[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 12:58:11.915136   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:41197
I20260709 12:58:11.917086   431 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 12:58:11.918231   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:58:11.936126   438 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:11.937821   440 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:11.936245   437 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:13.082182   439 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1145 milliseconds
I20260709 12:58:13.082356   431 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260709 12:58:13.083627   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:58:13.083858   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:58:13.084059   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601893084035 us; error 0 us; skew 500 ppm
I20260709 12:58:13.084861   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:58:13.091076   431 webserver.cc:533] Webserver started at http://127.0.107.254:38485/ using document root <none> and password file <none>
I20260709 12:58:13.091984   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:58:13.092209   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:58:13.092666   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:58:13.099006   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601891739070-431-0/minicluster-data/master-0-root/instance:
uuid: "4732e33b355a4564877e4067c535862e"
format_stamp: "Formatted at 2026-07-09 12:58:13 on dist-test-slave-qzg2"
I20260709 12:58:13.106875   431 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.007s	sys 0.001s
I20260709 12:58:13.112017   446 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:13.113745   431 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:58:13.114130   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601891739070-431-0/minicluster-data/master-0-root
uuid: "4732e33b355a4564877e4067c535862e"
format_stamp: "Formatted at 2026-07-09 12:58:13 on dist-test-slave-qzg2"
I20260709 12:58:13.114499   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601891739070-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601891739070-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601891739070-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:58:13.167533   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:58:13.169119   431 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 12:58:13.169593   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:58:13.249917   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:41197
I20260709 12:58:13.249990   497 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:41197 every 8 connection(s)
I20260709 12:58:13.258286   498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:13.281219   498 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4732e33b355a4564877e4067c535862e: Bootstrap starting.
I20260709 12:58:13.287631   498 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4732e33b355a4564877e4067c535862e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:13.289786   498 log.cc:826] T 00000000000000000000000000000000 P 4732e33b355a4564877e4067c535862e: Log is configured to *not* fsync() on all Append() calls
I20260709 12:58:13.295068   498 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4732e33b355a4564877e4067c535862e: No bootstrap required, opened a new log
I20260709 12:58:13.316757   498 raft_consensus.cc:359] T 00000000000000000000000000000000 P 4732e33b355a4564877e4067c535862e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4732e33b355a4564877e4067c535862e" member_type: VOTER }
I20260709 12:58:13.317332   498 raft_consensus.cc:385] T 00000000000000000000000000000000 P 4732e33b355a4564877e4067c535862e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:13.317711   498 raft_consensus.cc:740] T 00000000000000000000000000000000 P 4732e33b355a4564877e4067c535862e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4732e33b355a4564877e4067c535862e, State: Initialized, Role: FOLLOWER
I20260709 12:58:13.318750   498 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4732e33b355a4564877e4067c535862e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4732e33b355a4564877e4067c535862e" member_type: VOTER }
I20260709 12:58:13.319268   498 raft_consensus.cc:399] T 00000000000000000000000000000000 P 4732e33b355a4564877e4067c535862e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:58:13.319562   498 raft_consensus.cc:493] T 00000000000000000000000000000000 P 4732e33b355a4564877e4067c535862e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:58:13.319921   498 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 4732e33b355a4564877e4067c535862e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:13.324476   498 raft_consensus.cc:515] T 00000000000000000000000000000000 P 4732e33b355a4564877e4067c535862e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4732e33b355a4564877e4067c535862e" member_type: VOTER }
I20260709 12:58:13.325286   498 leader_election.cc:304] T 00000000000000000000000000000000 P 4732e33b355a4564877e4067c535862e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4732e33b355a4564877e4067c535862e; no voters: 
I20260709 12:58:13.327376   498 leader_election.cc:290] T 00000000000000000000000000000000 P 4732e33b355a4564877e4067c535862e [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:58:13.327697   501 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 4732e33b355a4564877e4067c535862e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:13.330550   501 raft_consensus.cc:697] T 00000000000000000000000000000000 P 4732e33b355a4564877e4067c535862e [term 1 LEADER]: Becoming Leader. State: Replica: 4732e33b355a4564877e4067c535862e, State: Running, Role: LEADER
I20260709 12:58:13.331465   501 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4732e33b355a4564877e4067c535862e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4732e33b355a4564877e4067c535862e" member_type: VOTER }
I20260709 12:58:13.332922   498 sys_catalog.cc:565] T 00000000000000000000000000000000 P 4732e33b355a4564877e4067c535862e [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:58:13.343683   503 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4732e33b355a4564877e4067c535862e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4732e33b355a4564877e4067c535862e. Latest consensus state: current_term: 1 leader_uuid: "4732e33b355a4564877e4067c535862e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4732e33b355a4564877e4067c535862e" member_type: VOTER } }
I20260709 12:58:13.344506   503 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4732e33b355a4564877e4067c535862e [sys.catalog]: This master's current role is: LEADER
I20260709 12:58:13.344460   502 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4732e33b355a4564877e4067c535862e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4732e33b355a4564877e4067c535862e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4732e33b355a4564877e4067c535862e" member_type: VOTER } }
I20260709 12:58:13.345006   502 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4732e33b355a4564877e4067c535862e [sys.catalog]: This master's current role is: LEADER
I20260709 12:58:13.349052   510 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:58:13.362218   510 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:58:13.364796   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:58:13.381763   510 catalog_manager.cc:1383] Generated new cluster ID: b2a7f8cc3ace43ddb88e5db6b05e0e34
I20260709 12:58:13.382103   510 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:58:13.401131   510 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:58:13.402765   510 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:58:13.416003   510 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 4732e33b355a4564877e4067c535862e: Generated new TSK 0
I20260709 12:58:13.417032   510 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:58:13.432178   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:58:13.441607   520 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:13.445194   521 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:13.447456   523 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:58:13.448501   431 server_base.cc:1061] running on GCE node
I20260709 12:58:13.449348   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:58:13.449582   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:58:13.449771   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601893449745 us; error 0 us; skew 500 ppm
I20260709 12:58:13.450366   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:58:13.455111   431 webserver.cc:533] Webserver started at http://127.0.107.193:41917/ using document root <none> and password file <none>
I20260709 12:58:13.455667   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:58:13.455863   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:58:13.456144   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:58:13.457276   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601891739070-431-0/minicluster-data/ts-0-root/instance:
uuid: "1e6c65ade84442dba7b9e742f473df99"
format_stamp: "Formatted at 2026-07-09 12:58:13 on dist-test-slave-qzg2"
I20260709 12:58:13.463570   431 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.004s	sys 0.004s
I20260709 12:58:13.469231   528 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:13.470062   431 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:58:13.470364   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601891739070-431-0/minicluster-data/ts-0-root
uuid: "1e6c65ade84442dba7b9e742f473df99"
format_stamp: "Formatted at 2026-07-09 12:58:13 on dist-test-slave-qzg2"
I20260709 12:58:13.470681   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601891739070-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601891739070-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601891739070-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:58:13.489620   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:58:13.491460   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:58:13.494017   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:58:13.498644   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:58:13.498968   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 12:58:13.499239   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:58:13.499396   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:13.607530   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:44941
I20260709 12:58:13.607596   590 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:44941 every 8 connection(s)
I20260709 12:58:13.614357   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:58:13.626529   595 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:13.631260   596 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:58:13.637099   431 server_base.cc:1061] running on GCE node
W20260709 12:58:13.638291   598 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:58:13.639467   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:58:13.639747   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:58:13.639964   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601893639944 us; error 0 us; skew 500 ppm
I20260709 12:58:13.640759   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:58:13.645922   591 heartbeater.cc:344] Connected to a master server at 127.0.107.254:41197
I20260709 12:58:13.646469   591 heartbeater.cc:461] Registering TS with master...
I20260709 12:58:13.647114   431 webserver.cc:533] Webserver started at http://127.0.107.194:43731/ using document root <none> and password file <none>
I20260709 12:58:13.647732   591 heartbeater.cc:507] Master 127.0.107.254:41197 requested a full tablet report, sending...
I20260709 12:58:13.647972   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:58:13.648240   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:58:13.648662   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:58:13.650302   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601891739070-431-0/minicluster-data/ts-1-root/instance:
uuid: "65b5e378480c4387aee25f0bdfeb1e7e"
format_stamp: "Formatted at 2026-07-09 12:58:13 on dist-test-slave-qzg2"
I20260709 12:58:13.651410   463 ts_manager.cc:194] Registered new tserver with Master: 1e6c65ade84442dba7b9e742f473df99 (127.0.107.193:44941)
I20260709 12:58:13.654361   463 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38904
I20260709 12:58:13.657400   431 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:58:13.662899   603 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:13.663733   431 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:58:13.664004   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601891739070-431-0/minicluster-data/ts-1-root
uuid: "65b5e378480c4387aee25f0bdfeb1e7e"
format_stamp: "Formatted at 2026-07-09 12:58:13 on dist-test-slave-qzg2"
I20260709 12:58:13.664281   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601891739070-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601891739070-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601891739070-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:58:13.680574   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:58:13.681838   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:58:13.684818   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:58:13.687743   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:58:13.687930   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:13.688172   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:58:13.688323   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:13.794677   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:40689
I20260709 12:58:13.794904   665 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:40689 every 8 connection(s)
I20260709 12:58:13.800972   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:58:13.812812   669 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:13.815936   670 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:58:13.823940   666 heartbeater.cc:344] Connected to a master server at 127.0.107.254:41197
I20260709 12:58:13.824402   666 heartbeater.cc:461] Registering TS with master...
I20260709 12:58:13.825390   666 heartbeater.cc:507] Master 127.0.107.254:41197 requested a full tablet report, sending...
I20260709 12:58:13.827874   463 ts_manager.cc:194] Registered new tserver with Master: 65b5e378480c4387aee25f0bdfeb1e7e (127.0.107.194:40689)
I20260709 12:58:13.828146   431 server_base.cc:1061] running on GCE node
W20260709 12:58:13.828081   673 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:58:13.829687   463 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38916
I20260709 12:58:13.829860   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:58:13.830097   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:58:13.830298   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601893830279 us; error 0 us; skew 500 ppm
I20260709 12:58:13.830955   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:58:13.835153   431 webserver.cc:533] Webserver started at http://127.0.107.195:43335/ using document root <none> and password file <none>
I20260709 12:58:13.835671   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:58:13.835872   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:58:13.836126   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:58:13.837285   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601891739070-431-0/minicluster-data/ts-2-root/instance:
uuid: "5d1af4aed7da41e0b9f4f1e0f5621160"
format_stamp: "Formatted at 2026-07-09 12:58:13 on dist-test-slave-qzg2"
I20260709 12:58:13.841989   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:58:13.845422   677 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:13.846307   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:58:13.846603   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601891739070-431-0/minicluster-data/ts-2-root
uuid: "5d1af4aed7da41e0b9f4f1e0f5621160"
format_stamp: "Formatted at 2026-07-09 12:58:13 on dist-test-slave-qzg2"
I20260709 12:58:13.846928   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601891739070-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601891739070-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601891739070-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:58:13.867251   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:58:13.868463   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:58:13.869949   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:58:13.873849   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:58:13.874060   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:13.874325   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:58:13.874469   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:13.987516   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:44825
I20260709 12:58:13.987980   739 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:44825 every 8 connection(s)
I20260709 12:58:14.006309   740 heartbeater.cc:344] Connected to a master server at 127.0.107.254:41197
I20260709 12:58:14.006731   740 heartbeater.cc:461] Registering TS with master...
I20260709 12:58:14.007534   740 heartbeater.cc:507] Master 127.0.107.254:41197 requested a full tablet report, sending...
I20260709 12:58:14.009652   463 ts_manager.cc:194] Registered new tserver with Master: 5d1af4aed7da41e0b9f4f1e0f5621160 (127.0.107.195:44825)
I20260709 12:58:14.009778   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016950627s
I20260709 12:58:14.011475   463 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38920
I20260709 12:58:14.066243   463 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38924:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:58:14.070314   463 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:58:14.188972   631 tablet_service.cc:1511] Processing CreateTablet for tablet 811ff95e986542668558d35c387ec366 (DEFAULT_TABLE table=test-workload [id=06296cd0fb1447c296a26fd9a25ba534]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:58:14.188973   629 tablet_service.cc:1511] Processing CreateTablet for tablet c496907a8ecb49cc86a0784628ae42c9 (DEFAULT_TABLE table=test-workload [id=06296cd0fb1447c296a26fd9a25ba534]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:58:14.192953   630 tablet_service.cc:1511] Processing CreateTablet for tablet a10f7a7b26cf41d38030d1e80c6123ec (DEFAULT_TABLE table=test-workload [id=06296cd0fb1447c296a26fd9a25ba534]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:58:14.194880   628 tablet_service.cc:1511] Processing CreateTablet for tablet 2bec920f53cb42b785062112f132c67c (DEFAULT_TABLE table=test-workload [id=06296cd0fb1447c296a26fd9a25ba534]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:58:14.195914   631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 811ff95e986542668558d35c387ec366. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:14.196638   628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bec920f53cb42b785062112f132c67c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:14.199013   630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a10f7a7b26cf41d38030d1e80c6123ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:14.200493   629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c496907a8ecb49cc86a0784628ae42c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:14.201582   627 tablet_service.cc:1511] Processing CreateTablet for tablet 6c34d54dde1042f2a472ac8502703b79 (DEFAULT_TABLE table=test-workload [id=06296cd0fb1447c296a26fd9a25ba534]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:58:14.206130   627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c34d54dde1042f2a472ac8502703b79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:14.212736   626 tablet_service.cc:1511] Processing CreateTablet for tablet 82e303e6a0b74de68d18d26049e994ed (DEFAULT_TABLE table=test-workload [id=06296cd0fb1447c296a26fd9a25ba534]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:58:14.218909   626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82e303e6a0b74de68d18d26049e994ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:14.247838   625 tablet_service.cc:1511] Processing CreateTablet for tablet d45270a45bb746e597d1d6ee3744b0b7 (DEFAULT_TABLE table=test-workload [id=06296cd0fb1447c296a26fd9a25ba534]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:58:14.250095   625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d45270a45bb746e597d1d6ee3744b0b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:14.262892   556 tablet_service.cc:1511] Processing CreateTablet for tablet 811ff95e986542668558d35c387ec366 (DEFAULT_TABLE table=test-workload [id=06296cd0fb1447c296a26fd9a25ba534]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:58:14.269224   553 tablet_service.cc:1511] Processing CreateTablet for tablet 2bec920f53cb42b785062112f132c67c (DEFAULT_TABLE table=test-workload [id=06296cd0fb1447c296a26fd9a25ba534]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:58:14.274955   552 tablet_service.cc:1511] Processing CreateTablet for tablet 6c34d54dde1042f2a472ac8502703b79 (DEFAULT_TABLE table=test-workload [id=06296cd0fb1447c296a26fd9a25ba534]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:58:14.276399   554 tablet_service.cc:1511] Processing CreateTablet for tablet c496907a8ecb49cc86a0784628ae42c9 (DEFAULT_TABLE table=test-workload [id=06296cd0fb1447c296a26fd9a25ba534]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:58:14.264127   624 tablet_service.cc:1511] Processing CreateTablet for tablet 87ceba987e5d48ba916d5e869e2a03b6 (DEFAULT_TABLE table=test-workload [id=06296cd0fb1447c296a26fd9a25ba534]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:58:14.278333   556 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 811ff95e986542668558d35c387ec366. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:14.268667   555 tablet_service.cc:1511] Processing CreateTablet for tablet a10f7a7b26cf41d38030d1e80c6123ec (DEFAULT_TABLE table=test-workload [id=06296cd0fb1447c296a26fd9a25ba534]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:58:14.285130   555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a10f7a7b26cf41d38030d1e80c6123ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:14.285267   624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87ceba987e5d48ba916d5e869e2a03b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:14.294909   551 tablet_service.cc:1511] Processing CreateTablet for tablet 82e303e6a0b74de68d18d26049e994ed (DEFAULT_TABLE table=test-workload [id=06296cd0fb1447c296a26fd9a25ba534]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:58:14.295953   705 tablet_service.cc:1511] Processing CreateTablet for tablet 811ff95e986542668558d35c387ec366 (DEFAULT_TABLE table=test-workload [id=06296cd0fb1447c296a26fd9a25ba534]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:58:14.306955   703 tablet_service.cc:1511] Processing CreateTablet for tablet c496907a8ecb49cc86a0784628ae42c9 (DEFAULT_TABLE table=test-workload [id=06296cd0fb1447c296a26fd9a25ba534]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:58:14.300118   550 tablet_service.cc:1511] Processing CreateTablet for tablet d45270a45bb746e597d1d6ee3744b0b7 (DEFAULT_TABLE table=test-workload [id=06296cd0fb1447c296a26fd9a25ba534]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:58:14.309538   552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c34d54dde1042f2a472ac8502703b79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:14.316043   549 tablet_service.cc:1511] Processing CreateTablet for tablet 87ceba987e5d48ba916d5e869e2a03b6 (DEFAULT_TABLE table=test-workload [id=06296cd0fb1447c296a26fd9a25ba534]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:58:14.317476   705 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 811ff95e986542668558d35c387ec366. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:14.318020   551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82e303e6a0b74de68d18d26049e994ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:14.316082   702 tablet_service.cc:1511] Processing CreateTablet for tablet 2bec920f53cb42b785062112f132c67c (DEFAULT_TABLE table=test-workload [id=06296cd0fb1447c296a26fd9a25ba534]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:58:14.321640   704 tablet_service.cc:1511] Processing CreateTablet for tablet a10f7a7b26cf41d38030d1e80c6123ec (DEFAULT_TABLE table=test-workload [id=06296cd0fb1447c296a26fd9a25ba534]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:58:14.332070   550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d45270a45bb746e597d1d6ee3744b0b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:14.335439   703 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c496907a8ecb49cc86a0784628ae42c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:14.341310   700 tablet_service.cc:1511] Processing CreateTablet for tablet 82e303e6a0b74de68d18d26049e994ed (DEFAULT_TABLE table=test-workload [id=06296cd0fb1447c296a26fd9a25ba534]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:58:14.342901   699 tablet_service.cc:1511] Processing CreateTablet for tablet d45270a45bb746e597d1d6ee3744b0b7 (DEFAULT_TABLE table=test-workload [id=06296cd0fb1447c296a26fd9a25ba534]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:58:14.340662   549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87ceba987e5d48ba916d5e869e2a03b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:14.347218   702 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bec920f53cb42b785062112f132c67c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:14.355894   701 tablet_service.cc:1511] Processing CreateTablet for tablet 6c34d54dde1042f2a472ac8502703b79 (DEFAULT_TABLE table=test-workload [id=06296cd0fb1447c296a26fd9a25ba534]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:58:14.356076   698 tablet_service.cc:1511] Processing CreateTablet for tablet 87ceba987e5d48ba916d5e869e2a03b6 (DEFAULT_TABLE table=test-workload [id=06296cd0fb1447c296a26fd9a25ba534]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:58:14.349872   623 tablet_service.cc:1511] Processing CreateTablet for tablet 51a60c5b8c0c485ebd1fabea4a3457ef (DEFAULT_TABLE table=test-workload [id=06296cd0fb1447c296a26fd9a25ba534]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
W20260709 12:58:14.359297   511 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:58:14.360729   554 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c496907a8ecb49cc86a0784628ae42c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:14.354746   548 tablet_service.cc:1511] Processing CreateTablet for tablet 51a60c5b8c0c485ebd1fabea4a3457ef (DEFAULT_TABLE table=test-workload [id=06296cd0fb1447c296a26fd9a25ba534]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:58:14.359321   699 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d45270a45bb746e597d1d6ee3744b0b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:14.365392   697 tablet_service.cc:1511] Processing CreateTablet for tablet 51a60c5b8c0c485ebd1fabea4a3457ef (DEFAULT_TABLE table=test-workload [id=06296cd0fb1447c296a26fd9a25ba534]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:58:14.367538   701 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c34d54dde1042f2a472ac8502703b79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:14.365988   623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51a60c5b8c0c485ebd1fabea4a3457ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:14.370846   758 tablet_bootstrap.cc:492] T 2bec920f53cb42b785062112f132c67c P 65b5e378480c4387aee25f0bdfeb1e7e: Bootstrap starting.
I20260709 12:58:14.372243   698 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87ceba987e5d48ba916d5e869e2a03b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:14.372298   553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bec920f53cb42b785062112f132c67c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:14.374809   697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51a60c5b8c0c485ebd1fabea4a3457ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:14.377149   548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51a60c5b8c0c485ebd1fabea4a3457ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:14.380873   700 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82e303e6a0b74de68d18d26049e994ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:14.402834   704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a10f7a7b26cf41d38030d1e80c6123ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:14.489953   758 tablet_bootstrap.cc:654] T 2bec920f53cb42b785062112f132c67c P 65b5e378480c4387aee25f0bdfeb1e7e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:14.550884   758 tablet_bootstrap.cc:492] T 2bec920f53cb42b785062112f132c67c P 65b5e378480c4387aee25f0bdfeb1e7e: No bootstrap required, opened a new log
I20260709 12:58:14.551414   758 ts_tablet_manager.cc:1403] T 2bec920f53cb42b785062112f132c67c P 65b5e378480c4387aee25f0bdfeb1e7e: Time spent bootstrapping tablet: real 0.205s	user 0.008s	sys 0.020s
I20260709 12:58:14.589633   760 tablet_bootstrap.cc:492] T 6c34d54dde1042f2a472ac8502703b79 P 1e6c65ade84442dba7b9e742f473df99: Bootstrap starting.
I20260709 12:58:14.620788   758 raft_consensus.cc:359] T 2bec920f53cb42b785062112f132c67c P 65b5e378480c4387aee25f0bdfeb1e7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:14.624185   758 raft_consensus.cc:385] T 2bec920f53cb42b785062112f132c67c P 65b5e378480c4387aee25f0bdfeb1e7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:14.624493   758 raft_consensus.cc:740] T 2bec920f53cb42b785062112f132c67c P 65b5e378480c4387aee25f0bdfeb1e7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65b5e378480c4387aee25f0bdfeb1e7e, State: Initialized, Role: FOLLOWER
I20260709 12:58:14.625156   758 consensus_queue.cc:260] T 2bec920f53cb42b785062112f132c67c P 65b5e378480c4387aee25f0bdfeb1e7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:14.637188   758 ts_tablet_manager.cc:1434] T 2bec920f53cb42b785062112f132c67c P 65b5e378480c4387aee25f0bdfeb1e7e: Time spent starting tablet: real 0.085s	user 0.014s	sys 0.013s
I20260709 12:58:14.637939   666 heartbeater.cc:499] Master 127.0.107.254:41197 was elected leader, sending a full tablet report...
I20260709 12:58:14.638217   758 tablet_bootstrap.cc:492] T 82e303e6a0b74de68d18d26049e994ed P 65b5e378480c4387aee25f0bdfeb1e7e: Bootstrap starting.
I20260709 12:58:14.649130   760 tablet_bootstrap.cc:654] T 6c34d54dde1042f2a472ac8502703b79 P 1e6c65ade84442dba7b9e742f473df99: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:14.656769   761 tablet_bootstrap.cc:492] T 811ff95e986542668558d35c387ec366 P 5d1af4aed7da41e0b9f4f1e0f5621160: Bootstrap starting.
I20260709 12:58:14.659210   591 heartbeater.cc:499] Master 127.0.107.254:41197 was elected leader, sending a full tablet report...
I20260709 12:58:14.669253   761 tablet_bootstrap.cc:654] T 811ff95e986542668558d35c387ec366 P 5d1af4aed7da41e0b9f4f1e0f5621160: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:14.669281   758 tablet_bootstrap.cc:654] T 82e303e6a0b74de68d18d26049e994ed P 65b5e378480c4387aee25f0bdfeb1e7e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:14.678331   760 tablet_bootstrap.cc:492] T 6c34d54dde1042f2a472ac8502703b79 P 1e6c65ade84442dba7b9e742f473df99: No bootstrap required, opened a new log
I20260709 12:58:14.678912   760 ts_tablet_manager.cc:1403] T 6c34d54dde1042f2a472ac8502703b79 P 1e6c65ade84442dba7b9e742f473df99: Time spent bootstrapping tablet: real 0.090s	user 0.013s	sys 0.007s
I20260709 12:58:14.688480   760 raft_consensus.cc:359] T 6c34d54dde1042f2a472ac8502703b79 P 1e6c65ade84442dba7b9e742f473df99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:14.689891   760 raft_consensus.cc:385] T 6c34d54dde1042f2a472ac8502703b79 P 1e6c65ade84442dba7b9e742f473df99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:14.690284   760 raft_consensus.cc:740] T 6c34d54dde1042f2a472ac8502703b79 P 1e6c65ade84442dba7b9e742f473df99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e6c65ade84442dba7b9e742f473df99, State: Initialized, Role: FOLLOWER
I20260709 12:58:14.691169   760 consensus_queue.cc:260] T 6c34d54dde1042f2a472ac8502703b79 P 1e6c65ade84442dba7b9e742f473df99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:14.689565   761 tablet_bootstrap.cc:492] T 811ff95e986542668558d35c387ec366 P 5d1af4aed7da41e0b9f4f1e0f5621160: No bootstrap required, opened a new log
I20260709 12:58:14.692709   761 ts_tablet_manager.cc:1403] T 811ff95e986542668558d35c387ec366 P 5d1af4aed7da41e0b9f4f1e0f5621160: Time spent bootstrapping tablet: real 0.065s	user 0.019s	sys 0.003s
I20260709 12:58:14.694868   761 raft_consensus.cc:359] T 811ff95e986542668558d35c387ec366 P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:14.695669   761 raft_consensus.cc:385] T 811ff95e986542668558d35c387ec366 P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:14.695979   761 raft_consensus.cc:740] T 811ff95e986542668558d35c387ec366 P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d1af4aed7da41e0b9f4f1e0f5621160, State: Initialized, Role: FOLLOWER
I20260709 12:58:14.696745   761 consensus_queue.cc:260] T 811ff95e986542668558d35c387ec366 P 5d1af4aed7da41e0b9f4f1e0f5621160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:14.701313   758 tablet_bootstrap.cc:492] T 82e303e6a0b74de68d18d26049e994ed P 65b5e378480c4387aee25f0bdfeb1e7e: No bootstrap required, opened a new log
I20260709 12:58:14.701821   758 ts_tablet_manager.cc:1403] T 82e303e6a0b74de68d18d26049e994ed P 65b5e378480c4387aee25f0bdfeb1e7e: Time spent bootstrapping tablet: real 0.064s	user 0.019s	sys 0.003s
I20260709 12:58:14.704695   758 raft_consensus.cc:359] T 82e303e6a0b74de68d18d26049e994ed P 65b5e378480c4387aee25f0bdfeb1e7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:14.705431   758 raft_consensus.cc:385] T 82e303e6a0b74de68d18d26049e994ed P 65b5e378480c4387aee25f0bdfeb1e7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:14.705761   758 raft_consensus.cc:740] T 82e303e6a0b74de68d18d26049e994ed P 65b5e378480c4387aee25f0bdfeb1e7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65b5e378480c4387aee25f0bdfeb1e7e, State: Initialized, Role: FOLLOWER
I20260709 12:58:14.706465   758 consensus_queue.cc:260] T 82e303e6a0b74de68d18d26049e994ed P 65b5e378480c4387aee25f0bdfeb1e7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:14.708827   758 ts_tablet_manager.cc:1434] T 82e303e6a0b74de68d18d26049e994ed P 65b5e378480c4387aee25f0bdfeb1e7e: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:58:14.709748   758 tablet_bootstrap.cc:492] T 6c34d54dde1042f2a472ac8502703b79 P 65b5e378480c4387aee25f0bdfeb1e7e: Bootstrap starting.
I20260709 12:58:14.711635   740 heartbeater.cc:499] Master 127.0.107.254:41197 was elected leader, sending a full tablet report...
I20260709 12:58:14.712209   761 ts_tablet_manager.cc:1434] T 811ff95e986542668558d35c387ec366 P 5d1af4aed7da41e0b9f4f1e0f5621160: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.014s
I20260709 12:58:14.713390   761 tablet_bootstrap.cc:492] T a10f7a7b26cf41d38030d1e80c6123ec P 5d1af4aed7da41e0b9f4f1e0f5621160: Bootstrap starting.
I20260709 12:58:14.718259   760 ts_tablet_manager.cc:1434] T 6c34d54dde1042f2a472ac8502703b79 P 1e6c65ade84442dba7b9e742f473df99: Time spent starting tablet: real 0.039s	user 0.012s	sys 0.000s
I20260709 12:58:14.719744   758 tablet_bootstrap.cc:654] T 6c34d54dde1042f2a472ac8502703b79 P 65b5e378480c4387aee25f0bdfeb1e7e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:14.723904   760 tablet_bootstrap.cc:492] T a10f7a7b26cf41d38030d1e80c6123ec P 1e6c65ade84442dba7b9e742f473df99: Bootstrap starting.
I20260709 12:58:14.730898   760 tablet_bootstrap.cc:654] T a10f7a7b26cf41d38030d1e80c6123ec P 1e6c65ade84442dba7b9e742f473df99: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:14.734019   758 tablet_bootstrap.cc:492] T 6c34d54dde1042f2a472ac8502703b79 P 65b5e378480c4387aee25f0bdfeb1e7e: No bootstrap required, opened a new log
I20260709 12:58:14.734498   758 ts_tablet_manager.cc:1403] T 6c34d54dde1042f2a472ac8502703b79 P 65b5e378480c4387aee25f0bdfeb1e7e: Time spent bootstrapping tablet: real 0.025s	user 0.008s	sys 0.008s
I20260709 12:58:14.735124   761 tablet_bootstrap.cc:654] T a10f7a7b26cf41d38030d1e80c6123ec P 5d1af4aed7da41e0b9f4f1e0f5621160: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:14.737247   758 raft_consensus.cc:359] T 6c34d54dde1042f2a472ac8502703b79 P 65b5e378480c4387aee25f0bdfeb1e7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:14.738003   758 raft_consensus.cc:385] T 6c34d54dde1042f2a472ac8502703b79 P 65b5e378480c4387aee25f0bdfeb1e7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:14.738291   758 raft_consensus.cc:740] T 6c34d54dde1042f2a472ac8502703b79 P 65b5e378480c4387aee25f0bdfeb1e7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65b5e378480c4387aee25f0bdfeb1e7e, State: Initialized, Role: FOLLOWER
I20260709 12:58:14.739017   758 consensus_queue.cc:260] T 6c34d54dde1042f2a472ac8502703b79 P 65b5e378480c4387aee25f0bdfeb1e7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:14.741549   758 ts_tablet_manager.cc:1434] T 6c34d54dde1042f2a472ac8502703b79 P 65b5e378480c4387aee25f0bdfeb1e7e: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:58:14.742424   762 raft_consensus.cc:493] T 82e303e6a0b74de68d18d26049e994ed P 65b5e378480c4387aee25f0bdfeb1e7e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:14.742930   762 raft_consensus.cc:515] T 82e303e6a0b74de68d18d26049e994ed P 65b5e378480c4387aee25f0bdfeb1e7e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:14.745836   762 leader_election.cc:290] T 82e303e6a0b74de68d18d26049e994ed P 65b5e378480c4387aee25f0bdfeb1e7e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e6c65ade84442dba7b9e742f473df99 (127.0.107.193:44941), 5d1af4aed7da41e0b9f4f1e0f5621160 (127.0.107.195:44825)
W20260709 12:58:14.746336   741 tablet.cc:2406] T 811ff95e986542668558d35c387ec366 P 5d1af4aed7da41e0b9f4f1e0f5621160: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:58:14.746718   758 tablet_bootstrap.cc:492] T 811ff95e986542668558d35c387ec366 P 65b5e378480c4387aee25f0bdfeb1e7e: Bootstrap starting.
I20260709 12:58:14.762725   758 tablet_bootstrap.cc:654] T 811ff95e986542668558d35c387ec366 P 65b5e378480c4387aee25f0bdfeb1e7e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:14.764359   760 tablet_bootstrap.cc:492] T a10f7a7b26cf41d38030d1e80c6123ec P 1e6c65ade84442dba7b9e742f473df99: No bootstrap required, opened a new log
I20260709 12:58:14.764983   760 ts_tablet_manager.cc:1403] T a10f7a7b26cf41d38030d1e80c6123ec P 1e6c65ade84442dba7b9e742f473df99: Time spent bootstrapping tablet: real 0.041s	user 0.008s	sys 0.010s
I20260709 12:58:14.769073   760 raft_consensus.cc:359] T a10f7a7b26cf41d38030d1e80c6123ec P 1e6c65ade84442dba7b9e742f473df99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:14.778299   760 raft_consensus.cc:385] T a10f7a7b26cf41d38030d1e80c6123ec P 1e6c65ade84442dba7b9e742f473df99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:14.775789   761 tablet_bootstrap.cc:492] T a10f7a7b26cf41d38030d1e80c6123ec P 5d1af4aed7da41e0b9f4f1e0f5621160: No bootstrap required, opened a new log
I20260709 12:58:14.778759   760 raft_consensus.cc:740] T a10f7a7b26cf41d38030d1e80c6123ec P 1e6c65ade84442dba7b9e742f473df99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e6c65ade84442dba7b9e742f473df99, State: Initialized, Role: FOLLOWER
I20260709 12:58:14.779078   761 ts_tablet_manager.cc:1403] T a10f7a7b26cf41d38030d1e80c6123ec P 5d1af4aed7da41e0b9f4f1e0f5621160: Time spent bootstrapping tablet: real 0.066s	user 0.016s	sys 0.017s
I20260709 12:58:14.779906   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e303e6a0b74de68d18d26049e994ed" candidate_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e6c65ade84442dba7b9e742f473df99" is_pre_election: true
I20260709 12:58:14.780059   760 consensus_queue.cc:260] T a10f7a7b26cf41d38030d1e80c6123ec P 1e6c65ade84442dba7b9e742f473df99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
W20260709 12:58:14.781996   605 leader_election.cc:343] T 82e303e6a0b74de68d18d26049e994ed P 65b5e378480c4387aee25f0bdfeb1e7e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e6c65ade84442dba7b9e742f473df99 (127.0.107.193:44941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:14.782743   761 raft_consensus.cc:359] T a10f7a7b26cf41d38030d1e80c6123ec P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:14.783468   761 raft_consensus.cc:385] T a10f7a7b26cf41d38030d1e80c6123ec P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:14.783782   761 raft_consensus.cc:740] T a10f7a7b26cf41d38030d1e80c6123ec P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d1af4aed7da41e0b9f4f1e0f5621160, State: Initialized, Role: FOLLOWER
I20260709 12:58:14.784819   761 consensus_queue.cc:260] T a10f7a7b26cf41d38030d1e80c6123ec P 5d1af4aed7da41e0b9f4f1e0f5621160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:14.788635   758 tablet_bootstrap.cc:492] T 811ff95e986542668558d35c387ec366 P 65b5e378480c4387aee25f0bdfeb1e7e: No bootstrap required, opened a new log
I20260709 12:58:14.789165   758 ts_tablet_manager.cc:1403] T 811ff95e986542668558d35c387ec366 P 65b5e378480c4387aee25f0bdfeb1e7e: Time spent bootstrapping tablet: real 0.043s	user 0.016s	sys 0.008s
I20260709 12:58:14.788394   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e303e6a0b74de68d18d26049e994ed" candidate_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" is_pre_election: true
W20260709 12:58:14.791249   605 leader_election.cc:343] T 82e303e6a0b74de68d18d26049e994ed P 65b5e378480c4387aee25f0bdfeb1e7e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d1af4aed7da41e0b9f4f1e0f5621160 (127.0.107.195:44825): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:14.791692   605 leader_election.cc:304] T 82e303e6a0b74de68d18d26049e994ed P 65b5e378480c4387aee25f0bdfeb1e7e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65b5e378480c4387aee25f0bdfeb1e7e; no voters: 1e6c65ade84442dba7b9e742f473df99, 5d1af4aed7da41e0b9f4f1e0f5621160
I20260709 12:58:14.792526   762 raft_consensus.cc:2749] T 82e303e6a0b74de68d18d26049e994ed P 65b5e378480c4387aee25f0bdfeb1e7e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:14.792224   758 raft_consensus.cc:359] T 811ff95e986542668558d35c387ec366 P 65b5e378480c4387aee25f0bdfeb1e7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:14.792868   761 ts_tablet_manager.cc:1434] T a10f7a7b26cf41d38030d1e80c6123ec P 5d1af4aed7da41e0b9f4f1e0f5621160: Time spent starting tablet: real 0.013s	user 0.001s	sys 0.005s
I20260709 12:58:14.793001   758 raft_consensus.cc:385] T 811ff95e986542668558d35c387ec366 P 65b5e378480c4387aee25f0bdfeb1e7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:14.793360   758 raft_consensus.cc:740] T 811ff95e986542668558d35c387ec366 P 65b5e378480c4387aee25f0bdfeb1e7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65b5e378480c4387aee25f0bdfeb1e7e, State: Initialized, Role: FOLLOWER
I20260709 12:58:14.794133   758 consensus_queue.cc:260] T 811ff95e986542668558d35c387ec366 P 65b5e378480c4387aee25f0bdfeb1e7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:14.794950   760 ts_tablet_manager.cc:1434] T a10f7a7b26cf41d38030d1e80c6123ec P 1e6c65ade84442dba7b9e742f473df99: Time spent starting tablet: real 0.030s	user 0.005s	sys 0.003s
I20260709 12:58:14.796555   758 ts_tablet_manager.cc:1434] T 811ff95e986542668558d35c387ec366 P 65b5e378480c4387aee25f0bdfeb1e7e: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 12:58:14.797613   758 tablet_bootstrap.cc:492] T c496907a8ecb49cc86a0784628ae42c9 P 65b5e378480c4387aee25f0bdfeb1e7e: Bootstrap starting.
I20260709 12:58:14.800307   761 tablet_bootstrap.cc:492] T 51a60c5b8c0c485ebd1fabea4a3457ef P 5d1af4aed7da41e0b9f4f1e0f5621160: Bootstrap starting.
I20260709 12:58:14.805380   758 tablet_bootstrap.cc:654] T c496907a8ecb49cc86a0784628ae42c9 P 65b5e378480c4387aee25f0bdfeb1e7e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:14.807905   761 tablet_bootstrap.cc:654] T 51a60c5b8c0c485ebd1fabea4a3457ef P 5d1af4aed7da41e0b9f4f1e0f5621160: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:14.809768   760 tablet_bootstrap.cc:492] T 51a60c5b8c0c485ebd1fabea4a3457ef P 1e6c65ade84442dba7b9e742f473df99: Bootstrap starting.
I20260709 12:58:14.817127   760 tablet_bootstrap.cc:654] T 51a60c5b8c0c485ebd1fabea4a3457ef P 1e6c65ade84442dba7b9e742f473df99: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:14.829768   761 tablet_bootstrap.cc:492] T 51a60c5b8c0c485ebd1fabea4a3457ef P 5d1af4aed7da41e0b9f4f1e0f5621160: No bootstrap required, opened a new log
I20260709 12:58:14.830269   761 ts_tablet_manager.cc:1403] T 51a60c5b8c0c485ebd1fabea4a3457ef P 5d1af4aed7da41e0b9f4f1e0f5621160: Time spent bootstrapping tablet: real 0.030s	user 0.007s	sys 0.015s
I20260709 12:58:14.831220   758 tablet_bootstrap.cc:492] T c496907a8ecb49cc86a0784628ae42c9 P 65b5e378480c4387aee25f0bdfeb1e7e: No bootstrap required, opened a new log
I20260709 12:58:14.831727   758 ts_tablet_manager.cc:1403] T c496907a8ecb49cc86a0784628ae42c9 P 65b5e378480c4387aee25f0bdfeb1e7e: Time spent bootstrapping tablet: real 0.034s	user 0.018s	sys 0.012s
I20260709 12:58:14.833333   761 raft_consensus.cc:359] T 51a60c5b8c0c485ebd1fabea4a3457ef P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:14.834049   761 raft_consensus.cc:385] T 51a60c5b8c0c485ebd1fabea4a3457ef P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:14.834348   761 raft_consensus.cc:740] T 51a60c5b8c0c485ebd1fabea4a3457ef P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d1af4aed7da41e0b9f4f1e0f5621160, State: Initialized, Role: FOLLOWER
I20260709 12:58:14.835265   758 raft_consensus.cc:359] T c496907a8ecb49cc86a0784628ae42c9 P 65b5e378480c4387aee25f0bdfeb1e7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:14.835491   761 consensus_queue.cc:260] T 51a60c5b8c0c485ebd1fabea4a3457ef P 5d1af4aed7da41e0b9f4f1e0f5621160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:14.836064   758 raft_consensus.cc:385] T c496907a8ecb49cc86a0784628ae42c9 P 65b5e378480c4387aee25f0bdfeb1e7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:14.837800   760 tablet_bootstrap.cc:492] T 51a60c5b8c0c485ebd1fabea4a3457ef P 1e6c65ade84442dba7b9e742f473df99: No bootstrap required, opened a new log
I20260709 12:58:14.838011   761 ts_tablet_manager.cc:1434] T 51a60c5b8c0c485ebd1fabea4a3457ef P 5d1af4aed7da41e0b9f4f1e0f5621160: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.006s
I20260709 12:58:14.838336   760 ts_tablet_manager.cc:1403] T 51a60c5b8c0c485ebd1fabea4a3457ef P 1e6c65ade84442dba7b9e742f473df99: Time spent bootstrapping tablet: real 0.029s	user 0.014s	sys 0.012s
I20260709 12:58:14.839013   761 tablet_bootstrap.cc:492] T 6c34d54dde1042f2a472ac8502703b79 P 5d1af4aed7da41e0b9f4f1e0f5621160: Bootstrap starting.
I20260709 12:58:14.841607   760 raft_consensus.cc:359] T 51a60c5b8c0c485ebd1fabea4a3457ef P 1e6c65ade84442dba7b9e742f473df99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:14.836381   758 raft_consensus.cc:740] T c496907a8ecb49cc86a0784628ae42c9 P 65b5e378480c4387aee25f0bdfeb1e7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65b5e378480c4387aee25f0bdfeb1e7e, State: Initialized, Role: FOLLOWER
I20260709 12:58:14.842439   760 raft_consensus.cc:385] T 51a60c5b8c0c485ebd1fabea4a3457ef P 1e6c65ade84442dba7b9e742f473df99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:14.842846   760 raft_consensus.cc:740] T 51a60c5b8c0c485ebd1fabea4a3457ef P 1e6c65ade84442dba7b9e742f473df99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e6c65ade84442dba7b9e742f473df99, State: Initialized, Role: FOLLOWER
I20260709 12:58:14.843648   760 consensus_queue.cc:260] T 51a60c5b8c0c485ebd1fabea4a3457ef P 1e6c65ade84442dba7b9e742f473df99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:14.846304   760 ts_tablet_manager.cc:1434] T 51a60c5b8c0c485ebd1fabea4a3457ef P 1e6c65ade84442dba7b9e742f473df99: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.004s
I20260709 12:58:14.847329   760 tablet_bootstrap.cc:492] T 811ff95e986542668558d35c387ec366 P 1e6c65ade84442dba7b9e742f473df99: Bootstrap starting.
I20260709 12:58:14.843209   758 consensus_queue.cc:260] T c496907a8ecb49cc86a0784628ae42c9 P 65b5e378480c4387aee25f0bdfeb1e7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:14.854631   758 ts_tablet_manager.cc:1434] T c496907a8ecb49cc86a0784628ae42c9 P 65b5e378480c4387aee25f0bdfeb1e7e: Time spent starting tablet: real 0.023s	user 0.003s	sys 0.004s
I20260709 12:58:14.855664   758 tablet_bootstrap.cc:492] T d45270a45bb746e597d1d6ee3744b0b7 P 65b5e378480c4387aee25f0bdfeb1e7e: Bootstrap starting.
I20260709 12:58:14.856135   760 tablet_bootstrap.cc:654] T 811ff95e986542668558d35c387ec366 P 1e6c65ade84442dba7b9e742f473df99: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:14.860621   766 raft_consensus.cc:493] T 6c34d54dde1042f2a472ac8502703b79 P 1e6c65ade84442dba7b9e742f473df99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:14.861145   766 raft_consensus.cc:515] T 6c34d54dde1042f2a472ac8502703b79 P 1e6c65ade84442dba7b9e742f473df99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:14.862453   758 tablet_bootstrap.cc:654] T d45270a45bb746e597d1d6ee3744b0b7 P 65b5e378480c4387aee25f0bdfeb1e7e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:14.864571   766 leader_election.cc:290] T 6c34d54dde1042f2a472ac8502703b79 P 1e6c65ade84442dba7b9e742f473df99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65b5e378480c4387aee25f0bdfeb1e7e (127.0.107.194:40689), 5d1af4aed7da41e0b9f4f1e0f5621160 (127.0.107.195:44825)
I20260709 12:58:14.873569   767 raft_consensus.cc:493] T 51a60c5b8c0c485ebd1fabea4a3457ef P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:14.874198   767 raft_consensus.cc:515] T 51a60c5b8c0c485ebd1fabea4a3457ef P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:14.875576   761 tablet_bootstrap.cc:654] T 6c34d54dde1042f2a472ac8502703b79 P 5d1af4aed7da41e0b9f4f1e0f5621160: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:14.878122   767 leader_election.cc:290] T 51a60c5b8c0c485ebd1fabea4a3457ef P 5d1af4aed7da41e0b9f4f1e0f5621160 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e6c65ade84442dba7b9e742f473df99 (127.0.107.193:44941), 65b5e378480c4387aee25f0bdfeb1e7e (127.0.107.194:40689)
I20260709 12:58:14.891145   762 raft_consensus.cc:493] T 6c34d54dde1042f2a472ac8502703b79 P 65b5e378480c4387aee25f0bdfeb1e7e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:14.892827   762 raft_consensus.cc:515] T 6c34d54dde1042f2a472ac8502703b79 P 65b5e378480c4387aee25f0bdfeb1e7e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:14.909462   762 leader_election.cc:290] T 6c34d54dde1042f2a472ac8502703b79 P 65b5e378480c4387aee25f0bdfeb1e7e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e6c65ade84442dba7b9e742f473df99 (127.0.107.193:44941), 5d1af4aed7da41e0b9f4f1e0f5621160 (127.0.107.195:44825)
I20260709 12:58:14.911903   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c34d54dde1042f2a472ac8502703b79" candidate_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e6c65ade84442dba7b9e742f473df99" is_pre_election: true
I20260709 12:58:14.913072   566 raft_consensus.cc:2468] T 6c34d54dde1042f2a472ac8502703b79 P 1e6c65ade84442dba7b9e742f473df99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65b5e378480c4387aee25f0bdfeb1e7e in term 0.
I20260709 12:58:14.915709   605 leader_election.cc:304] T 6c34d54dde1042f2a472ac8502703b79 P 65b5e378480c4387aee25f0bdfeb1e7e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e6c65ade84442dba7b9e742f473df99, 65b5e378480c4387aee25f0bdfeb1e7e; no voters: 
I20260709 12:58:14.919009   762 raft_consensus.cc:2804] T 6c34d54dde1042f2a472ac8502703b79 P 65b5e378480c4387aee25f0bdfeb1e7e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:14.919158   766 raft_consensus.cc:493] T a10f7a7b26cf41d38030d1e80c6123ec P 1e6c65ade84442dba7b9e742f473df99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:14.920331   766 raft_consensus.cc:515] T a10f7a7b26cf41d38030d1e80c6123ec P 1e6c65ade84442dba7b9e742f473df99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:14.920660   762 raft_consensus.cc:493] T 6c34d54dde1042f2a472ac8502703b79 P 65b5e378480c4387aee25f0bdfeb1e7e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:14.923135   762 raft_consensus.cc:3060] T 6c34d54dde1042f2a472ac8502703b79 P 65b5e378480c4387aee25f0bdfeb1e7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:14.925789   766 leader_election.cc:290] T a10f7a7b26cf41d38030d1e80c6123ec P 1e6c65ade84442dba7b9e742f473df99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65b5e378480c4387aee25f0bdfeb1e7e (127.0.107.194:40689), 5d1af4aed7da41e0b9f4f1e0f5621160 (127.0.107.195:44825)
I20260709 12:58:14.926733   766 raft_consensus.cc:493] T 51a60c5b8c0c485ebd1fabea4a3457ef P 1e6c65ade84442dba7b9e742f473df99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:14.928042   766 raft_consensus.cc:515] T 51a60c5b8c0c485ebd1fabea4a3457ef P 1e6c65ade84442dba7b9e742f473df99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:14.933125   760 tablet_bootstrap.cc:492] T 811ff95e986542668558d35c387ec366 P 1e6c65ade84442dba7b9e742f473df99: No bootstrap required, opened a new log
I20260709 12:58:14.933737   760 ts_tablet_manager.cc:1403] T 811ff95e986542668558d35c387ec366 P 1e6c65ade84442dba7b9e742f473df99: Time spent bootstrapping tablet: real 0.087s	user 0.026s	sys 0.013s
I20260709 12:58:14.932276   766 leader_election.cc:290] T 51a60c5b8c0c485ebd1fabea4a3457ef P 1e6c65ade84442dba7b9e742f473df99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65b5e378480c4387aee25f0bdfeb1e7e (127.0.107.194:40689), 5d1af4aed7da41e0b9f4f1e0f5621160 (127.0.107.195:44825)
I20260709 12:58:14.939950   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c34d54dde1042f2a472ac8502703b79" candidate_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" is_pre_election: true
I20260709 12:58:14.943358   760 raft_consensus.cc:359] T 811ff95e986542668558d35c387ec366 P 1e6c65ade84442dba7b9e742f473df99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:14.944182   760 raft_consensus.cc:385] T 811ff95e986542668558d35c387ec366 P 1e6c65ade84442dba7b9e742f473df99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:14.944478   758 tablet_bootstrap.cc:492] T d45270a45bb746e597d1d6ee3744b0b7 P 65b5e378480c4387aee25f0bdfeb1e7e: No bootstrap required, opened a new log
I20260709 12:58:14.944681   760 raft_consensus.cc:740] T 811ff95e986542668558d35c387ec366 P 1e6c65ade84442dba7b9e742f473df99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e6c65ade84442dba7b9e742f473df99, State: Initialized, Role: FOLLOWER
I20260709 12:58:14.945338   758 ts_tablet_manager.cc:1403] T d45270a45bb746e597d1d6ee3744b0b7 P 65b5e378480c4387aee25f0bdfeb1e7e: Time spent bootstrapping tablet: real 0.090s	user 0.013s	sys 0.014s
W20260709 12:58:14.945292   605 leader_election.cc:343] T 6c34d54dde1042f2a472ac8502703b79 P 65b5e378480c4387aee25f0bdfeb1e7e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d1af4aed7da41e0b9f4f1e0f5621160 (127.0.107.195:44825): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:14.946545   762 raft_consensus.cc:515] T 6c34d54dde1042f2a472ac8502703b79 P 65b5e378480c4387aee25f0bdfeb1e7e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:14.952998   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c34d54dde1042f2a472ac8502703b79" candidate_uuid: "1e6c65ade84442dba7b9e742f473df99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" is_pre_election: true
I20260709 12:58:14.954705   762 leader_election.cc:290] T 6c34d54dde1042f2a472ac8502703b79 P 65b5e378480c4387aee25f0bdfeb1e7e [CANDIDATE]: Term 1 election: Requested vote from peers 1e6c65ade84442dba7b9e742f473df99 (127.0.107.193:44941), 5d1af4aed7da41e0b9f4f1e0f5621160 (127.0.107.195:44825)
I20260709 12:58:14.955152   641 raft_consensus.cc:2393] T 6c34d54dde1042f2a472ac8502703b79 P 65b5e378480c4387aee25f0bdfeb1e7e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e6c65ade84442dba7b9e742f473df99 in current term 1: Already voted for candidate 65b5e378480c4387aee25f0bdfeb1e7e in this term.
I20260709 12:58:14.957289   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10f7a7b26cf41d38030d1e80c6123ec" candidate_uuid: "1e6c65ade84442dba7b9e742f473df99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" is_pre_election: true
W20260709 12:58:14.959661   531 leader_election.cc:343] T a10f7a7b26cf41d38030d1e80c6123ec P 1e6c65ade84442dba7b9e742f473df99 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65b5e378480c4387aee25f0bdfeb1e7e (127.0.107.194:40689): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:14.956198   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51a60c5b8c0c485ebd1fabea4a3457ef" candidate_uuid: "1e6c65ade84442dba7b9e742f473df99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" is_pre_election: true
W20260709 12:58:14.961678   531 leader_election.cc:343] T 51a60c5b8c0c485ebd1fabea4a3457ef P 1e6c65ade84442dba7b9e742f473df99 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65b5e378480c4387aee25f0bdfeb1e7e (127.0.107.194:40689): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:14.975566   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51a60c5b8c0c485ebd1fabea4a3457ef" candidate_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e6c65ade84442dba7b9e742f473df99" is_pre_election: true
I20260709 12:58:14.976195   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c34d54dde1042f2a472ac8502703b79" candidate_uuid: "1e6c65ade84442dba7b9e742f473df99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" is_pre_election: true
I20260709 12:58:14.976445   760 consensus_queue.cc:260] T 811ff95e986542668558d35c387ec366 P 1e6c65ade84442dba7b9e742f473df99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:14.977069   758 raft_consensus.cc:359] T d45270a45bb746e597d1d6ee3744b0b7 P 65b5e378480c4387aee25f0bdfeb1e7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:14.977809   758 raft_consensus.cc:385] T d45270a45bb746e597d1d6ee3744b0b7 P 65b5e378480c4387aee25f0bdfeb1e7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:14.977952   761 tablet_bootstrap.cc:492] T 6c34d54dde1042f2a472ac8502703b79 P 5d1af4aed7da41e0b9f4f1e0f5621160: No bootstrap required, opened a new log
I20260709 12:58:14.978322   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10f7a7b26cf41d38030d1e80c6123ec" candidate_uuid: "1e6c65ade84442dba7b9e742f473df99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" is_pre_election: true
I20260709 12:58:14.978444   761 ts_tablet_manager.cc:1403] T 6c34d54dde1042f2a472ac8502703b79 P 5d1af4aed7da41e0b9f4f1e0f5621160: Time spent bootstrapping tablet: real 0.140s	user 0.015s	sys 0.017s
I20260709 12:58:14.978956   715 raft_consensus.cc:2468] T a10f7a7b26cf41d38030d1e80c6123ec P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e6c65ade84442dba7b9e742f473df99 in term 0.
I20260709 12:58:14.979466   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c34d54dde1042f2a472ac8502703b79" candidate_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e6c65ade84442dba7b9e742f473df99"
I20260709 12:58:14.980089   565 raft_consensus.cc:3060] T 6c34d54dde1042f2a472ac8502703b79 P 1e6c65ade84442dba7b9e742f473df99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:14.981671   761 raft_consensus.cc:359] T 6c34d54dde1042f2a472ac8502703b79 P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:14.982398   761 raft_consensus.cc:385] T 6c34d54dde1042f2a472ac8502703b79 P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:14.982523   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51a60c5b8c0c485ebd1fabea4a3457ef" candidate_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" is_pre_election: true
I20260709 12:58:14.982805   760 ts_tablet_manager.cc:1434] T 811ff95e986542668558d35c387ec366 P 1e6c65ade84442dba7b9e742f473df99: Time spent starting tablet: real 0.049s	user 0.005s	sys 0.005s
I20260709 12:58:14.976272   566 raft_consensus.cc:2468] T 51a60c5b8c0c485ebd1fabea4a3457ef P 1e6c65ade84442dba7b9e742f473df99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1af4aed7da41e0b9f4f1e0f5621160 in term 0.
W20260709 12:58:14.984082   680 leader_election.cc:343] T 51a60c5b8c0c485ebd1fabea4a3457ef P 5d1af4aed7da41e0b9f4f1e0f5621160 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65b5e378480c4387aee25f0bdfeb1e7e (127.0.107.194:40689): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:14.985585   761 raft_consensus.cc:740] T 6c34d54dde1042f2a472ac8502703b79 P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d1af4aed7da41e0b9f4f1e0f5621160, State: Initialized, Role: FOLLOWER
I20260709 12:58:14.985873   760 tablet_bootstrap.cc:492] T 82e303e6a0b74de68d18d26049e994ed P 1e6c65ade84442dba7b9e742f473df99: Bootstrap starting.
I20260709 12:58:14.986529   761 consensus_queue.cc:260] T 6c34d54dde1042f2a472ac8502703b79 P 5d1af4aed7da41e0b9f4f1e0f5621160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:14.988781   565 raft_consensus.cc:2468] T 6c34d54dde1042f2a472ac8502703b79 P 1e6c65ade84442dba7b9e742f473df99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65b5e378480c4387aee25f0bdfeb1e7e in term 1.
I20260709 12:58:14.990813   679 leader_election.cc:304] T 51a60c5b8c0c485ebd1fabea4a3457ef P 5d1af4aed7da41e0b9f4f1e0f5621160 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e6c65ade84442dba7b9e742f473df99, 5d1af4aed7da41e0b9f4f1e0f5621160; no voters: 65b5e378480c4387aee25f0bdfeb1e7e
I20260709 12:58:14.992182   767 raft_consensus.cc:2804] T 51a60c5b8c0c485ebd1fabea4a3457ef P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:14.992558   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c34d54dde1042f2a472ac8502703b79" candidate_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160"
I20260709 12:58:14.992842   767 raft_consensus.cc:493] T 51a60c5b8c0c485ebd1fabea4a3457ef P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:14.993296   530 leader_election.cc:343] T 6c34d54dde1042f2a472ac8502703b79 P 1e6c65ade84442dba7b9e742f473df99 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d1af4aed7da41e0b9f4f1e0f5621160 (127.0.107.195:44825): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:14.990901   605 leader_election.cc:304] T 6c34d54dde1042f2a472ac8502703b79 P 65b5e378480c4387aee25f0bdfeb1e7e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e6c65ade84442dba7b9e742f473df99, 65b5e378480c4387aee25f0bdfeb1e7e; no voters: 
I20260709 12:58:14.993489   714 raft_consensus.cc:3060] T 6c34d54dde1042f2a472ac8502703b79 P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:14.996850   762 raft_consensus.cc:2804] T 6c34d54dde1042f2a472ac8502703b79 P 65b5e378480c4387aee25f0bdfeb1e7e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:14.993513   767 raft_consensus.cc:3060] T 51a60c5b8c0c485ebd1fabea4a3457ef P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:15.000384   761 ts_tablet_manager.cc:1434] T 6c34d54dde1042f2a472ac8502703b79 P 5d1af4aed7da41e0b9f4f1e0f5621160: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 12:58:14.998739   530 leader_election.cc:304] T 6c34d54dde1042f2a472ac8502703b79 P 1e6c65ade84442dba7b9e742f473df99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e6c65ade84442dba7b9e742f473df99; no voters: 5d1af4aed7da41e0b9f4f1e0f5621160, 65b5e378480c4387aee25f0bdfeb1e7e
I20260709 12:58:15.003846   786 raft_consensus.cc:2749] T 6c34d54dde1042f2a472ac8502703b79 P 1e6c65ade84442dba7b9e742f473df99 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:14.991505   758 raft_consensus.cc:740] T d45270a45bb746e597d1d6ee3744b0b7 P 65b5e378480c4387aee25f0bdfeb1e7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65b5e378480c4387aee25f0bdfeb1e7e, State: Initialized, Role: FOLLOWER
I20260709 12:58:15.006718   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51a60c5b8c0c485ebd1fabea4a3457ef" candidate_uuid: "1e6c65ade84442dba7b9e742f473df99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" is_pre_election: true
I20260709 12:58:15.007346   758 consensus_queue.cc:260] T d45270a45bb746e597d1d6ee3744b0b7 P 65b5e378480c4387aee25f0bdfeb1e7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:15.003464   761 tablet_bootstrap.cc:492] T 82e303e6a0b74de68d18d26049e994ed P 5d1af4aed7da41e0b9f4f1e0f5621160: Bootstrap starting.
I20260709 12:58:15.010769   714 raft_consensus.cc:2468] T 6c34d54dde1042f2a472ac8502703b79 P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65b5e378480c4387aee25f0bdfeb1e7e in term 1.
I20260709 12:58:15.004501   530 leader_election.cc:304] T a10f7a7b26cf41d38030d1e80c6123ec P 1e6c65ade84442dba7b9e742f473df99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e6c65ade84442dba7b9e742f473df99, 5d1af4aed7da41e0b9f4f1e0f5621160; no voters: 65b5e378480c4387aee25f0bdfeb1e7e
I20260709 12:58:15.022385   786 raft_consensus.cc:2804] T a10f7a7b26cf41d38030d1e80c6123ec P 1e6c65ade84442dba7b9e742f473df99 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:15.022840   786 raft_consensus.cc:493] T a10f7a7b26cf41d38030d1e80c6123ec P 1e6c65ade84442dba7b9e742f473df99 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:15.023192   786 raft_consensus.cc:3060] T a10f7a7b26cf41d38030d1e80c6123ec P 1e6c65ade84442dba7b9e742f473df99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:15.012946   762 raft_consensus.cc:697] T 6c34d54dde1042f2a472ac8502703b79 P 65b5e378480c4387aee25f0bdfeb1e7e [term 1 LEADER]: Becoming Leader. State: Replica: 65b5e378480c4387aee25f0bdfeb1e7e, State: Running, Role: LEADER
I20260709 12:58:15.021601   760 tablet_bootstrap.cc:654] T 82e303e6a0b74de68d18d26049e994ed P 1e6c65ade84442dba7b9e742f473df99: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:15.014014   767 raft_consensus.cc:515] T 51a60c5b8c0c485ebd1fabea4a3457ef P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:15.028494   715 raft_consensus.cc:2393] T 51a60c5b8c0c485ebd1fabea4a3457ef P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e6c65ade84442dba7b9e742f473df99 in current term 1: Already voted for candidate 5d1af4aed7da41e0b9f4f1e0f5621160 in this term.
I20260709 12:58:15.029975   767 leader_election.cc:290] T 51a60c5b8c0c485ebd1fabea4a3457ef P 5d1af4aed7da41e0b9f4f1e0f5621160 [CANDIDATE]: Term 1 election: Requested vote from peers 1e6c65ade84442dba7b9e742f473df99 (127.0.107.193:44941), 65b5e378480c4387aee25f0bdfeb1e7e (127.0.107.194:40689)
I20260709 12:58:15.033138   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51a60c5b8c0c485ebd1fabea4a3457ef" candidate_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e6c65ade84442dba7b9e742f473df99"
I20260709 12:58:15.033156   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51a60c5b8c0c485ebd1fabea4a3457ef" candidate_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65b5e378480c4387aee25f0bdfeb1e7e"
I20260709 12:58:15.033834   565 raft_consensus.cc:3060] T 51a60c5b8c0c485ebd1fabea4a3457ef P 1e6c65ade84442dba7b9e742f473df99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:15.035635   530 leader_election.cc:304] T 51a60c5b8c0c485ebd1fabea4a3457ef P 1e6c65ade84442dba7b9e742f473df99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e6c65ade84442dba7b9e742f473df99; no voters: 5d1af4aed7da41e0b9f4f1e0f5621160, 65b5e378480c4387aee25f0bdfeb1e7e
W20260709 12:58:15.036708   680 leader_election.cc:343] T 51a60c5b8c0c485ebd1fabea4a3457ef P 5d1af4aed7da41e0b9f4f1e0f5621160 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 65b5e378480c4387aee25f0bdfeb1e7e (127.0.107.194:40689): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:15.036947   762 consensus_queue.cc:237] T 6c34d54dde1042f2a472ac8502703b79 P 65b5e378480c4387aee25f0bdfeb1e7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:15.043534   758 ts_tablet_manager.cc:1434] T d45270a45bb746e597d1d6ee3744b0b7 P 65b5e378480c4387aee25f0bdfeb1e7e: Time spent starting tablet: real 0.097s	user 0.030s	sys 0.016s
I20260709 12:58:15.044694   758 tablet_bootstrap.cc:492] T a10f7a7b26cf41d38030d1e80c6123ec P 65b5e378480c4387aee25f0bdfeb1e7e: Bootstrap starting.
I20260709 12:58:15.045298   565 raft_consensus.cc:2468] T 51a60c5b8c0c485ebd1fabea4a3457ef P 1e6c65ade84442dba7b9e742f473df99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1af4aed7da41e0b9f4f1e0f5621160 in term 1.
I20260709 12:58:15.045848   766 raft_consensus.cc:2749] T 51a60c5b8c0c485ebd1fabea4a3457ef P 1e6c65ade84442dba7b9e742f473df99 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:15.046840   679 leader_election.cc:304] T 51a60c5b8c0c485ebd1fabea4a3457ef P 5d1af4aed7da41e0b9f4f1e0f5621160 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e6c65ade84442dba7b9e742f473df99, 5d1af4aed7da41e0b9f4f1e0f5621160; no voters: 65b5e378480c4387aee25f0bdfeb1e7e
I20260709 12:58:15.047710   767 raft_consensus.cc:2804] T 51a60c5b8c0c485ebd1fabea4a3457ef P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:15.047959   760 tablet_bootstrap.cc:492] T 82e303e6a0b74de68d18d26049e994ed P 1e6c65ade84442dba7b9e742f473df99: No bootstrap required, opened a new log
I20260709 12:58:15.049418   760 ts_tablet_manager.cc:1403] T 82e303e6a0b74de68d18d26049e994ed P 1e6c65ade84442dba7b9e742f473df99: Time spent bootstrapping tablet: real 0.064s	user 0.014s	sys 0.003s
I20260709 12:58:15.047678   786 raft_consensus.cc:515] T a10f7a7b26cf41d38030d1e80c6123ec P 1e6c65ade84442dba7b9e742f473df99 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:15.059563   758 tablet_bootstrap.cc:654] T a10f7a7b26cf41d38030d1e80c6123ec P 65b5e378480c4387aee25f0bdfeb1e7e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:15.060124   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10f7a7b26cf41d38030d1e80c6123ec" candidate_uuid: "1e6c65ade84442dba7b9e742f473df99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65b5e378480c4387aee25f0bdfeb1e7e"
W20260709 12:58:15.062295   531 leader_election.cc:343] T a10f7a7b26cf41d38030d1e80c6123ec P 1e6c65ade84442dba7b9e742f473df99 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 65b5e378480c4387aee25f0bdfeb1e7e (127.0.107.194:40689): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:15.062325   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10f7a7b26cf41d38030d1e80c6123ec" candidate_uuid: "1e6c65ade84442dba7b9e742f473df99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160"
I20260709 12:58:15.063086   715 raft_consensus.cc:3060] T a10f7a7b26cf41d38030d1e80c6123ec P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:15.060343   786 leader_election.cc:290] T a10f7a7b26cf41d38030d1e80c6123ec P 1e6c65ade84442dba7b9e742f473df99 [CANDIDATE]: Term 1 election: Requested vote from peers 65b5e378480c4387aee25f0bdfeb1e7e (127.0.107.194:40689), 5d1af4aed7da41e0b9f4f1e0f5621160 (127.0.107.195:44825)
I20260709 12:58:15.061784   767 raft_consensus.cc:697] T 51a60c5b8c0c485ebd1fabea4a3457ef P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 1 LEADER]: Becoming Leader. State: Replica: 5d1af4aed7da41e0b9f4f1e0f5621160, State: Running, Role: LEADER
I20260709 12:58:15.066641   767 consensus_queue.cc:237] T 51a60c5b8c0c485ebd1fabea4a3457ef P 5d1af4aed7da41e0b9f4f1e0f5621160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:15.068025   761 tablet_bootstrap.cc:654] T 82e303e6a0b74de68d18d26049e994ed P 5d1af4aed7da41e0b9f4f1e0f5621160: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:15.064422   760 raft_consensus.cc:359] T 82e303e6a0b74de68d18d26049e994ed P 1e6c65ade84442dba7b9e742f473df99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:15.071233   760 raft_consensus.cc:385] T 82e303e6a0b74de68d18d26049e994ed P 1e6c65ade84442dba7b9e742f473df99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:15.072167   760 raft_consensus.cc:740] T 82e303e6a0b74de68d18d26049e994ed P 1e6c65ade84442dba7b9e742f473df99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e6c65ade84442dba7b9e742f473df99, State: Initialized, Role: FOLLOWER
I20260709 12:58:15.073717   760 consensus_queue.cc:260] T 82e303e6a0b74de68d18d26049e994ed P 1e6c65ade84442dba7b9e742f473df99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:15.078796   760 ts_tablet_manager.cc:1434] T 82e303e6a0b74de68d18d26049e994ed P 1e6c65ade84442dba7b9e742f473df99: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.001s
I20260709 12:58:15.079164   715 raft_consensus.cc:2468] T a10f7a7b26cf41d38030d1e80c6123ec P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e6c65ade84442dba7b9e742f473df99 in term 1.
I20260709 12:58:15.081873   530 leader_election.cc:304] T a10f7a7b26cf41d38030d1e80c6123ec P 1e6c65ade84442dba7b9e742f473df99 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e6c65ade84442dba7b9e742f473df99, 5d1af4aed7da41e0b9f4f1e0f5621160; no voters: 65b5e378480c4387aee25f0bdfeb1e7e
I20260709 12:58:15.082867   760 tablet_bootstrap.cc:492] T 87ceba987e5d48ba916d5e869e2a03b6 P 1e6c65ade84442dba7b9e742f473df99: Bootstrap starting.
I20260709 12:58:15.083775   766 raft_consensus.cc:2804] T a10f7a7b26cf41d38030d1e80c6123ec P 1e6c65ade84442dba7b9e742f473df99 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:15.089506   758 tablet_bootstrap.cc:492] T a10f7a7b26cf41d38030d1e80c6123ec P 65b5e378480c4387aee25f0bdfeb1e7e: No bootstrap required, opened a new log
I20260709 12:58:15.090158   758 ts_tablet_manager.cc:1403] T a10f7a7b26cf41d38030d1e80c6123ec P 65b5e378480c4387aee25f0bdfeb1e7e: Time spent bootstrapping tablet: real 0.046s	user 0.016s	sys 0.015s
I20260709 12:58:15.093719   760 tablet_bootstrap.cc:654] T 87ceba987e5d48ba916d5e869e2a03b6 P 1e6c65ade84442dba7b9e742f473df99: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:15.100039   758 raft_consensus.cc:359] T a10f7a7b26cf41d38030d1e80c6123ec P 65b5e378480c4387aee25f0bdfeb1e7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:15.101181   758 raft_consensus.cc:385] T a10f7a7b26cf41d38030d1e80c6123ec P 65b5e378480c4387aee25f0bdfeb1e7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:15.101508   758 raft_consensus.cc:740] T a10f7a7b26cf41d38030d1e80c6123ec P 65b5e378480c4387aee25f0bdfeb1e7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65b5e378480c4387aee25f0bdfeb1e7e, State: Initialized, Role: FOLLOWER
I20260709 12:58:15.107326   766 raft_consensus.cc:697] T a10f7a7b26cf41d38030d1e80c6123ec P 1e6c65ade84442dba7b9e742f473df99 [term 1 LEADER]: Becoming Leader. State: Replica: 1e6c65ade84442dba7b9e742f473df99, State: Running, Role: LEADER
I20260709 12:58:15.107275   758 consensus_queue.cc:260] T a10f7a7b26cf41d38030d1e80c6123ec P 65b5e378480c4387aee25f0bdfeb1e7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:15.109442   762 raft_consensus.cc:493] T 2bec920f53cb42b785062112f132c67c P 65b5e378480c4387aee25f0bdfeb1e7e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:15.109952   762 raft_consensus.cc:515] T 2bec920f53cb42b785062112f132c67c P 65b5e378480c4387aee25f0bdfeb1e7e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:15.110821   766 consensus_queue.cc:237] T a10f7a7b26cf41d38030d1e80c6123ec P 1e6c65ade84442dba7b9e742f473df99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:15.112197   761 tablet_bootstrap.cc:492] T 82e303e6a0b74de68d18d26049e994ed P 5d1af4aed7da41e0b9f4f1e0f5621160: No bootstrap required, opened a new log
I20260709 12:58:15.112310   762 leader_election.cc:290] T 2bec920f53cb42b785062112f132c67c P 65b5e378480c4387aee25f0bdfeb1e7e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e6c65ade84442dba7b9e742f473df99 (127.0.107.193:44941), 5d1af4aed7da41e0b9f4f1e0f5621160 (127.0.107.195:44825)
I20260709 12:58:15.112833   761 ts_tablet_manager.cc:1403] T 82e303e6a0b74de68d18d26049e994ed P 5d1af4aed7da41e0b9f4f1e0f5621160: Time spent bootstrapping tablet: real 0.112s	user 0.025s	sys 0.015s
I20260709 12:58:15.115154   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bec920f53cb42b785062112f132c67c" candidate_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e6c65ade84442dba7b9e742f473df99" is_pre_election: true
I20260709 12:58:15.115692   767 raft_consensus.cc:493] T 811ff95e986542668558d35c387ec366 P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:15.115221   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bec920f53cb42b785062112f132c67c" candidate_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" is_pre_election: true
I20260709 12:58:15.116583   767 raft_consensus.cc:515] T 811ff95e986542668558d35c387ec366 P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
W20260709 12:58:15.117446   605 leader_election.cc:343] T 2bec920f53cb42b785062112f132c67c P 65b5e378480c4387aee25f0bdfeb1e7e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d1af4aed7da41e0b9f4f1e0f5621160 (127.0.107.195:44825): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:15.118883   758 ts_tablet_manager.cc:1434] T a10f7a7b26cf41d38030d1e80c6123ec P 65b5e378480c4387aee25f0bdfeb1e7e: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.000s
I20260709 12:58:15.118976   767 leader_election.cc:290] T 811ff95e986542668558d35c387ec366 P 5d1af4aed7da41e0b9f4f1e0f5621160 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65b5e378480c4387aee25f0bdfeb1e7e (127.0.107.194:40689), 1e6c65ade84442dba7b9e742f473df99 (127.0.107.193:44941)
W20260709 12:58:15.118109   605 leader_election.cc:343] T 2bec920f53cb42b785062112f132c67c P 65b5e378480c4387aee25f0bdfeb1e7e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e6c65ade84442dba7b9e742f473df99 (127.0.107.193:44941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:15.120822   762 raft_consensus.cc:493] T d45270a45bb746e597d1d6ee3744b0b7 P 65b5e378480c4387aee25f0bdfeb1e7e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:15.121157   605 leader_election.cc:304] T 2bec920f53cb42b785062112f132c67c P 65b5e378480c4387aee25f0bdfeb1e7e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65b5e378480c4387aee25f0bdfeb1e7e; no voters: 1e6c65ade84442dba7b9e742f473df99, 5d1af4aed7da41e0b9f4f1e0f5621160
I20260709 12:58:15.121452   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811ff95e986542668558d35c387ec366" candidate_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e6c65ade84442dba7b9e742f473df99" is_pre_election: true
I20260709 12:58:15.121701   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811ff95e986542668558d35c387ec366" candidate_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" is_pre_election: true
I20260709 12:58:15.121411   762 raft_consensus.cc:515] T d45270a45bb746e597d1d6ee3744b0b7 P 65b5e378480c4387aee25f0bdfeb1e7e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:15.122473   565 raft_consensus.cc:2468] T 811ff95e986542668558d35c387ec366 P 1e6c65ade84442dba7b9e742f473df99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1af4aed7da41e0b9f4f1e0f5621160 in term 0.
I20260709 12:58:15.123052   788 raft_consensus.cc:2749] T 2bec920f53cb42b785062112f132c67c P 65b5e378480c4387aee25f0bdfeb1e7e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:15.122473   639 raft_consensus.cc:2468] T 811ff95e986542668558d35c387ec366 P 65b5e378480c4387aee25f0bdfeb1e7e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1af4aed7da41e0b9f4f1e0f5621160 in term 0.
I20260709 12:58:15.124500   679 leader_election.cc:304] T 811ff95e986542668558d35c387ec366 P 5d1af4aed7da41e0b9f4f1e0f5621160 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e6c65ade84442dba7b9e742f473df99, 5d1af4aed7da41e0b9f4f1e0f5621160; no voters: 
I20260709 12:58:15.126479   767 raft_consensus.cc:2804] T 811ff95e986542668558d35c387ec366 P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:15.126497   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45270a45bb746e597d1d6ee3744b0b7" candidate_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e6c65ade84442dba7b9e742f473df99" is_pre_election: true
I20260709 12:58:15.127023   767 raft_consensus.cc:493] T 811ff95e986542668558d35c387ec366 P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:15.127408   762 leader_election.cc:290] T d45270a45bb746e597d1d6ee3744b0b7 P 65b5e378480c4387aee25f0bdfeb1e7e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e6c65ade84442dba7b9e742f473df99 (127.0.107.193:44941), 5d1af4aed7da41e0b9f4f1e0f5621160 (127.0.107.195:44825)
I20260709 12:58:15.125530   758 tablet_bootstrap.cc:492] T 87ceba987e5d48ba916d5e869e2a03b6 P 65b5e378480c4387aee25f0bdfeb1e7e: Bootstrap starting.
W20260709 12:58:15.128199   605 leader_election.cc:343] T d45270a45bb746e597d1d6ee3744b0b7 P 65b5e378480c4387aee25f0bdfeb1e7e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e6c65ade84442dba7b9e742f473df99 (127.0.107.193:44941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:15.127359   767 raft_consensus.cc:3060] T 811ff95e986542668558d35c387ec366 P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:15.128657   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45270a45bb746e597d1d6ee3744b0b7" candidate_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" is_pre_election: true
I20260709 12:58:15.129684   760 tablet_bootstrap.cc:492] T 87ceba987e5d48ba916d5e869e2a03b6 P 1e6c65ade84442dba7b9e742f473df99: No bootstrap required, opened a new log
I20260709 12:58:15.130221   760 ts_tablet_manager.cc:1403] T 87ceba987e5d48ba916d5e869e2a03b6 P 1e6c65ade84442dba7b9e742f473df99: Time spent bootstrapping tablet: real 0.050s	user 0.022s	sys 0.000s
W20260709 12:58:15.130162   605 leader_election.cc:343] T d45270a45bb746e597d1d6ee3744b0b7 P 65b5e378480c4387aee25f0bdfeb1e7e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d1af4aed7da41e0b9f4f1e0f5621160 (127.0.107.195:44825): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:15.130828   605 leader_election.cc:304] T d45270a45bb746e597d1d6ee3744b0b7 P 65b5e378480c4387aee25f0bdfeb1e7e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65b5e378480c4387aee25f0bdfeb1e7e; no voters: 1e6c65ade84442dba7b9e742f473df99, 5d1af4aed7da41e0b9f4f1e0f5621160
I20260709 12:58:15.131634   762 raft_consensus.cc:2749] T d45270a45bb746e597d1d6ee3744b0b7 P 65b5e378480c4387aee25f0bdfeb1e7e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:15.134382   767 raft_consensus.cc:515] T 811ff95e986542668558d35c387ec366 P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:15.134366   760 raft_consensus.cc:359] T 87ceba987e5d48ba916d5e869e2a03b6 P 1e6c65ade84442dba7b9e742f473df99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:15.135519   760 raft_consensus.cc:385] T 87ceba987e5d48ba916d5e869e2a03b6 P 1e6c65ade84442dba7b9e742f473df99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:15.136668   760 raft_consensus.cc:740] T 87ceba987e5d48ba916d5e869e2a03b6 P 1e6c65ade84442dba7b9e742f473df99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e6c65ade84442dba7b9e742f473df99, State: Initialized, Role: FOLLOWER
I20260709 12:58:15.146435   760 consensus_queue.cc:260] T 87ceba987e5d48ba916d5e869e2a03b6 P 1e6c65ade84442dba7b9e742f473df99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:15.148396   760 ts_tablet_manager.cc:1434] T 87ceba987e5d48ba916d5e869e2a03b6 P 1e6c65ade84442dba7b9e742f473df99: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 12:58:15.149565   760 tablet_bootstrap.cc:492] T 2bec920f53cb42b785062112f132c67c P 1e6c65ade84442dba7b9e742f473df99: Bootstrap starting.
I20260709 12:58:15.149823   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811ff95e986542668558d35c387ec366" candidate_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65b5e378480c4387aee25f0bdfeb1e7e"
I20260709 12:58:15.150748   767 leader_election.cc:290] T 811ff95e986542668558d35c387ec366 P 5d1af4aed7da41e0b9f4f1e0f5621160 [CANDIDATE]: Term 1 election: Requested vote from peers 65b5e378480c4387aee25f0bdfeb1e7e (127.0.107.194:40689), 1e6c65ade84442dba7b9e742f473df99 (127.0.107.193:44941)
I20260709 12:58:15.150900   639 raft_consensus.cc:3060] T 811ff95e986542668558d35c387ec366 P 65b5e378480c4387aee25f0bdfeb1e7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:15.151218   761 raft_consensus.cc:359] T 82e303e6a0b74de68d18d26049e994ed P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:15.152719   761 raft_consensus.cc:385] T 82e303e6a0b74de68d18d26049e994ed P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:15.153115   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811ff95e986542668558d35c387ec366" candidate_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e6c65ade84442dba7b9e742f473df99"
I20260709 12:58:15.153630   761 raft_consensus.cc:740] T 82e303e6a0b74de68d18d26049e994ed P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d1af4aed7da41e0b9f4f1e0f5621160, State: Initialized, Role: FOLLOWER
I20260709 12:58:15.153861   565 raft_consensus.cc:3060] T 811ff95e986542668558d35c387ec366 P 1e6c65ade84442dba7b9e742f473df99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:15.154572   761 consensus_queue.cc:260] T 82e303e6a0b74de68d18d26049e994ed P 5d1af4aed7da41e0b9f4f1e0f5621160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:15.160068   639 raft_consensus.cc:2468] T 811ff95e986542668558d35c387ec366 P 65b5e378480c4387aee25f0bdfeb1e7e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1af4aed7da41e0b9f4f1e0f5621160 in term 1.
I20260709 12:58:15.161016   761 ts_tablet_manager.cc:1434] T 82e303e6a0b74de68d18d26049e994ed P 5d1af4aed7da41e0b9f4f1e0f5621160: Time spent starting tablet: real 0.047s	user 0.006s	sys 0.001s
I20260709 12:58:15.161360   680 leader_election.cc:304] T 811ff95e986542668558d35c387ec366 P 5d1af4aed7da41e0b9f4f1e0f5621160 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1af4aed7da41e0b9f4f1e0f5621160, 65b5e378480c4387aee25f0bdfeb1e7e; no voters: 
I20260709 12:58:15.162111   767 raft_consensus.cc:2804] T 811ff95e986542668558d35c387ec366 P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:15.162575   767 raft_consensus.cc:697] T 811ff95e986542668558d35c387ec366 P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 1 LEADER]: Becoming Leader. State: Replica: 5d1af4aed7da41e0b9f4f1e0f5621160, State: Running, Role: LEADER
I20260709 12:58:15.163391   767 consensus_queue.cc:237] T 811ff95e986542668558d35c387ec366 P 5d1af4aed7da41e0b9f4f1e0f5621160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:15.167107   761 tablet_bootstrap.cc:492] T c496907a8ecb49cc86a0784628ae42c9 P 5d1af4aed7da41e0b9f4f1e0f5621160: Bootstrap starting.
I20260709 12:58:15.173930   463 catalog_manager.cc:5697] T a10f7a7b26cf41d38030d1e80c6123ec P 1e6c65ade84442dba7b9e742f473df99 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e6c65ade84442dba7b9e742f473df99 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "1e6c65ade84442dba7b9e742f473df99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:15.170722   461 catalog_manager.cc:5697] T 6c34d54dde1042f2a472ac8502703b79 P 65b5e378480c4387aee25f0bdfeb1e7e reported cstate change: term changed from 0 to 1, leader changed from <none> to 65b5e378480c4387aee25f0bdfeb1e7e (127.0.107.194). New cstate: current_term: 1 leader_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:15.177552   462 catalog_manager.cc:5697] T 51a60c5b8c0c485ebd1fabea4a3457ef P 5d1af4aed7da41e0b9f4f1e0f5621160 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d1af4aed7da41e0b9f4f1e0f5621160 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:15.181787   758 tablet_bootstrap.cc:654] T 87ceba987e5d48ba916d5e869e2a03b6 P 65b5e378480c4387aee25f0bdfeb1e7e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:15.186298   565 raft_consensus.cc:2468] T 811ff95e986542668558d35c387ec366 P 1e6c65ade84442dba7b9e742f473df99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1af4aed7da41e0b9f4f1e0f5621160 in term 1.
I20260709 12:58:15.192312   760 tablet_bootstrap.cc:654] T 2bec920f53cb42b785062112f132c67c P 1e6c65ade84442dba7b9e742f473df99: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:15.196496   761 tablet_bootstrap.cc:654] T c496907a8ecb49cc86a0784628ae42c9 P 5d1af4aed7da41e0b9f4f1e0f5621160: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:15.205636   761 tablet_bootstrap.cc:492] T c496907a8ecb49cc86a0784628ae42c9 P 5d1af4aed7da41e0b9f4f1e0f5621160: No bootstrap required, opened a new log
I20260709 12:58:15.206153   761 ts_tablet_manager.cc:1403] T c496907a8ecb49cc86a0784628ae42c9 P 5d1af4aed7da41e0b9f4f1e0f5621160: Time spent bootstrapping tablet: real 0.044s	user 0.006s	sys 0.009s
I20260709 12:58:15.208552   758 tablet_bootstrap.cc:492] T 87ceba987e5d48ba916d5e869e2a03b6 P 65b5e378480c4387aee25f0bdfeb1e7e: No bootstrap required, opened a new log
I20260709 12:58:15.208559   760 tablet_bootstrap.cc:492] T 2bec920f53cb42b785062112f132c67c P 1e6c65ade84442dba7b9e742f473df99: No bootstrap required, opened a new log
I20260709 12:58:15.209242   758 ts_tablet_manager.cc:1403] T 87ceba987e5d48ba916d5e869e2a03b6 P 65b5e378480c4387aee25f0bdfeb1e7e: Time spent bootstrapping tablet: real 0.085s	user 0.005s	sys 0.014s
I20260709 12:58:15.209242   760 ts_tablet_manager.cc:1403] T 2bec920f53cb42b785062112f132c67c P 1e6c65ade84442dba7b9e742f473df99: Time spent bootstrapping tablet: real 0.060s	user 0.006s	sys 0.008s
I20260709 12:58:15.209720   761 raft_consensus.cc:359] T c496907a8ecb49cc86a0784628ae42c9 P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:15.210541   761 raft_consensus.cc:385] T c496907a8ecb49cc86a0784628ae42c9 P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:15.211228   761 raft_consensus.cc:740] T c496907a8ecb49cc86a0784628ae42c9 P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d1af4aed7da41e0b9f4f1e0f5621160, State: Initialized, Role: FOLLOWER
I20260709 12:58:15.211998   761 consensus_queue.cc:260] T c496907a8ecb49cc86a0784628ae42c9 P 5d1af4aed7da41e0b9f4f1e0f5621160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:15.212734   758 raft_consensus.cc:359] T 87ceba987e5d48ba916d5e869e2a03b6 P 65b5e378480c4387aee25f0bdfeb1e7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:15.213018   760 raft_consensus.cc:359] T 2bec920f53cb42b785062112f132c67c P 1e6c65ade84442dba7b9e742f473df99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:15.213498   758 raft_consensus.cc:385] T 87ceba987e5d48ba916d5e869e2a03b6 P 65b5e378480c4387aee25f0bdfeb1e7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:15.213662   760 raft_consensus.cc:385] T 2bec920f53cb42b785062112f132c67c P 1e6c65ade84442dba7b9e742f473df99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:15.213963   758 raft_consensus.cc:740] T 87ceba987e5d48ba916d5e869e2a03b6 P 65b5e378480c4387aee25f0bdfeb1e7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65b5e378480c4387aee25f0bdfeb1e7e, State: Initialized, Role: FOLLOWER
I20260709 12:58:15.214597   761 ts_tablet_manager.cc:1434] T c496907a8ecb49cc86a0784628ae42c9 P 5d1af4aed7da41e0b9f4f1e0f5621160: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 12:58:15.214821   758 consensus_queue.cc:260] T 87ceba987e5d48ba916d5e869e2a03b6 P 65b5e378480c4387aee25f0bdfeb1e7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:15.215754   761 tablet_bootstrap.cc:492] T d45270a45bb746e597d1d6ee3744b0b7 P 5d1af4aed7da41e0b9f4f1e0f5621160: Bootstrap starting.
I20260709 12:58:15.217370   758 ts_tablet_manager.cc:1434] T 87ceba987e5d48ba916d5e869e2a03b6 P 65b5e378480c4387aee25f0bdfeb1e7e: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:58:15.218302   758 tablet_bootstrap.cc:492] T 51a60c5b8c0c485ebd1fabea4a3457ef P 65b5e378480c4387aee25f0bdfeb1e7e: Bootstrap starting.
I20260709 12:58:15.213971   760 raft_consensus.cc:740] T 2bec920f53cb42b785062112f132c67c P 1e6c65ade84442dba7b9e742f473df99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e6c65ade84442dba7b9e742f473df99, State: Initialized, Role: FOLLOWER
I20260709 12:58:15.223317   761 tablet_bootstrap.cc:654] T d45270a45bb746e597d1d6ee3744b0b7 P 5d1af4aed7da41e0b9f4f1e0f5621160: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:15.223814   758 tablet_bootstrap.cc:654] T 51a60c5b8c0c485ebd1fabea4a3457ef P 65b5e378480c4387aee25f0bdfeb1e7e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:15.223577   760 consensus_queue.cc:260] T 2bec920f53cb42b785062112f132c67c P 1e6c65ade84442dba7b9e742f473df99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:15.224888   762 raft_consensus.cc:493] T a10f7a7b26cf41d38030d1e80c6123ec P 65b5e378480c4387aee25f0bdfeb1e7e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:15.225346   762 raft_consensus.cc:515] T a10f7a7b26cf41d38030d1e80c6123ec P 65b5e378480c4387aee25f0bdfeb1e7e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:15.226773   760 ts_tablet_manager.cc:1434] T 2bec920f53cb42b785062112f132c67c P 1e6c65ade84442dba7b9e742f473df99: Time spent starting tablet: real 0.017s	user 0.003s	sys 0.005s
I20260709 12:58:15.227512   762 leader_election.cc:290] T a10f7a7b26cf41d38030d1e80c6123ec P 65b5e378480c4387aee25f0bdfeb1e7e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e6c65ade84442dba7b9e742f473df99 (127.0.107.193:44941), 5d1af4aed7da41e0b9f4f1e0f5621160 (127.0.107.195:44825)
I20260709 12:58:15.228118   760 tablet_bootstrap.cc:492] T c496907a8ecb49cc86a0784628ae42c9 P 1e6c65ade84442dba7b9e742f473df99: Bootstrap starting.
I20260709 12:58:15.228796   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10f7a7b26cf41d38030d1e80c6123ec" candidate_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e6c65ade84442dba7b9e742f473df99" is_pre_election: true
I20260709 12:58:15.229121   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10f7a7b26cf41d38030d1e80c6123ec" candidate_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" is_pre_election: true
I20260709 12:58:15.229818   715 raft_consensus.cc:2393] T a10f7a7b26cf41d38030d1e80c6123ec P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65b5e378480c4387aee25f0bdfeb1e7e in current term 1: Already voted for candidate 1e6c65ade84442dba7b9e742f473df99 in this term.
I20260709 12:58:15.230696   605 leader_election.cc:304] T a10f7a7b26cf41d38030d1e80c6123ec P 65b5e378480c4387aee25f0bdfeb1e7e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65b5e378480c4387aee25f0bdfeb1e7e; no voters: 1e6c65ade84442dba7b9e742f473df99, 5d1af4aed7da41e0b9f4f1e0f5621160
I20260709 12:58:15.231426   762 raft_consensus.cc:3060] T a10f7a7b26cf41d38030d1e80c6123ec P 65b5e378480c4387aee25f0bdfeb1e7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:15.237653   760 tablet_bootstrap.cc:654] T c496907a8ecb49cc86a0784628ae42c9 P 1e6c65ade84442dba7b9e742f473df99: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:15.238633   762 raft_consensus.cc:2749] T a10f7a7b26cf41d38030d1e80c6123ec P 65b5e378480c4387aee25f0bdfeb1e7e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:15.245916   761 tablet_bootstrap.cc:492] T d45270a45bb746e597d1d6ee3744b0b7 P 5d1af4aed7da41e0b9f4f1e0f5621160: No bootstrap required, opened a new log
I20260709 12:58:15.246412   761 ts_tablet_manager.cc:1403] T d45270a45bb746e597d1d6ee3744b0b7 P 5d1af4aed7da41e0b9f4f1e0f5621160: Time spent bootstrapping tablet: real 0.031s	user 0.009s	sys 0.004s
I20260709 12:58:15.252110   762 raft_consensus.cc:493] T c496907a8ecb49cc86a0784628ae42c9 P 65b5e378480c4387aee25f0bdfeb1e7e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:15.252256   761 raft_consensus.cc:359] T d45270a45bb746e597d1d6ee3744b0b7 P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:15.253007   761 raft_consensus.cc:385] T d45270a45bb746e597d1d6ee3744b0b7 P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:15.252650   762 raft_consensus.cc:515] T c496907a8ecb49cc86a0784628ae42c9 P 65b5e378480c4387aee25f0bdfeb1e7e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:15.253247   761 raft_consensus.cc:740] T d45270a45bb746e597d1d6ee3744b0b7 P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d1af4aed7da41e0b9f4f1e0f5621160, State: Initialized, Role: FOLLOWER
I20260709 12:58:15.254761   758 tablet_bootstrap.cc:492] T 51a60c5b8c0c485ebd1fabea4a3457ef P 65b5e378480c4387aee25f0bdfeb1e7e: No bootstrap required, opened a new log
I20260709 12:58:15.254855   762 leader_election.cc:290] T c496907a8ecb49cc86a0784628ae42c9 P 65b5e378480c4387aee25f0bdfeb1e7e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e6c65ade84442dba7b9e742f473df99 (127.0.107.193:44941), 5d1af4aed7da41e0b9f4f1e0f5621160 (127.0.107.195:44825)
I20260709 12:58:15.255878   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c496907a8ecb49cc86a0784628ae42c9" candidate_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e6c65ade84442dba7b9e742f473df99" is_pre_election: true
I20260709 12:58:15.256742   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c496907a8ecb49cc86a0784628ae42c9" candidate_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" is_pre_election: true
I20260709 12:58:15.257332   715 raft_consensus.cc:2468] T c496907a8ecb49cc86a0784628ae42c9 P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65b5e378480c4387aee25f0bdfeb1e7e in term 0.
W20260709 12:58:15.257386   605 leader_election.cc:343] T c496907a8ecb49cc86a0784628ae42c9 P 65b5e378480c4387aee25f0bdfeb1e7e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e6c65ade84442dba7b9e742f473df99 (127.0.107.193:44941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:15.253953   761 consensus_queue.cc:260] T d45270a45bb746e597d1d6ee3744b0b7 P 5d1af4aed7da41e0b9f4f1e0f5621160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:15.261690   761 ts_tablet_manager.cc:1434] T d45270a45bb746e597d1d6ee3744b0b7 P 5d1af4aed7da41e0b9f4f1e0f5621160: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.001s
I20260709 12:58:15.262607   761 tablet_bootstrap.cc:492] T 87ceba987e5d48ba916d5e869e2a03b6 P 5d1af4aed7da41e0b9f4f1e0f5621160: Bootstrap starting.
I20260709 12:58:15.264626   605 leader_election.cc:304] T c496907a8ecb49cc86a0784628ae42c9 P 65b5e378480c4387aee25f0bdfeb1e7e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1af4aed7da41e0b9f4f1e0f5621160, 65b5e378480c4387aee25f0bdfeb1e7e; no voters: 1e6c65ade84442dba7b9e742f473df99
I20260709 12:58:15.265452   762 raft_consensus.cc:2804] T c496907a8ecb49cc86a0784628ae42c9 P 65b5e378480c4387aee25f0bdfeb1e7e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:15.265869   762 raft_consensus.cc:493] T c496907a8ecb49cc86a0784628ae42c9 P 65b5e378480c4387aee25f0bdfeb1e7e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:15.266197   762 raft_consensus.cc:3060] T c496907a8ecb49cc86a0784628ae42c9 P 65b5e378480c4387aee25f0bdfeb1e7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:15.267297   758 ts_tablet_manager.cc:1403] T 51a60c5b8c0c485ebd1fabea4a3457ef P 65b5e378480c4387aee25f0bdfeb1e7e: Time spent bootstrapping tablet: real 0.049s	user 0.011s	sys 0.001s
I20260709 12:58:15.270082   758 raft_consensus.cc:359] T 51a60c5b8c0c485ebd1fabea4a3457ef P 65b5e378480c4387aee25f0bdfeb1e7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:15.270779   758 raft_consensus.cc:385] T 51a60c5b8c0c485ebd1fabea4a3457ef P 65b5e378480c4387aee25f0bdfeb1e7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:15.271064   758 raft_consensus.cc:740] T 51a60c5b8c0c485ebd1fabea4a3457ef P 65b5e378480c4387aee25f0bdfeb1e7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65b5e378480c4387aee25f0bdfeb1e7e, State: Initialized, Role: FOLLOWER
I20260709 12:58:15.271739   758 consensus_queue.cc:260] T 51a60c5b8c0c485ebd1fabea4a3457ef P 65b5e378480c4387aee25f0bdfeb1e7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:15.272874   762 raft_consensus.cc:515] T c496907a8ecb49cc86a0784628ae42c9 P 65b5e378480c4387aee25f0bdfeb1e7e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:15.273651   758 ts_tablet_manager.cc:1434] T 51a60c5b8c0c485ebd1fabea4a3457ef P 65b5e378480c4387aee25f0bdfeb1e7e: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:58:15.275290   762 leader_election.cc:290] T c496907a8ecb49cc86a0784628ae42c9 P 65b5e378480c4387aee25f0bdfeb1e7e [CANDIDATE]: Term 1 election: Requested vote from peers 1e6c65ade84442dba7b9e742f473df99 (127.0.107.193:44941), 5d1af4aed7da41e0b9f4f1e0f5621160 (127.0.107.195:44825)
I20260709 12:58:15.276448   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c496907a8ecb49cc86a0784628ae42c9" candidate_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e6c65ade84442dba7b9e742f473df99"
I20260709 12:58:15.276818   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c496907a8ecb49cc86a0784628ae42c9" candidate_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160"
I20260709 12:58:15.277413   715 raft_consensus.cc:3060] T c496907a8ecb49cc86a0784628ae42c9 P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:58:15.278023   605 leader_election.cc:343] T c496907a8ecb49cc86a0784628ae42c9 P 65b5e378480c4387aee25f0bdfeb1e7e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1e6c65ade84442dba7b9e742f473df99 (127.0.107.193:44941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:15.281636   462 catalog_manager.cc:5697] T 811ff95e986542668558d35c387ec366 P 5d1af4aed7da41e0b9f4f1e0f5621160 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d1af4aed7da41e0b9f4f1e0f5621160 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:15.286077   760 tablet_bootstrap.cc:492] T c496907a8ecb49cc86a0784628ae42c9 P 1e6c65ade84442dba7b9e742f473df99: No bootstrap required, opened a new log
I20260709 12:58:15.286609   760 ts_tablet_manager.cc:1403] T c496907a8ecb49cc86a0784628ae42c9 P 1e6c65ade84442dba7b9e742f473df99: Time spent bootstrapping tablet: real 0.059s	user 0.019s	sys 0.021s
I20260709 12:58:15.287200   715 raft_consensus.cc:2468] T c496907a8ecb49cc86a0784628ae42c9 P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65b5e378480c4387aee25f0bdfeb1e7e in term 1.
I20260709 12:58:15.288662   605 leader_election.cc:304] T c496907a8ecb49cc86a0784628ae42c9 P 65b5e378480c4387aee25f0bdfeb1e7e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1af4aed7da41e0b9f4f1e0f5621160, 65b5e378480c4387aee25f0bdfeb1e7e; no voters: 1e6c65ade84442dba7b9e742f473df99
I20260709 12:58:15.289422   762 raft_consensus.cc:2804] T c496907a8ecb49cc86a0784628ae42c9 P 65b5e378480c4387aee25f0bdfeb1e7e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:15.289893   762 raft_consensus.cc:697] T c496907a8ecb49cc86a0784628ae42c9 P 65b5e378480c4387aee25f0bdfeb1e7e [term 1 LEADER]: Becoming Leader. State: Replica: 65b5e378480c4387aee25f0bdfeb1e7e, State: Running, Role: LEADER
I20260709 12:58:15.290478   761 tablet_bootstrap.cc:654] T 87ceba987e5d48ba916d5e869e2a03b6 P 5d1af4aed7da41e0b9f4f1e0f5621160: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:15.290711   762 consensus_queue.cc:237] T c496907a8ecb49cc86a0784628ae42c9 P 65b5e378480c4387aee25f0bdfeb1e7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:15.291769   767 raft_consensus.cc:493] T d45270a45bb746e597d1d6ee3744b0b7 P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:15.292181   788 raft_consensus.cc:493] T 87ceba987e5d48ba916d5e869e2a03b6 P 65b5e378480c4387aee25f0bdfeb1e7e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:15.292650   788 raft_consensus.cc:515] T 87ceba987e5d48ba916d5e869e2a03b6 P 65b5e378480c4387aee25f0bdfeb1e7e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:15.294711   788 leader_election.cc:290] T 87ceba987e5d48ba916d5e869e2a03b6 P 65b5e378480c4387aee25f0bdfeb1e7e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e6c65ade84442dba7b9e742f473df99 (127.0.107.193:44941), 5d1af4aed7da41e0b9f4f1e0f5621160 (127.0.107.195:44825)
I20260709 12:58:15.292203   767 raft_consensus.cc:515] T d45270a45bb746e597d1d6ee3744b0b7 P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:15.296263   760 raft_consensus.cc:359] T c496907a8ecb49cc86a0784628ae42c9 P 1e6c65ade84442dba7b9e742f473df99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:15.295440   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ceba987e5d48ba916d5e869e2a03b6" candidate_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e6c65ade84442dba7b9e742f473df99" is_pre_election: true
I20260709 12:58:15.296962   760 raft_consensus.cc:385] T c496907a8ecb49cc86a0784628ae42c9 P 1e6c65ade84442dba7b9e742f473df99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:15.297359   760 raft_consensus.cc:740] T c496907a8ecb49cc86a0784628ae42c9 P 1e6c65ade84442dba7b9e742f473df99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e6c65ade84442dba7b9e742f473df99, State: Initialized, Role: FOLLOWER
I20260709 12:58:15.298197   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45270a45bb746e597d1d6ee3744b0b7" candidate_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e6c65ade84442dba7b9e742f473df99" is_pre_election: true
I20260709 12:58:15.298108   760 consensus_queue.cc:260] T c496907a8ecb49cc86a0784628ae42c9 P 1e6c65ade84442dba7b9e742f473df99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:15.299459   767 leader_election.cc:290] T d45270a45bb746e597d1d6ee3744b0b7 P 5d1af4aed7da41e0b9f4f1e0f5621160 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e6c65ade84442dba7b9e742f473df99 (127.0.107.193:44941), 65b5e378480c4387aee25f0bdfeb1e7e (127.0.107.194:40689)
W20260709 12:58:15.299794   679 leader_election.cc:343] T d45270a45bb746e597d1d6ee3744b0b7 P 5d1af4aed7da41e0b9f4f1e0f5621160 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e6c65ade84442dba7b9e742f473df99 (127.0.107.193:44941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:15.301113   760 ts_tablet_manager.cc:1434] T c496907a8ecb49cc86a0784628ae42c9 P 1e6c65ade84442dba7b9e742f473df99: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 12:58:15.301370   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45270a45bb746e597d1d6ee3744b0b7" candidate_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" is_pre_election: true
I20260709 12:58:15.301864   639 raft_consensus.cc:2468] T d45270a45bb746e597d1d6ee3744b0b7 P 65b5e378480c4387aee25f0bdfeb1e7e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1af4aed7da41e0b9f4f1e0f5621160 in term 0.
I20260709 12:58:15.302053   760 tablet_bootstrap.cc:492] T d45270a45bb746e597d1d6ee3744b0b7 P 1e6c65ade84442dba7b9e742f473df99: Bootstrap starting.
I20260709 12:58:15.305317   680 leader_election.cc:304] T d45270a45bb746e597d1d6ee3744b0b7 P 5d1af4aed7da41e0b9f4f1e0f5621160 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1af4aed7da41e0b9f4f1e0f5621160, 65b5e378480c4387aee25f0bdfeb1e7e; no voters: 1e6c65ade84442dba7b9e742f473df99
I20260709 12:58:15.297295   565 raft_consensus.cc:2468] T 87ceba987e5d48ba916d5e869e2a03b6 P 1e6c65ade84442dba7b9e742f473df99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65b5e378480c4387aee25f0bdfeb1e7e in term 0.
I20260709 12:58:15.307070   767 raft_consensus.cc:2804] T d45270a45bb746e597d1d6ee3744b0b7 P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:15.307487   767 raft_consensus.cc:493] T d45270a45bb746e597d1d6ee3744b0b7 P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:15.307832   767 raft_consensus.cc:3060] T d45270a45bb746e597d1d6ee3744b0b7 P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:15.308095   605 leader_election.cc:304] T 87ceba987e5d48ba916d5e869e2a03b6 P 65b5e378480c4387aee25f0bdfeb1e7e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e6c65ade84442dba7b9e742f473df99, 65b5e378480c4387aee25f0bdfeb1e7e; no voters: 
I20260709 12:58:15.308868   788 raft_consensus.cc:2804] T 87ceba987e5d48ba916d5e869e2a03b6 P 65b5e378480c4387aee25f0bdfeb1e7e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:15.309211   788 raft_consensus.cc:493] T 87ceba987e5d48ba916d5e869e2a03b6 P 65b5e378480c4387aee25f0bdfeb1e7e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:15.309516   788 raft_consensus.cc:3060] T 87ceba987e5d48ba916d5e869e2a03b6 P 65b5e378480c4387aee25f0bdfeb1e7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:15.313261   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ceba987e5d48ba916d5e869e2a03b6" candidate_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" is_pre_election: true
W20260709 12:58:15.314586   605 leader_election.cc:343] T 87ceba987e5d48ba916d5e869e2a03b6 P 65b5e378480c4387aee25f0bdfeb1e7e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d1af4aed7da41e0b9f4f1e0f5621160 (127.0.107.195:44825): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:15.315120   760 tablet_bootstrap.cc:654] T d45270a45bb746e597d1d6ee3744b0b7 P 1e6c65ade84442dba7b9e742f473df99: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:15.317266   761 tablet_bootstrap.cc:492] T 87ceba987e5d48ba916d5e869e2a03b6 P 5d1af4aed7da41e0b9f4f1e0f5621160: No bootstrap required, opened a new log
I20260709 12:58:15.316980   788 raft_consensus.cc:515] T 87ceba987e5d48ba916d5e869e2a03b6 P 65b5e378480c4387aee25f0bdfeb1e7e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:15.317739   761 ts_tablet_manager.cc:1403] T 87ceba987e5d48ba916d5e869e2a03b6 P 5d1af4aed7da41e0b9f4f1e0f5621160: Time spent bootstrapping tablet: real 0.055s	user 0.011s	sys 0.003s
I20260709 12:58:15.319938   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ceba987e5d48ba916d5e869e2a03b6" candidate_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e6c65ade84442dba7b9e742f473df99"
I20260709 12:58:15.320592   565 raft_consensus.cc:3060] T 87ceba987e5d48ba916d5e869e2a03b6 P 1e6c65ade84442dba7b9e742f473df99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:15.327462   565 raft_consensus.cc:2468] T 87ceba987e5d48ba916d5e869e2a03b6 P 1e6c65ade84442dba7b9e742f473df99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65b5e378480c4387aee25f0bdfeb1e7e in term 1.
I20260709 12:58:15.328917   605 leader_election.cc:304] T 87ceba987e5d48ba916d5e869e2a03b6 P 65b5e378480c4387aee25f0bdfeb1e7e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e6c65ade84442dba7b9e742f473df99, 65b5e378480c4387aee25f0bdfeb1e7e; no voters: 
I20260709 12:58:15.329921   787 raft_consensus.cc:2804] T 87ceba987e5d48ba916d5e869e2a03b6 P 65b5e378480c4387aee25f0bdfeb1e7e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:15.335116   767 raft_consensus.cc:515] T d45270a45bb746e597d1d6ee3744b0b7 P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:15.338440   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45270a45bb746e597d1d6ee3744b0b7" candidate_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e6c65ade84442dba7b9e742f473df99"
W20260709 12:58:15.339905   679 leader_election.cc:343] T d45270a45bb746e597d1d6ee3744b0b7 P 5d1af4aed7da41e0b9f4f1e0f5621160 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1e6c65ade84442dba7b9e742f473df99 (127.0.107.193:44941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:15.349607   788 leader_election.cc:290] T 87ceba987e5d48ba916d5e869e2a03b6 P 65b5e378480c4387aee25f0bdfeb1e7e [CANDIDATE]: Term 1 election: Requested vote from peers 1e6c65ade84442dba7b9e742f473df99 (127.0.107.193:44941), 5d1af4aed7da41e0b9f4f1e0f5621160 (127.0.107.195:44825)
I20260709 12:58:15.351024   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ceba987e5d48ba916d5e869e2a03b6" candidate_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160"
I20260709 12:58:15.353188   760 tablet_bootstrap.cc:492] T d45270a45bb746e597d1d6ee3744b0b7 P 1e6c65ade84442dba7b9e742f473df99: No bootstrap required, opened a new log
I20260709 12:58:15.353709   760 ts_tablet_manager.cc:1403] T d45270a45bb746e597d1d6ee3744b0b7 P 1e6c65ade84442dba7b9e742f473df99: Time spent bootstrapping tablet: real 0.052s	user 0.008s	sys 0.006s
I20260709 12:58:15.353910   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45270a45bb746e597d1d6ee3744b0b7" candidate_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65b5e378480c4387aee25f0bdfeb1e7e"
I20260709 12:58:15.354492   639 raft_consensus.cc:3060] T d45270a45bb746e597d1d6ee3744b0b7 P 65b5e378480c4387aee25f0bdfeb1e7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:15.356566   760 raft_consensus.cc:359] T d45270a45bb746e597d1d6ee3744b0b7 P 1e6c65ade84442dba7b9e742f473df99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:15.357317   760 raft_consensus.cc:385] T d45270a45bb746e597d1d6ee3744b0b7 P 1e6c65ade84442dba7b9e742f473df99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:15.357736   760 raft_consensus.cc:740] T d45270a45bb746e597d1d6ee3744b0b7 P 1e6c65ade84442dba7b9e742f473df99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e6c65ade84442dba7b9e742f473df99, State: Initialized, Role: FOLLOWER
I20260709 12:58:15.358578   760 consensus_queue.cc:260] T d45270a45bb746e597d1d6ee3744b0b7 P 1e6c65ade84442dba7b9e742f473df99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
W20260709 12:58:15.360236   605 leader_election.cc:343] T 87ceba987e5d48ba916d5e869e2a03b6 P 65b5e378480c4387aee25f0bdfeb1e7e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5d1af4aed7da41e0b9f4f1e0f5621160 (127.0.107.195:44825): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:15.361567   639 raft_consensus.cc:2468] T d45270a45bb746e597d1d6ee3744b0b7 P 65b5e378480c4387aee25f0bdfeb1e7e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1af4aed7da41e0b9f4f1e0f5621160 in term 1.
I20260709 12:58:15.362686   680 leader_election.cc:304] T d45270a45bb746e597d1d6ee3744b0b7 P 5d1af4aed7da41e0b9f4f1e0f5621160 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d1af4aed7da41e0b9f4f1e0f5621160, 65b5e378480c4387aee25f0bdfeb1e7e; no voters: 1e6c65ade84442dba7b9e742f473df99
I20260709 12:58:15.363673   791 raft_consensus.cc:2804] T d45270a45bb746e597d1d6ee3744b0b7 P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:58:15.364692   511 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:58:15.365314   760 ts_tablet_manager.cc:1434] T d45270a45bb746e597d1d6ee3744b0b7 P 1e6c65ade84442dba7b9e742f473df99: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:58:15.369663   761 raft_consensus.cc:359] T 87ceba987e5d48ba916d5e869e2a03b6 P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:15.370414   761 raft_consensus.cc:385] T 87ceba987e5d48ba916d5e869e2a03b6 P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:15.370776   761 raft_consensus.cc:740] T 87ceba987e5d48ba916d5e869e2a03b6 P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d1af4aed7da41e0b9f4f1e0f5621160, State: Initialized, Role: FOLLOWER
I20260709 12:58:15.371894   761 consensus_queue.cc:260] T 87ceba987e5d48ba916d5e869e2a03b6 P 5d1af4aed7da41e0b9f4f1e0f5621160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:15.372392   787 raft_consensus.cc:697] T 87ceba987e5d48ba916d5e869e2a03b6 P 65b5e378480c4387aee25f0bdfeb1e7e [term 1 LEADER]: Becoming Leader. State: Replica: 65b5e378480c4387aee25f0bdfeb1e7e, State: Running, Role: LEADER
I20260709 12:58:15.374186   767 leader_election.cc:290] T d45270a45bb746e597d1d6ee3744b0b7 P 5d1af4aed7da41e0b9f4f1e0f5621160 [CANDIDATE]: Term 1 election: Requested vote from peers 1e6c65ade84442dba7b9e742f473df99 (127.0.107.193:44941), 65b5e378480c4387aee25f0bdfeb1e7e (127.0.107.194:40689)
I20260709 12:58:15.374078   787 consensus_queue.cc:237] T 87ceba987e5d48ba916d5e869e2a03b6 P 65b5e378480c4387aee25f0bdfeb1e7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:15.375262   761 ts_tablet_manager.cc:1434] T 87ceba987e5d48ba916d5e869e2a03b6 P 5d1af4aed7da41e0b9f4f1e0f5621160: Time spent starting tablet: real 0.057s	user 0.001s	sys 0.008s
I20260709 12:58:15.376811   761 tablet_bootstrap.cc:492] T 2bec920f53cb42b785062112f132c67c P 5d1af4aed7da41e0b9f4f1e0f5621160: Bootstrap starting.
I20260709 12:58:15.380039   791 raft_consensus.cc:697] T d45270a45bb746e597d1d6ee3744b0b7 P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 1 LEADER]: Becoming Leader. State: Replica: 5d1af4aed7da41e0b9f4f1e0f5621160, State: Running, Role: LEADER
I20260709 12:58:15.381384   791 consensus_queue.cc:237] T d45270a45bb746e597d1d6ee3744b0b7 P 5d1af4aed7da41e0b9f4f1e0f5621160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:15.382748   761 tablet_bootstrap.cc:654] T 2bec920f53cb42b785062112f132c67c P 5d1af4aed7da41e0b9f4f1e0f5621160: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:15.388085   461 catalog_manager.cc:5697] T 87ceba987e5d48ba916d5e869e2a03b6 P 65b5e378480c4387aee25f0bdfeb1e7e reported cstate change: term changed from 0 to 1, leader changed from <none> to 65b5e378480c4387aee25f0bdfeb1e7e (127.0.107.194). New cstate: current_term: 1 leader_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:15.390370   461 catalog_manager.cc:5697] T c496907a8ecb49cc86a0784628ae42c9 P 65b5e378480c4387aee25f0bdfeb1e7e reported cstate change: term changed from 0 to 1, leader changed from <none> to 65b5e378480c4387aee25f0bdfeb1e7e (127.0.107.194). New cstate: current_term: 1 leader_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:15.402230   761 tablet_bootstrap.cc:492] T 2bec920f53cb42b785062112f132c67c P 5d1af4aed7da41e0b9f4f1e0f5621160: No bootstrap required, opened a new log
I20260709 12:58:15.402807   761 ts_tablet_manager.cc:1403] T 2bec920f53cb42b785062112f132c67c P 5d1af4aed7da41e0b9f4f1e0f5621160: Time spent bootstrapping tablet: real 0.026s	user 0.014s	sys 0.011s
I20260709 12:58:15.403164   462 catalog_manager.cc:5697] T d45270a45bb746e597d1d6ee3744b0b7 P 5d1af4aed7da41e0b9f4f1e0f5621160 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d1af4aed7da41e0b9f4f1e0f5621160 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:15.405697   761 raft_consensus.cc:359] T 2bec920f53cb42b785062112f132c67c P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:15.406414   761 raft_consensus.cc:385] T 2bec920f53cb42b785062112f132c67c P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:15.406770   761 raft_consensus.cc:740] T 2bec920f53cb42b785062112f132c67c P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d1af4aed7da41e0b9f4f1e0f5621160, State: Initialized, Role: FOLLOWER
I20260709 12:58:15.407493   761 consensus_queue.cc:260] T 2bec920f53cb42b785062112f132c67c P 5d1af4aed7da41e0b9f4f1e0f5621160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:15.409930   761 ts_tablet_manager.cc:1434] T 2bec920f53cb42b785062112f132c67c P 5d1af4aed7da41e0b9f4f1e0f5621160: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.001s
I20260709 12:58:15.427420   787 raft_consensus.cc:493] T 51a60c5b8c0c485ebd1fabea4a3457ef P 65b5e378480c4387aee25f0bdfeb1e7e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:15.427883   787 raft_consensus.cc:515] T 51a60c5b8c0c485ebd1fabea4a3457ef P 65b5e378480c4387aee25f0bdfeb1e7e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:15.429694   787 leader_election.cc:290] T 51a60c5b8c0c485ebd1fabea4a3457ef P 65b5e378480c4387aee25f0bdfeb1e7e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e6c65ade84442dba7b9e742f473df99 (127.0.107.193:44941), 5d1af4aed7da41e0b9f4f1e0f5621160 (127.0.107.195:44825)
I20260709 12:58:15.430500   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51a60c5b8c0c485ebd1fabea4a3457ef" candidate_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e6c65ade84442dba7b9e742f473df99" is_pre_election: true
I20260709 12:58:15.430835   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51a60c5b8c0c485ebd1fabea4a3457ef" candidate_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" is_pre_election: true
I20260709 12:58:15.431141   565 raft_consensus.cc:2393] T 51a60c5b8c0c485ebd1fabea4a3457ef P 1e6c65ade84442dba7b9e742f473df99 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65b5e378480c4387aee25f0bdfeb1e7e in current term 1: Already voted for candidate 5d1af4aed7da41e0b9f4f1e0f5621160 in this term.
I20260709 12:58:15.432358   605 leader_election.cc:304] T 51a60c5b8c0c485ebd1fabea4a3457ef P 65b5e378480c4387aee25f0bdfeb1e7e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65b5e378480c4387aee25f0bdfeb1e7e; no voters: 1e6c65ade84442dba7b9e742f473df99, 5d1af4aed7da41e0b9f4f1e0f5621160
I20260709 12:58:15.433148   787 raft_consensus.cc:3060] T 51a60c5b8c0c485ebd1fabea4a3457ef P 65b5e378480c4387aee25f0bdfeb1e7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:15.438578   787 raft_consensus.cc:2749] T 51a60c5b8c0c485ebd1fabea4a3457ef P 65b5e378480c4387aee25f0bdfeb1e7e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:15.444221   787 consensus_queue.cc:1048] T 6c34d54dde1042f2a472ac8502703b79 P 65b5e378480c4387aee25f0bdfeb1e7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:15.458307   813 consensus_queue.cc:1048] T 6c34d54dde1042f2a472ac8502703b79 P 65b5e378480c4387aee25f0bdfeb1e7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:15.475790   786 raft_consensus.cc:493] T d45270a45bb746e597d1d6ee3744b0b7 P 1e6c65ade84442dba7b9e742f473df99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:15.476483   786 raft_consensus.cc:515] T d45270a45bb746e597d1d6ee3744b0b7 P 1e6c65ade84442dba7b9e742f473df99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:15.477711   766 raft_consensus.cc:493] T 82e303e6a0b74de68d18d26049e994ed P 1e6c65ade84442dba7b9e742f473df99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:15.478238   766 raft_consensus.cc:515] T 82e303e6a0b74de68d18d26049e994ed P 1e6c65ade84442dba7b9e742f473df99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:15.478559   786 leader_election.cc:290] T d45270a45bb746e597d1d6ee3744b0b7 P 1e6c65ade84442dba7b9e742f473df99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65b5e378480c4387aee25f0bdfeb1e7e (127.0.107.194:40689), 5d1af4aed7da41e0b9f4f1e0f5621160 (127.0.107.195:44825)
I20260709 12:58:15.480204   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45270a45bb746e597d1d6ee3744b0b7" candidate_uuid: "1e6c65ade84442dba7b9e742f473df99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" is_pre_election: true
I20260709 12:58:15.480870   766 leader_election.cc:290] T 82e303e6a0b74de68d18d26049e994ed P 1e6c65ade84442dba7b9e742f473df99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65b5e378480c4387aee25f0bdfeb1e7e (127.0.107.194:40689), 5d1af4aed7da41e0b9f4f1e0f5621160 (127.0.107.195:44825)
I20260709 12:58:15.481716   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e303e6a0b74de68d18d26049e994ed" candidate_uuid: "1e6c65ade84442dba7b9e742f473df99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" is_pre_election: true
I20260709 12:58:15.481817   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45270a45bb746e597d1d6ee3744b0b7" candidate_uuid: "1e6c65ade84442dba7b9e742f473df99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" is_pre_election: true
I20260709 12:58:15.482499   640 raft_consensus.cc:2468] T 82e303e6a0b74de68d18d26049e994ed P 65b5e378480c4387aee25f0bdfeb1e7e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e6c65ade84442dba7b9e742f473df99 in term 0.
I20260709 12:58:15.482872   639 raft_consensus.cc:2393] T d45270a45bb746e597d1d6ee3744b0b7 P 65b5e378480c4387aee25f0bdfeb1e7e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e6c65ade84442dba7b9e742f473df99 in current term 1: Already voted for candidate 5d1af4aed7da41e0b9f4f1e0f5621160 in this term.
I20260709 12:58:15.483675   531 leader_election.cc:304] T 82e303e6a0b74de68d18d26049e994ed P 1e6c65ade84442dba7b9e742f473df99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e6c65ade84442dba7b9e742f473df99, 65b5e378480c4387aee25f0bdfeb1e7e; no voters: 
I20260709 12:58:15.484664   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e303e6a0b74de68d18d26049e994ed" candidate_uuid: "1e6c65ade84442dba7b9e742f473df99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" is_pre_election: true
I20260709 12:58:15.484694   531 leader_election.cc:304] T d45270a45bb746e597d1d6ee3744b0b7 P 1e6c65ade84442dba7b9e742f473df99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e6c65ade84442dba7b9e742f473df99; no voters: 5d1af4aed7da41e0b9f4f1e0f5621160, 65b5e378480c4387aee25f0bdfeb1e7e
I20260709 12:58:15.485534   715 raft_consensus.cc:2468] T 82e303e6a0b74de68d18d26049e994ed P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e6c65ade84442dba7b9e742f473df99 in term 0.
I20260709 12:58:15.486642   786 raft_consensus.cc:2804] T 82e303e6a0b74de68d18d26049e994ed P 1e6c65ade84442dba7b9e742f473df99 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:15.487128   786 raft_consensus.cc:493] T 82e303e6a0b74de68d18d26049e994ed P 1e6c65ade84442dba7b9e742f473df99 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:15.487458   786 raft_consensus.cc:3060] T 82e303e6a0b74de68d18d26049e994ed P 1e6c65ade84442dba7b9e742f473df99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:15.487360   766 raft_consensus.cc:3060] T d45270a45bb746e597d1d6ee3744b0b7 P 1e6c65ade84442dba7b9e742f473df99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:15.492935   786 raft_consensus.cc:515] T 82e303e6a0b74de68d18d26049e994ed P 1e6c65ade84442dba7b9e742f473df99 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:15.494678   786 leader_election.cc:290] T 82e303e6a0b74de68d18d26049e994ed P 1e6c65ade84442dba7b9e742f473df99 [CANDIDATE]: Term 1 election: Requested vote from peers 65b5e378480c4387aee25f0bdfeb1e7e (127.0.107.194:40689), 5d1af4aed7da41e0b9f4f1e0f5621160 (127.0.107.195:44825)
I20260709 12:58:15.495335   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e303e6a0b74de68d18d26049e994ed" candidate_uuid: "1e6c65ade84442dba7b9e742f473df99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65b5e378480c4387aee25f0bdfeb1e7e"
I20260709 12:58:15.495915   639 raft_consensus.cc:3060] T 82e303e6a0b74de68d18d26049e994ed P 65b5e378480c4387aee25f0bdfeb1e7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:15.496049   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e303e6a0b74de68d18d26049e994ed" candidate_uuid: "1e6c65ade84442dba7b9e742f473df99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160"
I20260709 12:58:15.496542   715 raft_consensus.cc:3060] T 82e303e6a0b74de68d18d26049e994ed P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:15.501446   766 raft_consensus.cc:2749] T d45270a45bb746e597d1d6ee3744b0b7 P 1e6c65ade84442dba7b9e742f473df99 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:15.501446   715 raft_consensus.cc:2468] T 82e303e6a0b74de68d18d26049e994ed P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e6c65ade84442dba7b9e742f473df99 in term 1.
I20260709 12:58:15.502556   639 raft_consensus.cc:2468] T 82e303e6a0b74de68d18d26049e994ed P 65b5e378480c4387aee25f0bdfeb1e7e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e6c65ade84442dba7b9e742f473df99 in term 1.
I20260709 12:58:15.503050   530 leader_election.cc:304] T 82e303e6a0b74de68d18d26049e994ed P 1e6c65ade84442dba7b9e742f473df99 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e6c65ade84442dba7b9e742f473df99, 5d1af4aed7da41e0b9f4f1e0f5621160; no voters: 
I20260709 12:58:15.504016   766 raft_consensus.cc:2804] T 82e303e6a0b74de68d18d26049e994ed P 1e6c65ade84442dba7b9e742f473df99 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:15.504631   766 raft_consensus.cc:697] T 82e303e6a0b74de68d18d26049e994ed P 1e6c65ade84442dba7b9e742f473df99 [term 1 LEADER]: Becoming Leader. State: Replica: 1e6c65ade84442dba7b9e742f473df99, State: Running, Role: LEADER
I20260709 12:58:15.505717   766 consensus_queue.cc:237] T 82e303e6a0b74de68d18d26049e994ed P 1e6c65ade84442dba7b9e742f473df99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:15.514299   461 catalog_manager.cc:5697] T 82e303e6a0b74de68d18d26049e994ed P 1e6c65ade84442dba7b9e742f473df99 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e6c65ade84442dba7b9e742f473df99 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "1e6c65ade84442dba7b9e742f473df99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:15.527855   791 consensus_queue.cc:1048] T 51a60c5b8c0c485ebd1fabea4a3457ef P 5d1af4aed7da41e0b9f4f1e0f5621160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:15.540779   814 consensus_queue.cc:1048] T 51a60c5b8c0c485ebd1fabea4a3457ef P 5d1af4aed7da41e0b9f4f1e0f5621160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:15.603444   766 raft_consensus.cc:493] T c496907a8ecb49cc86a0784628ae42c9 P 1e6c65ade84442dba7b9e742f473df99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:15.603891   766 raft_consensus.cc:515] T c496907a8ecb49cc86a0784628ae42c9 P 1e6c65ade84442dba7b9e742f473df99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:15.606824   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c496907a8ecb49cc86a0784628ae42c9" candidate_uuid: "1e6c65ade84442dba7b9e742f473df99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" is_pre_election: true
I20260709 12:58:15.607249   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c496907a8ecb49cc86a0784628ae42c9" candidate_uuid: "1e6c65ade84442dba7b9e742f473df99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" is_pre_election: true
I20260709 12:58:15.606060   766 leader_election.cc:290] T c496907a8ecb49cc86a0784628ae42c9 P 1e6c65ade84442dba7b9e742f473df99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65b5e378480c4387aee25f0bdfeb1e7e (127.0.107.194:40689), 5d1af4aed7da41e0b9f4f1e0f5621160 (127.0.107.195:44825)
I20260709 12:58:15.607995   715 raft_consensus.cc:2393] T c496907a8ecb49cc86a0784628ae42c9 P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e6c65ade84442dba7b9e742f473df99 in current term 1: Already voted for candidate 65b5e378480c4387aee25f0bdfeb1e7e in this term.
I20260709 12:58:15.608745   791 raft_consensus.cc:493] T 87ceba987e5d48ba916d5e869e2a03b6 P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:15.608896   530 leader_election.cc:304] T c496907a8ecb49cc86a0784628ae42c9 P 1e6c65ade84442dba7b9e742f473df99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e6c65ade84442dba7b9e742f473df99; no voters: 5d1af4aed7da41e0b9f4f1e0f5621160, 65b5e378480c4387aee25f0bdfeb1e7e
I20260709 12:58:15.609222   791 raft_consensus.cc:515] T 87ceba987e5d48ba916d5e869e2a03b6 P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:15.609658   766 raft_consensus.cc:3060] T c496907a8ecb49cc86a0784628ae42c9 P 1e6c65ade84442dba7b9e742f473df99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:15.612735   791 leader_election.cc:290] T 87ceba987e5d48ba916d5e869e2a03b6 P 5d1af4aed7da41e0b9f4f1e0f5621160 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e6c65ade84442dba7b9e742f473df99 (127.0.107.193:44941), 65b5e378480c4387aee25f0bdfeb1e7e (127.0.107.194:40689)
I20260709 12:58:15.613358   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ceba987e5d48ba916d5e869e2a03b6" candidate_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" is_pre_election: true
I20260709 12:58:15.613420   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ceba987e5d48ba916d5e869e2a03b6" candidate_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e6c65ade84442dba7b9e742f473df99" is_pre_election: true
I20260709 12:58:15.615052   791 consensus_queue.cc:1048] T 811ff95e986542668558d35c387ec366 P 5d1af4aed7da41e0b9f4f1e0f5621160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:15.615592   565 raft_consensus.cc:2393] T 87ceba987e5d48ba916d5e869e2a03b6 P 1e6c65ade84442dba7b9e742f473df99 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d1af4aed7da41e0b9f4f1e0f5621160 in current term 1: Already voted for candidate 65b5e378480c4387aee25f0bdfeb1e7e in this term.
I20260709 12:58:15.616771   679 leader_election.cc:304] T 87ceba987e5d48ba916d5e869e2a03b6 P 5d1af4aed7da41e0b9f4f1e0f5621160 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d1af4aed7da41e0b9f4f1e0f5621160; no voters: 1e6c65ade84442dba7b9e742f473df99, 65b5e378480c4387aee25f0bdfeb1e7e
I20260709 12:58:15.617534   766 raft_consensus.cc:2749] T c496907a8ecb49cc86a0784628ae42c9 P 1e6c65ade84442dba7b9e742f473df99 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:15.617826   814 raft_consensus.cc:3060] T 87ceba987e5d48ba916d5e869e2a03b6 P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:15.628000   814 raft_consensus.cc:2749] T 87ceba987e5d48ba916d5e869e2a03b6 P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:15.628634   767 consensus_queue.cc:1048] T 811ff95e986542668558d35c387ec366 P 5d1af4aed7da41e0b9f4f1e0f5621160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:15.633450   767 raft_consensus.cc:493] T 2bec920f53cb42b785062112f132c67c P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:15.633904   767 raft_consensus.cc:515] T 2bec920f53cb42b785062112f132c67c P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:15.636569   767 leader_election.cc:290] T 2bec920f53cb42b785062112f132c67c P 5d1af4aed7da41e0b9f4f1e0f5621160 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e6c65ade84442dba7b9e742f473df99 (127.0.107.193:44941), 65b5e378480c4387aee25f0bdfeb1e7e (127.0.107.194:40689)
I20260709 12:58:15.638180   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bec920f53cb42b785062112f132c67c" candidate_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" is_pre_election: true
I20260709 12:58:15.638825   640 raft_consensus.cc:2468] T 2bec920f53cb42b785062112f132c67c P 65b5e378480c4387aee25f0bdfeb1e7e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1af4aed7da41e0b9f4f1e0f5621160 in term 0.
I20260709 12:58:15.640323   680 leader_election.cc:304] T 2bec920f53cb42b785062112f132c67c P 5d1af4aed7da41e0b9f4f1e0f5621160 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1af4aed7da41e0b9f4f1e0f5621160, 65b5e378480c4387aee25f0bdfeb1e7e; no voters: 
I20260709 12:58:15.641897   791 raft_consensus.cc:2804] T 2bec920f53cb42b785062112f132c67c P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:15.642251   791 raft_consensus.cc:493] T 2bec920f53cb42b785062112f132c67c P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:15.643498   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bec920f53cb42b785062112f132c67c" candidate_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e6c65ade84442dba7b9e742f473df99" is_pre_election: true
I20260709 12:58:15.644150   565 raft_consensus.cc:2468] T 2bec920f53cb42b785062112f132c67c P 1e6c65ade84442dba7b9e742f473df99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d1af4aed7da41e0b9f4f1e0f5621160 in term 0.
I20260709 12:58:15.642581   791 raft_consensus.cc:3060] T 2bec920f53cb42b785062112f132c67c P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:15.646041   766 consensus_queue.cc:1048] T a10f7a7b26cf41d38030d1e80c6123ec P 1e6c65ade84442dba7b9e742f473df99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:15.652693   791 raft_consensus.cc:515] T 2bec920f53cb42b785062112f132c67c P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:15.655764   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bec920f53cb42b785062112f132c67c" candidate_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65b5e378480c4387aee25f0bdfeb1e7e"
I20260709 12:58:15.656159   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bec920f53cb42b785062112f132c67c" candidate_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e6c65ade84442dba7b9e742f473df99"
I20260709 12:58:15.656441   639 raft_consensus.cc:3060] T 2bec920f53cb42b785062112f132c67c P 65b5e378480c4387aee25f0bdfeb1e7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:15.656739   565 raft_consensus.cc:3060] T 2bec920f53cb42b785062112f132c67c P 1e6c65ade84442dba7b9e742f473df99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:15.657130   791 leader_election.cc:290] T 2bec920f53cb42b785062112f132c67c P 5d1af4aed7da41e0b9f4f1e0f5621160 [CANDIDATE]: Term 1 election: Requested vote from peers 1e6c65ade84442dba7b9e742f473df99 (127.0.107.193:44941), 65b5e378480c4387aee25f0bdfeb1e7e (127.0.107.194:40689)
I20260709 12:58:15.664448   565 raft_consensus.cc:2468] T 2bec920f53cb42b785062112f132c67c P 1e6c65ade84442dba7b9e742f473df99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1af4aed7da41e0b9f4f1e0f5621160 in term 1.
I20260709 12:58:15.666131   639 raft_consensus.cc:2468] T 2bec920f53cb42b785062112f132c67c P 65b5e378480c4387aee25f0bdfeb1e7e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1af4aed7da41e0b9f4f1e0f5621160 in term 1.
I20260709 12:58:15.666266   679 leader_election.cc:304] T 2bec920f53cb42b785062112f132c67c P 5d1af4aed7da41e0b9f4f1e0f5621160 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e6c65ade84442dba7b9e742f473df99, 5d1af4aed7da41e0b9f4f1e0f5621160; no voters: 
I20260709 12:58:15.667099   791 raft_consensus.cc:2804] T 2bec920f53cb42b785062112f132c67c P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:15.667577   791 raft_consensus.cc:697] T 2bec920f53cb42b785062112f132c67c P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 1 LEADER]: Becoming Leader. State: Replica: 5d1af4aed7da41e0b9f4f1e0f5621160, State: Running, Role: LEADER
I20260709 12:58:15.668322   791 consensus_queue.cc:237] T 2bec920f53cb42b785062112f132c67c P 5d1af4aed7da41e0b9f4f1e0f5621160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:15.675715   766 consensus_queue.cc:1048] T a10f7a7b26cf41d38030d1e80c6123ec P 1e6c65ade84442dba7b9e742f473df99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:15.684193   462 catalog_manager.cc:5697] T 2bec920f53cb42b785062112f132c67c P 5d1af4aed7da41e0b9f4f1e0f5621160 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d1af4aed7da41e0b9f4f1e0f5621160 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:15.697021   813 consensus_queue.cc:1048] T c496907a8ecb49cc86a0784628ae42c9 P 65b5e378480c4387aee25f0bdfeb1e7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:15.710775   762 consensus_queue.cc:1048] T c496907a8ecb49cc86a0784628ae42c9 P 65b5e378480c4387aee25f0bdfeb1e7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:15.875217   762 consensus_queue.cc:1048] T 87ceba987e5d48ba916d5e869e2a03b6 P 65b5e378480c4387aee25f0bdfeb1e7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:15.877851   762 consensus_queue.cc:1048] T 87ceba987e5d48ba916d5e869e2a03b6 P 65b5e378480c4387aee25f0bdfeb1e7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:15.892716   791 consensus_queue.cc:1048] T d45270a45bb746e597d1d6ee3744b0b7 P 5d1af4aed7da41e0b9f4f1e0f5621160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:15.911057   815 consensus_queue.cc:1048] T d45270a45bb746e597d1d6ee3744b0b7 P 5d1af4aed7da41e0b9f4f1e0f5621160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:15.968264   830 consensus_queue.cc:1048] T 82e303e6a0b74de68d18d26049e994ed P 1e6c65ade84442dba7b9e742f473df99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:15.983194   830 consensus_queue.cc:1048] T 82e303e6a0b74de68d18d26049e994ed P 1e6c65ade84442dba7b9e742f473df99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:16.020306   715 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "811ff95e986542668558d35c387ec366"
dest_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160"
mode: GRACEFUL
new_leader_uuid: "1e6c65ade84442dba7b9e742f473df99"
 from {username='slave'} at 127.0.0.1:53238
I20260709 12:58:16.021049   715 raft_consensus.cc:606] T 811ff95e986542668558d35c387ec366 P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 1 LEADER]: Received request to transfer leadership to TS 1e6c65ade84442dba7b9e742f473df99
I20260709 12:58:16.038543   639 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c496907a8ecb49cc86a0784628ae42c9"
dest_uuid: "65b5e378480c4387aee25f0bdfeb1e7e"
mode: GRACEFUL
new_leader_uuid: "1e6c65ade84442dba7b9e742f473df99"
 from {username='slave'} at 127.0.0.1:33468
I20260709 12:58:16.039259   639 raft_consensus.cc:606] T c496907a8ecb49cc86a0784628ae42c9 P 65b5e378480c4387aee25f0bdfeb1e7e [term 1 LEADER]: Received request to transfer leadership to TS 1e6c65ade84442dba7b9e742f473df99
I20260709 12:58:16.044950   715 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2bec920f53cb42b785062112f132c67c"
dest_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160"
mode: GRACEFUL
new_leader_uuid: "1e6c65ade84442dba7b9e742f473df99"
 from {username='slave'} at 127.0.0.1:53238
I20260709 12:58:16.045624   715 raft_consensus.cc:606] T 2bec920f53cb42b785062112f132c67c P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 1 LEADER]: Received request to transfer leadership to TS 1e6c65ade84442dba7b9e742f473df99
I20260709 12:58:16.063290   565 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "82e303e6a0b74de68d18d26049e994ed"
dest_uuid: "1e6c65ade84442dba7b9e742f473df99"
mode: GRACEFUL
new_leader_uuid: "65b5e378480c4387aee25f0bdfeb1e7e"
 from {username='slave'} at 127.0.0.1:38364
I20260709 12:58:16.063902   565 raft_consensus.cc:606] T 82e303e6a0b74de68d18d26049e994ed P 1e6c65ade84442dba7b9e742f473df99 [term 1 LEADER]: Received request to transfer leadership to TS 65b5e378480c4387aee25f0bdfeb1e7e
I20260709 12:58:16.072041   715 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d45270a45bb746e597d1d6ee3744b0b7"
dest_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160"
mode: GRACEFUL
new_leader_uuid: "65b5e378480c4387aee25f0bdfeb1e7e"
 from {username='slave'} at 127.0.0.1:53238
I20260709 12:58:16.072697   715 raft_consensus.cc:606] T d45270a45bb746e597d1d6ee3744b0b7 P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 1 LEADER]: Received request to transfer leadership to TS 65b5e378480c4387aee25f0bdfeb1e7e
I20260709 12:58:16.074572   767 consensus_queue.cc:1048] T 2bec920f53cb42b785062112f132c67c P 5d1af4aed7da41e0b9f4f1e0f5621160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:16.087108   767 consensus_queue.cc:1048] T 2bec920f53cb42b785062112f132c67c P 5d1af4aed7da41e0b9f4f1e0f5621160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:16.097568   767 raft_consensus.cc:993] T 2bec920f53cb42b785062112f132c67c P 5d1af4aed7da41e0b9f4f1e0f5621160: : Instructing follower 1e6c65ade84442dba7b9e742f473df99 to start an election
I20260709 12:58:16.098024   767 raft_consensus.cc:1081] T 2bec920f53cb42b785062112f132c67c P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 1 LEADER]: Signalling peer 1e6c65ade84442dba7b9e742f473df99 to start an election
I20260709 12:58:16.101900   565 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2bec920f53cb42b785062112f132c67c"
dest_uuid: "1e6c65ade84442dba7b9e742f473df99"
 from {username='slave'} at 127.0.0.1:38362
I20260709 12:58:16.102525   565 raft_consensus.cc:493] T 2bec920f53cb42b785062112f132c67c P 1e6c65ade84442dba7b9e742f473df99 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:16.102932   565 raft_consensus.cc:3060] T 2bec920f53cb42b785062112f132c67c P 1e6c65ade84442dba7b9e742f473df99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:16.113399   565 raft_consensus.cc:515] T 2bec920f53cb42b785062112f132c67c P 1e6c65ade84442dba7b9e742f473df99 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:16.116235   565 leader_election.cc:290] T 2bec920f53cb42b785062112f132c67c P 1e6c65ade84442dba7b9e742f473df99 [CANDIDATE]: Term 2 election: Requested vote from peers 65b5e378480c4387aee25f0bdfeb1e7e (127.0.107.194:40689), 5d1af4aed7da41e0b9f4f1e0f5621160 (127.0.107.195:44825)
I20260709 12:58:16.116514   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bec920f53cb42b785062112f132c67c" candidate_uuid: "1e6c65ade84442dba7b9e742f473df99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "65b5e378480c4387aee25f0bdfeb1e7e"
I20260709 12:58:16.117993   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bec920f53cb42b785062112f132c67c" candidate_uuid: "1e6c65ade84442dba7b9e742f473df99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160"
I20260709 12:58:16.118633   715 raft_consensus.cc:3055] T 2bec920f53cb42b785062112f132c67c P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:16.119027   715 raft_consensus.cc:740] T 2bec920f53cb42b785062112f132c67c P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5d1af4aed7da41e0b9f4f1e0f5621160, State: Running, Role: LEADER
I20260709 12:58:16.119901   715 consensus_queue.cc:260] T 2bec920f53cb42b785062112f132c67c P 5d1af4aed7da41e0b9f4f1e0f5621160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:16.121496   715 raft_consensus.cc:3060] T 2bec920f53cb42b785062112f132c67c P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:16.118144   639 raft_consensus.cc:3060] T 2bec920f53cb42b785062112f132c67c P 65b5e378480c4387aee25f0bdfeb1e7e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:16.128609   639 raft_consensus.cc:2468] T 2bec920f53cb42b785062112f132c67c P 65b5e378480c4387aee25f0bdfeb1e7e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e6c65ade84442dba7b9e742f473df99 in term 2.
I20260709 12:58:16.129897   531 leader_election.cc:304] T 2bec920f53cb42b785062112f132c67c P 1e6c65ade84442dba7b9e742f473df99 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e6c65ade84442dba7b9e742f473df99, 65b5e378480c4387aee25f0bdfeb1e7e; no voters: 
I20260709 12:58:16.130584   715 raft_consensus.cc:2468] T 2bec920f53cb42b785062112f132c67c P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e6c65ade84442dba7b9e742f473df99 in term 2.
I20260709 12:58:16.130751   786 raft_consensus.cc:2804] T 2bec920f53cb42b785062112f132c67c P 1e6c65ade84442dba7b9e742f473df99 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:16.131287   786 raft_consensus.cc:697] T 2bec920f53cb42b785062112f132c67c P 1e6c65ade84442dba7b9e742f473df99 [term 2 LEADER]: Becoming Leader. State: Replica: 1e6c65ade84442dba7b9e742f473df99, State: Running, Role: LEADER
I20260709 12:58:16.132059   786 consensus_queue.cc:237] T 2bec920f53cb42b785062112f132c67c P 1e6c65ade84442dba7b9e742f473df99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:16.139680   463 catalog_manager.cc:5697] T 2bec920f53cb42b785062112f132c67c P 1e6c65ade84442dba7b9e742f473df99 reported cstate change: term changed from 1 to 2, leader changed from 5d1af4aed7da41e0b9f4f1e0f5621160 (127.0.107.195) to 1e6c65ade84442dba7b9e742f473df99 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "1e6c65ade84442dba7b9e742f473df99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:16.151348   814 raft_consensus.cc:993] T 811ff95e986542668558d35c387ec366 P 5d1af4aed7da41e0b9f4f1e0f5621160: : Instructing follower 1e6c65ade84442dba7b9e742f473df99 to start an election
I20260709 12:58:16.151777   815 raft_consensus.cc:1081] T 811ff95e986542668558d35c387ec366 P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 1 LEADER]: Signalling peer 1e6c65ade84442dba7b9e742f473df99 to start an election
I20260709 12:58:16.153251   565 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "811ff95e986542668558d35c387ec366"
dest_uuid: "1e6c65ade84442dba7b9e742f473df99"
 from {username='slave'} at 127.0.0.1:38362
I20260709 12:58:16.153841   565 raft_consensus.cc:493] T 811ff95e986542668558d35c387ec366 P 1e6c65ade84442dba7b9e742f473df99 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:16.154214   565 raft_consensus.cc:3060] T 811ff95e986542668558d35c387ec366 P 1e6c65ade84442dba7b9e742f473df99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:16.161336   565 raft_consensus.cc:515] T 811ff95e986542668558d35c387ec366 P 1e6c65ade84442dba7b9e742f473df99 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:16.163480   565 leader_election.cc:290] T 811ff95e986542668558d35c387ec366 P 1e6c65ade84442dba7b9e742f473df99 [CANDIDATE]: Term 2 election: Requested vote from peers 65b5e378480c4387aee25f0bdfeb1e7e (127.0.107.194:40689), 5d1af4aed7da41e0b9f4f1e0f5621160 (127.0.107.195:44825)
I20260709 12:58:16.164263   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811ff95e986542668558d35c387ec366" candidate_uuid: "1e6c65ade84442dba7b9e742f473df99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "65b5e378480c4387aee25f0bdfeb1e7e"
I20260709 12:58:16.164659   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811ff95e986542668558d35c387ec366" candidate_uuid: "1e6c65ade84442dba7b9e742f473df99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160"
I20260709 12:58:16.164884   639 raft_consensus.cc:3060] T 811ff95e986542668558d35c387ec366 P 65b5e378480c4387aee25f0bdfeb1e7e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:16.165277   715 raft_consensus.cc:3055] T 811ff95e986542668558d35c387ec366 P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:16.165766   715 raft_consensus.cc:740] T 811ff95e986542668558d35c387ec366 P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5d1af4aed7da41e0b9f4f1e0f5621160, State: Running, Role: LEADER
I20260709 12:58:16.166604   715 consensus_queue.cc:260] T 811ff95e986542668558d35c387ec366 P 5d1af4aed7da41e0b9f4f1e0f5621160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:16.167797   715 raft_consensus.cc:3060] T 811ff95e986542668558d35c387ec366 P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:16.170173   639 raft_consensus.cc:2468] T 811ff95e986542668558d35c387ec366 P 65b5e378480c4387aee25f0bdfeb1e7e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e6c65ade84442dba7b9e742f473df99 in term 2.
I20260709 12:58:16.171265   531 leader_election.cc:304] T 811ff95e986542668558d35c387ec366 P 1e6c65ade84442dba7b9e742f473df99 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e6c65ade84442dba7b9e742f473df99, 65b5e378480c4387aee25f0bdfeb1e7e; no voters: 
I20260709 12:58:16.171926   786 raft_consensus.cc:2804] T 811ff95e986542668558d35c387ec366 P 1e6c65ade84442dba7b9e742f473df99 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:16.172408   786 raft_consensus.cc:697] T 811ff95e986542668558d35c387ec366 P 1e6c65ade84442dba7b9e742f473df99 [term 2 LEADER]: Becoming Leader. State: Replica: 1e6c65ade84442dba7b9e742f473df99, State: Running, Role: LEADER
I20260709 12:58:16.173136   786 consensus_queue.cc:237] T 811ff95e986542668558d35c387ec366 P 1e6c65ade84442dba7b9e742f473df99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:16.174947   715 raft_consensus.cc:2468] T 811ff95e986542668558d35c387ec366 P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e6c65ade84442dba7b9e742f473df99 in term 2.
I20260709 12:58:16.180697   463 catalog_manager.cc:5697] T 811ff95e986542668558d35c387ec366 P 1e6c65ade84442dba7b9e742f473df99 reported cstate change: term changed from 1 to 2, leader changed from 5d1af4aed7da41e0b9f4f1e0f5621160 (127.0.107.195) to 1e6c65ade84442dba7b9e742f473df99 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "1e6c65ade84442dba7b9e742f473df99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:16.230897   788 raft_consensus.cc:993] T c496907a8ecb49cc86a0784628ae42c9 P 65b5e378480c4387aee25f0bdfeb1e7e: : Instructing follower 1e6c65ade84442dba7b9e742f473df99 to start an election
I20260709 12:58:16.231305   788 raft_consensus.cc:1081] T c496907a8ecb49cc86a0784628ae42c9 P 65b5e378480c4387aee25f0bdfeb1e7e [term 1 LEADER]: Signalling peer 1e6c65ade84442dba7b9e742f473df99 to start an election
I20260709 12:58:16.232828   565 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c496907a8ecb49cc86a0784628ae42c9"
dest_uuid: "1e6c65ade84442dba7b9e742f473df99"
 from {username='slave'} at 127.0.0.1:38360
I20260709 12:58:16.233361   565 raft_consensus.cc:493] T c496907a8ecb49cc86a0784628ae42c9 P 1e6c65ade84442dba7b9e742f473df99 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:16.233678   565 raft_consensus.cc:3060] T c496907a8ecb49cc86a0784628ae42c9 P 1e6c65ade84442dba7b9e742f473df99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:16.239759   565 raft_consensus.cc:515] T c496907a8ecb49cc86a0784628ae42c9 P 1e6c65ade84442dba7b9e742f473df99 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:16.241690   565 leader_election.cc:290] T c496907a8ecb49cc86a0784628ae42c9 P 1e6c65ade84442dba7b9e742f473df99 [CANDIDATE]: Term 2 election: Requested vote from peers 65b5e378480c4387aee25f0bdfeb1e7e (127.0.107.194:40689), 5d1af4aed7da41e0b9f4f1e0f5621160 (127.0.107.195:44825)
I20260709 12:58:16.242465   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c496907a8ecb49cc86a0784628ae42c9" candidate_uuid: "1e6c65ade84442dba7b9e742f473df99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "65b5e378480c4387aee25f0bdfeb1e7e"
I20260709 12:58:16.242856   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c496907a8ecb49cc86a0784628ae42c9" candidate_uuid: "1e6c65ade84442dba7b9e742f473df99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160"
I20260709 12:58:16.243115   639 raft_consensus.cc:3055] T c496907a8ecb49cc86a0784628ae42c9 P 65b5e378480c4387aee25f0bdfeb1e7e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:16.243454   714 raft_consensus.cc:3060] T c496907a8ecb49cc86a0784628ae42c9 P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:16.243487   639 raft_consensus.cc:740] T c496907a8ecb49cc86a0784628ae42c9 P 65b5e378480c4387aee25f0bdfeb1e7e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 65b5e378480c4387aee25f0bdfeb1e7e, State: Running, Role: LEADER
I20260709 12:58:16.245277   639 consensus_queue.cc:260] T c496907a8ecb49cc86a0784628ae42c9 P 65b5e378480c4387aee25f0bdfeb1e7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:16.246316   639 raft_consensus.cc:3060] T c496907a8ecb49cc86a0784628ae42c9 P 65b5e378480c4387aee25f0bdfeb1e7e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:16.251564   639 raft_consensus.cc:2468] T c496907a8ecb49cc86a0784628ae42c9 P 65b5e378480c4387aee25f0bdfeb1e7e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e6c65ade84442dba7b9e742f473df99 in term 2.
I20260709 12:58:16.251832   714 raft_consensus.cc:2468] T c496907a8ecb49cc86a0784628ae42c9 P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e6c65ade84442dba7b9e742f473df99 in term 2.
I20260709 12:58:16.252689   531 leader_election.cc:304] T c496907a8ecb49cc86a0784628ae42c9 P 1e6c65ade84442dba7b9e742f473df99 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e6c65ade84442dba7b9e742f473df99, 65b5e378480c4387aee25f0bdfeb1e7e; no voters: 
I20260709 12:58:16.253451   786 raft_consensus.cc:2804] T c496907a8ecb49cc86a0784628ae42c9 P 1e6c65ade84442dba7b9e742f473df99 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:16.253916   786 raft_consensus.cc:697] T c496907a8ecb49cc86a0784628ae42c9 P 1e6c65ade84442dba7b9e742f473df99 [term 2 LEADER]: Becoming Leader. State: Replica: 1e6c65ade84442dba7b9e742f473df99, State: Running, Role: LEADER
I20260709 12:58:16.255213   786 consensus_queue.cc:237] T c496907a8ecb49cc86a0784628ae42c9 P 1e6c65ade84442dba7b9e742f473df99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:16.263119   463 catalog_manager.cc:5697] T c496907a8ecb49cc86a0784628ae42c9 P 1e6c65ade84442dba7b9e742f473df99 reported cstate change: term changed from 1 to 2, leader changed from 65b5e378480c4387aee25f0bdfeb1e7e (127.0.107.194) to 1e6c65ade84442dba7b9e742f473df99 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "1e6c65ade84442dba7b9e742f473df99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:16.491241   766 raft_consensus.cc:993] T 82e303e6a0b74de68d18d26049e994ed P 1e6c65ade84442dba7b9e742f473df99: : Instructing follower 65b5e378480c4387aee25f0bdfeb1e7e to start an election
I20260709 12:58:16.491745   786 raft_consensus.cc:1081] T 82e303e6a0b74de68d18d26049e994ed P 1e6c65ade84442dba7b9e742f473df99 [term 1 LEADER]: Signalling peer 65b5e378480c4387aee25f0bdfeb1e7e to start an election
I20260709 12:58:16.493297   639 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "82e303e6a0b74de68d18d26049e994ed"
dest_uuid: "65b5e378480c4387aee25f0bdfeb1e7e"
 from {username='slave'} at 127.0.0.1:33454
I20260709 12:58:16.493887   639 raft_consensus.cc:493] T 82e303e6a0b74de68d18d26049e994ed P 65b5e378480c4387aee25f0bdfeb1e7e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:16.494256   639 raft_consensus.cc:3060] T 82e303e6a0b74de68d18d26049e994ed P 65b5e378480c4387aee25f0bdfeb1e7e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:16.497576   767 raft_consensus.cc:993] T d45270a45bb746e597d1d6ee3744b0b7 P 5d1af4aed7da41e0b9f4f1e0f5621160: : Instructing follower 65b5e378480c4387aee25f0bdfeb1e7e to start an election
I20260709 12:58:16.498070   815 raft_consensus.cc:1081] T d45270a45bb746e597d1d6ee3744b0b7 P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 1 LEADER]: Signalling peer 65b5e378480c4387aee25f0bdfeb1e7e to start an election
I20260709 12:58:16.499748   640 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d45270a45bb746e597d1d6ee3744b0b7"
dest_uuid: "65b5e378480c4387aee25f0bdfeb1e7e"
 from {username='slave'} at 127.0.0.1:33460
I20260709 12:58:16.500326   640 raft_consensus.cc:493] T d45270a45bb746e597d1d6ee3744b0b7 P 65b5e378480c4387aee25f0bdfeb1e7e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:16.500687   640 raft_consensus.cc:3060] T d45270a45bb746e597d1d6ee3744b0b7 P 65b5e378480c4387aee25f0bdfeb1e7e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:16.500614   639 raft_consensus.cc:515] T 82e303e6a0b74de68d18d26049e994ed P 65b5e378480c4387aee25f0bdfeb1e7e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:16.502765   639 leader_election.cc:290] T 82e303e6a0b74de68d18d26049e994ed P 65b5e378480c4387aee25f0bdfeb1e7e [CANDIDATE]: Term 2 election: Requested vote from peers 1e6c65ade84442dba7b9e742f473df99 (127.0.107.193:44941), 5d1af4aed7da41e0b9f4f1e0f5621160 (127.0.107.195:44825)
I20260709 12:58:16.503528   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e303e6a0b74de68d18d26049e994ed" candidate_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1e6c65ade84442dba7b9e742f473df99"
I20260709 12:58:16.503875   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82e303e6a0b74de68d18d26049e994ed" candidate_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160"
I20260709 12:58:16.504122   565 raft_consensus.cc:3055] T 82e303e6a0b74de68d18d26049e994ed P 1e6c65ade84442dba7b9e742f473df99 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:16.504446   565 raft_consensus.cc:740] T 82e303e6a0b74de68d18d26049e994ed P 1e6c65ade84442dba7b9e742f473df99 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1e6c65ade84442dba7b9e742f473df99, State: Running, Role: LEADER
I20260709 12:58:16.504482   714 raft_consensus.cc:3060] T 82e303e6a0b74de68d18d26049e994ed P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:16.505326   565 consensus_queue.cc:260] T 82e303e6a0b74de68d18d26049e994ed P 1e6c65ade84442dba7b9e742f473df99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:16.506517   565 raft_consensus.cc:3060] T 82e303e6a0b74de68d18d26049e994ed P 1e6c65ade84442dba7b9e742f473df99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:16.506742   640 raft_consensus.cc:515] T d45270a45bb746e597d1d6ee3744b0b7 P 65b5e378480c4387aee25f0bdfeb1e7e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:16.508445   640 leader_election.cc:290] T d45270a45bb746e597d1d6ee3744b0b7 P 65b5e378480c4387aee25f0bdfeb1e7e [CANDIDATE]: Term 2 election: Requested vote from peers 1e6c65ade84442dba7b9e742f473df99 (127.0.107.193:44941), 5d1af4aed7da41e0b9f4f1e0f5621160 (127.0.107.195:44825)
I20260709 12:58:16.509842   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45270a45bb746e597d1d6ee3744b0b7" candidate_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1e6c65ade84442dba7b9e742f473df99"
I20260709 12:58:16.510453   566 raft_consensus.cc:3060] T d45270a45bb746e597d1d6ee3744b0b7 P 1e6c65ade84442dba7b9e742f473df99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:16.513566   565 raft_consensus.cc:2468] T 82e303e6a0b74de68d18d26049e994ed P 1e6c65ade84442dba7b9e742f473df99 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65b5e378480c4387aee25f0bdfeb1e7e in term 2.
I20260709 12:58:16.514320   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45270a45bb746e597d1d6ee3744b0b7" candidate_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160"
I20260709 12:58:16.514918   715 raft_consensus.cc:3055] T d45270a45bb746e597d1d6ee3744b0b7 P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:16.514928   605 leader_election.cc:304] T 82e303e6a0b74de68d18d26049e994ed P 65b5e378480c4387aee25f0bdfeb1e7e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e6c65ade84442dba7b9e742f473df99, 65b5e378480c4387aee25f0bdfeb1e7e; no voters: 
I20260709 12:58:16.515269   715 raft_consensus.cc:740] T d45270a45bb746e597d1d6ee3744b0b7 P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5d1af4aed7da41e0b9f4f1e0f5621160, State: Running, Role: LEADER
I20260709 12:58:16.515834   788 raft_consensus.cc:2804] T 82e303e6a0b74de68d18d26049e994ed P 65b5e378480c4387aee25f0bdfeb1e7e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:16.516309   788 raft_consensus.cc:697] T 82e303e6a0b74de68d18d26049e994ed P 65b5e378480c4387aee25f0bdfeb1e7e [term 2 LEADER]: Becoming Leader. State: Replica: 65b5e378480c4387aee25f0bdfeb1e7e, State: Running, Role: LEADER
I20260709 12:58:16.517026   566 raft_consensus.cc:2468] T d45270a45bb746e597d1d6ee3744b0b7 P 1e6c65ade84442dba7b9e742f473df99 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65b5e378480c4387aee25f0bdfeb1e7e in term 2.
I20260709 12:58:16.516433   715 consensus_queue.cc:260] T d45270a45bb746e597d1d6ee3744b0b7 P 5d1af4aed7da41e0b9f4f1e0f5621160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
W20260709 12:58:16.517714   678 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:16.517836   715 raft_consensus.cc:3060] T d45270a45bb746e597d1d6ee3744b0b7 P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:16.517575   788 consensus_queue.cc:237] T 82e303e6a0b74de68d18d26049e994ed P 65b5e378480c4387aee25f0bdfeb1e7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:16.518805   605 leader_election.cc:304] T d45270a45bb746e597d1d6ee3744b0b7 P 65b5e378480c4387aee25f0bdfeb1e7e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e6c65ade84442dba7b9e742f473df99, 65b5e378480c4387aee25f0bdfeb1e7e; no voters: 
I20260709 12:58:16.519598   813 raft_consensus.cc:2804] T d45270a45bb746e597d1d6ee3744b0b7 P 65b5e378480c4387aee25f0bdfeb1e7e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:16.520023   813 raft_consensus.cc:697] T d45270a45bb746e597d1d6ee3744b0b7 P 65b5e378480c4387aee25f0bdfeb1e7e [term 2 LEADER]: Becoming Leader. State: Replica: 65b5e378480c4387aee25f0bdfeb1e7e, State: Running, Role: LEADER
I20260709 12:58:16.520617   813 consensus_queue.cc:237] T d45270a45bb746e597d1d6ee3744b0b7 P 65b5e378480c4387aee25f0bdfeb1e7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:16.524899   715 raft_consensus.cc:2468] T d45270a45bb746e597d1d6ee3744b0b7 P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65b5e378480c4387aee25f0bdfeb1e7e in term 2.
I20260709 12:58:16.526726   714 raft_consensus.cc:2468] T 82e303e6a0b74de68d18d26049e994ed P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65b5e378480c4387aee25f0bdfeb1e7e in term 2.
I20260709 12:58:16.528731   463 catalog_manager.cc:5697] T 82e303e6a0b74de68d18d26049e994ed P 65b5e378480c4387aee25f0bdfeb1e7e reported cstate change: term changed from 1 to 2, leader changed from 1e6c65ade84442dba7b9e742f473df99 (127.0.107.193) to 65b5e378480c4387aee25f0bdfeb1e7e (127.0.107.194). New cstate: current_term: 2 leader_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:16.540270   463 catalog_manager.cc:5697] T d45270a45bb746e597d1d6ee3744b0b7 P 65b5e378480c4387aee25f0bdfeb1e7e reported cstate change: term changed from 1 to 2, leader changed from 5d1af4aed7da41e0b9f4f1e0f5621160 (127.0.107.195) to 65b5e378480c4387aee25f0bdfeb1e7e (127.0.107.194). New cstate: current_term: 2 leader_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:16.553148   714 raft_consensus.cc:1275] T 811ff95e986542668558d35c387ec366 P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 2 FOLLOWER]: Refusing update from remote peer 1e6c65ade84442dba7b9e742f473df99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:16.554318   786 consensus_queue.cc:1048] T 811ff95e986542668558d35c387ec366 P 1e6c65ade84442dba7b9e742f473df99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:16.562537   639 raft_consensus.cc:1275] T 2bec920f53cb42b785062112f132c67c P 65b5e378480c4387aee25f0bdfeb1e7e [term 2 FOLLOWER]: Refusing update from remote peer 1e6c65ade84442dba7b9e742f473df99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:16.563431   640 raft_consensus.cc:1275] T 811ff95e986542668558d35c387ec366 P 65b5e378480c4387aee25f0bdfeb1e7e [term 2 FOLLOWER]: Refusing update from remote peer 1e6c65ade84442dba7b9e742f473df99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:16.564706   766 consensus_queue.cc:1048] T 2bec920f53cb42b785062112f132c67c P 1e6c65ade84442dba7b9e742f473df99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:16.565232   830 consensus_queue.cc:1048] T 811ff95e986542668558d35c387ec366 P 1e6c65ade84442dba7b9e742f473df99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:16.573941   714 raft_consensus.cc:1275] T 2bec920f53cb42b785062112f132c67c P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 2 FOLLOWER]: Refusing update from remote peer 1e6c65ade84442dba7b9e742f473df99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:16.575893   786 consensus_queue.cc:1048] T 2bec920f53cb42b785062112f132c67c P 1e6c65ade84442dba7b9e742f473df99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:16.702733   640 raft_consensus.cc:1275] T c496907a8ecb49cc86a0784628ae42c9 P 65b5e378480c4387aee25f0bdfeb1e7e [term 2 FOLLOWER]: Refusing update from remote peer 1e6c65ade84442dba7b9e742f473df99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:16.703948   766 consensus_queue.cc:1048] T c496907a8ecb49cc86a0784628ae42c9 P 1e6c65ade84442dba7b9e742f473df99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:16.711256   714 raft_consensus.cc:1275] T c496907a8ecb49cc86a0784628ae42c9 P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 2 FOLLOWER]: Refusing update from remote peer 1e6c65ade84442dba7b9e742f473df99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:16.713184   847 consensus_queue.cc:1048] T c496907a8ecb49cc86a0784628ae42c9 P 1e6c65ade84442dba7b9e742f473df99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:16.983183   714 raft_consensus.cc:1275] T d45270a45bb746e597d1d6ee3744b0b7 P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 2 FOLLOWER]: Refusing update from remote peer 65b5e378480c4387aee25f0bdfeb1e7e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:16.984386   813 consensus_queue.cc:1048] T d45270a45bb746e597d1d6ee3744b0b7 P 65b5e378480c4387aee25f0bdfeb1e7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:16.987864   566 raft_consensus.cc:1275] T d45270a45bb746e597d1d6ee3744b0b7 P 1e6c65ade84442dba7b9e742f473df99 [term 2 FOLLOWER]: Refusing update from remote peer 65b5e378480c4387aee25f0bdfeb1e7e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:16.989275   813 consensus_queue.cc:1048] T d45270a45bb746e597d1d6ee3744b0b7 P 65b5e378480c4387aee25f0bdfeb1e7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:17.009584   714 raft_consensus.cc:1275] T 82e303e6a0b74de68d18d26049e994ed P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 2 FOLLOWER]: Refusing update from remote peer 65b5e378480c4387aee25f0bdfeb1e7e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:17.010748   813 consensus_queue.cc:1048] T 82e303e6a0b74de68d18d26049e994ed P 65b5e378480c4387aee25f0bdfeb1e7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:17.018685   566 raft_consensus.cc:1275] T 82e303e6a0b74de68d18d26049e994ed P 1e6c65ade84442dba7b9e742f473df99 [term 2 FOLLOWER]: Refusing update from remote peer 65b5e378480c4387aee25f0bdfeb1e7e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:17.020695   813 consensus_queue.cc:1048] T 82e303e6a0b74de68d18d26049e994ed P 65b5e378480c4387aee25f0bdfeb1e7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:19.108985   431 auto_leader_rebalancer-test.cc:316] The leader distribution is 
I20260709 12:58:19.109803   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:19.124634   566 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2bec920f53cb42b785062112f132c67c"
dest_uuid: "1e6c65ade84442dba7b9e742f473df99"
mode: GRACEFUL
new_leader_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160"
 from {username='slave'} at 127.0.0.1:38370
I20260709 12:58:19.125118   566 raft_consensus.cc:606] T 2bec920f53cb42b785062112f132c67c P 1e6c65ade84442dba7b9e742f473df99 [term 2 LEADER]: Received request to transfer leadership to TS 5d1af4aed7da41e0b9f4f1e0f5621160
I20260709 12:58:19.134829   640 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "87ceba987e5d48ba916d5e869e2a03b6"
dest_uuid: "65b5e378480c4387aee25f0bdfeb1e7e"
mode: GRACEFUL
new_leader_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160"
 from {username='slave'} at 127.0.0.1:33482
I20260709 12:58:19.135339   640 raft_consensus.cc:606] T 87ceba987e5d48ba916d5e869e2a03b6 P 65b5e378480c4387aee25f0bdfeb1e7e [term 1 LEADER]: Received request to transfer leadership to TS 5d1af4aed7da41e0b9f4f1e0f5621160
I20260709 12:58:19.136490   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:58:19.137055   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:58:19.371073   852 raft_consensus.cc:993] T 87ceba987e5d48ba916d5e869e2a03b6 P 65b5e378480c4387aee25f0bdfeb1e7e: : Instructing follower 5d1af4aed7da41e0b9f4f1e0f5621160 to start an election
I20260709 12:58:19.371513   813 raft_consensus.cc:1081] T 87ceba987e5d48ba916d5e869e2a03b6 P 65b5e378480c4387aee25f0bdfeb1e7e [term 1 LEADER]: Signalling peer 5d1af4aed7da41e0b9f4f1e0f5621160 to start an election
I20260709 12:58:19.372948   715 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "87ceba987e5d48ba916d5e869e2a03b6"
dest_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160"
 from {username='slave'} at 127.0.0.1:53226
I20260709 12:58:19.373407   715 raft_consensus.cc:493] T 87ceba987e5d48ba916d5e869e2a03b6 P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:19.373664   715 raft_consensus.cc:3060] T 87ceba987e5d48ba916d5e869e2a03b6 P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:19.377899   715 raft_consensus.cc:515] T 87ceba987e5d48ba916d5e869e2a03b6 P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:19.379478   715 leader_election.cc:290] T 87ceba987e5d48ba916d5e869e2a03b6 P 5d1af4aed7da41e0b9f4f1e0f5621160 [CANDIDATE]: Term 2 election: Requested vote from peers 1e6c65ade84442dba7b9e742f473df99 (127.0.107.193:44941), 65b5e378480c4387aee25f0bdfeb1e7e (127.0.107.194:40689)
I20260709 12:58:19.380339   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ceba987e5d48ba916d5e869e2a03b6" candidate_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1e6c65ade84442dba7b9e742f473df99"
I20260709 12:58:19.380548   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ceba987e5d48ba916d5e869e2a03b6" candidate_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "65b5e378480c4387aee25f0bdfeb1e7e"
I20260709 12:58:19.380882   566 raft_consensus.cc:3060] T 87ceba987e5d48ba916d5e869e2a03b6 P 1e6c65ade84442dba7b9e742f473df99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:19.381024   640 raft_consensus.cc:3055] T 87ceba987e5d48ba916d5e869e2a03b6 P 65b5e378480c4387aee25f0bdfeb1e7e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:19.381350   640 raft_consensus.cc:740] T 87ceba987e5d48ba916d5e869e2a03b6 P 65b5e378480c4387aee25f0bdfeb1e7e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 65b5e378480c4387aee25f0bdfeb1e7e, State: Running, Role: LEADER
I20260709 12:58:19.381928   640 consensus_queue.cc:260] T 87ceba987e5d48ba916d5e869e2a03b6 P 65b5e378480c4387aee25f0bdfeb1e7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:19.382812   640 raft_consensus.cc:3060] T 87ceba987e5d48ba916d5e869e2a03b6 P 65b5e378480c4387aee25f0bdfeb1e7e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:19.385614   566 raft_consensus.cc:2468] T 87ceba987e5d48ba916d5e869e2a03b6 P 1e6c65ade84442dba7b9e742f473df99 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1af4aed7da41e0b9f4f1e0f5621160 in term 2.
I20260709 12:58:19.386720   679 leader_election.cc:304] T 87ceba987e5d48ba916d5e869e2a03b6 P 5d1af4aed7da41e0b9f4f1e0f5621160 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e6c65ade84442dba7b9e742f473df99, 5d1af4aed7da41e0b9f4f1e0f5621160; no voters: 
I20260709 12:58:19.387276   640 raft_consensus.cc:2468] T 87ceba987e5d48ba916d5e869e2a03b6 P 65b5e378480c4387aee25f0bdfeb1e7e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1af4aed7da41e0b9f4f1e0f5621160 in term 2.
I20260709 12:58:19.387364   856 raft_consensus.cc:2804] T 87ceba987e5d48ba916d5e869e2a03b6 P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:19.388463   856 raft_consensus.cc:697] T 87ceba987e5d48ba916d5e869e2a03b6 P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 2 LEADER]: Becoming Leader. State: Replica: 5d1af4aed7da41e0b9f4f1e0f5621160, State: Running, Role: LEADER
I20260709 12:58:19.389312   856 consensus_queue.cc:237] T 87ceba987e5d48ba916d5e869e2a03b6 P 5d1af4aed7da41e0b9f4f1e0f5621160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:19.395771   462 catalog_manager.cc:5697] T 87ceba987e5d48ba916d5e869e2a03b6 P 5d1af4aed7da41e0b9f4f1e0f5621160 reported cstate change: term changed from 1 to 2, leader changed from 65b5e378480c4387aee25f0bdfeb1e7e (127.0.107.194) to 5d1af4aed7da41e0b9f4f1e0f5621160 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:19.512063   830 raft_consensus.cc:993] T 2bec920f53cb42b785062112f132c67c P 1e6c65ade84442dba7b9e742f473df99: : Instructing follower 5d1af4aed7da41e0b9f4f1e0f5621160 to start an election
I20260709 12:58:19.512446   863 raft_consensus.cc:1081] T 2bec920f53cb42b785062112f132c67c P 1e6c65ade84442dba7b9e742f473df99 [term 2 LEADER]: Signalling peer 5d1af4aed7da41e0b9f4f1e0f5621160 to start an election
I20260709 12:58:19.513926   715 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2bec920f53cb42b785062112f132c67c"
dest_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160"
 from {username='slave'} at 127.0.0.1:53234
I20260709 12:58:19.514380   715 raft_consensus.cc:493] T 2bec920f53cb42b785062112f132c67c P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:19.514685   715 raft_consensus.cc:3060] T 2bec920f53cb42b785062112f132c67c P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:19.518982   715 raft_consensus.cc:515] T 2bec920f53cb42b785062112f132c67c P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:19.520495   715 leader_election.cc:290] T 2bec920f53cb42b785062112f132c67c P 5d1af4aed7da41e0b9f4f1e0f5621160 [CANDIDATE]: Term 3 election: Requested vote from peers 1e6c65ade84442dba7b9e742f473df99 (127.0.107.193:44941), 65b5e378480c4387aee25f0bdfeb1e7e (127.0.107.194:40689)
I20260709 12:58:19.521373   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bec920f53cb42b785062112f132c67c" candidate_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1e6c65ade84442dba7b9e742f473df99"
I20260709 12:58:19.521538   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bec920f53cb42b785062112f132c67c" candidate_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "65b5e378480c4387aee25f0bdfeb1e7e"
I20260709 12:58:19.521975   566 raft_consensus.cc:3055] T 2bec920f53cb42b785062112f132c67c P 1e6c65ade84442dba7b9e742f473df99 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:19.522029   640 raft_consensus.cc:3060] T 2bec920f53cb42b785062112f132c67c P 65b5e378480c4387aee25f0bdfeb1e7e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:19.522390   566 raft_consensus.cc:740] T 2bec920f53cb42b785062112f132c67c P 1e6c65ade84442dba7b9e742f473df99 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1e6c65ade84442dba7b9e742f473df99, State: Running, Role: LEADER
I20260709 12:58:19.523182   566 consensus_queue.cc:260] T 2bec920f53cb42b785062112f132c67c P 1e6c65ade84442dba7b9e742f473df99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:19.524389   566 raft_consensus.cc:3060] T 2bec920f53cb42b785062112f132c67c P 1e6c65ade84442dba7b9e742f473df99 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:19.528750   640 raft_consensus.cc:2468] T 2bec920f53cb42b785062112f132c67c P 65b5e378480c4387aee25f0bdfeb1e7e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1af4aed7da41e0b9f4f1e0f5621160 in term 3.
I20260709 12:58:19.529939   680 leader_election.cc:304] T 2bec920f53cb42b785062112f132c67c P 5d1af4aed7da41e0b9f4f1e0f5621160 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1af4aed7da41e0b9f4f1e0f5621160, 65b5e378480c4387aee25f0bdfeb1e7e; no voters: 
I20260709 12:58:19.530292   566 raft_consensus.cc:2468] T 2bec920f53cb42b785062112f132c67c P 1e6c65ade84442dba7b9e742f473df99 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1af4aed7da41e0b9f4f1e0f5621160 in term 3.
I20260709 12:58:19.530570   856 raft_consensus.cc:2804] T 2bec920f53cb42b785062112f132c67c P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:19.531086   856 raft_consensus.cc:697] T 2bec920f53cb42b785062112f132c67c P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 3 LEADER]: Becoming Leader. State: Replica: 5d1af4aed7da41e0b9f4f1e0f5621160, State: Running, Role: LEADER
I20260709 12:58:19.531872   856 consensus_queue.cc:237] T 2bec920f53cb42b785062112f132c67c P 5d1af4aed7da41e0b9f4f1e0f5621160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:19.539264   462 catalog_manager.cc:5697] T 2bec920f53cb42b785062112f132c67c P 5d1af4aed7da41e0b9f4f1e0f5621160 reported cstate change: term changed from 2 to 3, leader changed from 1e6c65ade84442dba7b9e742f473df99 (127.0.107.193) to 5d1af4aed7da41e0b9f4f1e0f5621160 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:19.789184   566 raft_consensus.cc:1275] T 87ceba987e5d48ba916d5e869e2a03b6 P 1e6c65ade84442dba7b9e742f473df99 [term 2 FOLLOWER]: Refusing update from remote peer 5d1af4aed7da41e0b9f4f1e0f5621160: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:19.790345   856 consensus_queue.cc:1048] T 87ceba987e5d48ba916d5e869e2a03b6 P 5d1af4aed7da41e0b9f4f1e0f5621160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:19.800068   640 raft_consensus.cc:1275] T 87ceba987e5d48ba916d5e869e2a03b6 P 65b5e378480c4387aee25f0bdfeb1e7e [term 2 FOLLOWER]: Refusing update from remote peer 5d1af4aed7da41e0b9f4f1e0f5621160: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:19.802486   856 consensus_queue.cc:1048] T 87ceba987e5d48ba916d5e869e2a03b6 P 5d1af4aed7da41e0b9f4f1e0f5621160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:20.090339   640 raft_consensus.cc:1275] T 2bec920f53cb42b785062112f132c67c P 65b5e378480c4387aee25f0bdfeb1e7e [term 3 FOLLOWER]: Refusing update from remote peer 5d1af4aed7da41e0b9f4f1e0f5621160: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:20.091476   856 consensus_queue.cc:1048] T 2bec920f53cb42b785062112f132c67c P 5d1af4aed7da41e0b9f4f1e0f5621160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:20.099715   566 raft_consensus.cc:1275] T 2bec920f53cb42b785062112f132c67c P 1e6c65ade84442dba7b9e742f473df99 [term 3 FOLLOWER]: Refusing update from remote peer 5d1af4aed7da41e0b9f4f1e0f5621160: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:20.101357   856 consensus_queue.cc:1048] T 2bec920f53cb42b785062112f132c67c P 5d1af4aed7da41e0b9f4f1e0f5621160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:20.137944   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:20.147636   566 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "811ff95e986542668558d35c387ec366"
dest_uuid: "1e6c65ade84442dba7b9e742f473df99"
mode: GRACEFUL
new_leader_uuid: "65b5e378480c4387aee25f0bdfeb1e7e"
 from {username='slave'} at 127.0.0.1:38364
I20260709 12:58:20.148152   566 raft_consensus.cc:606] T 811ff95e986542668558d35c387ec366 P 1e6c65ade84442dba7b9e742f473df99 [term 2 LEADER]: Received request to transfer leadership to TS 65b5e378480c4387aee25f0bdfeb1e7e
I20260709 12:58:20.152712   566 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a10f7a7b26cf41d38030d1e80c6123ec"
dest_uuid: "1e6c65ade84442dba7b9e742f473df99"
mode: GRACEFUL
new_leader_uuid: "65b5e378480c4387aee25f0bdfeb1e7e"
 from {username='slave'} at 127.0.0.1:38364
I20260709 12:58:20.153188   566 raft_consensus.cc:606] T a10f7a7b26cf41d38030d1e80c6123ec P 1e6c65ade84442dba7b9e742f473df99 [term 1 LEADER]: Received request to transfer leadership to TS 65b5e378480c4387aee25f0bdfeb1e7e
I20260709 12:58:20.157784   566 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c496907a8ecb49cc86a0784628ae42c9"
dest_uuid: "1e6c65ade84442dba7b9e742f473df99"
mode: GRACEFUL
new_leader_uuid: "65b5e378480c4387aee25f0bdfeb1e7e"
 from {username='slave'} at 127.0.0.1:38364
I20260709 12:58:20.158282   566 raft_consensus.cc:606] T c496907a8ecb49cc86a0784628ae42c9 P 1e6c65ade84442dba7b9e742f473df99 [term 2 LEADER]: Received request to transfer leadership to TS 65b5e378480c4387aee25f0bdfeb1e7e
I20260709 12:58:20.162726   715 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2bec920f53cb42b785062112f132c67c"
dest_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160"
mode: GRACEFUL
new_leader_uuid: "65b5e378480c4387aee25f0bdfeb1e7e"
 from {username='slave'} at 127.0.0.1:53238
I20260709 12:58:20.163205   715 raft_consensus.cc:606] T 2bec920f53cb42b785062112f132c67c P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 3 LEADER]: Received request to transfer leadership to TS 65b5e378480c4387aee25f0bdfeb1e7e
I20260709 12:58:20.175798   715 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "87ceba987e5d48ba916d5e869e2a03b6"
dest_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160"
mode: GRACEFUL
new_leader_uuid: "65b5e378480c4387aee25f0bdfeb1e7e"
 from {username='slave'} at 127.0.0.1:53238
I20260709 12:58:20.176314   715 raft_consensus.cc:606] T 87ceba987e5d48ba916d5e869e2a03b6 P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 2 LEADER]: Received request to transfer leadership to TS 65b5e378480c4387aee25f0bdfeb1e7e
I20260709 12:58:20.213719   863 raft_consensus.cc:993] T a10f7a7b26cf41d38030d1e80c6123ec P 1e6c65ade84442dba7b9e742f473df99: : Instructing follower 65b5e378480c4387aee25f0bdfeb1e7e to start an election
I20260709 12:58:20.214120   863 raft_consensus.cc:1081] T a10f7a7b26cf41d38030d1e80c6123ec P 1e6c65ade84442dba7b9e742f473df99 [term 1 LEADER]: Signalling peer 65b5e378480c4387aee25f0bdfeb1e7e to start an election
I20260709 12:58:20.215623   640 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a10f7a7b26cf41d38030d1e80c6123ec"
dest_uuid: "65b5e378480c4387aee25f0bdfeb1e7e"
 from {username='slave'} at 127.0.0.1:33454
I20260709 12:58:20.216176   640 raft_consensus.cc:493] T a10f7a7b26cf41d38030d1e80c6123ec P 65b5e378480c4387aee25f0bdfeb1e7e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:20.216446   640 raft_consensus.cc:3060] T a10f7a7b26cf41d38030d1e80c6123ec P 65b5e378480c4387aee25f0bdfeb1e7e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:20.221098   640 raft_consensus.cc:515] T a10f7a7b26cf41d38030d1e80c6123ec P 65b5e378480c4387aee25f0bdfeb1e7e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:20.222585   640 leader_election.cc:290] T a10f7a7b26cf41d38030d1e80c6123ec P 65b5e378480c4387aee25f0bdfeb1e7e [CANDIDATE]: Term 2 election: Requested vote from peers 1e6c65ade84442dba7b9e742f473df99 (127.0.107.193:44941), 5d1af4aed7da41e0b9f4f1e0f5621160 (127.0.107.195:44825)
I20260709 12:58:20.223482   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10f7a7b26cf41d38030d1e80c6123ec" candidate_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1e6c65ade84442dba7b9e742f473df99"
I20260709 12:58:20.223762   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10f7a7b26cf41d38030d1e80c6123ec" candidate_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160"
I20260709 12:58:20.224081   566 raft_consensus.cc:3055] T a10f7a7b26cf41d38030d1e80c6123ec P 1e6c65ade84442dba7b9e742f473df99 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:20.224268   715 raft_consensus.cc:3060] T a10f7a7b26cf41d38030d1e80c6123ec P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:20.224437   566 raft_consensus.cc:740] T a10f7a7b26cf41d38030d1e80c6123ec P 1e6c65ade84442dba7b9e742f473df99 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1e6c65ade84442dba7b9e742f473df99, State: Running, Role: LEADER
I20260709 12:58:20.225266   566 consensus_queue.cc:260] T a10f7a7b26cf41d38030d1e80c6123ec P 1e6c65ade84442dba7b9e742f473df99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:20.226472   566 raft_consensus.cc:3060] T a10f7a7b26cf41d38030d1e80c6123ec P 1e6c65ade84442dba7b9e742f473df99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:20.231186   715 raft_consensus.cc:2468] T a10f7a7b26cf41d38030d1e80c6123ec P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65b5e378480c4387aee25f0bdfeb1e7e in term 2.
I20260709 12:58:20.232375   605 leader_election.cc:304] T a10f7a7b26cf41d38030d1e80c6123ec P 65b5e378480c4387aee25f0bdfeb1e7e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1af4aed7da41e0b9f4f1e0f5621160, 65b5e378480c4387aee25f0bdfeb1e7e; no voters: 
I20260709 12:58:20.232544   566 raft_consensus.cc:2468] T a10f7a7b26cf41d38030d1e80c6123ec P 1e6c65ade84442dba7b9e742f473df99 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65b5e378480c4387aee25f0bdfeb1e7e in term 2.
I20260709 12:58:20.233072   813 raft_consensus.cc:2804] T a10f7a7b26cf41d38030d1e80c6123ec P 65b5e378480c4387aee25f0bdfeb1e7e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:20.234534   813 raft_consensus.cc:697] T a10f7a7b26cf41d38030d1e80c6123ec P 65b5e378480c4387aee25f0bdfeb1e7e [term 2 LEADER]: Becoming Leader. State: Replica: 65b5e378480c4387aee25f0bdfeb1e7e, State: Running, Role: LEADER
I20260709 12:58:20.235289   813 consensus_queue.cc:237] T a10f7a7b26cf41d38030d1e80c6123ec P 65b5e378480c4387aee25f0bdfeb1e7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:20.241425   462 catalog_manager.cc:5697] T a10f7a7b26cf41d38030d1e80c6123ec P 65b5e378480c4387aee25f0bdfeb1e7e reported cstate change: term changed from 1 to 2, leader changed from 1e6c65ade84442dba7b9e742f473df99 (127.0.107.193) to 65b5e378480c4387aee25f0bdfeb1e7e (127.0.107.194). New cstate: current_term: 2 leader_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:20.296103   856 raft_consensus.cc:993] T 87ceba987e5d48ba916d5e869e2a03b6 P 5d1af4aed7da41e0b9f4f1e0f5621160: : Instructing follower 65b5e378480c4387aee25f0bdfeb1e7e to start an election
I20260709 12:58:20.296572   857 raft_consensus.cc:1081] T 87ceba987e5d48ba916d5e869e2a03b6 P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 2 LEADER]: Signalling peer 65b5e378480c4387aee25f0bdfeb1e7e to start an election
I20260709 12:58:20.298815   640 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "87ceba987e5d48ba916d5e869e2a03b6"
dest_uuid: "65b5e378480c4387aee25f0bdfeb1e7e"
 from {username='slave'} at 127.0.0.1:33460
I20260709 12:58:20.299297   640 raft_consensus.cc:493] T 87ceba987e5d48ba916d5e869e2a03b6 P 65b5e378480c4387aee25f0bdfeb1e7e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:20.299618   640 raft_consensus.cc:3060] T 87ceba987e5d48ba916d5e869e2a03b6 P 65b5e378480c4387aee25f0bdfeb1e7e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:20.304087   640 raft_consensus.cc:515] T 87ceba987e5d48ba916d5e869e2a03b6 P 65b5e378480c4387aee25f0bdfeb1e7e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:20.305662   640 leader_election.cc:290] T 87ceba987e5d48ba916d5e869e2a03b6 P 65b5e378480c4387aee25f0bdfeb1e7e [CANDIDATE]: Term 3 election: Requested vote from peers 1e6c65ade84442dba7b9e742f473df99 (127.0.107.193:44941), 5d1af4aed7da41e0b9f4f1e0f5621160 (127.0.107.195:44825)
I20260709 12:58:20.306546   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ceba987e5d48ba916d5e869e2a03b6" candidate_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1e6c65ade84442dba7b9e742f473df99"
I20260709 12:58:20.306886   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87ceba987e5d48ba916d5e869e2a03b6" candidate_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160"
I20260709 12:58:20.307144   566 raft_consensus.cc:3060] T 87ceba987e5d48ba916d5e869e2a03b6 P 1e6c65ade84442dba7b9e742f473df99 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:20.307382   715 raft_consensus.cc:3055] T 87ceba987e5d48ba916d5e869e2a03b6 P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:20.307729   715 raft_consensus.cc:740] T 87ceba987e5d48ba916d5e869e2a03b6 P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5d1af4aed7da41e0b9f4f1e0f5621160, State: Running, Role: LEADER
I20260709 12:58:20.308363   715 consensus_queue.cc:260] T 87ceba987e5d48ba916d5e869e2a03b6 P 5d1af4aed7da41e0b9f4f1e0f5621160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:20.309171   715 raft_consensus.cc:3060] T 87ceba987e5d48ba916d5e869e2a03b6 P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:20.312848   566 raft_consensus.cc:2468] T 87ceba987e5d48ba916d5e869e2a03b6 P 1e6c65ade84442dba7b9e742f473df99 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65b5e378480c4387aee25f0bdfeb1e7e in term 3.
I20260709 12:58:20.312932   715 raft_consensus.cc:2468] T 87ceba987e5d48ba916d5e869e2a03b6 P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65b5e378480c4387aee25f0bdfeb1e7e in term 3.
I20260709 12:58:20.313908   605 leader_election.cc:304] T 87ceba987e5d48ba916d5e869e2a03b6 P 65b5e378480c4387aee25f0bdfeb1e7e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e6c65ade84442dba7b9e742f473df99, 65b5e378480c4387aee25f0bdfeb1e7e; no voters: 
I20260709 12:58:20.314543   813 raft_consensus.cc:2804] T 87ceba987e5d48ba916d5e869e2a03b6 P 65b5e378480c4387aee25f0bdfeb1e7e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:20.314958   813 raft_consensus.cc:697] T 87ceba987e5d48ba916d5e869e2a03b6 P 65b5e378480c4387aee25f0bdfeb1e7e [term 3 LEADER]: Becoming Leader. State: Replica: 65b5e378480c4387aee25f0bdfeb1e7e, State: Running, Role: LEADER
I20260709 12:58:20.315640   813 consensus_queue.cc:237] T 87ceba987e5d48ba916d5e869e2a03b6 P 65b5e378480c4387aee25f0bdfeb1e7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:20.320959   462 catalog_manager.cc:5697] T 87ceba987e5d48ba916d5e869e2a03b6 P 65b5e378480c4387aee25f0bdfeb1e7e reported cstate change: term changed from 2 to 3, leader changed from 5d1af4aed7da41e0b9f4f1e0f5621160 (127.0.107.195) to 65b5e378480c4387aee25f0bdfeb1e7e (127.0.107.194). New cstate: current_term: 3 leader_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:20.332157   873 raft_consensus.cc:993] T c496907a8ecb49cc86a0784628ae42c9 P 1e6c65ade84442dba7b9e742f473df99: : Instructing follower 65b5e378480c4387aee25f0bdfeb1e7e to start an election
I20260709 12:58:20.332535   863 raft_consensus.cc:1081] T c496907a8ecb49cc86a0784628ae42c9 P 1e6c65ade84442dba7b9e742f473df99 [term 2 LEADER]: Signalling peer 65b5e378480c4387aee25f0bdfeb1e7e to start an election
I20260709 12:58:20.333948   640 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c496907a8ecb49cc86a0784628ae42c9"
dest_uuid: "65b5e378480c4387aee25f0bdfeb1e7e"
 from {username='slave'} at 127.0.0.1:33454
I20260709 12:58:20.334558   640 raft_consensus.cc:493] T c496907a8ecb49cc86a0784628ae42c9 P 65b5e378480c4387aee25f0bdfeb1e7e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:20.334900   640 raft_consensus.cc:3060] T c496907a8ecb49cc86a0784628ae42c9 P 65b5e378480c4387aee25f0bdfeb1e7e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:20.339799   640 raft_consensus.cc:515] T c496907a8ecb49cc86a0784628ae42c9 P 65b5e378480c4387aee25f0bdfeb1e7e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:20.341377   640 leader_election.cc:290] T c496907a8ecb49cc86a0784628ae42c9 P 65b5e378480c4387aee25f0bdfeb1e7e [CANDIDATE]: Term 3 election: Requested vote from peers 1e6c65ade84442dba7b9e742f473df99 (127.0.107.193:44941), 5d1af4aed7da41e0b9f4f1e0f5621160 (127.0.107.195:44825)
I20260709 12:58:20.342244   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c496907a8ecb49cc86a0784628ae42c9" candidate_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1e6c65ade84442dba7b9e742f473df99"
I20260709 12:58:20.342525   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c496907a8ecb49cc86a0784628ae42c9" candidate_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160"
I20260709 12:58:20.342844   566 raft_consensus.cc:3055] T c496907a8ecb49cc86a0784628ae42c9 P 1e6c65ade84442dba7b9e742f473df99 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:20.343027   715 raft_consensus.cc:3060] T c496907a8ecb49cc86a0784628ae42c9 P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:20.343204   566 raft_consensus.cc:740] T c496907a8ecb49cc86a0784628ae42c9 P 1e6c65ade84442dba7b9e742f473df99 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1e6c65ade84442dba7b9e742f473df99, State: Running, Role: LEADER
I20260709 12:58:20.343981   566 consensus_queue.cc:260] T c496907a8ecb49cc86a0784628ae42c9 P 1e6c65ade84442dba7b9e742f473df99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:20.345359   566 raft_consensus.cc:3060] T c496907a8ecb49cc86a0784628ae42c9 P 1e6c65ade84442dba7b9e742f473df99 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:20.349335   715 raft_consensus.cc:2468] T c496907a8ecb49cc86a0784628ae42c9 P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65b5e378480c4387aee25f0bdfeb1e7e in term 3.
I20260709 12:58:20.350397   605 leader_election.cc:304] T c496907a8ecb49cc86a0784628ae42c9 P 65b5e378480c4387aee25f0bdfeb1e7e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1af4aed7da41e0b9f4f1e0f5621160, 65b5e378480c4387aee25f0bdfeb1e7e; no voters: 
I20260709 12:58:20.351199   813 raft_consensus.cc:2804] T c496907a8ecb49cc86a0784628ae42c9 P 65b5e378480c4387aee25f0bdfeb1e7e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:20.351616   813 raft_consensus.cc:697] T c496907a8ecb49cc86a0784628ae42c9 P 65b5e378480c4387aee25f0bdfeb1e7e [term 3 LEADER]: Becoming Leader. State: Replica: 65b5e378480c4387aee25f0bdfeb1e7e, State: Running, Role: LEADER
I20260709 12:58:20.352104   566 raft_consensus.cc:2468] T c496907a8ecb49cc86a0784628ae42c9 P 1e6c65ade84442dba7b9e742f473df99 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65b5e378480c4387aee25f0bdfeb1e7e in term 3.
I20260709 12:58:20.352316   813 consensus_queue.cc:237] T c496907a8ecb49cc86a0784628ae42c9 P 65b5e378480c4387aee25f0bdfeb1e7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:20.358609   462 catalog_manager.cc:5697] T c496907a8ecb49cc86a0784628ae42c9 P 65b5e378480c4387aee25f0bdfeb1e7e reported cstate change: term changed from 2 to 3, leader changed from 1e6c65ade84442dba7b9e742f473df99 (127.0.107.193) to 65b5e378480c4387aee25f0bdfeb1e7e (127.0.107.194). New cstate: current_term: 3 leader_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:20.641444   566 raft_consensus.cc:1275] T a10f7a7b26cf41d38030d1e80c6123ec P 1e6c65ade84442dba7b9e742f473df99 [term 2 FOLLOWER]: Refusing update from remote peer 65b5e378480c4387aee25f0bdfeb1e7e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:20.642601   813 consensus_queue.cc:1048] T a10f7a7b26cf41d38030d1e80c6123ec P 65b5e378480c4387aee25f0bdfeb1e7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:20.654052   715 raft_consensus.cc:1275] T a10f7a7b26cf41d38030d1e80c6123ec P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 2 FOLLOWER]: Refusing update from remote peer 65b5e378480c4387aee25f0bdfeb1e7e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:20.655907   813 consensus_queue.cc:1048] T a10f7a7b26cf41d38030d1e80c6123ec P 65b5e378480c4387aee25f0bdfeb1e7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:20.667860   857 raft_consensus.cc:993] T 2bec920f53cb42b785062112f132c67c P 5d1af4aed7da41e0b9f4f1e0f5621160: : Instructing follower 65b5e378480c4387aee25f0bdfeb1e7e to start an election
I20260709 12:58:20.668365   856 raft_consensus.cc:1081] T 2bec920f53cb42b785062112f132c67c P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 3 LEADER]: Signalling peer 65b5e378480c4387aee25f0bdfeb1e7e to start an election
I20260709 12:58:20.669786   640 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2bec920f53cb42b785062112f132c67c"
dest_uuid: "65b5e378480c4387aee25f0bdfeb1e7e"
 from {username='slave'} at 127.0.0.1:33460
I20260709 12:58:20.670336   640 raft_consensus.cc:493] T 2bec920f53cb42b785062112f132c67c P 65b5e378480c4387aee25f0bdfeb1e7e [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:20.670717   640 raft_consensus.cc:3060] T 2bec920f53cb42b785062112f132c67c P 65b5e378480c4387aee25f0bdfeb1e7e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:20.675055   640 raft_consensus.cc:515] T 2bec920f53cb42b785062112f132c67c P 65b5e378480c4387aee25f0bdfeb1e7e [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:20.676728   640 leader_election.cc:290] T 2bec920f53cb42b785062112f132c67c P 65b5e378480c4387aee25f0bdfeb1e7e [CANDIDATE]: Term 4 election: Requested vote from peers 1e6c65ade84442dba7b9e742f473df99 (127.0.107.193:44941), 5d1af4aed7da41e0b9f4f1e0f5621160 (127.0.107.195:44825)
I20260709 12:58:20.677661   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bec920f53cb42b785062112f132c67c" candidate_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "1e6c65ade84442dba7b9e742f473df99"
I20260709 12:58:20.677775   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bec920f53cb42b785062112f132c67c" candidate_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160"
I20260709 12:58:20.678176   566 raft_consensus.cc:3060] T 2bec920f53cb42b785062112f132c67c P 1e6c65ade84442dba7b9e742f473df99 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:20.678256   715 raft_consensus.cc:3055] T 2bec920f53cb42b785062112f132c67c P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:20.678550   715 raft_consensus.cc:740] T 2bec920f53cb42b785062112f132c67c P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5d1af4aed7da41e0b9f4f1e0f5621160, State: Running, Role: LEADER
I20260709 12:58:20.679185   715 consensus_queue.cc:260] T 2bec920f53cb42b785062112f132c67c P 5d1af4aed7da41e0b9f4f1e0f5621160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:20.679966   715 raft_consensus.cc:3060] T 2bec920f53cb42b785062112f132c67c P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:20.682885   566 raft_consensus.cc:2468] T 2bec920f53cb42b785062112f132c67c P 1e6c65ade84442dba7b9e742f473df99 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65b5e378480c4387aee25f0bdfeb1e7e in term 4.
I20260709 12:58:20.683876   715 raft_consensus.cc:2468] T 2bec920f53cb42b785062112f132c67c P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65b5e378480c4387aee25f0bdfeb1e7e in term 4.
I20260709 12:58:20.684051   605 leader_election.cc:304] T 2bec920f53cb42b785062112f132c67c P 65b5e378480c4387aee25f0bdfeb1e7e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e6c65ade84442dba7b9e742f473df99, 65b5e378480c4387aee25f0bdfeb1e7e; no voters: 
I20260709 12:58:20.684801   813 raft_consensus.cc:2804] T 2bec920f53cb42b785062112f132c67c P 65b5e378480c4387aee25f0bdfeb1e7e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:20.685210   813 raft_consensus.cc:697] T 2bec920f53cb42b785062112f132c67c P 65b5e378480c4387aee25f0bdfeb1e7e [term 4 LEADER]: Becoming Leader. State: Replica: 65b5e378480c4387aee25f0bdfeb1e7e, State: Running, Role: LEADER
I20260709 12:58:20.685827   813 consensus_queue.cc:237] T 2bec920f53cb42b785062112f132c67c P 65b5e378480c4387aee25f0bdfeb1e7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:20.691711   463 catalog_manager.cc:5697] T 2bec920f53cb42b785062112f132c67c P 65b5e378480c4387aee25f0bdfeb1e7e reported cstate change: term changed from 3 to 4, leader changed from 5d1af4aed7da41e0b9f4f1e0f5621160 (127.0.107.195) to 65b5e378480c4387aee25f0bdfeb1e7e (127.0.107.194). New cstate: current_term: 4 leader_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:20.727707   873 raft_consensus.cc:993] T 811ff95e986542668558d35c387ec366 P 1e6c65ade84442dba7b9e742f473df99: : Instructing follower 65b5e378480c4387aee25f0bdfeb1e7e to start an election
I20260709 12:58:20.728133   863 raft_consensus.cc:1081] T 811ff95e986542668558d35c387ec366 P 1e6c65ade84442dba7b9e742f473df99 [term 2 LEADER]: Signalling peer 65b5e378480c4387aee25f0bdfeb1e7e to start an election
I20260709 12:58:20.729797   640 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "811ff95e986542668558d35c387ec366"
dest_uuid: "65b5e378480c4387aee25f0bdfeb1e7e"
 from {username='slave'} at 127.0.0.1:33454
I20260709 12:58:20.730307   640 raft_consensus.cc:493] T 811ff95e986542668558d35c387ec366 P 65b5e378480c4387aee25f0bdfeb1e7e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:20.730680   640 raft_consensus.cc:3060] T 811ff95e986542668558d35c387ec366 P 65b5e378480c4387aee25f0bdfeb1e7e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:20.735097   640 raft_consensus.cc:515] T 811ff95e986542668558d35c387ec366 P 65b5e378480c4387aee25f0bdfeb1e7e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:20.737056   640 leader_election.cc:290] T 811ff95e986542668558d35c387ec366 P 65b5e378480c4387aee25f0bdfeb1e7e [CANDIDATE]: Term 3 election: Requested vote from peers 1e6c65ade84442dba7b9e742f473df99 (127.0.107.193:44941), 5d1af4aed7da41e0b9f4f1e0f5621160 (127.0.107.195:44825)
I20260709 12:58:20.737778   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811ff95e986542668558d35c387ec366" candidate_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1e6c65ade84442dba7b9e742f473df99"
I20260709 12:58:20.737944   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811ff95e986542668558d35c387ec366" candidate_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160"
I20260709 12:58:20.738377   566 raft_consensus.cc:3055] T 811ff95e986542668558d35c387ec366 P 1e6c65ade84442dba7b9e742f473df99 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:20.738474   715 raft_consensus.cc:3060] T 811ff95e986542668558d35c387ec366 P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:20.738699   566 raft_consensus.cc:740] T 811ff95e986542668558d35c387ec366 P 1e6c65ade84442dba7b9e742f473df99 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1e6c65ade84442dba7b9e742f473df99, State: Running, Role: LEADER
I20260709 12:58:20.739380   566 consensus_queue.cc:260] T 811ff95e986542668558d35c387ec366 P 1e6c65ade84442dba7b9e742f473df99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:20.740250   566 raft_consensus.cc:3060] T 811ff95e986542668558d35c387ec366 P 1e6c65ade84442dba7b9e742f473df99 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:20.742573   715 raft_consensus.cc:2468] T 811ff95e986542668558d35c387ec366 P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65b5e378480c4387aee25f0bdfeb1e7e in term 3.
I20260709 12:58:20.743578   605 leader_election.cc:304] T 811ff95e986542668558d35c387ec366 P 65b5e378480c4387aee25f0bdfeb1e7e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d1af4aed7da41e0b9f4f1e0f5621160, 65b5e378480c4387aee25f0bdfeb1e7e; no voters: 
I20260709 12:58:20.744241   813 raft_consensus.cc:2804] T 811ff95e986542668558d35c387ec366 P 65b5e378480c4387aee25f0bdfeb1e7e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:20.744609   813 raft_consensus.cc:697] T 811ff95e986542668558d35c387ec366 P 65b5e378480c4387aee25f0bdfeb1e7e [term 3 LEADER]: Becoming Leader. State: Replica: 65b5e378480c4387aee25f0bdfeb1e7e, State: Running, Role: LEADER
I20260709 12:58:20.745009   566 raft_consensus.cc:2468] T 811ff95e986542668558d35c387ec366 P 1e6c65ade84442dba7b9e742f473df99 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65b5e378480c4387aee25f0bdfeb1e7e in term 3.
I20260709 12:58:20.745333   813 consensus_queue.cc:237] T 811ff95e986542668558d35c387ec366 P 65b5e378480c4387aee25f0bdfeb1e7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:20.752810   463 catalog_manager.cc:5697] T 811ff95e986542668558d35c387ec366 P 65b5e378480c4387aee25f0bdfeb1e7e reported cstate change: term changed from 2 to 3, leader changed from 1e6c65ade84442dba7b9e742f473df99 (127.0.107.193) to 65b5e378480c4387aee25f0bdfeb1e7e (127.0.107.194). New cstate: current_term: 3 leader_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:20.773150   715 raft_consensus.cc:1275] T 87ceba987e5d48ba916d5e869e2a03b6 P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 3 FOLLOWER]: Refusing update from remote peer 65b5e378480c4387aee25f0bdfeb1e7e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:20.774823   813 consensus_queue.cc:1048] T 87ceba987e5d48ba916d5e869e2a03b6 P 65b5e378480c4387aee25f0bdfeb1e7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:20.781880   566 raft_consensus.cc:1275] T 87ceba987e5d48ba916d5e869e2a03b6 P 1e6c65ade84442dba7b9e742f473df99 [term 3 FOLLOWER]: Refusing update from remote peer 65b5e378480c4387aee25f0bdfeb1e7e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:20.783680   886 consensus_queue.cc:1048] T 87ceba987e5d48ba916d5e869e2a03b6 P 65b5e378480c4387aee25f0bdfeb1e7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:20.868253   715 raft_consensus.cc:1275] T c496907a8ecb49cc86a0784628ae42c9 P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 3 FOLLOWER]: Refusing update from remote peer 65b5e378480c4387aee25f0bdfeb1e7e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:20.869431   813 consensus_queue.cc:1048] T c496907a8ecb49cc86a0784628ae42c9 P 65b5e378480c4387aee25f0bdfeb1e7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:20.877897   566 raft_consensus.cc:1275] T c496907a8ecb49cc86a0784628ae42c9 P 1e6c65ade84442dba7b9e742f473df99 [term 3 FOLLOWER]: Refusing update from remote peer 65b5e378480c4387aee25f0bdfeb1e7e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:20.881045   886 consensus_queue.cc:1048] T c496907a8ecb49cc86a0784628ae42c9 P 65b5e378480c4387aee25f0bdfeb1e7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:21.231776   566 raft_consensus.cc:1275] T 811ff95e986542668558d35c387ec366 P 1e6c65ade84442dba7b9e742f473df99 [term 3 FOLLOWER]: Refusing update from remote peer 65b5e378480c4387aee25f0bdfeb1e7e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:21.233126   813 consensus_queue.cc:1048] T 811ff95e986542668558d35c387ec366 P 65b5e378480c4387aee25f0bdfeb1e7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:21.234395   566 raft_consensus.cc:1275] T 2bec920f53cb42b785062112f132c67c P 1e6c65ade84442dba7b9e742f473df99 [term 4 FOLLOWER]: Refusing update from remote peer 65b5e378480c4387aee25f0bdfeb1e7e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:58:21.235579   813 consensus_queue.cc:1048] T 2bec920f53cb42b785062112f132c67c P 65b5e378480c4387aee25f0bdfeb1e7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:21.244004   715 raft_consensus.cc:1275] T 811ff95e986542668558d35c387ec366 P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 3 FOLLOWER]: Refusing update from remote peer 65b5e378480c4387aee25f0bdfeb1e7e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:21.249783   715 raft_consensus.cc:1275] T 2bec920f53cb42b785062112f132c67c P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 4 FOLLOWER]: Refusing update from remote peer 65b5e378480c4387aee25f0bdfeb1e7e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:58:21.248958   813 consensus_queue.cc:1048] T 811ff95e986542668558d35c387ec366 P 65b5e378480c4387aee25f0bdfeb1e7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:58:21.254207   886 consensus_queue.cc:1048] T 2bec920f53cb42b785062112f132c67c P 65b5e378480c4387aee25f0bdfeb1e7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:58:23.181052   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:23.188668   640 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2bec920f53cb42b785062112f132c67c"
dest_uuid: "65b5e378480c4387aee25f0bdfeb1e7e"
mode: GRACEFUL
new_leader_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160"
 from {username='slave'} at 127.0.0.1:33482
I20260709 12:58:23.189342   640 raft_consensus.cc:606] T 2bec920f53cb42b785062112f132c67c P 65b5e378480c4387aee25f0bdfeb1e7e [term 4 LEADER]: Received request to transfer leadership to TS 5d1af4aed7da41e0b9f4f1e0f5621160
I20260709 12:58:23.192273   640 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "811ff95e986542668558d35c387ec366"
dest_uuid: "65b5e378480c4387aee25f0bdfeb1e7e"
mode: GRACEFUL
new_leader_uuid: "1e6c65ade84442dba7b9e742f473df99"
 from {username='slave'} at 127.0.0.1:33482
I20260709 12:58:23.192837   640 raft_consensus.cc:606] T 811ff95e986542668558d35c387ec366 P 65b5e378480c4387aee25f0bdfeb1e7e [term 3 LEADER]: Received request to transfer leadership to TS 1e6c65ade84442dba7b9e742f473df99
I20260709 12:58:23.195178   640 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a10f7a7b26cf41d38030d1e80c6123ec"
dest_uuid: "65b5e378480c4387aee25f0bdfeb1e7e"
mode: GRACEFUL
new_leader_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160"
 from {username='slave'} at 127.0.0.1:33482
I20260709 12:58:23.195609   640 raft_consensus.cc:606] T a10f7a7b26cf41d38030d1e80c6123ec P 65b5e378480c4387aee25f0bdfeb1e7e [term 2 LEADER]: Received request to transfer leadership to TS 5d1af4aed7da41e0b9f4f1e0f5621160
I20260709 12:58:23.198061   640 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c496907a8ecb49cc86a0784628ae42c9"
dest_uuid: "65b5e378480c4387aee25f0bdfeb1e7e"
mode: GRACEFUL
new_leader_uuid: "1e6c65ade84442dba7b9e742f473df99"
 from {username='slave'} at 127.0.0.1:33482
I20260709 12:58:23.198453   640 raft_consensus.cc:606] T c496907a8ecb49cc86a0784628ae42c9 P 65b5e378480c4387aee25f0bdfeb1e7e [term 3 LEADER]: Received request to transfer leadership to TS 1e6c65ade84442dba7b9e742f473df99
I20260709 12:58:23.200784   640 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d45270a45bb746e597d1d6ee3744b0b7"
dest_uuid: "65b5e378480c4387aee25f0bdfeb1e7e"
mode: GRACEFUL
new_leader_uuid: "1e6c65ade84442dba7b9e742f473df99"
 from {username='slave'} at 127.0.0.1:33482
I20260709 12:58:23.201242   640 raft_consensus.cc:606] T d45270a45bb746e597d1d6ee3744b0b7 P 65b5e378480c4387aee25f0bdfeb1e7e [term 2 LEADER]: Received request to transfer leadership to TS 1e6c65ade84442dba7b9e742f473df99
I20260709 12:58:23.202482   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:58:23.203024   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:58:23.221159   813 raft_consensus.cc:993] T 2bec920f53cb42b785062112f132c67c P 65b5e378480c4387aee25f0bdfeb1e7e: : Instructing follower 5d1af4aed7da41e0b9f4f1e0f5621160 to start an election
I20260709 12:58:23.221594   813 raft_consensus.cc:1081] T 2bec920f53cb42b785062112f132c67c P 65b5e378480c4387aee25f0bdfeb1e7e [term 4 LEADER]: Signalling peer 5d1af4aed7da41e0b9f4f1e0f5621160 to start an election
I20260709 12:58:23.223143   714 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2bec920f53cb42b785062112f132c67c"
dest_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160"
 from {username='slave'} at 127.0.0.1:53226
I20260709 12:58:23.223632   714 raft_consensus.cc:493] T 2bec920f53cb42b785062112f132c67c P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:23.223946   714 raft_consensus.cc:3060] T 2bec920f53cb42b785062112f132c67c P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:23.229076   714 raft_consensus.cc:515] T 2bec920f53cb42b785062112f132c67c P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:23.230827   714 leader_election.cc:290] T 2bec920f53cb42b785062112f132c67c P 5d1af4aed7da41e0b9f4f1e0f5621160 [CANDIDATE]: Term 5 election: Requested vote from peers 1e6c65ade84442dba7b9e742f473df99 (127.0.107.193:44941), 65b5e378480c4387aee25f0bdfeb1e7e (127.0.107.194:40689)
I20260709 12:58:23.231882   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bec920f53cb42b785062112f132c67c" candidate_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "1e6c65ade84442dba7b9e742f473df99"
I20260709 12:58:23.231818   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bec920f53cb42b785062112f132c67c" candidate_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "65b5e378480c4387aee25f0bdfeb1e7e"
I20260709 12:58:23.232542   565 raft_consensus.cc:3060] T 2bec920f53cb42b785062112f132c67c P 1e6c65ade84442dba7b9e742f473df99 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:23.232620   640 raft_consensus.cc:3055] T 2bec920f53cb42b785062112f132c67c P 65b5e378480c4387aee25f0bdfeb1e7e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:58:23.232908   640 raft_consensus.cc:740] T 2bec920f53cb42b785062112f132c67c P 65b5e378480c4387aee25f0bdfeb1e7e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 65b5e378480c4387aee25f0bdfeb1e7e, State: Running, Role: LEADER
I20260709 12:58:23.233587   640 consensus_queue.cc:260] T 2bec920f53cb42b785062112f132c67c P 65b5e378480c4387aee25f0bdfeb1e7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:23.234457   640 raft_consensus.cc:3060] T 2bec920f53cb42b785062112f132c67c P 65b5e378480c4387aee25f0bdfeb1e7e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:23.236941   565 raft_consensus.cc:2468] T 2bec920f53cb42b785062112f132c67c P 1e6c65ade84442dba7b9e742f473df99 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1af4aed7da41e0b9f4f1e0f5621160 in term 5.
I20260709 12:58:23.238098   679 leader_election.cc:304] T 2bec920f53cb42b785062112f132c67c P 5d1af4aed7da41e0b9f4f1e0f5621160 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e6c65ade84442dba7b9e742f473df99, 5d1af4aed7da41e0b9f4f1e0f5621160; no voters: 
I20260709 12:58:23.239003   856 raft_consensus.cc:2804] T 2bec920f53cb42b785062112f132c67c P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:58:23.239203   640 raft_consensus.cc:2468] T 2bec920f53cb42b785062112f132c67c P 65b5e378480c4387aee25f0bdfeb1e7e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1af4aed7da41e0b9f4f1e0f5621160 in term 5.
I20260709 12:58:23.239980   856 raft_consensus.cc:697] T 2bec920f53cb42b785062112f132c67c P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 5 LEADER]: Becoming Leader. State: Replica: 5d1af4aed7da41e0b9f4f1e0f5621160, State: Running, Role: LEADER
I20260709 12:58:23.240957   856 consensus_queue.cc:237] T 2bec920f53cb42b785062112f132c67c P 5d1af4aed7da41e0b9f4f1e0f5621160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:23.247357   462 catalog_manager.cc:5697] T 2bec920f53cb42b785062112f132c67c P 5d1af4aed7da41e0b9f4f1e0f5621160 reported cstate change: term changed from 4 to 5, leader changed from 65b5e378480c4387aee25f0bdfeb1e7e (127.0.107.194) to 5d1af4aed7da41e0b9f4f1e0f5621160 (127.0.107.195). New cstate: current_term: 5 leader_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:23.256485   894 raft_consensus.cc:993] T a10f7a7b26cf41d38030d1e80c6123ec P 65b5e378480c4387aee25f0bdfeb1e7e: : Instructing follower 5d1af4aed7da41e0b9f4f1e0f5621160 to start an election
I20260709 12:58:23.257048   813 raft_consensus.cc:1081] T a10f7a7b26cf41d38030d1e80c6123ec P 65b5e378480c4387aee25f0bdfeb1e7e [term 2 LEADER]: Signalling peer 5d1af4aed7da41e0b9f4f1e0f5621160 to start an election
I20260709 12:58:23.258641   714 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a10f7a7b26cf41d38030d1e80c6123ec"
dest_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160"
 from {username='slave'} at 127.0.0.1:53226
I20260709 12:58:23.259239   714 raft_consensus.cc:493] T a10f7a7b26cf41d38030d1e80c6123ec P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:23.259572   714 raft_consensus.cc:3060] T a10f7a7b26cf41d38030d1e80c6123ec P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:23.264427   714 raft_consensus.cc:515] T a10f7a7b26cf41d38030d1e80c6123ec P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:23.266705   714 leader_election.cc:290] T a10f7a7b26cf41d38030d1e80c6123ec P 5d1af4aed7da41e0b9f4f1e0f5621160 [CANDIDATE]: Term 3 election: Requested vote from peers 1e6c65ade84442dba7b9e742f473df99 (127.0.107.193:44941), 65b5e378480c4387aee25f0bdfeb1e7e (127.0.107.194:40689)
I20260709 12:58:23.267047   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10f7a7b26cf41d38030d1e80c6123ec" candidate_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1e6c65ade84442dba7b9e742f473df99"
I20260709 12:58:23.267763   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10f7a7b26cf41d38030d1e80c6123ec" candidate_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "65b5e378480c4387aee25f0bdfeb1e7e"
I20260709 12:58:23.268316   640 raft_consensus.cc:3055] T a10f7a7b26cf41d38030d1e80c6123ec P 65b5e378480c4387aee25f0bdfeb1e7e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:23.268623   640 raft_consensus.cc:740] T a10f7a7b26cf41d38030d1e80c6123ec P 65b5e378480c4387aee25f0bdfeb1e7e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 65b5e378480c4387aee25f0bdfeb1e7e, State: Running, Role: LEADER
I20260709 12:58:23.268157   565 raft_consensus.cc:3060] T a10f7a7b26cf41d38030d1e80c6123ec P 1e6c65ade84442dba7b9e742f473df99 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:23.269397   640 consensus_queue.cc:260] T a10f7a7b26cf41d38030d1e80c6123ec P 65b5e378480c4387aee25f0bdfeb1e7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:23.270424   640 raft_consensus.cc:3060] T a10f7a7b26cf41d38030d1e80c6123ec P 65b5e378480c4387aee25f0bdfeb1e7e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:23.277036   565 raft_consensus.cc:2468] T a10f7a7b26cf41d38030d1e80c6123ec P 1e6c65ade84442dba7b9e742f473df99 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1af4aed7da41e0b9f4f1e0f5621160 in term 3.
I20260709 12:58:23.277981   566 raft_consensus.cc:1240] T a10f7a7b26cf41d38030d1e80c6123ec P 1e6c65ade84442dba7b9e742f473df99 [term 3 FOLLOWER]: Rejecting Update request from peer 65b5e378480c4387aee25f0bdfeb1e7e for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:23.277982   640 raft_consensus.cc:2468] T a10f7a7b26cf41d38030d1e80c6123ec P 65b5e378480c4387aee25f0bdfeb1e7e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d1af4aed7da41e0b9f4f1e0f5621160 in term 3.
I20260709 12:58:23.278501   679 leader_election.cc:304] T a10f7a7b26cf41d38030d1e80c6123ec P 5d1af4aed7da41e0b9f4f1e0f5621160 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e6c65ade84442dba7b9e742f473df99, 5d1af4aed7da41e0b9f4f1e0f5621160; no voters: 
I20260709 12:58:23.279654   856 raft_consensus.cc:2804] T a10f7a7b26cf41d38030d1e80c6123ec P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:23.280293   856 raft_consensus.cc:697] T a10f7a7b26cf41d38030d1e80c6123ec P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 3 LEADER]: Becoming Leader. State: Replica: 5d1af4aed7da41e0b9f4f1e0f5621160, State: Running, Role: LEADER
I20260709 12:58:23.281277   856 consensus_queue.cc:237] T a10f7a7b26cf41d38030d1e80c6123ec P 5d1af4aed7da41e0b9f4f1e0f5621160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:23.289223   462 catalog_manager.cc:5697] T a10f7a7b26cf41d38030d1e80c6123ec P 5d1af4aed7da41e0b9f4f1e0f5621160 reported cstate change: term changed from 2 to 3, leader changed from 65b5e378480c4387aee25f0bdfeb1e7e (127.0.107.194) to 5d1af4aed7da41e0b9f4f1e0f5621160 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:23.457867   894 raft_consensus.cc:993] T c496907a8ecb49cc86a0784628ae42c9 P 65b5e378480c4387aee25f0bdfeb1e7e: : Instructing follower 1e6c65ade84442dba7b9e742f473df99 to start an election
I20260709 12:58:23.458284   813 raft_consensus.cc:1081] T c496907a8ecb49cc86a0784628ae42c9 P 65b5e378480c4387aee25f0bdfeb1e7e [term 3 LEADER]: Signalling peer 1e6c65ade84442dba7b9e742f473df99 to start an election
I20260709 12:58:23.459772   566 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c496907a8ecb49cc86a0784628ae42c9"
dest_uuid: "1e6c65ade84442dba7b9e742f473df99"
 from {username='slave'} at 127.0.0.1:38360
I20260709 12:58:23.460170   566 raft_consensus.cc:493] T c496907a8ecb49cc86a0784628ae42c9 P 1e6c65ade84442dba7b9e742f473df99 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:23.460434   566 raft_consensus.cc:3060] T c496907a8ecb49cc86a0784628ae42c9 P 1e6c65ade84442dba7b9e742f473df99 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:23.464632   566 raft_consensus.cc:515] T c496907a8ecb49cc86a0784628ae42c9 P 1e6c65ade84442dba7b9e742f473df99 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:23.466316   566 leader_election.cc:290] T c496907a8ecb49cc86a0784628ae42c9 P 1e6c65ade84442dba7b9e742f473df99 [CANDIDATE]: Term 4 election: Requested vote from peers 65b5e378480c4387aee25f0bdfeb1e7e (127.0.107.194:40689), 5d1af4aed7da41e0b9f4f1e0f5621160 (127.0.107.195:44825)
I20260709 12:58:23.467095   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c496907a8ecb49cc86a0784628ae42c9" candidate_uuid: "1e6c65ade84442dba7b9e742f473df99" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "65b5e378480c4387aee25f0bdfeb1e7e"
I20260709 12:58:23.467481   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c496907a8ecb49cc86a0784628ae42c9" candidate_uuid: "1e6c65ade84442dba7b9e742f473df99" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160"
I20260709 12:58:23.467942   640 raft_consensus.cc:3055] T c496907a8ecb49cc86a0784628ae42c9 P 65b5e378480c4387aee25f0bdfeb1e7e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:23.467950   714 raft_consensus.cc:3060] T c496907a8ecb49cc86a0784628ae42c9 P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:23.468364   640 raft_consensus.cc:740] T c496907a8ecb49cc86a0784628ae42c9 P 65b5e378480c4387aee25f0bdfeb1e7e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 65b5e378480c4387aee25f0bdfeb1e7e, State: Running, Role: LEADER
I20260709 12:58:23.469096   640 consensus_queue.cc:260] T c496907a8ecb49cc86a0784628ae42c9 P 65b5e378480c4387aee25f0bdfeb1e7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:23.470202   640 raft_consensus.cc:3060] T c496907a8ecb49cc86a0784628ae42c9 P 65b5e378480c4387aee25f0bdfeb1e7e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:23.474749   714 raft_consensus.cc:2468] T c496907a8ecb49cc86a0784628ae42c9 P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e6c65ade84442dba7b9e742f473df99 in term 4.
I20260709 12:58:23.476109   640 raft_consensus.cc:2468] T c496907a8ecb49cc86a0784628ae42c9 P 65b5e378480c4387aee25f0bdfeb1e7e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e6c65ade84442dba7b9e742f473df99 in term 4.
I20260709 12:58:23.476215   530 leader_election.cc:304] T c496907a8ecb49cc86a0784628ae42c9 P 1e6c65ade84442dba7b9e742f473df99 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e6c65ade84442dba7b9e742f473df99, 5d1af4aed7da41e0b9f4f1e0f5621160; no voters: 
I20260709 12:58:23.477934   902 raft_consensus.cc:2804] T c496907a8ecb49cc86a0784628ae42c9 P 1e6c65ade84442dba7b9e742f473df99 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:23.478992   902 raft_consensus.cc:697] T c496907a8ecb49cc86a0784628ae42c9 P 1e6c65ade84442dba7b9e742f473df99 [term 4 LEADER]: Becoming Leader. State: Replica: 1e6c65ade84442dba7b9e742f473df99, State: Running, Role: LEADER
I20260709 12:58:23.479684   902 consensus_queue.cc:237] T c496907a8ecb49cc86a0784628ae42c9 P 1e6c65ade84442dba7b9e742f473df99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:23.486210   462 catalog_manager.cc:5697] T c496907a8ecb49cc86a0784628ae42c9 P 1e6c65ade84442dba7b9e742f473df99 reported cstate change: term changed from 3 to 4, leader changed from 65b5e378480c4387aee25f0bdfeb1e7e (127.0.107.194) to 1e6c65ade84442dba7b9e742f473df99 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "1e6c65ade84442dba7b9e742f473df99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:23.576767   894 raft_consensus.cc:993] T d45270a45bb746e597d1d6ee3744b0b7 P 65b5e378480c4387aee25f0bdfeb1e7e: : Instructing follower 1e6c65ade84442dba7b9e742f473df99 to start an election
I20260709 12:58:23.577169   813 raft_consensus.cc:1081] T d45270a45bb746e597d1d6ee3744b0b7 P 65b5e378480c4387aee25f0bdfeb1e7e [term 2 LEADER]: Signalling peer 1e6c65ade84442dba7b9e742f473df99 to start an election
I20260709 12:58:23.578577   566 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d45270a45bb746e597d1d6ee3744b0b7"
dest_uuid: "1e6c65ade84442dba7b9e742f473df99"
 from {username='slave'} at 127.0.0.1:38360
I20260709 12:58:23.579072   566 raft_consensus.cc:493] T d45270a45bb746e597d1d6ee3744b0b7 P 1e6c65ade84442dba7b9e742f473df99 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:23.579380   566 raft_consensus.cc:3060] T d45270a45bb746e597d1d6ee3744b0b7 P 1e6c65ade84442dba7b9e742f473df99 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:23.583390   566 raft_consensus.cc:515] T d45270a45bb746e597d1d6ee3744b0b7 P 1e6c65ade84442dba7b9e742f473df99 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:23.584878   566 leader_election.cc:290] T d45270a45bb746e597d1d6ee3744b0b7 P 1e6c65ade84442dba7b9e742f473df99 [CANDIDATE]: Term 3 election: Requested vote from peers 65b5e378480c4387aee25f0bdfeb1e7e (127.0.107.194:40689), 5d1af4aed7da41e0b9f4f1e0f5621160 (127.0.107.195:44825)
I20260709 12:58:23.585693   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45270a45bb746e597d1d6ee3744b0b7" candidate_uuid: "1e6c65ade84442dba7b9e742f473df99" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "65b5e378480c4387aee25f0bdfeb1e7e"
I20260709 12:58:23.585949   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45270a45bb746e597d1d6ee3744b0b7" candidate_uuid: "1e6c65ade84442dba7b9e742f473df99" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160"
I20260709 12:58:23.586207   640 raft_consensus.cc:3055] T d45270a45bb746e597d1d6ee3744b0b7 P 65b5e378480c4387aee25f0bdfeb1e7e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:23.586424   714 raft_consensus.cc:3060] T d45270a45bb746e597d1d6ee3744b0b7 P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:23.586503   640 raft_consensus.cc:740] T d45270a45bb746e597d1d6ee3744b0b7 P 65b5e378480c4387aee25f0bdfeb1e7e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 65b5e378480c4387aee25f0bdfeb1e7e, State: Running, Role: LEADER
I20260709 12:58:23.587253   640 consensus_queue.cc:260] T d45270a45bb746e597d1d6ee3744b0b7 P 65b5e378480c4387aee25f0bdfeb1e7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:23.588056   640 raft_consensus.cc:3060] T d45270a45bb746e597d1d6ee3744b0b7 P 65b5e378480c4387aee25f0bdfeb1e7e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:23.590869   714 raft_consensus.cc:2468] T d45270a45bb746e597d1d6ee3744b0b7 P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e6c65ade84442dba7b9e742f473df99 in term 3.
I20260709 12:58:23.591956   530 leader_election.cc:304] T d45270a45bb746e597d1d6ee3744b0b7 P 1e6c65ade84442dba7b9e742f473df99 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e6c65ade84442dba7b9e742f473df99, 5d1af4aed7da41e0b9f4f1e0f5621160; no voters: 
I20260709 12:58:23.592823   902 raft_consensus.cc:2804] T d45270a45bb746e597d1d6ee3744b0b7 P 1e6c65ade84442dba7b9e742f473df99 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:23.593313   902 raft_consensus.cc:697] T d45270a45bb746e597d1d6ee3744b0b7 P 1e6c65ade84442dba7b9e742f473df99 [term 3 LEADER]: Becoming Leader. State: Replica: 1e6c65ade84442dba7b9e742f473df99, State: Running, Role: LEADER
I20260709 12:58:23.594172   640 raft_consensus.cc:2468] T d45270a45bb746e597d1d6ee3744b0b7 P 65b5e378480c4387aee25f0bdfeb1e7e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e6c65ade84442dba7b9e742f473df99 in term 3.
I20260709 12:58:23.594739   902 consensus_queue.cc:237] T d45270a45bb746e597d1d6ee3744b0b7 P 1e6c65ade84442dba7b9e742f473df99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:23.601970   462 catalog_manager.cc:5697] T d45270a45bb746e597d1d6ee3744b0b7 P 1e6c65ade84442dba7b9e742f473df99 reported cstate change: term changed from 2 to 3, leader changed from 65b5e378480c4387aee25f0bdfeb1e7e (127.0.107.194) to 1e6c65ade84442dba7b9e742f473df99 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "1e6c65ade84442dba7b9e742f473df99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:23.619746   813 raft_consensus.cc:993] T 811ff95e986542668558d35c387ec366 P 65b5e378480c4387aee25f0bdfeb1e7e: : Instructing follower 1e6c65ade84442dba7b9e742f473df99 to start an election
I20260709 12:58:23.620098   813 raft_consensus.cc:1081] T 811ff95e986542668558d35c387ec366 P 65b5e378480c4387aee25f0bdfeb1e7e [term 3 LEADER]: Signalling peer 1e6c65ade84442dba7b9e742f473df99 to start an election
I20260709 12:58:23.621316   566 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "811ff95e986542668558d35c387ec366"
dest_uuid: "1e6c65ade84442dba7b9e742f473df99"
 from {username='slave'} at 127.0.0.1:38360
I20260709 12:58:23.621701   566 raft_consensus.cc:493] T 811ff95e986542668558d35c387ec366 P 1e6c65ade84442dba7b9e742f473df99 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:23.621927   566 raft_consensus.cc:3060] T 811ff95e986542668558d35c387ec366 P 1e6c65ade84442dba7b9e742f473df99 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:23.625663   566 raft_consensus.cc:515] T 811ff95e986542668558d35c387ec366 P 1e6c65ade84442dba7b9e742f473df99 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:23.627022   566 leader_election.cc:290] T 811ff95e986542668558d35c387ec366 P 1e6c65ade84442dba7b9e742f473df99 [CANDIDATE]: Term 4 election: Requested vote from peers 65b5e378480c4387aee25f0bdfeb1e7e (127.0.107.194:40689), 5d1af4aed7da41e0b9f4f1e0f5621160 (127.0.107.195:44825)
I20260709 12:58:23.627874   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811ff95e986542668558d35c387ec366" candidate_uuid: "1e6c65ade84442dba7b9e742f473df99" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "65b5e378480c4387aee25f0bdfeb1e7e"
I20260709 12:58:23.627980   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811ff95e986542668558d35c387ec366" candidate_uuid: "1e6c65ade84442dba7b9e742f473df99" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160"
I20260709 12:58:23.628465   714 raft_consensus.cc:3060] T 811ff95e986542668558d35c387ec366 P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:23.628454   640 raft_consensus.cc:3055] T 811ff95e986542668558d35c387ec366 P 65b5e378480c4387aee25f0bdfeb1e7e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:23.628942   640 raft_consensus.cc:740] T 811ff95e986542668558d35c387ec366 P 65b5e378480c4387aee25f0bdfeb1e7e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 65b5e378480c4387aee25f0bdfeb1e7e, State: Running, Role: LEADER
I20260709 12:58:23.629781   640 consensus_queue.cc:260] T 811ff95e986542668558d35c387ec366 P 65b5e378480c4387aee25f0bdfeb1e7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:23.630903   640 raft_consensus.cc:3060] T 811ff95e986542668558d35c387ec366 P 65b5e378480c4387aee25f0bdfeb1e7e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:23.634613   714 raft_consensus.cc:2468] T 811ff95e986542668558d35c387ec366 P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e6c65ade84442dba7b9e742f473df99 in term 4.
I20260709 12:58:23.635668   530 leader_election.cc:304] T 811ff95e986542668558d35c387ec366 P 1e6c65ade84442dba7b9e742f473df99 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e6c65ade84442dba7b9e742f473df99, 5d1af4aed7da41e0b9f4f1e0f5621160; no voters: 
I20260709 12:58:23.636399   902 raft_consensus.cc:2804] T 811ff95e986542668558d35c387ec366 P 1e6c65ade84442dba7b9e742f473df99 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:23.636529   640 raft_consensus.cc:2468] T 811ff95e986542668558d35c387ec366 P 65b5e378480c4387aee25f0bdfeb1e7e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e6c65ade84442dba7b9e742f473df99 in term 4.
I20260709 12:58:23.636905   902 raft_consensus.cc:697] T 811ff95e986542668558d35c387ec366 P 1e6c65ade84442dba7b9e742f473df99 [term 4 LEADER]: Becoming Leader. State: Replica: 1e6c65ade84442dba7b9e742f473df99, State: Running, Role: LEADER
I20260709 12:58:23.637668   902 consensus_queue.cc:237] T 811ff95e986542668558d35c387ec366 P 1e6c65ade84442dba7b9e742f473df99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } } peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } }
I20260709 12:58:23.644052   462 catalog_manager.cc:5697] T 811ff95e986542668558d35c387ec366 P 1e6c65ade84442dba7b9e742f473df99 reported cstate change: term changed from 3 to 4, leader changed from 65b5e378480c4387aee25f0bdfeb1e7e (127.0.107.194) to 1e6c65ade84442dba7b9e742f473df99 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "1e6c65ade84442dba7b9e742f473df99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:23.670409   566 raft_consensus.cc:1275] T a10f7a7b26cf41d38030d1e80c6123ec P 1e6c65ade84442dba7b9e742f473df99 [term 3 FOLLOWER]: Refusing update from remote peer 5d1af4aed7da41e0b9f4f1e0f5621160: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:23.671855   856 consensus_queue.cc:1048] T a10f7a7b26cf41d38030d1e80c6123ec P 5d1af4aed7da41e0b9f4f1e0f5621160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:23.683679   640 raft_consensus.cc:1275] T a10f7a7b26cf41d38030d1e80c6123ec P 65b5e378480c4387aee25f0bdfeb1e7e [term 3 FOLLOWER]: Refusing update from remote peer 5d1af4aed7da41e0b9f4f1e0f5621160: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:23.685101   856 consensus_queue.cc:1048] T a10f7a7b26cf41d38030d1e80c6123ec P 5d1af4aed7da41e0b9f4f1e0f5621160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:23.754709   565 raft_consensus.cc:1275] T 2bec920f53cb42b785062112f132c67c P 1e6c65ade84442dba7b9e742f473df99 [term 5 FOLLOWER]: Refusing update from remote peer 5d1af4aed7da41e0b9f4f1e0f5621160: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:58:23.755812   856 consensus_queue.cc:1048] T 2bec920f53cb42b785062112f132c67c P 5d1af4aed7da41e0b9f4f1e0f5621160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e6c65ade84442dba7b9e742f473df99" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:23.764456   640 raft_consensus.cc:1275] T 2bec920f53cb42b785062112f132c67c P 65b5e378480c4387aee25f0bdfeb1e7e [term 5 FOLLOWER]: Refusing update from remote peer 5d1af4aed7da41e0b9f4f1e0f5621160: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:58:23.766127   856 consensus_queue.cc:1048] T 2bec920f53cb42b785062112f132c67c P 5d1af4aed7da41e0b9f4f1e0f5621160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:23.864537   714 raft_consensus.cc:1275] T c496907a8ecb49cc86a0784628ae42c9 P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 4 FOLLOWER]: Refusing update from remote peer 1e6c65ade84442dba7b9e742f473df99: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:58:23.865845   902 consensus_queue.cc:1048] T c496907a8ecb49cc86a0784628ae42c9 P 1e6c65ade84442dba7b9e742f473df99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:23.874590   640 raft_consensus.cc:1275] T c496907a8ecb49cc86a0784628ae42c9 P 65b5e378480c4387aee25f0bdfeb1e7e [term 4 FOLLOWER]: Refusing update from remote peer 1e6c65ade84442dba7b9e742f473df99: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:58:23.876255   916 consensus_queue.cc:1048] T c496907a8ecb49cc86a0784628ae42c9 P 1e6c65ade84442dba7b9e742f473df99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:24.063585   714 raft_consensus.cc:1275] T d45270a45bb746e597d1d6ee3744b0b7 P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 3 FOLLOWER]: Refusing update from remote peer 1e6c65ade84442dba7b9e742f473df99: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:24.064889   916 consensus_queue.cc:1048] T d45270a45bb746e597d1d6ee3744b0b7 P 1e6c65ade84442dba7b9e742f473df99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:24.073939   640 raft_consensus.cc:1275] T d45270a45bb746e597d1d6ee3744b0b7 P 65b5e378480c4387aee25f0bdfeb1e7e [term 3 FOLLOWER]: Refusing update from remote peer 1e6c65ade84442dba7b9e742f473df99: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:24.075567   916 consensus_queue.cc:1048] T d45270a45bb746e597d1d6ee3744b0b7 P 1e6c65ade84442dba7b9e742f473df99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:24.185967   640 raft_consensus.cc:1275] T 811ff95e986542668558d35c387ec366 P 65b5e378480c4387aee25f0bdfeb1e7e [term 4 FOLLOWER]: Refusing update from remote peer 1e6c65ade84442dba7b9e742f473df99: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:58:24.187129   916 consensus_queue.cc:1048] T 811ff95e986542668558d35c387ec366 P 1e6c65ade84442dba7b9e742f473df99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65b5e378480c4387aee25f0bdfeb1e7e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:24.195755   714 raft_consensus.cc:1275] T 811ff95e986542668558d35c387ec366 P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 4 FOLLOWER]: Refusing update from remote peer 1e6c65ade84442dba7b9e742f473df99: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:58:24.197118   902 consensus_queue.cc:1048] T 811ff95e986542668558d35c387ec366 P 1e6c65ade84442dba7b9e742f473df99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d1af4aed7da41e0b9f4f1e0f5621160" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:24.208913   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:24.217813   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
I20260709 12:58:24.239943   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:58:24.240643   431 tablet_replica.cc:333] T d45270a45bb746e597d1d6ee3744b0b7 P 1e6c65ade84442dba7b9e742f473df99: stopping tablet replica
I20260709 12:58:24.241298   431 raft_consensus.cc:2243] T d45270a45bb746e597d1d6ee3744b0b7 P 1e6c65ade84442dba7b9e742f473df99 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:58:24.242062   431 raft_consensus.cc:2272] T d45270a45bb746e597d1d6ee3744b0b7 P 1e6c65ade84442dba7b9e742f473df99 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:24.244693   431 tablet_replica.cc:333] T c496907a8ecb49cc86a0784628ae42c9 P 1e6c65ade84442dba7b9e742f473df99: stopping tablet replica
I20260709 12:58:24.245214   431 raft_consensus.cc:2243] T c496907a8ecb49cc86a0784628ae42c9 P 1e6c65ade84442dba7b9e742f473df99 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:58:24.245914   431 raft_consensus.cc:2272] T c496907a8ecb49cc86a0784628ae42c9 P 1e6c65ade84442dba7b9e742f473df99 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:24.247767   431 tablet_replica.cc:333] T 2bec920f53cb42b785062112f132c67c P 1e6c65ade84442dba7b9e742f473df99: stopping tablet replica
I20260709 12:58:24.248245   431 raft_consensus.cc:2243] T 2bec920f53cb42b785062112f132c67c P 1e6c65ade84442dba7b9e742f473df99 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:24.248747   431 raft_consensus.cc:2272] T 2bec920f53cb42b785062112f132c67c P 1e6c65ade84442dba7b9e742f473df99 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:24.250846   431 tablet_replica.cc:333] T 82e303e6a0b74de68d18d26049e994ed P 1e6c65ade84442dba7b9e742f473df99: stopping tablet replica
I20260709 12:58:24.251324   431 raft_consensus.cc:2243] T 82e303e6a0b74de68d18d26049e994ed P 1e6c65ade84442dba7b9e742f473df99 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:24.251796   431 raft_consensus.cc:2272] T 82e303e6a0b74de68d18d26049e994ed P 1e6c65ade84442dba7b9e742f473df99 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:24.253268   431 tablet_replica.cc:333] T 811ff95e986542668558d35c387ec366 P 1e6c65ade84442dba7b9e742f473df99: stopping tablet replica
I20260709 12:58:24.253731   431 raft_consensus.cc:2243] T 811ff95e986542668558d35c387ec366 P 1e6c65ade84442dba7b9e742f473df99 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:58:24.254388   431 raft_consensus.cc:2272] T 811ff95e986542668558d35c387ec366 P 1e6c65ade84442dba7b9e742f473df99 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:24.256304   431 tablet_replica.cc:333] T 51a60c5b8c0c485ebd1fabea4a3457ef P 1e6c65ade84442dba7b9e742f473df99: stopping tablet replica
I20260709 12:58:24.256781   431 raft_consensus.cc:2243] T 51a60c5b8c0c485ebd1fabea4a3457ef P 1e6c65ade84442dba7b9e742f473df99 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:24.257172   431 raft_consensus.cc:2272] T 51a60c5b8c0c485ebd1fabea4a3457ef P 1e6c65ade84442dba7b9e742f473df99 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:24.258829   431 tablet_replica.cc:333] T a10f7a7b26cf41d38030d1e80c6123ec P 1e6c65ade84442dba7b9e742f473df99: stopping tablet replica
I20260709 12:58:24.259261   431 raft_consensus.cc:2243] T a10f7a7b26cf41d38030d1e80c6123ec P 1e6c65ade84442dba7b9e742f473df99 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:24.259617   431 raft_consensus.cc:2272] T a10f7a7b26cf41d38030d1e80c6123ec P 1e6c65ade84442dba7b9e742f473df99 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:24.261480   431 tablet_replica.cc:333] T 87ceba987e5d48ba916d5e869e2a03b6 P 1e6c65ade84442dba7b9e742f473df99: stopping tablet replica
I20260709 12:58:24.261941   431 raft_consensus.cc:2243] T 87ceba987e5d48ba916d5e869e2a03b6 P 1e6c65ade84442dba7b9e742f473df99 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:24.262313   431 raft_consensus.cc:2272] T 87ceba987e5d48ba916d5e869e2a03b6 P 1e6c65ade84442dba7b9e742f473df99 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:24.263875   431 tablet_replica.cc:333] T 6c34d54dde1042f2a472ac8502703b79 P 1e6c65ade84442dba7b9e742f473df99: stopping tablet replica
I20260709 12:58:24.264268   431 raft_consensus.cc:2243] T 6c34d54dde1042f2a472ac8502703b79 P 1e6c65ade84442dba7b9e742f473df99 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:24.264622   431 raft_consensus.cc:2272] T 6c34d54dde1042f2a472ac8502703b79 P 1e6c65ade84442dba7b9e742f473df99 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:58:24.359833   605 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:44941: connect: Connection refused (error 111)
I20260709 12:58:24.360894   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
W20260709 12:58:24.363356   605 consensus_peers.cc:597] T 6c34d54dde1042f2a472ac8502703b79 P 65b5e378480c4387aee25f0bdfeb1e7e -> Peer 1e6c65ade84442dba7b9e742f473df99 (127.0.107.193:44941): Couldn't send request to peer 1e6c65ade84442dba7b9e742f473df99. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:44941: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:58:24.363817   605 consensus_peers.cc:597] T 87ceba987e5d48ba916d5e869e2a03b6 P 65b5e378480c4387aee25f0bdfeb1e7e -> Peer 1e6c65ade84442dba7b9e742f473df99 (127.0.107.193:44941): Couldn't send request to peer 1e6c65ade84442dba7b9e742f473df99. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:44941: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:24.378784   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
I20260709 12:58:24.399148   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:58:24.399850   431 tablet_replica.cc:333] T 51a60c5b8c0c485ebd1fabea4a3457ef P 65b5e378480c4387aee25f0bdfeb1e7e: stopping tablet replica
I20260709 12:58:24.400638   431 raft_consensus.cc:2243] T 51a60c5b8c0c485ebd1fabea4a3457ef P 65b5e378480c4387aee25f0bdfeb1e7e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:24.401135   431 raft_consensus.cc:2272] T 51a60c5b8c0c485ebd1fabea4a3457ef P 65b5e378480c4387aee25f0bdfeb1e7e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:24.403060   431 tablet_replica.cc:333] T a10f7a7b26cf41d38030d1e80c6123ec P 65b5e378480c4387aee25f0bdfeb1e7e: stopping tablet replica
I20260709 12:58:24.403553   431 raft_consensus.cc:2243] T a10f7a7b26cf41d38030d1e80c6123ec P 65b5e378480c4387aee25f0bdfeb1e7e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:24.403906   431 raft_consensus.cc:2272] T a10f7a7b26cf41d38030d1e80c6123ec P 65b5e378480c4387aee25f0bdfeb1e7e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:24.406056   431 tablet_replica.cc:333] T d45270a45bb746e597d1d6ee3744b0b7 P 65b5e378480c4387aee25f0bdfeb1e7e: stopping tablet replica
I20260709 12:58:24.406514   431 raft_consensus.cc:2243] T d45270a45bb746e597d1d6ee3744b0b7 P 65b5e378480c4387aee25f0bdfeb1e7e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:24.407020   431 raft_consensus.cc:2272] T d45270a45bb746e597d1d6ee3744b0b7 P 65b5e378480c4387aee25f0bdfeb1e7e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:24.409078   431 tablet_replica.cc:333] T c496907a8ecb49cc86a0784628ae42c9 P 65b5e378480c4387aee25f0bdfeb1e7e: stopping tablet replica
I20260709 12:58:24.409559   431 raft_consensus.cc:2243] T c496907a8ecb49cc86a0784628ae42c9 P 65b5e378480c4387aee25f0bdfeb1e7e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:24.409904   431 raft_consensus.cc:2272] T c496907a8ecb49cc86a0784628ae42c9 P 65b5e378480c4387aee25f0bdfeb1e7e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:24.412004   431 tablet_replica.cc:333] T 811ff95e986542668558d35c387ec366 P 65b5e378480c4387aee25f0bdfeb1e7e: stopping tablet replica
I20260709 12:58:24.412436   431 raft_consensus.cc:2243] T 811ff95e986542668558d35c387ec366 P 65b5e378480c4387aee25f0bdfeb1e7e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:24.412763   431 raft_consensus.cc:2272] T 811ff95e986542668558d35c387ec366 P 65b5e378480c4387aee25f0bdfeb1e7e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:24.414640   431 tablet_replica.cc:333] T 87ceba987e5d48ba916d5e869e2a03b6 P 65b5e378480c4387aee25f0bdfeb1e7e: stopping tablet replica
I20260709 12:58:24.415122   431 raft_consensus.cc:2243] T 87ceba987e5d48ba916d5e869e2a03b6 P 65b5e378480c4387aee25f0bdfeb1e7e [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:58:24.415820   431 raft_consensus.cc:2272] T 87ceba987e5d48ba916d5e869e2a03b6 P 65b5e378480c4387aee25f0bdfeb1e7e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:24.417261   431 tablet_replica.cc:333] T 6c34d54dde1042f2a472ac8502703b79 P 65b5e378480c4387aee25f0bdfeb1e7e: stopping tablet replica
I20260709 12:58:24.417681   431 raft_consensus.cc:2243] T 6c34d54dde1042f2a472ac8502703b79 P 65b5e378480c4387aee25f0bdfeb1e7e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:58:24.418304   431 raft_consensus.cc:2272] T 6c34d54dde1042f2a472ac8502703b79 P 65b5e378480c4387aee25f0bdfeb1e7e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:24.419952   431 tablet_replica.cc:333] T 82e303e6a0b74de68d18d26049e994ed P 65b5e378480c4387aee25f0bdfeb1e7e: stopping tablet replica
I20260709 12:58:24.420354   431 raft_consensus.cc:2243] T 82e303e6a0b74de68d18d26049e994ed P 65b5e378480c4387aee25f0bdfeb1e7e [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:58:24.420971   431 raft_consensus.cc:2272] T 82e303e6a0b74de68d18d26049e994ed P 65b5e378480c4387aee25f0bdfeb1e7e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:24.422464   431 tablet_replica.cc:333] T 2bec920f53cb42b785062112f132c67c P 65b5e378480c4387aee25f0bdfeb1e7e: stopping tablet replica
I20260709 12:58:24.422876   431 raft_consensus.cc:2243] T 2bec920f53cb42b785062112f132c67c P 65b5e378480c4387aee25f0bdfeb1e7e [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:24.423203   431 raft_consensus.cc:2272] T 2bec920f53cb42b785062112f132c67c P 65b5e378480c4387aee25f0bdfeb1e7e [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:24.449196   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
I20260709 12:58:24.466535   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
I20260709 12:58:24.486732   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:58:24.487321   431 tablet_replica.cc:333] T d45270a45bb746e597d1d6ee3744b0b7 P 5d1af4aed7da41e0b9f4f1e0f5621160: stopping tablet replica
I20260709 12:58:24.487851   431 raft_consensus.cc:2243] T d45270a45bb746e597d1d6ee3744b0b7 P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:24.488250   431 raft_consensus.cc:2272] T d45270a45bb746e597d1d6ee3744b0b7 P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:24.490192   431 tablet_replica.cc:333] T c496907a8ecb49cc86a0784628ae42c9 P 5d1af4aed7da41e0b9f4f1e0f5621160: stopping tablet replica
I20260709 12:58:24.490648   431 raft_consensus.cc:2243] T c496907a8ecb49cc86a0784628ae42c9 P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:24.491071   431 raft_consensus.cc:2272] T c496907a8ecb49cc86a0784628ae42c9 P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:24.493319   431 tablet_replica.cc:333] T 2bec920f53cb42b785062112f132c67c P 5d1af4aed7da41e0b9f4f1e0f5621160: stopping tablet replica
I20260709 12:58:24.493796   431 raft_consensus.cc:2243] T 2bec920f53cb42b785062112f132c67c P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:58:24.494422   431 raft_consensus.cc:2272] T 2bec920f53cb42b785062112f132c67c P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:24.496302   431 tablet_replica.cc:333] T 82e303e6a0b74de68d18d26049e994ed P 5d1af4aed7da41e0b9f4f1e0f5621160: stopping tablet replica
I20260709 12:58:24.496779   431 raft_consensus.cc:2243] T 82e303e6a0b74de68d18d26049e994ed P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:24.497123   431 raft_consensus.cc:2272] T 82e303e6a0b74de68d18d26049e994ed P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:24.498637   431 tablet_replica.cc:333] T 87ceba987e5d48ba916d5e869e2a03b6 P 5d1af4aed7da41e0b9f4f1e0f5621160: stopping tablet replica
I20260709 12:58:24.499105   431 raft_consensus.cc:2243] T 87ceba987e5d48ba916d5e869e2a03b6 P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:24.499444   431 raft_consensus.cc:2272] T 87ceba987e5d48ba916d5e869e2a03b6 P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:24.500839   431 tablet_replica.cc:333] T 6c34d54dde1042f2a472ac8502703b79 P 5d1af4aed7da41e0b9f4f1e0f5621160: stopping tablet replica
I20260709 12:58:24.501236   431 raft_consensus.cc:2243] T 6c34d54dde1042f2a472ac8502703b79 P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:24.501557   431 raft_consensus.cc:2272] T 6c34d54dde1042f2a472ac8502703b79 P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:24.503005   431 tablet_replica.cc:333] T 51a60c5b8c0c485ebd1fabea4a3457ef P 5d1af4aed7da41e0b9f4f1e0f5621160: stopping tablet replica
I20260709 12:58:24.503526   431 raft_consensus.cc:2243] T 51a60c5b8c0c485ebd1fabea4a3457ef P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:58:24.504299   431 raft_consensus.cc:2272] T 51a60c5b8c0c485ebd1fabea4a3457ef P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:24.506111   431 tablet_replica.cc:333] T a10f7a7b26cf41d38030d1e80c6123ec P 5d1af4aed7da41e0b9f4f1e0f5621160: stopping tablet replica
I20260709 12:58:24.506623   431 raft_consensus.cc:2243] T a10f7a7b26cf41d38030d1e80c6123ec P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:58:24.507269   431 raft_consensus.cc:2272] T a10f7a7b26cf41d38030d1e80c6123ec P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:24.509064   431 tablet_replica.cc:333] T 811ff95e986542668558d35c387ec366 P 5d1af4aed7da41e0b9f4f1e0f5621160: stopping tablet replica
I20260709 12:58:24.509438   431 raft_consensus.cc:2243] T 811ff95e986542668558d35c387ec366 P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:24.509801   431 raft_consensus.cc:2272] T 811ff95e986542668558d35c387ec366 P 5d1af4aed7da41e0b9f4f1e0f5621160 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:24.535104   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 12:58:24.550866   431 master.cc:562] Master@127.0.107.254:41197 shutting down...
I20260709 12:58:24.740679   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 4732e33b355a4564877e4067c535862e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:58:24.741215   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 4732e33b355a4564877e4067c535862e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:24.741588   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P 4732e33b355a4564877e4067c535862e: stopping tablet replica
I20260709 12:58:24.760254   431 master.cc:584] Master@127.0.107.254:41197 shutdown complete.
1e6c65ade84442dba7b9e742f473df99  4
5d1af4aed7da41e0b9f4f1e0f5621160  1
65b5e378480c4387aee25f0bdfeb1e7e  4
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (12883 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 12:58:24.795908   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:38623
I20260709 12:58:24.796981   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:58:24.802711   925 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:24.802806   926 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:24.803040   928 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:58:24.804085   431 server_base.cc:1061] running on GCE node
I20260709 12:58:24.804903   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:58:24.805135   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:58:24.805289   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601904805275 us; error 0 us; skew 500 ppm
I20260709 12:58:24.805815   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:58:24.808380   431 webserver.cc:533] Webserver started at http://127.0.107.254:33165/ using document root <none> and password file <none>
I20260709 12:58:24.808888   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:58:24.809085   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:58:24.809345   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:58:24.810456   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601891739070-431-0/minicluster-data/master-0-root/instance:
uuid: "cdd0ff0b2925403185d1d2d9185801dc"
format_stamp: "Formatted at 2026-07-09 12:58:24 on dist-test-slave-qzg2"
I20260709 12:58:24.815114   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.001s
I20260709 12:58:24.818459   933 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:24.819221   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:58:24.819492   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601891739070-431-0/minicluster-data/master-0-root
uuid: "cdd0ff0b2925403185d1d2d9185801dc"
format_stamp: "Formatted at 2026-07-09 12:58:24 on dist-test-slave-qzg2"
I20260709 12:58:24.819756   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601891739070-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601891739070-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601891739070-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:58:24.832527   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:58:24.833740   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:58:24.871065   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:38623
I20260709 12:58:24.871174   984 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:38623 every 8 connection(s)
I20260709 12:58:24.874931   985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:24.884155   985 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cdd0ff0b2925403185d1d2d9185801dc: Bootstrap starting.
I20260709 12:58:24.888736   985 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cdd0ff0b2925403185d1d2d9185801dc: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:24.892872   985 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cdd0ff0b2925403185d1d2d9185801dc: No bootstrap required, opened a new log
I20260709 12:58:24.894980   985 raft_consensus.cc:359] T 00000000000000000000000000000000 P cdd0ff0b2925403185d1d2d9185801dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdd0ff0b2925403185d1d2d9185801dc" member_type: VOTER }
I20260709 12:58:24.895372   985 raft_consensus.cc:385] T 00000000000000000000000000000000 P cdd0ff0b2925403185d1d2d9185801dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:24.895596   985 raft_consensus.cc:740] T 00000000000000000000000000000000 P cdd0ff0b2925403185d1d2d9185801dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cdd0ff0b2925403185d1d2d9185801dc, State: Initialized, Role: FOLLOWER
I20260709 12:58:24.896183   985 consensus_queue.cc:260] T 00000000000000000000000000000000 P cdd0ff0b2925403185d1d2d9185801dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdd0ff0b2925403185d1d2d9185801dc" member_type: VOTER }
I20260709 12:58:24.896615   985 raft_consensus.cc:399] T 00000000000000000000000000000000 P cdd0ff0b2925403185d1d2d9185801dc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:58:24.896818   985 raft_consensus.cc:493] T 00000000000000000000000000000000 P cdd0ff0b2925403185d1d2d9185801dc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:58:24.897081   985 raft_consensus.cc:3060] T 00000000000000000000000000000000 P cdd0ff0b2925403185d1d2d9185801dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:24.900975   985 raft_consensus.cc:515] T 00000000000000000000000000000000 P cdd0ff0b2925403185d1d2d9185801dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdd0ff0b2925403185d1d2d9185801dc" member_type: VOTER }
I20260709 12:58:24.901489   985 leader_election.cc:304] T 00000000000000000000000000000000 P cdd0ff0b2925403185d1d2d9185801dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cdd0ff0b2925403185d1d2d9185801dc; no voters: 
I20260709 12:58:24.902550   985 leader_election.cc:290] T 00000000000000000000000000000000 P cdd0ff0b2925403185d1d2d9185801dc [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:58:24.902868   988 raft_consensus.cc:2804] T 00000000000000000000000000000000 P cdd0ff0b2925403185d1d2d9185801dc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:24.904079   988 raft_consensus.cc:697] T 00000000000000000000000000000000 P cdd0ff0b2925403185d1d2d9185801dc [term 1 LEADER]: Becoming Leader. State: Replica: cdd0ff0b2925403185d1d2d9185801dc, State: Running, Role: LEADER
I20260709 12:58:24.904835   988 consensus_queue.cc:237] T 00000000000000000000000000000000 P cdd0ff0b2925403185d1d2d9185801dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdd0ff0b2925403185d1d2d9185801dc" member_type: VOTER }
I20260709 12:58:24.905344   985 sys_catalog.cc:565] T 00000000000000000000000000000000 P cdd0ff0b2925403185d1d2d9185801dc [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:58:24.909015   989 sys_catalog.cc:455] T 00000000000000000000000000000000 P cdd0ff0b2925403185d1d2d9185801dc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cdd0ff0b2925403185d1d2d9185801dc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdd0ff0b2925403185d1d2d9185801dc" member_type: VOTER } }
I20260709 12:58:24.910043   990 sys_catalog.cc:455] T 00000000000000000000000000000000 P cdd0ff0b2925403185d1d2d9185801dc [sys.catalog]: SysCatalogTable state changed. Reason: New leader cdd0ff0b2925403185d1d2d9185801dc. Latest consensus state: current_term: 1 leader_uuid: "cdd0ff0b2925403185d1d2d9185801dc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdd0ff0b2925403185d1d2d9185801dc" member_type: VOTER } }
I20260709 12:58:24.910567   989 sys_catalog.cc:458] T 00000000000000000000000000000000 P cdd0ff0b2925403185d1d2d9185801dc [sys.catalog]: This master's current role is: LEADER
I20260709 12:58:24.910648   990 sys_catalog.cc:458] T 00000000000000000000000000000000 P cdd0ff0b2925403185d1d2d9185801dc [sys.catalog]: This master's current role is: LEADER
I20260709 12:58:24.912575   997 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:58:24.917515   997 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:58:24.919780   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:58:24.925573   997 catalog_manager.cc:1383] Generated new cluster ID: 349f15a4955d4b9aa0049bdb74e35233
I20260709 12:58:24.925801   997 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:58:24.943408   997 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:58:24.944593   997 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:58:24.955752   997 catalog_manager.cc:6070] T 00000000000000000000000000000000 P cdd0ff0b2925403185d1d2d9185801dc: Generated new TSK 0
I20260709 12:58:24.956338   997 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:58:24.986814   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:58:24.992777  1006 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:24.994017  1007 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:58:24.995546   431 server_base.cc:1061] running on GCE node
W20260709 12:58:24.995918  1009 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:58:24.996778   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:58:24.996964   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:58:24.997087   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601904997071 us; error 0 us; skew 500 ppm
I20260709 12:58:24.997534   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:58:24.999830   431 webserver.cc:533] Webserver started at http://127.0.107.193:35329/ using document root <none> and password file <none>
I20260709 12:58:25.000277   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:58:25.000432   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:58:25.000659   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:58:25.001664   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601891739070-431-0/minicluster-data/ts-0-root/instance:
uuid: "b82fd85b5d15463fb787fcd1e6196090"
format_stamp: "Formatted at 2026-07-09 12:58:24 on dist-test-slave-qzg2"
I20260709 12:58:25.006057   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 12:58:25.009501  1014 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:25.010238   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:58:25.010533   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601891739070-431-0/minicluster-data/ts-0-root
uuid: "b82fd85b5d15463fb787fcd1e6196090"
format_stamp: "Formatted at 2026-07-09 12:58:24 on dist-test-slave-qzg2"
I20260709 12:58:25.010895   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601891739070-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601891739070-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601891739070-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:58:25.032835   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:58:25.034091   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:58:25.035566   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:58:25.037835   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:58:25.038033   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:25.038273   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:58:25.038435   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:25.077852   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:35297
I20260709 12:58:25.077952  1076 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:35297 every 8 connection(s)
I20260709 12:58:25.082706   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:58:25.089654  1081 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:25.090274  1082 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:25.094983  1084 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:58:25.095623   431 server_base.cc:1061] running on GCE node
I20260709 12:58:25.095678  1077 heartbeater.cc:344] Connected to a master server at 127.0.107.254:38623
I20260709 12:58:25.096204  1077 heartbeater.cc:461] Registering TS with master...
I20260709 12:58:25.096865   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:58:25.097134   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:58:25.097110  1077 heartbeater.cc:507] Master 127.0.107.254:38623 requested a full tablet report, sending...
I20260709 12:58:25.097481   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601905097460 us; error 0 us; skew 500 ppm
I20260709 12:58:25.098222   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:58:25.099684   950 ts_manager.cc:194] Registered new tserver with Master: b82fd85b5d15463fb787fcd1e6196090 (127.0.107.193:35297)
I20260709 12:58:25.100797   431 webserver.cc:533] Webserver started at http://127.0.107.194:37387/ using document root <none> and password file <none>
I20260709 12:58:25.101286   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:58:25.101472   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:58:25.101557   950 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54994
I20260709 12:58:25.101707   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:58:25.103163   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601891739070-431-0/minicluster-data/ts-1-root/instance:
uuid: "c213ad22ae2e4088a98d1b66e94c5544"
format_stamp: "Formatted at 2026-07-09 12:58:25 on dist-test-slave-qzg2"
I20260709 12:58:25.107731   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:58:25.111050  1089 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:25.111896   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:58:25.112181   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601891739070-431-0/minicluster-data/ts-1-root
uuid: "c213ad22ae2e4088a98d1b66e94c5544"
format_stamp: "Formatted at 2026-07-09 12:58:25 on dist-test-slave-qzg2"
I20260709 12:58:25.112450   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601891739070-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601891739070-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601891739070-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:58:25.124812   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:58:25.126001   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:58:25.127470   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:58:25.129675   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:58:25.129873   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:25.130095   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:58:25.130252   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:25.168773   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:42287
I20260709 12:58:25.168867  1151 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:42287 every 8 connection(s)
I20260709 12:58:25.173207   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:58:25.179814  1155 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:25.182053  1156 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:25.184708  1158 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:58:25.185338  1152 heartbeater.cc:344] Connected to a master server at 127.0.107.254:38623
I20260709 12:58:25.185684  1152 heartbeater.cc:461] Registering TS with master...
I20260709 12:58:25.185829   431 server_base.cc:1061] running on GCE node
I20260709 12:58:25.186578  1152 heartbeater.cc:507] Master 127.0.107.254:38623 requested a full tablet report, sending...
I20260709 12:58:25.186831   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:58:25.187078   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:58:25.187312   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601905187290 us; error 0 us; skew 500 ppm
I20260709 12:58:25.187919   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:58:25.188864   950 ts_manager.cc:194] Registered new tserver with Master: c213ad22ae2e4088a98d1b66e94c5544 (127.0.107.194:42287)
I20260709 12:58:25.190353   950 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55000
I20260709 12:58:25.190644   431 webserver.cc:533] Webserver started at http://127.0.107.195:45101/ using document root <none> and password file <none>
I20260709 12:58:25.191263   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:58:25.191543   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:58:25.191789   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:58:25.192885   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601891739070-431-0/minicluster-data/ts-2-root/instance:
uuid: "6508e02af03a488685f95c2de71536a1"
format_stamp: "Formatted at 2026-07-09 12:58:25 on dist-test-slave-qzg2"
I20260709 12:58:25.197379   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 12:58:25.201030  1163 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:25.201866   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:58:25.202200   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601891739070-431-0/minicluster-data/ts-2-root
uuid: "6508e02af03a488685f95c2de71536a1"
format_stamp: "Formatted at 2026-07-09 12:58:25 on dist-test-slave-qzg2"
I20260709 12:58:25.202462   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601891739070-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601891739070-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601891739070-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:58:25.225776   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:58:25.227035   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:58:25.228485   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:58:25.230556   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:58:25.230752   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:25.230983   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:58:25.231130   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:25.268702   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:35017
I20260709 12:58:25.268810  1225 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:35017 every 8 connection(s)
I20260709 12:58:25.281436  1226 heartbeater.cc:344] Connected to a master server at 127.0.107.254:38623
I20260709 12:58:25.281786  1226 heartbeater.cc:461] Registering TS with master...
I20260709 12:58:25.282440  1226 heartbeater.cc:507] Master 127.0.107.254:38623 requested a full tablet report, sending...
I20260709 12:58:25.284343   950 ts_manager.cc:194] Registered new tserver with Master: 6508e02af03a488685f95c2de71536a1 (127.0.107.195:35017)
I20260709 12:58:25.284881   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013246719s
I20260709 12:58:25.285925   950 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55016
I20260709 12:58:25.308983   950 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55020:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:58:25.311734   950 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:58:25.383509  1191 tablet_service.cc:1511] Processing CreateTablet for tablet 3937dd9840304b0f8752a493ae246949 (DEFAULT_TABLE table=test-workload [id=c6a5ec739c5e4f34952f063d3ead5a7e]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:58:25.384948  1191 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3937dd9840304b0f8752a493ae246949. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:25.386507  1114 tablet_service.cc:1511] Processing CreateTablet for tablet 95a5561ec0684e6e955493c7f892e02a (DEFAULT_TABLE table=test-workload [id=c6a5ec739c5e4f34952f063d3ead5a7e]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:58:25.387921  1114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95a5561ec0684e6e955493c7f892e02a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:25.387802  1117 tablet_service.cc:1511] Processing CreateTablet for tablet 3937dd9840304b0f8752a493ae246949 (DEFAULT_TABLE table=test-workload [id=c6a5ec739c5e4f34952f063d3ead5a7e]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:58:25.389061  1117 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3937dd9840304b0f8752a493ae246949. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:25.391753  1116 tablet_service.cc:1511] Processing CreateTablet for tablet 197c75f75ec14fc0b3ab45ff540e308d (DEFAULT_TABLE table=test-workload [id=c6a5ec739c5e4f34952f063d3ead5a7e]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:58:25.393076  1116 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 197c75f75ec14fc0b3ab45ff540e308d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:25.394274  1115 tablet_service.cc:1511] Processing CreateTablet for tablet cc64d897105f4ef08f524f3545b807e0 (DEFAULT_TABLE table=test-workload [id=c6a5ec739c5e4f34952f063d3ead5a7e]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:58:25.395618  1115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc64d897105f4ef08f524f3545b807e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:25.400665  1113 tablet_service.cc:1511] Processing CreateTablet for tablet 795b091720eb457cb7373133625dba18 (DEFAULT_TABLE table=test-workload [id=c6a5ec739c5e4f34952f063d3ead5a7e]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:58:25.402014  1113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 795b091720eb457cb7373133625dba18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:25.404338  1190 tablet_service.cc:1511] Processing CreateTablet for tablet 197c75f75ec14fc0b3ab45ff540e308d (DEFAULT_TABLE table=test-workload [id=c6a5ec739c5e4f34952f063d3ead5a7e]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:58:25.405716  1190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 197c75f75ec14fc0b3ab45ff540e308d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:25.410636  1112 tablet_service.cc:1511] Processing CreateTablet for tablet e8759b94cc204bc58848a9008afbeab7 (DEFAULT_TABLE table=test-workload [id=c6a5ec739c5e4f34952f063d3ead5a7e]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:58:25.412097  1112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8759b94cc204bc58848a9008afbeab7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:25.411860  1189 tablet_service.cc:1511] Processing CreateTablet for tablet cc64d897105f4ef08f524f3545b807e0 (DEFAULT_TABLE table=test-workload [id=c6a5ec739c5e4f34952f063d3ead5a7e]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:58:25.413417  1189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc64d897105f4ef08f524f3545b807e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:25.415365  1241 tablet_bootstrap.cc:492] T 197c75f75ec14fc0b3ab45ff540e308d P c213ad22ae2e4088a98d1b66e94c5544: Bootstrap starting.
I20260709 12:58:25.417629  1188 tablet_service.cc:1511] Processing CreateTablet for tablet 95a5561ec0684e6e955493c7f892e02a (DEFAULT_TABLE table=test-workload [id=c6a5ec739c5e4f34952f063d3ead5a7e]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:58:25.418982  1188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95a5561ec0684e6e955493c7f892e02a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:25.424146  1187 tablet_service.cc:1511] Processing CreateTablet for tablet 795b091720eb457cb7373133625dba18 (DEFAULT_TABLE table=test-workload [id=c6a5ec739c5e4f34952f063d3ead5a7e]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:58:25.425527  1187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 795b091720eb457cb7373133625dba18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:25.427986  1116 tablet_service.cc:1511] Processing CreateTablet for tablet bef759002c944c3095e9777eba3c28c1 (DEFAULT_TABLE table=test-workload [id=c6a5ec739c5e4f34952f063d3ead5a7e]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:58:25.429289  1116 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bef759002c944c3095e9777eba3c28c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:25.429090  1111 tablet_service.cc:1511] Processing CreateTablet for tablet 7a06197c7e30456f9219b872c66b66f1 (DEFAULT_TABLE table=test-workload [id=c6a5ec739c5e4f34952f063d3ead5a7e]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:58:25.430343  1110 tablet_service.cc:1511] Processing CreateTablet for tablet c9d672f25bad4478a1790bede74733f1 (DEFAULT_TABLE table=test-workload [id=c6a5ec739c5e4f34952f063d3ead5a7e]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:58:25.432440  1109 tablet_service.cc:1511] Processing CreateTablet for tablet bb7e493140574c5dbfd328c93b4bfc3b (DEFAULT_TABLE table=test-workload [id=c6a5ec739c5e4f34952f063d3ead5a7e]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:58:25.430333  1111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a06197c7e30456f9219b872c66b66f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:25.435437  1109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb7e493140574c5dbfd328c93b4bfc3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:25.440215  1110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9d672f25bad4478a1790bede74733f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:25.440027  1040 tablet_service.cc:1511] Processing CreateTablet for tablet cc64d897105f4ef08f524f3545b807e0 (DEFAULT_TABLE table=test-workload [id=c6a5ec739c5e4f34952f063d3ead5a7e]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:58:25.441362  1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc64d897105f4ef08f524f3545b807e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:25.443863  1039 tablet_service.cc:1511] Processing CreateTablet for tablet 95a5561ec0684e6e955493c7f892e02a (DEFAULT_TABLE table=test-workload [id=c6a5ec739c5e4f34952f063d3ead5a7e]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:58:25.445190  1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95a5561ec0684e6e955493c7f892e02a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:25.447767  1038 tablet_service.cc:1511] Processing CreateTablet for tablet 795b091720eb457cb7373133625dba18 (DEFAULT_TABLE table=test-workload [id=c6a5ec739c5e4f34952f063d3ead5a7e]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:58:25.449100  1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 795b091720eb457cb7373133625dba18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:25.451905  1037 tablet_service.cc:1511] Processing CreateTablet for tablet e8759b94cc204bc58848a9008afbeab7 (DEFAULT_TABLE table=test-workload [id=c6a5ec739c5e4f34952f063d3ead5a7e]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:58:25.453203  1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8759b94cc204bc58848a9008afbeab7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:25.455109  1241 tablet_bootstrap.cc:654] T 197c75f75ec14fc0b3ab45ff540e308d P c213ad22ae2e4088a98d1b66e94c5544: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:25.455838  1036 tablet_service.cc:1511] Processing CreateTablet for tablet bef759002c944c3095e9777eba3c28c1 (DEFAULT_TABLE table=test-workload [id=c6a5ec739c5e4f34952f063d3ead5a7e]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:58:25.459702  1041 tablet_service.cc:1511] Processing CreateTablet for tablet 197c75f75ec14fc0b3ab45ff540e308d (DEFAULT_TABLE table=test-workload [id=c6a5ec739c5e4f34952f063d3ead5a7e]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:58:25.463296  1035 tablet_service.cc:1511] Processing CreateTablet for tablet 7a06197c7e30456f9219b872c66b66f1 (DEFAULT_TABLE table=test-workload [id=c6a5ec739c5e4f34952f063d3ead5a7e]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:58:25.465608  1033 tablet_service.cc:1511] Processing CreateTablet for tablet bb7e493140574c5dbfd328c93b4bfc3b (DEFAULT_TABLE table=test-workload [id=c6a5ec739c5e4f34952f063d3ead5a7e]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:58:25.466936  1034 tablet_service.cc:1511] Processing CreateTablet for tablet c9d672f25bad4478a1790bede74733f1 (DEFAULT_TABLE table=test-workload [id=c6a5ec739c5e4f34952f063d3ead5a7e]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:58:25.434768  1042 tablet_service.cc:1511] Processing CreateTablet for tablet 3937dd9840304b0f8752a493ae246949 (DEFAULT_TABLE table=test-workload [id=c6a5ec739c5e4f34952f063d3ead5a7e]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:58:25.469684  1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bef759002c944c3095e9777eba3c28c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:25.473694  1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9d672f25bad4478a1790bede74733f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:25.475318  1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb7e493140574c5dbfd328c93b4bfc3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:25.479075  1042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3937dd9840304b0f8752a493ae246949. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:25.483047  1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 197c75f75ec14fc0b3ab45ff540e308d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:25.484658  1186 tablet_service.cc:1511] Processing CreateTablet for tablet bef759002c944c3095e9777eba3c28c1 (DEFAULT_TABLE table=test-workload [id=c6a5ec739c5e4f34952f063d3ead5a7e]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:58:25.486061  1186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bef759002c944c3095e9777eba3c28c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:25.486112  1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a06197c7e30456f9219b872c66b66f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:25.487835  1185 tablet_service.cc:1511] Processing CreateTablet for tablet 7a06197c7e30456f9219b872c66b66f1 (DEFAULT_TABLE table=test-workload [id=c6a5ec739c5e4f34952f063d3ead5a7e]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:58:25.489130  1185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a06197c7e30456f9219b872c66b66f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:25.491896  1184 tablet_service.cc:1511] Processing CreateTablet for tablet c9d672f25bad4478a1790bede74733f1 (DEFAULT_TABLE table=test-workload [id=c6a5ec739c5e4f34952f063d3ead5a7e]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:58:25.493206  1184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9d672f25bad4478a1790bede74733f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:25.495669  1191 tablet_service.cc:1511] Processing CreateTablet for tablet e8759b94cc204bc58848a9008afbeab7 (DEFAULT_TABLE table=test-workload [id=c6a5ec739c5e4f34952f063d3ead5a7e]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:58:25.495843  1183 tablet_service.cc:1511] Processing CreateTablet for tablet bb7e493140574c5dbfd328c93b4bfc3b (DEFAULT_TABLE table=test-workload [id=c6a5ec739c5e4f34952f063d3ead5a7e]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:58:25.496889  1191 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8759b94cc204bc58848a9008afbeab7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:25.503028  1183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb7e493140574c5dbfd328c93b4bfc3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:25.519500  1241 tablet_bootstrap.cc:492] T 197c75f75ec14fc0b3ab45ff540e308d P c213ad22ae2e4088a98d1b66e94c5544: No bootstrap required, opened a new log
I20260709 12:58:25.542694  1241 ts_tablet_manager.cc:1403] T 197c75f75ec14fc0b3ab45ff540e308d P c213ad22ae2e4088a98d1b66e94c5544: Time spent bootstrapping tablet: real 0.125s	user 0.007s	sys 0.008s
I20260709 12:58:25.545763  1241 raft_consensus.cc:359] T 197c75f75ec14fc0b3ab45ff540e308d P c213ad22ae2e4088a98d1b66e94c5544 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:25.546620  1241 raft_consensus.cc:385] T 197c75f75ec14fc0b3ab45ff540e308d P c213ad22ae2e4088a98d1b66e94c5544 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:25.547008  1241 raft_consensus.cc:740] T 197c75f75ec14fc0b3ab45ff540e308d P c213ad22ae2e4088a98d1b66e94c5544 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c213ad22ae2e4088a98d1b66e94c5544, State: Initialized, Role: FOLLOWER
I20260709 12:58:25.551299  1241 consensus_queue.cc:260] T 197c75f75ec14fc0b3ab45ff540e308d P c213ad22ae2e4088a98d1b66e94c5544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:25.579730  1244 tablet_bootstrap.cc:492] T 795b091720eb457cb7373133625dba18 P b82fd85b5d15463fb787fcd1e6196090: Bootstrap starting.
I20260709 12:58:25.582892  1152 heartbeater.cc:499] Master 127.0.107.254:38623 was elected leader, sending a full tablet report...
I20260709 12:58:25.587208  1244 tablet_bootstrap.cc:654] T 795b091720eb457cb7373133625dba18 P b82fd85b5d15463fb787fcd1e6196090: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:25.592401  1243 tablet_bootstrap.cc:492] T 197c75f75ec14fc0b3ab45ff540e308d P 6508e02af03a488685f95c2de71536a1: Bootstrap starting.
I20260709 12:58:25.599292  1243 tablet_bootstrap.cc:654] T 197c75f75ec14fc0b3ab45ff540e308d P 6508e02af03a488685f95c2de71536a1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:25.603420  1244 tablet_bootstrap.cc:492] T 795b091720eb457cb7373133625dba18 P b82fd85b5d15463fb787fcd1e6196090: No bootstrap required, opened a new log
I20260709 12:58:25.603910  1244 ts_tablet_manager.cc:1403] T 795b091720eb457cb7373133625dba18 P b82fd85b5d15463fb787fcd1e6196090: Time spent bootstrapping tablet: real 0.025s	user 0.014s	sys 0.006s
I20260709 12:58:25.606676  1244 raft_consensus.cc:359] T 795b091720eb457cb7373133625dba18 P b82fd85b5d15463fb787fcd1e6196090 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:25.607362  1244 raft_consensus.cc:385] T 795b091720eb457cb7373133625dba18 P b82fd85b5d15463fb787fcd1e6196090 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:25.607661  1244 raft_consensus.cc:740] T 795b091720eb457cb7373133625dba18 P b82fd85b5d15463fb787fcd1e6196090 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b82fd85b5d15463fb787fcd1e6196090, State: Initialized, Role: FOLLOWER
I20260709 12:58:25.608592  1241 ts_tablet_manager.cc:1434] T 197c75f75ec14fc0b3ab45ff540e308d P c213ad22ae2e4088a98d1b66e94c5544: Time spent starting tablet: real 0.065s	user 0.005s	sys 0.001s
I20260709 12:58:25.608446  1244 consensus_queue.cc:260] T 795b091720eb457cb7373133625dba18 P b82fd85b5d15463fb787fcd1e6196090 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:25.610311  1241 tablet_bootstrap.cc:492] T e8759b94cc204bc58848a9008afbeab7 P c213ad22ae2e4088a98d1b66e94c5544: Bootstrap starting.
I20260709 12:58:25.616052  1244 ts_tablet_manager.cc:1434] T 795b091720eb457cb7373133625dba18 P b82fd85b5d15463fb787fcd1e6196090: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 12:58:25.616796  1077 heartbeater.cc:499] Master 127.0.107.254:38623 was elected leader, sending a full tablet report...
I20260709 12:58:25.617178  1244 tablet_bootstrap.cc:492] T 95a5561ec0684e6e955493c7f892e02a P b82fd85b5d15463fb787fcd1e6196090: Bootstrap starting.
I20260709 12:58:25.622959  1243 tablet_bootstrap.cc:492] T 197c75f75ec14fc0b3ab45ff540e308d P 6508e02af03a488685f95c2de71536a1: No bootstrap required, opened a new log
I20260709 12:58:25.623440  1243 ts_tablet_manager.cc:1403] T 197c75f75ec14fc0b3ab45ff540e308d P 6508e02af03a488685f95c2de71536a1: Time spent bootstrapping tablet: real 0.031s	user 0.011s	sys 0.005s
I20260709 12:58:25.623867  1244 tablet_bootstrap.cc:654] T 95a5561ec0684e6e955493c7f892e02a P b82fd85b5d15463fb787fcd1e6196090: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:25.623867  1241 tablet_bootstrap.cc:654] T e8759b94cc204bc58848a9008afbeab7 P c213ad22ae2e4088a98d1b66e94c5544: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:25.626322  1243 raft_consensus.cc:359] T 197c75f75ec14fc0b3ab45ff540e308d P 6508e02af03a488685f95c2de71536a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:25.627118  1243 raft_consensus.cc:385] T 197c75f75ec14fc0b3ab45ff540e308d P 6508e02af03a488685f95c2de71536a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:25.631359  1243 raft_consensus.cc:740] T 197c75f75ec14fc0b3ab45ff540e308d P 6508e02af03a488685f95c2de71536a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6508e02af03a488685f95c2de71536a1, State: Initialized, Role: FOLLOWER
I20260709 12:58:25.632217  1243 consensus_queue.cc:260] T 197c75f75ec14fc0b3ab45ff540e308d P 6508e02af03a488685f95c2de71536a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:25.634743  1226 heartbeater.cc:499] Master 127.0.107.254:38623 was elected leader, sending a full tablet report...
I20260709 12:58:25.635393  1243 ts_tablet_manager.cc:1434] T 197c75f75ec14fc0b3ab45ff540e308d P 6508e02af03a488685f95c2de71536a1: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:58:25.636510  1243 tablet_bootstrap.cc:492] T 3937dd9840304b0f8752a493ae246949 P 6508e02af03a488685f95c2de71536a1: Bootstrap starting.
I20260709 12:58:25.639621  1245 raft_consensus.cc:493] T 197c75f75ec14fc0b3ab45ff540e308d P c213ad22ae2e4088a98d1b66e94c5544 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:25.640195  1245 raft_consensus.cc:515] T 197c75f75ec14fc0b3ab45ff540e308d P c213ad22ae2e4088a98d1b66e94c5544 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:25.643711  1243 tablet_bootstrap.cc:654] T 3937dd9840304b0f8752a493ae246949 P 6508e02af03a488685f95c2de71536a1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:25.648797  1245 leader_election.cc:290] T 197c75f75ec14fc0b3ab45ff540e308d P c213ad22ae2e4088a98d1b66e94c5544 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b82fd85b5d15463fb787fcd1e6196090 (127.0.107.193:35297), 6508e02af03a488685f95c2de71536a1 (127.0.107.195:35017)
I20260709 12:58:25.649544  1243 tablet_bootstrap.cc:492] T 3937dd9840304b0f8752a493ae246949 P 6508e02af03a488685f95c2de71536a1: No bootstrap required, opened a new log
I20260709 12:58:25.650074  1243 ts_tablet_manager.cc:1403] T 3937dd9840304b0f8752a493ae246949 P 6508e02af03a488685f95c2de71536a1: Time spent bootstrapping tablet: real 0.014s	user 0.008s	sys 0.003s
I20260709 12:58:25.653062  1243 raft_consensus.cc:359] T 3937dd9840304b0f8752a493ae246949 P 6508e02af03a488685f95c2de71536a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } }
I20260709 12:58:25.653784  1243 raft_consensus.cc:385] T 3937dd9840304b0f8752a493ae246949 P 6508e02af03a488685f95c2de71536a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:25.654083  1243 raft_consensus.cc:740] T 3937dd9840304b0f8752a493ae246949 P 6508e02af03a488685f95c2de71536a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6508e02af03a488685f95c2de71536a1, State: Initialized, Role: FOLLOWER
I20260709 12:58:25.654829  1243 consensus_queue.cc:260] T 3937dd9840304b0f8752a493ae246949 P 6508e02af03a488685f95c2de71536a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } }
I20260709 12:58:25.655797  1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "197c75f75ec14fc0b3ab45ff540e308d" candidate_uuid: "c213ad22ae2e4088a98d1b66e94c5544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b82fd85b5d15463fb787fcd1e6196090" is_pre_election: true
I20260709 12:58:25.657191  1243 ts_tablet_manager.cc:1434] T 3937dd9840304b0f8752a493ae246949 P 6508e02af03a488685f95c2de71536a1: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
W20260709 12:58:25.657496  1090 leader_election.cc:343] T 197c75f75ec14fc0b3ab45ff540e308d P c213ad22ae2e4088a98d1b66e94c5544 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b82fd85b5d15463fb787fcd1e6196090 (127.0.107.193:35297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:25.658138  1243 tablet_bootstrap.cc:492] T 795b091720eb457cb7373133625dba18 P 6508e02af03a488685f95c2de71536a1: Bootstrap starting.
I20260709 12:58:25.674749  1243 tablet_bootstrap.cc:654] T 795b091720eb457cb7373133625dba18 P 6508e02af03a488685f95c2de71536a1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:25.674388  1201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "197c75f75ec14fc0b3ab45ff540e308d" candidate_uuid: "c213ad22ae2e4088a98d1b66e94c5544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6508e02af03a488685f95c2de71536a1" is_pre_election: true
I20260709 12:58:25.675321  1201 raft_consensus.cc:2468] T 197c75f75ec14fc0b3ab45ff540e308d P 6508e02af03a488685f95c2de71536a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c213ad22ae2e4088a98d1b66e94c5544 in term 0.
I20260709 12:58:25.676045  1241 tablet_bootstrap.cc:492] T e8759b94cc204bc58848a9008afbeab7 P c213ad22ae2e4088a98d1b66e94c5544: No bootstrap required, opened a new log
I20260709 12:58:25.676537  1241 ts_tablet_manager.cc:1403] T e8759b94cc204bc58848a9008afbeab7 P c213ad22ae2e4088a98d1b66e94c5544: Time spent bootstrapping tablet: real 0.067s	user 0.011s	sys 0.019s
I20260709 12:58:25.677079  1093 leader_election.cc:304] T 197c75f75ec14fc0b3ab45ff540e308d P c213ad22ae2e4088a98d1b66e94c5544 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6508e02af03a488685f95c2de71536a1, c213ad22ae2e4088a98d1b66e94c5544; no voters: b82fd85b5d15463fb787fcd1e6196090
I20260709 12:58:25.678063  1245 raft_consensus.cc:2804] T 197c75f75ec14fc0b3ab45ff540e308d P c213ad22ae2e4088a98d1b66e94c5544 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:25.678471  1245 raft_consensus.cc:493] T 197c75f75ec14fc0b3ab45ff540e308d P c213ad22ae2e4088a98d1b66e94c5544 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:25.678907  1245 raft_consensus.cc:3060] T 197c75f75ec14fc0b3ab45ff540e308d P c213ad22ae2e4088a98d1b66e94c5544 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:25.680924  1241 raft_consensus.cc:359] T e8759b94cc204bc58848a9008afbeab7 P c213ad22ae2e4088a98d1b66e94c5544 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:25.681458  1244 tablet_bootstrap.cc:492] T 95a5561ec0684e6e955493c7f892e02a P b82fd85b5d15463fb787fcd1e6196090: No bootstrap required, opened a new log
I20260709 12:58:25.681701  1241 raft_consensus.cc:385] T e8759b94cc204bc58848a9008afbeab7 P c213ad22ae2e4088a98d1b66e94c5544 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:25.682040  1241 raft_consensus.cc:740] T e8759b94cc204bc58848a9008afbeab7 P c213ad22ae2e4088a98d1b66e94c5544 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c213ad22ae2e4088a98d1b66e94c5544, State: Initialized, Role: FOLLOWER
I20260709 12:58:25.682161  1244 ts_tablet_manager.cc:1403] T 95a5561ec0684e6e955493c7f892e02a P b82fd85b5d15463fb787fcd1e6196090: Time spent bootstrapping tablet: real 0.065s	user 0.021s	sys 0.015s
I20260709 12:58:25.682981  1241 consensus_queue.cc:260] T e8759b94cc204bc58848a9008afbeab7 P c213ad22ae2e4088a98d1b66e94c5544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:25.685869  1244 raft_consensus.cc:359] T 95a5561ec0684e6e955493c7f892e02a P b82fd85b5d15463fb787fcd1e6196090 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:25.688090  1243 tablet_bootstrap.cc:492] T 795b091720eb457cb7373133625dba18 P 6508e02af03a488685f95c2de71536a1: No bootstrap required, opened a new log
I20260709 12:58:25.688717  1243 ts_tablet_manager.cc:1403] T 795b091720eb457cb7373133625dba18 P 6508e02af03a488685f95c2de71536a1: Time spent bootstrapping tablet: real 0.031s	user 0.012s	sys 0.000s
I20260709 12:58:25.691514  1243 raft_consensus.cc:359] T 795b091720eb457cb7373133625dba18 P 6508e02af03a488685f95c2de71536a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:25.692215  1243 raft_consensus.cc:385] T 795b091720eb457cb7373133625dba18 P 6508e02af03a488685f95c2de71536a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:25.692490  1243 raft_consensus.cc:740] T 795b091720eb457cb7373133625dba18 P 6508e02af03a488685f95c2de71536a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6508e02af03a488685f95c2de71536a1, State: Initialized, Role: FOLLOWER
I20260709 12:58:25.692953  1244 raft_consensus.cc:385] T 95a5561ec0684e6e955493c7f892e02a P b82fd85b5d15463fb787fcd1e6196090 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:25.693397  1244 raft_consensus.cc:740] T 95a5561ec0684e6e955493c7f892e02a P b82fd85b5d15463fb787fcd1e6196090 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b82fd85b5d15463fb787fcd1e6196090, State: Initialized, Role: FOLLOWER
I20260709 12:58:25.693298  1243 consensus_queue.cc:260] T 795b091720eb457cb7373133625dba18 P 6508e02af03a488685f95c2de71536a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:25.694504  1244 consensus_queue.cc:260] T 95a5561ec0684e6e955493c7f892e02a P b82fd85b5d15463fb787fcd1e6196090 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:25.695979  1243 ts_tablet_manager.cc:1434] T 795b091720eb457cb7373133625dba18 P 6508e02af03a488685f95c2de71536a1: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 12:58:25.696719  1245 raft_consensus.cc:515] T 197c75f75ec14fc0b3ab45ff540e308d P c213ad22ae2e4088a98d1b66e94c5544 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:25.697489  1244 ts_tablet_manager.cc:1434] T 95a5561ec0684e6e955493c7f892e02a P b82fd85b5d15463fb787fcd1e6196090: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:58:25.698513  1244 tablet_bootstrap.cc:492] T cc64d897105f4ef08f524f3545b807e0 P b82fd85b5d15463fb787fcd1e6196090: Bootstrap starting.
I20260709 12:58:25.699132  1243 tablet_bootstrap.cc:492] T cc64d897105f4ef08f524f3545b807e0 P 6508e02af03a488685f95c2de71536a1: Bootstrap starting.
I20260709 12:58:25.699437  1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "197c75f75ec14fc0b3ab45ff540e308d" candidate_uuid: "c213ad22ae2e4088a98d1b66e94c5544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b82fd85b5d15463fb787fcd1e6196090"
W20260709 12:58:25.701567  1090 leader_election.cc:343] T 197c75f75ec14fc0b3ab45ff540e308d P c213ad22ae2e4088a98d1b66e94c5544 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b82fd85b5d15463fb787fcd1e6196090 (127.0.107.193:35297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:25.702544  1201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "197c75f75ec14fc0b3ab45ff540e308d" candidate_uuid: "c213ad22ae2e4088a98d1b66e94c5544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6508e02af03a488685f95c2de71536a1"
I20260709 12:58:25.703264  1201 raft_consensus.cc:3060] T 197c75f75ec14fc0b3ab45ff540e308d P 6508e02af03a488685f95c2de71536a1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:25.709230  1244 tablet_bootstrap.cc:654] T cc64d897105f4ef08f524f3545b807e0 P b82fd85b5d15463fb787fcd1e6196090: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:25.710922  1241 ts_tablet_manager.cc:1434] T e8759b94cc204bc58848a9008afbeab7 P c213ad22ae2e4088a98d1b66e94c5544: Time spent starting tablet: real 0.034s	user 0.016s	sys 0.012s
I20260709 12:58:25.713538  1201 raft_consensus.cc:2468] T 197c75f75ec14fc0b3ab45ff540e308d P 6508e02af03a488685f95c2de71536a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c213ad22ae2e4088a98d1b66e94c5544 in term 1.
I20260709 12:58:25.717867  1244 tablet_bootstrap.cc:492] T cc64d897105f4ef08f524f3545b807e0 P b82fd85b5d15463fb787fcd1e6196090: No bootstrap required, opened a new log
I20260709 12:58:25.707077  1245 leader_election.cc:290] T 197c75f75ec14fc0b3ab45ff540e308d P c213ad22ae2e4088a98d1b66e94c5544 [CANDIDATE]: Term 1 election: Requested vote from peers b82fd85b5d15463fb787fcd1e6196090 (127.0.107.193:35297), 6508e02af03a488685f95c2de71536a1 (127.0.107.195:35017)
I20260709 12:58:25.716706  1241 tablet_bootstrap.cc:492] T 795b091720eb457cb7373133625dba18 P c213ad22ae2e4088a98d1b66e94c5544: Bootstrap starting.
I20260709 12:58:25.718825  1244 ts_tablet_manager.cc:1403] T cc64d897105f4ef08f524f3545b807e0 P b82fd85b5d15463fb787fcd1e6196090: Time spent bootstrapping tablet: real 0.021s	user 0.008s	sys 0.007s
I20260709 12:58:25.718233  1243 tablet_bootstrap.cc:654] T cc64d897105f4ef08f524f3545b807e0 P 6508e02af03a488685f95c2de71536a1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:25.719770  1093 leader_election.cc:304] T 197c75f75ec14fc0b3ab45ff540e308d P c213ad22ae2e4088a98d1b66e94c5544 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6508e02af03a488685f95c2de71536a1, c213ad22ae2e4088a98d1b66e94c5544; no voters: b82fd85b5d15463fb787fcd1e6196090
I20260709 12:58:25.720556  1245 raft_consensus.cc:2804] T 197c75f75ec14fc0b3ab45ff540e308d P c213ad22ae2e4088a98d1b66e94c5544 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:25.721081  1245 raft_consensus.cc:697] T 197c75f75ec14fc0b3ab45ff540e308d P c213ad22ae2e4088a98d1b66e94c5544 [term 1 LEADER]: Becoming Leader. State: Replica: c213ad22ae2e4088a98d1b66e94c5544, State: Running, Role: LEADER
I20260709 12:58:25.722128  1245 consensus_queue.cc:237] T 197c75f75ec14fc0b3ab45ff540e308d P c213ad22ae2e4088a98d1b66e94c5544 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:25.723479  1244 raft_consensus.cc:359] T cc64d897105f4ef08f524f3545b807e0 P b82fd85b5d15463fb787fcd1e6196090 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:25.724208  1244 raft_consensus.cc:385] T cc64d897105f4ef08f524f3545b807e0 P b82fd85b5d15463fb787fcd1e6196090 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:25.724493  1244 raft_consensus.cc:740] T cc64d897105f4ef08f524f3545b807e0 P b82fd85b5d15463fb787fcd1e6196090 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b82fd85b5d15463fb787fcd1e6196090, State: Initialized, Role: FOLLOWER
I20260709 12:58:25.725137  1241 tablet_bootstrap.cc:654] T 795b091720eb457cb7373133625dba18 P c213ad22ae2e4088a98d1b66e94c5544: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:25.725379  1244 consensus_queue.cc:260] T cc64d897105f4ef08f524f3545b807e0 P b82fd85b5d15463fb787fcd1e6196090 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:25.727861  1244 ts_tablet_manager.cc:1434] T cc64d897105f4ef08f524f3545b807e0 P b82fd85b5d15463fb787fcd1e6196090: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:58:25.728863  1244 tablet_bootstrap.cc:492] T 197c75f75ec14fc0b3ab45ff540e308d P b82fd85b5d15463fb787fcd1e6196090: Bootstrap starting.
I20260709 12:58:25.735698  1244 tablet_bootstrap.cc:654] T 197c75f75ec14fc0b3ab45ff540e308d P b82fd85b5d15463fb787fcd1e6196090: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:25.736074  1243 tablet_bootstrap.cc:492] T cc64d897105f4ef08f524f3545b807e0 P 6508e02af03a488685f95c2de71536a1: No bootstrap required, opened a new log
I20260709 12:58:25.735365   949 catalog_manager.cc:5697] T 197c75f75ec14fc0b3ab45ff540e308d P c213ad22ae2e4088a98d1b66e94c5544 reported cstate change: term changed from 0 to 1, leader changed from <none> to c213ad22ae2e4088a98d1b66e94c5544 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c213ad22ae2e4088a98d1b66e94c5544" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:25.736749  1243 ts_tablet_manager.cc:1403] T cc64d897105f4ef08f524f3545b807e0 P 6508e02af03a488685f95c2de71536a1: Time spent bootstrapping tablet: real 0.038s	user 0.012s	sys 0.004s
I20260709 12:58:25.740048  1241 tablet_bootstrap.cc:492] T 795b091720eb457cb7373133625dba18 P c213ad22ae2e4088a98d1b66e94c5544: No bootstrap required, opened a new log
I20260709 12:58:25.740052  1243 raft_consensus.cc:359] T cc64d897105f4ef08f524f3545b807e0 P 6508e02af03a488685f95c2de71536a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:25.741050  1243 raft_consensus.cc:385] T cc64d897105f4ef08f524f3545b807e0 P 6508e02af03a488685f95c2de71536a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:25.741416  1243 raft_consensus.cc:740] T cc64d897105f4ef08f524f3545b807e0 P 6508e02af03a488685f95c2de71536a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6508e02af03a488685f95c2de71536a1, State: Initialized, Role: FOLLOWER
I20260709 12:58:25.742259  1243 consensus_queue.cc:260] T cc64d897105f4ef08f524f3545b807e0 P 6508e02af03a488685f95c2de71536a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:25.740758  1241 ts_tablet_manager.cc:1403] T 795b091720eb457cb7373133625dba18 P c213ad22ae2e4088a98d1b66e94c5544: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.002s
I20260709 12:58:25.744613  1243 ts_tablet_manager.cc:1434] T cc64d897105f4ef08f524f3545b807e0 P 6508e02af03a488685f95c2de71536a1: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:58:25.745645  1243 tablet_bootstrap.cc:492] T 95a5561ec0684e6e955493c7f892e02a P 6508e02af03a488685f95c2de71536a1: Bootstrap starting.
I20260709 12:58:25.746733  1241 raft_consensus.cc:359] T 795b091720eb457cb7373133625dba18 P c213ad22ae2e4088a98d1b66e94c5544 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:25.747470  1241 raft_consensus.cc:385] T 795b091720eb457cb7373133625dba18 P c213ad22ae2e4088a98d1b66e94c5544 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:25.747766  1241 raft_consensus.cc:740] T 795b091720eb457cb7373133625dba18 P c213ad22ae2e4088a98d1b66e94c5544 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c213ad22ae2e4088a98d1b66e94c5544, State: Initialized, Role: FOLLOWER
I20260709 12:58:25.748044  1244 tablet_bootstrap.cc:492] T 197c75f75ec14fc0b3ab45ff540e308d P b82fd85b5d15463fb787fcd1e6196090: No bootstrap required, opened a new log
I20260709 12:58:25.748531  1244 ts_tablet_manager.cc:1403] T 197c75f75ec14fc0b3ab45ff540e308d P b82fd85b5d15463fb787fcd1e6196090: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.005s
I20260709 12:58:25.748533  1241 consensus_queue.cc:260] T 795b091720eb457cb7373133625dba18 P c213ad22ae2e4088a98d1b66e94c5544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:25.751308  1241 ts_tablet_manager.cc:1434] T 795b091720eb457cb7373133625dba18 P c213ad22ae2e4088a98d1b66e94c5544: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:58:25.751546  1244 raft_consensus.cc:359] T 197c75f75ec14fc0b3ab45ff540e308d P b82fd85b5d15463fb787fcd1e6196090 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:25.752303  1241 tablet_bootstrap.cc:492] T 95a5561ec0684e6e955493c7f892e02a P c213ad22ae2e4088a98d1b66e94c5544: Bootstrap starting.
I20260709 12:58:25.752256  1244 raft_consensus.cc:385] T 197c75f75ec14fc0b3ab45ff540e308d P b82fd85b5d15463fb787fcd1e6196090 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:25.752532  1243 tablet_bootstrap.cc:654] T 95a5561ec0684e6e955493c7f892e02a P 6508e02af03a488685f95c2de71536a1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:25.752767  1244 raft_consensus.cc:740] T 197c75f75ec14fc0b3ab45ff540e308d P b82fd85b5d15463fb787fcd1e6196090 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b82fd85b5d15463fb787fcd1e6196090, State: Initialized, Role: FOLLOWER
I20260709 12:58:25.753696  1244 consensus_queue.cc:260] T 197c75f75ec14fc0b3ab45ff540e308d P b82fd85b5d15463fb787fcd1e6196090 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:25.756173  1244 ts_tablet_manager.cc:1434] T 197c75f75ec14fc0b3ab45ff540e308d P b82fd85b5d15463fb787fcd1e6196090: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:58:25.757210  1244 tablet_bootstrap.cc:492] T c9d672f25bad4478a1790bede74733f1 P b82fd85b5d15463fb787fcd1e6196090: Bootstrap starting.
I20260709 12:58:25.759392  1241 tablet_bootstrap.cc:654] T 95a5561ec0684e6e955493c7f892e02a P c213ad22ae2e4088a98d1b66e94c5544: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:25.763765  1244 tablet_bootstrap.cc:654] T c9d672f25bad4478a1790bede74733f1 P b82fd85b5d15463fb787fcd1e6196090: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:25.770908  1244 tablet_bootstrap.cc:492] T c9d672f25bad4478a1790bede74733f1 P b82fd85b5d15463fb787fcd1e6196090: No bootstrap required, opened a new log
I20260709 12:58:25.770993  1243 tablet_bootstrap.cc:492] T 95a5561ec0684e6e955493c7f892e02a P 6508e02af03a488685f95c2de71536a1: No bootstrap required, opened a new log
I20260709 12:58:25.771603  1244 ts_tablet_manager.cc:1403] T c9d672f25bad4478a1790bede74733f1 P b82fd85b5d15463fb787fcd1e6196090: Time spent bootstrapping tablet: real 0.015s	user 0.007s	sys 0.005s
I20260709 12:58:25.771716  1243 ts_tablet_manager.cc:1403] T 95a5561ec0684e6e955493c7f892e02a P 6508e02af03a488685f95c2de71536a1: Time spent bootstrapping tablet: real 0.026s	user 0.009s	sys 0.015s
I20260709 12:58:25.772313  1248 raft_consensus.cc:493] T 95a5561ec0684e6e955493c7f892e02a P b82fd85b5d15463fb787fcd1e6196090 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:25.772825  1248 raft_consensus.cc:515] T 95a5561ec0684e6e955493c7f892e02a P b82fd85b5d15463fb787fcd1e6196090 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:25.775233  1243 raft_consensus.cc:359] T 95a5561ec0684e6e955493c7f892e02a P 6508e02af03a488685f95c2de71536a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:25.776129  1243 raft_consensus.cc:385] T 95a5561ec0684e6e955493c7f892e02a P 6508e02af03a488685f95c2de71536a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:25.776484  1243 raft_consensus.cc:740] T 95a5561ec0684e6e955493c7f892e02a P 6508e02af03a488685f95c2de71536a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6508e02af03a488685f95c2de71536a1, State: Initialized, Role: FOLLOWER
I20260709 12:58:25.777312  1243 consensus_queue.cc:260] T 95a5561ec0684e6e955493c7f892e02a P 6508e02af03a488685f95c2de71536a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:25.779883  1243 ts_tablet_manager.cc:1434] T 95a5561ec0684e6e955493c7f892e02a P 6508e02af03a488685f95c2de71536a1: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:58:25.781010  1248 leader_election.cc:290] T 95a5561ec0684e6e955493c7f892e02a P b82fd85b5d15463fb787fcd1e6196090 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c213ad22ae2e4088a98d1b66e94c5544 (127.0.107.194:42287), 6508e02af03a488685f95c2de71536a1 (127.0.107.195:35017)
I20260709 12:58:25.781181  1243 tablet_bootstrap.cc:492] T 7a06197c7e30456f9219b872c66b66f1 P 6508e02af03a488685f95c2de71536a1: Bootstrap starting.
I20260709 12:58:25.788980  1243 tablet_bootstrap.cc:654] T 7a06197c7e30456f9219b872c66b66f1 P 6508e02af03a488685f95c2de71536a1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:25.796799  1244 raft_consensus.cc:359] T c9d672f25bad4478a1790bede74733f1 P b82fd85b5d15463fb787fcd1e6196090 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:25.797353  1244 raft_consensus.cc:385] T c9d672f25bad4478a1790bede74733f1 P b82fd85b5d15463fb787fcd1e6196090 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:25.797658  1244 raft_consensus.cc:740] T c9d672f25bad4478a1790bede74733f1 P b82fd85b5d15463fb787fcd1e6196090 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b82fd85b5d15463fb787fcd1e6196090, State: Initialized, Role: FOLLOWER
I20260709 12:58:25.798386  1244 consensus_queue.cc:260] T c9d672f25bad4478a1790bede74733f1 P b82fd85b5d15463fb787fcd1e6196090 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:25.805459  1248 raft_consensus.cc:493] T cc64d897105f4ef08f524f3545b807e0 P b82fd85b5d15463fb787fcd1e6196090 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:25.805943  1244 ts_tablet_manager.cc:1434] T c9d672f25bad4478a1790bede74733f1 P b82fd85b5d15463fb787fcd1e6196090: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 12:58:25.806396  1245 raft_consensus.cc:493] T e8759b94cc204bc58848a9008afbeab7 P c213ad22ae2e4088a98d1b66e94c5544 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:25.806878  1245 raft_consensus.cc:515] T e8759b94cc204bc58848a9008afbeab7 P c213ad22ae2e4088a98d1b66e94c5544 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:25.807756  1241 tablet_bootstrap.cc:492] T 95a5561ec0684e6e955493c7f892e02a P c213ad22ae2e4088a98d1b66e94c5544: No bootstrap required, opened a new log
I20260709 12:58:25.808315  1241 ts_tablet_manager.cc:1403] T 95a5561ec0684e6e955493c7f892e02a P c213ad22ae2e4088a98d1b66e94c5544: Time spent bootstrapping tablet: real 0.056s	user 0.032s	sys 0.021s
I20260709 12:58:25.809085  1245 leader_election.cc:290] T e8759b94cc204bc58848a9008afbeab7 P c213ad22ae2e4088a98d1b66e94c5544 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b82fd85b5d15463fb787fcd1e6196090 (127.0.107.193:35297), 6508e02af03a488685f95c2de71536a1 (127.0.107.195:35017)
I20260709 12:58:25.811008  1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8759b94cc204bc58848a9008afbeab7" candidate_uuid: "c213ad22ae2e4088a98d1b66e94c5544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b82fd85b5d15463fb787fcd1e6196090" is_pre_election: true
I20260709 12:58:25.812891  1251 raft_consensus.cc:493] T 95a5561ec0684e6e955493c7f892e02a P 6508e02af03a488685f95c2de71536a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:25.812950  1201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8759b94cc204bc58848a9008afbeab7" candidate_uuid: "c213ad22ae2e4088a98d1b66e94c5544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6508e02af03a488685f95c2de71536a1" is_pre_election: true
I20260709 12:58:25.813529  1251 raft_consensus.cc:515] T 95a5561ec0684e6e955493c7f892e02a P 6508e02af03a488685f95c2de71536a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
W20260709 12:58:25.814671  1093 leader_election.cc:343] T e8759b94cc204bc58848a9008afbeab7 P c213ad22ae2e4088a98d1b66e94c5544 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6508e02af03a488685f95c2de71536a1 (127.0.107.195:35017): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:25.814893  1241 raft_consensus.cc:359] T 95a5561ec0684e6e955493c7f892e02a P c213ad22ae2e4088a98d1b66e94c5544 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:25.815642  1241 raft_consensus.cc:385] T 95a5561ec0684e6e955493c7f892e02a P c213ad22ae2e4088a98d1b66e94c5544 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:25.816012  1241 raft_consensus.cc:740] T 95a5561ec0684e6e955493c7f892e02a P c213ad22ae2e4088a98d1b66e94c5544 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c213ad22ae2e4088a98d1b66e94c5544, State: Initialized, Role: FOLLOWER
I20260709 12:58:25.815160  1244 tablet_bootstrap.cc:492] T 7a06197c7e30456f9219b872c66b66f1 P b82fd85b5d15463fb787fcd1e6196090: Bootstrap starting.
I20260709 12:58:25.816843  1241 consensus_queue.cc:260] T 95a5561ec0684e6e955493c7f892e02a P c213ad22ae2e4088a98d1b66e94c5544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:25.817759  1251 leader_election.cc:290] T 95a5561ec0684e6e955493c7f892e02a P 6508e02af03a488685f95c2de71536a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b82fd85b5d15463fb787fcd1e6196090 (127.0.107.193:35297), c213ad22ae2e4088a98d1b66e94c5544 (127.0.107.194:42287)
W20260709 12:58:25.818987  1090 leader_election.cc:343] T e8759b94cc204bc58848a9008afbeab7 P c213ad22ae2e4088a98d1b66e94c5544 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b82fd85b5d15463fb787fcd1e6196090 (127.0.107.193:35297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:25.819464  1090 leader_election.cc:304] T e8759b94cc204bc58848a9008afbeab7 P c213ad22ae2e4088a98d1b66e94c5544 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c213ad22ae2e4088a98d1b66e94c5544; no voters: 6508e02af03a488685f95c2de71536a1, b82fd85b5d15463fb787fcd1e6196090
I20260709 12:58:25.806011  1248 raft_consensus.cc:515] T cc64d897105f4ef08f524f3545b807e0 P b82fd85b5d15463fb787fcd1e6196090 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:25.822407  1248 leader_election.cc:290] T cc64d897105f4ef08f524f3545b807e0 P b82fd85b5d15463fb787fcd1e6196090 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c213ad22ae2e4088a98d1b66e94c5544 (127.0.107.194:42287), 6508e02af03a488685f95c2de71536a1 (127.0.107.195:35017)
I20260709 12:58:25.823055  1248 raft_consensus.cc:493] T 795b091720eb457cb7373133625dba18 P b82fd85b5d15463fb787fcd1e6196090 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:25.823523  1248 raft_consensus.cc:515] T 795b091720eb457cb7373133625dba18 P b82fd85b5d15463fb787fcd1e6196090 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:25.825481  1248 leader_election.cc:290] T 795b091720eb457cb7373133625dba18 P b82fd85b5d15463fb787fcd1e6196090 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c213ad22ae2e4088a98d1b66e94c5544 (127.0.107.194:42287), 6508e02af03a488685f95c2de71536a1 (127.0.107.195:35017)
I20260709 12:58:25.827879  1244 tablet_bootstrap.cc:654] T 7a06197c7e30456f9219b872c66b66f1 P b82fd85b5d15463fb787fcd1e6196090: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:25.833137  1248 raft_consensus.cc:493] T 197c75f75ec14fc0b3ab45ff540e308d P b82fd85b5d15463fb787fcd1e6196090 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:25.833712  1248 raft_consensus.cc:515] T 197c75f75ec14fc0b3ab45ff540e308d P b82fd85b5d15463fb787fcd1e6196090 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:25.835301  1245 raft_consensus.cc:2749] T e8759b94cc204bc58848a9008afbeab7 P c213ad22ae2e4088a98d1b66e94c5544 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:25.836056  1243 tablet_bootstrap.cc:492] T 7a06197c7e30456f9219b872c66b66f1 P 6508e02af03a488685f95c2de71536a1: No bootstrap required, opened a new log
I20260709 12:58:25.836596  1243 ts_tablet_manager.cc:1403] T 7a06197c7e30456f9219b872c66b66f1 P 6508e02af03a488685f95c2de71536a1: Time spent bootstrapping tablet: real 0.056s	user 0.019s	sys 0.031s
I20260709 12:58:25.837458  1241 ts_tablet_manager.cc:1434] T 95a5561ec0684e6e955493c7f892e02a P c213ad22ae2e4088a98d1b66e94c5544: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 12:58:25.838475  1241 tablet_bootstrap.cc:492] T c9d672f25bad4478a1790bede74733f1 P c213ad22ae2e4088a98d1b66e94c5544: Bootstrap starting.
I20260709 12:58:25.840493  1243 raft_consensus.cc:359] T 7a06197c7e30456f9219b872c66b66f1 P 6508e02af03a488685f95c2de71536a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:25.841305  1243 raft_consensus.cc:385] T 7a06197c7e30456f9219b872c66b66f1 P 6508e02af03a488685f95c2de71536a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:25.841675  1243 raft_consensus.cc:740] T 7a06197c7e30456f9219b872c66b66f1 P 6508e02af03a488685f95c2de71536a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6508e02af03a488685f95c2de71536a1, State: Initialized, Role: FOLLOWER
I20260709 12:58:25.842447  1243 consensus_queue.cc:260] T 7a06197c7e30456f9219b872c66b66f1 P 6508e02af03a488685f95c2de71536a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:25.847092  1241 tablet_bootstrap.cc:654] T c9d672f25bad4478a1790bede74733f1 P c213ad22ae2e4088a98d1b66e94c5544: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:25.845259  1243 ts_tablet_manager.cc:1434] T 7a06197c7e30456f9219b872c66b66f1 P 6508e02af03a488685f95c2de71536a1: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:58:25.848492  1243 tablet_bootstrap.cc:492] T e8759b94cc204bc58848a9008afbeab7 P 6508e02af03a488685f95c2de71536a1: Bootstrap starting.
I20260709 12:58:25.855443  1243 tablet_bootstrap.cc:654] T e8759b94cc204bc58848a9008afbeab7 P 6508e02af03a488685f95c2de71536a1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:25.858845  1241 tablet_bootstrap.cc:492] T c9d672f25bad4478a1790bede74733f1 P c213ad22ae2e4088a98d1b66e94c5544: No bootstrap required, opened a new log
I20260709 12:58:25.859419  1241 ts_tablet_manager.cc:1403] T c9d672f25bad4478a1790bede74733f1 P c213ad22ae2e4088a98d1b66e94c5544: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.006s
I20260709 12:58:25.862605  1241 raft_consensus.cc:359] T c9d672f25bad4478a1790bede74733f1 P c213ad22ae2e4088a98d1b66e94c5544 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:25.863602  1241 raft_consensus.cc:385] T c9d672f25bad4478a1790bede74733f1 P c213ad22ae2e4088a98d1b66e94c5544 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:25.863919  1241 raft_consensus.cc:740] T c9d672f25bad4478a1790bede74733f1 P c213ad22ae2e4088a98d1b66e94c5544 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c213ad22ae2e4088a98d1b66e94c5544, State: Initialized, Role: FOLLOWER
I20260709 12:58:25.864301  1248 leader_election.cc:290] T 197c75f75ec14fc0b3ab45ff540e308d P b82fd85b5d15463fb787fcd1e6196090 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c213ad22ae2e4088a98d1b66e94c5544 (127.0.107.194:42287), 6508e02af03a488685f95c2de71536a1 (127.0.107.195:35017)
I20260709 12:58:25.864882  1241 consensus_queue.cc:260] T c9d672f25bad4478a1790bede74733f1 P c213ad22ae2e4088a98d1b66e94c5544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:25.868139  1127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a5561ec0684e6e955493c7f892e02a" candidate_uuid: "b82fd85b5d15463fb787fcd1e6196090" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c213ad22ae2e4088a98d1b66e94c5544" is_pre_election: true
I20260709 12:58:25.868824  1127 raft_consensus.cc:2468] T 95a5561ec0684e6e955493c7f892e02a P c213ad22ae2e4088a98d1b66e94c5544 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b82fd85b5d15463fb787fcd1e6196090 in term 0.
I20260709 12:58:25.869683  1241 ts_tablet_manager.cc:1434] T c9d672f25bad4478a1790bede74733f1 P c213ad22ae2e4088a98d1b66e94c5544: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.004s
I20260709 12:58:25.870985  1241 tablet_bootstrap.cc:492] T 7a06197c7e30456f9219b872c66b66f1 P c213ad22ae2e4088a98d1b66e94c5544: Bootstrap starting.
I20260709 12:58:25.871742  1201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a5561ec0684e6e955493c7f892e02a" candidate_uuid: "b82fd85b5d15463fb787fcd1e6196090" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6508e02af03a488685f95c2de71536a1" is_pre_election: true
I20260709 12:58:25.872375  1201 raft_consensus.cc:2468] T 95a5561ec0684e6e955493c7f892e02a P 6508e02af03a488685f95c2de71536a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b82fd85b5d15463fb787fcd1e6196090 in term 0.
I20260709 12:58:25.874742  1201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc64d897105f4ef08f524f3545b807e0" candidate_uuid: "b82fd85b5d15463fb787fcd1e6196090" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6508e02af03a488685f95c2de71536a1" is_pre_election: true
I20260709 12:58:25.875386  1201 raft_consensus.cc:2468] T cc64d897105f4ef08f524f3545b807e0 P 6508e02af03a488685f95c2de71536a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b82fd85b5d15463fb787fcd1e6196090 in term 0.
I20260709 12:58:25.877914  1241 tablet_bootstrap.cc:654] T 7a06197c7e30456f9219b872c66b66f1 P c213ad22ae2e4088a98d1b66e94c5544: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:25.879865  1201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795b091720eb457cb7373133625dba18" candidate_uuid: "b82fd85b5d15463fb787fcd1e6196090" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6508e02af03a488685f95c2de71536a1" is_pre_election: true
I20260709 12:58:25.880620  1201 raft_consensus.cc:2468] T 795b091720eb457cb7373133625dba18 P 6508e02af03a488685f95c2de71536a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b82fd85b5d15463fb787fcd1e6196090 in term 0.
I20260709 12:58:25.880546  1127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc64d897105f4ef08f524f3545b807e0" candidate_uuid: "b82fd85b5d15463fb787fcd1e6196090" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c213ad22ae2e4088a98d1b66e94c5544" is_pre_election: true
I20260709 12:58:25.883348  1127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795b091720eb457cb7373133625dba18" candidate_uuid: "b82fd85b5d15463fb787fcd1e6196090" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c213ad22ae2e4088a98d1b66e94c5544" is_pre_election: true
I20260709 12:58:25.883694  1243 tablet_bootstrap.cc:492] T e8759b94cc204bc58848a9008afbeab7 P 6508e02af03a488685f95c2de71536a1: No bootstrap required, opened a new log
I20260709 12:58:25.884095  1127 raft_consensus.cc:2468] T 795b091720eb457cb7373133625dba18 P c213ad22ae2e4088a98d1b66e94c5544 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b82fd85b5d15463fb787fcd1e6196090 in term 0.
I20260709 12:58:25.884413  1243 ts_tablet_manager.cc:1403] T e8759b94cc204bc58848a9008afbeab7 P 6508e02af03a488685f95c2de71536a1: Time spent bootstrapping tablet: real 0.036s	user 0.017s	sys 0.015s
I20260709 12:58:25.886147  1201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "197c75f75ec14fc0b3ab45ff540e308d" candidate_uuid: "b82fd85b5d15463fb787fcd1e6196090" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6508e02af03a488685f95c2de71536a1" is_pre_election: true
I20260709 12:58:25.887032  1201 raft_consensus.cc:2393] T 197c75f75ec14fc0b3ab45ff540e308d P 6508e02af03a488685f95c2de71536a1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b82fd85b5d15463fb787fcd1e6196090 in current term 1: Already voted for candidate c213ad22ae2e4088a98d1b66e94c5544 in this term.
I20260709 12:58:25.887909  1243 raft_consensus.cc:359] T e8759b94cc204bc58848a9008afbeab7 P 6508e02af03a488685f95c2de71536a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:25.888744  1243 raft_consensus.cc:385] T e8759b94cc204bc58848a9008afbeab7 P 6508e02af03a488685f95c2de71536a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:25.888923  1127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "197c75f75ec14fc0b3ab45ff540e308d" candidate_uuid: "b82fd85b5d15463fb787fcd1e6196090" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c213ad22ae2e4088a98d1b66e94c5544" is_pre_election: true
I20260709 12:58:25.889285  1243 raft_consensus.cc:740] T e8759b94cc204bc58848a9008afbeab7 P 6508e02af03a488685f95c2de71536a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6508e02af03a488685f95c2de71536a1, State: Initialized, Role: FOLLOWER
I20260709 12:58:25.890929  1018 leader_election.cc:304] T 95a5561ec0684e6e955493c7f892e02a P b82fd85b5d15463fb787fcd1e6196090 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6508e02af03a488685f95c2de71536a1, b82fd85b5d15463fb787fcd1e6196090; no voters: 
I20260709 12:58:25.892045  1018 leader_election.cc:304] T cc64d897105f4ef08f524f3545b807e0 P b82fd85b5d15463fb787fcd1e6196090 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6508e02af03a488685f95c2de71536a1, b82fd85b5d15463fb787fcd1e6196090; no voters: 
I20260709 12:58:25.890211  1243 consensus_queue.cc:260] T e8759b94cc204bc58848a9008afbeab7 P 6508e02af03a488685f95c2de71536a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:25.892927  1267 raft_consensus.cc:2804] T 95a5561ec0684e6e955493c7f892e02a P b82fd85b5d15463fb787fcd1e6196090 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:25.893002  1018 leader_election.cc:304] T 795b091720eb457cb7373133625dba18 P b82fd85b5d15463fb787fcd1e6196090 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6508e02af03a488685f95c2de71536a1, b82fd85b5d15463fb787fcd1e6196090; no voters: 
I20260709 12:58:25.893402  1267 raft_consensus.cc:493] T 95a5561ec0684e6e955493c7f892e02a P b82fd85b5d15463fb787fcd1e6196090 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:25.893774  1267 raft_consensus.cc:3060] T 95a5561ec0684e6e955493c7f892e02a P b82fd85b5d15463fb787fcd1e6196090 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:25.894150  1248 raft_consensus.cc:2804] T cc64d897105f4ef08f524f3545b807e0 P b82fd85b5d15463fb787fcd1e6196090 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:25.894541  1248 raft_consensus.cc:493] T cc64d897105f4ef08f524f3545b807e0 P b82fd85b5d15463fb787fcd1e6196090 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:25.894903  1248 raft_consensus.cc:3060] T cc64d897105f4ef08f524f3545b807e0 P b82fd85b5d15463fb787fcd1e6196090 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:25.896878  1243 ts_tablet_manager.cc:1434] T e8759b94cc204bc58848a9008afbeab7 P 6508e02af03a488685f95c2de71536a1: Time spent starting tablet: real 0.012s	user 0.002s	sys 0.004s
I20260709 12:58:25.897967  1243 tablet_bootstrap.cc:492] T c9d672f25bad4478a1790bede74733f1 P 6508e02af03a488685f95c2de71536a1: Bootstrap starting.
I20260709 12:58:25.900467  1267 raft_consensus.cc:515] T 95a5561ec0684e6e955493c7f892e02a P b82fd85b5d15463fb787fcd1e6196090 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:25.902639  1267 leader_election.cc:290] T 95a5561ec0684e6e955493c7f892e02a P b82fd85b5d15463fb787fcd1e6196090 [CANDIDATE]: Term 1 election: Requested vote from peers c213ad22ae2e4088a98d1b66e94c5544 (127.0.107.194:42287), 6508e02af03a488685f95c2de71536a1 (127.0.107.195:35017)
I20260709 12:58:25.903189  1267 raft_consensus.cc:2804] T 795b091720eb457cb7373133625dba18 P b82fd85b5d15463fb787fcd1e6196090 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:25.903517  1267 raft_consensus.cc:493] T 795b091720eb457cb7373133625dba18 P b82fd85b5d15463fb787fcd1e6196090 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:25.903846  1267 raft_consensus.cc:3060] T 795b091720eb457cb7373133625dba18 P b82fd85b5d15463fb787fcd1e6196090 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:25.907325  1127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a5561ec0684e6e955493c7f892e02a" candidate_uuid: "b82fd85b5d15463fb787fcd1e6196090" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c213ad22ae2e4088a98d1b66e94c5544"
I20260709 12:58:25.908003  1127 raft_consensus.cc:3060] T 95a5561ec0684e6e955493c7f892e02a P c213ad22ae2e4088a98d1b66e94c5544 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:58:25.911727  1015 leader_election.cc:343] T cc64d897105f4ef08f524f3545b807e0 P b82fd85b5d15463fb787fcd1e6196090 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c213ad22ae2e4088a98d1b66e94c5544 (127.0.107.194:42287): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:25.912392  1267 raft_consensus.cc:515] T 795b091720eb457cb7373133625dba18 P b82fd85b5d15463fb787fcd1e6196090 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:25.912892  1243 tablet_bootstrap.cc:654] T c9d672f25bad4478a1790bede74733f1 P 6508e02af03a488685f95c2de71536a1: Neither blocks nor log segments found. Creating new log.
W20260709 12:58:25.914861   998 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:58:25.918193  1127 raft_consensus.cc:2468] T 95a5561ec0684e6e955493c7f892e02a P c213ad22ae2e4088a98d1b66e94c5544 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b82fd85b5d15463fb787fcd1e6196090 in term 1.
I20260709 12:58:25.921445  1267 leader_election.cc:290] T 795b091720eb457cb7373133625dba18 P b82fd85b5d15463fb787fcd1e6196090 [CANDIDATE]: Term 1 election: Requested vote from peers c213ad22ae2e4088a98d1b66e94c5544 (127.0.107.194:42287), 6508e02af03a488685f95c2de71536a1 (127.0.107.195:35017)
I20260709 12:58:25.935477  1251 raft_consensus.cc:493] T e8759b94cc204bc58848a9008afbeab7 P 6508e02af03a488685f95c2de71536a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:25.950858  1251 raft_consensus.cc:515] T e8759b94cc204bc58848a9008afbeab7 P 6508e02af03a488685f95c2de71536a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:25.953159  1251 leader_election.cc:290] T e8759b94cc204bc58848a9008afbeab7 P 6508e02af03a488685f95c2de71536a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b82fd85b5d15463fb787fcd1e6196090 (127.0.107.193:35297), c213ad22ae2e4088a98d1b66e94c5544 (127.0.107.194:42287)
I20260709 12:58:25.937914  1126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795b091720eb457cb7373133625dba18" candidate_uuid: "b82fd85b5d15463fb787fcd1e6196090" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c213ad22ae2e4088a98d1b66e94c5544"
W20260709 12:58:25.939105  1018 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:35017, user_credentials={real_user=slave}} blocked reactor thread for 46160.6us
I20260709 12:58:25.953889  1126 raft_consensus.cc:3060] T 795b091720eb457cb7373133625dba18 P c213ad22ae2e4088a98d1b66e94c5544 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:25.955554  1015 leader_election.cc:304] T 95a5561ec0684e6e955493c7f892e02a P b82fd85b5d15463fb787fcd1e6196090 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b82fd85b5d15463fb787fcd1e6196090, c213ad22ae2e4088a98d1b66e94c5544; no voters: 
I20260709 12:58:25.956470  1267 raft_consensus.cc:2804] T 95a5561ec0684e6e955493c7f892e02a P b82fd85b5d15463fb787fcd1e6196090 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:25.956962  1267 raft_consensus.cc:697] T 95a5561ec0684e6e955493c7f892e02a P b82fd85b5d15463fb787fcd1e6196090 [term 1 LEADER]: Becoming Leader. State: Replica: b82fd85b5d15463fb787fcd1e6196090, State: Running, Role: LEADER
I20260709 12:58:25.957770  1267 consensus_queue.cc:237] T 95a5561ec0684e6e955493c7f892e02a P b82fd85b5d15463fb787fcd1e6196090 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:25.961261  1126 raft_consensus.cc:2468] T 795b091720eb457cb7373133625dba18 P c213ad22ae2e4088a98d1b66e94c5544 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b82fd85b5d15463fb787fcd1e6196090 in term 1.
I20260709 12:58:25.954492  1018 leader_election.cc:304] T 197c75f75ec14fc0b3ab45ff540e308d P b82fd85b5d15463fb787fcd1e6196090 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b82fd85b5d15463fb787fcd1e6196090; no voters: 6508e02af03a488685f95c2de71536a1, c213ad22ae2e4088a98d1b66e94c5544
I20260709 12:58:25.963371  1015 leader_election.cc:304] T 795b091720eb457cb7373133625dba18 P b82fd85b5d15463fb787fcd1e6196090 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b82fd85b5d15463fb787fcd1e6196090, c213ad22ae2e4088a98d1b66e94c5544; no voters: 
I20260709 12:58:25.964336  1273 raft_consensus.cc:2804] T 795b091720eb457cb7373133625dba18 P b82fd85b5d15463fb787fcd1e6196090 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:25.971415   949 catalog_manager.cc:5697] T 95a5561ec0684e6e955493c7f892e02a P b82fd85b5d15463fb787fcd1e6196090 reported cstate change: term changed from 0 to 1, leader changed from <none> to b82fd85b5d15463fb787fcd1e6196090 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "b82fd85b5d15463fb787fcd1e6196090" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:25.978627  1201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a5561ec0684e6e955493c7f892e02a" candidate_uuid: "b82fd85b5d15463fb787fcd1e6196090" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6508e02af03a488685f95c2de71536a1"
I20260709 12:58:25.978950  1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a5561ec0684e6e955493c7f892e02a" candidate_uuid: "6508e02af03a488685f95c2de71536a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b82fd85b5d15463fb787fcd1e6196090" is_pre_election: true
I20260709 12:58:25.979137  1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8759b94cc204bc58848a9008afbeab7" candidate_uuid: "6508e02af03a488685f95c2de71536a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b82fd85b5d15463fb787fcd1e6196090" is_pre_election: true
I20260709 12:58:25.979508  1201 raft_consensus.cc:3060] T 95a5561ec0684e6e955493c7f892e02a P 6508e02af03a488685f95c2de71536a1 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:58:25.980772  1164 leader_election.cc:343] T e8759b94cc204bc58848a9008afbeab7 P 6508e02af03a488685f95c2de71536a1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b82fd85b5d15463fb787fcd1e6196090 (127.0.107.193:35297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:25.982336  1277 raft_consensus.cc:3060] T 197c75f75ec14fc0b3ab45ff540e308d P b82fd85b5d15463fb787fcd1e6196090 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:25.982867  1273 raft_consensus.cc:697] T 795b091720eb457cb7373133625dba18 P b82fd85b5d15463fb787fcd1e6196090 [term 1 LEADER]: Becoming Leader. State: Replica: b82fd85b5d15463fb787fcd1e6196090, State: Running, Role: LEADER
I20260709 12:58:25.983942  1273 consensus_queue.cc:237] T 795b091720eb457cb7373133625dba18 P b82fd85b5d15463fb787fcd1e6196090 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:25.987344  1201 raft_consensus.cc:2468] T 95a5561ec0684e6e955493c7f892e02a P 6508e02af03a488685f95c2de71536a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b82fd85b5d15463fb787fcd1e6196090 in term 1.
I20260709 12:58:25.990756  1201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795b091720eb457cb7373133625dba18" candidate_uuid: "b82fd85b5d15463fb787fcd1e6196090" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6508e02af03a488685f95c2de71536a1"
I20260709 12:58:25.991454  1201 raft_consensus.cc:3060] T 795b091720eb457cb7373133625dba18 P 6508e02af03a488685f95c2de71536a1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:25.998526  1126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a5561ec0684e6e955493c7f892e02a" candidate_uuid: "6508e02af03a488685f95c2de71536a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c213ad22ae2e4088a98d1b66e94c5544" is_pre_election: true
I20260709 12:58:25.949501  1248 raft_consensus.cc:515] T cc64d897105f4ef08f524f3545b807e0 P b82fd85b5d15463fb787fcd1e6196090 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:25.998872  1241 tablet_bootstrap.cc:492] T 7a06197c7e30456f9219b872c66b66f1 P c213ad22ae2e4088a98d1b66e94c5544: No bootstrap required, opened a new log
I20260709 12:58:26.004499  1241 ts_tablet_manager.cc:1403] T 7a06197c7e30456f9219b872c66b66f1 P c213ad22ae2e4088a98d1b66e94c5544: Time spent bootstrapping tablet: real 0.134s	user 0.025s	sys 0.056s
I20260709 12:58:26.004168  1248 leader_election.cc:290] T cc64d897105f4ef08f524f3545b807e0 P b82fd85b5d15463fb787fcd1e6196090 [CANDIDATE]: Term 1 election: Requested vote from peers c213ad22ae2e4088a98d1b66e94c5544 (127.0.107.194:42287), 6508e02af03a488685f95c2de71536a1 (127.0.107.195:35017)
I20260709 12:58:26.005789  1126 raft_consensus.cc:2393] T 95a5561ec0684e6e955493c7f892e02a P c213ad22ae2e4088a98d1b66e94c5544 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6508e02af03a488685f95c2de71536a1 in current term 1: Already voted for candidate b82fd85b5d15463fb787fcd1e6196090 in this term.
I20260709 12:58:26.005949  1277 raft_consensus.cc:2749] T 197c75f75ec14fc0b3ab45ff540e308d P b82fd85b5d15463fb787fcd1e6196090 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:26.005056  1125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc64d897105f4ef08f524f3545b807e0" candidate_uuid: "b82fd85b5d15463fb787fcd1e6196090" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c213ad22ae2e4088a98d1b66e94c5544"
W20260709 12:58:26.007825  1015 leader_election.cc:343] T cc64d897105f4ef08f524f3545b807e0 P b82fd85b5d15463fb787fcd1e6196090 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c213ad22ae2e4088a98d1b66e94c5544 (127.0.107.194:42287): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:26.009482  1164 leader_election.cc:304] T 95a5561ec0684e6e955493c7f892e02a P 6508e02af03a488685f95c2de71536a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6508e02af03a488685f95c2de71536a1; no voters: b82fd85b5d15463fb787fcd1e6196090, c213ad22ae2e4088a98d1b66e94c5544
I20260709 12:58:26.010084  1200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc64d897105f4ef08f524f3545b807e0" candidate_uuid: "b82fd85b5d15463fb787fcd1e6196090" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6508e02af03a488685f95c2de71536a1"
I20260709 12:58:26.000640  1127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8759b94cc204bc58848a9008afbeab7" candidate_uuid: "6508e02af03a488685f95c2de71536a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c213ad22ae2e4088a98d1b66e94c5544" is_pre_election: true
I20260709 12:58:26.010707  1251 raft_consensus.cc:2749] T 95a5561ec0684e6e955493c7f892e02a P 6508e02af03a488685f95c2de71536a1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:26.010931  1127 raft_consensus.cc:2468] T e8759b94cc204bc58848a9008afbeab7 P c213ad22ae2e4088a98d1b66e94c5544 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6508e02af03a488685f95c2de71536a1 in term 0.
I20260709 12:58:26.010721  1200 raft_consensus.cc:3060] T cc64d897105f4ef08f524f3545b807e0 P 6508e02af03a488685f95c2de71536a1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:26.011396  1241 raft_consensus.cc:359] T 7a06197c7e30456f9219b872c66b66f1 P c213ad22ae2e4088a98d1b66e94c5544 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:26.012248  1241 raft_consensus.cc:385] T 7a06197c7e30456f9219b872c66b66f1 P c213ad22ae2e4088a98d1b66e94c5544 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:26.012547  1241 raft_consensus.cc:740] T 7a06197c7e30456f9219b872c66b66f1 P c213ad22ae2e4088a98d1b66e94c5544 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c213ad22ae2e4088a98d1b66e94c5544, State: Initialized, Role: FOLLOWER
I20260709 12:58:26.013494  1241 consensus_queue.cc:260] T 7a06197c7e30456f9219b872c66b66f1 P c213ad22ae2e4088a98d1b66e94c5544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:26.014293  1244 tablet_bootstrap.cc:492] T 7a06197c7e30456f9219b872c66b66f1 P b82fd85b5d15463fb787fcd1e6196090: No bootstrap required, opened a new log
I20260709 12:58:26.014801  1244 ts_tablet_manager.cc:1403] T 7a06197c7e30456f9219b872c66b66f1 P b82fd85b5d15463fb787fcd1e6196090: Time spent bootstrapping tablet: real 0.200s	user 0.092s	sys 0.075s
I20260709 12:58:26.016057  1241 ts_tablet_manager.cc:1434] T 7a06197c7e30456f9219b872c66b66f1 P c213ad22ae2e4088a98d1b66e94c5544: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.003s
I20260709 12:58:26.017032  1241 tablet_bootstrap.cc:492] T bb7e493140574c5dbfd328c93b4bfc3b P c213ad22ae2e4088a98d1b66e94c5544: Bootstrap starting.
I20260709 12:58:26.018088  1164 leader_election.cc:304] T e8759b94cc204bc58848a9008afbeab7 P 6508e02af03a488685f95c2de71536a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6508e02af03a488685f95c2de71536a1, c213ad22ae2e4088a98d1b66e94c5544; no voters: b82fd85b5d15463fb787fcd1e6196090
I20260709 12:58:26.019371  1251 raft_consensus.cc:2804] T e8759b94cc204bc58848a9008afbeab7 P 6508e02af03a488685f95c2de71536a1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:26.019781  1251 raft_consensus.cc:493] T e8759b94cc204bc58848a9008afbeab7 P 6508e02af03a488685f95c2de71536a1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:26.020223  1251 raft_consensus.cc:3060] T e8759b94cc204bc58848a9008afbeab7 P 6508e02af03a488685f95c2de71536a1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:26.019909  1244 raft_consensus.cc:359] T 7a06197c7e30456f9219b872c66b66f1 P b82fd85b5d15463fb787fcd1e6196090 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:26.020709  1244 raft_consensus.cc:385] T 7a06197c7e30456f9219b872c66b66f1 P b82fd85b5d15463fb787fcd1e6196090 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:26.020998  1244 raft_consensus.cc:740] T 7a06197c7e30456f9219b872c66b66f1 P b82fd85b5d15463fb787fcd1e6196090 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b82fd85b5d15463fb787fcd1e6196090, State: Initialized, Role: FOLLOWER
I20260709 12:58:26.020352   950 catalog_manager.cc:5697] T 795b091720eb457cb7373133625dba18 P b82fd85b5d15463fb787fcd1e6196090 reported cstate change: term changed from 0 to 1, leader changed from <none> to b82fd85b5d15463fb787fcd1e6196090 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "b82fd85b5d15463fb787fcd1e6196090" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:26.021809  1244 consensus_queue.cc:260] T 7a06197c7e30456f9219b872c66b66f1 P b82fd85b5d15463fb787fcd1e6196090 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:26.023399  1241 tablet_bootstrap.cc:654] T bb7e493140574c5dbfd328c93b4bfc3b P c213ad22ae2e4088a98d1b66e94c5544: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:26.023984  1244 ts_tablet_manager.cc:1434] T 7a06197c7e30456f9219b872c66b66f1 P b82fd85b5d15463fb787fcd1e6196090: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:58:26.024971  1244 tablet_bootstrap.cc:492] T bef759002c944c3095e9777eba3c28c1 P b82fd85b5d15463fb787fcd1e6196090: Bootstrap starting.
I20260709 12:58:26.032526  1243 tablet_bootstrap.cc:492] T c9d672f25bad4478a1790bede74733f1 P 6508e02af03a488685f95c2de71536a1: No bootstrap required, opened a new log
I20260709 12:58:26.035051  1243 ts_tablet_manager.cc:1403] T c9d672f25bad4478a1790bede74733f1 P 6508e02af03a488685f95c2de71536a1: Time spent bootstrapping tablet: real 0.137s	user 0.030s	sys 0.036s
I20260709 12:58:26.033563  1244 tablet_bootstrap.cc:654] T bef759002c944c3095e9777eba3c28c1 P b82fd85b5d15463fb787fcd1e6196090: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:26.036906  1201 raft_consensus.cc:2468] T 795b091720eb457cb7373133625dba18 P 6508e02af03a488685f95c2de71536a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b82fd85b5d15463fb787fcd1e6196090 in term 1.
I20260709 12:58:26.041097  1243 raft_consensus.cc:359] T c9d672f25bad4478a1790bede74733f1 P 6508e02af03a488685f95c2de71536a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:26.041865  1243 raft_consensus.cc:385] T c9d672f25bad4478a1790bede74733f1 P 6508e02af03a488685f95c2de71536a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:26.042142  1243 raft_consensus.cc:740] T c9d672f25bad4478a1790bede74733f1 P 6508e02af03a488685f95c2de71536a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6508e02af03a488685f95c2de71536a1, State: Initialized, Role: FOLLOWER
I20260709 12:58:26.042253  1244 tablet_bootstrap.cc:492] T bef759002c944c3095e9777eba3c28c1 P b82fd85b5d15463fb787fcd1e6196090: No bootstrap required, opened a new log
I20260709 12:58:26.042797  1244 ts_tablet_manager.cc:1403] T bef759002c944c3095e9777eba3c28c1 P b82fd85b5d15463fb787fcd1e6196090: Time spent bootstrapping tablet: real 0.018s	user 0.008s	sys 0.004s
I20260709 12:58:26.045233  1244 raft_consensus.cc:359] T bef759002c944c3095e9777eba3c28c1 P b82fd85b5d15463fb787fcd1e6196090 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:26.045744  1244 raft_consensus.cc:385] T bef759002c944c3095e9777eba3c28c1 P b82fd85b5d15463fb787fcd1e6196090 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:26.045975  1244 raft_consensus.cc:740] T bef759002c944c3095e9777eba3c28c1 P b82fd85b5d15463fb787fcd1e6196090 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b82fd85b5d15463fb787fcd1e6196090, State: Initialized, Role: FOLLOWER
I20260709 12:58:26.046584  1244 consensus_queue.cc:260] T bef759002c944c3095e9777eba3c28c1 P b82fd85b5d15463fb787fcd1e6196090 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:26.048800  1244 ts_tablet_manager.cc:1434] T bef759002c944c3095e9777eba3c28c1 P b82fd85b5d15463fb787fcd1e6196090: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:58:26.049826  1244 tablet_bootstrap.cc:492] T 3937dd9840304b0f8752a493ae246949 P b82fd85b5d15463fb787fcd1e6196090: Bootstrap starting.
I20260709 12:58:26.037964  1200 raft_consensus.cc:2468] T cc64d897105f4ef08f524f3545b807e0 P 6508e02af03a488685f95c2de71536a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b82fd85b5d15463fb787fcd1e6196090 in term 1.
I20260709 12:58:26.036485  1251 raft_consensus.cc:515] T e8759b94cc204bc58848a9008afbeab7 P 6508e02af03a488685f95c2de71536a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:26.051285  1018 leader_election.cc:304] T cc64d897105f4ef08f524f3545b807e0 P b82fd85b5d15463fb787fcd1e6196090 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6508e02af03a488685f95c2de71536a1, b82fd85b5d15463fb787fcd1e6196090; no voters: c213ad22ae2e4088a98d1b66e94c5544
I20260709 12:58:26.052438  1248 raft_consensus.cc:2804] T cc64d897105f4ef08f524f3545b807e0 P b82fd85b5d15463fb787fcd1e6196090 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:26.052709  1251 leader_election.cc:290] T e8759b94cc204bc58848a9008afbeab7 P 6508e02af03a488685f95c2de71536a1 [CANDIDATE]: Term 1 election: Requested vote from peers b82fd85b5d15463fb787fcd1e6196090 (127.0.107.193:35297), c213ad22ae2e4088a98d1b66e94c5544 (127.0.107.194:42287)
I20260709 12:58:26.052901  1248 raft_consensus.cc:697] T cc64d897105f4ef08f524f3545b807e0 P b82fd85b5d15463fb787fcd1e6196090 [term 1 LEADER]: Becoming Leader. State: Replica: b82fd85b5d15463fb787fcd1e6196090, State: Running, Role: LEADER
I20260709 12:58:26.053280  1251 raft_consensus.cc:493] T 3937dd9840304b0f8752a493ae246949 P 6508e02af03a488685f95c2de71536a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:26.053773  1248 consensus_queue.cc:237] T cc64d897105f4ef08f524f3545b807e0 P b82fd85b5d15463fb787fcd1e6196090 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:26.057348  1244 tablet_bootstrap.cc:654] T 3937dd9840304b0f8752a493ae246949 P b82fd85b5d15463fb787fcd1e6196090: Neither blocks nor log segments found. Creating new log.
W20260709 12:58:26.062553  1164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:42287, user_credentials={real_user=slave}} blocked reactor thread for 44559.8us
I20260709 12:58:26.064394  1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8759b94cc204bc58848a9008afbeab7" candidate_uuid: "6508e02af03a488685f95c2de71536a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b82fd85b5d15463fb787fcd1e6196090"
I20260709 12:58:26.053755  1251 raft_consensus.cc:515] T 3937dd9840304b0f8752a493ae246949 P 6508e02af03a488685f95c2de71536a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } }
I20260709 12:58:26.067957  1244 tablet_bootstrap.cc:492] T 3937dd9840304b0f8752a493ae246949 P b82fd85b5d15463fb787fcd1e6196090: No bootstrap required, opened a new log
I20260709 12:58:26.068075  1251 leader_election.cc:290] T 3937dd9840304b0f8752a493ae246949 P 6508e02af03a488685f95c2de71536a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c213ad22ae2e4088a98d1b66e94c5544 (127.0.107.194:42287), b82fd85b5d15463fb787fcd1e6196090 (127.0.107.193:35297)
I20260709 12:58:26.068504  1244 ts_tablet_manager.cc:1403] T 3937dd9840304b0f8752a493ae246949 P b82fd85b5d15463fb787fcd1e6196090: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.000s
I20260709 12:58:26.071090  1244 raft_consensus.cc:359] T 3937dd9840304b0f8752a493ae246949 P b82fd85b5d15463fb787fcd1e6196090 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } }
I20260709 12:58:26.071326  1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3937dd9840304b0f8752a493ae246949" candidate_uuid: "6508e02af03a488685f95c2de71536a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b82fd85b5d15463fb787fcd1e6196090" is_pre_election: true
I20260709 12:58:26.071494  1126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3937dd9840304b0f8752a493ae246949" candidate_uuid: "6508e02af03a488685f95c2de71536a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c213ad22ae2e4088a98d1b66e94c5544" is_pre_election: true
I20260709 12:58:26.071764  1244 raft_consensus.cc:385] T 3937dd9840304b0f8752a493ae246949 P b82fd85b5d15463fb787fcd1e6196090 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:26.072050  1244 raft_consensus.cc:740] T 3937dd9840304b0f8752a493ae246949 P b82fd85b5d15463fb787fcd1e6196090 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b82fd85b5d15463fb787fcd1e6196090, State: Initialized, Role: FOLLOWER
W20260709 12:58:26.072364  1164 leader_election.cc:343] T e8759b94cc204bc58848a9008afbeab7 P 6508e02af03a488685f95c2de71536a1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b82fd85b5d15463fb787fcd1e6196090 (127.0.107.193:35297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:26.070176   950 catalog_manager.cc:5697] T cc64d897105f4ef08f524f3545b807e0 P b82fd85b5d15463fb787fcd1e6196090 reported cstate change: term changed from 0 to 1, leader changed from <none> to b82fd85b5d15463fb787fcd1e6196090 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "b82fd85b5d15463fb787fcd1e6196090" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:26.072762  1244 consensus_queue.cc:260] T 3937dd9840304b0f8752a493ae246949 P b82fd85b5d15463fb787fcd1e6196090 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } }
W20260709 12:58:26.073128  1164 leader_election.cc:343] T 3937dd9840304b0f8752a493ae246949 P 6508e02af03a488685f95c2de71536a1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c213ad22ae2e4088a98d1b66e94c5544 (127.0.107.194:42287): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:26.073642  1052 raft_consensus.cc:2468] T 3937dd9840304b0f8752a493ae246949 P b82fd85b5d15463fb787fcd1e6196090 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6508e02af03a488685f95c2de71536a1 in term 0.
I20260709 12:58:26.071004  1127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8759b94cc204bc58848a9008afbeab7" candidate_uuid: "6508e02af03a488685f95c2de71536a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c213ad22ae2e4088a98d1b66e94c5544"
I20260709 12:58:26.075765  1127 raft_consensus.cc:3060] T e8759b94cc204bc58848a9008afbeab7 P c213ad22ae2e4088a98d1b66e94c5544 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:26.075570  1243 consensus_queue.cc:260] T c9d672f25bad4478a1790bede74733f1 P 6508e02af03a488685f95c2de71536a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:26.077445  1164 leader_election.cc:304] T 3937dd9840304b0f8752a493ae246949 P 6508e02af03a488685f95c2de71536a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6508e02af03a488685f95c2de71536a1, b82fd85b5d15463fb787fcd1e6196090; no voters: c213ad22ae2e4088a98d1b66e94c5544
I20260709 12:58:26.077975  1244 ts_tablet_manager.cc:1434] T 3937dd9840304b0f8752a493ae246949 P b82fd85b5d15463fb787fcd1e6196090: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:58:26.078904  1244 tablet_bootstrap.cc:492] T bb7e493140574c5dbfd328c93b4bfc3b P b82fd85b5d15463fb787fcd1e6196090: Bootstrap starting.
I20260709 12:58:26.079080  1279 raft_consensus.cc:2804] T 3937dd9840304b0f8752a493ae246949 P 6508e02af03a488685f95c2de71536a1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:26.079480  1279 raft_consensus.cc:493] T 3937dd9840304b0f8752a493ae246949 P 6508e02af03a488685f95c2de71536a1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:26.079802  1279 raft_consensus.cc:3060] T 3937dd9840304b0f8752a493ae246949 P 6508e02af03a488685f95c2de71536a1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:26.087707  1243 ts_tablet_manager.cc:1434] T c9d672f25bad4478a1790bede74733f1 P 6508e02af03a488685f95c2de71536a1: Time spent starting tablet: real 0.049s	user 0.006s	sys 0.000s
I20260709 12:58:26.089357  1244 tablet_bootstrap.cc:654] T bb7e493140574c5dbfd328c93b4bfc3b P b82fd85b5d15463fb787fcd1e6196090: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:26.092022  1243 tablet_bootstrap.cc:492] T bef759002c944c3095e9777eba3c28c1 P 6508e02af03a488685f95c2de71536a1: Bootstrap starting.
I20260709 12:58:26.098209  1243 tablet_bootstrap.cc:654] T bef759002c944c3095e9777eba3c28c1 P 6508e02af03a488685f95c2de71536a1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:26.099881  1279 raft_consensus.cc:515] T 3937dd9840304b0f8752a493ae246949 P 6508e02af03a488685f95c2de71536a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } }
I20260709 12:58:26.101323  1241 tablet_bootstrap.cc:492] T bb7e493140574c5dbfd328c93b4bfc3b P c213ad22ae2e4088a98d1b66e94c5544: No bootstrap required, opened a new log
I20260709 12:58:26.101840  1241 ts_tablet_manager.cc:1403] T bb7e493140574c5dbfd328c93b4bfc3b P c213ad22ae2e4088a98d1b66e94c5544: Time spent bootstrapping tablet: real 0.085s	user 0.036s	sys 0.034s
I20260709 12:58:26.101867  1127 raft_consensus.cc:2468] T e8759b94cc204bc58848a9008afbeab7 P c213ad22ae2e4088a98d1b66e94c5544 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6508e02af03a488685f95c2de71536a1 in term 1.
I20260709 12:58:26.103024  1126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3937dd9840304b0f8752a493ae246949" candidate_uuid: "6508e02af03a488685f95c2de71536a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c213ad22ae2e4088a98d1b66e94c5544"
I20260709 12:58:26.103873  1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3937dd9840304b0f8752a493ae246949" candidate_uuid: "6508e02af03a488685f95c2de71536a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b82fd85b5d15463fb787fcd1e6196090"
W20260709 12:58:26.104204  1164 leader_election.cc:343] T 3937dd9840304b0f8752a493ae246949 P 6508e02af03a488685f95c2de71536a1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c213ad22ae2e4088a98d1b66e94c5544 (127.0.107.194:42287): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:26.104547  1052 raft_consensus.cc:3060] T 3937dd9840304b0f8752a493ae246949 P b82fd85b5d15463fb787fcd1e6196090 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:26.105072  1164 leader_election.cc:304] T e8759b94cc204bc58848a9008afbeab7 P 6508e02af03a488685f95c2de71536a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6508e02af03a488685f95c2de71536a1, c213ad22ae2e4088a98d1b66e94c5544; no voters: b82fd85b5d15463fb787fcd1e6196090
I20260709 12:58:26.104931  1241 raft_consensus.cc:359] T bb7e493140574c5dbfd328c93b4bfc3b P c213ad22ae2e4088a98d1b66e94c5544 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:26.105638  1241 raft_consensus.cc:385] T bb7e493140574c5dbfd328c93b4bfc3b P c213ad22ae2e4088a98d1b66e94c5544 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:26.103267  1279 leader_election.cc:290] T 3937dd9840304b0f8752a493ae246949 P 6508e02af03a488685f95c2de71536a1 [CANDIDATE]: Term 1 election: Requested vote from peers c213ad22ae2e4088a98d1b66e94c5544 (127.0.107.194:42287), b82fd85b5d15463fb787fcd1e6196090 (127.0.107.193:35297)
I20260709 12:58:26.105886  1251 raft_consensus.cc:2804] T e8759b94cc204bc58848a9008afbeab7 P 6508e02af03a488685f95c2de71536a1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:26.105921  1241 raft_consensus.cc:740] T bb7e493140574c5dbfd328c93b4bfc3b P c213ad22ae2e4088a98d1b66e94c5544 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c213ad22ae2e4088a98d1b66e94c5544, State: Initialized, Role: FOLLOWER
I20260709 12:58:26.107386  1241 consensus_queue.cc:260] T bb7e493140574c5dbfd328c93b4bfc3b P c213ad22ae2e4088a98d1b66e94c5544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:26.109548  1241 ts_tablet_manager.cc:1434] T bb7e493140574c5dbfd328c93b4bfc3b P c213ad22ae2e4088a98d1b66e94c5544: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:58:26.110491  1241 tablet_bootstrap.cc:492] T bef759002c944c3095e9777eba3c28c1 P c213ad22ae2e4088a98d1b66e94c5544: Bootstrap starting.
I20260709 12:58:26.111939  1052 raft_consensus.cc:2468] T 3937dd9840304b0f8752a493ae246949 P b82fd85b5d15463fb787fcd1e6196090 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6508e02af03a488685f95c2de71536a1 in term 1.
I20260709 12:58:26.113448  1164 leader_election.cc:304] T 3937dd9840304b0f8752a493ae246949 P 6508e02af03a488685f95c2de71536a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6508e02af03a488685f95c2de71536a1, b82fd85b5d15463fb787fcd1e6196090; no voters: c213ad22ae2e4088a98d1b66e94c5544
I20260709 12:58:26.115223  1244 tablet_bootstrap.cc:492] T bb7e493140574c5dbfd328c93b4bfc3b P b82fd85b5d15463fb787fcd1e6196090: No bootstrap required, opened a new log
I20260709 12:58:26.115834  1244 ts_tablet_manager.cc:1403] T bb7e493140574c5dbfd328c93b4bfc3b P b82fd85b5d15463fb787fcd1e6196090: Time spent bootstrapping tablet: real 0.037s	user 0.018s	sys 0.000s
I20260709 12:58:26.118906  1244 raft_consensus.cc:359] T bb7e493140574c5dbfd328c93b4bfc3b P b82fd85b5d15463fb787fcd1e6196090 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:26.119716  1244 raft_consensus.cc:385] T bb7e493140574c5dbfd328c93b4bfc3b P b82fd85b5d15463fb787fcd1e6196090 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:26.120127  1244 raft_consensus.cc:740] T bb7e493140574c5dbfd328c93b4bfc3b P b82fd85b5d15463fb787fcd1e6196090 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b82fd85b5d15463fb787fcd1e6196090, State: Initialized, Role: FOLLOWER
I20260709 12:58:26.121464  1241 tablet_bootstrap.cc:654] T bef759002c944c3095e9777eba3c28c1 P c213ad22ae2e4088a98d1b66e94c5544: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:26.121070  1244 consensus_queue.cc:260] T bb7e493140574c5dbfd328c93b4bfc3b P b82fd85b5d15463fb787fcd1e6196090 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:26.123510  1244 ts_tablet_manager.cc:1434] T bb7e493140574c5dbfd328c93b4bfc3b P b82fd85b5d15463fb787fcd1e6196090: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:58:26.124773  1244 tablet_bootstrap.cc:492] T e8759b94cc204bc58848a9008afbeab7 P b82fd85b5d15463fb787fcd1e6196090: Bootstrap starting.
I20260709 12:58:26.128526  1279 raft_consensus.cc:2804] T 3937dd9840304b0f8752a493ae246949 P 6508e02af03a488685f95c2de71536a1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:26.129030  1279 raft_consensus.cc:697] T 3937dd9840304b0f8752a493ae246949 P 6508e02af03a488685f95c2de71536a1 [term 1 LEADER]: Becoming Leader. State: Replica: 6508e02af03a488685f95c2de71536a1, State: Running, Role: LEADER
I20260709 12:58:26.129864  1279 consensus_queue.cc:237] T 3937dd9840304b0f8752a493ae246949 P 6508e02af03a488685f95c2de71536a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } }
I20260709 12:58:26.130797  1244 tablet_bootstrap.cc:654] T e8759b94cc204bc58848a9008afbeab7 P b82fd85b5d15463fb787fcd1e6196090: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:26.133332  1241 tablet_bootstrap.cc:492] T bef759002c944c3095e9777eba3c28c1 P c213ad22ae2e4088a98d1b66e94c5544: No bootstrap required, opened a new log
I20260709 12:58:26.133831  1241 ts_tablet_manager.cc:1403] T bef759002c944c3095e9777eba3c28c1 P c213ad22ae2e4088a98d1b66e94c5544: Time spent bootstrapping tablet: real 0.024s	user 0.008s	sys 0.004s
I20260709 12:58:26.136472  1241 raft_consensus.cc:359] T bef759002c944c3095e9777eba3c28c1 P c213ad22ae2e4088a98d1b66e94c5544 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:26.137202  1241 raft_consensus.cc:385] T bef759002c944c3095e9777eba3c28c1 P c213ad22ae2e4088a98d1b66e94c5544 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:26.137511  1251 raft_consensus.cc:697] T e8759b94cc204bc58848a9008afbeab7 P 6508e02af03a488685f95c2de71536a1 [term 1 LEADER]: Becoming Leader. State: Replica: 6508e02af03a488685f95c2de71536a1, State: Running, Role: LEADER
I20260709 12:58:26.138543  1251 consensus_queue.cc:237] T e8759b94cc204bc58848a9008afbeab7 P 6508e02af03a488685f95c2de71536a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:26.139653  1243 tablet_bootstrap.cc:492] T bef759002c944c3095e9777eba3c28c1 P 6508e02af03a488685f95c2de71536a1: No bootstrap required, opened a new log
I20260709 12:58:26.140154  1243 ts_tablet_manager.cc:1403] T bef759002c944c3095e9777eba3c28c1 P 6508e02af03a488685f95c2de71536a1: Time spent bootstrapping tablet: real 0.048s	user 0.011s	sys 0.000s
I20260709 12:58:26.137468  1241 raft_consensus.cc:740] T bef759002c944c3095e9777eba3c28c1 P c213ad22ae2e4088a98d1b66e94c5544 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c213ad22ae2e4088a98d1b66e94c5544, State: Initialized, Role: FOLLOWER
I20260709 12:58:26.142983  1243 raft_consensus.cc:359] T bef759002c944c3095e9777eba3c28c1 P 6508e02af03a488685f95c2de71536a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:26.143824  1243 raft_consensus.cc:385] T bef759002c944c3095e9777eba3c28c1 P 6508e02af03a488685f95c2de71536a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:26.144279  1243 raft_consensus.cc:740] T bef759002c944c3095e9777eba3c28c1 P 6508e02af03a488685f95c2de71536a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6508e02af03a488685f95c2de71536a1, State: Initialized, Role: FOLLOWER
I20260709 12:58:26.143930  1241 consensus_queue.cc:260] T bef759002c944c3095e9777eba3c28c1 P c213ad22ae2e4088a98d1b66e94c5544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:26.145610  1243 consensus_queue.cc:260] T bef759002c944c3095e9777eba3c28c1 P 6508e02af03a488685f95c2de71536a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:26.146615  1241 ts_tablet_manager.cc:1434] T bef759002c944c3095e9777eba3c28c1 P c213ad22ae2e4088a98d1b66e94c5544: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:58:26.147585  1244 tablet_bootstrap.cc:492] T e8759b94cc204bc58848a9008afbeab7 P b82fd85b5d15463fb787fcd1e6196090: No bootstrap required, opened a new log
I20260709 12:58:26.148309  1244 ts_tablet_manager.cc:1403] T e8759b94cc204bc58848a9008afbeab7 P b82fd85b5d15463fb787fcd1e6196090: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.005s
I20260709 12:58:26.148639  1241 tablet_bootstrap.cc:492] T cc64d897105f4ef08f524f3545b807e0 P c213ad22ae2e4088a98d1b66e94c5544: Bootstrap starting.
I20260709 12:58:26.149468   947 catalog_manager.cc:5697] T e8759b94cc204bc58848a9008afbeab7 P 6508e02af03a488685f95c2de71536a1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6508e02af03a488685f95c2de71536a1 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "6508e02af03a488685f95c2de71536a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:26.151132  1244 raft_consensus.cc:359] T e8759b94cc204bc58848a9008afbeab7 P b82fd85b5d15463fb787fcd1e6196090 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:26.151870  1244 raft_consensus.cc:385] T e8759b94cc204bc58848a9008afbeab7 P b82fd85b5d15463fb787fcd1e6196090 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:26.153842  1244 raft_consensus.cc:740] T e8759b94cc204bc58848a9008afbeab7 P b82fd85b5d15463fb787fcd1e6196090 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b82fd85b5d15463fb787fcd1e6196090, State: Initialized, Role: FOLLOWER
I20260709 12:58:26.153573  1243 ts_tablet_manager.cc:1434] T bef759002c944c3095e9777eba3c28c1 P 6508e02af03a488685f95c2de71536a1: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:58:26.154708  1241 tablet_bootstrap.cc:654] T cc64d897105f4ef08f524f3545b807e0 P c213ad22ae2e4088a98d1b66e94c5544: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:26.154722  1244 consensus_queue.cc:260] T e8759b94cc204bc58848a9008afbeab7 P b82fd85b5d15463fb787fcd1e6196090 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:26.158066  1244 ts_tablet_manager.cc:1434] T e8759b94cc204bc58848a9008afbeab7 P b82fd85b5d15463fb787fcd1e6196090: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:58:26.156250  1243 tablet_bootstrap.cc:492] T bb7e493140574c5dbfd328c93b4bfc3b P 6508e02af03a488685f95c2de71536a1: Bootstrap starting.
I20260709 12:58:26.164450  1243 tablet_bootstrap.cc:654] T bb7e493140574c5dbfd328c93b4bfc3b P 6508e02af03a488685f95c2de71536a1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:26.169786  1241 tablet_bootstrap.cc:492] T cc64d897105f4ef08f524f3545b807e0 P c213ad22ae2e4088a98d1b66e94c5544: No bootstrap required, opened a new log
I20260709 12:58:26.170166  1241 ts_tablet_manager.cc:1403] T cc64d897105f4ef08f524f3545b807e0 P c213ad22ae2e4088a98d1b66e94c5544: Time spent bootstrapping tablet: real 0.022s	user 0.008s	sys 0.012s
I20260709 12:58:26.172533  1241 raft_consensus.cc:359] T cc64d897105f4ef08f524f3545b807e0 P c213ad22ae2e4088a98d1b66e94c5544 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:26.172317   950 catalog_manager.cc:5697] T 3937dd9840304b0f8752a493ae246949 P 6508e02af03a488685f95c2de71536a1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6508e02af03a488685f95c2de71536a1 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "6508e02af03a488685f95c2de71536a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:26.173224  1241 raft_consensus.cc:385] T cc64d897105f4ef08f524f3545b807e0 P c213ad22ae2e4088a98d1b66e94c5544 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:26.173513  1241 raft_consensus.cc:740] T cc64d897105f4ef08f524f3545b807e0 P c213ad22ae2e4088a98d1b66e94c5544 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c213ad22ae2e4088a98d1b66e94c5544, State: Initialized, Role: FOLLOWER
I20260709 12:58:26.174157  1241 consensus_queue.cc:260] T cc64d897105f4ef08f524f3545b807e0 P c213ad22ae2e4088a98d1b66e94c5544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:26.175808  1241 ts_tablet_manager.cc:1434] T cc64d897105f4ef08f524f3545b807e0 P c213ad22ae2e4088a98d1b66e94c5544: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:58:26.176646  1241 tablet_bootstrap.cc:492] T 3937dd9840304b0f8752a493ae246949 P c213ad22ae2e4088a98d1b66e94c5544: Bootstrap starting.
I20260709 12:58:26.182060  1241 tablet_bootstrap.cc:654] T 3937dd9840304b0f8752a493ae246949 P c213ad22ae2e4088a98d1b66e94c5544: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:26.183954  1243 tablet_bootstrap.cc:492] T bb7e493140574c5dbfd328c93b4bfc3b P 6508e02af03a488685f95c2de71536a1: No bootstrap required, opened a new log
I20260709 12:58:26.184458  1243 ts_tablet_manager.cc:1403] T bb7e493140574c5dbfd328c93b4bfc3b P 6508e02af03a488685f95c2de71536a1: Time spent bootstrapping tablet: real 0.028s	user 0.019s	sys 0.005s
I20260709 12:58:26.186961  1243 raft_consensus.cc:359] T bb7e493140574c5dbfd328c93b4bfc3b P 6508e02af03a488685f95c2de71536a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:26.187649  1243 raft_consensus.cc:385] T bb7e493140574c5dbfd328c93b4bfc3b P 6508e02af03a488685f95c2de71536a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:26.187913  1243 raft_consensus.cc:740] T bb7e493140574c5dbfd328c93b4bfc3b P 6508e02af03a488685f95c2de71536a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6508e02af03a488685f95c2de71536a1, State: Initialized, Role: FOLLOWER
I20260709 12:58:26.188896  1243 consensus_queue.cc:260] T bb7e493140574c5dbfd328c93b4bfc3b P 6508e02af03a488685f95c2de71536a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:26.190805  1243 ts_tablet_manager.cc:1434] T bb7e493140574c5dbfd328c93b4bfc3b P 6508e02af03a488685f95c2de71536a1: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:58:26.191771  1241 tablet_bootstrap.cc:492] T 3937dd9840304b0f8752a493ae246949 P c213ad22ae2e4088a98d1b66e94c5544: No bootstrap required, opened a new log
I20260709 12:58:26.192211  1241 ts_tablet_manager.cc:1403] T 3937dd9840304b0f8752a493ae246949 P c213ad22ae2e4088a98d1b66e94c5544: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.005s
I20260709 12:58:26.194605  1241 raft_consensus.cc:359] T 3937dd9840304b0f8752a493ae246949 P c213ad22ae2e4088a98d1b66e94c5544 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } }
I20260709 12:58:26.195155  1241 raft_consensus.cc:385] T 3937dd9840304b0f8752a493ae246949 P c213ad22ae2e4088a98d1b66e94c5544 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:26.195360  1241 raft_consensus.cc:740] T 3937dd9840304b0f8752a493ae246949 P c213ad22ae2e4088a98d1b66e94c5544 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c213ad22ae2e4088a98d1b66e94c5544, State: Initialized, Role: FOLLOWER
I20260709 12:58:26.195859  1241 consensus_queue.cc:260] T 3937dd9840304b0f8752a493ae246949 P c213ad22ae2e4088a98d1b66e94c5544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } }
I20260709 12:58:26.197518  1241 ts_tablet_manager.cc:1434] T 3937dd9840304b0f8752a493ae246949 P c213ad22ae2e4088a98d1b66e94c5544: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:58:26.204169  1251 raft_consensus.cc:493] T bb7e493140574c5dbfd328c93b4bfc3b P 6508e02af03a488685f95c2de71536a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:26.204686  1251 raft_consensus.cc:515] T bb7e493140574c5dbfd328c93b4bfc3b P 6508e02af03a488685f95c2de71536a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:26.206782  1251 leader_election.cc:290] T bb7e493140574c5dbfd328c93b4bfc3b P 6508e02af03a488685f95c2de71536a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b82fd85b5d15463fb787fcd1e6196090 (127.0.107.193:35297), c213ad22ae2e4088a98d1b66e94c5544 (127.0.107.194:42287)
I20260709 12:58:26.207340  1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7e493140574c5dbfd328c93b4bfc3b" candidate_uuid: "6508e02af03a488685f95c2de71536a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b82fd85b5d15463fb787fcd1e6196090" is_pre_election: true
I20260709 12:58:26.207806  1052 raft_consensus.cc:2468] T bb7e493140574c5dbfd328c93b4bfc3b P b82fd85b5d15463fb787fcd1e6196090 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6508e02af03a488685f95c2de71536a1 in term 0.
I20260709 12:58:26.208889  1127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7e493140574c5dbfd328c93b4bfc3b" candidate_uuid: "6508e02af03a488685f95c2de71536a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c213ad22ae2e4088a98d1b66e94c5544" is_pre_election: true
I20260709 12:58:26.209040  1164 leader_election.cc:304] T bb7e493140574c5dbfd328c93b4bfc3b P 6508e02af03a488685f95c2de71536a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6508e02af03a488685f95c2de71536a1, b82fd85b5d15463fb787fcd1e6196090; no voters: 
I20260709 12:58:26.209358  1127 raft_consensus.cc:2468] T bb7e493140574c5dbfd328c93b4bfc3b P c213ad22ae2e4088a98d1b66e94c5544 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6508e02af03a488685f95c2de71536a1 in term 0.
I20260709 12:58:26.209736  1251 raft_consensus.cc:2804] T bb7e493140574c5dbfd328c93b4bfc3b P 6508e02af03a488685f95c2de71536a1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:26.210095  1251 raft_consensus.cc:493] T bb7e493140574c5dbfd328c93b4bfc3b P 6508e02af03a488685f95c2de71536a1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:26.210415  1251 raft_consensus.cc:3060] T bb7e493140574c5dbfd328c93b4bfc3b P 6508e02af03a488685f95c2de71536a1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:26.214844  1251 raft_consensus.cc:515] T bb7e493140574c5dbfd328c93b4bfc3b P 6508e02af03a488685f95c2de71536a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:26.216425  1251 leader_election.cc:290] T bb7e493140574c5dbfd328c93b4bfc3b P 6508e02af03a488685f95c2de71536a1 [CANDIDATE]: Term 1 election: Requested vote from peers b82fd85b5d15463fb787fcd1e6196090 (127.0.107.193:35297), c213ad22ae2e4088a98d1b66e94c5544 (127.0.107.194:42287)
I20260709 12:58:26.217185  1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7e493140574c5dbfd328c93b4bfc3b" candidate_uuid: "6508e02af03a488685f95c2de71536a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b82fd85b5d15463fb787fcd1e6196090"
I20260709 12:58:26.217453  1127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb7e493140574c5dbfd328c93b4bfc3b" candidate_uuid: "6508e02af03a488685f95c2de71536a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c213ad22ae2e4088a98d1b66e94c5544"
I20260709 12:58:26.217773  1052 raft_consensus.cc:3060] T bb7e493140574c5dbfd328c93b4bfc3b P b82fd85b5d15463fb787fcd1e6196090 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:26.217953  1127 raft_consensus.cc:3060] T bb7e493140574c5dbfd328c93b4bfc3b P c213ad22ae2e4088a98d1b66e94c5544 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:26.221318  1251 raft_consensus.cc:493] T 7a06197c7e30456f9219b872c66b66f1 P 6508e02af03a488685f95c2de71536a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:26.221802  1251 raft_consensus.cc:515] T 7a06197c7e30456f9219b872c66b66f1 P 6508e02af03a488685f95c2de71536a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:26.224424  1127 raft_consensus.cc:2468] T bb7e493140574c5dbfd328c93b4bfc3b P c213ad22ae2e4088a98d1b66e94c5544 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6508e02af03a488685f95c2de71536a1 in term 1.
I20260709 12:58:26.224690  1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a06197c7e30456f9219b872c66b66f1" candidate_uuid: "6508e02af03a488685f95c2de71536a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b82fd85b5d15463fb787fcd1e6196090" is_pre_election: true
I20260709 12:58:26.225317  1052 raft_consensus.cc:2468] T bb7e493140574c5dbfd328c93b4bfc3b P b82fd85b5d15463fb787fcd1e6196090 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6508e02af03a488685f95c2de71536a1 in term 1.
I20260709 12:58:26.225370  1051 raft_consensus.cc:2468] T 7a06197c7e30456f9219b872c66b66f1 P b82fd85b5d15463fb787fcd1e6196090 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6508e02af03a488685f95c2de71536a1 in term 0.
I20260709 12:58:26.226172  1164 leader_election.cc:304] T bb7e493140574c5dbfd328c93b4bfc3b P 6508e02af03a488685f95c2de71536a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6508e02af03a488685f95c2de71536a1, c213ad22ae2e4088a98d1b66e94c5544; no voters: 
I20260709 12:58:26.226543  1251 leader_election.cc:290] T 7a06197c7e30456f9219b872c66b66f1 P 6508e02af03a488685f95c2de71536a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b82fd85b5d15463fb787fcd1e6196090 (127.0.107.193:35297), c213ad22ae2e4088a98d1b66e94c5544 (127.0.107.194:42287)
I20260709 12:58:26.227051  1279 raft_consensus.cc:2804] T bb7e493140574c5dbfd328c93b4bfc3b P 6508e02af03a488685f95c2de71536a1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:26.227061  1127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a06197c7e30456f9219b872c66b66f1" candidate_uuid: "6508e02af03a488685f95c2de71536a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c213ad22ae2e4088a98d1b66e94c5544" is_pre_election: true
I20260709 12:58:26.227651  1279 raft_consensus.cc:697] T bb7e493140574c5dbfd328c93b4bfc3b P 6508e02af03a488685f95c2de71536a1 [term 1 LEADER]: Becoming Leader. State: Replica: 6508e02af03a488685f95c2de71536a1, State: Running, Role: LEADER
I20260709 12:58:26.227778  1127 raft_consensus.cc:2468] T 7a06197c7e30456f9219b872c66b66f1 P c213ad22ae2e4088a98d1b66e94c5544 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6508e02af03a488685f95c2de71536a1 in term 0.
I20260709 12:58:26.227505  1255 consensus_queue.cc:1048] T 197c75f75ec14fc0b3ab45ff540e308d P c213ad22ae2e4088a98d1b66e94c5544 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:26.228559  1279 consensus_queue.cc:237] T bb7e493140574c5dbfd328c93b4bfc3b P 6508e02af03a488685f95c2de71536a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:26.229562  1164 leader_election.cc:304] T 7a06197c7e30456f9219b872c66b66f1 P 6508e02af03a488685f95c2de71536a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6508e02af03a488685f95c2de71536a1, b82fd85b5d15463fb787fcd1e6196090; no voters: 
I20260709 12:58:26.230847  1251 raft_consensus.cc:2804] T 7a06197c7e30456f9219b872c66b66f1 P 6508e02af03a488685f95c2de71536a1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:26.231247  1251 raft_consensus.cc:493] T 7a06197c7e30456f9219b872c66b66f1 P 6508e02af03a488685f95c2de71536a1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:26.231599  1251 raft_consensus.cc:3060] T 7a06197c7e30456f9219b872c66b66f1 P 6508e02af03a488685f95c2de71536a1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:26.238745  1251 raft_consensus.cc:515] T 7a06197c7e30456f9219b872c66b66f1 P 6508e02af03a488685f95c2de71536a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:26.239995   948 catalog_manager.cc:5697] T bb7e493140574c5dbfd328c93b4bfc3b P 6508e02af03a488685f95c2de71536a1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6508e02af03a488685f95c2de71536a1 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "6508e02af03a488685f95c2de71536a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:26.241991  1251 leader_election.cc:290] T 7a06197c7e30456f9219b872c66b66f1 P 6508e02af03a488685f95c2de71536a1 [CANDIDATE]: Term 1 election: Requested vote from peers b82fd85b5d15463fb787fcd1e6196090 (127.0.107.193:35297), c213ad22ae2e4088a98d1b66e94c5544 (127.0.107.194:42287)
I20260709 12:58:26.242197  1127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a06197c7e30456f9219b872c66b66f1" candidate_uuid: "6508e02af03a488685f95c2de71536a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c213ad22ae2e4088a98d1b66e94c5544"
I20260709 12:58:26.242877  1127 raft_consensus.cc:3060] T 7a06197c7e30456f9219b872c66b66f1 P c213ad22ae2e4088a98d1b66e94c5544 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:26.248385  1277 raft_consensus.cc:493] T c9d672f25bad4478a1790bede74733f1 P b82fd85b5d15463fb787fcd1e6196090 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:26.248929  1277 raft_consensus.cc:515] T c9d672f25bad4478a1790bede74733f1 P b82fd85b5d15463fb787fcd1e6196090 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:26.251312  1277 leader_election.cc:290] T c9d672f25bad4478a1790bede74733f1 P b82fd85b5d15463fb787fcd1e6196090 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c213ad22ae2e4088a98d1b66e94c5544 (127.0.107.194:42287), 6508e02af03a488685f95c2de71536a1 (127.0.107.195:35017)
I20260709 12:58:26.254136  1126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d672f25bad4478a1790bede74733f1" candidate_uuid: "b82fd85b5d15463fb787fcd1e6196090" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c213ad22ae2e4088a98d1b66e94c5544" is_pre_election: true
I20260709 12:58:26.254621  1126 raft_consensus.cc:2468] T c9d672f25bad4478a1790bede74733f1 P c213ad22ae2e4088a98d1b66e94c5544 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b82fd85b5d15463fb787fcd1e6196090 in term 0.
I20260709 12:58:26.250466  1127 raft_consensus.cc:2468] T 7a06197c7e30456f9219b872c66b66f1 P c213ad22ae2e4088a98d1b66e94c5544 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6508e02af03a488685f95c2de71536a1 in term 1.
I20260709 12:58:26.255096  1200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d672f25bad4478a1790bede74733f1" candidate_uuid: "b82fd85b5d15463fb787fcd1e6196090" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6508e02af03a488685f95c2de71536a1" is_pre_election: true
I20260709 12:58:26.255870  1200 raft_consensus.cc:2468] T c9d672f25bad4478a1790bede74733f1 P 6508e02af03a488685f95c2de71536a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b82fd85b5d15463fb787fcd1e6196090 in term 0.
I20260709 12:58:26.255885  1015 leader_election.cc:304] T c9d672f25bad4478a1790bede74733f1 P b82fd85b5d15463fb787fcd1e6196090 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b82fd85b5d15463fb787fcd1e6196090, c213ad22ae2e4088a98d1b66e94c5544; no voters: 
I20260709 12:58:26.257781  1277 raft_consensus.cc:2804] T c9d672f25bad4478a1790bede74733f1 P b82fd85b5d15463fb787fcd1e6196090 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:26.258177  1277 raft_consensus.cc:493] T c9d672f25bad4478a1790bede74733f1 P b82fd85b5d15463fb787fcd1e6196090 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:26.258534  1277 raft_consensus.cc:3060] T c9d672f25bad4478a1790bede74733f1 P b82fd85b5d15463fb787fcd1e6196090 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:26.258894  1245 consensus_queue.cc:1048] T 197c75f75ec14fc0b3ab45ff540e308d P c213ad22ae2e4088a98d1b66e94c5544 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:26.258395  1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a06197c7e30456f9219b872c66b66f1" candidate_uuid: "6508e02af03a488685f95c2de71536a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b82fd85b5d15463fb787fcd1e6196090"
I20260709 12:58:26.260622  1052 raft_consensus.cc:3060] T 7a06197c7e30456f9219b872c66b66f1 P b82fd85b5d15463fb787fcd1e6196090 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:26.262526  1248 raft_consensus.cc:493] T e8759b94cc204bc58848a9008afbeab7 P b82fd85b5d15463fb787fcd1e6196090 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:26.263001  1248 raft_consensus.cc:515] T e8759b94cc204bc58848a9008afbeab7 P b82fd85b5d15463fb787fcd1e6196090 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:26.265092  1248 leader_election.cc:290] T e8759b94cc204bc58848a9008afbeab7 P b82fd85b5d15463fb787fcd1e6196090 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c213ad22ae2e4088a98d1b66e94c5544 (127.0.107.194:42287), 6508e02af03a488685f95c2de71536a1 (127.0.107.195:35017)
I20260709 12:58:26.269805  1127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8759b94cc204bc58848a9008afbeab7" candidate_uuid: "b82fd85b5d15463fb787fcd1e6196090" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c213ad22ae2e4088a98d1b66e94c5544" is_pre_election: true
I20260709 12:58:26.270692  1127 raft_consensus.cc:2393] T e8759b94cc204bc58848a9008afbeab7 P c213ad22ae2e4088a98d1b66e94c5544 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b82fd85b5d15463fb787fcd1e6196090 in current term 1: Already voted for candidate 6508e02af03a488685f95c2de71536a1 in this term.
I20260709 12:58:26.272047  1200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8759b94cc204bc58848a9008afbeab7" candidate_uuid: "b82fd85b5d15463fb787fcd1e6196090" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6508e02af03a488685f95c2de71536a1" is_pre_election: true
I20260709 12:58:26.273526  1018 leader_election.cc:304] T e8759b94cc204bc58848a9008afbeab7 P b82fd85b5d15463fb787fcd1e6196090 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b82fd85b5d15463fb787fcd1e6196090; no voters: 6508e02af03a488685f95c2de71536a1, c213ad22ae2e4088a98d1b66e94c5544
I20260709 12:58:26.273851  1052 raft_consensus.cc:2468] T 7a06197c7e30456f9219b872c66b66f1 P b82fd85b5d15463fb787fcd1e6196090 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6508e02af03a488685f95c2de71536a1 in term 1.
I20260709 12:58:26.274273  1248 raft_consensus.cc:3060] T e8759b94cc204bc58848a9008afbeab7 P b82fd85b5d15463fb787fcd1e6196090 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:26.275241  1164 leader_election.cc:304] T 7a06197c7e30456f9219b872c66b66f1 P 6508e02af03a488685f95c2de71536a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6508e02af03a488685f95c2de71536a1, b82fd85b5d15463fb787fcd1e6196090; no voters: 
I20260709 12:58:26.276109  1251 raft_consensus.cc:2804] T 7a06197c7e30456f9219b872c66b66f1 P 6508e02af03a488685f95c2de71536a1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:26.276608  1251 raft_consensus.cc:697] T 7a06197c7e30456f9219b872c66b66f1 P 6508e02af03a488685f95c2de71536a1 [term 1 LEADER]: Becoming Leader. State: Replica: 6508e02af03a488685f95c2de71536a1, State: Running, Role: LEADER
I20260709 12:58:26.277436  1251 consensus_queue.cc:237] T 7a06197c7e30456f9219b872c66b66f1 P 6508e02af03a488685f95c2de71536a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:26.278993  1277 raft_consensus.cc:515] T c9d672f25bad4478a1790bede74733f1 P b82fd85b5d15463fb787fcd1e6196090 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:26.280606  1248 raft_consensus.cc:2749] T e8759b94cc204bc58848a9008afbeab7 P b82fd85b5d15463fb787fcd1e6196090 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:26.281634  1127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d672f25bad4478a1790bede74733f1" candidate_uuid: "b82fd85b5d15463fb787fcd1e6196090" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c213ad22ae2e4088a98d1b66e94c5544"
I20260709 12:58:26.282225  1127 raft_consensus.cc:3060] T c9d672f25bad4478a1790bede74733f1 P c213ad22ae2e4088a98d1b66e94c5544 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:26.287964  1248 raft_consensus.cc:493] T bef759002c944c3095e9777eba3c28c1 P b82fd85b5d15463fb787fcd1e6196090 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:26.287892  1201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d672f25bad4478a1790bede74733f1" candidate_uuid: "b82fd85b5d15463fb787fcd1e6196090" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6508e02af03a488685f95c2de71536a1"
I20260709 12:58:26.288691  1201 raft_consensus.cc:3060] T c9d672f25bad4478a1790bede74733f1 P 6508e02af03a488685f95c2de71536a1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:26.288594  1248 raft_consensus.cc:515] T bef759002c944c3095e9777eba3c28c1 P b82fd85b5d15463fb787fcd1e6196090 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:26.287552  1277 leader_election.cc:290] T c9d672f25bad4478a1790bede74733f1 P b82fd85b5d15463fb787fcd1e6196090 [CANDIDATE]: Term 1 election: Requested vote from peers c213ad22ae2e4088a98d1b66e94c5544 (127.0.107.194:42287), 6508e02af03a488685f95c2de71536a1 (127.0.107.195:35017)
I20260709 12:58:26.292941  1127 raft_consensus.cc:2468] T c9d672f25bad4478a1790bede74733f1 P c213ad22ae2e4088a98d1b66e94c5544 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b82fd85b5d15463fb787fcd1e6196090 in term 1.
I20260709 12:58:26.293970  1015 leader_election.cc:304] T c9d672f25bad4478a1790bede74733f1 P b82fd85b5d15463fb787fcd1e6196090 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b82fd85b5d15463fb787fcd1e6196090, c213ad22ae2e4088a98d1b66e94c5544; no voters: 
I20260709 12:58:26.294608  1277 raft_consensus.cc:2804] T c9d672f25bad4478a1790bede74733f1 P b82fd85b5d15463fb787fcd1e6196090 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:26.295840  1277 raft_consensus.cc:697] T c9d672f25bad4478a1790bede74733f1 P b82fd85b5d15463fb787fcd1e6196090 [term 1 LEADER]: Becoming Leader. State: Replica: b82fd85b5d15463fb787fcd1e6196090, State: Running, Role: LEADER
I20260709 12:58:26.295948  1127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bef759002c944c3095e9777eba3c28c1" candidate_uuid: "b82fd85b5d15463fb787fcd1e6196090" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c213ad22ae2e4088a98d1b66e94c5544" is_pre_election: true
I20260709 12:58:26.296516  1201 raft_consensus.cc:2468] T c9d672f25bad4478a1790bede74733f1 P 6508e02af03a488685f95c2de71536a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b82fd85b5d15463fb787fcd1e6196090 in term 1.
I20260709 12:58:26.296629  1127 raft_consensus.cc:2468] T bef759002c944c3095e9777eba3c28c1 P c213ad22ae2e4088a98d1b66e94c5544 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b82fd85b5d15463fb787fcd1e6196090 in term 0.
I20260709 12:58:26.296998  1199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bef759002c944c3095e9777eba3c28c1" candidate_uuid: "b82fd85b5d15463fb787fcd1e6196090" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6508e02af03a488685f95c2de71536a1" is_pre_election: true
I20260709 12:58:26.296805  1277 consensus_queue.cc:237] T c9d672f25bad4478a1790bede74733f1 P b82fd85b5d15463fb787fcd1e6196090 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:26.297757  1199 raft_consensus.cc:2468] T bef759002c944c3095e9777eba3c28c1 P 6508e02af03a488685f95c2de71536a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b82fd85b5d15463fb787fcd1e6196090 in term 0.
I20260709 12:58:26.297137  1248 leader_election.cc:290] T bef759002c944c3095e9777eba3c28c1 P b82fd85b5d15463fb787fcd1e6196090 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c213ad22ae2e4088a98d1b66e94c5544 (127.0.107.194:42287), 6508e02af03a488685f95c2de71536a1 (127.0.107.195:35017)
I20260709 12:58:26.298209  1015 leader_election.cc:304] T bef759002c944c3095e9777eba3c28c1 P b82fd85b5d15463fb787fcd1e6196090 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b82fd85b5d15463fb787fcd1e6196090, c213ad22ae2e4088a98d1b66e94c5544; no voters: 
I20260709 12:58:26.299219  1248 raft_consensus.cc:2804] T bef759002c944c3095e9777eba3c28c1 P b82fd85b5d15463fb787fcd1e6196090 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:26.299553  1248 raft_consensus.cc:493] T bef759002c944c3095e9777eba3c28c1 P b82fd85b5d15463fb787fcd1e6196090 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:26.299880  1248 raft_consensus.cc:3060] T bef759002c944c3095e9777eba3c28c1 P b82fd85b5d15463fb787fcd1e6196090 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:26.301837   948 catalog_manager.cc:5697] T 7a06197c7e30456f9219b872c66b66f1 P 6508e02af03a488685f95c2de71536a1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6508e02af03a488685f95c2de71536a1 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "6508e02af03a488685f95c2de71536a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:26.306124  1248 raft_consensus.cc:515] T bef759002c944c3095e9777eba3c28c1 P b82fd85b5d15463fb787fcd1e6196090 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:26.306373   950 catalog_manager.cc:5697] T c9d672f25bad4478a1790bede74733f1 P b82fd85b5d15463fb787fcd1e6196090 reported cstate change: term changed from 0 to 1, leader changed from <none> to b82fd85b5d15463fb787fcd1e6196090 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "b82fd85b5d15463fb787fcd1e6196090" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:26.308892  1127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bef759002c944c3095e9777eba3c28c1" candidate_uuid: "b82fd85b5d15463fb787fcd1e6196090" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c213ad22ae2e4088a98d1b66e94c5544"
I20260709 12:58:26.309162  1200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bef759002c944c3095e9777eba3c28c1" candidate_uuid: "b82fd85b5d15463fb787fcd1e6196090" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6508e02af03a488685f95c2de71536a1"
I20260709 12:58:26.309507  1127 raft_consensus.cc:3060] T bef759002c944c3095e9777eba3c28c1 P c213ad22ae2e4088a98d1b66e94c5544 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:26.309711  1200 raft_consensus.cc:3060] T bef759002c944c3095e9777eba3c28c1 P 6508e02af03a488685f95c2de71536a1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:26.316596  1127 raft_consensus.cc:2468] T bef759002c944c3095e9777eba3c28c1 P c213ad22ae2e4088a98d1b66e94c5544 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b82fd85b5d15463fb787fcd1e6196090 in term 1.
I20260709 12:58:26.316906  1200 raft_consensus.cc:2468] T bef759002c944c3095e9777eba3c28c1 P 6508e02af03a488685f95c2de71536a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b82fd85b5d15463fb787fcd1e6196090 in term 1.
I20260709 12:58:26.317657  1015 leader_election.cc:304] T bef759002c944c3095e9777eba3c28c1 P b82fd85b5d15463fb787fcd1e6196090 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b82fd85b5d15463fb787fcd1e6196090, c213ad22ae2e4088a98d1b66e94c5544; no voters: 
I20260709 12:58:26.318181  1248 leader_election.cc:290] T bef759002c944c3095e9777eba3c28c1 P b82fd85b5d15463fb787fcd1e6196090 [CANDIDATE]: Term 1 election: Requested vote from peers c213ad22ae2e4088a98d1b66e94c5544 (127.0.107.194:42287), 6508e02af03a488685f95c2de71536a1 (127.0.107.195:35017)
I20260709 12:58:26.318496  1277 raft_consensus.cc:2804] T bef759002c944c3095e9777eba3c28c1 P b82fd85b5d15463fb787fcd1e6196090 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:26.318989  1277 raft_consensus.cc:697] T bef759002c944c3095e9777eba3c28c1 P b82fd85b5d15463fb787fcd1e6196090 [term 1 LEADER]: Becoming Leader. State: Replica: b82fd85b5d15463fb787fcd1e6196090, State: Running, Role: LEADER
I20260709 12:58:26.319655  1277 consensus_queue.cc:237] T bef759002c944c3095e9777eba3c28c1 P b82fd85b5d15463fb787fcd1e6196090 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:26.325956   948 catalog_manager.cc:5697] T bef759002c944c3095e9777eba3c28c1 P b82fd85b5d15463fb787fcd1e6196090 reported cstate change: term changed from 0 to 1, leader changed from <none> to b82fd85b5d15463fb787fcd1e6196090 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "b82fd85b5d15463fb787fcd1e6196090" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:26.389019  1277 consensus_queue.cc:1048] T 95a5561ec0684e6e955493c7f892e02a P b82fd85b5d15463fb787fcd1e6196090 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:26.399703  1277 consensus_queue.cc:1048] T 95a5561ec0684e6e955493c7f892e02a P b82fd85b5d15463fb787fcd1e6196090 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:26.495157  1200 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3937dd9840304b0f8752a493ae246949"
dest_uuid: "6508e02af03a488685f95c2de71536a1"
mode: GRACEFUL
new_leader_uuid: "b82fd85b5d15463fb787fcd1e6196090"
 from {username='slave'} at 127.0.0.1:41840
I20260709 12:58:26.495631  1200 raft_consensus.cc:606] T 3937dd9840304b0f8752a493ae246949 P 6508e02af03a488685f95c2de71536a1 [term 1 LEADER]: Received request to transfer leadership to TS b82fd85b5d15463fb787fcd1e6196090
I20260709 12:58:26.499315  1277 consensus_queue.cc:1048] T 795b091720eb457cb7373133625dba18 P b82fd85b5d15463fb787fcd1e6196090 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:26.501235  1300 raft_consensus.cc:493] T cc64d897105f4ef08f524f3545b807e0 P c213ad22ae2e4088a98d1b66e94c5544 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:26.501793  1300 raft_consensus.cc:515] T cc64d897105f4ef08f524f3545b807e0 P c213ad22ae2e4088a98d1b66e94c5544 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:26.504136  1300 leader_election.cc:290] T cc64d897105f4ef08f524f3545b807e0 P c213ad22ae2e4088a98d1b66e94c5544 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b82fd85b5d15463fb787fcd1e6196090 (127.0.107.193:35297), 6508e02af03a488685f95c2de71536a1 (127.0.107.195:35017)
I20260709 12:58:26.505864  1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc64d897105f4ef08f524f3545b807e0" candidate_uuid: "c213ad22ae2e4088a98d1b66e94c5544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b82fd85b5d15463fb787fcd1e6196090" is_pre_election: true
I20260709 12:58:26.506764  1201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc64d897105f4ef08f524f3545b807e0" candidate_uuid: "c213ad22ae2e4088a98d1b66e94c5544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6508e02af03a488685f95c2de71536a1" is_pre_election: true
I20260709 12:58:26.507495  1201 raft_consensus.cc:2393] T cc64d897105f4ef08f524f3545b807e0 P 6508e02af03a488685f95c2de71536a1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c213ad22ae2e4088a98d1b66e94c5544 in current term 1: Already voted for candidate b82fd85b5d15463fb787fcd1e6196090 in this term.
I20260709 12:58:26.508942  1093 leader_election.cc:304] T cc64d897105f4ef08f524f3545b807e0 P c213ad22ae2e4088a98d1b66e94c5544 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c213ad22ae2e4088a98d1b66e94c5544; no voters: 6508e02af03a488685f95c2de71536a1, b82fd85b5d15463fb787fcd1e6196090
I20260709 12:58:26.510190  1300 raft_consensus.cc:3060] T cc64d897105f4ef08f524f3545b807e0 P c213ad22ae2e4088a98d1b66e94c5544 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:26.518241  1300 raft_consensus.cc:2749] T cc64d897105f4ef08f524f3545b807e0 P c213ad22ae2e4088a98d1b66e94c5544 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:26.525960  1273 consensus_queue.cc:1048] T 795b091720eb457cb7373133625dba18 P b82fd85b5d15463fb787fcd1e6196090 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:26.528443  1126 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "197c75f75ec14fc0b3ab45ff540e308d"
dest_uuid: "c213ad22ae2e4088a98d1b66e94c5544"
mode: GRACEFUL
new_leader_uuid: "b82fd85b5d15463fb787fcd1e6196090"
 from {username='slave'} at 127.0.0.1:51096
I20260709 12:58:26.529196  1126 raft_consensus.cc:606] T 197c75f75ec14fc0b3ab45ff540e308d P c213ad22ae2e4088a98d1b66e94c5544 [term 1 LEADER]: Received request to transfer leadership to TS b82fd85b5d15463fb787fcd1e6196090
I20260709 12:58:26.538647  1273 consensus_queue.cc:1048] T cc64d897105f4ef08f524f3545b807e0 P b82fd85b5d15463fb787fcd1e6196090 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:26.544601  1251 consensus_queue.cc:1048] T e8759b94cc204bc58848a9008afbeab7 P 6508e02af03a488685f95c2de71536a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:26.549338  1312 consensus_queue.cc:1048] T cc64d897105f4ef08f524f3545b807e0 P b82fd85b5d15463fb787fcd1e6196090 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:26.549623  1200 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e8759b94cc204bc58848a9008afbeab7"
dest_uuid: "6508e02af03a488685f95c2de71536a1"
mode: GRACEFUL
new_leader_uuid: "c213ad22ae2e4088a98d1b66e94c5544"
 from {username='slave'} at 127.0.0.1:41840
I20260709 12:58:26.550154  1200 raft_consensus.cc:606] T e8759b94cc204bc58848a9008afbeab7 P 6508e02af03a488685f95c2de71536a1 [term 1 LEADER]: Received request to transfer leadership to TS c213ad22ae2e4088a98d1b66e94c5544
I20260709 12:58:26.567246  1287 consensus_queue.cc:1048] T e8759b94cc204bc58848a9008afbeab7 P 6508e02af03a488685f95c2de71536a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:26.581957  1251 raft_consensus.cc:993] T e8759b94cc204bc58848a9008afbeab7 P 6508e02af03a488685f95c2de71536a1: : Instructing follower c213ad22ae2e4088a98d1b66e94c5544 to start an election
I20260709 12:58:26.581808  1052 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bef759002c944c3095e9777eba3c28c1"
dest_uuid: "b82fd85b5d15463fb787fcd1e6196090"
mode: GRACEFUL
new_leader_uuid: "c213ad22ae2e4088a98d1b66e94c5544"
 from {username='slave'} at 127.0.0.1:53596
I20260709 12:58:26.582376  1287 raft_consensus.cc:1081] T e8759b94cc204bc58848a9008afbeab7 P 6508e02af03a488685f95c2de71536a1 [term 1 LEADER]: Signalling peer c213ad22ae2e4088a98d1b66e94c5544 to start an election
I20260709 12:58:26.582420  1052 raft_consensus.cc:606] T bef759002c944c3095e9777eba3c28c1 P b82fd85b5d15463fb787fcd1e6196090 [term 1 LEADER]: Received request to transfer leadership to TS c213ad22ae2e4088a98d1b66e94c5544
I20260709 12:58:26.583936  1127 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e8759b94cc204bc58848a9008afbeab7"
dest_uuid: "c213ad22ae2e4088a98d1b66e94c5544"
 from {username='slave'} at 127.0.0.1:51088
I20260709 12:58:26.584501  1127 raft_consensus.cc:493] T e8759b94cc204bc58848a9008afbeab7 P c213ad22ae2e4088a98d1b66e94c5544 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:26.584878  1127 raft_consensus.cc:3060] T e8759b94cc204bc58848a9008afbeab7 P c213ad22ae2e4088a98d1b66e94c5544 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:26.587774  1200 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7a06197c7e30456f9219b872c66b66f1"
dest_uuid: "6508e02af03a488685f95c2de71536a1"
mode: GRACEFUL
new_leader_uuid: "c213ad22ae2e4088a98d1b66e94c5544"
 from {username='slave'} at 127.0.0.1:41840
I20260709 12:58:26.588361  1200 raft_consensus.cc:606] T 7a06197c7e30456f9219b872c66b66f1 P 6508e02af03a488685f95c2de71536a1 [term 1 LEADER]: Received request to transfer leadership to TS c213ad22ae2e4088a98d1b66e94c5544
I20260709 12:58:26.591287  1127 raft_consensus.cc:515] T e8759b94cc204bc58848a9008afbeab7 P c213ad22ae2e4088a98d1b66e94c5544 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:26.593993  1127 leader_election.cc:290] T e8759b94cc204bc58848a9008afbeab7 P c213ad22ae2e4088a98d1b66e94c5544 [CANDIDATE]: Term 2 election: Requested vote from peers b82fd85b5d15463fb787fcd1e6196090 (127.0.107.193:35297), 6508e02af03a488685f95c2de71536a1 (127.0.107.195:35017)
I20260709 12:58:26.594187  1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8759b94cc204bc58848a9008afbeab7" candidate_uuid: "c213ad22ae2e4088a98d1b66e94c5544" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b82fd85b5d15463fb787fcd1e6196090"
I20260709 12:58:26.594889  1052 raft_consensus.cc:3060] T e8759b94cc204bc58848a9008afbeab7 P b82fd85b5d15463fb787fcd1e6196090 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:26.595155  1200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8759b94cc204bc58848a9008afbeab7" candidate_uuid: "c213ad22ae2e4088a98d1b66e94c5544" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6508e02af03a488685f95c2de71536a1"
I20260709 12:58:26.595724  1200 raft_consensus.cc:3055] T e8759b94cc204bc58848a9008afbeab7 P 6508e02af03a488685f95c2de71536a1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:26.596050  1200 raft_consensus.cc:740] T e8759b94cc204bc58848a9008afbeab7 P 6508e02af03a488685f95c2de71536a1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6508e02af03a488685f95c2de71536a1, State: Running, Role: LEADER
I20260709 12:58:26.596799  1200 consensus_queue.cc:260] T e8759b94cc204bc58848a9008afbeab7 P 6508e02af03a488685f95c2de71536a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:26.597628  1200 raft_consensus.cc:3060] T e8759b94cc204bc58848a9008afbeab7 P 6508e02af03a488685f95c2de71536a1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:26.601675  1052 raft_consensus.cc:2468] T e8759b94cc204bc58848a9008afbeab7 P b82fd85b5d15463fb787fcd1e6196090 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c213ad22ae2e4088a98d1b66e94c5544 in term 2.
I20260709 12:58:26.602773  1090 leader_election.cc:304] T e8759b94cc204bc58848a9008afbeab7 P c213ad22ae2e4088a98d1b66e94c5544 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b82fd85b5d15463fb787fcd1e6196090, c213ad22ae2e4088a98d1b66e94c5544; no voters: 
I20260709 12:58:26.602766  1200 raft_consensus.cc:2468] T e8759b94cc204bc58848a9008afbeab7 P 6508e02af03a488685f95c2de71536a1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c213ad22ae2e4088a98d1b66e94c5544 in term 2.
I20260709 12:58:26.603092  1050 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c9d672f25bad4478a1790bede74733f1"
dest_uuid: "b82fd85b5d15463fb787fcd1e6196090"
mode: GRACEFUL
new_leader_uuid: "c213ad22ae2e4088a98d1b66e94c5544"
 from {username='slave'} at 127.0.0.1:53596
I20260709 12:58:26.603617  1300 raft_consensus.cc:2804] T e8759b94cc204bc58848a9008afbeab7 P c213ad22ae2e4088a98d1b66e94c5544 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:26.603720  1050 raft_consensus.cc:606] T c9d672f25bad4478a1790bede74733f1 P b82fd85b5d15463fb787fcd1e6196090 [term 1 LEADER]: Received request to transfer leadership to TS c213ad22ae2e4088a98d1b66e94c5544
I20260709 12:58:26.604148  1300 raft_consensus.cc:697] T e8759b94cc204bc58848a9008afbeab7 P c213ad22ae2e4088a98d1b66e94c5544 [term 2 LEADER]: Becoming Leader. State: Replica: c213ad22ae2e4088a98d1b66e94c5544, State: Running, Role: LEADER
I20260709 12:58:26.604967  1300 consensus_queue.cc:237] T e8759b94cc204bc58848a9008afbeab7 P c213ad22ae2e4088a98d1b66e94c5544 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:26.611812   948 catalog_manager.cc:5697] T e8759b94cc204bc58848a9008afbeab7 P c213ad22ae2e4088a98d1b66e94c5544 reported cstate change: term changed from 1 to 2, leader changed from 6508e02af03a488685f95c2de71536a1 (127.0.107.195) to c213ad22ae2e4088a98d1b66e94c5544 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "c213ad22ae2e4088a98d1b66e94c5544" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:26.614699  1300 raft_consensus.cc:493] T 3937dd9840304b0f8752a493ae246949 P c213ad22ae2e4088a98d1b66e94c5544 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:26.615208  1300 raft_consensus.cc:515] T 3937dd9840304b0f8752a493ae246949 P c213ad22ae2e4088a98d1b66e94c5544 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } }
I20260709 12:58:26.616999  1300 leader_election.cc:290] T 3937dd9840304b0f8752a493ae246949 P c213ad22ae2e4088a98d1b66e94c5544 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6508e02af03a488685f95c2de71536a1 (127.0.107.195:35017), b82fd85b5d15463fb787fcd1e6196090 (127.0.107.193:35297)
I20260709 12:58:26.617900  1200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3937dd9840304b0f8752a493ae246949" candidate_uuid: "c213ad22ae2e4088a98d1b66e94c5544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6508e02af03a488685f95c2de71536a1" is_pre_election: true
I20260709 12:58:26.618040  1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3937dd9840304b0f8752a493ae246949" candidate_uuid: "c213ad22ae2e4088a98d1b66e94c5544" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b82fd85b5d15463fb787fcd1e6196090" is_pre_election: true
I20260709 12:58:26.618744  1050 raft_consensus.cc:2393] T 3937dd9840304b0f8752a493ae246949 P b82fd85b5d15463fb787fcd1e6196090 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c213ad22ae2e4088a98d1b66e94c5544 in current term 1: Already voted for candidate 6508e02af03a488685f95c2de71536a1 in this term.
I20260709 12:58:26.619735  1090 leader_election.cc:304] T 3937dd9840304b0f8752a493ae246949 P c213ad22ae2e4088a98d1b66e94c5544 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c213ad22ae2e4088a98d1b66e94c5544; no voters: 6508e02af03a488685f95c2de71536a1, b82fd85b5d15463fb787fcd1e6196090
I20260709 12:58:26.620448  1300 raft_consensus.cc:3060] T 3937dd9840304b0f8752a493ae246949 P c213ad22ae2e4088a98d1b66e94c5544 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:26.624893  1300 raft_consensus.cc:2749] T 3937dd9840304b0f8752a493ae246949 P c213ad22ae2e4088a98d1b66e94c5544 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:26.645036  1287 consensus_queue.cc:1048] T 3937dd9840304b0f8752a493ae246949 P 6508e02af03a488685f95c2de71536a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:26.651394  1251 raft_consensus.cc:993] T 3937dd9840304b0f8752a493ae246949 P 6508e02af03a488685f95c2de71536a1: : Instructing follower b82fd85b5d15463fb787fcd1e6196090 to start an election
I20260709 12:58:26.651829  1279 raft_consensus.cc:1081] T 3937dd9840304b0f8752a493ae246949 P 6508e02af03a488685f95c2de71536a1 [term 1 LEADER]: Signalling peer b82fd85b5d15463fb787fcd1e6196090 to start an election
I20260709 12:58:26.653539  1052 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3937dd9840304b0f8752a493ae246949"
dest_uuid: "b82fd85b5d15463fb787fcd1e6196090"
 from {username='slave'} at 127.0.0.1:53588
I20260709 12:58:26.654181  1052 raft_consensus.cc:493] T 3937dd9840304b0f8752a493ae246949 P b82fd85b5d15463fb787fcd1e6196090 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:26.654570  1052 raft_consensus.cc:3060] T 3937dd9840304b0f8752a493ae246949 P b82fd85b5d15463fb787fcd1e6196090 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:26.658694  1279 consensus_queue.cc:1048] T 3937dd9840304b0f8752a493ae246949 P 6508e02af03a488685f95c2de71536a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:26.661804  1052 raft_consensus.cc:515] T 3937dd9840304b0f8752a493ae246949 P b82fd85b5d15463fb787fcd1e6196090 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } }
I20260709 12:58:26.664659  1279 consensus_queue.cc:1048] T 7a06197c7e30456f9219b872c66b66f1 P 6508e02af03a488685f95c2de71536a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:26.665061  1052 leader_election.cc:290] T 3937dd9840304b0f8752a493ae246949 P b82fd85b5d15463fb787fcd1e6196090 [CANDIDATE]: Term 2 election: Requested vote from peers 6508e02af03a488685f95c2de71536a1 (127.0.107.195:35017), c213ad22ae2e4088a98d1b66e94c5544 (127.0.107.194:42287)
I20260709 12:58:26.667371  1126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3937dd9840304b0f8752a493ae246949" candidate_uuid: "b82fd85b5d15463fb787fcd1e6196090" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c213ad22ae2e4088a98d1b66e94c5544"
I20260709 12:58:26.670269  1200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3937dd9840304b0f8752a493ae246949" candidate_uuid: "b82fd85b5d15463fb787fcd1e6196090" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6508e02af03a488685f95c2de71536a1"
I20260709 12:58:26.670954  1200 raft_consensus.cc:3055] T 3937dd9840304b0f8752a493ae246949 P 6508e02af03a488685f95c2de71536a1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:26.671290  1200 raft_consensus.cc:740] T 3937dd9840304b0f8752a493ae246949 P 6508e02af03a488685f95c2de71536a1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6508e02af03a488685f95c2de71536a1, State: Running, Role: LEADER
I20260709 12:58:26.672562  1200 consensus_queue.cc:260] T 3937dd9840304b0f8752a493ae246949 P 6508e02af03a488685f95c2de71536a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } }
I20260709 12:58:26.673864  1200 raft_consensus.cc:3060] T 3937dd9840304b0f8752a493ae246949 P 6508e02af03a488685f95c2de71536a1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:26.680446  1287 consensus_queue.cc:1048] T 7a06197c7e30456f9219b872c66b66f1 P 6508e02af03a488685f95c2de71536a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:26.692392  1200 raft_consensus.cc:2468] T 3937dd9840304b0f8752a493ae246949 P 6508e02af03a488685f95c2de71536a1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b82fd85b5d15463fb787fcd1e6196090 in term 2.
I20260709 12:58:26.693071  1273 consensus_queue.cc:1048] T c9d672f25bad4478a1790bede74733f1 P b82fd85b5d15463fb787fcd1e6196090 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:26.693656  1018 leader_election.cc:304] T 3937dd9840304b0f8752a493ae246949 P b82fd85b5d15463fb787fcd1e6196090 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6508e02af03a488685f95c2de71536a1, b82fd85b5d15463fb787fcd1e6196090; no voters: c213ad22ae2e4088a98d1b66e94c5544
I20260709 12:58:26.694509  1273 raft_consensus.cc:2804] T 3937dd9840304b0f8752a493ae246949 P b82fd85b5d15463fb787fcd1e6196090 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:26.695009  1273 raft_consensus.cc:697] T 3937dd9840304b0f8752a493ae246949 P b82fd85b5d15463fb787fcd1e6196090 [term 2 LEADER]: Becoming Leader. State: Replica: b82fd85b5d15463fb787fcd1e6196090, State: Running, Role: LEADER
I20260709 12:58:26.695771  1287 raft_consensus.cc:993] T 7a06197c7e30456f9219b872c66b66f1 P 6508e02af03a488685f95c2de71536a1: : Instructing follower c213ad22ae2e4088a98d1b66e94c5544 to start an election
I20260709 12:58:26.696296  1287 raft_consensus.cc:1081] T 7a06197c7e30456f9219b872c66b66f1 P 6508e02af03a488685f95c2de71536a1 [term 1 LEADER]: Signalling peer c213ad22ae2e4088a98d1b66e94c5544 to start an election
I20260709 12:58:26.695909  1273 consensus_queue.cc:237] T 3937dd9840304b0f8752a493ae246949 P b82fd85b5d15463fb787fcd1e6196090 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } }
I20260709 12:58:26.698103  1126 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7a06197c7e30456f9219b872c66b66f1"
dest_uuid: "c213ad22ae2e4088a98d1b66e94c5544"
 from {username='slave'} at 127.0.0.1:51088
I20260709 12:58:26.698707  1126 raft_consensus.cc:493] T 7a06197c7e30456f9219b872c66b66f1 P c213ad22ae2e4088a98d1b66e94c5544 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:26.699131  1126 raft_consensus.cc:3060] T 7a06197c7e30456f9219b872c66b66f1 P c213ad22ae2e4088a98d1b66e94c5544 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:26.704097  1277 raft_consensus.cc:993] T c9d672f25bad4478a1790bede74733f1 P b82fd85b5d15463fb787fcd1e6196090: : Instructing follower c213ad22ae2e4088a98d1b66e94c5544 to start an election
I20260709 12:58:26.704627  1277 raft_consensus.cc:1081] T c9d672f25bad4478a1790bede74733f1 P b82fd85b5d15463fb787fcd1e6196090 [term 1 LEADER]: Signalling peer c213ad22ae2e4088a98d1b66e94c5544 to start an election
I20260709 12:58:26.707930  1126 raft_consensus.cc:515] T 7a06197c7e30456f9219b872c66b66f1 P c213ad22ae2e4088a98d1b66e94c5544 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:26.708997  1125 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c9d672f25bad4478a1790bede74733f1"
dest_uuid: "c213ad22ae2e4088a98d1b66e94c5544"
 from {username='slave'} at 127.0.0.1:51074
I20260709 12:58:26.709625  1125 raft_consensus.cc:493] T c9d672f25bad4478a1790bede74733f1 P c213ad22ae2e4088a98d1b66e94c5544 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:26.710058  1126 leader_election.cc:290] T 7a06197c7e30456f9219b872c66b66f1 P c213ad22ae2e4088a98d1b66e94c5544 [CANDIDATE]: Term 2 election: Requested vote from peers b82fd85b5d15463fb787fcd1e6196090 (127.0.107.193:35297), 6508e02af03a488685f95c2de71536a1 (127.0.107.195:35017)
I20260709 12:58:26.710004  1125 raft_consensus.cc:3060] T c9d672f25bad4478a1790bede74733f1 P c213ad22ae2e4088a98d1b66e94c5544 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:26.709944  1277 consensus_queue.cc:1048] T c9d672f25bad4478a1790bede74733f1 P b82fd85b5d15463fb787fcd1e6196090 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:26.708038   950 catalog_manager.cc:5697] T 3937dd9840304b0f8752a493ae246949 P b82fd85b5d15463fb787fcd1e6196090 reported cstate change: term changed from 1 to 2, leader changed from 6508e02af03a488685f95c2de71536a1 (127.0.107.195) to b82fd85b5d15463fb787fcd1e6196090 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "b82fd85b5d15463fb787fcd1e6196090" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:26.713781  1201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a06197c7e30456f9219b872c66b66f1" candidate_uuid: "c213ad22ae2e4088a98d1b66e94c5544" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6508e02af03a488685f95c2de71536a1"
I20260709 12:58:26.715754  1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a06197c7e30456f9219b872c66b66f1" candidate_uuid: "c213ad22ae2e4088a98d1b66e94c5544" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b82fd85b5d15463fb787fcd1e6196090"
I20260709 12:58:26.716361  1052 raft_consensus.cc:3060] T 7a06197c7e30456f9219b872c66b66f1 P b82fd85b5d15463fb787fcd1e6196090 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:26.718981  1125 raft_consensus.cc:515] T c9d672f25bad4478a1790bede74733f1 P c213ad22ae2e4088a98d1b66e94c5544 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:26.714432  1201 raft_consensus.cc:3055] T 7a06197c7e30456f9219b872c66b66f1 P 6508e02af03a488685f95c2de71536a1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:26.720775  1201 raft_consensus.cc:740] T 7a06197c7e30456f9219b872c66b66f1 P 6508e02af03a488685f95c2de71536a1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6508e02af03a488685f95c2de71536a1, State: Running, Role: LEADER
I20260709 12:58:26.721565  1125 leader_election.cc:290] T c9d672f25bad4478a1790bede74733f1 P c213ad22ae2e4088a98d1b66e94c5544 [CANDIDATE]: Term 2 election: Requested vote from peers b82fd85b5d15463fb787fcd1e6196090 (127.0.107.193:35297), 6508e02af03a488685f95c2de71536a1 (127.0.107.195:35017)
I20260709 12:58:26.721830  1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d672f25bad4478a1790bede74733f1" candidate_uuid: "c213ad22ae2e4088a98d1b66e94c5544" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b82fd85b5d15463fb787fcd1e6196090"
I20260709 12:58:26.721680  1201 consensus_queue.cc:260] T 7a06197c7e30456f9219b872c66b66f1 P 6508e02af03a488685f95c2de71536a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:26.722400  1050 raft_consensus.cc:3055] T c9d672f25bad4478a1790bede74733f1 P b82fd85b5d15463fb787fcd1e6196090 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:26.722776  1050 raft_consensus.cc:740] T c9d672f25bad4478a1790bede74733f1 P b82fd85b5d15463fb787fcd1e6196090 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b82fd85b5d15463fb787fcd1e6196090, State: Running, Role: LEADER
I20260709 12:58:26.723670  1050 consensus_queue.cc:260] T c9d672f25bad4478a1790bede74733f1 P b82fd85b5d15463fb787fcd1e6196090 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:26.724097  1199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d672f25bad4478a1790bede74733f1" candidate_uuid: "c213ad22ae2e4088a98d1b66e94c5544" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6508e02af03a488685f95c2de71536a1"
I20260709 12:58:26.724633  1050 raft_consensus.cc:3060] T c9d672f25bad4478a1790bede74733f1 P b82fd85b5d15463fb787fcd1e6196090 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:26.727072  1201 raft_consensus.cc:3060] T 7a06197c7e30456f9219b872c66b66f1 P 6508e02af03a488685f95c2de71536a1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:26.730901  1052 raft_consensus.cc:2468] T 7a06197c7e30456f9219b872c66b66f1 P b82fd85b5d15463fb787fcd1e6196090 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c213ad22ae2e4088a98d1b66e94c5544 in term 2.
I20260709 12:58:26.732230  1090 leader_election.cc:304] T 7a06197c7e30456f9219b872c66b66f1 P c213ad22ae2e4088a98d1b66e94c5544 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b82fd85b5d15463fb787fcd1e6196090, c213ad22ae2e4088a98d1b66e94c5544; no voters: 
I20260709 12:58:26.733202  1300 raft_consensus.cc:2804] T 7a06197c7e30456f9219b872c66b66f1 P c213ad22ae2e4088a98d1b66e94c5544 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:26.733632  1201 raft_consensus.cc:2468] T 7a06197c7e30456f9219b872c66b66f1 P 6508e02af03a488685f95c2de71536a1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c213ad22ae2e4088a98d1b66e94c5544 in term 2.
I20260709 12:58:26.733667  1300 raft_consensus.cc:697] T 7a06197c7e30456f9219b872c66b66f1 P c213ad22ae2e4088a98d1b66e94c5544 [term 2 LEADER]: Becoming Leader. State: Replica: c213ad22ae2e4088a98d1b66e94c5544, State: Running, Role: LEADER
I20260709 12:58:26.734892  1300 consensus_queue.cc:237] T 7a06197c7e30456f9219b872c66b66f1 P c213ad22ae2e4088a98d1b66e94c5544 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:26.735415  1050 raft_consensus.cc:2468] T c9d672f25bad4478a1790bede74733f1 P b82fd85b5d15463fb787fcd1e6196090 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c213ad22ae2e4088a98d1b66e94c5544 in term 2.
I20260709 12:58:26.737603  1090 leader_election.cc:304] T c9d672f25bad4478a1790bede74733f1 P c213ad22ae2e4088a98d1b66e94c5544 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b82fd85b5d15463fb787fcd1e6196090, c213ad22ae2e4088a98d1b66e94c5544; no voters: 6508e02af03a488685f95c2de71536a1
I20260709 12:58:26.738390  1245 raft_consensus.cc:2804] T c9d672f25bad4478a1790bede74733f1 P c213ad22ae2e4088a98d1b66e94c5544 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:26.738870  1245 raft_consensus.cc:697] T c9d672f25bad4478a1790bede74733f1 P c213ad22ae2e4088a98d1b66e94c5544 [term 2 LEADER]: Becoming Leader. State: Replica: c213ad22ae2e4088a98d1b66e94c5544, State: Running, Role: LEADER
I20260709 12:58:26.739676  1245 consensus_queue.cc:237] T c9d672f25bad4478a1790bede74733f1 P c213ad22ae2e4088a98d1b66e94c5544 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:26.742148  1287 consensus_queue.cc:1048] T bb7e493140574c5dbfd328c93b4bfc3b P 6508e02af03a488685f95c2de71536a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:26.744681   949 catalog_manager.cc:5697] T 7a06197c7e30456f9219b872c66b66f1 P c213ad22ae2e4088a98d1b66e94c5544 reported cstate change: term changed from 1 to 2, leader changed from 6508e02af03a488685f95c2de71536a1 (127.0.107.195) to c213ad22ae2e4088a98d1b66e94c5544 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "c213ad22ae2e4088a98d1b66e94c5544" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:26.753358  1251 consensus_queue.cc:1048] T bb7e493140574c5dbfd328c93b4bfc3b P 6508e02af03a488685f95c2de71536a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:26.761276   950 catalog_manager.cc:5697] T c9d672f25bad4478a1790bede74733f1 P c213ad22ae2e4088a98d1b66e94c5544 reported cstate change: term changed from 1 to 2, leader changed from b82fd85b5d15463fb787fcd1e6196090 (127.0.107.193) to c213ad22ae2e4088a98d1b66e94c5544 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "c213ad22ae2e4088a98d1b66e94c5544" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:26.831930  1277 consensus_queue.cc:1048] T bef759002c944c3095e9777eba3c28c1 P b82fd85b5d15463fb787fcd1e6196090 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:26.832515  1300 raft_consensus.cc:993] T 197c75f75ec14fc0b3ab45ff540e308d P c213ad22ae2e4088a98d1b66e94c5544: : Instructing follower b82fd85b5d15463fb787fcd1e6196090 to start an election
I20260709 12:58:26.832937  1245 raft_consensus.cc:1081] T 197c75f75ec14fc0b3ab45ff540e308d P c213ad22ae2e4088a98d1b66e94c5544 [term 1 LEADER]: Signalling peer b82fd85b5d15463fb787fcd1e6196090 to start an election
I20260709 12:58:26.834367  1050 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "197c75f75ec14fc0b3ab45ff540e308d"
dest_uuid: "b82fd85b5d15463fb787fcd1e6196090"
 from {username='slave'} at 127.0.0.1:53580
I20260709 12:58:26.834939  1050 raft_consensus.cc:493] T 197c75f75ec14fc0b3ab45ff540e308d P b82fd85b5d15463fb787fcd1e6196090 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:26.835249  1050 raft_consensus.cc:3060] T 197c75f75ec14fc0b3ab45ff540e308d P b82fd85b5d15463fb787fcd1e6196090 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:26.842923  1050 raft_consensus.cc:515] T 197c75f75ec14fc0b3ab45ff540e308d P b82fd85b5d15463fb787fcd1e6196090 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:26.843760  1313 consensus_queue.cc:1048] T bef759002c944c3095e9777eba3c28c1 P b82fd85b5d15463fb787fcd1e6196090 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:26.845507  1050 leader_election.cc:290] T 197c75f75ec14fc0b3ab45ff540e308d P b82fd85b5d15463fb787fcd1e6196090 [CANDIDATE]: Term 2 election: Requested vote from peers c213ad22ae2e4088a98d1b66e94c5544 (127.0.107.194:42287), 6508e02af03a488685f95c2de71536a1 (127.0.107.195:35017)
I20260709 12:58:26.847031  1127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "197c75f75ec14fc0b3ab45ff540e308d" candidate_uuid: "b82fd85b5d15463fb787fcd1e6196090" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c213ad22ae2e4088a98d1b66e94c5544"
I20260709 12:58:26.847642  1127 raft_consensus.cc:3055] T 197c75f75ec14fc0b3ab45ff540e308d P c213ad22ae2e4088a98d1b66e94c5544 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:26.847999  1127 raft_consensus.cc:740] T 197c75f75ec14fc0b3ab45ff540e308d P c213ad22ae2e4088a98d1b66e94c5544 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c213ad22ae2e4088a98d1b66e94c5544, State: Running, Role: LEADER
I20260709 12:58:26.847996  1200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "197c75f75ec14fc0b3ab45ff540e308d" candidate_uuid: "b82fd85b5d15463fb787fcd1e6196090" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6508e02af03a488685f95c2de71536a1"
I20260709 12:58:26.848644  1200 raft_consensus.cc:3060] T 197c75f75ec14fc0b3ab45ff540e308d P 6508e02af03a488685f95c2de71536a1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:26.848913  1127 consensus_queue.cc:260] T 197c75f75ec14fc0b3ab45ff540e308d P c213ad22ae2e4088a98d1b66e94c5544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:26.850117  1127 raft_consensus.cc:3060] T 197c75f75ec14fc0b3ab45ff540e308d P c213ad22ae2e4088a98d1b66e94c5544 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:26.856597  1200 raft_consensus.cc:2468] T 197c75f75ec14fc0b3ab45ff540e308d P 6508e02af03a488685f95c2de71536a1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b82fd85b5d15463fb787fcd1e6196090 in term 2.
I20260709 12:58:26.858974  1277 raft_consensus.cc:993] T bef759002c944c3095e9777eba3c28c1 P b82fd85b5d15463fb787fcd1e6196090: : Instructing follower c213ad22ae2e4088a98d1b66e94c5544 to start an election
I20260709 12:58:26.859396  1313 raft_consensus.cc:1081] T bef759002c944c3095e9777eba3c28c1 P b82fd85b5d15463fb787fcd1e6196090 [term 1 LEADER]: Signalling peer c213ad22ae2e4088a98d1b66e94c5544 to start an election
I20260709 12:58:26.859840  1018 leader_election.cc:304] T 197c75f75ec14fc0b3ab45ff540e308d P b82fd85b5d15463fb787fcd1e6196090 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6508e02af03a488685f95c2de71536a1, b82fd85b5d15463fb787fcd1e6196090; no voters: 
I20260709 12:58:26.859973  1127 raft_consensus.cc:2468] T 197c75f75ec14fc0b3ab45ff540e308d P c213ad22ae2e4088a98d1b66e94c5544 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b82fd85b5d15463fb787fcd1e6196090 in term 2.
I20260709 12:58:26.861080  1126 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bef759002c944c3095e9777eba3c28c1"
dest_uuid: "c213ad22ae2e4088a98d1b66e94c5544"
 from {username='slave'} at 127.0.0.1:51074
I20260709 12:58:26.861184  1313 raft_consensus.cc:2804] T 197c75f75ec14fc0b3ab45ff540e308d P b82fd85b5d15463fb787fcd1e6196090 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:26.861697  1126 raft_consensus.cc:493] T bef759002c944c3095e9777eba3c28c1 P c213ad22ae2e4088a98d1b66e94c5544 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:26.861896  1313 raft_consensus.cc:697] T 197c75f75ec14fc0b3ab45ff540e308d P b82fd85b5d15463fb787fcd1e6196090 [term 2 LEADER]: Becoming Leader. State: Replica: b82fd85b5d15463fb787fcd1e6196090, State: Running, Role: LEADER
I20260709 12:58:26.862152  1126 raft_consensus.cc:3060] T bef759002c944c3095e9777eba3c28c1 P c213ad22ae2e4088a98d1b66e94c5544 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:26.862816  1313 consensus_queue.cc:237] T 197c75f75ec14fc0b3ab45ff540e308d P b82fd85b5d15463fb787fcd1e6196090 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:26.868386  1126 raft_consensus.cc:515] T bef759002c944c3095e9777eba3c28c1 P c213ad22ae2e4088a98d1b66e94c5544 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:26.870134  1126 leader_election.cc:290] T bef759002c944c3095e9777eba3c28c1 P c213ad22ae2e4088a98d1b66e94c5544 [CANDIDATE]: Term 2 election: Requested vote from peers b82fd85b5d15463fb787fcd1e6196090 (127.0.107.193:35297), 6508e02af03a488685f95c2de71536a1 (127.0.107.195:35017)
I20260709 12:58:26.870221   950 catalog_manager.cc:5697] T 197c75f75ec14fc0b3ab45ff540e308d P b82fd85b5d15463fb787fcd1e6196090 reported cstate change: term changed from 1 to 2, leader changed from c213ad22ae2e4088a98d1b66e94c5544 (127.0.107.194) to b82fd85b5d15463fb787fcd1e6196090 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "b82fd85b5d15463fb787fcd1e6196090" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:26.871376  1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bef759002c944c3095e9777eba3c28c1" candidate_uuid: "c213ad22ae2e4088a98d1b66e94c5544" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b82fd85b5d15463fb787fcd1e6196090"
I20260709 12:58:26.871879  1200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bef759002c944c3095e9777eba3c28c1" candidate_uuid: "c213ad22ae2e4088a98d1b66e94c5544" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6508e02af03a488685f95c2de71536a1"
I20260709 12:58:26.872371  1050 raft_consensus.cc:3055] T bef759002c944c3095e9777eba3c28c1 P b82fd85b5d15463fb787fcd1e6196090 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:26.872462  1200 raft_consensus.cc:3060] T bef759002c944c3095e9777eba3c28c1 P 6508e02af03a488685f95c2de71536a1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:26.872766  1050 raft_consensus.cc:740] T bef759002c944c3095e9777eba3c28c1 P b82fd85b5d15463fb787fcd1e6196090 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b82fd85b5d15463fb787fcd1e6196090, State: Running, Role: LEADER
I20260709 12:58:26.873654  1050 consensus_queue.cc:260] T bef759002c944c3095e9777eba3c28c1 P b82fd85b5d15463fb787fcd1e6196090 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:26.874907  1050 raft_consensus.cc:3060] T bef759002c944c3095e9777eba3c28c1 P b82fd85b5d15463fb787fcd1e6196090 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:26.878981  1200 raft_consensus.cc:2468] T bef759002c944c3095e9777eba3c28c1 P 6508e02af03a488685f95c2de71536a1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c213ad22ae2e4088a98d1b66e94c5544 in term 2.
I20260709 12:58:26.879978  1093 leader_election.cc:304] T bef759002c944c3095e9777eba3c28c1 P c213ad22ae2e4088a98d1b66e94c5544 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6508e02af03a488685f95c2de71536a1, c213ad22ae2e4088a98d1b66e94c5544; no voters: 
I20260709 12:58:26.880700  1245 raft_consensus.cc:2804] T bef759002c944c3095e9777eba3c28c1 P c213ad22ae2e4088a98d1b66e94c5544 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:26.881175  1245 raft_consensus.cc:697] T bef759002c944c3095e9777eba3c28c1 P c213ad22ae2e4088a98d1b66e94c5544 [term 2 LEADER]: Becoming Leader. State: Replica: c213ad22ae2e4088a98d1b66e94c5544, State: Running, Role: LEADER
I20260709 12:58:26.881206  1050 raft_consensus.cc:2468] T bef759002c944c3095e9777eba3c28c1 P b82fd85b5d15463fb787fcd1e6196090 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c213ad22ae2e4088a98d1b66e94c5544 in term 2.
I20260709 12:58:26.882263  1245 consensus_queue.cc:237] T bef759002c944c3095e9777eba3c28c1 P c213ad22ae2e4088a98d1b66e94c5544 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:26.888104   950 catalog_manager.cc:5697] T bef759002c944c3095e9777eba3c28c1 P c213ad22ae2e4088a98d1b66e94c5544 reported cstate change: term changed from 1 to 2, leader changed from b82fd85b5d15463fb787fcd1e6196090 (127.0.107.193) to c213ad22ae2e4088a98d1b66e94c5544 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "c213ad22ae2e4088a98d1b66e94c5544" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:27.028270  1050 raft_consensus.cc:1275] T e8759b94cc204bc58848a9008afbeab7 P b82fd85b5d15463fb787fcd1e6196090 [term 2 FOLLOWER]: Refusing update from remote peer c213ad22ae2e4088a98d1b66e94c5544: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:27.029487  1245 consensus_queue.cc:1048] T e8759b94cc204bc58848a9008afbeab7 P c213ad22ae2e4088a98d1b66e94c5544 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:27.037043  1200 raft_consensus.cc:1275] T e8759b94cc204bc58848a9008afbeab7 P 6508e02af03a488685f95c2de71536a1 [term 2 FOLLOWER]: Refusing update from remote peer c213ad22ae2e4088a98d1b66e94c5544: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:27.038713  1330 consensus_queue.cc:1048] T e8759b94cc204bc58848a9008afbeab7 P c213ad22ae2e4088a98d1b66e94c5544 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:27.159122  1050 raft_consensus.cc:1275] T c9d672f25bad4478a1790bede74733f1 P b82fd85b5d15463fb787fcd1e6196090 [term 2 FOLLOWER]: Refusing update from remote peer c213ad22ae2e4088a98d1b66e94c5544: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:27.160302  1330 consensus_queue.cc:1048] T c9d672f25bad4478a1790bede74733f1 P c213ad22ae2e4088a98d1b66e94c5544 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:27.162390  1200 raft_consensus.cc:3060] T c9d672f25bad4478a1790bede74733f1 P 6508e02af03a488685f95c2de71536a1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:27.169629  1200 raft_consensus.cc:1275] T c9d672f25bad4478a1790bede74733f1 P 6508e02af03a488685f95c2de71536a1 [term 2 FOLLOWER]: Refusing update from remote peer c213ad22ae2e4088a98d1b66e94c5544: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:27.171682  1200 raft_consensus.cc:1275] T 7a06197c7e30456f9219b872c66b66f1 P 6508e02af03a488685f95c2de71536a1 [term 2 FOLLOWER]: Refusing update from remote peer c213ad22ae2e4088a98d1b66e94c5544: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:27.171630  1330 consensus_queue.cc:1048] T c9d672f25bad4478a1790bede74733f1 P c213ad22ae2e4088a98d1b66e94c5544 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:27.173966  1330 consensus_queue.cc:1048] T 7a06197c7e30456f9219b872c66b66f1 P c213ad22ae2e4088a98d1b66e94c5544 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:27.182332  1050 raft_consensus.cc:1275] T 7a06197c7e30456f9219b872c66b66f1 P b82fd85b5d15463fb787fcd1e6196090 [term 2 FOLLOWER]: Refusing update from remote peer c213ad22ae2e4088a98d1b66e94c5544: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:27.184542  1330 consensus_queue.cc:1048] T 7a06197c7e30456f9219b872c66b66f1 P c213ad22ae2e4088a98d1b66e94c5544 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:27.250609  1126 raft_consensus.cc:3060] T 3937dd9840304b0f8752a493ae246949 P c213ad22ae2e4088a98d1b66e94c5544 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:27.255429  1126 raft_consensus.cc:1275] T 3937dd9840304b0f8752a493ae246949 P c213ad22ae2e4088a98d1b66e94c5544 [term 2 FOLLOWER]: Refusing update from remote peer b82fd85b5d15463fb787fcd1e6196090: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:27.256611  1313 consensus_queue.cc:1048] T 3937dd9840304b0f8752a493ae246949 P b82fd85b5d15463fb787fcd1e6196090 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:27.264245  1201 raft_consensus.cc:1275] T 3937dd9840304b0f8752a493ae246949 P 6508e02af03a488685f95c2de71536a1 [term 2 FOLLOWER]: Refusing update from remote peer b82fd85b5d15463fb787fcd1e6196090: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:27.266093  1277 consensus_queue.cc:1048] T 3937dd9840304b0f8752a493ae246949 P b82fd85b5d15463fb787fcd1e6196090 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:27.276574  1126 raft_consensus.cc:1275] T 197c75f75ec14fc0b3ab45ff540e308d P c213ad22ae2e4088a98d1b66e94c5544 [term 2 FOLLOWER]: Refusing update from remote peer b82fd85b5d15463fb787fcd1e6196090: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:27.277711  1277 consensus_queue.cc:1048] T 197c75f75ec14fc0b3ab45ff540e308d P b82fd85b5d15463fb787fcd1e6196090 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:27.285640  1200 raft_consensus.cc:1275] T 197c75f75ec14fc0b3ab45ff540e308d P 6508e02af03a488685f95c2de71536a1 [term 2 FOLLOWER]: Refusing update from remote peer b82fd85b5d15463fb787fcd1e6196090: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:27.287151  1312 consensus_queue.cc:1048] T 197c75f75ec14fc0b3ab45ff540e308d P b82fd85b5d15463fb787fcd1e6196090 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:27.342732  1050 raft_consensus.cc:1275] T bef759002c944c3095e9777eba3c28c1 P b82fd85b5d15463fb787fcd1e6196090 [term 2 FOLLOWER]: Refusing update from remote peer c213ad22ae2e4088a98d1b66e94c5544: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:27.343963  1330 consensus_queue.cc:1048] T bef759002c944c3095e9777eba3c28c1 P c213ad22ae2e4088a98d1b66e94c5544 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:27.350980  1200 raft_consensus.cc:1275] T bef759002c944c3095e9777eba3c28c1 P 6508e02af03a488685f95c2de71536a1 [term 2 FOLLOWER]: Refusing update from remote peer c213ad22ae2e4088a98d1b66e94c5544: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:27.352358  1245 consensus_queue.cc:1048] T bef759002c944c3095e9777eba3c28c1 P c213ad22ae2e4088a98d1b66e94c5544 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:29.640264   431 auto_leader_rebalancer-test.cc:348] The leader distribution is 
I20260709 12:58:29.640980   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:29.668068  1050 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "197c75f75ec14fc0b3ab45ff540e308d"
dest_uuid: "b82fd85b5d15463fb787fcd1e6196090"
mode: GRACEFUL
new_leader_uuid: "6508e02af03a488685f95c2de71536a1"
 from {username='slave'} at 127.0.0.1:53610
I20260709 12:58:29.668630  1050 raft_consensus.cc:606] T 197c75f75ec14fc0b3ab45ff540e308d P b82fd85b5d15463fb787fcd1e6196090 [term 2 LEADER]: Received request to transfer leadership to TS 6508e02af03a488685f95c2de71536a1
I20260709 12:58:29.671082  1050 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "95a5561ec0684e6e955493c7f892e02a"
dest_uuid: "b82fd85b5d15463fb787fcd1e6196090"
mode: GRACEFUL
new_leader_uuid: "6508e02af03a488685f95c2de71536a1"
 from {username='slave'} at 127.0.0.1:53610
I20260709 12:58:29.671546  1050 raft_consensus.cc:606] T 95a5561ec0684e6e955493c7f892e02a P b82fd85b5d15463fb787fcd1e6196090 [term 1 LEADER]: Received request to transfer leadership to TS 6508e02af03a488685f95c2de71536a1
I20260709 12:58:29.672462   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:58:29.672878   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:58:29.782683  1332 raft_consensus.cc:993] T 197c75f75ec14fc0b3ab45ff540e308d P b82fd85b5d15463fb787fcd1e6196090: : Instructing follower 6508e02af03a488685f95c2de71536a1 to start an election
I20260709 12:58:29.783160  1312 raft_consensus.cc:1081] T 197c75f75ec14fc0b3ab45ff540e308d P b82fd85b5d15463fb787fcd1e6196090 [term 2 LEADER]: Signalling peer 6508e02af03a488685f95c2de71536a1 to start an election
I20260709 12:58:29.784523  1200 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "197c75f75ec14fc0b3ab45ff540e308d"
dest_uuid: "6508e02af03a488685f95c2de71536a1"
 from {username='slave'} at 127.0.0.1:41838
I20260709 12:58:29.784950  1200 raft_consensus.cc:493] T 197c75f75ec14fc0b3ab45ff540e308d P 6508e02af03a488685f95c2de71536a1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:29.785221  1200 raft_consensus.cc:3060] T 197c75f75ec14fc0b3ab45ff540e308d P 6508e02af03a488685f95c2de71536a1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:29.820895  1200 raft_consensus.cc:515] T 197c75f75ec14fc0b3ab45ff540e308d P 6508e02af03a488685f95c2de71536a1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:29.822621  1200 leader_election.cc:290] T 197c75f75ec14fc0b3ab45ff540e308d P 6508e02af03a488685f95c2de71536a1 [CANDIDATE]: Term 3 election: Requested vote from peers b82fd85b5d15463fb787fcd1e6196090 (127.0.107.193:35297), c213ad22ae2e4088a98d1b66e94c5544 (127.0.107.194:42287)
I20260709 12:58:29.823475  1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "197c75f75ec14fc0b3ab45ff540e308d" candidate_uuid: "6508e02af03a488685f95c2de71536a1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b82fd85b5d15463fb787fcd1e6196090"
I20260709 12:58:29.823897  1126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "197c75f75ec14fc0b3ab45ff540e308d" candidate_uuid: "6508e02af03a488685f95c2de71536a1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c213ad22ae2e4088a98d1b66e94c5544"
I20260709 12:58:29.824090  1050 raft_consensus.cc:3055] T 197c75f75ec14fc0b3ab45ff540e308d P b82fd85b5d15463fb787fcd1e6196090 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:29.824446  1050 raft_consensus.cc:740] T 197c75f75ec14fc0b3ab45ff540e308d P b82fd85b5d15463fb787fcd1e6196090 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b82fd85b5d15463fb787fcd1e6196090, State: Running, Role: LEADER
I20260709 12:58:29.824479  1126 raft_consensus.cc:3060] T 197c75f75ec14fc0b3ab45ff540e308d P c213ad22ae2e4088a98d1b66e94c5544 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:29.825287  1050 consensus_queue.cc:260] T 197c75f75ec14fc0b3ab45ff540e308d P b82fd85b5d15463fb787fcd1e6196090 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:29.826195  1050 raft_consensus.cc:3060] T 197c75f75ec14fc0b3ab45ff540e308d P b82fd85b5d15463fb787fcd1e6196090 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:29.923035  1050 raft_consensus.cc:2468] T 197c75f75ec14fc0b3ab45ff540e308d P b82fd85b5d15463fb787fcd1e6196090 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6508e02af03a488685f95c2de71536a1 in term 3.
I20260709 12:58:29.923035  1126 raft_consensus.cc:2468] T 197c75f75ec14fc0b3ab45ff540e308d P c213ad22ae2e4088a98d1b66e94c5544 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6508e02af03a488685f95c2de71536a1 in term 3.
I20260709 12:58:29.924381  1164 leader_election.cc:304] T 197c75f75ec14fc0b3ab45ff540e308d P 6508e02af03a488685f95c2de71536a1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6508e02af03a488685f95c2de71536a1, b82fd85b5d15463fb787fcd1e6196090; no voters: 
I20260709 12:58:29.925108  1279 raft_consensus.cc:2804] T 197c75f75ec14fc0b3ab45ff540e308d P 6508e02af03a488685f95c2de71536a1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:29.926340  1279 raft_consensus.cc:697] T 197c75f75ec14fc0b3ab45ff540e308d P 6508e02af03a488685f95c2de71536a1 [term 3 LEADER]: Becoming Leader. State: Replica: 6508e02af03a488685f95c2de71536a1, State: Running, Role: LEADER
I20260709 12:58:29.927078  1279 consensus_queue.cc:237] T 197c75f75ec14fc0b3ab45ff540e308d P 6508e02af03a488685f95c2de71536a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:29.934527   949 catalog_manager.cc:5697] T 197c75f75ec14fc0b3ab45ff540e308d P 6508e02af03a488685f95c2de71536a1 reported cstate change: term changed from 2 to 3, leader changed from b82fd85b5d15463fb787fcd1e6196090 (127.0.107.193) to 6508e02af03a488685f95c2de71536a1 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "6508e02af03a488685f95c2de71536a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:30.038703  1332 raft_consensus.cc:993] T 95a5561ec0684e6e955493c7f892e02a P b82fd85b5d15463fb787fcd1e6196090: : Instructing follower 6508e02af03a488685f95c2de71536a1 to start an election
I20260709 12:58:30.039144  1332 raft_consensus.cc:1081] T 95a5561ec0684e6e955493c7f892e02a P b82fd85b5d15463fb787fcd1e6196090 [term 1 LEADER]: Signalling peer 6508e02af03a488685f95c2de71536a1 to start an election
I20260709 12:58:30.040551  1200 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "95a5561ec0684e6e955493c7f892e02a"
dest_uuid: "6508e02af03a488685f95c2de71536a1"
 from {username='slave'} at 127.0.0.1:41838
I20260709 12:58:30.040956  1200 raft_consensus.cc:493] T 95a5561ec0684e6e955493c7f892e02a P 6508e02af03a488685f95c2de71536a1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:30.041184  1200 raft_consensus.cc:3060] T 95a5561ec0684e6e955493c7f892e02a P 6508e02af03a488685f95c2de71536a1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:30.104997  1200 raft_consensus.cc:515] T 95a5561ec0684e6e955493c7f892e02a P 6508e02af03a488685f95c2de71536a1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:30.106417  1200 leader_election.cc:290] T 95a5561ec0684e6e955493c7f892e02a P 6508e02af03a488685f95c2de71536a1 [CANDIDATE]: Term 2 election: Requested vote from peers b82fd85b5d15463fb787fcd1e6196090 (127.0.107.193:35297), c213ad22ae2e4088a98d1b66e94c5544 (127.0.107.194:42287)
I20260709 12:58:30.107524  1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a5561ec0684e6e955493c7f892e02a" candidate_uuid: "6508e02af03a488685f95c2de71536a1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b82fd85b5d15463fb787fcd1e6196090"
I20260709 12:58:30.108088  1050 raft_consensus.cc:3055] T 95a5561ec0684e6e955493c7f892e02a P b82fd85b5d15463fb787fcd1e6196090 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:30.108333  1050 raft_consensus.cc:740] T 95a5561ec0684e6e955493c7f892e02a P b82fd85b5d15463fb787fcd1e6196090 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b82fd85b5d15463fb787fcd1e6196090, State: Running, Role: LEADER
I20260709 12:58:30.108260  1126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a5561ec0684e6e955493c7f892e02a" candidate_uuid: "6508e02af03a488685f95c2de71536a1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c213ad22ae2e4088a98d1b66e94c5544"
I20260709 12:58:30.108896  1126 raft_consensus.cc:3060] T 95a5561ec0684e6e955493c7f892e02a P c213ad22ae2e4088a98d1b66e94c5544 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:30.109122  1050 consensus_queue.cc:260] T 95a5561ec0684e6e955493c7f892e02a P b82fd85b5d15463fb787fcd1e6196090 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:30.110069  1050 raft_consensus.cc:3060] T 95a5561ec0684e6e955493c7f892e02a P b82fd85b5d15463fb787fcd1e6196090 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:30.208036  1050 raft_consensus.cc:2468] T 95a5561ec0684e6e955493c7f892e02a P b82fd85b5d15463fb787fcd1e6196090 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6508e02af03a488685f95c2de71536a1 in term 2.
I20260709 12:58:30.208041  1126 raft_consensus.cc:2468] T 95a5561ec0684e6e955493c7f892e02a P c213ad22ae2e4088a98d1b66e94c5544 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6508e02af03a488685f95c2de71536a1 in term 2.
I20260709 12:58:30.209292  1164 leader_election.cc:304] T 95a5561ec0684e6e955493c7f892e02a P 6508e02af03a488685f95c2de71536a1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6508e02af03a488685f95c2de71536a1, b82fd85b5d15463fb787fcd1e6196090; no voters: 
I20260709 12:58:30.209965  1279 raft_consensus.cc:2804] T 95a5561ec0684e6e955493c7f892e02a P 6508e02af03a488685f95c2de71536a1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:30.210428  1279 raft_consensus.cc:697] T 95a5561ec0684e6e955493c7f892e02a P 6508e02af03a488685f95c2de71536a1 [term 2 LEADER]: Becoming Leader. State: Replica: 6508e02af03a488685f95c2de71536a1, State: Running, Role: LEADER
I20260709 12:58:30.211130  1279 consensus_queue.cc:237] T 95a5561ec0684e6e955493c7f892e02a P 6508e02af03a488685f95c2de71536a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:30.217653   949 catalog_manager.cc:5697] T 95a5561ec0684e6e955493c7f892e02a P 6508e02af03a488685f95c2de71536a1 reported cstate change: term changed from 1 to 2, leader changed from b82fd85b5d15463fb787fcd1e6196090 (127.0.107.193) to 6508e02af03a488685f95c2de71536a1 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "6508e02af03a488685f95c2de71536a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:30.316102  1050 raft_consensus.cc:1275] T 197c75f75ec14fc0b3ab45ff540e308d P b82fd85b5d15463fb787fcd1e6196090 [term 3 FOLLOWER]: Refusing update from remote peer 6508e02af03a488685f95c2de71536a1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:30.317292  1279 consensus_queue.cc:1048] T 197c75f75ec14fc0b3ab45ff540e308d P 6508e02af03a488685f95c2de71536a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:30.326709  1126 raft_consensus.cc:1275] T 197c75f75ec14fc0b3ab45ff540e308d P c213ad22ae2e4088a98d1b66e94c5544 [term 3 FOLLOWER]: Refusing update from remote peer 6508e02af03a488685f95c2de71536a1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:30.328328  1279 consensus_queue.cc:1048] T 197c75f75ec14fc0b3ab45ff540e308d P 6508e02af03a488685f95c2de71536a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:30.620883  1126 raft_consensus.cc:1275] T 95a5561ec0684e6e955493c7f892e02a P c213ad22ae2e4088a98d1b66e94c5544 [term 2 FOLLOWER]: Refusing update from remote peer 6508e02af03a488685f95c2de71536a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:30.622118  1279 consensus_queue.cc:1048] T 95a5561ec0684e6e955493c7f892e02a P 6508e02af03a488685f95c2de71536a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:30.630720  1050 raft_consensus.cc:1275] T 95a5561ec0684e6e955493c7f892e02a P b82fd85b5d15463fb787fcd1e6196090 [term 2 FOLLOWER]: Refusing update from remote peer 6508e02af03a488685f95c2de71536a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:30.632292  1349 consensus_queue.cc:1048] T 95a5561ec0684e6e955493c7f892e02a P 6508e02af03a488685f95c2de71536a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:30.673676   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:30.687394  1200 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "197c75f75ec14fc0b3ab45ff540e308d"
dest_uuid: "6508e02af03a488685f95c2de71536a1"
mode: GRACEFUL
new_leader_uuid: "b82fd85b5d15463fb787fcd1e6196090"
 from {username='slave'} at 127.0.0.1:41840
I20260709 12:58:30.687914  1200 raft_consensus.cc:606] T 197c75f75ec14fc0b3ab45ff540e308d P 6508e02af03a488685f95c2de71536a1 [term 3 LEADER]: Received request to transfer leadership to TS b82fd85b5d15463fb787fcd1e6196090
I20260709 12:58:30.695597  1200 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "95a5561ec0684e6e955493c7f892e02a"
dest_uuid: "6508e02af03a488685f95c2de71536a1"
mode: GRACEFUL
new_leader_uuid: "b82fd85b5d15463fb787fcd1e6196090"
 from {username='slave'} at 127.0.0.1:41840
I20260709 12:58:30.696157  1200 raft_consensus.cc:606] T 95a5561ec0684e6e955493c7f892e02a P 6508e02af03a488685f95c2de71536a1 [term 2 LEADER]: Received request to transfer leadership to TS b82fd85b5d15463fb787fcd1e6196090
I20260709 12:58:30.703428  1126 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e8759b94cc204bc58848a9008afbeab7"
dest_uuid: "c213ad22ae2e4088a98d1b66e94c5544"
mode: GRACEFUL
new_leader_uuid: "b82fd85b5d15463fb787fcd1e6196090"
 from {username='slave'} at 127.0.0.1:51096
I20260709 12:58:30.704000  1126 raft_consensus.cc:606] T e8759b94cc204bc58848a9008afbeab7 P c213ad22ae2e4088a98d1b66e94c5544 [term 2 LEADER]: Received request to transfer leadership to TS b82fd85b5d15463fb787fcd1e6196090
I20260709 12:58:30.709096  1126 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bef759002c944c3095e9777eba3c28c1"
dest_uuid: "c213ad22ae2e4088a98d1b66e94c5544"
mode: GRACEFUL
new_leader_uuid: "b82fd85b5d15463fb787fcd1e6196090"
 from {username='slave'} at 127.0.0.1:51096
I20260709 12:58:30.709592  1126 raft_consensus.cc:606] T bef759002c944c3095e9777eba3c28c1 P c213ad22ae2e4088a98d1b66e94c5544 [term 2 LEADER]: Received request to transfer leadership to TS b82fd85b5d15463fb787fcd1e6196090
I20260709 12:58:30.714833  1126 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7a06197c7e30456f9219b872c66b66f1"
dest_uuid: "c213ad22ae2e4088a98d1b66e94c5544"
mode: GRACEFUL
new_leader_uuid: "b82fd85b5d15463fb787fcd1e6196090"
 from {username='slave'} at 127.0.0.1:51096
I20260709 12:58:30.715308  1126 raft_consensus.cc:606] T 7a06197c7e30456f9219b872c66b66f1 P c213ad22ae2e4088a98d1b66e94c5544 [term 2 LEADER]: Received request to transfer leadership to TS b82fd85b5d15463fb787fcd1e6196090
I20260709 12:58:30.805876  1351 raft_consensus.cc:993] T bef759002c944c3095e9777eba3c28c1 P c213ad22ae2e4088a98d1b66e94c5544: : Instructing follower b82fd85b5d15463fb787fcd1e6196090 to start an election
I20260709 12:58:30.806309  1245 raft_consensus.cc:1081] T bef759002c944c3095e9777eba3c28c1 P c213ad22ae2e4088a98d1b66e94c5544 [term 2 LEADER]: Signalling peer b82fd85b5d15463fb787fcd1e6196090 to start an election
I20260709 12:58:30.807914  1050 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bef759002c944c3095e9777eba3c28c1"
dest_uuid: "b82fd85b5d15463fb787fcd1e6196090"
 from {username='slave'} at 127.0.0.1:53580
I20260709 12:58:30.808388  1050 raft_consensus.cc:493] T bef759002c944c3095e9777eba3c28c1 P b82fd85b5d15463fb787fcd1e6196090 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:30.808715  1050 raft_consensus.cc:3060] T bef759002c944c3095e9777eba3c28c1 P b82fd85b5d15463fb787fcd1e6196090 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:30.814399  1050 raft_consensus.cc:515] T bef759002c944c3095e9777eba3c28c1 P b82fd85b5d15463fb787fcd1e6196090 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:30.816020  1050 leader_election.cc:290] T bef759002c944c3095e9777eba3c28c1 P b82fd85b5d15463fb787fcd1e6196090 [CANDIDATE]: Term 3 election: Requested vote from peers c213ad22ae2e4088a98d1b66e94c5544 (127.0.107.194:42287), 6508e02af03a488685f95c2de71536a1 (127.0.107.195:35017)
I20260709 12:58:30.816958  1200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bef759002c944c3095e9777eba3c28c1" candidate_uuid: "b82fd85b5d15463fb787fcd1e6196090" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6508e02af03a488685f95c2de71536a1"
I20260709 12:58:30.816888  1126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bef759002c944c3095e9777eba3c28c1" candidate_uuid: "b82fd85b5d15463fb787fcd1e6196090" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c213ad22ae2e4088a98d1b66e94c5544"
I20260709 12:58:30.817526  1200 raft_consensus.cc:3060] T bef759002c944c3095e9777eba3c28c1 P 6508e02af03a488685f95c2de71536a1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:30.817622  1126 raft_consensus.cc:3055] T bef759002c944c3095e9777eba3c28c1 P c213ad22ae2e4088a98d1b66e94c5544 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:30.818004  1126 raft_consensus.cc:740] T bef759002c944c3095e9777eba3c28c1 P c213ad22ae2e4088a98d1b66e94c5544 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c213ad22ae2e4088a98d1b66e94c5544, State: Running, Role: LEADER
I20260709 12:58:30.818625  1126 consensus_queue.cc:260] T bef759002c944c3095e9777eba3c28c1 P c213ad22ae2e4088a98d1b66e94c5544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:30.819568  1126 raft_consensus.cc:3060] T bef759002c944c3095e9777eba3c28c1 P c213ad22ae2e4088a98d1b66e94c5544 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:30.821787  1200 raft_consensus.cc:2468] T bef759002c944c3095e9777eba3c28c1 P 6508e02af03a488685f95c2de71536a1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b82fd85b5d15463fb787fcd1e6196090 in term 3.
I20260709 12:58:30.822844  1018 leader_election.cc:304] T bef759002c944c3095e9777eba3c28c1 P b82fd85b5d15463fb787fcd1e6196090 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6508e02af03a488685f95c2de71536a1, b82fd85b5d15463fb787fcd1e6196090; no voters: 
I20260709 12:58:30.823654  1332 raft_consensus.cc:2804] T bef759002c944c3095e9777eba3c28c1 P b82fd85b5d15463fb787fcd1e6196090 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:30.824601  1126 raft_consensus.cc:2468] T bef759002c944c3095e9777eba3c28c1 P c213ad22ae2e4088a98d1b66e94c5544 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b82fd85b5d15463fb787fcd1e6196090 in term 3.
I20260709 12:58:30.824606  1332 raft_consensus.cc:697] T bef759002c944c3095e9777eba3c28c1 P b82fd85b5d15463fb787fcd1e6196090 [term 3 LEADER]: Becoming Leader. State: Replica: b82fd85b5d15463fb787fcd1e6196090, State: Running, Role: LEADER
I20260709 12:58:30.825773  1332 consensus_queue.cc:237] T bef759002c944c3095e9777eba3c28c1 P b82fd85b5d15463fb787fcd1e6196090 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:30.832875   949 catalog_manager.cc:5697] T bef759002c944c3095e9777eba3c28c1 P b82fd85b5d15463fb787fcd1e6196090 reported cstate change: term changed from 2 to 3, leader changed from c213ad22ae2e4088a98d1b66e94c5544 (127.0.107.194) to b82fd85b5d15463fb787fcd1e6196090 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "b82fd85b5d15463fb787fcd1e6196090" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:30.934005  1336 raft_consensus.cc:993] T 197c75f75ec14fc0b3ab45ff540e308d P 6508e02af03a488685f95c2de71536a1: : Instructing follower b82fd85b5d15463fb787fcd1e6196090 to start an election
I20260709 12:58:30.934407  1336 raft_consensus.cc:1081] T 197c75f75ec14fc0b3ab45ff540e308d P 6508e02af03a488685f95c2de71536a1 [term 3 LEADER]: Signalling peer b82fd85b5d15463fb787fcd1e6196090 to start an election
I20260709 12:58:30.935878  1050 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "197c75f75ec14fc0b3ab45ff540e308d"
dest_uuid: "b82fd85b5d15463fb787fcd1e6196090"
 from {username='slave'} at 127.0.0.1:53588
I20260709 12:58:30.936357  1050 raft_consensus.cc:493] T 197c75f75ec14fc0b3ab45ff540e308d P b82fd85b5d15463fb787fcd1e6196090 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:30.936643  1050 raft_consensus.cc:3060] T 197c75f75ec14fc0b3ab45ff540e308d P b82fd85b5d15463fb787fcd1e6196090 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:30.941368  1050 raft_consensus.cc:515] T 197c75f75ec14fc0b3ab45ff540e308d P b82fd85b5d15463fb787fcd1e6196090 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:30.942811  1050 leader_election.cc:290] T 197c75f75ec14fc0b3ab45ff540e308d P b82fd85b5d15463fb787fcd1e6196090 [CANDIDATE]: Term 4 election: Requested vote from peers c213ad22ae2e4088a98d1b66e94c5544 (127.0.107.194:42287), 6508e02af03a488685f95c2de71536a1 (127.0.107.195:35017)
I20260709 12:58:30.943765  1200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "197c75f75ec14fc0b3ab45ff540e308d" candidate_uuid: "b82fd85b5d15463fb787fcd1e6196090" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "6508e02af03a488685f95c2de71536a1"
I20260709 12:58:30.943701  1126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "197c75f75ec14fc0b3ab45ff540e308d" candidate_uuid: "b82fd85b5d15463fb787fcd1e6196090" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c213ad22ae2e4088a98d1b66e94c5544"
I20260709 12:58:30.944373  1200 raft_consensus.cc:3055] T 197c75f75ec14fc0b3ab45ff540e308d P 6508e02af03a488685f95c2de71536a1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:30.944416  1126 raft_consensus.cc:3060] T 197c75f75ec14fc0b3ab45ff540e308d P c213ad22ae2e4088a98d1b66e94c5544 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:30.944799  1200 raft_consensus.cc:740] T 197c75f75ec14fc0b3ab45ff540e308d P 6508e02af03a488685f95c2de71536a1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6508e02af03a488685f95c2de71536a1, State: Running, Role: LEADER
I20260709 12:58:30.945504  1200 consensus_queue.cc:260] T 197c75f75ec14fc0b3ab45ff540e308d P 6508e02af03a488685f95c2de71536a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:30.946565  1200 raft_consensus.cc:3060] T 197c75f75ec14fc0b3ab45ff540e308d P 6508e02af03a488685f95c2de71536a1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:30.951051  1126 raft_consensus.cc:2468] T 197c75f75ec14fc0b3ab45ff540e308d P c213ad22ae2e4088a98d1b66e94c5544 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b82fd85b5d15463fb787fcd1e6196090 in term 4.
I20260709 12:58:30.952244  1200 raft_consensus.cc:2468] T 197c75f75ec14fc0b3ab45ff540e308d P 6508e02af03a488685f95c2de71536a1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b82fd85b5d15463fb787fcd1e6196090 in term 4.
I20260709 12:58:30.952216  1015 leader_election.cc:304] T 197c75f75ec14fc0b3ab45ff540e308d P b82fd85b5d15463fb787fcd1e6196090 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b82fd85b5d15463fb787fcd1e6196090, c213ad22ae2e4088a98d1b66e94c5544; no voters: 
I20260709 12:58:30.953051  1353 raft_consensus.cc:2804] T 197c75f75ec14fc0b3ab45ff540e308d P b82fd85b5d15463fb787fcd1e6196090 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:30.953841  1353 raft_consensus.cc:697] T 197c75f75ec14fc0b3ab45ff540e308d P b82fd85b5d15463fb787fcd1e6196090 [term 4 LEADER]: Becoming Leader. State: Replica: b82fd85b5d15463fb787fcd1e6196090, State: Running, Role: LEADER
I20260709 12:58:30.954412  1353 consensus_queue.cc:237] T 197c75f75ec14fc0b3ab45ff540e308d P b82fd85b5d15463fb787fcd1e6196090 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:30.959918   949 catalog_manager.cc:5697] T 197c75f75ec14fc0b3ab45ff540e308d P b82fd85b5d15463fb787fcd1e6196090 reported cstate change: term changed from 3 to 4, leader changed from 6508e02af03a488685f95c2de71536a1 (127.0.107.195) to b82fd85b5d15463fb787fcd1e6196090 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "b82fd85b5d15463fb787fcd1e6196090" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:30.996579  1245 raft_consensus.cc:993] T e8759b94cc204bc58848a9008afbeab7 P c213ad22ae2e4088a98d1b66e94c5544: : Instructing follower b82fd85b5d15463fb787fcd1e6196090 to start an election
I20260709 12:58:30.996938  1351 raft_consensus.cc:1081] T e8759b94cc204bc58848a9008afbeab7 P c213ad22ae2e4088a98d1b66e94c5544 [term 2 LEADER]: Signalling peer b82fd85b5d15463fb787fcd1e6196090 to start an election
I20260709 12:58:30.998260  1050 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e8759b94cc204bc58848a9008afbeab7"
dest_uuid: "b82fd85b5d15463fb787fcd1e6196090"
 from {username='slave'} at 127.0.0.1:53580
I20260709 12:58:30.998703  1050 raft_consensus.cc:493] T e8759b94cc204bc58848a9008afbeab7 P b82fd85b5d15463fb787fcd1e6196090 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:30.998968  1050 raft_consensus.cc:3060] T e8759b94cc204bc58848a9008afbeab7 P b82fd85b5d15463fb787fcd1e6196090 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:31.002740  1050 raft_consensus.cc:515] T e8759b94cc204bc58848a9008afbeab7 P b82fd85b5d15463fb787fcd1e6196090 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:31.004129  1050 leader_election.cc:290] T e8759b94cc204bc58848a9008afbeab7 P b82fd85b5d15463fb787fcd1e6196090 [CANDIDATE]: Term 3 election: Requested vote from peers c213ad22ae2e4088a98d1b66e94c5544 (127.0.107.194:42287), 6508e02af03a488685f95c2de71536a1 (127.0.107.195:35017)
I20260709 12:58:31.004983  1126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8759b94cc204bc58848a9008afbeab7" candidate_uuid: "b82fd85b5d15463fb787fcd1e6196090" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c213ad22ae2e4088a98d1b66e94c5544"
I20260709 12:58:31.005157  1200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8759b94cc204bc58848a9008afbeab7" candidate_uuid: "b82fd85b5d15463fb787fcd1e6196090" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6508e02af03a488685f95c2de71536a1"
I20260709 12:58:31.005439  1126 raft_consensus.cc:3055] T e8759b94cc204bc58848a9008afbeab7 P c213ad22ae2e4088a98d1b66e94c5544 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:31.005594  1200 raft_consensus.cc:3060] T e8759b94cc204bc58848a9008afbeab7 P 6508e02af03a488685f95c2de71536a1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:31.005724  1126 raft_consensus.cc:740] T e8759b94cc204bc58848a9008afbeab7 P c213ad22ae2e4088a98d1b66e94c5544 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c213ad22ae2e4088a98d1b66e94c5544, State: Running, Role: LEADER
I20260709 12:58:31.006453  1126 consensus_queue.cc:260] T e8759b94cc204bc58848a9008afbeab7 P c213ad22ae2e4088a98d1b66e94c5544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:31.007349  1126 raft_consensus.cc:3060] T e8759b94cc204bc58848a9008afbeab7 P c213ad22ae2e4088a98d1b66e94c5544 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:31.009718  1200 raft_consensus.cc:2468] T e8759b94cc204bc58848a9008afbeab7 P 6508e02af03a488685f95c2de71536a1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b82fd85b5d15463fb787fcd1e6196090 in term 3.
I20260709 12:58:31.010699  1018 leader_election.cc:304] T e8759b94cc204bc58848a9008afbeab7 P b82fd85b5d15463fb787fcd1e6196090 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6508e02af03a488685f95c2de71536a1, b82fd85b5d15463fb787fcd1e6196090; no voters: 
I20260709 12:58:31.011322  1353 raft_consensus.cc:2804] T e8759b94cc204bc58848a9008afbeab7 P b82fd85b5d15463fb787fcd1e6196090 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:31.011509  1126 raft_consensus.cc:2468] T e8759b94cc204bc58848a9008afbeab7 P c213ad22ae2e4088a98d1b66e94c5544 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b82fd85b5d15463fb787fcd1e6196090 in term 3.
I20260709 12:58:31.011682  1353 raft_consensus.cc:697] T e8759b94cc204bc58848a9008afbeab7 P b82fd85b5d15463fb787fcd1e6196090 [term 3 LEADER]: Becoming Leader. State: Replica: b82fd85b5d15463fb787fcd1e6196090, State: Running, Role: LEADER
I20260709 12:58:31.012495  1353 consensus_queue.cc:237] T e8759b94cc204bc58848a9008afbeab7 P b82fd85b5d15463fb787fcd1e6196090 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:31.019091   949 catalog_manager.cc:5697] T e8759b94cc204bc58848a9008afbeab7 P b82fd85b5d15463fb787fcd1e6196090 reported cstate change: term changed from 2 to 3, leader changed from c213ad22ae2e4088a98d1b66e94c5544 (127.0.107.194) to b82fd85b5d15463fb787fcd1e6196090 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "b82fd85b5d15463fb787fcd1e6196090" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:31.095948  1245 raft_consensus.cc:993] T 7a06197c7e30456f9219b872c66b66f1 P c213ad22ae2e4088a98d1b66e94c5544: : Instructing follower b82fd85b5d15463fb787fcd1e6196090 to start an election
I20260709 12:58:31.096311  1351 raft_consensus.cc:1081] T 7a06197c7e30456f9219b872c66b66f1 P c213ad22ae2e4088a98d1b66e94c5544 [term 2 LEADER]: Signalling peer b82fd85b5d15463fb787fcd1e6196090 to start an election
I20260709 12:58:31.097551  1050 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7a06197c7e30456f9219b872c66b66f1"
dest_uuid: "b82fd85b5d15463fb787fcd1e6196090"
 from {username='slave'} at 127.0.0.1:53580
I20260709 12:58:31.097986  1050 raft_consensus.cc:493] T 7a06197c7e30456f9219b872c66b66f1 P b82fd85b5d15463fb787fcd1e6196090 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:31.098289  1050 raft_consensus.cc:3060] T 7a06197c7e30456f9219b872c66b66f1 P b82fd85b5d15463fb787fcd1e6196090 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:31.102185  1050 raft_consensus.cc:515] T 7a06197c7e30456f9219b872c66b66f1 P b82fd85b5d15463fb787fcd1e6196090 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:31.103596  1050 leader_election.cc:290] T 7a06197c7e30456f9219b872c66b66f1 P b82fd85b5d15463fb787fcd1e6196090 [CANDIDATE]: Term 3 election: Requested vote from peers c213ad22ae2e4088a98d1b66e94c5544 (127.0.107.194:42287), 6508e02af03a488685f95c2de71536a1 (127.0.107.195:35017)
I20260709 12:58:31.104568  1126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a06197c7e30456f9219b872c66b66f1" candidate_uuid: "b82fd85b5d15463fb787fcd1e6196090" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c213ad22ae2e4088a98d1b66e94c5544"
I20260709 12:58:31.104701  1200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a06197c7e30456f9219b872c66b66f1" candidate_uuid: "b82fd85b5d15463fb787fcd1e6196090" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6508e02af03a488685f95c2de71536a1"
I20260709 12:58:31.105007  1126 raft_consensus.cc:3055] T 7a06197c7e30456f9219b872c66b66f1 P c213ad22ae2e4088a98d1b66e94c5544 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:31.105140  1200 raft_consensus.cc:3060] T 7a06197c7e30456f9219b872c66b66f1 P 6508e02af03a488685f95c2de71536a1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:31.105264  1126 raft_consensus.cc:740] T 7a06197c7e30456f9219b872c66b66f1 P c213ad22ae2e4088a98d1b66e94c5544 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c213ad22ae2e4088a98d1b66e94c5544, State: Running, Role: LEADER
I20260709 12:58:31.105924  1126 consensus_queue.cc:260] T 7a06197c7e30456f9219b872c66b66f1 P c213ad22ae2e4088a98d1b66e94c5544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:31.106909  1126 raft_consensus.cc:3060] T 7a06197c7e30456f9219b872c66b66f1 P c213ad22ae2e4088a98d1b66e94c5544 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:31.109200  1200 raft_consensus.cc:2468] T 7a06197c7e30456f9219b872c66b66f1 P 6508e02af03a488685f95c2de71536a1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b82fd85b5d15463fb787fcd1e6196090 in term 3.
I20260709 12:58:31.110090  1018 leader_election.cc:304] T 7a06197c7e30456f9219b872c66b66f1 P b82fd85b5d15463fb787fcd1e6196090 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6508e02af03a488685f95c2de71536a1, b82fd85b5d15463fb787fcd1e6196090; no voters: 
I20260709 12:58:31.110702  1126 raft_consensus.cc:2468] T 7a06197c7e30456f9219b872c66b66f1 P c213ad22ae2e4088a98d1b66e94c5544 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b82fd85b5d15463fb787fcd1e6196090 in term 3.
I20260709 12:58:31.110741  1353 raft_consensus.cc:2804] T 7a06197c7e30456f9219b872c66b66f1 P b82fd85b5d15463fb787fcd1e6196090 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:31.111266  1353 raft_consensus.cc:697] T 7a06197c7e30456f9219b872c66b66f1 P b82fd85b5d15463fb787fcd1e6196090 [term 3 LEADER]: Becoming Leader. State: Replica: b82fd85b5d15463fb787fcd1e6196090, State: Running, Role: LEADER
I20260709 12:58:31.112020  1353 consensus_queue.cc:237] T 7a06197c7e30456f9219b872c66b66f1 P b82fd85b5d15463fb787fcd1e6196090 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:31.118257   949 catalog_manager.cc:5697] T 7a06197c7e30456f9219b872c66b66f1 P b82fd85b5d15463fb787fcd1e6196090 reported cstate change: term changed from 2 to 3, leader changed from c213ad22ae2e4088a98d1b66e94c5544 (127.0.107.194) to b82fd85b5d15463fb787fcd1e6196090 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "b82fd85b5d15463fb787fcd1e6196090" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:31.182614  1336 raft_consensus.cc:993] T 95a5561ec0684e6e955493c7f892e02a P 6508e02af03a488685f95c2de71536a1: : Instructing follower b82fd85b5d15463fb787fcd1e6196090 to start an election
I20260709 12:58:31.183051  1349 raft_consensus.cc:1081] T 95a5561ec0684e6e955493c7f892e02a P 6508e02af03a488685f95c2de71536a1 [term 2 LEADER]: Signalling peer b82fd85b5d15463fb787fcd1e6196090 to start an election
I20260709 12:58:31.184413  1050 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "95a5561ec0684e6e955493c7f892e02a"
dest_uuid: "b82fd85b5d15463fb787fcd1e6196090"
 from {username='slave'} at 127.0.0.1:53588
I20260709 12:58:31.184873  1050 raft_consensus.cc:493] T 95a5561ec0684e6e955493c7f892e02a P b82fd85b5d15463fb787fcd1e6196090 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:31.185202  1050 raft_consensus.cc:3060] T 95a5561ec0684e6e955493c7f892e02a P b82fd85b5d15463fb787fcd1e6196090 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:31.189182  1050 raft_consensus.cc:515] T 95a5561ec0684e6e955493c7f892e02a P b82fd85b5d15463fb787fcd1e6196090 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:31.190814  1050 leader_election.cc:290] T 95a5561ec0684e6e955493c7f892e02a P b82fd85b5d15463fb787fcd1e6196090 [CANDIDATE]: Term 3 election: Requested vote from peers c213ad22ae2e4088a98d1b66e94c5544 (127.0.107.194:42287), 6508e02af03a488685f95c2de71536a1 (127.0.107.195:35017)
I20260709 12:58:31.191526  1126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a5561ec0684e6e955493c7f892e02a" candidate_uuid: "b82fd85b5d15463fb787fcd1e6196090" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c213ad22ae2e4088a98d1b66e94c5544"
I20260709 12:58:31.191830  1200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a5561ec0684e6e955493c7f892e02a" candidate_uuid: "b82fd85b5d15463fb787fcd1e6196090" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6508e02af03a488685f95c2de71536a1"
I20260709 12:58:31.192013  1126 raft_consensus.cc:3060] T 95a5561ec0684e6e955493c7f892e02a P c213ad22ae2e4088a98d1b66e94c5544 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:31.192281  1200 raft_consensus.cc:3055] T 95a5561ec0684e6e955493c7f892e02a P 6508e02af03a488685f95c2de71536a1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:31.192507  1200 raft_consensus.cc:740] T 95a5561ec0684e6e955493c7f892e02a P 6508e02af03a488685f95c2de71536a1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6508e02af03a488685f95c2de71536a1, State: Running, Role: LEADER
I20260709 12:58:31.193070  1200 consensus_queue.cc:260] T 95a5561ec0684e6e955493c7f892e02a P 6508e02af03a488685f95c2de71536a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:31.193819  1200 raft_consensus.cc:3060] T 95a5561ec0684e6e955493c7f892e02a P 6508e02af03a488685f95c2de71536a1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:31.196178  1126 raft_consensus.cc:2468] T 95a5561ec0684e6e955493c7f892e02a P c213ad22ae2e4088a98d1b66e94c5544 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b82fd85b5d15463fb787fcd1e6196090 in term 3.
I20260709 12:58:31.197115  1015 leader_election.cc:304] T 95a5561ec0684e6e955493c7f892e02a P b82fd85b5d15463fb787fcd1e6196090 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b82fd85b5d15463fb787fcd1e6196090, c213ad22ae2e4088a98d1b66e94c5544; no voters: 
I20260709 12:58:31.197746  1353 raft_consensus.cc:2804] T 95a5561ec0684e6e955493c7f892e02a P b82fd85b5d15463fb787fcd1e6196090 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:31.198189  1353 raft_consensus.cc:697] T 95a5561ec0684e6e955493c7f892e02a P b82fd85b5d15463fb787fcd1e6196090 [term 3 LEADER]: Becoming Leader. State: Replica: b82fd85b5d15463fb787fcd1e6196090, State: Running, Role: LEADER
I20260709 12:58:31.198484  1200 raft_consensus.cc:2468] T 95a5561ec0684e6e955493c7f892e02a P 6508e02af03a488685f95c2de71536a1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b82fd85b5d15463fb787fcd1e6196090 in term 3.
I20260709 12:58:31.199128  1353 consensus_queue.cc:237] T 95a5561ec0684e6e955493c7f892e02a P b82fd85b5d15463fb787fcd1e6196090 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:31.204723   949 catalog_manager.cc:5697] T 95a5561ec0684e6e955493c7f892e02a P b82fd85b5d15463fb787fcd1e6196090 reported cstate change: term changed from 2 to 3, leader changed from 6508e02af03a488685f95c2de71536a1 (127.0.107.195) to b82fd85b5d15463fb787fcd1e6196090 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "b82fd85b5d15463fb787fcd1e6196090" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:31.251818  1200 raft_consensus.cc:1275] T bef759002c944c3095e9777eba3c28c1 P 6508e02af03a488685f95c2de71536a1 [term 3 FOLLOWER]: Refusing update from remote peer b82fd85b5d15463fb787fcd1e6196090: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:31.252882  1353 consensus_queue.cc:1048] T bef759002c944c3095e9777eba3c28c1 P b82fd85b5d15463fb787fcd1e6196090 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:31.261713  1126 raft_consensus.cc:1275] T bef759002c944c3095e9777eba3c28c1 P c213ad22ae2e4088a98d1b66e94c5544 [term 3 FOLLOWER]: Refusing update from remote peer b82fd85b5d15463fb787fcd1e6196090: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:31.263110  1362 consensus_queue.cc:1048] T bef759002c944c3095e9777eba3c28c1 P b82fd85b5d15463fb787fcd1e6196090 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:31.394044  1126 raft_consensus.cc:1275] T 197c75f75ec14fc0b3ab45ff540e308d P c213ad22ae2e4088a98d1b66e94c5544 [term 4 FOLLOWER]: Refusing update from remote peer b82fd85b5d15463fb787fcd1e6196090: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:58:31.395097  1362 consensus_queue.cc:1048] T 197c75f75ec14fc0b3ab45ff540e308d P b82fd85b5d15463fb787fcd1e6196090 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:31.402864  1200 raft_consensus.cc:1275] T 197c75f75ec14fc0b3ab45ff540e308d P 6508e02af03a488685f95c2de71536a1 [term 4 FOLLOWER]: Refusing update from remote peer b82fd85b5d15463fb787fcd1e6196090: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:58:31.404625  1352 consensus_queue.cc:1048] T 197c75f75ec14fc0b3ab45ff540e308d P b82fd85b5d15463fb787fcd1e6196090 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:31.412107  1201 raft_consensus.cc:1275] T e8759b94cc204bc58848a9008afbeab7 P 6508e02af03a488685f95c2de71536a1 [term 3 FOLLOWER]: Refusing update from remote peer b82fd85b5d15463fb787fcd1e6196090: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:31.413362  1352 consensus_queue.cc:1048] T e8759b94cc204bc58848a9008afbeab7 P b82fd85b5d15463fb787fcd1e6196090 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:31.422519  1126 raft_consensus.cc:1275] T e8759b94cc204bc58848a9008afbeab7 P c213ad22ae2e4088a98d1b66e94c5544 [term 3 FOLLOWER]: Refusing update from remote peer b82fd85b5d15463fb787fcd1e6196090: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:31.424238  1369 consensus_queue.cc:1048] T e8759b94cc204bc58848a9008afbeab7 P b82fd85b5d15463fb787fcd1e6196090 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:31.514828  1126 raft_consensus.cc:1275] T 7a06197c7e30456f9219b872c66b66f1 P c213ad22ae2e4088a98d1b66e94c5544 [term 3 FOLLOWER]: Refusing update from remote peer b82fd85b5d15463fb787fcd1e6196090: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:31.516065  1369 consensus_queue.cc:1048] T 7a06197c7e30456f9219b872c66b66f1 P b82fd85b5d15463fb787fcd1e6196090 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:31.523799  1201 raft_consensus.cc:1275] T 7a06197c7e30456f9219b872c66b66f1 P 6508e02af03a488685f95c2de71536a1 [term 3 FOLLOWER]: Refusing update from remote peer b82fd85b5d15463fb787fcd1e6196090: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:31.525511  1362 consensus_queue.cc:1048] T 7a06197c7e30456f9219b872c66b66f1 P b82fd85b5d15463fb787fcd1e6196090 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:31.614620  1126 raft_consensus.cc:1275] T 95a5561ec0684e6e955493c7f892e02a P c213ad22ae2e4088a98d1b66e94c5544 [term 3 FOLLOWER]: Refusing update from remote peer b82fd85b5d15463fb787fcd1e6196090: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:31.615881  1362 consensus_queue.cc:1048] T 95a5561ec0684e6e955493c7f892e02a P b82fd85b5d15463fb787fcd1e6196090 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:31.623663  1201 raft_consensus.cc:1275] T 95a5561ec0684e6e955493c7f892e02a P 6508e02af03a488685f95c2de71536a1 [term 3 FOLLOWER]: Refusing update from remote peer b82fd85b5d15463fb787fcd1e6196090: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:31.625245  1352 consensus_queue.cc:1048] T 95a5561ec0684e6e955493c7f892e02a P b82fd85b5d15463fb787fcd1e6196090 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:33.722990   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:33.731063  1050 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7a06197c7e30456f9219b872c66b66f1"
dest_uuid: "b82fd85b5d15463fb787fcd1e6196090"
mode: GRACEFUL
new_leader_uuid: "c213ad22ae2e4088a98d1b66e94c5544"
 from {username='slave'} at 127.0.0.1:53610
I20260709 12:58:33.731961  1050 raft_consensus.cc:606] T 7a06197c7e30456f9219b872c66b66f1 P b82fd85b5d15463fb787fcd1e6196090 [term 3 LEADER]: Received request to transfer leadership to TS c213ad22ae2e4088a98d1b66e94c5544
I20260709 12:58:33.734579  1050 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "95a5561ec0684e6e955493c7f892e02a"
dest_uuid: "b82fd85b5d15463fb787fcd1e6196090"
mode: GRACEFUL
new_leader_uuid: "6508e02af03a488685f95c2de71536a1"
 from {username='slave'} at 127.0.0.1:53610
I20260709 12:58:33.735023  1050 raft_consensus.cc:606] T 95a5561ec0684e6e955493c7f892e02a P b82fd85b5d15463fb787fcd1e6196090 [term 3 LEADER]: Received request to transfer leadership to TS 6508e02af03a488685f95c2de71536a1
I20260709 12:58:33.737138  1050 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bef759002c944c3095e9777eba3c28c1"
dest_uuid: "b82fd85b5d15463fb787fcd1e6196090"
mode: GRACEFUL
new_leader_uuid: "c213ad22ae2e4088a98d1b66e94c5544"
 from {username='slave'} at 127.0.0.1:53610
I20260709 12:58:33.737533  1050 raft_consensus.cc:606] T bef759002c944c3095e9777eba3c28c1 P b82fd85b5d15463fb787fcd1e6196090 [term 3 LEADER]: Received request to transfer leadership to TS c213ad22ae2e4088a98d1b66e94c5544
I20260709 12:58:33.739586  1050 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cc64d897105f4ef08f524f3545b807e0"
dest_uuid: "b82fd85b5d15463fb787fcd1e6196090"
mode: GRACEFUL
new_leader_uuid: "6508e02af03a488685f95c2de71536a1"
 from {username='slave'} at 127.0.0.1:53610
I20260709 12:58:33.739971  1050 raft_consensus.cc:606] T cc64d897105f4ef08f524f3545b807e0 P b82fd85b5d15463fb787fcd1e6196090 [term 1 LEADER]: Received request to transfer leadership to TS 6508e02af03a488685f95c2de71536a1
I20260709 12:58:33.740832   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:58:33.741247   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:58:33.904141  1332 raft_consensus.cc:993] T cc64d897105f4ef08f524f3545b807e0 P b82fd85b5d15463fb787fcd1e6196090: : Instructing follower 6508e02af03a488685f95c2de71536a1 to start an election
I20260709 12:58:33.904757  1378 raft_consensus.cc:1081] T cc64d897105f4ef08f524f3545b807e0 P b82fd85b5d15463fb787fcd1e6196090 [term 1 LEADER]: Signalling peer 6508e02af03a488685f95c2de71536a1 to start an election
I20260709 12:58:33.906483  1200 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cc64d897105f4ef08f524f3545b807e0"
dest_uuid: "6508e02af03a488685f95c2de71536a1"
 from {username='slave'} at 127.0.0.1:41838
I20260709 12:58:33.907083  1200 raft_consensus.cc:493] T cc64d897105f4ef08f524f3545b807e0 P 6508e02af03a488685f95c2de71536a1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:33.907418  1200 raft_consensus.cc:3060] T cc64d897105f4ef08f524f3545b807e0 P 6508e02af03a488685f95c2de71536a1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:33.912160  1200 raft_consensus.cc:515] T cc64d897105f4ef08f524f3545b807e0 P 6508e02af03a488685f95c2de71536a1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:33.913864  1200 leader_election.cc:290] T cc64d897105f4ef08f524f3545b807e0 P 6508e02af03a488685f95c2de71536a1 [CANDIDATE]: Term 2 election: Requested vote from peers b82fd85b5d15463fb787fcd1e6196090 (127.0.107.193:35297), c213ad22ae2e4088a98d1b66e94c5544 (127.0.107.194:42287)
I20260709 12:58:33.914757  1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc64d897105f4ef08f524f3545b807e0" candidate_uuid: "6508e02af03a488685f95c2de71536a1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b82fd85b5d15463fb787fcd1e6196090"
I20260709 12:58:33.915138  1126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc64d897105f4ef08f524f3545b807e0" candidate_uuid: "6508e02af03a488685f95c2de71536a1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c213ad22ae2e4088a98d1b66e94c5544"
I20260709 12:58:33.915491  1050 raft_consensus.cc:3055] T cc64d897105f4ef08f524f3545b807e0 P b82fd85b5d15463fb787fcd1e6196090 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:33.915603  1126 raft_consensus.cc:3060] T cc64d897105f4ef08f524f3545b807e0 P c213ad22ae2e4088a98d1b66e94c5544 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:33.915793  1050 raft_consensus.cc:740] T cc64d897105f4ef08f524f3545b807e0 P b82fd85b5d15463fb787fcd1e6196090 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b82fd85b5d15463fb787fcd1e6196090, State: Running, Role: LEADER
I20260709 12:58:33.916673  1050 consensus_queue.cc:260] T cc64d897105f4ef08f524f3545b807e0 P b82fd85b5d15463fb787fcd1e6196090 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:33.917902  1050 raft_consensus.cc:3060] T cc64d897105f4ef08f524f3545b807e0 P b82fd85b5d15463fb787fcd1e6196090 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:33.922511  1126 raft_consensus.cc:2468] T cc64d897105f4ef08f524f3545b807e0 P c213ad22ae2e4088a98d1b66e94c5544 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6508e02af03a488685f95c2de71536a1 in term 2.
I20260709 12:58:33.924470  1050 raft_consensus.cc:2468] T cc64d897105f4ef08f524f3545b807e0 P b82fd85b5d15463fb787fcd1e6196090 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6508e02af03a488685f95c2de71536a1 in term 2.
I20260709 12:58:33.925838  1164 leader_election.cc:304] T cc64d897105f4ef08f524f3545b807e0 P 6508e02af03a488685f95c2de71536a1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6508e02af03a488685f95c2de71536a1, b82fd85b5d15463fb787fcd1e6196090; no voters: 
I20260709 12:58:33.927403  1376 raft_consensus.cc:2804] T cc64d897105f4ef08f524f3545b807e0 P 6508e02af03a488685f95c2de71536a1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:33.928345  1376 raft_consensus.cc:697] T cc64d897105f4ef08f524f3545b807e0 P 6508e02af03a488685f95c2de71536a1 [term 2 LEADER]: Becoming Leader. State: Replica: 6508e02af03a488685f95c2de71536a1, State: Running, Role: LEADER
I20260709 12:58:33.929102  1376 consensus_queue.cc:237] T cc64d897105f4ef08f524f3545b807e0 P 6508e02af03a488685f95c2de71536a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:33.935927   949 catalog_manager.cc:5697] T cc64d897105f4ef08f524f3545b807e0 P 6508e02af03a488685f95c2de71536a1 reported cstate change: term changed from 1 to 2, leader changed from b82fd85b5d15463fb787fcd1e6196090 (127.0.107.193) to 6508e02af03a488685f95c2de71536a1 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "6508e02af03a488685f95c2de71536a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:33.993966  1377 raft_consensus.cc:993] T 95a5561ec0684e6e955493c7f892e02a P b82fd85b5d15463fb787fcd1e6196090: : Instructing follower 6508e02af03a488685f95c2de71536a1 to start an election
I20260709 12:58:33.994395  1378 raft_consensus.cc:1081] T 95a5561ec0684e6e955493c7f892e02a P b82fd85b5d15463fb787fcd1e6196090 [term 3 LEADER]: Signalling peer 6508e02af03a488685f95c2de71536a1 to start an election
I20260709 12:58:33.995900  1200 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "95a5561ec0684e6e955493c7f892e02a"
dest_uuid: "6508e02af03a488685f95c2de71536a1"
 from {username='slave'} at 127.0.0.1:41838
I20260709 12:58:33.996338  1200 raft_consensus.cc:493] T 95a5561ec0684e6e955493c7f892e02a P 6508e02af03a488685f95c2de71536a1 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:33.996577  1200 raft_consensus.cc:3060] T 95a5561ec0684e6e955493c7f892e02a P 6508e02af03a488685f95c2de71536a1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:34.000715  1200 raft_consensus.cc:515] T 95a5561ec0684e6e955493c7f892e02a P 6508e02af03a488685f95c2de71536a1 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:34.002064  1200 leader_election.cc:290] T 95a5561ec0684e6e955493c7f892e02a P 6508e02af03a488685f95c2de71536a1 [CANDIDATE]: Term 4 election: Requested vote from peers b82fd85b5d15463fb787fcd1e6196090 (127.0.107.193:35297), c213ad22ae2e4088a98d1b66e94c5544 (127.0.107.194:42287)
I20260709 12:58:34.002912  1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a5561ec0684e6e955493c7f892e02a" candidate_uuid: "6508e02af03a488685f95c2de71536a1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b82fd85b5d15463fb787fcd1e6196090"
I20260709 12:58:34.003130  1126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a5561ec0684e6e955493c7f892e02a" candidate_uuid: "6508e02af03a488685f95c2de71536a1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c213ad22ae2e4088a98d1b66e94c5544"
I20260709 12:58:34.003355  1050 raft_consensus.cc:3055] T 95a5561ec0684e6e955493c7f892e02a P b82fd85b5d15463fb787fcd1e6196090 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:34.003603  1050 raft_consensus.cc:740] T 95a5561ec0684e6e955493c7f892e02a P b82fd85b5d15463fb787fcd1e6196090 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b82fd85b5d15463fb787fcd1e6196090, State: Running, Role: LEADER
I20260709 12:58:34.003613  1126 raft_consensus.cc:3060] T 95a5561ec0684e6e955493c7f892e02a P c213ad22ae2e4088a98d1b66e94c5544 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:34.004268  1050 consensus_queue.cc:260] T 95a5561ec0684e6e955493c7f892e02a P b82fd85b5d15463fb787fcd1e6196090 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:34.005117  1050 raft_consensus.cc:3060] T 95a5561ec0684e6e955493c7f892e02a P b82fd85b5d15463fb787fcd1e6196090 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:34.008031  1126 raft_consensus.cc:2468] T 95a5561ec0684e6e955493c7f892e02a P c213ad22ae2e4088a98d1b66e94c5544 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6508e02af03a488685f95c2de71536a1 in term 4.
I20260709 12:58:34.009074  1164 leader_election.cc:304] T 95a5561ec0684e6e955493c7f892e02a P 6508e02af03a488685f95c2de71536a1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6508e02af03a488685f95c2de71536a1, c213ad22ae2e4088a98d1b66e94c5544; no voters: 
I20260709 12:58:34.009357  1050 raft_consensus.cc:2468] T 95a5561ec0684e6e955493c7f892e02a P b82fd85b5d15463fb787fcd1e6196090 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6508e02af03a488685f95c2de71536a1 in term 4.
I20260709 12:58:34.009759  1376 raft_consensus.cc:2804] T 95a5561ec0684e6e955493c7f892e02a P 6508e02af03a488685f95c2de71536a1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:34.010252  1376 raft_consensus.cc:697] T 95a5561ec0684e6e955493c7f892e02a P 6508e02af03a488685f95c2de71536a1 [term 4 LEADER]: Becoming Leader. State: Replica: 6508e02af03a488685f95c2de71536a1, State: Running, Role: LEADER
I20260709 12:58:34.011196  1376 consensus_queue.cc:237] T 95a5561ec0684e6e955493c7f892e02a P 6508e02af03a488685f95c2de71536a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:34.019562   949 catalog_manager.cc:5697] T 95a5561ec0684e6e955493c7f892e02a P 6508e02af03a488685f95c2de71536a1 reported cstate change: term changed from 3 to 4, leader changed from b82fd85b5d15463fb787fcd1e6196090 (127.0.107.193) to 6508e02af03a488685f95c2de71536a1 (127.0.107.195). New cstate: current_term: 4 leader_uuid: "6508e02af03a488685f95c2de71536a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:34.075237  1377 raft_consensus.cc:993] T 7a06197c7e30456f9219b872c66b66f1 P b82fd85b5d15463fb787fcd1e6196090: : Instructing follower c213ad22ae2e4088a98d1b66e94c5544 to start an election
I20260709 12:58:34.075642  1378 raft_consensus.cc:1081] T 7a06197c7e30456f9219b872c66b66f1 P b82fd85b5d15463fb787fcd1e6196090 [term 3 LEADER]: Signalling peer c213ad22ae2e4088a98d1b66e94c5544 to start an election
I20260709 12:58:34.077147  1126 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7a06197c7e30456f9219b872c66b66f1"
dest_uuid: "c213ad22ae2e4088a98d1b66e94c5544"
 from {username='slave'} at 127.0.0.1:51074
I20260709 12:58:34.077556  1126 raft_consensus.cc:493] T 7a06197c7e30456f9219b872c66b66f1 P c213ad22ae2e4088a98d1b66e94c5544 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:34.077772  1126 raft_consensus.cc:3060] T 7a06197c7e30456f9219b872c66b66f1 P c213ad22ae2e4088a98d1b66e94c5544 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:34.081708  1126 raft_consensus.cc:515] T 7a06197c7e30456f9219b872c66b66f1 P c213ad22ae2e4088a98d1b66e94c5544 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:34.083261  1126 leader_election.cc:290] T 7a06197c7e30456f9219b872c66b66f1 P c213ad22ae2e4088a98d1b66e94c5544 [CANDIDATE]: Term 4 election: Requested vote from peers b82fd85b5d15463fb787fcd1e6196090 (127.0.107.193:35297), 6508e02af03a488685f95c2de71536a1 (127.0.107.195:35017)
I20260709 12:58:34.084326  1200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a06197c7e30456f9219b872c66b66f1" candidate_uuid: "c213ad22ae2e4088a98d1b66e94c5544" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "6508e02af03a488685f95c2de71536a1"
I20260709 12:58:34.084408  1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a06197c7e30456f9219b872c66b66f1" candidate_uuid: "c213ad22ae2e4088a98d1b66e94c5544" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b82fd85b5d15463fb787fcd1e6196090"
I20260709 12:58:34.084941  1200 raft_consensus.cc:3060] T 7a06197c7e30456f9219b872c66b66f1 P 6508e02af03a488685f95c2de71536a1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:34.084988  1050 raft_consensus.cc:3055] T 7a06197c7e30456f9219b872c66b66f1 P b82fd85b5d15463fb787fcd1e6196090 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:34.085435  1050 raft_consensus.cc:740] T 7a06197c7e30456f9219b872c66b66f1 P b82fd85b5d15463fb787fcd1e6196090 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b82fd85b5d15463fb787fcd1e6196090, State: Running, Role: LEADER
I20260709 12:58:34.086212  1050 consensus_queue.cc:260] T 7a06197c7e30456f9219b872c66b66f1 P b82fd85b5d15463fb787fcd1e6196090 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:34.087357  1050 raft_consensus.cc:3060] T 7a06197c7e30456f9219b872c66b66f1 P b82fd85b5d15463fb787fcd1e6196090 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:34.091385  1200 raft_consensus.cc:2468] T 7a06197c7e30456f9219b872c66b66f1 P 6508e02af03a488685f95c2de71536a1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c213ad22ae2e4088a98d1b66e94c5544 in term 4.
I20260709 12:58:34.092684  1093 leader_election.cc:304] T 7a06197c7e30456f9219b872c66b66f1 P c213ad22ae2e4088a98d1b66e94c5544 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6508e02af03a488685f95c2de71536a1, c213ad22ae2e4088a98d1b66e94c5544; no voters: 
I20260709 12:58:34.093400  1050 raft_consensus.cc:2468] T 7a06197c7e30456f9219b872c66b66f1 P b82fd85b5d15463fb787fcd1e6196090 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c213ad22ae2e4088a98d1b66e94c5544 in term 4.
I20260709 12:58:34.093618  1351 raft_consensus.cc:2804] T 7a06197c7e30456f9219b872c66b66f1 P c213ad22ae2e4088a98d1b66e94c5544 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:34.094844  1351 raft_consensus.cc:697] T 7a06197c7e30456f9219b872c66b66f1 P c213ad22ae2e4088a98d1b66e94c5544 [term 4 LEADER]: Becoming Leader. State: Replica: c213ad22ae2e4088a98d1b66e94c5544, State: Running, Role: LEADER
I20260709 12:58:34.095640  1351 consensus_queue.cc:237] T 7a06197c7e30456f9219b872c66b66f1 P c213ad22ae2e4088a98d1b66e94c5544 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:34.102021   949 catalog_manager.cc:5697] T 7a06197c7e30456f9219b872c66b66f1 P c213ad22ae2e4088a98d1b66e94c5544 reported cstate change: term changed from 3 to 4, leader changed from b82fd85b5d15463fb787fcd1e6196090 (127.0.107.193) to c213ad22ae2e4088a98d1b66e94c5544 (127.0.107.194). New cstate: current_term: 4 leader_uuid: "c213ad22ae2e4088a98d1b66e94c5544" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:34.249156  1378 raft_consensus.cc:993] T bef759002c944c3095e9777eba3c28c1 P b82fd85b5d15463fb787fcd1e6196090: : Instructing follower c213ad22ae2e4088a98d1b66e94c5544 to start an election
I20260709 12:58:34.249619  1378 raft_consensus.cc:1081] T bef759002c944c3095e9777eba3c28c1 P b82fd85b5d15463fb787fcd1e6196090 [term 3 LEADER]: Signalling peer c213ad22ae2e4088a98d1b66e94c5544 to start an election
I20260709 12:58:34.251005  1126 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bef759002c944c3095e9777eba3c28c1"
dest_uuid: "c213ad22ae2e4088a98d1b66e94c5544"
 from {username='slave'} at 127.0.0.1:51074
I20260709 12:58:34.251394  1126 raft_consensus.cc:493] T bef759002c944c3095e9777eba3c28c1 P c213ad22ae2e4088a98d1b66e94c5544 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:34.251613  1126 raft_consensus.cc:3060] T bef759002c944c3095e9777eba3c28c1 P c213ad22ae2e4088a98d1b66e94c5544 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:34.255587  1126 raft_consensus.cc:515] T bef759002c944c3095e9777eba3c28c1 P c213ad22ae2e4088a98d1b66e94c5544 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:34.257016  1126 leader_election.cc:290] T bef759002c944c3095e9777eba3c28c1 P c213ad22ae2e4088a98d1b66e94c5544 [CANDIDATE]: Term 4 election: Requested vote from peers b82fd85b5d15463fb787fcd1e6196090 (127.0.107.193:35297), 6508e02af03a488685f95c2de71536a1 (127.0.107.195:35017)
I20260709 12:58:34.257809  1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bef759002c944c3095e9777eba3c28c1" candidate_uuid: "c213ad22ae2e4088a98d1b66e94c5544" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b82fd85b5d15463fb787fcd1e6196090"
I20260709 12:58:34.258067  1200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bef759002c944c3095e9777eba3c28c1" candidate_uuid: "c213ad22ae2e4088a98d1b66e94c5544" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "6508e02af03a488685f95c2de71536a1"
I20260709 12:58:34.258347  1050 raft_consensus.cc:3055] T bef759002c944c3095e9777eba3c28c1 P b82fd85b5d15463fb787fcd1e6196090 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:34.258589  1200 raft_consensus.cc:3060] T bef759002c944c3095e9777eba3c28c1 P 6508e02af03a488685f95c2de71536a1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:34.258633  1050 raft_consensus.cc:740] T bef759002c944c3095e9777eba3c28c1 P b82fd85b5d15463fb787fcd1e6196090 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b82fd85b5d15463fb787fcd1e6196090, State: Running, Role: LEADER
I20260709 12:58:34.259436  1050 consensus_queue.cc:260] T bef759002c944c3095e9777eba3c28c1 P b82fd85b5d15463fb787fcd1e6196090 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:34.260536  1050 raft_consensus.cc:3060] T bef759002c944c3095e9777eba3c28c1 P b82fd85b5d15463fb787fcd1e6196090 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:34.264523  1200 raft_consensus.cc:2468] T bef759002c944c3095e9777eba3c28c1 P 6508e02af03a488685f95c2de71536a1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c213ad22ae2e4088a98d1b66e94c5544 in term 4.
I20260709 12:58:34.265589  1093 leader_election.cc:304] T bef759002c944c3095e9777eba3c28c1 P c213ad22ae2e4088a98d1b66e94c5544 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6508e02af03a488685f95c2de71536a1, c213ad22ae2e4088a98d1b66e94c5544; no voters: 
I20260709 12:58:34.266407  1351 raft_consensus.cc:2804] T bef759002c944c3095e9777eba3c28c1 P c213ad22ae2e4088a98d1b66e94c5544 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:34.266420  1050 raft_consensus.cc:2468] T bef759002c944c3095e9777eba3c28c1 P b82fd85b5d15463fb787fcd1e6196090 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c213ad22ae2e4088a98d1b66e94c5544 in term 4.
I20260709 12:58:34.267053  1351 raft_consensus.cc:697] T bef759002c944c3095e9777eba3c28c1 P c213ad22ae2e4088a98d1b66e94c5544 [term 4 LEADER]: Becoming Leader. State: Replica: c213ad22ae2e4088a98d1b66e94c5544, State: Running, Role: LEADER
I20260709 12:58:34.267916  1351 consensus_queue.cc:237] T bef759002c944c3095e9777eba3c28c1 P c213ad22ae2e4088a98d1b66e94c5544 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } }
I20260709 12:58:34.274379   949 catalog_manager.cc:5697] T bef759002c944c3095e9777eba3c28c1 P c213ad22ae2e4088a98d1b66e94c5544 reported cstate change: term changed from 3 to 4, leader changed from b82fd85b5d15463fb787fcd1e6196090 (127.0.107.193) to c213ad22ae2e4088a98d1b66e94c5544 (127.0.107.194). New cstate: current_term: 4 leader_uuid: "c213ad22ae2e4088a98d1b66e94c5544" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:34.336817  1126 raft_consensus.cc:1275] T cc64d897105f4ef08f524f3545b807e0 P c213ad22ae2e4088a98d1b66e94c5544 [term 2 FOLLOWER]: Refusing update from remote peer 6508e02af03a488685f95c2de71536a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:34.337909  1376 consensus_queue.cc:1048] T cc64d897105f4ef08f524f3545b807e0 P 6508e02af03a488685f95c2de71536a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:34.347179  1050 raft_consensus.cc:1275] T cc64d897105f4ef08f524f3545b807e0 P b82fd85b5d15463fb787fcd1e6196090 [term 2 FOLLOWER]: Refusing update from remote peer 6508e02af03a488685f95c2de71536a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:34.348449  1376 consensus_queue.cc:1048] T cc64d897105f4ef08f524f3545b807e0 P 6508e02af03a488685f95c2de71536a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:34.482489  1200 raft_consensus.cc:1275] T 7a06197c7e30456f9219b872c66b66f1 P 6508e02af03a488685f95c2de71536a1 [term 4 FOLLOWER]: Refusing update from remote peer c213ad22ae2e4088a98d1b66e94c5544: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:58:34.483639  1351 consensus_queue.cc:1048] T 7a06197c7e30456f9219b872c66b66f1 P c213ad22ae2e4088a98d1b66e94c5544 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:34.491784  1050 raft_consensus.cc:1275] T 7a06197c7e30456f9219b872c66b66f1 P b82fd85b5d15463fb787fcd1e6196090 [term 4 FOLLOWER]: Refusing update from remote peer c213ad22ae2e4088a98d1b66e94c5544: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:58:34.493081  1351 consensus_queue.cc:1048] T 7a06197c7e30456f9219b872c66b66f1 P c213ad22ae2e4088a98d1b66e94c5544 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:34.626778  1050 raft_consensus.cc:1275] T 95a5561ec0684e6e955493c7f892e02a P b82fd85b5d15463fb787fcd1e6196090 [term 4 FOLLOWER]: Refusing update from remote peer 6508e02af03a488685f95c2de71536a1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:58:34.627883  1391 consensus_queue.cc:1048] T 95a5561ec0684e6e955493c7f892e02a P 6508e02af03a488685f95c2de71536a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b82fd85b5d15463fb787fcd1e6196090" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:34.633805  1126 raft_consensus.cc:1275] T 95a5561ec0684e6e955493c7f892e02a P c213ad22ae2e4088a98d1b66e94c5544 [term 4 FOLLOWER]: Refusing update from remote peer 6508e02af03a488685f95c2de71536a1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:58:34.636858  1391 consensus_queue.cc:1048] T 95a5561ec0684e6e955493c7f892e02a P 6508e02af03a488685f95c2de71536a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c213ad22ae2e4088a98d1b66e94c5544" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:34.742100   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:34.747823   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
I20260709 12:58:34.766705   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:58:34.767365   431 tablet_replica.cc:333] T bb7e493140574c5dbfd328c93b4bfc3b P b82fd85b5d15463fb787fcd1e6196090: stopping tablet replica
I20260709 12:58:34.767956   431 raft_consensus.cc:2243] T bb7e493140574c5dbfd328c93b4bfc3b P b82fd85b5d15463fb787fcd1e6196090 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:34.768419   431 raft_consensus.cc:2272] T bb7e493140574c5dbfd328c93b4bfc3b P b82fd85b5d15463fb787fcd1e6196090 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:34.770207   431 tablet_replica.cc:333] T 3937dd9840304b0f8752a493ae246949 P b82fd85b5d15463fb787fcd1e6196090: stopping tablet replica
I20260709 12:58:34.770756   431 raft_consensus.cc:2243] T 3937dd9840304b0f8752a493ae246949 P b82fd85b5d15463fb787fcd1e6196090 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:58:34.771543   431 raft_consensus.cc:2272] T 3937dd9840304b0f8752a493ae246949 P b82fd85b5d15463fb787fcd1e6196090 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:34.773226   431 tablet_replica.cc:333] T 7a06197c7e30456f9219b872c66b66f1 P b82fd85b5d15463fb787fcd1e6196090: stopping tablet replica
I20260709 12:58:34.773692   431 raft_consensus.cc:2243] T 7a06197c7e30456f9219b872c66b66f1 P b82fd85b5d15463fb787fcd1e6196090 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:34.774044   431 raft_consensus.cc:2272] T 7a06197c7e30456f9219b872c66b66f1 P b82fd85b5d15463fb787fcd1e6196090 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:34.776140   431 tablet_replica.cc:333] T 197c75f75ec14fc0b3ab45ff540e308d P b82fd85b5d15463fb787fcd1e6196090: stopping tablet replica
I20260709 12:58:34.776634   431 raft_consensus.cc:2243] T 197c75f75ec14fc0b3ab45ff540e308d P b82fd85b5d15463fb787fcd1e6196090 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:58:34.777348   431 raft_consensus.cc:2272] T 197c75f75ec14fc0b3ab45ff540e308d P b82fd85b5d15463fb787fcd1e6196090 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:34.779192   431 tablet_replica.cc:333] T c9d672f25bad4478a1790bede74733f1 P b82fd85b5d15463fb787fcd1e6196090: stopping tablet replica
I20260709 12:58:34.779754   431 raft_consensus.cc:2243] T c9d672f25bad4478a1790bede74733f1 P b82fd85b5d15463fb787fcd1e6196090 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:34.780174   431 raft_consensus.cc:2272] T c9d672f25bad4478a1790bede74733f1 P b82fd85b5d15463fb787fcd1e6196090 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:34.781921   431 tablet_replica.cc:333] T bef759002c944c3095e9777eba3c28c1 P b82fd85b5d15463fb787fcd1e6196090: stopping tablet replica
I20260709 12:58:34.782451   431 raft_consensus.cc:2243] T bef759002c944c3095e9777eba3c28c1 P b82fd85b5d15463fb787fcd1e6196090 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:34.782871   431 raft_consensus.cc:2272] T bef759002c944c3095e9777eba3c28c1 P b82fd85b5d15463fb787fcd1e6196090 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:34.784477   431 tablet_replica.cc:333] T 95a5561ec0684e6e955493c7f892e02a P b82fd85b5d15463fb787fcd1e6196090: stopping tablet replica
I20260709 12:58:34.784888   431 raft_consensus.cc:2243] T 95a5561ec0684e6e955493c7f892e02a P b82fd85b5d15463fb787fcd1e6196090 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:34.785215   431 raft_consensus.cc:2272] T 95a5561ec0684e6e955493c7f892e02a P b82fd85b5d15463fb787fcd1e6196090 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:34.787171   431 tablet_replica.cc:333] T e8759b94cc204bc58848a9008afbeab7 P b82fd85b5d15463fb787fcd1e6196090: stopping tablet replica
I20260709 12:58:34.787671   431 raft_consensus.cc:2243] T e8759b94cc204bc58848a9008afbeab7 P b82fd85b5d15463fb787fcd1e6196090 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:58:34.788381   431 raft_consensus.cc:2272] T e8759b94cc204bc58848a9008afbeab7 P b82fd85b5d15463fb787fcd1e6196090 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:34.789995   431 tablet_replica.cc:333] T cc64d897105f4ef08f524f3545b807e0 P b82fd85b5d15463fb787fcd1e6196090: stopping tablet replica
I20260709 12:58:34.790414   431 raft_consensus.cc:2243] T cc64d897105f4ef08f524f3545b807e0 P b82fd85b5d15463fb787fcd1e6196090 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:34.790787   431 raft_consensus.cc:2272] T cc64d897105f4ef08f524f3545b807e0 P b82fd85b5d15463fb787fcd1e6196090 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:34.793176   431 tablet_replica.cc:333] T 795b091720eb457cb7373133625dba18 P b82fd85b5d15463fb787fcd1e6196090: stopping tablet replica
I20260709 12:58:34.793699   431 raft_consensus.cc:2243] T 795b091720eb457cb7373133625dba18 P b82fd85b5d15463fb787fcd1e6196090 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:58:34.794339   431 raft_consensus.cc:2272] T 795b091720eb457cb7373133625dba18 P b82fd85b5d15463fb787fcd1e6196090 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:34.823329   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
W20260709 12:58:34.838891  1090 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35297: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260709 12:58:34.842418  1090 consensus_peers.cc:597] T bef759002c944c3095e9777eba3c28c1 P c213ad22ae2e4088a98d1b66e94c5544 -> Peer b82fd85b5d15463fb787fcd1e6196090 (127.0.107.193:35297): Couldn't send request to peer b82fd85b5d15463fb787fcd1e6196090. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35297: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:34.845036   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
W20260709 12:58:34.845319  1090 consensus_peers.cc:597] T c9d672f25bad4478a1790bede74733f1 P c213ad22ae2e4088a98d1b66e94c5544 -> Peer b82fd85b5d15463fb787fcd1e6196090 (127.0.107.193:35297): Couldn't send request to peer b82fd85b5d15463fb787fcd1e6196090. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35297: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:34.849370  1200 raft_consensus.cc:1275] T bef759002c944c3095e9777eba3c28c1 P 6508e02af03a488685f95c2de71536a1 [term 4 FOLLOWER]: Refusing update from remote peer c213ad22ae2e4088a98d1b66e94c5544: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:58:34.850449  1351 consensus_queue.cc:1048] T bef759002c944c3095e9777eba3c28c1 P c213ad22ae2e4088a98d1b66e94c5544 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6508e02af03a488685f95c2de71536a1" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:34.878796   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:58:34.879443   431 tablet_replica.cc:333] T 3937dd9840304b0f8752a493ae246949 P c213ad22ae2e4088a98d1b66e94c5544: stopping tablet replica
I20260709 12:58:34.879983   431 raft_consensus.cc:2243] T 3937dd9840304b0f8752a493ae246949 P c213ad22ae2e4088a98d1b66e94c5544 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:34.880409   431 raft_consensus.cc:2272] T 3937dd9840304b0f8752a493ae246949 P c213ad22ae2e4088a98d1b66e94c5544 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:34.882161   431 tablet_replica.cc:333] T bb7e493140574c5dbfd328c93b4bfc3b P c213ad22ae2e4088a98d1b66e94c5544: stopping tablet replica
I20260709 12:58:34.882652   431 raft_consensus.cc:2243] T bb7e493140574c5dbfd328c93b4bfc3b P c213ad22ae2e4088a98d1b66e94c5544 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:34.883114   431 raft_consensus.cc:2272] T bb7e493140574c5dbfd328c93b4bfc3b P c213ad22ae2e4088a98d1b66e94c5544 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:34.884737   431 tablet_replica.cc:333] T c9d672f25bad4478a1790bede74733f1 P c213ad22ae2e4088a98d1b66e94c5544: stopping tablet replica
I20260709 12:58:34.885195   431 raft_consensus.cc:2243] T c9d672f25bad4478a1790bede74733f1 P c213ad22ae2e4088a98d1b66e94c5544 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:58:34.885931   431 raft_consensus.cc:2272] T c9d672f25bad4478a1790bede74733f1 P c213ad22ae2e4088a98d1b66e94c5544 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:34.887506   431 tablet_replica.cc:333] T bef759002c944c3095e9777eba3c28c1 P c213ad22ae2e4088a98d1b66e94c5544: stopping tablet replica
I20260709 12:58:34.888021   431 raft_consensus.cc:2243] T bef759002c944c3095e9777eba3c28c1 P c213ad22ae2e4088a98d1b66e94c5544 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:58:34.888711   431 raft_consensus.cc:2272] T bef759002c944c3095e9777eba3c28c1 P c213ad22ae2e4088a98d1b66e94c5544 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:34.890528   431 tablet_replica.cc:333] T 95a5561ec0684e6e955493c7f892e02a P c213ad22ae2e4088a98d1b66e94c5544: stopping tablet replica
I20260709 12:58:34.891053   431 raft_consensus.cc:2243] T 95a5561ec0684e6e955493c7f892e02a P c213ad22ae2e4088a98d1b66e94c5544 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:34.891460   431 raft_consensus.cc:2272] T 95a5561ec0684e6e955493c7f892e02a P c213ad22ae2e4088a98d1b66e94c5544 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:34.893607   431 tablet_replica.cc:333] T 795b091720eb457cb7373133625dba18 P c213ad22ae2e4088a98d1b66e94c5544: stopping tablet replica
I20260709 12:58:34.894078   431 raft_consensus.cc:2243] T 795b091720eb457cb7373133625dba18 P c213ad22ae2e4088a98d1b66e94c5544 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:34.894441   431 raft_consensus.cc:2272] T 795b091720eb457cb7373133625dba18 P c213ad22ae2e4088a98d1b66e94c5544 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:34.896126   431 tablet_replica.cc:333] T cc64d897105f4ef08f524f3545b807e0 P c213ad22ae2e4088a98d1b66e94c5544: stopping tablet replica
I20260709 12:58:34.896586   431 raft_consensus.cc:2243] T cc64d897105f4ef08f524f3545b807e0 P c213ad22ae2e4088a98d1b66e94c5544 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:34.896950   431 raft_consensus.cc:2272] T cc64d897105f4ef08f524f3545b807e0 P c213ad22ae2e4088a98d1b66e94c5544 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:34.898886   431 tablet_replica.cc:333] T e8759b94cc204bc58848a9008afbeab7 P c213ad22ae2e4088a98d1b66e94c5544: stopping tablet replica
I20260709 12:58:34.899343   431 raft_consensus.cc:2243] T e8759b94cc204bc58848a9008afbeab7 P c213ad22ae2e4088a98d1b66e94c5544 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:34.899710   431 raft_consensus.cc:2272] T e8759b94cc204bc58848a9008afbeab7 P c213ad22ae2e4088a98d1b66e94c5544 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:34.901201   431 tablet_replica.cc:333] T 7a06197c7e30456f9219b872c66b66f1 P c213ad22ae2e4088a98d1b66e94c5544: stopping tablet replica
I20260709 12:58:34.901624   431 raft_consensus.cc:2243] T 7a06197c7e30456f9219b872c66b66f1 P c213ad22ae2e4088a98d1b66e94c5544 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:58:34.902300   431 raft_consensus.cc:2272] T 7a06197c7e30456f9219b872c66b66f1 P c213ad22ae2e4088a98d1b66e94c5544 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:34.904210   431 tablet_replica.cc:333] T 197c75f75ec14fc0b3ab45ff540e308d P c213ad22ae2e4088a98d1b66e94c5544: stopping tablet replica
I20260709 12:58:34.904641   431 raft_consensus.cc:2243] T 197c75f75ec14fc0b3ab45ff540e308d P c213ad22ae2e4088a98d1b66e94c5544 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:34.905046   431 raft_consensus.cc:2272] T 197c75f75ec14fc0b3ab45ff540e308d P c213ad22ae2e4088a98d1b66e94c5544 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:58:34.930025  1164 consensus_peers.cc:597] T cc64d897105f4ef08f524f3545b807e0 P 6508e02af03a488685f95c2de71536a1 -> Peer b82fd85b5d15463fb787fcd1e6196090 (127.0.107.193:35297): Couldn't send request to peer b82fd85b5d15463fb787fcd1e6196090. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35297: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:34.931938   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
I20260709 12:58:34.949285   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
I20260709 12:58:34.968545   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:58:34.969305   431 tablet_replica.cc:333] T bb7e493140574c5dbfd328c93b4bfc3b P 6508e02af03a488685f95c2de71536a1: stopping tablet replica
I20260709 12:58:34.969863   431 raft_consensus.cc:2243] T bb7e493140574c5dbfd328c93b4bfc3b P 6508e02af03a488685f95c2de71536a1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:58:34.970611   431 raft_consensus.cc:2272] T bb7e493140574c5dbfd328c93b4bfc3b P 6508e02af03a488685f95c2de71536a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:34.972347   431 tablet_replica.cc:333] T c9d672f25bad4478a1790bede74733f1 P 6508e02af03a488685f95c2de71536a1: stopping tablet replica
I20260709 12:58:34.972816   431 raft_consensus.cc:2243] T c9d672f25bad4478a1790bede74733f1 P 6508e02af03a488685f95c2de71536a1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:34.973174   431 raft_consensus.cc:2272] T c9d672f25bad4478a1790bede74733f1 P 6508e02af03a488685f95c2de71536a1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:34.974733   431 tablet_replica.cc:333] T e8759b94cc204bc58848a9008afbeab7 P 6508e02af03a488685f95c2de71536a1: stopping tablet replica
I20260709 12:58:34.975163   431 raft_consensus.cc:2243] T e8759b94cc204bc58848a9008afbeab7 P 6508e02af03a488685f95c2de71536a1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:34.975525   431 raft_consensus.cc:2272] T e8759b94cc204bc58848a9008afbeab7 P 6508e02af03a488685f95c2de71536a1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:34.976977   431 tablet_replica.cc:333] T cc64d897105f4ef08f524f3545b807e0 P 6508e02af03a488685f95c2de71536a1: stopping tablet replica
I20260709 12:58:34.977401   431 raft_consensus.cc:2243] T cc64d897105f4ef08f524f3545b807e0 P 6508e02af03a488685f95c2de71536a1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:58:34.978024   431 raft_consensus.cc:2272] T cc64d897105f4ef08f524f3545b807e0 P 6508e02af03a488685f95c2de71536a1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:34.980263   431 tablet_replica.cc:333] T 795b091720eb457cb7373133625dba18 P 6508e02af03a488685f95c2de71536a1: stopping tablet replica
I20260709 12:58:34.980700   431 raft_consensus.cc:2243] T 795b091720eb457cb7373133625dba18 P 6508e02af03a488685f95c2de71536a1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:34.981006   431 raft_consensus.cc:2272] T 795b091720eb457cb7373133625dba18 P 6508e02af03a488685f95c2de71536a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:34.982488   431 tablet_replica.cc:333] T bef759002c944c3095e9777eba3c28c1 P 6508e02af03a488685f95c2de71536a1: stopping tablet replica
I20260709 12:58:34.982940   431 raft_consensus.cc:2243] T bef759002c944c3095e9777eba3c28c1 P 6508e02af03a488685f95c2de71536a1 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:34.983300   431 raft_consensus.cc:2272] T bef759002c944c3095e9777eba3c28c1 P 6508e02af03a488685f95c2de71536a1 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:34.985040   431 tablet_replica.cc:333] T 95a5561ec0684e6e955493c7f892e02a P 6508e02af03a488685f95c2de71536a1: stopping tablet replica
I20260709 12:58:34.985522   431 raft_consensus.cc:2243] T 95a5561ec0684e6e955493c7f892e02a P 6508e02af03a488685f95c2de71536a1 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:58:34.986196   431 raft_consensus.cc:2272] T 95a5561ec0684e6e955493c7f892e02a P 6508e02af03a488685f95c2de71536a1 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:34.988070   431 tablet_replica.cc:333] T 3937dd9840304b0f8752a493ae246949 P 6508e02af03a488685f95c2de71536a1: stopping tablet replica
I20260709 12:58:34.988518   431 raft_consensus.cc:2243] T 3937dd9840304b0f8752a493ae246949 P 6508e02af03a488685f95c2de71536a1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:34.988935   431 raft_consensus.cc:2272] T 3937dd9840304b0f8752a493ae246949 P 6508e02af03a488685f95c2de71536a1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:34.990433   431 tablet_replica.cc:333] T 7a06197c7e30456f9219b872c66b66f1 P 6508e02af03a488685f95c2de71536a1: stopping tablet replica
I20260709 12:58:34.990872   431 raft_consensus.cc:2243] T 7a06197c7e30456f9219b872c66b66f1 P 6508e02af03a488685f95c2de71536a1 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:34.991237   431 raft_consensus.cc:2272] T 7a06197c7e30456f9219b872c66b66f1 P 6508e02af03a488685f95c2de71536a1 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:34.993012   431 tablet_replica.cc:333] T 197c75f75ec14fc0b3ab45ff540e308d P 6508e02af03a488685f95c2de71536a1: stopping tablet replica
I20260709 12:58:34.993400   431 raft_consensus.cc:2243] T 197c75f75ec14fc0b3ab45ff540e308d P 6508e02af03a488685f95c2de71536a1 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:34.993734   431 raft_consensus.cc:2272] T 197c75f75ec14fc0b3ab45ff540e308d P 6508e02af03a488685f95c2de71536a1 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:35.020159   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 12:58:35.039009   431 master.cc:562] Master@127.0.107.254:38623 shutting down...
I20260709 12:58:35.056448   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P cdd0ff0b2925403185d1d2d9185801dc [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:58:35.056957   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P cdd0ff0b2925403185d1d2d9185801dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:35.057255   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P cdd0ff0b2925403185d1d2d9185801dc: stopping tablet replica
I20260709 12:58:35.076900   431 master.cc:584] Master@127.0.107.254:38623 shutdown complete.
6508e02af03a488685f95c2de71536a1  1
b82fd85b5d15463fb787fcd1e6196090  5
c213ad22ae2e4088a98d1b66e94c5544  4
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (10318 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 12:58:35.114794   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:40423
I20260709 12:58:35.115898   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:58:35.120966  1406 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:35.121062  1405 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:35.122210  1408 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:58:35.123488   431 server_base.cc:1061] running on GCE node
I20260709 12:58:35.124279   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:58:35.124459   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:58:35.124605   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601915124588 us; error 0 us; skew 500 ppm
I20260709 12:58:35.125114   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:58:35.127529   431 webserver.cc:533] Webserver started at http://127.0.107.254:32899/ using document root <none> and password file <none>
I20260709 12:58:35.128007   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:58:35.128180   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:58:35.128434   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:58:35.129489   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601891739070-431-0/minicluster-data/master-0-root/instance:
uuid: "9f38d0e5c9db43a48554defe1153354e"
format_stamp: "Formatted at 2026-07-09 12:58:35 on dist-test-slave-qzg2"
I20260709 12:58:35.133852   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:58:35.137166  1413 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:35.137822   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 12:58:35.138080   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601891739070-431-0/minicluster-data/master-0-root
uuid: "9f38d0e5c9db43a48554defe1153354e"
format_stamp: "Formatted at 2026-07-09 12:58:35 on dist-test-slave-qzg2"
I20260709 12:58:35.138314   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601891739070-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601891739070-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601891739070-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:58:35.149538   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:58:35.150803   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:58:35.187394   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:40423
I20260709 12:58:35.187495  1464 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:40423 every 8 connection(s)
I20260709 12:58:35.191226  1465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.200745  1465 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9f38d0e5c9db43a48554defe1153354e: Bootstrap starting.
I20260709 12:58:35.205265  1465 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9f38d0e5c9db43a48554defe1153354e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:35.209293  1465 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9f38d0e5c9db43a48554defe1153354e: No bootstrap required, opened a new log
I20260709 12:58:35.211427  1465 raft_consensus.cc:359] T 00000000000000000000000000000000 P 9f38d0e5c9db43a48554defe1153354e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f38d0e5c9db43a48554defe1153354e" member_type: VOTER }
I20260709 12:58:35.211809  1465 raft_consensus.cc:385] T 00000000000000000000000000000000 P 9f38d0e5c9db43a48554defe1153354e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:35.211985  1465 raft_consensus.cc:740] T 00000000000000000000000000000000 P 9f38d0e5c9db43a48554defe1153354e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f38d0e5c9db43a48554defe1153354e, State: Initialized, Role: FOLLOWER
I20260709 12:58:35.212518  1465 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9f38d0e5c9db43a48554defe1153354e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f38d0e5c9db43a48554defe1153354e" member_type: VOTER }
I20260709 12:58:35.212953  1465 raft_consensus.cc:399] T 00000000000000000000000000000000 P 9f38d0e5c9db43a48554defe1153354e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:58:35.213150  1465 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9f38d0e5c9db43a48554defe1153354e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:58:35.213351  1465 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 9f38d0e5c9db43a48554defe1153354e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:35.217330  1465 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9f38d0e5c9db43a48554defe1153354e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f38d0e5c9db43a48554defe1153354e" member_type: VOTER }
I20260709 12:58:35.217818  1465 leader_election.cc:304] T 00000000000000000000000000000000 P 9f38d0e5c9db43a48554defe1153354e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9f38d0e5c9db43a48554defe1153354e; no voters: 
I20260709 12:58:35.218851  1465 leader_election.cc:290] T 00000000000000000000000000000000 P 9f38d0e5c9db43a48554defe1153354e [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:58:35.219259  1468 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 9f38d0e5c9db43a48554defe1153354e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:35.220439  1468 raft_consensus.cc:697] T 00000000000000000000000000000000 P 9f38d0e5c9db43a48554defe1153354e [term 1 LEADER]: Becoming Leader. State: Replica: 9f38d0e5c9db43a48554defe1153354e, State: Running, Role: LEADER
I20260709 12:58:35.221086  1468 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9f38d0e5c9db43a48554defe1153354e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f38d0e5c9db43a48554defe1153354e" member_type: VOTER }
I20260709 12:58:35.221586  1465 sys_catalog.cc:565] T 00000000000000000000000000000000 P 9f38d0e5c9db43a48554defe1153354e [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:58:35.223937  1470 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9f38d0e5c9db43a48554defe1153354e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9f38d0e5c9db43a48554defe1153354e. Latest consensus state: current_term: 1 leader_uuid: "9f38d0e5c9db43a48554defe1153354e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f38d0e5c9db43a48554defe1153354e" member_type: VOTER } }
I20260709 12:58:35.223883  1469 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9f38d0e5c9db43a48554defe1153354e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9f38d0e5c9db43a48554defe1153354e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f38d0e5c9db43a48554defe1153354e" member_type: VOTER } }
I20260709 12:58:35.224548  1470 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9f38d0e5c9db43a48554defe1153354e [sys.catalog]: This master's current role is: LEADER
I20260709 12:58:35.224632  1469 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9f38d0e5c9db43a48554defe1153354e [sys.catalog]: This master's current role is: LEADER
I20260709 12:58:35.230136  1473 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:58:35.234880  1473 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:58:35.235862   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:58:35.243479  1473 catalog_manager.cc:1383] Generated new cluster ID: 7ef31614ff074f0db854d28682ef5d3d
I20260709 12:58:35.243821  1473 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:58:35.279035  1473 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:58:35.280252  1473 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:58:35.292081  1473 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 9f38d0e5c9db43a48554defe1153354e: Generated new TSK 0
I20260709 12:58:35.292723  1473 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:58:35.302593   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:58:35.308411  1486 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:35.309275  1487 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:35.311542  1489 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:58:35.311784   431 server_base.cc:1061] running on GCE node
I20260709 12:58:35.312633   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:58:35.312839   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:58:35.312991   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601915312974 us; error 0 us; skew 500 ppm
I20260709 12:58:35.313514   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:58:35.316010   431 webserver.cc:533] Webserver started at http://127.0.107.193:36929/ using document root <none> and password file <none>
I20260709 12:58:35.316488   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:58:35.316684   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:58:35.316929   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:58:35.317986   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601891739070-431-0/minicluster-data/ts-0-root/instance:
uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
format_stamp: "Formatted at 2026-07-09 12:58:35 on dist-test-slave-qzg2"
I20260709 12:58:35.322373   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:58:35.325624  1494 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:35.326387   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:58:35.326643   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601891739070-431-0/minicluster-data/ts-0-root
uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
format_stamp: "Formatted at 2026-07-09 12:58:35 on dist-test-slave-qzg2"
I20260709 12:58:35.326936   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601891739070-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601891739070-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601891739070-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:58:35.349632   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:58:35.350863   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:58:35.352252   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:58:35.354403   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:58:35.354583   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:35.354811   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:58:35.354952   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:35.393131   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:43931
I20260709 12:58:35.393265  1556 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:43931 every 8 connection(s)
I20260709 12:58:35.397733   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:58:35.404134  1561 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:35.405793  1562 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:35.408823  1564 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:58:35.409051   431 server_base.cc:1061] running on GCE node
I20260709 12:58:35.410131   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:58:35.410324   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:58:35.410446   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601915410435 us; error 0 us; skew 500 ppm
I20260709 12:58:35.410938   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:58:35.413254   431 webserver.cc:533] Webserver started at http://127.0.107.194:42487/ using document root <none> and password file <none>
I20260709 12:58:35.413684   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:58:35.413842   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:58:35.414044   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:58:35.415185   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601891739070-431-0/minicluster-data/ts-1-root/instance:
uuid: "39a92f5a4352465d8af3af5908fe8642"
format_stamp: "Formatted at 2026-07-09 12:58:35 on dist-test-slave-qzg2"
I20260709 12:58:35.419504  1557 heartbeater.cc:344] Connected to a master server at 127.0.107.254:40423
I20260709 12:58:35.419862  1557 heartbeater.cc:461] Registering TS with master...
I20260709 12:58:35.420053   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.004s
I20260709 12:58:35.420590  1557 heartbeater.cc:507] Master 127.0.107.254:40423 requested a full tablet report, sending...
I20260709 12:58:35.422524  1430 ts_manager.cc:194] Registered new tserver with Master: e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931)
I20260709 12:58:35.423776  1569 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:35.424588   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:58:35.424679  1430 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46258
I20260709 12:58:35.424949   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601891739070-431-0/minicluster-data/ts-1-root
uuid: "39a92f5a4352465d8af3af5908fe8642"
format_stamp: "Formatted at 2026-07-09 12:58:35 on dist-test-slave-qzg2"
I20260709 12:58:35.425330   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601891739070-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601891739070-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601891739070-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:58:35.437551   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:58:35.438805   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:58:35.440346   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:58:35.442698   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:58:35.442903   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:35.443154   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:58:35.443306   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:35.482741   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:40303
I20260709 12:58:35.482849  1631 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:40303 every 8 connection(s)
I20260709 12:58:35.487571   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:58:35.494554  1635 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:35.496243  1636 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:35.497615  1639 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:58:35.498085   431 server_base.cc:1061] running on GCE node
I20260709 12:58:35.498965   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:58:35.499181   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:58:35.499378   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601915499359 us; error 0 us; skew 500 ppm
I20260709 12:58:35.499403  1632 heartbeater.cc:344] Connected to a master server at 127.0.107.254:40423
I20260709 12:58:35.499811  1632 heartbeater.cc:461] Registering TS with master...
I20260709 12:58:35.499994   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:58:35.500566  1632 heartbeater.cc:507] Master 127.0.107.254:40423 requested a full tablet report, sending...
I20260709 12:58:35.502615   431 webserver.cc:533] Webserver started at http://127.0.107.195:33849/ using document root <none> and password file <none>
I20260709 12:58:35.502781  1430 ts_manager.cc:194] Registered new tserver with Master: 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:58:35.503159   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:58:35.503372   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:58:35.503611   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:58:35.504269  1430 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46260
I20260709 12:58:35.504763   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601891739070-431-0/minicluster-data/ts-2-root/instance:
uuid: "ddf11fc190dd4b898773379c6b129d90"
format_stamp: "Formatted at 2026-07-09 12:58:35 on dist-test-slave-qzg2"
I20260709 12:58:35.509363   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:58:35.512735  1643 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:35.513515   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 12:58:35.513818   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601891739070-431-0/minicluster-data/ts-2-root
uuid: "ddf11fc190dd4b898773379c6b129d90"
format_stamp: "Formatted at 2026-07-09 12:58:35 on dist-test-slave-qzg2"
I20260709 12:58:35.514096   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601891739070-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601891739070-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601891739070-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:58:35.535171   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:58:35.536386   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:58:35.537849   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:58:35.540258   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:58:35.540467   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:35.540688   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:58:35.540831   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:35.579591   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:44217
I20260709 12:58:35.579689  1705 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:44217 every 8 connection(s)
I20260709 12:58:35.593250  1706 heartbeater.cc:344] Connected to a master server at 127.0.107.254:40423
I20260709 12:58:35.593617  1706 heartbeater.cc:461] Registering TS with master...
I20260709 12:58:35.594307  1706 heartbeater.cc:507] Master 127.0.107.254:40423 requested a full tablet report, sending...
I20260709 12:58:35.596251  1430 ts_manager.cc:194] Registered new tserver with Master: ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:35.596371   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013655059s
I20260709 12:58:35.597733  1430 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46274
I20260709 12:58:35.622635  1430 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46278:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:58:35.628855  1430 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:58:35.820367  1597 tablet_service.cc:1511] Processing CreateTablet for tablet a031a0ef86384487bd1f89ead66f851b (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:58:35.821903  1597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a031a0ef86384487bd1f89ead66f851b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.823153  1596 tablet_service.cc:1511] Processing CreateTablet for tablet c1d40b53631d4998a9a462e3c91a3004 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:58:35.824604  1596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1d40b53631d4998a9a462e3c91a3004. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.828410  1595 tablet_service.cc:1511] Processing CreateTablet for tablet 9b906ca026f44e76913719f278eed7d3 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:58:35.829829  1595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b906ca026f44e76913719f278eed7d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.834038  1594 tablet_service.cc:1511] Processing CreateTablet for tablet f3dd6988dfbe43e0ac446b79d37d9c24 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:58:35.837407  1594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3dd6988dfbe43e0ac446b79d37d9c24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.841398  1670 tablet_service.cc:1511] Processing CreateTablet for tablet c1d40b53631d4998a9a462e3c91a3004 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:58:35.842092  1671 tablet_service.cc:1511] Processing CreateTablet for tablet a031a0ef86384487bd1f89ead66f851b (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:58:35.842939  1670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1d40b53631d4998a9a462e3c91a3004. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.843551  1671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a031a0ef86384487bd1f89ead66f851b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.845862  1669 tablet_service.cc:1511] Processing CreateTablet for tablet 9b906ca026f44e76913719f278eed7d3 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:58:35.847357  1669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b906ca026f44e76913719f278eed7d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.851081  1593 tablet_service.cc:1511] Processing CreateTablet for tablet 53176f970a394c5cb2c76bd88f09c751 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:58:35.852532  1593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53176f970a394c5cb2c76bd88f09c751. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.855540  1668 tablet_service.cc:1511] Processing CreateTablet for tablet f3dd6988dfbe43e0ac446b79d37d9c24 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:58:35.856937  1668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3dd6988dfbe43e0ac446b79d37d9c24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.858199  1522 tablet_service.cc:1511] Processing CreateTablet for tablet a031a0ef86384487bd1f89ead66f851b (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:58:35.859579  1522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a031a0ef86384487bd1f89ead66f851b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.859833  1667 tablet_service.cc:1511] Processing CreateTablet for tablet 53176f970a394c5cb2c76bd88f09c751 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:58:35.861284  1667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53176f970a394c5cb2c76bd88f09c751. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.863238  1592 tablet_service.cc:1511] Processing CreateTablet for tablet 2abb9a42c35f4b6386342bccdff6fbf0 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:58:35.864909  1592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2abb9a42c35f4b6386342bccdff6fbf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.866979  1521 tablet_service.cc:1511] Processing CreateTablet for tablet c1d40b53631d4998a9a462e3c91a3004 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:58:35.868350  1521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1d40b53631d4998a9a462e3c91a3004. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.870383  1591 tablet_service.cc:1511] Processing CreateTablet for tablet 9b7b5b00d91c4b488d16174662489496 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:58:35.865516  1666 tablet_service.cc:1511] Processing CreateTablet for tablet 2abb9a42c35f4b6386342bccdff6fbf0 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:58:35.871910  1591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b7b5b00d91c4b488d16174662489496. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.872814  1666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2abb9a42c35f4b6386342bccdff6fbf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.876325  1520 tablet_service.cc:1511] Processing CreateTablet for tablet 9b906ca026f44e76913719f278eed7d3 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:58:35.877714  1520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b906ca026f44e76913719f278eed7d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.880756  1665 tablet_service.cc:1511] Processing CreateTablet for tablet 9b7b5b00d91c4b488d16174662489496 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:58:35.882172  1665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b7b5b00d91c4b488d16174662489496. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.884549  1664 tablet_service.cc:1511] Processing CreateTablet for tablet 7d60bdd9b7f543e180698438c413d061 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:58:35.886111  1664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d60bdd9b7f543e180698438c413d061. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.886020  1597 tablet_service.cc:1511] Processing CreateTablet for tablet dcad30336a5440bca17cda2724035211 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:58:35.887497  1597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcad30336a5440bca17cda2724035211. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.890703  1519 tablet_service.cc:1511] Processing CreateTablet for tablet f3dd6988dfbe43e0ac446b79d37d9c24 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:58:35.892099  1519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3dd6988dfbe43e0ac446b79d37d9c24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.896732  1663 tablet_service.cc:1511] Processing CreateTablet for tablet dcad30336a5440bca17cda2724035211 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:58:35.897154  1518 tablet_service.cc:1511] Processing CreateTablet for tablet 53176f970a394c5cb2c76bd88f09c751 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:58:35.898291  1663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcad30336a5440bca17cda2724035211. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.898488  1518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53176f970a394c5cb2c76bd88f09c751. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.896731  1590 tablet_service.cc:1511] Processing CreateTablet for tablet a5802fa5e328499da4525506ccdf4dc9 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:58:35.900255  1590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5802fa5e328499da4525506ccdf4dc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.903964  1662 tablet_service.cc:1511] Processing CreateTablet for tablet a5802fa5e328499da4525506ccdf4dc9 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:58:35.905820  1662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5802fa5e328499da4525506ccdf4dc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.917842  1597 tablet_service.cc:1511] Processing CreateTablet for tablet 72071486140c4d6c919b25e882a8f5e5 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:58:35.919396  1597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72071486140c4d6c919b25e882a8f5e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.919852  1591 tablet_service.cc:1511] Processing CreateTablet for tablet 7ba438a35d164c02a9840bbedeac6097 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:58:35.921099  1591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ba438a35d164c02a9840bbedeac6097. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.932384  1517 tablet_service.cc:1511] Processing CreateTablet for tablet 2abb9a42c35f4b6386342bccdff6fbf0 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:58:35.935357  1516 tablet_service.cc:1511] Processing CreateTablet for tablet 9b7b5b00d91c4b488d16174662489496 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:58:35.938158  1515 tablet_service.cc:1511] Processing CreateTablet for tablet 7d60bdd9b7f543e180698438c413d061 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:58:35.881753  1595 tablet_service.cc:1511] Processing CreateTablet for tablet 7d60bdd9b7f543e180698438c413d061 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:58:35.958935  1516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b7b5b00d91c4b488d16174662489496. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.963111  1515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d60bdd9b7f543e180698438c413d061. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.965372  1595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d60bdd9b7f543e180698438c413d061. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.967088  1517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2abb9a42c35f4b6386342bccdff6fbf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.968911  1589 tablet_service.cc:1511] Processing CreateTablet for tablet 7b4d826f7c344b45b7de4b9f69ea958b (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:58:35.970374  1589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b4d826f7c344b45b7de4b9f69ea958b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:35.983887  1514 tablet_service.cc:1511] Processing CreateTablet for tablet dcad30336a5440bca17cda2724035211 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:58:35.985292  1514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcad30336a5440bca17cda2724035211. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.008610  1518 tablet_service.cc:1511] Processing CreateTablet for tablet 72071486140c4d6c919b25e882a8f5e5 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:58:36.008978  1513 tablet_service.cc:1511] Processing CreateTablet for tablet 7ba438a35d164c02a9840bbedeac6097 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:58:36.011881  1518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72071486140c4d6c919b25e882a8f5e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.021622  1663 tablet_service.cc:1511] Processing CreateTablet for tablet 7ba438a35d164c02a9840bbedeac6097 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:58:36.018532  1513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ba438a35d164c02a9840bbedeac6097. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.028427  1663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ba438a35d164c02a9840bbedeac6097. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.033999  1667 tablet_service.cc:1511] Processing CreateTablet for tablet 7b4d826f7c344b45b7de4b9f69ea958b (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:58:36.023497  1515 tablet_service.cc:1511] Processing CreateTablet for tablet a5802fa5e328499da4525506ccdf4dc9 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:58:36.035631  1515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5802fa5e328499da4525506ccdf4dc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.043756  1593 tablet_service.cc:1511] Processing CreateTablet for tablet 770925e70faa4a16a275abd5282f5284 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:58:36.047976  1593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 770925e70faa4a16a275abd5282f5284. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.045019  1521 tablet_service.cc:1511] Processing CreateTablet for tablet 7b4d826f7c344b45b7de4b9f69ea958b (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:58:36.059849  1668 tablet_service.cc:1511] Processing CreateTablet for tablet 770925e70faa4a16a275abd5282f5284 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:58:36.068091  1521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b4d826f7c344b45b7de4b9f69ea958b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.079535  1591 tablet_service.cc:1511] Processing CreateTablet for tablet bb48619ad4f74c71a726835ef5a8b4c2 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:58:36.081086  1591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb48619ad4f74c71a726835ef5a8b4c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.085623  1666 tablet_service.cc:1511] Processing CreateTablet for tablet 72071486140c4d6c919b25e882a8f5e5 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:58:36.074512  1663 tablet_service.cc:1511] Processing CreateTablet for tablet fbb85f388454464192e052f706a78e65 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:58:36.088289  1671 tablet_service.cc:1511] Processing CreateTablet for tablet bb48619ad4f74c71a726835ef5a8b4c2 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:58:36.072276  1518 tablet_service.cc:1511] Processing CreateTablet for tablet 770925e70faa4a16a275abd5282f5284 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:58:36.072758  1594 tablet_service.cc:1511] Processing CreateTablet for tablet fbb85f388454464192e052f706a78e65 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:58:36.075876  1513 tablet_service.cc:1511] Processing CreateTablet for tablet fbb85f388454464192e052f706a78e65 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:58:36.092577  1594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbb85f388454464192e052f706a78e65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.096266  1723 tablet_bootstrap.cc:492] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1: Bootstrap starting.
I20260709 12:58:36.035569  1667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b4d826f7c344b45b7de4b9f69ea958b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.103811  1590 tablet_service.cc:1511] Processing CreateTablet for tablet d0b325904f4646bca264eeeea15dfeb0 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:58:36.106365  1521 tablet_service.cc:1511] Processing CreateTablet for tablet bb48619ad4f74c71a726835ef5a8b4c2 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:58:36.104246  1666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72071486140c4d6c919b25e882a8f5e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.092577  1518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 770925e70faa4a16a275abd5282f5284. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.113847  1663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbb85f388454464192e052f706a78e65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.120208  1513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbb85f388454464192e052f706a78e65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.120558  1664 tablet_service.cc:1511] Processing CreateTablet for tablet d0b325904f4646bca264eeeea15dfeb0 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:58:36.121925  1671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb48619ad4f74c71a726835ef5a8b4c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.122934  1668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 770925e70faa4a16a275abd5282f5284. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.123113  1722 tablet_bootstrap.cc:492] T c1d40b53631d4998a9a462e3c91a3004 P ddf11fc190dd4b898773379c6b129d90: Bootstrap starting.
I20260709 12:58:36.133473  1520 tablet_service.cc:1511] Processing CreateTablet for tablet d0b325904f4646bca264eeeea15dfeb0 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:58:36.134756  1722 tablet_bootstrap.cc:654] T c1d40b53631d4998a9a462e3c91a3004 P ddf11fc190dd4b898773379c6b129d90: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:36.135005  1521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb48619ad4f74c71a726835ef5a8b4c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.136329  1664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0b325904f4646bca264eeeea15dfeb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.133514  1721 tablet_bootstrap.cc:492] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642: Bootstrap starting.
I20260709 12:58:36.141528  1516 tablet_service.cc:1511] Processing CreateTablet for tablet 9f373c2c361f4fafa5411e39387ef06e (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:58:36.143325  1597 tablet_service.cc:1511] Processing CreateTablet for tablet 9f373c2c361f4fafa5411e39387ef06e (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:58:36.147802  1670 tablet_service.cc:1511] Processing CreateTablet for tablet 9f373c2c361f4fafa5411e39387ef06e (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:58:36.149092  1670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f373c2c361f4fafa5411e39387ef06e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.154790  1590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0b325904f4646bca264eeeea15dfeb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.159013  1597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f373c2c361f4fafa5411e39387ef06e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.158978  1522 tablet_service.cc:1511] Processing CreateTablet for tablet 1975e24877834ab7ae6da515a5cf6251 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:58:36.160357  1522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1975e24877834ab7ae6da515a5cf6251. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.162199  1520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0b325904f4646bca264eeeea15dfeb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.176591  1721 tablet_bootstrap.cc:654] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:36.184741  1723 tablet_bootstrap.cc:654] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:36.185678  1516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f373c2c361f4fafa5411e39387ef06e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.186549  1589 tablet_service.cc:1511] Processing CreateTablet for tablet 1975e24877834ab7ae6da515a5cf6251 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:58:36.196931  1589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1975e24877834ab7ae6da515a5cf6251. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.190279  1664 tablet_service.cc:1511] Processing CreateTablet for tablet 1975e24877834ab7ae6da515a5cf6251 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:58:36.203812  1664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1975e24877834ab7ae6da515a5cf6251. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.225118  1595 tablet_service.cc:1511] Processing CreateTablet for tablet fb3a9a4620ef4fcd86eb78530746a583 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:58:36.226505  1595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb3a9a4620ef4fcd86eb78530746a583. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.226603  1663 tablet_service.cc:1511] Processing CreateTablet for tablet fb3a9a4620ef4fcd86eb78530746a583 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:58:36.227183  1517 tablet_service.cc:1511] Processing CreateTablet for tablet fb3a9a4620ef4fcd86eb78530746a583 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:58:36.228163  1663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb3a9a4620ef4fcd86eb78530746a583. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.228477  1517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb3a9a4620ef4fcd86eb78530746a583. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:58:36.232142  1478 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:58:36.236963  1671 tablet_service.cc:1511] Processing CreateTablet for tablet 8e096d30f7404398b10b9cd77da3c04c (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:58:36.237244  1593 tablet_service.cc:1511] Processing CreateTablet for tablet 8e096d30f7404398b10b9cd77da3c04c (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:58:36.238247  1671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e096d30f7404398b10b9cd77da3c04c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.249951  1593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e096d30f7404398b10b9cd77da3c04c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.251637  1513 tablet_service.cc:1511] Processing CreateTablet for tablet 8e096d30f7404398b10b9cd77da3c04c (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:58:36.252952  1513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e096d30f7404398b10b9cd77da3c04c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.253305  1722 tablet_bootstrap.cc:492] T c1d40b53631d4998a9a462e3c91a3004 P ddf11fc190dd4b898773379c6b129d90: No bootstrap required, opened a new log
I20260709 12:58:36.253841  1722 ts_tablet_manager.cc:1403] T c1d40b53631d4998a9a462e3c91a3004 P ddf11fc190dd4b898773379c6b129d90: Time spent bootstrapping tablet: real 0.131s	user 0.010s	sys 0.012s
I20260709 12:58:36.255194  1521 tablet_service.cc:1511] Processing CreateTablet for tablet 43a7da8b76b845d39257f80dcbdf6b9a (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:58:36.265095  1670 tablet_service.cc:1511] Processing CreateTablet for tablet 43a7da8b76b845d39257f80dcbdf6b9a (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:58:36.266435  1670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43a7da8b76b845d39257f80dcbdf6b9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.267688  1592 tablet_service.cc:1511] Processing CreateTablet for tablet 9a873ede2f0f418cbcab98586dba9b1e (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:58:36.268942  1592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a873ede2f0f418cbcab98586dba9b1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.271076  1521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43a7da8b76b845d39257f80dcbdf6b9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.271651  1671 tablet_service.cc:1511] Processing CreateTablet for tablet 9a873ede2f0f418cbcab98586dba9b1e (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:58:36.272933  1671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a873ede2f0f418cbcab98586dba9b1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.283689  1516 tablet_service.cc:1511] Processing CreateTablet for tablet 9a873ede2f0f418cbcab98586dba9b1e (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:58:36.284219  1514 tablet_service.cc:1511] Processing CreateTablet for tablet 1359810508724a7a8749ce09a6654a9c (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:58:36.285004  1516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a873ede2f0f418cbcab98586dba9b1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.285584  1514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1359810508724a7a8749ce09a6654a9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.285259  1722 raft_consensus.cc:359] T c1d40b53631d4998a9a462e3c91a3004 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:36.286041  1722 raft_consensus.cc:385] T c1d40b53631d4998a9a462e3c91a3004 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:36.286345  1722 raft_consensus.cc:740] T c1d40b53631d4998a9a462e3c91a3004 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Initialized, Role: FOLLOWER
I20260709 12:58:36.304255  1721 tablet_bootstrap.cc:492] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642: No bootstrap required, opened a new log
I20260709 12:58:36.304768  1721 ts_tablet_manager.cc:1403] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642: Time spent bootstrapping tablet: real 0.192s	user 0.027s	sys 0.029s
I20260709 12:58:36.304437  1590 tablet_service.cc:1511] Processing CreateTablet for tablet 1359810508724a7a8749ce09a6654a9c (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:58:36.305693  1590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1359810508724a7a8749ce09a6654a9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.307564  1721 raft_consensus.cc:359] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:36.308290  1721 raft_consensus.cc:385] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:36.308570  1721 raft_consensus.cc:740] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Initialized, Role: FOLLOWER
I20260709 12:58:36.309403  1721 consensus_queue.cc:260] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:36.302142  1591 tablet_service.cc:1511] Processing CreateTablet for tablet 43a7da8b76b845d39257f80dcbdf6b9a (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:58:36.311774  1591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43a7da8b76b845d39257f80dcbdf6b9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.317685  1670 tablet_service.cc:1511] Processing CreateTablet for tablet 1359810508724a7a8749ce09a6654a9c (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:58:36.319229  1670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1359810508724a7a8749ce09a6654a9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.356268  1723 tablet_bootstrap.cc:492] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1: No bootstrap required, opened a new log
I20260709 12:58:36.357776  1723 ts_tablet_manager.cc:1403] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent bootstrapping tablet: real 0.262s	user 0.014s	sys 0.004s
I20260709 12:58:36.369829  1595 tablet_service.cc:1511] Processing CreateTablet for tablet 4190d217954f4f798b3a610501115290 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:58:36.371127  1595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4190d217954f4f798b3a610501115290. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.370802  1520 tablet_service.cc:1511] Processing CreateTablet for tablet 4190d217954f4f798b3a610501115290 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:58:36.374168  1667 tablet_service.cc:1511] Processing CreateTablet for tablet 4190d217954f4f798b3a610501115290 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:58:36.375406  1632 heartbeater.cc:499] Master 127.0.107.254:40423 was elected leader, sending a full tablet report...
I20260709 12:58:36.375501  1667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4190d217954f4f798b3a610501115290. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.377967  1520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4190d217954f4f798b3a610501115290. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.381678  1517 tablet_service.cc:1511] Processing CreateTablet for tablet 0b050d298db6466f856d263a342e3c51 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:58:36.382941  1517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b050d298db6466f856d263a342e3c51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.389983  1592 tablet_service.cc:1511] Processing CreateTablet for tablet 0b050d298db6466f856d263a342e3c51 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:58:36.391427  1592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b050d298db6466f856d263a342e3c51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.357415  1722 consensus_queue.cc:260] T c1d40b53631d4998a9a462e3c91a3004 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:36.397074  1723 raft_consensus.cc:359] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:36.397872  1723 raft_consensus.cc:385] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:36.397746  1664 tablet_service.cc:1511] Processing CreateTablet for tablet 0b050d298db6466f856d263a342e3c51 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:58:36.398209  1723 raft_consensus.cc:740] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Initialized, Role: FOLLOWER
I20260709 12:58:36.399123  1664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b050d298db6466f856d263a342e3c51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.403771  1721 ts_tablet_manager.cc:1434] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642: Time spent starting tablet: real 0.099s	user 0.006s	sys 0.010s
I20260709 12:58:36.407063  1516 tablet_service.cc:1511] Processing CreateTablet for tablet 64842f503da44f59896ed29b9edd3b29 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:58:36.413304  1723 consensus_queue.cc:260] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:36.415585  1706 heartbeater.cc:499] Master 127.0.107.254:40423 was elected leader, sending a full tablet report...
I20260709 12:58:36.416651  1590 tablet_service.cc:1511] Processing CreateTablet for tablet 64842f503da44f59896ed29b9edd3b29 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:58:36.418733  1590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64842f503da44f59896ed29b9edd3b29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.419766  1722 ts_tablet_manager.cc:1434] T c1d40b53631d4998a9a462e3c91a3004 P ddf11fc190dd4b898773379c6b129d90: Time spent starting tablet: real 0.160s	user 0.008s	sys 0.000s
I20260709 12:58:36.420511  1516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64842f503da44f59896ed29b9edd3b29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.427388  1557 heartbeater.cc:499] Master 127.0.107.254:40423 was elected leader, sending a full tablet report...
I20260709 12:58:36.417312  1671 tablet_service.cc:1511] Processing CreateTablet for tablet 64842f503da44f59896ed29b9edd3b29 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:58:36.431238  1721 tablet_bootstrap.cc:492] T a031a0ef86384487bd1f89ead66f851b P 39a92f5a4352465d8af3af5908fe8642: Bootstrap starting.
I20260709 12:58:36.433905  1522 tablet_service.cc:1511] Processing CreateTablet for tablet e0590ffd096d4e378ab66c1795ff5cce (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:58:36.437603  1671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64842f503da44f59896ed29b9edd3b29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.439680  1589 tablet_service.cc:1511] Processing CreateTablet for tablet e0590ffd096d4e378ab66c1795ff5cce (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:58:36.440950  1589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0590ffd096d4e378ab66c1795ff5cce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.427475  1722 tablet_bootstrap.cc:492] T 2abb9a42c35f4b6386342bccdff6fbf0 P ddf11fc190dd4b898773379c6b129d90: Bootstrap starting.
I20260709 12:58:36.443194  1522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0590ffd096d4e378ab66c1795ff5cce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.457461  1723 ts_tablet_manager.cc:1434] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent starting tablet: real 0.094s	user 0.009s	sys 0.002s
I20260709 12:58:36.458055  1667 tablet_service.cc:1511] Processing CreateTablet for tablet e0590ffd096d4e378ab66c1795ff5cce (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:58:36.458583  1514 tablet_service.cc:1511] Processing CreateTablet for tablet cbe75e7a89594d3f81b1b8935b43b2ed (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:58:36.459837  1514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbe75e7a89594d3f81b1b8935b43b2ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.469208  1722 tablet_bootstrap.cc:654] T 2abb9a42c35f4b6386342bccdff6fbf0 P ddf11fc190dd4b898773379c6b129d90: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:36.458483  1723 tablet_bootstrap.cc:492] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Bootstrap starting.
I20260709 12:58:36.472906  1721 tablet_bootstrap.cc:654] T a031a0ef86384487bd1f89ead66f851b P 39a92f5a4352465d8af3af5908fe8642: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:36.474381  1592 tablet_service.cc:1511] Processing CreateTablet for tablet cbe75e7a89594d3f81b1b8935b43b2ed (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:58:36.475014  1663 tablet_service.cc:1511] Processing CreateTablet for tablet cbe75e7a89594d3f81b1b8935b43b2ed (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:58:36.475647  1667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0590ffd096d4e378ab66c1795ff5cce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.475829  1592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbe75e7a89594d3f81b1b8935b43b2ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.482481  1663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbe75e7a89594d3f81b1b8935b43b2ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.490573  1722 tablet_bootstrap.cc:492] T 2abb9a42c35f4b6386342bccdff6fbf0 P ddf11fc190dd4b898773379c6b129d90: No bootstrap required, opened a new log
I20260709 12:58:36.491137  1722 ts_tablet_manager.cc:1403] T 2abb9a42c35f4b6386342bccdff6fbf0 P ddf11fc190dd4b898773379c6b129d90: Time spent bootstrapping tablet: real 0.064s	user 0.014s	sys 0.000s
I20260709 12:58:36.494084  1722 raft_consensus.cc:359] T 2abb9a42c35f4b6386342bccdff6fbf0 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:36.494855  1722 raft_consensus.cc:385] T 2abb9a42c35f4b6386342bccdff6fbf0 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:36.495213  1722 raft_consensus.cc:740] T 2abb9a42c35f4b6386342bccdff6fbf0 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Initialized, Role: FOLLOWER
I20260709 12:58:36.498016  1722 consensus_queue.cc:260] T 2abb9a42c35f4b6386342bccdff6fbf0 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:36.503827  1723 tablet_bootstrap.cc:654] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:36.498601  1517 tablet_service.cc:1511] Processing CreateTablet for tablet 819fbeffe41b4610a05fcaac38e161b6 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:58:36.507776  1517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 819fbeffe41b4610a05fcaac38e161b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.509650  1721 tablet_bootstrap.cc:492] T a031a0ef86384487bd1f89ead66f851b P 39a92f5a4352465d8af3af5908fe8642: No bootstrap required, opened a new log
I20260709 12:58:36.510176  1589 tablet_service.cc:1511] Processing CreateTablet for tablet 819fbeffe41b4610a05fcaac38e161b6 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:58:36.511581  1589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 819fbeffe41b4610a05fcaac38e161b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.510195  1721 ts_tablet_manager.cc:1403] T a031a0ef86384487bd1f89ead66f851b P 39a92f5a4352465d8af3af5908fe8642: Time spent bootstrapping tablet: real 0.079s	user 0.014s	sys 0.002s
I20260709 12:58:36.516883  1671 tablet_service.cc:1511] Processing CreateTablet for tablet 819fbeffe41b4610a05fcaac38e161b6 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:58:36.518297  1671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 819fbeffe41b4610a05fcaac38e161b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.518567  1721 raft_consensus.cc:359] T a031a0ef86384487bd1f89ead66f851b P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:36.519335  1721 raft_consensus.cc:385] T a031a0ef86384487bd1f89ead66f851b P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:36.521546  1722 ts_tablet_manager.cc:1434] T 2abb9a42c35f4b6386342bccdff6fbf0 P ddf11fc190dd4b898773379c6b129d90: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 12:58:36.522526  1722 tablet_bootstrap.cc:492] T dcad30336a5440bca17cda2724035211 P ddf11fc190dd4b898773379c6b129d90: Bootstrap starting.
I20260709 12:58:36.519644  1721 raft_consensus.cc:740] T a031a0ef86384487bd1f89ead66f851b P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Initialized, Role: FOLLOWER
I20260709 12:58:36.537809  1722 tablet_bootstrap.cc:654] T dcad30336a5440bca17cda2724035211 P ddf11fc190dd4b898773379c6b129d90: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:36.538884  1721 consensus_queue.cc:260] T a031a0ef86384487bd1f89ead66f851b P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:36.542145  1721 ts_tablet_manager.cc:1434] T a031a0ef86384487bd1f89ead66f851b P 39a92f5a4352465d8af3af5908fe8642: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.001s
I20260709 12:58:36.543185  1721 tablet_bootstrap.cc:492] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642: Bootstrap starting.
I20260709 12:58:36.542966  1592 tablet_service.cc:1511] Processing CreateTablet for tablet 429fe651e8bc487eb6f07e38a7c3cb41 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:58:36.545328  1592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 429fe651e8bc487eb6f07e38a7c3cb41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.548763  1522 tablet_service.cc:1511] Processing CreateTablet for tablet 429fe651e8bc487eb6f07e38a7c3cb41 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:58:36.550741  1522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 429fe651e8bc487eb6f07e38a7c3cb41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.562536  1667 tablet_service.cc:1511] Processing CreateTablet for tablet 429fe651e8bc487eb6f07e38a7c3cb41 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:58:36.563153  1723 tablet_bootstrap.cc:492] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1: No bootstrap required, opened a new log
I20260709 12:58:36.563738  1723 ts_tablet_manager.cc:1403] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent bootstrapping tablet: real 0.105s	user 0.008s	sys 0.018s
I20260709 12:58:36.564947  1514 tablet_service.cc:1511] Processing CreateTablet for tablet 21e83a626139459097bb40dc22d9bd93 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:58:36.566282  1514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21e83a626139459097bb40dc22d9bd93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.566769  1723 raft_consensus.cc:359] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:36.567548  1723 raft_consensus.cc:385] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:36.567834  1723 raft_consensus.cc:740] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Initialized, Role: FOLLOWER
I20260709 12:58:36.568578  1723 consensus_queue.cc:260] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:36.574616  1667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 429fe651e8bc487eb6f07e38a7c3cb41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.576860  1722 tablet_bootstrap.cc:492] T dcad30336a5440bca17cda2724035211 P ddf11fc190dd4b898773379c6b129d90: No bootstrap required, opened a new log
I20260709 12:58:36.577368  1722 ts_tablet_manager.cc:1403] T dcad30336a5440bca17cda2724035211 P ddf11fc190dd4b898773379c6b129d90: Time spent bootstrapping tablet: real 0.055s	user 0.008s	sys 0.002s
I20260709 12:58:36.580406  1722 raft_consensus.cc:359] T dcad30336a5440bca17cda2724035211 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:36.581171  1722 raft_consensus.cc:385] T dcad30336a5440bca17cda2724035211 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:36.581463  1722 raft_consensus.cc:740] T dcad30336a5440bca17cda2724035211 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Initialized, Role: FOLLOWER
I20260709 12:58:36.581607  1723 ts_tablet_manager.cc:1434] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 12:58:36.582643  1723 tablet_bootstrap.cc:492] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Bootstrap starting.
I20260709 12:58:36.577391  1721 tablet_bootstrap.cc:654] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:36.582595  1722 consensus_queue.cc:260] T dcad30336a5440bca17cda2724035211 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:36.589035  1723 tablet_bootstrap.cc:654] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:36.589167  1592 tablet_service.cc:1511] Processing CreateTablet for tablet 21e83a626139459097bb40dc22d9bd93 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:58:36.594079  1663 tablet_service.cc:1511] Processing CreateTablet for tablet 21e83a626139459097bb40dc22d9bd93 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:58:36.595513  1592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21e83a626139459097bb40dc22d9bd93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.595512  1663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21e83a626139459097bb40dc22d9bd93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.611177  1522 tablet_service.cc:1511] Processing CreateTablet for tablet a7cff69bd4394da195321efd78d5a703 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:58:36.616634  1664 tablet_service.cc:1511] Processing CreateTablet for tablet a7cff69bd4394da195321efd78d5a703 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:58:36.615384  1589 tablet_service.cc:1511] Processing CreateTablet for tablet a7cff69bd4394da195321efd78d5a703 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:58:36.618945  1589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7cff69bd4394da195321efd78d5a703. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.623349  1522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7cff69bd4394da195321efd78d5a703. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.627971  1664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7cff69bd4394da195321efd78d5a703. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.629268  1727 raft_consensus.cc:493] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:36.629796  1727 raft_consensus.cc:515] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:36.633874  1727 leader_election.cc:290] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:36.646214  1722 ts_tablet_manager.cc:1434] T dcad30336a5440bca17cda2724035211 P ddf11fc190dd4b898773379c6b129d90: Time spent starting tablet: real 0.069s	user 0.008s	sys 0.000s
I20260709 12:58:36.660797  1721 tablet_bootstrap.cc:492] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642: No bootstrap required, opened a new log
I20260709 12:58:36.661453  1721 ts_tablet_manager.cc:1403] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642: Time spent bootstrapping tablet: real 0.118s	user 0.011s	sys 0.005s
I20260709 12:58:36.665084  1729 raft_consensus.cc:493] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:36.664987  1721 raft_consensus.cc:359] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:36.665957  1721 raft_consensus.cc:385] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:36.665705  1729 raft_consensus.cc:515] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:36.666328  1721 raft_consensus.cc:740] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Initialized, Role: FOLLOWER
I20260709 12:58:36.701615  1721 consensus_queue.cc:260] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:36.701938  1593 tablet_service.cc:1511] Processing CreateTablet for tablet 4549f0dba6504cfda954259e71ec4c91 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:58:36.702749  1671 tablet_service.cc:1511] Processing CreateTablet for tablet 4549f0dba6504cfda954259e71ec4c91 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:58:36.703176  1593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4549f0dba6504cfda954259e71ec4c91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.703400  1664 tablet_service.cc:1511] Processing CreateTablet for tablet d53340cc35954204b06e3743bec8adbf (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:58:36.703871  1721 ts_tablet_manager.cc:1434] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.000s
I20260709 12:58:36.704021  1671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4549f0dba6504cfda954259e71ec4c91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.704607  1664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d53340cc35954204b06e3743bec8adbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.653935  1514 tablet_service.cc:1511] Processing CreateTablet for tablet 7352869c54614c80af4953b2ce90cace (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:58:36.708781  1514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7352869c54614c80af4953b2ce90cace. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.669886  1729 leader_election.cc:290] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:36.653839  1517 tablet_service.cc:1511] Processing CreateTablet for tablet ad4dae0957134e9aba74a14dc8984866 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:58:36.711441  1721 tablet_bootstrap.cc:492] T 9b7b5b00d91c4b488d16174662489496 P 39a92f5a4352465d8af3af5908fe8642: Bootstrap starting.
I20260709 12:58:36.711529  1517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad4dae0957134e9aba74a14dc8984866. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.671568  1516 tablet_service.cc:1511] Processing CreateTablet for tablet d53340cc35954204b06e3743bec8adbf (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:58:36.713341  1516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d53340cc35954204b06e3743bec8adbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.661399  1722 tablet_bootstrap.cc:492] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90: Bootstrap starting.
I20260709 12:58:36.679466  1723 tablet_bootstrap.cc:492] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1: No bootstrap required, opened a new log
I20260709 12:58:36.716881  1723 ts_tablet_manager.cc:1403] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent bootstrapping tablet: real 0.134s	user 0.050s	sys 0.042s
I20260709 12:58:36.690567  1520 tablet_service.cc:1511] Processing CreateTablet for tablet 4549f0dba6504cfda954259e71ec4c91 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:58:36.718535  1728 raft_consensus.cc:493] T dcad30336a5440bca17cda2724035211 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:36.719311  1520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4549f0dba6504cfda954259e71ec4c91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.719135  1728 raft_consensus.cc:515] T dcad30336a5440bca17cda2724035211 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:36.697221  1663 tablet_service.cc:1511] Processing CreateTablet for tablet 7352869c54614c80af4953b2ce90cace (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:58:36.697562  1521 tablet_service.cc:1511] Processing CreateTablet for tablet 94d0d4cbe71742a39337e80ad5770e28 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:58:36.721599  1663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7352869c54614c80af4953b2ce90cace. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.721732  1521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94d0d4cbe71742a39337e80ad5770e28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.699301  1592 tablet_service.cc:1511] Processing CreateTablet for tablet 7352869c54614c80af4953b2ce90cace (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:58:36.699590  1590 tablet_service.cc:1511] Processing CreateTablet for tablet ad4dae0957134e9aba74a14dc8984866 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:58:36.726706  1590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad4dae0957134e9aba74a14dc8984866. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.699944  1591 tablet_service.cc:1511] Processing CreateTablet for tablet d53340cc35954204b06e3743bec8adbf (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:58:36.728735  1591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d53340cc35954204b06e3743bec8adbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.700404  1667 tablet_service.cc:1511] Processing CreateTablet for tablet ad4dae0957134e9aba74a14dc8984866 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:58:36.730756  1667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad4dae0957134e9aba74a14dc8984866. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.733440  1592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7352869c54614c80af4953b2ce90cace. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.745540  1721 tablet_bootstrap.cc:654] T 9b7b5b00d91c4b488d16174662489496 P 39a92f5a4352465d8af3af5908fe8642: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:36.751895  1723 raft_consensus.cc:359] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:36.752661  1723 raft_consensus.cc:385] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:36.752959  1723 raft_consensus.cc:740] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Initialized, Role: FOLLOWER
I20260709 12:58:36.753633  1723 consensus_queue.cc:260] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:36.761993  1727 raft_consensus.cc:493] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:36.762565  1727 raft_consensus.cc:515] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:36.764715  1727 leader_election.cc:290] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:36.769282  1722 tablet_bootstrap.cc:654] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:36.776440  1723 ts_tablet_manager.cc:1434] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent starting tablet: real 0.059s	user 0.004s	sys 0.005s
I20260709 12:58:36.777578  1723 tablet_bootstrap.cc:492] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Bootstrap starting.
I20260709 12:58:36.786844  1728 leader_election.cc:290] T dcad30336a5440bca17cda2724035211 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:58:36.787459  1728 raft_consensus.cc:493] T 2abb9a42c35f4b6386342bccdff6fbf0 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:36.787915  1728 raft_consensus.cc:515] T 2abb9a42c35f4b6386342bccdff6fbf0 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:36.789845  1728 leader_election.cc:290] T 2abb9a42c35f4b6386342bccdff6fbf0 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:58:36.798017  1589 tablet_service.cc:1511] Processing CreateTablet for tablet 94d0d4cbe71742a39337e80ad5770e28 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:58:36.799432  1589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94d0d4cbe71742a39337e80ad5770e28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.800391  1670 tablet_service.cc:1511] Processing CreateTablet for tablet 94d0d4cbe71742a39337e80ad5770e28 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:58:36.807773  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:58:36.808493  1681 raft_consensus.cc:2468] T c1d40b53631d4998a9a462e3c91a3004 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 0.
I20260709 12:58:36.809743  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:58:36.811193  1571 leader_election.cc:304] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:58:36.812110  1727 raft_consensus.cc:2804] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:36.812479  1727 raft_consensus.cc:493] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:36.812813  1727 raft_consensus.cc:3060] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:58:36.818325  1571 leader_election.cc:343] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:36.824150  1670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94d0d4cbe71742a39337e80ad5770e28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.825001  1522 tablet_service.cc:1511] Processing CreateTablet for tablet e4b8c02fb560459fbbb59424361a5457 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:58:36.826344  1522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4b8c02fb560459fbbb59424361a5457. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.832743  1595 tablet_service.cc:1511] Processing CreateTablet for tablet e4b8c02fb560459fbbb59424361a5457 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:58:36.834084  1595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4b8c02fb560459fbbb59424361a5457. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.840052  1513 tablet_service.cc:1511] Processing CreateTablet for tablet 112134ca2a6243c98c85c27d41496747 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:58:36.841481  1513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 112134ca2a6243c98c85c27d41496747. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.847779  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:58:36.852042  1607 raft_consensus.cc:2468] T a031a0ef86384487bd1f89ead66f851b P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 0.
I20260709 12:58:36.856088  1589 tablet_service.cc:1511] Processing CreateTablet for tablet 112134ca2a6243c98c85c27d41496747 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:58:36.856634  1668 tablet_service.cc:1511] Processing CreateTablet for tablet e4b8c02fb560459fbbb59424361a5457 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:58:36.857434  1589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 112134ca2a6243c98c85c27d41496747. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.857126  1666 tablet_service.cc:1511] Processing CreateTablet for tablet 112134ca2a6243c98c85c27d41496747 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:58:36.857671  1497 leader_election.cc:304] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:58:36.858435  1666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 112134ca2a6243c98c85c27d41496747. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.865901  1668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4b8c02fb560459fbbb59424361a5457. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.869128  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:58:36.858477  1729 raft_consensus.cc:2804] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:36.871119  1729 raft_consensus.cc:493] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:36.871506  1729 raft_consensus.cc:3060] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:36.870705  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 12:58:36.871632  1570 leader_election.cc:343] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:58:36.876348  1570 leader_election.cc:343] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:36.876838  1570 leader_election.cc:304] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:58:36.890416  1520 tablet_service.cc:1511] Processing CreateTablet for tablet 1e4adfe2190c4487ab72be02d6cfa923 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:58:36.891834  1520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e4adfe2190c4487ab72be02d6cfa923. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.904938  1663 tablet_service.cc:1511] Processing CreateTablet for tablet 1e4adfe2190c4487ab72be02d6cfa923 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:58:36.906845  1663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e4adfe2190c4487ab72be02d6cfa923. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.906648  1522 tablet_service.cc:1511] Processing CreateTablet for tablet 073cc710cf6642bb940606f8df5c2331 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:58:36.907918  1522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 073cc710cf6642bb940606f8df5c2331. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.885398  1727 raft_consensus.cc:515] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:36.910348  1727 leader_election.cc:290] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:36.911012  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:58:36.911633  1680 raft_consensus.cc:3060] T c1d40b53631d4998a9a462e3c91a3004 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:36.917829  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:58:36.918306  1593 tablet_service.cc:1511] Processing CreateTablet for tablet 1e4adfe2190c4487ab72be02d6cfa923 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
W20260709 12:58:36.919420  1570 leader_election.cc:343] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:36.920679  1589 tablet_service.cc:1511] Processing CreateTablet for tablet 073cc710cf6642bb940606f8df5c2331 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:58:36.919667  1593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e4adfe2190c4487ab72be02d6cfa923. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.928241  1662 tablet_service.cc:1511] Processing CreateTablet for tablet 073cc710cf6642bb940606f8df5c2331 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:58:36.929589  1662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 073cc710cf6642bb940606f8df5c2331. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.929417  1516 tablet_service.cc:1511] Processing CreateTablet for tablet 93811be2a8094a489bcf8091e503f2c9 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:58:36.932473  1516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93811be2a8094a489bcf8091e503f2c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.932281  1665 tablet_service.cc:1511] Processing CreateTablet for tablet 93811be2a8094a489bcf8091e503f2c9 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:58:36.933562  1665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93811be2a8094a489bcf8091e503f2c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.935400  1721 tablet_bootstrap.cc:492] T 9b7b5b00d91c4b488d16174662489496 P 39a92f5a4352465d8af3af5908fe8642: No bootstrap required, opened a new log
I20260709 12:58:36.938355  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 12:58:36.944172  1644 leader_election.cc:343] T dcad30336a5440bca17cda2724035211 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:36.938877  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:58:36.939107  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 12:58:36.946264  1644 leader_election.cc:343] T 2abb9a42c35f4b6386342bccdff6fbf0 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:36.946354  1589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 073cc710cf6642bb940606f8df5c2331. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.946959  1722 tablet_bootstrap.cc:492] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90: No bootstrap required, opened a new log
I20260709 12:58:36.939685  1590 tablet_service.cc:1511] Processing CreateTablet for tablet 93811be2a8094a489bcf8091e503f2c9 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
W20260709 12:58:36.947470  1496 leader_election.cc:343] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:36.947499  1722 ts_tablet_manager.cc:1403] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90: Time spent bootstrapping tablet: real 0.286s	user 0.009s	sys 0.021s
I20260709 12:58:36.949065  1723 tablet_bootstrap.cc:654] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:36.951081  1722 raft_consensus.cc:359] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:36.951778  1722 raft_consensus.cc:385] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:36.952060  1722 raft_consensus.cc:740] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Initialized, Role: FOLLOWER
I20260709 12:58:36.952091  1729 raft_consensus.cc:515] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:36.953603  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:58:36.954147  1729 leader_election.cc:290] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 12:58:36.955086  1646 leader_election.cc:343] T dcad30336a5440bca17cda2724035211 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:36.955515  1646 leader_election.cc:304] T dcad30336a5440bca17cda2724035211 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:58:36.956784  1721 ts_tablet_manager.cc:1403] T 9b7b5b00d91c4b488d16174662489496 P 39a92f5a4352465d8af3af5908fe8642: Time spent bootstrapping tablet: real 0.246s	user 0.040s	sys 0.031s
I20260709 12:58:36.955103  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:58:36.957669  1747 raft_consensus.cc:2749] T dcad30336a5440bca17cda2724035211 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:36.958611  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:58:36.958485  1722 consensus_queue.cc:260] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:36.959712  1721 raft_consensus.cc:359] T 9b7b5b00d91c4b488d16174662489496 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:36.960421  1721 raft_consensus.cc:385] T 9b7b5b00d91c4b488d16174662489496 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:36.960695  1721 raft_consensus.cc:740] T 9b7b5b00d91c4b488d16174662489496 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Initialized, Role: FOLLOWER
W20260709 12:58:36.961230  1646 leader_election.cc:343] T 2abb9a42c35f4b6386342bccdff6fbf0 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:36.961644  1646 leader_election.cc:304] T 2abb9a42c35f4b6386342bccdff6fbf0 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:58:36.961529  1721 consensus_queue.cc:260] T 9b7b5b00d91c4b488d16174662489496 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:36.962785  1728 raft_consensus.cc:2749] T 2abb9a42c35f4b6386342bccdff6fbf0 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:58:36.960661  1496 leader_election.cc:343] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:36.963754  1721 ts_tablet_manager.cc:1434] T 9b7b5b00d91c4b488d16174662489496 P 39a92f5a4352465d8af3af5908fe8642: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:58:36.967255  1721 tablet_bootstrap.cc:492] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642: Bootstrap starting.
I20260709 12:58:36.968096  1751 raft_consensus.cc:2749] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:36.968713  1590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93811be2a8094a489bcf8091e503f2c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.960836  1722 ts_tablet_manager.cc:1434] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:58:36.975397  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:58:36.975988  1606 raft_consensus.cc:3060] T a031a0ef86384487bd1f89ead66f851b P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:36.997344  1722 tablet_bootstrap.cc:492] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90: Bootstrap starting.
W20260709 12:58:37.009464  1414 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 49684.2us
I20260709 12:58:37.011859  1517 tablet_service.cc:1511] Processing CreateTablet for tablet 8a1804adcd3844f5837dfc27d40e4cdf (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:58:37.012220  1669 tablet_service.cc:1511] Processing CreateTablet for tablet 8a1804adcd3844f5837dfc27d40e4cdf (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:58:37.013177  1517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a1804adcd3844f5837dfc27d40e4cdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:37.013525  1669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a1804adcd3844f5837dfc27d40e4cdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:37.017349  1591 tablet_service.cc:1511] Processing CreateTablet for tablet 8a1804adcd3844f5837dfc27d40e4cdf (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:58:37.017691  1593 tablet_service.cc:1511] Processing CreateTablet for tablet 317204271cc04f68818b36450c9725b1 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:58:37.018738  1591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a1804adcd3844f5837dfc27d40e4cdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:37.021538  1593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 317204271cc04f68818b36450c9725b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:37.022217  1597 tablet_service.cc:1511] Processing CreateTablet for tablet 822e65124bb44159b257fd219d28d93c (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:58:37.023705  1597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 822e65124bb44159b257fd219d28d93c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:37.025764  1516 tablet_service.cc:1511] Processing CreateTablet for tablet 317204271cc04f68818b36450c9725b1 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:58:37.027302  1516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 317204271cc04f68818b36450c9725b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:37.027351  1521 tablet_service.cc:1511] Processing CreateTablet for tablet 822e65124bb44159b257fd219d28d93c (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:58:37.029462  1521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 822e65124bb44159b257fd219d28d93c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:37.033905  1594 tablet_service.cc:1511] Processing CreateTablet for tablet 4ea41c88222b469fb11229faef735050 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:58:37.035293  1594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ea41c88222b469fb11229faef735050. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:37.037410  1721 tablet_bootstrap.cc:654] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:37.039269  1596 tablet_service.cc:1511] Processing CreateTablet for tablet e78618eba8b74effa4a90f2c8e34cc02 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:58:37.040630  1596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e78618eba8b74effa4a90f2c8e34cc02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:37.041054  1729 raft_consensus.cc:493] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:37.041538  1729 raft_consensus.cc:515] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:37.043591  1729 leader_election.cc:290] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:37.045719  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:58:37.048565  1680 raft_consensus.cc:2468] T c1d40b53631d4998a9a462e3c91a3004 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 1.
I20260709 12:58:37.050280  1514 tablet_service.cc:1511] Processing CreateTablet for tablet e78618eba8b74effa4a90f2c8e34cc02 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:58:37.051406  1722 tablet_bootstrap.cc:654] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:37.051605  1514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e78618eba8b74effa4a90f2c8e34cc02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:37.052626  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:58:37.053738  1606 raft_consensus.cc:2468] T a031a0ef86384487bd1f89ead66f851b P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 1.
I20260709 12:58:37.057550  1588 tablet_service.cc:1511] Processing CreateTablet for tablet 2228d923442c4e439f7f227db910dad8 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:58:37.058952  1588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2228d923442c4e439f7f227db910dad8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:37.046372  1681 raft_consensus.cc:2468] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 0.
I20260709 12:58:37.065340  1664 tablet_service.cc:1511] Processing CreateTablet for tablet 317204271cc04f68818b36450c9725b1 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
W20260709 12:58:37.066222  1497 leader_election.cc:343] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:37.066908  1571 leader_election.cc:304] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:58:37.068143  1751 raft_consensus.cc:2804] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:37.068606  1751 raft_consensus.cc:697] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:58:37.069415  1751 consensus_queue.cc:237] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:37.071368  1497 leader_election.cc:304] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 12:58:37.072733  1729 raft_consensus.cc:2804] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:37.069571  1668 tablet_service.cc:1511] Processing CreateTablet for tablet 822e65124bb44159b257fd219d28d93c (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:58:37.073622  1592 tablet_service.cc:1511] Processing CreateTablet for tablet 3406989a2b754fe7804c691a11bba6d0 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:58:37.087803  1663 tablet_service.cc:1511] Processing CreateTablet for tablet e78618eba8b74effa4a90f2c8e34cc02 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:58:37.082626  1664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 317204271cc04f68818b36450c9725b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:37.091405  1667 tablet_service.cc:1511] Processing CreateTablet for tablet 2228d923442c4e439f7f227db910dad8 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:58:37.095053  1665 tablet_service.cc:1511] Processing CreateTablet for tablet 4ea41c88222b469fb11229faef735050 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:58:37.076412  1595 tablet_service.cc:1511] Processing CreateTablet for tablet bf3b3cd19c1e496fa7fdb5550772123b (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:58:37.098184  1671 tablet_service.cc:1511] Processing CreateTablet for tablet bf3b3cd19c1e496fa7fdb5550772123b (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:58:37.098188  1670 tablet_service.cc:1511] Processing CreateTablet for tablet 3406989a2b754fe7804c691a11bba6d0 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:58:37.092530  1592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3406989a2b754fe7804c691a11bba6d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:37.085562  1729 raft_consensus.cc:697] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 12:58:37.099699  1496 leader_election.cc:304] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 12:58:37.111891  1520 tablet_service.cc:1511] Processing CreateTablet for tablet 2228d923442c4e439f7f227db910dad8 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:58:37.112603  1595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf3b3cd19c1e496fa7fdb5550772123b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:37.113217  1670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3406989a2b754fe7804c691a11bba6d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:37.131655  1665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ea41c88222b469fb11229faef735050. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:37.113749  1727 raft_consensus.cc:493] T 9b7b5b00d91c4b488d16174662489496 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:37.132329  1727 raft_consensus.cc:515] T 9b7b5b00d91c4b488d16174662489496 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:37.113893  1722 tablet_bootstrap.cc:492] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90: No bootstrap required, opened a new log
I20260709 12:58:37.124367  1729 consensus_queue.cc:237] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:37.112938  1589 tablet_service.cc:1511] Processing CreateTablet for tablet 8ea5da45c6d2479383e6af85e0a394b5 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:58:37.134627  1722 ts_tablet_manager.cc:1403] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90: Time spent bootstrapping tablet: real 0.138s	user 0.017s	sys 0.009s
I20260709 12:58:37.135190  1589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ea5da45c6d2479383e6af85e0a394b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:37.138792  1722 raft_consensus.cc:359] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:37.139825  1722 raft_consensus.cc:385] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:37.140159  1722 raft_consensus.cc:740] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Initialized, Role: FOLLOWER
I20260709 12:58:37.140445  1520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2228d923442c4e439f7f227db910dad8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:37.146062  1518 tablet_service.cc:1511] Processing CreateTablet for tablet bf3b3cd19c1e496fa7fdb5550772123b (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:58:37.144351  1722 consensus_queue.cc:260] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:37.147387  1518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf3b3cd19c1e496fa7fdb5550772123b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:37.147447  1667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2228d923442c4e439f7f227db910dad8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:37.149297  1668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 822e65124bb44159b257fd219d28d93c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:37.150064  1519 tablet_service.cc:1511] Processing CreateTablet for tablet 8ea5da45c6d2479383e6af85e0a394b5 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:58:37.151319  1519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ea5da45c6d2479383e6af85e0a394b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:37.151367  1723 tablet_bootstrap.cc:492] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1: No bootstrap required, opened a new log
I20260709 12:58:37.152035  1723 ts_tablet_manager.cc:1403] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent bootstrapping tablet: real 0.375s	user 0.015s	sys 0.014s
I20260709 12:58:37.155040  1663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e78618eba8b74effa4a90f2c8e34cc02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:37.154899  1723 raft_consensus.cc:359] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:37.155689  1723 raft_consensus.cc:385] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:37.156071  1723 raft_consensus.cc:740] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Initialized, Role: FOLLOWER
I20260709 12:58:37.156823  1513 tablet_service.cc:1511] Processing CreateTablet for tablet 3406989a2b754fe7804c691a11bba6d0 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:58:37.158245  1513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3406989a2b754fe7804c691a11bba6d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:37.156795  1723 consensus_queue.cc:260] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:37.159123  1671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf3b3cd19c1e496fa7fdb5550772123b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:58:37.159188  1416 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 47390.5us
I20260709 12:58:37.091948  1522 tablet_service.cc:1511] Processing CreateTablet for tablet 4ea41c88222b469fb11229faef735050 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:58:37.162999  1522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ea41c88222b469fb11229faef735050. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:37.166368  1754 raft_consensus.cc:2804] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:37.166831  1754 raft_consensus.cc:493] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:37.167184  1754 raft_consensus.cc:3060] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:37.167109  1669 tablet_service.cc:1511] Processing CreateTablet for tablet 8ea5da45c6d2479383e6af85e0a394b5 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:58:37.171712  1669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ea5da45c6d2479383e6af85e0a394b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:37.192059  1727 leader_election.cc:290] T 9b7b5b00d91c4b488d16174662489496 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:37.197455  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:58:37.198736  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 12:58:37.200050  1571 leader_election.cc:343] T 9b7b5b00d91c4b488d16174662489496 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:58:37.200601  1570 leader_election.cc:343] T 9b7b5b00d91c4b488d16174662489496 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:37.201006  1570 leader_election.cc:304] T 9b7b5b00d91c4b488d16174662489496 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:58:37.202000  1727 raft_consensus.cc:2749] T 9b7b5b00d91c4b488d16174662489496 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:58:37.234647  1478 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:58:37.236331  1722 ts_tablet_manager.cc:1434] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90: Time spent starting tablet: real 0.101s	user 0.003s	sys 0.004s
I20260709 12:58:37.240391  1722 tablet_bootstrap.cc:492] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90: Bootstrap starting.
I20260709 12:58:37.252277  1522 tablet_service.cc:1511] Processing CreateTablet for tablet 0ff83996d65d44e1925b89ba8eacd311 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:58:37.261659  1522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ff83996d65d44e1925b89ba8eacd311. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:37.266988  1758 raft_consensus.cc:493] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:37.267557  1758 raft_consensus.cc:515] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:37.283023  1597 tablet_service.cc:1511] Processing CreateTablet for tablet 0ff83996d65d44e1925b89ba8eacd311 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:58:37.284395  1721 tablet_bootstrap.cc:492] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642: No bootstrap required, opened a new log
I20260709 12:58:37.284883  1721 ts_tablet_manager.cc:1403] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642: Time spent bootstrapping tablet: real 0.318s	user 0.019s	sys 0.017s
I20260709 12:58:37.285144  1597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ff83996d65d44e1925b89ba8eacd311. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:37.286650  1758 leader_election.cc:290] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:37.289675  1723 ts_tablet_manager.cc:1434] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent starting tablet: real 0.137s	user 0.029s	sys 0.013s
I20260709 12:58:37.287016  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:58:37.298243  1723 tablet_bootstrap.cc:492] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Bootstrap starting.
I20260709 12:58:37.299531  1663 tablet_service.cc:1511] Processing CreateTablet for tablet 0ff83996d65d44e1925b89ba8eacd311 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:58:37.300707  1663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ff83996d65d44e1925b89ba8eacd311. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:58:37.302023  1497 leader_election.cc:343] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:37.302073  1428 catalog_manager.cc:5697] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 0 to 1, leader changed from <none> to 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:37.306330  1429 catalog_manager.cc:5697] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:37.310773  1666 tablet_service.cc:1511] Processing CreateTablet for tablet 2eadc97fd6dd494596f9ea9242d9db59 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:58:37.311681  1721 raft_consensus.cc:359] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:37.312192  1666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2eadc97fd6dd494596f9ea9242d9db59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:37.319598  1592 tablet_service.cc:1511] Processing CreateTablet for tablet 2eadc97fd6dd494596f9ea9242d9db59 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:58:37.320931  1592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2eadc97fd6dd494596f9ea9242d9db59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:37.315496  1721 raft_consensus.cc:385] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:37.326198  1721 raft_consensus.cc:740] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Initialized, Role: FOLLOWER
I20260709 12:58:37.334492  1589 tablet_service.cc:1511] Processing CreateTablet for tablet 04fed4c219e14efb9f9a8eb0d336ceac (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:58:37.335707  1589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04fed4c219e14efb9f9a8eb0d336ceac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:37.352130  1522 tablet_service.cc:1511] Processing CreateTablet for tablet 2eadc97fd6dd494596f9ea9242d9db59 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:58:37.353354  1522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2eadc97fd6dd494596f9ea9242d9db59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:37.356348  1721 consensus_queue.cc:260] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:37.355639  1514 tablet_service.cc:1511] Processing CreateTablet for tablet 04fed4c219e14efb9f9a8eb0d336ceac (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:58:37.360965  1663 tablet_service.cc:1511] Processing CreateTablet for tablet 04fed4c219e14efb9f9a8eb0d336ceac (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:58:37.361265  1514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04fed4c219e14efb9f9a8eb0d336ceac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:37.363085  1754 raft_consensus.cc:515] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:37.365182  1754 leader_election.cc:290] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:37.365996  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
W20260709 12:58:37.367513  1497 leader_election.cc:343] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:37.371124  1721 ts_tablet_manager.cc:1434] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642: Time spent starting tablet: real 0.086s	user 0.007s	sys 0.001s
I20260709 12:58:37.372212  1721 tablet_bootstrap.cc:492] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642: Bootstrap starting.
I20260709 12:58:37.373394  1663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04fed4c219e14efb9f9a8eb0d336ceac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:37.378250  1721 tablet_bootstrap.cc:654] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642: Neither blocks nor log segments found. Creating new log.
W20260709 12:58:37.410384  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 310786us
I20260709 12:58:37.413753  1595 tablet_service.cc:1511] Processing CreateTablet for tablet 4faabc98f1164ba881cfb477657da505 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:58:37.416450  1595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4faabc98f1164ba881cfb477657da505. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:37.416994  1671 tablet_service.cc:1511] Processing CreateTablet for tablet 4faabc98f1164ba881cfb477657da505 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:58:37.419792  1513 tablet_service.cc:1511] Processing CreateTablet for tablet 4faabc98f1164ba881cfb477657da505 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:58:37.421133  1513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4faabc98f1164ba881cfb477657da505. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:37.428741  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:58:37.381187  1522 tablet_service.cc:1511] Processing CreateTablet for tablet c0e4d309cca4449096f65b38755e557e (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:58:37.430684  1522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0e4d309cca4449096f65b38755e557e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:37.385721  1669 tablet_service.cc:1511] Processing CreateTablet for tablet c0e4d309cca4449096f65b38755e557e (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
W20260709 12:58:37.387194  1759 log.cc:927] Time spent T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:58:37.389940  1722 tablet_bootstrap.cc:654] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:37.379653  1723 tablet_bootstrap.cc:654] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:37.392547  1517 tablet_service.cc:1511] Processing CreateTablet for tablet 83ed1c1e27234d98ba5eeb14457a4ee2 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:58:37.438647  1517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83ed1c1e27234d98ba5eeb14457a4ee2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:37.390564  1592 tablet_service.cc:1511] Processing CreateTablet for tablet 83ed1c1e27234d98ba5eeb14457a4ee2 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:58:37.439640  1592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83ed1c1e27234d98ba5eeb14457a4ee2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:37.439729  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:58:37.440371  1680 raft_consensus.cc:3060] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:37.398967  1670 tablet_service.cc:1511] Processing CreateTablet for tablet 83ed1c1e27234d98ba5eeb14457a4ee2 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:58:37.402865  1520 tablet_service.cc:1511] Processing CreateTablet for tablet c6bffb0971b74366af514d43d81b1d50 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:58:37.442088  1520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6bffb0971b74366af514d43d81b1d50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:37.382346  1594 tablet_service.cc:1511] Processing CreateTablet for tablet c0e4d309cca4449096f65b38755e557e (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:58:37.447472  1594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0e4d309cca4449096f65b38755e557e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:58:37.449730  1496 leader_election.cc:343] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:37.450207  1496 leader_election.cc:304] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:58:37.404903  1664 tablet_service.cc:1511] Processing CreateTablet for tablet c6bffb0971b74366af514d43d81b1d50 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:58:37.429796  1671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4faabc98f1164ba881cfb477657da505. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:37.452122  1664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6bffb0971b74366af514d43d81b1d50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:37.453598  1754 raft_consensus.cc:2749] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:37.454257  1669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0e4d309cca4449096f65b38755e557e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:37.455230  1670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83ed1c1e27234d98ba5eeb14457a4ee2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:37.462927  1680 raft_consensus.cc:2468] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 1.
I20260709 12:58:37.403865  1589 tablet_service.cc:1511] Processing CreateTablet for tablet c6bffb0971b74366af514d43d81b1d50 (DEFAULT_TABLE table=test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:58:37.464775  1722 tablet_bootstrap.cc:492] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90: No bootstrap required, opened a new log
I20260709 12:58:37.465111  1589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6bffb0971b74366af514d43d81b1d50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:37.465302  1722 ts_tablet_manager.cc:1403] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90: Time spent bootstrapping tablet: real 0.225s	user 0.012s	sys 0.001s
I20260709 12:58:37.468547  1722 raft_consensus.cc:359] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:37.469271  1722 raft_consensus.cc:385] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:37.469561  1722 raft_consensus.cc:740] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Initialized, Role: FOLLOWER
I20260709 12:58:37.470415  1722 consensus_queue.cc:260] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:37.472584  1722 ts_tablet_manager.cc:1434] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:58:37.474872  1496 leader_election.cc:304] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 12:58:37.475687  1754 raft_consensus.cc:2804] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:37.476164  1754 raft_consensus.cc:697] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 12:58:37.476943  1754 consensus_queue.cc:237] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:37.483739  1721 tablet_bootstrap.cc:492] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642: No bootstrap required, opened a new log
I20260709 12:58:37.484270  1721 ts_tablet_manager.cc:1403] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642: Time spent bootstrapping tablet: real 0.112s	user 0.014s	sys 0.017s
I20260709 12:58:37.492273  1722 tablet_bootstrap.cc:492] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90: Bootstrap starting.
I20260709 12:58:37.492964  1723 tablet_bootstrap.cc:492] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1: No bootstrap required, opened a new log
I20260709 12:58:37.498992  1723 ts_tablet_manager.cc:1403] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent bootstrapping tablet: real 0.201s	user 0.007s	sys 0.005s
I20260709 12:58:37.510486  1723 raft_consensus.cc:359] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:37.522766  1723 raft_consensus.cc:385] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:37.523211  1723 raft_consensus.cc:740] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Initialized, Role: FOLLOWER
I20260709 12:58:37.524137  1723 consensus_queue.cc:260] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:37.521916  1722 tablet_bootstrap.cc:654] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:37.515470  1721 raft_consensus.cc:359] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:37.527745  1721 raft_consensus.cc:385] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:37.528232  1721 raft_consensus.cc:740] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Initialized, Role: FOLLOWER
I20260709 12:58:37.529134  1721 consensus_queue.cc:260] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:37.531925  1721 ts_tablet_manager.cc:1434] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642: Time spent starting tablet: real 0.047s	user 0.008s	sys 0.000s
I20260709 12:58:37.532999  1721 tablet_bootstrap.cc:492] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642: Bootstrap starting.
I20260709 12:58:37.534276  1751 consensus_queue.cc:1048] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:37.528244  1532 raft_consensus.cc:3060] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:37.543623  1747 raft_consensus.cc:493] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:37.544118  1747 raft_consensus.cc:515] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:37.535147  1723 ts_tablet_manager.cc:1434] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent starting tablet: real 0.028s	user 0.003s	sys 0.004s
I20260709 12:58:37.547730  1723 tablet_bootstrap.cc:492] T 7ba438a35d164c02a9840bbedeac6097 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Bootstrap starting.
I20260709 12:58:37.549758  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:58:37.554332  1606 raft_consensus.cc:2393] T a031a0ef86384487bd1f89ead66f851b P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 1: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 12:58:37.547609  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:58:37.556785  1723 tablet_bootstrap.cc:654] T 7ba438a35d164c02a9840bbedeac6097 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:37.557250  1644 leader_election.cc:304] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:58:37.550277  1747 leader_election.cc:290] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931)
I20260709 12:58:37.558748  1747 raft_consensus.cc:3060] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:37.567714  1751 consensus_queue.cc:1048] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:37.572739  1722 tablet_bootstrap.cc:492] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90: No bootstrap required, opened a new log
I20260709 12:58:37.573362  1722 ts_tablet_manager.cc:1403] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90: Time spent bootstrapping tablet: real 0.081s	user 0.002s	sys 0.010s
I20260709 12:58:37.577013  1722 raft_consensus.cc:359] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:37.581966  1722 raft_consensus.cc:385] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:37.582384  1722 raft_consensus.cc:740] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Initialized, Role: FOLLOWER
I20260709 12:58:37.577204  1429 catalog_manager.cc:5697] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:37.580420  1721 tablet_bootstrap.cc:654] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:37.586436  1722 consensus_queue.cc:260] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:37.589416  1722 ts_tablet_manager.cc:1434] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90: Time spent starting tablet: real 0.015s	user 0.000s	sys 0.006s
I20260709 12:58:37.590957  1722 tablet_bootstrap.cc:492] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90: Bootstrap starting.
I20260709 12:58:37.604106  1721 tablet_bootstrap.cc:492] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642: No bootstrap required, opened a new log
I20260709 12:58:37.604744  1721 ts_tablet_manager.cc:1403] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642: Time spent bootstrapping tablet: real 0.072s	user 0.013s	sys 0.002s
I20260709 12:58:37.610069  1721 raft_consensus.cc:359] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:37.614197  1721 raft_consensus.cc:385] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:37.614626  1721 raft_consensus.cc:740] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Initialized, Role: FOLLOWER
I20260709 12:58:37.616978  1722 tablet_bootstrap.cc:654] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:37.617489  1721 consensus_queue.cc:260] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:37.628715  1721 ts_tablet_manager.cc:1434] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642: Time spent starting tablet: real 0.021s	user 0.002s	sys 0.004s
I20260709 12:58:37.648541  1721 tablet_bootstrap.cc:492] T 53176f970a394c5cb2c76bd88f09c751 P 39a92f5a4352465d8af3af5908fe8642: Bootstrap starting.
I20260709 12:58:37.662053  1722 tablet_bootstrap.cc:492] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90: No bootstrap required, opened a new log
I20260709 12:58:37.662628  1722 ts_tablet_manager.cc:1403] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90: Time spent bootstrapping tablet: real 0.072s	user 0.010s	sys 0.001s
I20260709 12:58:37.665623  1747 raft_consensus.cc:2749] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:37.665239  1722 raft_consensus.cc:359] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:37.666875  1722 raft_consensus.cc:385] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:37.669665  1721 tablet_bootstrap.cc:654] T 53176f970a394c5cb2c76bd88f09c751 P 39a92f5a4352465d8af3af5908fe8642: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:37.667187  1722 raft_consensus.cc:740] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Initialized, Role: FOLLOWER
I20260709 12:58:37.676095  1722 consensus_queue.cc:260] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:37.678038  1723 tablet_bootstrap.cc:492] T 7ba438a35d164c02a9840bbedeac6097 P e46412b3b0b44f01ad5c33d4cfe3d6b1: No bootstrap required, opened a new log
I20260709 12:58:37.678608  1723 ts_tablet_manager.cc:1403] T 7ba438a35d164c02a9840bbedeac6097 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent bootstrapping tablet: real 0.131s	user 0.043s	sys 0.053s
I20260709 12:58:37.682124  1723 raft_consensus.cc:359] T 7ba438a35d164c02a9840bbedeac6097 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:37.682942  1723 raft_consensus.cc:385] T 7ba438a35d164c02a9840bbedeac6097 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:37.683274  1723 raft_consensus.cc:740] T 7ba438a35d164c02a9840bbedeac6097 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Initialized, Role: FOLLOWER
I20260709 12:58:37.684005  1723 consensus_queue.cc:260] T 7ba438a35d164c02a9840bbedeac6097 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:37.678555  1722 ts_tablet_manager.cc:1434] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.002s
I20260709 12:58:37.685740  1722 tablet_bootstrap.cc:492] T a5802fa5e328499da4525506ccdf4dc9 P ddf11fc190dd4b898773379c6b129d90: Bootstrap starting.
I20260709 12:58:37.686371  1723 ts_tablet_manager.cc:1434] T 7ba438a35d164c02a9840bbedeac6097 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:58:37.687449  1723 tablet_bootstrap.cc:492] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1: Bootstrap starting.
I20260709 12:58:37.689136  1758 consensus_queue.cc:1048] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:37.691318  1722 tablet_bootstrap.cc:654] T a5802fa5e328499da4525506ccdf4dc9 P ddf11fc190dd4b898773379c6b129d90: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:37.695590  1747 raft_consensus.cc:493] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:37.699087  1758 consensus_queue.cc:1048] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:37.700484  1723 tablet_bootstrap.cc:654] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:37.696089  1747 raft_consensus.cc:515] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:37.702808  1747 leader_election.cc:290] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:58:37.712596  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:58:37.713122  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:58:37.713300  1531 raft_consensus.cc:2468] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 0.
I20260709 12:58:37.714608  1644 leader_election.cc:304] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
W20260709 12:58:37.716090  1646 leader_election.cc:343] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:37.715971  1747 raft_consensus.cc:2804] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:37.721930  1747 raft_consensus.cc:493] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:37.722309  1747 raft_consensus.cc:3060] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:37.725028  1721 tablet_bootstrap.cc:492] T 53176f970a394c5cb2c76bd88f09c751 P 39a92f5a4352465d8af3af5908fe8642: No bootstrap required, opened a new log
I20260709 12:58:37.725517  1721 ts_tablet_manager.cc:1403] T 53176f970a394c5cb2c76bd88f09c751 P 39a92f5a4352465d8af3af5908fe8642: Time spent bootstrapping tablet: real 0.077s	user 0.012s	sys 0.007s
I20260709 12:58:37.730544  1721 raft_consensus.cc:359] T 53176f970a394c5cb2c76bd88f09c751 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:37.731278  1721 raft_consensus.cc:385] T 53176f970a394c5cb2c76bd88f09c751 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:37.731567  1721 raft_consensus.cc:740] T 53176f970a394c5cb2c76bd88f09c751 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Initialized, Role: FOLLOWER
I20260709 12:58:37.732409  1721 consensus_queue.cc:260] T 53176f970a394c5cb2c76bd88f09c751 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:37.734756  1721 ts_tablet_manager.cc:1434] T 53176f970a394c5cb2c76bd88f09c751 P 39a92f5a4352465d8af3af5908fe8642: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 12:58:37.735695  1721 tablet_bootstrap.cc:492] T f3dd6988dfbe43e0ac446b79d37d9c24 P 39a92f5a4352465d8af3af5908fe8642: Bootstrap starting.
I20260709 12:58:37.741389  1721 tablet_bootstrap.cc:654] T f3dd6988dfbe43e0ac446b79d37d9c24 P 39a92f5a4352465d8af3af5908fe8642: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:37.742851  1754 raft_consensus.cc:493] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:37.743393  1754 raft_consensus.cc:515] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:37.745605  1754 leader_election.cc:290] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:37.748143  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 12:58:37.751153  1496 leader_election.cc:343] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:37.752091  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:58:37.752767  1606 raft_consensus.cc:2468] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 0.
I20260709 12:58:37.753903  1497 leader_election.cc:304] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 12:58:37.755069  1754 raft_consensus.cc:2804] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:37.755748  1754 raft_consensus.cc:493] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:37.756178  1754 raft_consensus.cc:3060] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:37.757704  1723 tablet_bootstrap.cc:492] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1: No bootstrap required, opened a new log
I20260709 12:58:37.758267  1723 ts_tablet_manager.cc:1403] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent bootstrapping tablet: real 0.071s	user 0.027s	sys 0.019s
I20260709 12:58:37.761448  1747 raft_consensus.cc:515] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:37.761711  1723 raft_consensus.cc:359] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:37.762586  1723 raft_consensus.cc:385] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:37.762991  1723 raft_consensus.cc:740] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Initialized, Role: FOLLOWER
I20260709 12:58:37.755381  1722 tablet_bootstrap.cc:492] T a5802fa5e328499da4525506ccdf4dc9 P ddf11fc190dd4b898773379c6b129d90: No bootstrap required, opened a new log
I20260709 12:58:37.763885  1723 consensus_queue.cc:260] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:37.765657  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:58:37.764355  1722 ts_tablet_manager.cc:1403] T a5802fa5e328499da4525506ccdf4dc9 P ddf11fc190dd4b898773379c6b129d90: Time spent bootstrapping tablet: real 0.079s	user 0.010s	sys 0.002s
I20260709 12:58:37.766201  1531 raft_consensus.cc:3060] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:37.767182  1723 ts_tablet_manager.cc:1434] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.002s
I20260709 12:58:37.763682  1747 leader_election.cc:290] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:58:37.768119  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
W20260709 12:58:37.769471  1646 leader_election.cc:343] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:37.770049  1722 raft_consensus.cc:359] T a5802fa5e328499da4525506ccdf4dc9 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:37.770717  1722 raft_consensus.cc:385] T a5802fa5e328499da4525506ccdf4dc9 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:37.770993  1722 raft_consensus.cc:740] T a5802fa5e328499da4525506ccdf4dc9 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Initialized, Role: FOLLOWER
I20260709 12:58:37.771637  1722 consensus_queue.cc:260] T a5802fa5e328499da4525506ccdf4dc9 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:37.773406  1723 tablet_bootstrap.cc:492] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Bootstrap starting.
I20260709 12:58:37.773614  1722 ts_tablet_manager.cc:1434] T a5802fa5e328499da4525506ccdf4dc9 P ddf11fc190dd4b898773379c6b129d90: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.002s
I20260709 12:58:37.780807  1723 tablet_bootstrap.cc:654] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:37.787328  1721 tablet_bootstrap.cc:492] T f3dd6988dfbe43e0ac446b79d37d9c24 P 39a92f5a4352465d8af3af5908fe8642: No bootstrap required, opened a new log
I20260709 12:58:37.787982  1721 ts_tablet_manager.cc:1403] T f3dd6988dfbe43e0ac446b79d37d9c24 P 39a92f5a4352465d8af3af5908fe8642: Time spent bootstrapping tablet: real 0.052s	user 0.010s	sys 0.005s
I20260709 12:58:37.789606  1722 tablet_bootstrap.cc:492] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90: Bootstrap starting.
I20260709 12:58:37.790988  1721 raft_consensus.cc:359] T f3dd6988dfbe43e0ac446b79d37d9c24 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:37.791868  1721 raft_consensus.cc:385] T f3dd6988dfbe43e0ac446b79d37d9c24 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:37.792222  1721 raft_consensus.cc:740] T f3dd6988dfbe43e0ac446b79d37d9c24 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Initialized, Role: FOLLOWER
I20260709 12:58:37.793180  1721 consensus_queue.cc:260] T f3dd6988dfbe43e0ac446b79d37d9c24 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:37.795727  1722 tablet_bootstrap.cc:654] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:37.800014  1721 ts_tablet_manager.cc:1434] T f3dd6988dfbe43e0ac446b79d37d9c24 P 39a92f5a4352465d8af3af5908fe8642: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:58:37.801252  1721 tablet_bootstrap.cc:492] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642: Bootstrap starting.
I20260709 12:58:37.807617  1721 tablet_bootstrap.cc:654] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:37.814746  1723 tablet_bootstrap.cc:492] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1: No bootstrap required, opened a new log
I20260709 12:58:37.815299  1723 ts_tablet_manager.cc:1403] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent bootstrapping tablet: real 0.042s	user 0.036s	sys 0.005s
I20260709 12:58:37.818131  1723 raft_consensus.cc:359] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:37.818917  1723 raft_consensus.cc:385] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:37.819193  1723 raft_consensus.cc:740] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Initialized, Role: FOLLOWER
I20260709 12:58:37.819900  1723 consensus_queue.cc:260] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:37.821966  1723 ts_tablet_manager.cc:1434] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:58:37.823120  1723 tablet_bootstrap.cc:492] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Bootstrap starting.
I20260709 12:58:37.828729  1723 tablet_bootstrap.cc:654] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:37.831197  1722 tablet_bootstrap.cc:492] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90: No bootstrap required, opened a new log
I20260709 12:58:37.831665  1722 ts_tablet_manager.cc:1403] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90: Time spent bootstrapping tablet: real 0.042s	user 0.013s	sys 0.012s
I20260709 12:58:37.834113  1722 raft_consensus.cc:359] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:37.834816  1722 raft_consensus.cc:385] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:37.835080  1722 raft_consensus.cc:740] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Initialized, Role: FOLLOWER
I20260709 12:58:37.835973  1778 raft_consensus.cc:493] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:37.835840  1722 consensus_queue.cc:260] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:37.836541  1778 raft_consensus.cc:515] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:37.839919  1778 leader_election.cc:290] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:37.841758  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:58:37.842211  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:58:37.842880  1680 raft_consensus.cc:2468] T dcad30336a5440bca17cda2724035211 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 0.
W20260709 12:58:37.843202  1570 leader_election.cc:343] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:37.844764  1721 tablet_bootstrap.cc:492] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642: No bootstrap required, opened a new log
I20260709 12:58:37.845250  1721 ts_tablet_manager.cc:1403] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642: Time spent bootstrapping tablet: real 0.044s	user 0.013s	sys 0.008s
I20260709 12:58:37.845265  1723 tablet_bootstrap.cc:492] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1: No bootstrap required, opened a new log
I20260709 12:58:37.845867  1723 ts_tablet_manager.cc:1403] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.008s
I20260709 12:58:37.847307  1571 leader_election.cc:304] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:58:37.848111  1778 raft_consensus.cc:2804] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:37.848455  1778 raft_consensus.cc:493] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:37.848819  1778 raft_consensus.cc:3060] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:37.848533  1723 raft_consensus.cc:359] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:37.849195  1723 raft_consensus.cc:385] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:37.849444  1723 raft_consensus.cc:740] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Initialized, Role: FOLLOWER
I20260709 12:58:37.850165  1723 consensus_queue.cc:260] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:37.851166  1722 ts_tablet_manager.cc:1434] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 12:58:37.852402  1723 ts_tablet_manager.cc:1434] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:58:37.853292  1723 tablet_bootstrap.cc:492] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Bootstrap starting.
I20260709 12:58:37.859267  1723 tablet_bootstrap.cc:654] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:37.859202  1747 raft_consensus.cc:493] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:37.859874  1747 raft_consensus.cc:515] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:37.861680  1747 leader_election.cc:290] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:58:37.862489  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 12:58:37.863931  1644 leader_election.cc:343] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:37.863991  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:58:37.864640  1606 raft_consensus.cc:2468] T f3dd6988dfbe43e0ac446b79d37d9c24 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 0.
I20260709 12:58:37.865731  1646 leader_election.cc:304] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:58:37.866204  1754 raft_consensus.cc:515] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:37.867717  1721 raft_consensus.cc:359] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:37.868794  1721 raft_consensus.cc:385] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:37.869127  1721 raft_consensus.cc:740] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Initialized, Role: FOLLOWER
I20260709 12:58:37.869730  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:58:37.869900  1721 consensus_queue.cc:260] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 12:58:37.871268  1496 leader_election.cc:343] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:37.871881  1747 raft_consensus.cc:2804] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:37.872259  1721 ts_tablet_manager.cc:1434] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 12:58:37.873488  1721 tablet_bootstrap.cc:492] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642: Bootstrap starting.
I20260709 12:58:37.872247  1747 raft_consensus.cc:493] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:37.874154  1747 raft_consensus.cc:3060] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:37.875402  1723 tablet_bootstrap.cc:492] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1: No bootstrap required, opened a new log
I20260709 12:58:37.875870  1723 ts_tablet_manager.cc:1403] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.003s
I20260709 12:58:37.879021  1727 raft_consensus.cc:493] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:37.879271  1723 raft_consensus.cc:359] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:37.879527  1727 raft_consensus.cc:515] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:37.879928  1723 raft_consensus.cc:385] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:37.880182  1723 raft_consensus.cc:740] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Initialized, Role: FOLLOWER
I20260709 12:58:37.879035  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:58:37.880798  1606 raft_consensus.cc:3060] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:37.881120  1722 tablet_bootstrap.cc:492] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90: Bootstrap starting.
I20260709 12:58:37.881021  1723 consensus_queue.cc:260] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:37.881501  1727 leader_election.cc:290] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:37.883098  1723 ts_tablet_manager.cc:1434] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:58:37.868295  1754 leader_election.cc:290] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:37.866585  1778 raft_consensus.cc:515] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:37.885720  1778 leader_election.cc:290] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:37.883970  1723 tablet_bootstrap.cc:492] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Bootstrap starting.
I20260709 12:58:37.884003  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:58:37.887042  1722 tablet_bootstrap.cc:654] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:37.887265  1680 raft_consensus.cc:2468] T a5802fa5e328499da4525506ccdf4dc9 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 0.
I20260709 12:58:37.891242  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:58:37.891872  1532 raft_consensus.cc:2468] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 0.
I20260709 12:58:37.900627  1723 tablet_bootstrap.cc:654] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:37.892788  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:58:37.894273  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:58:37.904597  1680 raft_consensus.cc:3060] T dcad30336a5440bca17cda2724035211 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:37.891819  1571 leader_election.cc:304] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
W20260709 12:58:37.907164  1570 leader_election.cc:343] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:37.907755  1778 raft_consensus.cc:493] T 53176f970a394c5cb2c76bd88f09c751 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:37.908123  1727 raft_consensus.cc:2804] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:37.908588  1727 raft_consensus.cc:493] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:37.909134  1727 raft_consensus.cc:3060] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:37.908330  1778 raft_consensus.cc:515] T 53176f970a394c5cb2c76bd88f09c751 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:37.899930  1721 tablet_bootstrap.cc:654] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:37.914520  1778 leader_election.cc:290] T 53176f970a394c5cb2c76bd88f09c751 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:37.913229  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:58:37.915604  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:58:37.916496  1681 raft_consensus.cc:2393] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 1: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 12:58:37.918107  1571 leader_election.cc:304] T 53176f970a394c5cb2c76bd88f09c751 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:58:37.918649  1722 tablet_bootstrap.cc:492] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90: No bootstrap required, opened a new log
I20260709 12:58:37.918937  1778 raft_consensus.cc:3060] T 53176f970a394c5cb2c76bd88f09c751 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:37.919106  1722 ts_tablet_manager.cc:1403] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90: Time spent bootstrapping tablet: real 0.038s	user 0.020s	sys 0.007s
I20260709 12:58:37.921484  1721 tablet_bootstrap.cc:492] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642: No bootstrap required, opened a new log
I20260709 12:58:37.921485  1723 tablet_bootstrap.cc:492] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1: No bootstrap required, opened a new log
I20260709 12:58:37.921552  1722 raft_consensus.cc:359] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:37.922113  1721 ts_tablet_manager.cc:1403] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642: Time spent bootstrapping tablet: real 0.049s	user 0.012s	sys 0.000s
I20260709 12:58:37.922149  1723 ts_tablet_manager.cc:1403] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent bootstrapping tablet: real 0.038s	user 0.024s	sys 0.000s
I20260709 12:58:37.922309  1722 raft_consensus.cc:385] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:37.922690  1722 raft_consensus.cc:740] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Initialized, Role: FOLLOWER
I20260709 12:58:37.923269  1722 consensus_queue.cc:260] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:37.925051  1722 ts_tablet_manager.cc:1434] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:58:37.924965  1723 raft_consensus.cc:359] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:37.925091  1721 raft_consensus.cc:359] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:37.925699  1723 raft_consensus.cc:385] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:37.925885  1721 raft_consensus.cc:385] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:37.925989  1723 raft_consensus.cc:740] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Initialized, Role: FOLLOWER
I20260709 12:58:37.926229  1722 tablet_bootstrap.cc:492] T 72071486140c4d6c919b25e882a8f5e5 P ddf11fc190dd4b898773379c6b129d90: Bootstrap starting.
I20260709 12:58:37.926172  1721 raft_consensus.cc:740] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Initialized, Role: FOLLOWER
I20260709 12:58:37.926678  1723 consensus_queue.cc:260] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:37.928534  1723 ts_tablet_manager.cc:1434] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:58:37.929651  1723 tablet_bootstrap.cc:492] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Bootstrap starting.
I20260709 12:58:37.927155  1721 consensus_queue.cc:260] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:37.931875  1722 tablet_bootstrap.cc:654] T 72071486140c4d6c919b25e882a8f5e5 P ddf11fc190dd4b898773379c6b129d90: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:37.936288  1723 tablet_bootstrap.cc:654] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:37.937553  1721 ts_tablet_manager.cc:1434] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.002s
I20260709 12:58:37.938485  1721 tablet_bootstrap.cc:492] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642: Bootstrap starting.
I20260709 12:58:37.942996  1754 raft_consensus.cc:493] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:37.943609  1754 raft_consensus.cc:515] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:37.947963  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:58:37.948706  1681 raft_consensus.cc:2468] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 0.
I20260709 12:58:37.949779  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:58:37.950490  1607 raft_consensus.cc:2468] T 9b7b5b00d91c4b488d16174662489496 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 0.
I20260709 12:58:37.951887  1497 leader_election.cc:304] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:58:37.952883  1729 raft_consensus.cc:2804] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:37.953281  1729 raft_consensus.cc:493] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:37.953622  1729 raft_consensus.cc:3060] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:37.955188  1754 leader_election.cc:290] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:37.957162  1722 tablet_bootstrap.cc:492] T 72071486140c4d6c919b25e882a8f5e5 P ddf11fc190dd4b898773379c6b129d90: No bootstrap required, opened a new log
I20260709 12:58:37.957645  1722 ts_tablet_manager.cc:1403] T 72071486140c4d6c919b25e882a8f5e5 P ddf11fc190dd4b898773379c6b129d90: Time spent bootstrapping tablet: real 0.032s	user 0.019s	sys 0.008s
I20260709 12:58:37.960256  1722 raft_consensus.cc:359] T 72071486140c4d6c919b25e882a8f5e5 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:37.961004  1722 raft_consensus.cc:385] T 72071486140c4d6c919b25e882a8f5e5 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:37.961314  1722 raft_consensus.cc:740] T 72071486140c4d6c919b25e882a8f5e5 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Initialized, Role: FOLLOWER
I20260709 12:58:37.961683  1771 raft_consensus.cc:493] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:37.962066  1722 consensus_queue.cc:260] T 72071486140c4d6c919b25e882a8f5e5 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:37.962203  1771 raft_consensus.cc:515] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:37.965054  1721 tablet_bootstrap.cc:654] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:37.965555  1771 leader_election.cc:290] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:58:37.967306  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:58:37.967643  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:58:37.967986  1530 raft_consensus.cc:2468] T 7ba438a35d164c02a9840bbedeac6097 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 0.
I20260709 12:58:37.968245  1607 raft_consensus.cc:2468] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 0.
I20260709 12:58:37.968546  1531 raft_consensus.cc:2468] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 1.
I20260709 12:58:37.968546  1606 raft_consensus.cc:2468] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 1.
I20260709 12:58:37.968823  1747 raft_consensus.cc:515] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:37.979401  1747 leader_election.cc:290] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:58:37.969274  1644 leader_election.cc:304] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:58:37.981245  1644 leader_election.cc:304] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 12:58:37.982079  1771 raft_consensus.cc:2804] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:37.982466  1771 raft_consensus.cc:493] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:37.982856  1771 raft_consensus.cc:3060] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:37.985375  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:58:37.985385  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:58:37.986157  1531 raft_consensus.cc:3060] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:37.986235  1607 raft_consensus.cc:3060] T f3dd6988dfbe43e0ac446b79d37d9c24 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:37.991065  1747 raft_consensus.cc:2804] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:37.985281  1497 leader_election.cc:304] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 12:58:37.993360  1754 raft_consensus.cc:2804] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:37.993974  1754 raft_consensus.cc:697] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 12:58:37.995038  1754 consensus_queue.cc:237] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:37.996635  1757 raft_consensus.cc:493] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:37.997814  1757 raft_consensus.cc:515] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:38.002808  1757 leader_election.cc:290] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:38.004735  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:58:38.007496  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 12:58:38.010222  1496 leader_election.cc:343] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:58:38.011225  1497 leader_election.cc:343] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:38.011745  1497 leader_election.cc:304] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:58:38.013696  1757 raft_consensus.cc:2749] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:38.014597  1723 tablet_bootstrap.cc:492] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1: No bootstrap required, opened a new log
I20260709 12:58:38.015141  1723 ts_tablet_manager.cc:1403] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent bootstrapping tablet: real 0.086s	user 0.035s	sys 0.019s
I20260709 12:58:38.015579  1747 raft_consensus.cc:697] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:58:38.015484  1797 raft_consensus.cc:493] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.016618  1797 raft_consensus.cc:515] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:38.016963  1747 consensus_queue.cc:237] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:38.020803  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:58:38.020998  1723 raft_consensus.cc:359] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:38.021377  1722 ts_tablet_manager.cc:1434] T 72071486140c4d6c919b25e882a8f5e5 P ddf11fc190dd4b898773379c6b129d90: Time spent starting tablet: real 0.063s	user 0.030s	sys 0.019s
I20260709 12:58:38.021698  1723 raft_consensus.cc:385] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:38.021561  1530 raft_consensus.cc:2468] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 0.
I20260709 12:58:38.022034  1723 raft_consensus.cc:740] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Initialized, Role: FOLLOWER
I20260709 12:58:38.022917  1722 tablet_bootstrap.cc:492] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90: Bootstrap starting.
I20260709 12:58:38.023228  1644 leader_election.cc:304] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:58:38.022770  1723 consensus_queue.cc:260] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:38.029605  1758 consensus_queue.cc:1048] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:38.030181  1722 tablet_bootstrap.cc:654] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:38.030324  1723 ts_tablet_manager.cc:1434] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:58:38.033025  1723 tablet_bootstrap.cc:492] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Bootstrap starting.
I20260709 12:58:38.036048  1747 raft_consensus.cc:2804] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:38.036543  1747 raft_consensus.cc:493] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:38.036968  1747 raft_consensus.cc:3060] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:38.039829  1797 leader_election.cc:290] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:58:38.040136  1722 tablet_bootstrap.cc:492] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90: No bootstrap required, opened a new log
I20260709 12:58:38.040692  1722 ts_tablet_manager.cc:1403] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.004s
I20260709 12:58:38.041694  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:58:38.042411  1605 raft_consensus.cc:2468] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 0.
I20260709 12:58:38.043607  1722 raft_consensus.cc:359] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:38.045240  1722 raft_consensus.cc:385] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:38.045537  1722 raft_consensus.cc:740] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Initialized, Role: FOLLOWER
I20260709 12:58:38.046233  1722 consensus_queue.cc:260] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:38.048245  1722 ts_tablet_manager.cc:1434] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:58:38.049162  1722 tablet_bootstrap.cc:492] T d0b325904f4646bca264eeeea15dfeb0 P ddf11fc190dd4b898773379c6b129d90: Bootstrap starting.
I20260709 12:58:38.049212  1428 catalog_manager.cc:5697] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 reported cstate change: term changed from 0 to 1, leader changed from <none> to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:38.053588  1723 tablet_bootstrap.cc:654] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:38.055735  1722 tablet_bootstrap.cc:654] T d0b325904f4646bca264eeeea15dfeb0 P ddf11fc190dd4b898773379c6b129d90: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:38.055913  1427 catalog_manager.cc:5697] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:38.074328  1729 raft_consensus.cc:515] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:38.075927  1721 tablet_bootstrap.cc:492] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642: No bootstrap required, opened a new log
I20260709 12:58:38.076354  1721 ts_tablet_manager.cc:1403] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642: Time spent bootstrapping tablet: real 0.138s	user 0.013s	sys 0.020s
I20260709 12:58:38.078078  1778 raft_consensus.cc:2749] T 53176f970a394c5cb2c76bd88f09c751 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:38.085456  1721 raft_consensus.cc:359] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:38.086253  1721 raft_consensus.cc:385] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:38.086598  1721 raft_consensus.cc:740] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Initialized, Role: FOLLOWER
I20260709 12:58:38.077468  1680 raft_consensus.cc:2468] T dcad30336a5440bca17cda2724035211 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 1.
I20260709 12:58:38.087142  1758 consensus_queue.cc:1048] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:38.078516  1727 raft_consensus.cc:515] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:38.088812  1571 leader_election.cc:304] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:58:38.089679  1723 tablet_bootstrap.cc:492] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1: No bootstrap required, opened a new log
I20260709 12:58:38.090221  1723 ts_tablet_manager.cc:1403] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent bootstrapping tablet: real 0.057s	user 0.017s	sys 0.013s
I20260709 12:58:38.091158  1721 consensus_queue.cc:260] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:38.090495  1778 raft_consensus.cc:2804] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:38.077939  1607 raft_consensus.cc:2468] T f3dd6988dfbe43e0ac446b79d37d9c24 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 1.
I20260709 12:58:38.093200  1646 leader_election.cc:304] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:58:38.093441  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:58:38.093469  1721 ts_tablet_manager.cc:1434] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:58:38.094617  1530 raft_consensus.cc:3060] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:38.095229  1721 tablet_bootstrap.cc:492] T 770925e70faa4a16a275abd5282f5284 P 39a92f5a4352465d8af3af5908fe8642: Bootstrap starting.
I20260709 12:58:38.090368  1727 leader_election.cc:290] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:38.100322  1801 raft_consensus.cc:2804] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:38.100929  1729 leader_election.cc:290] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:38.101171  1801 raft_consensus.cc:697] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:58:38.113225  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:58:38.113888  1606 raft_consensus.cc:3060] T 9b7b5b00d91c4b488d16174662489496 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:38.102035  1801 consensus_queue.cc:237] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:38.149776  1722 tablet_bootstrap.cc:492] T d0b325904f4646bca264eeeea15dfeb0 P ddf11fc190dd4b898773379c6b129d90: No bootstrap required, opened a new log
I20260709 12:58:38.124140  1751 raft_consensus.cc:493] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.150691  1722 ts_tablet_manager.cc:1403] T d0b325904f4646bca264eeeea15dfeb0 P ddf11fc190dd4b898773379c6b129d90: Time spent bootstrapping tablet: real 0.102s	user 0.035s	sys 0.003s
I20260709 12:58:38.148003  1723 raft_consensus.cc:359] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:38.115010  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:58:38.152053  1797 raft_consensus.cc:493] T 72071486140c4d6c919b25e882a8f5e5 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.152844  1680 raft_consensus.cc:3060] T a5802fa5e328499da4525506ccdf4dc9 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:38.152994  1797 raft_consensus.cc:515] T 72071486140c4d6c919b25e882a8f5e5 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:38.151448  1778 raft_consensus.cc:697] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:58:38.154510  1723 raft_consensus.cc:385] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:38.154821  1723 raft_consensus.cc:740] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Initialized, Role: FOLLOWER
I20260709 12:58:38.155171  1797 leader_election.cc:290] T 72071486140c4d6c919b25e882a8f5e5 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:58:38.155566  1723 consensus_queue.cc:260] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:38.155922  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:58:38.157058  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:58:38.157513  1723 ts_tablet_manager.cc:1434] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent starting tablet: real 0.067s	user 0.006s	sys 0.005s
I20260709 12:58:38.158349  1605 raft_consensus.cc:2393] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 1: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 12:58:38.158495  1723 tablet_bootstrap.cc:492] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Bootstrap starting.
I20260709 12:58:38.159663  1646 leader_election.cc:304] T 72071486140c4d6c919b25e882a8f5e5 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:58:38.151144  1751 raft_consensus.cc:515] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:38.153002  1721 tablet_bootstrap.cc:654] T 770925e70faa4a16a275abd5282f5284 P 39a92f5a4352465d8af3af5908fe8642: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:38.113225  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:58:38.161139  1797 raft_consensus.cc:3060] T 72071486140c4d6c919b25e882a8f5e5 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:38.163702  1796 raft_consensus.cc:493] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.154346  1778 consensus_queue.cc:237] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:38.164206  1796 raft_consensus.cc:515] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:38.166257  1796 leader_election.cc:290] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:58:38.163074  1681 raft_consensus.cc:3060] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:38.168407  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:58:38.170183  1751 leader_election.cc:290] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:38.171077  1531 raft_consensus.cc:2468] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 1.
I20260709 12:58:38.172058  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:58:38.173406  1747 raft_consensus.cc:515] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:38.173066  1771 raft_consensus.cc:515] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:38.174881  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:58:38.176292  1679 raft_consensus.cc:2468] T 2abb9a42c35f4b6386342bccdff6fbf0 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 0.
I20260709 12:58:38.180194  1571 leader_election.cc:304] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
W20260709 12:58:38.181610  1570 leader_election.cc:343] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:58:38.176605  1646 leader_election.cc:343] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:38.173128  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 12:58:38.185071  1644 leader_election.cc:343] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:38.186111  1644 leader_election.cc:304] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:58:38.181185  1751 raft_consensus.cc:2804] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:38.187242  1801 raft_consensus.cc:2749] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:38.187561  1751 raft_consensus.cc:493] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:38.187939  1751 raft_consensus.cc:3060] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:38.189978  1722 raft_consensus.cc:359] T d0b325904f4646bca264eeeea15dfeb0 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:38.190970  1722 raft_consensus.cc:385] T d0b325904f4646bca264eeeea15dfeb0 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:38.191270  1722 raft_consensus.cc:740] T d0b325904f4646bca264eeeea15dfeb0 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Initialized, Role: FOLLOWER
I20260709 12:58:38.191969  1722 consensus_queue.cc:260] T d0b325904f4646bca264eeeea15dfeb0 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:38.170998  1606 raft_consensus.cc:2468] T 9b7b5b00d91c4b488d16174662489496 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 1.
I20260709 12:58:38.201467  1722 ts_tablet_manager.cc:1434] T d0b325904f4646bca264eeeea15dfeb0 P ddf11fc190dd4b898773379c6b129d90: Time spent starting tablet: real 0.050s	user 0.006s	sys 0.000s
I20260709 12:58:38.202482  1722 tablet_bootstrap.cc:492] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90: Bootstrap starting.
I20260709 12:58:38.202633  1801 raft_consensus.cc:493] T d0b325904f4646bca264eeeea15dfeb0 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.203320  1801 raft_consensus.cc:515] T d0b325904f4646bca264eeeea15dfeb0 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:38.208214  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:58:38.207479  1801 leader_election.cc:290] T d0b325904f4646bca264eeeea15dfeb0 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
W20260709 12:58:38.209892  1646 leader_election.cc:343] T d0b325904f4646bca264eeeea15dfeb0 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:38.210362  1497 leader_election.cc:304] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:58:38.211673  1729 raft_consensus.cc:2804] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:38.212143  1758 raft_consensus.cc:493] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.212587  1758 raft_consensus.cc:515] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:38.212932  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:58:38.213474  1532 raft_consensus.cc:3060] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:38.214634  1758 leader_election.cc:290] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:38.215181  1729 raft_consensus.cc:697] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 12:58:38.216188  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:58:38.217203  1679 raft_consensus.cc:2393] T dcad30336a5440bca17cda2724035211 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 1: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 12:58:38.217265  1729 consensus_queue.cc:237] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:38.174383  1530 raft_consensus.cc:2468] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 1.
I20260709 12:58:38.219898  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:58:38.229206  1806 raft_consensus.cc:493] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.229837  1806 raft_consensus.cc:515] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:38.224681  1747 leader_election.cc:290] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:58:38.240255  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:58:38.240892  1607 raft_consensus.cc:3060] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:38.241518  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 12:58:38.243152  1571 leader_election.cc:343] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:38.244374  1681 raft_consensus.cc:2468] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 1.
I20260709 12:58:38.215737  1427 catalog_manager.cc:5697] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 reported cstate change: term changed from 0 to 1, leader changed from <none> to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:38.248539  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:58:38.249312  1570 leader_election.cc:304] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:58:38.252113  1497 leader_election.cc:304] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:58:38.252986  1758 raft_consensus.cc:3060] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:38.254107  1727 raft_consensus.cc:2804] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:38.254849  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:58:38.255460  1529 raft_consensus.cc:3060] T 7ba438a35d164c02a9840bbedeac6097 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:58:38.248735  1644 leader_election.cc:343] T d0b325904f4646bca264eeeea15dfeb0 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:38.259378  1727 raft_consensus.cc:697] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:58:38.240279  1806 leader_election.cc:290] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:38.261853  1727 consensus_queue.cc:237] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:38.260989  1644 leader_election.cc:304] T d0b325904f4646bca264eeeea15dfeb0 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:58:38.248744  1771 leader_election.cc:290] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:58:38.256563  1680 raft_consensus.cc:2468] T a5802fa5e328499da4525506ccdf4dc9 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 1.
I20260709 12:58:38.265525  1428 catalog_manager.cc:5697] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:38.265857  1771 raft_consensus.cc:2749] T d0b325904f4646bca264eeeea15dfeb0 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:38.268829  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:58:38.269495  1606 raft_consensus.cc:3060] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:58:38.251052  1478 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:58:38.247635  1532 raft_consensus.cc:2468] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 1.
W20260709 12:58:38.311805  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 59824.8us
W20260709 12:58:38.314911  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 55749.2us
I20260709 12:58:38.318460  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:58:38.319285  1532 raft_consensus.cc:2468] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 0.
I20260709 12:58:38.318542  1644 leader_election.cc:304] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:58:38.320403  1721 tablet_bootstrap.cc:492] T 770925e70faa4a16a275abd5282f5284 P 39a92f5a4352465d8af3af5908fe8642: No bootstrap required, opened a new log
I20260709 12:58:38.320850  1721 ts_tablet_manager.cc:1403] T 770925e70faa4a16a275abd5282f5284 P 39a92f5a4352465d8af3af5908fe8642: Time spent bootstrapping tablet: real 0.226s	user 0.033s	sys 0.019s
I20260709 12:58:38.320865  1771 raft_consensus.cc:2804] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:38.322067  1771 raft_consensus.cc:697] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:58:38.323140  1570 leader_election.cc:304] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 12:58:38.327896  1806 raft_consensus.cc:2804] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:38.324757  1721 raft_consensus.cc:359] T 770925e70faa4a16a275abd5282f5284 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:38.329205  1721 raft_consensus.cc:385] T 770925e70faa4a16a275abd5282f5284 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:38.329411  1721 raft_consensus.cc:740] T 770925e70faa4a16a275abd5282f5284 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Initialized, Role: FOLLOWER
I20260709 12:58:38.328446  1806 raft_consensus.cc:493] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:38.331250  1721 consensus_queue.cc:260] T 770925e70faa4a16a275abd5282f5284 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:38.327958  1771 consensus_queue.cc:237] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:38.315680  1607 raft_consensus.cc:2468] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 1.
I20260709 12:58:38.332765  1806 raft_consensus.cc:3060] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:38.343581  1723 tablet_bootstrap.cc:654] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:38.345031  1721 ts_tablet_manager.cc:1434] T 770925e70faa4a16a275abd5282f5284 P 39a92f5a4352465d8af3af5908fe8642: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.000s
I20260709 12:58:38.345916  1721 tablet_bootstrap.cc:492] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642: Bootstrap starting.
I20260709 12:58:38.344254  1806 raft_consensus.cc:515] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:38.349453  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:58:38.349769  1806 leader_election.cc:290] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:38.350035  1532 raft_consensus.cc:3060] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:38.354566  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
W20260709 12:58:38.356379  1571 leader_election.cc:343] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:38.357237  1606 raft_consensus.cc:2468] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 1.
I20260709 12:58:38.350344  1797 raft_consensus.cc:2749] T 72071486140c4d6c919b25e882a8f5e5 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:38.358614  1646 leader_election.cc:304] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:58:38.359840  1532 raft_consensus.cc:2468] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 1.
I20260709 12:58:38.359834  1797 raft_consensus.cc:2804] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:38.360914  1797 raft_consensus.cc:697] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:58:38.361794  1570 leader_election.cc:304] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 12:58:38.361829  1797 consensus_queue.cc:237] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:38.362892  1806 raft_consensus.cc:2804] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:38.363313  1806 raft_consensus.cc:697] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:58:38.363937  1806 consensus_queue.cc:237] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:38.360059  1529 raft_consensus.cc:2468] T 7ba438a35d164c02a9840bbedeac6097 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 1.
I20260709 12:58:38.367007  1758 raft_consensus.cc:2749] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:38.370586  1723 tablet_bootstrap.cc:492] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1: No bootstrap required, opened a new log
I20260709 12:58:38.371099  1723 ts_tablet_manager.cc:1403] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent bootstrapping tablet: real 0.213s	user 0.007s	sys 0.011s
I20260709 12:58:38.371994  1722 tablet_bootstrap.cc:654] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:38.375790  1723 raft_consensus.cc:359] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:38.376690  1723 raft_consensus.cc:385] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:38.377089  1723 raft_consensus.cc:740] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Initialized, Role: FOLLOWER
I20260709 12:58:38.373682  1751 raft_consensus.cc:515] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:38.377949  1723 consensus_queue.cc:260] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:38.382170  1721 tablet_bootstrap.cc:654] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:38.383162  1723 ts_tablet_manager.cc:1434] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:58:38.384344  1723 tablet_bootstrap.cc:492] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Bootstrap starting.
I20260709 12:58:38.390367  1723 tablet_bootstrap.cc:654] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:38.392059  1430 catalog_manager.cc:5697] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 0 to 1, leader changed from <none> to 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:38.387049  1427 catalog_manager.cc:5697] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 reported cstate change: term changed from 0 to 1, leader changed from <none> to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:38.395382  1427 catalog_manager.cc:5697] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 reported cstate change: term changed from 0 to 1, leader changed from <none> to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:38.402184  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:58:38.402812  1529 raft_consensus.cc:3060] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:38.408797  1722 tablet_bootstrap.cc:492] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90: No bootstrap required, opened a new log
I20260709 12:58:38.409328  1722 ts_tablet_manager.cc:1403] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90: Time spent bootstrapping tablet: real 0.207s	user 0.007s	sys 0.004s
I20260709 12:58:38.410084  1529 raft_consensus.cc:2468] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 1.
I20260709 12:58:38.411293  1570 leader_election.cc:304] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:58:38.412118  1806 raft_consensus.cc:2804] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:38.411952  1722 raft_consensus.cc:359] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:38.412629  1806 raft_consensus.cc:697] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:58:38.412895  1722 raft_consensus.cc:385] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:38.413221  1722 raft_consensus.cc:740] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Initialized, Role: FOLLOWER
I20260709 12:58:38.413445  1806 consensus_queue.cc:237] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:38.413980  1722 consensus_queue.cc:260] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:38.416993  1722 ts_tablet_manager.cc:1434] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:58:38.417989  1722 tablet_bootstrap.cc:492] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90: Bootstrap starting.
I20260709 12:58:38.423645  1751 leader_election.cc:290] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:38.424763  1721 tablet_bootstrap.cc:492] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642: No bootstrap required, opened a new log
I20260709 12:58:38.425227  1721 ts_tablet_manager.cc:1403] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642: Time spent bootstrapping tablet: real 0.079s	user 0.009s	sys 0.007s
I20260709 12:58:38.426180  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:58:38.427057  1680 raft_consensus.cc:3060] T 2abb9a42c35f4b6386342bccdff6fbf0 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:38.434154  1680 raft_consensus.cc:2468] T 2abb9a42c35f4b6386342bccdff6fbf0 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 1.
I20260709 12:58:38.437789  1722 tablet_bootstrap.cc:654] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:38.437721  1721 raft_consensus.cc:359] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:38.438454  1721 raft_consensus.cc:385] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:38.438741  1721 raft_consensus.cc:740] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Initialized, Role: FOLLOWER
I20260709 12:58:38.439561  1723 tablet_bootstrap.cc:492] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1: No bootstrap required, opened a new log
I20260709 12:58:38.439474  1721 consensus_queue.cc:260] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:38.440007  1723 ts_tablet_manager.cc:1403] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent bootstrapping tablet: real 0.056s	user 0.015s	sys 0.008s
I20260709 12:58:38.441479  1721 ts_tablet_manager.cc:1434] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642: Time spent starting tablet: real 0.016s	user 0.002s	sys 0.005s
I20260709 12:58:38.442335  1721 tablet_bootstrap.cc:492] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642: Bootstrap starting.
I20260709 12:58:38.442111  1758 consensus_queue.cc:1048] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:38.442575  1723 raft_consensus.cc:359] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:38.443701  1723 raft_consensus.cc:385] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:38.443976  1723 raft_consensus.cc:740] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Initialized, Role: FOLLOWER
I20260709 12:58:38.444589  1723 consensus_queue.cc:260] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:38.446511  1723 ts_tablet_manager.cc:1434] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:58:38.447439  1723 tablet_bootstrap.cc:492] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1: Bootstrap starting.
I20260709 12:58:38.448674  1721 tablet_bootstrap.cc:654] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:38.453583  1723 tablet_bootstrap.cc:654] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:38.453680  1427 catalog_manager.cc:5697] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 0 to 1, leader changed from <none> to 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:38.456241  1427 catalog_manager.cc:5697] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 0 to 1, leader changed from <none> to 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:38.459965  1721 tablet_bootstrap.cc:492] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642: No bootstrap required, opened a new log
I20260709 12:58:38.460507  1721 ts_tablet_manager.cc:1403] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642: Time spent bootstrapping tablet: real 0.018s	user 0.015s	sys 0.000s
I20260709 12:58:38.463979  1721 raft_consensus.cc:359] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:38.466440  1721 raft_consensus.cc:385] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:38.466760  1721 raft_consensus.cc:740] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Initialized, Role: FOLLOWER
I20260709 12:58:38.466990  1722 tablet_bootstrap.cc:492] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90: No bootstrap required, opened a new log
I20260709 12:58:38.467562  1722 ts_tablet_manager.cc:1403] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90: Time spent bootstrapping tablet: real 0.050s	user 0.006s	sys 0.011s
I20260709 12:58:38.467608  1721 consensus_queue.cc:260] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:38.471925  1722 raft_consensus.cc:359] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:38.472373  1721 ts_tablet_manager.cc:1434] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 12:58:38.472586  1722 raft_consensus.cc:385] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:38.472857  1722 raft_consensus.cc:740] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Initialized, Role: FOLLOWER
I20260709 12:58:38.473433  1722 consensus_queue.cc:260] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:38.474443  1723 tablet_bootstrap.cc:492] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1: No bootstrap required, opened a new log
I20260709 12:58:38.474892  1723 ts_tablet_manager.cc:1403] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent bootstrapping tablet: real 0.028s	user 0.023s	sys 0.000s
I20260709 12:58:38.475143  1722 ts_tablet_manager.cc:1434] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:58:38.477953  1723 raft_consensus.cc:359] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:38.478652  1723 raft_consensus.cc:385] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:38.478947  1723 raft_consensus.cc:740] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Initialized, Role: FOLLOWER
I20260709 12:58:38.479784  1721 tablet_bootstrap.cc:492] T bb48619ad4f74c71a726835ef5a8b4c2 P 39a92f5a4352465d8af3af5908fe8642: Bootstrap starting.
I20260709 12:58:38.479655  1723 consensus_queue.cc:260] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:38.481673  1723 ts_tablet_manager.cc:1434] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:58:38.482910  1723 tablet_bootstrap.cc:492] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Bootstrap starting.
I20260709 12:58:38.485728  1721 tablet_bootstrap.cc:654] T bb48619ad4f74c71a726835ef5a8b4c2 P 39a92f5a4352465d8af3af5908fe8642: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:38.488023  1427 catalog_manager.cc:5697] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 0 to 1, leader changed from <none> to 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:38.489001  1723 tablet_bootstrap.cc:654] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:38.493093  1722 tablet_bootstrap.cc:492] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90: Bootstrap starting.
I20260709 12:58:38.502486  1722 tablet_bootstrap.cc:654] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:38.502540  1723 tablet_bootstrap.cc:492] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1: No bootstrap required, opened a new log
I20260709 12:58:38.503213  1723 ts_tablet_manager.cc:1403] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.003s
I20260709 12:58:38.506100  1723 raft_consensus.cc:359] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:38.506824  1723 raft_consensus.cc:385] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:38.507102  1723 raft_consensus.cc:740] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Initialized, Role: FOLLOWER
I20260709 12:58:38.507732  1723 consensus_queue.cc:260] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:38.508538  1721 tablet_bootstrap.cc:492] T bb48619ad4f74c71a726835ef5a8b4c2 P 39a92f5a4352465d8af3af5908fe8642: No bootstrap required, opened a new log
I20260709 12:58:38.508818  1722 tablet_bootstrap.cc:492] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90: No bootstrap required, opened a new log
I20260709 12:58:38.508960  1721 ts_tablet_manager.cc:1403] T bb48619ad4f74c71a726835ef5a8b4c2 P 39a92f5a4352465d8af3af5908fe8642: Time spent bootstrapping tablet: real 0.029s	user 0.011s	sys 0.015s
I20260709 12:58:38.509208  1722 ts_tablet_manager.cc:1403] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.000s
I20260709 12:58:38.509629  1723 ts_tablet_manager.cc:1434] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 12:58:38.510742  1723 tablet_bootstrap.cc:492] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Bootstrap starting.
I20260709 12:58:38.511696  1721 raft_consensus.cc:359] T bb48619ad4f74c71a726835ef5a8b4c2 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:38.512429  1721 raft_consensus.cc:385] T bb48619ad4f74c71a726835ef5a8b4c2 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:38.512734  1721 raft_consensus.cc:740] T bb48619ad4f74c71a726835ef5a8b4c2 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Initialized, Role: FOLLOWER
I20260709 12:58:38.512776  1722 raft_consensus.cc:359] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:38.513509  1722 raft_consensus.cc:385] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:38.513821  1722 raft_consensus.cc:740] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Initialized, Role: FOLLOWER
I20260709 12:58:38.513585  1721 consensus_queue.cc:260] T bb48619ad4f74c71a726835ef5a8b4c2 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:38.514554  1722 consensus_queue.cc:260] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:38.516112  1721 ts_tablet_manager.cc:1434] T bb48619ad4f74c71a726835ef5a8b4c2 P 39a92f5a4352465d8af3af5908fe8642: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:58:38.516781  1723 tablet_bootstrap.cc:654] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:38.517120  1721 tablet_bootstrap.cc:492] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642: Bootstrap starting.
I20260709 12:58:38.520473  1722 ts_tablet_manager.cc:1434] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.004s
I20260709 12:58:38.521488  1722 tablet_bootstrap.cc:492] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90: Bootstrap starting.
I20260709 12:58:38.524986  1721 tablet_bootstrap.cc:654] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:38.527951  1722 tablet_bootstrap.cc:654] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:38.528275  1729 consensus_queue.cc:1048] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:38.532042  1723 tablet_bootstrap.cc:492] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1: No bootstrap required, opened a new log
I20260709 12:58:38.532938  1723 ts_tablet_manager.cc:1403] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.000s
I20260709 12:58:38.536573  1723 raft_consensus.cc:359] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:38.540951  1723 raft_consensus.cc:385] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:38.541802  1723 raft_consensus.cc:740] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Initialized, Role: FOLLOWER
I20260709 12:58:38.542965  1723 consensus_queue.cc:260] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:38.546584  1723 ts_tablet_manager.cc:1434] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 12:58:38.557713  1721 tablet_bootstrap.cc:492] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642: No bootstrap required, opened a new log
I20260709 12:58:38.558094  1721 ts_tablet_manager.cc:1403] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642: Time spent bootstrapping tablet: real 0.041s	user 0.015s	sys 0.010s
I20260709 12:58:38.559854  1723 tablet_bootstrap.cc:492] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1: Bootstrap starting.
I20260709 12:58:38.560031  1722 tablet_bootstrap.cc:492] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90: No bootstrap required, opened a new log
I20260709 12:58:38.560570  1722 ts_tablet_manager.cc:1403] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90: Time spent bootstrapping tablet: real 0.039s	user 0.018s	sys 0.017s
I20260709 12:58:38.560941  1721 raft_consensus.cc:359] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:38.561619  1721 raft_consensus.cc:385] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:38.561918  1721 raft_consensus.cc:740] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Initialized, Role: FOLLOWER
I20260709 12:58:38.562567  1721 consensus_queue.cc:260] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:38.563316  1722 raft_consensus.cc:359] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:38.563999  1722 raft_consensus.cc:385] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:38.564278  1722 raft_consensus.cc:740] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Initialized, Role: FOLLOWER
I20260709 12:58:38.564604  1721 ts_tablet_manager.cc:1434] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.003s
I20260709 12:58:38.565026  1722 consensus_queue.cc:260] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:38.567926  1722 ts_tablet_manager.cc:1434] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:58:38.569139  1722 tablet_bootstrap.cc:492] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90: Bootstrap starting.
I20260709 12:58:38.569540  1723 tablet_bootstrap.cc:654] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:38.571367  1721 tablet_bootstrap.cc:492] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642: Bootstrap starting.
I20260709 12:58:38.575332  1722 tablet_bootstrap.cc:654] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:38.577750  1721 tablet_bootstrap.cc:654] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:38.586845  1797 consensus_queue.cc:1048] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:38.589905  1797 consensus_queue.cc:1048] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:38.608433  1771 raft_consensus.cc:493] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.608927  1771 raft_consensus.cc:515] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:38.611479  1771 leader_election.cc:290] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:58:38.612578  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:58:38.613245  1532 raft_consensus.cc:2468] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 0.
I20260709 12:58:38.614358  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:58:38.615099  1607 raft_consensus.cc:2468] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 0.
I20260709 12:58:38.617234  1646 leader_election.cc:304] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:58:38.617689  1723 tablet_bootstrap.cc:492] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1: No bootstrap required, opened a new log
I20260709 12:58:38.618089  1723 ts_tablet_manager.cc:1403] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent bootstrapping tablet: real 0.058s	user 0.034s	sys 0.014s
I20260709 12:58:38.618319  1747 raft_consensus.cc:2804] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:38.618716  1747 raft_consensus.cc:493] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:38.619053  1607 raft_consensus.cc:3060] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:38.620241  1723 raft_consensus.cc:359] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:38.620708  1723 raft_consensus.cc:385] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:38.620862  1723 raft_consensus.cc:740] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Initialized, Role: FOLLOWER
I20260709 12:58:38.621320  1723 consensus_queue.cc:260] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:38.619033  1747 raft_consensus.cc:3060] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:38.622946  1723 ts_tablet_manager.cc:1434] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.003s
I20260709 12:58:38.624132  1723 tablet_bootstrap.cc:492] T fb3a9a4620ef4fcd86eb78530746a583 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Bootstrap starting.
I20260709 12:58:38.643479  1806 raft_consensus.cc:493] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.644001  1806 raft_consensus.cc:515] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:38.646080  1806 leader_election.cc:290] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:38.646811  1722 tablet_bootstrap.cc:492] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90: No bootstrap required, opened a new log
I20260709 12:58:38.647248  1722 ts_tablet_manager.cc:1403] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90: Time spent bootstrapping tablet: real 0.078s	user 0.008s	sys 0.012s
I20260709 12:58:38.647646  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:58:38.650512  1681 raft_consensus.cc:2468] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 0.
I20260709 12:58:38.654021  1571 leader_election.cc:304] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:58:38.655090  1751 raft_consensus.cc:493] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.656352  1751 raft_consensus.cc:515] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:38.659302  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:58:38.660152  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:58:38.660837  1532 raft_consensus.cc:2468] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 0.
I20260709 12:58:38.658455  1751 leader_election.cc:290] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:38.662950  1806 raft_consensus.cc:2804] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:38.663058  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:58:38.663554  1806 raft_consensus.cc:493] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:38.663993  1806 raft_consensus.cc:3060] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:38.664558  1571 leader_election.cc:304] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:58:38.665815  1751 raft_consensus.cc:2749] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:38.666957  1771 consensus_queue.cc:1048] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:38.668488  1797 consensus_queue.cc:1048] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:38.674458  1722 raft_consensus.cc:359] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:38.630560  1747 raft_consensus.cc:515] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:38.675231  1722 raft_consensus.cc:385] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:38.675659  1722 raft_consensus.cc:740] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Initialized, Role: FOLLOWER
I20260709 12:58:38.676204  1722 consensus_queue.cc:260] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:38.679644  1722 ts_tablet_manager.cc:1434] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 12:58:38.680627  1722 tablet_bootstrap.cc:492] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90: Bootstrap starting.
I20260709 12:58:38.687610  1806 raft_consensus.cc:515] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:38.688537  1721 tablet_bootstrap.cc:492] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642: No bootstrap required, opened a new log
I20260709 12:58:38.688999  1721 ts_tablet_manager.cc:1403] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642: Time spent bootstrapping tablet: real 0.118s	user 0.014s	sys 0.055s
I20260709 12:58:38.689659  1806 leader_election.cc:290] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:38.691197  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:58:38.691468  1721 raft_consensus.cc:359] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:38.692122  1721 raft_consensus.cc:385] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:38.692379  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:58:38.691787  1681 raft_consensus.cc:3060] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:38.692924  1751 consensus_queue.cc:1048] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:38.693055  1722 tablet_bootstrap.cc:654] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:38.692921  1529 raft_consensus.cc:3060] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:38.696327  1757 raft_consensus.cc:493] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.692392  1721 raft_consensus.cc:740] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Initialized, Role: FOLLOWER
I20260709 12:58:38.697562  1721 consensus_queue.cc:260] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:38.698213  1757 raft_consensus.cc:515] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:38.698957  1751 raft_consensus.cc:493] T 770925e70faa4a16a275abd5282f5284 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.699555  1721 ts_tablet_manager.cc:1434] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 12:58:38.699468  1751 raft_consensus.cc:515] T 770925e70faa4a16a275abd5282f5284 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:38.700915  1757 leader_election.cc:290] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:38.701419  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:58:38.702006  1680 raft_consensus.cc:2468] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 0.
I20260709 12:58:38.702397  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:58:38.703440  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:58:38.703526  1606 raft_consensus.cc:2468] T 770925e70faa4a16a275abd5282f5284 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 0.
I20260709 12:58:38.704077  1679 raft_consensus.cc:2468] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 0.
I20260709 12:58:38.700461  1721 tablet_bootstrap.cc:492] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642: Bootstrap starting.
I20260709 12:58:38.704794  1497 leader_election.cc:304] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:58:38.705556  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:58:38.705734  1571 leader_election.cc:304] T 770925e70faa4a16a275abd5282f5284 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:58:38.706212  1532 raft_consensus.cc:2468] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 0.
I20260709 12:58:38.708411  1806 raft_consensus.cc:2804] T 770925e70faa4a16a275abd5282f5284 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:38.708593  1757 raft_consensus.cc:2804] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:38.709780  1806 raft_consensus.cc:493] T 770925e70faa4a16a275abd5282f5284 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:38.701416  1751 leader_election.cc:290] T 770925e70faa4a16a275abd5282f5284 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:38.710206  1806 raft_consensus.cc:3060] T 770925e70faa4a16a275abd5282f5284 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:38.711607  1757 raft_consensus.cc:493] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:38.712054  1757 raft_consensus.cc:3060] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:38.721185  1758 consensus_queue.cc:1048] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:38.721290  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:58:38.722057  1606 raft_consensus.cc:3060] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:38.727135  1747 leader_election.cc:290] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:58:38.729682  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:58:38.730289  1532 raft_consensus.cc:3060] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:38.730830  1606 raft_consensus.cc:2468] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 1.
I20260709 12:58:38.731917  1723 tablet_bootstrap.cc:654] T fb3a9a4620ef4fcd86eb78530746a583 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:38.732172  1646 leader_election.cc:304] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:58:38.733457  1751 consensus_queue.cc:1048] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:38.734798  1747 raft_consensus.cc:2804] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:38.744753  1729 raft_consensus.cc:493] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.748701  1681 raft_consensus.cc:2468] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 1.
I20260709 12:58:38.745244  1729 raft_consensus.cc:515] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:38.751298  1571 leader_election.cc:304] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:58:38.752197  1751 raft_consensus.cc:2804] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:38.752345  1729 leader_election.cc:290] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:38.752794  1751 raft_consensus.cc:697] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:58:38.753701  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:58:38.753648  1751 consensus_queue.cc:237] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:38.754386  1679 raft_consensus.cc:2468] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 0.
I20260709 12:58:38.755916  1747 raft_consensus.cc:697] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:58:38.756742  1747 consensus_queue.cc:237] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:38.756677  1496 leader_election.cc:304] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:58:38.760315  1529 raft_consensus.cc:2468] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 1.
I20260709 12:58:38.761376  1729 raft_consensus.cc:2804] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:38.761860  1729 raft_consensus.cc:493] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:38.762343  1729 raft_consensus.cc:3060] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:38.761489  1758 consensus_queue.cc:1048] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:58:38.769331  1727 raft_consensus.cc:493] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.776813  1532 raft_consensus.cc:2468] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 1.
I20260709 12:58:38.776939  1727 raft_consensus.cc:515] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:38.779246  1727 leader_election.cc:290] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:38.780884  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:58:38.781545  1681 raft_consensus.cc:2468] T d0b325904f4646bca264eeeea15dfeb0 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 0.
I20260709 12:58:38.782776  1571 leader_election.cc:304] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:58:38.782877  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:58:38.783565  1529 raft_consensus.cc:2468] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 0.
I20260709 12:58:38.783849  1727 raft_consensus.cc:2804] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:38.784222  1727 raft_consensus.cc:493] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:38.784590  1727 raft_consensus.cc:3060] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:38.784227  1722 tablet_bootstrap.cc:492] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90: No bootstrap required, opened a new log
I20260709 12:58:38.787469  1722 ts_tablet_manager.cc:1403] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90: Time spent bootstrapping tablet: real 0.107s	user 0.014s	sys 0.001s
I20260709 12:58:38.773608  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:58:38.792380  1722 raft_consensus.cc:359] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:38.786552  1812 consensus_queue.cc:1048] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:38.769778  1757 raft_consensus.cc:515] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:38.795373  1722 raft_consensus.cc:385] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:38.795823  1607 raft_consensus.cc:2468] T bb48619ad4f74c71a726835ef5a8b4c2 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 0.
I20260709 12:58:38.793139  1806 raft_consensus.cc:515] T 770925e70faa4a16a275abd5282f5284 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:38.800007  1722 raft_consensus.cc:740] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Initialized, Role: FOLLOWER
I20260709 12:58:38.802290  1722 consensus_queue.cc:260] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:38.805019  1757 leader_election.cc:290] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:38.807364  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:58:38.807946  1679 raft_consensus.cc:3060] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:38.820473  1722 ts_tablet_manager.cc:1434] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.000s
I20260709 12:58:38.828022  1727 raft_consensus.cc:515] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:38.831776  1722 tablet_bootstrap.cc:492] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90: Bootstrap starting.
I20260709 12:58:38.868630  1721 tablet_bootstrap.cc:654] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:38.871625  1679 raft_consensus.cc:2468] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 1.
I20260709 12:58:38.872444  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:58:38.872772  1806 leader_election.cc:290] T 770925e70faa4a16a275abd5282f5284 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:38.873468  1605 raft_consensus.cc:2393] T 770925e70faa4a16a275abd5282f5284 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 1: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 12:58:38.882931  1723 tablet_bootstrap.cc:492] T fb3a9a4620ef4fcd86eb78530746a583 P e46412b3b0b44f01ad5c33d4cfe3d6b1: No bootstrap required, opened a new log
I20260709 12:58:38.883359  1723 ts_tablet_manager.cc:1403] T fb3a9a4620ef4fcd86eb78530746a583 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent bootstrapping tablet: real 0.259s	user 0.005s	sys 0.010s
I20260709 12:58:38.872808  1678 raft_consensus.cc:3060] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:38.892319  1496 leader_election.cc:304] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:58:38.893232  1758 raft_consensus.cc:2804] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:38.893704  1758 raft_consensus.cc:697] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 12:58:38.894464  1758 consensus_queue.cc:237] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:38.895215  1430 catalog_manager.cc:5697] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 0 to 1, leader changed from <none> to 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:38.900393  1771 consensus_queue.cc:1048] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:38.877267  1747 consensus_queue.cc:1048] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 12:58:38.901094  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:58:38.906418  1679 raft_consensus.cc:2393] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 1: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 12:58:38.909032  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:58:38.902055  1727 leader_election.cc:290] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:38.912787  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:58:38.921072  1531 raft_consensus.cc:3060] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:38.913965  1812 consensus_queue.cc:1048] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:38.927217  1778 consensus_queue.cc:1048] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:38.929988  1806 consensus_queue.cc:1048] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:38.934748  1771 consensus_queue.cc:1048] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:38.936929  1570 leader_election.cc:304] T 770925e70faa4a16a275abd5282f5284 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:58:38.937973  1806 raft_consensus.cc:2749] T 770925e70faa4a16a275abd5282f5284 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:58:38.939239  1428 catalog_manager.cc:5697] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 reported cstate change: term changed from 0 to 1, leader changed from <none> to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:38.939271  1727 consensus_queue.cc:1048] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:58:38.945814  1729 raft_consensus.cc:515] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:38.941249  1723 raft_consensus.cc:359] T fb3a9a4620ef4fcd86eb78530746a583 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:38.947552  1723 raft_consensus.cc:385] T fb3a9a4620ef4fcd86eb78530746a583 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:38.947772  1723 raft_consensus.cc:740] T fb3a9a4620ef4fcd86eb78530746a583 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Initialized, Role: FOLLOWER
I20260709 12:58:38.925769  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:58:38.954043  1723 consensus_queue.cc:260] T fb3a9a4620ef4fcd86eb78530746a583 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:38.956161  1771 raft_consensus.cc:493] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.956533  1723 ts_tablet_manager.cc:1434] T fb3a9a4620ef4fcd86eb78530746a583 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent starting tablet: real 0.073s	user 0.006s	sys 0.000s
I20260709 12:58:38.956676  1771 raft_consensus.cc:515] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:38.958323  1723 tablet_bootstrap.cc:492] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1: Bootstrap starting.
I20260709 12:58:38.970683  1797 raft_consensus.cc:493] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.960443  1677 raft_consensus.cc:3060] T d0b325904f4646bca264eeeea15dfeb0 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:38.971211  1797 raft_consensus.cc:515] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:38.970950  1729 leader_election.cc:290] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:38.991271  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:58:38.992092  1681 raft_consensus.cc:3060] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:39.040843  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:58:39.041674  1606 raft_consensus.cc:3060] T bb48619ad4f74c71a726835ef5a8b4c2 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:39.059612  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:58:39.082650  1757 raft_consensus.cc:493] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:39.083309  1757 raft_consensus.cc:515] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:39.084685  1747 consensus_queue.cc:1048] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:58:39.145267  1771 leader_election.cc:290] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:58:39.158417  1721 tablet_bootstrap.cc:492] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642: No bootstrap required, opened a new log
I20260709 12:58:39.158926  1721 ts_tablet_manager.cc:1403] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642: Time spent bootstrapping tablet: real 0.459s	user 0.028s	sys 0.055s
I20260709 12:58:39.149636  1797 leader_election.cc:290] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:58:39.151813  1677 raft_consensus.cc:2468] T d0b325904f4646bca264eeeea15dfeb0 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 1.
I20260709 12:58:39.170713  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:58:39.171475  1526 raft_consensus.cc:2468] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 0.
I20260709 12:58:39.174790  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 12:58:39.162528  1644 leader_election.cc:343] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:58:39.225033  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 64091.9us
W20260709 12:58:39.238463  1845 log.cc:927] Time spent T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.202s	user 0.001s	sys 0.000s
I20260709 12:58:39.240996  1571 leader_election.cc:304] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:58:39.236140  1757 leader_election.cc:290] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 12:58:39.247330  1646 leader_election.cc:343] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:39.247833  1646 leader_election.cc:304] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:58:39.248577  1801 raft_consensus.cc:2749] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:39.238451  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:58:39.252077  1721 raft_consensus.cc:359] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:39.256321  1721 raft_consensus.cc:385] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:39.256645  1721 raft_consensus.cc:740] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Initialized, Role: FOLLOWER
I20260709 12:58:39.256989  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:58:39.257325  1721 consensus_queue.cc:260] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:39.254842  1846 raft_consensus.cc:2804] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:39.258952  1846 raft_consensus.cc:697] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:58:39.259860  1846 consensus_queue.cc:237] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:39.261852  1531 raft_consensus.cc:2468] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 1.
I20260709 12:58:39.265326  1721 ts_tablet_manager.cc:1434] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642: Time spent starting tablet: real 0.106s	user 0.006s	sys 0.001s
I20260709 12:58:39.266415  1721 tablet_bootstrap.cc:492] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642: Bootstrap starting.
W20260709 12:58:39.273065  1855 log.cc:927] Time spent T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 12:58:39.245411  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:58:39.268746  1676 raft_consensus.cc:2468] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 0.
I20260709 12:58:39.286554  1722 tablet_bootstrap.cc:654] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90: Neither blocks nor log segments found. Creating new log.
W20260709 12:58:39.311147  1497 leader_election.cc:343] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:39.321895  1723 tablet_bootstrap.cc:654] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:39.283582  1606 raft_consensus.cc:2468] T bb48619ad4f74c71a726835ef5a8b4c2 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 1.
W20260709 12:58:39.336229  1646 leader_election.cc:343] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:39.337409  1751 consensus_queue.cc:1048] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:58:39.322629  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 75078.2us
I20260709 12:58:39.343441  1838 raft_consensus.cc:493] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:39.343839  1497 leader_election.cc:304] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:58:39.346866  1857 consensus_queue.cc:1048] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:58:39.348575  1861 raft_consensus.cc:2804] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:39.349061  1861 raft_consensus.cc:697] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 12:58:39.353935  1806 consensus_queue.cc:1048] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:39.345456  1838 raft_consensus.cc:515] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:39.359071  1812 consensus_queue.cc:1048] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:58:39.360667  1496 leader_election.cc:304] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 12:58:39.358400  1861 consensus_queue.cc:237] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:39.363272  1863 raft_consensus.cc:2804] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:39.361608  1757 raft_consensus.cc:493] T fb3a9a4620ef4fcd86eb78530746a583 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:39.378078  1721 tablet_bootstrap.cc:654] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:39.372785  1681 raft_consensus.cc:2468] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 1.
I20260709 12:58:39.363796  1863 raft_consensus.cc:493] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:39.364893  1757 raft_consensus.cc:515] T fb3a9a4620ef4fcd86eb78530746a583 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:39.367118  1644 leader_election.cc:304] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 12:58:39.388479  1863 raft_consensus.cc:3060] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:39.417925  1722 tablet_bootstrap.cc:492] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90: No bootstrap required, opened a new log
I20260709 12:58:39.418504  1722 ts_tablet_manager.cc:1403] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90: Time spent bootstrapping tablet: real 0.587s	user 0.028s	sys 0.022s
I20260709 12:58:39.406884  1801 raft_consensus.cc:2804] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:58:39.418907  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 51901.6us
I20260709 12:58:39.431833  1757 leader_election.cc:290] T fb3a9a4620ef4fcd86eb78530746a583 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:39.426090  1801 raft_consensus.cc:493] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:39.436189  1801 raft_consensus.cc:3060] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:39.438508  1838 leader_election.cc:290] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:58:39.443622  1430 catalog_manager.cc:5697] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 0 to 1, leader changed from <none> to 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:39.475593  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:58:39.476714  1723 tablet_bootstrap.cc:492] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1: No bootstrap required, opened a new log
I20260709 12:58:39.477246  1723 ts_tablet_manager.cc:1403] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent bootstrapping tablet: real 0.519s	user 0.018s	sys 0.007s
I20260709 12:58:39.478440  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:58:39.493134  1723 raft_consensus.cc:359] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:39.493949  1723 raft_consensus.cc:385] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:39.494225  1723 raft_consensus.cc:740] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Initialized, Role: FOLLOWER
I20260709 12:58:39.476876  1866 raft_consensus.cc:493] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:39.494812  1723 consensus_queue.cc:260] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:39.497262  1723 ts_tablet_manager.cc:1434] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 12:58:39.498268  1723 tablet_bootstrap.cc:492] T 1359810508724a7a8749ce09a6654a9c P e46412b3b0b44f01ad5c33d4cfe3d6b1: Bootstrap starting.
I20260709 12:58:39.498805  1758 raft_consensus.cc:493] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:39.499348  1758 raft_consensus.cc:515] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:39.496240  1866 raft_consensus.cc:515] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:39.512212  1758 leader_election.cc:290] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:39.513223  1722 raft_consensus.cc:359] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:39.513819  1722 raft_consensus.cc:385] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:39.514070  1722 raft_consensus.cc:740] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Initialized, Role: FOLLOWER
I20260709 12:58:39.514215  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 12:58:39.507371  1496 leader_election.cc:343] T fb3a9a4620ef4fcd86eb78530746a583 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:39.516810  1729 consensus_queue.cc:1048] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:39.519383  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:58:39.519743  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:58:39.522929  1722 consensus_queue.cc:260] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:39.526477  1644 leader_election.cc:304] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:58:39.527622  1857 raft_consensus.cc:2749] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:58:39.533097  1478 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:58:39.533583  1866 leader_election.cc:290] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:39.534205  1722 ts_tablet_manager.cc:1434] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90: Time spent starting tablet: real 0.115s	user 0.002s	sys 0.004s
I20260709 12:58:39.535171  1722 tablet_bootstrap.cc:492] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90: Bootstrap starting.
W20260709 12:58:39.535094  1496 leader_election.cc:343] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:39.536676  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:58:39.537276  1605 raft_consensus.cc:2468] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 0.
I20260709 12:58:39.535284  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:58:39.543771  1801 raft_consensus.cc:515] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 12:58:39.545043  1497 leader_election.cc:343] T fb3a9a4620ef4fcd86eb78530746a583 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:58:39.547278  1571 leader_election.cc:343] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:39.548084  1723 tablet_bootstrap.cc:654] T 1359810508724a7a8749ce09a6654a9c P e46412b3b0b44f01ad5c33d4cfe3d6b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:39.537226  1863 raft_consensus.cc:515] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:39.550566  1721 tablet_bootstrap.cc:492] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642: No bootstrap required, opened a new log
I20260709 12:58:39.547379  1497 leader_election.cc:304] T fb3a9a4620ef4fcd86eb78530746a583 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:58:39.551047  1721 ts_tablet_manager.cc:1403] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642: Time spent bootstrapping tablet: real 0.285s	user 0.028s	sys 0.024s
I20260709 12:58:39.555009  1722 tablet_bootstrap.cc:654] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:39.553581  1797 consensus_queue.cc:1048] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:58:39.557443  1721 raft_consensus.cc:359] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:39.557276  1428 catalog_manager.cc:5697] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:39.558408  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:58:39.559011  1526 raft_consensus.cc:2468] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 0.
I20260709 12:58:39.559736  1497 leader_election.cc:304] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 12:58:39.560463  1758 raft_consensus.cc:2804] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:39.560794  1758 raft_consensus.cc:493] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:39.561106  1758 raft_consensus.cc:3060] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:39.561805  1570 leader_election.cc:304] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 12:58:39.563239  1850 consensus_queue.cc:1048] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:39.562937  1721 raft_consensus.cc:385] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:39.564585  1721 raft_consensus.cc:740] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Initialized, Role: FOLLOWER
I20260709 12:58:39.569957  1758 raft_consensus.cc:515] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:39.566025  1866 raft_consensus.cc:2804] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:39.572329  1866 raft_consensus.cc:493] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:39.572713  1866 raft_consensus.cc:3060] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:39.573403  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:58:39.552148  1861 raft_consensus.cc:2749] T fb3a9a4620ef4fcd86eb78530746a583 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:39.573798  1721 consensus_queue.cc:260] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 12:58:39.580219  1496 leader_election.cc:343] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:39.586915  1721 ts_tablet_manager.cc:1434] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642: Time spent starting tablet: real 0.036s	user 0.004s	sys 0.003s
I20260709 12:58:39.587980  1721 tablet_bootstrap.cc:492] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642: Bootstrap starting.
I20260709 12:58:39.575345  1758 leader_election.cc:290] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:39.599133  1863 leader_election.cc:290] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:39.600632  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:58:39.600872  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:58:39.601752  1681 raft_consensus.cc:2393] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 1: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
W20260709 12:58:39.602043  1646 leader_election.cc:343] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:39.603163  1801 leader_election.cc:290] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:58:39.609719  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:58:39.618530  1721 tablet_bootstrap.cc:654] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:39.614815  1428 catalog_manager.cc:5697] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:39.621156  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:58:39.613647  1866 raft_consensus.cc:515] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:39.624679  1866 leader_election.cc:290] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:39.625872  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
W20260709 12:58:39.627643  1571 leader_election.cc:343] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:39.631145  1604 raft_consensus.cc:2393] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 1: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 12:58:39.637359  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:58:39.638607  1529 raft_consensus.cc:2393] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 1: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 12:58:39.644516  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:58:39.645314  1530 raft_consensus.cc:2393] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 1: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 12:58:39.654887  1644 leader_election.cc:304] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 12:58:39.655323  1497 leader_election.cc:343] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:39.655993  1801 raft_consensus.cc:2749] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:58:39.658010  1570 leader_election.cc:304] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:58:39.659289  1751 raft_consensus.cc:2749] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:58:39.661535  1722 tablet_bootstrap.cc:492] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90: No bootstrap required, opened a new log
I20260709 12:58:39.655884  1497 leader_election.cc:304] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:58:39.662009  1722 ts_tablet_manager.cc:1403] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90: Time spent bootstrapping tablet: real 0.127s	user 0.019s	sys 0.039s
I20260709 12:58:39.662186  1863 raft_consensus.cc:2749] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:58:39.663018  1721 tablet_bootstrap.cc:492] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642: No bootstrap required, opened a new log
I20260709 12:58:39.663502  1721 ts_tablet_manager.cc:1403] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642: Time spent bootstrapping tablet: real 0.076s	user 0.007s	sys 0.018s
I20260709 12:58:39.665100  1722 raft_consensus.cc:359] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:39.665807  1722 raft_consensus.cc:385] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:39.666069  1722 raft_consensus.cc:740] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Initialized, Role: FOLLOWER
I20260709 12:58:39.666725  1722 consensus_queue.cc:260] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:39.667068  1721 raft_consensus.cc:359] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:39.667668  1721 raft_consensus.cc:385] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:39.667918  1721 raft_consensus.cc:740] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Initialized, Role: FOLLOWER
I20260709 12:58:39.665529  1723 tablet_bootstrap.cc:492] T 1359810508724a7a8749ce09a6654a9c P e46412b3b0b44f01ad5c33d4cfe3d6b1: No bootstrap required, opened a new log
I20260709 12:58:39.668627  1723 ts_tablet_manager.cc:1403] T 1359810508724a7a8749ce09a6654a9c P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent bootstrapping tablet: real 0.171s	user 0.016s	sys 0.024s
I20260709 12:58:39.665270  1497 leader_election.cc:304] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:58:39.669518  1758 raft_consensus.cc:2749] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:58:39.671600  1723 raft_consensus.cc:359] T 1359810508724a7a8749ce09a6654a9c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:39.672257  1723 raft_consensus.cc:385] T 1359810508724a7a8749ce09a6654a9c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:39.672506  1723 raft_consensus.cc:740] T 1359810508724a7a8749ce09a6654a9c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Initialized, Role: FOLLOWER
I20260709 12:58:39.673084  1723 consensus_queue.cc:260] T 1359810508724a7a8749ce09a6654a9c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:39.673292  1866 consensus_queue.cc:1048] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:39.675124  1723 ts_tablet_manager.cc:1434] T 1359810508724a7a8749ce09a6654a9c P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:58:39.676002  1723 tablet_bootstrap.cc:492] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Bootstrap starting.
I20260709 12:58:39.679309  1721 consensus_queue.cc:260] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:39.679848  1722 ts_tablet_manager.cc:1434] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 12:58:39.680742  1722 tablet_bootstrap.cc:492] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90: Bootstrap starting.
I20260709 12:58:39.681087  1721 ts_tablet_manager.cc:1434] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.002s
I20260709 12:58:39.681973  1721 tablet_bootstrap.cc:492] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642: Bootstrap starting.
I20260709 12:58:39.687705  1721 tablet_bootstrap.cc:654] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:39.690253  1722 tablet_bootstrap.cc:654] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:39.693432  1723 tablet_bootstrap.cc:654] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:39.693432  1801 raft_consensus.cc:493] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:39.694078  1801 raft_consensus.cc:515] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:39.697566  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:58:39.698329  1604 raft_consensus.cc:2468] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 0.
I20260709 12:58:39.700906  1646 leader_election.cc:304] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:58:39.701617  1721 tablet_bootstrap.cc:492] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642: No bootstrap required, opened a new log
I20260709 12:58:39.701856  1796 raft_consensus.cc:2804] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:39.702080  1721 ts_tablet_manager.cc:1403] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.004s
I20260709 12:58:39.702221  1796 raft_consensus.cc:493] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:39.702564  1796 raft_consensus.cc:3060] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:39.706125  1721 raft_consensus.cc:359] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:39.707559  1721 raft_consensus.cc:385] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:39.707824  1721 raft_consensus.cc:740] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Initialized, Role: FOLLOWER
I20260709 12:58:39.707988  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:58:39.708478  1721 consensus_queue.cc:260] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:39.712338  1723 tablet_bootstrap.cc:492] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1: No bootstrap required, opened a new log
I20260709 12:58:39.715061  1801 leader_election.cc:290] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:58:39.715461  1723 ts_tablet_manager.cc:1403] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent bootstrapping tablet: real 0.040s	user 0.005s	sys 0.007s
I20260709 12:58:39.713232  1721 ts_tablet_manager.cc:1434] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:58:39.716720  1721 tablet_bootstrap.cc:492] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642: Bootstrap starting.
I20260709 12:58:39.714454  1796 raft_consensus.cc:515] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:39.718252  1723 raft_consensus.cc:359] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:39.718974  1723 raft_consensus.cc:385] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:39.719269  1723 raft_consensus.cc:740] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Initialized, Role: FOLLOWER
I20260709 12:58:39.719993  1723 consensus_queue.cc:260] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:39.720186  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:58:39.720894  1604 raft_consensus.cc:3060] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:39.722509  1723 ts_tablet_manager.cc:1434] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:58:39.722949  1721 tablet_bootstrap.cc:654] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:39.723541  1723 tablet_bootstrap.cc:492] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Bootstrap starting.
I20260709 12:58:39.723220  1727 consensus_queue.cc:1048] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:39.724524  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:58:39.725090  1530 raft_consensus.cc:3060] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:58:39.725835  1644 leader_election.cc:343] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:39.720647  1796 leader_election.cc:290] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:58:39.737303  1530 raft_consensus.cc:2468] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 1.
I20260709 12:58:39.742372  1644 leader_election.cc:304] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:58:39.745013  1796 raft_consensus.cc:2804] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:39.742251  1604 raft_consensus.cc:2468] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 1.
I20260709 12:58:39.747144  1723 tablet_bootstrap.cc:654] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:39.746394  1796 raft_consensus.cc:697] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:58:39.750016  1796 consensus_queue.cc:237] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:39.755276  1721 tablet_bootstrap.cc:492] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642: No bootstrap required, opened a new log
I20260709 12:58:39.755857  1721 ts_tablet_manager.cc:1403] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642: Time spent bootstrapping tablet: real 0.039s	user 0.015s	sys 0.013s
I20260709 12:58:39.758420  1721 raft_consensus.cc:359] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:39.759264  1721 raft_consensus.cc:385] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:39.759600  1721 raft_consensus.cc:740] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Initialized, Role: FOLLOWER
I20260709 12:58:39.760336  1721 consensus_queue.cc:260] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:39.762571  1721 ts_tablet_manager.cc:1434] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.001s
I20260709 12:58:39.763653  1721 tablet_bootstrap.cc:492] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642: Bootstrap starting.
I20260709 12:58:39.770293  1721 tablet_bootstrap.cc:654] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:39.771787  1723 tablet_bootstrap.cc:492] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1: No bootstrap required, opened a new log
I20260709 12:58:39.774806  1723 ts_tablet_manager.cc:1403] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent bootstrapping tablet: real 0.051s	user 0.013s	sys 0.001s
I20260709 12:58:39.775957  1722 tablet_bootstrap.cc:492] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90: No bootstrap required, opened a new log
I20260709 12:58:39.776432  1722 ts_tablet_manager.cc:1403] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90: Time spent bootstrapping tablet: real 0.096s	user 0.006s	sys 0.015s
I20260709 12:58:39.766114  1429 catalog_manager.cc:5697] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 reported cstate change: term changed from 0 to 1, leader changed from <none> to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:39.778096  1723 raft_consensus.cc:359] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:39.779021  1723 raft_consensus.cc:385] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:39.779378  1723 raft_consensus.cc:740] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Initialized, Role: FOLLOWER
I20260709 12:58:39.780108  1723 consensus_queue.cc:260] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:39.780768  1722 raft_consensus.cc:359] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:39.781457  1722 raft_consensus.cc:385] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:39.781713  1722 raft_consensus.cc:740] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Initialized, Role: FOLLOWER
I20260709 12:58:39.782675  1723 ts_tablet_manager.cc:1434] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:58:39.782451  1722 consensus_queue.cc:260] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:39.783840  1723 tablet_bootstrap.cc:492] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1: Bootstrap starting.
I20260709 12:58:39.785102  1722 ts_tablet_manager.cc:1434] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:58:39.785990  1722 tablet_bootstrap.cc:492] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90: Bootstrap starting.
I20260709 12:58:39.791069  1723 tablet_bootstrap.cc:654] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:39.799551  1722 tablet_bootstrap.cc:654] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:39.800616  1721 tablet_bootstrap.cc:492] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642: No bootstrap required, opened a new log
I20260709 12:58:39.801059  1723 tablet_bootstrap.cc:492] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1: No bootstrap required, opened a new log
I20260709 12:58:39.801098  1721 ts_tablet_manager.cc:1403] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642: Time spent bootstrapping tablet: real 0.038s	user 0.019s	sys 0.008s
I20260709 12:58:39.801617  1723 ts_tablet_manager.cc:1403] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent bootstrapping tablet: real 0.018s	user 0.008s	sys 0.006s
I20260709 12:58:39.804767  1723 raft_consensus.cc:359] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:39.804814  1721 raft_consensus.cc:359] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:39.805286  1723 raft_consensus.cc:385] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:39.805513  1721 raft_consensus.cc:385] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:39.805558  1723 raft_consensus.cc:740] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Initialized, Role: FOLLOWER
I20260709 12:58:39.805898  1721 raft_consensus.cc:740] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Initialized, Role: FOLLOWER
I20260709 12:58:39.806257  1723 consensus_queue.cc:260] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:39.806576  1722 tablet_bootstrap.cc:492] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90: No bootstrap required, opened a new log
I20260709 12:58:39.807137  1722 ts_tablet_manager.cc:1403] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.002s
I20260709 12:58:39.807973  1723 ts_tablet_manager.cc:1434] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:58:39.806535  1721 consensus_queue.cc:260] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:39.809190  1723 tablet_bootstrap.cc:492] T 0b050d298db6466f856d263a342e3c51 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Bootstrap starting.
I20260709 12:58:39.809556  1722 raft_consensus.cc:359] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:39.810110  1721 ts_tablet_manager.cc:1434] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:58:39.810178  1722 raft_consensus.cc:385] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:39.810500  1722 raft_consensus.cc:740] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Initialized, Role: FOLLOWER
I20260709 12:58:39.811018  1721 tablet_bootstrap.cc:492] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642: Bootstrap starting.
I20260709 12:58:39.811278  1722 consensus_queue.cc:260] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:39.815743  1723 tablet_bootstrap.cc:654] T 0b050d298db6466f856d263a342e3c51 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:39.820734  1796 raft_consensus.cc:493] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:39.821223  1796 raft_consensus.cc:515] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:39.823333  1796 leader_election.cc:290] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:58:39.824729  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:58:39.826121  1607 raft_consensus.cc:2393] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 1: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 12:58:39.824756  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:58:39.827428  1530 raft_consensus.cc:2393] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 1: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 12:58:39.829440  1722 ts_tablet_manager.cc:1434] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.000s
I20260709 12:58:39.831638  1646 leader_election.cc:304] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:58:39.832743  1796 raft_consensus.cc:3060] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:39.834103  1722 tablet_bootstrap.cc:492] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90: Bootstrap starting.
I20260709 12:58:39.840950  1722 tablet_bootstrap.cc:654] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:39.843710  1796 raft_consensus.cc:2749] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:39.844525  1721 tablet_bootstrap.cc:654] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:39.851684  1721 tablet_bootstrap.cc:492] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642: No bootstrap required, opened a new log
I20260709 12:58:39.852195  1721 ts_tablet_manager.cc:1403] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642: Time spent bootstrapping tablet: real 0.041s	user 0.008s	sys 0.003s
I20260709 12:58:39.854933  1721 raft_consensus.cc:359] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:39.855633  1721 raft_consensus.cc:385] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:39.855911  1721 raft_consensus.cc:740] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Initialized, Role: FOLLOWER
I20260709 12:58:39.855981  1723 tablet_bootstrap.cc:492] T 0b050d298db6466f856d263a342e3c51 P e46412b3b0b44f01ad5c33d4cfe3d6b1: No bootstrap required, opened a new log
I20260709 12:58:39.856535  1723 ts_tablet_manager.cc:1403] T 0b050d298db6466f856d263a342e3c51 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent bootstrapping tablet: real 0.048s	user 0.025s	sys 0.022s
I20260709 12:58:39.856751  1721 consensus_queue.cc:260] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:39.858754  1721 ts_tablet_manager.cc:1434] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:58:39.858814  1723 raft_consensus.cc:359] T 0b050d298db6466f856d263a342e3c51 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:39.859503  1723 raft_consensus.cc:385] T 0b050d298db6466f856d263a342e3c51 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:39.859707  1723 raft_consensus.cc:740] T 0b050d298db6466f856d263a342e3c51 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Initialized, Role: FOLLOWER
I20260709 12:58:39.860474  1722 tablet_bootstrap.cc:492] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90: No bootstrap required, opened a new log
I20260709 12:58:39.860270  1723 consensus_queue.cc:260] T 0b050d298db6466f856d263a342e3c51 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:39.860927  1722 ts_tablet_manager.cc:1403] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90: Time spent bootstrapping tablet: real 0.027s	user 0.010s	sys 0.011s
I20260709 12:58:39.861641  1723 ts_tablet_manager.cc:1434] T 0b050d298db6466f856d263a342e3c51 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.001s
I20260709 12:58:39.862855  1723 tablet_bootstrap.cc:492] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Bootstrap starting.
I20260709 12:58:39.863871  1722 raft_consensus.cc:359] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:39.864494  1722 raft_consensus.cc:385] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:39.864748  1722 raft_consensus.cc:740] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Initialized, Role: FOLLOWER
I20260709 12:58:39.865415  1721 tablet_bootstrap.cc:492] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642: Bootstrap starting.
I20260709 12:58:39.865437  1722 consensus_queue.cc:260] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:39.868811  1722 ts_tablet_manager.cc:1434] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 12:58:39.869072  1723 tablet_bootstrap.cc:654] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:39.870954  1722 tablet_bootstrap.cc:492] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90: Bootstrap starting.
I20260709 12:58:39.877382  1722 tablet_bootstrap.cc:654] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:39.881642  1723 tablet_bootstrap.cc:492] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1: No bootstrap required, opened a new log
I20260709 12:58:39.882144  1723 ts_tablet_manager.cc:1403] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent bootstrapping tablet: real 0.019s	user 0.007s	sys 0.008s
I20260709 12:58:39.884645  1723 raft_consensus.cc:359] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:39.885381  1723 raft_consensus.cc:385] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:39.885644  1723 raft_consensus.cc:740] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Initialized, Role: FOLLOWER
I20260709 12:58:39.886391  1723 consensus_queue.cc:260] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:39.888835  1721 tablet_bootstrap.cc:654] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:39.889439  1723 ts_tablet_manager.cc:1434] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:58:39.890511  1723 tablet_bootstrap.cc:492] T e0590ffd096d4e378ab66c1795ff5cce P e46412b3b0b44f01ad5c33d4cfe3d6b1: Bootstrap starting.
I20260709 12:58:39.896548  1723 tablet_bootstrap.cc:654] T e0590ffd096d4e378ab66c1795ff5cce P e46412b3b0b44f01ad5c33d4cfe3d6b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:39.909399  1723 tablet_bootstrap.cc:492] T e0590ffd096d4e378ab66c1795ff5cce P e46412b3b0b44f01ad5c33d4cfe3d6b1: No bootstrap required, opened a new log
I20260709 12:58:39.909883  1723 ts_tablet_manager.cc:1403] T e0590ffd096d4e378ab66c1795ff5cce P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent bootstrapping tablet: real 0.020s	user 0.007s	sys 0.004s
I20260709 12:58:39.910780  1861 consensus_queue.cc:1048] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:39.912451  1722 tablet_bootstrap.cc:492] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90: No bootstrap required, opened a new log
I20260709 12:58:39.912974  1722 ts_tablet_manager.cc:1403] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90: Time spent bootstrapping tablet: real 0.043s	user 0.005s	sys 0.017s
I20260709 12:58:39.915256  1722 raft_consensus.cc:359] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:39.915860  1722 raft_consensus.cc:385] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:39.916143  1722 raft_consensus.cc:740] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Initialized, Role: FOLLOWER
I20260709 12:58:39.916927  1722 consensus_queue.cc:260] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:39.919127  1722 ts_tablet_manager.cc:1434] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:58:39.919900  1722 tablet_bootstrap.cc:492] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90: Bootstrap starting.
I20260709 12:58:39.920121  1721 tablet_bootstrap.cc:492] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642: No bootstrap required, opened a new log
I20260709 12:58:39.920583  1721 ts_tablet_manager.cc:1403] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642: Time spent bootstrapping tablet: real 0.055s	user 0.019s	sys 0.008s
I20260709 12:58:39.925184  1723 raft_consensus.cc:359] T e0590ffd096d4e378ab66c1795ff5cce P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:39.925874  1723 raft_consensus.cc:385] T e0590ffd096d4e378ab66c1795ff5cce P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:39.926155  1723 raft_consensus.cc:740] T e0590ffd096d4e378ab66c1795ff5cce P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Initialized, Role: FOLLOWER
I20260709 12:58:39.926771  1723 consensus_queue.cc:260] T e0590ffd096d4e378ab66c1795ff5cce P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:39.927889  1863 consensus_queue.cc:1048] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:39.928700  1723 ts_tablet_manager.cc:1434] T e0590ffd096d4e378ab66c1795ff5cce P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.001s
I20260709 12:58:39.929561  1723 tablet_bootstrap.cc:492] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1: Bootstrap starting.
I20260709 12:58:39.931057  1721 raft_consensus.cc:359] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:39.931733  1721 raft_consensus.cc:385] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:39.931993  1721 raft_consensus.cc:740] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Initialized, Role: FOLLOWER
I20260709 12:58:39.932593  1721 consensus_queue.cc:260] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:39.934517  1721 ts_tablet_manager.cc:1434] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.000s
I20260709 12:58:39.935479  1721 tablet_bootstrap.cc:492] T 64842f503da44f59896ed29b9edd3b29 P 39a92f5a4352465d8af3af5908fe8642: Bootstrap starting.
I20260709 12:58:39.936421  1723 tablet_bootstrap.cc:654] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:39.936671  1846 raft_consensus.cc:493] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:39.937140  1846 raft_consensus.cc:515] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:39.939998  1846 leader_election.cc:290] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:39.941565  1721 tablet_bootstrap.cc:654] T 64842f503da44f59896ed29b9edd3b29 P 39a92f5a4352465d8af3af5908fe8642: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:39.946156  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:58:39.947140  1530 raft_consensus.cc:2468] T 0b050d298db6466f856d263a342e3c51 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 0.
I20260709 12:58:39.949083  1570 leader_election.cc:304] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:58:39.956157  1751 raft_consensus.cc:2804] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:39.956666  1751 raft_consensus.cc:493] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:39.957021  1751 raft_consensus.cc:3060] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:39.954061  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:58:39.961000  1681 raft_consensus.cc:2468] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 0.
I20260709 12:58:39.965078  1723 tablet_bootstrap.cc:492] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1: No bootstrap required, opened a new log
I20260709 12:58:39.965593  1723 ts_tablet_manager.cc:1403] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent bootstrapping tablet: real 0.036s	user 0.009s	sys 0.020s
I20260709 12:58:39.968469  1723 raft_consensus.cc:359] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:39.968943  1727 raft_consensus.cc:493] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:39.969286  1723 raft_consensus.cc:385] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:39.969605  1723 raft_consensus.cc:740] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Initialized, Role: FOLLOWER
I20260709 12:58:39.969470  1727 raft_consensus.cc:515] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:39.970371  1723 consensus_queue.cc:260] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:39.972318  1721 tablet_bootstrap.cc:492] T 64842f503da44f59896ed29b9edd3b29 P 39a92f5a4352465d8af3af5908fe8642: No bootstrap required, opened a new log
I20260709 12:58:39.972512  1723 ts_tablet_manager.cc:1434] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:58:39.972797  1721 ts_tablet_manager.cc:1403] T 64842f503da44f59896ed29b9edd3b29 P 39a92f5a4352465d8af3af5908fe8642: Time spent bootstrapping tablet: real 0.038s	user 0.002s	sys 0.013s
I20260709 12:58:39.975131  1727 leader_election.cc:290] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:39.975293  1721 raft_consensus.cc:359] T 64842f503da44f59896ed29b9edd3b29 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:39.976604  1723 tablet_bootstrap.cc:492] T 819fbeffe41b4610a05fcaac38e161b6 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Bootstrap starting.
I20260709 12:58:39.983829  1723 tablet_bootstrap.cc:654] T 819fbeffe41b4610a05fcaac38e161b6 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:39.983660  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:58:39.984339  1529 raft_consensus.cc:2468] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 0.
I20260709 12:58:39.983830  1722 tablet_bootstrap.cc:654] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:39.985872  1570 leader_election.cc:304] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:58:39.986797  1846 raft_consensus.cc:2804] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:39.987190  1846 raft_consensus.cc:493] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:39.988339  1846 raft_consensus.cc:3060] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:39.989939  1721 raft_consensus.cc:385] T 64842f503da44f59896ed29b9edd3b29 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:39.990502  1721 raft_consensus.cc:740] T 64842f503da44f59896ed29b9edd3b29 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Initialized, Role: FOLLOWER
I20260709 12:58:39.991269  1721 consensus_queue.cc:260] T 64842f503da44f59896ed29b9edd3b29 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:39.992216  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:58:40.001036  1681 raft_consensus.cc:2468] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 0.
I20260709 12:58:39.993557  1721 ts_tablet_manager.cc:1434] T 64842f503da44f59896ed29b9edd3b29 P 39a92f5a4352465d8af3af5908fe8642: Time spent starting tablet: real 0.020s	user 0.003s	sys 0.003s
I20260709 12:58:39.994760  1751 raft_consensus.cc:515] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:39.999637  1778 raft_consensus.cc:493] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:40.002595  1778 raft_consensus.cc:515] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:40.000504  1723 tablet_bootstrap.cc:492] T 819fbeffe41b4610a05fcaac38e161b6 P e46412b3b0b44f01ad5c33d4cfe3d6b1: No bootstrap required, opened a new log
I20260709 12:58:40.003438  1751 leader_election.cc:290] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:40.003646  1723 ts_tablet_manager.cc:1403] T 819fbeffe41b4610a05fcaac38e161b6 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent bootstrapping tablet: real 0.027s	user 0.010s	sys 0.013s
I20260709 12:58:40.004158  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:58:40.004678  1778 leader_election.cc:290] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:40.004830  1529 raft_consensus.cc:3060] T 0b050d298db6466f856d263a342e3c51 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:40.005918  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:58:40.006386  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:58:40.006510  1680 raft_consensus.cc:3060] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:40.007057  1678 raft_consensus.cc:2468] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 0.
I20260709 12:58:40.007829  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:58:40.008445  1530 raft_consensus.cc:2468] T fb3a9a4620ef4fcd86eb78530746a583 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 0.
I20260709 12:58:40.008541  1571 leader_election.cc:304] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:58:40.008919  1723 raft_consensus.cc:359] T 819fbeffe41b4610a05fcaac38e161b6 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:40.009770  1723 raft_consensus.cc:385] T 819fbeffe41b4610a05fcaac38e161b6 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:40.010133  1723 raft_consensus.cc:740] T 819fbeffe41b4610a05fcaac38e161b6 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Initialized, Role: FOLLOWER
I20260709 12:58:40.009685  1778 raft_consensus.cc:2804] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:40.010684  1778 raft_consensus.cc:493] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:40.011039  1778 raft_consensus.cc:3060] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:40.010998  1723 consensus_queue.cc:260] T 819fbeffe41b4610a05fcaac38e161b6 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:40.013403  1721 tablet_bootstrap.cc:492] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642: Bootstrap starting.
I20260709 12:58:40.017999  1529 raft_consensus.cc:2468] T 0b050d298db6466f856d263a342e3c51 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 1.
I20260709 12:58:40.020124  1570 leader_election.cc:304] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:58:40.021059  1751 raft_consensus.cc:2804] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:40.021526  1751 raft_consensus.cc:697] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:58:40.022315  1751 consensus_queue.cc:237] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:40.023623  1723 ts_tablet_manager.cc:1434] T 819fbeffe41b4610a05fcaac38e161b6 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.001s
I20260709 12:58:40.024682  1723 tablet_bootstrap.cc:492] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Bootstrap starting.
I20260709 12:58:40.021975  1778 raft_consensus.cc:515] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:40.026952  1846 raft_consensus.cc:515] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:40.029001  1680 raft_consensus.cc:2468] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 1.
I20260709 12:58:40.034518  1723 tablet_bootstrap.cc:654] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:40.037307  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:58:40.037179  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:58:40.037935  1529 raft_consensus.cc:3060] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:40.037982  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:58:40.038002  1681 raft_consensus.cc:3060] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:40.035931  1846 leader_election.cc:290] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:40.038805  1530 raft_consensus.cc:3060] T fb3a9a4620ef4fcd86eb78530746a583 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:40.046934  1681 raft_consensus.cc:2468] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 1.
I20260709 12:58:40.047945  1429 catalog_manager.cc:5697] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 0 to 1, leader changed from <none> to 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:40.048875  1571 leader_election.cc:304] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:58:40.049249  1529 raft_consensus.cc:2468] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 1.
I20260709 12:58:40.050104  1751 raft_consensus.cc:2804] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:40.050568  1751 raft_consensus.cc:697] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:58:40.051405  1751 consensus_queue.cc:237] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:40.065500  1778 leader_election.cc:290] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:40.067848  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:58:40.069610  1681 raft_consensus.cc:3060] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:40.090060  1530 raft_consensus.cc:2468] T fb3a9a4620ef4fcd86eb78530746a583 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 1.
I20260709 12:58:40.092634  1570 leader_election.cc:304] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:58:40.094947  1721 tablet_bootstrap.cc:654] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:40.094647  1778 raft_consensus.cc:2804] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:40.095499  1778 raft_consensus.cc:697] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:58:40.096199  1681 raft_consensus.cc:2468] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 1.
I20260709 12:58:40.097200  1722 tablet_bootstrap.cc:492] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90: No bootstrap required, opened a new log
I20260709 12:58:40.097630  1722 ts_tablet_manager.cc:1403] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90: Time spent bootstrapping tablet: real 0.178s	user 0.006s	sys 0.011s
I20260709 12:58:40.096623  1778 consensus_queue.cc:237] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:40.100099  1722 raft_consensus.cc:359] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:40.100840  1722 raft_consensus.cc:385] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:40.101148  1722 raft_consensus.cc:740] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Initialized, Role: FOLLOWER
I20260709 12:58:40.101781  1722 consensus_queue.cc:260] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:40.104038  1722 ts_tablet_manager.cc:1434] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:58:40.106175  1723 tablet_bootstrap.cc:492] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1: No bootstrap required, opened a new log
I20260709 12:58:40.106760  1723 ts_tablet_manager.cc:1403] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent bootstrapping tablet: real 0.082s	user 0.014s	sys 0.051s
I20260709 12:58:40.110064  1722 tablet_bootstrap.cc:492] T cbe75e7a89594d3f81b1b8935b43b2ed P ddf11fc190dd4b898773379c6b129d90: Bootstrap starting.
I20260709 12:58:40.109638  1429 catalog_manager.cc:5697] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 0 to 1, leader changed from <none> to 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:40.114267  1721 tablet_bootstrap.cc:492] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642: No bootstrap required, opened a new log
I20260709 12:58:40.114861  1721 ts_tablet_manager.cc:1403] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642: Time spent bootstrapping tablet: real 0.102s	user 0.009s	sys 0.011s
I20260709 12:58:40.115710  1722 tablet_bootstrap.cc:654] T cbe75e7a89594d3f81b1b8935b43b2ed P ddf11fc190dd4b898773379c6b129d90: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:40.118036  1721 raft_consensus.cc:359] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:40.121309  1721 raft_consensus.cc:385] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:40.121680  1721 raft_consensus.cc:740] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Initialized, Role: FOLLOWER
I20260709 12:58:40.125160  1721 consensus_queue.cc:260] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:40.128114  1721 ts_tablet_manager.cc:1434] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 12:58:40.129426  1721 tablet_bootstrap.cc:492] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642: Bootstrap starting.
I20260709 12:58:40.131664  1722 tablet_bootstrap.cc:492] T cbe75e7a89594d3f81b1b8935b43b2ed P ddf11fc190dd4b898773379c6b129d90: No bootstrap required, opened a new log
I20260709 12:58:40.132138  1722 ts_tablet_manager.cc:1403] T cbe75e7a89594d3f81b1b8935b43b2ed P ddf11fc190dd4b898773379c6b129d90: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.007s
I20260709 12:58:40.135085  1722 raft_consensus.cc:359] T cbe75e7a89594d3f81b1b8935b43b2ed P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:40.135743  1722 raft_consensus.cc:385] T cbe75e7a89594d3f81b1b8935b43b2ed P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:40.136045  1722 raft_consensus.cc:740] T cbe75e7a89594d3f81b1b8935b43b2ed P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Initialized, Role: FOLLOWER
I20260709 12:58:40.136765  1721 tablet_bootstrap.cc:654] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:40.135861  1429 catalog_manager.cc:5697] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 0 to 1, leader changed from <none> to 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:40.137549  1723 raft_consensus.cc:359] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:40.138223  1723 raft_consensus.cc:385] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:40.138487  1723 raft_consensus.cc:740] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Initialized, Role: FOLLOWER
I20260709 12:58:40.136809  1722 consensus_queue.cc:260] T cbe75e7a89594d3f81b1b8935b43b2ed P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:40.139190  1723 consensus_queue.cc:260] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:40.141403  1723 ts_tablet_manager.cc:1434] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent starting tablet: real 0.034s	user 0.005s	sys 0.000s
I20260709 12:58:40.142769  1723 tablet_bootstrap.cc:492] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Bootstrap starting.
I20260709 12:58:40.141405  1722 ts_tablet_manager.cc:1434] T cbe75e7a89594d3f81b1b8935b43b2ed P ddf11fc190dd4b898773379c6b129d90: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:58:40.145948  1722 tablet_bootstrap.cc:492] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90: Bootstrap starting.
I20260709 12:58:40.148933  1778 raft_consensus.cc:493] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:40.149559  1778 raft_consensus.cc:515] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:40.152060  1778 leader_election.cc:290] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:40.153642  1723 tablet_bootstrap.cc:654] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:40.155896  1801 raft_consensus.cc:493] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:40.156108  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:58:40.156675  1722 tablet_bootstrap.cc:654] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:40.156443  1801 raft_consensus.cc:515] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:40.156840  1681 raft_consensus.cc:2468] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 0.
I20260709 12:58:40.158699  1571 leader_election.cc:304] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:58:40.153777  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:58:40.159978  1530 raft_consensus.cc:2468] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 0.
I20260709 12:58:40.160099  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:58:40.160523  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:58:40.160749  1604 raft_consensus.cc:2468] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 0.
I20260709 12:58:40.161092  1778 raft_consensus.cc:2804] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:40.161489  1778 raft_consensus.cc:493] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:40.161873  1778 raft_consensus.cc:3060] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:40.161095  1529 raft_consensus.cc:2468] T 1359810508724a7a8749ce09a6654a9c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 0.
I20260709 12:58:40.163544  1861 raft_consensus.cc:493] T 1359810508724a7a8749ce09a6654a9c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:40.163975  1861 raft_consensus.cc:515] T 1359810508724a7a8749ce09a6654a9c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:40.161948  1646 leader_election.cc:304] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:58:40.165547  1838 raft_consensus.cc:2804] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:40.165916  1838 raft_consensus.cc:493] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:40.166353  1838 raft_consensus.cc:3060] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:40.167771  1861 leader_election.cc:290] T 1359810508724a7a8749ce09a6654a9c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:40.169473  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:58:40.170260  1604 raft_consensus.cc:2468] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 0.
I20260709 12:58:40.174292  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:58:40.171661  1497 leader_election.cc:304] T 1359810508724a7a8749ce09a6654a9c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:58:40.177299  1861 raft_consensus.cc:2804] T 1359810508724a7a8749ce09a6654a9c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:40.177682  1861 raft_consensus.cc:493] T 1359810508724a7a8749ce09a6654a9c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:40.178045  1861 raft_consensus.cc:3060] T 1359810508724a7a8749ce09a6654a9c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:40.179747  1838 raft_consensus.cc:515] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:40.181886  1838 leader_election.cc:290] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:58:40.158538  1801 leader_election.cc:290] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:58:40.182531  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:58:40.183090  1681 raft_consensus.cc:2393] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 1: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 12:58:40.185159  1861 raft_consensus.cc:515] T 1359810508724a7a8749ce09a6654a9c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:40.186272  1529 raft_consensus.cc:2393] T 1359810508724a7a8749ce09a6654a9c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 1: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 12:58:40.188446  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:58:40.189033  1604 raft_consensus.cc:3060] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:40.190275  1721 tablet_bootstrap.cc:492] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642: No bootstrap required, opened a new log
I20260709 12:58:40.190761  1796 raft_consensus.cc:493] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:40.190948  1721 ts_tablet_manager.cc:1403] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642: Time spent bootstrapping tablet: real 0.062s	user 0.010s	sys 0.006s
I20260709 12:58:40.191980  1796 raft_consensus.cc:515] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:40.194111  1721 raft_consensus.cc:359] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:40.194948  1721 raft_consensus.cc:385] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:40.195281  1721 raft_consensus.cc:740] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Initialized, Role: FOLLOWER
I20260709 12:58:40.195451  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:58:40.196241  1607 raft_consensus.cc:2468] T 64842f503da44f59896ed29b9edd3b29 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 0.
I20260709 12:58:40.196453  1604 raft_consensus.cc:2468] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 1.
I20260709 12:58:40.196653  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:58:40.197297  1530 raft_consensus.cc:2468] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 0.
I20260709 12:58:40.197701  1722 tablet_bootstrap.cc:492] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90: No bootstrap required, opened a new log
I20260709 12:58:40.197870  1646 leader_election.cc:304] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:58:40.196125  1721 consensus_queue.cc:260] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:40.198223  1722 ts_tablet_manager.cc:1403] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90: Time spent bootstrapping tablet: real 0.052s	user 0.012s	sys 0.004s
I20260709 12:58:40.194128  1796 leader_election.cc:290] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:58:40.200449  1721 ts_tablet_manager.cc:1434] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:58:40.201363  1801 raft_consensus.cc:2804] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:40.202167  1801 raft_consensus.cc:493] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:40.202510  1801 raft_consensus.cc:3060] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:40.203967  1722 raft_consensus.cc:359] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:40.207156  1722 raft_consensus.cc:385] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:40.201474  1721 tablet_bootstrap.cc:492] T 429fe651e8bc487eb6f07e38a7c3cb41 P 39a92f5a4352465d8af3af5908fe8642: Bootstrap starting.
I20260709 12:58:40.207501  1778 raft_consensus.cc:515] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:40.205968  1861 leader_election.cc:290] T 1359810508724a7a8749ce09a6654a9c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:40.199349  1796 consensus_queue.cc:1048] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 12:58:40.211045  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:58:40.211898  1681 raft_consensus.cc:2393] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 1: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 12:58:40.213127  1722 raft_consensus.cc:740] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Initialized, Role: FOLLOWER
I20260709 12:58:40.214215  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:58:40.216275  1530 raft_consensus.cc:3060] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:40.216909  1722 consensus_queue.cc:260] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:40.217722  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:58:40.218592  1681 raft_consensus.cc:3060] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:40.221026  1721 tablet_bootstrap.cc:654] T 429fe651e8bc487eb6f07e38a7c3cb41 P 39a92f5a4352465d8af3af5908fe8642: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:40.223043  1861 raft_consensus.cc:493] T 819fbeffe41b4610a05fcaac38e161b6 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:40.222330  1778 leader_election.cc:290] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:40.227694  1722 ts_tablet_manager.cc:1434] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90: Time spent starting tablet: real 0.028s	user 0.010s	sys 0.000s
I20260709 12:58:40.228019  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:58:40.228736  1722 tablet_bootstrap.cc:492] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90: Bootstrap starting.
I20260709 12:58:40.226264  1861 raft_consensus.cc:515] T 819fbeffe41b4610a05fcaac38e161b6 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:40.229594  1646 leader_election.cc:304] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:58:40.230504  1838 raft_consensus.cc:2804] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:40.231005  1838 raft_consensus.cc:697] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:58:40.231828  1838 consensus_queue.cc:237] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:40.233001  1681 raft_consensus.cc:2468] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 1.
I20260709 12:58:40.234988  1571 leader_election.cc:304] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:58:40.230185  1604 raft_consensus.cc:2393] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 1: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 12:58:40.236102  1723 tablet_bootstrap.cc:492] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1: No bootstrap required, opened a new log
I20260709 12:58:40.236829  1723 ts_tablet_manager.cc:1403] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent bootstrapping tablet: real 0.094s	user 0.016s	sys 0.003s
I20260709 12:58:40.241359  1796 raft_consensus.cc:493] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:40.241870  1796 raft_consensus.cc:515] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:40.243402  1861 leader_election.cc:290] T 819fbeffe41b4610a05fcaac38e161b6 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:40.243939  1796 leader_election.cc:290] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:58:40.238583  1778 raft_consensus.cc:2804] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:40.246773  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:58:40.247105  1778 raft_consensus.cc:697] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:58:40.247931  1778 consensus_queue.cc:237] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:40.249861  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 12:58:40.250830  1496 leader_election.cc:343] T 819fbeffe41b4610a05fcaac38e161b6 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:40.251250  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:58:40.251971  1605 raft_consensus.cc:2468] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 0.
I20260709 12:58:40.256979  1846 raft_consensus.cc:493] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:40.257452  1497 leader_election.cc:304] T 1359810508724a7a8749ce09a6654a9c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:58:40.257577  1846 raft_consensus.cc:515] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 12:58:40.258620  1497 leader_election.cc:343] T 819fbeffe41b4610a05fcaac38e161b6 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:40.259078  1497 leader_election.cc:304] T 819fbeffe41b4610a05fcaac38e161b6 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:58:40.259999  1846 leader_election.cc:290] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:40.261509  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:58:40.257079  1646 leader_election.cc:304] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:58:40.262844  1863 raft_consensus.cc:2749] T 1359810508724a7a8749ce09a6654a9c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:58:40.263373  1861 raft_consensus.cc:2749] T 819fbeffe41b4610a05fcaac38e161b6 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:40.263525  1846 raft_consensus.cc:493] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:40.263998  1846 raft_consensus.cc:515] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:40.264796  1681 raft_consensus.cc:2468] T cbe75e7a89594d3f81b1b8935b43b2ed P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 0.
I20260709 12:58:40.264884  1530 raft_consensus.cc:2468] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 1.
I20260709 12:58:40.265995  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:58:40.266177  1571 leader_election.cc:304] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:58:40.266753  1529 raft_consensus.cc:2468] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 0.
I20260709 12:58:40.266040  1846 leader_election.cc:290] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:40.268013  1751 raft_consensus.cc:2804] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:40.269367  1751 raft_consensus.cc:493] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:40.269702  1751 raft_consensus.cc:3060] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:40.269733  1723 raft_consensus.cc:359] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:40.271090  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:58:40.271930  1681 raft_consensus.cc:2393] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 1: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 12:58:40.270521  1723 raft_consensus.cc:385] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:40.275161  1723 raft_consensus.cc:740] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Initialized, Role: FOLLOWER
I20260709 12:58:40.275722  1427 catalog_manager.cc:5697] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 reported cstate change: term changed from 0 to 1, leader changed from <none> to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:40.289140  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:58:40.291903  1530 raft_consensus.cc:2393] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 1: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 12:58:40.279286  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:58:40.292677  1529 raft_consensus.cc:2468] T e0590ffd096d4e378ab66c1795ff5cce P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 0.
I20260709 12:58:40.293640  1570 leader_election.cc:304] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:58:40.289609  1723 consensus_queue.cc:260] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:40.296345  1722 tablet_bootstrap.cc:654] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:40.278028  1838 raft_consensus.cc:2804] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:40.298880  1866 raft_consensus.cc:3060] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:40.307210  1723 ts_tablet_manager.cc:1434] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent starting tablet: real 0.070s	user 0.007s	sys 0.000s
I20260709 12:58:40.308252  1723 tablet_bootstrap.cc:492] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Bootstrap starting.
I20260709 12:58:40.301069  1838 raft_consensus.cc:493] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:40.309114  1838 raft_consensus.cc:3060] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:40.313400  1751 raft_consensus.cc:515] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:40.325284  1866 raft_consensus.cc:2749] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:40.335273  1430 catalog_manager.cc:5697] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 0 to 1, leader changed from <none> to 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:40.336181  1721 tablet_bootstrap.cc:492] T 429fe651e8bc487eb6f07e38a7c3cb41 P 39a92f5a4352465d8af3af5908fe8642: No bootstrap required, opened a new log
I20260709 12:58:40.336666  1721 ts_tablet_manager.cc:1403] T 429fe651e8bc487eb6f07e38a7c3cb41 P 39a92f5a4352465d8af3af5908fe8642: Time spent bootstrapping tablet: real 0.135s	user 0.021s	sys 0.001s
I20260709 12:58:40.337208  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:58:40.337755  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:58:40.338434  1681 raft_consensus.cc:3060] T cbe75e7a89594d3f81b1b8935b43b2ed P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:40.339246  1721 raft_consensus.cc:359] T 429fe651e8bc487eb6f07e38a7c3cb41 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:40.340651  1721 raft_consensus.cc:385] T 429fe651e8bc487eb6f07e38a7c3cb41 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:40.340912  1721 raft_consensus.cc:740] T 429fe651e8bc487eb6f07e38a7c3cb41 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Initialized, Role: FOLLOWER
I20260709 12:58:40.342862  1721 consensus_queue.cc:260] T 429fe651e8bc487eb6f07e38a7c3cb41 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:40.345139  1721 ts_tablet_manager.cc:1434] T 429fe651e8bc487eb6f07e38a7c3cb41 P 39a92f5a4352465d8af3af5908fe8642: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:58:40.346029  1721 tablet_bootstrap.cc:492] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642: Bootstrap starting.
I20260709 12:58:40.350972  1917 consensus_queue.cc:1048] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:40.336803  1751 leader_election.cc:290] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:40.337764  1529 raft_consensus.cc:3060] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:40.358196  1838 raft_consensus.cc:515] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:40.351118  1801 raft_consensus.cc:515] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:40.358837  1681 raft_consensus.cc:2468] T cbe75e7a89594d3f81b1b8935b43b2ed P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 1.
I20260709 12:58:40.369769  1721 tablet_bootstrap.cc:654] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:40.371730  1571 leader_election.cc:304] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:58:40.372381  1722 tablet_bootstrap.cc:492] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90: No bootstrap required, opened a new log
I20260709 12:58:40.372910  1722 ts_tablet_manager.cc:1403] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90: Time spent bootstrapping tablet: real 0.144s	user 0.012s	sys 0.016s
I20260709 12:58:40.372812  1846 raft_consensus.cc:2804] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:40.373468  1846 raft_consensus.cc:697] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:58:40.374267  1846 consensus_queue.cc:237] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:40.374816  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:58:40.375394  1532 raft_consensus.cc:3060] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:40.375695  1722 raft_consensus.cc:359] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:40.376377  1722 raft_consensus.cc:385] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:40.376646  1722 raft_consensus.cc:740] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Initialized, Role: FOLLOWER
I20260709 12:58:40.380184  1722 consensus_queue.cc:260] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:40.383430  1529 raft_consensus.cc:2468] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 1.
I20260709 12:58:40.383800  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:58:40.384413  1607 raft_consensus.cc:3060] T 64842f503da44f59896ed29b9edd3b29 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:40.385869  1838 leader_election.cc:290] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:58:40.386492  1722 ts_tablet_manager.cc:1434] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.001s
I20260709 12:58:40.386986  1532 raft_consensus.cc:2468] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 1.
I20260709 12:58:40.387913  1722 tablet_bootstrap.cc:492] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90: Bootstrap starting.
I20260709 12:58:40.389729  1644 leader_election.cc:304] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:58:40.390096  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:58:40.390758  1532 raft_consensus.cc:3060] T e0590ffd096d4e378ab66c1795ff5cce P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:40.395777  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:58:40.396474  1605 raft_consensus.cc:3060] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:40.398746  1532 raft_consensus.cc:2468] T e0590ffd096d4e378ab66c1795ff5cce P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 1.
I20260709 12:58:40.405504  1605 raft_consensus.cc:2468] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 1.
I20260709 12:58:40.407634  1838 raft_consensus.cc:2804] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:40.408164  1838 raft_consensus.cc:697] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:58:40.408253  1644 leader_election.cc:304] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:58:40.409395  1916 raft_consensus.cc:2804] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:40.408998  1838 consensus_queue.cc:237] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:40.409978  1916 raft_consensus.cc:697] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:58:40.410970  1916 consensus_queue.cc:237] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:40.379693  1801 leader_election.cc:290] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:58:40.433868  1863 raft_consensus.cc:493] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:40.443112  1607 raft_consensus.cc:2468] T 64842f503da44f59896ed29b9edd3b29 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 1.
I20260709 12:58:40.460292  1723 tablet_bootstrap.cc:654] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:40.435397  1863 raft_consensus.cc:515] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:40.472913  1429 catalog_manager.cc:5697] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 reported cstate change: term changed from 0 to 1, leader changed from <none> to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:40.473929  1429 catalog_manager.cc:5697] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 reported cstate change: term changed from 0 to 1, leader changed from <none> to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:40.479622  1863 leader_election.cc:290] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:40.471464  1427 catalog_manager.cc:5697] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 0 to 1, leader changed from <none> to 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:40.485532  1722 tablet_bootstrap.cc:654] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:40.486199  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 12:58:40.487836  1496 leader_election.cc:343] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:40.488368  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:58:40.491513  1721 tablet_bootstrap.cc:492] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642: No bootstrap required, opened a new log
I20260709 12:58:40.491987  1721 ts_tablet_manager.cc:1403] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642: Time spent bootstrapping tablet: real 0.146s	user 0.014s	sys 0.027s
I20260709 12:58:40.492409  1846 consensus_queue.cc:1048] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:40.495225  1721 raft_consensus.cc:359] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:40.495929  1721 raft_consensus.cc:385] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:40.496213  1721 raft_consensus.cc:740] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Initialized, Role: FOLLOWER
I20260709 12:58:40.496869  1721 consensus_queue.cc:260] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:40.500027  1721 ts_tablet_manager.cc:1434] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 12:58:40.501091  1721 tablet_bootstrap.cc:492] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642: Bootstrap starting.
W20260709 12:58:40.502737  1497 leader_election.cc:343] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:40.503574  1497 leader_election.cc:304] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:58:40.505856  1863 raft_consensus.cc:2749] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:40.510706  1721 tablet_bootstrap.cc:654] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:40.525265  1723 tablet_bootstrap.cc:492] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1: No bootstrap required, opened a new log
I20260709 12:58:40.526098  1723 ts_tablet_manager.cc:1403] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent bootstrapping tablet: real 0.218s	user 0.014s	sys 0.003s
I20260709 12:58:40.547964  1866 consensus_queue.cc:1048] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:40.550163  1722 tablet_bootstrap.cc:492] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90: No bootstrap required, opened a new log
I20260709 12:58:40.550680  1722 ts_tablet_manager.cc:1403] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90: Time spent bootstrapping tablet: real 0.163s	user 0.024s	sys 0.001s
I20260709 12:58:40.552137  1723 raft_consensus.cc:359] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:40.560846  1723 raft_consensus.cc:385] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:40.561161  1723 raft_consensus.cc:740] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Initialized, Role: FOLLOWER
I20260709 12:58:40.561918  1723 consensus_queue.cc:260] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:40.563995  1723 ts_tablet_manager.cc:1434] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent starting tablet: real 0.038s	user 0.000s	sys 0.005s
I20260709 12:58:40.564815  1723 tablet_bootstrap.cc:492] T e4b8c02fb560459fbbb59424361a5457 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Bootstrap starting.
I20260709 12:58:40.566491  1846 consensus_queue.cc:1048] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:40.567355  1721 tablet_bootstrap.cc:492] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642: No bootstrap required, opened a new log
I20260709 12:58:40.567906  1721 ts_tablet_manager.cc:1403] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642: Time spent bootstrapping tablet: real 0.067s	user 0.028s	sys 0.022s
I20260709 12:58:40.579020  1929 raft_consensus.cc:493] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:40.579550  1929 raft_consensus.cc:515] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:40.580931  1721 raft_consensus.cc:359] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:40.581597  1721 raft_consensus.cc:385] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:40.581766  1929 leader_election.cc:290] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:40.581871  1721 raft_consensus.cc:740] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Initialized, Role: FOLLOWER
I20260709 12:58:40.584800  1721 consensus_queue.cc:260] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:40.588281  1721 ts_tablet_manager.cc:1434] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.001s
I20260709 12:58:40.588393  1723 tablet_bootstrap.cc:654] T e4b8c02fb560459fbbb59424361a5457 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:40.594090  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:58:40.735634  1607 raft_consensus.cc:2468] T 429fe651e8bc487eb6f07e38a7c3cb41 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 0.
I20260709 12:58:40.588362  1722 raft_consensus.cc:359] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 12:58:40.616866  1478 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:58:40.704011  1727 raft_consensus.cc:493] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:40.743074  1721 tablet_bootstrap.cc:492] T a7cff69bd4394da195321efd78d5a703 P 39a92f5a4352465d8af3af5908fe8642: Bootstrap starting.
I20260709 12:58:40.743465  1722 raft_consensus.cc:385] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:40.745079  1722 raft_consensus.cc:740] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Initialized, Role: FOLLOWER
I20260709 12:58:40.610743  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:58:40.750286  1801 raft_consensus.cc:493] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:40.746520  1722 consensus_queue.cc:260] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:40.614773  1846 consensus_queue.cc:1048] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.137s
I20260709 12:58:40.746325  1727 raft_consensus.cc:515] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:40.757753  1722 ts_tablet_manager.cc:1434] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90: Time spent starting tablet: real 0.207s	user 0.008s	sys 0.000s
I20260709 12:58:40.759006  1722 tablet_bootstrap.cc:492] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90: Bootstrap starting.
I20260709 12:58:40.750842  1801 raft_consensus.cc:515] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:40.763581  1801 leader_election.cc:290] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:58:40.763733  1727 leader_election.cc:290] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:40.754122  1678 raft_consensus.cc:2468] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 0.
I20260709 12:58:40.765460  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:58:40.766211  1607 raft_consensus.cc:2468] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 0.
I20260709 12:58:40.750854  1497 leader_election.cc:304] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:58:40.768662  1646 leader_election.cc:304] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:58:40.769176  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:58:40.769678  1917 raft_consensus.cc:2804] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:40.769883  1532 raft_consensus.cc:2468] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 0.
I20260709 12:58:40.770079  1917 raft_consensus.cc:493] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:40.770555  1727 consensus_queue.cc:1048] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:40.769129  1929 raft_consensus.cc:2804] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:40.771904  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:58:40.772418  1929 raft_consensus.cc:493] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:40.770493  1917 raft_consensus.cc:3060] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:40.772636  1529 raft_consensus.cc:2468] T 819fbeffe41b4610a05fcaac38e161b6 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 0.
I20260709 12:58:40.775085  1801 consensus_queue.cc:1048] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:40.781577  1751 consensus_queue.cc:1048] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:40.777659  1929 raft_consensus.cc:3060] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:40.783993  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:58:40.784365  1721 tablet_bootstrap.cc:654] T a7cff69bd4394da195321efd78d5a703 P 39a92f5a4352465d8af3af5908fe8642: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:40.785878  1570 leader_election.cc:304] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:58:40.788317  1778 raft_consensus.cc:2804] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:40.788708  1778 raft_consensus.cc:493] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:40.789072  1778 raft_consensus.cc:3060] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:40.790853  1846 consensus_queue.cc:1048] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:58:40.792179  1571 leader_election.cc:343] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:40.793576  1801 consensus_queue.cc:1048] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:40.770172  1866 consensus_queue.cc:1048] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.029s
I20260709 12:58:40.796468  1929 raft_consensus.cc:515] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:40.796873  1723 tablet_bootstrap.cc:492] T e4b8c02fb560459fbbb59424361a5457 P e46412b3b0b44f01ad5c33d4cfe3d6b1: No bootstrap required, opened a new log
I20260709 12:58:40.799670  1723 ts_tablet_manager.cc:1403] T e4b8c02fb560459fbbb59424361a5457 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent bootstrapping tablet: real 0.235s	user 0.052s	sys 0.059s
I20260709 12:58:40.802541  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:58:40.803251  1605 raft_consensus.cc:3060] T 429fe651e8bc487eb6f07e38a7c3cb41 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:40.805189  1929 leader_election.cc:290] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:40.806903  1778 raft_consensus.cc:515] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:40.809028  1778 leader_election.cc:290] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:40.811843  1723 raft_consensus.cc:359] T e4b8c02fb560459fbbb59424361a5457 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:40.857323  1723 raft_consensus.cc:385] T e4b8c02fb560459fbbb59424361a5457 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:40.857581  1723 raft_consensus.cc:740] T e4b8c02fb560459fbbb59424361a5457 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Initialized, Role: FOLLOWER
I20260709 12:58:40.869541  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:58:40.870353  1530 raft_consensus.cc:3060] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:40.822086  1605 raft_consensus.cc:2468] T 429fe651e8bc487eb6f07e38a7c3cb41 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 1.
I20260709 12:58:40.872413  1723 consensus_queue.cc:260] T e4b8c02fb560459fbbb59424361a5457 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:40.821592  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:58:40.824893  1917 raft_consensus.cc:515] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:40.875200  1680 raft_consensus.cc:3060] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:40.877936  1929 raft_consensus.cc:493] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:40.878472  1929 raft_consensus.cc:515] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:40.850222  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:58:40.885386  1723 ts_tablet_manager.cc:1434] T e4b8c02fb560459fbbb59424361a5457 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent starting tablet: real 0.085s	user 0.002s	sys 0.005s
I20260709 12:58:40.902112  1723 tablet_bootstrap.cc:492] T 4549f0dba6504cfda954259e71ec4c91 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Bootstrap starting.
I20260709 12:58:40.908952  1721 tablet_bootstrap.cc:492] T a7cff69bd4394da195321efd78d5a703 P 39a92f5a4352465d8af3af5908fe8642: No bootstrap required, opened a new log
I20260709 12:58:40.909497  1721 ts_tablet_manager.cc:1403] T a7cff69bd4394da195321efd78d5a703 P 39a92f5a4352465d8af3af5908fe8642: Time spent bootstrapping tablet: real 0.177s	user 0.018s	sys 0.021s
W20260709 12:58:40.913515  1571 leader_election.cc:343] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:40.914678  1721 raft_consensus.cc:359] T a7cff69bd4394da195321efd78d5a703 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:40.918097  1721 raft_consensus.cc:385] T a7cff69bd4394da195321efd78d5a703 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:40.918408  1721 raft_consensus.cc:740] T a7cff69bd4394da195321efd78d5a703 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Initialized, Role: FOLLOWER
I20260709 12:58:40.919087  1721 consensus_queue.cc:260] T a7cff69bd4394da195321efd78d5a703 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:40.921058  1721 ts_tablet_manager.cc:1434] T a7cff69bd4394da195321efd78d5a703 P 39a92f5a4352465d8af3af5908fe8642: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:58:40.921942  1721 tablet_bootstrap.cc:492] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642: Bootstrap starting.
I20260709 12:58:40.915052  1801 consensus_queue.cc:1048] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:58:40.929947  1929 leader_election.cc:290] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:40.930146  1917 leader_election.cc:290] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:58:40.933000  1722 tablet_bootstrap.cc:654] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:40.933298  1723 tablet_bootstrap.cc:654] T 4549f0dba6504cfda954259e71ec4c91 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:40.939908  1680 raft_consensus.cc:2468] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 1.
I20260709 12:58:40.941850  1497 leader_election.cc:304] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:58:40.947948  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:58:40.948679  1607 raft_consensus.cc:2468] T a7cff69bd4394da195321efd78d5a703 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 0.
I20260709 12:58:40.948770  1751 consensus_queue.cc:1048] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:40.949276  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:58:40.949889  1605 raft_consensus.cc:3060] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:40.946727  1929 raft_consensus.cc:2804] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:40.950438  1838 consensus_queue.cc:1048] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:40.950645  1929 raft_consensus.cc:697] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 12:58:40.954993  1929 consensus_queue.cc:237] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:40.966082  1605 raft_consensus.cc:2468] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 1.
I20260709 12:58:40.968370  1497 leader_election.cc:304] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:58:40.989524  1530 raft_consensus.cc:2468] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 1.
I20260709 12:58:40.987128  1863 raft_consensus.cc:2804] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:41.018872  1861 raft_consensus.cc:493] T e4b8c02fb560459fbbb59424361a5457 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:41.019485  1861 raft_consensus.cc:515] T e4b8c02fb560459fbbb59424361a5457 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:40.993022  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:58:40.997442  1863 raft_consensus.cc:493] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:41.024878  1863 raft_consensus.cc:3060] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:58:41.036032  1938 log.cc:927] Time spent T 1359810508724a7a8749ce09a6654a9c P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 12:58:41.115873  1861 leader_election.cc:290] T e4b8c02fb560459fbbb59424361a5457 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:41.139323  1721 tablet_bootstrap.cc:654] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:41.099962  1646 leader_election.cc:304] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:58:41.144156  1722 tablet_bootstrap.cc:492] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90: No bootstrap required, opened a new log
I20260709 12:58:41.144797  1722 ts_tablet_manager.cc:1403] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90: Time spent bootstrapping tablet: real 0.386s	user 0.039s	sys 0.025s
I20260709 12:58:41.163609  1944 raft_consensus.cc:2804] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:58:41.164119  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 67497.5us
I20260709 12:58:41.172580  1723 tablet_bootstrap.cc:492] T 4549f0dba6504cfda954259e71ec4c91 P e46412b3b0b44f01ad5c33d4cfe3d6b1: No bootstrap required, opened a new log
I20260709 12:58:41.176347  1944 raft_consensus.cc:697] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:58:41.176538  1723 ts_tablet_manager.cc:1403] T 4549f0dba6504cfda954259e71ec4c91 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent bootstrapping tablet: real 0.275s	user 0.032s	sys 0.034s
I20260709 12:58:41.174098  1863 raft_consensus.cc:515] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:41.182415  1944 consensus_queue.cc:237] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:41.167980  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:58:41.184495  1723 raft_consensus.cc:359] T 4549f0dba6504cfda954259e71ec4c91 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:41.186029  1723 raft_consensus.cc:385] T 4549f0dba6504cfda954259e71ec4c91 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:41.186332  1723 raft_consensus.cc:740] T 4549f0dba6504cfda954259e71ec4c91 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Initialized, Role: FOLLOWER
I20260709 12:58:41.186995  1723 consensus_queue.cc:260] T 4549f0dba6504cfda954259e71ec4c91 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:41.190681  1723 ts_tablet_manager.cc:1434] T 4549f0dba6504cfda954259e71ec4c91 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:58:41.191385  1863 leader_election.cc:290] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:41.191586  1723 tablet_bootstrap.cc:492] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1: Bootstrap starting.
W20260709 12:58:41.189627  1496 leader_election.cc:343] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:58:41.202627  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 233320us
I20260709 12:58:41.207537  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:58:41.208137  1527 raft_consensus.cc:3060] T 819fbeffe41b4610a05fcaac38e161b6 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:58:41.210817  1496 leader_election.cc:343] T e4b8c02fb560459fbbb59424361a5457 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:41.210588  1722 raft_consensus.cc:359] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:41.211478  1722 raft_consensus.cc:385] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:41.211797  1722 raft_consensus.cc:740] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Initialized, Role: FOLLOWER
I20260709 12:58:41.212466  1722 consensus_queue.cc:260] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:41.214886  1722 ts_tablet_manager.cc:1434] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90: Time spent starting tablet: real 0.070s	user 0.006s	sys 0.000s
I20260709 12:58:41.215960  1722 tablet_bootstrap.cc:492] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90: Bootstrap starting.
I20260709 12:58:41.217336  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:58:41.218048  1600 raft_consensus.cc:3060] T a7cff69bd4394da195321efd78d5a703 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:41.218137  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:58:41.211115  1427 catalog_manager.cc:5697] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:41.218001  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:58:41.234526  1846 consensus_queue.cc:1048] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:41.218721  1570 leader_election.cc:304] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 12:58:41.246482  1955 raft_consensus.cc:2804] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:41.247105  1955 raft_consensus.cc:697] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:58:41.249828  1430 catalog_manager.cc:5697] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 reported cstate change: term changed from 0 to 1, leader changed from <none> to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } }
W20260709 12:58:41.250777  1496 leader_election.cc:343] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:41.256723  1721 tablet_bootstrap.cc:492] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642: No bootstrap required, opened a new log
I20260709 12:58:41.257182  1721 ts_tablet_manager.cc:1403] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642: Time spent bootstrapping tablet: real 0.335s	user 0.022s	sys 0.015s
I20260709 12:58:41.247984  1955 consensus_queue.cc:237] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:41.261178  1721 raft_consensus.cc:359] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:41.261711  1721 raft_consensus.cc:385] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:41.261914  1721 raft_consensus.cc:740] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Initialized, Role: FOLLOWER
I20260709 12:58:41.263139  1721 consensus_queue.cc:260] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:41.265321  1721 ts_tablet_manager.cc:1434] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:58:41.266217  1721 tablet_bootstrap.cc:492] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642: Bootstrap starting.
I20260709 12:58:41.266495  1722 tablet_bootstrap.cc:654] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:41.281457  1723 tablet_bootstrap.cc:654] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:41.276536  1527 raft_consensus.cc:2468] T 819fbeffe41b4610a05fcaac38e161b6 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 1.
I20260709 12:58:41.281563  1600 raft_consensus.cc:2468] T a7cff69bd4394da195321efd78d5a703 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 1.
I20260709 12:58:41.328264  1838 consensus_queue.cc:1048] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:41.329596  1838 consensus_queue.cc:1048] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:41.329846  1721 tablet_bootstrap.cc:654] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:41.335577  1722 tablet_bootstrap.cc:492] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90: No bootstrap required, opened a new log
I20260709 12:58:41.336148  1722 ts_tablet_manager.cc:1403] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90: Time spent bootstrapping tablet: real 0.120s	user 0.011s	sys 0.001s
I20260709 12:58:41.339422  1954 raft_consensus.cc:493] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:41.339962  1954 raft_consensus.cc:515] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:41.343089  1954 leader_election.cc:290] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 12:58:41.344877  1497 leader_election.cc:343] T e4b8c02fb560459fbbb59424361a5457 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:41.345294  1497 leader_election.cc:304] T e4b8c02fb560459fbbb59424361a5457 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:58:41.345583  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:58:41.346205  1677 raft_consensus.cc:2468] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 1.
I20260709 12:58:41.346872  1929 raft_consensus.cc:2749] T e4b8c02fb560459fbbb59424361a5457 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:41.347486  1496 leader_election.cc:304] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:58:41.348114  1943 raft_consensus.cc:493] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:41.348595  1954 raft_consensus.cc:2804] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:41.348592  1943 raft_consensus.cc:515] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:41.349103  1954 raft_consensus.cc:493] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:41.351277  1954 raft_consensus.cc:3060] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:41.352352  1497 leader_election.cc:304] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 12:58:41.354820  1951 raft_consensus.cc:2804] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:41.355283  1951 raft_consensus.cc:697] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 12:58:41.355098  1943 leader_election.cc:290] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:58:41.359197  1951 consensus_queue.cc:237] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:41.360423  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:58:41.363706  1722 raft_consensus.cc:359] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:41.362994  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:58:41.359447  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:58:41.367381  1722 raft_consensus.cc:385] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:41.370237  1722 raft_consensus.cc:740] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Initialized, Role: FOLLOWER
I20260709 12:58:41.372736  1722 consensus_queue.cc:260] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:41.375349  1722 ts_tablet_manager.cc:1434] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.000s
I20260709 12:58:41.376098  1722 tablet_bootstrap.cc:492] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90: Bootstrap starting.
I20260709 12:58:41.372658  1607 raft_consensus.cc:2468] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 1.
I20260709 12:58:41.380788  1646 leader_election.cc:304] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:58:41.381642  1723 tablet_bootstrap.cc:492] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1: No bootstrap required, opened a new log
I20260709 12:58:41.382077  1723 ts_tablet_manager.cc:1403] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent bootstrapping tablet: real 0.191s	user 0.017s	sys 0.012s
I20260709 12:58:41.371737  1526 raft_consensus.cc:2468] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 1.
I20260709 12:58:41.383003  1943 raft_consensus.cc:2804] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:41.383460  1943 raft_consensus.cc:493] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:41.383790  1943 raft_consensus.cc:3060] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:41.371928  1606 raft_consensus.cc:2468] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 1.
I20260709 12:58:41.390995  1723 raft_consensus.cc:359] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:41.391584  1723 raft_consensus.cc:385] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:41.391788  1723 raft_consensus.cc:740] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Initialized, Role: FOLLOWER
I20260709 12:58:41.392441  1723 consensus_queue.cc:260] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:41.394447  1723 ts_tablet_manager.cc:1434] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.000s
I20260709 12:58:41.399773  1723 tablet_bootstrap.cc:492] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1: Bootstrap starting.
I20260709 12:58:41.404981  1943 raft_consensus.cc:515] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:41.405952  1954 raft_consensus.cc:515] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:41.411630  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:58:41.412051  1954 leader_election.cc:290] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 2 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:41.412233  1606 raft_consensus.cc:3060] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:41.413093  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:58:41.413971  1677 raft_consensus.cc:3060] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:41.416705  1721 tablet_bootstrap.cc:492] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642: No bootstrap required, opened a new log
I20260709 12:58:41.419972  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:58:41.420593  1527 raft_consensus.cc:3060] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:41.420936  1721 ts_tablet_manager.cc:1403] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642: Time spent bootstrapping tablet: real 0.155s	user 0.017s	sys 0.007s
I20260709 12:58:41.421262  1606 raft_consensus.cc:2468] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 2.
I20260709 12:58:41.422811  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:58:41.425189  1607 raft_consensus.cc:3060] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:41.425778  1497 leader_election.cc:304] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:58:41.423254  1943 leader_election.cc:290] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 2 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:58:41.426700  1954 raft_consensus.cc:2804] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:41.420964  1722 tablet_bootstrap.cc:654] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:41.424362  1721 raft_consensus.cc:359] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:41.427465  1721 raft_consensus.cc:385] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:41.427742  1721 raft_consensus.cc:740] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Initialized, Role: FOLLOWER
I20260709 12:58:41.428288  1721 consensus_queue.cc:260] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:41.429338  1954 raft_consensus.cc:697] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 12:58:41.436932  1954 consensus_queue.cc:237] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:41.438997  1721 ts_tablet_manager.cc:1434] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.008s
I20260709 12:58:41.439955  1721 tablet_bootstrap.cc:492] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642: Bootstrap starting.
I20260709 12:58:41.442912  1677 raft_consensus.cc:2468] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 2.
I20260709 12:58:41.443135  1958 raft_consensus.cc:493] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:41.443645  1958 raft_consensus.cc:515] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:41.447889  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:58:41.449687  1607 raft_consensus.cc:2468] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 2.
I20260709 12:58:41.453008  1646 leader_election.cc:304] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
W20260709 12:58:41.449741  1570 leader_election.cc:343] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:41.455669  1958 leader_election.cc:290] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:41.458819  1943 raft_consensus.cc:2804] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:41.463596  1943 raft_consensus.cc:697] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 2 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:58:41.465111  1723 tablet_bootstrap.cc:654] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:41.464934  1943 consensus_queue.cc:237] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:41.474742  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 12:58:41.481750  1571 leader_election.cc:343] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:41.482304  1571 leader_election.cc:304] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:58:41.484779  1958 raft_consensus.cc:2749] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:41.490361  1430 catalog_manager.cc:5697] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 0 to 1, leader changed from <none> to 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:41.502345  1721 tablet_bootstrap.cc:654] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:41.494491  1527 raft_consensus.cc:2468] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 2.
I20260709 12:58:41.513458  1723 tablet_bootstrap.cc:492] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1: No bootstrap required, opened a new log
I20260709 12:58:41.513959  1723 ts_tablet_manager.cc:1403] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent bootstrapping tablet: real 0.119s	user 0.007s	sys 0.009s
I20260709 12:58:41.517004  1723 raft_consensus.cc:359] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:41.517664  1723 raft_consensus.cc:385] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:41.517915  1723 raft_consensus.cc:740] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Initialized, Role: FOLLOWER
I20260709 12:58:41.518514  1723 consensus_queue.cc:260] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:41.519487  1722 tablet_bootstrap.cc:492] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90: No bootstrap required, opened a new log
I20260709 12:58:41.520064  1722 ts_tablet_manager.cc:1403] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90: Time spent bootstrapping tablet: real 0.144s	user 0.013s	sys 0.006s
I20260709 12:58:41.520431  1723 ts_tablet_manager.cc:1434] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:58:41.521574  1723 tablet_bootstrap.cc:492] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Bootstrap starting.
I20260709 12:58:41.523118  1722 raft_consensus.cc:359] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:41.523972  1722 raft_consensus.cc:385] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:41.524302  1722 raft_consensus.cc:740] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Initialized, Role: FOLLOWER
I20260709 12:58:41.525005  1722 consensus_queue.cc:260] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:41.525722  1427 catalog_manager.cc:5697] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:41.528069  1722 ts_tablet_manager.cc:1434] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.004s
I20260709 12:58:41.527761  1427 catalog_manager.cc:5697] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 0 to 2, leader changed from <none> to e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:41.529160  1723 tablet_bootstrap.cc:654] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:41.534222  1722 tablet_bootstrap.cc:492] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90: Bootstrap starting.
I20260709 12:58:41.541507  1722 tablet_bootstrap.cc:654] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:41.546139  1430 catalog_manager.cc:5697] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 reported cstate change: term changed from 0 to 2, leader changed from <none> to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:41.555284  1721 tablet_bootstrap.cc:492] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642: No bootstrap required, opened a new log
I20260709 12:58:41.555740  1723 tablet_bootstrap.cc:492] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1: No bootstrap required, opened a new log
I20260709 12:58:41.555804  1721 ts_tablet_manager.cc:1403] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642: Time spent bootstrapping tablet: real 0.116s	user 0.029s	sys 0.016s
I20260709 12:58:41.556348  1723 ts_tablet_manager.cc:1403] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent bootstrapping tablet: real 0.035s	user 0.012s	sys 0.000s
I20260709 12:58:41.558624  1721 raft_consensus.cc:359] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:41.559340  1721 raft_consensus.cc:385] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:41.559608  1721 raft_consensus.cc:740] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Initialized, Role: FOLLOWER
I20260709 12:58:41.560231  1721 consensus_queue.cc:260] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:41.562270  1721 ts_tablet_manager.cc:1434] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 12:58:41.563323  1721 tablet_bootstrap.cc:492] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642: Bootstrap starting.
I20260709 12:58:41.569785  1722 tablet_bootstrap.cc:492] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90: No bootstrap required, opened a new log
I20260709 12:58:41.570286  1722 ts_tablet_manager.cc:1403] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90: Time spent bootstrapping tablet: real 0.036s	user 0.010s	sys 0.004s
I20260709 12:58:41.571820  1721 tablet_bootstrap.cc:654] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:41.572901  1722 raft_consensus.cc:359] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:41.573592  1722 raft_consensus.cc:385] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:41.573845  1722 raft_consensus.cc:740] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Initialized, Role: FOLLOWER
I20260709 12:58:41.574537  1722 consensus_queue.cc:260] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:41.575156  1929 raft_consensus.cc:493] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:41.575620  1929 raft_consensus.cc:515] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:41.576869  1722 ts_tablet_manager.cc:1434] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:58:41.577771  1722 tablet_bootstrap.cc:492] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90: Bootstrap starting.
I20260709 12:58:41.579866  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:58:41.578615  1929 leader_election.cc:290] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 12:58:41.590905  1497 leader_election.cc:343] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:41.593062  1722 tablet_bootstrap.cc:654] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:41.583894  1723 raft_consensus.cc:359] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:41.585875  1951 consensus_queue.cc:1048] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 12:58:41.597183  1723 raft_consensus.cc:385] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:41.598016  1723 raft_consensus.cc:740] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Initialized, Role: FOLLOWER
I20260709 12:58:41.580160  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:58:41.598639  1723 consensus_queue.cc:260] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 12:58:41.600730  1496 leader_election.cc:343] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:41.601178  1496 leader_election.cc:304] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:58:41.602016  1929 raft_consensus.cc:2749] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:41.605968  1723 ts_tablet_manager.cc:1434] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent starting tablet: real 0.049s	user 0.006s	sys 0.000s
I20260709 12:58:41.607159  1723 tablet_bootstrap.cc:492] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Bootstrap starting.
I20260709 12:58:41.613516  1953 consensus_queue.cc:1048] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:41.614051  1723 tablet_bootstrap.cc:654] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:41.620287  1944 raft_consensus.cc:493] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:41.620814  1944 raft_consensus.cc:515] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:41.628366  1723 tablet_bootstrap.cc:492] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1: No bootstrap required, opened a new log
I20260709 12:58:41.628929  1723 ts_tablet_manager.cc:1403] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.005s
I20260709 12:58:41.629161  1944 leader_election.cc:290] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:58:41.630898  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:58:41.631767  1723 raft_consensus.cc:359] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:41.632797  1723 raft_consensus.cc:385] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:41.633100  1723 raft_consensus.cc:740] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Initialized, Role: FOLLOWER
I20260709 12:58:41.634011  1723 consensus_queue.cc:260] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:41.636564  1723 ts_tablet_manager.cc:1434] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent starting tablet: real 0.007s	user 0.009s	sys 0.000s
I20260709 12:58:41.638027  1723 tablet_bootstrap.cc:492] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Bootstrap starting.
W20260709 12:58:41.633100  1646 leader_election.cc:343] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:41.655670  1958 raft_consensus.cc:493] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:41.656184  1958 raft_consensus.cc:515] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:41.658437  1838 raft_consensus.cc:493] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:41.659005  1838 raft_consensus.cc:515] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:41.660192  1723 tablet_bootstrap.cc:654] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:41.661136  1838 leader_election.cc:290] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:58:41.664292  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:58:41.667676  1866 raft_consensus.cc:493] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:41.670161  1958 leader_election.cc:290] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:41.677830  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:58:41.671994  1866 raft_consensus.cc:515] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:41.680061  1677 raft_consensus.cc:3060] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:41.680605  1866 leader_election.cc:290] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 12:58:41.685509  1571 leader_election.cc:343] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:41.691195  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:58:41.692080  1606 raft_consensus.cc:2393] T a7cff69bd4394da195321efd78d5a703 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 1: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 12:58:41.693338  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:58:41.693733  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:58:41.694047  1529 raft_consensus.cc:2468] T 4549f0dba6504cfda954259e71ec4c91 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 0.
W20260709 12:58:41.695310  1570 leader_election.cc:343] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:41.695747  1570 leader_election.cc:304] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:58:41.697371  1570 leader_election.cc:304] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:58:41.699388  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:58:41.700037  1527 raft_consensus.cc:2468] T e4b8c02fb560459fbbb59424361a5457 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 0.
I20260709 12:58:41.703732  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:58:41.704900  1958 raft_consensus.cc:2804] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:41.705300  1958 raft_consensus.cc:493] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:41.705636  1958 raft_consensus.cc:3060] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:41.706053  1946 consensus_queue.cc:1048] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:41.695444  1951 raft_consensus.cc:493] T 4549f0dba6504cfda954259e71ec4c91 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:41.718192  1951 raft_consensus.cc:515] T 4549f0dba6504cfda954259e71ec4c91 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:41.698262  1866 raft_consensus.cc:2749] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:58:41.719549  1571 leader_election.cc:343] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:41.720686  1644 leader_election.cc:304] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 12:58:41.724805  1951 leader_election.cc:290] T 4549f0dba6504cfda954259e71ec4c91 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:41.725843  1943 raft_consensus.cc:2804] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:41.739560  1946 consensus_queue.cc:1048] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:41.739853  1943 raft_consensus.cc:493] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:41.740321  1943 raft_consensus.cc:3060] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:41.723609  1646 leader_election.cc:304] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:58:41.734256  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:58:41.744208  1946 raft_consensus.cc:3060] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:41.735062  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:58:41.754491  1723 tablet_bootstrap.cc:492] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1: No bootstrap required, opened a new log
I20260709 12:58:41.746003  1944 raft_consensus.cc:493] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:41.759531  1723 ts_tablet_manager.cc:1403] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent bootstrapping tablet: real 0.122s	user 0.027s	sys 0.023s
I20260709 12:58:41.740453  1866 consensus_queue.cc:1048] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 12:58:41.748921  1958 raft_consensus.cc:515] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:41.761382  1944 raft_consensus.cc:515] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:41.784396  1958 leader_election.cc:290] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:41.785966  1606 raft_consensus.cc:2393] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 1: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 12:58:41.789090  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
W20260709 12:58:41.755012  1496 leader_election.cc:343] T 4549f0dba6504cfda954259e71ec4c91 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:58:41.793246  1571 leader_election.cc:343] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:41.804744  1723 raft_consensus.cc:359] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:41.805841  1497 leader_election.cc:304] T 4549f0dba6504cfda954259e71ec4c91 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:58:41.815881  1954 raft_consensus.cc:493] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:41.816408  1954 raft_consensus.cc:515] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:41.816761  1944 leader_election.cc:290] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:58:41.816948  1953 raft_consensus.cc:3060] T 4549f0dba6504cfda954259e71ec4c91 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:41.819263  1954 leader_election.cc:290] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:41.821920  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:58:41.822602  1527 raft_consensus.cc:2468] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 1.
I20260709 12:58:41.822862  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:58:41.823791  1723 raft_consensus.cc:385] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:41.824194  1723 raft_consensus.cc:740] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Initialized, Role: FOLLOWER
I20260709 12:58:41.824613  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:58:41.811998  1721 tablet_bootstrap.cc:492] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642: No bootstrap required, opened a new log
I20260709 12:58:41.824981  1723 consensus_queue.cc:260] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:41.827490  1723 ts_tablet_manager.cc:1434] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent starting tablet: real 0.068s	user 0.006s	sys 0.000s
W20260709 12:58:41.828717  1496 leader_election.cc:343] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:41.829496  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:58:41.833009  1946 raft_consensus.cc:2749] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:41.834450  1943 raft_consensus.cc:515] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:41.825469  1721 ts_tablet_manager.cc:1403] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642: Time spent bootstrapping tablet: real 0.262s	user 0.064s	sys 0.074s
I20260709 12:58:41.839584  1723 tablet_bootstrap.cc:492] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Bootstrap starting.
I20260709 12:58:41.838575  1721 raft_consensus.cc:359] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:41.843901  1721 raft_consensus.cc:385] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:41.844475  1721 raft_consensus.cc:740] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Initialized, Role: FOLLOWER
I20260709 12:58:41.845157  1943 leader_election.cc:290] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:58:41.845412  1721 consensus_queue.cc:260] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:41.843600  1644 leader_election.cc:304] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
W20260709 12:58:41.847043  1497 leader_election.cc:343] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:41.847471  1497 leader_election.cc:304] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:58:41.849646  1951 raft_consensus.cc:2749] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:41.851053  1721 ts_tablet_manager.cc:1434] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:58:41.852062  1721 tablet_bootstrap.cc:492] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642: Bootstrap starting.
I20260709 12:58:41.851079  1953 raft_consensus.cc:2749] T 4549f0dba6504cfda954259e71ec4c91 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:41.852522  1722 tablet_bootstrap.cc:492] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90: No bootstrap required, opened a new log
I20260709 12:58:41.856112  1722 ts_tablet_manager.cc:1403] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90: Time spent bootstrapping tablet: real 0.279s	user 0.015s	sys 0.003s
I20260709 12:58:41.860905  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:58:41.861583  1528 raft_consensus.cc:3060] T e4b8c02fb560459fbbb59424361a5457 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:41.865782  1529 raft_consensus.cc:2468] T 4549f0dba6504cfda954259e71ec4c91 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 1.
I20260709 12:58:41.867970  1570 leader_election.cc:304] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 12:58:41.868999  1958 raft_consensus.cc:2804] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:41.869450  1958 raft_consensus.cc:697] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:58:41.870225  1958 consensus_queue.cc:237] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 12:58:41.873806  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 84481.5us
I20260709 12:58:41.875486  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:58:41.876458  1723 tablet_bootstrap.cc:654] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:41.877031  1946 raft_consensus.cc:2804] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:41.878240  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:58:41.870378  1528 raft_consensus.cc:2468] T e4b8c02fb560459fbbb59424361a5457 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 1.
I20260709 12:58:41.878924  1946 raft_consensus.cc:493] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:58:41.878120  1722 raft_consensus.cc:359] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:41.879423  1722 raft_consensus.cc:385] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:41.879753  1722 raft_consensus.cc:740] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Initialized, Role: FOLLOWER
I20260709 12:58:41.882146  1722 consensus_queue.cc:260] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:41.879375  1946 raft_consensus.cc:3060] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:41.884688  1722 ts_tablet_manager.cc:1434] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 12:58:41.885579  1722 tablet_bootstrap.cc:492] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90: Bootstrap starting.
W20260709 12:58:41.886245  1646 leader_election.cc:343] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:41.889004  1644 leader_election.cc:304] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 12:58:41.891254  1946 raft_consensus.cc:515] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:41.895032  1678 raft_consensus.cc:1240] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:41.892359  1722 tablet_bootstrap.cc:654] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:41.897770  1838 raft_consensus.cc:2804] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:41.898319  1838 raft_consensus.cc:697] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:58:41.899132  1955 consensus_queue.cc:1048] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:41.899931  1866 consensus_queue.cc:1059] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:41.899132  1838 consensus_queue.cc:237] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:41.900933  1866 raft_consensus.cc:3055] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:41.901288  1866 raft_consensus.cc:740] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:58:41.902056  1866 consensus_queue.cc:260] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:41.907584  1953 raft_consensus.cc:493] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:41.908107  1953 raft_consensus.cc:515] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:41.910120  1953 leader_election.cc:290] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:41.911535  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:58:41.912232  1678 raft_consensus.cc:2468] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 0.
I20260709 12:58:41.912662  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:58:41.913370  1496 leader_election.cc:304] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:58:41.914202  1953 raft_consensus.cc:2804] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:41.914572  1953 raft_consensus.cc:493] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:41.914947  1953 raft_consensus.cc:3060] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:41.915355  1946 leader_election.cc:290] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 2 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
W20260709 12:58:41.917704  1497 leader_election.cc:343] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:41.915899  1951 raft_consensus.cc:493] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:41.930394  1951 raft_consensus.cc:515] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:41.931246  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:58:41.921636  1429 catalog_manager.cc:5697] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 0 to 1, leader changed from <none> to 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:41.925279  1953 raft_consensus.cc:515] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:41.911530  1866 raft_consensus.cc:3060] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:41.928980  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:58:41.932821  1951 leader_election.cc:290] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:41.938767  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:58:41.939500  1607 raft_consensus.cc:2468] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 0.
I20260709 12:58:41.946318  1497 leader_election.cc:304] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:58:41.948829  1954 raft_consensus.cc:2804] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:41.950522  1954 raft_consensus.cc:493] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:41.950879  1607 raft_consensus.cc:1275] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:58:41.951220  1953 leader_election.cc:290] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:41.950937  1954 raft_consensus.cc:3060] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:41.960577  1723 tablet_bootstrap.cc:492] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1: No bootstrap required, opened a new log
I20260709 12:58:41.961077  1723 ts_tablet_manager.cc:1403] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent bootstrapping tablet: real 0.122s	user 0.010s	sys 0.011s
I20260709 12:58:41.965660  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:58:41.962541  1430 catalog_manager.cc:5697] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 reported cstate change: term changed from 0 to 1, leader changed from <none> to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:41.955691  1946 consensus_queue.cc:1048] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 12:58:41.971935  1721 tablet_bootstrap.cc:654] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:41.972157  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:58:41.971545  1723 raft_consensus.cc:359] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:41.968744  1954 raft_consensus.cc:515] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:41.972831  1723 raft_consensus.cc:385] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:58:41.975997  1497 leader_election.cc:343] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:41.976053  1723 raft_consensus.cc:740] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Initialized, Role: FOLLOWER
I20260709 12:58:41.976809  1723 consensus_queue.cc:260] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:41.978370  1723 ts_tablet_manager.cc:1434] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.002s
I20260709 12:58:41.979197  1723 tablet_bootstrap.cc:492] T 073cc710cf6642bb940606f8df5c2331 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Bootstrap starting.
I20260709 12:58:41.975334  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:58:41.981040  1680 raft_consensus.cc:3060] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:41.956210  1953 consensus_queue.cc:1048] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20260709 12:58:41.994457  1722 tablet_bootstrap.cc:492] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90: No bootstrap required, opened a new log
I20260709 12:58:41.995088  1722 ts_tablet_manager.cc:1403] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90: Time spent bootstrapping tablet: real 0.110s	user 0.021s	sys 0.005s
I20260709 12:58:41.996912  1606 raft_consensus.cc:1275] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
W20260709 12:58:41.988257  1496 leader_election.cc:343] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:41.999073  1863 consensus_queue.cc:1048] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:42.004977  1678 raft_consensus.cc:1275] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:58:42.007257  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
W20260709 12:58:42.009691  1496 leader_election.cc:343] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:42.011570  1722 raft_consensus.cc:359] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:42.012341  1722 raft_consensus.cc:385] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:42.012583  1722 raft_consensus.cc:740] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Initialized, Role: FOLLOWER
I20260709 12:58:42.013212  1722 consensus_queue.cc:260] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:42.023548  1722 ts_tablet_manager.cc:1434] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 12:58:42.024734  1722 tablet_bootstrap.cc:492] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90: Bootstrap starting.
I20260709 12:58:42.018260  1954 leader_election.cc:290] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:42.006568  1680 raft_consensus.cc:2468] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 1.
I20260709 12:58:42.031155  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:58:42.033794  1953 consensus_queue.cc:1048] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:42.098845  1528 raft_consensus.cc:1275] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:58:42.099368  1721 tablet_bootstrap.cc:492] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642: No bootstrap required, opened a new log
I20260709 12:58:42.080405  1723 tablet_bootstrap.cc:654] T 073cc710cf6642bb940606f8df5c2331 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:42.084352  1496 leader_election.cc:304] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 12:58:42.087428  1600 raft_consensus.cc:2468] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 2.
I20260709 12:58:42.116418  1946 consensus_queue.cc:1048] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:42.121833  1929 raft_consensus.cc:2804] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:42.123544  1929 raft_consensus.cc:697] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 12:58:42.029306  1951 consensus_queue.cc:1048] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.096s
I20260709 12:58:42.124752  1646 leader_election.cc:304] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:58:42.124425  1929 consensus_queue.cc:237] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:42.126745  1721 ts_tablet_manager.cc:1403] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642: Time spent bootstrapping tablet: real 0.275s	user 0.023s	sys 0.008s
I20260709 12:58:42.079632  1722 tablet_bootstrap.cc:654] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90: Neither blocks nor log segments found. Creating new log.
W20260709 12:58:42.079810  1478 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:58:42.135875  1838 raft_consensus.cc:2804] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:42.136439  1838 raft_consensus.cc:697] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 2 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:58:42.114512  1603 raft_consensus.cc:3060] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:42.148736  1838 consensus_queue.cc:237] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:42.161960  1723 tablet_bootstrap.cc:492] T 073cc710cf6642bb940606f8df5c2331 P e46412b3b0b44f01ad5c33d4cfe3d6b1: No bootstrap required, opened a new log
I20260709 12:58:42.162417  1723 ts_tablet_manager.cc:1403] T 073cc710cf6642bb940606f8df5c2331 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent bootstrapping tablet: real 0.183s	user 0.020s	sys 0.011s
I20260709 12:58:42.233103  1991 raft_consensus.cc:493] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:42.243280  1723 raft_consensus.cc:359] T 073cc710cf6642bb940606f8df5c2331 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:42.244287  1723 raft_consensus.cc:385] T 073cc710cf6642bb940606f8df5c2331 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:42.244711  1723 raft_consensus.cc:740] T 073cc710cf6642bb940606f8df5c2331 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Initialized, Role: FOLLOWER
I20260709 12:58:42.211038  1721 raft_consensus.cc:359] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:42.255198  1721 raft_consensus.cc:385] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:42.255560  1721 raft_consensus.cc:740] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Initialized, Role: FOLLOWER
I20260709 12:58:42.256556  1721 consensus_queue.cc:260] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:42.257800  1723 consensus_queue.cc:260] T 073cc710cf6642bb940606f8df5c2331 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:42.234248  1991 raft_consensus.cc:515] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:42.265520  1723 ts_tablet_manager.cc:1434] T 073cc710cf6642bb940606f8df5c2331 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent starting tablet: real 0.103s	user 0.006s	sys 0.001s
I20260709 12:58:42.267277  1723 tablet_bootstrap.cc:492] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Bootstrap starting.
I20260709 12:58:42.277838  1991 leader_election.cc:290] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:58:42.279275  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:58:42.288892  1529 raft_consensus.cc:2468] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 0.
I20260709 12:58:42.290704  1644 leader_election.cc:304] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:58:42.292686  1721 ts_tablet_manager.cc:1434] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642: Time spent starting tablet: real 0.166s	user 0.005s	sys 0.005s
I20260709 12:58:42.296694  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:58:42.297766  1607 raft_consensus.cc:2468] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 0.
W20260709 12:58:42.290769  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 141256us
I20260709 12:58:42.302211  1801 raft_consensus.cc:2804] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:42.305115  1801 raft_consensus.cc:493] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:42.305521  1801 raft_consensus.cc:3060] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:42.307698  1429 catalog_manager.cc:5697] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 reported cstate change: term changed from 1 to 2, leader changed from 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:42.310791  1951 raft_consensus.cc:493] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:42.313026  1951 raft_consensus.cc:515] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:42.314311  1722 tablet_bootstrap.cc:492] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90: No bootstrap required, opened a new log
I20260709 12:58:42.314566  1917 consensus_queue.cc:1048] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:42.316136  1721 tablet_bootstrap.cc:492] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642: Bootstrap starting.
I20260709 12:58:42.317739  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:58:42.315093  1722 ts_tablet_manager.cc:1403] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90: Time spent bootstrapping tablet: real 0.291s	user 0.018s	sys 0.007s
I20260709 12:58:42.319744  1951 leader_election.cc:290] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 12:58:42.319803  1496 leader_election.cc:343] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:42.326088  1722 raft_consensus.cc:359] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:42.328034  1722 raft_consensus.cc:385] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:42.328419  1722 raft_consensus.cc:740] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Initialized, Role: FOLLOWER
I20260709 12:58:42.332592  1722 consensus_queue.cc:260] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:42.345201  1603 raft_consensus.cc:2468] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 1.
I20260709 12:58:42.347002  1801 raft_consensus.cc:515] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:42.356772  1722 ts_tablet_manager.cc:1434] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.000s
I20260709 12:58:42.361389  1722 tablet_bootstrap.cc:492] T 1e4adfe2190c4487ab72be02d6cfa923 P ddf11fc190dd4b898773379c6b129d90: Bootstrap starting.
I20260709 12:58:42.357360  1723 tablet_bootstrap.cc:654] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:42.355245  1721 tablet_bootstrap.cc:654] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:42.358032  1429 catalog_manager.cc:5697] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:42.359535  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:58:42.366895  1528 raft_consensus.cc:3060] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:42.373744  1801 leader_election.cc:290] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:58:42.393128  1991 raft_consensus.cc:493] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:42.393853  1991 raft_consensus.cc:515] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:42.398331  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:58:42.399134  1607 raft_consensus.cc:2468] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 0.
I20260709 12:58:42.400717  1646 leader_election.cc:304] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:58:42.401212  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:58:42.401616  1917 raft_consensus.cc:2804] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:42.402081  1917 raft_consensus.cc:493] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:42.402590  1917 raft_consensus.cc:3060] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:42.402037  1604 raft_consensus.cc:2468] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 0.
I20260709 12:58:42.410312  1951 raft_consensus.cc:493] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:42.417232  1917 raft_consensus.cc:515] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:42.412976  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:58:42.419282  1603 raft_consensus.cc:3060] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:42.409011  1991 leader_election.cc:290] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:58:42.425709  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:58:42.428738  1527 raft_consensus.cc:2468] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 0.
I20260709 12:58:42.431067  1951 raft_consensus.cc:515] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 12:58:42.433000  1646 consensus_peers.cc:597] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 -> Peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Couldn't send request to peer 39a92f5a4352465d8af3af5908fe8642. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:42.433434  1951 leader_election.cc:290] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:42.433593  1917 leader_election.cc:290] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:58:42.434054  1497 leader_election.cc:304] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 12:58:42.435868  1929 raft_consensus.cc:2804] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:42.440125  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:58:42.440819  1680 raft_consensus.cc:2468] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 0.
I20260709 12:58:42.441509  1929 raft_consensus.cc:697] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 12:58:42.441776  1496 leader_election.cc:304] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:58:42.442556  1929 consensus_queue.cc:237] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:42.447418  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:58:42.447918  1603 raft_consensus.cc:2468] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 1.
I20260709 12:58:42.448058  1723 tablet_bootstrap.cc:492] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1: No bootstrap required, opened a new log
I20260709 12:58:42.449208  1723 ts_tablet_manager.cc:1403] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent bootstrapping tablet: real 0.182s	user 0.007s	sys 0.013s
I20260709 12:58:42.456753  1497 leader_election.cc:304] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 12:58:42.457643  1953 raft_consensus.cc:2804] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:42.457865  1721 tablet_bootstrap.cc:492] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642: No bootstrap required, opened a new log
I20260709 12:58:42.458330  1953 raft_consensus.cc:493] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:42.458828  1953 raft_consensus.cc:3060] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:42.458381  1721 ts_tablet_manager.cc:1403] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642: Time spent bootstrapping tablet: real 0.143s	user 0.017s	sys 0.022s
I20260709 12:58:42.448048  1604 raft_consensus.cc:3060] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:42.462529  1722 tablet_bootstrap.cc:654] T 1e4adfe2190c4487ab72be02d6cfa923 P ddf11fc190dd4b898773379c6b129d90: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:42.465979  2020 raft_consensus.cc:2804] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:42.466524  2020 raft_consensus.cc:493] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:42.467963  2020 raft_consensus.cc:3060] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:42.470996  1646 leader_election.cc:304] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:58:42.471506  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:58:42.471637  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:58:42.472127  1530 raft_consensus.cc:3060] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:42.472221  1801 raft_consensus.cc:2804] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:42.472748  1801 raft_consensus.cc:697] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:58:42.473117  1953 raft_consensus.cc:515] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:42.473582  1801 consensus_queue.cc:237] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:42.476363  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:58:42.476900  1680 raft_consensus.cc:3060] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:58:42.480645  1497 leader_election.cc:343] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:42.482108  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:58:42.484473  1680 raft_consensus.cc:2468] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 1.
W20260709 12:58:42.485087  1571 consensus_peers.cc:597] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 -> Peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217): Couldn't send request to peer ddf11fc190dd4b898773379c6b129d90. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:42.487952  1528 raft_consensus.cc:2468] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 1.
W20260709 12:58:42.489099  1497 leader_election.cc:343] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:42.483139  1721 raft_consensus.cc:359] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:42.490212  1721 raft_consensus.cc:385] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:42.490471  1721 raft_consensus.cc:740] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Initialized, Role: FOLLOWER
I20260709 12:58:42.494168  1530 raft_consensus.cc:2468] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 1.
I20260709 12:58:42.483127  1953 leader_election.cc:290] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:42.491736  1496 leader_election.cc:304] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 12:58:42.496510  1721 consensus_queue.cc:260] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:42.497722  1954 raft_consensus.cc:2804] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:42.498199  1954 raft_consensus.cc:697] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 12:58:42.498971  1721 ts_tablet_manager.cc:1434] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.000s
I20260709 12:58:42.500015  1866 consensus_queue.cc:1048] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 12:58:42.495024  1723 raft_consensus.cc:359] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:42.500977  1427 catalog_manager.cc:5697] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:42.499975  1721 tablet_bootstrap.cc:492] T 7352869c54614c80af4953b2ce90cace P 39a92f5a4352465d8af3af5908fe8642: Bootstrap starting.
I20260709 12:58:42.500902  1723 raft_consensus.cc:385] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:42.503707  1723 raft_consensus.cc:740] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Initialized, Role: FOLLOWER
I20260709 12:58:42.506520  1644 leader_election.cc:304] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:58:42.508034  1917 raft_consensus.cc:2804] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:42.508548  1917 raft_consensus.cc:697] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:58:42.508889  1954 consensus_queue.cc:237] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:42.509343  1917 consensus_queue.cc:237] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:42.522313  1723 consensus_queue.cc:260] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:42.533138  1723 ts_tablet_manager.cc:1434] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent starting tablet: real 0.084s	user 0.005s	sys 0.004s
I20260709 12:58:42.551203  1604 raft_consensus.cc:2468] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 1.
I20260709 12:58:42.556607  1723 tablet_bootstrap.cc:492] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Bootstrap starting.
I20260709 12:58:42.555650  2020 raft_consensus.cc:515] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:42.572796  1722 tablet_bootstrap.cc:492] T 1e4adfe2190c4487ab72be02d6cfa923 P ddf11fc190dd4b898773379c6b129d90: No bootstrap required, opened a new log
I20260709 12:58:42.573302  1722 ts_tablet_manager.cc:1403] T 1e4adfe2190c4487ab72be02d6cfa923 P ddf11fc190dd4b898773379c6b129d90: Time spent bootstrapping tablet: real 0.212s	user 0.014s	sys 0.018s
I20260709 12:58:42.583738  1722 raft_consensus.cc:359] T 1e4adfe2190c4487ab72be02d6cfa923 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:42.584756  1427 catalog_manager.cc:5697] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 reported cstate change: term changed from 0 to 1, leader changed from <none> to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:42.586148  1722 raft_consensus.cc:385] T 1e4adfe2190c4487ab72be02d6cfa923 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:42.586467  1722 raft_consensus.cc:740] T 1e4adfe2190c4487ab72be02d6cfa923 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Initialized, Role: FOLLOWER
I20260709 12:58:42.587352  1721 tablet_bootstrap.cc:654] T 7352869c54614c80af4953b2ce90cace P 39a92f5a4352465d8af3af5908fe8642: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:42.592223  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:58:42.592818  1603 raft_consensus.cc:3060] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:42.592875  1430 catalog_manager.cc:5697] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:42.595346  1528 raft_consensus.cc:3060] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:42.599192  2020 leader_election.cc:290] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:42.599838  1722 consensus_queue.cc:260] T 1e4adfe2190c4487ab72be02d6cfa923 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:42.600260  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
W20260709 12:58:42.601859  1496 leader_election.cc:343] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:42.604481  1723 tablet_bootstrap.cc:654] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:42.607246  1528 raft_consensus.cc:1275] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:42.607270  1603 raft_consensus.cc:2468] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 1.
I20260709 12:58:42.608642  1722 ts_tablet_manager.cc:1434] T 1e4adfe2190c4487ab72be02d6cfa923 P ddf11fc190dd4b898773379c6b129d90: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.000s
I20260709 12:58:42.614837  1722 tablet_bootstrap.cc:492] T 94d0d4cbe71742a39337e80ad5770e28 P ddf11fc190dd4b898773379c6b129d90: Bootstrap starting.
I20260709 12:58:42.618381  1991 consensus_queue.cc:1048] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
W20260709 12:58:42.619537  1497 consensus_peers.cc:597] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 -> Peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Couldn't send request to peer 39a92f5a4352465d8af3af5908fe8642. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:42.629683  1497 leader_election.cc:304] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 12:58:42.630699  2020 raft_consensus.cc:2804] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:42.631327  2020 raft_consensus.cc:697] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 12:58:42.632172  2020 consensus_queue.cc:237] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:42.646121  1722 tablet_bootstrap.cc:654] T 94d0d4cbe71742a39337e80ad5770e28 P ddf11fc190dd4b898773379c6b129d90: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:42.650431  1430 catalog_manager.cc:5697] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 reported cstate change: term changed from 0 to 1, leader changed from <none> to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:42.652819  1723 tablet_bootstrap.cc:492] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1: No bootstrap required, opened a new log
I20260709 12:58:42.653417  1723 ts_tablet_manager.cc:1403] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent bootstrapping tablet: real 0.110s	user 0.009s	sys 0.017s
I20260709 12:58:42.660037  1604 raft_consensus.cc:1275] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:42.662389  1721 tablet_bootstrap.cc:492] T 7352869c54614c80af4953b2ce90cace P 39a92f5a4352465d8af3af5908fe8642: No bootstrap required, opened a new log
I20260709 12:58:42.662096  1943 consensus_queue.cc:1048] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:42.663185  1721 ts_tablet_manager.cc:1403] T 7352869c54614c80af4953b2ce90cace P 39a92f5a4352465d8af3af5908fe8642: Time spent bootstrapping tablet: real 0.163s	user 0.010s	sys 0.007s
I20260709 12:58:42.671965  1723 raft_consensus.cc:359] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:42.672696  1723 raft_consensus.cc:385] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:42.672995  1723 raft_consensus.cc:740] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Initialized, Role: FOLLOWER
I20260709 12:58:42.673631  1723 consensus_queue.cc:260] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:42.681396  1723 ts_tablet_manager.cc:1434] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent starting tablet: real 0.027s	user 0.003s	sys 0.002s
I20260709 12:58:42.682528  1723 tablet_bootstrap.cc:492] T 822e65124bb44159b257fd219d28d93c P e46412b3b0b44f01ad5c33d4cfe3d6b1: Bootstrap starting.
I20260709 12:58:42.683364  1721 raft_consensus.cc:359] T 7352869c54614c80af4953b2ce90cace P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:42.686830  1721 raft_consensus.cc:385] T 7352869c54614c80af4953b2ce90cace P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:42.687206  1721 raft_consensus.cc:740] T 7352869c54614c80af4953b2ce90cace P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Initialized, Role: FOLLOWER
I20260709 12:58:42.690475  1721 consensus_queue.cc:260] T 7352869c54614c80af4953b2ce90cace P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:42.698807  1721 ts_tablet_manager.cc:1434] T 7352869c54614c80af4953b2ce90cace P 39a92f5a4352465d8af3af5908fe8642: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.000s
I20260709 12:58:42.700063  1721 tablet_bootstrap.cc:492] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642: Bootstrap starting.
I20260709 12:58:42.705483  1954 raft_consensus.cc:493] T 073cc710cf6642bb940606f8df5c2331 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:42.706032  1954 raft_consensus.cc:515] T 073cc710cf6642bb940606f8df5c2331 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:42.709323  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 12:58:42.710961  1496 leader_election.cc:343] T 073cc710cf6642bb940606f8df5c2331 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:42.711560  1722 tablet_bootstrap.cc:492] T 94d0d4cbe71742a39337e80ad5770e28 P ddf11fc190dd4b898773379c6b129d90: No bootstrap required, opened a new log
I20260709 12:58:42.711982  1722 ts_tablet_manager.cc:1403] T 94d0d4cbe71742a39337e80ad5770e28 P ddf11fc190dd4b898773379c6b129d90: Time spent bootstrapping tablet: real 0.097s	user 0.014s	sys 0.025s
I20260709 12:58:42.713860  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:58:42.714258  1954 leader_election.cc:290] T 073cc710cf6642bb940606f8df5c2331 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 12:58:42.716310  1497 leader_election.cc:343] T 073cc710cf6642bb940606f8df5c2331 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:42.716738  1497 leader_election.cc:304] T 073cc710cf6642bb940606f8df5c2331 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:58:42.717700  2017 raft_consensus.cc:2749] T 073cc710cf6642bb940606f8df5c2331 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:42.719625  2020 consensus_queue.cc:1048] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:42.724198  1721 tablet_bootstrap.cc:654] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:42.724589  1723 tablet_bootstrap.cc:654] T 822e65124bb44159b257fd219d28d93c P e46412b3b0b44f01ad5c33d4cfe3d6b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:42.726835  1429 catalog_manager.cc:5697] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:42.730297  1722 raft_consensus.cc:359] T 94d0d4cbe71742a39337e80ad5770e28 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:42.747562  1722 raft_consensus.cc:385] T 94d0d4cbe71742a39337e80ad5770e28 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:42.747874  1722 raft_consensus.cc:740] T 94d0d4cbe71742a39337e80ad5770e28 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Initialized, Role: FOLLOWER
I20260709 12:58:42.750777  1722 consensus_queue.cc:260] T 94d0d4cbe71742a39337e80ad5770e28 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:42.753237  1722 ts_tablet_manager.cc:1434] T 94d0d4cbe71742a39337e80ad5770e28 P ddf11fc190dd4b898773379c6b129d90: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.000s
I20260709 12:58:42.754262  1722 tablet_bootstrap.cc:492] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90: Bootstrap starting.
I20260709 12:58:42.760354  1722 tablet_bootstrap.cc:654] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:42.764142  1723 tablet_bootstrap.cc:492] T 822e65124bb44159b257fd219d28d93c P e46412b3b0b44f01ad5c33d4cfe3d6b1: No bootstrap required, opened a new log
I20260709 12:58:42.764694  1723 ts_tablet_manager.cc:1403] T 822e65124bb44159b257fd219d28d93c P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent bootstrapping tablet: real 0.082s	user 0.013s	sys 0.017s
I20260709 12:58:42.765086  1721 tablet_bootstrap.cc:492] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642: No bootstrap required, opened a new log
I20260709 12:58:42.765631  1721 ts_tablet_manager.cc:1403] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642: Time spent bootstrapping tablet: real 0.066s	user 0.025s	sys 0.009s
I20260709 12:58:42.767722  1723 raft_consensus.cc:359] T 822e65124bb44159b257fd219d28d93c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:42.768249  1723 raft_consensus.cc:385] T 822e65124bb44159b257fd219d28d93c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:42.768517  1723 raft_consensus.cc:740] T 822e65124bb44159b257fd219d28d93c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Initialized, Role: FOLLOWER
I20260709 12:58:42.768468  1721 raft_consensus.cc:359] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:42.769351  1721 raft_consensus.cc:385] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:42.769675  1721 raft_consensus.cc:740] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Initialized, Role: FOLLOWER
I20260709 12:58:42.769500  1723 consensus_queue.cc:260] T 822e65124bb44159b257fd219d28d93c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:42.770495  1721 consensus_queue.cc:260] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:42.777997  1723 ts_tablet_manager.cc:1434] T 822e65124bb44159b257fd219d28d93c P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent starting tablet: real 0.013s	user 0.000s	sys 0.004s
I20260709 12:58:42.778420  1958 raft_consensus.cc:493] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:42.779232  1723 tablet_bootstrap.cc:492] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Bootstrap starting.
I20260709 12:58:42.778926  1958 raft_consensus.cc:515] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:42.781095  1958 leader_election.cc:290] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:42.785084  1721 ts_tablet_manager.cc:1434] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 12:58:42.785449  1723 tablet_bootstrap.cc:654] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:42.787017  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:58:42.787712  1677 raft_consensus.cc:2468] T 1e4adfe2190c4487ab72be02d6cfa923 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 0.
I20260709 12:58:42.788290  1722 tablet_bootstrap.cc:492] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90: No bootstrap required, opened a new log
I20260709 12:58:42.788731  1722 ts_tablet_manager.cc:1403] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90: Time spent bootstrapping tablet: real 0.035s	user 0.021s	sys 0.007s
I20260709 12:58:42.791302  1722 raft_consensus.cc:359] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:42.791973  1722 raft_consensus.cc:385] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:42.792248  1722 raft_consensus.cc:740] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Initialized, Role: FOLLOWER
I20260709 12:58:42.792845  1722 consensus_queue.cc:260] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:42.796487  1721 tablet_bootstrap.cc:492] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642: Bootstrap starting.
I20260709 12:58:42.793001  1571 leader_election.cc:304] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:58:42.799890  2012 raft_consensus.cc:2804] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:42.800304  2012 raft_consensus.cc:493] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:42.800643  2012 raft_consensus.cc:3060] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:42.801045  1722 ts_tablet_manager.cc:1434] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.001s
I20260709 12:58:42.804026  1722 tablet_bootstrap.cc:492] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90: Bootstrap starting.
I20260709 12:58:42.809674  1722 tablet_bootstrap.cc:654] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:42.817584  1721 tablet_bootstrap.cc:654] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:42.785174  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:58:42.820798  1528 raft_consensus.cc:2468] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 0.
I20260709 12:58:42.821491  1722 tablet_bootstrap.cc:492] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90: No bootstrap required, opened a new log
I20260709 12:58:42.821954  1722 ts_tablet_manager.cc:1403] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90: Time spent bootstrapping tablet: real 0.018s	user 0.006s	sys 0.009s
I20260709 12:58:42.836542  1722 raft_consensus.cc:359] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:42.843554  1722 raft_consensus.cc:385] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:42.843876  1722 raft_consensus.cc:740] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Initialized, Role: FOLLOWER
I20260709 12:58:42.839536  1721 tablet_bootstrap.cc:492] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642: No bootstrap required, opened a new log
I20260709 12:58:42.844763  1721 ts_tablet_manager.cc:1403] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642: Time spent bootstrapping tablet: real 0.048s	user 0.012s	sys 0.013s
I20260709 12:58:42.835402  2012 raft_consensus.cc:515] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:42.847141  2012 leader_election.cc:290] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:42.847832  1721 raft_consensus.cc:359] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:42.848554  1721 raft_consensus.cc:385] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:42.848645  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:58:42.849049  1943 raft_consensus.cc:493] T 94d0d4cbe71742a39337e80ad5770e28 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:42.849826  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:58:42.849535  1943 raft_consensus.cc:515] T 94d0d4cbe71742a39337e80ad5770e28 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:42.850481  1680 raft_consensus.cc:3060] T 1e4adfe2190c4487ab72be02d6cfa923 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:42.853050  1943 leader_election.cc:290] T 94d0d4cbe71742a39337e80ad5770e28 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:58:42.844754  1722 consensus_queue.cc:260] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:42.855067  1722 ts_tablet_manager.cc:1434] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90: Time spent starting tablet: real 0.033s	user 0.001s	sys 0.008s
I20260709 12:58:42.856120  1723 tablet_bootstrap.cc:492] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1: No bootstrap required, opened a new log
I20260709 12:58:42.856588  1723 ts_tablet_manager.cc:1403] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent bootstrapping tablet: real 0.078s	user 0.018s	sys 0.045s
I20260709 12:58:42.856506  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:58:42.857021  1721 raft_consensus.cc:740] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Initialized, Role: FOLLOWER
I20260709 12:58:42.857357  1603 raft_consensus.cc:2393] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 1: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 12:58:42.857707  1721 consensus_queue.cc:260] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:42.859344  1723 raft_consensus.cc:359] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:42.859989  1723 raft_consensus.cc:385] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:42.860226  1723 raft_consensus.cc:740] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Initialized, Role: FOLLOWER
I20260709 12:58:42.860896  1721 ts_tablet_manager.cc:1434] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 12:58:42.856722  1680 raft_consensus.cc:2468] T 1e4adfe2190c4487ab72be02d6cfa923 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 1.
I20260709 12:58:42.860945  1723 consensus_queue.cc:260] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:42.862828  1721 tablet_bootstrap.cc:492] T e78618eba8b74effa4a90f2c8e34cc02 P 39a92f5a4352465d8af3af5908fe8642: Bootstrap starting.
I20260709 12:58:42.863649  1571 leader_election.cc:304] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:58:42.865410  1958 raft_consensus.cc:2804] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:42.866882  1958 raft_consensus.cc:697] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:58:42.868040  1958 consensus_queue.cc:237] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:42.869433  1721 tablet_bootstrap.cc:654] T e78618eba8b74effa4a90f2c8e34cc02 P 39a92f5a4352465d8af3af5908fe8642: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:42.869783  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:58:42.872303  1722 tablet_bootstrap.cc:492] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90: Bootstrap starting.
I20260709 12:58:42.882334  1644 leader_election.cc:304] T 94d0d4cbe71742a39337e80ad5770e28 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:58:42.883566  1943 raft_consensus.cc:3060] T 94d0d4cbe71742a39337e80ad5770e28 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:42.872869  1525 raft_consensus.cc:3060] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:42.890600  1991 raft_consensus.cc:493] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:42.891142  1991 raft_consensus.cc:515] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:42.893412  1991 leader_election.cc:290] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:58:42.872601  1723 ts_tablet_manager.cc:1434] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:58:42.894495  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:58:42.895687  1721 tablet_bootstrap.cc:492] T e78618eba8b74effa4a90f2c8e34cc02 P 39a92f5a4352465d8af3af5908fe8642: No bootstrap required, opened a new log
I20260709 12:58:42.896140  1721 ts_tablet_manager.cc:1403] T e78618eba8b74effa4a90f2c8e34cc02 P 39a92f5a4352465d8af3af5908fe8642: Time spent bootstrapping tablet: real 0.034s	user 0.009s	sys 0.004s
I20260709 12:58:42.898860  1721 raft_consensus.cc:359] T e78618eba8b74effa4a90f2c8e34cc02 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:42.899780  1721 raft_consensus.cc:385] T e78618eba8b74effa4a90f2c8e34cc02 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:42.888742  1722 tablet_bootstrap.cc:654] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:42.900097  1721 raft_consensus.cc:740] T e78618eba8b74effa4a90f2c8e34cc02 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Initialized, Role: FOLLOWER
I20260709 12:58:42.900321  1723 tablet_bootstrap.cc:492] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Bootstrap starting.
I20260709 12:58:42.900285  1430 catalog_manager.cc:5697] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 0 to 1, leader changed from <none> to 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:42.900933  1721 consensus_queue.cc:260] T e78618eba8b74effa4a90f2c8e34cc02 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:42.903498  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:58:42.904115  1721 ts_tablet_manager.cc:1434] T e78618eba8b74effa4a90f2c8e34cc02 P 39a92f5a4352465d8af3af5908fe8642: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:58:42.905184  1721 tablet_bootstrap.cc:492] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642: Bootstrap starting.
I20260709 12:58:42.906169  1644 leader_election.cc:304] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:58:42.907713  1991 raft_consensus.cc:2749] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:42.910283  1603 raft_consensus.cc:3060] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:42.910979  1677 raft_consensus.cc:3060] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:42.912758  1525 raft_consensus.cc:2468] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 1.
W20260709 12:58:42.915675  1497 consensus_peers.cc:597] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 -> Peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Couldn't send request to peer 39a92f5a4352465d8af3af5908fe8642. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:42.920941  1723 tablet_bootstrap.cc:654] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:42.927258  1943 raft_consensus.cc:2749] T 94d0d4cbe71742a39337e80ad5770e28 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:42.938505  1721 tablet_bootstrap.cc:654] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:42.942792  2020 consensus_queue.cc:1048] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:42.957288  1722 tablet_bootstrap.cc:492] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90: No bootstrap required, opened a new log
I20260709 12:58:42.957791  1722 ts_tablet_manager.cc:1403] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90: Time spent bootstrapping tablet: real 0.086s	user 0.013s	sys 0.015s
I20260709 12:58:42.960964  1722 raft_consensus.cc:359] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:42.961656  1722 raft_consensus.cc:385] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:42.961949  1722 raft_consensus.cc:740] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Initialized, Role: FOLLOWER
I20260709 12:58:42.962589  1722 consensus_queue.cc:260] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:42.963166  2017 consensus_queue.cc:1048] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:42.964005  1991 consensus_queue.cc:1048] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:42.968951  1722 ts_tablet_manager.cc:1434] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:58:42.972880  1722 tablet_bootstrap.cc:492] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90: Bootstrap starting.
I20260709 12:58:42.987370  1721 tablet_bootstrap.cc:492] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642: No bootstrap required, opened a new log
I20260709 12:58:42.988456  1721 ts_tablet_manager.cc:1403] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642: Time spent bootstrapping tablet: real 0.083s	user 0.010s	sys 0.003s
I20260709 12:58:42.999142  1722 tablet_bootstrap.cc:654] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:43.003482  1721 raft_consensus.cc:359] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:43.004276  1721 raft_consensus.cc:385] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:43.004557  1721 raft_consensus.cc:740] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Initialized, Role: FOLLOWER
I20260709 12:58:43.009209  1723 tablet_bootstrap.cc:492] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1: No bootstrap required, opened a new log
I20260709 12:58:43.009790  1723 ts_tablet_manager.cc:1403] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent bootstrapping tablet: real 0.114s	user 0.012s	sys 0.014s
I20260709 12:58:43.009889  2020 raft_consensus.cc:493] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:43.011089  2020 raft_consensus.cc:515] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:43.014185  2020 leader_election.cc:290] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:43.016214  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:58:43.015578  1953 consensus_queue.cc:1048] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:58:43.018844  1496 leader_election.cc:343] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:43.021874  1801 consensus_queue.cc:1048] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:43.022073  1723 raft_consensus.cc:359] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:43.025336  1723 raft_consensus.cc:385] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:43.025636  1723 raft_consensus.cc:740] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Initialized, Role: FOLLOWER
I20260709 12:58:43.025005  1722 tablet_bootstrap.cc:492] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90: No bootstrap required, opened a new log
I20260709 12:58:43.026494  1722 ts_tablet_manager.cc:1403] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90: Time spent bootstrapping tablet: real 0.054s	user 0.007s	sys 0.007s
I20260709 12:58:43.028012  1846 raft_consensus.cc:493] T e78618eba8b74effa4a90f2c8e34cc02 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:43.028563  1846 raft_consensus.cc:515] T e78618eba8b74effa4a90f2c8e34cc02 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:43.029599  1722 raft_consensus.cc:359] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:43.030256  1722 raft_consensus.cc:385] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:43.030932  1723 consensus_queue.cc:260] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:43.031834  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:58:43.032668  1846 leader_election.cc:290] T e78618eba8b74effa4a90f2c8e34cc02 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:43.033432  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:58:43.034294  1723 ts_tablet_manager.cc:1434] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent starting tablet: real 0.024s	user 0.002s	sys 0.005s
W20260709 12:58:43.035024  1571 leader_election.cc:343] T e78618eba8b74effa4a90f2c8e34cc02 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:43.035372  1723 tablet_bootstrap.cc:492] T 8a1804adcd3844f5837dfc27d40e4cdf P e46412b3b0b44f01ad5c33d4cfe3d6b1: Bootstrap starting.
W20260709 12:58:43.035459  1570 leader_election.cc:343] T e78618eba8b74effa4a90f2c8e34cc02 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:43.035956  1570 leader_election.cc:304] T e78618eba8b74effa4a90f2c8e34cc02 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:58:43.037448  1846 raft_consensus.cc:2749] T e78618eba8b74effa4a90f2c8e34cc02 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:43.030521  1722 raft_consensus.cc:740] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Initialized, Role: FOLLOWER
I20260709 12:58:43.040160  1607 raft_consensus.cc:3060] T 7352869c54614c80af4953b2ce90cace P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:43.042145  1723 tablet_bootstrap.cc:654] T 8a1804adcd3844f5837dfc27d40e4cdf P e46412b3b0b44f01ad5c33d4cfe3d6b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:43.042714  1721 consensus_queue.cc:260] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:43.045439  1722 consensus_queue.cc:260] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:43.046000  1721 ts_tablet_manager.cc:1434] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642: Time spent starting tablet: real 0.055s	user 0.009s	sys 0.000s
I20260709 12:58:43.047145  1721 tablet_bootstrap.cc:492] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642: Bootstrap starting.
I20260709 12:58:43.047713  1722 ts_tablet_manager.cc:1434] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.000s
I20260709 12:58:43.048720  1722 tablet_bootstrap.cc:492] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90: Bootstrap starting.
I20260709 12:58:43.053453  1721 tablet_bootstrap.cc:654] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:43.054612  1722 tablet_bootstrap.cc:654] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:43.057613  1917 consensus_queue.cc:1048] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:43.068755  1722 tablet_bootstrap.cc:492] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90: No bootstrap required, opened a new log
I20260709 12:58:43.069267  1722 ts_tablet_manager.cc:1403] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.003s
I20260709 12:58:43.073393  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:58:43.074182  1604 raft_consensus.cc:2468] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 0.
I20260709 12:58:43.080650  1991 consensus_queue.cc:1048] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:43.089439  1497 leader_election.cc:304] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 12:58:43.090445  2020 raft_consensus.cc:2804] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:43.090854  2020 raft_consensus.cc:493] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:43.091190  2020 raft_consensus.cc:3060] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:43.096244  1677 raft_consensus.cc:3060] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:43.097756  2020 raft_consensus.cc:515] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:43.100566  2020 leader_election.cc:290] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:43.102018  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
W20260709 12:58:43.103367  1496 leader_election.cc:343] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:43.107295  2020 consensus_queue.cc:1048] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:43.117206  1846 raft_consensus.cc:493] T 7352869c54614c80af4953b2ce90cace P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 12:58:43.117738  1846 raft_consensus.cc:515] T 7352869c54614c80af4953b2ce90cace P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:43.120764  1723 tablet_bootstrap.cc:492] T 8a1804adcd3844f5837dfc27d40e4cdf P e46412b3b0b44f01ad5c33d4cfe3d6b1: No bootstrap required, opened a new log
I20260709 12:58:43.121269  1723 ts_tablet_manager.cc:1403] T 8a1804adcd3844f5837dfc27d40e4cdf P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent bootstrapping tablet: real 0.086s	user 0.034s	sys 0.015s
I20260709 12:58:43.121320  1846 leader_election.cc:290] T 7352869c54614c80af4953b2ce90cace P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:43.122587  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:58:43.120882  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:58:43.123617  1600 raft_consensus.cc:3060] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:43.124660  1723 raft_consensus.cc:359] T 8a1804adcd3844f5837dfc27d40e4cdf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:43.125082  1721 tablet_bootstrap.cc:492] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642: No bootstrap required, opened a new log
I20260709 12:58:43.126057  1721 ts_tablet_manager.cc:1403] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642: Time spent bootstrapping tablet: real 0.079s	user 0.028s	sys 0.005s
I20260709 12:58:43.125371  1723 raft_consensus.cc:385] T 8a1804adcd3844f5837dfc27d40e4cdf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:43.127740  1723 raft_consensus.cc:740] T 8a1804adcd3844f5837dfc27d40e4cdf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Initialized, Role: FOLLOWER
I20260709 12:58:43.128364  1723 consensus_queue.cc:260] T 8a1804adcd3844f5837dfc27d40e4cdf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:43.130002  1723 ts_tablet_manager.cc:1434] T 8a1804adcd3844f5837dfc27d40e4cdf P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 12:58:43.129674  1721 raft_consensus.cc:359] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:43.131480  1721 raft_consensus.cc:385] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:43.132169  1721 raft_consensus.cc:740] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Initialized, Role: FOLLOWER
I20260709 12:58:43.133563  1721 consensus_queue.cc:260] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:43.136497  1721 ts_tablet_manager.cc:1434] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642: Time spent starting tablet: real 0.010s	user 0.000s	sys 0.004s
I20260709 12:58:43.130877  1723 tablet_bootstrap.cc:492] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Bootstrap starting.
I20260709 12:58:43.144897  1721 tablet_bootstrap.cc:492] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642: Bootstrap starting.
I20260709 12:58:43.117224  1722 raft_consensus.cc:359] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:43.146843  1722 raft_consensus.cc:385] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:43.147179  1722 raft_consensus.cc:740] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Initialized, Role: FOLLOWER
I20260709 12:58:43.147845  1722 consensus_queue.cc:260] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:43.149319  2020 consensus_queue.cc:1048] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:43.157454  1723 tablet_bootstrap.cc:654] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:43.162204  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:58:43.163667  1722 ts_tablet_manager.cc:1434] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90: Time spent starting tablet: real 0.094s	user 0.005s	sys 0.002s
I20260709 12:58:43.166246  1570 leader_election.cc:304] T 7352869c54614c80af4953b2ce90cace P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:58:43.169037  2012 raft_consensus.cc:2749] T 7352869c54614c80af4953b2ce90cace P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:43.160568  1600 raft_consensus.cc:2468] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 1.
I20260709 12:58:43.180712  1722 tablet_bootstrap.cc:492] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90: Bootstrap starting.
I20260709 12:58:43.187886  1497 leader_election.cc:304] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 12:58:43.189740  1943 raft_consensus.cc:493] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:43.191311  1721 tablet_bootstrap.cc:654] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:43.189687  2020 raft_consensus.cc:2804] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:43.194624  2020 raft_consensus.cc:697] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 12:58:43.195500  2020 consensus_queue.cc:237] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:43.197254  2017 raft_consensus.cc:493] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:43.197747  2017 raft_consensus.cc:515] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:43.190351  1943 raft_consensus.cc:515] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:43.201264  1722 tablet_bootstrap.cc:654] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:43.201279  1943 leader_election.cc:290] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:58:43.201756  2017 leader_election.cc:290] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:43.202780  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 12:58:43.204190  1496 leader_election.cc:343] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:43.209225  2012 raft_consensus.cc:493] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:43.211611  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:58:43.213344  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:58:43.214031  1525 raft_consensus.cc:2468] T 073cc710cf6642bb940606f8df5c2331 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 0.
I20260709 12:58:43.215221  1917 raft_consensus.cc:493] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:43.215749  1917 raft_consensus.cc:515] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:43.217801  1917 leader_election.cc:290] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:58:43.219740  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:58:43.208493  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:58:43.221015  1600 raft_consensus.cc:2468] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 0.
I20260709 12:58:43.210466  2012 raft_consensus.cc:515] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:43.224864  1644 leader_election.cc:304] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:58:43.225816  1943 raft_consensus.cc:2804] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:58:43.226878  1497 leader_election.cc:343] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:43.227440  1497 leader_election.cc:304] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:58:43.228631  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:58:43.227843  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 12:58:43.230041  1646 leader_election.cc:343] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:43.230238  1525 raft_consensus.cc:2468] T 8a1804adcd3844f5837dfc27d40e4cdf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 0.
I20260709 12:58:43.235148  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:58:43.233568  1954 raft_consensus.cc:493] T 822e65124bb44159b257fd219d28d93c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:43.237061  1954 raft_consensus.cc:515] T 822e65124bb44159b257fd219d28d93c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:43.227375  1943 raft_consensus.cc:493] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:43.247720  1954 leader_election.cc:290] T 822e65124bb44159b257fd219d28d93c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:43.249385  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:58:43.260178  1943 raft_consensus.cc:3060] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:58:43.266063  1496 leader_election.cc:343] T 822e65124bb44159b257fd219d28d93c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:43.267560  1571 leader_election.cc:304] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:58:43.269657  1846 raft_consensus.cc:2749] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:43.231881  2017 raft_consensus.cc:2749] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:43.256901  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:58:43.229429  2012 leader_election.cc:290] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:43.286422  1721 tablet_bootstrap.cc:492] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642: No bootstrap required, opened a new log
I20260709 12:58:43.286962  1721 ts_tablet_manager.cc:1403] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642: Time spent bootstrapping tablet: real 0.142s	user 0.014s	sys 0.001s
I20260709 12:58:43.286751  1954 raft_consensus.cc:493] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:43.294469  1497 leader_election.cc:343] T 822e65124bb44159b257fd219d28d93c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:43.294559  1723 tablet_bootstrap.cc:492] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1: No bootstrap required, opened a new log
I20260709 12:58:43.294900  1497 leader_election.cc:304] T 822e65124bb44159b257fd219d28d93c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:58:43.295121  1723 ts_tablet_manager.cc:1403] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent bootstrapping tablet: real 0.164s	user 0.027s	sys 0.024s
I20260709 12:58:43.295588  2020 raft_consensus.cc:2749] T 822e65124bb44159b257fd219d28d93c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:43.296396  1429 catalog_manager.cc:5697] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:43.297960  1723 raft_consensus.cc:359] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:43.298604  1723 raft_consensus.cc:385] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:43.298906  1723 raft_consensus.cc:740] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Initialized, Role: FOLLOWER
I20260709 12:58:43.292979  1954 raft_consensus.cc:515] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:43.313951  1954 leader_election.cc:290] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:43.306062  1644 leader_election.cc:304] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 12:58:43.314487  1943 raft_consensus.cc:515] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:43.315680  1991 raft_consensus.cc:2804] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:43.316264  1991 raft_consensus.cc:493] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:43.304173  1721 raft_consensus.cc:359] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:43.316605  1991 raft_consensus.cc:3060] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:43.316731  1721 raft_consensus.cc:385] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:43.317014  1721 raft_consensus.cc:740] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Initialized, Role: FOLLOWER
I20260709 12:58:43.319064  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:58:43.319689  1600 raft_consensus.cc:3060] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:43.310484  1723 consensus_queue.cc:260] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:43.324944  1723 ts_tablet_manager.cc:1434] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260709 12:58:43.326093  1723 tablet_bootstrap.cc:492] T 4ea41c88222b469fb11229faef735050 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Bootstrap starting.
I20260709 12:58:43.324739  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:58:43.328421  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 12:58:43.328631  1496 leader_election.cc:343] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:43.330332  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:58:43.330781  1943 leader_election.cc:290] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:58:43.330971  1532 raft_consensus.cc:3060] T 073cc710cf6642bb940606f8df5c2331 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:43.335918  1723 tablet_bootstrap.cc:654] T 4ea41c88222b469fb11229faef735050 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:43.338575  1600 raft_consensus.cc:2468] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 1.
I20260709 12:58:43.338977  1532 raft_consensus.cc:2468] T 073cc710cf6642bb940606f8df5c2331 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 1.
I20260709 12:58:43.339916  1646 leader_election.cc:304] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:58:43.340385  1722 tablet_bootstrap.cc:492] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90: No bootstrap required, opened a new log
I20260709 12:58:43.338599  1991 raft_consensus.cc:515] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:43.340845  1722 ts_tablet_manager.cc:1403] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90: Time spent bootstrapping tablet: real 0.161s	user 0.013s	sys 0.006s
I20260709 12:58:43.319100  1721 consensus_queue.cc:260] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:43.344074  1722 raft_consensus.cc:359] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:43.344753  1722 raft_consensus.cc:385] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:43.345017  1722 raft_consensus.cc:740] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Initialized, Role: FOLLOWER
I20260709 12:58:43.345621  1722 consensus_queue.cc:260] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:43.347700  1722 ts_tablet_manager.cc:1434] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:58:43.348703  1722 tablet_bootstrap.cc:492] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90: Bootstrap starting.
I20260709 12:58:43.340898  1943 raft_consensus.cc:2804] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:43.351111  1943 raft_consensus.cc:697] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:58:43.351996  1943 consensus_queue.cc:237] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 12:58:43.351111  1497 leader_election.cc:343] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:43.354547  1497 leader_election.cc:304] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:58:43.357686  2020 raft_consensus.cc:2749] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:43.359176  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:58:43.343636  1721 ts_tablet_manager.cc:1434] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642: Time spent starting tablet: real 0.056s	user 0.009s	sys 0.001s
I20260709 12:58:43.359762  1525 raft_consensus.cc:3060] T 8a1804adcd3844f5837dfc27d40e4cdf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:43.360555  1721 tablet_bootstrap.cc:492] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642: Bootstrap starting.
I20260709 12:58:43.362226  1723 tablet_bootstrap.cc:492] T 4ea41c88222b469fb11229faef735050 P e46412b3b0b44f01ad5c33d4cfe3d6b1: No bootstrap required, opened a new log
I20260709 12:58:43.364378  1991 leader_election.cc:290] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:58:43.365453  1722 tablet_bootstrap.cc:654] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:43.365752  1723 ts_tablet_manager.cc:1403] T 4ea41c88222b469fb11229faef735050 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent bootstrapping tablet: real 0.040s	user 0.011s	sys 0.000s
I20260709 12:58:43.372175  1525 raft_consensus.cc:2468] T 8a1804adcd3844f5837dfc27d40e4cdf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 1.
W20260709 12:58:43.373093  1478 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:58:43.375826  1644 leader_election.cc:304] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:58:43.373982  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:58:43.377408  1801 raft_consensus.cc:2804] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:43.377882  1801 raft_consensus.cc:697] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:58:43.378981  1801 consensus_queue.cc:237] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:43.383687  1723 raft_consensus.cc:359] T 4ea41c88222b469fb11229faef735050 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:43.385026  1723 raft_consensus.cc:385] T 4ea41c88222b469fb11229faef735050 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:43.385607  1723 raft_consensus.cc:740] T 4ea41c88222b469fb11229faef735050 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Initialized, Role: FOLLOWER
I20260709 12:58:43.386165  1723 consensus_queue.cc:260] T 4ea41c88222b469fb11229faef735050 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:43.388504  1723 ts_tablet_manager.cc:1434] T 4ea41c88222b469fb11229faef735050 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 12:58:43.387997  1428 catalog_manager.cc:5697] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 reported cstate change: term changed from 0 to 1, leader changed from <none> to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:43.389031  1721 tablet_bootstrap.cc:654] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:43.389569  1723 tablet_bootstrap.cc:492] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Bootstrap starting.
W20260709 12:58:43.394266  1646 leader_election.cc:343] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:43.406459  1723 tablet_bootstrap.cc:654] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:43.411830  1429 catalog_manager.cc:5697] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 reported cstate change: term changed from 0 to 1, leader changed from <none> to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:43.428093  1722 tablet_bootstrap.cc:492] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90: No bootstrap required, opened a new log
I20260709 12:58:43.428596  1722 ts_tablet_manager.cc:1403] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90: Time spent bootstrapping tablet: real 0.080s	user 0.013s	sys 0.014s
I20260709 12:58:43.431819  1722 raft_consensus.cc:359] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:43.432479  1600 raft_consensus.cc:3060] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:43.432535  1722 raft_consensus.cc:385] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:43.433362  1722 raft_consensus.cc:740] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Initialized, Role: FOLLOWER
I20260709 12:58:43.434262  1722 consensus_queue.cc:260] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:43.436473  1722 ts_tablet_manager.cc:1434] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:58:43.437516  1722 tablet_bootstrap.cc:492] T 317204271cc04f68818b36450c9725b1 P ddf11fc190dd4b898773379c6b129d90: Bootstrap starting.
I20260709 12:58:43.443545  2012 consensus_queue.cc:1048] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:43.466640  2020 raft_consensus.cc:493] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:43.467185  2020 raft_consensus.cc:515] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:43.469187  2020 leader_election.cc:290] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:43.471333  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:58:43.472000  1603 raft_consensus.cc:2468] T e78618eba8b74effa4a90f2c8e34cc02 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 0.
I20260709 12:58:43.473484  1497 leader_election.cc:304] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:58:43.474284  2061 raft_consensus.cc:2804] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:43.474624  2061 raft_consensus.cc:493] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:43.474973  2061 raft_consensus.cc:3060] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:43.475366  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:58:43.475950  1680 raft_consensus.cc:2468] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 0.
I20260709 12:58:43.496351  2061 raft_consensus.cc:515] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:43.501423  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:58:43.502147  1603 raft_consensus.cc:3060] T e78618eba8b74effa4a90f2c8e34cc02 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:43.518460  2012 consensus_queue.cc:1048] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:43.548168  2061 leader_election.cc:290] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:43.548372  1723 tablet_bootstrap.cc:492] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1: No bootstrap required, opened a new log
I20260709 12:58:43.549017  1723 ts_tablet_manager.cc:1403] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent bootstrapping tablet: real 0.160s	user 0.017s	sys 0.048s
I20260709 12:58:43.549643  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:58:43.550326  1677 raft_consensus.cc:3060] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:43.550920  1722 tablet_bootstrap.cc:654] T 317204271cc04f68818b36450c9725b1 P ddf11fc190dd4b898773379c6b129d90: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:43.552983  1723 raft_consensus.cc:359] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:43.553723  1723 raft_consensus.cc:385] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:43.554049  1723 raft_consensus.cc:740] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Initialized, Role: FOLLOWER
I20260709 12:58:43.554915  1723 consensus_queue.cc:260] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:43.558139  1723 ts_tablet_manager.cc:1434] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent starting tablet: real 0.009s	user 0.001s	sys 0.005s
I20260709 12:58:43.559191  1723 tablet_bootstrap.cc:492] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Bootstrap starting.
I20260709 12:58:43.561254  1721 tablet_bootstrap.cc:492] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642: No bootstrap required, opened a new log
I20260709 12:58:43.561702  1721 ts_tablet_manager.cc:1403] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642: Time spent bootstrapping tablet: real 0.201s	user 0.018s	sys 0.004s
I20260709 12:58:43.566112  1721 raft_consensus.cc:359] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:43.566887  1721 raft_consensus.cc:385] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:43.567162  1721 raft_consensus.cc:740] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Initialized, Role: FOLLOWER
I20260709 12:58:43.567545  1723 tablet_bootstrap.cc:654] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:43.567795  1721 consensus_queue.cc:260] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:43.569824  1721 ts_tablet_manager.cc:1434] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 12:58:43.571084  1721 tablet_bootstrap.cc:492] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642: Bootstrap starting.
I20260709 12:58:43.571913  1603 raft_consensus.cc:2468] T e78618eba8b74effa4a90f2c8e34cc02 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 1.
I20260709 12:58:43.573249  1497 leader_election.cc:304] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:58:43.559108  1677 raft_consensus.cc:2468] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 1.
I20260709 12:58:43.575793  1953 raft_consensus.cc:2804] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:43.576308  1953 raft_consensus.cc:697] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 12:58:43.577113  1953 consensus_queue.cc:237] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:43.579612  1721 tablet_bootstrap.cc:654] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:43.595350  1722 tablet_bootstrap.cc:492] T 317204271cc04f68818b36450c9725b1 P ddf11fc190dd4b898773379c6b129d90: No bootstrap required, opened a new log
I20260709 12:58:43.595875  1722 ts_tablet_manager.cc:1403] T 317204271cc04f68818b36450c9725b1 P ddf11fc190dd4b898773379c6b129d90: Time spent bootstrapping tablet: real 0.159s	user 0.029s	sys 0.041s
W20260709 12:58:43.598354  1496 consensus_peers.cc:597] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 -> Peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217): Couldn't send request to peer ddf11fc190dd4b898773379c6b129d90. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:43.598294  1722 raft_consensus.cc:359] T 317204271cc04f68818b36450c9725b1 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:43.599033  1722 raft_consensus.cc:385] T 317204271cc04f68818b36450c9725b1 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:43.599330  1722 raft_consensus.cc:740] T 317204271cc04f68818b36450c9725b1 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Initialized, Role: FOLLOWER
I20260709 12:58:43.600093  1722 consensus_queue.cc:260] T 317204271cc04f68818b36450c9725b1 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:43.602057  1722 ts_tablet_manager.cc:1434] T 317204271cc04f68818b36450c9725b1 P ddf11fc190dd4b898773379c6b129d90: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:58:43.603144  1722 tablet_bootstrap.cc:492] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90: Bootstrap starting.
I20260709 12:58:43.607023  1721 tablet_bootstrap.cc:492] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642: No bootstrap required, opened a new log
I20260709 12:58:43.607522  1721 ts_tablet_manager.cc:1403] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642: Time spent bootstrapping tablet: real 0.037s	user 0.013s	sys 0.004s
I20260709 12:58:43.607465  2061 raft_consensus.cc:493] T 4ea41c88222b469fb11229faef735050 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:43.608045  2061 raft_consensus.cc:515] T 4ea41c88222b469fb11229faef735050 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:43.608748  1722 tablet_bootstrap.cc:654] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:43.610037  2061 leader_election.cc:290] T 4ea41c88222b469fb11229faef735050 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:43.610877  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:58:43.611176  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 12:58:43.612715  1497 leader_election.cc:343] T 4ea41c88222b469fb11229faef735050 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:43.613067  1721 raft_consensus.cc:359] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:43.613674  1917 raft_consensus.cc:493] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:43.619390  1721 raft_consensus.cc:385] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:43.619746  1721 raft_consensus.cc:740] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Initialized, Role: FOLLOWER
W20260709 12:58:43.613243  1496 leader_election.cc:343] T 4ea41c88222b469fb11229faef735050 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:43.620705  1496 leader_election.cc:304] T 4ea41c88222b469fb11229faef735050 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:58:43.621753  1953 raft_consensus.cc:2749] T 4ea41c88222b469fb11229faef735050 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:43.622506  1721 consensus_queue.cc:260] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:43.623992  1801 raft_consensus.cc:493] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:43.624670  1721 ts_tablet_manager.cc:1434] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 12:58:43.624507  1801 raft_consensus.cc:515] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:43.625703  1721 tablet_bootstrap.cc:492] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642: Bootstrap starting.
I20260709 12:58:43.627830  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:58:43.628639  1525 raft_consensus.cc:2468] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 0.
I20260709 12:58:43.630141  1644 leader_election.cc:304] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:58:43.631261  1943 raft_consensus.cc:2804] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:43.631692  1943 raft_consensus.cc:493] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:43.632072  1721 tablet_bootstrap.cc:654] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:43.632066  1943 raft_consensus.cc:3060] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:43.633183  1429 catalog_manager.cc:5697] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:43.641176  1722 tablet_bootstrap.cc:492] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90: No bootstrap required, opened a new log
I20260709 12:58:43.641731  1722 ts_tablet_manager.cc:1403] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90: Time spent bootstrapping tablet: real 0.039s	user 0.022s	sys 0.010s
I20260709 12:58:43.644399  1722 raft_consensus.cc:359] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:43.645349  1722 raft_consensus.cc:385] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:43.645673  1722 raft_consensus.cc:740] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Initialized, Role: FOLLOWER
I20260709 12:58:43.646586  1722 consensus_queue.cc:260] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:43.647445  1991 raft_consensus.cc:493] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:43.647861  1991 raft_consensus.cc:515] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:43.650377  1991 leader_election.cc:290] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:58:43.651381  1721 tablet_bootstrap.cc:492] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642: No bootstrap required, opened a new log
I20260709 12:58:43.651830  1721 ts_tablet_manager.cc:1403] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.004s
I20260709 12:58:43.651964  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:58:43.652616  1532 raft_consensus.cc:2468] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 0.
I20260709 12:58:43.654394  1644 leader_election.cc:304] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:58:43.664218  1721 raft_consensus.cc:359] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:43.664965  1721 raft_consensus.cc:385] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:43.665191  1721 raft_consensus.cc:740] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Initialized, Role: FOLLOWER
I20260709 12:58:43.665700  1721 consensus_queue.cc:260] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:43.666934  2078 raft_consensus.cc:2804] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:43.667441  2078 raft_consensus.cc:493] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:43.667641  1721 ts_tablet_manager.cc:1434] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.001s
I20260709 12:58:43.667910  2078 raft_consensus.cc:3060] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:43.668613  1721 tablet_bootstrap.cc:492] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642: Bootstrap starting.
I20260709 12:58:43.669277  1838 raft_consensus.cc:493] T 317204271cc04f68818b36450c9725b1 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:43.669785  1838 raft_consensus.cc:515] T 317204271cc04f68818b36450c9725b1 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:43.671934  1838 leader_election.cc:290] T 317204271cc04f68818b36450c9725b1 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:58:43.673632  1917 raft_consensus.cc:515] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:43.675014  1721 tablet_bootstrap.cc:654] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:43.675658  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:58:43.677037  1801 leader_election.cc:290] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:58:43.679234  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:58:43.680061  1603 raft_consensus.cc:2468] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 0.
I20260709 12:58:43.638266  1943 raft_consensus.cc:515] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:43.685550  1943 leader_election.cc:290] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:58:43.690186  1917 leader_election.cc:290] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:58:43.697427  2078 raft_consensus.cc:515] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:43.736390  2078 leader_election.cc:290] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:58:43.738540  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:58:43.739228  1606 raft_consensus.cc:3060] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:58:43.740450  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 63683us
I20260709 12:58:43.704658  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:58:43.721447  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:58:43.722853  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:58:43.730067  1953 consensus_queue.cc:1048] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:43.729969  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:58:43.742802  1603 raft_consensus.cc:2393] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 1: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 12:58:43.743510  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
W20260709 12:58:43.749043  1646 leader_election.cc:343] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:43.748383  1527 raft_consensus.cc:3060] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:43.752513  1722 ts_tablet_manager.cc:1434] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90: Time spent starting tablet: real 0.110s	user 0.007s	sys 0.028s
W20260709 12:58:43.758111  1646 leader_election.cc:343] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:58:43.758806  1646 leader_election.cc:343] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:43.790119  1646 leader_election.cc:304] T 317204271cc04f68818b36450c9725b1 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:58:43.786405  2009 raft_consensus.cc:493] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:43.794056  1722 tablet_bootstrap.cc:492] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90: Bootstrap starting.
I20260709 12:58:43.803488  1606 raft_consensus.cc:2468] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 1.
I20260709 12:58:43.806521  1723 tablet_bootstrap.cc:492] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1: No bootstrap required, opened a new log
I20260709 12:58:43.810355  1723 ts_tablet_manager.cc:1403] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent bootstrapping tablet: real 0.251s	user 0.052s	sys 0.050s
I20260709 12:58:43.812700  1721 tablet_bootstrap.cc:492] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642: No bootstrap required, opened a new log
I20260709 12:58:43.813246  1721 ts_tablet_manager.cc:1403] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642: Time spent bootstrapping tablet: real 0.145s	user 0.035s	sys 0.056s
I20260709 12:58:43.814142  1646 leader_election.cc:304] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:58:43.792856  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:58:43.815847  1917 raft_consensus.cc:2804] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:43.821053  1917 raft_consensus.cc:697] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
W20260709 12:58:43.821640  1644 leader_election.cc:343] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:43.821893  1917 consensus_queue.cc:237] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:43.816435  2080 consensus_queue.cc:1048] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:43.818339  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:58:43.822993  1526 raft_consensus.cc:3060] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:43.793874  2079 raft_consensus.cc:3060] T 317204271cc04f68818b36450c9725b1 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:43.822306  1644 leader_election.cc:304] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:58:43.827857  2080 raft_consensus.cc:2749] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:43.800138  2009 raft_consensus.cc:515] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:43.830029  2009 leader_election.cc:290] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:43.831522  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:58:43.831997  1527 raft_consensus.cc:2468] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 1.
W20260709 12:58:43.832962  1571 leader_election.cc:343] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:43.825965  1723 raft_consensus.cc:359] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:43.834465  1723 raft_consensus.cc:385] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:43.834820  1723 raft_consensus.cc:740] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Initialized, Role: FOLLOWER
I20260709 12:58:43.834875  1644 leader_election.cc:304] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 12:58:43.835551  1723 consensus_queue.cc:260] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:43.838528  1723 ts_tablet_manager.cc:1434] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 12:58:43.840765  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:58:43.839558  2082 raft_consensus.cc:2804] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:43.842881  1532 raft_consensus.cc:2468] T 822e65124bb44159b257fd219d28d93c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 0.
I20260709 12:58:43.849124  2082 raft_consensus.cc:697] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:58:43.850548  2079 raft_consensus.cc:2749] T 317204271cc04f68818b36450c9725b1 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:43.850126  2082 consensus_queue.cc:237] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:43.857299  1721 raft_consensus.cc:359] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:43.858073  1721 raft_consensus.cc:385] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:43.858084  1570 leader_election.cc:304] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 12:58:43.858423  1721 raft_consensus.cc:740] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Initialized, Role: FOLLOWER
I20260709 12:58:43.857359  1722 tablet_bootstrap.cc:654] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:43.859527  1721 consensus_queue.cc:260] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:43.859871  2009 raft_consensus.cc:2804] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:43.866693  2009 raft_consensus.cc:493] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:43.867074  2009 raft_consensus.cc:3060] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:43.867668  1723 tablet_bootstrap.cc:492] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1: Bootstrap starting.
I20260709 12:58:43.877665  1721 ts_tablet_manager.cc:1434] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642: Time spent starting tablet: real 0.064s	user 0.003s	sys 0.005s
I20260709 12:58:43.885820  1526 raft_consensus.cc:2468] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 1.
I20260709 12:58:43.892777  2082 consensus_queue.cc:1048] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:43.896056  2012 raft_consensus.cc:493] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:43.896543  2012 raft_consensus.cc:515] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:43.898342  2078 consensus_queue.cc:1048] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:43.899654  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:58:43.900496  1721 tablet_bootstrap.cc:492] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642: Bootstrap starting.
I20260709 12:58:43.899881  1723 tablet_bootstrap.cc:654] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:43.894263  1430 catalog_manager.cc:5697] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 reported cstate change: term changed from 0 to 1, leader changed from <none> to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:43.893920  2009 raft_consensus.cc:515] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:43.906868  2012 leader_election.cc:290] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:43.910921  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:58:43.921269  1570 leader_election.cc:304] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:58:43.922711  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
W20260709 12:58:43.924162  1571 leader_election.cc:343] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:43.924823  2083 raft_consensus.cc:2749] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:43.924947  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:58:43.933574  1532 raft_consensus.cc:3060] T 822e65124bb44159b257fd219d28d93c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:43.933862  2009 leader_election.cc:290] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:43.945525  1603 raft_consensus.cc:3060] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:43.959935  1532 raft_consensus.cc:2468] T 822e65124bb44159b257fd219d28d93c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 1.
I20260709 12:58:43.961552  1570 leader_election.cc:304] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 12:58:43.963229  1722 tablet_bootstrap.cc:492] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90: No bootstrap required, opened a new log
I20260709 12:58:43.963615  1722 ts_tablet_manager.cc:1403] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90: Time spent bootstrapping tablet: real 0.177s	user 0.016s	sys 0.004s
I20260709 12:58:43.966042  1430 catalog_manager.cc:5697] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 reported cstate change: term changed from 0 to 1, leader changed from <none> to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:43.968442  2009 raft_consensus.cc:2804] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:43.968981  2009 raft_consensus.cc:697] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:58:43.971191  2012 raft_consensus.cc:493] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:43.976234  2012 raft_consensus.cc:515] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:43.980885  2012 leader_election.cc:290] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:43.983139  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 12:58:43.984684  1570 leader_election.cc:343] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:43.984493  2009 consensus_queue.cc:237] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:43.983268  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:58:43.994401  1721 tablet_bootstrap.cc:654] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:44.001013  1723 tablet_bootstrap.cc:492] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1: No bootstrap required, opened a new log
I20260709 12:58:44.001600  1723 ts_tablet_manager.cc:1403] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent bootstrapping tablet: real 0.134s	user 0.019s	sys 0.003s
I20260709 12:58:44.001230  1722 raft_consensus.cc:359] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:44.002841  1722 raft_consensus.cc:385] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:44.003146  1722 raft_consensus.cc:740] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Initialized, Role: FOLLOWER
I20260709 12:58:44.003860  1722 consensus_queue.cc:260] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:44.004660  1680 raft_consensus.cc:2468] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 0.
I20260709 12:58:44.004611  1723 raft_consensus.cc:359] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:44.005455  1723 raft_consensus.cc:385] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:44.005717  1723 raft_consensus.cc:740] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Initialized, Role: FOLLOWER
I20260709 12:58:44.006446  1723 consensus_queue.cc:260] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:44.007439  1571 leader_election.cc:304] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:58:44.008250  2009 raft_consensus.cc:2804] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:44.008692  1723 ts_tablet_manager.cc:1434] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:58:44.008703  2009 raft_consensus.cc:493] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:44.009407  2009 raft_consensus.cc:3060] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:44.009871  1723 tablet_bootstrap.cc:492] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Bootstrap starting.
I20260709 12:58:44.013965  1722 ts_tablet_manager.cc:1434] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90: Time spent starting tablet: real 0.050s	user 0.005s	sys 0.001s
I20260709 12:58:44.015216  1722 tablet_bootstrap.cc:492] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90: Bootstrap starting.
I20260709 12:58:44.020385  1723 tablet_bootstrap.cc:654] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:44.023139  2009 raft_consensus.cc:515] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:44.029495  2009 leader_election.cc:290] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:44.029628  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:58:44.031761  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:58:44.032284  1428 catalog_manager.cc:5697] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 0 to 1, leader changed from <none> to 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } }
W20260709 12:58:44.033608  1570 leader_election.cc:343] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:44.032400  1917 consensus_queue.cc:1048] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:58:44.032433  1680 raft_consensus.cc:3060] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:44.044723  1722 tablet_bootstrap.cc:654] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:44.047335  1680 raft_consensus.cc:2468] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 1.
I20260709 12:58:44.049012  1571 leader_election.cc:304] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:58:44.050331  2012 raft_consensus.cc:2804] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:44.050990  2012 raft_consensus.cc:697] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:58:44.051885  2012 consensus_queue.cc:237] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:44.040695  1721 tablet_bootstrap.cc:492] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642: No bootstrap required, opened a new log
I20260709 12:58:44.056540  1721 ts_tablet_manager.cc:1403] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642: Time spent bootstrapping tablet: real 0.156s	user 0.009s	sys 0.007s
I20260709 12:58:44.059923  1721 raft_consensus.cc:359] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:44.062232  1723 tablet_bootstrap.cc:492] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1: No bootstrap required, opened a new log
I20260709 12:58:44.068837  1723 ts_tablet_manager.cc:1403] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent bootstrapping tablet: real 0.059s	user 0.015s	sys 0.006s
I20260709 12:58:44.072849  1721 raft_consensus.cc:385] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:44.079445  1721 raft_consensus.cc:740] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Initialized, Role: FOLLOWER
I20260709 12:58:44.081967  1721 consensus_queue.cc:260] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:44.084138  1721 ts_tablet_manager.cc:1434] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 12:58:44.071779  1723 raft_consensus.cc:359] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:44.086503  1723 raft_consensus.cc:385] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:44.086930  1723 raft_consensus.cc:740] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Initialized, Role: FOLLOWER
I20260709 12:58:44.088694  1723 consensus_queue.cc:260] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:44.090446  1723 ts_tablet_manager.cc:1434] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.000s
I20260709 12:58:44.091567  1723 tablet_bootstrap.cc:492] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1: Bootstrap starting.
I20260709 12:58:44.098801  1723 tablet_bootstrap.cc:654] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:44.087929  1721 tablet_bootstrap.cc:492] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642: Bootstrap starting.
I20260709 12:58:44.099702  1722 tablet_bootstrap.cc:492] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90: No bootstrap required, opened a new log
I20260709 12:58:44.100718  1722 ts_tablet_manager.cc:1403] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90: Time spent bootstrapping tablet: real 0.086s	user 0.040s	sys 0.014s
I20260709 12:58:44.103456  1722 raft_consensus.cc:359] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:44.104090  1722 raft_consensus.cc:385] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:44.104346  1722 raft_consensus.cc:740] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Initialized, Role: FOLLOWER
I20260709 12:58:44.104552  1721 tablet_bootstrap.cc:654] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:44.105131  1722 consensus_queue.cc:260] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:44.107473  1722 ts_tablet_manager.cc:1434] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:58:44.108482  1722 tablet_bootstrap.cc:492] T 2eadc97fd6dd494596f9ea9242d9db59 P ddf11fc190dd4b898773379c6b129d90: Bootstrap starting.
I20260709 12:58:44.110191  2061 consensus_queue.cc:1048] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:44.116446  1722 tablet_bootstrap.cc:654] T 2eadc97fd6dd494596f9ea9242d9db59 P ddf11fc190dd4b898773379c6b129d90: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:44.122179  1723 tablet_bootstrap.cc:492] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1: No bootstrap required, opened a new log
I20260709 12:58:44.124104  1723 ts_tablet_manager.cc:1403] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent bootstrapping tablet: real 0.033s	user 0.006s	sys 0.008s
I20260709 12:58:44.130612  1723 raft_consensus.cc:359] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:44.132534  1723 raft_consensus.cc:385] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:44.134382  1723 raft_consensus.cc:740] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Initialized, Role: FOLLOWER
I20260709 12:58:44.135905  1722 tablet_bootstrap.cc:492] T 2eadc97fd6dd494596f9ea9242d9db59 P ddf11fc190dd4b898773379c6b129d90: No bootstrap required, opened a new log
I20260709 12:58:44.136541  1722 ts_tablet_manager.cc:1403] T 2eadc97fd6dd494596f9ea9242d9db59 P ddf11fc190dd4b898773379c6b129d90: Time spent bootstrapping tablet: real 0.028s	user 0.013s	sys 0.010s
I20260709 12:58:44.136039  1723 consensus_queue.cc:260] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:44.142083  1723 ts_tablet_manager.cc:1434] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.002s
I20260709 12:58:44.143044  1723 tablet_bootstrap.cc:492] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Bootstrap starting.
I20260709 12:58:44.145653  1722 raft_consensus.cc:359] T 2eadc97fd6dd494596f9ea9242d9db59 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:44.146196  1722 raft_consensus.cc:385] T 2eadc97fd6dd494596f9ea9242d9db59 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:44.146391  1722 raft_consensus.cc:740] T 2eadc97fd6dd494596f9ea9242d9db59 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Initialized, Role: FOLLOWER
I20260709 12:58:44.147416  1722 consensus_queue.cc:260] T 2eadc97fd6dd494596f9ea9242d9db59 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:44.149587  1722 ts_tablet_manager.cc:1434] T 2eadc97fd6dd494596f9ea9242d9db59 P ddf11fc190dd4b898773379c6b129d90: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:58:44.150499  1722 tablet_bootstrap.cc:492] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90: Bootstrap starting.
I20260709 12:58:44.163899  2020 consensus_queue.cc:1048] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:44.172439  1428 catalog_manager.cc:5697] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 0 to 1, leader changed from <none> to 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:44.183367  1722 tablet_bootstrap.cc:654] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:44.184301  1721 tablet_bootstrap.cc:492] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642: No bootstrap required, opened a new log
I20260709 12:58:44.184856  1721 ts_tablet_manager.cc:1403] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642: Time spent bootstrapping tablet: real 0.097s	user 0.025s	sys 0.018s
I20260709 12:58:44.189541  2084 raft_consensus.cc:493] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:44.190084  2084 raft_consensus.cc:515] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:44.191823  2084 leader_election.cc:290] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:44.192543  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:58:44.196237  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:58:44.196345  1530 raft_consensus.cc:2468] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 0.
I20260709 12:58:44.196959  1676 raft_consensus.cc:2468] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 0.
I20260709 12:58:44.197871  1570 leader_election.cc:304] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:58:44.205231  1721 raft_consensus.cc:359] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:44.205936  1721 raft_consensus.cc:385] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:44.206192  1721 raft_consensus.cc:740] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Initialized, Role: FOLLOWER
I20260709 12:58:44.206853  2084 raft_consensus.cc:2804] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:44.207265  2084 raft_consensus.cc:493] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:44.207592  2084 raft_consensus.cc:3060] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:44.213150  1723 tablet_bootstrap.cc:654] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:44.216029  1721 consensus_queue.cc:260] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:44.218273  1721 ts_tablet_manager.cc:1434] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642: Time spent starting tablet: real 0.033s	user 0.003s	sys 0.002s
I20260709 12:58:44.219259  1721 tablet_bootstrap.cc:492] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642: Bootstrap starting.
I20260709 12:58:44.225769  2078 consensus_queue.cc:1048] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:44.228549  1721 tablet_bootstrap.cc:654] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:44.234630  2020 raft_consensus.cc:493] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:44.235176  2020 raft_consensus.cc:515] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:44.237239  2020 leader_election.cc:290] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:44.239441  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:58:44.240155  1604 raft_consensus.cc:2468] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 0.
I20260709 12:58:44.241727  1497 leader_election.cc:304] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:58:44.242825  1953 raft_consensus.cc:2804] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:44.243211  1953 raft_consensus.cc:493] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:44.243531  1953 raft_consensus.cc:3060] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:44.251623  1722 tablet_bootstrap.cc:492] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90: No bootstrap required, opened a new log
I20260709 12:58:44.251451  2078 consensus_queue.cc:1048] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:44.252110  1722 ts_tablet_manager.cc:1403] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90: Time spent bootstrapping tablet: real 0.102s	user 0.020s	sys 0.004s
I20260709 12:58:44.254705  1722 raft_consensus.cc:359] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:44.255357  1722 raft_consensus.cc:385] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:44.255626  1722 raft_consensus.cc:740] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Initialized, Role: FOLLOWER
I20260709 12:58:44.256263  1722 consensus_queue.cc:260] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:44.258322  1722 ts_tablet_manager.cc:1434] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:58:44.260242  1722 tablet_bootstrap.cc:492] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90: Bootstrap starting.
I20260709 12:58:44.265563  1723 tablet_bootstrap.cc:492] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1: No bootstrap required, opened a new log
I20260709 12:58:44.266064  1723 ts_tablet_manager.cc:1403] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent bootstrapping tablet: real 0.123s	user 0.025s	sys 0.000s
I20260709 12:58:44.268493  1723 raft_consensus.cc:359] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:44.269141  1723 raft_consensus.cc:385] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:44.269408  1723 raft_consensus.cc:740] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Initialized, Role: FOLLOWER
I20260709 12:58:44.269999  1723 consensus_queue.cc:260] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:44.271996  1723 ts_tablet_manager.cc:1434] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.002s
I20260709 12:58:44.272935  1723 tablet_bootstrap.cc:492] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1: Bootstrap starting.
I20260709 12:58:44.273681  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:58:44.274276  1680 raft_consensus.cc:2468] T 2eadc97fd6dd494596f9ea9242d9db59 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 0.
I20260709 12:58:44.276525  1722 tablet_bootstrap.cc:654] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:44.282650  1723 tablet_bootstrap.cc:654] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1: Neither blocks nor log segments found. Creating new log.
W20260709 12:58:44.284587  1646 consensus_peers.cc:597] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 -> Peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Couldn't send request to peer 39a92f5a4352465d8af3af5908fe8642. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:44.293953  1721 tablet_bootstrap.cc:492] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642: No bootstrap required, opened a new log
I20260709 12:58:44.294510  1721 ts_tablet_manager.cc:1403] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642: Time spent bootstrapping tablet: real 0.075s	user 0.010s	sys 0.005s
I20260709 12:58:44.297047  1721 raft_consensus.cc:359] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:44.297678  1721 raft_consensus.cc:385] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:44.297947  1721 raft_consensus.cc:740] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Initialized, Role: FOLLOWER
I20260709 12:58:44.298542  1721 consensus_queue.cc:260] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:44.300674  1721 ts_tablet_manager.cc:1434] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:58:44.301627  1721 tablet_bootstrap.cc:492] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642: Bootstrap starting.
I20260709 12:58:44.301432  1953 raft_consensus.cc:515] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:44.307528  1721 tablet_bootstrap.cc:654] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:44.312899  1722 tablet_bootstrap.cc:492] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90: No bootstrap required, opened a new log
I20260709 12:58:44.313349  1722 ts_tablet_manager.cc:1403] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90: Time spent bootstrapping tablet: real 0.053s	user 0.008s	sys 0.004s
I20260709 12:58:44.293887  2084 raft_consensus.cc:515] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:44.315819  1722 raft_consensus.cc:359] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:44.316460  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:58:44.317139  1677 raft_consensus.cc:3060] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:44.318250  1723 tablet_bootstrap.cc:492] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1: No bootstrap required, opened a new log
I20260709 12:58:44.316478  1722 raft_consensus.cc:385] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:44.320564  1722 raft_consensus.cc:740] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Initialized, Role: FOLLOWER
I20260709 12:58:44.318712  1723 ts_tablet_manager.cc:1403] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent bootstrapping tablet: real 0.046s	user 0.010s	sys 0.004s
I20260709 12:58:44.323094  1722 consensus_queue.cc:260] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:44.323437  1723 raft_consensus.cc:359] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:44.324175  1723 raft_consensus.cc:385] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:44.324491  1723 raft_consensus.cc:740] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Initialized, Role: FOLLOWER
I20260709 12:58:44.325163  1722 ts_tablet_manager.cc:1434] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:58:44.325153  1723 consensus_queue.cc:260] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:44.327095  1722 tablet_bootstrap.cc:492] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90: Bootstrap starting.
I20260709 12:58:44.327661  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:58:44.328222  1723 ts_tablet_manager.cc:1434] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:58:44.328298  1680 raft_consensus.cc:3060] T 2eadc97fd6dd494596f9ea9242d9db59 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:44.329450  1723 tablet_bootstrap.cc:492] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Bootstrap starting.
I20260709 12:58:44.334353  1722 tablet_bootstrap.cc:654] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:44.335264  1801 raft_consensus.cc:493] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:44.336347  1801 raft_consensus.cc:515] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:44.338039  1723 tablet_bootstrap.cc:654] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:44.338450  1801 leader_election.cc:290] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:58:44.334575  1680 raft_consensus.cc:2468] T 2eadc97fd6dd494596f9ea9242d9db59 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 1.
I20260709 12:58:44.342372  1496 leader_election.cc:304] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:58:44.343061  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 12:58:44.345070  1646 leader_election.cc:343] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:44.346264  1677 raft_consensus.cc:2468] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 1.
I20260709 12:58:44.347179  1571 leader_election.cc:304] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:58:44.347892  1846 raft_consensus.cc:2804] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:44.348372  1846 raft_consensus.cc:697] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:58:44.349139  1846 consensus_queue.cc:237] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:44.360559  2103 raft_consensus.cc:2804] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:44.362732  2103 raft_consensus.cc:697] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 12:58:44.363616  2103 consensus_queue.cc:237] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:44.364110  2061 raft_consensus.cc:493] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:44.364671  2061 raft_consensus.cc:515] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:44.363469  1429 catalog_manager.cc:5697] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 0 to 1, leader changed from <none> to 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:44.368505  2061 leader_election.cc:290] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:44.371482  1722 tablet_bootstrap.cc:492] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90: No bootstrap required, opened a new log
I20260709 12:58:44.372015  1722 ts_tablet_manager.cc:1403] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90: Time spent bootstrapping tablet: real 0.045s	user 0.026s	sys 0.015s
I20260709 12:58:44.372687  1723 tablet_bootstrap.cc:492] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1: No bootstrap required, opened a new log
I20260709 12:58:44.373123  1723 ts_tablet_manager.cc:1403] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent bootstrapping tablet: real 0.044s	user 0.002s	sys 0.012s
I20260709 12:58:44.376322  1723 raft_consensus.cc:359] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:44.376999  2084 leader_election.cc:290] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:44.377012  1723 raft_consensus.cc:385] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:44.378299  1723 raft_consensus.cc:740] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Initialized, Role: FOLLOWER
I20260709 12:58:44.378441  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:58:44.379074  1532 raft_consensus.cc:3060] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:44.379112  1723 consensus_queue.cc:260] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:44.381420  1723 ts_tablet_manager.cc:1434] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 12:58:44.382371  1723 tablet_bootstrap.cc:492] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Bootstrap starting.
I20260709 12:58:44.386014  1532 raft_consensus.cc:2468] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 1.
I20260709 12:58:44.374845  1722 raft_consensus.cc:359] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:44.387319  1722 raft_consensus.cc:385] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:44.387625  1722 raft_consensus.cc:740] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Initialized, Role: FOLLOWER
I20260709 12:58:44.387841  1723 tablet_bootstrap.cc:654] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:44.390358  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:58:44.322382  1953 leader_election.cc:290] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:44.390960  1722 consensus_queue.cc:260] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:44.393778  2020 raft_consensus.cc:493] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:44.394330  2020 raft_consensus.cc:515] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:44.396492  2020 leader_election.cc:290] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:44.396982  2020 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:44.397380  2020 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:44.398093  1722 ts_tablet_manager.cc:1434] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.000s
I20260709 12:58:44.399113  1722 tablet_bootstrap.cc:492] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90: Bootstrap starting.
I20260709 12:58:44.401497  2020 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:44.442077  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:58:44.442734  1603 raft_consensus.cc:3060] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:44.443500  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:58:44.445392  1722 tablet_bootstrap.cc:654] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:44.447669  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:58:44.448637  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:58:44.449268  1604 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 0.
I20260709 12:58:44.449754  1603 raft_consensus.cc:2468] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 1.
W20260709 12:58:44.453649  1496 leader_election.cc:343] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:44.456624  2061 raft_consensus.cc:493] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:44.457123  2061 raft_consensus.cc:515] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:44.459169  2061 leader_election.cc:290] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:44.462637  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:58:44.463332  1530 raft_consensus.cc:2468] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 0.
I20260709 12:58:44.465204  1917 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:44.465720  1917 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:44.468483  1917 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:58:44.473834  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:58:44.474457  1604 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 0.
I20260709 12:58:44.475641  1646 leader_election.cc:304] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:58:44.475982  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:58:44.476410  1917 raft_consensus.cc:2804] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:44.476823  1917 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:44.476866  1530 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 0.
I20260709 12:58:44.477212  1917 raft_consensus.cc:3060] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:44.484033  1721 tablet_bootstrap.cc:492] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642: No bootstrap required, opened a new log
I20260709 12:58:44.484711  1721 ts_tablet_manager.cc:1403] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642: Time spent bootstrapping tablet: real 0.183s	user 0.035s	sys 0.008s
W20260709 12:58:44.494598  1478 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:58:44.501516  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:58:44.503321  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:58:44.504055  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:58:44.506836  2078 raft_consensus.cc:493] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:44.507351  2078 raft_consensus.cc:515] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:44.507685  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:58:44.508438  1677 raft_consensus.cc:2393] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 1: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 12:58:44.509768  2078 leader_election.cc:290] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:58:44.511837  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:58:44.512567  1428 catalog_manager.cc:5697] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:44.531656  1644 leader_election.cc:304] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 12:58:44.532707  2079 raft_consensus.cc:2804] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:44.533130  2079 raft_consensus.cc:493] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:44.533476  2079 raft_consensus.cc:3060] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:44.536078  1721 raft_consensus.cc:359] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:44.537096  1721 raft_consensus.cc:385] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:44.537387  1721 raft_consensus.cc:740] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Initialized, Role: FOLLOWER
I20260709 12:58:44.540951  1801 consensus_queue.cc:1048] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:44.542630  1723 tablet_bootstrap.cc:492] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1: No bootstrap required, opened a new log
I20260709 12:58:44.543170  1723 ts_tablet_manager.cc:1403] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent bootstrapping tablet: real 0.161s	user 0.047s	sys 0.071s
I20260709 12:58:44.543043  1721 consensus_queue.cc:260] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:44.544534  1721 ts_tablet_manager.cc:1434] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642: Time spent starting tablet: real 0.059s	user 0.006s	sys 0.000s
I20260709 12:58:44.546078  1723 raft_consensus.cc:359] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:44.546792  1723 raft_consensus.cc:385] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:44.547055  1723 raft_consensus.cc:740] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Initialized, Role: FOLLOWER
I20260709 12:58:44.547683  1723 consensus_queue.cc:260] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:44.549440  1723 ts_tablet_manager.cc:1434] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.003s
W20260709 12:58:44.561221  1497 leader_election.cc:343] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:44.561810  1497 leader_election.cc:304] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
W20260709 12:58:44.579747  1496 leader_election.cc:343] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:58:44.580955  1497 leader_election.cc:343] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:44.582520  1721 tablet_bootstrap.cc:492] T 2228d923442c4e439f7f227db910dad8 P 39a92f5a4352465d8af3af5908fe8642: Bootstrap starting.
I20260709 12:58:44.547894  2079 raft_consensus.cc:515] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 12:58:44.594471  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 44617.9us
I20260709 12:58:44.604311  2079 leader_election.cc:290] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:58:44.593624  2061 raft_consensus.cc:2749] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:44.611428  1721 tablet_bootstrap.cc:654] T 2228d923442c4e439f7f227db910dad8 P 39a92f5a4352465d8af3af5908fe8642: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:44.612011  1846 raft_consensus.cc:493] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:44.613273  1846 raft_consensus.cc:515] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:44.623669  2082 raft_consensus.cc:493] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:44.624310  2082 raft_consensus.cc:515] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:44.641937  1497 leader_election.cc:304] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:58:44.644068  1846 leader_election.cc:290] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:44.654459  1722 tablet_bootstrap.cc:492] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90: No bootstrap required, opened a new log
I20260709 12:58:44.655054  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:58:44.656352  2020 raft_consensus.cc:2749] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:44.658458  1917 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:44.659678  1680 raft_consensus.cc:2393] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 1: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 12:58:44.655068  1722 ts_tablet_manager.cc:1403] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90: Time spent bootstrapping tablet: real 0.256s	user 0.035s	sys 0.067s
W20260709 12:58:44.694941  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 115098us
I20260709 12:58:44.696111  1497 leader_election.cc:304] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 12:58:44.699752  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:58:44.700177  2020 raft_consensus.cc:2804] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:44.700573  2020 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:44.700577  1679 raft_consensus.cc:2468] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 0.
I20260709 12:58:44.701015  2020 raft_consensus.cc:3060] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:44.701424  1680 raft_consensus.cc:3060] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:44.701740  1497 leader_election.cc:304] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:58:44.699695  1722 raft_consensus.cc:359] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:44.703578  2118 raft_consensus.cc:3060] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:44.711740  2082 leader_election.cc:290] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
W20260709 12:58:44.714594  1646 leader_election.cc:343] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:44.718056  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:58:44.718747  1606 raft_consensus.cc:2468] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 0.
I20260709 12:58:44.714375  2118 raft_consensus.cc:2749] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:44.720256  1722 raft_consensus.cc:385] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:44.720608  1722 raft_consensus.cc:740] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Initialized, Role: FOLLOWER
I20260709 12:58:44.720695  1917 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:58:44.722270  1722 consensus_queue.cc:260] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:44.722993  1571 leader_election.cc:304] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:58:44.723991  2124 raft_consensus.cc:2804] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:44.724368  2124 raft_consensus.cc:493] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:44.724936  1722 ts_tablet_manager.cc:1434] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.000s
I20260709 12:58:44.724717  2124 raft_consensus.cc:3060] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:44.729337  1722 tablet_bootstrap.cc:492] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90: Bootstrap starting.
I20260709 12:58:44.732728  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:58:44.733341  1606 raft_consensus.cc:3060] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:44.733747  2020 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:44.736200  2020 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:44.738930  1722 tablet_bootstrap.cc:654] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:44.739660  1606 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 1.
I20260709 12:58:44.741494  2009 raft_consensus.cc:493] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:44.741946  2009 raft_consensus.cc:515] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:44.743975  2009 leader_election.cc:290] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:44.743971  1846 consensus_queue.cc:1048] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:58:44.751192  1646 leader_election.cc:304] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:58:44.752710  1721 tablet_bootstrap.cc:492] T 2228d923442c4e439f7f227db910dad8 P 39a92f5a4352465d8af3af5908fe8642: No bootstrap required, opened a new log
I20260709 12:58:44.753198  1721 ts_tablet_manager.cc:1403] T 2228d923442c4e439f7f227db910dad8 P 39a92f5a4352465d8af3af5908fe8642: Time spent bootstrapping tablet: real 0.171s	user 0.011s	sys 0.001s
I20260709 12:58:44.755892  1721 raft_consensus.cc:359] T 2228d923442c4e439f7f227db910dad8 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:44.756294  2123 raft_consensus.cc:2804] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:44.756596  1721 raft_consensus.cc:385] T 2228d923442c4e439f7f227db910dad8 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:44.756692  2123 raft_consensus.cc:493] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:44.756907  1721 raft_consensus.cc:740] T 2228d923442c4e439f7f227db910dad8 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Initialized, Role: FOLLOWER
I20260709 12:58:44.757058  2123 raft_consensus.cc:3060] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:44.757601  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:58:44.758445  1530 raft_consensus.cc:2393] T 822e65124bb44159b257fd219d28d93c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 1: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 12:58:44.760983  2009 consensus_queue.cc:1048] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:44.763856  2123 raft_consensus.cc:515] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:44.764075  1846 consensus_queue.cc:1048] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:44.765967  2123 leader_election.cc:290] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:58:44.767017  1646 leader_election.cc:304] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:58:44.767729  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:58:44.768693  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:58:44.769222  2082 raft_consensus.cc:2804] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:44.769695  2082 raft_consensus.cc:697] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:58:44.770467  2082 consensus_queue.cc:237] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:44.772804  2020 raft_consensus.cc:493] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:44.773273  2020 raft_consensus.cc:515] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:44.775182  2020 leader_election.cc:290] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:44.778262  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:58:44.780320  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:58:44.780982  1675 raft_consensus.cc:2468] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 0.
I20260709 12:58:44.784559  1496 leader_election.cc:304] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:58:44.785923  1721 consensus_queue.cc:260] T 2228d923442c4e439f7f227db910dad8 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:44.788546  1721 ts_tablet_manager.cc:1434] T 2228d923442c4e439f7f227db910dad8 P 39a92f5a4352465d8af3af5908fe8642: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.000s
I20260709 12:58:44.789791  1721 tablet_bootstrap.cc:492] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642: Bootstrap starting.
I20260709 12:58:44.782414  2124 raft_consensus.cc:515] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:44.791437  1604 raft_consensus.cc:2393] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 1: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 12:58:44.791851  2126 raft_consensus.cc:2804] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:44.823905  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:58:44.824630  1532 raft_consensus.cc:3060] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:44.827702  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:58:44.828492  1526 raft_consensus.cc:2468] T 4ea41c88222b469fb11229faef735050 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 0.
I20260709 12:58:44.817394  2126 raft_consensus.cc:493] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:44.831990  1429 catalog_manager.cc:5697] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 reported cstate change: term changed from 0 to 1, leader changed from <none> to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } }
W20260709 12:58:44.835647  1633 tablet.cc:2406] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:58:44.840787  2124 leader_election.cc:290] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:44.846119  1721 tablet_bootstrap.cc:654] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:44.846997  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:58:44.847827  1526 raft_consensus.cc:2393] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 1: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 12:58:44.847940  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:58:44.849346  1679 raft_consensus.cc:2393] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 1: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 12:58:44.858282  1532 raft_consensus.cc:2468] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 1.
I20260709 12:58:44.835093  2126 raft_consensus.cc:3060] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:44.876833  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:58:44.877445  1532 raft_consensus.cc:3060] T 4ea41c88222b469fb11229faef735050 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:44.889744  1532 raft_consensus.cc:2468] T 4ea41c88222b469fb11229faef735050 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 1.
I20260709 12:58:44.898540  2126 raft_consensus.cc:515] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:44.913525  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:58:44.913657  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:58:44.915387  1607 raft_consensus.cc:2393] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 1: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 12:58:44.912415  1644 leader_election.cc:304] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:58:44.919518  1801 raft_consensus.cc:2749] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:44.934178  1721 tablet_bootstrap.cc:492] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642: No bootstrap required, opened a new log
I20260709 12:58:44.934628  1721 ts_tablet_manager.cc:1403] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642: Time spent bootstrapping tablet: real 0.145s	user 0.014s	sys 0.006s
I20260709 12:58:44.941376  1722 tablet_bootstrap.cc:492] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90: No bootstrap required, opened a new log
I20260709 12:58:44.941360  1953 raft_consensus.cc:493] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:44.943035  1953 raft_consensus.cc:515] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:44.944229  2126 leader_election.cc:290] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:44.945248  1953 leader_election.cc:290] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:44.949591  1721 raft_consensus.cc:359] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:44.952481  2103 consensus_queue.cc:1048] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:44.956678  1721 raft_consensus.cc:385] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:44.957062  1721 raft_consensus.cc:740] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Initialized, Role: FOLLOWER
I20260709 12:58:44.957788  1721 consensus_queue.cc:260] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 12:58:44.953258  1497 leader_election.cc:343] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:44.946543  1722 ts_tablet_manager.cc:1403] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90: Time spent bootstrapping tablet: real 0.217s	user 0.028s	sys 0.028s
I20260709 12:58:44.960361  1721 ts_tablet_manager.cc:1434] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642: Time spent starting tablet: real 0.025s	user 0.001s	sys 0.005s
I20260709 12:58:44.961429  1721 tablet_bootstrap.cc:492] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642: Bootstrap starting.
I20260709 12:58:44.962070  1497 leader_election.cc:304] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:58:44.964273  1600 raft_consensus.cc:3060] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:44.968526  2122 consensus_queue.cc:1048] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:44.973892  2103 raft_consensus.cc:2749] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:58:44.976130  1722 raft_consensus.cc:359] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:44.980535  1722 raft_consensus.cc:385] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:44.980216  1953 consensus_queue.cc:1048] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:44.980878  1722 raft_consensus.cc:740] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Initialized, Role: FOLLOWER
I20260709 12:58:44.981593  1722 consensus_queue.cc:260] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:44.978823  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:58:44.954612  1644 leader_election.cc:304] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 12:58:44.980242  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:58:44.967036  1721 tablet_bootstrap.cc:654] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:44.986881  2078 raft_consensus.cc:2804] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:44.989923  2078 raft_consensus.cc:697] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:58:44.986927  1680 raft_consensus.cc:3060] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:44.991907  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 12:58:44.987149  1496 leader_election.cc:343] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:44.992623  1530 raft_consensus.cc:2393] T 4ea41c88222b469fb11229faef735050 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 1: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 12:58:44.993052  2078 consensus_queue.cc:237] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:45.000823  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:58:45.005337  1680 raft_consensus.cc:2468] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 1.
I20260709 12:58:45.006553  1496 leader_election.cc:304] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:58:45.007412  2139 raft_consensus.cc:2804] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:44.988454  1722 ts_tablet_manager.cc:1434] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260709 12:58:45.008072  2139 raft_consensus.cc:697] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 12:58:45.008527  1722 tablet_bootstrap.cc:492] T 83ed1c1e27234d98ba5eeb14457a4ee2 P ddf11fc190dd4b898773379c6b129d90: Bootstrap starting.
I20260709 12:58:44.986644  1644 leader_election.cc:304] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 12:58:45.008868  2139 consensus_queue.cc:237] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:45.012600  1917 raft_consensus.cc:2804] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:45.013087  1917 raft_consensus.cc:697] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:58:45.016069  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:58:45.016902  1532 raft_consensus.cc:2393] T 4ea41c88222b469fb11229faef735050 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 1: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 12:58:45.014433  1917 consensus_queue.cc:237] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:45.019845  1846 raft_consensus.cc:493] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:45.020375  1846 raft_consensus.cc:515] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:45.022900  1846 leader_election.cc:290] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:45.024065  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 12:58:45.025260  1571 leader_election.cc:343] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:45.029649  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:58:45.031612  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:58:45.032351  1606 raft_consensus.cc:2468] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 0.
I20260709 12:58:45.055239  1570 leader_election.cc:304] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 12:58:45.059067  1497 leader_election.cc:343] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:45.060096  1497 leader_election.cc:304] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 12:58:45.064641  1721 tablet_bootstrap.cc:492] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642: No bootstrap required, opened a new log
I20260709 12:58:45.065065  1721 ts_tablet_manager.cc:1403] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642: Time spent bootstrapping tablet: real 0.104s	user 0.009s	sys 0.021s
I20260709 12:58:45.075372  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:58:45.061558  2138 raft_consensus.cc:2804] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:45.061908  2084 consensus_queue.cc:1048] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260709 12:58:45.080883  2138 raft_consensus.cc:493] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:45.094589  2138 raft_consensus.cc:3060] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:45.081835  1846 raft_consensus.cc:2749] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:58:45.104970  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 49825.8us
I20260709 12:58:45.107399  2084 consensus_queue.cc:1048] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:45.108986  1570 leader_election.cc:304] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:58:45.112699  1722 tablet_bootstrap.cc:654] T 83ed1c1e27234d98ba5eeb14457a4ee2 P ddf11fc190dd4b898773379c6b129d90: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:45.124341  2012 raft_consensus.cc:2749] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:58:45.121492  1429 catalog_manager.cc:5697] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 reported cstate change: term changed from 0 to 1, leader changed from <none> to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:45.140018  1721 raft_consensus.cc:359] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:45.150053  1721 raft_consensus.cc:385] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:45.152177  1721 raft_consensus.cc:740] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Initialized, Role: FOLLOWER
W20260709 12:58:45.163347  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 83499.3us
I20260709 12:58:45.185707  1428 catalog_manager.cc:5697] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:45.198169  1721 consensus_queue.cc:260] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:45.218073  1721 ts_tablet_manager.cc:1434] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642: Time spent starting tablet: real 0.153s	user 0.007s	sys 0.002s
I20260709 12:58:45.193322  2012 raft_consensus.cc:493] T 2228d923442c4e439f7f227db910dad8 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:45.217419  2138 raft_consensus.cc:515] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 12:58:45.256021  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 60957.5us
W20260709 12:58:45.263224  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 59178.5us
I20260709 12:58:45.233265  2012 raft_consensus.cc:515] T 2228d923442c4e439f7f227db910dad8 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 12:58:45.282795  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 71317us
I20260709 12:58:45.287971  1531 raft_consensus.cc:2393] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 1: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
W20260709 12:58:45.288681  2154 log.cc:927] Time spent T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:58:45.302876  2012 leader_election.cc:290] T 2228d923442c4e439f7f227db910dad8 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:45.298242  2138 leader_election.cc:290] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:45.307971  2155 raft_consensus.cc:493] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:45.308480  2155 raft_consensus.cc:515] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:45.312762  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:58:45.313424  1605 raft_consensus.cc:3060] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:45.320418  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:58:45.321291  1527 raft_consensus.cc:2393] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 1: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 12:58:45.322795  1722 tablet_bootstrap.cc:492] T 83ed1c1e27234d98ba5eeb14457a4ee2 P ddf11fc190dd4b898773379c6b129d90: No bootstrap required, opened a new log
I20260709 12:58:45.323328  1722 ts_tablet_manager.cc:1403] T 83ed1c1e27234d98ba5eeb14457a4ee2 P ddf11fc190dd4b898773379c6b129d90: Time spent bootstrapping tablet: real 0.315s	user 0.022s	sys 0.020s
I20260709 12:58:45.329075  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:58:45.330240  1603 raft_consensus.cc:2468] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 0.
I20260709 12:58:45.334434  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:58:45.340524  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:58:45.341464  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:58:45.345371  1646 leader_election.cc:304] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:58:45.342108  1531 raft_consensus.cc:2468] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 0.
I20260709 12:58:45.354184  2156 consensus_queue.cc:1048] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 12:58:45.355671  2137 raft_consensus.cc:2804] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:45.356139  2137 raft_consensus.cc:493] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:45.357986  1570 leader_election.cc:304] T 2228d923442c4e439f7f227db910dad8 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:58:45.358348  2137 raft_consensus.cc:3060] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:45.352484  1721 tablet_bootstrap.cc:492] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642: Bootstrap starting.
I20260709 12:58:45.312801  2155 leader_election.cc:290] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:58:45.359206  1570 leader_election.cc:304] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:58:45.347790  1605 raft_consensus.cc:2468] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 1.
I20260709 12:58:45.360141  2121 raft_consensus.cc:3060] T 2228d923442c4e439f7f227db910dad8 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:45.364456  2124 raft_consensus.cc:2749] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:45.375278  2121 raft_consensus.cc:2749] T 2228d923442c4e439f7f227db910dad8 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:45.379305  1497 leader_election.cc:304] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:58:45.381887  2160 raft_consensus.cc:2804] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:45.382526  2160 raft_consensus.cc:697] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 12:58:45.382819  2078 consensus_queue.cc:1048] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:58:45.386473  2160 consensus_queue.cc:237] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:45.386507  1721 tablet_bootstrap.cc:654] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:45.401156  2137 raft_consensus.cc:515] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:45.410451  2137 leader_election.cc:290] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
W20260709 12:58:45.411104  1496 leader_election.cc:343] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:45.411906  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:58:45.412523  1600 raft_consensus.cc:3060] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:45.415547  2158 consensus_queue.cc:1048] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:45.425068  1600 raft_consensus.cc:2468] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 1.
I20260709 12:58:45.426146  1646 leader_election.cc:304] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:58:45.426294  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:58:45.427728  2161 raft_consensus.cc:2804] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:45.428237  2161 raft_consensus.cc:697] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:58:45.426888  1528 raft_consensus.cc:3060] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:45.417062  1428 catalog_manager.cc:5697] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 reported cstate change: term changed from 0 to 1, leader changed from <none> to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:45.429033  2161 consensus_queue.cc:237] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:45.429920  2155 consensus_queue.cc:1048] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:45.435568  1721 tablet_bootstrap.cc:492] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642: No bootstrap required, opened a new log
I20260709 12:58:45.436105  1721 ts_tablet_manager.cc:1403] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642: Time spent bootstrapping tablet: real 0.084s	user 0.008s	sys 0.011s
I20260709 12:58:45.443598  1528 raft_consensus.cc:2468] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 1.
I20260709 12:58:45.444929  1721 raft_consensus.cc:359] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:45.445744  1721 raft_consensus.cc:385] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:45.446044  1721 raft_consensus.cc:740] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Initialized, Role: FOLLOWER
W20260709 12:58:45.458765  1497 consensus_peers.cc:597] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 -> Peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Couldn't send request to peer 39a92f5a4352465d8af3af5908fe8642. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:45.460156  1721 consensus_queue.cc:260] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:45.461802  1721 ts_tablet_manager.cc:1434] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642: Time spent starting tablet: real 0.025s	user 0.004s	sys 0.002s
I20260709 12:58:45.463277  1721 tablet_bootstrap.cc:492] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642: Bootstrap starting.
I20260709 12:58:45.470811  1721 tablet_bootstrap.cc:654] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:45.421684  1722 raft_consensus.cc:359] T 83ed1c1e27234d98ba5eeb14457a4ee2 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:45.474408  1722 raft_consensus.cc:385] T 83ed1c1e27234d98ba5eeb14457a4ee2 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:45.474757  1722 raft_consensus.cc:740] T 83ed1c1e27234d98ba5eeb14457a4ee2 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Initialized, Role: FOLLOWER
I20260709 12:58:45.475487  1722 consensus_queue.cc:260] T 83ed1c1e27234d98ba5eeb14457a4ee2 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:45.477185  1722 ts_tablet_manager.cc:1434] T 83ed1c1e27234d98ba5eeb14457a4ee2 P ddf11fc190dd4b898773379c6b129d90: Time spent starting tablet: real 0.154s	user 0.005s	sys 0.000s
I20260709 12:58:45.477952  1722 tablet_bootstrap.cc:492] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90: Bootstrap starting.
I20260709 12:58:45.481835  1721 tablet_bootstrap.cc:492] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642: No bootstrap required, opened a new log
I20260709 12:58:45.482327  1721 ts_tablet_manager.cc:1403] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642: Time spent bootstrapping tablet: real 0.020s	user 0.003s	sys 0.013s
I20260709 12:58:45.485076  1427 catalog_manager.cc:5697] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 reported cstate change: term changed from 0 to 1, leader changed from <none> to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:45.485108  1721 raft_consensus.cc:359] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:45.486503  1721 raft_consensus.cc:385] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:45.486825  1721 raft_consensus.cc:740] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Initialized, Role: FOLLOWER
I20260709 12:58:45.487447  1721 consensus_queue.cc:260] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:45.488883  1722 tablet_bootstrap.cc:654] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:45.489077  2155 consensus_queue.cc:1048] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:45.489831  1721 ts_tablet_manager.cc:1434] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:58:45.499989  1429 catalog_manager.cc:5697] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:45.506084  2123 raft_consensus.cc:493] T 83ed1c1e27234d98ba5eeb14457a4ee2 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:45.506623  2123 raft_consensus.cc:515] T 83ed1c1e27234d98ba5eeb14457a4ee2 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:45.509207  2123 leader_election.cc:290] T 83ed1c1e27234d98ba5eeb14457a4ee2 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:58:45.518638  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:58:45.521898  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:58:45.522540  1600 raft_consensus.cc:2393] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 1: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 12:58:45.528952  1646 leader_election.cc:304] T 83ed1c1e27234d98ba5eeb14457a4ee2 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:58:45.530352  2152 raft_consensus.cc:3060] T 83ed1c1e27234d98ba5eeb14457a4ee2 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:45.530509  1722 tablet_bootstrap.cc:492] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90: No bootstrap required, opened a new log
I20260709 12:58:45.531082  1722 ts_tablet_manager.cc:1403] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90: Time spent bootstrapping tablet: real 0.053s	user 0.015s	sys 0.000s
I20260709 12:58:45.533732  1722 raft_consensus.cc:359] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:45.534566  1722 raft_consensus.cc:385] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:45.534859  1722 raft_consensus.cc:740] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Initialized, Role: FOLLOWER
I20260709 12:58:45.535516  1722 consensus_queue.cc:260] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:45.537906  1722 ts_tablet_manager.cc:1434] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:58:45.540753  2152 raft_consensus.cc:2749] T 83ed1c1e27234d98ba5eeb14457a4ee2 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:45.574924  2152 consensus_queue.cc:1048] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:58:45.577970  1478 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:58:45.592684  2155 consensus_queue.cc:1048] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:45.804267  2127 raft_consensus.cc:493] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:45.804766  2127 raft_consensus.cc:515] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:45.806805  2127 leader_election.cc:290] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:45.808686  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:58:45.808905  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:58:45.811650  1570 leader_election.cc:304] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:58:45.812956  2127 raft_consensus.cc:2749] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:45.848148  2127 raft_consensus.cc:493] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:45.848596  2127 raft_consensus.cc:515] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:45.850234  2127 leader_election.cc:290] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:45.851871  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:58:45.851903  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:58:45.852697  1527 raft_consensus.cc:2468] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 0.
I20260709 12:58:45.852735  1678 raft_consensus.cc:2468] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 0.
I20260709 12:58:45.854300  1570 leader_election.cc:304] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:58:45.855423  2121 raft_consensus.cc:2804] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:45.855806  2121 raft_consensus.cc:493] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:45.856110  2121 raft_consensus.cc:3060] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:45.859428  2137 consensus_queue.cc:1048] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:45.862325  2121 raft_consensus.cc:515] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:45.865525  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:58:45.866174  1527 raft_consensus.cc:3060] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:45.867575  2121 leader_election.cc:290] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:45.868389  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:58:45.868961  1678 raft_consensus.cc:3060] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:45.877596  2152 consensus_queue.cc:1048] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:45.890333  1678 raft_consensus.cc:2468] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 1.
I20260709 12:58:45.898823  1527 raft_consensus.cc:2468] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 1.
I20260709 12:58:45.899345  1571 leader_election.cc:304] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:58:45.900169  2012 raft_consensus.cc:2804] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:45.900728  2012 raft_consensus.cc:697] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:58:45.901510  2012 consensus_queue.cc:237] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:45.907928  2139 consensus_queue.cc:1048] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:45.921957  1429 catalog_manager.cc:5697] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 0 to 1, leader changed from <none> to 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:45.927191  2158 consensus_queue.cc:1048] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:45.929358  1600 raft_consensus.cc:3060] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:46.029778   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:58:46.038468  2181 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:46.060858  2182 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:58:46.063403   431 server_base.cc:1061] running on GCE node
W20260709 12:58:46.063838  2184 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:58:46.066013   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:58:46.066398   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:58:46.066727   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601926066704 us; error 0 us; skew 500 ppm
I20260709 12:58:46.068401   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:58:46.072576   431 webserver.cc:533] Webserver started at http://127.0.107.196:43429/ using document root <none> and password file <none>
I20260709 12:58:46.073101   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:58:46.073318   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:58:46.073642   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:58:46.074998   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601891739070-431-0/minicluster-data/ts-3-root/instance:
uuid: "b96ce9cc496c49d7818fa983a17b062b"
format_stamp: "Formatted at 2026-07-09 12:58:46 on dist-test-slave-qzg2"
I20260709 12:58:46.080024   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:58:46.084436  2189 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:46.085345   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:58:46.085644   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601891739070-431-0/minicluster-data/ts-3-root
uuid: "b96ce9cc496c49d7818fa983a17b062b"
format_stamp: "Formatted at 2026-07-09 12:58:46 on dist-test-slave-qzg2"
I20260709 12:58:46.085913   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601891739070-431-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601891739070-431-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601891739070-431-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:58:46.111675   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:58:46.113336   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:58:46.116065   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:58:46.119282   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:58:46.119565   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:46.119856   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:58:46.120079   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:46.187216   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.196:37373
I20260709 12:58:46.187390  2251 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.196:37373 every 8 connection(s)
I20260709 12:58:46.196417   431 auto_leader_rebalancer-test.cc:384] add a tserver: b96ce9cc496c49d7818fa983a17b062b
I20260709 12:58:46.209726  2252 heartbeater.cc:344] Connected to a master server at 127.0.107.254:40423
I20260709 12:58:46.210104  2252 heartbeater.cc:461] Registering TS with master...
I20260709 12:58:46.210851  2252 heartbeater.cc:507] Master 127.0.107.254:40423 requested a full tablet report, sending...
I20260709 12:58:46.212881  1428 ts_manager.cc:194] Registered new tserver with Master: b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:58:46.214385  1428 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50074
I20260709 12:58:46.421450  2121 consensus_queue.cc:1048] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:46.436133  2127 consensus_queue.cc:1048] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:46.647267  1605 consensus_queue.cc:237] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:58:46.654757  1528 raft_consensus.cc:1275] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:46.658072  2012 consensus_queue.cc:1048] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:46.659309  1678 raft_consensus.cc:1275] T c1d40b53631d4998a9a462e3c91a3004 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:46.661090  2121 consensus_queue.cc:1048] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:58:46.674096  1572 consensus_peers.cc:597] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 -> Peer b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373): Couldn't send request to peer b96ce9cc496c49d7818fa983a17b062b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c1d40b53631d4998a9a462e3c91a3004. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:46.675035  2127 raft_consensus.cc:2955] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:58:46.677011  1527 raft_consensus.cc:2955] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:58:46.683795  1678 raft_consensus.cc:2955] T c1d40b53631d4998a9a462e3c91a3004 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:58:46.699946  1427 catalog_manager.cc:5697] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:58:46.723628  1678 consensus_queue.cc:237] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:58:46.737962  1527 raft_consensus.cc:1275] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:46.739261  1600 raft_consensus.cc:1275] T 64842f503da44f59896ed29b9edd3b29 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:46.739308  2137 consensus_queue.cc:1048] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:46.740649  2152 consensus_queue.cc:1048] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:58:46.749599  1646 consensus_peers.cc:597] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 -> Peer b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373): Couldn't send request to peer b96ce9cc496c49d7818fa983a17b062b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 64842f503da44f59896ed29b9edd3b29. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:46.751497  2152 raft_consensus.cc:2955] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:58:46.753058  1527 raft_consensus.cc:2955] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:58:46.753686  1605 raft_consensus.cc:2955] T 64842f503da44f59896ed29b9edd3b29 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:58:46.768675  1428 catalog_manager.cc:5697] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:58:46.769868  1678 consensus_queue.cc:237] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:58:46.779459  1605 raft_consensus.cc:1275] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:46.780004  1527 raft_consensus.cc:1275] T 7ba438a35d164c02a9840bbedeac6097 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:46.781383  2137 consensus_queue.cc:1048] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:58:46.782519  1646 consensus_peers.cc:597] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 -> Peer b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373): Couldn't send request to peer b96ce9cc496c49d7818fa983a17b062b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7ba438a35d164c02a9840bbedeac6097. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:46.782956  2152 consensus_queue.cc:1048] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:46.809002  2152 raft_consensus.cc:2955] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:58:46.812736  1527 raft_consensus.cc:2955] T 7ba438a35d164c02a9840bbedeac6097 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:58:46.815868  1600 raft_consensus.cc:2955] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:58:46.831195  1428 catalog_manager.cc:5697] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 reported cstate change: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:46.856981  1528 consensus_queue.cc:237] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:58:46.864298  1678 raft_consensus.cc:1275] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:46.865622  2139 consensus_queue.cc:1048] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:46.866808  1600 raft_consensus.cc:1275] T 770925e70faa4a16a275abd5282f5284 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:46.868347  2139 consensus_queue.cc:1048] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:46.875604  2061 raft_consensus.cc:2955] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:58:46.877877  1678 raft_consensus.cc:2955] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
W20260709 12:58:46.881062  1497 consensus_peers.cc:597] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 -> Peer b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373): Couldn't send request to peer b96ce9cc496c49d7818fa983a17b062b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 770925e70faa4a16a275abd5282f5284. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:46.900233  1428 catalog_manager.cc:5697] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 reported cstate change: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:58:46.907263  1600 raft_consensus.cc:2955] T 770925e70faa4a16a275abd5282f5284 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:58:47.075721  2283 ts_tablet_manager.cc:933] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b: Initiating tablet copy from peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:58:47.078419  2283 tablet_copy_client.cc:323] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:40303
I20260709 12:58:47.094538  1617 tablet_copy_service.cc:140] P 39a92f5a4352465d8af3af5908fe8642: Received BeginTabletCopySession request for tablet c1d40b53631d4998a9a462e3c91a3004 from peer b96ce9cc496c49d7818fa983a17b062b ({username='slave'} at 127.0.0.1:57268)
I20260709 12:58:47.095117  1617 tablet_copy_service.cc:161] P 39a92f5a4352465d8af3af5908fe8642: Beginning new tablet copy session on tablet c1d40b53631d4998a9a462e3c91a3004 from peer b96ce9cc496c49d7818fa983a17b062b at {username='slave'} at 127.0.0.1:57268: session id = b96ce9cc496c49d7818fa983a17b062b-c1d40b53631d4998a9a462e3c91a3004
I20260709 12:58:47.102856  1617 tablet_copy_source_session.cc:215] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:47.106554  2283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1d40b53631d4998a9a462e3c91a3004. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:47.123571  2283 tablet_copy_client.cc:806] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:47.124297  2283 tablet_copy_client.cc:670] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:47.130172  2283 tablet_copy_client.cc:538] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:47.138917  2283 tablet_bootstrap.cc:492] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap starting.
I20260709 12:58:47.156584  2283 tablet_bootstrap.cc:492] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:47.157363  2283 tablet_bootstrap.cc:492] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap complete.
I20260709 12:58:47.157905  2283 ts_tablet_manager.cc:1403] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.005s
I20260709 12:58:47.161073  2283 raft_consensus.cc:359] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:58:47.161947  2283 raft_consensus.cc:740] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Initialized, Role: LEARNER
I20260709 12:58:47.162639  2283 consensus_queue.cc:260] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:58:47.164876  2252 heartbeater.cc:499] Master 127.0.107.254:40423 was elected leader, sending a full tablet report...
I20260709 12:58:47.165352  2283 ts_tablet_manager.cc:1434] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.004s
I20260709 12:58:47.167606  1617 tablet_copy_service.cc:342] P 39a92f5a4352465d8af3af5908fe8642: Request end of tablet copy session b96ce9cc496c49d7818fa983a17b062b-c1d40b53631d4998a9a462e3c91a3004 received from {username='slave'} at 127.0.0.1:57268
I20260709 12:58:47.168072  1617 tablet_copy_service.cc:434] P 39a92f5a4352465d8af3af5908fe8642: ending tablet copy session b96ce9cc496c49d7818fa983a17b062b-c1d40b53631d4998a9a462e3c91a3004 on tablet c1d40b53631d4998a9a462e3c91a3004 with peer b96ce9cc496c49d7818fa983a17b062b
I20260709 12:58:47.281276  2283 ts_tablet_manager.cc:933] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b: Initiating tablet copy from peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:47.282855  2283 tablet_copy_client.cc:323] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:44217
I20260709 12:58:47.293753  1691 tablet_copy_service.cc:140] P ddf11fc190dd4b898773379c6b129d90: Received BeginTabletCopySession request for tablet 7ba438a35d164c02a9840bbedeac6097 from peer b96ce9cc496c49d7818fa983a17b062b ({username='slave'} at 127.0.0.1:50664)
I20260709 12:58:47.294363  1691 tablet_copy_service.cc:161] P ddf11fc190dd4b898773379c6b129d90: Beginning new tablet copy session on tablet 7ba438a35d164c02a9840bbedeac6097 from peer b96ce9cc496c49d7818fa983a17b062b at {username='slave'} at 127.0.0.1:50664: session id = b96ce9cc496c49d7818fa983a17b062b-7ba438a35d164c02a9840bbedeac6097
I20260709 12:58:47.302896  1691 tablet_copy_source_session.cc:215] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:47.310473  2283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ba438a35d164c02a9840bbedeac6097. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:47.323860  2283 tablet_copy_client.cc:806] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:47.324357  2283 tablet_copy_client.cc:670] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:47.327598  2283 tablet_copy_client.cc:538] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:47.336973  2283 tablet_bootstrap.cc:492] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap starting.
I20260709 12:58:47.351507  2290 ts_tablet_manager.cc:933] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b: Initiating tablet copy from peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:47.379380  2283 tablet_bootstrap.cc:492] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:47.380299  2283 tablet_bootstrap.cc:492] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap complete.
I20260709 12:58:47.386520  2290 tablet_copy_client.cc:323] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:44217
I20260709 12:58:47.388404  2283 ts_tablet_manager.cc:1403] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b: Time spent bootstrapping tablet: real 0.052s	user 0.025s	sys 0.004s
I20260709 12:58:47.389272  1691 tablet_copy_service.cc:140] P ddf11fc190dd4b898773379c6b129d90: Received BeginTabletCopySession request for tablet 64842f503da44f59896ed29b9edd3b29 from peer b96ce9cc496c49d7818fa983a17b062b ({username='slave'} at 127.0.0.1:50664)
I20260709 12:58:47.389791  1691 tablet_copy_service.cc:161] P ddf11fc190dd4b898773379c6b129d90: Beginning new tablet copy session on tablet 64842f503da44f59896ed29b9edd3b29 from peer b96ce9cc496c49d7818fa983a17b062b at {username='slave'} at 127.0.0.1:50664: session id = b96ce9cc496c49d7818fa983a17b062b-64842f503da44f59896ed29b9edd3b29
I20260709 12:58:47.393528  2283 raft_consensus.cc:359] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:58:47.394520  2283 raft_consensus.cc:740] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Initialized, Role: LEARNER
I20260709 12:58:47.395576  2283 consensus_queue.cc:260] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:58:47.397956  2283 ts_tablet_manager.cc:1434] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:58:47.401857  1690 tablet_copy_service.cc:342] P ddf11fc190dd4b898773379c6b129d90: Request end of tablet copy session b96ce9cc496c49d7818fa983a17b062b-7ba438a35d164c02a9840bbedeac6097 received from {username='slave'} at 127.0.0.1:50664
I20260709 12:58:47.402318  1690 tablet_copy_service.cc:434] P ddf11fc190dd4b898773379c6b129d90: ending tablet copy session b96ce9cc496c49d7818fa983a17b062b-7ba438a35d164c02a9840bbedeac6097 on tablet 7ba438a35d164c02a9840bbedeac6097 with peer b96ce9cc496c49d7818fa983a17b062b
I20260709 12:58:47.404067  1691 tablet_copy_source_session.cc:215] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:47.409030  2283 ts_tablet_manager.cc:933] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b: Initiating tablet copy from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931)
I20260709 12:58:47.409468  2290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64842f503da44f59896ed29b9edd3b29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:47.430925  2283 tablet_copy_client.cc:323] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:43931
I20260709 12:58:47.439592  2290 tablet_copy_client.cc:806] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:47.440421  2290 tablet_copy_client.cc:670] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:47.445103  2290 tablet_copy_client.cc:538] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:47.454146  2290 tablet_bootstrap.cc:492] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap starting.
I20260709 12:58:47.456496  1542 tablet_copy_service.cc:140] P e46412b3b0b44f01ad5c33d4cfe3d6b1: Received BeginTabletCopySession request for tablet 770925e70faa4a16a275abd5282f5284 from peer b96ce9cc496c49d7818fa983a17b062b ({username='slave'} at 127.0.0.1:49310)
I20260709 12:58:47.457162  1542 tablet_copy_service.cc:161] P e46412b3b0b44f01ad5c33d4cfe3d6b1: Beginning new tablet copy session on tablet 770925e70faa4a16a275abd5282f5284 from peer b96ce9cc496c49d7818fa983a17b062b at {username='slave'} at 127.0.0.1:49310: session id = b96ce9cc496c49d7818fa983a17b062b-770925e70faa4a16a275abd5282f5284
I20260709 12:58:47.466925  1542 tablet_copy_source_session.cc:215] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:47.470304  2283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 770925e70faa4a16a275abd5282f5284. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:47.473264  2290 tablet_bootstrap.cc:492] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:47.474174  2290 tablet_bootstrap.cc:492] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap complete.
I20260709 12:58:47.474869  2290 ts_tablet_manager.cc:1403] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.005s
I20260709 12:58:47.480409  2290 raft_consensus.cc:359] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:58:47.481220  2290 raft_consensus.cc:740] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Initialized, Role: LEARNER
I20260709 12:58:47.481834  2290 consensus_queue.cc:260] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:58:47.484006  2290 ts_tablet_manager.cc:1434] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b: Time spent starting tablet: real 0.009s	user 0.000s	sys 0.006s
I20260709 12:58:47.488587  1691 tablet_copy_service.cc:342] P ddf11fc190dd4b898773379c6b129d90: Request end of tablet copy session b96ce9cc496c49d7818fa983a17b062b-64842f503da44f59896ed29b9edd3b29 received from {username='slave'} at 127.0.0.1:50664
I20260709 12:58:47.489013  1691 tablet_copy_service.cc:434] P ddf11fc190dd4b898773379c6b129d90: ending tablet copy session b96ce9cc496c49d7818fa983a17b062b-64842f503da44f59896ed29b9edd3b29 on tablet 64842f503da44f59896ed29b9edd3b29 with peer b96ce9cc496c49d7818fa983a17b062b
I20260709 12:58:47.491961  2283 tablet_copy_client.cc:806] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:47.492645  2283 tablet_copy_client.cc:670] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:47.496763  2283 tablet_copy_client.cc:538] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:47.543795  2283 tablet_bootstrap.cc:492] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap starting.
I20260709 12:58:47.588260  2283 tablet_bootstrap.cc:492] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:47.589182  2283 tablet_bootstrap.cc:492] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap complete.
I20260709 12:58:47.589814  2283 ts_tablet_manager.cc:1403] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b: Time spent bootstrapping tablet: real 0.046s	user 0.015s	sys 0.011s
I20260709 12:58:47.592471  2283 raft_consensus.cc:359] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:58:47.593017  2283 raft_consensus.cc:740] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Initialized, Role: LEARNER
I20260709 12:58:47.594288  2283 consensus_queue.cc:260] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:58:47.595885  2283 ts_tablet_manager.cc:1434] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:58:47.597769  1542 tablet_copy_service.cc:342] P e46412b3b0b44f01ad5c33d4cfe3d6b1: Request end of tablet copy session b96ce9cc496c49d7818fa983a17b062b-770925e70faa4a16a275abd5282f5284 received from {username='slave'} at 127.0.0.1:49310
I20260709 12:58:47.598191  1542 tablet_copy_service.cc:434] P e46412b3b0b44f01ad5c33d4cfe3d6b1: ending tablet copy session b96ce9cc496c49d7818fa983a17b062b-770925e70faa4a16a275abd5282f5284 on tablet 770925e70faa4a16a275abd5282f5284 with peer b96ce9cc496c49d7818fa983a17b062b
I20260709 12:58:47.677073  2227 raft_consensus.cc:1217] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:58:47.704140  2227 raft_consensus.cc:1217] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:58:47.771023  2227 raft_consensus.cc:1217] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:58:47.807395  2227 raft_consensus.cc:1217] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:58:48.128737  2152 raft_consensus.cc:1064] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90: attempting to promote NON_VOTER b96ce9cc496c49d7818fa983a17b062b to VOTER
I20260709 12:58:48.131165  2152 consensus_queue.cc:237] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:58:48.140002  2227 raft_consensus.cc:1275] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:48.140604  1527 raft_consensus.cc:1275] T 7ba438a35d164c02a9840bbedeac6097 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:48.143972  2297 consensus_queue.cc:1048] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:48.145992  2297 consensus_queue.cc:1048] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:48.147866  1605 raft_consensus.cc:1275] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:48.149518  2137 consensus_queue.cc:1048] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:48.167398  2297 raft_consensus.cc:2955] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:48.172293  2227 raft_consensus.cc:2955] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:48.178457  1527 raft_consensus.cc:2955] T 7ba438a35d164c02a9840bbedeac6097 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:48.183895  1600 raft_consensus.cc:2955] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:48.186637  1427 catalog_manager.cc:5697] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:48.204995  2139 raft_consensus.cc:1064] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1: attempting to promote NON_VOTER b96ce9cc496c49d7818fa983a17b062b to VOTER
I20260709 12:58:48.209589  2139 consensus_queue.cc:237] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:58:48.238286  1600 raft_consensus.cc:1275] T 770925e70faa4a16a275abd5282f5284 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:48.236949  2227 raft_consensus.cc:1275] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:48.236945  1675 raft_consensus.cc:1275] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:48.242554  2308 consensus_queue.cc:1048] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:48.245779  2308 consensus_queue.cc:1048] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:48.249827  2308 consensus_queue.cc:1048] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:48.250316  2012 raft_consensus.cc:1064] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642: attempting to promote NON_VOTER b96ce9cc496c49d7818fa983a17b062b to VOTER
I20260709 12:58:48.252866  2012 consensus_queue.cc:237] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:58:48.265064  2152 raft_consensus.cc:1064] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90: attempting to promote NON_VOTER b96ce9cc496c49d7818fa983a17b062b to VOTER
I20260709 12:58:48.267940  2152 consensus_queue.cc:237] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:58:48.271678  2282 raft_consensus.cc:2955] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:48.274466  1678 raft_consensus.cc:2955] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:48.278767  1528 raft_consensus.cc:1275] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:48.279093  2226 raft_consensus.cc:1275] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:48.282815  1681 raft_consensus.cc:1275] T c1d40b53631d4998a9a462e3c91a3004 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:48.280259  1600 raft_consensus.cc:2955] T 770925e70faa4a16a275abd5282f5284 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:48.283082  2127 consensus_queue.cc:1048] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:48.283936  2226 raft_consensus.cc:2955] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:48.285108  2127 consensus_queue.cc:1048] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:48.285948  2121 consensus_queue.cc:1048] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:48.312529  2121 raft_consensus.cc:2955] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:48.328766  1604 raft_consensus.cc:1275] T 64842f503da44f59896ed29b9edd3b29 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:48.329222  1528 raft_consensus.cc:1275] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:48.332327  2301 consensus_queue.cc:1048] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:48.333786  2226 raft_consensus.cc:1275] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:48.334935  2152 consensus_queue.cc:1048] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:48.335114  1528 raft_consensus.cc:2955] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:48.335943  2137 consensus_queue.cc:1048] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:48.343057  2227 raft_consensus.cc:2955] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:48.341114  1429 catalog_manager.cc:5697] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:48.352314  1681 raft_consensus.cc:2955] T c1d40b53631d4998a9a462e3c91a3004 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:48.356980  1678 consensus_queue.cc:237] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:58:48.378345  2224 raft_consensus.cc:1275] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:48.380336  1604 raft_consensus.cc:1275] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:48.381865  1427 catalog_manager.cc:5697] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:48.387261  2298 consensus_queue.cc:1048] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:48.389207  2298 consensus_queue.cc:1048] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:48.400462  1528 consensus_queue.cc:237] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:58:48.404649  2298 raft_consensus.cc:2955] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:48.411473  1604 consensus_queue.cc:237] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:58:48.415962  1527 raft_consensus.cc:2955] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:48.417161  2227 raft_consensus.cc:1275] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:48.420557  2152 raft_consensus.cc:2955] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:48.423671  1681 raft_consensus.cc:1275] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:48.426712  2139 consensus_queue.cc:1048] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:48.427521  2282 consensus_queue.cc:1048] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:48.430902  2227 raft_consensus.cc:1275] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:48.435220  2012 consensus_queue.cc:1048] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:48.438077  1531 raft_consensus.cc:1275] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:48.437721  1600 raft_consensus.cc:2955] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:48.445698  2061 raft_consensus.cc:2955] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:48.468082  1415 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7ba438a35d164c02a9840bbedeac6097 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:48.469681  2127 raft_consensus.cc:2955] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:48.475653  1681 raft_consensus.cc:2955] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:48.504474  1429 catalog_manager.cc:5697] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 reported cstate change: config changed from index 3 to 4, VOTER e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:48.504961  1426 catalog_manager.cc:5697] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:48.523633  2227 raft_consensus.cc:2955] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:48.530573  1517 tablet_service.cc:1558] Processing DeleteTablet for tablet 7ba438a35d164c02a9840bbedeac6097 with delete_type TABLET_DATA_TOMBSTONED (TS e46412b3b0b44f01ad5c33d4cfe3d6b1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43004
I20260709 12:58:48.532078  1427 catalog_manager.cc:5697] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: config changed from index 3 to 4, VOTER ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:58:48.553794  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 78359.8us
I20260709 12:58:48.552451  1600 raft_consensus.cc:2955] T 64842f503da44f59896ed29b9edd3b29 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:48.574867  2226 raft_consensus.cc:2955] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:48.579094  2224 raft_consensus.cc:2955] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
W20260709 12:58:48.575766  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 126270us
I20260709 12:58:48.589891  1416 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c1d40b53631d4998a9a462e3c91a3004 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:48.591918  1414 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 770925e70faa4a16a275abd5282f5284 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:48.610841  1426 catalog_manager.cc:5697] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 reported cstate change: config changed from index 3 to 4, VOTER 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:48.615088  1664 tablet_service.cc:1558] Processing DeleteTablet for tablet c1d40b53631d4998a9a462e3c91a3004 with delete_type TABLET_DATA_TOMBSTONED (TS ddf11fc190dd4b898773379c6b129d90 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49162
I20260709 12:58:48.624612  2012 consensus_queue.cc:1048] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 12:58:48.634275  2328 tablet_replica.cc:333] T 7ba438a35d164c02a9840bbedeac6097 P e46412b3b0b44f01ad5c33d4cfe3d6b1: stopping tablet replica
I20260709 12:58:48.635797  2328 raft_consensus.cc:2243] T 7ba438a35d164c02a9840bbedeac6097 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:48.638211  2328 raft_consensus.cc:2272] T 7ba438a35d164c02a9840bbedeac6097 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:48.643741  2328 ts_tablet_manager.cc:1916] T 7ba438a35d164c02a9840bbedeac6097 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:48.649084  2226 raft_consensus.cc:2955] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:48.650297  2332 tablet_replica.cc:333] T c1d40b53631d4998a9a462e3c91a3004 P ddf11fc190dd4b898773379c6b129d90: stopping tablet replica
I20260709 12:58:48.651328  2332 raft_consensus.cc:2243] T c1d40b53631d4998a9a462e3c91a3004 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:58:48.666952  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 112157us
I20260709 12:58:48.670094  1594 tablet_service.cc:1558] Processing DeleteTablet for tablet 770925e70faa4a16a275abd5282f5284 with delete_type TABLET_DATA_TOMBSTONED (TS 39a92f5a4352465d8af3af5908fe8642 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36192
I20260709 12:58:48.681301  2337 tablet_replica.cc:333] T 770925e70faa4a16a275abd5282f5284 P 39a92f5a4352465d8af3af5908fe8642: stopping tablet replica
I20260709 12:58:48.689517  1678 consensus_queue.cc:237] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:58:48.690058  2337 raft_consensus.cc:2243] T 770925e70faa4a16a275abd5282f5284 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:48.695096  1525 raft_consensus.cc:2955] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:48.699219  2226 raft_consensus.cc:1275] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:48.700721  2330 consensus_queue.cc:1048] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:48.702297  2332 raft_consensus.cc:2272] T c1d40b53631d4998a9a462e3c91a3004 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:48.695999  2337 raft_consensus.cc:2272] T 770925e70faa4a16a275abd5282f5284 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:48.705090  1530 raft_consensus.cc:1275] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:48.709815  2337 ts_tablet_manager.cc:1916] T 770925e70faa4a16a275abd5282f5284 P 39a92f5a4352465d8af3af5908fe8642: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:48.712139  2298 raft_consensus.cc:2955] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:48.721418  2336 consensus_queue.cc:1048] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:48.728543  2332 ts_tablet_manager.cc:1916] T c1d40b53631d4998a9a462e3c91a3004 P ddf11fc190dd4b898773379c6b129d90: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:48.729328  2226 raft_consensus.cc:2955] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:48.743178  1429 catalog_manager.cc:5697] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: config changed from index 3 to 4, VOTER 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:48.746871  1525 raft_consensus.cc:2955] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:48.753260  1415 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 64842f503da44f59896ed29b9edd3b29 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:48.758172  2328 ts_tablet_manager.cc:1929] T 7ba438a35d164c02a9840bbedeac6097 P e46412b3b0b44f01ad5c33d4cfe3d6b1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:58:48.759198  2328 log.cc:1199] T 7ba438a35d164c02a9840bbedeac6097 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Deleting WAL directory at /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601891739070-431-0/minicluster-data/ts-0-root/wals/7ba438a35d164c02a9840bbedeac6097
I20260709 12:58:48.762419  1414 catalog_manager.cc:5028] TS e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): tablet 7ba438a35d164c02a9840bbedeac6097 (table test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]) successfully deleted
I20260709 12:58:48.765143  1594 tablet_service.cc:1558] Processing DeleteTablet for tablet 64842f503da44f59896ed29b9edd3b29 with delete_type TABLET_DATA_TOMBSTONED (TS 39a92f5a4352465d8af3af5908fe8642 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36192
I20260709 12:58:48.769495  2332 ts_tablet_manager.cc:1929] T c1d40b53631d4998a9a462e3c91a3004 P ddf11fc190dd4b898773379c6b129d90: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:58:48.769949  2332 log.cc:1199] T c1d40b53631d4998a9a462e3c91a3004 P ddf11fc190dd4b898773379c6b129d90: Deleting WAL directory at /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601891739070-431-0/minicluster-data/ts-2-root/wals/c1d40b53631d4998a9a462e3c91a3004
I20260709 12:58:48.772336  2337 ts_tablet_manager.cc:1929] T 770925e70faa4a16a275abd5282f5284 P 39a92f5a4352465d8af3af5908fe8642: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:58:48.772745  2337 log.cc:1199] T 770925e70faa4a16a275abd5282f5284 P 39a92f5a4352465d8af3af5908fe8642: Deleting WAL directory at /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601891739070-431-0/minicluster-data/ts-1-root/wals/770925e70faa4a16a275abd5282f5284
I20260709 12:58:48.774209  1415 catalog_manager.cc:5028] TS ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217): tablet c1d40b53631d4998a9a462e3c91a3004 (table test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]) successfully deleted
I20260709 12:58:48.775349  2337 tablet_replica.cc:333] T 64842f503da44f59896ed29b9edd3b29 P 39a92f5a4352465d8af3af5908fe8642: stopping tablet replica
I20260709 12:58:48.776383  1416 catalog_manager.cc:5028] TS 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): tablet 770925e70faa4a16a275abd5282f5284 (table test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]) successfully deleted
I20260709 12:58:48.796639  2337 raft_consensus.cc:2243] T 64842f503da44f59896ed29b9edd3b29 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:48.797216  2337 raft_consensus.cc:2272] T 64842f503da44f59896ed29b9edd3b29 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:48.799535  2337 ts_tablet_manager.cc:1916] T 64842f503da44f59896ed29b9edd3b29 P 39a92f5a4352465d8af3af5908fe8642: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:48.810793  2337 ts_tablet_manager.cc:1929] T 64842f503da44f59896ed29b9edd3b29 P 39a92f5a4352465d8af3af5908fe8642: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:58:48.811080  2337 log.cc:1199] T 64842f503da44f59896ed29b9edd3b29 P 39a92f5a4352465d8af3af5908fe8642: Deleting WAL directory at /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601891739070-431-0/minicluster-data/ts-1-root/wals/64842f503da44f59896ed29b9edd3b29
I20260709 12:58:48.812341  1416 catalog_manager.cc:5028] TS 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): tablet 64842f503da44f59896ed29b9edd3b29 (table test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]) successfully deleted
I20260709 12:58:49.837292  1527 consensus_queue.cc:237] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:58:49.846021  1678 raft_consensus.cc:1275] T 2eadc97fd6dd494596f9ea9242d9db59 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:58:49.847491  1497 consensus_peers.cc:597] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 -> Peer b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373): Couldn't send request to peer b96ce9cc496c49d7818fa983a17b062b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2eadc97fd6dd494596f9ea9242d9db59. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:49.847605  1605 raft_consensus.cc:1275] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:49.847635  2334 consensus_queue.cc:1048] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:49.849236  2061 consensus_queue.cc:1048] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:49.855451  2334 raft_consensus.cc:2955] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:58:49.859025  1604 raft_consensus.cc:2955] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:58:49.859184  1678 raft_consensus.cc:2955] T 2eadc97fd6dd494596f9ea9242d9db59 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:58:49.873687  1678 consensus_queue.cc:237] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:58:49.874315  1429 catalog_manager.cc:5697] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:58:49.884104  1646 consensus_peers.cc:597] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 -> Peer b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373): Couldn't send request to peer b96ce9cc496c49d7818fa983a17b062b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a1804adcd3844f5837dfc27d40e4cdf. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:49.885273  1604 raft_consensus.cc:1275] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:49.887132  1527 raft_consensus.cc:1275] T 8a1804adcd3844f5837dfc27d40e4cdf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:49.887359  2333 consensus_queue.cc:1048] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:49.889315  2333 consensus_queue.cc:1048] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:49.900492  1605 raft_consensus.cc:2955] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:58:49.898802  2346 raft_consensus.cc:2955] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:58:49.921802  1530 consensus_queue.cc:237] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:58:49.933646  1678 raft_consensus.cc:1275] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:49.934962  2061 consensus_queue.cc:1048] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:49.934872  1427 catalog_manager.cc:5697] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
W20260709 12:58:49.935789  1497 consensus_peers.cc:597] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 -> Peer b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373): Couldn't send request to peer b96ce9cc496c49d7818fa983a17b062b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 429fe651e8bc487eb6f07e38a7c3cb41. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:49.937911  1605 raft_consensus.cc:1275] T 429fe651e8bc487eb6f07e38a7c3cb41 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:49.942205  2061 consensus_queue.cc:1048] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:49.943053  1527 raft_consensus.cc:2955] T 8a1804adcd3844f5837dfc27d40e4cdf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:58:49.972572  2334 raft_consensus.cc:2955] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:58:49.974256  1678 raft_consensus.cc:2955] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:58:49.992038  1681 consensus_queue.cc:237] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:58:49.991825  1430 catalog_manager.cc:5697] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:49.993516  1604 raft_consensus.cc:2955] T 429fe651e8bc487eb6f07e38a7c3cb41 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:58:50.000181  1605 raft_consensus.cc:1275] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:50.001616  2352 consensus_queue.cc:1048] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:50.002843  1525 raft_consensus.cc:1275] T 4ea41c88222b469fb11229faef735050 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:58:50.007052  1646 consensus_peers.cc:597] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 -> Peer b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373): Couldn't send request to peer b96ce9cc496c49d7818fa983a17b062b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4ea41c88222b469fb11229faef735050. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:50.007916  2333 consensus_queue.cc:1048] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:50.017591  1527 raft_consensus.cc:2955] T 4ea41c88222b469fb11229faef735050 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:58:50.015920  2352 raft_consensus.cc:2955] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:58:50.028179  1604 raft_consensus.cc:2955] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:58:50.035974  1430 catalog_manager.cc:5697] T 4ea41c88222b469fb11229faef735050 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:58:50.359336  2358 ts_tablet_manager.cc:933] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b: Initiating tablet copy from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931)
I20260709 12:58:50.362854  2358 tablet_copy_client.cc:323] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:43931
I20260709 12:58:50.365116  1542 tablet_copy_service.cc:140] P e46412b3b0b44f01ad5c33d4cfe3d6b1: Received BeginTabletCopySession request for tablet 429fe651e8bc487eb6f07e38a7c3cb41 from peer b96ce9cc496c49d7818fa983a17b062b ({username='slave'} at 127.0.0.1:49310)
I20260709 12:58:50.365680  1542 tablet_copy_service.cc:161] P e46412b3b0b44f01ad5c33d4cfe3d6b1: Beginning new tablet copy session on tablet 429fe651e8bc487eb6f07e38a7c3cb41 from peer b96ce9cc496c49d7818fa983a17b062b at {username='slave'} at 127.0.0.1:49310: session id = b96ce9cc496c49d7818fa983a17b062b-429fe651e8bc487eb6f07e38a7c3cb41
I20260709 12:58:50.375288  1542 tablet_copy_source_session.cc:215] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:50.378746  2358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 429fe651e8bc487eb6f07e38a7c3cb41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:50.394842  2358 tablet_copy_client.cc:806] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:50.395483  2358 tablet_copy_client.cc:670] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:50.403199  2358 tablet_copy_client.cc:538] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:50.405941  2360 ts_tablet_manager.cc:933] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b: Initiating tablet copy from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931)
I20260709 12:58:50.411561  2360 tablet_copy_client.cc:323] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:43931
I20260709 12:58:50.413087  1542 tablet_copy_service.cc:140] P e46412b3b0b44f01ad5c33d4cfe3d6b1: Received BeginTabletCopySession request for tablet 2eadc97fd6dd494596f9ea9242d9db59 from peer b96ce9cc496c49d7818fa983a17b062b ({username='slave'} at 127.0.0.1:49310)
I20260709 12:58:50.413530  1542 tablet_copy_service.cc:161] P e46412b3b0b44f01ad5c33d4cfe3d6b1: Beginning new tablet copy session on tablet 2eadc97fd6dd494596f9ea9242d9db59 from peer b96ce9cc496c49d7818fa983a17b062b at {username='slave'} at 127.0.0.1:49310: session id = b96ce9cc496c49d7818fa983a17b062b-2eadc97fd6dd494596f9ea9242d9db59
I20260709 12:58:50.415596  2358 tablet_bootstrap.cc:492] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap starting.
I20260709 12:58:50.421937  1542 tablet_copy_source_session.cc:215] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:50.426540  2360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2eadc97fd6dd494596f9ea9242d9db59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:50.444308  2362 ts_tablet_manager.cc:933] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b: Initiating tablet copy from peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:50.454802  2358 tablet_bootstrap.cc:492] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:50.455668  2358 tablet_bootstrap.cc:492] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap complete.
I20260709 12:58:50.456310  2358 ts_tablet_manager.cc:1403] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b: Time spent bootstrapping tablet: real 0.041s	user 0.016s	sys 0.017s
I20260709 12:58:50.458259  2362 tablet_copy_client.cc:323] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:44217
I20260709 12:58:50.459756  2358 raft_consensus.cc:359] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:58:50.461347  2358 raft_consensus.cc:740] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Initialized, Role: LEARNER
I20260709 12:58:50.461506  2360 tablet_copy_client.cc:806] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:50.462114  2360 tablet_copy_client.cc:670] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:50.460373  1691 tablet_copy_service.cc:140] P ddf11fc190dd4b898773379c6b129d90: Received BeginTabletCopySession request for tablet 8a1804adcd3844f5837dfc27d40e4cdf from peer b96ce9cc496c49d7818fa983a17b062b ({username='slave'} at 127.0.0.1:50664)
I20260709 12:58:50.463502  1691 tablet_copy_service.cc:161] P ddf11fc190dd4b898773379c6b129d90: Beginning new tablet copy session on tablet 8a1804adcd3844f5837dfc27d40e4cdf from peer b96ce9cc496c49d7818fa983a17b062b at {username='slave'} at 127.0.0.1:50664: session id = b96ce9cc496c49d7818fa983a17b062b-8a1804adcd3844f5837dfc27d40e4cdf
I20260709 12:58:50.462051  2358 consensus_queue.cc:260] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:58:50.466574  2360 tablet_copy_client.cc:538] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:50.472951  1691 tablet_copy_source_session.cc:215] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:50.476331  2362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a1804adcd3844f5837dfc27d40e4cdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:50.494189  2358 ts_tablet_manager.cc:1434] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b: Time spent starting tablet: real 0.038s	user 0.017s	sys 0.013s
I20260709 12:58:50.496198  1542 tablet_copy_service.cc:342] P e46412b3b0b44f01ad5c33d4cfe3d6b1: Request end of tablet copy session b96ce9cc496c49d7818fa983a17b062b-429fe651e8bc487eb6f07e38a7c3cb41 received from {username='slave'} at 127.0.0.1:49310
I20260709 12:58:50.496644  1542 tablet_copy_service.cc:434] P e46412b3b0b44f01ad5c33d4cfe3d6b1: ending tablet copy session b96ce9cc496c49d7818fa983a17b062b-429fe651e8bc487eb6f07e38a7c3cb41 on tablet 429fe651e8bc487eb6f07e38a7c3cb41 with peer b96ce9cc496c49d7818fa983a17b062b
I20260709 12:58:50.501112  2360 tablet_bootstrap.cc:492] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap starting.
I20260709 12:58:50.505081  2358 ts_tablet_manager.cc:933] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b: Initiating tablet copy from peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:50.512303  2362 tablet_copy_client.cc:806] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:50.515379  2362 tablet_copy_client.cc:670] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:50.516264  2358 tablet_copy_client.cc:323] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:44217
I20260709 12:58:50.519995  1690 tablet_copy_service.cc:140] P ddf11fc190dd4b898773379c6b129d90: Received BeginTabletCopySession request for tablet 4ea41c88222b469fb11229faef735050 from peer b96ce9cc496c49d7818fa983a17b062b ({username='slave'} at 127.0.0.1:50664)
I20260709 12:58:50.520634  1690 tablet_copy_service.cc:161] P ddf11fc190dd4b898773379c6b129d90: Beginning new tablet copy session on tablet 4ea41c88222b469fb11229faef735050 from peer b96ce9cc496c49d7818fa983a17b062b at {username='slave'} at 127.0.0.1:50664: session id = b96ce9cc496c49d7818fa983a17b062b-4ea41c88222b469fb11229faef735050
I20260709 12:58:50.536108  2360 tablet_bootstrap.cc:492] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:50.536784  1690 tablet_copy_source_session.cc:215] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:50.537067  2360 tablet_bootstrap.cc:492] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap complete.
I20260709 12:58:50.537786  2360 ts_tablet_manager.cc:1403] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b: Time spent bootstrapping tablet: real 0.037s	user 0.014s	sys 0.009s
I20260709 12:58:50.540055  2358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ea41c88222b469fb11229faef735050. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:50.540264  2362 tablet_copy_client.cc:538] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:50.540740  2360 raft_consensus.cc:359] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:58:50.541534  2360 raft_consensus.cc:740] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Initialized, Role: LEARNER
I20260709 12:58:50.542183  2360 consensus_queue.cc:260] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:58:50.544658  2360 ts_tablet_manager.cc:1434] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 12:58:50.546379  1542 tablet_copy_service.cc:342] P e46412b3b0b44f01ad5c33d4cfe3d6b1: Request end of tablet copy session b96ce9cc496c49d7818fa983a17b062b-2eadc97fd6dd494596f9ea9242d9db59 received from {username='slave'} at 127.0.0.1:49310
I20260709 12:58:50.546797  1542 tablet_copy_service.cc:434] P e46412b3b0b44f01ad5c33d4cfe3d6b1: ending tablet copy session b96ce9cc496c49d7818fa983a17b062b-2eadc97fd6dd494596f9ea9242d9db59 on tablet 2eadc97fd6dd494596f9ea9242d9db59 with peer b96ce9cc496c49d7818fa983a17b062b
I20260709 12:58:50.556752  2362 tablet_bootstrap.cc:492] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b: Bootstrap starting.
I20260709 12:58:50.564836  2358 tablet_copy_client.cc:806] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:50.565739  2358 tablet_copy_client.cc:670] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:50.600692  2358 tablet_copy_client.cc:538] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:50.623778  2362 tablet_bootstrap.cc:492] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:50.624903  2362 tablet_bootstrap.cc:492] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b: Bootstrap complete.
I20260709 12:58:50.625672  2362 ts_tablet_manager.cc:1403] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b: Time spent bootstrapping tablet: real 0.069s	user 0.022s	sys 0.033s
I20260709 12:58:50.627938  2358 tablet_bootstrap.cc:492] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap starting.
I20260709 12:58:50.628099  2362 raft_consensus.cc:359] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:58:50.628823  2362 raft_consensus.cc:740] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Initialized, Role: LEARNER
I20260709 12:58:50.629670  2362 consensus_queue.cc:260] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:58:50.631949  2362 ts_tablet_manager.cc:1434] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.002s
I20260709 12:58:50.642239  1690 tablet_copy_service.cc:342] P ddf11fc190dd4b898773379c6b129d90: Request end of tablet copy session b96ce9cc496c49d7818fa983a17b062b-8a1804adcd3844f5837dfc27d40e4cdf received from {username='slave'} at 127.0.0.1:50664
I20260709 12:58:50.644008  1690 tablet_copy_service.cc:434] P ddf11fc190dd4b898773379c6b129d90: ending tablet copy session b96ce9cc496c49d7818fa983a17b062b-8a1804adcd3844f5837dfc27d40e4cdf on tablet 8a1804adcd3844f5837dfc27d40e4cdf with peer b96ce9cc496c49d7818fa983a17b062b
I20260709 12:58:50.695039  2358 tablet_bootstrap.cc:492] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:50.696020  2358 tablet_bootstrap.cc:492] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap complete.
I20260709 12:58:50.696736  2358 ts_tablet_manager.cc:1403] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b: Time spent bootstrapping tablet: real 0.069s	user 0.037s	sys 0.025s
I20260709 12:58:50.700070  2358 raft_consensus.cc:359] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:58:50.700925  2358 raft_consensus.cc:740] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Initialized, Role: LEARNER
I20260709 12:58:50.701622  2358 consensus_queue.cc:260] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:58:50.703976  2358 ts_tablet_manager.cc:1434] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 12:58:50.705734  1690 tablet_copy_service.cc:342] P ddf11fc190dd4b898773379c6b129d90: Request end of tablet copy session b96ce9cc496c49d7818fa983a17b062b-4ea41c88222b469fb11229faef735050 received from {username='slave'} at 127.0.0.1:50664
I20260709 12:58:50.706152  1690 tablet_copy_service.cc:434] P ddf11fc190dd4b898773379c6b129d90: ending tablet copy session b96ce9cc496c49d7818fa983a17b062b-4ea41c88222b469fb11229faef735050 on tablet 4ea41c88222b469fb11229faef735050 with peer b96ce9cc496c49d7818fa983a17b062b
I20260709 12:58:50.735594  2226 raft_consensus.cc:1217] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:58:50.947664  2226 raft_consensus.cc:1217] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:58:51.031705  2226 raft_consensus.cc:1217] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:58:51.088038  2226 raft_consensus.cc:1217] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:58:51.176292  2371 raft_consensus.cc:1064] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1: attempting to promote NON_VOTER b96ce9cc496c49d7818fa983a17b062b to VOTER
I20260709 12:58:51.178220  2371 consensus_queue.cc:237] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:58:51.196821  2226 raft_consensus.cc:1275] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:51.198197  1605 raft_consensus.cc:1275] T 429fe651e8bc487eb6f07e38a7c3cb41 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:51.199245  2331 consensus_queue.cc:1048] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:51.200500  2334 consensus_queue.cc:1048] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:51.205037  1678 raft_consensus.cc:1275] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:51.206701  2334 consensus_queue.cc:1048] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:51.233708  2331 raft_consensus.cc:2955] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:51.236040  2226 raft_consensus.cc:2955] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:51.244206  1605 raft_consensus.cc:2955] T 429fe651e8bc487eb6f07e38a7c3cb41 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:51.252501  1678 raft_consensus.cc:2955] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:51.256973  1427 catalog_manager.cc:5697] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:51.285645  1527 consensus_queue.cc:237] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:58:51.294339  1678 raft_consensus.cc:1275] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:51.294394  2226 raft_consensus.cc:1275] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:51.298825  2374 consensus_queue.cc:1048] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:51.300729  2374 consensus_queue.cc:1048] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:51.306517  1678 raft_consensus.cc:2955] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:51.305485  2331 raft_consensus.cc:2955] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:51.318128  2226 raft_consensus.cc:2955] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:51.323594  1429 catalog_manager.cc:5697] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 reported cstate change: config changed from index 3 to 4, VOTER 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:51.340705  1414 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 429fe651e8bc487eb6f07e38a7c3cb41 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:51.354430  1594 tablet_service.cc:1558] Processing DeleteTablet for tablet 429fe651e8bc487eb6f07e38a7c3cb41 with delete_type TABLET_DATA_TOMBSTONED (TS 39a92f5a4352465d8af3af5908fe8642 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36192
I20260709 12:58:51.371274  2383 tablet_replica.cc:333] T 429fe651e8bc487eb6f07e38a7c3cb41 P 39a92f5a4352465d8af3af5908fe8642: stopping tablet replica
I20260709 12:58:51.372279  2383 raft_consensus.cc:2243] T 429fe651e8bc487eb6f07e38a7c3cb41 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:51.372960  2383 raft_consensus.cc:2272] T 429fe651e8bc487eb6f07e38a7c3cb41 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:51.376291  2383 ts_tablet_manager.cc:1916] T 429fe651e8bc487eb6f07e38a7c3cb41 P 39a92f5a4352465d8af3af5908fe8642: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:51.378118  2371 raft_consensus.cc:1064] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1: attempting to promote NON_VOTER b96ce9cc496c49d7818fa983a17b062b to VOTER
I20260709 12:58:51.380700  2371 consensus_queue.cc:237] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:58:51.389219  2383 ts_tablet_manager.cc:1929] T 429fe651e8bc487eb6f07e38a7c3cb41 P 39a92f5a4352465d8af3af5908fe8642: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:58:51.389750  2383 log.cc:1199] T 429fe651e8bc487eb6f07e38a7c3cb41 P 39a92f5a4352465d8af3af5908fe8642: Deleting WAL directory at /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601891739070-431-0/minicluster-data/ts-1-root/wals/429fe651e8bc487eb6f07e38a7c3cb41
I20260709 12:58:51.391498  1416 catalog_manager.cc:5028] TS 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): tablet 429fe651e8bc487eb6f07e38a7c3cb41 (table test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]) successfully deleted
I20260709 12:58:51.394163  2226 raft_consensus.cc:1275] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:51.396077  1678 raft_consensus.cc:1275] T 2eadc97fd6dd494596f9ea9242d9db59 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:51.397948  2374 consensus_queue.cc:1048] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:51.399811  2374 consensus_queue.cc:1048] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:51.404985  1605 raft_consensus.cc:1275] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:51.407052  2331 consensus_queue.cc:1048] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:51.428643  2371 raft_consensus.cc:2955] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:51.431695  2226 raft_consensus.cc:2955] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:51.433831  1604 raft_consensus.cc:2955] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:51.441614  1678 raft_consensus.cc:2955] T 2eadc97fd6dd494596f9ea9242d9db59 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:51.446363  1429 catalog_manager.cc:5697] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:51.483632  1525 consensus_queue.cc:237] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:58:51.489390  2226 raft_consensus.cc:1275] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:51.491031  1605 raft_consensus.cc:1275] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:51.494262  2346 raft_consensus.cc:1064] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90: attempting to promote NON_VOTER b96ce9cc496c49d7818fa983a17b062b to VOTER
I20260709 12:58:51.493981  2371 consensus_queue.cc:1048] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:51.496599  2374 consensus_queue.cc:1048] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:51.496794  2346 consensus_queue.cc:237] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:58:51.513247  1604 raft_consensus.cc:1275] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:51.513514  2226 raft_consensus.cc:1275] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:51.515003  2352 consensus_queue.cc:1048] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:51.517016  2352 consensus_queue.cc:1048] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:51.530435  1528 raft_consensus.cc:1275] T 8a1804adcd3844f5837dfc27d40e4cdf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:51.531567  1604 raft_consensus.cc:2955] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:51.530539  2371 raft_consensus.cc:2955] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:51.543365  2369 consensus_queue.cc:1048] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:51.555848  2390 raft_consensus.cc:2955] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:51.559070  1429 catalog_manager.cc:5697] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: config changed from index 3 to 4, VOTER ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:51.562383  1414 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2eadc97fd6dd494596f9ea9242d9db59 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:51.560407  1605 raft_consensus.cc:2955] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:51.576356  1664 tablet_service.cc:1558] Processing DeleteTablet for tablet 2eadc97fd6dd494596f9ea9242d9db59 with delete_type TABLET_DATA_TOMBSTONED (TS ddf11fc190dd4b898773379c6b129d90 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49162
I20260709 12:58:51.578994  2226 raft_consensus.cc:2955] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:51.608666  1429 catalog_manager.cc:5697] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:51.615109  2394 tablet_replica.cc:333] T 2eadc97fd6dd494596f9ea9242d9db59 P ddf11fc190dd4b898773379c6b129d90: stopping tablet replica
I20260709 12:58:51.615981  2394 raft_consensus.cc:2243] T 2eadc97fd6dd494596f9ea9242d9db59 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:51.619988  2394 raft_consensus.cc:2272] T 2eadc97fd6dd494596f9ea9242d9db59 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:51.632359  2226 raft_consensus.cc:2955] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:51.636818  1678 consensus_queue.cc:237] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:58:51.644358  2394 ts_tablet_manager.cc:1916] T 2eadc97fd6dd494596f9ea9242d9db59 P ddf11fc190dd4b898773379c6b129d90: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:51.656018  1604 raft_consensus.cc:1275] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:51.657260  2369 consensus_queue.cc:1048] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:51.662218  2394 ts_tablet_manager.cc:1929] T 2eadc97fd6dd494596f9ea9242d9db59 P ddf11fc190dd4b898773379c6b129d90: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:58:51.664402  2352 raft_consensus.cc:2955] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:51.662767  2394 log.cc:1199] T 2eadc97fd6dd494596f9ea9242d9db59 P ddf11fc190dd4b898773379c6b129d90: Deleting WAL directory at /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601891739070-431-0/minicluster-data/ts-2-root/wals/2eadc97fd6dd494596f9ea9242d9db59
I20260709 12:58:51.669807  1415 catalog_manager.cc:5028] TS ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217): tablet 2eadc97fd6dd494596f9ea9242d9db59 (table test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]) successfully deleted
I20260709 12:58:51.665966  1604 raft_consensus.cc:2955] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:51.675110  2224 raft_consensus.cc:1275] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:51.677708  2369 consensus_queue.cc:1048] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:51.686059  2224 raft_consensus.cc:2955] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:51.693964  1528 raft_consensus.cc:2955] T 8a1804adcd3844f5837dfc27d40e4cdf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:51.700534  1427 catalog_manager.cc:5697] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b reported cstate change: config changed from index 3 to 4, VOTER e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:51.702701  1415 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8a1804adcd3844f5837dfc27d40e4cdf with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:51.720151  1517 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a1804adcd3844f5837dfc27d40e4cdf with delete_type TABLET_DATA_TOMBSTONED (TS e46412b3b0b44f01ad5c33d4cfe3d6b1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43004
I20260709 12:58:51.743743  2369 raft_consensus.cc:1064] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90: attempting to promote NON_VOTER b96ce9cc496c49d7818fa983a17b062b to VOTER
I20260709 12:58:51.746449  2396 tablet_replica.cc:333] T 8a1804adcd3844f5837dfc27d40e4cdf P e46412b3b0b44f01ad5c33d4cfe3d6b1: stopping tablet replica
I20260709 12:58:51.746441  2369 consensus_queue.cc:237] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:58:51.748631  2396 raft_consensus.cc:2243] T 8a1804adcd3844f5837dfc27d40e4cdf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:51.749895  2396 raft_consensus.cc:2272] T 8a1804adcd3844f5837dfc27d40e4cdf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:51.752851  2396 ts_tablet_manager.cc:1916] T 8a1804adcd3844f5837dfc27d40e4cdf P e46412b3b0b44f01ad5c33d4cfe3d6b1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:51.765692  2224 raft_consensus.cc:1275] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:51.765903  1605 raft_consensus.cc:1275] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:51.768261  1528 raft_consensus.cc:1275] T 4ea41c88222b469fb11229faef735050 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:51.769731  2346 consensus_queue.cc:1048] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:51.772432  2369 consensus_queue.cc:1048] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:51.774478  2396 ts_tablet_manager.cc:1929] T 8a1804adcd3844f5837dfc27d40e4cdf P e46412b3b0b44f01ad5c33d4cfe3d6b1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:58:51.775514  2396 log.cc:1199] T 8a1804adcd3844f5837dfc27d40e4cdf P e46412b3b0b44f01ad5c33d4cfe3d6b1: Deleting WAL directory at /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601891739070-431-0/minicluster-data/ts-0-root/wals/8a1804adcd3844f5837dfc27d40e4cdf
I20260709 12:58:51.777261  1414 catalog_manager.cc:5028] TS e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): tablet 8a1804adcd3844f5837dfc27d40e4cdf (table test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]) successfully deleted
I20260709 12:58:51.782506  2390 consensus_queue.cc:1048] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:51.792104  2369 raft_consensus.cc:2955] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:51.795198  1604 raft_consensus.cc:2955] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:51.811194  1528 raft_consensus.cc:2955] T 4ea41c88222b469fb11229faef735050 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:51.829223  2224 raft_consensus.cc:2955] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:51.833705  1429 catalog_manager.cc:5697] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:51.854815  1678 consensus_queue.cc:237] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:58:51.859957  2224 raft_consensus.cc:1275] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:51.859957  1604 raft_consensus.cc:1275] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:51.861445  2369 consensus_queue.cc:1048] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:51.862500  2390 consensus_queue.cc:1048] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:51.872675  2389 raft_consensus.cc:2955] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:51.874833  1604 raft_consensus.cc:2955] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:51.874727  2224 raft_consensus.cc:2955] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:51.884562  1415 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4ea41c88222b469fb11229faef735050 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:51.895169  1427 catalog_manager.cc:5697] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: config changed from index 3 to 4, VOTER e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:51.911732  1517 tablet_service.cc:1558] Processing DeleteTablet for tablet 4ea41c88222b469fb11229faef735050 with delete_type TABLET_DATA_TOMBSTONED (TS e46412b3b0b44f01ad5c33d4cfe3d6b1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43004
I20260709 12:58:51.912770  2396 tablet_replica.cc:333] T 4ea41c88222b469fb11229faef735050 P e46412b3b0b44f01ad5c33d4cfe3d6b1: stopping tablet replica
I20260709 12:58:51.914242  2396 raft_consensus.cc:2243] T 4ea41c88222b469fb11229faef735050 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:51.914954  2396 raft_consensus.cc:2272] T 4ea41c88222b469fb11229faef735050 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:51.917984  2396 ts_tablet_manager.cc:1916] T 4ea41c88222b469fb11229faef735050 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:51.929219  2396 ts_tablet_manager.cc:1929] T 4ea41c88222b469fb11229faef735050 P e46412b3b0b44f01ad5c33d4cfe3d6b1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:58:51.929522  2396 log.cc:1199] T 4ea41c88222b469fb11229faef735050 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Deleting WAL directory at /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601891739070-431-0/minicluster-data/ts-0-root/wals/4ea41c88222b469fb11229faef735050
I20260709 12:58:51.930919  1414 catalog_manager.cc:5028] TS e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): tablet 4ea41c88222b469fb11229faef735050 (table test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]) successfully deleted
I20260709 12:58:52.974699  1600 consensus_queue.cc:237] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:58:52.981976  1681 raft_consensus.cc:1275] T 2abb9a42c35f4b6386342bccdff6fbf0 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:52.981976  1528 raft_consensus.cc:1275] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:58:52.982545  1572 consensus_peers.cc:597] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 -> Peer b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373): Couldn't send request to peer b96ce9cc496c49d7818fa983a17b062b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2abb9a42c35f4b6386342bccdff6fbf0. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:52.983621  2403 consensus_queue.cc:1048] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:52.984613  2012 consensus_queue.cc:1048] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:52.992429  2012 raft_consensus.cc:2955] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:58:52.994290  1528 raft_consensus.cc:2955] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:58:53.008299  1678 raft_consensus.cc:2955] T 2abb9a42c35f4b6386342bccdff6fbf0 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:58:53.012373  1427 catalog_manager.cc:5697] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:58:53.019259  1600 consensus_queue.cc:237] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
W20260709 12:58:53.045583  1572 consensus_peers.cc:597] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 -> Peer b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373): Couldn't send request to peer b96ce9cc496c49d7818fa983a17b062b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 822e65124bb44159b257fd219d28d93c. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:53.046310  1528 raft_consensus.cc:1275] T 822e65124bb44159b257fd219d28d93c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:53.046463  1678 raft_consensus.cc:1275] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:53.048377  2012 consensus_queue.cc:1048] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:53.053593  2402 consensus_queue.cc:1048] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:53.070729  2012 raft_consensus.cc:2955] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:58:53.077003  1678 raft_consensus.cc:2955] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:58:53.083124  1525 raft_consensus.cc:2955] T 822e65124bb44159b257fd219d28d93c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:58:53.107686  1678 consensus_queue.cc:237] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
W20260709 12:58:53.119550  1646 consensus_peers.cc:597] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 -> Peer b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373): Couldn't send request to peer b96ce9cc496c49d7818fa983a17b062b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2228d923442c4e439f7f227db910dad8. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:53.121272  1600 raft_consensus.cc:1275] T 2228d923442c4e439f7f227db910dad8 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:53.123968  2346 consensus_queue.cc:1048] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:53.124387  1525 raft_consensus.cc:1275] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:53.126017  2369 consensus_queue.cc:1048] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:53.126223  1428 catalog_manager.cc:5697] T 822e65124bb44159b257fd219d28d93c P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:58:53.167116  2411 raft_consensus.cc:2955] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:58:53.169691  1527 raft_consensus.cc:2955] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:58:53.170425  1600 raft_consensus.cc:2955] T 2228d923442c4e439f7f227db910dad8 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:58:53.187412  1430 catalog_manager.cc:5697] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 reported cstate change: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:53.188849  1525 consensus_queue.cc:237] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:58:53.201896  1600 raft_consensus.cc:1275] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:58:53.203344  1497 consensus_peers.cc:597] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 -> Peer b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373): Couldn't send request to peer b96ce9cc496c49d7818fa983a17b062b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 83ed1c1e27234d98ba5eeb14457a4ee2. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:53.205363  2404 consensus_queue.cc:1048] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:53.219274  2371 raft_consensus.cc:2955] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:58:53.225492  1681 raft_consensus.cc:1275] T 83ed1c1e27234d98ba5eeb14457a4ee2 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:53.227972  2421 consensus_queue.cc:1048] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:53.226629  1604 raft_consensus.cc:2955] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:58:53.234143  1681 raft_consensus.cc:2955] T 83ed1c1e27234d98ba5eeb14457a4ee2 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:58:53.245421  1430 catalog_manager.cc:5697] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:58:53.470911  2424 ts_tablet_manager.cc:933] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b: Initiating tablet copy from peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:58:53.473887  2424 tablet_copy_client.cc:323] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:40303
I20260709 12:58:53.475960  1617 tablet_copy_service.cc:140] P 39a92f5a4352465d8af3af5908fe8642: Received BeginTabletCopySession request for tablet 2abb9a42c35f4b6386342bccdff6fbf0 from peer b96ce9cc496c49d7818fa983a17b062b ({username='slave'} at 127.0.0.1:57268)
I20260709 12:58:53.476447  1617 tablet_copy_service.cc:161] P 39a92f5a4352465d8af3af5908fe8642: Beginning new tablet copy session on tablet 2abb9a42c35f4b6386342bccdff6fbf0 from peer b96ce9cc496c49d7818fa983a17b062b at {username='slave'} at 127.0.0.1:57268: session id = b96ce9cc496c49d7818fa983a17b062b-2abb9a42c35f4b6386342bccdff6fbf0
I20260709 12:58:53.482697  1617 tablet_copy_source_session.cc:215] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:53.486083  2424 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2abb9a42c35f4b6386342bccdff6fbf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:53.501278  2424 tablet_copy_client.cc:806] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:53.501864  2424 tablet_copy_client.cc:670] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:53.506392  2424 tablet_copy_client.cc:538] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:53.509917  2426 ts_tablet_manager.cc:933] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b: Initiating tablet copy from peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:58:53.519861  2424 tablet_bootstrap.cc:492] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap starting.
I20260709 12:58:53.521174  2426 tablet_copy_client.cc:323] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:40303
I20260709 12:58:53.522918  1617 tablet_copy_service.cc:140] P 39a92f5a4352465d8af3af5908fe8642: Received BeginTabletCopySession request for tablet 822e65124bb44159b257fd219d28d93c from peer b96ce9cc496c49d7818fa983a17b062b ({username='slave'} at 127.0.0.1:57268)
I20260709 12:58:53.523465  1617 tablet_copy_service.cc:161] P 39a92f5a4352465d8af3af5908fe8642: Beginning new tablet copy session on tablet 822e65124bb44159b257fd219d28d93c from peer b96ce9cc496c49d7818fa983a17b062b at {username='slave'} at 127.0.0.1:57268: session id = b96ce9cc496c49d7818fa983a17b062b-822e65124bb44159b257fd219d28d93c
I20260709 12:58:53.528568  1617 tablet_copy_source_session.cc:215] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:53.531786  2428 ts_tablet_manager.cc:933] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b: Initiating tablet copy from peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:53.531934  2426 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 822e65124bb44159b257fd219d28d93c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:53.534329  2428 tablet_copy_client.cc:323] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:44217
I20260709 12:58:53.536505  1690 tablet_copy_service.cc:140] P ddf11fc190dd4b898773379c6b129d90: Received BeginTabletCopySession request for tablet 2228d923442c4e439f7f227db910dad8 from peer b96ce9cc496c49d7818fa983a17b062b ({username='slave'} at 127.0.0.1:50664)
I20260709 12:58:53.537124  1690 tablet_copy_service.cc:161] P ddf11fc190dd4b898773379c6b129d90: Beginning new tablet copy session on tablet 2228d923442c4e439f7f227db910dad8 from peer b96ce9cc496c49d7818fa983a17b062b at {username='slave'} at 127.0.0.1:50664: session id = b96ce9cc496c49d7818fa983a17b062b-2228d923442c4e439f7f227db910dad8
I20260709 12:58:53.552564  1690 tablet_copy_source_session.cc:215] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:53.559720  2428 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2228d923442c4e439f7f227db910dad8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:53.569173  2424 tablet_bootstrap.cc:492] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:53.570209  2424 tablet_bootstrap.cc:492] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap complete.
I20260709 12:58:53.570950  2424 ts_tablet_manager.cc:1403] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b: Time spent bootstrapping tablet: real 0.052s	user 0.025s	sys 0.004s
I20260709 12:58:53.575295  2424 raft_consensus.cc:359] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:58:53.576249  2424 raft_consensus.cc:740] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Initialized, Role: LEARNER
I20260709 12:58:53.576937  2424 consensus_queue.cc:260] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:58:53.581682  2428 tablet_copy_client.cc:806] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:53.582298  2428 tablet_copy_client.cc:670] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:53.586540  2428 tablet_copy_client.cc:538] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:53.592608  2424 ts_tablet_manager.cc:1434] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b: Time spent starting tablet: real 0.021s	user 0.012s	sys 0.007s
I20260709 12:58:53.594310  1617 tablet_copy_service.cc:342] P 39a92f5a4352465d8af3af5908fe8642: Request end of tablet copy session b96ce9cc496c49d7818fa983a17b062b-2abb9a42c35f4b6386342bccdff6fbf0 received from {username='slave'} at 127.0.0.1:57268
I20260709 12:58:53.594790  1617 tablet_copy_service.cc:434] P 39a92f5a4352465d8af3af5908fe8642: ending tablet copy session b96ce9cc496c49d7818fa983a17b062b-2abb9a42c35f4b6386342bccdff6fbf0 on tablet 2abb9a42c35f4b6386342bccdff6fbf0 with peer b96ce9cc496c49d7818fa983a17b062b
I20260709 12:58:53.613718  2428 tablet_bootstrap.cc:492] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap starting.
I20260709 12:58:53.616690  2426 tablet_copy_client.cc:806] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:53.617309  2426 tablet_copy_client.cc:670] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:53.648007  2426 tablet_copy_client.cc:538] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:53.657904  2428 tablet_bootstrap.cc:492] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:53.658878  2428 tablet_bootstrap.cc:492] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap complete.
I20260709 12:58:53.659564  2428 ts_tablet_manager.cc:1403] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b: Time spent bootstrapping tablet: real 0.046s	user 0.027s	sys 0.014s
I20260709 12:58:53.662636  2428 raft_consensus.cc:359] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:58:53.663570  2428 raft_consensus.cc:740] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Initialized, Role: LEARNER
I20260709 12:58:53.664196  2428 consensus_queue.cc:260] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:58:53.672971  2426 tablet_bootstrap.cc:492] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b: Bootstrap starting.
I20260709 12:58:53.680462  2428 ts_tablet_manager.cc:1434] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b: Time spent starting tablet: real 0.021s	user 0.002s	sys 0.006s
I20260709 12:58:53.683769  1690 tablet_copy_service.cc:342] P ddf11fc190dd4b898773379c6b129d90: Request end of tablet copy session b96ce9cc496c49d7818fa983a17b062b-2228d923442c4e439f7f227db910dad8 received from {username='slave'} at 127.0.0.1:50664
I20260709 12:58:53.684226  1690 tablet_copy_service.cc:434] P ddf11fc190dd4b898773379c6b129d90: ending tablet copy session b96ce9cc496c49d7818fa983a17b062b-2228d923442c4e439f7f227db910dad8 on tablet 2228d923442c4e439f7f227db910dad8 with peer b96ce9cc496c49d7818fa983a17b062b
I20260709 12:58:53.709030  2426 tablet_bootstrap.cc:492] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:53.710048  2426 tablet_bootstrap.cc:492] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b: Bootstrap complete.
I20260709 12:58:53.710814  2426 ts_tablet_manager.cc:1403] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b: Time spent bootstrapping tablet: real 0.038s	user 0.023s	sys 0.000s
I20260709 12:58:53.713622  2426 raft_consensus.cc:359] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:58:53.714218  2426 raft_consensus.cc:740] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Initialized, Role: LEARNER
I20260709 12:58:53.714748  2426 consensus_queue.cc:260] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:58:53.716519  2426 ts_tablet_manager.cc:1434] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:58:53.718325  1617 tablet_copy_service.cc:342] P 39a92f5a4352465d8af3af5908fe8642: Request end of tablet copy session b96ce9cc496c49d7818fa983a17b062b-822e65124bb44159b257fd219d28d93c received from {username='slave'} at 127.0.0.1:57268
I20260709 12:58:53.718755  1617 tablet_copy_service.cc:434] P 39a92f5a4352465d8af3af5908fe8642: ending tablet copy session b96ce9cc496c49d7818fa983a17b062b-822e65124bb44159b257fd219d28d93c on tablet 822e65124bb44159b257fd219d28d93c with peer b96ce9cc496c49d7818fa983a17b062b
I20260709 12:58:53.758216  2426 ts_tablet_manager.cc:933] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b: Initiating tablet copy from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931)
I20260709 12:58:53.759840  2426 tablet_copy_client.cc:323] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:43931
I20260709 12:58:53.761613  1542 tablet_copy_service.cc:140] P e46412b3b0b44f01ad5c33d4cfe3d6b1: Received BeginTabletCopySession request for tablet 83ed1c1e27234d98ba5eeb14457a4ee2 from peer b96ce9cc496c49d7818fa983a17b062b ({username='slave'} at 127.0.0.1:49310)
I20260709 12:58:53.762181  1542 tablet_copy_service.cc:161] P e46412b3b0b44f01ad5c33d4cfe3d6b1: Beginning new tablet copy session on tablet 83ed1c1e27234d98ba5eeb14457a4ee2 from peer b96ce9cc496c49d7818fa983a17b062b at {username='slave'} at 127.0.0.1:49310: session id = b96ce9cc496c49d7818fa983a17b062b-83ed1c1e27234d98ba5eeb14457a4ee2
I20260709 12:58:53.769693  1542 tablet_copy_source_session.cc:215] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:53.772275  2426 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83ed1c1e27234d98ba5eeb14457a4ee2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:53.785230  2426 tablet_copy_client.cc:806] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:53.785745  2426 tablet_copy_client.cc:670] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:53.789341  2426 tablet_copy_client.cc:538] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:53.797511  2426 tablet_bootstrap.cc:492] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap starting.
I20260709 12:58:53.815713  2426 tablet_bootstrap.cc:492] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:53.816689  2426 tablet_bootstrap.cc:492] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap complete.
I20260709 12:58:53.817353  2426 ts_tablet_manager.cc:1403] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.005s
I20260709 12:58:53.819543  2426 raft_consensus.cc:359] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:58:53.820274  2426 raft_consensus.cc:740] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Initialized, Role: LEARNER
I20260709 12:58:53.820907  2426 consensus_queue.cc:260] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:58:53.822729  2426 ts_tablet_manager.cc:1434] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:58:53.827126  1542 tablet_copy_service.cc:342] P e46412b3b0b44f01ad5c33d4cfe3d6b1: Request end of tablet copy session b96ce9cc496c49d7818fa983a17b062b-83ed1c1e27234d98ba5eeb14457a4ee2 received from {username='slave'} at 127.0.0.1:49310
I20260709 12:58:53.827603  1542 tablet_copy_service.cc:434] P e46412b3b0b44f01ad5c33d4cfe3d6b1: ending tablet copy session b96ce9cc496c49d7818fa983a17b062b-83ed1c1e27234d98ba5eeb14457a4ee2 on tablet 83ed1c1e27234d98ba5eeb14457a4ee2 with peer b96ce9cc496c49d7818fa983a17b062b
I20260709 12:58:53.905735  2224 raft_consensus.cc:1217] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:58:53.920738  2224 raft_consensus.cc:1217] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:58:54.048738  2224 raft_consensus.cc:1217] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:58:54.299176  2346 raft_consensus.cc:1064] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90: attempting to promote NON_VOTER b96ce9cc496c49d7818fa983a17b062b to VOTER
I20260709 12:58:54.301575  2346 consensus_queue.cc:237] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:58:54.307752  2224 raft_consensus.cc:1275] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:54.307833  1600 raft_consensus.cc:1275] T 2228d923442c4e439f7f227db910dad8 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:54.310459  1525 raft_consensus.cc:1275] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:54.309190  2346 consensus_queue.cc:1048] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:54.311645  2369 consensus_queue.cc:1048] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:54.315235  2432 consensus_queue.cc:1048] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:54.328076  2369 raft_consensus.cc:2955] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:54.333781  1525 raft_consensus.cc:2955] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:54.339973  1600 raft_consensus.cc:2955] T 2228d923442c4e439f7f227db910dad8 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:54.354261  2224 raft_consensus.cc:1217] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:58:54.358438  1428 catalog_manager.cc:5697] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:54.368287  2224 raft_consensus.cc:2955] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:54.397084  1678 consensus_queue.cc:237] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:58:54.403751  1525 raft_consensus.cc:1275] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:54.405136  2224 raft_consensus.cc:1275] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:54.405134  2346 consensus_queue.cc:1048] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:54.408370  2432 consensus_queue.cc:1048] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:54.416589  2369 raft_consensus.cc:2955] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:54.416977  1528 raft_consensus.cc:2955] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:54.428210  1415 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2228d923442c4e439f7f227db910dad8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:54.434646  1429 catalog_manager.cc:5697] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: config changed from index 3 to 4, VOTER 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:54.448952  2224 raft_consensus.cc:2955] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:54.467864  1594 tablet_service.cc:1558] Processing DeleteTablet for tablet 2228d923442c4e439f7f227db910dad8 with delete_type TABLET_DATA_TOMBSTONED (TS 39a92f5a4352465d8af3af5908fe8642 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36192
I20260709 12:58:54.502815  2447 tablet_replica.cc:333] T 2228d923442c4e439f7f227db910dad8 P 39a92f5a4352465d8af3af5908fe8642: stopping tablet replica
I20260709 12:58:54.506340  2012 raft_consensus.cc:1064] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642: attempting to promote NON_VOTER b96ce9cc496c49d7818fa983a17b062b to VOTER
I20260709 12:58:54.508611  2012 consensus_queue.cc:237] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:58:54.516732  2447 raft_consensus.cc:2243] T 2228d923442c4e439f7f227db910dad8 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:54.517434  2447 raft_consensus.cc:2272] T 2228d923442c4e439f7f227db910dad8 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:54.521152  2447 ts_tablet_manager.cc:1916] T 2228d923442c4e439f7f227db910dad8 P 39a92f5a4352465d8af3af5908fe8642: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:54.525556  2224 raft_consensus.cc:1275] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:54.527623  1678 raft_consensus.cc:1275] T 2abb9a42c35f4b6386342bccdff6fbf0 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:54.527415  2012 consensus_queue.cc:1048] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:54.527959  1527 raft_consensus.cc:1275] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:54.529515  2403 consensus_queue.cc:1048] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:54.530862  2012 consensus_queue.cc:1048] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:54.547051  2447 ts_tablet_manager.cc:1929] T 2228d923442c4e439f7f227db910dad8 P 39a92f5a4352465d8af3af5908fe8642: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:58:54.550959  2447 log.cc:1199] T 2228d923442c4e439f7f227db910dad8 P 39a92f5a4352465d8af3af5908fe8642: Deleting WAL directory at /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601891739070-431-0/minicluster-data/ts-1-root/wals/2228d923442c4e439f7f227db910dad8
I20260709 12:58:54.554177  1416 catalog_manager.cc:5028] TS 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): tablet 2228d923442c4e439f7f227db910dad8 (table test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]) successfully deleted
I20260709 12:58:54.552816  2403 raft_consensus.cc:2955] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:54.555585  1528 raft_consensus.cc:2955] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:54.556340  1681 raft_consensus.cc:2955] T 2abb9a42c35f4b6386342bccdff6fbf0 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:54.579562  1429 catalog_manager.cc:5697] T 2abb9a42c35f4b6386342bccdff6fbf0 P ddf11fc190dd4b898773379c6b129d90 reported cstate change: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:54.575484  2224 raft_consensus.cc:2955] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:54.602558  1605 consensus_queue.cc:237] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:58:54.615940  2224 raft_consensus.cc:1275] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:54.616508  1527 raft_consensus.cc:1275] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:54.617906  2453 consensus_queue.cc:1048] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:54.619449  2437 consensus_queue.cc:1048] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:54.627929  2403 raft_consensus.cc:2955] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:54.630501  2224 raft_consensus.cc:2955] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:54.633143  1528 raft_consensus.cc:2955] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:54.638813  1416 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2abb9a42c35f4b6386342bccdff6fbf0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:54.649008  1427 catalog_manager.cc:5697] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: config changed from index 3 to 4, VOTER ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:54.661763  1664 tablet_service.cc:1558] Processing DeleteTablet for tablet 2abb9a42c35f4b6386342bccdff6fbf0 with delete_type TABLET_DATA_TOMBSTONED (TS ddf11fc190dd4b898773379c6b129d90 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49162
I20260709 12:58:54.663731  2454 tablet_replica.cc:333] T 2abb9a42c35f4b6386342bccdff6fbf0 P ddf11fc190dd4b898773379c6b129d90: stopping tablet replica
I20260709 12:58:54.665019  2454 raft_consensus.cc:2243] T 2abb9a42c35f4b6386342bccdff6fbf0 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:54.669559  2453 raft_consensus.cc:1064] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642: attempting to promote NON_VOTER b96ce9cc496c49d7818fa983a17b062b to VOTER
I20260709 12:58:54.671161  2454 raft_consensus.cc:2272] T 2abb9a42c35f4b6386342bccdff6fbf0 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:54.672266  2453 consensus_queue.cc:237] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:58:54.675916  2454 ts_tablet_manager.cc:1916] T 2abb9a42c35f4b6386342bccdff6fbf0 P ddf11fc190dd4b898773379c6b129d90: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:54.686398  2224 raft_consensus.cc:1275] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:54.687493  1528 raft_consensus.cc:1275] T 822e65124bb44159b257fd219d28d93c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:54.687881  2453 consensus_queue.cc:1048] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:54.689131  2012 consensus_queue.cc:1048] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:54.686385  1678 raft_consensus.cc:1275] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:54.691625  2012 consensus_queue.cc:1048] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:54.707165  2012 raft_consensus.cc:2955] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:54.709543  2454 ts_tablet_manager.cc:1929] T 2abb9a42c35f4b6386342bccdff6fbf0 P ddf11fc190dd4b898773379c6b129d90: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:58:54.710075  2454 log.cc:1199] T 2abb9a42c35f4b6386342bccdff6fbf0 P ddf11fc190dd4b898773379c6b129d90: Deleting WAL directory at /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601891739070-431-0/minicluster-data/ts-2-root/wals/2abb9a42c35f4b6386342bccdff6fbf0
I20260709 12:58:54.711707  1415 catalog_manager.cc:5028] TS ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217): tablet 2abb9a42c35f4b6386342bccdff6fbf0 (table test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]) successfully deleted
I20260709 12:58:54.711959  2224 raft_consensus.cc:2955] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:54.717089  1528 raft_consensus.cc:2955] T 822e65124bb44159b257fd219d28d93c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:54.725628  1430 catalog_manager.cc:5697] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b reported cstate change: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:54.736797  1678 raft_consensus.cc:2955] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:54.750531  1605 consensus_queue.cc:237] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:58:54.767346  1678 raft_consensus.cc:1275] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:54.769263  2403 consensus_queue.cc:1048] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:54.773550  2224 raft_consensus.cc:1275] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:54.778788  2453 consensus_queue.cc:1048] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:54.780943  2453 raft_consensus.cc:2955] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:54.784695  2224 raft_consensus.cc:2955] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:54.790650  1678 raft_consensus.cc:2955] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:54.893402  1430 catalog_manager.cc:5697] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b reported cstate change: config changed from index 3 to 4, VOTER e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:54.903550  1416 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 822e65124bb44159b257fd219d28d93c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:54.907557  1517 tablet_service.cc:1558] Processing DeleteTablet for tablet 822e65124bb44159b257fd219d28d93c with delete_type TABLET_DATA_TOMBSTONED (TS e46412b3b0b44f01ad5c33d4cfe3d6b1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43004
I20260709 12:58:54.908183  2420 raft_consensus.cc:1064] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1: attempting to promote NON_VOTER b96ce9cc496c49d7818fa983a17b062b to VOTER
I20260709 12:58:54.910393  2420 consensus_queue.cc:237] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:58:55.502008  2461 tablet_replica.cc:333] T 822e65124bb44159b257fd219d28d93c P e46412b3b0b44f01ad5c33d4cfe3d6b1: stopping tablet replica
I20260709 12:58:55.505755  2224 raft_consensus.cc:1275] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:55.512408  1678 raft_consensus.cc:1275] T 83ed1c1e27234d98ba5eeb14457a4ee2 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 12:58:55.551074  2462 log.cc:927] Time spent T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.634s	user 0.001s	sys 0.000s
W20260709 12:58:55.589609  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 87070us
I20260709 12:58:55.643357  2461 raft_consensus.cc:2243] T 822e65124bb44159b257fd219d28d93c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:55.644223  2461 raft_consensus.cc:2272] T 822e65124bb44159b257fd219d28d93c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:55.648699  2461 ts_tablet_manager.cc:1916] T 822e65124bb44159b257fd219d28d93c P e46412b3b0b44f01ad5c33d4cfe3d6b1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:55.670135  2461 ts_tablet_manager.cc:1929] T 822e65124bb44159b257fd219d28d93c P e46412b3b0b44f01ad5c33d4cfe3d6b1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:58:55.670745  2461 log.cc:1199] T 822e65124bb44159b257fd219d28d93c P e46412b3b0b44f01ad5c33d4cfe3d6b1: Deleting WAL directory at /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601891739070-431-0/minicluster-data/ts-0-root/wals/822e65124bb44159b257fd219d28d93c
I20260709 12:58:55.905205  2471 raft_consensus.cc:493] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 12:58:55.906011  2471 raft_consensus.cc:515] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:55.908542  2471 leader_election.cc:290] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931)
I20260709 12:58:55.937834  2475 consensus_queue.cc:1048] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:55.944336  2476 raft_consensus.cc:493] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:58:55.945086  2477 raft_consensus.cc:493] T fb3a9a4620ef4fcd86eb78530746a583 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:58:55.945001  2476 raft_consensus.cc:515] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:55.945592  2477 raft_consensus.cc:515] T fb3a9a4620ef4fcd86eb78530746a583 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:55.946918  2468 raft_consensus.cc:493] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:58:55.947518  2468 raft_consensus.cc:515] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:55.947896  2463 raft_consensus.cc:493] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:58:55.948434  2463 raft_consensus.cc:515] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:58:55.949815  2468 leader_election.cc:290] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:55.950510  2463 leader_election.cc:290] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:58:55.955823  2476 leader_election.cc:290] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:55.950802  2478 raft_consensus.cc:493] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:58:55.956629  2478 raft_consensus.cc:515] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:55.971933  2468 raft_consensus.cc:493] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:58:55.972502  2478 leader_election.cc:290] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:55.973084  2478 raft_consensus.cc:493] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:58:55.973484  2476 raft_consensus.cc:493] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:58:55.973528  2478 raft_consensus.cc:515] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:55.974172  2477 leader_election.cc:290] T fb3a9a4620ef4fcd86eb78530746a583 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:55.974028  2476 raft_consensus.cc:515] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:55.976100  2476 leader_election.cc:290] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:55.976568  1605 raft_consensus.cc:1275] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:55.972554  2468 raft_consensus.cc:515] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:55.978258  2483 raft_consensus.cc:493] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:58:55.978861  2483 raft_consensus.cc:515] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:55.979187  2468 leader_election.cc:290] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:55.980005  2478 leader_election.cc:290] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:55.979779  2484 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:58:55.982707  2484 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:55.976588  2476 raft_consensus.cc:493] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:58:55.984416  2476 raft_consensus.cc:515] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:55.985643  2484 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:55.986426  2483 leader_election.cc:290] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:55.993464  2471 raft_consensus.cc:493] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:58:55.994064  2471 raft_consensus.cc:515] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:55.996196  2471 leader_election.cc:290] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:58:55.998059  2484 raft_consensus.cc:493] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 12:58:55.998668  2484 raft_consensus.cc:515] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:58:55.986469  2476 leader_election.cc:290] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:56.007098  2484 leader_election.cc:290] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:58:56.011793  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:58:56.012840  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:58:56.013751  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:58:56.013212  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:58:56.017656  2484 raft_consensus.cc:493] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:58:56.018271  2484 raft_consensus.cc:515] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:56.020426  2484 leader_election.cc:290] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:56.021034  2485 raft_consensus.cc:493] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 12:58:56.021803  2485 raft_consensus.cc:515] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:58:56.022480  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:58:56.024746  2485 leader_election.cc:290] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:56.025471  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:58:56.025645  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:58:56.025669  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:58:56.026837  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:58:56.027144  1601 raft_consensus.cc:2468] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 1.
I20260709 12:58:56.027791  2475 consensus_queue.cc:1048] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:56.028680  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:58:56.031216  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:58:56.031970  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:58:56.032579  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:58:56.033295  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:58:56.033684  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 12:58:56.038046  1572 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.012s	sys 0.028s
W20260709 12:58:56.038543  1572 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.012s	sys 0.028s
I20260709 12:58:56.039733  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:58:56.041678  2468 raft_consensus.cc:493] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:58:56.043149  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:58:56.043905  2463 raft_consensus.cc:493] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:58:56.044451  2463 raft_consensus.cc:515] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:56.043218  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:58:56.046396  2484 raft_consensus.cc:493] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:58:56.047003  2484 raft_consensus.cc:515] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:56.046557  2463 leader_election.cc:290] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:56.042243  2468 raft_consensus.cc:515] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:56.049968  2484 leader_election.cc:290] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:56.052891  2468 leader_election.cc:290] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:56.059887  2478 raft_consensus.cc:493] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:58:56.060546  2478 raft_consensus.cc:515] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:56.063374  1414 catalog_manager.cc:5028] TS e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): tablet 822e65124bb44159b257fd219d28d93c (table test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]) successfully deleted
I20260709 12:58:56.066886  2478 leader_election.cc:290] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:56.085772  2476 raft_consensus.cc:493] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:58:56.086426  2476 raft_consensus.cc:515] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:56.089066  2476 leader_election.cc:290] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:56.107366  2484 raft_consensus.cc:493] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:58:56.107959  2484 raft_consensus.cc:515] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:56.110162  2484 leader_election.cc:290] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:56.119570  2466 raft_consensus.cc:493] T 317204271cc04f68818b36450c9725b1 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 12:58:56.120385  2466 raft_consensus.cc:515] T 317204271cc04f68818b36450c9725b1 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:56.126624  1570 leader_election.cc:304] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:58:56.126799  2466 leader_election.cc:290] T 317204271cc04f68818b36450c9725b1 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:58:56.141280  2421 consensus_queue.cc:1048] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:56.146464  2484 raft_consensus.cc:2749] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:56.158818  2484 raft_consensus.cc:493] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:58:56.159358  2484 raft_consensus.cc:515] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:56.161661  2484 leader_election.cc:290] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:56.173328  1497 leader_election.cc:304] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:58:56.194852  2475 raft_consensus.cc:2804] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:56.195399  2475 raft_consensus.cc:493] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:58:56.195844  2475 raft_consensus.cc:3060] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:56.204558  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:58:56.207764  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:58:56.220284  2484 raft_consensus.cc:493] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 12:58:56.220997  2484 raft_consensus.cc:515] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:56.223660  2484 leader_election.cc:290] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:56.225587  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:58:56.238323  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:58:56.239197  2460 raft_consensus.cc:493] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:58:56.239734  2460 raft_consensus.cc:515] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:56.240314  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:58:56.239624  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:58:56.238045  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:58:56.243054  2469 raft_consensus.cc:493] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 12:58:56.239240  2475 raft_consensus.cc:515] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:56.243538  2469 raft_consensus.cc:515] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:56.244481  1523 raft_consensus.cc:1240] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:56.245162  2460 leader_election.cc:290] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:56.245925  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:58:56.246235  2469 leader_election.cc:290] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:58:56.247877  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:58:56.249372  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:58:56.250212  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:58:56.249352  2469 raft_consensus.cc:493] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:58:56.250823  1530 raft_consensus.cc:2468] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 1.
I20260709 12:58:56.251065  2469 raft_consensus.cc:515] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:56.251868  2466 raft_consensus.cc:493] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 12:58:56.254411  2475 leader_election.cc:290] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 2 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:56.255314  2469 leader_election.cc:290] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:58:56.254348  2466 raft_consensus.cc:515] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:58:56.259441  2466 leader_election.cc:290] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:58:56.263556  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:58:56.264256  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:58:56.265206  2191 leader_election.cc:304] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:58:56.266820  2485 raft_consensus.cc:2749] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:56.267486  2463 raft_consensus.cc:493] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:58:56.268131  2463 raft_consensus.cc:515] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:56.271528  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:58:56.275158  2486 raft_consensus.cc:493] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:58:56.275800  2486 raft_consensus.cc:515] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:58:56.277714  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:58:56.276273  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:58:56.280339  2486 leader_election.cc:290] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:58:56.277084  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:58:56.283061  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:58:56.288552  2475 raft_consensus.cc:493] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:58:56.289089  2475 raft_consensus.cc:515] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:56.287837  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:58:56.284493  2448 consensus_queue.cc:1059] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:56.291320  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:58:56.291551  2448 raft_consensus.cc:3055] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:56.292089  2448 raft_consensus.cc:740] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:58:56.291666  2475 leader_election.cc:290] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:56.277360  2463 leader_election.cc:290] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:56.287160  1570 leader_election.cc:304] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:58:56.289382  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:58:56.292794  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:58:56.293113  2448 consensus_queue.cc:260] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:56.290679  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:58:56.294523  2448 raft_consensus.cc:3060] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:56.300020  2466 raft_consensus.cc:493] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:58:56.296654  2490 raft_consensus.cc:2804] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:56.300601  2490 raft_consensus.cc:493] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:58:56.300535  2466 raft_consensus.cc:515] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:58:56.301118  2490 raft_consensus.cc:3060] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:56.297461  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:58:56.285993  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:58:56.305042  2466 leader_election.cc:290] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:58:56.309091  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:58:56.312255  2490 raft_consensus.cc:515] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:56.298877  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:58:56.315152  2490 leader_election.cc:290] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:56.318816  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:58:56.327145  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:58:56.336139  1646 leader_election.cc:304] T 317204271cc04f68818b36450c9725b1 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:58:56.336798  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:58:56.337198  2471 raft_consensus.cc:2749] T 317204271cc04f68818b36450c9725b1 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:56.338374  1646 leader_election.cc:304] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:58:56.339123  2471 raft_consensus.cc:2749] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:56.342222  1646 leader_election.cc:304] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:58:56.342955  2471 raft_consensus.cc:2749] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:56.344911  1572 leader_election.cc:304] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:58:56.345803  1646 leader_election.cc:304] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:58:56.346832  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:58:56.347477  2471 raft_consensus.cc:2749] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:56.349452  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:58:56.349754  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:58:56.349519  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:58:56.350075  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:58:56.351919  2490 raft_consensus.cc:2749] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:56.358369  1646 leader_election.cc:304] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:58:56.359434  2448 raft_consensus.cc:2749] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:56.360457  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:58:56.361032  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:58:56.364696  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:58:56.365103  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:58:56.367933  1646 leader_election.cc:304] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:58:56.368688  2471 raft_consensus.cc:2749] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:56.360960  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:58:56.371398  2478 raft_consensus.cc:2955] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:56.373854  1599 raft_consensus.cc:2955] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:56.381729  1646 leader_election.cc:304] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 12:58:56.383800  2471 raft_consensus.cc:2749] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:56.386260  2227 raft_consensus.cc:2955] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:56.390928  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:58:56.392793  1430 catalog_manager.cc:5697] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:56.397912  1674 raft_consensus.cc:2468] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 2.
I20260709 12:58:56.400805  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:58:56.400879  1571 leader_election.cc:304] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:58:56.402287  2463 raft_consensus.cc:2749] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:56.403151  1571 leader_election.cc:304] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 12:58:56.404699  1571 leader_election.cc:304] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:58:56.404868  2486 raft_consensus.cc:2749] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:56.405957  2486 raft_consensus.cc:2749] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:56.406157  1571 leader_election.cc:304] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:58:56.407088  2490 raft_consensus.cc:2749] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:56.408049  2448 raft_consensus.cc:493] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:58:56.408592  2448 raft_consensus.cc:515] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:56.411842  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:58:56.413899  2448 leader_election.cc:290] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:58:56.415946  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:58:56.417562  1646 leader_election.cc:304] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:58:56.418748  2471 raft_consensus.cc:2749] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:56.429397  2448 raft_consensus.cc:493] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:58:56.430011  2448 raft_consensus.cc:515] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:56.438417  1496 leader_election.cc:304] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:58:56.439358  2474 raft_consensus.cc:2749] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:56.441934  1496 leader_election.cc:304] T fb3a9a4620ef4fcd86eb78530746a583 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:58:56.443317  2448 leader_election.cc:290] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:58:56.444185  2474 raft_consensus.cc:2749] T fb3a9a4620ef4fcd86eb78530746a583 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:56.444051  1496 leader_election.cc:304] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:58:56.445286  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:58:56.445499  1496 leader_election.cc:304] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:58:56.446120  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:58:56.446362  2474 raft_consensus.cc:2749] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:56.446813  2478 raft_consensus.cc:2749] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:56.446604  1496 leader_election.cc:304] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:58:56.447645  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:58:56.448210  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:58:56.448808  2346 raft_consensus.cc:493] T dcad30336a5440bca17cda2724035211 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:58:56.449239  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:58:56.449348  2346 raft_consensus.cc:515] T dcad30336a5440bca17cda2724035211 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:56.450742  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:58:56.451454  2346 leader_election.cc:290] T dcad30336a5440bca17cda2724035211 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:58:56.452229  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:58:56.454577  1646 leader_election.cc:304] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:58:56.455456  2346 raft_consensus.cc:2749] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:56.456149  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:58:56.457602  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:58:56.459057  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:58:56.460795  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:58:56.461020  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:58:56.462682  1496 leader_election.cc:304] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:58:56.463887  2478 raft_consensus.cc:2749] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:56.464200  2474 raft_consensus.cc:2749] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:56.461160  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:58:56.466724  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:58:56.466889  1496 leader_election.cc:304] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:58:56.467849  2476 raft_consensus.cc:2749] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:56.470439  1496 leader_election.cc:304] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:58:56.472625  2476 raft_consensus.cc:2749] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:56.474453  1496 leader_election.cc:304] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 12:58:56.476128  1644 leader_election.cc:304] T dcad30336a5440bca17cda2724035211 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:58:56.476394  2478 raft_consensus.cc:2804] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:56.477373  1571 leader_election.cc:304] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:58:56.478566  1571 leader_election.cc:304] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:58:56.479645  1571 leader_election.cc:304] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:58:56.477581  2346 raft_consensus.cc:2749] T dcad30336a5440bca17cda2724035211 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:56.481352  2490 raft_consensus.cc:2749] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:56.481575  2478 raft_consensus.cc:697] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 12:58:56.482578  2460 raft_consensus.cc:2749] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:56.481493  2479 raft_consensus.cc:2749] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:56.483251  2478 consensus_queue.cc:237] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:56.478906  1496 leader_election.cc:304] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:58:56.485733  1571 leader_election.cc:304] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:58:56.486476  2490 raft_consensus.cc:2749] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:56.485554  2483 raft_consensus.cc:2749] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:56.489573  1571 leader_election.cc:304] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:58:56.490329  2490 raft_consensus.cc:2749] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:58:56.491683  1571 leader_election.cc:304] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:58:56.492355  2490 raft_consensus.cc:2749] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:56.493383  1571 leader_election.cc:304] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:58:56.494091  2490 raft_consensus.cc:2749] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:56.495155  1571 leader_election.cc:304] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:58:56.508993  2490 raft_consensus.cc:2749] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:58:56.508536  1679 raft_consensus.cc:2955] T 83ed1c1e27234d98ba5eeb14457a4ee2 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:56.510264  1571 leader_election.cc:304] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 12:58:56.519992  1528 consensus_queue.cc:237] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:58:56.540370  2227 raft_consensus.cc:1275] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:56.540550  1599 raft_consensus.cc:1275] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:56.541887  2490 raft_consensus.cc:2749] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:56.544711  2474 consensus_queue.cc:1048] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:56.552356  2474 consensus_queue.cc:1048] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:56.558467  2474 raft_consensus.cc:2955] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:56.573190  1599 raft_consensus.cc:2955] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:56.586527  2227 raft_consensus.cc:2955] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:56.604185  1414 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 83ed1c1e27234d98ba5eeb14457a4ee2 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:56.604502  1602 raft_consensus.cc:1240] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:56.605150  1429 catalog_manager.cc:5697] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: config changed from index 3 to 4, VOTER ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:56.607076  2465 consensus_queue.cc:1059] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:56.613724  2466 raft_consensus.cc:3055] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:56.614125  2466 raft_consensus.cc:740] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:58:56.615859  2466 consensus_queue.cc:260] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:56.617235  2466 raft_consensus.cc:3060] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:56.628255  1427 catalog_manager.cc:5697] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 1 to 2, leader changed from ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) to e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:56.633808  1664 tablet_service.cc:1558] Processing DeleteTablet for tablet 83ed1c1e27234d98ba5eeb14457a4ee2 with delete_type TABLET_DATA_TOMBSTONED (TS ddf11fc190dd4b898773379c6b129d90 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49162
I20260709 12:58:56.636634  2500 tablet_replica.cc:333] T 83ed1c1e27234d98ba5eeb14457a4ee2 P ddf11fc190dd4b898773379c6b129d90: stopping tablet replica
I20260709 12:58:56.637909  2500 raft_consensus.cc:2243] T 83ed1c1e27234d98ba5eeb14457a4ee2 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:56.638708  2500 raft_consensus.cc:2272] T 83ed1c1e27234d98ba5eeb14457a4ee2 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:56.642095  2500 ts_tablet_manager.cc:1916] T 83ed1c1e27234d98ba5eeb14457a4ee2 P ddf11fc190dd4b898773379c6b129d90: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:56.657213  2500 ts_tablet_manager.cc:1929] T 83ed1c1e27234d98ba5eeb14457a4ee2 P ddf11fc190dd4b898773379c6b129d90: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:58:56.657542  2500 log.cc:1199] T 83ed1c1e27234d98ba5eeb14457a4ee2 P ddf11fc190dd4b898773379c6b129d90: Deleting WAL directory at /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601891739070-431-0/minicluster-data/ts-2-root/wals/83ed1c1e27234d98ba5eeb14457a4ee2
I20260709 12:58:56.658957  1415 catalog_manager.cc:5028] TS ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217): tablet 83ed1c1e27234d98ba5eeb14457a4ee2 (table test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]) successfully deleted
W20260709 12:58:56.850644  1628 debug-util.cc:398] Leaking SignalData structure 0x7b0800132500 after lost signal to thread 434
W20260709 12:58:56.851527  1628 debug-util.cc:398] Leaking SignalData structure 0x7b08001c2820 after lost signal to thread 1464
W20260709 12:58:56.852353  1628 debug-util.cc:398] Leaking SignalData structure 0x7b080030a260 after lost signal to thread 1556
W20260709 12:58:56.853121  1628 debug-util.cc:398] Leaking SignalData structure 0x7b080030f980 after lost signal to thread 1631
W20260709 12:58:56.853865  1628 debug-util.cc:398] Leaking SignalData structure 0x7b080011d140 after lost signal to thread 1705
W20260709 12:58:56.854748  1628 debug-util.cc:398] Leaking SignalData structure 0x7b080013fa80 after lost signal to thread 2251
I20260709 12:58:56.954288  1674 raft_consensus.cc:1275] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:56.955484  2474 consensus_queue.cc:1048] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:56.980614  1599 raft_consensus.cc:3060] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:56.988746  1599 raft_consensus.cc:1275] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:56.990440  2474 consensus_queue.cc:1048] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:57.700232  1526 consensus_queue.cc:237] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:58:57.706554  1674 raft_consensus.cc:1275] T 94d0d4cbe71742a39337e80ad5770e28 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:58:57.707348  1497 consensus_peers.cc:597] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 -> Peer b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373): Couldn't send request to peer b96ce9cc496c49d7818fa983a17b062b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 94d0d4cbe71742a39337e80ad5770e28. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:57.708232  2421 consensus_queue.cc:1048] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:57.709208  1602 raft_consensus.cc:1275] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:57.711951  2483 consensus_queue.cc:1048] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:57.717664  2474 raft_consensus.cc:2955] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:58:57.721087  1679 raft_consensus.cc:2955] T 94d0d4cbe71742a39337e80ad5770e28 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:58:57.740542  1428 catalog_manager.cc:5697] T 94d0d4cbe71742a39337e80ad5770e28 P ddf11fc190dd4b898773379c6b129d90 reported cstate change: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:58:57.744515  1602 raft_consensus.cc:2955] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:58:57.778436  1526 consensus_queue.cc:237] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:58:57.791571  1674 raft_consensus.cc:1275] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:57.793406  2421 consensus_queue.cc:1048] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:57.795267  1602 raft_consensus.cc:1275] T a031a0ef86384487bd1f89ead66f851b P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:58:57.796826  1497 consensus_peers.cc:597] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 -> Peer b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373): Couldn't send request to peer b96ce9cc496c49d7818fa983a17b062b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a031a0ef86384487bd1f89ead66f851b. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:57.802189  2483 consensus_queue.cc:1048] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:57.822897  2474 raft_consensus.cc:2955] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:58:57.826259  1674 raft_consensus.cc:2955] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:58:57.834616  1600 raft_consensus.cc:2955] T a031a0ef86384487bd1f89ead66f851b P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:58:57.844547  1427 catalog_manager.cc:5697] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 reported cstate change: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:58:57.850008  1674 consensus_queue.cc:237] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:58:57.863108  1600 raft_consensus.cc:1275] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:57.866904  2466 consensus_queue.cc:1048] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:57.869046  1526 raft_consensus.cc:1275] T 073cc710cf6642bb940606f8df5c2331 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:58:57.869197  1646 consensus_peers.cc:597] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 -> Peer b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373): Couldn't send request to peer b96ce9cc496c49d7818fa983a17b062b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 073cc710cf6642bb940606f8df5c2331. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:57.870781  2466 consensus_queue.cc:1048] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:57.885003  2465 raft_consensus.cc:2955] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:58:57.886440  1600 raft_consensus.cc:2955] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:58:57.904229  1528 raft_consensus.cc:2955] T 073cc710cf6642bb940606f8df5c2331 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:58:57.907490  1427 catalog_manager.cc:5697] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 reported cstate change: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:57.908370  1600 consensus_queue.cc:237] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
W20260709 12:58:57.940800  1572 consensus_peers.cc:597] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 -> Peer b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373): Couldn't send request to peer b96ce9cc496c49d7818fa983a17b062b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4549f0dba6504cfda954259e71ec4c91. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:57.942386  1680 raft_consensus.cc:1275] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:57.944737  2490 consensus_queue.cc:1048] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:57.945850  2466 raft_consensus.cc:493] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:57.946363  2466 raft_consensus.cc:515] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:57.948355  1528 raft_consensus.cc:1275] T 4549f0dba6504cfda954259e71ec4c91 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:57.948547  2466 leader_election.cc:290] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:58:57.950088  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:58:57.950728  1602 raft_consensus.cc:2468] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 2.
I20260709 12:58:57.952306  2490 consensus_queue.cc:1048] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:57.952545  1646 leader_election.cc:304] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:58:57.953456  2466 raft_consensus.cc:2804] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:58:57.953819  2466 raft_consensus.cc:493] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:57.954160  2466 raft_consensus.cc:3060] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:57.958323  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:58:57.958983  1528 raft_consensus.cc:2468] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 1.
I20260709 12:58:57.966408  2466 raft_consensus.cc:515] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:57.968595  2466 leader_election.cc:290] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:58:57.969684  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:58:57.970317  1599 raft_consensus.cc:3060] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:57.971622  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:58:57.972159  1528 raft_consensus.cc:3060] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:58:57.976495  2507 raft_consensus.cc:2955] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:58:57.980583  1530 raft_consensus.cc:2955] T 4549f0dba6504cfda954259e71ec4c91 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:58:57.978291  1599 raft_consensus.cc:2468] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 3.
I20260709 12:58:57.982872  1646 leader_election.cc:304] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:58:57.983690  2448 raft_consensus.cc:2804] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:57.984141  2448 raft_consensus.cc:697] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 3 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:58:57.984920  2448 consensus_queue.cc:237] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:58:58.000761  1528 raft_consensus.cc:2468] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 3.
I20260709 12:58:58.001341  1429 catalog_manager.cc:5697] T 4549f0dba6504cfda954259e71ec4c91 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:58:58.021728  1427 catalog_manager.cc:5697] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } }
W20260709 12:58:58.035621  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 50225.8us
I20260709 12:58:58.042412  1674 raft_consensus.cc:2955] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:58:58.312815  2530 ts_tablet_manager.cc:933] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b: Initiating tablet copy from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931)
I20260709 12:58:58.319312  2530 tablet_copy_client.cc:323] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:43931
I20260709 12:58:58.321050  1542 tablet_copy_service.cc:140] P e46412b3b0b44f01ad5c33d4cfe3d6b1: Received BeginTabletCopySession request for tablet a031a0ef86384487bd1f89ead66f851b from peer b96ce9cc496c49d7818fa983a17b062b ({username='slave'} at 127.0.0.1:49310)
I20260709 12:58:58.321486  1542 tablet_copy_service.cc:161] P e46412b3b0b44f01ad5c33d4cfe3d6b1: Beginning new tablet copy session on tablet a031a0ef86384487bd1f89ead66f851b from peer b96ce9cc496c49d7818fa983a17b062b at {username='slave'} at 127.0.0.1:49310: session id = b96ce9cc496c49d7818fa983a17b062b-a031a0ef86384487bd1f89ead66f851b
I20260709 12:58:58.326486  1542 tablet_copy_source_session.cc:215] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:58.329704  2530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a031a0ef86384487bd1f89ead66f851b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:58.349090  2530 tablet_copy_client.cc:806] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:58.349813  2530 tablet_copy_client.cc:670] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:58.355505  2530 tablet_copy_client.cc:538] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:58.355553  2532 ts_tablet_manager.cc:933] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b: Initiating tablet copy from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931)
I20260709 12:58:58.368965  2530 tablet_bootstrap.cc:492] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b: Bootstrap starting.
I20260709 12:58:58.398777  2532 tablet_copy_client.cc:323] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:43931
I20260709 12:58:58.400520  1542 tablet_copy_service.cc:140] P e46412b3b0b44f01ad5c33d4cfe3d6b1: Received BeginTabletCopySession request for tablet 94d0d4cbe71742a39337e80ad5770e28 from peer b96ce9cc496c49d7818fa983a17b062b ({username='slave'} at 127.0.0.1:49310)
I20260709 12:58:58.401006  1542 tablet_copy_service.cc:161] P e46412b3b0b44f01ad5c33d4cfe3d6b1: Beginning new tablet copy session on tablet 94d0d4cbe71742a39337e80ad5770e28 from peer b96ce9cc496c49d7818fa983a17b062b at {username='slave'} at 127.0.0.1:49310: session id = b96ce9cc496c49d7818fa983a17b062b-94d0d4cbe71742a39337e80ad5770e28
I20260709 12:58:58.407629  1542 tablet_copy_source_session.cc:215] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:58.412415  2530 tablet_bootstrap.cc:492] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:58.413390  2530 tablet_bootstrap.cc:492] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b: Bootstrap complete.
I20260709 12:58:58.414079  2530 ts_tablet_manager.cc:1403] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b: Time spent bootstrapping tablet: real 0.045s	user 0.019s	sys 0.010s
I20260709 12:58:58.417088  2530 raft_consensus.cc:359] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:58:58.418447  2530 raft_consensus.cc:740] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Initialized, Role: LEARNER
I20260709 12:58:58.419565  2535 ts_tablet_manager.cc:933] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b: Initiating tablet copy from peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:58:58.419121  2530 consensus_queue.cc:260] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:58:58.424499  2532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94d0d4cbe71742a39337e80ad5770e28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:58.429737  2530 ts_tablet_manager.cc:1434] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.004s
I20260709 12:58:58.431419  1542 tablet_copy_service.cc:342] P e46412b3b0b44f01ad5c33d4cfe3d6b1: Request end of tablet copy session b96ce9cc496c49d7818fa983a17b062b-a031a0ef86384487bd1f89ead66f851b received from {username='slave'} at 127.0.0.1:49310
I20260709 12:58:58.431538  2535 tablet_copy_client.cc:323] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:44217
I20260709 12:58:58.431841  1542 tablet_copy_service.cc:434] P e46412b3b0b44f01ad5c33d4cfe3d6b1: ending tablet copy session b96ce9cc496c49d7818fa983a17b062b-a031a0ef86384487bd1f89ead66f851b on tablet a031a0ef86384487bd1f89ead66f851b with peer b96ce9cc496c49d7818fa983a17b062b
I20260709 12:58:58.433311  1690 tablet_copy_service.cc:140] P ddf11fc190dd4b898773379c6b129d90: Received BeginTabletCopySession request for tablet 073cc710cf6642bb940606f8df5c2331 from peer b96ce9cc496c49d7818fa983a17b062b ({username='slave'} at 127.0.0.1:50664)
I20260709 12:58:58.433846  1690 tablet_copy_service.cc:161] P ddf11fc190dd4b898773379c6b129d90: Beginning new tablet copy session on tablet 073cc710cf6642bb940606f8df5c2331 from peer b96ce9cc496c49d7818fa983a17b062b at {username='slave'} at 127.0.0.1:50664: session id = b96ce9cc496c49d7818fa983a17b062b-073cc710cf6642bb940606f8df5c2331
I20260709 12:58:58.440518  1600 raft_consensus.cc:1275] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:58:58.442154  2506 consensus_queue.cc:1048] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:58.456687  2532 tablet_copy_client.cc:806] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:58.456318  1690 tablet_copy_source_session.cc:215] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:58.457432  2532 tablet_copy_client.cc:670] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:58.461966  2532 tablet_copy_client.cc:538] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:58.462500  2535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 073cc710cf6642bb940606f8df5c2331. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:58.484802  2532 tablet_bootstrap.cc:492] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap starting.
I20260709 12:58:58.499894  2530 ts_tablet_manager.cc:933] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b: Initiating tablet copy from peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:58:58.500476  2535 tablet_copy_client.cc:806] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:58.501121  2535 tablet_copy_client.cc:670] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:58.514747  1530 raft_consensus.cc:1275] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:58:58.521040  2506 consensus_queue.cc:1048] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:58.546277  2535 tablet_copy_client.cc:538] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:58.582798  2535 tablet_bootstrap.cc:492] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap starting.
I20260709 12:58:58.617930  2532 tablet_bootstrap.cc:492] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:58.618854  2532 tablet_bootstrap.cc:492] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap complete.
I20260709 12:58:58.619498  2532 ts_tablet_manager.cc:1403] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b: Time spent bootstrapping tablet: real 0.135s	user 0.025s	sys 0.029s
I20260709 12:58:58.623484  2532 raft_consensus.cc:359] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:58:58.625793  2532 raft_consensus.cc:740] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Initialized, Role: LEARNER
I20260709 12:58:58.626466  2532 consensus_queue.cc:260] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:58:58.629448  2532 ts_tablet_manager.cc:1434] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:58:58.641709  2535 tablet_bootstrap.cc:492] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:58.642634  2535 tablet_bootstrap.cc:492] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap complete.
I20260709 12:58:58.643465  2535 ts_tablet_manager.cc:1403] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b: Time spent bootstrapping tablet: real 0.061s	user 0.021s	sys 0.007s
I20260709 12:58:58.647063  2535 raft_consensus.cc:359] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:58:58.647907  2535 raft_consensus.cc:740] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Initialized, Role: LEARNER
I20260709 12:58:58.648540  2535 consensus_queue.cc:260] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:58:58.651212  2535 ts_tablet_manager.cc:1434] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:58:58.652868  1690 tablet_copy_service.cc:342] P ddf11fc190dd4b898773379c6b129d90: Request end of tablet copy session b96ce9cc496c49d7818fa983a17b062b-073cc710cf6642bb940606f8df5c2331 received from {username='slave'} at 127.0.0.1:50664
I20260709 12:58:58.653262  1690 tablet_copy_service.cc:434] P ddf11fc190dd4b898773379c6b129d90: ending tablet copy session b96ce9cc496c49d7818fa983a17b062b-073cc710cf6642bb940606f8df5c2331 on tablet 073cc710cf6642bb940606f8df5c2331 with peer b96ce9cc496c49d7818fa983a17b062b
W20260709 12:58:58.646468  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 70052.9us
I20260709 12:58:58.657773  1542 tablet_copy_service.cc:342] P e46412b3b0b44f01ad5c33d4cfe3d6b1: Request end of tablet copy session b96ce9cc496c49d7818fa983a17b062b-94d0d4cbe71742a39337e80ad5770e28 received from {username='slave'} at 127.0.0.1:49310
I20260709 12:58:58.658232  1542 tablet_copy_service.cc:434] P e46412b3b0b44f01ad5c33d4cfe3d6b1: ending tablet copy session b96ce9cc496c49d7818fa983a17b062b-94d0d4cbe71742a39337e80ad5770e28 on tablet 94d0d4cbe71742a39337e80ad5770e28 with peer b96ce9cc496c49d7818fa983a17b062b
I20260709 12:58:58.679586  2530 tablet_copy_client.cc:323] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:40303
I20260709 12:58:58.681210  1617 tablet_copy_service.cc:140] P 39a92f5a4352465d8af3af5908fe8642: Received BeginTabletCopySession request for tablet 4549f0dba6504cfda954259e71ec4c91 from peer b96ce9cc496c49d7818fa983a17b062b ({username='slave'} at 127.0.0.1:57268)
I20260709 12:58:58.681759  1617 tablet_copy_service.cc:161] P 39a92f5a4352465d8af3af5908fe8642: Beginning new tablet copy session on tablet 4549f0dba6504cfda954259e71ec4c91 from peer b96ce9cc496c49d7818fa983a17b062b at {username='slave'} at 127.0.0.1:57268: session id = b96ce9cc496c49d7818fa983a17b062b-4549f0dba6504cfda954259e71ec4c91
I20260709 12:58:58.689252  1617 tablet_copy_source_session.cc:215] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:58.696900  2530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4549f0dba6504cfda954259e71ec4c91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:58.714768  2530 tablet_copy_client.cc:806] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:58.715833  2530 tablet_copy_client.cc:670] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:58.742102  2530 tablet_copy_client.cc:538] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:58.758152  2530 tablet_bootstrap.cc:492] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap starting.
I20260709 12:58:58.783315  2530 tablet_bootstrap.cc:492] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:58.784302  2530 tablet_bootstrap.cc:492] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap complete.
I20260709 12:58:58.785007  2530 ts_tablet_manager.cc:1403] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b: Time spent bootstrapping tablet: real 0.028s	user 0.019s	sys 0.004s
I20260709 12:58:58.788273  2530 raft_consensus.cc:359] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:58:58.790185  2530 raft_consensus.cc:740] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Initialized, Role: LEARNER
I20260709 12:58:58.790920  2530 consensus_queue.cc:260] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:58:58.794611  2530 ts_tablet_manager.cc:1434] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:58:58.797570  2226 raft_consensus.cc:1217] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:58:58.800138  1617 tablet_copy_service.cc:342] P 39a92f5a4352465d8af3af5908fe8642: Request end of tablet copy session b96ce9cc496c49d7818fa983a17b062b-4549f0dba6504cfda954259e71ec4c91 received from {username='slave'} at 127.0.0.1:57268
I20260709 12:58:58.800580  1617 tablet_copy_service.cc:434] P 39a92f5a4352465d8af3af5908fe8642: ending tablet copy session b96ce9cc496c49d7818fa983a17b062b-4549f0dba6504cfda954259e71ec4c91 on tablet 4549f0dba6504cfda954259e71ec4c91 with peer b96ce9cc496c49d7818fa983a17b062b
I20260709 12:58:58.851071  2226 raft_consensus.cc:1217] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:58:58.952919  2226 raft_consensus.cc:1217] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:58:58.963163  2226 raft_consensus.cc:1217] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:58:59.222610  2448 raft_consensus.cc:1064] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90: attempting to promote NON_VOTER b96ce9cc496c49d7818fa983a17b062b to VOTER
I20260709 12:58:59.224928  2448 consensus_queue.cc:237] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:58:59.242816  2226 raft_consensus.cc:1275] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:59.244417  2526 consensus_queue.cc:1048] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:59.270901  1526 raft_consensus.cc:1275] T 073cc710cf6642bb940606f8df5c2331 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:59.275939  1600 raft_consensus.cc:1275] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:59.277421  2526 consensus_queue.cc:1048] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:59.279891  2526 consensus_queue.cc:1048] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:59.305588  2474 raft_consensus.cc:1064] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1: attempting to promote NON_VOTER b96ce9cc496c49d7818fa983a17b062b to VOTER
I20260709 12:58:59.311350  2474 consensus_queue.cc:237] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:58:59.323575  2506 raft_consensus.cc:2955] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:59.333081  1526 raft_consensus.cc:2955] T 073cc710cf6642bb940606f8df5c2331 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:59.337250  2226 raft_consensus.cc:2955] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:59.343381  2227 raft_consensus.cc:1275] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:59.343730  1600 raft_consensus.cc:2955] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:59.351796  1674 raft_consensus.cc:1275] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:59.358801  2491 raft_consensus.cc:1064] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642: attempting to promote NON_VOTER b96ce9cc496c49d7818fa983a17b062b to VOTER
I20260709 12:58:59.360643  1428 catalog_manager.cc:5697] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:59.363824  2491 consensus_queue.cc:237] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:58:59.366909  2421 consensus_queue.cc:1048] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:59.372344  2545 consensus_queue.cc:1048] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:59.391330  1599 raft_consensus.cc:1275] T a031a0ef86384487bd1f89ead66f851b P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:59.402602  2421 raft_consensus.cc:2955] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:59.414052  1674 consensus_queue.cc:237] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:58:59.422879  2225 raft_consensus.cc:1275] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:59.426983  2526 consensus_queue.cc:1048] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:59.434370  1674 raft_consensus.cc:2955] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:59.443152  2506 raft_consensus.cc:2955] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:59.450511  1679 raft_consensus.cc:1275] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:59.456651  2559 consensus_queue.cc:1048] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:59.458441  1600 raft_consensus.cc:1275] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:59.448951  2226 raft_consensus.cc:2955] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:59.475220  2474 consensus_queue.cc:1048] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:59.446298  1428 catalog_manager.cc:5697] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:59.491662  2226 raft_consensus.cc:1275] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:59.494335  1429 catalog_manager.cc:5697] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: config changed from index 3 to 4, VOTER e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:59.495044  2448 consensus_queue.cc:1048] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:59.502029  2568 consensus_queue.cc:1048] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:59.505045  1517 tablet_service.cc:1558] Processing DeleteTablet for tablet 073cc710cf6642bb940606f8df5c2331 with delete_type TABLET_DATA_TOMBSTONED (TS e46412b3b0b44f01ad5c33d4cfe3d6b1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43004
I20260709 12:58:59.509138  1526 consensus_queue.cc:237] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:58:59.503712  2225 raft_consensus.cc:2955] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:59.525508  1600 raft_consensus.cc:2955] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:59.528867  1680 raft_consensus.cc:1275] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:59.533000  2474 consensus_queue.cc:1048] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:59.546257  2545 raft_consensus.cc:2955] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:59.558938  1415 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 073cc710cf6642bb940606f8df5c2331 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:59.567230  1528 raft_consensus.cc:1275] T 4549f0dba6504cfda954259e71ec4c91 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:59.564570  1599 raft_consensus.cc:2955] T a031a0ef86384487bd1f89ead66f851b P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:59.562018  1680 raft_consensus.cc:2955] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:59.605445  1414 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a031a0ef86384487bd1f89ead66f851b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:59.600508  2570 tablet_replica.cc:333] T 073cc710cf6642bb940606f8df5c2331 P e46412b3b0b44f01ad5c33d4cfe3d6b1: stopping tablet replica
I20260709 12:58:59.607699  2570 raft_consensus.cc:2243] T 073cc710cf6642bb940606f8df5c2331 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:59.609236  2570 raft_consensus.cc:2272] T 073cc710cf6642bb940606f8df5c2331 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:59.616847  1427 catalog_manager.cc:5697] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: config changed from index 3 to 4, VOTER 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:59.620685  2570 ts_tablet_manager.cc:1916] T 073cc710cf6642bb940606f8df5c2331 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:59.627250  2559 consensus_queue.cc:1048] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:59.629926  2474 raft_consensus.cc:1064] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1: attempting to promote NON_VOTER b96ce9cc496c49d7818fa983a17b062b to VOTER
I20260709 12:58:59.635136  2474 consensus_queue.cc:237] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:58:59.667610  2570 ts_tablet_manager.cc:1929] T 073cc710cf6642bb940606f8df5c2331 P e46412b3b0b44f01ad5c33d4cfe3d6b1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:58:59.671013  2570 log.cc:1199] T 073cc710cf6642bb940606f8df5c2331 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Deleting WAL directory at /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601891739070-431-0/minicluster-data/ts-0-root/wals/073cc710cf6642bb940606f8df5c2331
I20260709 12:58:59.673332  1414 catalog_manager.cc:5028] TS e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): tablet 073cc710cf6642bb940606f8df5c2331 (table test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]) successfully deleted
I20260709 12:58:59.679247  1680 raft_consensus.cc:1275] T 94d0d4cbe71742a39337e80ad5770e28 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:59.683404  2474 consensus_queue.cc:1048] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:59.684290  2528 raft_consensus.cc:2955] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:59.690771  2223 raft_consensus.cc:1275] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:59.697240  1680 raft_consensus.cc:2955] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
W20260709 12:58:59.700685  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 74202.5us
I20260709 12:58:59.704964  2225 raft_consensus.cc:2955] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:59.717742  1428 catalog_manager.cc:5697] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 reported cstate change: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:59.733124  1594 tablet_service.cc:1558] Processing DeleteTablet for tablet a031a0ef86384487bd1f89ead66f851b with delete_type TABLET_DATA_TOMBSTONED (TS 39a92f5a4352465d8af3af5908fe8642 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36192
I20260709 12:58:59.770650  1600 consensus_queue.cc:237] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:58:59.780320  2225 raft_consensus.cc:1275] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:59.784255  1680 raft_consensus.cc:1275] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:59.782610  2574 consensus_queue.cc:1048] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 12:58:59.790041  2574 consensus_queue.cc:1048] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:59.792689  2528 raft_consensus.cc:2955] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:59.796067  2225 raft_consensus.cc:2955] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:59.805043  1680 raft_consensus.cc:2955] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
W20260709 12:58:59.806941  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 182171us
I20260709 12:58:59.810907  1416 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4549f0dba6504cfda954259e71ec4c91 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:59.819705  1429 catalog_manager.cc:5697] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: config changed from index 3 to 4, VOTER e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:59.822724  2577 tablet_replica.cc:333] T a031a0ef86384487bd1f89ead66f851b P 39a92f5a4352465d8af3af5908fe8642: stopping tablet replica
I20260709 12:58:59.823733  2577 raft_consensus.cc:2243] T a031a0ef86384487bd1f89ead66f851b P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:59.824460  2577 raft_consensus.cc:2272] T a031a0ef86384487bd1f89ead66f851b P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:59.828032  2577 ts_tablet_manager.cc:1916] T a031a0ef86384487bd1f89ead66f851b P 39a92f5a4352465d8af3af5908fe8642: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:59.830786  1517 tablet_service.cc:1558] Processing DeleteTablet for tablet 4549f0dba6504cfda954259e71ec4c91 with delete_type TABLET_DATA_TOMBSTONED (TS e46412b3b0b44f01ad5c33d4cfe3d6b1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43004
I20260709 12:58:59.831794  2570 tablet_replica.cc:333] T 4549f0dba6504cfda954259e71ec4c91 P e46412b3b0b44f01ad5c33d4cfe3d6b1: stopping tablet replica
I20260709 12:58:59.832710  2226 raft_consensus.cc:1275] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:59.833280  2570 raft_consensus.cc:2243] T 4549f0dba6504cfda954259e71ec4c91 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:59.835884  1428 catalog_manager.cc:5244] ChangeConfig:REMOVE_PEER RPC for tablet 4549f0dba6504cfda954259e71ec4c91 with cas_config_opid_index 3: aborting the task: latest config opid_index 4; task opid_index 3
I20260709 12:58:59.855999  1600 raft_consensus.cc:1275] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:59.860339  2570 raft_consensus.cc:2272] T 4549f0dba6504cfda954259e71ec4c91 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:59.863210  2570 ts_tablet_manager.cc:1916] T 4549f0dba6504cfda954259e71ec4c91 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 12:58:59.870329  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:59.880942  2573 consensus_queue.cc:1048] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:59.884094  2474 consensus_queue.cc:1048] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:59.903156  2225 raft_consensus.cc:2955] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:59.906786  2474 consensus_queue.cc:1048] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:59.916914  2577 ts_tablet_manager.cc:1929] T a031a0ef86384487bd1f89ead66f851b P 39a92f5a4352465d8af3af5908fe8642: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:58:59.917433  2577 log.cc:1199] T a031a0ef86384487bd1f89ead66f851b P 39a92f5a4352465d8af3af5908fe8642: Deleting WAL directory at /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601891739070-431-0/minicluster-data/ts-1-root/wals/a031a0ef86384487bd1f89ead66f851b
I20260709 12:58:59.929642  2570 ts_tablet_manager.cc:1929] T 4549f0dba6504cfda954259e71ec4c91 P e46412b3b0b44f01ad5c33d4cfe3d6b1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.2
I20260709 12:58:59.929014  2474 raft_consensus.cc:2955] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:59.931780  2223 raft_consensus.cc:2955] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:59.937083  2570 log.cc:1199] T 4549f0dba6504cfda954259e71ec4c91 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Deleting WAL directory at /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601891739070-431-0/minicluster-data/ts-0-root/wals/4549f0dba6504cfda954259e71ec4c91
I20260709 12:58:59.937795  1416 catalog_manager.cc:5028] TS 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): tablet a031a0ef86384487bd1f89ead66f851b (table test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]) successfully deleted
I20260709 12:58:59.947315  1680 raft_consensus.cc:2955] T 94d0d4cbe71742a39337e80ad5770e28 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:59.956691  1599 raft_consensus.cc:2955] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:58:59.970525  1414 catalog_manager.cc:5028] TS e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): tablet 4549f0dba6504cfda954259e71ec4c91 (table test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]) successfully deleted
I20260709 12:58:59.979835  1429 catalog_manager.cc:5697] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:00.016848  1524 consensus_queue.cc:237] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:00.027438  2223 raft_consensus.cc:1275] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:00.029868  1599 raft_consensus.cc:1275] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:00.031708  2573 consensus_queue.cc:1048] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:00.035585  2573 consensus_queue.cc:1048] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:00.056734  2474 raft_consensus.cc:2955] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:00.062161  1599 raft_consensus.cc:2955] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:00.066062  1414 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 94d0d4cbe71742a39337e80ad5770e28 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:00.068912  2223 raft_consensus.cc:2955] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:00.076937  1428 catalog_manager.cc:5697] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: config changed from index 3 to 4, VOTER ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:00.123013  1664 tablet_service.cc:1558] Processing DeleteTablet for tablet 94d0d4cbe71742a39337e80ad5770e28 with delete_type TABLET_DATA_TOMBSTONED (TS ddf11fc190dd4b898773379c6b129d90 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49162
I20260709 12:59:00.150311  2581 tablet_replica.cc:333] T 94d0d4cbe71742a39337e80ad5770e28 P ddf11fc190dd4b898773379c6b129d90: stopping tablet replica
I20260709 12:59:00.153734  2581 raft_consensus.cc:2243] T 94d0d4cbe71742a39337e80ad5770e28 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:00.154474  2581 raft_consensus.cc:2272] T 94d0d4cbe71742a39337e80ad5770e28 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:00.157013  2581 ts_tablet_manager.cc:1916] T 94d0d4cbe71742a39337e80ad5770e28 P ddf11fc190dd4b898773379c6b129d90: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:00.176337  2581 ts_tablet_manager.cc:1929] T 94d0d4cbe71742a39337e80ad5770e28 P ddf11fc190dd4b898773379c6b129d90: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:00.176831  2581 log.cc:1199] T 94d0d4cbe71742a39337e80ad5770e28 P ddf11fc190dd4b898773379c6b129d90: Deleting WAL directory at /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601891739070-431-0/minicluster-data/ts-2-root/wals/94d0d4cbe71742a39337e80ad5770e28
I20260709 12:59:00.178318  1415 catalog_manager.cc:5028] TS ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217): tablet 94d0d4cbe71742a39337e80ad5770e28 (table test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]) successfully deleted
I20260709 12:59:01.176947  1600 consensus_queue.cc:237] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:59:01.183698  1680 raft_consensus.cc:1275] T 1e4adfe2190c4487ab72be02d6cfa923 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:59:01.184128  1572 consensus_peers.cc:597] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 -> Peer b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373): Couldn't send request to peer b96ce9cc496c49d7818fa983a17b062b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1e4adfe2190c4487ab72be02d6cfa923. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:01.184572  1531 raft_consensus.cc:1275] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:01.185150  2528 consensus_queue.cc:1048] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:01.185946  2559 consensus_queue.cc:1048] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:01.196079  2528 raft_consensus.cc:2955] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:59:01.198091  1531 raft_consensus.cc:2955] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:59:01.208308  1680 raft_consensus.cc:2955] T 1e4adfe2190c4487ab72be02d6cfa923 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:59:01.218856  1524 consensus_queue.cc:237] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:59:01.239722  1426 catalog_manager.cc:5697] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
W20260709 12:59:01.247255  1497 consensus_peers.cc:597] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 -> Peer b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373): Couldn't send request to peer b96ce9cc496c49d7818fa983a17b062b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7352869c54614c80af4953b2ce90cace. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:01.254916  1680 raft_consensus.cc:1275] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:01.255846  1600 raft_consensus.cc:1275] T 7352869c54614c80af4953b2ce90cace P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:01.257584  2421 consensus_queue.cc:1048] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:01.258872  2591 consensus_queue.cc:1048] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:01.275754  2544 raft_consensus.cc:2955] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:59:01.277509  1600 raft_consensus.cc:2955] T 7352869c54614c80af4953b2ce90cace P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:59:01.324553  1599 consensus_queue.cc:237] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:59:01.348800  1428 catalog_manager.cc:5697] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:01.352169  1524 raft_consensus.cc:1275] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:01.354789  2528 consensus_queue.cc:1048] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:59:01.363803  1572 consensus_peers.cc:597] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 -> Peer b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373): Couldn't send request to peer b96ce9cc496c49d7818fa983a17b062b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d0b325904f4646bca264eeeea15dfeb0. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:01.366752  1679 raft_consensus.cc:1275] T d0b325904f4646bca264eeeea15dfeb0 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:01.368046  1681 raft_consensus.cc:2955] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:59:01.370885  2587 consensus_queue.cc:1048] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:01.396360  2586 raft_consensus.cc:2955] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:59:01.401016  1679 raft_consensus.cc:2955] T d0b325904f4646bca264eeeea15dfeb0 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:59:01.399300  1524 raft_consensus.cc:2955] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:59:01.442243  1426 catalog_manager.cc:5697] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:59:01.493858  1524 consensus_queue.cc:237] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:59:01.549638  1599 raft_consensus.cc:1275] T bb48619ad4f74c71a726835ef5a8b4c2 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:01.550343  1681 raft_consensus.cc:1275] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:01.551892  2421 consensus_queue.cc:1048] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:01.552644  2582 consensus_queue.cc:1048] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:59:01.555989  1497 consensus_peers.cc:597] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 -> Peer b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373): Couldn't send request to peer b96ce9cc496c49d7818fa983a17b062b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bb48619ad4f74c71a726835ef5a8b4c2. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:01.569535  1599 raft_consensus.cc:2955] T bb48619ad4f74c71a726835ef5a8b4c2 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:59:01.567972  2582 raft_consensus.cc:2955] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:59:01.571713  1681 raft_consensus.cc:2955] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:59:01.588994  1428 catalog_manager.cc:5697] T bb48619ad4f74c71a726835ef5a8b4c2 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:59:01.646720  2606 ts_tablet_manager.cc:933] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b: Initiating tablet copy from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931)
I20260709 12:59:01.656486  2606 tablet_copy_client.cc:323] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:43931
I20260709 12:59:01.658212  1542 tablet_copy_service.cc:140] P e46412b3b0b44f01ad5c33d4cfe3d6b1: Received BeginTabletCopySession request for tablet 7352869c54614c80af4953b2ce90cace from peer b96ce9cc496c49d7818fa983a17b062b ({username='slave'} at 127.0.0.1:49310)
I20260709 12:59:01.658825  1542 tablet_copy_service.cc:161] P e46412b3b0b44f01ad5c33d4cfe3d6b1: Beginning new tablet copy session on tablet 7352869c54614c80af4953b2ce90cace from peer b96ce9cc496c49d7818fa983a17b062b at {username='slave'} at 127.0.0.1:49310: session id = b96ce9cc496c49d7818fa983a17b062b-7352869c54614c80af4953b2ce90cace
I20260709 12:59:01.675647  2608 ts_tablet_manager.cc:933] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b: Initiating tablet copy from peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:01.683300  1542 tablet_copy_source_session.cc:215] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:01.690133  2608 tablet_copy_client.cc:323] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:40303
I20260709 12:59:01.692047  1617 tablet_copy_service.cc:140] P 39a92f5a4352465d8af3af5908fe8642: Received BeginTabletCopySession request for tablet 1e4adfe2190c4487ab72be02d6cfa923 from peer b96ce9cc496c49d7818fa983a17b062b ({username='slave'} at 127.0.0.1:57268)
I20260709 12:59:01.692612  1617 tablet_copy_service.cc:161] P 39a92f5a4352465d8af3af5908fe8642: Beginning new tablet copy session on tablet 1e4adfe2190c4487ab72be02d6cfa923 from peer b96ce9cc496c49d7818fa983a17b062b at {username='slave'} at 127.0.0.1:57268: session id = b96ce9cc496c49d7818fa983a17b062b-1e4adfe2190c4487ab72be02d6cfa923
I20260709 12:59:01.696281  2606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7352869c54614c80af4953b2ce90cace. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:01.701990  1617 tablet_copy_source_session.cc:215] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:01.705370  2608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e4adfe2190c4487ab72be02d6cfa923. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:01.726186  2608 tablet_copy_client.cc:806] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:01.726864  2608 tablet_copy_client.cc:670] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:01.727473  2606 tablet_copy_client.cc:806] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:01.728156  2606 tablet_copy_client.cc:670] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:01.731298  2608 tablet_copy_client.cc:538] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:01.737097  2606 tablet_copy_client.cc:538] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:01.751420  2608 tablet_bootstrap.cc:492] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap starting.
I20260709 12:59:01.755349  2606 tablet_bootstrap.cc:492] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b: Bootstrap starting.
I20260709 12:59:01.794400  2608 tablet_bootstrap.cc:492] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:01.795341  2608 tablet_bootstrap.cc:492] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap complete.
I20260709 12:59:01.795991  2608 ts_tablet_manager.cc:1403] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b: Time spent bootstrapping tablet: real 0.045s	user 0.009s	sys 0.011s
I20260709 12:59:01.798306  2606 tablet_bootstrap.cc:492] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:01.799291  2606 tablet_bootstrap.cc:492] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b: Bootstrap complete.
I20260709 12:59:01.799062  2608 raft_consensus.cc:359] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:59:01.800482  2608 raft_consensus.cc:740] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Initialized, Role: LEARNER
I20260709 12:59:01.800616  2606 ts_tablet_manager.cc:1403] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b: Time spent bootstrapping tablet: real 0.045s	user 0.010s	sys 0.015s
I20260709 12:59:01.801723  2608 consensus_queue.cc:260] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:59:01.804251  2606 raft_consensus.cc:359] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:59:01.805119  2606 raft_consensus.cc:740] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Initialized, Role: LEARNER
I20260709 12:59:01.805794  2606 consensus_queue.cc:260] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:59:01.824113  2612 ts_tablet_manager.cc:933] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b: Initiating tablet copy from peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:01.840389  2606 ts_tablet_manager.cc:1434] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b: Time spent starting tablet: real 0.039s	user 0.016s	sys 0.019s
I20260709 12:59:01.842337  1542 tablet_copy_service.cc:342] P e46412b3b0b44f01ad5c33d4cfe3d6b1: Request end of tablet copy session b96ce9cc496c49d7818fa983a17b062b-7352869c54614c80af4953b2ce90cace received from {username='slave'} at 127.0.0.1:49310
I20260709 12:59:01.842844  1542 tablet_copy_service.cc:434] P e46412b3b0b44f01ad5c33d4cfe3d6b1: ending tablet copy session b96ce9cc496c49d7818fa983a17b062b-7352869c54614c80af4953b2ce90cace on tablet 7352869c54614c80af4953b2ce90cace with peer b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:01.843262  2612 tablet_copy_client.cc:323] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:40303
I20260709 12:59:01.846431  1617 tablet_copy_service.cc:140] P 39a92f5a4352465d8af3af5908fe8642: Received BeginTabletCopySession request for tablet d0b325904f4646bca264eeeea15dfeb0 from peer b96ce9cc496c49d7818fa983a17b062b ({username='slave'} at 127.0.0.1:57268)
I20260709 12:59:01.846988  1617 tablet_copy_service.cc:161] P 39a92f5a4352465d8af3af5908fe8642: Beginning new tablet copy session on tablet d0b325904f4646bca264eeeea15dfeb0 from peer b96ce9cc496c49d7818fa983a17b062b at {username='slave'} at 127.0.0.1:57268: session id = b96ce9cc496c49d7818fa983a17b062b-d0b325904f4646bca264eeeea15dfeb0
I20260709 12:59:01.855718  2608 ts_tablet_manager.cc:1434] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b: Time spent starting tablet: real 0.059s	user 0.025s	sys 0.010s
I20260709 12:59:01.857606  1616 tablet_copy_service.cc:342] P 39a92f5a4352465d8af3af5908fe8642: Request end of tablet copy session b96ce9cc496c49d7818fa983a17b062b-1e4adfe2190c4487ab72be02d6cfa923 received from {username='slave'} at 127.0.0.1:57268
I20260709 12:59:01.858021  1616 tablet_copy_service.cc:434] P 39a92f5a4352465d8af3af5908fe8642: ending tablet copy session b96ce9cc496c49d7818fa983a17b062b-1e4adfe2190c4487ab72be02d6cfa923 on tablet 1e4adfe2190c4487ab72be02d6cfa923 with peer b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:01.854602  1617 tablet_copy_source_session.cc:215] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:01.863368  2612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0b325904f4646bca264eeeea15dfeb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:01.881088  2612 tablet_copy_client.cc:806] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:01.881754  2612 tablet_copy_client.cc:670] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:01.893790  2612 tablet_copy_client.cc:538] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:01.905354  2612 tablet_bootstrap.cc:492] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap starting.
I20260709 12:59:01.932164  2612 tablet_bootstrap.cc:492] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:01.933073  2612 tablet_bootstrap.cc:492] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap complete.
I20260709 12:59:01.933746  2612 ts_tablet_manager.cc:1403] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b: Time spent bootstrapping tablet: real 0.029s	user 0.005s	sys 0.020s
I20260709 12:59:01.937196  2612 raft_consensus.cc:359] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:59:01.938016  2612 raft_consensus.cc:740] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Initialized, Role: LEARNER
I20260709 12:59:01.939566  2612 consensus_queue.cc:260] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:59:01.942175  2612 ts_tablet_manager.cc:1434] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b: Time spent starting tablet: real 0.008s	user 0.000s	sys 0.009s
I20260709 12:59:01.958354  1617 tablet_copy_service.cc:342] P 39a92f5a4352465d8af3af5908fe8642: Request end of tablet copy session b96ce9cc496c49d7818fa983a17b062b-d0b325904f4646bca264eeeea15dfeb0 received from {username='slave'} at 127.0.0.1:57268
I20260709 12:59:01.959393  1617 tablet_copy_service.cc:434] P 39a92f5a4352465d8af3af5908fe8642: ending tablet copy session b96ce9cc496c49d7818fa983a17b062b-d0b325904f4646bca264eeeea15dfeb0 on tablet d0b325904f4646bca264eeeea15dfeb0 with peer b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:02.068259  2612 ts_tablet_manager.cc:933] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b: Initiating tablet copy from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931)
I20260709 12:59:02.071352  2612 tablet_copy_client.cc:323] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:43931
I20260709 12:59:02.073073  1542 tablet_copy_service.cc:140] P e46412b3b0b44f01ad5c33d4cfe3d6b1: Received BeginTabletCopySession request for tablet bb48619ad4f74c71a726835ef5a8b4c2 from peer b96ce9cc496c49d7818fa983a17b062b ({username='slave'} at 127.0.0.1:49310)
I20260709 12:59:02.073635  1542 tablet_copy_service.cc:161] P e46412b3b0b44f01ad5c33d4cfe3d6b1: Beginning new tablet copy session on tablet bb48619ad4f74c71a726835ef5a8b4c2 from peer b96ce9cc496c49d7818fa983a17b062b at {username='slave'} at 127.0.0.1:49310: session id = b96ce9cc496c49d7818fa983a17b062b-bb48619ad4f74c71a726835ef5a8b4c2
I20260709 12:59:02.084405  1542 tablet_copy_source_session.cc:215] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:02.088166  2612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb48619ad4f74c71a726835ef5a8b4c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:02.096598  2223 raft_consensus.cc:1217] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:02.127229  2612 tablet_copy_client.cc:806] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:02.128508  2612 tablet_copy_client.cc:670] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:02.137681  2612 tablet_copy_client.cc:538] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:02.150646  2612 tablet_bootstrap.cc:492] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap starting.
I20260709 12:59:02.243528  2612 tablet_bootstrap.cc:492] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:02.244710  2612 tablet_bootstrap.cc:492] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap complete.
I20260709 12:59:02.245682  2612 ts_tablet_manager.cc:1403] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b: Time spent bootstrapping tablet: real 0.095s	user 0.025s	sys 0.012s
I20260709 12:59:02.254346  2612 raft_consensus.cc:359] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:59:02.255306  2612 raft_consensus.cc:740] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Initialized, Role: LEARNER
I20260709 12:59:02.256014  2612 consensus_queue.cc:260] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:59:02.266908  2612 ts_tablet_manager.cc:1434] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.003s
I20260709 12:59:02.276851  1542 tablet_copy_service.cc:342] P e46412b3b0b44f01ad5c33d4cfe3d6b1: Request end of tablet copy session b96ce9cc496c49d7818fa983a17b062b-bb48619ad4f74c71a726835ef5a8b4c2 received from {username='slave'} at 127.0.0.1:49310
I20260709 12:59:02.277297  1542 tablet_copy_service.cc:434] P e46412b3b0b44f01ad5c33d4cfe3d6b1: ending tablet copy session b96ce9cc496c49d7818fa983a17b062b-bb48619ad4f74c71a726835ef5a8b4c2 on tablet bb48619ad4f74c71a726835ef5a8b4c2 with peer b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:02.283965  2223 raft_consensus.cc:1217] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:02.406857  2223 raft_consensus.cc:1217] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:02.525187  2223 raft_consensus.cc:1217] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:02.606153  2421 raft_consensus.cc:1064] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1: attempting to promote NON_VOTER b96ce9cc496c49d7818fa983a17b062b to VOTER
I20260709 12:59:02.609531  2421 consensus_queue.cc:237] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:02.618717  1681 raft_consensus.cc:1275] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:02.618981  2225 raft_consensus.cc:1275] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:02.619228  1600 raft_consensus.cc:1275] T 7352869c54614c80af4953b2ce90cace P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:02.620554  2421 consensus_queue.cc:1048] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:02.622027  2582 consensus_queue.cc:1048] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:02.625792  2622 consensus_queue.cc:1048] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:02.660316  1605 raft_consensus.cc:2955] T 7352869c54614c80af4953b2ce90cace P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:02.675974  1673 raft_consensus.cc:2955] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:02.658420  2582 raft_consensus.cc:2955] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:02.711208  2225 raft_consensus.cc:2955] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:02.708719  1429 catalog_manager.cc:5697] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 reported cstate change: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:02.750241  1523 consensus_queue.cc:237] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:02.755520  2225 raft_consensus.cc:1275] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:02.755577  1673 raft_consensus.cc:1275] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:02.757038  2421 consensus_queue.cc:1048] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:02.757834  2582 consensus_queue.cc:1048] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:02.769831  2627 raft_consensus.cc:2955] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:02.780273  2225 raft_consensus.cc:2955] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:02.787364  1673 raft_consensus.cc:2955] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:02.791142  1414 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7352869c54614c80af4953b2ce90cace with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:02.799482  2559 raft_consensus.cc:1064] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642: attempting to promote NON_VOTER b96ce9cc496c49d7818fa983a17b062b to VOTER
I20260709 12:59:02.801607  1428 catalog_manager.cc:5697] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: config changed from index 3 to 4, VOTER 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:02.802248  2559 consensus_queue.cc:237] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:02.828123  1594 tablet_service.cc:1558] Processing DeleteTablet for tablet 7352869c54614c80af4953b2ce90cace with delete_type TABLET_DATA_TOMBSTONED (TS 39a92f5a4352465d8af3af5908fe8642 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36192
I20260709 12:59:02.830637  2633 tablet_replica.cc:333] T 7352869c54614c80af4953b2ce90cace P 39a92f5a4352465d8af3af5908fe8642: stopping tablet replica
I20260709 12:59:02.838527  2602 raft_consensus.cc:1064] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642: attempting to promote NON_VOTER b96ce9cc496c49d7818fa983a17b062b to VOTER
I20260709 12:59:02.841673  2602 consensus_queue.cc:237] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:02.843816  2633 raft_consensus.cc:2243] T 7352869c54614c80af4953b2ce90cace P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:02.844898  2633 raft_consensus.cc:2272] T 7352869c54614c80af4953b2ce90cace P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:02.848711  2633 ts_tablet_manager.cc:1916] T 7352869c54614c80af4953b2ce90cace P 39a92f5a4352465d8af3af5908fe8642: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:02.855702  2223 raft_consensus.cc:1275] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:02.857055  1673 raft_consensus.cc:1275] T d0b325904f4646bca264eeeea15dfeb0 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:02.857434  2586 consensus_queue.cc:1048] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:02.858559  1531 raft_consensus.cc:1275] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:02.860044  2586 consensus_queue.cc:1048] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:02.861480  2587 consensus_queue.cc:1048] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:02.871102  1523 raft_consensus.cc:1275] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:02.871966  2225 raft_consensus.cc:1275] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:02.880191  2635 consensus_queue.cc:1048] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:02.888877  1673 raft_consensus.cc:1275] T 1e4adfe2190c4487ab72be02d6cfa923 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:02.882294  2635 consensus_queue.cc:1048] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 12:59:02.909996  2586 consensus_queue.cc:1048] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:02.927354  2633 ts_tablet_manager.cc:1929] T 7352869c54614c80af4953b2ce90cace P 39a92f5a4352465d8af3af5908fe8642: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:02.928061  2633 log.cc:1199] T 7352869c54614c80af4953b2ce90cace P 39a92f5a4352465d8af3af5908fe8642: Deleting WAL directory at /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601891739070-431-0/minicluster-data/ts-1-root/wals/7352869c54614c80af4953b2ce90cace
I20260709 12:59:02.930212  1416 catalog_manager.cc:5028] TS 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): tablet 7352869c54614c80af4953b2ce90cace (table test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]) successfully deleted
I20260709 12:59:02.934024  2559 raft_consensus.cc:2955] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:02.935865  1524 raft_consensus.cc:2955] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:02.941643  2622 raft_consensus.cc:1064] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1: attempting to promote NON_VOTER b96ce9cc496c49d7818fa983a17b062b to VOTER
I20260709 12:59:02.944463  2622 consensus_queue.cc:237] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:02.953548  2227 raft_consensus.cc:2955] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:02.962400  2225 raft_consensus.cc:1275] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:02.962170  1428 catalog_manager.cc:5697] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:02.968402  1673 raft_consensus.cc:2955] T d0b325904f4646bca264eeeea15dfeb0 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:02.977451  2582 consensus_queue.cc:1048] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:02.978191  2586 raft_consensus.cc:2955] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:02.980727  1681 raft_consensus.cc:1275] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:02.989490  2582 consensus_queue.cc:1048] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:02.991876  1605 consensus_queue.cc:237] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:03.009924  2226 raft_consensus.cc:1275] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:03.011430  1599 raft_consensus.cc:1275] T bb48619ad4f74c71a726835ef5a8b4c2 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:03.014678  2622 consensus_queue.cc:1048] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:03.012792  2225 raft_consensus.cc:2955] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:03.023443  1523 raft_consensus.cc:1275] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:03.025679  2635 consensus_queue.cc:1048] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:03.026237  1523 raft_consensus.cc:2955] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:03.039441  1679 raft_consensus.cc:2955] T 1e4adfe2190c4487ab72be02d6cfa923 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:03.080570  2638 consensus_queue.cc:1048] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
W20260709 12:59:03.127589  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 55599.2us
I20260709 12:59:03.129572  2587 raft_consensus.cc:2955] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:03.134336  2227 raft_consensus.cc:2955] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:03.179221  1430 catalog_manager.cc:5697] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:03.251627  2421 raft_consensus.cc:2955] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:03.254604  1416 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d0b325904f4646bca264eeeea15dfeb0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:03.258070  1426 catalog_manager.cc:5697] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: config changed from index 3 to 4, VOTER ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:03.261134  2223 raft_consensus.cc:2955] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:03.278445  1524 raft_consensus.cc:2955] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:03.281878  1599 consensus_queue.cc:237] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:03.285177  1679 raft_consensus.cc:2955] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:03.292475  2225 raft_consensus.cc:1275] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:03.294032  1526 raft_consensus.cc:1275] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:03.293984  1599 raft_consensus.cc:2955] T bb48619ad4f74c71a726835ef5a8b4c2 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:03.297036  2647 consensus_queue.cc:1048] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:03.302760  2647 consensus_queue.cc:1048] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:03.307334  2638 raft_consensus.cc:2955] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:03.309157  2225 raft_consensus.cc:2955] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:03.319864  1664 tablet_service.cc:1558] Processing DeleteTablet for tablet d0b325904f4646bca264eeeea15dfeb0 with delete_type TABLET_DATA_TOMBSTONED (TS ddf11fc190dd4b898773379c6b129d90 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49162
I20260709 12:59:03.317767  1429 catalog_manager.cc:5697] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:03.323921  1526 raft_consensus.cc:2955] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:03.326068  1416 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1e4adfe2190c4487ab72be02d6cfa923 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:03.330137  1430 catalog_manager.cc:5697] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: config changed from index 3 to 4, VOTER ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:03.352351  1670 tablet_service.cc:1558] Processing DeleteTablet for tablet 1e4adfe2190c4487ab72be02d6cfa923 with delete_type TABLET_DATA_TOMBSTONED (TS ddf11fc190dd4b898773379c6b129d90 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49162
I20260709 12:59:03.357301  2652 tablet_replica.cc:333] T d0b325904f4646bca264eeeea15dfeb0 P ddf11fc190dd4b898773379c6b129d90: stopping tablet replica
I20260709 12:59:03.358500  2652 raft_consensus.cc:2243] T d0b325904f4646bca264eeeea15dfeb0 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:03.359346  2652 raft_consensus.cc:2272] T d0b325904f4646bca264eeeea15dfeb0 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:03.364180  1526 consensus_queue.cc:237] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:03.370214  2223 raft_consensus.cc:1275] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:03.370297  1681 raft_consensus.cc:1275] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:03.371637  2652 ts_tablet_manager.cc:1916] T d0b325904f4646bca264eeeea15dfeb0 P ddf11fc190dd4b898773379c6b129d90: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:03.371887  2582 consensus_queue.cc:1048] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:03.372895  2622 consensus_queue.cc:1048] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:03.380386  2421 raft_consensus.cc:2955] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:03.383450  1681 raft_consensus.cc:2955] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:03.389212  1414 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bb48619ad4f74c71a726835ef5a8b4c2 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 12:59:03.394971  1414 catalog_manager.cc:5220] ChangeConfig:REMOVE_PEER RPC for tablet bb48619ad4f74c71a726835ef5a8b4c2 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 3 but the committed config has opid_index of 4
I20260709 12:59:03.396957  2652 ts_tablet_manager.cc:1929] T d0b325904f4646bca264eeeea15dfeb0 P ddf11fc190dd4b898773379c6b129d90: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:03.397450  2652 log.cc:1199] T d0b325904f4646bca264eeeea15dfeb0 P ddf11fc190dd4b898773379c6b129d90: Deleting WAL directory at /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601891739070-431-0/minicluster-data/ts-2-root/wals/d0b325904f4646bca264eeeea15dfeb0
I20260709 12:59:03.399082  2652 tablet_replica.cc:333] T 1e4adfe2190c4487ab72be02d6cfa923 P ddf11fc190dd4b898773379c6b129d90: stopping tablet replica
I20260709 12:59:03.399726  1415 catalog_manager.cc:5028] TS ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217): tablet d0b325904f4646bca264eeeea15dfeb0 (table test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]) successfully deleted
I20260709 12:59:03.400110  2652 raft_consensus.cc:2243] T 1e4adfe2190c4487ab72be02d6cfa923 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:03.400969  2652 raft_consensus.cc:2272] T 1e4adfe2190c4487ab72be02d6cfa923 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:03.402078  1430 catalog_manager.cc:5697] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: config changed from index 3 to 4, VOTER 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:03.404950  2652 ts_tablet_manager.cc:1916] T 1e4adfe2190c4487ab72be02d6cfa923 P ddf11fc190dd4b898773379c6b129d90: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:03.410143  2223 raft_consensus.cc:2955] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:03.421844  2652 ts_tablet_manager.cc:1929] T 1e4adfe2190c4487ab72be02d6cfa923 P ddf11fc190dd4b898773379c6b129d90: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:03.421948  1594 tablet_service.cc:1558] Processing DeleteTablet for tablet bb48619ad4f74c71a726835ef5a8b4c2 with delete_type TABLET_DATA_TOMBSTONED (TS 39a92f5a4352465d8af3af5908fe8642 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36192
I20260709 12:59:03.422817  2652 log.cc:1199] T 1e4adfe2190c4487ab72be02d6cfa923 P ddf11fc190dd4b898773379c6b129d90: Deleting WAL directory at /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601891739070-431-0/minicluster-data/ts-2-root/wals/1e4adfe2190c4487ab72be02d6cfa923
I20260709 12:59:03.423172  2633 tablet_replica.cc:333] T bb48619ad4f74c71a726835ef5a8b4c2 P 39a92f5a4352465d8af3af5908fe8642: stopping tablet replica
I20260709 12:59:03.424211  2633 raft_consensus.cc:2243] T bb48619ad4f74c71a726835ef5a8b4c2 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:03.424958  2633 raft_consensus.cc:2272] T bb48619ad4f74c71a726835ef5a8b4c2 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:03.425446  1415 catalog_manager.cc:5028] TS ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217): tablet 1e4adfe2190c4487ab72be02d6cfa923 (table test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]) successfully deleted
I20260709 12:59:03.437297  2633 ts_tablet_manager.cc:1916] T bb48619ad4f74c71a726835ef5a8b4c2 P 39a92f5a4352465d8af3af5908fe8642: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:03.451553  2633 ts_tablet_manager.cc:1929] T bb48619ad4f74c71a726835ef5a8b4c2 P 39a92f5a4352465d8af3af5908fe8642: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:03.451843  2633 log.cc:1199] T bb48619ad4f74c71a726835ef5a8b4c2 P 39a92f5a4352465d8af3af5908fe8642: Deleting WAL directory at /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601891739070-431-0/minicluster-data/ts-1-root/wals/bb48619ad4f74c71a726835ef5a8b4c2
I20260709 12:59:03.453203  1416 catalog_manager.cc:5028] TS 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): tablet bb48619ad4f74c71a726835ef5a8b4c2 (table test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]) successfully deleted
I20260709 12:59:04.503994  1681 consensus_queue.cc:237] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:59:04.510015  1605 raft_consensus.cc:1275] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:59:04.510627  1646 consensus_peers.cc:597] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 -> Peer b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373): Couldn't send request to peer b96ce9cc496c49d7818fa983a17b062b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 819fbeffe41b4610a05fcaac38e161b6. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:04.511206  1526 raft_consensus.cc:1275] T 819fbeffe41b4610a05fcaac38e161b6 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:04.511621  2620 consensus_queue.cc:1048] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:04.512310  2655 consensus_queue.cc:1048] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:04.519697  2655 raft_consensus.cc:2955] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:59:04.523867  1526 raft_consensus.cc:2955] T 819fbeffe41b4610a05fcaac38e161b6 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:59:04.525804  1605 raft_consensus.cc:2955] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:59:04.536688  1681 consensus_queue.cc:237] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:59:04.543642  1428 catalog_manager.cc:5697] T 819fbeffe41b4610a05fcaac38e161b6 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
W20260709 12:59:04.551419  1646 consensus_peers.cc:597] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 -> Peer b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373): Couldn't send request to peer b96ce9cc496c49d7818fa983a17b062b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e4b8c02fb560459fbbb59424361a5457. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:04.551577  1605 raft_consensus.cc:1275] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:04.552907  2620 consensus_queue.cc:1048] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:04.553148  1526 raft_consensus.cc:1275] T e4b8c02fb560459fbbb59424361a5457 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:04.559417  2655 consensus_queue.cc:1048] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:04.568830  2620 raft_consensus.cc:2955] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:59:04.572741  1605 raft_consensus.cc:2955] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:59:04.584306  1526 raft_consensus.cc:2955] T e4b8c02fb560459fbbb59424361a5457 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:59:04.588855  1429 catalog_manager.cc:5697] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:59:04.596434  1605 consensus_queue.cc:237] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:59:04.609867  1681 raft_consensus.cc:1275] T a5802fa5e328499da4525506ccdf4dc9 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:04.610306  1526 raft_consensus.cc:1275] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:04.611181  2638 consensus_queue.cc:1048] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:59:04.612174  1572 consensus_peers.cc:597] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 -> Peer b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373): Couldn't send request to peer b96ce9cc496c49d7818fa983a17b062b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a5802fa5e328499da4525506ccdf4dc9. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:04.612798  2666 consensus_queue.cc:1048] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:04.620266  2638 raft_consensus.cc:2955] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:59:04.622617  1677 raft_consensus.cc:2955] T a5802fa5e328499da4525506ccdf4dc9 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:59:04.625393  1526 raft_consensus.cc:2955] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:59:04.637446  1430 catalog_manager.cc:5697] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:04.637792  1526 consensus_queue.cc:237] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:59:04.645702  1605 raft_consensus.cc:1275] T 53176f970a394c5cb2c76bd88f09c751 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:04.645952  1677 raft_consensus.cc:1275] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:59:04.647404  1497 consensus_peers.cc:597] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 -> Peer b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373): Couldn't send request to peer b96ce9cc496c49d7818fa983a17b062b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 53176f970a394c5cb2c76bd88f09c751. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:04.648240  2622 consensus_queue.cc:1048] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:04.651695  2582 consensus_queue.cc:1048] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:04.674232  2622 raft_consensus.cc:2955] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:59:04.675479  1677 raft_consensus.cc:2955] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:59:04.700801  1430 catalog_manager.cc:5697] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 reported cstate change: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:59:04.711377  1605 raft_consensus.cc:2955] T 53176f970a394c5cb2c76bd88f09c751 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:59:05.052606  2677 ts_tablet_manager.cc:933] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b: Initiating tablet copy from peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:05.054610  2677 tablet_copy_client.cc:323] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:44217
I20260709 12:59:05.056627  1690 tablet_copy_service.cc:140] P ddf11fc190dd4b898773379c6b129d90: Received BeginTabletCopySession request for tablet e4b8c02fb560459fbbb59424361a5457 from peer b96ce9cc496c49d7818fa983a17b062b ({username='slave'} at 127.0.0.1:50664)
I20260709 12:59:05.057227  1690 tablet_copy_service.cc:161] P ddf11fc190dd4b898773379c6b129d90: Beginning new tablet copy session on tablet e4b8c02fb560459fbbb59424361a5457 from peer b96ce9cc496c49d7818fa983a17b062b at {username='slave'} at 127.0.0.1:50664: session id = b96ce9cc496c49d7818fa983a17b062b-e4b8c02fb560459fbbb59424361a5457
I20260709 12:59:05.068344  1690 tablet_copy_source_session.cc:215] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:05.078200  2677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4b8c02fb560459fbbb59424361a5457. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:05.083032  2679 ts_tablet_manager.cc:933] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b: Initiating tablet copy from peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:05.090567  2679 tablet_copy_client.cc:323] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:44217
I20260709 12:59:05.093086  1690 tablet_copy_service.cc:140] P ddf11fc190dd4b898773379c6b129d90: Received BeginTabletCopySession request for tablet 819fbeffe41b4610a05fcaac38e161b6 from peer b96ce9cc496c49d7818fa983a17b062b ({username='slave'} at 127.0.0.1:50664)
I20260709 12:59:05.093626  1690 tablet_copy_service.cc:161] P ddf11fc190dd4b898773379c6b129d90: Beginning new tablet copy session on tablet 819fbeffe41b4610a05fcaac38e161b6 from peer b96ce9cc496c49d7818fa983a17b062b at {username='slave'} at 127.0.0.1:50664: session id = b96ce9cc496c49d7818fa983a17b062b-819fbeffe41b4610a05fcaac38e161b6
I20260709 12:59:05.100919  2677 tablet_copy_client.cc:806] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:05.101336  1690 tablet_copy_source_session.cc:215] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:05.101635  2677 tablet_copy_client.cc:670] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:05.104983  2679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 819fbeffe41b4610a05fcaac38e161b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:05.105549  2677 tablet_copy_client.cc:538] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:05.115456  2677 tablet_bootstrap.cc:492] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap starting.
I20260709 12:59:05.142795  2681 ts_tablet_manager.cc:933] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b: Initiating tablet copy from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931)
I20260709 12:59:05.144976  2679 tablet_copy_client.cc:806] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:05.145813  2679 tablet_copy_client.cc:670] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:05.150524  2679 tablet_copy_client.cc:538] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:05.151600  2681 tablet_copy_client.cc:323] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:43931
I20260709 12:59:05.156589  2677 tablet_bootstrap.cc:492] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:05.157693  2677 tablet_bootstrap.cc:492] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap complete.
I20260709 12:59:05.157979  1542 tablet_copy_service.cc:140] P e46412b3b0b44f01ad5c33d4cfe3d6b1: Received BeginTabletCopySession request for tablet 53176f970a394c5cb2c76bd88f09c751 from peer b96ce9cc496c49d7818fa983a17b062b ({username='slave'} at 127.0.0.1:49310)
I20260709 12:59:05.158510  2677 ts_tablet_manager.cc:1403] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b: Time spent bootstrapping tablet: real 0.043s	user 0.016s	sys 0.020s
I20260709 12:59:05.158566  1542 tablet_copy_service.cc:161] P e46412b3b0b44f01ad5c33d4cfe3d6b1: Beginning new tablet copy session on tablet 53176f970a394c5cb2c76bd88f09c751 from peer b96ce9cc496c49d7818fa983a17b062b at {username='slave'} at 127.0.0.1:49310: session id = b96ce9cc496c49d7818fa983a17b062b-53176f970a394c5cb2c76bd88f09c751
I20260709 12:59:05.161378  2679 tablet_bootstrap.cc:492] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap starting.
I20260709 12:59:05.162060  2677 raft_consensus.cc:359] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:59:05.163051  2677 raft_consensus.cc:740] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Initialized, Role: LEARNER
I20260709 12:59:05.163810  2677 consensus_queue.cc:260] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:59:05.167349  1542 tablet_copy_source_session.cc:215] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:05.173864  2677 ts_tablet_manager.cc:1434] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b: Time spent starting tablet: real 0.015s	user 0.010s	sys 0.003s
I20260709 12:59:05.194059  2681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53176f970a394c5cb2c76bd88f09c751. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:05.194835  1690 tablet_copy_service.cc:342] P ddf11fc190dd4b898773379c6b129d90: Request end of tablet copy session b96ce9cc496c49d7818fa983a17b062b-e4b8c02fb560459fbbb59424361a5457 received from {username='slave'} at 127.0.0.1:50664
I20260709 12:59:05.195395  1690 tablet_copy_service.cc:434] P ddf11fc190dd4b898773379c6b129d90: ending tablet copy session b96ce9cc496c49d7818fa983a17b062b-e4b8c02fb560459fbbb59424361a5457 on tablet e4b8c02fb560459fbbb59424361a5457 with peer b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:05.203557  2677 ts_tablet_manager.cc:933] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b: Initiating tablet copy from peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:05.239500  2677 tablet_copy_client.cc:323] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:40303
I20260709 12:59:05.243028  2681 tablet_copy_client.cc:806] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:05.243736  2681 tablet_copy_client.cc:670] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:05.245630  1617 tablet_copy_service.cc:140] P 39a92f5a4352465d8af3af5908fe8642: Received BeginTabletCopySession request for tablet a5802fa5e328499da4525506ccdf4dc9 from peer b96ce9cc496c49d7818fa983a17b062b ({username='slave'} at 127.0.0.1:57268)
I20260709 12:59:05.246203  1617 tablet_copy_service.cc:161] P 39a92f5a4352465d8af3af5908fe8642: Beginning new tablet copy session on tablet a5802fa5e328499da4525506ccdf4dc9 from peer b96ce9cc496c49d7818fa983a17b062b at {username='slave'} at 127.0.0.1:57268: session id = b96ce9cc496c49d7818fa983a17b062b-a5802fa5e328499da4525506ccdf4dc9
I20260709 12:59:05.248533  2681 tablet_copy_client.cc:538] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:05.253925  1617 tablet_copy_source_session.cc:215] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:05.256980  2679 tablet_bootstrap.cc:492] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:05.258579  2677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5802fa5e328499da4525506ccdf4dc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:05.260103  2681 tablet_bootstrap.cc:492] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap starting.
I20260709 12:59:05.264451  2679 tablet_bootstrap.cc:492] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap complete.
I20260709 12:59:05.265336  2679 ts_tablet_manager.cc:1403] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b: Time spent bootstrapping tablet: real 0.104s	user 0.020s	sys 0.021s
I20260709 12:59:05.287305  2681 tablet_bootstrap.cc:492] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:05.288393  2681 tablet_bootstrap.cc:492] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap complete.
I20260709 12:59:05.288290  2679 raft_consensus.cc:359] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:59:05.289232  2681 ts_tablet_manager.cc:1403] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b: Time spent bootstrapping tablet: real 0.029s	user 0.020s	sys 0.007s
I20260709 12:59:05.289739  2679 raft_consensus.cc:740] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Initialized, Role: LEARNER
I20260709 12:59:05.290494  2679 consensus_queue.cc:260] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:59:05.293428  2679 ts_tablet_manager.cc:1434] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.001s
I20260709 12:59:05.295940  2677 tablet_copy_client.cc:806] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:05.296243  1690 tablet_copy_service.cc:342] P ddf11fc190dd4b898773379c6b129d90: Request end of tablet copy session b96ce9cc496c49d7818fa983a17b062b-819fbeffe41b4610a05fcaac38e161b6 received from {username='slave'} at 127.0.0.1:50664
I20260709 12:59:05.296566  2677 tablet_copy_client.cc:670] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:05.296696  1690 tablet_copy_service.cc:434] P ddf11fc190dd4b898773379c6b129d90: ending tablet copy session b96ce9cc496c49d7818fa983a17b062b-819fbeffe41b4610a05fcaac38e161b6 on tablet 819fbeffe41b4610a05fcaac38e161b6 with peer b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:05.299578  2681 raft_consensus.cc:359] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:59:05.300467  2681 raft_consensus.cc:740] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Initialized, Role: LEARNER
I20260709 12:59:05.301128  2681 consensus_queue.cc:260] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:59:05.302894  2677 tablet_copy_client.cc:538] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:05.305682  2681 ts_tablet_manager.cc:1434] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.004s
I20260709 12:59:05.307456  1542 tablet_copy_service.cc:342] P e46412b3b0b44f01ad5c33d4cfe3d6b1: Request end of tablet copy session b96ce9cc496c49d7818fa983a17b062b-53176f970a394c5cb2c76bd88f09c751 received from {username='slave'} at 127.0.0.1:49310
I20260709 12:59:05.307874  1542 tablet_copy_service.cc:434] P e46412b3b0b44f01ad5c33d4cfe3d6b1: ending tablet copy session b96ce9cc496c49d7818fa983a17b062b-53176f970a394c5cb2c76bd88f09c751 on tablet 53176f970a394c5cb2c76bd88f09c751 with peer b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:05.311900  2677 tablet_bootstrap.cc:492] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap starting.
I20260709 12:59:05.338040  2677 tablet_bootstrap.cc:492] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:05.339010  2677 tablet_bootstrap.cc:492] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap complete.
I20260709 12:59:05.339737  2677 ts_tablet_manager.cc:1403] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b: Time spent bootstrapping tablet: real 0.028s	user 0.021s	sys 0.006s
I20260709 12:59:05.342767  2677 raft_consensus.cc:359] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:59:05.343672  2677 raft_consensus.cc:740] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Initialized, Role: LEARNER
I20260709 12:59:05.344383  2677 consensus_queue.cc:260] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:59:05.347234  2677 ts_tablet_manager.cc:1434] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:59:05.349365  1617 tablet_copy_service.cc:342] P 39a92f5a4352465d8af3af5908fe8642: Request end of tablet copy session b96ce9cc496c49d7818fa983a17b062b-a5802fa5e328499da4525506ccdf4dc9 received from {username='slave'} at 127.0.0.1:57268
I20260709 12:59:05.349779  1617 tablet_copy_service.cc:434] P 39a92f5a4352465d8af3af5908fe8642: ending tablet copy session b96ce9cc496c49d7818fa983a17b062b-a5802fa5e328499da4525506ccdf4dc9 on tablet a5802fa5e328499da4525506ccdf4dc9 with peer b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:05.576256  2225 raft_consensus.cc:1217] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:05.601118  2225 raft_consensus.cc:1217] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:05.672775  2223 raft_consensus.cc:1217] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:05.682973  2223 raft_consensus.cc:1217] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:06.058171  2582 raft_consensus.cc:1064] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1: attempting to promote NON_VOTER b96ce9cc496c49d7818fa983a17b062b to VOTER
I20260709 12:59:06.060524  2582 consensus_queue.cc:237] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:06.069316  2223 raft_consensus.cc:1275] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:06.070727  1677 raft_consensus.cc:1275] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:06.072662  2582 consensus_queue.cc:1048] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:06.073804  2672 consensus_queue.cc:1048] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:06.074633  1605 raft_consensus.cc:1275] T 53176f970a394c5cb2c76bd88f09c751 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:06.075973  2672 consensus_queue.cc:1048] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:06.086329  2672 raft_consensus.cc:2955] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:06.087903  1677 raft_consensus.cc:2955] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:06.088649  1605 raft_consensus.cc:2955] T 53176f970a394c5cb2c76bd88f09c751 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:06.100556  2225 raft_consensus.cc:2955] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:06.107905  1430 catalog_manager.cc:5697] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 reported cstate change: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:06.136795  2638 raft_consensus.cc:1064] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642: attempting to promote NON_VOTER b96ce9cc496c49d7818fa983a17b062b to VOTER
I20260709 12:59:06.138759  2638 consensus_queue.cc:237] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:06.144459  2225 raft_consensus.cc:1275] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:06.146729  2653 consensus_queue.cc:1048] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:06.147912  1524 raft_consensus.cc:1275] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:06.148160  1677 raft_consensus.cc:1275] T a5802fa5e328499da4525506ccdf4dc9 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:06.166546  2655 raft_consensus.cc:1064] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90: attempting to promote NON_VOTER b96ce9cc496c49d7818fa983a17b062b to VOTER
I20260709 12:59:06.169354  2655 consensus_queue.cc:237] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:06.171407  2690 consensus_queue.cc:1048] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:06.199079  2701 consensus_queue.cc:1048] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:06.216710  2708 raft_consensus.cc:1064] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90: attempting to promote NON_VOTER b96ce9cc496c49d7818fa983a17b062b to VOTER
I20260709 12:59:06.217841  2699 raft_consensus.cc:2955] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:06.219250  1526 raft_consensus.cc:2955] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:06.220633   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:06.221319  2708 consensus_queue.cc:237] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:06.226959  2223 raft_consensus.cc:1275] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:06.228456  2649 consensus_queue.cc:1048] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:06.230180  1681 raft_consensus.cc:2955] T a5802fa5e328499da4525506ccdf4dc9 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:06.257341  2223 raft_consensus.cc:2955] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:06.257990  1526 consensus_queue.cc:237] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:06.264633  1681 raft_consensus.cc:1275] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:06.266294  2674 consensus_queue.cc:1048] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:06.272379  2225 raft_consensus.cc:1275] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:06.276144  2672 consensus_queue.cc:1048] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:06.278055  1429 catalog_manager.cc:5697] T a5802fa5e328499da4525506ccdf4dc9 P ddf11fc190dd4b898773379c6b129d90 reported cstate change: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:06.291489  2582 raft_consensus.cc:2955] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:06.292541  1681 raft_consensus.cc:2955] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:06.298244  1526 raft_consensus.cc:1275] T e4b8c02fb560459fbbb59424361a5457 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:06.300257  2620 consensus_queue.cc:1048] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:06.300489  1524 raft_consensus.cc:1275] T 819fbeffe41b4610a05fcaac38e161b6 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:06.302474  2620 consensus_queue.cc:1048] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:59:06.303310  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 56127.4us
I20260709 12:59:06.310245  1600 raft_consensus.cc:1275] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:06.310585  2225 raft_consensus.cc:1275] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:06.314003  2655 consensus_queue.cc:1048] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:06.314594  1599 raft_consensus.cc:1275] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:06.316685  2655 consensus_queue.cc:1048] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:06.320009  1414 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 53176f970a394c5cb2c76bd88f09c751 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:06.321097  1599 consensus_queue.cc:237] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:06.331017  2227 raft_consensus.cc:1275] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:06.332444  1528 raft_consensus.cc:1275] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:06.333751  2699 consensus_queue.cc:1048] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:06.335072  2701 consensus_queue.cc:1048] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:06.336917  2620 consensus_queue.cc:1048] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:06.345139  2227 raft_consensus.cc:2955] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:06.346756  2638 raft_consensus.cc:2955] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:06.348951  1530 raft_consensus.cc:2955] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:06.364403  2226 raft_consensus.cc:2955] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:06.349995  1429 catalog_manager.cc:5697] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: config changed from index 3 to 4, VOTER 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:06.366430  2712 raft_consensus.cc:2955] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:06.369484  1526 raft_consensus.cc:2955] T e4b8c02fb560459fbbb59424361a5457 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:06.381421  1416 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a5802fa5e328499da4525506ccdf4dc9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:06.408983  1428 catalog_manager.cc:5697] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: config changed from index 3 to 4, VOTER ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:06.410198  2649 raft_consensus.cc:2955] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:06.419109  1594 tablet_service.cc:1558] Processing DeleteTablet for tablet 53176f970a394c5cb2c76bd88f09c751 with delete_type TABLET_DATA_TOMBSTONED (TS 39a92f5a4352465d8af3af5908fe8642 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36192
I20260709 12:59:06.423632  2719 tablet_replica.cc:333] T 53176f970a394c5cb2c76bd88f09c751 P 39a92f5a4352465d8af3af5908fe8642: stopping tablet replica
I20260709 12:59:06.430372  1600 raft_consensus.cc:2955] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:06.436338  2225 raft_consensus.cc:2955] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:06.437922  1664 tablet_service.cc:1558] Processing DeleteTablet for tablet a5802fa5e328499da4525506ccdf4dc9 with delete_type TABLET_DATA_TOMBSTONED (TS ddf11fc190dd4b898773379c6b129d90 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49162
I20260709 12:59:06.431354  1526 raft_consensus.cc:2955] T 819fbeffe41b4610a05fcaac38e161b6 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:06.458807  2720 tablet_replica.cc:333] T a5802fa5e328499da4525506ccdf4dc9 P ddf11fc190dd4b898773379c6b129d90: stopping tablet replica
I20260709 12:59:06.459975  2720 raft_consensus.cc:2243] T a5802fa5e328499da4525506ccdf4dc9 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:06.461874  2720 raft_consensus.cc:2272] T a5802fa5e328499da4525506ccdf4dc9 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:06.466439  1430 catalog_manager.cc:5697] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:06.471251  2720 ts_tablet_manager.cc:1916] T a5802fa5e328499da4525506ccdf4dc9 P ddf11fc190dd4b898773379c6b129d90: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:06.475968  2719 raft_consensus.cc:2243] T 53176f970a394c5cb2c76bd88f09c751 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:06.477095  2719 raft_consensus.cc:2272] T 53176f970a394c5cb2c76bd88f09c751 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:06.479377  1605 raft_consensus.cc:2955] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:06.488371  2719 ts_tablet_manager.cc:1916] T 53176f970a394c5cb2c76bd88f09c751 P 39a92f5a4352465d8af3af5908fe8642: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:06.501659  1428 catalog_manager.cc:5697] T e4b8c02fb560459fbbb59424361a5457 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:06.512862  2225 raft_consensus.cc:2955] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:06.516969  1675 consensus_queue.cc:237] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:06.525207  2226 raft_consensus.cc:1275] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:06.528225  2707 consensus_queue.cc:1048] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:06.532898  2720 ts_tablet_manager.cc:1929] T a5802fa5e328499da4525506ccdf4dc9 P ddf11fc190dd4b898773379c6b129d90: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:06.539588  2720 log.cc:1199] T a5802fa5e328499da4525506ccdf4dc9 P ddf11fc190dd4b898773379c6b129d90: Deleting WAL directory at /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601891739070-431-0/minicluster-data/ts-2-root/wals/a5802fa5e328499da4525506ccdf4dc9
I20260709 12:59:06.542842  2649 raft_consensus.cc:2955] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:06.547170  1415 catalog_manager.cc:5028] TS ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217): tablet a5802fa5e328499da4525506ccdf4dc9 (table test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]) successfully deleted
I20260709 12:59:06.559715  2226 raft_consensus.cc:2955] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:06.570168  1602 raft_consensus.cc:1275] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:06.570963  2719 ts_tablet_manager.cc:1929] T 53176f970a394c5cb2c76bd88f09c751 P 39a92f5a4352465d8af3af5908fe8642: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:06.571486  2708 consensus_queue.cc:1048] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:06.571488  2719 log.cc:1199] T 53176f970a394c5cb2c76bd88f09c751 P 39a92f5a4352465d8af3af5908fe8642: Deleting WAL directory at /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601891739070-431-0/minicluster-data/ts-1-root/wals/53176f970a394c5cb2c76bd88f09c751
I20260709 12:59:06.575460  1416 catalog_manager.cc:5028] TS 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): tablet 53176f970a394c5cb2c76bd88f09c751 (table test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]) successfully deleted
I20260709 12:59:06.585510  1675 consensus_queue.cc:237] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:06.594292  1429 catalog_manager.cc:5697] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: config changed from index 3 to 4, VOTER e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:06.598865  1415 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 819fbeffe41b4610a05fcaac38e161b6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:06.599962  2226 raft_consensus.cc:1275] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:06.588526  1602 raft_consensus.cc:2955] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:06.601393  2712 consensus_queue.cc:1048] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:06.602428  1605 raft_consensus.cc:1275] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:06.604199  2708 consensus_queue.cc:1048] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:06.612486  1517 tablet_service.cc:1558] Processing DeleteTablet for tablet 819fbeffe41b4610a05fcaac38e161b6 with delete_type TABLET_DATA_TOMBSTONED (TS e46412b3b0b44f01ad5c33d4cfe3d6b1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43004
I20260709 12:59:06.614773  2708 raft_consensus.cc:2955] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:06.621079  2226 raft_consensus.cc:2955] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:06.624409  1605 raft_consensus.cc:2955] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:06.624781  2723 tablet_replica.cc:333] T 819fbeffe41b4610a05fcaac38e161b6 P e46412b3b0b44f01ad5c33d4cfe3d6b1: stopping tablet replica
I20260709 12:59:06.631050  2723 raft_consensus.cc:2243] T 819fbeffe41b4610a05fcaac38e161b6 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:06.631767  2723 raft_consensus.cc:2272] T 819fbeffe41b4610a05fcaac38e161b6 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:06.634155  1526 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "112134ca2a6243c98c85c27d41496747"
dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
mode: GRACEFUL
new_leader_uuid: "39a92f5a4352465d8af3af5908fe8642"
 from {username='slave'} at 127.0.0.1:55626
I20260709 12:59:06.634892  1526 raft_consensus.cc:606] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Received request to transfer leadership to TS 39a92f5a4352465d8af3af5908fe8642
I20260709 12:59:06.637773  2723 ts_tablet_manager.cc:1916] T 819fbeffe41b4610a05fcaac38e161b6 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:06.643599  1415 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e4b8c02fb560459fbbb59424361a5457 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:06.669708  1429 catalog_manager.cc:5697] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 reported cstate change: config changed from index 3 to 4, VOTER e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:06.682704  1605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0"
dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
mode: GRACEFUL
new_leader_uuid: "b96ce9cc496c49d7818fa983a17b062b"
 from {username='slave'} at 127.0.0.1:48230
I20260709 12:59:06.684175  1605 raft_consensus.cc:606] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Received request to transfer leadership to TS b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:06.688036  2700 raft_consensus.cc:993] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642: : Instructing follower b96ce9cc496c49d7818fa983a17b062b to start an election
I20260709 12:59:06.688566  2701 raft_consensus.cc:1081] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Signalling peer b96ce9cc496c49d7818fa983a17b062b to start an election
I20260709 12:59:06.693331  1517 tablet_service.cc:1558] Processing DeleteTablet for tablet e4b8c02fb560459fbbb59424361a5457 with delete_type TABLET_DATA_TOMBSTONED (TS e46412b3b0b44f01ad5c33d4cfe3d6b1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43004
I20260709 12:59:06.696596  2225 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0"
dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
 from {username='slave'} at 127.0.0.1:50310
I20260709 12:59:06.697252  2225 raft_consensus.cc:493] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:06.697621  2225 raft_consensus.cc:3060] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:06.704097  2225 raft_consensus.cc:515] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:06.710186  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:06.710868  1526 raft_consensus.cc:3060] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:06.711186  2723 ts_tablet_manager.cc:1929] T 819fbeffe41b4610a05fcaac38e161b6 P e46412b3b0b44f01ad5c33d4cfe3d6b1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:06.711614  2723 log.cc:1199] T 819fbeffe41b4610a05fcaac38e161b6 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Deleting WAL directory at /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601891739070-431-0/minicluster-data/ts-0-root/wals/819fbeffe41b4610a05fcaac38e161b6
I20260709 12:59:06.713383  2723 tablet_replica.cc:333] T e4b8c02fb560459fbbb59424361a5457 P e46412b3b0b44f01ad5c33d4cfe3d6b1: stopping tablet replica
I20260709 12:59:06.714022  1414 catalog_manager.cc:5028] TS e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): tablet 819fbeffe41b4610a05fcaac38e161b6 (table test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]) successfully deleted
I20260709 12:59:06.714375  2723 raft_consensus.cc:2243] T e4b8c02fb560459fbbb59424361a5457 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:06.715068  2723 raft_consensus.cc:2272] T e4b8c02fb560459fbbb59424361a5457 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:06.711486  2582 raft_consensus.cc:993] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1: : Instructing follower 39a92f5a4352465d8af3af5908fe8642 to start an election
I20260709 12:59:06.717607  2582 raft_consensus.cc:1081] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Signalling peer 39a92f5a4352465d8af3af5908fe8642 to start an election
I20260709 12:59:06.717974  1526 raft_consensus.cc:2468] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 2.
I20260709 12:59:06.718972  2723 ts_tablet_manager.cc:1916] T e4b8c02fb560459fbbb59424361a5457 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:06.719436  2190 leader_election.cc:304] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:06.720573  2684 raft_consensus.cc:2804] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:06.721292  1602 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "112134ca2a6243c98c85c27d41496747"
dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
 from {username='slave'} at 127.0.0.1:36194
I20260709 12:59:06.721302  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:06.722082  1602 raft_consensus.cc:493] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:06.722100  1605 raft_consensus.cc:3055] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:06.722558  1602 raft_consensus.cc:3060] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:06.722625  1605 raft_consensus.cc:740] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:06.723245  2684 raft_consensus.cc:697] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 2 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 12:59:06.723584  1605 consensus_queue.cc:260] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:06.724673  1605 raft_consensus.cc:3060] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:06.719444  2225 leader_election.cc:290] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 2 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:06.733475  1602 raft_consensus.cc:515] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:06.736342  1602 leader_election.cc:290] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:06.736892  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:06.737445  1526 raft_consensus.cc:3055] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:06.724180  2684 consensus_queue.cc:237] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:06.737679  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:06.727954  1675 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097"
dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
mode: GRACEFUL
new_leader_uuid: "b96ce9cc496c49d7818fa983a17b062b"
 from {username='slave'} at 127.0.0.1:33616
I20260709 12:59:06.737710  1526 raft_consensus.cc:740] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 12:59:06.739048  1526 consensus_queue.cc:260] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:06.740267  1526 raft_consensus.cc:3060] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:06.732375  1605 raft_consensus.cc:2468] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 2.
I20260709 12:59:06.738260  1681 raft_consensus.cc:3060] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:06.738381  1675 raft_consensus.cc:606] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Received request to transfer leadership to TS b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:06.746796  2723 ts_tablet_manager.cc:1929] T e4b8c02fb560459fbbb59424361a5457 P e46412b3b0b44f01ad5c33d4cfe3d6b1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:06.747345  2723 log.cc:1199] T e4b8c02fb560459fbbb59424361a5457 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Deleting WAL directory at /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601891739070-431-0/minicluster-data/ts-0-root/wals/e4b8c02fb560459fbbb59424361a5457
I20260709 12:59:06.749104  1414 catalog_manager.cc:5028] TS e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): tablet e4b8c02fb560459fbbb59424361a5457 (table test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]) successfully deleted
I20260709 12:59:06.750187  1675 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3"
dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
mode: GRACEFUL
new_leader_uuid: "39a92f5a4352465d8af3af5908fe8642"
 from {username='slave'} at 127.0.0.1:33616
I20260709 12:59:06.750842  1675 raft_consensus.cc:606] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Received request to transfer leadership to TS 39a92f5a4352465d8af3af5908fe8642
I20260709 12:59:06.753526  1605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004"
dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
mode: GRACEFUL
new_leader_uuid: "b96ce9cc496c49d7818fa983a17b062b"
 from {username='slave'} at 127.0.0.1:48230
I20260709 12:59:06.754213  1605 raft_consensus.cc:606] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Received request to transfer leadership to TS b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:06.754261  1428 catalog_manager.cc:5697] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 1 to 2, leader changed from 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) to b96ce9cc496c49d7818fa983a17b062b (127.0.107.196). New cstate: current_term: 2 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:06.756390  1526 raft_consensus.cc:2468] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 2.
I20260709 12:59:06.758427  1681 raft_consensus.cc:2468] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 2.
I20260709 12:59:06.758338  1570 leader_election.cc:304] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:06.760088  2638 raft_consensus.cc:2804] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:06.760522  2638 raft_consensus.cc:697] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 2 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:06.761294  2638 consensus_queue.cc:237] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:06.763116  1605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0"
dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
mode: GRACEFUL
new_leader_uuid: "b96ce9cc496c49d7818fa983a17b062b"
 from {username='slave'} at 127.0.0.1:48230
I20260709 12:59:06.763743  1605 raft_consensus.cc:606] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Received request to transfer leadership to TS b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:06.766775   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:59:06.768255   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:06.773152  1428 catalog_manager.cc:5697] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 1 to 2, leader changed from e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) to 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:07.026633  2712 raft_consensus.cc:993] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90: : Instructing follower b96ce9cc496c49d7818fa983a17b062b to start an election
I20260709 12:59:07.027257  2712 raft_consensus.cc:1081] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Signalling peer b96ce9cc496c49d7818fa983a17b062b to start an election
I20260709 12:59:07.029943  2700 raft_consensus.cc:993] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642: : Instructing follower b96ce9cc496c49d7818fa983a17b062b to start an election
I20260709 12:59:07.030527  2699 raft_consensus.cc:1081] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Signalling peer b96ce9cc496c49d7818fa983a17b062b to start an election
I20260709 12:59:07.031136  2225 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097"
dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
 from {username='slave'} at 127.0.0.1:50326
I20260709 12:59:07.031685  2225 raft_consensus.cc:493] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:07.031994  2225 raft_consensus.cc:3060] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:07.032155  2226 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0"
dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
 from {username='slave'} at 127.0.0.1:50310
I20260709 12:59:07.032658  2226 raft_consensus.cc:493] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:07.032963  2226 raft_consensus.cc:3060] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:07.036883  2225 raft_consensus.cc:515] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:07.037467  2226 raft_consensus.cc:515] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:07.039157  2225 leader_election.cc:290] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 2 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:07.039475  2226 leader_election.cc:290] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 2 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:07.040616  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:07.040997  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:07.041146  1526 raft_consensus.cc:3060] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:07.041445  1602 raft_consensus.cc:3060] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:07.046222  1602 raft_consensus.cc:2468] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 2.
I20260709 12:59:07.039552  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:07.046355  1526 raft_consensus.cc:2468] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 2.
I20260709 12:59:07.047490  1681 raft_consensus.cc:3055] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:07.047749  1681 raft_consensus.cc:740] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:07.048080  2190 leader_election.cc:304] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:07.048413  1681 consensus_queue.cc:260] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:07.048595  2192 leader_election.cc:304] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 12:59:07.048924  2684 raft_consensus.cc:2804] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:07.049446  2727 raft_consensus.cc:2804] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:07.050103  2684 raft_consensus.cc:697] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 2 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 12:59:07.050251  1681 raft_consensus.cc:3060] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:07.051080  2684 consensus_queue.cc:237] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:07.049364  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:07.058331  1602 raft_consensus.cc:3055] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:07.059294  1602 raft_consensus.cc:740] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:07.061254  2699 raft_consensus.cc:993] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642: : Instructing follower b96ce9cc496c49d7818fa983a17b062b to start an election
I20260709 12:59:07.061734  2699 raft_consensus.cc:1081] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Signalling peer b96ce9cc496c49d7818fa983a17b062b to start an election
I20260709 12:59:07.063345  2226 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004"
dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
 from {username='slave'} at 127.0.0.1:50310
I20260709 12:59:07.063807  2727 raft_consensus.cc:697] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 2 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 12:59:07.063907  2226 raft_consensus.cc:493] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:07.064496  2226 raft_consensus.cc:3060] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:07.064925  2727 consensus_queue.cc:237] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:07.060772  1602 consensus_queue.cc:260] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:07.071414  1602 raft_consensus.cc:3060] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:07.070587  2226 raft_consensus.cc:515] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:07.080349  2226 leader_election.cc:290] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 2 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:07.083213  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:07.083869  1526 raft_consensus.cc:3060] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:07.084112  1602 raft_consensus.cc:2468] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 2.
I20260709 12:59:07.086863  1681 raft_consensus.cc:2468] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 2.
I20260709 12:59:07.088127  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:07.089190  1602 raft_consensus.cc:3055] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:07.087857  1428 catalog_manager.cc:5697] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 1 to 2, leader changed from 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) to b96ce9cc496c49d7818fa983a17b062b (127.0.107.196). New cstate: current_term: 2 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:07.089540  1602 raft_consensus.cc:740] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:07.089936  1526 raft_consensus.cc:2468] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 2.
I20260709 12:59:07.090413  1602 consensus_queue.cc:260] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:07.090432  1428 catalog_manager.cc:5697] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 1 to 2, leader changed from ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) to b96ce9cc496c49d7818fa983a17b062b (127.0.107.196). New cstate: current_term: 2 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:07.091830  1602 raft_consensus.cc:3060] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:07.091150  2190 leader_election.cc:304] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:07.094449  2727 raft_consensus.cc:2804] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:07.095245  2727 raft_consensus.cc:697] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 2 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 12:59:07.096175  2727 consensus_queue.cc:237] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:07.102054  1602 raft_consensus.cc:2468] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 2.
I20260709 12:59:07.107872  1428 catalog_manager.cc:5697] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 1 to 2, leader changed from 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) to b96ce9cc496c49d7818fa983a17b062b (127.0.107.196). New cstate: current_term: 2 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:07.143539  1602 raft_consensus.cc:1275] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:07.144968  2727 consensus_queue.cc:1048] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:07.159667  1526 raft_consensus.cc:1275] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:07.160933  2684 consensus_queue.cc:1048] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:07.215448  1526 raft_consensus.cc:1275] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:07.216665  2701 consensus_queue.cc:1048] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:07.235077  1681 raft_consensus.cc:1275] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:07.236496  2638 consensus_queue.cc:1048] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:07.328212  2649 raft_consensus.cc:993] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90: : Instructing follower 39a92f5a4352465d8af3af5908fe8642 to start an election
I20260709 12:59:07.328687  2649 raft_consensus.cc:1081] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Signalling peer 39a92f5a4352465d8af3af5908fe8642 to start an election
I20260709 12:59:07.330029  1602 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3"
dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
 from {username='slave'} at 127.0.0.1:36200
I20260709 12:59:07.330475  1602 raft_consensus.cc:493] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:07.330752  1602 raft_consensus.cc:3060] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:07.335350  1602 raft_consensus.cc:515] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:07.336766  1602 leader_election.cc:290] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:07.337440  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:07.337680  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:07.338153  1681 raft_consensus.cc:3055] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:07.338153  1530 raft_consensus.cc:3060] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:07.338588  1681 raft_consensus.cc:740] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:07.339666  1681 consensus_queue.cc:260] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:07.340937  1681 raft_consensus.cc:3060] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:07.344569  1530 raft_consensus.cc:2468] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 2.
I20260709 12:59:07.345654  1570 leader_election.cc:304] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:07.346254  2638 raft_consensus.cc:2804] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:07.346702  2638 raft_consensus.cc:697] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 2 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:07.347138  1681 raft_consensus.cc:2468] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 2.
I20260709 12:59:07.347469  2638 consensus_queue.cc:237] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:07.371651  1428 catalog_manager.cc:5697] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 1 to 2, leader changed from ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) to 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:07.454819  1530 raft_consensus.cc:1275] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:07.456044  2684 consensus_queue.cc:1048] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:07.464879  1605 raft_consensus.cc:1275] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:07.468456  2684 consensus_queue.cc:1048] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:07.498000  1605 raft_consensus.cc:1275] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:07.499396  2684 consensus_queue.cc:1048] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:07.511171  1681 raft_consensus.cc:1275] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:07.514420  2727 consensus_queue.cc:1048] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:07.547053  1530 raft_consensus.cc:1275] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:07.548256  2727 consensus_queue.cc:1048] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:07.556059  1605 raft_consensus.cc:1275] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:07.557338  2731 consensus_queue.cc:1048] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:07.756227  1526 consensus_queue.cc:237] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:59:07.762024  1675 raft_consensus.cc:1275] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:07.762761  1602 raft_consensus.cc:1275] T e78618eba8b74effa4a90f2c8e34cc02 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:59:07.763227  1497 consensus_peers.cc:597] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 -> Peer b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373): Couldn't send request to peer b96ce9cc496c49d7818fa983a17b062b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e78618eba8b74effa4a90f2c8e34cc02. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:07.763464  2672 consensus_queue.cc:1048] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:07.764292  2745 consensus_queue.cc:1048] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:07.769595   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:07.772523  2745 raft_consensus.cc:2955] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:59:07.777768  1602 raft_consensus.cc:2955] T e78618eba8b74effa4a90f2c8e34cc02 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:59:07.788810  1681 raft_consensus.cc:1275] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:07.790307  2638 consensus_queue.cc:1048] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:07.803618  1675 raft_consensus.cc:2955] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:59:07.814884  1526 raft_consensus.cc:1275] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:07.816979  2638 consensus_queue.cc:1048] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:07.822048  1430 catalog_manager.cc:5697] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 reported cstate change: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:59:07.847275   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:07.877660  1602 consensus_queue.cc:237] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:59:07.888383  1681 raft_consensus.cc:1275] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:07.890393  2700 consensus_queue.cc:1048] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:07.917541  1526 raft_consensus.cc:1275] T 0b050d298db6466f856d263a342e3c51 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:07.920029  2700 consensus_queue.cc:1048] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:07.922592  1675 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331"
dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
mode: GRACEFUL
new_leader_uuid: "b96ce9cc496c49d7818fa983a17b062b"
 from {username='slave'} at 127.0.0.1:33616
I20260709 12:59:07.923216  1675 raft_consensus.cc:606] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Received request to transfer leadership to TS b96ce9cc496c49d7818fa983a17b062b
W20260709 12:59:07.925168  1572 consensus_peers.cc:597] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 -> Peer b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373): Couldn't send request to peer b96ce9cc496c49d7818fa983a17b062b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0b050d298db6466f856d263a342e3c51. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:07.924690  2699 raft_consensus.cc:2955] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:59:07.934685  1526 raft_consensus.cc:2955] T 0b050d298db6466f856d263a342e3c51 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:59:07.937315  1675 raft_consensus.cc:2955] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:59:07.943775  1679 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93"
dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
mode: GRACEFUL
new_leader_uuid: "39a92f5a4352465d8af3af5908fe8642"
 from {username='slave'} at 127.0.0.1:33616
I20260709 12:59:07.944259  1679 raft_consensus.cc:606] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 2 LEADER]: Received request to transfer leadership to TS 39a92f5a4352465d8af3af5908fe8642
I20260709 12:59:07.945093  1602 consensus_queue.cc:237] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:59:07.952373  1430 catalog_manager.cc:5697] T 0b050d298db6466f856d263a342e3c51 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
W20260709 12:59:07.960976  1572 consensus_peers.cc:597] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 -> Peer b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373): Couldn't send request to peer b96ce9cc496c49d7818fa983a17b062b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: dcad30336a5440bca17cda2724035211. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:07.962231  1679 raft_consensus.cc:1275] T dcad30336a5440bca17cda2724035211 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:07.955678  1675 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2228d923442c4e439f7f227db910dad8"
dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
mode: GRACEFUL
new_leader_uuid: "b96ce9cc496c49d7818fa983a17b062b"
 from {username='slave'} at 127.0.0.1:33616
I20260709 12:59:07.964315  1675 raft_consensus.cc:606] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Received request to transfer leadership to TS b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:07.964439  1526 raft_consensus.cc:1275] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:07.966076  2712 raft_consensus.cc:993] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90: : Instructing follower b96ce9cc496c49d7818fa983a17b062b to start an election
I20260709 12:59:07.966022  2700 consensus_queue.cc:1048] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:07.966620  2712 raft_consensus.cc:1081] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Signalling peer b96ce9cc496c49d7818fa983a17b062b to start an election
I20260709 12:59:07.967146  2701 consensus_queue.cc:1048] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:07.967494  1602 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91"
dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
mode: GRACEFUL
new_leader_uuid: "b96ce9cc496c49d7818fa983a17b062b"
 from {username='slave'} at 127.0.0.1:48230
I20260709 12:59:07.968103  2226 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2228d923442c4e439f7f227db910dad8"
dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
 from {username='slave'} at 127.0.0.1:50326
I20260709 12:59:07.969640  2226 raft_consensus.cc:493] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:07.969923  2226 raft_consensus.cc:3060] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:07.970959  1602 raft_consensus.cc:606] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Received request to transfer leadership to TS b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:07.974020  1526 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5"
dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
mode: GRACEFUL
new_leader_uuid: "39a92f5a4352465d8af3af5908fe8642"
 from {username='slave'} at 127.0.0.1:55626
I20260709 12:59:07.974557  1526 raft_consensus.cc:606] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Received request to transfer leadership to TS 39a92f5a4352465d8af3af5908fe8642
I20260709 12:59:07.976410  2226 raft_consensus.cc:515] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:07.977746  1602 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "822e65124bb44159b257fd219d28d93c"
dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
mode: GRACEFUL
new_leader_uuid: "b96ce9cc496c49d7818fa983a17b062b"
 from {username='slave'} at 127.0.0.1:48230
I20260709 12:59:07.978399  1602 raft_consensus.cc:606] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Received request to transfer leadership to TS b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:07.979365  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:07.980013  1526 raft_consensus.cc:3060] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:07.980108   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:59:07.981769   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:07.991861  2226 leader_election.cc:290] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 2 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:07.990639  1526 raft_consensus.cc:2468] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 2.
I20260709 12:59:07.992781  2701 raft_consensus.cc:2955] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:59:07.994501  2190 leader_election.cc:304] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:07.995332  2731 raft_consensus.cc:2804] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:07.995810  2731 raft_consensus.cc:697] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 2 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 12:59:07.996445  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:07.997064  1679 raft_consensus.cc:3055] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:07.997352  1679 raft_consensus.cc:740] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:07.998097  1679 consensus_queue.cc:260] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:07.999159  1679 raft_consensus.cc:3060] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:07.996639  2731 consensus_queue.cc:237] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:08.005188  1530 raft_consensus.cc:2955] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:59:08.015013  2712 raft_consensus.cc:993] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90: : Instructing follower b96ce9cc496c49d7818fa983a17b062b to start an election
I20260709 12:59:08.015810  2712 raft_consensus.cc:1081] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Signalling peer b96ce9cc496c49d7818fa983a17b062b to start an election
I20260709 12:59:08.019064  2226 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331"
dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
 from {username='slave'} at 127.0.0.1:50326
I20260709 12:59:08.019816  2226 raft_consensus.cc:493] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:08.020491  2226 raft_consensus.cc:3060] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:08.024684  1679 raft_consensus.cc:2468] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 2.
I20260709 12:59:08.047642  1677 consensus_queue.cc:237] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:59:08.042618  1429 catalog_manager.cc:5697] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:08.046340  1675 raft_consensus.cc:2955] T dcad30336a5440bca17cda2724035211 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:59:08.084028  1428 catalog_manager.cc:5697] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 1 to 2, leader changed from ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) to b96ce9cc496c49d7818fa983a17b062b (127.0.107.196). New cstate: current_term: 2 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:08.029371  2226 raft_consensus.cc:515] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:08.088020  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:08.088593  1602 raft_consensus.cc:3060] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:08.098335  1602 raft_consensus.cc:2468] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 2.
I20260709 12:59:08.099557  2192 leader_election.cc:304] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 12:59:08.100481  2731 raft_consensus.cc:2804] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:08.099727  2226 leader_election.cc:290] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 2 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:08.100699  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:08.101069  2731 raft_consensus.cc:697] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 2 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
W20260709 12:59:08.101696  1646 consensus_peers.cc:597] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 -> Peer b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373): Couldn't send request to peer b96ce9cc496c49d7818fa983a17b062b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1359810508724a7a8749ce09a6654a9c. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:08.101356  1679 raft_consensus.cc:3055] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:08.102489  1679 raft_consensus.cc:740] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:08.103338  1679 consensus_queue.cc:260] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:08.104564  1679 raft_consensus.cc:3060] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:08.104812  1602 raft_consensus.cc:1275] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:08.106004  2731 consensus_queue.cc:237] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:08.107869  2764 consensus_queue.cc:1048] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:08.109172  1526 raft_consensus.cc:1275] T 1359810508724a7a8749ce09a6654a9c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:08.111440  1679 raft_consensus.cc:2468] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 2.
I20260709 12:59:08.113488  2712 consensus_queue.cc:1048] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:08.125396  2712 raft_consensus.cc:993] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90: : Instructing follower 39a92f5a4352465d8af3af5908fe8642 to start an election
I20260709 12:59:08.125311  1428 catalog_manager.cc:5697] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 1 to 2, leader changed from ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) to b96ce9cc496c49d7818fa983a17b062b (127.0.107.196). New cstate: current_term: 2 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:08.126340  2764 raft_consensus.cc:1081] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 2 LEADER]: Signalling peer 39a92f5a4352465d8af3af5908fe8642 to start an election
I20260709 12:59:08.128228  1602 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93"
dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
 from {username='slave'} at 127.0.0.1:36200
I20260709 12:59:08.128772  1602 raft_consensus.cc:493] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:08.129106  1602 raft_consensus.cc:3060] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:08.129423  2762 raft_consensus.cc:2955] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:59:08.132871  1605 raft_consensus.cc:2955] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:59:08.136950  1602 raft_consensus.cc:515] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:08.140727  2638 raft_consensus.cc:993] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642: : Instructing follower b96ce9cc496c49d7818fa983a17b062b to start an election
I20260709 12:59:08.141182  2638 raft_consensus.cc:1081] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Signalling peer b96ce9cc496c49d7818fa983a17b062b to start an election
I20260709 12:59:08.143471  2226 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91"
dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
 from {username='slave'} at 127.0.0.1:50310
I20260709 12:59:08.143985  2226 raft_consensus.cc:493] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:08.144312  2226 raft_consensus.cc:3060] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:08.151114  2226 raft_consensus.cc:515] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:08.151700  1428 catalog_manager.cc:5697] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 reported cstate change: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:08.152608  2226 leader_election.cc:290] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 2 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:08.153218  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:08.153748  1600 raft_consensus.cc:3055] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:08.154078  1600 raft_consensus.cc:740] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:08.153685  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:08.154757  1679 raft_consensus.cc:3060] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:08.154872  1600 consensus_queue.cc:260] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:08.132565  1530 raft_consensus.cc:2955] T 1359810508724a7a8749ce09a6654a9c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:59:08.156177  1600 raft_consensus.cc:3060] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:08.161111  1679 raft_consensus.cc:2468] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 2.
I20260709 12:59:08.162603  2191 leader_election.cc:304] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:08.162408  1600 raft_consensus.cc:2468] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 2.
I20260709 12:59:08.168612  1602 leader_election.cc:290] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:08.168744  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:08.169399  1677 raft_consensus.cc:3055] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:08.169647  1677 raft_consensus.cc:740] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:08.170192  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:08.170769  1526 raft_consensus.cc:3060] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:08.170315  1677 consensus_queue.cc:260] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:08.176755  2731 raft_consensus.cc:2804] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:08.177317  2731 raft_consensus.cc:697] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 2 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 12:59:08.177664  1526 raft_consensus.cc:2468] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 3.
I20260709 12:59:08.178203  2731 consensus_queue.cc:237] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:08.178913  1570 leader_election.cc:304] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:08.179702  2701 raft_consensus.cc:2804] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:08.180321  2701 raft_consensus.cc:697] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 3 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:08.182754  1677 raft_consensus.cc:3060] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:08.184854  2701 consensus_queue.cc:237] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:08.193010  1677 raft_consensus.cc:2468] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 3.
I20260709 12:59:08.203989  2773 ts_tablet_manager.cc:933] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b: Initiating tablet copy from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931)
I20260709 12:59:08.213534  1428 catalog_manager.cc:5697] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 2 to 3, leader changed from ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) to 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:08.217710  2773 tablet_copy_client.cc:323] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:43931
I20260709 12:59:08.219758  1542 tablet_copy_service.cc:140] P e46412b3b0b44f01ad5c33d4cfe3d6b1: Received BeginTabletCopySession request for tablet e78618eba8b74effa4a90f2c8e34cc02 from peer b96ce9cc496c49d7818fa983a17b062b ({username='slave'} at 127.0.0.1:49310)
I20260709 12:59:08.220288  1542 tablet_copy_service.cc:161] P e46412b3b0b44f01ad5c33d4cfe3d6b1: Beginning new tablet copy session on tablet e78618eba8b74effa4a90f2c8e34cc02 from peer b96ce9cc496c49d7818fa983a17b062b at {username='slave'} at 127.0.0.1:49310: session id = b96ce9cc496c49d7818fa983a17b062b-e78618eba8b74effa4a90f2c8e34cc02
I20260709 12:59:08.229013  1430 catalog_manager.cc:5697] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 1 to 2, leader changed from 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) to b96ce9cc496c49d7818fa983a17b062b (127.0.107.196). New cstate: current_term: 2 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:08.229830  1542 tablet_copy_source_session.cc:215] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:08.234822  2773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e78618eba8b74effa4a90f2c8e34cc02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:08.248243  2700 raft_consensus.cc:993] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642: : Instructing follower b96ce9cc496c49d7818fa983a17b062b to start an election
I20260709 12:59:08.248792  2700 raft_consensus.cc:1081] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Signalling peer b96ce9cc496c49d7818fa983a17b062b to start an election
I20260709 12:59:08.250470  2226 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "822e65124bb44159b257fd219d28d93c"
dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
 from {username='slave'} at 127.0.0.1:50310
I20260709 12:59:08.251027  2226 raft_consensus.cc:493] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:08.251170  2773 tablet_copy_client.cc:806] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:08.251387  2226 raft_consensus.cc:3060] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:08.251720  2773 tablet_copy_client.cc:670] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:08.255268  2773 tablet_copy_client.cc:538] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:08.257115  2226 raft_consensus.cc:515] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:08.259120  2226 leader_election.cc:290] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 2 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:08.260026  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:08.260664  1602 raft_consensus.cc:3055] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:08.260991  1602 raft_consensus.cc:740] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:08.261722  1602 consensus_queue.cc:260] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:08.263417  1602 raft_consensus.cc:3060] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:08.264431  2773 tablet_bootstrap.cc:492] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap starting.
I20260709 12:59:08.269753  1602 raft_consensus.cc:2468] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 2.
I20260709 12:59:08.260021  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:08.270856  1677 raft_consensus.cc:3060] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:08.271826  2192 leader_election.cc:304] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 12:59:08.272899  2731 raft_consensus.cc:2804] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:08.274083  2731 raft_consensus.cc:697] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 2 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 12:59:08.277431  1677 raft_consensus.cc:2468] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 2.
I20260709 12:59:08.275182  2731 consensus_queue.cc:237] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:08.287489  2672 raft_consensus.cc:993] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1: : Instructing follower 39a92f5a4352465d8af3af5908fe8642 to start an election
I20260709 12:59:08.287923  2741 raft_consensus.cc:1081] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Signalling peer 39a92f5a4352465d8af3af5908fe8642 to start an election
I20260709 12:59:08.289314  1602 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5"
dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
 from {username='slave'} at 127.0.0.1:36194
I20260709 12:59:08.289759  1602 raft_consensus.cc:493] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:08.290037  1602 raft_consensus.cc:3060] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:08.294142  1430 catalog_manager.cc:5697] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 1 to 2, leader changed from 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) to b96ce9cc496c49d7818fa983a17b062b (127.0.107.196). New cstate: current_term: 2 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:08.297281  1602 raft_consensus.cc:515] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:08.299427  1602 leader_election.cc:290] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:08.300323  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:08.300902  1526 raft_consensus.cc:3055] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:08.301204  1526 raft_consensus.cc:740] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 12:59:08.301952  1526 consensus_queue.cc:260] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:08.303509  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:08.304070  1677 raft_consensus.cc:3060] T 72071486140c4d6c919b25e882a8f5e5 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:08.305773  1526 raft_consensus.cc:3060] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:08.311733  1677 raft_consensus.cc:2468] T 72071486140c4d6c919b25e882a8f5e5 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 2.
I20260709 12:59:08.313586  1526 raft_consensus.cc:2468] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 2.
I20260709 12:59:08.313639  1571 leader_election.cc:304] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:08.314708  2700 raft_consensus.cc:2804] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:08.315245  2700 raft_consensus.cc:697] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 2 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:08.316053  2700 consensus_queue.cc:237] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:08.318231  2773 tablet_bootstrap.cc:492] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:08.319020  2773 tablet_bootstrap.cc:492] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap complete.
I20260709 12:59:08.320320  2773 ts_tablet_manager.cc:1403] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b: Time spent bootstrapping tablet: real 0.056s	user 0.013s	sys 0.009s
I20260709 12:59:08.323347  2773 raft_consensus.cc:359] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:59:08.324165  2773 raft_consensus.cc:740] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Initialized, Role: LEARNER
I20260709 12:59:08.324802  2773 consensus_queue.cc:260] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:59:08.325567  1430 catalog_manager.cc:5697] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 1 to 2, leader changed from e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) to 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:08.334767  2773 ts_tablet_manager.cc:1434] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.001s
I20260709 12:59:08.338996  1542 tablet_copy_service.cc:342] P e46412b3b0b44f01ad5c33d4cfe3d6b1: Request end of tablet copy session b96ce9cc496c49d7818fa983a17b062b-e78618eba8b74effa4a90f2c8e34cc02 received from {username='slave'} at 127.0.0.1:49310
I20260709 12:59:08.339460  1542 tablet_copy_service.cc:434] P e46412b3b0b44f01ad5c33d4cfe3d6b1: ending tablet copy session b96ce9cc496c49d7818fa983a17b062b-e78618eba8b74effa4a90f2c8e34cc02 on tablet e78618eba8b74effa4a90f2c8e34cc02 with peer b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:08.351011  2773 ts_tablet_manager.cc:933] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b: Initiating tablet copy from peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:08.353009  2773 tablet_copy_client.cc:323] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:40303
I20260709 12:59:08.354491  1617 tablet_copy_service.cc:140] P 39a92f5a4352465d8af3af5908fe8642: Received BeginTabletCopySession request for tablet 0b050d298db6466f856d263a342e3c51 from peer b96ce9cc496c49d7818fa983a17b062b ({username='slave'} at 127.0.0.1:57268)
I20260709 12:59:08.354983  1617 tablet_copy_service.cc:161] P 39a92f5a4352465d8af3af5908fe8642: Beginning new tablet copy session on tablet 0b050d298db6466f856d263a342e3c51 from peer b96ce9cc496c49d7818fa983a17b062b at {username='slave'} at 127.0.0.1:57268: session id = b96ce9cc496c49d7818fa983a17b062b-0b050d298db6466f856d263a342e3c51
I20260709 12:59:08.361673  1617 tablet_copy_source_session.cc:215] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:08.364976  2773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b050d298db6466f856d263a342e3c51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:08.376776  2773 tablet_copy_client.cc:806] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:08.378852  2773 tablet_copy_client.cc:670] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:08.385339  2773 tablet_copy_client.cc:538] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:08.394994  2773 tablet_bootstrap.cc:492] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap starting.
I20260709 12:59:08.417094  2773 tablet_bootstrap.cc:492] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:08.418002  2773 tablet_bootstrap.cc:492] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap complete.
I20260709 12:59:08.418764  2773 ts_tablet_manager.cc:1403] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b: Time spent bootstrapping tablet: real 0.024s	user 0.019s	sys 0.004s
I20260709 12:59:08.421602  2773 raft_consensus.cc:359] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:59:08.422437  2773 raft_consensus.cc:740] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Initialized, Role: LEARNER
I20260709 12:59:08.423547  2773 consensus_queue.cc:260] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:59:08.426697  2773 ts_tablet_manager.cc:1434] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 12:59:08.428606  1617 tablet_copy_service.cc:342] P 39a92f5a4352465d8af3af5908fe8642: Request end of tablet copy session b96ce9cc496c49d7818fa983a17b062b-0b050d298db6466f856d263a342e3c51 received from {username='slave'} at 127.0.0.1:57268
I20260709 12:59:08.429034  1617 tablet_copy_service.cc:434] P 39a92f5a4352465d8af3af5908fe8642: ending tablet copy session b96ce9cc496c49d7818fa983a17b062b-0b050d298db6466f856d263a342e3c51 on tablet 0b050d298db6466f856d263a342e3c51 with peer b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:08.443639  1677 raft_consensus.cc:1275] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:08.445875  2731 consensus_queue.cc:1048] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:08.458202  1530 raft_consensus.cc:1275] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:08.459779  2684 consensus_queue.cc:1048] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:08.502338  2773 ts_tablet_manager.cc:933] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b: Initiating tablet copy from peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:08.536882  2773 tablet_copy_client.cc:323] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:44217
I20260709 12:59:08.538513  1690 tablet_copy_service.cc:140] P ddf11fc190dd4b898773379c6b129d90: Received BeginTabletCopySession request for tablet 1359810508724a7a8749ce09a6654a9c from peer b96ce9cc496c49d7818fa983a17b062b ({username='slave'} at 127.0.0.1:50664)
I20260709 12:59:08.539013  1690 tablet_copy_service.cc:161] P ddf11fc190dd4b898773379c6b129d90: Beginning new tablet copy session on tablet 1359810508724a7a8749ce09a6654a9c from peer b96ce9cc496c49d7818fa983a17b062b at {username='slave'} at 127.0.0.1:50664: session id = b96ce9cc496c49d7818fa983a17b062b-1359810508724a7a8749ce09a6654a9c
I20260709 12:59:08.544955  1690 tablet_copy_source_session.cc:215] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:08.547952  2773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1359810508724a7a8749ce09a6654a9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:08.556669  2788 ts_tablet_manager.cc:933] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b: Initiating tablet copy from peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:08.569941  2788 tablet_copy_client.cc:323] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:40303
I20260709 12:59:08.570231  2773 tablet_copy_client.cc:806] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:08.570840  2773 tablet_copy_client.cc:670] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:08.571640  1617 tablet_copy_service.cc:140] P 39a92f5a4352465d8af3af5908fe8642: Received BeginTabletCopySession request for tablet dcad30336a5440bca17cda2724035211 from peer b96ce9cc496c49d7818fa983a17b062b ({username='slave'} at 127.0.0.1:57268)
I20260709 12:59:08.572256  1617 tablet_copy_service.cc:161] P 39a92f5a4352465d8af3af5908fe8642: Beginning new tablet copy session on tablet dcad30336a5440bca17cda2724035211 from peer b96ce9cc496c49d7818fa983a17b062b at {username='slave'} at 127.0.0.1:57268: session id = b96ce9cc496c49d7818fa983a17b062b-dcad30336a5440bca17cda2724035211
I20260709 12:59:08.575111  2773 tablet_copy_client.cc:538] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:08.582861  1617 tablet_copy_source_session.cc:215] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:08.586026  2773 tablet_bootstrap.cc:492] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b: Bootstrap starting.
I20260709 12:59:08.587734  2788 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcad30336a5440bca17cda2724035211. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:08.598379  1677 raft_consensus.cc:1275] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:08.605207  2684 consensus_queue.cc:1048] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:08.611029  2788 tablet_copy_client.cc:806] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:08.611660  2788 tablet_copy_client.cc:670] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:08.616302  2788 tablet_copy_client.cc:538] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:08.629897  2227 raft_consensus.cc:1217] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:08.656890  2788 tablet_bootstrap.cc:492] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap starting.
I20260709 12:59:08.697427  1602 raft_consensus.cc:1275] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:08.698946  2727 consensus_queue.cc:1048] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:08.705775  2773 tablet_bootstrap.cc:492] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:08.706847  2773 tablet_bootstrap.cc:492] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b: Bootstrap complete.
I20260709 12:59:08.707516  2773 ts_tablet_manager.cc:1403] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b: Time spent bootstrapping tablet: real 0.122s	user 0.040s	sys 0.041s
I20260709 12:59:08.711771  2773 raft_consensus.cc:359] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:59:08.712580  2773 raft_consensus.cc:740] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Initialized, Role: LEARNER
I20260709 12:59:08.713182  2773 consensus_queue.cc:260] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:59:08.718817  2773 ts_tablet_manager.cc:1434] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.002s
I20260709 12:59:08.721056  1690 tablet_copy_service.cc:342] P ddf11fc190dd4b898773379c6b129d90: Request end of tablet copy session b96ce9cc496c49d7818fa983a17b062b-1359810508724a7a8749ce09a6654a9c received from {username='slave'} at 127.0.0.1:50664
I20260709 12:59:08.722159  1690 tablet_copy_service.cc:434] P ddf11fc190dd4b898773379c6b129d90: ending tablet copy session b96ce9cc496c49d7818fa983a17b062b-1359810508724a7a8749ce09a6654a9c on tablet 1359810508724a7a8749ce09a6654a9c with peer b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:08.736481  2788 tablet_bootstrap.cc:492] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:08.736548  1524 raft_consensus.cc:1275] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:08.737638  2788 tablet_bootstrap.cc:492] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap complete.
I20260709 12:59:08.737573  1679 raft_consensus.cc:1275] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:08.738536  2788 ts_tablet_manager.cc:1403] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b: Time spent bootstrapping tablet: real 0.082s	user 0.023s	sys 0.013s
I20260709 12:59:08.721117  1605 raft_consensus.cc:1275] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:08.739217  2727 consensus_queue.cc:1048] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:08.740823  2727 consensus_queue.cc:1048] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:08.739095  2701 consensus_queue.cc:1048] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 12:59:08.747234  2788 raft_consensus.cc:359] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:59:08.748064  2788 raft_consensus.cc:740] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Initialized, Role: LEARNER
I20260709 12:59:08.748745  2788 consensus_queue.cc:260] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:59:08.753684  2788 ts_tablet_manager.cc:1434] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.003s
I20260709 12:59:08.755635  1617 tablet_copy_service.cc:342] P 39a92f5a4352465d8af3af5908fe8642: Request end of tablet copy session b96ce9cc496c49d7818fa983a17b062b-dcad30336a5440bca17cda2724035211 received from {username='slave'} at 127.0.0.1:57268
I20260709 12:59:08.756069  1617 tablet_copy_service.cc:434] P 39a92f5a4352465d8af3af5908fe8642: ending tablet copy session b96ce9cc496c49d7818fa983a17b062b-dcad30336a5440bca17cda2724035211 on tablet dcad30336a5440bca17cda2724035211 with peer b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:08.757706  2227 raft_consensus.cc:1217] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:08.792208  1679 raft_consensus.cc:1275] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:08.811867  2701 consensus_queue.cc:1048] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:08.819253  1524 raft_consensus.cc:1275] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:08.823223  2700 consensus_queue.cc:1048] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:08.832243  1602 raft_consensus.cc:1275] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:08.834820  2684 consensus_queue.cc:1048] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:08.865545  1679 raft_consensus.cc:1275] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:08.867792  2727 consensus_queue.cc:1048] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:08.884605  1679 raft_consensus.cc:1275] T 72071486140c4d6c919b25e882a8f5e5 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:08.893146  2700 consensus_queue.cc:1048] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:08.982617   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:09.025693  2672 raft_consensus.cc:1064] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1: attempting to promote NON_VOTER b96ce9cc496c49d7818fa983a17b062b to VOTER
I20260709 12:59:09.028272  2672 consensus_queue.cc:237] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:09.037984  1677 raft_consensus.cc:1275] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:09.039541  2227 raft_consensus.cc:1275] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:09.042783  2227 raft_consensus.cc:1217] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:09.043467  1605 raft_consensus.cc:1275] T e78618eba8b74effa4a90f2c8e34cc02 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:09.056159   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:09.056370  2741 consensus_queue.cc:1048] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:09.058303  2806 consensus_queue.cc:1048] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:09.072193  2672 consensus_queue.cc:1048] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:59:09.089031  2741 raft_consensus.cc:2955] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:09.094856  1602 raft_consensus.cc:2955] T e78618eba8b74effa4a90f2c8e34cc02 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:09.104988  2227 raft_consensus.cc:1217] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:09.111261  2226 raft_consensus.cc:2955] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:09.138837  1679 raft_consensus.cc:2955] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:09.153672  1430 catalog_manager.cc:5697] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:09.171066  1675 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac"
dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
mode: GRACEFUL
new_leader_uuid: "39a92f5a4352465d8af3af5908fe8642"
 from {username='slave'} at 127.0.0.1:33616
I20260709 12:59:09.171679  1675 raft_consensus.cc:606] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Received request to transfer leadership to TS 39a92f5a4352465d8af3af5908fe8642
I20260709 12:59:09.175254  1675 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c"
dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
mode: GRACEFUL
new_leader_uuid: "39a92f5a4352465d8af3af5908fe8642"
 from {username='slave'} at 127.0.0.1:33616
I20260709 12:59:09.175864  1675 raft_consensus.cc:606] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Received request to transfer leadership to TS 39a92f5a4352465d8af3af5908fe8642
I20260709 12:59:09.178742  1602 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b"
dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
mode: GRACEFUL
new_leader_uuid: "ddf11fc190dd4b898773379c6b129d90"
 from {username='slave'} at 127.0.0.1:48230
I20260709 12:59:09.179364  1602 raft_consensus.cc:606] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Received request to transfer leadership to TS ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:09.183240  1530 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9"
dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
mode: GRACEFUL
new_leader_uuid: "ddf11fc190dd4b898773379c6b129d90"
 from {username='slave'} at 127.0.0.1:55626
I20260709 12:59:09.183831  1530 raft_consensus.cc:606] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Received request to transfer leadership to TS ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:09.185138   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:59:09.186769   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:09.193981  1530 consensus_queue.cc:237] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:09.199733  1675 raft_consensus.cc:1275] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:09.201474  2741 consensus_queue.cc:1048] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:09.204898  2226 raft_consensus.cc:1275] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:09.207619  2741 consensus_queue.cc:1048] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:09.210508  2672 raft_consensus.cc:2955] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:09.214129  2700 raft_consensus.cc:1064] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642: attempting to promote NON_VOTER b96ce9cc496c49d7818fa983a17b062b to VOTER
I20260709 12:59:09.216763  2700 consensus_queue.cc:237] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:09.220755  2226 raft_consensus.cc:2955] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:09.221024  1675 raft_consensus.cc:2955] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:09.222802  1414 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e78618eba8b74effa4a90f2c8e34cc02 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:09.260537  1430 catalog_manager.cc:5697] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: config changed from index 3 to 4, VOTER 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:09.266636  2226 raft_consensus.cc:1275] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:09.269697  1679 raft_consensus.cc:1275] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:09.271979  2700 consensus_queue.cc:1048] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:09.272827  1526 raft_consensus.cc:1275] T 0b050d298db6466f856d263a342e3c51 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:09.274595  2699 consensus_queue.cc:1048] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:09.285888  2701 consensus_queue.cc:1048] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:09.287629  1594 tablet_service.cc:1558] Processing DeleteTablet for tablet e78618eba8b74effa4a90f2c8e34cc02 with delete_type TABLET_DATA_TOMBSTONED (TS 39a92f5a4352465d8af3af5908fe8642 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36192
I20260709 12:59:09.291569  2818 tablet_replica.cc:333] T e78618eba8b74effa4a90f2c8e34cc02 P 39a92f5a4352465d8af3af5908fe8642: stopping tablet replica
I20260709 12:59:09.293411  2818 raft_consensus.cc:2243] T e78618eba8b74effa4a90f2c8e34cc02 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:09.294239  2818 raft_consensus.cc:2272] T e78618eba8b74effa4a90f2c8e34cc02 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:09.300643  2818 ts_tablet_manager.cc:1916] T e78618eba8b74effa4a90f2c8e34cc02 P 39a92f5a4352465d8af3af5908fe8642: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:09.307466  2672 raft_consensus.cc:993] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1: : Instructing follower ddf11fc190dd4b898773379c6b129d90 to start an election
I20260709 12:59:09.307957  2672 raft_consensus.cc:1081] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Signalling peer ddf11fc190dd4b898773379c6b129d90 to start an election
I20260709 12:59:09.312201  1675 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9"
dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
 from {username='slave'} at 127.0.0.1:49178
I20260709 12:59:09.312739  1675 raft_consensus.cc:493] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:09.313056  1675 raft_consensus.cc:3060] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:09.313644  2701 raft_consensus.cc:2955] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:09.320703  1526 raft_consensus.cc:2955] T 0b050d298db6466f856d263a342e3c51 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:09.328675  2818 ts_tablet_manager.cc:1929] T e78618eba8b74effa4a90f2c8e34cc02 P 39a92f5a4352465d8af3af5908fe8642: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:09.329247  2818 log.cc:1199] T e78618eba8b74effa4a90f2c8e34cc02 P 39a92f5a4352465d8af3af5908fe8642: Deleting WAL directory at /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601891739070-431-0/minicluster-data/ts-1-root/wals/e78618eba8b74effa4a90f2c8e34cc02
I20260709 12:59:09.328850  1679 raft_consensus.cc:2955] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:09.331036  1416 catalog_manager.cc:5028] TS 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): tablet e78618eba8b74effa4a90f2c8e34cc02 (table test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]) successfully deleted
I20260709 12:59:09.323866  1675 raft_consensus.cc:515] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:09.332856  2226 raft_consensus.cc:2955] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:09.341382  2764 raft_consensus.cc:993] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90: : Instructing follower 39a92f5a4352465d8af3af5908fe8642 to start an election
I20260709 12:59:09.340696  1430 catalog_manager.cc:5697] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:09.341866  2764 raft_consensus.cc:1081] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Signalling peer 39a92f5a4352465d8af3af5908fe8642 to start an election
I20260709 12:59:09.343721  1602 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac"
dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
 from {username='slave'} at 127.0.0.1:36200
I20260709 12:59:09.344296  1602 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:09.344681  1602 raft_consensus.cc:3060] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:09.352607  1675 leader_election.cc:290] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 2 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:09.359773  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:09.360350  1605 raft_consensus.cc:3060] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:09.361037  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:09.361600  1526 raft_consensus.cc:3055] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:09.362383  1526 raft_consensus.cc:740] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 12:59:09.363723  1526 consensus_queue.cc:260] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:09.365002  1526 raft_consensus.cc:3060] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:09.374375  1599 consensus_queue.cc:237] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:09.380882  1526 raft_consensus.cc:2468] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 2.
I20260709 12:59:09.384959  1602 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:09.384979  1679 raft_consensus.cc:1275] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:09.387507  1644 leader_election.cc:304] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:09.388816  2764 raft_consensus.cc:2804] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:09.389303  2764 raft_consensus.cc:697] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 2 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:09.389470  2699 consensus_queue.cc:1048] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:09.390348  2764 consensus_queue.cc:237] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:09.395071  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:09.395730  1530 raft_consensus.cc:3060] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:09.398536  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:09.399155  1675 raft_consensus.cc:3055] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:09.399451  1675 raft_consensus.cc:740] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:09.400199  1675 consensus_queue.cc:260] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:09.401273  1675 raft_consensus.cc:3060] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:09.404538  1530 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 2.
I20260709 12:59:09.395268  1602 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:09.407528  1675 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 2.
I20260709 12:59:09.403666  2798 raft_consensus.cc:2955] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:09.410388  2226 raft_consensus.cc:1275] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:09.413734  1571 leader_election.cc:304] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:09.416556  1605 raft_consensus.cc:2468] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 2.
I20260709 12:59:09.413658  2700 consensus_queue.cc:1048] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 12:59:09.421312  2700 raft_consensus.cc:2804] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:09.421818  2700 raft_consensus.cc:697] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 2 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:09.422638  2700 consensus_queue.cc:237] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:09.431118  1679 raft_consensus.cc:2955] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:09.433622  1430 catalog_manager.cc:5697] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 reported cstate change: term changed from 1 to 2, leader changed from e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:09.445885  2699 raft_consensus.cc:993] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642: : Instructing follower ddf11fc190dd4b898773379c6b129d90 to start an election
I20260709 12:59:09.447203  2699 raft_consensus.cc:1081] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Signalling peer ddf11fc190dd4b898773379c6b129d90 to start an election
I20260709 12:59:09.454129  2226 raft_consensus.cc:2955] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:09.460975  1430 catalog_manager.cc:5697] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 1 to 2, leader changed from ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) to 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } }
W20260709 12:59:09.475396  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 60826.4us
I20260709 12:59:09.477648  1677 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b"
dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
 from {username='slave'} at 127.0.0.1:49170
I20260709 12:59:09.478186  1677 raft_consensus.cc:493] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:09.478549  1677 raft_consensus.cc:3060] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:09.498878  1416 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0b050d298db6466f856d263a342e3c51 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:09.501708  1430 catalog_manager.cc:5697] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 reported cstate change: config changed from index 3 to 4, VOTER e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:09.508426  2700 raft_consensus.cc:1064] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642: attempting to promote NON_VOTER b96ce9cc496c49d7818fa983a17b062b to VOTER
I20260709 12:59:09.511202  2700 consensus_queue.cc:237] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:09.515434  1677 raft_consensus.cc:515] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:09.519174  1517 tablet_service.cc:1558] Processing DeleteTablet for tablet 0b050d298db6466f856d263a342e3c51 with delete_type TABLET_DATA_TOMBSTONED (TS e46412b3b0b44f01ad5c33d4cfe3d6b1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43004
I20260709 12:59:09.520468  1677 leader_election.cc:290] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 2 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:09.525029  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:09.525573  1526 raft_consensus.cc:3060] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:09.531443  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:09.532341  1605 raft_consensus.cc:3055] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:09.532714  1605 raft_consensus.cc:740] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:09.533464  1605 consensus_queue.cc:260] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:09.534611  1605 raft_consensus.cc:3060] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:09.531711  1526 raft_consensus.cc:2468] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 2.
I20260709 12:59:09.539973  1675 raft_consensus.cc:1275] T dcad30336a5440bca17cda2724035211 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:09.540666  1644 leader_election.cc:304] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:09.531876  2826 tablet_replica.cc:333] T 0b050d298db6466f856d263a342e3c51 P e46412b3b0b44f01ad5c33d4cfe3d6b1: stopping tablet replica
I20260709 12:59:09.541742  2223 raft_consensus.cc:1275] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:09.539971  1530 raft_consensus.cc:1275] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:09.542454  2764 raft_consensus.cc:2804] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:09.542264  2826 raft_consensus.cc:2243] T 0b050d298db6466f856d263a342e3c51 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:09.543814  2826 raft_consensus.cc:2272] T 0b050d298db6466f856d263a342e3c51 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:09.544055  2764 raft_consensus.cc:697] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 2 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:09.545733  2764 consensus_queue.cc:237] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:09.546885  2826 ts_tablet_manager.cc:1916] T 0b050d298db6466f856d263a342e3c51 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:09.543159  2824 consensus_queue.cc:1048] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 12:59:09.554864  2700 consensus_queue.cc:1048] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:09.556661  2821 consensus_queue.cc:1048] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:09.564213  2826 ts_tablet_manager.cc:1929] T 0b050d298db6466f856d263a342e3c51 P e46412b3b0b44f01ad5c33d4cfe3d6b1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:09.564786  2826 log.cc:1199] T 0b050d298db6466f856d263a342e3c51 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Deleting WAL directory at /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601891739070-431-0/minicluster-data/ts-0-root/wals/0b050d298db6466f856d263a342e3c51
I20260709 12:59:09.566681  1414 catalog_manager.cc:5028] TS e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): tablet 0b050d298db6466f856d263a342e3c51 (table test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]) successfully deleted
I20260709 12:59:09.582194  1605 raft_consensus.cc:2468] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 2.
I20260709 12:59:09.584197  2811 raft_consensus.cc:993] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90: : Instructing follower 39a92f5a4352465d8af3af5908fe8642 to start an election
I20260709 12:59:09.584748  2811 raft_consensus.cc:1081] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Signalling peer 39a92f5a4352465d8af3af5908fe8642 to start an election
I20260709 12:59:09.589296  1605 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c"
dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
 from {username='slave'} at 127.0.0.1:36200
I20260709 12:59:09.589957  1605 raft_consensus.cc:493] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:09.590380  1605 raft_consensus.cc:3060] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:09.599653  2762 raft_consensus.cc:1064] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90: attempting to promote NON_VOTER b96ce9cc496c49d7818fa983a17b062b to VOTER
W20260709 12:59:09.600219  2762 raft_consensus.cc:1068] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90: Unable to promote non-voter b96ce9cc496c49d7818fa983a17b062b: Service unavailable: leader transfer in progress
I20260709 12:59:09.600185  1605 raft_consensus.cc:515] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:59:09.603440  1605 leader_election.cc:290] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:09.604024  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:09.604629  1677 raft_consensus.cc:3055] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:09.605077  1677 raft_consensus.cc:740] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:09.605803  1677 consensus_queue.cc:260] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:59:09.606995  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:09.607466  1677 raft_consensus.cc:3060] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:09.607580  1528 raft_consensus.cc:3060] T 1359810508724a7a8749ce09a6654a9c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:09.575330  1426 catalog_manager.cc:5697] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 reported cstate change: term changed from 1 to 2, leader changed from 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:09.615051  1677 raft_consensus.cc:2468] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 2.
I20260709 12:59:09.615319  1528 raft_consensus.cc:2468] T 1359810508724a7a8749ce09a6654a9c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 2.
I20260709 12:59:09.616340  1571 leader_election.cc:304] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:09.617172  2821 raft_consensus.cc:2804] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:09.617713  2821 raft_consensus.cc:697] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 2 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:09.618579  2821 consensus_queue.cc:237] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
W20260709 12:59:09.620235  2827 log.cc:927] Time spent T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:59:09.635574  1675 raft_consensus.cc:2955] T dcad30336a5440bca17cda2724035211 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:09.633942  2821 raft_consensus.cc:2955] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:09.646473  1526 raft_consensus.cc:2955] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:09.651031  2223 raft_consensus.cc:2955] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:09.655304  1429 catalog_manager.cc:5697] T dcad30336a5440bca17cda2724035211 P ddf11fc190dd4b898773379c6b129d90 reported cstate change: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:09.661926  1426 catalog_manager.cc:5697] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 1 to 2, leader changed from ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) to 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:09.688925  1605 consensus_queue.cc:237] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:09.693176  2223 raft_consensus.cc:1275] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:09.693953  1526 raft_consensus.cc:1275] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:09.694554  2700 consensus_queue.cc:1048] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:09.696771  2700 consensus_queue.cc:1048] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:09.702495  2821 raft_consensus.cc:2955] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:09.703799  2223 raft_consensus.cc:2955] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:09.707548  1526 raft_consensus.cc:2955] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:09.711665  1416 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet dcad30336a5440bca17cda2724035211 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:09.719630  1429 catalog_manager.cc:5697] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: config changed from index 3 to 4, VOTER ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:09.733142  1664 tablet_service.cc:1558] Processing DeleteTablet for tablet dcad30336a5440bca17cda2724035211 with delete_type TABLET_DATA_TOMBSTONED (TS ddf11fc190dd4b898773379c6b129d90 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49162
I20260709 12:59:09.741163  2832 tablet_replica.cc:333] T dcad30336a5440bca17cda2724035211 P ddf11fc190dd4b898773379c6b129d90: stopping tablet replica
I20260709 12:59:09.741897  2832 raft_consensus.cc:2243] T dcad30336a5440bca17cda2724035211 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:09.742487  2832 raft_consensus.cc:2272] T dcad30336a5440bca17cda2724035211 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:09.745656  2832 ts_tablet_manager.cc:1916] T dcad30336a5440bca17cda2724035211 P ddf11fc190dd4b898773379c6b129d90: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:09.757501  2832 ts_tablet_manager.cc:1929] T dcad30336a5440bca17cda2724035211 P ddf11fc190dd4b898773379c6b129d90: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:09.757843  2832 log.cc:1199] T dcad30336a5440bca17cda2724035211 P ddf11fc190dd4b898773379c6b129d90: Deleting WAL directory at /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601891739070-431-0/minicluster-data/ts-2-root/wals/dcad30336a5440bca17cda2724035211
I20260709 12:59:09.759315  1415 catalog_manager.cc:5028] TS ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217): tablet dcad30336a5440bca17cda2724035211 (table test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]) successfully deleted
I20260709 12:59:09.778223  1526 raft_consensus.cc:1275] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:09.779461  2811 consensus_queue.cc:1048] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:09.790351  1605 raft_consensus.cc:1275] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:09.796105  2811 consensus_queue.cc:1048] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:09.962160  1675 raft_consensus.cc:1275] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:09.963481  2700 consensus_queue.cc:1048] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:09.983665  1526 raft_consensus.cc:1275] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:09.985239  2700 consensus_queue.cc:1048] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:10.114890  1599 raft_consensus.cc:1275] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:10.115955  2764 consensus_queue.cc:1048] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:10.126024  1526 raft_consensus.cc:1275] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:10.128835  2712 consensus_queue.cc:1048] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:10.158694  2223 raft_consensus.cc:3060] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Advancing to term 2
I20260709 12:59:10.161314  1526 raft_consensus.cc:1275] T 1359810508724a7a8749ce09a6654a9c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:59:10.162848  2700 consensus_queue.cc:1048] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:10.165383  2223 raft_consensus.cc:1275] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 2 LEARNER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:59:10.167047  2700 consensus_queue.cc:1048] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:10.184989  1677 raft_consensus.cc:1275] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:59:10.186327  2824 consensus_queue.cc:1048] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:10.186940  2700 raft_consensus.cc:1064] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642: attempting to promote NON_VOTER b96ce9cc496c49d7818fa983a17b062b to VOTER
I20260709 12:59:10.188925  2700 consensus_queue.cc:237] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 2, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:10.193001   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:10.200234  2821 raft_consensus.cc:1027] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 2 LEADER]: attempt to promote peer b96ce9cc496c49d7818fa983a17b062b: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260709 12:59:10.210062  2223 raft_consensus.cc:1275] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 2 LEARNER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:59:10.211728  2822 consensus_queue.cc:1048] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:10.220795  1530 raft_consensus.cc:1275] T 1359810508724a7a8749ce09a6654a9c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:59:10.222455  2824 consensus_queue.cc:1048] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:10.232720  2821 raft_consensus.cc:2955] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 2 to 4, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:10.240013  1675 raft_consensus.cc:1275] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:59:10.247562  2700 consensus_queue.cc:1048] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:10.247934  2223 raft_consensus.cc:2955] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:10.246332  1530 raft_consensus.cc:2955] T 1359810508724a7a8749ce09a6654a9c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:10.266620  1675 raft_consensus.cc:2955] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:10.270838  1429 catalog_manager.cc:5697] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: config changed from index 2 to 4, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:10.341014   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:10.387861  1605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c"
dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
mode: GRACEFUL
new_leader_uuid: "b96ce9cc496c49d7818fa983a17b062b"
 from {username='slave'} at 127.0.0.1:48230
I20260709 12:59:10.388437  1605 raft_consensus.cc:606] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 2 LEADER]: Received request to transfer leadership to TS b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:10.390997  1605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0"
dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
mode: GRACEFUL
new_leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:48230
I20260709 12:59:10.391525  1605 raft_consensus.cc:606] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Received request to transfer leadership to TS e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:10.396939  1530 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e"
dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
mode: GRACEFUL
new_leader_uuid: "ddf11fc190dd4b898773379c6b129d90"
 from {username='slave'} at 127.0.0.1:55626
I20260709 12:59:10.397513  1530 raft_consensus.cc:606] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 LEADER]: Received request to transfer leadership to TS ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:10.402803  1677 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e"
dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
mode: GRACEFUL
new_leader_uuid: "39a92f5a4352465d8af3af5908fe8642"
 from {username='slave'} at 127.0.0.1:33616
I20260709 12:59:10.403359  1677 raft_consensus.cc:606] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Received request to transfer leadership to TS 39a92f5a4352465d8af3af5908fe8642
I20260709 12:59:10.404994   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:59:10.410437   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:10.411755  2672 raft_consensus.cc:993] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1: : Instructing follower ddf11fc190dd4b898773379c6b129d90 to start an election
I20260709 12:59:10.412206  2741 raft_consensus.cc:1081] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 LEADER]: Signalling peer ddf11fc190dd4b898773379c6b129d90 to start an election
I20260709 12:59:10.413589  1675 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e"
dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
 from {username='slave'} at 127.0.0.1:49178
I20260709 12:59:10.414108  1675 raft_consensus.cc:493] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:10.414453  1675 raft_consensus.cc:3060] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:10.420823  1675 raft_consensus.cc:515] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:10.424289  1675 leader_election.cc:290] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:10.424917  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:10.425518  1530 raft_consensus.cc:3055] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:10.425812  1530 raft_consensus.cc:740] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 12:59:10.426122  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:10.426648  1605 raft_consensus.cc:3060] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:10.429459  1530 consensus_queue.cc:260] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:10.430106  2798 raft_consensus.cc:993] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642: : Instructing follower e46412b3b0b44f01ad5c33d4cfe3d6b1 to start an election
I20260709 12:59:10.430603  2798 raft_consensus.cc:1081] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Signalling peer e46412b3b0b44f01ad5c33d4cfe3d6b1 to start an election
I20260709 12:59:10.431124  1530 raft_consensus.cc:3060] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:10.432459  1526 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0"
dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:43008
I20260709 12:59:10.432964  1526 raft_consensus.cc:493] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:10.433288  1526 raft_consensus.cc:3060] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:10.437770  1605 raft_consensus.cc:2468] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 3.
I20260709 12:59:10.438839  1646 leader_election.cc:304] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:10.439947  1526 raft_consensus.cc:515] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:10.440577  2712 raft_consensus.cc:2804] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:10.441629  2712 raft_consensus.cc:697] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 3 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:10.442281  2712 consensus_queue.cc:237] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:10.445657  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:10.446209  1605 raft_consensus.cc:3055] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:10.446341  1526 leader_election.cc:290] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 2 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:10.446852  1530 raft_consensus.cc:2468] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 3.
I20260709 12:59:10.459585  1428 catalog_manager.cc:5697] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 reported cstate change: term changed from 2 to 3, leader changed from e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:10.446564  1605 raft_consensus.cc:740] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:10.466310  1605 consensus_queue.cc:260] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:10.447093  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:10.467335  1675 raft_consensus.cc:3060] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:10.467567  1605 raft_consensus.cc:3060] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:10.474277  1675 raft_consensus.cc:2468] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 2.
I20260709 12:59:10.475458  1496 leader_election.cc:304] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:10.476257  2672 raft_consensus.cc:2804] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:10.476706  2672 raft_consensus.cc:697] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 12:59:10.477449  2672 consensus_queue.cc:237] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:10.483415  1605 raft_consensus.cc:2468] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 2.
I20260709 12:59:10.489071  1428 catalog_manager.cc:5697] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 1 to 2, leader changed from 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) to e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } }
W20260709 12:59:10.686556  1416 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leader transfer in progress [suppressed 2 similar messages]
W20260709 12:59:10.699676  1416 catalog_manager.cc:4755] TS 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): ChangeConfig:REMOVE_PEER RPC failed for tablet 1359810508724a7a8749ce09a6654a9c: Remote error: Service unavailable: leader transfer in progress
I20260709 12:59:10.762802  2798 raft_consensus.cc:993] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642: : Instructing follower b96ce9cc496c49d7818fa983a17b062b to start an election
I20260709 12:59:10.763290  2699 raft_consensus.cc:1081] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 2 LEADER]: Signalling peer b96ce9cc496c49d7818fa983a17b062b to start an election
I20260709 12:59:10.764604  2223 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c"
dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
 from {username='slave'} at 127.0.0.1:50310
I20260709 12:59:10.765054  2223 raft_consensus.cc:493] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:10.765388  2223 raft_consensus.cc:3060] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:10.769891  2223 raft_consensus.cc:515] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:10.772244  2811 raft_consensus.cc:993] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90: : Instructing follower 39a92f5a4352465d8af3af5908fe8642 to start an election
I20260709 12:59:10.772321  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:10.772866  2712 raft_consensus.cc:1081] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Signalling peer 39a92f5a4352465d8af3af5908fe8642 to start an election
I20260709 12:59:10.773020  1530 raft_consensus.cc:3060] T 1359810508724a7a8749ce09a6654a9c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:10.774852  1605 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e"
dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
 from {username='slave'} at 127.0.0.1:36200
I20260709 12:59:10.775370  1605 raft_consensus.cc:493] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:10.775718  1605 raft_consensus.cc:3060] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:10.782737  1605 raft_consensus.cc:515] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:10.783557  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:10.784134  1675 raft_consensus.cc:3060] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:10.785249  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:10.785437  1605 leader_election.cc:290] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:10.785635  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:10.785792  1526 raft_consensus.cc:3060] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:10.786194  1681 raft_consensus.cc:3055] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:10.786480  1681 raft_consensus.cc:740] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:10.784158  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:10.787477  1602 raft_consensus.cc:3055] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:10.787268  1681 consensus_queue.cc:260] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:10.787791  1602 raft_consensus.cc:740] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:10.788689  1681 raft_consensus.cc:3060] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:10.788695  1602 consensus_queue.cc:260] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:10.793090  1602 raft_consensus.cc:3060] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:10.797092  1526 raft_consensus.cc:2468] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 2.
I20260709 12:59:10.780844  1530 raft_consensus.cc:2468] T 1359810508724a7a8749ce09a6654a9c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 3.
I20260709 12:59:10.798141  1681 raft_consensus.cc:2468] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 2.
I20260709 12:59:10.799661  1570 leader_election.cc:304] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:10.802053  2798 raft_consensus.cc:2804] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:10.802744  2798 raft_consensus.cc:697] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 2 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:10.803426  2223 leader_election.cc:290] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 3 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:10.803565  2798 consensus_queue.cc:237] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:10.808887  1675 raft_consensus.cc:2468] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 3.
I20260709 12:59:10.816116  2191 leader_election.cc:304] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:10.817112  2727 raft_consensus.cc:2804] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:10.817230  1428 catalog_manager.cc:5697] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 1 to 2, leader changed from ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) to 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:10.818188  2727 raft_consensus.cc:697] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 3 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 12:59:10.831739  2727 consensus_queue.cc:237] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:10.836033  1602 raft_consensus.cc:2468] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 3.
I20260709 12:59:10.842376  1428 catalog_manager.cc:5697] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 2 to 3, leader changed from 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) to b96ce9cc496c49d7818fa983a17b062b (127.0.107.196). New cstate: current_term: 3 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:10.862866  1675 raft_consensus.cc:1275] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:10.864315  2672 consensus_queue.cc:1048] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:10.888581  1602 raft_consensus.cc:1275] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:10.891772  2672 consensus_queue.cc:1048] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:59:10.918139  1416 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 1359810508724a7a8749ce09a6654a9c with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:59:10.954766  1526 raft_consensus.cc:1275] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:59:10.956054  2811 consensus_queue.cc:1048] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:10.966176  1602 raft_consensus.cc:1275] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:59:10.971181  2811 consensus_queue.cc:1048] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:11.206571  1526 raft_consensus.cc:1275] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:11.207906  2821 consensus_queue.cc:1048] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:11.219187  1677 raft_consensus.cc:1275] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:11.220767  2699 consensus_queue.cc:1048] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:11.322572  1677 raft_consensus.cc:1275] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:11.324167  2854 consensus_queue.cc:1048] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:11.329886  1599 raft_consensus.cc:1275] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:11.331416  2727 consensus_queue.cc:1048] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:11.359885  1526 raft_consensus.cc:1275] T 1359810508724a7a8749ce09a6654a9c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:11.361066  2727 consensus_queue.cc:1048] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:11.389628  2223 consensus_queue.cc:237] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:11.404713  1599 raft_consensus.cc:1275] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:59:11.406203  2727 consensus_queue.cc:1048] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:11.411264   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:11.412747  1677 raft_consensus.cc:1275] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:59:11.423138  2727 consensus_queue.cc:1048] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:11.429314  2854 raft_consensus.cc:2955] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 4 to 6, VOTER e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:11.432587  1602 raft_consensus.cc:2955] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 4 to 6, VOTER e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:11.435479  1681 raft_consensus.cc:2955] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 4 to 6, VOTER e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:11.442296  1416 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1359810508724a7a8749ce09a6654a9c with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 6)
I20260709 12:59:11.462224  1426 catalog_manager.cc:5697] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b reported cstate change: config changed from index 4 to 6, VOTER e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) evicted. New cstate: current_term: 3 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:11.493016  1517 tablet_service.cc:1558] Processing DeleteTablet for tablet 1359810508724a7a8749ce09a6654a9c with delete_type TABLET_DATA_TOMBSTONED (TS e46412b3b0b44f01ad5c33d4cfe3d6b1 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:43004
I20260709 12:59:11.505471  2875 tablet_replica.cc:333] T 1359810508724a7a8749ce09a6654a9c P e46412b3b0b44f01ad5c33d4cfe3d6b1: stopping tablet replica
I20260709 12:59:11.516502  2875 raft_consensus.cc:2243] T 1359810508724a7a8749ce09a6654a9c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:11.517231  2875 raft_consensus.cc:2272] T 1359810508724a7a8749ce09a6654a9c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:11.520835  2875 ts_tablet_manager.cc:1916] T 1359810508724a7a8749ce09a6654a9c P e46412b3b0b44f01ad5c33d4cfe3d6b1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:11.530612   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:11.537612  2875 ts_tablet_manager.cc:1929] T 1359810508724a7a8749ce09a6654a9c P e46412b3b0b44f01ad5c33d4cfe3d6b1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.5
I20260709 12:59:11.538030  2875 log.cc:1199] T 1359810508724a7a8749ce09a6654a9c P e46412b3b0b44f01ad5c33d4cfe3d6b1: Deleting WAL directory at /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601891739070-431-0/minicluster-data/ts-0-root/wals/1359810508724a7a8749ce09a6654a9c
I20260709 12:59:11.539324  1414 catalog_manager.cc:5028] TS e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): tablet 1359810508724a7a8749ce09a6654a9c (table test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]) successfully deleted
I20260709 12:59:11.568789  1602 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac"
dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
mode: GRACEFUL
new_leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:48230
I20260709 12:59:11.569387  1602 raft_consensus.cc:606] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 2 LEADER]: Received request to transfer leadership to TS e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:11.571766  1681 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4ea41c88222b469fb11229faef735050"
dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
mode: GRACEFUL
new_leader_uuid: "39a92f5a4352465d8af3af5908fe8642"
 from {username='slave'} at 127.0.0.1:33616
I20260709 12:59:11.572178  1681 raft_consensus.cc:606] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Received request to transfer leadership to TS 39a92f5a4352465d8af3af5908fe8642
I20260709 12:59:11.574424  1530 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2"
dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
mode: GRACEFUL
new_leader_uuid: "ddf11fc190dd4b898773379c6b129d90"
 from {username='slave'} at 127.0.0.1:55626
I20260709 12:59:11.574896  1530 raft_consensus.cc:606] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Received request to transfer leadership to TS ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:11.576006   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:59:11.577013   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:12.152904  2798 raft_consensus.cc:993] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642: : Instructing follower e46412b3b0b44f01ad5c33d4cfe3d6b1 to start an election
I20260709 12:59:12.153456  2798 raft_consensus.cc:1081] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 2 LEADER]: Signalling peer e46412b3b0b44f01ad5c33d4cfe3d6b1 to start an election
I20260709 12:59:12.157168  2880 raft_consensus.cc:993] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1: : Instructing follower ddf11fc190dd4b898773379c6b129d90 to start an election
I20260709 12:59:12.157675  2880 raft_consensus.cc:1081] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Signalling peer ddf11fc190dd4b898773379c6b129d90 to start an election
I20260709 12:59:12.159583  1681 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2"
dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
 from {username='slave'} at 127.0.0.1:49178
I20260709 12:59:12.160128  1681 raft_consensus.cc:493] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:12.160488  1681 raft_consensus.cc:3060] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:59:12.165974  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 142557us
I20260709 12:59:12.169271  1681 raft_consensus.cc:515] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:12.169842  2886 raft_consensus.cc:993] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90: : Instructing follower 39a92f5a4352465d8af3af5908fe8642 to start an election
I20260709 12:59:12.170359  2886 raft_consensus.cc:1081] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Signalling peer 39a92f5a4352465d8af3af5908fe8642 to start an election
I20260709 12:59:12.172109  1681 leader_election.cc:290] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 2 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:12.190804  1599 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4ea41c88222b469fb11229faef735050"
dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
 from {username='slave'} at 127.0.0.1:36200
I20260709 12:59:12.191354  1599 raft_consensus.cc:493] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:12.191702  1599 raft_consensus.cc:3060] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:12.197738  1599 raft_consensus.cc:515] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:12.199018  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 12:59:12.199687  2226 raft_consensus.cc:3060] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:12.200152  1523 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac"
dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:43008
I20260709 12:59:12.200776  1523 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:12.201128  1523 raft_consensus.cc:3060] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:12.203127  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:12.203733  1529 raft_consensus.cc:3055] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:12.204031  1529 raft_consensus.cc:740] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 12:59:12.204813  1529 consensus_queue.cc:260] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:12.206063  1529 raft_consensus.cc:3060] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:12.208649  2226 raft_consensus.cc:2468] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 2.
I20260709 12:59:12.210518  1599 leader_election.cc:290] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:12.212347  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:12.213037  1675 raft_consensus.cc:3055] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:12.213400  1675 raft_consensus.cc:740] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:12.214030  1675 consensus_queue.cc:260] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:12.214644  1675 raft_consensus.cc:3060] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:12.215009  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 12:59:12.215538  2226 raft_consensus.cc:3060] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:12.219383  1529 raft_consensus.cc:2468] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 2.
I20260709 12:59:12.220911  1523 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:12.222935  1644 leader_election.cc:304] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:12.224619  2811 raft_consensus.cc:2804] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:12.225106  2811 raft_consensus.cc:697] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 2 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:12.225883  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:12.226106  1675 raft_consensus.cc:2468] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 2.
I20260709 12:59:12.226804  1523 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:12.226545  1681 raft_consensus.cc:3060] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:12.228726  1571 leader_election.cc:304] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:12.230547  2877 raft_consensus.cc:2804] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:12.231040  2877 raft_consensus.cc:697] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 2 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:12.231889  2877 consensus_queue.cc:237] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:12.225970  2811 consensus_queue.cc:237] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:12.238194  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:12.238843  1605 raft_consensus.cc:3055] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:12.238955  1681 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 3.
I20260709 12:59:12.239171  1605 raft_consensus.cc:740] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:12.239899  1605 consensus_queue.cc:260] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:12.241281  1605 raft_consensus.cc:3060] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:12.246969  1496 leader_election.cc:304] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:12.247246  1605 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 3.
I20260709 12:59:12.247850  2807 raft_consensus.cc:2804] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:12.248345  2807 raft_consensus.cc:697] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 12:59:12.249122  2807 consensus_queue.cc:237] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:12.254017  1426 catalog_manager.cc:5697] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 1 to 2, leader changed from ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) to 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:12.239864  2226 raft_consensus.cc:2468] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 2.
I20260709 12:59:12.275539  1429 catalog_manager.cc:5697] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 2 to 3, leader changed from 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) to e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:12.279901  1428 catalog_manager.cc:5697] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 reported cstate change: term changed from 1 to 2, leader changed from e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:12.592128  1675 consensus_queue.cc:237] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
W20260709 12:59:12.604902  1646 consensus_peers.cc:597] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 -> Peer b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373): Couldn't send request to peer b96ce9cc496c49d7818fa983a17b062b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f3dd6988dfbe43e0ac446b79d37d9c24. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:12.605237  1605 raft_consensus.cc:1275] T f3dd6988dfbe43e0ac446b79d37d9c24 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:12.606189  1528 raft_consensus.cc:1275] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:12.606720  2811 consensus_queue.cc:1048] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:12.607776  2884 consensus_queue.cc:1048] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:12.618649  2884 raft_consensus.cc:2955] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:59:12.620422  1605 raft_consensus.cc:2955] T f3dd6988dfbe43e0ac446b79d37d9c24 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:59:12.622741  1528 raft_consensus.cc:2955] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:59:12.640666  1602 consensus_queue.cc:237] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:59:12.644768  2223 raft_consensus.cc:1275] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:12.647603  2851 consensus_queue.cc:1048] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:12.648375  1428 catalog_manager.cc:5697] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 reported cstate change: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:12.662070  1674 raft_consensus.cc:1275] T 72071486140c4d6c919b25e882a8f5e5 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:59:12.662801  1528 raft_consensus.cc:1275] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 12:59:12.663856  1572 consensus_peers.cc:597] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 -> Peer b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373): Couldn't send request to peer b96ce9cc496c49d7818fa983a17b062b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 72071486140c4d6c919b25e882a8f5e5. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:12.664597  1523 raft_consensus.cc:1275] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:12.664930  2877 consensus_queue.cc:1048] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:12.667133  2851 consensus_queue.cc:1048] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:12.668295  2798 consensus_queue.cc:1048] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:12.694887  2798 raft_consensus.cc:2955] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:59:12.696703  1674 raft_consensus.cc:2955] T 72071486140c4d6c919b25e882a8f5e5 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:59:12.711643   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:12.714505  1528 consensus_queue.cc:237] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:59:12.716384  2226 raft_consensus.cc:1275] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:12.718096  2876 consensus_queue.cc:1048] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:12.729055  1605 raft_consensus.cc:1275] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:12.730341  2807 consensus_queue.cc:1048] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:12.743961  1675 raft_consensus.cc:1275] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:12.745687  2741 consensus_queue.cc:1048] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:59:12.758535  1497 consensus_peers.cc:597] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 -> Peer b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373): Couldn't send request to peer b96ce9cc496c49d7818fa983a17b062b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a7cff69bd4394da195321efd78d5a703. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:12.769676  1599 raft_consensus.cc:1275] T a7cff69bd4394da195321efd78d5a703 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:12.776008  2807 consensus_queue.cc:1048] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:12.783393  1428 catalog_manager.cc:5697] T 72071486140c4d6c919b25e882a8f5e5 P ddf11fc190dd4b898773379c6b129d90 reported cstate change: config changed from index -1 to 3, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New cstate: current_term: 2 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:59:12.828198  2741 raft_consensus.cc:2955] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
W20260709 12:59:12.829555  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 51559.9us
I20260709 12:59:12.838428  1674 raft_consensus.cc:1275] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:12.840184  2880 consensus_queue.cc:1048] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:12.849607  1675 raft_consensus.cc:2955] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:59:12.864037  1528 consensus_queue.cc:237] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:59:12.883980  1681 raft_consensus.cc:1275] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:12.888449  1529 raft_consensus.cc:2955] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:59:12.891718  2914 consensus_queue.cc:1048] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:59:12.892242  1497 consensus_peers.cc:597] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 -> Peer b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373): Couldn't send request to peer b96ce9cc496c49d7818fa983a17b062b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 317204271cc04f68818b36450c9725b1. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:12.897922   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:12.897452  1675 raft_consensus.cc:1275] T 317204271cc04f68818b36450c9725b1 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:12.917583  2741 consensus_queue.cc:1048] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:12.918099  1599 raft_consensus.cc:1275] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:12.926905  1599 raft_consensus.cc:2955] T a7cff69bd4394da195321efd78d5a703 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:59:12.937130  2741 consensus_queue.cc:1048] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:12.969506  1428 catalog_manager.cc:5697] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:12.974608  2880 raft_consensus.cc:2955] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:59:12.979640  1599 raft_consensus.cc:2955] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:59:12.980150  1675 raft_consensus.cc:2955] T 317204271cc04f68818b36450c9725b1 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
W20260709 12:59:13.001690  1628 debug-util.cc:398] Leaking SignalData structure 0x7b08003143c0 after lost signal to thread 434
W20260709 12:59:13.008258  1628 debug-util.cc:398] Leaking SignalData structure 0x7b080022a5c0 after lost signal to thread 1464
W20260709 12:59:13.009493  1628 debug-util.cc:398] Leaking SignalData structure 0x7b08000d7a80 after lost signal to thread 1556
W20260709 12:59:13.010479  1628 debug-util.cc:398] Leaking SignalData structure 0x7b08000b1140 after lost signal to thread 1631
W20260709 12:59:13.011662  1628 debug-util.cc:398] Leaking SignalData structure 0x7b080034ce00 after lost signal to thread 1705
I20260709 12:59:13.011827  1429 catalog_manager.cc:5697] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:59:13.012941  1628 debug-util.cc:398] Leaking SignalData structure 0x7b0800350280 after lost signal to thread 2251
I20260709 12:59:13.071274  1528 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751"
dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
mode: GRACEFUL
new_leader_uuid: "ddf11fc190dd4b898773379c6b129d90"
 from {username='slave'} at 127.0.0.1:55626
I20260709 12:59:13.072535  1528 raft_consensus.cc:606] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Received request to transfer leadership to TS ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:13.068812  2924 ts_tablet_manager.cc:933] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b: Initiating tablet copy from peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:13.077004  1675 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf"
dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
mode: GRACEFUL
new_leader_uuid: "39a92f5a4352465d8af3af5908fe8642"
 from {username='slave'} at 127.0.0.1:33616
I20260709 12:59:13.077450  1675 raft_consensus.cc:606] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Received request to transfer leadership to TS 39a92f5a4352465d8af3af5908fe8642
I20260709 12:59:13.081307  1602 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9"
dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
mode: GRACEFUL
new_leader_uuid: "b96ce9cc496c49d7818fa983a17b062b"
 from {username='slave'} at 127.0.0.1:48230
I20260709 12:59:13.081857  1602 raft_consensus.cc:606] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Received request to transfer leadership to TS b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:13.083557   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:59:13.086747  2924 tablet_copy_client.cc:323] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:44217
I20260709 12:59:13.087316   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:13.089378  1690 tablet_copy_service.cc:140] P ddf11fc190dd4b898773379c6b129d90: Received BeginTabletCopySession request for tablet f3dd6988dfbe43e0ac446b79d37d9c24 from peer b96ce9cc496c49d7818fa983a17b062b ({username='slave'} at 127.0.0.1:50664)
I20260709 12:59:13.089973  1690 tablet_copy_service.cc:161] P ddf11fc190dd4b898773379c6b129d90: Beginning new tablet copy session on tablet f3dd6988dfbe43e0ac446b79d37d9c24 from peer b96ce9cc496c49d7818fa983a17b062b at {username='slave'} at 127.0.0.1:50664: session id = b96ce9cc496c49d7818fa983a17b062b-f3dd6988dfbe43e0ac446b79d37d9c24
I20260709 12:59:13.118779  1690 tablet_copy_source_session.cc:215] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:13.122128  2924 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3dd6988dfbe43e0ac446b79d37d9c24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:13.142872  2924 tablet_copy_client.cc:806] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:13.143539  2924 tablet_copy_client.cc:670] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:13.149277  2924 tablet_copy_client.cc:538] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:13.158815  2924 tablet_bootstrap.cc:492] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap starting.
I20260709 12:59:13.187188  2924 tablet_bootstrap.cc:492] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:13.188614  2924 tablet_bootstrap.cc:492] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap complete.
I20260709 12:59:13.189729  2924 ts_tablet_manager.cc:1403] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b: Time spent bootstrapping tablet: real 0.031s	user 0.015s	sys 0.007s
I20260709 12:59:13.192941  2924 raft_consensus.cc:359] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:59:13.193887  2924 raft_consensus.cc:740] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Initialized, Role: LEARNER
I20260709 12:59:13.194653  2924 consensus_queue.cc:260] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:59:13.197886  2924 ts_tablet_manager.cc:1434] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:59:13.199760  1690 tablet_copy_service.cc:342] P ddf11fc190dd4b898773379c6b129d90: Request end of tablet copy session b96ce9cc496c49d7818fa983a17b062b-f3dd6988dfbe43e0ac446b79d37d9c24 received from {username='slave'} at 127.0.0.1:50664
I20260709 12:59:13.200229  1690 tablet_copy_service.cc:434] P ddf11fc190dd4b898773379c6b129d90: ending tablet copy session b96ce9cc496c49d7818fa983a17b062b-f3dd6988dfbe43e0ac446b79d37d9c24 on tablet f3dd6988dfbe43e0ac446b79d37d9c24 with peer b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:13.258039  2924 ts_tablet_manager.cc:933] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b: Initiating tablet copy from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931)
I20260709 12:59:13.263875  2924 tablet_copy_client.cc:323] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:43931
I20260709 12:59:13.265810  1542 tablet_copy_service.cc:140] P e46412b3b0b44f01ad5c33d4cfe3d6b1: Received BeginTabletCopySession request for tablet a7cff69bd4394da195321efd78d5a703 from peer b96ce9cc496c49d7818fa983a17b062b ({username='slave'} at 127.0.0.1:49310)
I20260709 12:59:13.266376  1542 tablet_copy_service.cc:161] P e46412b3b0b44f01ad5c33d4cfe3d6b1: Beginning new tablet copy session on tablet a7cff69bd4394da195321efd78d5a703 from peer b96ce9cc496c49d7818fa983a17b062b at {username='slave'} at 127.0.0.1:49310: session id = b96ce9cc496c49d7818fa983a17b062b-a7cff69bd4394da195321efd78d5a703
I20260709 12:59:13.272248  2928 ts_tablet_manager.cc:933] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b: Initiating tablet copy from peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:13.274909  1542 tablet_copy_source_session.cc:215] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:13.284158  2928 tablet_copy_client.cc:323] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:40303
I20260709 12:59:13.295640  1617 tablet_copy_service.cc:140] P 39a92f5a4352465d8af3af5908fe8642: Received BeginTabletCopySession request for tablet 72071486140c4d6c919b25e882a8f5e5 from peer b96ce9cc496c49d7818fa983a17b062b ({username='slave'} at 127.0.0.1:57268)
I20260709 12:59:13.295904  2924 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7cff69bd4394da195321efd78d5a703. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:13.296255  1617 tablet_copy_service.cc:161] P 39a92f5a4352465d8af3af5908fe8642: Beginning new tablet copy session on tablet 72071486140c4d6c919b25e882a8f5e5 from peer b96ce9cc496c49d7818fa983a17b062b at {username='slave'} at 127.0.0.1:57268: session id = b96ce9cc496c49d7818fa983a17b062b-72071486140c4d6c919b25e882a8f5e5
I20260709 12:59:13.312203  1617 tablet_copy_source_session.cc:215] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:13.329345  2924 tablet_copy_client.cc:806] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:13.329490  2928 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72071486140c4d6c919b25e882a8f5e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:13.338819  2924 tablet_copy_client.cc:670] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:13.353063  2924 tablet_copy_client.cc:538] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:13.378022  2917 raft_consensus.cc:993] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642: : Instructing follower b96ce9cc496c49d7818fa983a17b062b to start an election
I20260709 12:59:13.378537  2917 raft_consensus.cc:1081] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Signalling peer b96ce9cc496c49d7818fa983a17b062b to start an election
I20260709 12:59:13.381379  2223 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9"
dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
 from {username='slave'} at 127.0.0.1:50310
I20260709 12:59:13.381989  2223 raft_consensus.cc:493] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:13.380239  2924 tablet_bootstrap.cc:492] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap starting.
I20260709 12:59:13.382329  2223 raft_consensus.cc:3060] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:13.400339  2928 tablet_copy_client.cc:806] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:13.410292  2928 tablet_copy_client.cc:670] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:13.420202  2928 tablet_copy_client.cc:538] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:13.429450  2223 raft_consensus.cc:515] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:13.432235  2928 tablet_bootstrap.cc:492] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap starting.
I20260709 12:59:13.450086  2924 tablet_bootstrap.cc:492] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:13.453765  2887 raft_consensus.cc:993] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90: : Instructing follower 39a92f5a4352465d8af3af5908fe8642 to start an election
I20260709 12:59:13.454375  2887 raft_consensus.cc:1081] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Signalling peer 39a92f5a4352465d8af3af5908fe8642 to start an election
I20260709 12:59:13.457754  1602 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf"
dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
 from {username='slave'} at 127.0.0.1:36200
I20260709 12:59:13.458315  1602 raft_consensus.cc:493] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:13.458650  1602 raft_consensus.cc:3060] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:13.465878  1602 raft_consensus.cc:515] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:13.467598  2924 tablet_bootstrap.cc:492] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap complete.
I20260709 12:59:13.478729  1602 leader_election.cc:290] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:13.493806  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 12:59:13.492225  2924 ts_tablet_manager.cc:1403] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b: Time spent bootstrapping tablet: real 0.112s	user 0.015s	sys 0.013s
I20260709 12:59:13.494518  2226 raft_consensus.cc:3060] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:13.499667  2223 leader_election.cc:290] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 2 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:13.489188  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:13.501353  1681 raft_consensus.cc:3055] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:13.501655  1681 raft_consensus.cc:740] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:13.503821  1681 consensus_queue.cc:260] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:13.504981  1681 raft_consensus.cc:3060] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:13.506261  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:13.506873  1602 raft_consensus.cc:3055] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:13.507187  1602 raft_consensus.cc:740] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:13.507948  1602 consensus_queue.cc:260] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:13.509068  2924 raft_consensus.cc:359] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:59:13.509902  2924 raft_consensus.cc:740] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Initialized, Role: LEARNER
I20260709 12:59:13.510694  2226 raft_consensus.cc:2468] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 2.
I20260709 12:59:13.510509  2924 consensus_queue.cc:260] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:59:13.512202  1572 leader_election.cc:304] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 12:59:13.513537  2924 ts_tablet_manager.cc:1434] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:59:13.515509  2914 raft_consensus.cc:2804] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:13.516044  2914 raft_consensus.cc:697] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 2 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:13.516845  2914 consensus_queue.cc:237] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:13.519110  1602 raft_consensus.cc:3060] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:13.523725  1681 raft_consensus.cc:2468] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 2.
I20260709 12:59:13.523387  2223 raft_consensus.cc:1217] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:13.527601  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:13.530594  1528 raft_consensus.cc:3060] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:13.553696  2932 raft_consensus.cc:993] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1: : Instructing follower ddf11fc190dd4b898773379c6b129d90 to start an election
I20260709 12:59:13.554270  2807 raft_consensus.cc:1081] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Signalling peer ddf11fc190dd4b898773379c6b129d90 to start an election
I20260709 12:59:13.554363  1602 raft_consensus.cc:2468] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 2.
I20260709 12:59:13.555313  1528 raft_consensus.cc:2468] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 2.
I20260709 12:59:13.557515  1523 raft_consensus.cc:1240] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:13.560196  1542 tablet_copy_service.cc:342] P e46412b3b0b44f01ad5c33d4cfe3d6b1: Request end of tablet copy session b96ce9cc496c49d7818fa983a17b062b-a7cff69bd4394da195321efd78d5a703 received from {username='slave'} at 127.0.0.1:49310
I20260709 12:59:13.560695  1542 tablet_copy_service.cc:434] P e46412b3b0b44f01ad5c33d4cfe3d6b1: ending tablet copy session b96ce9cc496c49d7818fa983a17b062b-a7cff69bd4394da195321efd78d5a703 on tablet a7cff69bd4394da195321efd78d5a703 with peer b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:13.562350  2190 leader_election.cc:304] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:13.564391  2870 raft_consensus.cc:2804] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:13.564850  2870 raft_consensus.cc:697] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 2 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 12:59:13.565564  2870 consensus_queue.cc:237] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:13.565850  1680 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751"
dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
 from {username='slave'} at 127.0.0.1:49178
I20260709 12:59:13.566422  1680 raft_consensus.cc:493] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:13.566815  1680 raft_consensus.cc:3060] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:13.579975  1429 catalog_manager.cc:5697] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 1 to 2, leader changed from 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) to b96ce9cc496c49d7818fa983a17b062b (127.0.107.196). New cstate: current_term: 2 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:13.589160  1680 raft_consensus.cc:515] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:13.605065  2928 tablet_bootstrap.cc:492] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:13.606248  2928 tablet_bootstrap.cc:492] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap complete.
I20260709 12:59:13.607399  2928 ts_tablet_manager.cc:1403] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b: Time spent bootstrapping tablet: real 0.175s	user 0.036s	sys 0.013s
I20260709 12:59:13.614713  1428 catalog_manager.cc:5697] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 1 to 2, leader changed from ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) to 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:13.623612  2928 raft_consensus.cc:359] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:59:13.626174  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 12:59:13.627789  2223 raft_consensus.cc:3060] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:13.628227  2924 ts_tablet_manager.cc:933] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b: Initiating tablet copy from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931)
I20260709 12:59:13.626718  1680 leader_election.cc:290] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 2 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:13.632879  2924 tablet_copy_client.cc:323] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:43931
I20260709 12:59:13.636543  2928 raft_consensus.cc:740] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Initialized, Role: LEARNER
I20260709 12:59:13.640358  1542 tablet_copy_service.cc:140] P e46412b3b0b44f01ad5c33d4cfe3d6b1: Received BeginTabletCopySession request for tablet 317204271cc04f68818b36450c9725b1 from peer b96ce9cc496c49d7818fa983a17b062b ({username='slave'} at 127.0.0.1:49310)
I20260709 12:59:13.640918  1542 tablet_copy_service.cc:161] P e46412b3b0b44f01ad5c33d4cfe3d6b1: Beginning new tablet copy session on tablet 317204271cc04f68818b36450c9725b1 from peer b96ce9cc496c49d7818fa983a17b062b at {username='slave'} at 127.0.0.1:49310: session id = b96ce9cc496c49d7818fa983a17b062b-317204271cc04f68818b36450c9725b1
I20260709 12:59:13.650293  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:13.651016  1524 raft_consensus.cc:3055] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:13.651317  1524 raft_consensus.cc:740] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 12:59:13.652056  1524 consensus_queue.cc:260] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:13.653331  1524 raft_consensus.cc:3060] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:13.636371  2223 raft_consensus.cc:2468] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 2.
I20260709 12:59:13.637331  2928 consensus_queue.cc:260] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:59:13.669381  1646 leader_election.cc:304] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:13.670109  2851 raft_consensus.cc:2804] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:13.671442  2928 ts_tablet_manager.cc:1434] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b: Time spent starting tablet: real 0.055s	user 0.005s	sys 0.002s
I20260709 12:59:13.670604  2851 raft_consensus.cc:697] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 2 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:13.673709  2851 consensus_queue.cc:237] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:13.684578  1524 raft_consensus.cc:2468] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 2.
I20260709 12:59:13.689224  1542 tablet_copy_source_session.cc:215] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:13.700408  2924 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 317204271cc04f68818b36450c9725b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:13.703868  2223 raft_consensus.cc:1217] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:59:13.706811  1617 tablet_copy_service.cc:342] P 39a92f5a4352465d8af3af5908fe8642: Request end of tablet copy session b96ce9cc496c49d7818fa983a17b062b-72071486140c4d6c919b25e882a8f5e5 received from {username='slave'} at 127.0.0.1:57268
I20260709 12:59:13.707304  1617 tablet_copy_service.cc:434] P 39a92f5a4352465d8af3af5908fe8642: ending tablet copy session b96ce9cc496c49d7818fa983a17b062b-72071486140c4d6c919b25e882a8f5e5 on tablet 72071486140c4d6c919b25e882a8f5e5 with peer b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:13.724680  1426 catalog_manager.cc:5697] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 reported cstate change: term changed from 1 to 2, leader changed from e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:59:13.741989  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 44275.5us
I20260709 12:59:13.765367  2924 tablet_copy_client.cc:806] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:13.765964  2924 tablet_copy_client.cc:670] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:13.769841  2924 tablet_copy_client.cc:538] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:13.779513  2924 tablet_bootstrap.cc:492] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap starting.
I20260709 12:59:13.781102  2223 raft_consensus.cc:1217] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:13.813743  2924 tablet_bootstrap.cc:492] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:13.814754  2924 tablet_bootstrap.cc:492] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap complete.
I20260709 12:59:13.815384  2924 ts_tablet_manager.cc:1403] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b: Time spent bootstrapping tablet: real 0.036s	user 0.015s	sys 0.005s
I20260709 12:59:13.818177  2924 raft_consensus.cc:359] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:59:13.819087  2924 raft_consensus.cc:740] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Initialized, Role: LEARNER
I20260709 12:59:13.820756  2924 consensus_queue.cc:260] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:59:13.823046  2924 ts_tablet_manager.cc:1434] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:59:13.827143  1542 tablet_copy_service.cc:342] P e46412b3b0b44f01ad5c33d4cfe3d6b1: Request end of tablet copy session b96ce9cc496c49d7818fa983a17b062b-317204271cc04f68818b36450c9725b1 received from {username='slave'} at 127.0.0.1:49310
I20260709 12:59:13.827591  1542 tablet_copy_service.cc:434] P e46412b3b0b44f01ad5c33d4cfe3d6b1: ending tablet copy session b96ce9cc496c49d7818fa983a17b062b-317204271cc04f68818b36450c9725b1 on tablet 317204271cc04f68818b36450c9725b1 with peer b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:13.954859  2223 raft_consensus.cc:1275] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:13.956485  2915 consensus_queue.cc:1048] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:13.983362  1681 raft_consensus.cc:1275] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:13.984931  2914 consensus_queue.cc:1048] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:14.021317  1599 raft_consensus.cc:1275] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:14.023203  2870 consensus_queue.cc:1048] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:14.039893  2227 raft_consensus.cc:1217] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:14.086901  1524 raft_consensus.cc:1275] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:14.088294   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:14.089841  2885 consensus_queue.cc:1048] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:14.134225  2887 raft_consensus.cc:1064] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90: attempting to promote NON_VOTER b96ce9cc496c49d7818fa983a17b062b to VOTER
I20260709 12:59:14.135468  1529 raft_consensus.cc:1275] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:14.136690  2887 consensus_queue.cc:237] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:14.139302  2811 consensus_queue.cc:1048] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:14.158232  2227 raft_consensus.cc:1275] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:14.160142  2851 consensus_queue.cc:1048] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:14.166033  2880 raft_consensus.cc:1064] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1: attempting to promote NON_VOTER b96ce9cc496c49d7818fa983a17b062b to VOTER
I20260709 12:59:14.169145  2880 consensus_queue.cc:237] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:14.193636  1681 raft_consensus.cc:1275] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:14.195652  2223 raft_consensus.cc:1275] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:14.199326  2880 consensus_queue.cc:1048] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:14.200294  2930 consensus_queue.cc:1048] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:14.209057  1599 raft_consensus.cc:1275] T a7cff69bd4394da195321efd78d5a703 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:14.227218  2915 raft_consensus.cc:1064] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642: attempting to promote NON_VOTER b96ce9cc496c49d7818fa983a17b062b to VOTER
I20260709 12:59:14.229753  2915 consensus_queue.cc:237] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:14.239526  2226 raft_consensus.cc:1275] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:14.242195  1599 raft_consensus.cc:1275] T f3dd6988dfbe43e0ac446b79d37d9c24 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:14.247529  1524 raft_consensus.cc:1275] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:14.249822  2851 consensus_queue.cc:1048] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:14.251596   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:14.254110  2811 consensus_queue.cc:1048] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:14.269706  2880 consensus_queue.cc:1048] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:14.272888  2811 raft_consensus.cc:2955] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:14.273991  2226 raft_consensus.cc:2955] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:14.274775  2887 consensus_queue.cc:1048] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:14.292057  2227 raft_consensus.cc:1275] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 2 LEARNER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:59:14.293529  1680 raft_consensus.cc:1275] T 72071486140c4d6c919b25e882a8f5e5 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:59:14.297057  2917 consensus_queue.cc:1048] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:14.306475  2914 consensus_queue.cc:1048] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:14.309898  2930 raft_consensus.cc:2955] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:14.313684  1529 raft_consensus.cc:2955] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:14.318284  1429 catalog_manager.cc:5697] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 reported cstate change: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:14.326013  2223 raft_consensus.cc:2955] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:14.335260  1681 raft_consensus.cc:2955] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
W20260709 12:59:14.378731  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 44490.5us
I20260709 12:59:14.381924  1524 raft_consensus.cc:1275] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:59:14.381382  2917 raft_consensus.cc:2955] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:14.388129  2224 raft_consensus.cc:2955] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:14.393954  2914 consensus_queue.cc:1048] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:14.348213  1599 raft_consensus.cc:2955] T f3dd6988dfbe43e0ac446b79d37d9c24 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:14.411614  1605 raft_consensus.cc:2955] T a7cff69bd4394da195321efd78d5a703 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:14.422251  1680 raft_consensus.cc:2955] T 72071486140c4d6c919b25e882a8f5e5 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:14.435295  1430 catalog_manager.cc:5697] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: config changed from index 3 to 4, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:14.466454  1675 consensus_queue.cc:237] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:14.467491  1605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a"
dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
mode: GRACEFUL
new_leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:48230
I20260709 12:59:14.468933  1605 raft_consensus.cc:606] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Received request to transfer leadership to TS e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:14.467972  1428 catalog_manager.cc:5697] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:14.463973  1524 raft_consensus.cc:2955] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:14.485416  1528 consensus_queue.cc:237] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:14.487876  1524 raft_consensus.cc:1275] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:14.491827  2887 consensus_queue.cc:1048] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:14.493567  2223 raft_consensus.cc:1275] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:14.496448  2811 consensus_queue.cc:1048] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:14.498142  2224 raft_consensus.cc:1275] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:14.503448  2967 consensus_queue.cc:1048] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:14.483973  1605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf"
dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
mode: GRACEFUL
new_leader_uuid: "ddf11fc190dd4b898773379c6b129d90"
 from {username='slave'} at 127.0.0.1:48230
I20260709 12:59:14.506810  1605 raft_consensus.cc:606] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 2 LEADER]: Received request to transfer leadership to TS ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:14.508438  1681 raft_consensus.cc:1275] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:14.507517  2851 raft_consensus.cc:2955] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:14.512403  1524 raft_consensus.cc:2955] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:14.513201  2930 raft_consensus.cc:2955] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:14.517177  2224 raft_consensus.cc:2955] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:14.518334  2807 consensus_queue.cc:1048] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:14.524353  1414 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a7cff69bd4394da195321efd78d5a703 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:14.533629  2919 raft_consensus.cc:993] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642: : Instructing follower e46412b3b0b44f01ad5c33d4cfe3d6b1 to start an election
I20260709 12:59:14.534119  2919 raft_consensus.cc:1081] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Signalling peer e46412b3b0b44f01ad5c33d4cfe3d6b1 to start an election
I20260709 12:59:14.536695  2223 raft_consensus.cc:2955] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:14.538496  1415 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f3dd6988dfbe43e0ac446b79d37d9c24 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:14.533303  1681 raft_consensus.cc:2955] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:14.541162  1524 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a"
dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:43008
I20260709 12:59:14.541703  1524 raft_consensus.cc:493] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:14.542032  1524 raft_consensus.cc:3060] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:14.548237  1524 raft_consensus.cc:515] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:14.549991  1524 leader_election.cc:290] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 2 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:14.555586  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:14.556411  1605 raft_consensus.cc:3055] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:14.557581  1605 raft_consensus.cc:740] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:14.557156  1680 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c"
dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
mode: GRACEFUL
new_leader_uuid: "39a92f5a4352465d8af3af5908fe8642"
 from {username='slave'} at 127.0.0.1:33616
I20260709 12:59:14.567436  1428 catalog_manager.cc:5697] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: config changed from index 3 to 4, VOTER 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:14.568604  1680 raft_consensus.cc:606] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 2 LEADER]: Received request to transfer leadership to TS 39a92f5a4352465d8af3af5908fe8642
I20260709 12:59:14.562343  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:14.569209  1675 raft_consensus.cc:3060] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:14.569875  1605 consensus_queue.cc:260] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:14.569243  1428 catalog_manager.cc:5697] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: config changed from index 3 to 4, VOTER 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:14.579393  1680 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e"
dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
mode: GRACEFUL
new_leader_uuid: "39a92f5a4352465d8af3af5908fe8642"
 from {username='slave'} at 127.0.0.1:33616
I20260709 12:59:14.580036  1680 raft_consensus.cc:606] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 3 LEADER]: Received request to transfer leadership to TS 39a92f5a4352465d8af3af5908fe8642
I20260709 12:59:14.581190   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:59:14.582845   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:14.583521  1605 raft_consensus.cc:3060] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:14.588171  1675 raft_consensus.cc:2468] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 2.
I20260709 12:59:14.592207  1605 raft_consensus.cc:2468] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 2.
I20260709 12:59:14.593889  1496 leader_election.cc:304] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:14.594781  2930 raft_consensus.cc:2804] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:14.595239  2930 raft_consensus.cc:697] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 12:59:14.596042  2930 consensus_queue.cc:237] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:14.602367  1594 tablet_service.cc:1558] Processing DeleteTablet for tablet a7cff69bd4394da195321efd78d5a703 with delete_type TABLET_DATA_TOMBSTONED (TS 39a92f5a4352465d8af3af5908fe8642 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36192
I20260709 12:59:14.607301  1595 tablet_service.cc:1558] Processing DeleteTablet for tablet f3dd6988dfbe43e0ac446b79d37d9c24 with delete_type TABLET_DATA_TOMBSTONED (TS 39a92f5a4352465d8af3af5908fe8642 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36192
I20260709 12:59:14.608151  2977 tablet_replica.cc:333] T a7cff69bd4394da195321efd78d5a703 P 39a92f5a4352465d8af3af5908fe8642: stopping tablet replica
I20260709 12:59:14.609556  2977 raft_consensus.cc:2243] T a7cff69bd4394da195321efd78d5a703 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:14.611299  2977 raft_consensus.cc:2272] T a7cff69bd4394da195321efd78d5a703 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:14.620255  2977 ts_tablet_manager.cc:1916] T a7cff69bd4394da195321efd78d5a703 P 39a92f5a4352465d8af3af5908fe8642: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:14.631306  1428 catalog_manager.cc:5697] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 1 to 2, leader changed from 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) to e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:14.635797  2977 ts_tablet_manager.cc:1929] T a7cff69bd4394da195321efd78d5a703 P 39a92f5a4352465d8af3af5908fe8642: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:14.636294  2977 log.cc:1199] T a7cff69bd4394da195321efd78d5a703 P 39a92f5a4352465d8af3af5908fe8642: Deleting WAL directory at /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601891739070-431-0/minicluster-data/ts-1-root/wals/a7cff69bd4394da195321efd78d5a703
I20260709 12:59:14.639223  2977 tablet_replica.cc:333] T f3dd6988dfbe43e0ac446b79d37d9c24 P 39a92f5a4352465d8af3af5908fe8642: stopping tablet replica
I20260709 12:59:14.640470  2977 raft_consensus.cc:2243] T f3dd6988dfbe43e0ac446b79d37d9c24 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:14.641114  2977 raft_consensus.cc:2272] T f3dd6988dfbe43e0ac446b79d37d9c24 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:14.641688  1416 catalog_manager.cc:5028] TS 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): tablet a7cff69bd4394da195321efd78d5a703 (table test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]) successfully deleted
I20260709 12:59:14.646052  2977 ts_tablet_manager.cc:1916] T f3dd6988dfbe43e0ac446b79d37d9c24 P 39a92f5a4352465d8af3af5908fe8642: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:14.660646  2977 ts_tablet_manager.cc:1929] T f3dd6988dfbe43e0ac446b79d37d9c24 P 39a92f5a4352465d8af3af5908fe8642: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:14.661062  2977 log.cc:1199] T f3dd6988dfbe43e0ac446b79d37d9c24 P 39a92f5a4352465d8af3af5908fe8642: Deleting WAL directory at /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601891739070-431-0/minicluster-data/ts-1-root/wals/f3dd6988dfbe43e0ac446b79d37d9c24
I20260709 12:59:14.661754  2807 raft_consensus.cc:1064] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1: attempting to promote NON_VOTER b96ce9cc496c49d7818fa983a17b062b to VOTER
I20260709 12:59:14.662828  1416 catalog_manager.cc:5028] TS 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): tablet f3dd6988dfbe43e0ac446b79d37d9c24 (table test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]) successfully deleted
I20260709 12:59:14.664145  2807 consensus_queue.cc:237] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:14.672817  2224 raft_consensus.cc:1275] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:14.674597  2880 consensus_queue.cc:1048] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:14.677651  1675 raft_consensus.cc:1275] T 317204271cc04f68818b36450c9725b1 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:14.680428  1605 raft_consensus.cc:1275] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:14.686458  2880 consensus_queue.cc:1048] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:14.687903  2930 consensus_queue.cc:1048] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:14.700165  2930 raft_consensus.cc:2955] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:14.702241  1675 raft_consensus.cc:2955] T 317204271cc04f68818b36450c9725b1 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:14.708531  1605 raft_consensus.cc:2955] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:14.720752  1428 catalog_manager.cc:5697] T 317204271cc04f68818b36450c9725b1 P ddf11fc190dd4b898773379c6b129d90 reported cstate change: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:14.730291  2223 raft_consensus.cc:2955] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:14.735248  1524 consensus_queue.cc:237] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:14.747685  1605 raft_consensus.cc:1275] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:14.748308  2223 raft_consensus.cc:1275] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:14.749991  2880 consensus_queue.cc:1048] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:14.750937  2967 consensus_queue.cc:1048] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:14.759567  2967 raft_consensus.cc:2955] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:14.770205  2223 raft_consensus.cc:2955] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:14.767674  1605 raft_consensus.cc:2955] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:14.775498  1414 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 317204271cc04f68818b36450c9725b1 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:14.784524  1430 catalog_manager.cc:5697] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: config changed from index 3 to 4, VOTER ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:14.806095  1664 tablet_service.cc:1558] Processing DeleteTablet for tablet 317204271cc04f68818b36450c9725b1 with delete_type TABLET_DATA_TOMBSTONED (TS ddf11fc190dd4b898773379c6b129d90 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49162
I20260709 12:59:14.808053  2982 tablet_replica.cc:333] T 317204271cc04f68818b36450c9725b1 P ddf11fc190dd4b898773379c6b129d90: stopping tablet replica
I20260709 12:59:14.809137  2982 raft_consensus.cc:2243] T 317204271cc04f68818b36450c9725b1 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:14.809927  2982 raft_consensus.cc:2272] T 317204271cc04f68818b36450c9725b1 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:14.813040  2982 ts_tablet_manager.cc:1916] T 317204271cc04f68818b36450c9725b1 P ddf11fc190dd4b898773379c6b129d90: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:14.815387  1605 consensus_queue.cc:237] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:14.820595  2223 raft_consensus.cc:1275] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:14.822088  1524 raft_consensus.cc:1275] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:14.822870  2915 consensus_queue.cc:1048] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:14.826171  2915 consensus_queue.cc:1048] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:14.830986  2914 raft_consensus.cc:2955] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:14.833772  2982 ts_tablet_manager.cc:1929] T 317204271cc04f68818b36450c9725b1 P ddf11fc190dd4b898773379c6b129d90: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:14.834157  2982 log.cc:1199] T 317204271cc04f68818b36450c9725b1 P ddf11fc190dd4b898773379c6b129d90: Deleting WAL directory at /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601891739070-431-0/minicluster-data/ts-2-root/wals/317204271cc04f68818b36450c9725b1
I20260709 12:59:14.836448  1415 catalog_manager.cc:5028] TS ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217): tablet 317204271cc04f68818b36450c9725b1 (table test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]) successfully deleted
I20260709 12:59:14.836663  2223 raft_consensus.cc:2955] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:14.851191  2811 raft_consensus.cc:993] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90: : Instructing follower 39a92f5a4352465d8af3af5908fe8642 to start an election
I20260709 12:59:14.851728  2811 raft_consensus.cc:1081] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 3 LEADER]: Signalling peer 39a92f5a4352465d8af3af5908fe8642 to start an election
I20260709 12:59:14.856040  1416 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 72071486140c4d6c919b25e882a8f5e5 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:14.867057  1428 catalog_manager.cc:5697] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: config changed from index 4 to 5, VOTER ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) evicted. New cstate: current_term: 2 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:14.871178  1599 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e"
dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
 from {username='slave'} at 127.0.0.1:36200
I20260709 12:59:14.871801  1599 raft_consensus.cc:493] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:14.872150  1599 raft_consensus.cc:3060] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:14.877892  2919 raft_consensus.cc:993] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642: : Instructing follower ddf11fc190dd4b898773379c6b129d90 to start an election
I20260709 12:59:14.878907  2919 raft_consensus.cc:1081] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 2 LEADER]: Signalling peer ddf11fc190dd4b898773379c6b129d90 to start an election
I20260709 12:59:14.880518  1675 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf"
dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
 from {username='slave'} at 127.0.0.1:49170
I20260709 12:59:14.881139  1675 raft_consensus.cc:493] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:14.881534  1675 raft_consensus.cc:3060] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:14.883137  1664 tablet_service.cc:1558] Processing DeleteTablet for tablet 72071486140c4d6c919b25e882a8f5e5 with delete_type TABLET_DATA_TOMBSTONED (TS ddf11fc190dd4b898773379c6b129d90 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:49162
I20260709 12:59:14.884079  2982 tablet_replica.cc:333] T 72071486140c4d6c919b25e882a8f5e5 P ddf11fc190dd4b898773379c6b129d90: stopping tablet replica
I20260709 12:59:14.885109  2982 raft_consensus.cc:2243] T 72071486140c4d6c919b25e882a8f5e5 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:14.885942  2982 raft_consensus.cc:2272] T 72071486140c4d6c919b25e882a8f5e5 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:14.888829  1599 raft_consensus.cc:515] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:14.890208  2982 ts_tablet_manager.cc:1916] T 72071486140c4d6c919b25e882a8f5e5 P ddf11fc190dd4b898773379c6b129d90: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:14.891449  1599 leader_election.cc:290] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:14.892719  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:14.892719  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:14.891108  1675 raft_consensus.cc:515] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:14.893484  1680 raft_consensus.cc:3055] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:14.893926  1680 raft_consensus.cc:740] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:14.893363  1524 raft_consensus.cc:2955] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:14.894591  1680 consensus_queue.cc:260] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:14.895486  1675 leader_election.cc:290] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:14.895826  1680 raft_consensus.cc:3060] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:14.893483  1529 raft_consensus.cc:3060] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:14.897334  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 12:59:14.897450  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:14.897920  2223 raft_consensus.cc:3060] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:14.898022  1605 raft_consensus.cc:3055] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:14.901427  1605 raft_consensus.cc:740] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:14.902136  1605 consensus_queue.cc:260] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:14.903152  1605 raft_consensus.cc:3060] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:14.905900  1529 raft_consensus.cc:2468] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 4.
I20260709 12:59:14.907107  2982 ts_tablet_manager.cc:1929] T 72071486140c4d6c919b25e882a8f5e5 P ddf11fc190dd4b898773379c6b129d90: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:59:14.907595  2982 log.cc:1199] T 72071486140c4d6c919b25e882a8f5e5 P ddf11fc190dd4b898773379c6b129d90: Deleting WAL directory at /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601891739070-431-0/minicluster-data/ts-2-root/wals/72071486140c4d6c919b25e882a8f5e5
I20260709 12:59:14.907532  1570 leader_election.cc:304] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:14.908517  2914 raft_consensus.cc:2804] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:14.909158  2914 raft_consensus.cc:697] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 4 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:14.909453  1415 catalog_manager.cc:5028] TS ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217): tablet 72071486140c4d6c919b25e882a8f5e5 (table test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]) successfully deleted
I20260709 12:59:14.909873  2914 consensus_queue.cc:237] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:14.921185  1680 raft_consensus.cc:2468] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 4.
I20260709 12:59:14.922231  1605 raft_consensus.cc:2468] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 3.
I20260709 12:59:14.923321  1646 leader_election.cc:304] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:14.924124  2968 raft_consensus.cc:2804] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:14.924624  2968 raft_consensus.cc:697] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 3 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:14.925410  2968 consensus_queue.cc:237] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:14.931607  2223 raft_consensus.cc:2468] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 3.
I20260709 12:59:14.943572  1428 catalog_manager.cc:5697] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 reported cstate change: term changed from 2 to 3, leader changed from 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:14.947808  1429 catalog_manager.cc:5697] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 3 to 4, leader changed from ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) to 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194). New cstate: current_term: 4 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:15.004077  1599 raft_consensus.cc:1275] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:15.005228  2967 consensus_queue.cc:1048] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:15.013548  2968 raft_consensus.cc:993] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90: : Instructing follower 39a92f5a4352465d8af3af5908fe8642 to start an election
I20260709 12:59:15.014171  2887 raft_consensus.cc:1081] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 2 LEADER]: Signalling peer 39a92f5a4352465d8af3af5908fe8642 to start an election
I20260709 12:59:15.016299  1599 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c"
dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
 from {username='slave'} at 127.0.0.1:36200
I20260709 12:59:15.016384  1675 raft_consensus.cc:1275] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:15.016978  1599 raft_consensus.cc:493] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:15.017381  1599 raft_consensus.cc:3060] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:15.018100  2967 consensus_queue.cc:1048] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:15.024302  1599 raft_consensus.cc:515] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:15.027756  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:15.027895  1599 leader_election.cc:290] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:15.028384  1680 raft_consensus.cc:3055] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:15.028707  1680 raft_consensus.cc:740] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:15.029402  1680 consensus_queue.cc:260] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:15.030617  1680 raft_consensus.cc:3060] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:15.032584  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:15.033201  1524 raft_consensus.cc:3060] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:15.039328  1524 raft_consensus.cc:2468] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 3.
I20260709 12:59:15.040161  1680 raft_consensus.cc:2468] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 3.
I20260709 12:59:15.042029  1570 leader_election.cc:304] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:15.043380  2919 raft_consensus.cc:2804] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:15.043859  2919 raft_consensus.cc:697] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 3 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:15.044654  2919 consensus_queue.cc:237] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:15.059043  1429 catalog_manager.cc:5697] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 2 to 3, leader changed from ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) to 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:15.363639  1529 raft_consensus.cc:1275] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:59:15.364907  2919 consensus_queue.cc:1048] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:15.374470  1680 raft_consensus.cc:1275] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:59:15.376726  2917 consensus_queue.cc:1048] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:15.386006  2224 raft_consensus.cc:1275] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:59:15.387647  2811 consensus_queue.cc:1048] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:15.410615  1605 raft_consensus.cc:1275] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:59:15.411979  2968 consensus_queue.cc:1048] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:15.519944  1680 raft_consensus.cc:1275] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:59:15.522837  2917 consensus_queue.cc:1048] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:15.540002  1524 raft_consensus.cc:1275] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:59:15.541415  2914 consensus_queue.cc:1048] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:15.583820   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:15.686484   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:15.723909  1605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923"
dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
mode: GRACEFUL
new_leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:48230
I20260709 12:59:15.724638  1605 raft_consensus.cc:606] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Received request to transfer leadership to TS e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:15.727170  1605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4ea41c88222b469fb11229faef735050"
dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
mode: GRACEFUL
new_leader_uuid: "b96ce9cc496c49d7818fa983a17b062b"
 from {username='slave'} at 127.0.0.1:48230
I20260709 12:59:15.727679  1605 raft_consensus.cc:606] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 2 LEADER]: Received request to transfer leadership to TS b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:15.730149  1680 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9"
dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
mode: GRACEFUL
new_leader_uuid: "39a92f5a4352465d8af3af5908fe8642"
 from {username='slave'} at 127.0.0.1:33616
I20260709 12:59:15.730795  1680 raft_consensus.cc:606] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 2 LEADER]: Received request to transfer leadership to TS 39a92f5a4352465d8af3af5908fe8642
I20260709 12:59:15.733402  1529 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28"
dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
mode: GRACEFUL
new_leader_uuid: "39a92f5a4352465d8af3af5908fe8642"
 from {username='slave'} at 127.0.0.1:55626
I20260709 12:59:15.733946  1529 raft_consensus.cc:606] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Received request to transfer leadership to TS 39a92f5a4352465d8af3af5908fe8642
I20260709 12:59:15.735087   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:59:15.736585   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:15.945906  1680 consensus_queue.cc:237] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:59:15.947383  2811 raft_consensus.cc:993] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90: : Instructing follower 39a92f5a4352465d8af3af5908fe8642 to start an election
I20260709 12:59:15.947868  2811 raft_consensus.cc:1081] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 2 LEADER]: Signalling peer 39a92f5a4352465d8af3af5908fe8642 to start an election
I20260709 12:59:15.947892  2930 raft_consensus.cc:993] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1: : Instructing follower 39a92f5a4352465d8af3af5908fe8642 to start an election
I20260709 12:59:15.948590  2880 raft_consensus.cc:1081] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Signalling peer 39a92f5a4352465d8af3af5908fe8642 to start an election
I20260709 12:59:15.949451  1599 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9"
dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
 from {username='slave'} at 127.0.0.1:36200
I20260709 12:59:15.950013  1599 raft_consensus.cc:493] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:15.950368  1599 raft_consensus.cc:3060] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:15.952693  1529 raft_consensus.cc:1275] T e0590ffd096d4e378ab66c1795ff5cce P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:15.952930  1600 raft_consensus.cc:1275] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:59:15.953450  1646 consensus_peers.cc:597] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 -> Peer b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373): Couldn't send request to peer b96ce9cc496c49d7818fa983a17b062b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e0590ffd096d4e378ab66c1795ff5cce. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:15.954190  2811 consensus_queue.cc:1048] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:15.955000  2851 consensus_queue.cc:1048] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:15.958803  1599 raft_consensus.cc:515] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:15.962174  1599 leader_election.cc:290] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:15.963444  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:15.960134  1605 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28"
dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
 from {username='slave'} at 127.0.0.1:36194
I20260709 12:59:15.966957  1681 raft_consensus.cc:3055] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:15.967097  1605 raft_consensus.cc:493] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:15.967592  1605 raft_consensus.cc:3060] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:15.968611  1681 raft_consensus.cc:740] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:15.968794  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:15.969337  1524 raft_consensus.cc:3060] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:15.972332  1681 consensus_queue.cc:260] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:15.973574  1681 raft_consensus.cc:3060] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:15.980391  1524 raft_consensus.cc:2468] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 3.
I20260709 12:59:15.982347  1570 leader_election.cc:304] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:15.983238  2914 raft_consensus.cc:2804] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:15.986778  1681 raft_consensus.cc:2468] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 3.
I20260709 12:59:15.990197  2811 raft_consensus.cc:2955] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:59:15.996505  1605 raft_consensus.cc:515] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:15.997478  1529 raft_consensus.cc:2955] T e0590ffd096d4e378ab66c1795ff5cce P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:59:15.998909  1605 leader_election.cc:290] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:15.990047  2914 raft_consensus.cc:697] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 3 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:16.002605  2914 consensus_queue.cc:237] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:16.007048  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:16.007635  1528 raft_consensus.cc:3055] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:16.007910  1528 raft_consensus.cc:740] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 12:59:16.008317  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 12:59:16.008872  2226 raft_consensus.cc:3060] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:16.008592  1528 consensus_queue.cc:260] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:16.009855  1528 raft_consensus.cc:3060] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:16.009682  1429 catalog_manager.cc:5697] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 reported cstate change: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:16.016575  1528 raft_consensus.cc:2468] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 2.
I20260709 12:59:16.018532  1430 catalog_manager.cc:5697] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 2 to 3, leader changed from ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) to 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:16.020133  1524 consensus_queue.cc:237] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:59:16.026139  1600 raft_consensus.cc:2955] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:59:16.031869  1570 leader_election.cc:304] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:16.034874  2914 raft_consensus.cc:2804] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:16.035477  2914 raft_consensus.cc:697] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 2 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:16.036072  2919 raft_consensus.cc:993] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642: : Instructing follower e46412b3b0b44f01ad5c33d4cfe3d6b1 to start an election
I20260709 12:59:16.036613  2919 raft_consensus.cc:1081] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Signalling peer e46412b3b0b44f01ad5c33d4cfe3d6b1 to start an election
W20260709 12:59:16.039745  1497 consensus_peers.cc:597] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 -> Peer b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373): Couldn't send request to peer b96ce9cc496c49d7818fa983a17b062b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9b7b5b00d91c4b488d16174662489496. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:16.040402  1680 raft_consensus.cc:1275] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:16.043386  2880 consensus_queue.cc:1048] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:16.041764  2226 raft_consensus.cc:2468] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 2.
I20260709 12:59:16.036497  2914 consensus_queue.cc:237] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:16.049486  2917 raft_consensus.cc:993] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642: : Instructing follower b96ce9cc496c49d7818fa983a17b062b to start an election
I20260709 12:59:16.050026  2917 raft_consensus.cc:1081] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 2 LEADER]: Signalling peer b96ce9cc496c49d7818fa983a17b062b to start an election
I20260709 12:59:16.059232  2224 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4ea41c88222b469fb11229faef735050"
dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
 from {username='slave'} at 127.0.0.1:50310
I20260709 12:59:16.059937  2224 raft_consensus.cc:493] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:16.060324  2224 raft_consensus.cc:3060] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:16.067020  1524 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923"
dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:43008
I20260709 12:59:16.067682  1524 raft_consensus.cc:493] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:16.068078  1524 raft_consensus.cc:3060] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:16.068606  1600 raft_consensus.cc:1275] T 9b7b5b00d91c4b488d16174662489496 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:16.071317  2930 consensus_queue.cc:1048] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:16.098455  1524 raft_consensus.cc:515] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:16.096782  1428 catalog_manager.cc:5697] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 1 to 2, leader changed from e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) to 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:16.114809  1524 leader_election.cc:290] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 2 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:16.118733  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 12:59:16.119397  2226 raft_consensus.cc:3060] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:16.121333  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:16.121912  1605 raft_consensus.cc:3055] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:16.122149  1605 raft_consensus.cc:740] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:16.122735  1605 consensus_queue.cc:260] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:16.123550  1605 raft_consensus.cc:3060] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:16.126770  2224 raft_consensus.cc:515] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:16.130165  2224 leader_election.cc:290] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 3 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:16.127619  2226 raft_consensus.cc:2468] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 2.
I20260709 12:59:16.132680  1497 leader_election.cc:304] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:16.133450  2880 raft_consensus.cc:2804] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:16.133554  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:16.133822  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:16.134104  1599 raft_consensus.cc:3055] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:16.134446  1599 raft_consensus.cc:740] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:16.134604  2880 raft_consensus.cc:697] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 12:59:16.135146  1599 consensus_queue.cc:260] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:16.136044  2880 consensus_queue.cc:237] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:16.136389  1599 raft_consensus.cc:3060] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:16.138136  2967 raft_consensus.cc:2955] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:59:16.129920  1605 raft_consensus.cc:2468] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 2.
I20260709 12:59:16.143970  1605 raft_consensus.cc:2955] T 9b7b5b00d91c4b488d16174662489496 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:59:16.134322  1680 raft_consensus.cc:3060] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:16.146855  1681 raft_consensus.cc:2955] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:59:16.153040  1680 raft_consensus.cc:2468] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 3.
I20260709 12:59:16.155042  2191 leader_election.cc:304] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:16.155890  2997 raft_consensus.cc:2804] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:16.156404  2997 raft_consensus.cc:697] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 3 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 12:59:16.144780  1599 raft_consensus.cc:2468] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 3.
I20260709 12:59:16.157255  2997 consensus_queue.cc:237] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:16.170037  1428 catalog_manager.cc:5697] T 9b7b5b00d91c4b488d16174662489496 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:59:16.198015  1605 consensus_queue.cc:237] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:59:16.272825  1428 catalog_manager.cc:5697] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 1 to 2, leader changed from 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) to e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:59:16.279970  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 63152.7us
I20260709 12:59:16.279503  1429 catalog_manager.cc:5697] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 2 to 3, leader changed from 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) to b96ce9cc496c49d7818fa983a17b062b (127.0.107.196). New cstate: current_term: 3 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:59:16.282058  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 65442.6us
I20260709 12:59:16.286446  1524 raft_consensus.cc:1275] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:59:16.289546  1572 consensus_peers.cc:597] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 -> Peer b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373): Couldn't send request to peer b96ce9cc496c49d7818fa983a17b062b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cbe75e7a89594d3f81b1b8935b43b2ed. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:16.294516  1680 raft_consensus.cc:1275] T cbe75e7a89594d3f81b1b8935b43b2ed P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:16.294647  2914 consensus_queue.cc:1048] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:16.301085  2915 consensus_queue.cc:1048] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:16.316702  2917 raft_consensus.cc:2955] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:59:16.322034  1681 raft_consensus.cc:2955] T cbe75e7a89594d3f81b1b8935b43b2ed P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:59:16.322773  1524 raft_consensus.cc:2955] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:59:16.331432  1605 consensus_queue.cc:237] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:59:16.336653  1428 catalog_manager.cc:5697] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:16.353888  1681 raft_consensus.cc:1275] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:16.355439  1524 raft_consensus.cc:1275] T fb3a9a4620ef4fcd86eb78530746a583 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:16.357293  2917 consensus_queue.cc:1048] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:59:16.358191  1572 consensus_peers.cc:597] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 -> Peer b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373): Couldn't send request to peer b96ce9cc496c49d7818fa983a17b062b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fb3a9a4620ef4fcd86eb78530746a583. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:16.358238  2914 consensus_queue.cc:1048] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:16.365839  2917 raft_consensus.cc:2955] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:59:16.367733  1681 raft_consensus.cc:2955] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:59:16.375677  1528 raft_consensus.cc:2955] T fb3a9a4620ef4fcd86eb78530746a583 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:59:16.385392  1429 catalog_manager.cc:5697] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 reported cstate change: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:59:16.396579  1680 raft_consensus.cc:1275] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:16.401234  2915 consensus_queue.cc:1048] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:16.436518  1528 raft_consensus.cc:1275] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:16.439455  2915 consensus_queue.cc:1048] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:16.445659  2226 raft_consensus.cc:1275] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:16.447073  2914 consensus_queue.cc:1048] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:16.481158  1528 raft_consensus.cc:1275] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:16.483140  2914 consensus_queue.cc:1048] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:16.544981  3029 ts_tablet_manager.cc:933] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b: Initiating tablet copy from peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:16.554051  3029 tablet_copy_client.cc:323] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:44217
I20260709 12:59:16.555768  1690 tablet_copy_service.cc:140] P ddf11fc190dd4b898773379c6b129d90: Received BeginTabletCopySession request for tablet e0590ffd096d4e378ab66c1795ff5cce from peer b96ce9cc496c49d7818fa983a17b062b ({username='slave'} at 127.0.0.1:50664)
I20260709 12:59:16.556340  1690 tablet_copy_service.cc:161] P ddf11fc190dd4b898773379c6b129d90: Beginning new tablet copy session on tablet e0590ffd096d4e378ab66c1795ff5cce from peer b96ce9cc496c49d7818fa983a17b062b at {username='slave'} at 127.0.0.1:50664: session id = b96ce9cc496c49d7818fa983a17b062b-e0590ffd096d4e378ab66c1795ff5cce
I20260709 12:59:16.565689  1690 tablet_copy_source_session.cc:215] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:16.573416  3029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0590ffd096d4e378ab66c1795ff5cce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:16.573467  1680 raft_consensus.cc:1275] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:59:16.575536  2997 consensus_queue.cc:1048] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:16.573549  1605 raft_consensus.cc:1275] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:16.591723  3029 tablet_copy_client.cc:806] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:16.592423  3029 tablet_copy_client.cc:670] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:16.598444  2880 consensus_queue.cc:1048] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:16.600343  3029 tablet_copy_client.cc:538] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:16.612826  3029 tablet_bootstrap.cc:492] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b: Bootstrap starting.
I20260709 12:59:16.621454  1599 raft_consensus.cc:1275] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:59:16.623376  3014 consensus_queue.cc:1048] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:16.656985  3035 ts_tablet_manager.cc:933] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b: Initiating tablet copy from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931)
I20260709 12:59:16.659085  3029 tablet_bootstrap.cc:492] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:16.660142  3029 tablet_bootstrap.cc:492] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b: Bootstrap complete.
I20260709 12:59:16.660828  3029 ts_tablet_manager.cc:1403] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b: Time spent bootstrapping tablet: real 0.048s	user 0.019s	sys 0.016s
I20260709 12:59:16.673635  3029 raft_consensus.cc:359] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:59:16.674592  3029 raft_consensus.cc:740] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Initialized, Role: LEARNER
I20260709 12:59:16.675360  3029 consensus_queue.cc:260] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:59:16.677886  3029 ts_tablet_manager.cc:1434] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b: Time spent starting tablet: real 0.017s	user 0.003s	sys 0.004s
I20260709 12:59:16.679533  1690 tablet_copy_service.cc:342] P ddf11fc190dd4b898773379c6b129d90: Request end of tablet copy session b96ce9cc496c49d7818fa983a17b062b-e0590ffd096d4e378ab66c1795ff5cce received from {username='slave'} at 127.0.0.1:50664
I20260709 12:59:16.679979  1690 tablet_copy_service.cc:434] P ddf11fc190dd4b898773379c6b129d90: ending tablet copy session b96ce9cc496c49d7818fa983a17b062b-e0590ffd096d4e378ab66c1795ff5cce on tablet e0590ffd096d4e378ab66c1795ff5cce with peer b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:16.689798  2224 raft_consensus.cc:1275] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:16.692191  3011 consensus_queue.cc:1048] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:16.717146  3035 tablet_copy_client.cc:323] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:43931
I20260709 12:59:16.718683  1542 tablet_copy_service.cc:140] P e46412b3b0b44f01ad5c33d4cfe3d6b1: Received BeginTabletCopySession request for tablet 9b7b5b00d91c4b488d16174662489496 from peer b96ce9cc496c49d7818fa983a17b062b ({username='slave'} at 127.0.0.1:49310)
I20260709 12:59:16.719295  1542 tablet_copy_service.cc:161] P e46412b3b0b44f01ad5c33d4cfe3d6b1: Beginning new tablet copy session on tablet 9b7b5b00d91c4b488d16174662489496 from peer b96ce9cc496c49d7818fa983a17b062b at {username='slave'} at 127.0.0.1:49310: session id = b96ce9cc496c49d7818fa983a17b062b-9b7b5b00d91c4b488d16174662489496
I20260709 12:59:16.728696  3029 ts_tablet_manager.cc:933] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b: Initiating tablet copy from peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:16.732419  1542 tablet_copy_source_session.cc:215] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:16.735800  3035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b7b5b00d91c4b488d16174662489496. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:16.739269   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:16.751443  3029 tablet_copy_client.cc:323] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:40303
I20260709 12:59:16.753286  1617 tablet_copy_service.cc:140] P 39a92f5a4352465d8af3af5908fe8642: Received BeginTabletCopySession request for tablet cbe75e7a89594d3f81b1b8935b43b2ed from peer b96ce9cc496c49d7818fa983a17b062b ({username='slave'} at 127.0.0.1:57268)
I20260709 12:59:16.753850  1617 tablet_copy_service.cc:161] P 39a92f5a4352465d8af3af5908fe8642: Beginning new tablet copy session on tablet cbe75e7a89594d3f81b1b8935b43b2ed from peer b96ce9cc496c49d7818fa983a17b062b at {username='slave'} at 127.0.0.1:57268: session id = b96ce9cc496c49d7818fa983a17b062b-cbe75e7a89594d3f81b1b8935b43b2ed
I20260709 12:59:16.762768  1617 tablet_copy_source_session.cc:215] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:16.766289  3029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbe75e7a89594d3f81b1b8935b43b2ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:16.769105  3035 tablet_copy_client.cc:806] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:16.771534  3039 ts_tablet_manager.cc:933] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b: Initiating tablet copy from peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:16.773383  3035 tablet_copy_client.cc:670] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:16.777765  3035 tablet_copy_client.cc:538] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:16.788885  3029 tablet_copy_client.cc:806] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:16.793357  3029 tablet_copy_client.cc:670] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:16.806926  3029 tablet_copy_client.cc:538] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:16.808748  3035 tablet_bootstrap.cc:492] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap starting.
I20260709 12:59:16.823459  3039 tablet_copy_client.cc:323] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:40303
I20260709 12:59:16.825779  1617 tablet_copy_service.cc:140] P 39a92f5a4352465d8af3af5908fe8642: Received BeginTabletCopySession request for tablet fb3a9a4620ef4fcd86eb78530746a583 from peer b96ce9cc496c49d7818fa983a17b062b ({username='slave'} at 127.0.0.1:57268)
I20260709 12:59:16.826336  1617 tablet_copy_service.cc:161] P 39a92f5a4352465d8af3af5908fe8642: Beginning new tablet copy session on tablet fb3a9a4620ef4fcd86eb78530746a583 from peer b96ce9cc496c49d7818fa983a17b062b at {username='slave'} at 127.0.0.1:57268: session id = b96ce9cc496c49d7818fa983a17b062b-fb3a9a4620ef4fcd86eb78530746a583
I20260709 12:59:16.836692  1617 tablet_copy_source_session.cc:215] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:16.840068  3039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb3a9a4620ef4fcd86eb78530746a583. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:16.853772  3029 tablet_bootstrap.cc:492] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b: Bootstrap starting.
I20260709 12:59:16.865236  3039 tablet_copy_client.cc:806] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:16.865872  3039 tablet_copy_client.cc:670] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:16.869432  3035 tablet_bootstrap.cc:492] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:16.870980  3035 tablet_bootstrap.cc:492] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap complete.
I20260709 12:59:16.873154  3035 ts_tablet_manager.cc:1403] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b: Time spent bootstrapping tablet: real 0.065s	user 0.020s	sys 0.011s
I20260709 12:59:16.874799  3039 tablet_copy_client.cc:538] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:16.876250  3035 raft_consensus.cc:359] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:59:16.877272  3035 raft_consensus.cc:740] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Initialized, Role: LEARNER
I20260709 12:59:16.877988  3035 consensus_queue.cc:260] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:59:16.888919  3035 ts_tablet_manager.cc:1434] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:59:16.889010  3039 tablet_bootstrap.cc:492] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap starting.
I20260709 12:59:16.892239  1542 tablet_copy_service.cc:342] P e46412b3b0b44f01ad5c33d4cfe3d6b1: Request end of tablet copy session b96ce9cc496c49d7818fa983a17b062b-9b7b5b00d91c4b488d16174662489496 received from {username='slave'} at 127.0.0.1:49310
I20260709 12:59:16.892719  1542 tablet_copy_service.cc:434] P e46412b3b0b44f01ad5c33d4cfe3d6b1: ending tablet copy session b96ce9cc496c49d7818fa983a17b062b-9b7b5b00d91c4b488d16174662489496 on tablet 9b7b5b00d91c4b488d16174662489496 with peer b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:16.905236  3029 tablet_bootstrap.cc:492] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:16.906222  3029 tablet_bootstrap.cc:492] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b: Bootstrap complete.
I20260709 12:59:16.907087  3029 ts_tablet_manager.cc:1403] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b: Time spent bootstrapping tablet: real 0.053s	user 0.026s	sys 0.000s
I20260709 12:59:16.915433  3029 raft_consensus.cc:359] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:59:16.916340  3029 raft_consensus.cc:740] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Initialized, Role: LEARNER
I20260709 12:59:16.917028  3029 consensus_queue.cc:260] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:59:16.920987  3029 ts_tablet_manager.cc:1434] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:59:16.923782  3039 tablet_bootstrap.cc:492] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:16.926606  3039 tablet_bootstrap.cc:492] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap complete.
I20260709 12:59:16.927345  3039 ts_tablet_manager.cc:1403] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b: Time spent bootstrapping tablet: real 0.039s	user 0.023s	sys 0.009s
I20260709 12:59:16.930590  3039 raft_consensus.cc:359] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:59:16.931825  3039 raft_consensus.cc:740] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Initialized, Role: LEARNER
I20260709 12:59:16.932485  3039 consensus_queue.cc:260] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:59:16.935005  3039 ts_tablet_manager.cc:1434] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:59:16.936429  2224 raft_consensus.cc:1217] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:16.939287  1617 tablet_copy_service.cc:342] P 39a92f5a4352465d8af3af5908fe8642: Request end of tablet copy session b96ce9cc496c49d7818fa983a17b062b-cbe75e7a89594d3f81b1b8935b43b2ed received from {username='slave'} at 127.0.0.1:57268
I20260709 12:59:16.940343  1617 tablet_copy_service.cc:434] P 39a92f5a4352465d8af3af5908fe8642: ending tablet copy session b96ce9cc496c49d7818fa983a17b062b-cbe75e7a89594d3f81b1b8935b43b2ed on tablet cbe75e7a89594d3f81b1b8935b43b2ed with peer b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:16.942158  1616 tablet_copy_service.cc:342] P 39a92f5a4352465d8af3af5908fe8642: Request end of tablet copy session b96ce9cc496c49d7818fa983a17b062b-fb3a9a4620ef4fcd86eb78530746a583 received from {username='slave'} at 127.0.0.1:57268
I20260709 12:59:16.942561  1616 tablet_copy_service.cc:434] P 39a92f5a4352465d8af3af5908fe8642: ending tablet copy session b96ce9cc496c49d7818fa983a17b062b-fb3a9a4620ef4fcd86eb78530746a583 on tablet fb3a9a4620ef4fcd86eb78530746a583 with peer b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:17.048060  2224 raft_consensus.cc:1217] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:17.052058   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:17.103575  1605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9"
dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
mode: GRACEFUL
new_leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:48230
I20260709 12:59:17.104169  1605 raft_consensus.cc:606] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 3 LEADER]: Received request to transfer leadership to TS e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:17.106604  1528 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703"
dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
mode: GRACEFUL
new_leader_uuid: "ddf11fc190dd4b898773379c6b129d90"
 from {username='slave'} at 127.0.0.1:55626
I20260709 12:59:17.107200  1528 raft_consensus.cc:606] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Received request to transfer leadership to TS ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:17.111835  1605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50"
dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
mode: GRACEFUL
new_leader_uuid: "ddf11fc190dd4b898773379c6b129d90"
 from {username='slave'} at 127.0.0.1:48230
I20260709 12:59:17.112411  1605 raft_consensus.cc:606] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Received request to transfer leadership to TS ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:17.113469   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:59:17.114518   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:17.148897  2224 raft_consensus.cc:1217] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:17.175483  2915 raft_consensus.cc:993] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642: : Instructing follower ddf11fc190dd4b898773379c6b129d90 to start an election
I20260709 12:59:17.175913  2914 raft_consensus.cc:1081] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Signalling peer ddf11fc190dd4b898773379c6b129d90 to start an election
I20260709 12:59:17.177495  1680 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50"
dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
 from {username='slave'} at 127.0.0.1:49170
I20260709 12:59:17.178014  1680 raft_consensus.cc:493] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:17.178416  1680 raft_consensus.cc:3060] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:17.204797  1680 raft_consensus.cc:515] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:17.207020  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:17.207369  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:17.207590  1524 raft_consensus.cc:3060] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:17.207878  1680 leader_election.cc:290] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 2 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:17.210845  1605 raft_consensus.cc:3055] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:17.211231  1605 raft_consensus.cc:740] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:17.211856  1605 consensus_queue.cc:260] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:17.212836  1605 raft_consensus.cc:3060] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:17.219005  1524 raft_consensus.cc:2468] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 2.
I20260709 12:59:17.220407  1644 leader_election.cc:304] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:17.220587  1605 raft_consensus.cc:2468] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 2.
I20260709 12:59:17.221266  2968 raft_consensus.cc:2804] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:17.221755  2968 raft_consensus.cc:697] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 2 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:17.222563  2968 consensus_queue.cc:237] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:17.241243  2224 raft_consensus.cc:1217] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:17.246738  1429 catalog_manager.cc:5697] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 reported cstate change: term changed from 1 to 2, leader changed from 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:17.354576  2967 raft_consensus.cc:993] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1: : Instructing follower ddf11fc190dd4b898773379c6b129d90 to start an election
I20260709 12:59:17.355073  2880 raft_consensus.cc:1081] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Signalling peer ddf11fc190dd4b898773379c6b129d90 to start an election
I20260709 12:59:17.356684  1680 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703"
dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
 from {username='slave'} at 127.0.0.1:49178
I20260709 12:59:17.357237  1680 raft_consensus.cc:493] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:17.357594  1680 raft_consensus.cc:3060] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:17.369527  1680 raft_consensus.cc:515] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:17.371848  1680 leader_election.cc:290] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 2 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:17.372419  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:17.372284  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 12:59:17.372968  1524 raft_consensus.cc:3055] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:17.373049  2224 raft_consensus.cc:3060] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:17.373363  1524 raft_consensus.cc:740] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 12:59:17.374101  1524 consensus_queue.cc:260] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:17.375293  1524 raft_consensus.cc:3060] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:17.379978  2224 raft_consensus.cc:2468] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 2.
I20260709 12:59:17.381178  1646 leader_election.cc:304] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:17.381951  2811 raft_consensus.cc:2804] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:17.385368  2811 raft_consensus.cc:697] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 2 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:17.381799  1524 raft_consensus.cc:2468] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 2.
I20260709 12:59:17.386246  2811 consensus_queue.cc:237] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:17.790946  3050 raft_consensus.cc:1064] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642: attempting to promote NON_VOTER b96ce9cc496c49d7818fa983a17b062b to VOTER
I20260709 12:59:17.793422  3050 consensus_queue.cc:237] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:17.800202  2226 raft_consensus.cc:1275] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:17.801573  2914 consensus_queue.cc:1048] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:17.828372  3049 raft_consensus.cc:1064] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642: attempting to promote NON_VOTER b96ce9cc496c49d7818fa983a17b062b to VOTER
I20260709 12:59:17.831251  3049 consensus_queue.cc:237] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:17.889995  1430 catalog_manager.cc:5697] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 reported cstate change: term changed from 1 to 2, leader changed from e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:17.925058  1529 raft_consensus.cc:1275] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:17.938700  2917 raft_consensus.cc:993] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642: : Instructing follower e46412b3b0b44f01ad5c33d4cfe3d6b1 to start an election
I20260709 12:59:17.939288  3050 raft_consensus.cc:1081] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 3 LEADER]: Signalling peer e46412b3b0b44f01ad5c33d4cfe3d6b1 to start an election
W20260709 12:59:17.961869  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 106563us
I20260709 12:59:17.970373  2226 raft_consensus.cc:1275] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:17.971843  2914 consensus_queue.cc:1048] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:17.984179  1680 raft_consensus.cc:1275] T cbe75e7a89594d3f81b1b8935b43b2ed P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:17.996867  2967 raft_consensus.cc:1064] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1: attempting to promote NON_VOTER b96ce9cc496c49d7818fa983a17b062b to VOTER
I20260709 12:59:18.000257  2967 consensus_queue.cc:237] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:18.008234  1599 raft_consensus.cc:1275] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:18.016010  1673 raft_consensus.cc:1275] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:18.020066  2914 consensus_queue.cc:1048] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:18.027284  3054 consensus_queue.cc:1048] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:18.029419  1528 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9"
dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:43008
I20260709 12:59:18.030040  1528 raft_consensus.cc:493] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:18.030421  1528 raft_consensus.cc:3060] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:18.035331  3057 raft_consensus.cc:1064] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90: attempting to promote NON_VOTER b96ce9cc496c49d7818fa983a17b062b to VOTER
I20260709 12:59:18.038561  1528 raft_consensus.cc:515] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:18.040782  1528 leader_election.cc:290] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:18.043118  1526 raft_consensus.cc:1275] T fb3a9a4620ef4fcd86eb78530746a583 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:18.044163  1528 raft_consensus.cc:1240] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:18.045334  1526 raft_consensus.cc:1275] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:18.047863  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:18.048465  1602 raft_consensus.cc:3055] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:18.048769  1602 raft_consensus.cc:740] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:18.049491  1602 consensus_queue.cc:260] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:18.051775  1526 raft_consensus.cc:1275] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:18.050480  1602 raft_consensus.cc:3060] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:18.060245  2226 raft_consensus.cc:1275] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:18.062197  3054 consensus_queue.cc:1048] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:18.068771  3057 consensus_queue.cc:237] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:18.078063  1602 raft_consensus.cc:2468] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 4.
I20260709 12:59:18.080152  1497 leader_election.cc:304] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:18.080943  2880 raft_consensus.cc:2804] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:18.081377  2880 raft_consensus.cc:697] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 12:59:18.082077  2880 consensus_queue.cc:237] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:18.087379  3060 consensus_queue.cc:1048] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:18.088752  3062 consensus_queue.cc:1048] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:18.088311  3054 consensus_queue.cc:1048] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 12:59:18.094460  2968 consensus_queue.cc:1048] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:18.098938  2914 raft_consensus.cc:2955] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:18.115293  2226 raft_consensus.cc:2955] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:18.126049  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:18.126789  1680 raft_consensus.cc:3060] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:18.129503  1430 catalog_manager.cc:5697] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:18.134014  1680 raft_consensus.cc:2468] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 4.
I20260709 12:59:18.144991  1599 consensus_queue.cc:237] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:18.147114  2851 consensus_queue.cc:1048] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:18.151362  1524 raft_consensus.cc:2955] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:18.155025  2225 raft_consensus.cc:1275] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:18.162380  3049 consensus_queue.cc:1048] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:18.164363  2225 raft_consensus.cc:1275] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:18.172648  3050 raft_consensus.cc:2955] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:18.175419  1429 catalog_manager.cc:5697] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 3 to 4, leader changed from 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) to e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:18.185449  2225 raft_consensus.cc:2955] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:18.196672  1416 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet cbe75e7a89594d3f81b1b8935b43b2ed with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:18.205574  1429 catalog_manager.cc:5697] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: config changed from index 3 to 4, VOTER ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:18.205857  1602 raft_consensus.cc:1275] T 9b7b5b00d91c4b488d16174662489496 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:18.213080  1675 raft_consensus.cc:1275] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 12:59:18.216338  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 57092.7us
I20260709 12:59:18.217651  2917 raft_consensus.cc:2955] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:18.223335  1529 raft_consensus.cc:2955] T fb3a9a4620ef4fcd86eb78530746a583 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:18.233778  1524 raft_consensus.cc:1275] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:18.233354  2227 raft_consensus.cc:2955] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:18.236743  3065 consensus_queue.cc:1048] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:18.258844  2223 raft_consensus.cc:1275] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 1 LEARNER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:18.262199  3062 consensus_queue.cc:1048] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:18.263474  2917 consensus_queue.cc:1048] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:18.274005  1602 raft_consensus.cc:1275] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:18.282066  3065 consensus_queue.cc:1048] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:18.286033  1528 raft_consensus.cc:1275] T e0590ffd096d4e378ab66c1795ff5cce P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 12:59:18.324607  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 47901.9us
I20260709 12:59:18.344174  2967 consensus_queue.cc:1048] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:18.328895  1430 catalog_manager.cc:5697] T fb3a9a4620ef4fcd86eb78530746a583 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:18.342900  1664 tablet_service.cc:1558] Processing DeleteTablet for tablet cbe75e7a89594d3f81b1b8935b43b2ed with delete_type TABLET_DATA_TOMBSTONED (TS ddf11fc190dd4b898773379c6b129d90 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49162
I20260709 12:59:18.351945  3061 consensus_queue.cc:1048] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:18.356626  2968 consensus_queue.cc:1048] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:18.419938  3089 tablet_replica.cc:333] T cbe75e7a89594d3f81b1b8935b43b2ed P ddf11fc190dd4b898773379c6b129d90: stopping tablet replica
I20260709 12:59:18.421016  3089 raft_consensus.cc:2243] T cbe75e7a89594d3f81b1b8935b43b2ed P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:18.421730  3089 pending_rounds.cc:70] T cbe75e7a89594d3f81b1b8935b43b2ed P ddf11fc190dd4b898773379c6b129d90: Trying to abort 1 pending ops.
I20260709 12:59:18.422106  3089 pending_rounds.cc:77] T cbe75e7a89594d3f81b1b8935b43b2ed P ddf11fc190dd4b898773379c6b129d90: Aborting op as it isn't in flight: id { term: 1 index: 3 } timestamp: 7305633619116658688 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" old_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } } new_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } } }
I20260709 12:59:18.424772  3089 raft_consensus.cc:2917] T cbe75e7a89594d3f81b1b8935b43b2ed P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted
I20260709 12:59:18.425644  3089 raft_consensus.cc:2889] T cbe75e7a89594d3f81b1b8935b43b2ed P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 12:59:18.427317  3089 raft_consensus.cc:2272] T cbe75e7a89594d3f81b1b8935b43b2ed P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:18.433198  3089 ts_tablet_manager.cc:1916] T cbe75e7a89594d3f81b1b8935b43b2ed P ddf11fc190dd4b898773379c6b129d90: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:18.317500  1529 raft_consensus.cc:2955] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:18.446563  3061 raft_consensus.cc:2955] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:18.452816  1600 raft_consensus.cc:2955] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:18.462137  3089 ts_tablet_manager.cc:1929] T cbe75e7a89594d3f81b1b8935b43b2ed P ddf11fc190dd4b898773379c6b129d90: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:18.475648  3089 log.cc:1199] T cbe75e7a89594d3f81b1b8935b43b2ed P ddf11fc190dd4b898773379c6b129d90: Deleting WAL directory at /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601891739070-431-0/minicluster-data/ts-2-root/wals/cbe75e7a89594d3f81b1b8935b43b2ed
I20260709 12:59:18.479409  1528 raft_consensus.cc:2955] T e0590ffd096d4e378ab66c1795ff5cce P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:18.481406  1426 catalog_manager.cc:5697] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:18.488472  1415 catalog_manager.cc:5028] TS ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217): tablet cbe75e7a89594d3f81b1b8935b43b2ed (table test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]) successfully deleted
I20260709 12:59:18.493157  2880 raft_consensus.cc:2955] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:18.504467  2225 raft_consensus.cc:2955] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:18.511720  1430 catalog_manager.cc:5697] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:18.513082   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:18.515525  1679 raft_consensus.cc:2955] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:18.519930  1673 raft_consensus.cc:2955] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:18.508365  1602 raft_consensus.cc:2955] T 9b7b5b00d91c4b488d16174662489496 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:18.532096  2223 raft_consensus.cc:2955] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:18.543128  1526 consensus_queue.cc:237] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:18.551405  1600 consensus_queue.cc:237] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:18.553237  1681 raft_consensus.cc:1275] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:18.556367  2880 consensus_queue.cc:1048] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:18.564641  2226 raft_consensus.cc:1275] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:18.566123  2967 consensus_queue.cc:1048] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:18.568274  2225 raft_consensus.cc:1275] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:18.571990  3050 consensus_queue.cc:1048] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:18.582557  3011 raft_consensus.cc:2955] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:18.596294  1414 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9b7b5b00d91c4b488d16174662489496 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:18.600538  1600 raft_consensus.cc:1275] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:59:18.603233  2917 raft_consensus.cc:2955] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:18.606015  2967 consensus_queue.cc:1048] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:18.605526  2225 raft_consensus.cc:2955] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:18.612166  2226 raft_consensus.cc:2955] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:18.616169  1416 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet fb3a9a4620ef4fcd86eb78530746a583 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:18.658934  1681 consensus_queue.cc:237] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:18.659359  1680 raft_consensus.cc:1275] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:59:18.660605  1679 raft_consensus.cc:1275] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:18.664156  2917 consensus_queue.cc:1048] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:18.665369  1429 catalog_manager.cc:5697] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: config changed from index 3 to 4, VOTER 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
W20260709 12:59:18.666051  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 112751us
I20260709 12:59:18.667418  2967 consensus_queue.cc:1048] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:18.673456  1673 raft_consensus.cc:2955] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:18.677213  1430 catalog_manager.cc:5697] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: config changed from index 3 to 4, VOTER e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:18.678808  1680 raft_consensus.cc:2955] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:18.692701  1600 raft_consensus.cc:1275] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:18.695502  2223 raft_consensus.cc:1275] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:18.700820  3097 consensus_queue.cc:1048] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:18.707782  3098 consensus_queue.cc:1048] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:18.714623  1517 tablet_service.cc:1558] Processing DeleteTablet for tablet fb3a9a4620ef4fcd86eb78530746a583 with delete_type TABLET_DATA_TOMBSTONED (TS e46412b3b0b44f01ad5c33d4cfe3d6b1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43004
I20260709 12:59:18.727156  2851 raft_consensus.cc:2955] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:18.730453  1594 tablet_service.cc:1558] Processing DeleteTablet for tablet 9b7b5b00d91c4b488d16174662489496 with delete_type TABLET_DATA_TOMBSTONED (TS 39a92f5a4352465d8af3af5908fe8642 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36192
I20260709 12:59:18.735989  2223 raft_consensus.cc:2955] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
W20260709 12:59:18.741465  2248 debug-util.cc:398] Leaking SignalData structure 0x7b0800301060 after lost signal to thread 434
W20260709 12:59:18.742543  2248 debug-util.cc:398] Leaking SignalData structure 0x7b0800301740 after lost signal to thread 1464
W20260709 12:59:18.743683  2248 debug-util.cc:398] Leaking SignalData structure 0x7b08001b1f40 after lost signal to thread 1556
W20260709 12:59:18.744827  2248 debug-util.cc:398] Leaking SignalData structure 0x7b0800357460 after lost signal to thread 1631
W20260709 12:59:18.746016  2248 debug-util.cc:398] Leaking SignalData structure 0x7b08000ad3c0 after lost signal to thread 1705
I20260709 12:59:18.760679  1602 raft_consensus.cc:2955] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:18.764676  1415 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e0590ffd096d4e378ab66c1795ff5cce with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 12:59:18.758711  2248 debug-util.cc:398] Leaking SignalData structure 0x7b080024d140 after lost signal to thread 2251
I20260709 12:59:18.797372  3103 tablet_replica.cc:333] T 9b7b5b00d91c4b488d16174662489496 P 39a92f5a4352465d8af3af5908fe8642: stopping tablet replica
I20260709 12:59:18.798548  3103 raft_consensus.cc:2243] T 9b7b5b00d91c4b488d16174662489496 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:18.798346  1428 catalog_manager.cc:5697] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b reported cstate change: config changed from index 3 to 4, VOTER e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:18.799510  3103 raft_consensus.cc:2272] T 9b7b5b00d91c4b488d16174662489496 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:18.802968  3102 tablet_replica.cc:333] T fb3a9a4620ef4fcd86eb78530746a583 P e46412b3b0b44f01ad5c33d4cfe3d6b1: stopping tablet replica
I20260709 12:59:18.804061  3102 raft_consensus.cc:2243] T fb3a9a4620ef4fcd86eb78530746a583 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:18.807510  3103 ts_tablet_manager.cc:1916] T 9b7b5b00d91c4b488d16174662489496 P 39a92f5a4352465d8af3af5908fe8642: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:18.812793  3102 raft_consensus.cc:2272] T fb3a9a4620ef4fcd86eb78530746a583 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:18.814442  1517 tablet_service.cc:1558] Processing DeleteTablet for tablet e0590ffd096d4e378ab66c1795ff5cce with delete_type TABLET_DATA_TOMBSTONED (TS e46412b3b0b44f01ad5c33d4cfe3d6b1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43004
I20260709 12:59:18.816900  3102 ts_tablet_manager.cc:1916] T fb3a9a4620ef4fcd86eb78530746a583 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:18.841485  3103 ts_tablet_manager.cc:1929] T 9b7b5b00d91c4b488d16174662489496 P 39a92f5a4352465d8af3af5908fe8642: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:18.842074  3103 log.cc:1199] T 9b7b5b00d91c4b488d16174662489496 P 39a92f5a4352465d8af3af5908fe8642: Deleting WAL directory at /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601891739070-431-0/minicluster-data/ts-1-root/wals/9b7b5b00d91c4b488d16174662489496
I20260709 12:59:18.844465  1416 catalog_manager.cc:5028] TS 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): tablet 9b7b5b00d91c4b488d16174662489496 (table test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]) successfully deleted
I20260709 12:59:18.846699  3102 ts_tablet_manager.cc:1929] T fb3a9a4620ef4fcd86eb78530746a583 P e46412b3b0b44f01ad5c33d4cfe3d6b1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:18.847090  3102 log.cc:1199] T fb3a9a4620ef4fcd86eb78530746a583 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Deleting WAL directory at /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601891739070-431-0/minicluster-data/ts-0-root/wals/fb3a9a4620ef4fcd86eb78530746a583
I20260709 12:59:18.848419  1414 catalog_manager.cc:5028] TS e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): tablet fb3a9a4620ef4fcd86eb78530746a583 (table test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]) successfully deleted
I20260709 12:59:18.848588  3102 tablet_replica.cc:333] T e0590ffd096d4e378ab66c1795ff5cce P e46412b3b0b44f01ad5c33d4cfe3d6b1: stopping tablet replica
I20260709 12:59:18.849421  3102 raft_consensus.cc:2243] T e0590ffd096d4e378ab66c1795ff5cce P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:18.849995  3102 raft_consensus.cc:2272] T e0590ffd096d4e378ab66c1795ff5cce P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:18.852660  3102 ts_tablet_manager.cc:1916] T e0590ffd096d4e378ab66c1795ff5cce P e46412b3b0b44f01ad5c33d4cfe3d6b1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:18.869800  3102 ts_tablet_manager.cc:1929] T e0590ffd096d4e378ab66c1795ff5cce P e46412b3b0b44f01ad5c33d4cfe3d6b1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:18.870198  3102 log.cc:1199] T e0590ffd096d4e378ab66c1795ff5cce P e46412b3b0b44f01ad5c33d4cfe3d6b1: Deleting WAL directory at /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601891739070-431-0/minicluster-data/ts-0-root/wals/e0590ffd096d4e378ab66c1795ff5cce
I20260709 12:59:18.871863  1414 catalog_manager.cc:5028] TS e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): tablet e0590ffd096d4e378ab66c1795ff5cce (table test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]) successfully deleted
I20260709 12:59:19.055751   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:19.097270  1680 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061"
dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
mode: GRACEFUL
new_leader_uuid: "39a92f5a4352465d8af3af5908fe8642"
 from {username='slave'} at 127.0.0.1:33616
I20260709 12:59:19.097965  1680 raft_consensus.cc:606] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Received request to transfer leadership to TS 39a92f5a4352465d8af3af5908fe8642
I20260709 12:59:19.100725  1680 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf"
dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
mode: GRACEFUL
new_leader_uuid: "b96ce9cc496c49d7818fa983a17b062b"
 from {username='slave'} at 127.0.0.1:33616
I20260709 12:59:19.101209  1680 raft_consensus.cc:606] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 3 LEADER]: Received request to transfer leadership to TS b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:19.103397  1528 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02"
dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
mode: GRACEFUL
new_leader_uuid: "ddf11fc190dd4b898773379c6b129d90"
 from {username='slave'} at 127.0.0.1:55626
I20260709 12:59:19.103940  1528 raft_consensus.cc:606] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Received request to transfer leadership to TS ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:19.105027   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:59:19.106609   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:19.285983  3099 raft_consensus.cc:993] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90: : Instructing follower 39a92f5a4352465d8af3af5908fe8642 to start an election
I20260709 12:59:19.286427  3098 raft_consensus.cc:1081] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Signalling peer 39a92f5a4352465d8af3af5908fe8642 to start an election
I20260709 12:59:19.287971  1602 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061"
dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
 from {username='slave'} at 127.0.0.1:36200
I20260709 12:59:19.288504  1602 raft_consensus.cc:493] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:19.288875  1602 raft_consensus.cc:3060] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:19.306372  1602 raft_consensus.cc:515] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:19.308732  1602 leader_election.cc:290] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:19.308944  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:19.309612  1681 raft_consensus.cc:3055] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:19.309913  1681 raft_consensus.cc:740] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:19.310608  1681 consensus_queue.cc:260] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:19.311786  1681 raft_consensus.cc:3060] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:19.324234  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:19.324847  1528 raft_consensus.cc:3060] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:19.325367  1681 raft_consensus.cc:2468] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 2.
I20260709 12:59:19.326540  1571 leader_election.cc:304] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:19.327313  3050 raft_consensus.cc:2804] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:19.328001  3050 raft_consensus.cc:697] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 2 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:19.328895  3050 consensus_queue.cc:237] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:19.338454  1528 raft_consensus.cc:2468] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 2.
I20260709 12:59:19.347787  1425 catalog_manager.cc:5697] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 1 to 2, leader changed from ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) to 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:19.420995  3065 raft_consensus.cc:993] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1: : Instructing follower ddf11fc190dd4b898773379c6b129d90 to start an election
I20260709 12:59:19.421505  3065 raft_consensus.cc:1081] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Signalling peer ddf11fc190dd4b898773379c6b129d90 to start an election
I20260709 12:59:19.425130  1681 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02"
dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
 from {username='slave'} at 127.0.0.1:49178
I20260709 12:59:19.425704  1681 raft_consensus.cc:493] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:19.426055  1681 raft_consensus.cc:3060] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:19.434135  1681 raft_consensus.cc:515] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:19.439476  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 12:59:19.440155  2223 raft_consensus.cc:3060] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:19.474318  1681 leader_election.cc:290] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 2 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:19.475752  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:19.476405  1528 raft_consensus.cc:3055] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:19.479125  1528 raft_consensus.cc:740] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 12:59:19.479934  1528 consensus_queue.cc:260] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:19.480973  1528 raft_consensus.cc:3060] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:19.494789  1528 raft_consensus.cc:2468] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 2.
I20260709 12:59:20.109813   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:20.455315  3109 raft_consensus.cc:493] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:20.456020  3109 raft_consensus.cc:515] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:20.458284  3109 leader_election.cc:290] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:20.584897  3109 raft_consensus.cc:493] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:20.483035  3110 raft_consensus.cc:493] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:20.586170  3110 raft_consensus.cc:515] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:20.588541  3110 leader_election.cc:290] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 12:59:20.491151  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:20.494064  1461 debug-util.cc:398] Leaking SignalData structure 0x7b0800190e40 after lost signal to thread 434
W20260709 12:59:20.590698  1461 debug-util.cc:398] Leaking SignalData structure 0x7b08001eeb60 after lost signal to thread 1464
I20260709 12:59:20.599403  3065 raft_consensus.cc:493] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:20.600018  3065 raft_consensus.cc:515] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:20.602250  3065 leader_election.cc:290] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:20.623752  3096 raft_consensus.cc:493] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 12:59:20.624349  3096 raft_consensus.cc:515] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:20.629192  3116 raft_consensus.cc:493] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:20.585620  3109 raft_consensus.cc:515] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:20.672824  3116 raft_consensus.cc:515] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:20.674571  3109 leader_election.cc:290] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:20.675277  3116 leader_election.cc:290] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:20.658928  3113 raft_consensus.cc:493] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:20.664660  3112 raft_consensus.cc:493] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 12:59:20.694193  3115 raft_consensus.cc:493] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 12:59:20.657400  3114 raft_consensus.cc:493] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:20.704880  3119 raft_consensus.cc:493] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:20.705500  3120 raft_consensus.cc:493] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 12:59:20.675305  3109 raft_consensus.cc:493] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:20.715837  3122 raft_consensus.cc:493] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:20.716590  3110 raft_consensus.cc:493] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:20.730537  3111 raft_consensus.cc:493] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:20.682485  3108 raft_consensus.cc:493] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:20.765338  3109 raft_consensus.cc:515] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:20.765579  3108 raft_consensus.cc:515] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:20.767465  3109 leader_election.cc:290] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:20.768137  3110 raft_consensus.cc:515] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:20.770157  3108 leader_election.cc:290] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:20.741407  3049 raft_consensus.cc:493] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:20.742498  3099 raft_consensus.cc:493] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:20.753139  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:20.754129  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:20.742946  3066 raft_consensus.cc:493] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:20.770362  3119 raft_consensus.cc:515] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:20.771059  3114 raft_consensus.cc:515] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:20.764868  3120 raft_consensus.cc:515] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:20.772516  3122 raft_consensus.cc:515] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 12:59:20.732633  1570 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.941s	user 0.012s	sys 0.010s
I20260709 12:59:20.775200  1679 raft_consensus.cc:2468] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 1.
W20260709 12:59:20.787909  1570 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.996s	user 0.013s	sys 0.010s
I20260709 12:59:20.753266  3098 raft_consensus.cc:493] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:20.755946  3116 raft_consensus.cc:493] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 12:59:20.756845  3096 leader_election.cc:290] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:20.793463  2967 raft_consensus.cc:493] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:20.777048  3111 raft_consensus.cc:515] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:20.797127  3111 leader_election.cc:290] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:20.794145  2967 raft_consensus.cc:515] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:20.799155  2967 leader_election.cc:290] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:20.799669  2967 raft_consensus.cc:493] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:20.800173  2967 raft_consensus.cc:515] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:20.801973  2967 leader_election.cc:290] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:19.475991  2223 raft_consensus.cc:2468] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 2.
I20260709 12:59:20.804790  2223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50326 (request call id 434) took 1365 ms. Trace:
I20260709 12:59:20.805176  2223 rpcz_store.cc:276] 0709 12:59:19.438998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:19.439214 (+   216us) service_pool.cc:224] Handling call
0709 12:59:20.804692 (+1365478us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:20.799580  3117 raft_consensus.cc:493] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:20.808478  3117 raft_consensus.cc:515] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:20.812039  3117 leader_election.cc:290] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:20.812749  3116 raft_consensus.cc:515] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:20.815042  3116 leader_election.cc:290] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:20.818321  3116 raft_consensus.cc:493] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:20.770166  3110 leader_election.cc:290] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:20.762985  3065 raft_consensus.cc:493] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:20.776965  3099 raft_consensus.cc:515] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:20.864365  2967 raft_consensus.cc:493] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:20.864898  2967 raft_consensus.cc:515] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:20.855314  3109 raft_consensus.cc:493] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:20.883087  1680 raft_consensus.cc:2468] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 4.
I20260709 12:59:20.884021  3109 raft_consensus.cc:515] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:20.886317  3109 leader_election.cc:290] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:20.777685  3049 raft_consensus.cc:515] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:20.888641  2967 leader_election.cc:290] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:20.866405  3110 raft_consensus.cc:493] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:20.861370  3098 raft_consensus.cc:515] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:20.756641  3113 raft_consensus.cc:515] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:20.862552  3116 raft_consensus.cc:515] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:20.887871  2917 raft_consensus.cc:493] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 12:59:20.903481  2967 raft_consensus.cc:493] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:20.904649  2967 raft_consensus.cc:515] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:20.762701  3115 raft_consensus.cc:515] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:20.892031  3096 raft_consensus.cc:493] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:20.909340  2917 raft_consensus.cc:515] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:20.871338  3065 raft_consensus.cc:515] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:20.914671  3131 raft_consensus.cc:493] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 12:59:20.915303  3118 raft_consensus.cc:493] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:20.915802  3123 raft_consensus.cc:493] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
W20260709 12:59:20.918928  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 117997us
I20260709 12:59:20.919296  2967 leader_election.cc:290] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:20.921538  2917 leader_election.cc:290] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:20.757966  3112 raft_consensus.cc:515] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:20.924181  3112 leader_election.cc:290] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:20.924681  2967 raft_consensus.cc:493] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:20.925266  2967 raft_consensus.cc:515] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:20.854900  3066 raft_consensus.cc:515] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:20.931284  3066 leader_election.cc:290] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:20.933992  2967 leader_election.cc:290] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:20.912333  3108 raft_consensus.cc:493] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:20.939972  2917 raft_consensus.cc:493] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:20.903659  3110 raft_consensus.cc:515] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:20.941969  2917 raft_consensus.cc:515] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:20.953095  3125 raft_consensus.cc:493] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:20.953692  3125 raft_consensus.cc:515] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:20.957018  1496 leader_election.cc:304] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:20.957901  2967 raft_consensus.cc:2804] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:20.958280  2967 raft_consensus.cc:493] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:20.940068  3066 raft_consensus.cc:493] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:20.958613  2967 raft_consensus.cc:3060] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:20.961220  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:20.948423  3117 raft_consensus.cc:493] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:20.959975  2917 leader_election.cc:290] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:20.961802  1526 raft_consensus.cc:2468] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 2.
I20260709 12:59:20.925369  3096 raft_consensus.cc:515] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:20.966696  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:20.967250  2190 leader_election.cc:304] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:20.974320  2917 raft_consensus.cc:493] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:20.974956  2917 raft_consensus.cc:515] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:20.978231  3050 raft_consensus.cc:493] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:20.978760  3050 raft_consensus.cc:515] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:20.982460  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:20.995326  3050 leader_election.cc:290] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 12:59:21.000468  1461 debug-util.cc:398] Leaking SignalData structure 0x7b08002663c0 after lost signal to thread 1556
I20260709 12:59:21.007951  3109 raft_consensus.cc:493] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:21.008595  3109 raft_consensus.cc:515] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:21.010843  3109 leader_election.cc:290] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:21.012450  3143 raft_consensus.cc:493] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:20.960510  3138 raft_consensus.cc:493] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 12:59:20.960500  3134 raft_consensus.cc:493] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:20.939688  3123 raft_consensus.cc:515] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:20.937417  3131 raft_consensus.cc:515] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:20.952329  3108 raft_consensus.cc:515] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:20.965372  3117 raft_consensus.cc:515] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:21.036769  2967 raft_consensus.cc:515] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:20.940528  3118 raft_consensus.cc:515] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:21.041167  3108 leader_election.cc:290] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:21.025910  3119 leader_election.cc:290] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:21.041791  3122 leader_election.cc:290] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:21.042100  3098 leader_election.cc:290] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:21.042246  3049 leader_election.cc:290] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:21.042729  3125 leader_election.cc:290] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:21.042876  3136 raft_consensus.cc:493] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:21.038488  3138 raft_consensus.cc:515] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:21.043257  3125 raft_consensus.cc:493] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 12:59:21.031970  3109 raft_consensus.cc:493] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:21.045192  3099 leader_election.cc:290] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:21.038617  3134 raft_consensus.cc:515] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:21.054970  3134 leader_election.cc:290] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:21.033474  3127 raft_consensus.cc:493] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:21.061985  3146 raft_consensus.cc:493] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 12:59:21.062750  3124 raft_consensus.cc:493] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:21.063288  3129 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 12:59:21.020606  3066 raft_consensus.cc:515] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:21.037343  3141 raft_consensus.cc:493] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 12:59:21.043371  3120 leader_election.cc:290] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:21.045389  3109 raft_consensus.cc:515] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:21.061045  3098 raft_consensus.cc:493] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:21.061483  3108 raft_consensus.cc:493] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:21.077205  3114 leader_election.cc:290] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:21.077535  3116 leader_election.cc:290] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 12:59:21.091280  1461 debug-util.cc:398] Leaking SignalData structure 0x7b08001b8660 after lost signal to thread 1631
I20260709 12:59:21.103048  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:21.045006  3136 raft_consensus.cc:515] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:21.076982  3065 leader_election.cc:290] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:21.039427  3143 raft_consensus.cc:515] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:21.076632  3137 raft_consensus.cc:493] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:21.055760  3125 raft_consensus.cc:515] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:21.103749  1674 raft_consensus.cc:2468] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 1.
I20260709 12:59:21.092697  3117 leader_election.cc:290] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:21.090054  3147 raft_consensus.cc:493] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:21.118283  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:21.118773  3131 leader_election.cc:290] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:21.098033  3108 raft_consensus.cc:515] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:21.117076  3152 raft_consensus.cc:493] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:21.094681  3098 raft_consensus.cc:515] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:21.118693  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:21.115353  3115 leader_election.cc:290] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:21.156103  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:21.120923  3113 leader_election.cc:290] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:21.127672  3110 leader_election.cc:290] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:21.127507  3049 raft_consensus.cc:493] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:21.128347  3122 raft_consensus.cc:493] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 12:59:21.193614  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:21.194393  1674 raft_consensus.cc:2468] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 1.
W20260709 12:59:21.132543  1461 debug-util.cc:398] Leaking SignalData structure 0x7b08003489a0 after lost signal to thread 1705
I20260709 12:59:21.091630  3146 raft_consensus.cc:515] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:21.199769  3063 raft_consensus.cc:493] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:21.093011  3129 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:21.200069  3110 raft_consensus.cc:493] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:21.192804  3138 leader_election.cc:290] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:21.154218  3142 raft_consensus.cc:493] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 12:59:21.203058  3135 raft_consensus.cc:493] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 12:59:21.154881  3109 leader_election.cc:290] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:21.095208  3141 raft_consensus.cc:515] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:21.192721  3049 raft_consensus.cc:515] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:21.203903  3128 raft_consensus.cc:493] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:21.160492  3145 raft_consensus.cc:2804] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:21.155050  3096 leader_election.cc:290] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:21.191573  3126 raft_consensus.cc:493] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:21.160856  3132 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 12:59:21.197362  3116 raft_consensus.cc:493] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:21.189692  3123 leader_election.cc:290] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:21.196112  3113 raft_consensus.cc:493] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:21.224867  3135 raft_consensus.cc:515] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:21.227497  3113 raft_consensus.cc:515] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:21.228902  3135 leader_election.cc:290] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:21.205928  3110 raft_consensus.cc:515] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:21.209044  3108 leader_election.cc:290] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:21.080955  3127 raft_consensus.cc:515] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:21.212659  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:21.213145  2917 leader_election.cc:290] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:21.091470  3124 raft_consensus.cc:515] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:21.160720  3148 raft_consensus.cc:493] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:21.200919  3122 raft_consensus.cc:515] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:21.223786  3143 leader_election.cc:290] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:21.161001  3152 raft_consensus.cc:515] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:21.130234  3147 raft_consensus.cc:515] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:21.125357  3137 raft_consensus.cc:515] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:21.224148  3049 leader_election.cc:290] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:21.216547  3118 leader_election.cc:290] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:21.220929  3128 raft_consensus.cc:515] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:21.207141  3063 raft_consensus.cc:515] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:21.229460  3113 leader_election.cc:290] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:21.331212  3129 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 12:59:21.335203  1461 debug-util.cc:398] Leaking SignalData structure 0x7b080034fc20 after lost signal to thread 2251
W20260709 12:59:21.335647  1461 debug-util.cc:398] Leaking SignalData structure 0x7b0800360be0 after lost signal to thread 2851
I20260709 12:59:21.308852  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:21.310894  2967 leader_election.cc:290] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 2 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:21.315059  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:21.340431  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:21.341069  1526 raft_consensus.cc:2468] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 1.
I20260709 12:59:21.336640  1528 raft_consensus.cc:2468] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 2.
I20260709 12:59:21.331915  3136 leader_election.cc:290] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:21.343466  3137 leader_election.cc:290] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:21.341960  3135 raft_consensus.cc:493] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:21.310698  2191 leader_election.cc:304] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:21.279129  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:21.345677  1680 raft_consensus.cc:2468] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 1.
I20260709 12:59:21.345716  2191 leader_election.cc:304] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:21.349525  3120 raft_consensus.cc:2804] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:21.349957  3120 raft_consensus.cc:493] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 12:59:21.350307  3120 raft_consensus.cc:3060] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:21.352128  2191 leader_election.cc:304] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:21.223253  3066 leader_election.cc:290] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:21.226111  3145 raft_consensus.cc:493] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:21.356895  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:21.359200  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:21.315827  3146 leader_election.cc:290] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:21.340782  3141 leader_election.cc:290] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:21.344082  3135 raft_consensus.cc:515] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:21.360373  3110 leader_election.cc:290] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:21.369763  3135 leader_election.cc:290] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:21.279806  3098 leader_election.cc:290] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:21.362511  2190 leader_election.cc:304] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:21.352921  3148 raft_consensus.cc:515] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:21.367980  3144 raft_consensus.cc:2804] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:21.372588  3152 leader_election.cc:290] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:21.354844  3113 raft_consensus.cc:2749] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:21.229576  3116 raft_consensus.cc:515] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:21.374447  2190 leader_election.cc:304] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:21.377790  3147 leader_election.cc:290] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:21.378235  3063 leader_election.cc:290] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:21.387836  3063 raft_consensus.cc:493] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:21.388319  3063 raft_consensus.cc:515] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 12:59:21.383198  1573 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.008s	sys 0.030s
W20260709 12:59:21.392756  1573 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.008s	sys 0.031s
I20260709 12:59:21.393299  3063 leader_election.cc:290] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:21.367975  2191 leader_election.cc:304] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:21.385380  3151 raft_consensus.cc:493] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:21.386277  3141 raft_consensus.cc:493] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 12:59:21.386526  3153 raft_consensus.cc:493] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 12:59:21.397245  3108 raft_consensus.cc:493] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:21.398125  3141 raft_consensus.cc:515] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:21.398983  3144 raft_consensus.cc:493] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:21.399457  3144 raft_consensus.cc:3060] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:21.386921  3164 raft_consensus.cc:493] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:21.390377  3158 raft_consensus.cc:493] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 12:59:21.390847  3134 raft_consensus.cc:493] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 12:59:21.379313  3149 raft_consensus.cc:493] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:21.391310  3155 raft_consensus.cc:493] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 12:59:21.396710  3063 raft_consensus.cc:2804] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:21.402268  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:21.403463  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:21.364043  3145 raft_consensus.cc:3060] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:21.406862  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:21.420895  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:21.421463  1600 raft_consensus.cc:2468] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 2.
I20260709 12:59:21.421756  3154 raft_consensus.cc:493] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:21.408465  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:21.422506  3128 leader_election.cc:290] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:21.423062  3128 raft_consensus.cc:2804] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:21.423377  3128 raft_consensus.cc:493] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:21.423461  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:21.408692  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:21.408972  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:21.423781  3128 raft_consensus.cc:3060] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:21.424211  1528 raft_consensus.cc:2468] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 2.
I20260709 12:59:21.424592  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:21.425614  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:21.421747  3157 raft_consensus.cc:493] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:21.409767  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:21.398252  3153 raft_consensus.cc:515] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:21.410705  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:21.411309  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:21.411341  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:21.412045  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:21.413269  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:21.397743  3146 raft_consensus.cc:493] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 12:59:21.414463  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:21.375790  3135 raft_consensus.cc:2804] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:21.398527  3108 raft_consensus.cc:515] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:21.407845  3156 raft_consensus.cc:493] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:21.459935  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:21.430163  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:21.430586  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:21.460829  1607 raft_consensus.cc:2468] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 2.
I20260709 12:59:21.446596  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:21.466130  2223 raft_consensus.cc:2468] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 1.
I20260709 12:59:21.404920  3125 leader_election.cc:290] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:21.426518  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:21.454329  1677 raft_consensus.cc:2468] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 1.
I20260709 12:59:21.429322  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:21.468556  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:21.455586  1680 raft_consensus.cc:2468] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 3.
I20260709 12:59:21.415978  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:21.469848  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:21.475606  2224 raft_consensus.cc:2468] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 1.
W20260709 12:59:21.476205  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 50977.8us
I20260709 12:59:21.416283  3063 raft_consensus.cc:493] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:21.479509  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:21.479821  3063 raft_consensus.cc:3060] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:21.430975  3141 leader_election.cc:290] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:21.489977  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:21.491868   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:21.429728  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:21.415362  3134 raft_consensus.cc:515] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:21.475111  3130 raft_consensus.cc:493] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:21.429886  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:21.429325  3116 leader_election.cc:290] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:21.475589  3146 raft_consensus.cc:515] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:21.458022  3135 raft_consensus.cc:493] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:21.397272  3151 raft_consensus.cc:515] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:21.539388  3108 leader_election.cc:290] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:21.245100  3142 raft_consensus.cc:515] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:21.256790  3132 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:21.430379  3155 raft_consensus.cc:515] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:21.505061  3113 raft_consensus.cc:493] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 12:59:21.511726  3122 leader_election.cc:290] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:21.457806  3149 raft_consensus.cc:515] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:21.229490  3126 raft_consensus.cc:515] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:21.426456  3157 raft_consensus.cc:515] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:21.420020  3158 raft_consensus.cc:515] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:21.416356  3164 raft_consensus.cc:515] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:21.545822  2223 raft_consensus.cc:2468] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 2.
I20260709 12:59:21.546202  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 12:59:21.549239  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 174876us
I20260709 12:59:21.540764  3135 raft_consensus.cc:3060] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:21.477200  1646 leader_election.cc:304] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:21.557427  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:21.558640  3127 leader_election.cc:290] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:21.422353  3154 raft_consensus.cc:515] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 12:59:21.556214  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 79102.5us
I20260709 12:59:21.562038  2227 raft_consensus.cc:2468] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 3.
I20260709 12:59:21.557502  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:21.561408  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:21.562033  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:21.577096  2223 raft_consensus.cc:2468] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 1.
I20260709 12:59:21.590197  1646 leader_election.cc:304] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:21.549280  3113 raft_consensus.cc:515] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:21.561400  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:21.495400  3156 raft_consensus.cc:515] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:21.562299  3127 raft_consensus.cc:493] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:21.580503  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:21.603753  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:21.576059  3124 leader_election.cc:290] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:21.566944  3121 raft_consensus.cc:2804] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:21.609367  1572 leader_election.cc:304] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 12:59:21.618515  1528 consensus_queue.cc:237] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:59:21.596310  3147 raft_consensus.cc:2804] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:21.619678  2967 raft_consensus.cc:493] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:21.622766  3118 raft_consensus.cc:493] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:21.629235  2967 raft_consensus.cc:515] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:21.634312  3118 raft_consensus.cc:515] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:21.588584  3120 raft_consensus.cc:515] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:21.637379  1572 leader_election.cc:304] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 12:59:21.638863  3110 raft_consensus.cc:493] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:21.549448  3130 raft_consensus.cc:515] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:21.623207  3134 leader_election.cc:290] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:21.610284  3161 raft_consensus.cc:493] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:21.629642  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:21.654713  2967 leader_election.cc:290] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:21.654912  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:21.629031  3147 raft_consensus.cc:493] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:21.656327  1644 leader_election.cc:304] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:21.645421  1600 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5"
dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
mode: GRACEFUL
new_leader_uuid: "b96ce9cc496c49d7818fa983a17b062b"
 from {username='slave'} at 127.0.0.1:48230
I20260709 12:59:21.661139  3141 raft_consensus.cc:2804] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:21.655953  1572 leader_election.cc:304] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 12:59:21.620332  3127 raft_consensus.cc:515] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:21.665135  1600 raft_consensus.cc:606] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 2 LEADER]: Received request to transfer leadership to TS b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:21.665917  1572 leader_election.cc:304] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 12:59:21.666047  1679 raft_consensus.cc:2468] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 2.
I20260709 12:59:21.642513  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:21.643824  3124 raft_consensus.cc:2804] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:21.669512  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:21.669806  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:21.681989  1572 leader_election.cc:304] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 12:59:21.650812  3121 raft_consensus.cc:493] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 12:59:21.636333  3066 raft_consensus.cc:493] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
W20260709 12:59:21.706111  1496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:21.708230  3121 raft_consensus.cc:3060] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:21.708786  3137 raft_consensus.cc:2804] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:21.667186  3141 raft_consensus.cc:493] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 12:59:21.666527  3147 raft_consensus.cc:3060] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:21.683658  3124 raft_consensus.cc:493] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:21.682538  3142 leader_election.cc:290] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:21.681053  3122 raft_consensus.cc:2804] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:21.685742  3108 raft_consensus.cc:2804] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:21.694985  3146 leader_election.cc:290] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:21.663230  3110 raft_consensus.cc:515] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:21.695252  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:21.738421  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:21.716681  3098 raft_consensus.cc:2804] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:21.682323  3148 leader_election.cc:290] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:21.739434  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:21.743948  1530 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "770925e70faa4a16a275abd5282f5284"
dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
mode: GRACEFUL
new_leader_uuid: "ddf11fc190dd4b898773379c6b129d90"
 from {username='slave'} at 127.0.0.1:55626
I20260709 12:59:21.680708  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:21.721992  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:21.730441  3141 raft_consensus.cc:3060] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:21.718885  3137 raft_consensus.cc:493] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:21.749595  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:21.730180  3151 leader_election.cc:290] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:21.732342  3124 raft_consensus.cc:3060] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:21.744688  1530 raft_consensus.cc:606] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Received request to transfer leadership to TS ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:21.733260  3122 raft_consensus.cc:493] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 12:59:21.735476  3108 raft_consensus.cc:493] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 12:59:21.731004  3136 raft_consensus.cc:493] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:21.716946  3066 raft_consensus.cc:515] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:21.763871  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:21.764228  3157 leader_election.cc:290] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:21.775377  1496 leader_election.cc:304] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:21.749130  3149 leader_election.cc:290] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:21.752719  3137 raft_consensus.cc:3060] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:21.776268  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:21.780948  3153 leader_election.cc:290] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:21.781510  3120 leader_election.cc:290] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 2 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:21.753969  3098 raft_consensus.cc:697] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 2 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:21.767071  3122 raft_consensus.cc:3060] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:21.684116  3161 raft_consensus.cc:515] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:21.863266  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:21.770175  3108 raft_consensus.cc:3060] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:21.921869  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:21.785421  1530 raft_consensus.cc:1240] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:21.797941  1679 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6"
dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
mode: GRACEFUL
new_leader_uuid: "39a92f5a4352465d8af3af5908fe8642"
 from {username='slave'} at 127.0.0.1:33616
I20260709 12:59:21.885497  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:21.929152  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:21.937230  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:21.767951  3158 leader_election.cc:290] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 12:59:21.861456  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 84283.6us
I20260709 12:59:21.956637  1679 raft_consensus.cc:606] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Received request to transfer leadership to TS 39a92f5a4352465d8af3af5908fe8642
I20260709 12:59:21.862685  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:21.903066  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:21.958230  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:21.885459  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:21.853000  2967 raft_consensus.cc:493] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:21.923764  2227 raft_consensus.cc:2468] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 2.
I20260709 12:59:21.959524  2967 raft_consensus.cc:515] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:21.780997  3160 raft_consensus.cc:2804] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:21.962157  1496 leader_election.cc:304] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
W20260709 12:59:21.963249  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 411883us
I20260709 12:59:21.869407  3113 leader_election.cc:290] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:21.886284  3118 leader_election.cc:290] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:21.881366  3126 leader_election.cc:290] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:21.964694  2967 leader_election.cc:290] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:21.859673  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:21.777034  3136 raft_consensus.cc:515] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:21.858887  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:21.855521  3063 raft_consensus.cc:515] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:21.979115  2192 leader_election.cc:304] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:21.966498  1496 leader_election.cc:304] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:21.967347  2190 leader_election.cc:304] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:21.884928  3155 leader_election.cc:290] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:21.859966  3110 leader_election.cc:290] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:21.986060  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:21.966411  3156 leader_election.cc:290] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:21.848934  3130 leader_election.cc:290] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:21.821908  1672 raft_consensus.cc:2468] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 2.
I20260709 12:59:21.839728  3162 raft_consensus.cc:493] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:21.796811  1676 raft_consensus.cc:2468] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 1.
I20260709 12:59:21.960765  3127 leader_election.cc:290] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:21.856989  3135 raft_consensus.cc:515] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:21.977774  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 12:59:21.996723  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 340495us
I20260709 12:59:21.983103  1673 raft_consensus.cc:3060] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:21.977838  3147 raft_consensus.cc:515] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:21.966699  3160 raft_consensus.cc:493] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:21.986301  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:22.002944  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:22.003684  1680 raft_consensus.cc:2468] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 2.
I20260709 12:59:21.841593  3132 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:21.975497  3150 raft_consensus.cc:2804] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:59:21.983474  3145 consensus_meta.cc:287] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b: Time spent flushing consensus metadata: real 0.518s	user 0.004s	sys 0.006s
W20260709 12:59:22.020085  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 364591us
I20260709 12:59:21.984830  2967 raft_consensus.cc:2804] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:22.020884  2967 raft_consensus.cc:493] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:21.996704  1606 raft_consensus.cc:2468] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 1.
I20260709 12:59:21.999017  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:21.999764  3135 leader_election.cc:290] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 2 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 12:59:22.025092  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:22.022164  1532 raft_consensus.cc:2468] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 3.
I20260709 12:59:21.995208  3162 raft_consensus.cc:515] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 12:59:22.032867  3128 consensus_meta.cc:287] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b: Time spent flushing consensus metadata: real 0.609s	user 0.016s	sys 0.000s
I20260709 12:59:22.020974  3066 leader_election.cc:290] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:21.996906  3142 raft_consensus.cc:2749] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:22.033742  3162 leader_election.cc:290] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:22.008009  3113 raft_consensus.cc:2804] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:22.034482  3113 raft_consensus.cc:493] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:22.034893  3113 raft_consensus.cc:3060] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:22.023953  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:22.035365  3156 raft_consensus.cc:993] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90: : Instructing follower 39a92f5a4352465d8af3af5908fe8642 to start an election
I20260709 12:59:22.025418  3145 raft_consensus.cc:515] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:22.041157  3145 leader_election.cc:290] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 3 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:22.021255  2967 raft_consensus.cc:3060] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:21.987284  2192 leader_election.cc:304] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:22.025835  1681 raft_consensus.cc:1240] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:22.027225  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:22.005055  3160 raft_consensus.cc:3060] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:22.028384  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:22.028431  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 12:59:22.043764  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 56528.5us
I20260709 12:59:22.020339  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:22.029667  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:22.029850  3147 leader_election.cc:290] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:22.030223  3154 leader_election.cc:290] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:22.030725  3164 leader_election.cc:290] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:22.031553  3121 raft_consensus.cc:515] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:22.048648  3145 raft_consensus.cc:2749] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:22.051584  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:22.052318  2225 raft_consensus.cc:2393] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 2: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 12:59:22.052790  3121 leader_election.cc:290] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:22.053156  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:22.005770  3143 raft_consensus.cc:993] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642: : Instructing follower b96ce9cc496c49d7818fa983a17b062b to start an election
I20260709 12:59:22.029060  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:22.021999  3150 raft_consensus.cc:493] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:22.044512  2192 leader_election.cc:304] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:22.056819  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:22.033314  3128 raft_consensus.cc:515] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:22.043483  1604 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 3.
I20260709 12:59:22.053823  2221 raft_consensus.cc:2468] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 1.
I20260709 12:59:22.050036  3130 raft_consensus.cc:1081] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Signalling peer 39a92f5a4352465d8af3af5908fe8642 to start an election
I20260709 12:59:22.001408  3098 consensus_queue.cc:237] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:22.049789  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:22.067971  1529 raft_consensus.cc:2468] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 1.
I20260709 12:59:22.068728  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:22.060479  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:22.062434  2967 raft_consensus.cc:515] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:22.033387  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:22.069576  2225 raft_consensus.cc:2468] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 1.
I20260709 12:59:22.069824  1606 raft_consensus.cc:2468] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 1.
I20260709 12:59:22.065073  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:22.070863  2967 leader_election.cc:290] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:22.059583  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:22.072975  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:22.074939  2224 raft_consensus.cc:2393] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 3: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 12:59:22.076248  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:22.077214  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:22.056973  3161 leader_election.cc:290] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:22.080317  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 12:59:22.077919  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 91064.8us
I20260709 12:59:22.057806  3150 raft_consensus.cc:3060] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:22.059384  3158 raft_consensus.cc:2749] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:22.059573  3154 raft_consensus.cc:1081] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 2 LEADER]: Signalling peer b96ce9cc496c49d7818fa983a17b062b to start an election
I20260709 12:59:22.090022  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:22.090896  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:22.093775  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:22.095079  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:22.095722  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 12:59:22.085965  3144 consensus_meta.cc:287] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b: Time spent flushing consensus metadata: real 0.686s	user 0.012s	sys 0.000s
I20260709 12:59:22.099757  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 12:59:22.097070  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 129793us
I20260709 12:59:22.104382  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:22.101179  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:22.105930  1529 raft_consensus.cc:1275] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:22.108094  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:22.108088  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:22.109382  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:22.109892  2224 raft_consensus.cc:2468] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 1.
I20260709 12:59:22.111406  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:22.319713  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 12:59:22.320506  3141 consensus_meta.cc:287] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.551s	user 0.010s	sys 0.000s
I20260709 12:59:22.270467  3137 raft_consensus.cc:515] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:22.320998  3141 raft_consensus.cc:515] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:22.321477  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:22.322275  1598 raft_consensus.cc:2393] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 2: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 12:59:22.270341  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:22.323685  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:22.323861  3162 raft_consensus.cc:993] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1: : Instructing follower ddf11fc190dd4b898773379c6b129d90 to start an election
I20260709 12:59:22.324605  3162 raft_consensus.cc:1081] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Signalling peer ddf11fc190dd4b898773379c6b129d90 to start an election
I20260709 12:59:22.325117  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:22.323930  1673 raft_consensus.cc:2468] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 2.
W20260709 12:59:22.325984  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 229372us
I20260709 12:59:22.326421  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:22.327594  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:22.327703  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:22.307008  3108 raft_consensus.cc:515] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:22.329774  1496 leader_election.cc:304] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:22.330089  1602 raft_consensus.cc:2393] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 2: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 12:59:22.330478  3110 raft_consensus.cc:2804] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:22.330993  3110 raft_consensus.cc:493] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:22.331341  3110 raft_consensus.cc:3060] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:22.331678  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:22.332049  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:22.328843  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:22.309888  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:22.138489  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:22.149300  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:22.266887  2224 raft_consensus.cc:1240] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:22.330497  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:22.334203  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:22.134752  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:22.237479  1572 leader_election.cc:304] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
W20260709 12:59:22.335399  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 98022.1us
I20260709 12:59:22.236912  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:22.111869  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:22.135739  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:22.150271  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:22.130509  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:22.289319  2227 raft_consensus.cc:1240] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:22.151224  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:22.241839  2192 leader_election.cc:304] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 12:59:22.259837  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:22.326292  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:22.339759  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:22.300256  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:22.150147  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:22.272106  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:22.345376  2224 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5"
dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
 from {username='slave'} at 127.0.0.1:50310
I20260709 12:59:22.351759  2224 raft_consensus.cc:493] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:22.352085  3120 raft_consensus.cc:2804] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:22.149930  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:22.340772  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:22.328779  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:22.300966  3122 raft_consensus.cc:515] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:22.337086  1571 leader_election.cc:304] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:22.343235  1646 leader_election.cc:304] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:22.353832  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:22.353440  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 12:59:22.346082  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:22.099371  2220 raft_consensus.cc:1240] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:22.343703  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:22.192721  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:22.354351  1496 leader_election.cc:304] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:22.169943  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:22.344612  1675 raft_consensus.cc:1240] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:22.346941  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:22.350164  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:22.350651  1678 raft_consensus.cc:1275] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:22.352370  2224 raft_consensus.cc:3060] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:22.324275  3141 leader_election.cc:290] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 12:59:22.209582  3170 log.cc:927] Time spent T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 12:59:22.351089  1572 leader_election.cc:304] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:22.351675  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 12:59:22.339847  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 98120.5us
I20260709 12:59:22.343662  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:22.366853  1646 leader_election.cc:304] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:22.120321  2221 raft_consensus.cc:1240] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:22.373553  2192 leader_election.cc:304] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:22.338392  1529 raft_consensus.cc:2468] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 1.
I20260709 12:59:22.351214  3154 raft_consensus.cc:2804] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:22.369268  1571 leader_election.cc:304] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:22.368163  1496 leader_election.cc:304] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:22.375037  2967 raft_consensus.cc:2804] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:22.375237  1571 leader_election.cc:304] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:22.375391  2967 raft_consensus.cc:493] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:22.375841  2967 raft_consensus.cc:3060] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:22.349633  3110 raft_consensus.cc:515] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:22.371521  3162 raft_consensus.cc:2804] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:22.376825  3159 raft_consensus.cc:2804] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:22.377199  3162 raft_consensus.cc:493] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:22.377599  3162 raft_consensus.cc:3060] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:22.378000  3110 leader_election.cc:290] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:22.375994  1496 leader_election.cc:304] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:22.131249  3136 leader_election.cc:290] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:22.376871  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:22.346431  1531 raft_consensus.cc:2468] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 2.
I20260709 12:59:22.377733  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:22.388979  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:22.129823  3063 leader_election.cc:290] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 2 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:22.192291  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:22.107707  3144 raft_consensus.cc:515] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:22.390058  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:22.263001  3128 leader_election.cc:290] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 3 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:22.150208  3158 raft_consensus.cc:493] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:22.390688  3152 raft_consensus.cc:2749] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:22.371419  3149 raft_consensus.cc:2749] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:22.390908  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:22.391255  3164 raft_consensus.cc:3060] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:22.379101  3159 raft_consensus.cc:493] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 12:59:22.391817  3151 raft_consensus.cc:2804] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:22.349898  3137 leader_election.cc:290] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:22.392544  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:22.392983  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:22.393422  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 12:59:22.394129  1570 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.524s (SENT) [suppressed 2 similar messages]
I20260709 12:59:22.395476  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:22.371274  3132 raft_consensus.cc:2804] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:22.401255  1646 leader_election.cc:304] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:22.427531  1602 raft_consensus.cc:1240] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:22.391505  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:22.352486  3120 raft_consensus.cc:493] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 12:59:22.410010  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:22.346957  1523 raft_consensus.cc:2468] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 1.
I20260709 12:59:22.399230  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:22.406435  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:22.419704  1644 leader_election.cc:304] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:22.402911  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:22.408977  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 12:59:22.406607  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 55612.3us
I20260709 12:59:22.418182  1606 raft_consensus.cc:1240] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:22.433270  3159 raft_consensus.cc:3060] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:22.399770  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:22.435324  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:22.397974  2967 raft_consensus.cc:515] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:22.409948  1601 raft_consensus.cc:2393] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 3: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 12:59:22.435878  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:22.407696  2191 leader_election.cc:304] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:22.412002  2225 raft_consensus.cc:1240] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:22.418627  2224 raft_consensus.cc:515] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:22.446600  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 12:59:22.409525  3124 consensus_meta.cc:287] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.635s	user 0.010s	sys 0.003s
W20260709 12:59:22.420224  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 45070.6us
I20260709 12:59:22.413359  1600 raft_consensus.cc:3060] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:22.405319  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:22.418870  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:22.401891   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:59:22.378515  3143 raft_consensus.cc:2749] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:22.455613  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:22.417647  1496 leader_election.cc:304] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:22.444921  1530 raft_consensus.cc:2468] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 1.
I20260709 12:59:22.378693  3154 raft_consensus.cc:493] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:22.347007  3113 raft_consensus.cc:515] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:22.404381  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:22.452898   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:22.453526  1529 raft_consensus.cc:2468] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 2.
I20260709 12:59:22.409580  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 12:59:22.447613  2227 raft_consensus.cc:2393] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 2: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 12:59:22.489710  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 12:59:22.490386  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 96287.5us
I20260709 12:59:22.493638  2192 leader_election.cc:304] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:22.495060  2192 leader_election.cc:304] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:22.495843  3145 raft_consensus.cc:3060] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:22.496156  3128 raft_consensus.cc:2749] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:59:22.457969  2224 leader_election.cc:290] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 3 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:22.436070  3132 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 12:59:22.498445  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:22.455780  3172 consensus_queue.cc:1059] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 12:59:22.459143  3127 raft_consensus.cc:2749] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:22.463567  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:22.463876  2219 raft_consensus.cc:1240] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:22.498986  3132 raft_consensus.cc:3060] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:22.499782  3172 raft_consensus.cc:3055] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:22.500113  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 12:59:22.500129  3172 raft_consensus.cc:740] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 12:59:22.501507  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:22.501366  3172 consensus_queue.cc:260] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:22.463976  3065 raft_consensus.cc:2804] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:22.502562  3172 raft_consensus.cc:3060] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:22.464468  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:22.503394  1527 raft_consensus.cc:2393] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 3: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 12:59:22.400903  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:22.448925  3158 raft_consensus.cc:515] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:22.465126  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:22.412685  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:22.506124  2221 raft_consensus.cc:2468] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 2.
I20260709 12:59:22.410854  3122 leader_election.cc:290] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:22.507174  3158 leader_election.cc:290] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:22.467398  3113 leader_election.cc:290] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 3 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:22.459945  3154 raft_consensus.cc:3060] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:22.468590  3144 leader_election.cc:290] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 2 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:22.469115  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:22.513968  3132 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:22.482712  1425 catalog_manager.cc:5697] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 reported cstate change: term changed from 1 to 2, leader changed from e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:22.515601  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:22.516752  3108 leader_election.cc:290] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:22.517544  1674 raft_consensus.cc:1240] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:22.466176  3162 raft_consensus.cc:515] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:22.518427  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:22.518703  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 12:59:22.520081  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:22.514364  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 57151us
I20260709 12:59:22.401755  3147 consensus_queue.cc:1059] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 12:59:22.469412  1604 raft_consensus.cc:1240] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:22.470269  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:22.437342  3171 raft_consensus.cc:2749] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:22.470448  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:22.470872  2226 raft_consensus.cc:1240] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:22.471176  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:22.471772  1603 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6"
dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
 from {username='slave'} at 127.0.0.1:36200
I20260709 12:59:22.449370  3125 raft_consensus.cc:2749] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:22.441397  3120 raft_consensus.cc:3060] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:22.470721  1497 leader_election.cc:304] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:22.435591  3151 raft_consensus.cc:493] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:22.461723  3124 raft_consensus.cc:515] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:22.400234  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:22.510722  3145 raft_consensus.cc:2749] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:22.427599  3110 raft_consensus.cc:2804] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:22.409590  3150 raft_consensus.cc:515] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:22.401965  3130 consensus_queue.cc:1059] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.082s
I20260709 12:59:22.531030  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:22.555240  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:22.449569  2967 leader_election.cc:290] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:22.528112  1672 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "770925e70faa4a16a275abd5282f5284"
dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
 from {username='slave'} at 127.0.0.1:49178
I20260709 12:59:22.440872  3160 raft_consensus.cc:515] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:22.536449  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:22.557301  1675 raft_consensus.cc:3060] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:22.516866  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:22.539042  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:22.485956  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:22.559944  2227 raft_consensus.cc:1240] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:22.548554  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:22.552959  1599 raft_consensus.cc:1240] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:22.555754  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:22.562291  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 12:59:22.537334  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 12:59:22.532241  2218 raft_consensus.cc:2468] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 3.
I20260709 12:59:22.530275  3149 consensus_queue.cc:1059] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 12:59:22.567711  1607 raft_consensus.cc:1240] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:22.542678  3151 raft_consensus.cc:3060] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:22.585335  1526 raft_consensus.cc:1240] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:22.549400  3110 raft_consensus.cc:493] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:22.543262  3162 leader_election.cc:290] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:22.582008  3066 raft_consensus.cc:2749] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:22.601572  3150 leader_election.cc:290] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 2 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:22.603364  3160 leader_election.cc:290] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:22.603614  3132 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:22.604781  3137 consensus_queue.cc:1059] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:22.605224  1672 raft_consensus.cc:493] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:22.605721  1672 raft_consensus.cc:3060] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:22.593928  1600 raft_consensus.cc:2468] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 3.
I20260709 12:59:22.608505  1602 raft_consensus.cc:1240] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:22.608748  1605 raft_consensus.cc:3055] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:22.560118  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:22.609190  1605 raft_consensus.cc:740] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:22.610874  1605 consensus_queue.cc:260] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:22.596439  3110 raft_consensus.cc:3060] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:22.589555  3136 consensus_queue.cc:1059] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
W20260709 12:59:22.627038  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 89271.9us
I20260709 12:59:22.628018  1646 leader_election.cc:304] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:22.629544  1646 leader_election.cc:304] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:22.630301  3181 raft_consensus.cc:2749] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:22.560634  3171 consensus_queue.cc:1059] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 12:59:22.631412  1646 leader_election.cc:304] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:22.636196  1675 raft_consensus.cc:2468] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 3.
I20260709 12:59:22.626696  3149 raft_consensus.cc:3055] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:22.631124  3132 consensus_queue.cc:1059] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 12:59:22.631148  3169 raft_consensus.cc:2749] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:22.640103  3149 raft_consensus.cc:740] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:22.645594  3156 raft_consensus.cc:3055] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:22.645655  3124 leader_election.cc:290] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:22.628499  3143 consensus_queue.cc:1059] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 12:59:22.651376  3154 raft_consensus.cc:515] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:22.648487  3156 raft_consensus.cc:740] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:22.654137  3151 raft_consensus.cc:515] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:22.654495  3156 consensus_queue.cc:260] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:22.655709  3156 raft_consensus.cc:3060] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:22.656241  3151 leader_election.cc:290] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:22.653043  3149 consensus_queue.cc:260] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:22.662151  3154 leader_election.cc:290] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:22.654512  3164 raft_consensus.cc:2749] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:22.665608  3159 raft_consensus.cc:515] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 12:59:22.692003  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 143393us
I20260709 12:59:22.697944  1570 leader_election.cc:304] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:22.699707  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:22.701962  1570 leader_election.cc:304] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:22.703009  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:22.704708  1570 leader_election.cc:304] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
W20260709 12:59:22.706483  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 162366us
I20260709 12:59:22.708120  1603 raft_consensus.cc:493] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:22.709065  1603 raft_consensus.cc:3060] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:22.706377  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:22.711246  1599 raft_consensus.cc:1240] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 1. Current term is 2. Ops: []
W20260709 12:59:22.706498  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 150621us
I20260709 12:59:22.711830  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 12:59:22.716478  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 85259.2us
I20260709 12:59:22.721042  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:22.725229  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 12:59:22.727979  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:22.729575  3098 raft_consensus.cc:2749] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:22.731906  3098 consensus_queue.cc:1059] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:22.733685  3098 raft_consensus.cc:3055] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:22.708144  1571 leader_election.cc:304] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:22.735280  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:22.736974  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:22.740338  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:22.742260  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:22.747828  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:22.748551  3108 raft_consensus.cc:3055] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:22.748930  3065 raft_consensus.cc:697] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 12:59:22.753625  3151 raft_consensus.cc:2804] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:22.756994  3141 raft_consensus.cc:2804] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:22.753144  3065 consensus_queue.cc:237] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:22.757532  3141 raft_consensus.cc:493] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:22.749073  3108 raft_consensus.cc:740] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:22.754292  3151 raft_consensus.cc:493] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:22.734189  3098 raft_consensus.cc:740] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
W20260709 12:59:22.823619  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 107414us
I20260709 12:59:22.851732  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:22.853951  1528 raft_consensus.cc:3060] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:22.840250  1605 raft_consensus.cc:3060] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:22.770247  3154 consensus_queue.cc:1059] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.096s
I20260709 12:59:22.853915  3149 raft_consensus.cc:3060] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:22.859020  3154 raft_consensus.cc:3055] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:22.756212  3122 raft_consensus.cc:2749] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:59:22.845610  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:22.821514  1603 raft_consensus.cc:515] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:22.859620  3154 raft_consensus.cc:740] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:22.833076  3130 raft_consensus.cc:3055] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:22.863234  3130 raft_consensus.cc:740] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:22.834177  3181 raft_consensus.cc:3055] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:59:22.850965  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 146595us
I20260709 12:59:22.759537  3141 raft_consensus.cc:3060] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:22.831682  3147 raft_consensus.cc:3055] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:22.869025  1606 raft_consensus.cc:1240] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 1. Current term is 3. Ops: []
I20260709 12:59:22.860716  3151 raft_consensus.cc:3060] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:22.880008  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 12:59:22.870862  2218 raft_consensus.cc:1275] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:22.890290  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:22.890568  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:22.891134  1529 raft_consensus.cc:2468] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 2.
I20260709 12:59:22.891901  1528 raft_consensus.cc:2468] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 3.
W20260709 12:59:22.893424  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 185649us
I20260709 12:59:22.894399  1571 leader_election.cc:304] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:22.895687  3122 raft_consensus.cc:2749] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:22.864362  3181 raft_consensus.cc:740] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:22.897151  3181 consensus_queue.cc:260] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:22.897593  3122 consensus_queue.cc:1048] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:22.768747  3137 raft_consensus.cc:2749] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:22.886281  3147 raft_consensus.cc:740] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:22.901297  1571 leader_election.cc:304] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:22.901602  3147 consensus_queue.cc:260] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:22.875265  1672 raft_consensus.cc:515] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:22.903436  3154 consensus_queue.cc:260] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:22.904013  3122 raft_consensus.cc:2749] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:22.904781  1672 leader_election.cc:290] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 2 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:22.905467  3154 raft_consensus.cc:3060] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:22.905823  1571 leader_election.cc:304] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:22.908211  3122 raft_consensus.cc:2749] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:22.910377  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 12:59:22.910684  1646 leader_election.cc:304] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:22.911280  2218 raft_consensus.cc:3060] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:22.911844  3156 raft_consensus.cc:2804] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:22.915370  1605 raft_consensus.cc:2468] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 3.
W20260709 12:59:22.917361  3152 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 12:59:22.918030  3181 raft_consensus.cc:3060] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:22.916935  3156 raft_consensus.cc:697] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 3 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:22.921563  3156 consensus_queue.cc:237] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:22.925606  3130 consensus_queue.cc:260] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 12:59:22.928948  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:22.929507  1570 leader_election.cc:304] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:22.932210  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 12:59:22.933115  1603 leader_election.cc:290] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:22.932150  3171 consensus_queue.cc:1048] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
W20260709 12:59:22.932994  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:22.936265  1571 leader_election.cc:304] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:22.934904  3147 raft_consensus.cc:3060] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:22.940481  3152 raft_consensus.cc:2749] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:22.928597  3098 consensus_queue.cc:260] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:22.943354  3098 raft_consensus.cc:3060] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:22.877285  3120 raft_consensus.cc:515] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:22.946476  1677 raft_consensus.cc:1240] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 1. Current term is 2. Ops: []
W20260709 12:59:22.946854  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:22.943979  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:22.947875  3120 leader_election.cc:290] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 2 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:22.949798  2222 raft_consensus.cc:1240] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:22.952836  3159 leader_election.cc:290] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 2 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:22.864063  3108 consensus_queue.cc:260] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:22.957847  1677 raft_consensus.cc:1240] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:22.957981  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 12:59:22.958396  3108 raft_consensus.cc:3060] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:22.960839  3122 raft_consensus.cc:2749] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:22.965744  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:22.964879  3130 raft_consensus.cc:3060] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:22.972079  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:22.973943  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:22.975700  1676 raft_consensus.cc:1240] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:59:22.975847  1677 raft_consensus.cc:3055] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:22.976430  1677 raft_consensus.cc:740] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:22.981241  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:22.981551  1677 consensus_queue.cc:260] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:22.981982  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
W20260709 12:59:22.983328  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:22.983314  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 54001.2us
I20260709 12:59:22.990638  2190 leader_election.cc:304] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:22.990477  3184 consensus_queue.cc:1059] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:59:22.991521  3120 raft_consensus.cc:2749] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:22.992093  3184 raft_consensus.cc:3055] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:22.992384  2190 leader_election.cc:304] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:22.993367  3120 raft_consensus.cc:2749] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:22.993736  3184 raft_consensus.cc:740] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:22.994098  2190 leader_election.cc:304] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:22.994827  3184 consensus_queue.cc:260] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:23.000027  3184 raft_consensus.cc:3060] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:22.995977  1677 raft_consensus.cc:3060] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:59:22.987064  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:22.997165  1672 raft_consensus.cc:1240] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:23.010299  3171 consensus_queue.cc:1059] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:23.011619  3159 raft_consensus.cc:3055] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:23.012036  3159 raft_consensus.cc:740] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:23.012280  3120 raft_consensus.cc:2749] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:23.013043  3159 consensus_queue.cc:260] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:23.024415  3137 consensus_queue.cc:1059] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:23.025476  3152 raft_consensus.cc:3055] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:23.025877  3152 raft_consensus.cc:740] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:23.026834  3152 consensus_queue.cc:260] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:23.033136  2190 leader_election.cc:304] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:23.035297  3159 raft_consensus.cc:3060] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:23.037218  3141 raft_consensus.cc:515] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:22.978881  3110 raft_consensus.cc:515] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:23.047890  1570 leader_election.cc:304] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:23.049912  3141 leader_election.cc:290] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 12:59:23.051011  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 592536us
I20260709 12:59:23.052776  1497 leader_election.cc:304] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:23.054052  3190 raft_consensus.cc:2749] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:23.040767  3149 consensus_queue.cc:1048] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 12:59:23.055891  1497 leader_election.cc:304] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:23.057530  3152 raft_consensus.cc:3060] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:23.058137  3110 leader_election.cc:290] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 2 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:23.061755  3141 raft_consensus.cc:2749] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:59:23.059374  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 45695.5us
I20260709 12:59:23.061124  1570 leader_election.cc:304] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:23.066385  1677 raft_consensus.cc:2468] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 3.
I20260709 12:59:23.066469  1570 leader_election.cc:304] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:23.077801  1571 leader_election.cc:304] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:23.070744  3141 raft_consensus.cc:2749] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:23.077515  3110 raft_consensus.cc:2749] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:23.086540  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:23.086508  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:23.082759  3122 raft_consensus.cc:2804] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:23.083273  2218 raft_consensus.cc:2468] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 2.
I20260709 12:59:23.099445  1601 raft_consensus.cc:1240] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:23.093540  3190 consensus_queue.cc:1059] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 12:59:23.101257  3063 raft_consensus.cc:2749] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:23.107335  3190 raft_consensus.cc:3055] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:23.101285  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:23.107791  3190 raft_consensus.cc:740] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 12:59:23.108867  3190 consensus_queue.cc:260] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:59:23.110581  3190 raft_consensus.cc:3060] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:23.116175  1603 raft_consensus.cc:3060] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:23.117771  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 51524.6us
I20260709 12:59:23.096670  3193 raft_consensus.cc:2749] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:23.120227  1497 leader_election.cc:304] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:23.100489  3122 raft_consensus.cc:697] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 3 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
W20260709 12:59:23.152694  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 67792.4us
W20260709 12:59:23.154774  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:23.127867  3151 raft_consensus.cc:515] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:23.222797  3063 raft_consensus.cc:493] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 12:59:23.248230  3063 raft_consensus.cc:515] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:23.251226  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:23.251646  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:23.253192  3151 leader_election.cc:290] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:23.223673  1603 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 4.
I20260709 12:59:23.223521  1570 leader_election.cc:304] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 12:59:23.225196  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:23.253888  3063 leader_election.cc:290] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:23.254310  3151 raft_consensus.cc:2749] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:23.227845  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 12:59:23.232861  1678 raft_consensus.cc:2468] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 2.
W20260709 12:59:23.254585  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 128985us
I20260709 12:59:23.233726  1572 leader_election.cc:304] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:23.129024  2190 leader_election.cc:304] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:23.261726  2222 raft_consensus.cc:3060] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:59:23.228796  3122 consensus_queue.cc:237] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 12:59:23.235262  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:23.236779  1496 leader_election.cc:304] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:23.218986  3065 raft_consensus.cc:2749] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:23.226464  1425 catalog_manager.cc:5697] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 1 to 2, leader changed from 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) to e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:23.229975  3130 consensus_queue.cc:1059] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:59:23.262269  3063 raft_consensus.cc:2749] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:59:23.262478  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 162138us
I20260709 12:59:23.262907  1570 leader_election.cc:304] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:23.263082  1572 leader_election.cc:304] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:23.263696  3151 raft_consensus.cc:2749] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:59:23.268574  1497 leader_election.cc:304] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:23.269982  3190 raft_consensus.cc:2804] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:23.271435  3180 consensus_queue.cc:1059] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:23.272884  1571 leader_election.cc:304] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:23.272953  3110 consensus_queue.cc:1059] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:23.292538  3193 raft_consensus.cc:2804] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:23.301021  3193 raft_consensus.cc:493] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:23.301486  3193 raft_consensus.cc:3060] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:23.294847  2222 raft_consensus.cc:2468] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 3.
I20260709 12:59:23.308367  1570 leader_election.cc:304] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:23.309738  3137 raft_consensus.cc:2749] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:23.309829  1570 leader_election.cc:304] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:23.293399  3108 raft_consensus.cc:2804] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:23.300184  2190 leader_election.cc:304] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:23.315595  3063 raft_consensus.cc:2749] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:59:23.316303  2190 leader_election.cc:304] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:23.317245  3063 raft_consensus.cc:2749] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:23.318586  3137 raft_consensus.cc:2749] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:23.319626  3108 raft_consensus.cc:697] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 2 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:23.320924  3065 raft_consensus.cc:2749] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:23.322305  1570 leader_election.cc:304] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:23.322106  1427 catalog_manager.cc:5697] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 reported cstate change: term changed from 2 to 3, leader changed from e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:23.323395  3108 consensus_queue.cc:237] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:23.329897  2190 leader_election.cc:304] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 12:59:23.331092  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 62683.3us
I20260709 12:59:23.337193  1603 raft_consensus.cc:1240] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:23.340651  3063 raft_consensus.cc:2749] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:23.337045  3151 raft_consensus.cc:2804] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:59:23.333868  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:23.339442  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 54333.3us
I20260709 12:59:23.338184  3184 raft_consensus.cc:3055] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:23.349570  3151 raft_consensus.cc:493] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
W20260709 12:59:23.358904  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 87813.6us
I20260709 12:59:23.350172  3184 raft_consensus.cc:740] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:23.373893  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:23.374801  1603 raft_consensus.cc:2393] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 3: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 12:59:23.364456  3151 raft_consensus.cc:3060] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:23.377532  1646 leader_election.cc:304] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:23.369485  3154 raft_consensus.cc:2749] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 3 LEADER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:59:23.384742  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 12:59:23.386915  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 69248.3us
I20260709 12:59:23.385577  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:23.394578  1606 raft_consensus.cc:1240] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:23.396045  2190 leader_election.cc:304] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:23.398078  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:23.398341  3184 consensus_queue.cc:260] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:23.399542  3184 raft_consensus.cc:3060] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:23.400125  3130 consensus_queue.cc:1059] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:23.401154  3098 raft_consensus.cc:3055] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:23.401530  3098 raft_consensus.cc:740] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:23.392213  3156 raft_consensus.cc:2804] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:23.402281  3098 consensus_queue.cc:260] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:23.403112  3156 raft_consensus.cc:697] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 4 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:23.403491  3098 raft_consensus.cc:3060] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:23.404006  3156 consensus_queue.cc:237] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:23.384220  3110 raft_consensus.cc:3055] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:23.390959  3190 raft_consensus.cc:697] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
W20260709 12:59:23.411772  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:23.413494  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:23.415836  1605 raft_consensus.cc:1240] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:23.417486  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:23.408243  3110 raft_consensus.cc:740] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 12:59:23.419373  1428 catalog_manager.cc:5697] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 1 to 3, leader changed from ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) to 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:23.421033  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:23.419107  3164 raft_consensus.cc:2749] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:59:23.422288  2192 leader_election.cc:304] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:23.428925  3164 raft_consensus.cc:2749] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:59:23.430027  2192 leader_election.cc:304] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:23.431823  2190 leader_election.cc:304] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:23.432142  3063 raft_consensus.cc:3060] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:23.436220  3164 raft_consensus.cc:2749] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:23.444641  1607 raft_consensus.cc:1275] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:23.444129  3065 raft_consensus.cc:3055] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:23.449931  3065 raft_consensus.cc:740] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 12:59:23.451005  3193 raft_consensus.cc:515] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:23.451182  3065 consensus_queue.cc:260] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:23.452690  3065 raft_consensus.cc:3060] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:23.453327  3193 leader_election.cc:290] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:23.453526  3184 consensus_queue.cc:1048] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:23.453619  3110 consensus_queue.cc:260] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:23.455134  3110 raft_consensus.cc:3060] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:23.459722  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:23.460210  1673 raft_consensus.cc:1275] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:23.460697  3151 raft_consensus.cc:515] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:23.462050  3063 raft_consensus.cc:2749] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:23.463325  3199 consensus_queue.cc:1059] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:23.465449  3199 raft_consensus.cc:3055] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:23.465868  3199 raft_consensus.cc:740] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 12:59:23.431114  3190 consensus_queue.cc:237] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:23.466912  3199 consensus_queue.cc:260] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:23.468274  3199 raft_consensus.cc:3060] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:23.472688  1496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:23.475766  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:23.479601  3202 consensus_queue.cc:1059] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 12:59:23.480911  3202 raft_consensus.cc:3055] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:23.481300  3202 raft_consensus.cc:740] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 12:59:23.481825  1497 leader_election.cc:304] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:23.487305  3201 consensus_queue.cc:1059] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:23.492287  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:23.509833  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:23.478909  3151 leader_election.cc:290] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:23.501502  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:23.516908  2192 leader_election.cc:304] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
W20260709 12:59:23.520018  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 88322.8us
W20260709 12:59:23.520249  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:23.523451  3201 consensus_queue.cc:1048] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:23.524492  2190 leader_election.cc:304] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:23.526384  3164 raft_consensus.cc:2804] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:23.526922  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:23.482261  3202 consensus_queue.cc:260] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:23.527452  1646 leader_election.cc:304] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:23.527995  3202 raft_consensus.cc:3060] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:23.529505  3156 raft_consensus.cc:2804] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:23.530023  3156 raft_consensus.cc:697] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 2 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
W20260709 12:59:23.530376  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:23.531068  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:23.527072  3200 raft_consensus.cc:2749] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:23.522131   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:23.531637  3212 raft_consensus.cc:3055] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:23.537168  3120 raft_consensus.cc:2804] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:23.567720  3120 raft_consensus.cc:493] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:23.568158  3120 raft_consensus.cc:3060] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:23.526952  3164 raft_consensus.cc:697] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 3 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 12:59:23.571476  3164 consensus_queue.cc:237] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:23.531003  3156 consensus_queue.cc:237] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:23.576134  3212 raft_consensus.cc:740] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 12:59:23.577153  3212 consensus_queue.cc:260] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:23.577075  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:23.583333  1605 raft_consensus.cc:1240] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 1. Current term is 2. Ops: []
W20260709 12:59:23.588047  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 106314us
I20260709 12:59:23.593364  3212 raft_consensus.cc:3060] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:23.595151  1497 leader_election.cc:304] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:23.597074  3201 consensus_queue.cc:1059] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:23.598307  3201 raft_consensus.cc:2749] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:23.599045  3211 raft_consensus.cc:3055] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:23.599491  3211 raft_consensus.cc:740] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 12:59:23.600518  3211 consensus_queue.cc:260] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:23.602129  3211 raft_consensus.cc:3060] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:23.618211  3181 consensus_queue.cc:1059] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:23.620242  3130 raft_consensus.cc:3055] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:23.620622  3130 raft_consensus.cc:740] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:23.621493  3130 consensus_queue.cc:260] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:23.630111  3120 raft_consensus.cc:515] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:23.622614  3130 raft_consensus.cc:3060] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:23.638093  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:23.638339  2218 raft_consensus.cc:1240] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:23.640735  2190 leader_election.cc:304] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:23.645018  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:23.645669  1526 raft_consensus.cc:3060] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:23.652423  3215 raft_consensus.cc:2749] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:59:23.635578  3120 leader_election.cc:290] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 3 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:23.648249  1497 leader_election.cc:304] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:23.659183  1526 raft_consensus.cc:2468] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 3.
I20260709 12:59:23.655839  2190 leader_election.cc:304] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:23.660089  3215 raft_consensus.cc:2749] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:23.665166  3156 consensus_queue.cc:1059] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:23.666512  3156 raft_consensus.cc:3055] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:23.672278  3156 raft_consensus.cc:740] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:23.673040  3156 consensus_queue.cc:260] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:23.673844  3156 raft_consensus.cc:3060] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:23.675969  1425 catalog_manager.cc:5697] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 2 to 3, leader changed from 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) to e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:23.679872  3201 raft_consensus.cc:2749] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:23.681046  1497 leader_election.cc:304] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:23.681756  3212 raft_consensus.cc:2749] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:23.682600  1497 leader_election.cc:304] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:23.683282  3212 raft_consensus.cc:2749] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:23.683748  1497 leader_election.cc:304] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
W20260709 12:59:23.684320  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:23.685019  3212 raft_consensus.cc:2749] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:23.699069  1497 leader_election.cc:304] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:23.700589  3190 raft_consensus.cc:2749] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:23.704228  2190 leader_election.cc:304] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:23.717476  3216 raft_consensus.cc:2804] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:23.717975  3216 raft_consensus.cc:697] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 3 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 12:59:23.718994  3216 consensus_queue.cc:237] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 12:59:23.721334  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:23.713593  1428 catalog_manager.cc:5697] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 2 to 3, leader changed from 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) to b96ce9cc496c49d7818fa983a17b062b (127.0.107.196). New cstate: current_term: 3 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:23.715963  1426 catalog_manager.cc:5697] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 1 to 2, leader changed from ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) to 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:23.729101  1607 raft_consensus.cc:1240] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 2. Current term is 3. Ops: []
W20260709 12:59:23.729149  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 87828.4us
I20260709 12:59:23.732954  3156 consensus_queue.cc:1059] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:23.734113  3130 raft_consensus.cc:3055] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:23.735656  1497 leader_election.cc:304] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:23.734483  3130 raft_consensus.cc:740] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:23.737507  3130 consensus_queue.cc:260] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:23.738754  3130 raft_consensus.cc:3060] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:23.753957  1425 catalog_manager.cc:5697] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 2 to 3, leader changed from ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) to b96ce9cc496c49d7818fa983a17b062b (127.0.107.196). New cstate: current_term: 3 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:59:23.762485  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:23.773145  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:23.776168  1681 raft_consensus.cc:1275] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:23.777885  3154 consensus_queue.cc:1048] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:59:23.783828  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 55382.5us
I20260709 12:59:23.784660  1497 leader_election.cc:304] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:23.785432  3190 raft_consensus.cc:2749] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:23.786152  3190 raft_consensus.cc:2749] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:23.787544  1497 leader_election.cc:304] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:23.790791  3211 raft_consensus.cc:2749] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:23.793139  1427 catalog_manager.cc:5697] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 reported cstate change: term changed from 1 to 2, leader changed from e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:59:23.798237  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:23.798278  1497 leader_election.cc:304] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:23.803717  3211 raft_consensus.cc:2804] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:23.804208  3211 raft_consensus.cc:493] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:23.804651  3211 raft_consensus.cc:3060] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:23.812233  3211 raft_consensus.cc:515] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:23.802073  1427 catalog_manager.cc:5697] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 reported cstate change: term changed from 3 to 4, leader changed from e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 4 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:23.817124  1497 leader_election.cc:304] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:23.819283  3190 raft_consensus.cc:2749] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:23.821018  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:23.822168  1497 leader_election.cc:304] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:23.823503  3190 raft_consensus.cc:3060] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:23.833088  2222 raft_consensus.cc:1275] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:23.834889  3122 consensus_queue.cc:1048] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:23.846225  3122 raft_consensus.cc:493] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:23.846825  3122 raft_consensus.cc:515] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:23.849174  3122 leader_election.cc:290] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:23.849753  3190 raft_consensus.cc:2749] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:23.851079  1497 leader_election.cc:304] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:23.852202  3130 raft_consensus.cc:493] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:23.852377  1497 leader_election.cc:304] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:23.852962  3130 raft_consensus.cc:515] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:23.860131  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:23.860888  1607 raft_consensus.cc:2468] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 2.
I20260709 12:59:23.862253  1646 leader_election.cc:304] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:23.863210  3156 raft_consensus.cc:2804] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:23.863627  3156 raft_consensus.cc:493] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:23.863989  3156 raft_consensus.cc:3060] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:23.869069  1678 raft_consensus.cc:1275] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:23.870954  3122 consensus_queue.cc:1048] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:23.873865  3180 raft_consensus.cc:2804] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:23.874392  3180 raft_consensus.cc:493] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:23.874816  3180 raft_consensus.cc:3060] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:23.877790  3212 raft_consensus.cc:3060] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:23.883361  3130 leader_election.cc:290] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:23.884984  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:23.886010  2218 raft_consensus.cc:2393] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 2: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 12:59:23.886950  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 12:59:23.896747  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:23.900429  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 48197.7us
I20260709 12:59:23.893246  3180 raft_consensus.cc:515] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:23.905781  3190 consensus_queue.cc:1059] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:23.906528  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:23.907409  3202 raft_consensus.cc:3055] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:23.907838  3202 raft_consensus.cc:740] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 12:59:23.908660  3202 consensus_queue.cc:260] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:23.914012  3202 raft_consensus.cc:3060] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:23.919631  2218 raft_consensus.cc:3060] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:23.919901  1497 leader_election.cc:304] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:23.921159  1497 leader_election.cc:304] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:23.921988  3213 raft_consensus.cc:2749] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:23.922706  3213 raft_consensus.cc:2749] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:23.928442  3180 leader_election.cc:290] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 2 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:23.930492  3130 raft_consensus.cc:493] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:23.931147  3130 raft_consensus.cc:515] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:23.934976  3130 leader_election.cc:290] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:23.935352  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:23.936228  2219 raft_consensus.cc:2468] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 3.
I20260709 12:59:23.937463  1646 leader_election.cc:304] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:23.938179  3130 raft_consensus.cc:2804] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:23.938619  3130 raft_consensus.cc:493] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:23.939072  3130 raft_consensus.cc:3060] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:23.941334  2218 raft_consensus.cc:1275] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:23.943080  3122 consensus_queue.cc:1048] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:23.946527  3130 raft_consensus.cc:515] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:23.949183  1497 leader_election.cc:304] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:23.896696  3212 raft_consensus.cc:2749] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:23.950361  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 12:59:23.950611  1497 leader_election.cc:304] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:23.950984  2219 raft_consensus.cc:3060] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:23.951419  3202 raft_consensus.cc:2764] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:59:23.962580  1607 raft_consensus.cc:1275] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:59:23.963820  2219 raft_consensus.cc:2468] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 4.
I20260709 12:59:23.968817  1646 leader_election.cc:304] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:23.964637  3181 consensus_queue.cc:1048] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:23.949771  3130 leader_election.cc:290] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:23.973794  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:23.974042  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:23.974203  3180 raft_consensus.cc:2749] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:23.974849  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:24.005393  3130 raft_consensus.cc:2804] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:23.975874  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:23.977340  1530 raft_consensus.cc:1240] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:24.005927  3130 raft_consensus.cc:697] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 4 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:24.007045  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:24.006834  3130 consensus_queue.cc:237] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:24.008188  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:24.008810  1530 raft_consensus.cc:2468] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 2.
I20260709 12:59:24.009585  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:24.010330  1530 raft_consensus.cc:2410] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for term 3 because replica has last-logged OpId of term: 2 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:59:23.979069  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:23.980357  1524 raft_consensus.cc:1240] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:24.010449  1526 raft_consensus.cc:2468] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 2.
I20260709 12:59:23.980643  1523 raft_consensus.cc:1240] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:23.981170  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:24.012516  1527 raft_consensus.cc:3060] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:24.013168  1525 raft_consensus.cc:2468] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 3.
I20260709 12:59:23.982405  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:24.015190  1531 raft_consensus.cc:3060] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:24.014948  1532 raft_consensus.cc:3060] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:23.988654  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:24.016700  1607 raft_consensus.cc:2410] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:59:23.998553  3211 leader_election.cc:290] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:23.998764  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
W20260709 12:59:24.025059  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 56331.4us
I20260709 12:59:24.025298  1528 raft_consensus.cc:2468] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 2.
I20260709 12:59:23.964991  1673 raft_consensus.cc:2468] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 3.
I20260709 12:59:23.995103  1677 raft_consensus.cc:1275] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:59:24.026825  1527 raft_consensus.cc:2468] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 4.
I20260709 12:59:24.027456  1531 raft_consensus.cc:2468] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 2.
I20260709 12:59:24.022181  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:24.030140  1532 raft_consensus.cc:2468] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 2.
I20260709 12:59:24.031713  1527 raft_consensus.cc:1240] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:24.033669  1528 raft_consensus.cc:1240] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:24.035058  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:23.882488  3156 raft_consensus.cc:515] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:24.036132  1526 raft_consensus.cc:2468] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 1.
I20260709 12:59:24.041625  3156 leader_election.cc:290] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 2 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:24.043021  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:24.043329  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:24.043748  1529 raft_consensus.cc:3060] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:24.044679  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:24.047971  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 12:59:24.048879  2222 raft_consensus.cc:2393] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 2: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 12:59:24.033563  3180 consensus_queue.cc:1048] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 12:59:24.052394  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:24.036600  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:24.055569  1607 raft_consensus.cc:2468] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 2.
I20260709 12:59:24.055569  1529 raft_consensus.cc:2468] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 3.
I20260709 12:59:24.051707  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 12:59:24.058307  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:24.089205  3154 consensus_queue.cc:1059] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:24.111058  1530 raft_consensus.cc:1240] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:24.059950  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:24.053053  1496 leader_election.cc:304] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:24.101989  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:24.102272  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:24.102059  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:24.102916  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:24.098205  1601 raft_consensus.cc:1275] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:24.109684  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:24.131968  1532 raft_consensus.cc:2468] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 2.
I20260709 12:59:24.110345  2224 raft_consensus.cc:1275] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:24.132659  3212 raft_consensus.cc:2804] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:24.133210  3212 raft_consensus.cc:697] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 12:59:24.133688  1526 raft_consensus.cc:2468] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 2.
I20260709 12:59:24.106560  1525 raft_consensus.cc:2376] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 2. Re-sending same reply.
I20260709 12:59:24.109484  1646 leader_election.cc:304] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:24.114145  1524 raft_consensus.cc:2410] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for term 3 because replica has last-logged OpId of term: 2 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:59:24.134116  3212 consensus_queue.cc:237] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:24.136107  3137 raft_consensus.cc:3055] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:24.136521  3137 raft_consensus.cc:740] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:24.138862  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 12:59:24.132568  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 79604.9us
I20260709 12:59:24.136521  3098 raft_consensus.cc:2804] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:24.140987  3098 raft_consensus.cc:697] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 2 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:24.141852  3098 consensus_queue.cc:237] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:24.143023  1523 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 4.
I20260709 12:59:24.143679  3156 consensus_queue.cc:1048] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:24.137400  3137 consensus_queue.cc:260] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:24.104467  3211 raft_consensus.cc:493] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:24.153160  3137 raft_consensus.cc:3060] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:24.105082  3164 raft_consensus.cc:493] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:24.121259  1531 raft_consensus.cc:2468] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 2.
I20260709 12:59:24.116695  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:24.152954  3211 raft_consensus.cc:515] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:24.116179  1425 catalog_manager.cc:5697] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:24.160794  1527 raft_consensus.cc:2393] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 2: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 12:59:24.175117  3209 raft_consensus.cc:493] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:24.175719  3209 raft_consensus.cc:515] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:24.178627  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:24.179278  1531 raft_consensus.cc:2468] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 2.
I20260709 12:59:24.183027  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:24.185330  2190 leader_election.cc:304] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:24.190763  1528 raft_consensus.cc:2393] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 5: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 12:59:24.194168  1527 raft_consensus.cc:1275] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 3. (term mismatch)
W20260709 12:59:24.208140  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:24.194545  1527 pending_rounds.cc:85] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting all ops after (but not including) 2
I20260709 12:59:24.211488  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:24.220130  3120 raft_consensus.cc:2804] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:24.220489  1523 raft_consensus.cc:1275] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:59:24.220577  3120 raft_consensus.cc:493] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:24.209865  1527 pending_rounds.cc:107] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 2.3
I20260709 12:59:24.220954  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:24.221001  3120 raft_consensus.cc:3060] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:24.221830  1528 raft_consensus.cc:2393] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 3: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 12:59:24.227130  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:24.182701  3164 raft_consensus.cc:515] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:24.235019  1527 raft_consensus.cc:2917] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Aborting config change with OpId 2.3: Aborted: Op aborted by new leader
I20260709 12:59:24.239737  1527 raft_consensus.cc:2889] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:24.219069  3209 leader_election.cc:290] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:24.244019  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:24.244659  1531 raft_consensus.cc:3060] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:24.247470  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 62215.2us
I20260709 12:59:24.243229  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:24.255306  1524 raft_consensus.cc:1275] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 12:59:24.257400  3232 log.cc:927] Time spent T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:59:24.260712  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:24.260963  3211 leader_election.cc:290] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:24.261513  1603 raft_consensus.cc:2468] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 2.
I20260709 12:59:24.262576  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:24.263258  1677 raft_consensus.cc:2468] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 3.
I20260709 12:59:24.264053  1527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:49300 (request call id 13) took 2684 ms. Trace:
I20260709 12:59:24.251644  3130 raft_consensus.cc:493] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:24.265723  1531 raft_consensus.cc:2468] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 4.
I20260709 12:59:24.264505  1527 rpcz_store.cc:276] 0709 12:59:21.580088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:21.580235 (+   147us) service_pool.cc:224] Handling call
0709 12:59:21.641430 (+ 61195us) spinlock_profiling.cc:243] Waited 983 us on lock 0x7b2c00000658. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a16eaca11 00007f6a16ebba0a 00007f6a16ebb693 00007f6a16ebb631 00007f6a185ee3f1 00007f6a185279fe 00007f6a185ae749 00007f6a185af76a 00007f6a185ae91b 00007f6a185ba03c 00007f6a185b96b3
0709 12:59:21.644668 (+  3238us) log.cc:844] Serialized 506 byte log entry
0709 12:59:22.032481 (+387813us) spinlock_profiling.cc:243] Waited 5.42 ms on lock 0x7b54004851a0. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a1852c142 00007f6a1850ceaa 00007f6a18513d53 00007f6a18513cd9 00007f6a18513c69 00007f6a18513c31 00007f6a18512dfd 000000000038f354 000000000038f199 00007f6a154c6475
0709 12:59:22.319101 (+286620us) spinlock_profiling.cc:243] Waited 1.36 ms on lock 0x7b18002ce2a0. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1e38ede1 00007f6a1e39b5b1 00007f6a15440c0a 00007f6a1eb80219 00007f6a154c8a40 00007f6a154c34e4 00007f6a154c3455 00007f6a1850cb0b 00007f6a18591b63 00007f6a185b9752 00007f6a1d579d29
0709 12:59:24.258746 (+1939645us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":600336,"raft.queue_time_us":319725,"raft.run_cpu_time_us":3259,"raft.run_wall_time_us":16722,"spinlock_wait_cycles":17842176,"thread_start_us":320914,"threads_started":1,"wal-append.queue_time_us":396374,"wal-append.run_cpu_time_us":10218,"wal-append.run_wall_time_us":1341043}
I20260709 12:59:24.266170  3164 leader_election.cc:290] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:24.268754  1427 catalog_manager.cc:5697] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 2 to 3, leader changed from ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) to e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:24.271603  1496 leader_election.cc:304] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
W20260709 12:59:24.271864  1478 auto_rebalancer.cc:629] Failed to schedule move for tablet 3406989a2b754fe7804c691a11bba6d0: Aborted: Op aborted by new leader
I20260709 12:59:24.266434  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:24.265576  3130 raft_consensus.cc:515] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:24.273094  1528 raft_consensus.cc:2393] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 3: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 12:59:24.278256  3239 consensus_queue.cc:1048] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:24.278291  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:24.283665  3130 leader_election.cc:290] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:24.284292  3211 raft_consensus.cc:2804] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:24.284731  1605 consensus_queue.cc:237] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:59:24.285576  3120 raft_consensus.cc:515] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:24.290874  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:24.291599  1606 raft_consensus.cc:2468] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 4.
I20260709 12:59:24.292428  1601 raft_consensus.cc:1275] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:59:24.293807  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:24.284700  3211 raft_consensus.cc:493] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:24.296864  1646 leader_election.cc:304] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:24.297475  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:24.298062  1525 raft_consensus.cc:2468] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 2.
I20260709 12:59:24.298251  3181 raft_consensus.cc:2804] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:24.298295  1523 raft_consensus.cc:1240] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:24.298733  3181 raft_consensus.cc:493] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:24.299135  3181 raft_consensus.cc:3060] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:24.299849  3216 raft_consensus.cc:493] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:24.300379  3216 raft_consensus.cc:515] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:24.303213  1599 raft_consensus.cc:2468] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 2.
I20260709 12:59:24.307045  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:24.307739  1528 raft_consensus.cc:2376] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 4. Re-sending same reply.
I20260709 12:59:24.308979  3211 raft_consensus.cc:3060] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:24.314363  1681 raft_consensus.cc:1275] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:59:24.302492  3216 leader_election.cc:290] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:24.316962  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:24.317646  1681 raft_consensus.cc:2468] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 2.
I20260709 12:59:24.317788  1425 catalog_manager.cc:5697] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 reported cstate change: term changed from 1 to 2, leader changed from 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:24.325975  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:24.318045  3216 consensus_queue.cc:1048] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 12:59:24.328306  1606 raft_consensus.cc:2393] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 2: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 12:59:24.323505  3241 consensus_queue.cc:1048] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 12:59:24.329703  2192 leader_election.cc:304] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 12:59:24.317735  3181 raft_consensus.cc:515] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:24.330744  2191 leader_election.cc:304] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:24.332000  3181 leader_election.cc:290] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:24.331247  1531 raft_consensus.cc:1275] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:24.338181  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:24.339058  2218 raft_consensus.cc:1240] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:24.325490  3120 leader_election.cc:290] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 3 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:24.332671  3238 raft_consensus.cc:2804] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:24.338274  3239 raft_consensus.cc:2804] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:24.349474  3193 consensus_queue.cc:1059] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:24.350521  3193 raft_consensus.cc:3055] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:24.344728  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 12:59:24.351105  3193 raft_consensus.cc:740] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:24.351625  1603 raft_consensus.cc:1275] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:59:24.351709  2224 raft_consensus.cc:2393] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 3: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 12:59:24.342978  3238 raft_consensus.cc:493] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:24.352495  3238 raft_consensus.cc:3060] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:24.352118  3193 consensus_queue.cc:260] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:24.353572  3193 raft_consensus.cc:3060] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:24.343925  1570 leader_election.cc:304] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:24.352041  1603 pending_rounds.cc:85] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642: Aborting all ops after (but not including) 1
I20260709 12:59:24.355057  1603 pending_rounds.cc:107] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:59:24.355293  1603 raft_consensus.cc:2889] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:24.357041  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:24.355687  3137 raft_consensus.cc:2749] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:59:24.357738  1606 raft_consensus.cc:3060] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:24.355687  1570 leader_election.cc:304] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:24.349537  3239 raft_consensus.cc:493] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:24.359184  3239 raft_consensus.cc:3060] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:24.359632  1570 leader_election.cc:304] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:24.360347  3108 raft_consensus.cc:2804] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:24.360705  3108 raft_consensus.cc:493] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:24.361029  3108 raft_consensus.cc:3060] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:24.364635  3137 raft_consensus.cc:2749] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:24.365041  1606 raft_consensus.cc:2468] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 5.
I20260709 12:59:24.368640  1646 leader_election.cc:304] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:24.369263  1644 leader_election.cc:304] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:24.370537  3184 raft_consensus.cc:2804] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:24.369475  3130 raft_consensus.cc:2804] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:24.370963  3184 raft_consensus.cc:493] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 12:59:24.371361  3130 raft_consensus.cc:697] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 5 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:24.372231  3130 consensus_queue.cc:237] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:24.371366  3184 raft_consensus.cc:3060] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:24.377590  1677 raft_consensus.cc:1275] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:24.379657  1644 leader_election.cc:304] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 12:59:24.381670  1570 leader_election.cc:304] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:24.382056  3137 consensus_queue.cc:1059] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:24.383142  1570 leader_election.cc:304] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:24.383381  3122 raft_consensus.cc:2804] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:24.383292  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:24.384341  1527 raft_consensus.cc:3060] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:24.385162  1531 raft_consensus.cc:1275] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:59:24.381345  1644 leader_election.cc:304] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:24.384831  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 12:59:24.393637  3164 raft_consensus.cc:493] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:24.448050  1497 leader_election.cc:304] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:24.447701  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:24.448733  1531 raft_consensus.cc:2376] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 3. Re-sending same reply.
I20260709 12:59:24.409360  3181 raft_consensus.cc:2804] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:59:24.453730  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 69638.8us
I20260709 12:59:24.447501  3098 raft_consensus.cc:2749] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:24.451388  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:24.462918  1527 raft_consensus.cc:2468] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 3.
I20260709 12:59:24.413542  3209 consensus_queue.cc:1048] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 12:59:24.444911  3120 raft_consensus.cc:493] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:24.411612  3164 raft_consensus.cc:515] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:24.474231  2220 raft_consensus.cc:2393] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 3: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 12:59:24.474148  3120 raft_consensus.cc:515] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:24.475757  3164 leader_election.cc:290] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:24.463608  3122 raft_consensus.cc:697] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 2 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:24.476256  3120 leader_election.cc:290] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:24.476394  3180 raft_consensus.cc:493] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:24.469731  2190 leader_election.cc:304] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:24.476917  3180 raft_consensus.cc:515] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:24.478673  3120 raft_consensus.cc:2804] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:24.479650  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:24.480444  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:24.466868  3202 raft_consensus.cc:2749] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:59:24.466578  3181 raft_consensus.cc:697] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 2 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:24.501032  1681 raft_consensus.cc:2468] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 1.
I20260709 12:59:24.477010  3122 consensus_queue.cc:237] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:24.514170  2191 leader_election.cc:304] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:24.518846  3108 raft_consensus.cc:515] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:24.519709  3137 consensus_queue.cc:1048] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:24.521090  3108 leader_election.cc:290] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:24.512724  3248 raft_consensus.cc:2804] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:24.508975  3120 raft_consensus.cc:697] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 3 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 12:59:24.500411  3211 raft_consensus.cc:515] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:24.534809  3253 raft_consensus.cc:493] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 12:59:24.535414  3253 raft_consensus.cc:515] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 12:59:24.534351  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 151293us
I20260709 12:59:24.539456  1570 leader_election.cc:304] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:24.540031  3241 raft_consensus.cc:2804] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:24.540455  3241 raft_consensus.cc:493] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:24.540546  3202 raft_consensus.cc:493] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
W20260709 12:59:24.514305  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 133013us
I20260709 12:59:24.544026  1644 leader_election.cc:304] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:24.515844  3239 raft_consensus.cc:515] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 12:59:24.549490  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 83171.4us
I20260709 12:59:24.532017  3248 raft_consensus.cc:697] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 4 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:24.552966  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:24.544667  3241 raft_consensus.cc:3060] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:24.554140  1570 leader_election.cc:304] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:24.554157  3098 raft_consensus.cc:3060] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:24.596128  1570 leader_election.cc:304] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:24.585089  3154 raft_consensus.cc:493] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:24.596729  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 52776.7us
I20260709 12:59:24.603809  3258 raft_consensus.cc:2749] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:24.604606  3256 raft_consensus.cc:2804] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:24.609156  1644 leader_election.cc:304] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:24.551651  3202 raft_consensus.cc:515] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:24.636873  3202 leader_election.cc:290] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:24.638489  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:24.605118  3154 raft_consensus.cc:515] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:24.640697  3154 leader_election.cc:290] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 12:59:24.642062  3247 log.cc:927] Time spent T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 12:59:24.604504  3249 raft_consensus.cc:493] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:24.643529  3249 raft_consensus.cc:515] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:24.632089  3253 leader_election.cc:290] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:24.633103  3251 raft_consensus.cc:3055] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:24.644922  3251 raft_consensus.cc:740] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:24.552263  3181 consensus_queue.cc:237] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:24.602286  3262 raft_consensus.cc:2804] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:24.645768  3249 leader_election.cc:290] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:24.645846  3251 consensus_queue.cc:260] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 12:59:24.665517  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 61460.8us
I20260709 12:59:24.660682  3239 leader_election.cc:290] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 2 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:24.669442  1570 leader_election.cc:304] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 12:59:24.674093  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 65037.7us
I20260709 12:59:24.674933  1644 leader_election.cc:304] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:24.675705  3156 raft_consensus.cc:3060] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:24.675505  3184 raft_consensus.cc:515] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:24.677404  3180 leader_election.cc:290] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:24.678850  3108 consensus_queue.cc:1059] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:24.679723  3211 leader_election.cc:290] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:24.680011  3108 raft_consensus.cc:3055] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:24.680379  3108 raft_consensus.cc:740] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:24.680613  3251 raft_consensus.cc:3060] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:24.681110  3108 consensus_queue.cc:260] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:24.679051  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:24.671386  1425 catalog_manager.cc:5697] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:24.690474  3108 raft_consensus.cc:3060] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:24.690976  3184 leader_election.cc:290] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 2 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:24.646718  3120 consensus_queue.cc:237] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:24.672669  3256 raft_consensus.cc:697] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 2 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
W20260709 12:59:24.696749  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 58578.1us
I20260709 12:59:24.699921  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:24.700562  1678 raft_consensus.cc:2468] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 1.
I20260709 12:59:24.703303  2220 raft_consensus.cc:1275] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:24.704335  3261 raft_consensus.cc:2749] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:24.705945  1644 leader_election.cc:304] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:24.695153  3262 raft_consensus.cc:697] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 2 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:24.707095  1644 leader_election.cc:304] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:24.674109  3259 consensus_queue.cc:1059] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 12:59:24.707731  3262 consensus_queue.cc:237] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:24.709132  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 12:59:24.709380  1644 leader_election.cc:304] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:24.709950  2218 raft_consensus.cc:2393] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 2: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 12:59:24.710752  3252 consensus_queue.cc:1048] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:24.712086  3252 raft_consensus.cc:3060] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:24.711740  3256 consensus_queue.cc:237] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:24.701642  1570 leader_election.cc:304] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:24.716475  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:24.693969  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:24.695302  3130 raft_consensus.cc:493] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:24.719053  3244 raft_consensus.cc:2749] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:24.698891  3258 raft_consensus.cc:2749] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:24.659118  3248 consensus_queue.cc:237] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 12:59:24.732373  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 284410us
I20260709 12:59:24.733739  1644 leader_election.cc:304] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:24.736506  1497 leader_election.cc:304] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:24.739035  1673 raft_consensus.cc:2468] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 3.
I20260709 12:59:24.746078  1673 raft_consensus.cc:1275] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:59:24.746440  1570 leader_election.cc:304] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:24.719229  3253 raft_consensus.cc:3060] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:24.686831  3238 raft_consensus.cc:515] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:24.773613  1570 leader_election.cc:304] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
W20260709 12:59:24.782433  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 45998.7us
I20260709 12:59:24.772182  3193 raft_consensus.cc:2804] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:59:24.787245  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 53587us
I20260709 12:59:24.775977  3164 raft_consensus.cc:493] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:24.728127  3130 raft_consensus.cc:515] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:24.776585  3211 raft_consensus.cc:2749] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:24.776873  3098 raft_consensus.cc:2749] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:24.777921  3259 raft_consensus.cc:2749] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:24.756148  3180 consensus_queue.cc:1059] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 12:59:24.800748  3098 raft_consensus.cc:2749] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:24.804913  3164 raft_consensus.cc:515] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:24.805534  3259 raft_consensus.cc:493] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 12:59:24.807245  3164 leader_election.cc:290] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:24.808418  3130 leader_election.cc:290] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:24.792397  3258 raft_consensus.cc:2804] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:24.809268  3258 raft_consensus.cc:697] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 3 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:24.810199  3258 consensus_queue.cc:237] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:24.811784  3238 leader_election.cc:290] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 3 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:24.813470  3156 raft_consensus.cc:2749] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:24.789472  3193 raft_consensus.cc:493] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:24.814891  3193 raft_consensus.cc:3060] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:24.829540  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:24.806224  3259 raft_consensus.cc:515] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:24.819654  3211 raft_consensus.cc:3055] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:24.827440  3137 raft_consensus.cc:493] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
W20260709 12:59:24.877209  1572 consensus_peers.cc:597] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 -> Peer b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373): Couldn't send request to peer b96ce9cc496c49d7818fa983a17b062b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4190d217954f4f798b3a610501115290. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:24.880724  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 49976.6us
I20260709 12:59:24.840068  3211 raft_consensus.cc:740] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 12:59:24.903905   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:59:24.905249  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 206973us
W20260709 12:59:24.920379  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 130453us
I20260709 12:59:24.882951  3137 raft_consensus.cc:515] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:24.934197  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:24.957063  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:24.958390  1603 raft_consensus.cc:2393] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 2: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 12:59:24.960733  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:24.961364  1607 raft_consensus.cc:2468] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 2.
I20260709 12:59:24.963405  1605 raft_consensus.cc:2468] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 2.
I20260709 12:59:24.930908  3181 raft_consensus.cc:493] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:24.952425  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:24.962256  3239 raft_consensus.cc:493] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:24.943585  3156 consensus_queue.cc:1048] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 12:59:24.964535  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 12:59:24.990300  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 207117us
I20260709 12:59:24.992574  1497 leader_election.cc:304] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:24.993604  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:24.985244  1523 raft_consensus.cc:3060] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:24.997253  1602 raft_consensus.cc:2368] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b for earlier term 4. Current term is 5.
I20260709 12:59:24.954685  3211 consensus_queue.cc:260] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:24.987389  2218 raft_consensus.cc:1275] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:24.966427  3258 raft_consensus.cc:493] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:24.997490  1497 leader_election.cc:304] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:25.002090  1571 leader_election.cc:304] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:24.992391  3239 raft_consensus.cc:515] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 12:59:25.007210  3267 log.cc:927] Time spent T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 12:59:25.008999  3277 raft_consensus.cc:493] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 12:59:25.009593  3277 raft_consensus.cc:515] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 12:59:25.011564  3269 log.cc:927] Time spent T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:59:24.999909  3202 raft_consensus.cc:2749] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:59:25.022773  3259 leader_election.cc:290] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:25.023865  1496 leader_election.cc:304] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:24.993726  3262 raft_consensus.cc:493] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 12:59:25.024628  3262 raft_consensus.cc:515] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:25.000396  3130 consensus_queue.cc:1048] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
W20260709 12:59:25.010378  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 496319us
I20260709 12:59:25.037489  3276 consensus_queue.cc:1059] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 12:59:25.038674  3276 raft_consensus.cc:3055] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:25.039086  3276 raft_consensus.cc:740] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:25.039928  3276 consensus_queue.cc:260] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:25.042321  3263 raft_consensus.cc:493] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:25.042903  3263 raft_consensus.cc:515] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 12:59:25.045842  3272 log.cc:927] Time spent T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:59:25.042929  3249 raft_consensus.cc:3055] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:25.047001  3249 raft_consensus.cc:740] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:24.993366  2220 raft_consensus.cc:2468] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 3.
I20260709 12:59:25.047811  3249 consensus_queue.cc:260] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:25.048791  3249 raft_consensus.cc:3060] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:25.047020  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:25.065492  3254 raft_consensus.cc:493] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 12:59:25.065524  3255 raft_consensus.cc:493] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:25.068745  3255 raft_consensus.cc:515] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:25.067787  3254 raft_consensus.cc:515] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:25.087883  3274 raft_consensus.cc:2749] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:59:25.065667  3264 consensus_queue.cc:1048] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 12:59:25.004277  3258 raft_consensus.cc:515] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:25.063319  3202 raft_consensus.cc:2804] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:25.094340  3202 raft_consensus.cc:697] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 12:59:25.095273  3202 consensus_queue.cc:237] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 12:59:25.131083  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 129154us
I20260709 12:59:25.135283  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:25.136016  3108 raft_consensus.cc:2804] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:25.133891  3238 raft_consensus.cc:493] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:25.136478  3108 raft_consensus.cc:493] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:25.133795  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 145096us
I20260709 12:59:25.143503  1646 leader_election.cc:304] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:24.988094  3181 raft_consensus.cc:515] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:25.147594  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:25.148988  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:25.152791  1673 raft_consensus.cc:2393] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 3: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
W20260709 12:59:25.145164  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 119888us
I20260709 12:59:25.136930  3108 raft_consensus.cc:3060] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:25.161324  1605 raft_consensus.cc:1240] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:25.136016  3239 leader_election.cc:290] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:25.162698  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:25.141227  3164 raft_consensus.cc:493] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:25.167802  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:25.168660  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:25.142607  3276 raft_consensus.cc:3060] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:25.169982  1679 raft_consensus.cc:2468] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 2.
I20260709 12:59:25.171012  1524 raft_consensus.cc:2468] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 2.
I20260709 12:59:25.175752  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:25.176379  1600 raft_consensus.cc:2468] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 2.
I20260709 12:59:25.179400  3254 leader_election.cc:290] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:25.181416  3273 consensus_queue.cc:1048] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 12:59:25.145213  3137 leader_election.cc:290] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:25.183518  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:25.186122  1606 raft_consensus.cc:2468] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 2.
I20260709 12:59:25.160231  3184 raft_consensus.cc:2804] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:25.154968  3258 leader_election.cc:290] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:25.136874  3238 raft_consensus.cc:515] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:25.186853  2190 leader_election.cc:304] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:25.194788  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:25.196244  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:25.200281  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:25.200929  1598 raft_consensus.cc:3060] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:59:25.201249  3251 consensus_meta.cc:287] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.520s	user 0.009s	sys 0.007s
I20260709 12:59:25.202533  1606 raft_consensus.cc:1275] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:25.184729  3164 raft_consensus.cc:515] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:25.205531  3164 leader_election.cc:290] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:25.204947  3256 raft_consensus.cc:2955] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:59:25.183400  3211 raft_consensus.cc:3060] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:25.214299  1646 leader_election.cc:304] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:25.217447  1571 leader_election.cc:304] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:25.197198  3184 raft_consensus.cc:493] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:25.197979  3137 raft_consensus.cc:476] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 3 LEADER]: Not starting pre-election -- already a leader
I20260709 12:59:25.228766  1523 raft_consensus.cc:2468] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 3.
I20260709 12:59:25.234283  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 12:59:25.235162  3278 log.cc:927] Time spent T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 12:59:25.236056  3262 leader_election.cc:290] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:25.226519  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:25.240376  1524 raft_consensus.cc:2468] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 3.
I20260709 12:59:25.229408  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:25.238210  2190 leader_election.cc:304] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:25.239267  3130 consensus_queue.cc:1059] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 12:59:25.244216  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:25.210812  3255 leader_election.cc:290] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:25.216574  3164 raft_consensus.cc:2804] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:25.233052  3154 raft_consensus.cc:2804] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:25.229094  3184 raft_consensus.cc:3060] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:25.247727  3193 raft_consensus.cc:515] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:25.253814  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:25.257344  1601 raft_consensus.cc:3060] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:25.259446  3289 raft_consensus.cc:493] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:25.236963  3253 raft_consensus.cc:2749] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:25.262394  1674 raft_consensus.cc:2468] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 2.
I20260709 12:59:25.268414  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:25.249567  3164 raft_consensus.cc:493] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:25.269274  2223 raft_consensus.cc:2468] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 3.
I20260709 12:59:25.241048  3277 leader_election.cc:290] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:25.252668  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:25.252395  3154 raft_consensus.cc:493] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 12:59:25.293421  1605 raft_consensus.cc:1240] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:25.237213  1679 raft_consensus.cc:2955] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
W20260709 12:59:25.299965  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 139514us
I20260709 12:59:25.264149  3239 raft_consensus.cc:2804] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:25.271606  3287 raft_consensus.cc:2804] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:59:25.291328  3241 consensus_meta.cc:287] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b: Time spent flushing consensus metadata: real 0.690s	user 0.010s	sys 0.009s
W20260709 12:59:25.301964  3252 consensus_meta.cc:287] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.579s	user 0.000s	sys 0.014s
I20260709 12:59:25.291960  3164 raft_consensus.cc:3060] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:25.299806  3156 raft_consensus.cc:493] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:25.324221  2192 leader_election.cc:400] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 4 pre-election: Vote denied by peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303) with higher term. Message: Invalid argument: T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b for earlier term 4. Current term is 5.
I20260709 12:59:25.329454  2192 leader_election.cc:403] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:59:25.317399  3216 raft_consensus.cc:493] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:25.306900  3154 raft_consensus.cc:3060] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:25.265811  3244 consensus_queue.cc:1048] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 12:59:25.317507  3287 raft_consensus.cc:493] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 12:59:25.325135  3239 raft_consensus.cc:697] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 3 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 12:59:25.352506  3238 leader_election.cc:290] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:25.337138  3252 raft_consensus.cc:2749] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:25.339268  3181 leader_election.cc:290] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:25.334792  3156 raft_consensus.cc:515] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:25.408151  1678 raft_consensus.cc:1240] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:25.303211  3289 raft_consensus.cc:515] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:25.344311  3287 raft_consensus.cc:3060] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:25.335875  3216 raft_consensus.cc:515] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:25.367262  3238 raft_consensus.cc:3060] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Advancing to term 5
W20260709 12:59:25.365276  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 367861us
W20260709 12:59:25.413542  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 82398.8us
I20260709 12:59:25.328238  3241 raft_consensus.cc:515] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:25.423640  2192 leader_election.cc:304] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 12:59:25.428385  3241 leader_election.cc:290] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 3 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:25.430117  3241 raft_consensus.cc:2804] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:25.431154  3241 raft_consensus.cc:493] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:25.431651  3241 raft_consensus.cc:3060] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:25.431250  2220 raft_consensus.cc:2393] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 3: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 12:59:25.449846  3289 leader_election.cc:290] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 12:59:25.452474  3286 log.cc:927] Time spent T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:59:25.455067  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
W20260709 12:59:25.456332  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 211181us
I20260709 12:59:25.459257  1497 leader_election.cc:304] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:25.412681  3252 raft_consensus.cc:493] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:25.468062  1674 raft_consensus.cc:1275] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:25.452353  3193 leader_election.cc:290] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 12:59:25.480369  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 255708us
I20260709 12:59:25.484058  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:25.484344  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:25.412153  3285 raft_consensus.cc:493] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:25.486579  2191 leader_election.cc:304] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:25.484743  1570 leader_election.cc:304] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:25.467250  3209 raft_consensus.cc:493] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:25.499322  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:25.499974  1607 raft_consensus.cc:2468] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 4.
W20260709 12:59:25.500209  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 73293.2us
I20260709 12:59:25.466967  3264 consensus_queue.cc:1048] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 12:59:25.491644  3289 raft_consensus.cc:2749] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:59:25.515520  1602 raft_consensus.cc:1275] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:59:25.499498  3258 raft_consensus.cc:493] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:25.527506  3256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:57256 (request call id 12) took 1244 ms. Trace:
I20260709 12:59:25.503515  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:25.494124  3181 consensus_queue.cc:1048] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 12:59:25.478194  3252 raft_consensus.cc:515] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:25.543645  1672 raft_consensus.cc:1275] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:25.532806  3256 rpcz_store.cc:276] 0709 12:59:24.282957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:24.283054 (+    97us) service_pool.cc:224] Handling call
0709 12:59:24.320862 (+ 37808us) log.cc:844] Serialized 506 byte log entry
0709 12:59:25.527400 (+1206538us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11737,"raft.queue_time_us":12246,"raft.run_cpu_time_us":1795,"raft.run_wall_time_us":8517,"thread_start_us":41648,"threads_started":1,"wal-append.queue_time_us":26415,"wal-append.run_cpu_time_us":1831,"wal-append.run_wall_time_us":1009419}
I20260709 12:59:25.528234  3202 raft_consensus.cc:493] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:25.503157  3209 raft_consensus.cc:515] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:25.504689  3180 consensus_queue.cc:1048] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 12:59:25.559773  1679 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b"
dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
mode: GRACEFUL
new_leader_uuid: "39a92f5a4352465d8af3af5908fe8642"
 from {username='slave'} at 127.0.0.1:33616
I20260709 12:59:25.497776  3285 raft_consensus.cc:515] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:25.558682  3301 consensus_queue.cc:1048] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
W20260709 12:59:25.562152  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 75657.3us
I20260709 12:59:25.489619  3239 consensus_queue.cc:237] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 12:59:25.569248  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 84578.4us
I20260709 12:59:25.538245  3289 raft_consensus.cc:493] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
W20260709 12:59:25.586531  1570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:25.587087  1570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:25.547636  3253 raft_consensus.cc:493] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:25.543723  3284 raft_consensus.cc:2804] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:59:25.559829  3295 log.cc:927] Time spent T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:59:25.536288  3258 raft_consensus.cc:515] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:25.603441  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:25.604417  1675 raft_consensus.cc:3060] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:59:25.568185  1676 raft_consensus.cc:2468] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 2.
W20260709 12:59:25.592012  3249 consensus_meta.cc:287] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.539s	user 0.014s	sys 0.003s
I20260709 12:59:25.579001  3277 consensus_queue.cc:1048] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 12:59:25.604247  3108 raft_consensus.cc:515] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:25.624219  3292 raft_consensus.cc:2749] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:25.625149  3108 leader_election.cc:290] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:25.605855  1598 raft_consensus.cc:2468] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 3.
I20260709 12:59:25.627175  3263 leader_election.cc:290] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 12:59:25.630481  3288 log.cc:927] Time spent T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.469s	user 0.000s	sys 0.002s
I20260709 12:59:25.636878  3285 leader_election.cc:290] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:25.638362  1677 consensus_queue.cc:237] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:59:25.567569  3202 raft_consensus.cc:515] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:25.595971  3289 raft_consensus.cc:515] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:25.610497  3254 raft_consensus.cc:493] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:25.659160  1601 raft_consensus.cc:1275] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:25.657923  3258 leader_election.cc:290] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:25.612958  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:25.711438  3254 raft_consensus.cc:515] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:25.712395  1672 raft_consensus.cc:2468] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 2.
I20260709 12:59:25.655604  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:25.713819  1680 raft_consensus.cc:2468] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 3.
I20260709 12:59:25.713871  3254 leader_election.cc:290] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:25.643620  3216 leader_election.cc:290] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:25.603948  3253 raft_consensus.cc:515] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:25.717079  3253 leader_election.cc:290] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:25.658582  3291 raft_consensus.cc:493] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
W20260709 12:59:25.654263  3298 log.cc:927] Time spent T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.223s	user 0.002s	sys 0.000s
I20260709 12:59:25.589490  3154 raft_consensus.cc:515] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:25.670152  3238 raft_consensus.cc:2749] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303) with higher term. Message: Invalid argument: T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b for earlier term 4. Current term is 5.
I20260709 12:59:25.673378  3209 leader_election.cc:290] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:25.675127  3156 leader_election.cc:290] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:25.719066  3291 raft_consensus.cc:515] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:25.720266  2223 raft_consensus.cc:1275] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:59:25.687544  3202 leader_election.cc:290] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:25.721297  3154 leader_election.cc:290] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:25.689704  3273 raft_consensus.cc:3055] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:25.721930  3273 raft_consensus.cc:740] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:25.722913  3273 consensus_queue.cc:260] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:25.724851  3273 raft_consensus.cc:3060] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:59:25.725828  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 140426us
I20260709 12:59:25.727649  1572 leader_election.cc:304] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:25.729082  3098 raft_consensus.cc:493] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:25.729638  3098 raft_consensus.cc:515] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:25.730012  3256 raft_consensus.cc:2804] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:25.730404  3256 raft_consensus.cc:493] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:25.730774  3256 raft_consensus.cc:3060] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:25.731846  3098 leader_election.cc:290] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:25.735303  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:25.735960  1673 raft_consensus.cc:2468] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 5.
I20260709 12:59:25.737167  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:25.738020  1599 raft_consensus.cc:2393] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 3: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 12:59:25.734685  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:25.740773  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:25.742081  1605 raft_consensus.cc:3055] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:25.742476  1605 raft_consensus.cc:740] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:25.743234  1605 consensus_queue.cc:260] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:25.744215  1605 raft_consensus.cc:3060] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:25.744540  1425 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46274 (request call id 357) took 1098 ms. Trace:
I20260709 12:59:25.747593  1678 raft_consensus.cc:1275] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:25.748601  3284 raft_consensus.cc:697] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 3 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:25.748410  1428 catalog_manager.cc:5697] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 1 to 2, leader changed from e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) to 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:25.749492  3284 consensus_queue.cc:237] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:25.751557  3289 leader_election.cc:290] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:25.744899  1425 rpcz_store.cc:276] 0709 12:59:24.646520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:24.646909 (+   389us) service_pool.cc:224] Handling call
0709 12:59:25.744447 (+1097538us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:24.690916 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:24.691440 (+   524us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:24.691481 (+    41us) write_op.cc:435] Acquired schema lock
0709 12:59:24.691494 (+    13us) tablet.cc:662] Decoding operations
0709 12:59:24.693938 (+  2444us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:24.693997 (+    59us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:24.694024 (+    27us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:59:24.715089 (+ 21065us) tablet.cc:701] Row locks acquired
0709 12:59:24.715106 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:59:24.731437 (+ 16331us) write_op.cc:270] Start()
0709 12:59:24.748317 (+ 16880us) write_op.cc:276] Timestamp: P: 1783601964728533 usec, L: 0
0709 12:59:24.748343 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 12:59:24.822070 (+ 73727us) log.cc:844] Serialized 536 byte log entry
0709 12:59:25.049109 (+227039us) op_driver.cc:464] REPLICATION: finished
0709 12:59:25.427438 (+378329us) write_op.cc:301] APPLY: starting
0709 12:59:25.427525 (+    87us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:25.427634 (+   109us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:25.427749 (+   115us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:25.427947 (+   198us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:25.428093 (+   146us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:59:25.428133 (+    40us) write_op.cc:312] APPLY: finished
0709 12:59:25.428315 (+   182us) log.cc:844] Serialized 23 byte log entry
0709 12:59:25.428491 (+   176us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:25.428569 (+    78us) write_op.cc:454] Released schema lock
0709 12:59:25.428603 (+    34us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:25.428948 (+   345us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:25.428976 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":378041,"apply.run_cpu_time_us":1518,"apply.run_wall_time_us":1525,"num_ops":1,"prepare.queue_time_us":631,"prepare.run_cpu_time_us":3198,"prepare.run_wall_time_us":141033,"replication_time_us":292885,"thread_start_us":281289,"threads_started":1}]]}
I20260709 12:59:25.761476  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:25.764273  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:25.721338  3291 leader_election.cc:290] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:25.767195  1678 raft_consensus.cc:1275] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:59:25.641268  3241 raft_consensus.cc:515] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:25.773151  3241 leader_election.cc:290] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 4 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:25.777953  1571 leader_election.cc:304] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:25.719515  1679 raft_consensus.cc:606] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Received request to transfer leadership to TS 39a92f5a4352465d8af3af5908fe8642
I20260709 12:59:25.779583  1679 raft_consensus.cc:614] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:25.692947  3252 leader_election.cc:290] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:25.778623  3258 consensus_queue.cc:1048] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:59:25.786875  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:25.663367  3184 raft_consensus.cc:515] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:25.787124  1679 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf"
dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
mode: GRACEFUL
new_leader_uuid: "39a92f5a4352465d8af3af5908fe8642"
 from {username='slave'} at 127.0.0.1:33616
I20260709 12:59:25.696089  3164 raft_consensus.cc:515] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:25.787865  1679 raft_consensus.cc:606] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 5 LEADER]: Received request to transfer leadership to TS 39a92f5a4352465d8af3af5908fe8642
I20260709 12:59:25.787937  1681 raft_consensus.cc:2393] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 4: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 12:59:25.788595  2222 raft_consensus.cc:2393] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 3: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 12:59:25.790292  3164 leader_election.cc:290] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 3 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:25.791029  3287 raft_consensus.cc:515] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:25.792431  1680 raft_consensus.cc:2393] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 3: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 12:59:25.792304  3258 raft_consensus.cc:2804] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:25.792804  3258 raft_consensus.cc:493] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:25.793159  3258 raft_consensus.cc:3060] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:59:25.794272  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 153591us
I20260709 12:59:25.795033  2190 leader_election.cc:304] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:25.796227  2190 leader_election.cc:304] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:25.796640  3120 raft_consensus.cc:2749] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:25.797454  3120 raft_consensus.cc:2804] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:25.797816  3120 raft_consensus.cc:493] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:25.798130  3120 raft_consensus.cc:3060] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:25.799881  3307 raft_consensus.cc:493] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 12:59:25.800486  3307 raft_consensus.cc:515] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:25.801889  3154 consensus_queue.cc:1048] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:25.802767  3307 leader_election.cc:290] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:25.803102   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:59:25.804680   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:25.806934  3108 consensus_queue.cc:1048] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:25.808225  3254 raft_consensus.cc:493] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:25.808398  3120 raft_consensus.cc:515] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:25.809314  3254 raft_consensus.cc:515] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:25.813650  3120 leader_election.cc:290] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 4 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:25.816442  3181 consensus_queue.cc:1059] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:25.816916  3190 raft_consensus.cc:493] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:25.817711  3252 raft_consensus.cc:3055] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:25.817605  3190 raft_consensus.cc:515] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:25.818118  3252 raft_consensus.cc:740] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:25.819022  3252 consensus_queue.cc:260] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:25.822530  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:25.823043  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:25.823242  1527 raft_consensus.cc:2468] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 2.
I20260709 12:59:25.824147  3211 raft_consensus.cc:493] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:25.824657  3180 raft_consensus.cc:493] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:25.825163  3180 raft_consensus.cc:515] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:25.827104  3180 leader_election.cc:290] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:25.827571  3180 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:25.827935  3180 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:25.828331  1525 raft_consensus.cc:1275] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:25.829279  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:25.829655  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:25.829885  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:25.830245  1529 raft_consensus.cc:2468] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 2.
I20260709 12:59:25.830413  1524 raft_consensus.cc:2468] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 4.
I20260709 12:59:25.831292  3309 raft_consensus.cc:493] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:25.831861  3309 raft_consensus.cc:515] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:25.833504  3180 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:25.834462  3184 leader_election.cc:290] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:25.824646  3211 raft_consensus.cc:515] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:25.836694  3211 leader_election.cc:290] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:25.839295  2190 leader_election.cc:304] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:25.868573  3209 raft_consensus.cc:2804] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:25.869015  3209 raft_consensus.cc:493] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:25.869385  3209 raft_consensus.cc:3060] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:25.840574  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:25.872496  1605 raft_consensus.cc:1275] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 12:59:25.872921  1605 pending_rounds.cc:85] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642: Aborting all ops after (but not including) 4
I20260709 12:59:25.873121  1605 pending_rounds.cc:107] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 12:59:25.873332  1605 raft_consensus.cc:2889] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:25.873608  3180 raft_consensus.cc:493] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:25.841310  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:25.875728  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:25.876339  1523 raft_consensus.cc:3060] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:25.876130  1427 catalog_manager.cc:5697] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 2 to 3, leader changed from ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) to e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:25.880708  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:25.842272  1531 raft_consensus.cc:1275] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:25.881469  1524 raft_consensus.cc:2393] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 4: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 12:59:25.881947  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:25.882208  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:25.882575  1531 raft_consensus.cc:2468] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 2.
I20260709 12:59:25.883478  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:25.884034  1531 raft_consensus.cc:2468] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 5.
I20260709 12:59:25.843042  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:25.843758  3190 leader_election.cc:290] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:25.833917  3309 leader_election.cc:290] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:25.829828  1525 raft_consensus.cc:2468] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 3.
I20260709 12:59:25.885383  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:25.886276  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:25.886901  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:25.887440  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:25.887914  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:25.888046  1525 raft_consensus.cc:2468] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 2.
I20260709 12:59:25.888613  1529 raft_consensus.cc:2393] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 2: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 12:59:25.888926  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:25.889005  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:25.889307  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:25.889791  1529 raft_consensus.cc:3060] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:25.889973  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:25.845909  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:25.890915  1525 raft_consensus.cc:2393] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 2: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 12:59:25.891599  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:25.891732  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:25.892323  1525 raft_consensus.cc:2468] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 2.
I20260709 12:59:25.892825  1677 raft_consensus.cc:1240] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:25.892951  1530 raft_consensus.cc:1275] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:25.894021  1530 raft_consensus.cc:1240] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:25.844185  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:25.884791  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:25.907074  1532 raft_consensus.cc:1240] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:25.908666  1532 raft_consensus.cc:1275] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:25.909603  1497 leader_election.cc:304] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:25.850282  3256 raft_consensus.cc:515] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:25.860232  1496 leader_election.cc:304] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
W20260709 12:59:25.862131  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:25.914433  1644 leader_election.cc:304] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:25.915613  1644 leader_election.cc:304] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:25.916419  3190 raft_consensus.cc:2749] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:59:25.865561  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:25.916757  3279 raft_consensus.cc:2804] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:59:25.916420  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 56291.8us
I20260709 12:59:25.917569  3261 consensus_queue.cc:1048] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:25.919602  2190 leader_election.cc:304] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:25.874179  3180 raft_consensus.cc:515] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:25.920789  3299 consensus_queue.cc:1048] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:25.717355  1675 raft_consensus.cc:2468] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 3.
I20260709 12:59:25.921646  3180 leader_election.cc:290] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:25.922183  3299 raft_consensus.cc:2804] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:25.922616  3299 raft_consensus.cc:493] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:25.922971  3299 raft_consensus.cc:3060] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:25.922148  3180 raft_consensus.cc:493] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:25.923764  3180 raft_consensus.cc:515] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:25.909905  1532 raft_consensus.cc:1240] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:25.930361  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:25.929929  1527 raft_consensus.cc:2468] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 2.
I20260709 12:59:25.917151  3279 raft_consensus.cc:493] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:25.849761  3252 raft_consensus.cc:3060] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:25.933380  1531 raft_consensus.cc:1275] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:59:25.866130  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 50714.3us
I20260709 12:59:25.914211  3256 leader_election.cc:290] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:25.929395  1497 leader_election.cc:304] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:25.947166  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:25.948500  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:25.926466  3180 leader_election.cc:290] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:25.967633  1644 leader_election.cc:304] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:25.914495  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:25.978394  1532 raft_consensus.cc:1275] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:25.978286  1678 raft_consensus.cc:1275] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:59:25.983529  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:25.982394  1529 raft_consensus.cc:2468] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 3.
I20260709 12:59:25.984341  1673 raft_consensus.cc:2368] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 3. Current term is 4.
I20260709 12:59:25.956579  3279 raft_consensus.cc:3060] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:25.986879  1644 leader_election.cc:304] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:25.990240  2190 leader_election.cc:304] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:25.995370  3287 leader_election.cc:290] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:25.956096  3274 consensus_queue.cc:1059] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 12:59:25.997592  3258 raft_consensus.cc:515] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:26.012580  1571 leader_election.cc:400] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 election: Vote denied by peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217) with higher term. Message: Invalid argument: T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 3. Current term is 4.
I20260709 12:59:26.013020  1571 leader_election.cc:403] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:59:25.993209  3299 raft_consensus.cc:515] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:26.015136  3256 raft_consensus.cc:3060] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:25.986114  1676 raft_consensus.cc:2468] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 3.
I20260709 12:59:26.022207  3209 raft_consensus.cc:515] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:26.023068  3297 raft_consensus.cc:2804] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:26.023876  3297 raft_consensus.cc:697] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 3 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 12:59:26.024516  3209 leader_election.cc:290] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 3 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:26.024775  3297 consensus_queue.cc:237] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:26.016816  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 12:59:26.027117  2218 raft_consensus.cc:2393] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 4: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 12:59:26.029872  1675 raft_consensus.cc:2468] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 2.
I20260709 12:59:25.984889  3184 consensus_queue.cc:1048] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
W20260709 12:59:26.044554  1646 consensus_peers.cc:597] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 -> Peer b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373): Couldn't send request to peer b96ce9cc496c49d7818fa983a17b062b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 04fed4c219e14efb9f9a8eb0d336ceac. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:26.079981  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 61488us
W20260709 12:59:26.044993  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 316195us
I20260709 12:59:26.084780  1644 leader_election.cc:304] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:26.073154  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:26.086511  1532 raft_consensus.cc:3060] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:26.088953  1644 leader_election.cc:304] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:26.088927  1570 leader_election.cc:304] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
W20260709 12:59:26.134531  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 90087.7us
W20260709 12:59:26.135424  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:26.138566  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 12:59:26.140267  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 51425.9us
I20260709 12:59:26.141700  1496 leader_election.cc:304] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:26.142637  1496 leader_election.cc:304] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:26.143628  1570 leader_election.cc:304] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:26.138283  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:26.085952  3154 raft_consensus.cc:493] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:26.035451  3253 raft_consensus.cc:2804] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:26.148061  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:26.088711  3309 raft_consensus.cc:493] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:26.121735  3274 raft_consensus.cc:493] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:26.153633  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:26.150231  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:26.054962  3289 raft_consensus.cc:3055] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:26.090114  3254 leader_election.cc:290] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:26.157050  1570 leader_election.cc:304] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:26.131511  3244 raft_consensus.cc:2804] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:26.073491  3130 consensus_queue.cc:1048] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 12:59:26.086453  3209 consensus_queue.cc:1048] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.075s
I20260709 12:59:26.179044  1603 raft_consensus.cc:2468] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 4.
I20260709 12:59:26.055321  3180 consensus_queue.cc:1048] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.099s
I20260709 12:59:26.184626  1606 raft_consensus.cc:1275] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:59:26.090346  3252 consensus_queue.cc:1048] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.063s
I20260709 12:59:26.187332  3259 raft_consensus.cc:2749] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:59:26.187722  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:26.188798  1570 leader_election.cc:304] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:26.148676  3108 raft_consensus.cc:2804] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:26.155402  3190 raft_consensus.cc:2804] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:26.152447  3211 raft_consensus.cc:2804] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:26.198462  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:26.181103  3284 raft_consensus.cc:2749] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:26.221720  1600 raft_consensus.cc:2393] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 3: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 12:59:26.209226  3304 raft_consensus.cc:3060] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:26.201645  1570 leader_election.cc:304] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 12:59:26.211266  3316 log.cc:927] Time spent T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:59:26.211786  3262 raft_consensus.cc:2749] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:26.205295  1532 raft_consensus.cc:2468] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 3.
I20260709 12:59:26.184926  3289 raft_consensus.cc:740] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 12:59:26.178793  1523 raft_consensus.cc:2468] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 4.
I20260709 12:59:26.231640  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:26.232266  1677 raft_consensus.cc:3060] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:26.182391  3309 raft_consensus.cc:515] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:26.216482  3108 raft_consensus.cc:493] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 12:59:26.215891  3190 raft_consensus.cc:493] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:26.173950  3154 raft_consensus.cc:515] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:26.229856  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:26.247823  1527 raft_consensus.cc:3060] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:26.227187  1570 leader_election.cc:304] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:26.183233  3274 raft_consensus.cc:515] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:26.235692  2190 leader_election.cc:304] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
W20260709 12:59:26.256983  3273 consensus_meta.cc:287] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.532s	user 0.008s	sys 0.003s
I20260709 12:59:26.221437  3211 raft_consensus.cc:493] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:26.258108  1681 raft_consensus.cc:2468] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 3.
I20260709 12:59:26.226004  3258 leader_election.cc:290] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:26.258461  3211 raft_consensus.cc:3060] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:26.234437  3156 raft_consensus.cc:2804] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:26.262912  3254 raft_consensus.cc:2804] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:26.263494  3254 raft_consensus.cc:697] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [term 3 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 12:59:26.264344  3254 consensus_queue.cc:237] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:26.242084  3108 raft_consensus.cc:3060] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:59:26.251832  2191 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.664s	user 0.010s	sys 0.009s
I20260709 12:59:26.228861  3248 raft_consensus.cc:2749] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:59:26.287387  2191 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.700s	user 0.010s	sys 0.009s
I20260709 12:59:26.240226  3190 raft_consensus.cc:3060] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:26.258379  3282 consensus_queue.cc:1059] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.074s
I20260709 12:59:26.304677  1527 raft_consensus.cc:2468] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 3.
W20260709 12:59:26.305950  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 79298.3us
I20260709 12:59:26.251216  3261 raft_consensus.cc:2804] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:26.287243  3258 raft_consensus.cc:493] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:26.365500  1677 raft_consensus.cc:2468] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 6.
I20260709 12:59:26.305430  3270 raft_consensus.cc:493] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:26.300724  3299 leader_election.cc:290] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 3 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:26.315033  3262 raft_consensus.cc:2749] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:26.380164  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 12:59:26.384310  2223 raft_consensus.cc:2393] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 3: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
W20260709 12:59:26.386072  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:26.379303  3260 raft_consensus.cc:2804] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:26.401930  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 12:59:26.404414  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 164229us
I20260709 12:59:26.406828  2190 leader_election.cc:304] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:26.421862  2190 leader_election.cc:304] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:26.312458  3289 consensus_queue.cc:260] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:26.375660  3258 raft_consensus.cc:515] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 12:59:26.439910  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:26.449415  2224 raft_consensus.cc:1275] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:59:26.382021  3270 raft_consensus.cc:515] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:26.448576  2220 raft_consensus.cc:1275] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:59:26.400513  3279 raft_consensus.cc:515] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:26.494113  3282 raft_consensus.cc:493] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:26.494864  3282 raft_consensus.cc:515] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:26.495895  3279 leader_election.cc:290] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:26.497205  3282 leader_election.cc:290] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:26.449915  3271 raft_consensus.cc:493] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:26.439767  3319 raft_consensus.cc:2804] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:26.456128  3241 raft_consensus.cc:2804] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:26.465529  3259 raft_consensus.cc:493] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:26.503132  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:26.503924  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:26.505395  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 12:59:26.518280  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 182602us
I20260709 12:59:26.506458  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:26.454738  3262 raft_consensus.cc:493] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:26.469983  3256 raft_consensus.cc:2749] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217) with higher term. Message: Invalid argument: T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 3. Current term is 4.
I20260709 12:59:26.525487  2225 raft_consensus.cc:2468] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 2.
W20260709 12:59:26.526180  3315 log.cc:927] Time spent T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.285s	user 0.001s	sys 0.000s
I20260709 12:59:26.517396  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:26.543469  1571 leader_election.cc:304] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:26.546267  3314 raft_consensus.cc:493] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:26.548827  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:26.550565  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36200 (request call id 1634) took 1037 ms. Trace:
I20260709 12:59:26.551074  1604 rpcz_store.cc:276] 0709 12:59:25.512663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:25.550641 (+ 37978us) service_pool.cc:224] Handling call
0709 12:59:25.603111 (+ 52470us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:25.757321 (+154210us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:25.757350 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:25.757816 (+   466us) log.cc:844] Serialized 26 byte log entry
0709 12:59:26.068883 (+311067us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:26.068930 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:26.069009 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:26.550194 (+481185us) raft_consensus.cc:1685] finished
0709 12:59:26.550220 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:26.550366 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":149611,"raft.queue_time_us":155032,"raft.run_cpu_time_us":51,"raft.run_wall_time_us":51,"thread_start_us":310644,"threads_started":1,"wal-append.queue_time_us":454182}
W20260709 12:59:26.552636  3320 log.cc:927] Time spent T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:59:26.522413  3259 raft_consensus.cc:515] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:26.559299  3130 raft_consensus.cc:493] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:26.559976  3130 raft_consensus.cc:515] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:26.560510  3259 leader_election.cc:290] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:26.561199  3259 raft_consensus.cc:2804] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:26.531013  3154 leader_election.cc:290] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:26.528667  3319 raft_consensus.cc:697] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 4 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
W20260709 12:59:26.563297  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 368784us
I20260709 12:59:26.515218  3271 raft_consensus.cc:515] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:26.568751  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:26.529033  3244 raft_consensus.cc:697] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 2 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:26.567330  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:26.569651  1677 raft_consensus.cc:2468] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 3.
I20260709 12:59:26.533661  3241 raft_consensus.cc:697] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 3 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 12:59:26.545441  3282 raft_consensus.cc:493] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:26.572417  1679 raft_consensus.cc:2468] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 2.
I20260709 12:59:26.549144  3273 raft_consensus.cc:493] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:26.547857  3309 leader_election.cc:290] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:26.576838  1570 leader_election.cc:304] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:26.534080  3262 raft_consensus.cc:515] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:26.549105  3314 raft_consensus.cc:515] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:26.567248  3274 leader_election.cc:290] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:26.604857  3259 raft_consensus.cc:697] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 6 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:26.581045  1672 raft_consensus.cc:2468] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 2.
I20260709 12:59:26.607075  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 12:59:26.610157  1646 leader_election.cc:304] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:26.620088  1646 leader_election.cc:304] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:26.619971  3259 consensus_queue.cc:237] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:26.626796  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:26.630843  2225 raft_consensus.cc:2393] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 3: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
W20260709 12:59:26.634511  3329 log.cc:927] Time spent T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 12:59:26.636147  2219 raft_consensus.cc:1240] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 3 LEADER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:26.636562  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 12:59:26.637365  2222 raft_consensus.cc:2368] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 3. Current term is 4.
I20260709 12:59:26.638266  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:26.639045  3348 raft_consensus.cc:2749] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:59:26.640136  3330 log.cc:927] Time spent T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:59:26.640564  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:26.638366  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 12:59:26.641247  3334 log.cc:927] Time spent T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 12:59:26.641688  3241 consensus_queue.cc:237] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:26.608548  3130 leader_election.cc:290] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:26.643325  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:26.657011  3252 raft_consensus.cc:2804] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:26.600788  3282 raft_consensus.cc:515] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:26.640483  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:26.584393  3273 raft_consensus.cc:515] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:26.634485  3342 consensus_queue.cc:1048] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 12:59:26.657778  3108 raft_consensus.cc:515] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:26.631511  3337 raft_consensus.cc:493] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:26.691701  3249 raft_consensus.cc:493] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:26.704058  3252 raft_consensus.cc:493] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:26.709291  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:26.709860  3252 raft_consensus.cc:3060] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:26.696221  3156 raft_consensus.cc:493] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:26.710239  3190 raft_consensus.cc:515] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:26.710937  3156 raft_consensus.cc:3060] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:26.712458  3190 leader_election.cc:290] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 2 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:26.705225  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:26.668536  3297 raft_consensus.cc:493] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:26.714644  3262 leader_election.cc:290] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:26.688488  2191 leader_election.cc:304] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 12:59:26.663367  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:26.715764  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:26.672223  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:26.706696  3271 leader_election.cc:290] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:26.716838  1675 raft_consensus.cc:2393] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 4: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 12:59:26.718338  3254 raft_consensus.cc:2804] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:26.719399  2191 leader_election.cc:304] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 12:59:26.659091  3304 raft_consensus.cc:2749] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:26.709671  3249 raft_consensus.cc:515] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 12:59:26.676815  3333 log.cc:927] Time spent T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 12:59:26.716184  1524 raft_consensus.cc:2468] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 2.
I20260709 12:59:26.709391  3337 raft_consensus.cc:515] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:26.678269  3258 leader_election.cc:290] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:26.723253  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
W20260709 12:59:26.735333  3331 log.cc:927] Time spent T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.169s	user 0.001s	sys 0.001s
I20260709 12:59:26.737426  1673 raft_consensus.cc:1275] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:26.718879  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:26.724810  2191 leader_election.cc:304] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:26.691044  3336 raft_consensus.cc:2749] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:26.676117  3350 consensus_queue.cc:1048] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 12:59:26.726573  3282 leader_election.cc:290] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:26.722205  3254 raft_consensus.cc:697] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 2 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 12:59:26.715216  3297 raft_consensus.cc:515] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:26.647506  3319 consensus_queue.cc:237] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:26.734175  3209 raft_consensus.cc:2804] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:26.728614  3252 raft_consensus.cc:515] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:26.752480  1676 raft_consensus.cc:2468] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 2.
I20260709 12:59:26.716401  3273 leader_election.cc:290] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:26.661845  3270 leader_election.cc:290] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:26.743420  2191 leader_election.cc:304] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:26.721529  3351 raft_consensus.cc:493] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
W20260709 12:59:26.746724  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 169978us
I20260709 12:59:26.705861  3211 raft_consensus.cc:515] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 12:59:26.752375  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 184586us
I20260709 12:59:26.757303  3249 leader_election.cc:290] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:26.764281  2191 leader_election.cc:304] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:26.769807  1571 leader_election.cc:304] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:26.777673  1675 raft_consensus.cc:2468] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 3.
I20260709 12:59:26.677352  3244 consensus_queue.cc:237] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:26.783056  1603 raft_consensus.cc:1240] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:26.784138  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:26.785018  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:26.753479  3357 raft_consensus.cc:493] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:26.789907  1572 leader_election.cc:304] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:26.794139  1602 raft_consensus.cc:2393] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 3: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 12:59:26.801304  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:26.802062  1602 raft_consensus.cc:2468] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 3.
I20260709 12:59:26.803383  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:26.763653  3209 raft_consensus.cc:697] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 3 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 12:59:26.804538  1602 raft_consensus.cc:2468] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 2.
I20260709 12:59:26.805459  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:26.807528  1607 raft_consensus.cc:2393] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 2: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 12:59:26.763828  3181 raft_consensus.cc:493] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:26.785732  3284 raft_consensus.cc:2804] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:26.785996  3164 raft_consensus.cc:2749] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:26.828510  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:26.829196  1602 raft_consensus.cc:3060] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:26.780264  3270 consensus_queue.cc:1048] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 12:59:26.831274  3164 raft_consensus.cc:2749] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:26.832116  3261 raft_consensus.cc:493] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:26.787042  3249 consensus_queue.cc:1048] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 12:59:26.836114  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:26.837299  3211 leader_election.cc:290] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:26.834339  3209 consensus_queue.cc:237] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:26.838773  3252 leader_election.cc:290] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:26.827090  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:26.862149  1602 raft_consensus.cc:2468] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 5.
W20260709 12:59:26.834743  3322 log.cc:927] Time spent T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.363s	user 0.001s	sys 0.000s
I20260709 12:59:26.869215  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:26.871224  3108 leader_election.cc:290] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:26.837901  3156 raft_consensus.cc:515] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:26.880638  3345 raft_consensus.cc:2749] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:26.881402  3305 raft_consensus.cc:493] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:26.881664  1528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43010 (request call id 1525) took 1055 ms. Trace:
I20260709 12:59:26.882030  1528 rpcz_store.cc:276] 0709 12:59:25.826204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:25.830473 (+  4269us) service_pool.cc:224] Handling call
0709 12:59:25.834263 (+  3790us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:25.834583 (+   320us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:25.834609 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:25.835083 (+   474us) log.cc:844] Serialized 26 byte log entry
0709 12:59:26.235046 (+399963us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:26.268548 (+ 33502us) log.cc:844] Serialized 14 byte log entry
0709 12:59:26.268769 (+   221us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:26.268837 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:26.739776 (+470939us) spinlock_profiling.cc:243] Waited 18.9 ms on lock 0x7b4400022b4c. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a153ecc85 00007f6a153ed6a2 00007f6a1815f1db 00007f6a1815aaaf 00007f6a1814e86e 00007f6a1814dbb6 00007f6a1814d7d8 00007f6a18157221 00007f6a181571d9 00007f6a18157169
0709 12:59:26.881331 (+141555us) raft_consensus.cc:1685] finished
0709 12:59:26.881434 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:26.881588 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":57924,"prepare.queue_time_us":29360,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":45022,"raft.run_cpu_time_us":216,"raft.run_wall_time_us":25060,"spinlock_wait_cycles":58047488,"thread_start_us":399311,"threads_started":1,"wal-append.queue_time_us":541795}
I20260709 12:59:26.884220  1531 raft_consensus.cc:1275] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:59:26.827644  3284 raft_consensus.cc:493] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:26.827702  3297 leader_election.cc:290] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:26.832132  3337 leader_election.cc:290] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:26.896420  3156 leader_election.cc:290] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:26.870294  3261 raft_consensus.cc:3060] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:26.906931  3313 raft_consensus.cc:3055] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:26.907491  3313 raft_consensus.cc:740] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:26.786055  3351 raft_consensus.cc:515] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:26.911451  3351 leader_election.cc:290] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:26.887223  3354 raft_consensus.cc:2804] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:26.913805  3354 raft_consensus.cc:493] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:26.914281  3354 raft_consensus.cc:3060] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:26.828989  3357 raft_consensus.cc:515] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:26.899528  3305 raft_consensus.cc:515] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:26.887681  2221 raft_consensus.cc:2468] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 1.
I20260709 12:59:26.903328  3314 leader_election.cc:290] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:26.868116  3254 consensus_queue.cc:237] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:26.913197  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49178 (request call id 1443) took 1024 ms. Trace:
W20260709 12:59:26.915153  3321 log.cc:927] Time spent T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.511s	user 0.001s	sys 0.000s
I20260709 12:59:26.908438  3313 consensus_queue.cc:260] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:59:26.933414  1681 rpcz_store.cc:276] 0709 12:59:25.888682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:25.888803 (+   121us) service_pool.cc:224] Handling call
0709 12:59:26.912997 (+1024194us) spinlock_profiling.cc:243] Waited 368 ms on lock 0x7b54000cdfd4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 12:59:26.913130 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":847432960}
I20260709 12:59:26.932750  1571 leader_election.cc:304] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:26.911990  3260 raft_consensus.cc:493] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:26.914891  3284 raft_consensus.cc:3060] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:26.829763  3181 raft_consensus.cc:515] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:26.944983  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:26.968849  1681 raft_consensus.cc:2468] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 3.
I20260709 12:59:26.971920  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:26.972649  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:26.966909  3260 raft_consensus.cc:3060] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:26.966305  3270 raft_consensus.cc:2804] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:26.978303  3313 raft_consensus.cc:3060] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:26.975376  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:26.984210  1571 leader_election.cc:304] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:26.980044  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:26.988373  1676 raft_consensus.cc:2468] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 3.
I20260709 12:59:26.989974  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:26.983764  3270 raft_consensus.cc:493] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:26.998570  1571 leader_election.cc:304] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:26.987715  3259 raft_consensus.cc:2804] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:27.002882  3249 raft_consensus.cc:2804] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:59:27.003378  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:27.003422  3362 raft_consensus.cc:493] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:27.005954  1680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49170 (request call id 1457) took 1188 ms. Trace:
I20260709 12:59:27.005936  3362 raft_consensus.cc:515] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:27.007790  1675 raft_consensus.cc:2468] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 2.
I20260709 12:59:27.006536  1680 rpcz_store.cc:276] 0709 12:59:25.817444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:25.820126 (+  2682us) service_pool.cc:224] Handling call
0709 12:59:25.820462 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:25.821020 (+   558us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:25.821048 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:25.821562 (+   514us) log.cc:844] Serialized 26 byte log entry
0709 12:59:26.231455 (+409893us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:59:26.231495 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:26.231567 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:26.914060 (+682493us) spinlock_profiling.cc:243] Waited 2.14 ms on lock 0x7b4400022b4c. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a153ecc85 00007f6a153ed6a2 00007f6a1815f1db 00007f6a1815aaaf 00007f6a1814e86e 00007f6a1814dbb6 00007f6a1814d7d8 00007f6a18157221 00007f6a181571d9 00007f6a18157169
0709 12:59:27.004957 (+ 90897us) raft_consensus.cc:1685] finished
0709 12:59:27.004984 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:27.005859 (+   875us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":94,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":87,"spinlock_wait_cycles":4927744,"thread_start_us":409553,"threads_started":1,"wal-append.queue_time_us":548414}
I20260709 12:59:27.018152  3362 leader_election.cc:290] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:26.990978  1598 raft_consensus.cc:2468] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 2.
I20260709 12:59:27.003371  3249 raft_consensus.cc:493] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:26.995657  3253 raft_consensus.cc:493] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:27.005092  3270 raft_consensus.cc:3060] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:27.005403  3259 raft_consensus.cc:493] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:27.033898  3249 raft_consensus.cc:3060] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:27.034504  3253 raft_consensus.cc:3060] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:27.038636  3259 raft_consensus.cc:3060] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:27.045145  3305 leader_election.cc:290] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:27.034813  3261 raft_consensus.cc:515] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:27.056054  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:27.056751  3181 leader_election.cc:290] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:27.057272  3261 leader_election.cc:290] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:27.057641  1607 raft_consensus.cc:1275] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:27.055912  3352 ts_tablet_manager.cc:933] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b: Initiating tablet copy from peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:27.049443  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:27.045323  3353 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
W20260709 12:59:27.082795  3318 log.cc:927] Time spent T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.880s	user 0.006s	sys 0.000s
I20260709 12:59:27.079351  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:27.100188  1680 raft_consensus.cc:1240] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 4. Current term is 5. Ops: []
W20260709 12:59:27.119791  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 327035us
I20260709 12:59:27.079406  3357 leader_election.cc:290] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:27.096434  3181 raft_consensus.cc:493] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:27.099870  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:27.086450  3353 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:27.208082  1674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49170 (request call id 1448) took 1479 ms. Trace:
I20260709 12:59:27.120534  3282 consensus_queue.cc:1059] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 12:59:27.208653  1601 raft_consensus.cc:3060] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:27.225812  2224 raft_consensus.cc:1240] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 4 LEADER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:27.215233  1674 rpcz_store.cc:276] 0709 12:59:25.728282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:25.760274 (+ 31992us) service_pool.cc:224] Handling call
0709 12:59:25.760630 (+   356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:25.780397 (+ 19767us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:25.780427 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:25.780916 (+   489us) log.cc:844] Serialized 26 byte log entry
0709 12:59:26.033622 (+252706us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:59:26.033675 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:26.059013 (+ 25338us) spinlock_profiling.cc:243] Waited 19.4 ms on lock 0x7b5400179154. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 12:59:26.059072 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:27.019767 (+960695us) spinlock_profiling.cc:243] Waited 2.57 ms on lock 0x7b4400022b4c. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a153ecc85 00007f6a153ed6a2 00007f6a1815f1db 00007f6a1815aaaf 00007f6a1814e86e 00007f6a1814dbb6 00007f6a1814d7d8 00007f6a18157221 00007f6a181571d9 00007f6a18157169
0709 12:59:27.207111 (+187344us) raft_consensus.cc:1685] finished
0709 12:59:27.207145 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:27.208010 (+   865us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1083,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":99,"spinlock_wait_cycles":50460288,"thread_start_us":252343,"threads_started":1,"wal-append.queue_time_us":358156}
W20260709 12:59:27.308566  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:27.290284  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 526091us
I20260709 12:59:27.308297  3357 raft_consensus.cc:493] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:27.337782  3301 raft_consensus.cc:493] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:27.355249  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 12:59:27.308670  3359 log.cc:927] Time spent T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 12:59:27.164625  3362 raft_consensus.cc:493] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 12:59:27.359076  3259 raft_consensus.cc:515] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:27.360018  3357 raft_consensus.cc:515] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:59:27.368394  2191 leader_election.cc:304] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:27.324082  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:27.403523  3289 raft_consensus.cc:3060] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:27.417675  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:27.419183  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:27.420469  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 12:59:27.421537  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:27.422094  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:27.382332  3345 raft_consensus.cc:2804] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:27.423480  3345 raft_consensus.cc:493] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:27.423887  3345 raft_consensus.cc:3060] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:27.164767  3181 raft_consensus.cc:515] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:27.326857  3260 raft_consensus.cc:515] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:27.432119  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:27.436014  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:27.436856  1600 raft_consensus.cc:2410] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:59:27.336360  3284 raft_consensus.cc:515] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:27.309635  3354 raft_consensus.cc:515] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:27.441742  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:27.442322  1676 raft_consensus.cc:3055] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:27.372244  3282 raft_consensus.cc:493] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:27.376775  3362 raft_consensus.cc:515] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:27.434381  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:27.448276  1673 raft_consensus.cc:1240] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:27.442921  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:27.449865  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:27.440672  1646 leader_election.cc:304] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:27.379228  3164 consensus_queue.cc:1048] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 12:59:27.375317  3301 raft_consensus.cc:515] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:27.444643  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:27.456241  1602 raft_consensus.cc:2368] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for earlier term 4. Current term is 5.
I20260709 12:59:27.463018  1600 raft_consensus.cc:1240] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:27.442967  1676 raft_consensus.cc:740] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:27.470522  1681 raft_consensus.cc:1275] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:59:27.478520  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:27.454640  3287 raft_consensus.cc:2804] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:27.508813  1676 consensus_queue.cc:260] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:27.447657  3282 raft_consensus.cc:515] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:27.486469  3287 raft_consensus.cc:493] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:27.502321  3360 raft_consensus.cc:493] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:27.524696  1646 leader_election.cc:304] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:27.532838  1646 leader_election.cc:304] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
W20260709 12:59:27.519344  1572 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.196:37373 timed out after 1.598s (SENT) [suppressed 18 similar messages]
W20260709 12:59:27.534575  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:27.536595  3382 raft_consensus.cc:3055] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:27.520992  3287 raft_consensus.cc:3060] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:27.512591  3313 consensus_queue.cc:1048] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 12:59:27.537487  3354 leader_election.cc:290] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:27.564260  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:27.617146  3301 leader_election.cc:290] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:27.617753  3301 raft_consensus.cc:2749] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:27.618364  3301 raft_consensus.cc:2749] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:27.540665  3382 raft_consensus.cc:740] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
W20260709 12:59:27.652184  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 973211us
W20260709 12:59:27.652652  3374 log.cc:927] Time spent T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 12:59:27.657303  3260 leader_election.cc:290] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:27.659730  3284 leader_election.cc:290] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:27.615491  3259 leader_election.cc:290] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:27.534849  3360 raft_consensus.cc:515] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:27.652765  3279 raft_consensus.cc:493] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:27.652230  3315 log.cc:927] Time spent T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
W20260709 12:59:27.671880  3380 log.cc:927] Time spent T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.148s	user 0.000s	sys 0.000s
W20260709 12:59:27.653491  3253 consensus_meta.cc:287] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.598s	user 0.008s	sys 0.001s
W20260709 12:59:27.653198  3372 log.cc:927] Time spent T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.173s	user 0.000s	sys 0.001s
I20260709 12:59:27.669111  1531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43010 (request call id 1538) took 1707 ms. Trace:
I20260709 12:59:27.676617  3382 consensus_queue.cc:260] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:27.675913  3211 raft_consensus.cc:493] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:27.664980  3181 leader_election.cc:290] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:27.681666  1531 rpcz_store.cc:276] 0709 12:59:25.961335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:25.961469 (+   134us) service_pool.cc:224] Handling call
0709 12:59:26.883890 (+922421us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:26.884607 (+   717us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:27.664975 (+780368us) spinlock_profiling.cc:243] Waited 905 ms on lock 0x7b54001b71d0. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b28ad 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 12:59:27.669041 (+  4066us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2081179392}
I20260709 12:59:27.669864  3293 raft_consensus.cc:493] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:27.674865  3357 leader_election.cc:290] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:27.654572  3352 tablet_copy_client.cc:323] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:40303
I20260709 12:59:27.674734  3308 raft_consensus.cc:493] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:27.684420  3253 raft_consensus.cc:515] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:27.701866  3293 raft_consensus.cc:515] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:27.704310  3282 leader_election.cc:290] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:27.679834  3279 raft_consensus.cc:515] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:27.678874  3289 raft_consensus.cc:493] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
W20260709 12:59:27.708693  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 175968us
W20260709 12:59:27.689018  3368 log.cc:927] Time spent T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.222s	user 0.001s	sys 0.000s
I20260709 12:59:27.720566  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:27.712858  3308 raft_consensus.cc:515] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:27.688583  1672 raft_consensus.cc:3060] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:27.719350  1528 raft_consensus.cc:1275] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:27.708777  3362 leader_election.cc:290] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:27.717362  3363 ts_tablet_manager.cc:933] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b: Initiating tablet copy from peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:27.721153  1677 raft_consensus.cc:3060] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:27.722734  3360 leader_election.cc:290] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 12:59:27.725345  3249 consensus_meta.cc:287] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.673s	user 0.008s	sys 0.000s
I20260709 12:59:27.697306  3211 raft_consensus.cc:515] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:27.706020  3345 raft_consensus.cc:515] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:27.730865  1646 leader_election.cc:304] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:27.746085  1646 leader_election.cc:400] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 election: Vote denied by peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303) with higher term. Message: Invalid argument: T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for earlier term 4. Current term is 5.
I20260709 12:59:27.746522  1646 leader_election.cc:403] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:59:27.749140  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:27.749878  1528 raft_consensus.cc:2468] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 2.
I20260709 12:59:27.751828  1528 raft_consensus.cc:1275] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:27.773052  3357 raft_consensus.cc:493] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 12:59:27.773695  3357 raft_consensus.cc:515] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:27.772312  1677 raft_consensus.cc:2468] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 4.
I20260709 12:59:27.744998  3360 raft_consensus.cc:2749] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:59:27.773123  3383 log.cc:927] Time spent T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 12:59:27.779439  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:27.777953  2192 leader_election.cc:304] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
W20260709 12:59:27.771302  3270 consensus_meta.cc:287] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.732s	user 0.011s	sys 0.000s
I20260709 12:59:27.767096  3362 raft_consensus.cc:3060] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:27.779793  1571 leader_election.cc:304] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:27.735247  3289 raft_consensus.cc:515] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:27.741510  3249 raft_consensus.cc:515] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:27.789881  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:27.792840  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:27.793625  1528 raft_consensus.cc:2468] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 1.
W20260709 12:59:27.801079  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 281770us
I20260709 12:59:27.797629  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:27.802784  1572 leader_election.cc:400] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 election: Vote denied by peer b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373) with higher term. Message: Invalid argument: T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 3. Current term is 4.
I20260709 12:59:27.810735  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36194 (request call id 1282) took 1029 ms. Trace:
I20260709 12:59:27.813068  1572 leader_election.cc:304] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:27.814508  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:27.816136  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:27.811223  1606 rpcz_store.cc:276] 0709 12:59:26.781182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:26.781509 (+   327us) service_pool.cc:224] Handling call
0709 12:59:26.781791 (+   282us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:26.786286 (+  4495us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:26.786315 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:26.786771 (+   456us) log.cc:844] Serialized 26 byte log entry
0709 12:59:27.085006 (+298235us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:59:27.091131 (+  6125us) log.cc:844] Serialized 14 byte log entry
0709 12:59:27.091507 (+   376us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:27.091597 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:27.810493 (+718896us) raft_consensus.cc:1685] finished
0709 12:59:27.810511 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:27.810642 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4145,"prepare.queue_time_us":5960,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":57418,"raft.run_cpu_time_us":364,"raft.run_wall_time_us":12837,"thread_start_us":253591,"threads_started":1,"wal-append.queue_time_us":621258}
I20260709 12:59:27.819938  1606 raft_consensus.cc:1240] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:27.821311  3392 raft_consensus.cc:493] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:27.821899  3392 raft_consensus.cc:515] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:27.824209  3392 leader_election.cc:290] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:27.826122  1528 raft_consensus.cc:1275] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:59:27.829512  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 82231.4us
I20260709 12:59:27.835326  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:27.836093  2225 raft_consensus.cc:2468] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 2.
I20260709 12:59:27.835326  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 12:59:27.840381  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:27.797108  3390 raft_consensus.cc:2804] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:27.808324  3293 leader_election.cc:290] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:27.789103  3270 raft_consensus.cc:515] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:27.817246  3313 raft_consensus.cc:2749] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:27.846925  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 12:59:27.851413  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:27.852910  1677 raft_consensus.cc:1240] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:27.852113  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:27.852602  1496 leader_election.cc:304] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:27.857012  1604 raft_consensus.cc:2393] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 3: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 12:59:27.857110  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43010 (request call id 1526) took 2030 ms. Trace:
I20260709 12:59:27.837112  3284 raft_consensus.cc:493] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
W20260709 12:59:27.859225  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:27.861105  1646 leader_election.cc:304] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:27.864322  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
W20260709 12:59:27.854902  3375 log.cc:927] Time spent T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.240s	user 0.000s	sys 0.001s
I20260709 12:59:27.868448  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:27.869829  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:27.870414  1607 raft_consensus.cc:2468] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 2.
I20260709 12:59:27.853551  3264 raft_consensus.cc:2749] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:27.877880  3308 leader_election.cc:290] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:27.875360  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:27.857784  1526 rpcz_store.cc:276] 0709 12:59:25.826473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:25.830773 (+  4300us) service_pool.cc:224] Handling call
0709 12:59:25.950503 (+119730us) spinlock_profiling.cc:243] Waited 12.5 ms on lock 0x7b5800002a98. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a1548eb71 00007f6a1548ea22 00007f6a1e3a7c09 00007f6a1d501ee0 00007f6a1d5cb0ab 00007f6a1d5cb131 00007f6a1d58cfc0 00007f6a1d577929 00007f6a1d5773d2 00007f6a16aeebd4
0709 12:59:25.950717 (+   214us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:25.951074 (+   357us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:25.951102 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:25.951561 (+   459us) log.cc:844] Serialized 26 byte log entry
0709 12:59:26.366995 (+415434us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:26.420768 (+ 53773us) log.cc:844] Serialized 14 byte log entry
0709 12:59:27.853401 (+1432633us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:27.853687 (+   286us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:27.853729 (+    42us) raft_consensus.cc:1685] finished
0709 12:59:27.856911 (+  3182us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:27.857049 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1142344,"prepare.queue_time_us":941240,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":46,"raft.queue_time_us":1235065,"raft.run_cpu_time_us":346,"raft.run_wall_time_us":32873,"spinlock_wait_cycles":28776192,"thread_start_us":698525,"threads_started":2,"wal-append.queue_time_us":551691,"wal-append.run_cpu_time_us":3256,"wal-append.run_wall_time_us":1219450}
I20260709 12:59:27.883996  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:27.855548  3390 raft_consensus.cc:697] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 4 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
W20260709 12:59:27.873451  1679 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49170 (request call id 1466) took 1296 ms (client timeout 1679 ms). Trace:
I20260709 12:59:27.858596  3354 raft_consensus.cc:493] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:27.895313  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:27.895720  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 242243us
I20260709 12:59:27.861611  3253 leader_election.cc:290] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
W20260709 12:59:27.891531  1679 rpcz_store.cc:269] 0709 12:59:26.566581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:26.566751 (+   170us) service_pool.cc:224] Handling call
0709 12:59:27.862735 (+1295984us) spinlock_profiling.cc:243] Waited 2.92 ms on lock 0x7b54003e6f54. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 12:59:27.862847 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6717824}
I20260709 12:59:27.915112  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:27.870728  3392 raft_consensus.cc:2804] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:27.870510  3393 raft_consensus.cc:2749] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:27.911599  1646 leader_election.cc:304] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:27.919392  1607 raft_consensus.cc:2393] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 3: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 12:59:27.885681  3296 raft_consensus.cc:493] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:27.876335  3164 consensus_queue.cc:1048] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 12:59:27.920290  3357 leader_election.cc:290] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:27.876120  3284 raft_consensus.cc:515] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:27.925680  3274 raft_consensus.cc:493] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:27.947237  1497 leader_election.cc:304] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
W20260709 12:59:27.947711  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 159245us
I20260709 12:59:27.921453  3392 raft_consensus.cc:493] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:27.919692  3360 raft_consensus.cc:493] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 12:59:27.922645  3190 raft_consensus.cc:493] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:27.922760  3211 leader_election.cc:290] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:27.929860  3309 raft_consensus.cc:493] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:27.949295  1646 leader_election.cc:304] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:27.962905  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:27.946482  3345 leader_election.cc:290] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 2 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:27.966037  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:27.933048  3156 raft_consensus.cc:2804] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:27.917701  3354 raft_consensus.cc:515] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:27.931902  3260 raft_consensus.cc:493] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 12:59:27.944758  3369 raft_consensus.cc:2749] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:27.966343  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:27.963913  2192 leader_election.cc:304] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
W20260709 12:59:27.974735  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 98220us
W20260709 12:59:27.977337  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:27.925320  3308 consensus_queue.cc:1048] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:59:27.987979  1605 raft_consensus.cc:2468] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 4.
W20260709 12:59:27.993083  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 43887.4us
I20260709 12:59:27.999969  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:27.971832  3392 raft_consensus.cc:3060] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:59:27.997915  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:27.951849  3202 consensus_queue.cc:1048] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:59:28.005192  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36194 (request call id 1289) took 1206 ms. Trace:
I20260709 12:59:27.982100  3211 raft_consensus.cc:2749] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:28.006461  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 12:59:28.008507  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 44662.3us
I20260709 12:59:28.010167  3373 raft_consensus.cc:2749] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:27.989262  3289 leader_election.cc:290] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:27.992466  3180 raft_consensus.cc:493] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:27.995970  3256 raft_consensus.cc:493] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:27.989985  3156 raft_consensus.cc:493] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:28.014822  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:27.980237  3360 raft_consensus.cc:515] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:27.961107  3296 raft_consensus.cc:515] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:28.006023  2219 raft_consensus.cc:2468] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 2.
I20260709 12:59:28.029342  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:27.971189  3274 raft_consensus.cc:515] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:27.982726  3309 raft_consensus.cc:515] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:27.978250  3190 raft_consensus.cc:515] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:28.007078  1603 rpcz_store.cc:276] 0709 12:59:26.799265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:27.999700 (+1200435us) service_pool.cc:224] Handling call
0709 12:59:28.005116 (+  5416us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:28.000255  3339 raft_consensus.cc:493] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:28.039060  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:28.026628  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:28.002871  3363 tablet_copy_client.cc:323] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:44217
I20260709 12:59:28.003926  3249 leader_election.cc:290] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:28.031260  3156 raft_consensus.cc:3060] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:28.000538  3260 raft_consensus.cc:515] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:28.044050  3296 leader_election.cc:290] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 12:59:28.052877  3398 log.cc:927] Time spent T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:59:28.053964  1525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43010 (request call id 1542) took 1594 ms. Trace:
I20260709 12:59:28.055181  1673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49170 (request call id 1473) took 1073 ms. Trace:
I20260709 12:59:28.074355  1673 rpcz_store.cc:276] 0709 12:59:26.982101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:26.982280 (+   179us) service_pool.cc:224] Handling call
0709 12:59:26.982597 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:27.448692 (+466095us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:28.054976 (+606284us) spinlock_profiling.cc:243] Waited 465 ms on lock 0x7b540024d954. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 12:59:28.055126 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1070601088}
I20260709 12:59:28.035074  3397 raft_consensus.cc:493] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:28.062286  2224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50310 (request call id 428) took 1425 ms. Trace:
I20260709 12:59:28.031702  3256 raft_consensus.cc:515] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:28.063419  1678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50664 (request call id 280) took 1381 ms. Trace:
I20260709 12:59:28.064147  3309 leader_election.cc:290] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:28.068017  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:28.031258  3289 raft_consensus.cc:493] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:28.079799  1678 rpcz_store.cc:276] 0709 12:59:26.682320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:26.733566 (+ 51246us) service_pool.cc:224] Handling call
0709 12:59:27.866055 (+1132489us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:27.866267 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:27.866296 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:27.866340 (+    44us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:27.866374 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:27.866426 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:28.063243 (+196817us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54003e6f50. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b28ad 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 12:59:28.063361 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2604014976}
I20260709 12:59:28.070973  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:28.071086  3382 raft_consensus.cc:3060] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:28.032958  3270 leader_election.cc:290] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 12:59:28.072216  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 73716.1us
I20260709 12:59:28.092193  2190 leader_election.cc:304] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:28.073110  1525 rpcz_store.cc:276] 0709 12:59:26.459935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:26.468644 (+  8709us) service_pool.cc:224] Handling call
0709 12:59:26.512131 (+ 43487us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:27.537064 (+1024933us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:27.537093 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:27.556829 (+ 19736us) log.cc:844] Serialized 26 byte log entry
0709 12:59:27.871345 (+314516us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:59:27.871384 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:27.871445 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:28.053760 (+182315us) raft_consensus.cc:1685] finished
0709 12:59:28.053780 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:28.053907 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1042736,"raft.queue_time_us":1139545,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":12197,"thread_start_us":248316,"threads_started":1,"wal-append.queue_time_us":361496}
I20260709 12:59:28.034358  3211 raft_consensus.cc:493] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:27.978473  3390 consensus_queue.cc:237] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:28.029743  3319 consensus_queue.cc:1048] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 12:59:28.084128  3098 raft_consensus.cc:493] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 12:59:28.062290  3287 raft_consensus.cc:515] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:28.090775  3284 leader_election.cc:290] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:28.092422  1607 raft_consensus.cc:2393] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 4: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 12:59:28.077971  2224 rpcz_store.cc:276] 0709 12:59:26.636784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:26.639889 (+  3105us) service_pool.cc:224] Handling call
0709 12:59:26.640137 (+   248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:27.340634 (+700497us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:28.062034 (+721400us) spinlock_profiling.cc:243] Waited 585 ms on lock 0x7b5400629154. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 12:59:28.062196 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1344412416}
I20260709 12:59:28.081979  3350 raft_consensus.cc:493] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 12:59:28.031941  3180 raft_consensus.cc:515] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:28.095770  1644 leader_election.cc:304] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:28.097525  1603 raft_consensus.cc:2393] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 2: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 12:59:28.072348  3339 raft_consensus.cc:515] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:28.103107  2190 leader_election.cc:304] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:28.112146  3285 raft_consensus.cc:493] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
W20260709 12:59:28.116416  1571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:28.147650  3400 log.cc:927] Time spent T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:59:28.083494  1672 raft_consensus.cc:2468] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 3.
W20260709 12:59:28.162642  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 137063us
W20260709 12:59:28.150761  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 55070.8us
W20260709 12:59:28.153448  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 50433.5us
I20260709 12:59:28.092694  3289 raft_consensus.cc:515] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 12:59:28.165138  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 155815us
I20260709 12:59:28.170089  3358 raft_consensus.cc:2804] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:28.098449  3254 raft_consensus.cc:2804] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:28.147548  3098 raft_consensus.cc:515] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:28.112540  3261 raft_consensus.cc:493] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 12:59:28.099581  3244 raft_consensus.cc:493] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 12:59:28.180317  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 12:59:28.182265  3358 raft_consensus.cc:493] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:28.184255  1601 consensus_meta.cc:287] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.813s	user 0.010s	sys 0.000s
I20260709 12:59:28.186832  2224 raft_consensus.cc:3060] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:28.110831  3404 consensus_queue.cc:1048] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.081s
I20260709 12:59:28.171175  3373 raft_consensus.cc:2804] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:28.160971  3287 leader_election.cc:290] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:28.083258  3397 raft_consensus.cc:515] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:28.162307  3350 raft_consensus.cc:515] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:28.198875  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 12:59:28.208263  1599 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36194 (request call id 1290) took 1408 ms (client timeout 1671 ms). Trace:
I20260709 12:59:28.171289  3285 raft_consensus.cc:515] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:28.181702  3254 raft_consensus.cc:493] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
W20260709 12:59:28.208706  1599 rpcz_store.cc:269] 0709 12:59:26.799598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:28.198573 (+1398975us) service_pool.cc:224] Handling call
0709 12:59:28.208192 (+  9619us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:28.188504  3358 raft_consensus.cc:3060] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:28.111320  3211 raft_consensus.cc:515] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:28.215749  3360 leader_election.cc:290] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:28.178730  3181 consensus_queue.cc:1048] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 12:59:28.215915  3098 leader_election.cc:290] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:28.217110  3339 leader_election.cc:290] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:28.218376  3180 leader_election.cc:290] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:28.194070  3369 raft_consensus.cc:493] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 12:59:28.197088  3373 raft_consensus.cc:493] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:28.224403  3274 leader_election.cc:290] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:28.225512  3361 raft_consensus.cc:2749] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:28.226109  3285 leader_election.cc:290] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:28.181033  3345 consensus_queue.cc:1048] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:59:28.190372  1601 raft_consensus.cc:2468] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 3.
I20260709 12:59:28.303658  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 349) took 1224 ms. Trace:
I20260709 12:59:28.194638  3244 raft_consensus.cc:515] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:28.227036  3256 leader_election.cc:290] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:28.228691  1497 leader_election.cc:304] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:28.190779  3261 raft_consensus.cc:515] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:28.236768  2224 raft_consensus.cc:2468] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 3.
I20260709 12:59:28.213682  3254 raft_consensus.cc:3060] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:28.214509  3309 raft_consensus.cc:493] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:28.214330  3354 leader_election.cc:290] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:28.292131  3382 raft_consensus.cc:493] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 12:59:28.236711  3362 raft_consensus.cc:2749] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303) with higher term. Message: Invalid argument: T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for earlier term 4. Current term is 5.
I20260709 12:59:28.306420  1675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49170 (request call id 1470) took 1334 ms. Trace:
I20260709 12:59:28.294330  3373 raft_consensus.cc:3060] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:59:28.310164  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 126903us
I20260709 12:59:28.301990  3289 leader_election.cc:290] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:28.314814  1675 rpcz_store.cc:276] 0709 12:59:26.972193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:26.972381 (+   188us) service_pool.cc:224] Handling call
0709 12:59:28.306266 (+1333885us) spinlock_profiling.cc:243] Waited 34.4 ms on lock 0x7b54000cd354. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 12:59:28.306366 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":79154048}
W20260709 12:59:28.310809  1605 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36200 (request call id 1643) took 2149 ms (client timeout 1857 ms). Trace:
W20260709 12:59:28.321295  1605 rpcz_store.cc:269] 0709 12:59:26.156000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:26.156120 (+   120us) service_pool.cc:224] Handling call
0709 12:59:28.304732 (+2148612us) spinlock_profiling.cc:243] Waited 1.75 s on lock 0x7b54002675d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 12:59:28.304850 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4029562624}
I20260709 12:59:28.304008  1601 rpcz_store.cc:276] 0709 12:59:27.078978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:27.080847 (+  1869us) service_pool.cc:224] Handling call
0709 12:59:28.303568 (+1222721us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:28.315101  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 137920us
W20260709 12:59:28.318106  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 89495.7us
I20260709 12:59:28.326874  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:28.319023  3403 raft_consensus.cc:2749] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:28.321907  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:28.307745  3350 leader_election.cc:290] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:28.296458  3369 raft_consensus.cc:515] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:28.331727  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:28.314556  3354 raft_consensus.cc:493] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:28.330327  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:28.335398  2226 raft_consensus.cc:2468] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 3.
I20260709 12:59:28.316287  3382 raft_consensus.cc:515] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:28.337421  3261 leader_election.cc:290] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:28.337893  3382 leader_election.cc:290] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:28.338006  3353 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:28.338832  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:28.339483  1598 raft_consensus.cc:2376] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 4. Re-sending same reply.
I20260709 12:59:28.340243  3211 leader_election.cc:290] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:28.341814  3190 leader_election.cc:290] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:28.344815  1427 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46258 (request call id 340) took 2498 ms. Trace:
I20260709 12:59:28.345924  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:27.613579   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:28.347220  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:28.352049  1425 catalog_manager.cc:5697] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 reported cstate change: term changed from 1 to 2, leader changed from e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:28.355032  1430 catalog_manager.cc:5697] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 2 to 3, leader changed from 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) to b96ce9cc496c49d7818fa983a17b062b (127.0.107.196). New cstate: current_term: 3 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:59:28.367035  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:28.367578  3156 raft_consensus.cc:515] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:59:28.370245  3156 leader_election.cc:290] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 2 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:28.372382  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36200 (request call id 1651) took 1080 ms. Trace:
I20260709 12:59:28.332630  1605 raft_consensus.cc:2468] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 2.
I20260709 12:59:28.328567  1497 leader_election.cc:304] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
W20260709 12:59:28.374222  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 45732.3us
I20260709 12:59:28.354434  1425 catalog_manager.cc:5697] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 reported cstate change: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:59:28.372773  1602 rpcz_store.cc:276] 0709 12:59:27.292139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:27.459831 (+167692us) service_pool.cc:224] Handling call
0709 12:59:27.460203 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:27.528852 (+ 68649us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:59:27.540876 (+ 12024us) log.cc:844] Serialized 14 byte log entry
0709 12:59:27.541101 (+   225us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:27.541149 (+    48us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:27.541186 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:27.725238 (+184052us) spinlock_profiling.cc:243] Waited 4.6 ms on lock 0x7b18002f9020. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1e38ede1 00007f6a1e39b5b1 00007f6a154c63f3 00007f6a154c87c1 00007f6a154c8779 00007f6a154c8709 00007f6a154c86d1 00007f6a154c79cd 000000000038f354 000000000038f199 00007f6a154a983a
0709 12:59:28.372166 (+646928us) spinlock_profiling.cc:243] Waited 68.4 ms on lock 0x7b540041fd54. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 12:59:28.372214 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:28.372330 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9,"prepare.queue_time_us":29053,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":128,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":97,"spinlock_wait_cycles":167888640}
I20260709 12:59:28.379732  1497 leader_election.cc:304] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:28.313657  3309 raft_consensus.cc:515] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:28.382722  2224 raft_consensus.cc:2468] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 1.
I20260709 12:59:28.383098  1646 leader_election.cc:304] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:28.380707  1497 leader_election.cc:304] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:28.379098  3190 raft_consensus.cc:2804] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:28.420652  1497 leader_election.cc:304] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:28.428483  3309 leader_election.cc:290] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:28.419248  3261 raft_consensus.cc:493] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:28.431792  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:28.439142  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 56035.7us
I20260709 12:59:28.441363  1497 leader_election.cc:304] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:28.444545  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:28.445119  1526 raft_consensus.cc:3060] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:28.447227  3338 raft_consensus.cc:2749] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:28.447942  3361 raft_consensus.cc:2804] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:28.449138  3361 raft_consensus.cc:697] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [term 3 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:28.384133  3211 raft_consensus.cc:2804] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:28.454855  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:28.456158  1526 raft_consensus.cc:2468] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 6.
I20260709 12:59:28.456100  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:28.456326  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:28.455562  1528 raft_consensus.cc:2468] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 2.
I20260709 12:59:28.456950  1524 raft_consensus.cc:2468] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 3.
I20260709 12:59:28.435786  3164 consensus_queue.cc:1059] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 12:59:28.459805  1530 raft_consensus.cc:2393] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 4: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 12:59:28.460023  3164 raft_consensus.cc:3055] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:28.459506  1525 raft_consensus.cc:1240] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:28.385236  3350 raft_consensus.cc:493] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:28.458581  1646 leader_election.cc:304] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:28.460495  3164 raft_consensus.cc:740] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 12:59:28.375514  3354 raft_consensus.cc:515] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:28.466058  1527 raft_consensus.cc:1240] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 1. Current term is 2. Ops: [1.2-1.2]
I20260709 12:59:28.473758  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:28.467015  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:28.464289  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:28.469713  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:28.470384  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:28.434329  3392 raft_consensus.cc:515] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:28.382855  3345 consensus_queue.cc:1059] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.081s
I20260709 12:59:28.437846  3190 raft_consensus.cc:493] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:28.479562  3156 raft_consensus.cc:2804] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:28.479743  3262 raft_consensus.cc:493] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:28.480461  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:28.450982  3293 raft_consensus.cc:2749] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:28.345299  1427 rpcz_store.cc:276] 0709 12:59:25.846442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:25.846593 (+   151us) service_pool.cc:224] Handling call
0709 12:59:28.344698 (+2498105us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:26.268092 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:26.379174 (+111082us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:26.381592 (+  2418us) write_op.cc:435] Acquired schema lock
0709 12:59:26.383410 (+  1818us) tablet.cc:662] Decoding operations
0709 12:59:26.435716 (+ 52306us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:26.455178 (+ 19462us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:26.465522 (+ 10344us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:59:26.501109 (+ 35587us) tablet.cc:701] Row locks acquired
0709 12:59:26.501131 (+    22us) write_op.cc:260] PREPARE: finished
0709 12:59:26.531247 (+ 30116us) write_op.cc:270] Start()
0709 12:59:26.542516 (+ 11269us) write_op.cc:276] Timestamp: P: 1783601966528378 usec, L: 0
0709 12:59:26.542556 (+    40us) op_driver.cc:348] REPLICATION: starting
0709 12:59:26.553998 (+ 11442us) log.cc:844] Serialized 536 byte log entry
0709 12:59:26.938958 (+384960us) op_driver.cc:464] REPLICATION: finished
0709 12:59:26.962464 (+ 23506us) write_op.cc:301] APPLY: starting
0709 12:59:26.962561 (+    97us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:26.962702 (+   141us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:26.962821 (+   119us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:26.963084 (+   263us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:26.963245 (+   161us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:59:26.963292 (+    47us) write_op.cc:312] APPLY: finished
0709 12:59:26.963505 (+   213us) log.cc:844] Serialized 23 byte log entry
0709 12:59:26.963693 (+   188us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:26.963773 (+    80us) write_op.cc:454] Released schema lock
0709 12:59:26.963816 (+    43us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":23181,"apply.run_cpu_time_us":1691,"apply.run_wall_time_us":1691,"num_ops":1,"prepare.queue_time_us":388738,"prepare.run_cpu_time_us":4216,"prepare.run_wall_time_us":286177,"replication_time_us":394065,"thread_start_us":193381,"threads_started":1}]]}
I20260709 12:59:28.385289  3397 leader_election.cc:290] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:28.481238  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:28.482129  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:28.486361  1527 raft_consensus.cc:3060] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:28.486433  1526 raft_consensus.cc:2393] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 4: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 12:59:28.480897  1646 leader_election.cc:304] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
W20260709 12:59:28.493579  3421 log.cc:927] Time spent T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:59:28.494184  3392 leader_election.cc:290] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:28.494977  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:28.496114  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:28.497133  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:28.498101  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:28.499066  3156 raft_consensus.cc:697] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 4 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:28.467957  3211 raft_consensus.cc:697] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 12:59:28.499130  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:28.500308  3354 leader_election.cc:290] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:28.500174  3156 consensus_queue.cc:237] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:28.501045  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:28.501958  1528 raft_consensus.cc:2393] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 2: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 12:59:28.504839  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:28.439909  3360 raft_consensus.cc:493] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:28.505931  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 12:59:28.506559  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 86130.8us
I20260709 12:59:28.506506  1606 raft_consensus.cc:2468] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 3.
I20260709 12:59:28.507614  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:28.505470  1599 raft_consensus.cc:2468] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 3.
I20260709 12:59:28.508265  1524 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 4.
I20260709 12:59:28.461005  3261 raft_consensus.cc:515] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:28.483705  3369 leader_election.cc:290] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:28.485181  3190 raft_consensus.cc:3060] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:28.509465  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:28.421208  3418 raft_consensus.cc:2749] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:28.484588  3411 raft_consensus.cc:493] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:28.514225  1605 raft_consensus.cc:2468] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 2.
I20260709 12:59:28.450074  3361 consensus_queue.cc:237] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:28.515655  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:28.472514  3350 raft_consensus.cc:515] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:28.516745  1527 raft_consensus.cc:2468] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 4.
I20260709 12:59:28.508823  1523 raft_consensus.cc:2368] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 2. Current term is 3.
I20260709 12:59:28.509258  1599 raft_consensus.cc:2955] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index -1 to 5, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:59:28.517546  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:28.519342  1526 raft_consensus.cc:2393] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 2: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 12:59:28.514744  1644 leader_election.cc:304] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:28.543829  1602 raft_consensus.cc:2410] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 3 because replica has last-logged OpId of term: 1 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:59:28.529588  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:28.546155  1527 raft_consensus.cc:3060] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:28.546432  1644 leader_election.cc:304] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:28.547859  1644 leader_election.cc:304] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:28.511081  3362 raft_consensus.cc:2804] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:28.549332  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:28.550299  1605 raft_consensus.cc:2410] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:59:28.542610  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:28.530391  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:28.490597  3262 raft_consensus.cc:515] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:28.556736  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:28.561915  1606 raft_consensus.cc:1275] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:28.524121  1646 leader_election.cc:304] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:28.519558  3285 raft_consensus.cc:493] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:28.563656  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:28.566998  1528 raft_consensus.cc:2393] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 2: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 12:59:28.572111  1616 tablet_copy_service.cc:140] P 39a92f5a4352465d8af3af5908fe8642: Received BeginTabletCopySession request for tablet 4190d217954f4f798b3a610501115290 from peer b96ce9cc496c49d7818fa983a17b062b ({username='slave'} at 127.0.0.1:57268)
I20260709 12:59:28.549404  3181 raft_consensus.cc:2749] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:59:28.572744  1616 tablet_copy_service.cc:161] P 39a92f5a4352465d8af3af5908fe8642: Beginning new tablet copy session on tablet 4190d217954f4f798b3a610501115290 from peer b96ce9cc496c49d7818fa983a17b062b at {username='slave'} at 127.0.0.1:57268: session id = b96ce9cc496c49d7818fa983a17b062b-4190d217954f4f798b3a610501115290
I20260709 12:59:28.573877  3261 leader_election.cc:290] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:28.574925  3353 consensus_queue.cc:1059] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:28.575925  1527 raft_consensus.cc:2468] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 3.
I20260709 12:59:28.541746  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:28.528501  3244 leader_election.cc:290] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:28.575173  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:28.500195  3211 consensus_queue.cc:237] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:28.553001  3356 raft_consensus.cc:2749] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:28.555234  3362 raft_consensus.cc:493] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 12:59:28.516106  3360 raft_consensus.cc:515] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:28.581223  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:28.575883  3353 raft_consensus.cc:3055] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:28.572059  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:28.587112  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:28.584795  1570 leader_election.cc:304] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:28.556701  3425 raft_consensus.cc:2749] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:28.589970  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:28.519769  3164 consensus_queue.cc:260] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:28.552767  3411 raft_consensus.cc:515] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:28.588408  3353 raft_consensus.cc:740] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:28.580580  3271 raft_consensus.cc:2804] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:28.593106  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:28.593619  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:28.594808  1523 raft_consensus.cc:3060] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:28.671288  3373 raft_consensus.cc:515] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 12:59:28.598695  3407 log.cc:927] Time spent T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.558s	user 0.000s	sys 0.003s
I20260709 12:59:28.604761  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 12:59:28.608633  1571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:28.460592  3184 raft_consensus.cc:2955] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 4 LEADER]: Committing config change with OpId 4.5: config changed from index -1 to 5, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:59:28.611968  1570 leader_election.cc:304] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 12:59:28.674783  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 62924.1us
I20260709 12:59:28.583341  3362 raft_consensus.cc:3060] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:28.677088  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:28.644004  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:28.677551  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:28.645915  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:28.643262  1572 leader_election.cc:304] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 12:59:28.676067  1570 leader_election.cc:304] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:28.681885  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:28.648170  1527 raft_consensus.cc:3060] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:28.684852  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:28.685067  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:28.686028  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:28.688146  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:28.690353  1572 leader_election.cc:304] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:28.690992  2225 raft_consensus.cc:1240] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:28.693655  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:28.694355  1680 raft_consensus.cc:2468] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 1.
I20260709 12:59:28.667307  3271 raft_consensus.cc:697] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 2 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:28.662928  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:28.672475  3279 leader_election.cc:290] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:28.642889  3348 raft_consensus.cc:2749] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:28.577267  3285 raft_consensus.cc:515] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:28.608227  3358 raft_consensus.cc:515] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:28.701958  3282 raft_consensus.cc:2749] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:28.695783  3256 raft_consensus.cc:493] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:28.703187  3256 raft_consensus.cc:515] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:28.703769  3360 leader_election.cc:290] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:28.705294  3256 leader_election.cc:290] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:28.706142  1690 tablet_copy_service.cc:140] P ddf11fc190dd4b898773379c6b129d90: Received BeginTabletCopySession request for tablet 04fed4c219e14efb9f9a8eb0d336ceac from peer b96ce9cc496c49d7818fa983a17b062b ({username='slave'} at 127.0.0.1:50664)
I20260709 12:59:28.707211  3350 leader_election.cc:290] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:28.676959  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:28.693478  2191 leader_election.cc:304] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:28.708472  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:28.680311  3382 raft_consensus.cc:2749] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:28.712455  2224 raft_consensus.cc:1240] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [term 3 LEADER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:28.708663  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:28.687029  3349 raft_consensus.cc:2804] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:28.709782  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:28.699879  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:28.714334  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:28.713953  1526 raft_consensus.cc:2468] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 2.
I20260709 12:59:28.716293  1524 raft_consensus.cc:2468] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 3.
I20260709 12:59:28.659279  1607 raft_consensus.cc:2468] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 3.
W20260709 12:59:28.666241  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 154062us
I20260709 12:59:28.670310  3353 consensus_queue.cc:260] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:28.719844  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:28.721169  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:28.702181  3314 raft_consensus.cc:2749] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:28.721165  2191 leader_election.cc:304] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:28.731114  1526 raft_consensus.cc:1275] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:28.733868  1681 raft_consensus.cc:1240] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:28.707746  1672 raft_consensus.cc:1275] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:28.735816  1497 leader_election.cc:304] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:28.740752  3358 leader_election.cc:290] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:28.743163  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49170 (request call id 1481) took 1181 ms. Trace:
I20260709 12:59:28.746237  1681 rpcz_store.cc:276] 0709 12:59:27.561997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:27.562163 (+   166us) service_pool.cc:224] Handling call
0709 12:59:28.733509 (+1171346us) spinlock_profiling.cc:243] Waited 2.09 ms on lock 0x7b5800143798. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a1548eb71 00007f6a1548ea22 00007f6a1e3a7c09 00007f6a1d501ee0 00007f6a1d5cb0ab 00007f6a1d5cb131 00007f6a1d58cfc0 00007f6a1d577929 00007f6a1d5773d2 00007f6a16aeebd4
0709 12:59:28.733704 (+   195us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:28.742866 (+  9162us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:28.743105 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4808064}
I20260709 12:59:28.727051  1527 raft_consensus.cc:2468] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 3.
W20260709 12:59:28.748087  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:28.749508  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:28.750248  3271 consensus_queue.cc:237] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:59:28.751253  1616 tablet_copy_source_session.cc:215] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:28.750177  2219 raft_consensus.cc:2468] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 1.
I20260709 12:59:28.753599  3262 leader_election.cc:290] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:28.755545  1530 raft_consensus.cc:1275] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:59:28.760452  3431 log.cc:927] Time spent T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:59:28.804427  1528 raft_consensus.cc:1275] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:59:28.764698  1497 leader_election.cc:304] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:28.777081  1523 raft_consensus.cc:2468] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 3.
I20260709 12:59:28.808234  1531 raft_consensus.cc:1240] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:59:28.718163  3369 raft_consensus.cc:2749] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:59:28.744398  3426 raft_consensus.cc:2804] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:28.828835  3426 raft_consensus.cc:493] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 12:59:28.829236  3426 raft_consensus.cc:3060] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:28.831349  3362 raft_consensus.cc:515] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:28.718837  3349 raft_consensus.cc:493] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:28.720475  1690 tablet_copy_service.cc:161] P ddf11fc190dd4b898773379c6b129d90: Beginning new tablet copy session on tablet 04fed4c219e14efb9f9a8eb0d336ceac from peer b96ce9cc496c49d7818fa983a17b062b at {username='slave'} at 127.0.0.1:50664: session id = b96ce9cc496c49d7818fa983a17b062b-04fed4c219e14efb9f9a8eb0d336ceac
I20260709 12:59:28.847610  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 12:59:28.831418  3436 log.cc:927] Time spent T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 12:59:28.766992  3264 raft_consensus.cc:2804] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:59:28.748778  3390 consensus_queue.cc:1175] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b96ce9cc496c49d7818fa983a17b062b" responder_term: 4 status { last_received { term: 4 index: 6 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 3. Current term is 4. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:59:29.350984  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
W20260709 12:59:29.266999  1571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:29.274709  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 584458us
I20260709 12:59:28.808528  3353 raft_consensus.cc:3060] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:29.327598  1675 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.004s	sys 0.004s
I20260709 12:59:29.333992  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
W20260709 12:59:29.274215  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 598216us
W20260709 12:59:29.182484  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:29.314036  1428 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46260 (request call id 362) took 4168 ms. Trace:
I20260709 12:59:29.109441  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 12:59:29.105813  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:29.362735  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:29.357478  1523 raft_consensus.cc:2468] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 3.
I20260709 12:59:29.334080  1497 leader_election.cc:304] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:29.363600  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:29.425856  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:29.504161  1673 raft_consensus.cc:2468] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 2.
W20260709 12:59:29.448668  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:29.448491  1678 raft_consensus.cc:2393] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 3: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 12:59:28.843760  3349 raft_consensus.cc:3060] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:59:29.449065  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 88242.6us
W20260709 12:59:29.503716  1675 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.745s	user 0.006s	sys 0.011s
I20260709 12:59:29.502995  1681 raft_consensus.cc:3060] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:29.511593  1604 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36200 (request call id 1649) took 2224 ms (client timeout 1555 ms). Trace:
I20260709 12:59:29.506610  1677 raft_consensus.cc:2468] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 2.
W20260709 12:59:29.512125  1604 rpcz_store.cc:269] 0709 12:59:27.287299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:27.354693 (+ 67394us) service_pool.cc:224] Handling call
0709 12:59:29.511358 (+2156665us) spinlock_profiling.cc:243] Waited 499 ms on lock 0x7b54000db954. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 12:59:29.511521 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1148451584}
W20260709 12:59:29.318984  3401 log.cc:927] Time spent T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 1.286s	user 0.000s	sys 0.010s
W20260709 12:59:29.196293  3408 log.cc:927] Time spent T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 1.199s	user 0.003s	sys 0.000s
I20260709 12:59:29.507881  1571 leader_election.cc:304] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:29.299700  3164 raft_consensus.cc:3060] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:59:29.503443  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 169474us
I20260709 12:59:29.299592  3350 raft_consensus.cc:493] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:28.875315  3411 leader_election.cc:290] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:29.522562  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:29.057221  3340 raft_consensus.cc:2804] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:29.448274  3181 raft_consensus.cc:493] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:29.304049  3424 raft_consensus.cc:3055] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:59:29.448588  3254 consensus_meta.cc:287] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b: Time spent flushing consensus metadata: real 1.133s	user 0.012s	sys 0.008s
I20260709 12:59:29.107183  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:28.971918  3285 leader_election.cc:290] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:29.357329  3264 raft_consensus.cc:493] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:29.310076  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:29.322906  3361 raft_consensus.cc:493] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:29.449178  3404 raft_consensus.cc:493] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:29.558957  3404 raft_consensus.cc:515] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:29.559902  3361 raft_consensus.cc:515] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:29.561712  3404 leader_election.cc:290] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:29.041164  3190 raft_consensus.cc:515] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:29.524240  3262 raft_consensus.cc:2749] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:29.563454  3262 consensus_queue.cc:1059] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:29.564420  3190 leader_election.cc:290] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:29.536594  3181 raft_consensus.cc:515] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:29.566154  3411 raft_consensus.cc:493] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:29.566920  3411 raft_consensus.cc:515] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:29.567744  3285 raft_consensus.cc:493] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:29.568387  3285 raft_consensus.cc:515] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:29.569181  3411 leader_election.cc:290] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:29.569799  3411 raft_consensus.cc:493] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:29.529127  3342 consensus_queue.cc:1059] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 12:59:29.572233  3342 raft_consensus.cc:3055] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:29.572639  3342 raft_consensus.cc:740] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:29.573527  3342 consensus_queue.cc:260] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:29.529664  3350 raft_consensus.cc:515] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:29.575055  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:29.576017  1605 raft_consensus.cc:2393] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 3: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 12:59:29.577055  3350 leader_election.cc:290] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:29.577258  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36194 (request call id 1303) took 1073 ms. Trace:
I20260709 12:59:29.536629  3424 raft_consensus.cc:740] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 12:59:29.578060  3362 leader_election.cc:290] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:29.502688  1428 rpcz_store.cc:276] 0709 12:59:25.145398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:25.145514 (+   116us) service_pool.cc:224] Handling call
0709 12:59:25.633345 (+487831us) spinlock_profiling.cc:243] Waited 155 ms on lock 0x7b5400411254. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851d090 00007f6a185bbf3a 00007f6a1e3721cc 00007f6a1e47037e 00007f6a1c9312a4 00007f6a1c931232 00007f6a1c931161 00007f6a1c9310dc 00007f6a1c930392 00007f6a168ee48c 00007f6a168ed8c6
0709 12:59:29.313955 (+3680610us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:26.265269 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:26.265927 (+   658us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:26.265966 (+    39us) write_op.cc:435] Acquired schema lock
0709 12:59:26.265984 (+    18us) tablet.cc:662] Decoding operations
0709 12:59:26.266329 (+   345us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:26.266421 (+    92us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:26.266463 (+    42us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:59:26.266649 (+   186us) tablet.cc:701] Row locks acquired
0709 12:59:26.266699 (+    50us) write_op.cc:260] PREPARE: finished
0709 12:59:26.266848 (+   149us) write_op.cc:270] Start()
0709 12:59:26.266968 (+   120us) write_op.cc:276] Timestamp: P: 1783601966266799 usec, L: 0
0709 12:59:26.266990 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:59:26.267678 (+   688us) log.cc:844] Serialized 536 byte log entry
0709 12:59:26.657444 (+389766us) op_driver.cc:464] REPLICATION: finished
0709 12:59:26.937979 (+280535us) write_op.cc:301] APPLY: starting
0709 12:59:26.938078 (+    99us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:26.938195 (+   117us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:26.938335 (+   140us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:26.938644 (+   309us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:26.938849 (+   205us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:59:26.938892 (+    43us) write_op.cc:312] APPLY: finished
0709 12:59:26.939117 (+   225us) log.cc:844] Serialized 23 byte log entry
0709 12:59:26.939324 (+   207us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:26.939403 (+    79us) write_op.cc:454] Released schema lock
0709 12:59:26.939441 (+    38us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:26.939801 (+   360us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:26.939828 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1507109,"reported_tablets":1,"spinlock_wait_cycles":356175616,"child_traces":[["op",{"apply.queue_time_us":280269,"apply.run_cpu_time_us":1814,"apply.run_wall_time_us":1815,"num_ops":1,"prepare.queue_time_us":466281,"prepare.run_cpu_time_us":2772,"prepare.run_wall_time_us":31690,"replication_time_us":380915,"thread_start_us":556400,"threads_started":2}]]}
I20260709 12:59:29.536876  3254 raft_consensus.cc:515] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:29.582901  3254 leader_election.cc:290] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 3 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:29.276407  3369 consensus_queue.cc:1048] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.248s
I20260709 12:59:29.585635  2222 raft_consensus.cc:1240] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:29.510304  3394 raft_consensus.cc:2749] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:29.276186  3209 consensus_queue.cc:1048] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.251s
I20260709 12:59:29.528152  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:29.540421  1531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43008 (request call id 1538) took 1071 ms. Trace:
I20260709 12:59:29.545038  3264 raft_consensus.cc:3060] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:29.591405  3424 consensus_queue.cc:260] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:29.592538  3424 raft_consensus.cc:3060] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:29.522184  1497 leader_election.cc:304] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:29.545953  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:29.527550  1604 raft_consensus.cc:2468] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 3.
I20260709 12:59:29.595705  1680 raft_consensus.cc:2468] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 4.
I20260709 12:59:28.929119  3319 consensus_queue.cc:1048] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.600s
I20260709 12:59:29.590497  1531 rpcz_store.cc:276] 0709 12:59:28.468474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:28.718074 (+249600us) service_pool.cc:224] Handling call
0709 12:59:28.807947 (+ 89873us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:28.808706 (+   759us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:29.540140 (+731434us) spinlock_profiling.cc:243] Waited 61 ms on lock 0x7b540010ccd0. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b28ad 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 12:59:29.540330 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":140212608}
W20260709 12:59:29.599748  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 77696.1us
I20260709 12:59:29.249148  3426 raft_consensus.cc:515] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:29.596058  1674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50664 (request call id 287) took 2114 ms. Trace:
I20260709 12:59:29.601161  1497 leader_election.cc:304] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:29.603228  1674 rpcz_store.cc:276] 0709 12:59:27.428654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:27.429101 (+   447us) service_pool.cc:224] Handling call
0709 12:59:28.306388 (+877287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:28.306572 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:28.306596 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:28.306638 (+    42us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:28.306693 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:28.306746 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:29.543082 (+1236336us) spinlock_profiling.cc:243] Waited 872 ms on lock 0x7b54000cd350. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b28ad 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 12:59:29.543206 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2006704000}
I20260709 12:59:29.570288  3411 raft_consensus.cc:515] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:29.599472  3342 raft_consensus.cc:3060] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:29.608772  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:29.609238  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:29.609522  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:29.609882  1523 raft_consensus.cc:2468] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 2.
I20260709 12:59:29.564374  3262 raft_consensus.cc:3055] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:29.610214  1526 raft_consensus.cc:2393] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 3: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 12:59:29.612162  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:29.612870  1680 raft_consensus.cc:2468] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 3.
I20260709 12:59:29.537511  1676 raft_consensus.cc:3060] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:59:29.616643  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:29.595235  3373 leader_election.cc:290] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 2 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:29.600980  3285 leader_election.cc:290] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:29.602144  3394 raft_consensus.cc:2764] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:59:29.623754  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:29.603616  3361 leader_election.cc:290] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:29.605373  3412 raft_consensus.cc:2749] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:29.546434  3348 consensus_queue.cc:1059] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.073s
I20260709 12:59:29.611630  3262 raft_consensus.cc:740] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:29.577803  1601 rpcz_store.cc:276] 0709 12:59:28.503474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:28.509589 (+  6115us) service_pool.cc:224] Handling call
0709 12:59:29.309885 (+800296us) spinlock_profiling.cc:243] Waited 5.46 ms on lock 0x7b5800017198. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a1548eb71 00007f6a1548ea22 00007f6a1e3a7c09 00007f6a1d501ee0 00007f6a1d5cb0ab 00007f6a1d5cb131 00007f6a1d5790a0 00007f6a1d578984 00007f6a16af36d4 00007f6a16af3662
0709 12:59:29.577190 (+267305us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12561792}
I20260709 12:59:29.666075  3258 raft_consensus.cc:493] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:29.672233  3348 raft_consensus.cc:493] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:29.696498  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:29.692050  1497 leader_election.cc:304] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:29.641897  3305 consensus_queue.cc:1048] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
W20260709 12:59:29.699713  1529 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.936s	user 0.015s	sys 0.018s
W20260709 12:59:29.724869  1529 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.961s	user 0.015s	sys 0.018s
W20260709 12:59:29.699131  2191 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.687s	user 0.018s	sys 0.025s
W20260709 12:59:29.725896  2191 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.714s	user 0.018s	sys 0.025s
I20260709 12:59:29.726984  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:29.674896  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:29.697925  3181 leader_election.cc:290] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:29.696638  3190 raft_consensus.cc:493] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:29.741472  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:29.752096  3411 leader_election.cc:290] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:29.771559  3352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4190d217954f4f798b3a610501115290. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:29.753301  3340 raft_consensus.cc:493] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:29.758347  3260 leader_election.cc:290] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:29.708712  1497 leader_election.cc:304] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
W20260709 12:59:29.777902  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 69267.7us
I20260709 12:59:29.767232  1681 raft_consensus.cc:2468] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 4.
I20260709 12:59:29.739876  1672 raft_consensus.cc:2468] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 5.
I20260709 12:59:29.782908  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:29.801299  1605 raft_consensus.cc:2393] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 3: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 12:59:29.738844  3313 raft_consensus.cc:493] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:29.783088  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:29.802161  3411 raft_consensus.cc:2804] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:59:29.804503  3438 log.cc:927] Time spent T 00000000000000000000000000000000 P 9f38d0e5c9db43a48554defe1153354e: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:59:29.805518  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:29.807535  1604 raft_consensus.cc:2468] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 2.
I20260709 12:59:29.806341  1675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50664 (request call id 290) took 1167 ms. Trace:
I20260709 12:59:29.808347  1675 rpcz_store.cc:276] 0709 12:59:28.639076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:28.639187 (+   111us) service_pool.cc:224] Handling call
0709 12:59:28.639544 (+   357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:28.708086 (+ 68542us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:28.708114 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:28.710592 (+  2478us) log.cc:844] Serialized 26 byte log entry
0709 12:59:29.508265 (+797673us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:29.508309 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:29.773601 (+265292us) spinlock_profiling.cc:243] Waited 68.2 ms on lock 0x7b54002fba54. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 12:59:29.773650 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:29.773697 (+    47us) raft_consensus.cc:1685] finished
0709 12:59:29.773710 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:29.806266 (+ 32556us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":897,"raft.queue_time_us":2032,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":8461,"spinlock_wait_cycles":156787456,"thread_start_us":749253,"threads_started":1,"wal-append.queue_time_us":969328}
W20260709 12:59:29.812232  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 266750us
I20260709 12:59:29.816854  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:29.807838  1674 raft_consensus.cc:2376] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 3. Re-sending same reply.
I20260709 12:59:29.818123  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:29.818116  1526 raft_consensus.cc:1275] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:29.819928  1526 raft_consensus.cc:1240] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:29.725522  3258 raft_consensus.cc:515] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:29.729907  3348 raft_consensus.cc:515] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:29.783561  3340 raft_consensus.cc:3060] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:29.824061  2191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:29.771585  2222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50310 (request call id 444) took 1425 ms. Trace:
I20260709 12:59:29.825379  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:29.832302  1528 raft_consensus.cc:2468] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 3.
I20260709 12:59:29.829212  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:29.828014  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:29.833974  1526 raft_consensus.cc:2468] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 3.
I20260709 12:59:29.832463  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:29.811925  3411 raft_consensus.cc:493] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:29.837335  1644 leader_election.cc:304] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:29.729084  3262 consensus_queue.cc:260] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:29.839951  1644 leader_election.cc:304] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:29.844363  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:29.838985  3337 raft_consensus.cc:493] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:29.845239  3337 raft_consensus.cc:515] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:29.778139  3190 raft_consensus.cc:515] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:29.849107  1644 leader_election.cc:304] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:29.871217  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 12:59:30.058115  1527 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.776s	user 0.022s	sys 0.045s
I20260709 12:59:29.839356  3357 raft_consensus.cc:2749] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:29.849169  3426 leader_election.cc:290] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 2 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:29.831903  2222 rpcz_store.cc:276] 0709 12:59:28.345771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:28.347838 (+  2067us) service_pool.cc:224] Handling call
0709 12:59:28.348113 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:29.586098 (+1237985us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:29.771264 (+185166us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b54001306d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 12:59:29.771515 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2845810048}
W20260709 12:59:30.088222  3184 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.963s	user 0.006s	sys 0.036s
W20260709 12:59:30.125594  1498 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.925s	user 0.016s	sys 0.028s
W20260709 12:59:30.111683  3443 log.cc:927] Time spent T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.293s	user 0.000s	sys 0.001s
W20260709 12:59:30.054271  1496 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.679s	user 0.023s	sys 0.045s
W20260709 12:59:30.057754  1646 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.010s	sys 0.057s
W20260709 12:59:30.153431  1496 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.778s	user 0.030s	sys 0.046s
W20260709 12:59:30.158113  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 782685us
W20260709 12:59:30.153637  1646 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.649s	user 0.012s	sys 0.063s
I20260709 12:59:30.161630  1646 leader_election.cc:304] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
W20260709 12:59:30.152923  1498 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.953s	user 0.016s	sys 0.029s
W20260709 12:59:29.955811  3438 log.cc:927] Time spent T 00000000000000000000000000000000 P 9f38d0e5c9db43a48554defe1153354e: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
I20260709 12:59:29.818315  3313 raft_consensus.cc:515] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:29.842869  3411 raft_consensus.cc:3060] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:30.173188  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:30.175177  1681 raft_consensus.cc:1240] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:30.176169  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:30.177328  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:30.178231  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:30.141551  3314 raft_consensus.cc:493] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:30.178970  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:30.179171  3314 raft_consensus.cc:515] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:30.180425  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:30.181209  3314 leader_election.cc:290] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:30.181713  3314 raft_consensus.cc:493] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:30.183640  3337 leader_election.cc:290] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:30.182132  3314 raft_consensus.cc:515] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:30.184842  3412 raft_consensus.cc:493] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:30.185470  3412 raft_consensus.cc:515] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 12:59:30.188781  3264 consensus_meta.cc:287] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent flushing consensus metadata: real 0.586s	user 0.008s	sys 0.000s
I20260709 12:59:30.189229  3264 raft_consensus.cc:515] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:30.190878  3373 raft_consensus.cc:493] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
W20260709 12:59:30.191536  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:30.192140  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:30.147713  3279 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.025s	sys 0.041s
I20260709 12:59:29.825104  3390 consensus_queue.cc:1059] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 12:59:29.856307  3305 raft_consensus.cc:493] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
W20260709 12:59:29.978756  2226 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.705s	user 0.026s	sys 0.033s
W20260709 12:59:30.206429  2226 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.933s	user 0.032s	sys 0.043s
W20260709 12:59:30.146471  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:30.128671  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 297289us
W20260709 12:59:30.148032  1527 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.866s	user 0.022s	sys 0.053s
W20260709 12:59:30.128145  3271 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.018s	sys 0.024s
W20260709 12:59:30.152745  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 303719us
I20260709 12:59:30.154376  3391 raft_consensus.cc:2749] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:30.147293  3260 raft_consensus.cc:2749] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:30.169747  1674 raft_consensus.cc:1275] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:59:30.205129  3353 consensus_meta.cc:287] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.684s	user 0.000s	sys 0.009s
I20260709 12:59:30.172009  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:30.172248  3190 leader_election.cc:290] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:30.172736  3313 leader_election.cc:290] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:30.221264  1599 raft_consensus.cc:1275] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
W20260709 12:59:30.211748  3271 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.018s	sys 0.024s
I20260709 12:59:30.221670  1599 pending_rounds.cc:85] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642: Aborting all ops after (but not including) 5
I20260709 12:59:30.222030  1599 pending_rounds.cc:107] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:59:30.222335  1599 raft_consensus.cc:2889] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:29.840003  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:30.193812  1523 raft_consensus.cc:2393] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 4: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 12:59:30.191459  3373 raft_consensus.cc:515] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:30.148051  3386 raft_consensus.cc:3055] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:59:30.152637  3184 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.028s	user 0.007s	sys 0.037s
I20260709 12:59:30.239266  3184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:50654 (request call id 11) took 4603 ms. Trace:
I20260709 12:59:30.239668  3184 rpcz_store.cc:276] 0709 12:59:25.636497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:25.636635 (+   138us) service_pool.cc:224] Handling call
0709 12:59:25.642862 (+  6227us) log.cc:844] Serialized 506 byte log entry
0709 12:59:30.239154 (+4596292us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":976,"raft.run_cpu_time_us":1593,"raft.run_wall_time_us":1595,"thread_start_us":174880,"threads_started":1,"wal-append.queue_time_us":162585,"wal-append.run_cpu_time_us":2046,"wal-append.run_wall_time_us":1020651}
I20260709 12:59:30.151613  3262 raft_consensus.cc:3060] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:59:30.242259  3349 consensus_meta.cc:287] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.718s	user 0.008s	sys 0.001s
I20260709 12:59:30.214486  3426 raft_consensus.cc:493] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 12:59:30.245023  3426 raft_consensus.cc:515] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:30.201031  1681 raft_consensus.cc:2393] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 3: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 12:59:30.247325  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:30.247692  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:30.248982  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
W20260709 12:59:30.249225  1676 consensus_meta.cc:287] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.628s	user 0.007s	sys 0.000s
I20260709 12:59:30.249985  1679 raft_consensus.cc:2393] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 4: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 12:59:30.213310  3305 raft_consensus.cc:515] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 12:59:30.142748  3444 log.cc:927] Time spent T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.318s	user 0.000s	sys 0.011s
I20260709 12:59:30.250854  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:30.190804  3409 raft_consensus.cc:493] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 12:59:30.251506  1524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49310 (request call id 260) took 1764 ms. Trace:
I20260709 12:59:30.251557  1679 raft_consensus.cc:2393] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 3: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 12:59:30.156294  3441 raft_consensus.cc:493] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:30.251720  3409 raft_consensus.cc:515] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:30.252174  3305 leader_election.cc:290] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:30.252511  3441 raft_consensus.cc:515] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:30.252815  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:30.253695  3258 leader_election.cc:290] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:30.253903  3409 leader_election.cc:290] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:30.213474  2226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 563) took 1625 ms. Trace:
W20260709 12:59:30.196036  3279 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.026s	sys 0.041s
I20260709 12:59:30.254513  2226 rpcz_store.cc:276] 0709 12:59:28.588293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:28.588438 (+   145us) service_pool.cc:224] Handling call
0709 12:59:28.637627 (+ 49189us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:28.637965 (+   338us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:28.637992 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:28.659776 (+ 21784us) log.cc:844] Serialized 26 byte log entry
0709 12:59:29.273309 (+613533us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:30.206823 (+933514us) log.cc:844] Serialized 14 byte log entry
0709 12:59:30.213159 (+  6336us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:30.213237 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:30.213275 (+    38us) raft_consensus.cc:1685] finished
0709 12:59:30.213287 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:30.213419 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6068,"prepare.queue_time_us":487199,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":9128,"raft.run_cpu_time_us":267,"raft.run_wall_time_us":19137,"thread_start_us":1196329,"threads_started":2,"wal-append.queue_time_us":1030254}
W20260709 12:59:30.211802  3211 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.617s	user 0.015s	sys 0.056s
W20260709 12:59:30.256393  3211 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.662s	user 0.015s	sys 0.056s
W20260709 12:59:30.256597  3445 log.cc:927] Time spent T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.430s	user 0.003s	sys 0.000s
I20260709 12:59:30.192994  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:30.257268  1673 raft_consensus.cc:2393] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 4: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 12:59:30.258088  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:30.259261  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:30.259940  1673 raft_consensus.cc:2393] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 5: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 12:59:30.259999  1679 raft_consensus.cc:2468] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 3.
I20260709 12:59:30.261680  1530 raft_consensus.cc:1240] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:30.205993  3209 raft_consensus.cc:493] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:30.165462  1646 leader_election.cc:304] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:30.210435  3418 raft_consensus.cc:2749] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:30.227277  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 12:59:30.263463  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 98079.6us
I20260709 12:59:30.264216  1646 leader_election.cc:304] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:30.265349  1646 leader_election.cc:304] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:30.261197  1527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49310 (request call id 263) took 1772 ms. Trace:
I20260709 12:59:30.266794  1527 rpcz_store.cc:276] 0709 12:59:28.489270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:28.800566 (+311296us) service_pool.cc:224] Handling call
0709 12:59:28.801034 (+   468us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:28.806588 (+  5554us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:28.806721 (+   133us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:29.281555 (+474834us) log.cc:844] Serialized 26 byte log entry
0709 12:59:30.208351 (+926796us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:30.208388 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:30.208462 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:30.261021 (+ 52559us) raft_consensus.cc:1685] finished
0709 12:59:30.261039 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:30.261141 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4805,"raft.queue_time_us":41291,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":20122,"thread_start_us":926396,"threads_started":1,"wal-append.queue_time_us":936690}
I20260709 12:59:30.262805  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49310 (request call id 262) took 1774 ms. Trace:
I20260709 12:59:30.268539  1532 rpcz_store.cc:276] 0709 12:59:28.488840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:28.754345 (+265505us) service_pool.cc:224] Handling call
0709 12:59:28.754821 (+   476us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:28.755176 (+   355us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:28.755204 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:28.755694 (+   490us) log.cc:844] Serialized 26 byte log entry
0709 12:59:29.079130 (+323436us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:29.079167 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:29.079237 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:30.256062 (+1176825us) spinlock_profiling.cc:243] Waited 3.33 ms on lock 0x7b4400022b4c. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a153ecc85 00007f6a153ed6a2 00007f6a1815f1db 00007f6a1815aaaf 00007f6a1814e86e 00007f6a1814dbb6 00007f6a1814d7d8 00007f6a18157221 00007f6a181571d9 00007f6a18157169
0709 12:59:30.260797 (+  4735us) raft_consensus.cc:1685] finished
0709 12:59:30.260819 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:30.262737 (+  1918us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3116,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":112,"spinlock_wait_cycles":7663488,"thread_start_us":322996,"threads_started":1,"wal-append.queue_time_us":1008600}
I20260709 12:59:30.234807  3348 leader_election.cc:290] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:30.269912  3426 leader_election.cc:290] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:30.237782  1599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 361) took 1668 ms. Trace:
I20260709 12:59:30.249903  1676 raft_consensus.cc:1275] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 12:59:30.221446  3448 raft_consensus.cc:493] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:30.251995  1524 rpcz_store.cc:276] 0709 12:59:28.487663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:28.718409 (+230746us) service_pool.cc:224] Handling call
0709 12:59:28.718781 (+   372us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:28.719451 (+   670us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:28.719488 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:28.735347 (+ 15859us) log.cc:844] Serialized 26 byte log entry
0709 12:59:29.054233 (+318886us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:29.054281 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:29.054378 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:30.251302 (+1196924us) raft_consensus.cc:1685] finished
0709 12:59:30.251323 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:30.251451 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":318,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":13451,"thread_start_us":301218,"threads_started":1,"wal-append.queue_time_us":988047}
I20260709 12:59:30.238823  3386 raft_consensus.cc:740] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:30.281411  1676 pending_rounds.cc:85] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90: Aborting all ops after (but not including) 4
I20260709 12:59:30.204030  1678 raft_consensus.cc:2468] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 2.
I20260709 12:59:30.211114  1644 leader_election.cc:304] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:30.193360  3319 raft_consensus.cc:493] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
W20260709 12:59:30.321712  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 110644us
I20260709 12:59:30.322160  3319 raft_consensus.cc:515] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:30.322598  1644 leader_election.cc:304] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:30.324363  3319 leader_election.cc:290] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:30.225456  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:30.325098  3181 raft_consensus.cc:2749] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:30.325462  3357 raft_consensus.cc:2749] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:30.271064  1680 raft_consensus.cc:2468] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 3.
I20260709 12:59:30.270429  1599 rpcz_store.cc:276] 0709 12:59:28.569192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:28.610238 (+ 41046us) service_pool.cc:224] Handling call
0709 12:59:28.610567 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:30.222783 (+1612216us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:30.237481 (+ 14698us) spinlock_profiling.cc:243] Waited 1.61 s on lock 0x7b5400267ad4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 12:59:30.237676 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3701912448}
I20260709 12:59:30.272661  1646 leader_election.cc:304] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:30.326725  3442 raft_consensus.cc:3055] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:30.260668  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:30.327507  1673 raft_consensus.cc:2393] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 4: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 12:59:30.272109  1530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43010 (request call id 1559) took 1774 ms. Trace:
I20260709 12:59:30.327389  3453 raft_consensus.cc:2749] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:59:30.326956  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 54372.1us
I20260709 12:59:30.329360  1646 leader_election.cc:304] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:30.330108  3453 raft_consensus.cc:2804] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:30.330472  3453 raft_consensus.cc:493] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 12:59:30.330843  3453 raft_consensus.cc:3060] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:30.327137  3442 raft_consensus.cc:740] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:30.331929  3442 consensus_queue.cc:260] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:30.332631  1690 tablet_copy_source_session.cc:215] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:30.333138  3442 raft_consensus.cc:3060] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:30.333823  1690 rpcz_store.cc:275] Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.0.0.1:50664 (request call id 294) took 1668 ms. Trace:
W20260709 12:59:30.335204  3447 log.cc:927] Time spent T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.186s	user 0.000s	sys 0.000s
I20260709 12:59:30.328202  1530 rpcz_store.cc:276] 0709 12:59:28.497699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:28.758085 (+260386us) service_pool.cc:224] Handling call
0709 12:59:30.261485 (+1503400us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:30.262091 (+   606us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:30.271885 (+  9794us) spinlock_profiling.cc:243] Waited 1.5 s on lock 0x7b540002b050. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b28ad 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 12:59:30.272040 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3457241472}
I20260709 12:59:30.336344  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43010 (request call id 1566) took 1836 ms. Trace:
I20260709 12:59:30.336726  1529 rpcz_store.cc:276] 0709 12:59:28.499459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:28.761718 (+262259us) service_pool.cc:224] Handling call
0709 12:59:28.762195 (+   477us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:28.762498 (+   303us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:28.762523 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:28.763499 (+   976us) log.cc:844] Serialized 506 byte log entry
0709 12:59:29.725432 (+961933us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:29.725475 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:29.725551 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:30.336133 (+610582us) raft_consensus.cc:1685] finished
0709 12:59:30.336152 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:30.336288 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":961609,"threads_started":1,"wal-append.queue_time_us":1069133}
I20260709 12:59:30.339067  3264 leader_election.cc:290] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:30.339970  3453 raft_consensus.cc:515] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:30.308528  3448 raft_consensus.cc:515] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:30.342869  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:30.343516  1606 raft_consensus.cc:2468] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 3.
I20260709 12:59:30.343540  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:30.343123  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:30.344542  1607 raft_consensus.cc:3060] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:30.311699  1601 raft_consensus.cc:2393] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 4: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 12:59:30.345482  1644 leader_election.cc:304] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 12:59:30.254565  3441 leader_election.cc:290] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:30.282207  3271 raft_consensus.cc:2804] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:30.348161  1644 leader_election.cc:304] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:30.270644  1672 raft_consensus.cc:2468] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 5.
I20260709 12:59:30.265545  3349 raft_consensus.cc:515] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:30.278316  3391 raft_consensus.cc:2804] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:30.277966  3209 raft_consensus.cc:515] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:30.318863  3412 leader_election.cc:290] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:30.342311  3453 leader_election.cc:290] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 2 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:30.307883  3314 leader_election.cc:290] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:30.308606  1598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 360) took 1753 ms. Trace:
I20260709 12:59:30.393967  1603 raft_consensus.cc:1275] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:30.250216  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:30.321530  1676 pending_rounds.cc:107] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 12:59:30.360834  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:30.352437  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:30.395452  1604 raft_consensus.cc:1240] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:30.395941  1605 raft_consensus.cc:2468] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 3.
I20260709 12:59:30.359052  3260 raft_consensus.cc:2804] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:30.378939  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:30.376941  3357 raft_consensus.cc:493] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:30.334229  1690 rpcz_store.cc:276] 0709 12:59:28.673316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:28.705869 (+ 32553us) service_pool.cc:224] Handling call
0709 12:59:30.332283 (+1626414us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b540024de54. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185bd3f7 00007f6a1d553036 00007f6a1d55ca3e 00007f6a14e2027b 00007f6a1d55c9ba 00007f6a1d557acc 00007f6a1d552c7b 00007f6a1d5478d1 00007f6a1c5fb4b4 00007f6a1c5fb442
0709 12:59:30.333719 (+  1436us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2300528512}
I20260709 12:59:30.381917  3386 consensus_queue.cc:260] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 12:59:30.383075  3342 consensus_meta.cc:287] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.776s	user 0.007s	sys 0.003s
I20260709 12:59:30.352551  3271 raft_consensus.cc:493] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 12:59:30.383625  3448 leader_election.cc:290] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:30.384184  3453 raft_consensus.cc:493] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:30.384922  3356 raft_consensus.cc:2749] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:59:30.385751  3457 log.cc:927] Time spent T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 12:59:30.396870  1676 raft_consensus.cc:2889] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:30.392647  3373 leader_election.cc:290] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 12:59:30.389528  3340 consensus_meta.cc:287] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent flushing consensus metadata: real 0.552s	user 0.009s	sys 0.001s
W20260709 12:59:30.391033  1571 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.695s	user 0.007s	sys 0.019s
W20260709 12:59:30.439661  1571 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.744s	user 0.007s	sys 0.019s
W20260709 12:59:30.440001  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 744600us
I20260709 12:59:30.351327  3337 raft_consensus.cc:2804] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:30.402217  1599 raft_consensus.cc:1240] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:30.412977  1607 raft_consensus.cc:2468] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 3.
I20260709 12:59:30.360196  3391 raft_consensus.cc:493] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 12:59:30.417021  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:30.426461  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:30.443382  1603 raft_consensus.cc:2468] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 5.
I20260709 12:59:30.387450  3411 raft_consensus.cc:515] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:30.431615   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:30.432610  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
W20260709 12:59:30.388527  3424 consensus_meta.cc:287] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b: Time spent flushing consensus metadata: real 0.796s	user 0.010s	sys 0.000s
I20260709 12:59:30.434809  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 12:59:30.459895  1478 auto_rebalancer.cc:629] Failed to schedule move for tablet 112134ca2a6243c98c85c27d41496747: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:59:30.464567  2225 raft_consensus.cc:2468] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 3.
I20260709 12:59:30.429131  3271 raft_consensus.cc:3060] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:59:30.444183  1571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:30.479449  3337 raft_consensus.cc:697] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 3 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:30.482530  3337 consensus_queue.cc:237] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:30.451822  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:30.450519  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:30.455201  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:30.436914  3386 raft_consensus.cc:3060] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:59:30.433385  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 219113us
I20260709 12:59:30.411350  3262 raft_consensus.cc:493] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 12:59:30.485239  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 12:59:30.486231  1571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:30.487890  1571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:30.488585  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:30.489056  1571 leader_election.cc:304] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:30.489703  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:30.426029  3357 raft_consensus.cc:515] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:30.490983  3262 raft_consensus.cc:515] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:30.492394  3357 leader_election.cc:290] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:30.459328  3301 raft_consensus.cc:2804] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:30.491379  3260 raft_consensus.cc:493] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:30.461588  3391 raft_consensus.cc:3060] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:30.494822  1571 leader_election.cc:304] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:30.493930  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:30.497418  1606 raft_consensus.cc:2393] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 3: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 12:59:30.461496  3426 raft_consensus.cc:493] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:30.498951  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:30.507448  1524 raft_consensus.cc:3060] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:30.493424  3262 leader_election.cc:290] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:30.505205  1571 leader_election.cc:304] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:30.483771  3463 raft_consensus.cc:493] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:30.489161  1570 leader_election.cc:400] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 election: Vote denied by peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931) with higher term. Message: Invalid argument: T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 2. Current term is 3.
I20260709 12:59:30.437016  3453 raft_consensus.cc:515] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:30.484272  3358 raft_consensus.cc:493] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:30.480055  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:30.498174  3260 raft_consensus.cc:3060] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:30.498226  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50664 (request call id 288) took 3069 ms. Trace:
I20260709 12:59:30.512740  1570 leader_election.cc:403] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:59:30.505954  3459 raft_consensus.cc:493] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:30.524469  1570 leader_election.cc:304] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:30.508013  3442 raft_consensus.cc:2804] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:59:30.513331  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 165255us
I20260709 12:59:30.516641  1529 raft_consensus.cc:1240] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:59:30.525920  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:30.511121  1571 leader_election.cc:304] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:30.508283  1601 raft_consensus.cc:1275] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:30.498025  3314 raft_consensus.cc:2804] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:30.460700  3340 raft_consensus.cc:515] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 12:59:30.509130  1497 leader_election.cc:336] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Timed out: RequestConsensusVote RPC to 127.0.107.194:40303 timed out after 1.671s (SENT)
I20260709 12:59:30.512179  3348 raft_consensus.cc:2749] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:30.533315  1673 raft_consensus.cc:2468] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 5.
I20260709 12:59:30.535084  1644 leader_election.cc:304] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:30.535043  1497 leader_election.cc:304] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:30.540969  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:30.536724  1571 leader_election.cc:304] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:30.556044  1571 leader_election.cc:304] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:30.565809  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 12:59:30.589112  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 43845.6us
I20260709 12:59:30.589313  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 12:59:30.590073  1571 leader_election.cc:304] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:30.534601  3441 raft_consensus.cc:2804] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:30.529363  3442 raft_consensus.cc:493] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:30.565716  3258 raft_consensus.cc:2804] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:30.644012  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:30.642320  2224 raft_consensus.cc:1275] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:30.648118  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:30.588807  3390 raft_consensus.cc:2749] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:30.600492  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:30.592836  1644 leader_election.cc:304] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:30.611912  3418 raft_consensus.cc:493] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:30.591835  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:30.615024  1646 leader_election.cc:304] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:30.616358  1571 leader_election.cc:304] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:30.556232  3184 consensus_queue.cc:1048] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 12:59:30.589918  3412 raft_consensus.cc:2749] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:30.588356  3357 consensus_queue.cc:1059] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.052s
I20260709 12:59:30.555797  3342 raft_consensus.cc:2804] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:30.665069  3342 raft_consensus.cc:493] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 12:59:30.596100  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:30.615725  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 12:59:30.555733  3449 log.cc:927] Time spent T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.240s	user 0.000s	sys 0.001s
I20260709 12:59:30.529050  2222 raft_consensus.cc:2468] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 3.
I20260709 12:59:30.623814  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:30.666065  1529 raft_consensus.cc:2468] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 1.
I20260709 12:59:30.625180  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:30.628686  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:30.534732  3314 raft_consensus.cc:493] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 12:59:30.519402  3463 raft_consensus.cc:515] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:30.667560  3314 raft_consensus.cc:3060] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:30.669013  3463 leader_election.cc:290] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:30.522800  3358 raft_consensus.cc:515] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:30.652035  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:30.523288  1676 rpcz_store.cc:276] 0709 12:59:27.428960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:27.430150 (+  1190us) service_pool.cc:224] Handling call
0709 12:59:27.442193 (+ 12043us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:29.537273 (+2095080us) spinlock_profiling.cc:243] Waited 951 ms on lock 0x7b580060f5d0. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a1850f0aa 00007f6a18591447 00007f6a185a9fe7 00007f6a185ab7de 00007f6a185b5b49 00007f6a185b6416 00007f6a185b2d8f 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4
0709 12:59:30.467183 (+929910us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:30.496259 (+ 29076us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2187863424}
I20260709 12:59:30.612709  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:30.671119  2226 raft_consensus.cc:2410] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 12:59:30.591707  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 82624us
I20260709 12:59:30.511174  3426 raft_consensus.cc:515] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:30.673580  3426 leader_election.cc:290] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:30.612215  3319 raft_consensus.cc:493] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:30.674983  3319 raft_consensus.cc:515] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:30.677280  3319 leader_election.cc:290] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:30.660938  1599 raft_consensus.cc:2468] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 3.
I20260709 12:59:30.637513  3442 raft_consensus.cc:3060] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:30.665562  3342 raft_consensus.cc:3060] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:30.694044  3442 raft_consensus.cc:515] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:30.696970  3319 raft_consensus.cc:493] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:30.637985  3348 raft_consensus.cc:2804] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:30.637287  3349 leader_election.cc:290] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:30.649748  3441 raft_consensus.cc:697] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 3 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:30.648841  3258 raft_consensus.cc:493] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:30.648703  3209 leader_election.cc:290] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:30.653807  3262 raft_consensus.cc:2749] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931) with higher term. Message: Invalid argument: T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 2. Current term is 3.
W20260709 12:59:30.709853  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 93630.1us
I20260709 12:59:30.645835  3474 raft_consensus.cc:2804] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:30.555709  3459 raft_consensus.cc:515] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 12:59:30.709214  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:30.712942  3412 raft_consensus.cc:493] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:30.733958  2220 raft_consensus.cc:1275] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:30.737957  3475 raft_consensus.cc:493] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:30.738479  3475 raft_consensus.cc:515] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:30.392840  1598 rpcz_store.cc:276] 0709 12:59:28.555604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:28.595567 (+ 39963us) service_pool.cc:224] Handling call
0709 12:59:28.595931 (+   364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:28.663627 (+ 67696us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:28.666774 (+  3147us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:28.707298 (+ 40524us) log.cc:844] Serialized 26 byte log entry
0709 12:59:28.947992 (+240694us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:28.950566 (+  2574us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:28.978146 (+ 27580us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:30.273227 (+1295081us) raft_consensus.cc:1685] finished
0709 12:59:30.277459 (+  4232us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:30.299601 (+ 22142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44435,"raft.queue_time_us":45352,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":15282,"thread_start_us":150594,"threads_started":1,"wal-append.queue_time_us":1021310}
W20260709 12:59:30.740165  3464 log.cc:927] Time spent T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.183s	user 0.000s	sys 0.000s
I20260709 12:59:30.740681  3475 leader_election.cc:290] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:30.629671  3460 consensus_queue.cc:1059] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.087s
I20260709 12:59:30.704737  3348 raft_consensus.cc:493] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:30.741467  3475 raft_consensus.cc:2804] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:30.741807  3482 raft_consensus.cc:2804] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:30.742259  3482 raft_consensus.cc:493] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 12:59:30.742470  3411 leader_election.cc:290] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:30.713642  3463 raft_consensus.cc:493] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:30.743191  3463 raft_consensus.cc:515] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:59:30.699630  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:30.745756  1524 raft_consensus.cc:2468] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 3.
I20260709 12:59:30.697830  3319 raft_consensus.cc:515] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 12:59:30.774335  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:30.791611  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 142085us
I20260709 12:59:30.742617  3482 raft_consensus.cc:3060] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:30.724730  3258 raft_consensus.cc:3060] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:30.741604  3348 raft_consensus.cc:3060] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:30.723768  3390 raft_consensus.cc:2804] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:30.741751  3460 raft_consensus.cc:3055] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:30.742586  3301 raft_consensus.cc:493] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
W20260709 12:59:30.849507  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 234574us
I20260709 12:59:30.731952  3474 raft_consensus.cc:493] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
W20260709 12:59:30.858170  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 265408us
I20260709 12:59:30.825461  3475 raft_consensus.cc:493] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:30.737494  3412 raft_consensus.cc:515] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:30.700773  3418 raft_consensus.cc:515] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:30.742694  3349 consensus_queue.cc:1048] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.108s
I20260709 12:59:30.741389  3314 raft_consensus.cc:515] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:30.857713  3363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04fed4c219e14efb9f9a8eb0d336ceac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:30.850052  3460 raft_consensus.cc:740] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:30.863978  1646 leader_election.cc:304] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
W20260709 12:59:30.870558  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:30.859450  3301 raft_consensus.cc:3060] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:30.857637  3474 raft_consensus.cc:3060] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:30.872860  3453 leader_election.cc:290] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
W20260709 12:59:30.910512  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 46615us
I20260709 12:59:30.917663  1600 raft_consensus.cc:2468] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 2.
I20260709 12:59:30.865607  3475 raft_consensus.cc:3060] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:30.870133  3354 raft_consensus.cc:493] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:30.867748  3441 consensus_queue.cc:237] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:30.867146  3348 raft_consensus.cc:515] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 12:59:30.946355  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 119290us
I20260709 12:59:30.949115  3314 leader_election.cc:290] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:30.950026  3459 leader_election.cc:290] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:30.952746  3418 leader_election.cc:290] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:30.954429  3487 raft_consensus.cc:2804] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:30.954919  3487 raft_consensus.cc:493] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:30.955277  3487 raft_consensus.cc:3060] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:30.956252  3356 consensus_queue.cc:1048] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:30.954486  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 12:59:30.987447  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 65456.3us
I20260709 12:59:30.935427  3340 leader_election.cc:290] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:30.936007  3181 consensus_queue.cc:1048] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 12:59:30.996081  3489 raft_consensus.cc:493] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:30.996676  3489 raft_consensus.cc:515] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:30.997829  1646 leader_election.cc:304] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:30.999258  1646 leader_election.cc:304] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:30.999857  3348 leader_election.cc:290] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:31.000772  1646 leader_election.cc:304] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:31.002499  3181 raft_consensus.cc:3060] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:31.004613  3319 leader_election.cc:290] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:31.005934  3442 leader_election.cc:290] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:31.007866  3258 raft_consensus.cc:515] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:31.009999  3258 leader_election.cc:290] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:31.010200  3181 raft_consensus.cc:2749] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:31.010844  3342 raft_consensus.cc:515] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:31.011103  3181 consensus_queue.cc:1059] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:31.012192  3181 raft_consensus.cc:2804] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:31.012663  3181 raft_consensus.cc:697] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 3 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:31.012871  3342 leader_election.cc:290] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:31.009891  3488 raft_consensus.cc:2804] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:31.013701  3463 leader_election.cc:290] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:31.013682  3488 raft_consensus.cc:493] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:30.931901  3354 raft_consensus.cc:515] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:31.014640  3488 raft_consensus.cc:3060] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:31.016113  3354 leader_election.cc:290] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:31.013754  3181 consensus_queue.cc:237] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:31.020519  3340 raft_consensus.cc:493] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:31.021072  3340 raft_consensus.cc:515] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:31.021463  3482 raft_consensus.cc:515] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:31.027933  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:31.034305  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:31.034811  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:31.036554  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:31.036934  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:31.037853  1679 raft_consensus.cc:2393] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 3: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 12:59:31.039710  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:31.038798  1677 raft_consensus.cc:2376] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 4. Re-sending same reply.
I20260709 12:59:30.927145  3484 consensus_queue.cc:1059] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.072s
I20260709 12:59:31.068269  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:31.068038  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:31.071187  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:31.071755  1677 raft_consensus.cc:3060] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:31.072434  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:31.072225  3497 consensus_queue.cc:1048] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:30.990056  3314 raft_consensus.cc:493] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:31.079548  1677 raft_consensus.cc:2468] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 6.
I20260709 12:59:31.067729  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 12:59:31.084214  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 558944us
I20260709 12:59:31.084959  1570 leader_election.cc:304] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:31.086861  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:31.089751  3484 raft_consensus.cc:3055] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:31.090214  3484 raft_consensus.cc:740] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 12:59:31.012820  3358 leader_election.cc:290] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:31.091203  3484 consensus_queue.cc:260] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 12:59:31.076431  3391 consensus_meta.cc:287] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.565s	user 0.009s	sys 0.001s
I20260709 12:59:31.092521  3484 raft_consensus.cc:3060] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:31.092388  3391 raft_consensus.cc:515] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:31.023196  3340 leader_election.cc:290] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:31.014202  3184 raft_consensus.cc:3055] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:59:31.069787  3467 log.cc:927] Time spent T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.325s	user 0.001s	sys 0.000s
I20260709 12:59:31.075842  3314 raft_consensus.cc:515] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:31.095443  1570 leader_election.cc:304] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:31.108029  1571 leader_election.cc:304] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:31.110764  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 12:59:31.096511  3386 consensus_meta.cc:287] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.599s	user 0.004s	sys 0.007s
I20260709 12:59:31.112174  1571 leader_election.cc:304] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:31.081902  3489 leader_election.cc:290] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:31.081162  3390 raft_consensus.cc:697] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 3 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:31.116978  1571 leader_election.cc:304] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:31.098436  3184 raft_consensus.cc:740] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:31.097540  3349 raft_consensus.cc:2804] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:31.090301  3487 raft_consensus.cc:515] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:31.111290  3354 raft_consensus.cc:2804] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:30.948087  3460 consensus_queue.cc:260] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:31.131793  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:31.116186  3258 raft_consensus.cc:2804] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:59:31.135649  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 177047us
I20260709 12:59:31.136436  1678 raft_consensus.cc:1240] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 3 LEADER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 2. Current term is 3. Ops: []
W20260709 12:59:31.141091  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 138915us
I20260709 12:59:31.151469  1646 leader_election.cc:304] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:31.122493  3262 raft_consensus.cc:2804] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:31.119143  3412 leader_election.cc:290] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:31.123701  3489 raft_consensus.cc:3055] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:31.118134  3486 raft_consensus.cc:2749] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:31.159446  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:31.123903  3349 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:31.122462  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:31.162310  1605 raft_consensus.cc:1240] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:31.124574  3418 raft_consensus.cc:493] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:31.180313  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 12:59:31.167676  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 303114us
I20260709 12:59:31.119370  3348 consensus_queue.cc:1048] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 12:59:31.132833  3354 raft_consensus.cc:493] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:31.183282  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 12:59:31.184152  2224 raft_consensus.cc:3060] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:31.191252  2224 raft_consensus.cc:2468] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 4.
I20260709 12:59:31.168571  3482 leader_election.cc:290] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:31.198999  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:31.170855  3489 raft_consensus.cc:740] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:31.201381  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:31.208246  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 12:59:31.208886  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 54070.8us
I20260709 12:59:31.178985  3258 raft_consensus.cc:697] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 4 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:31.200752  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:31.213613  1524 raft_consensus.cc:2376] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 3. Re-sending same reply.
I20260709 12:59:31.214262  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:31.214476  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:31.192978  3354 raft_consensus.cc:3060] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:31.204907  1526 raft_consensus.cc:2468] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 6.
I20260709 12:59:31.191540  3262 raft_consensus.cc:697] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 6 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
W20260709 12:59:31.209869  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:31.179183  3349 raft_consensus.cc:3060] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:31.162063  3411 consensus_queue.cc:1059] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 12:59:31.220625  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:31.211464  1528 raft_consensus.cc:1275] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:59:31.221405  1604 raft_consensus.cc:2468] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 5.
I20260709 12:59:31.212363  1644 leader_election.cc:304] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:31.212924  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:31.216007  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:31.209124  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 12:59:31.220084  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 58111.5us
I20260709 12:59:31.196560  1676 raft_consensus.cc:2468] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 3.
I20260709 12:59:31.215029  1524 raft_consensus.cc:2468] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 4.
I20260709 12:59:31.219667  1606 raft_consensus.cc:1240] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:31.216826  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:31.204030  3505 raft_consensus.cc:2804] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:31.230288  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:31.172574  3184 consensus_queue.cc:260] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:31.231660  1496 leader_election.cc:304] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:31.230997  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:31.228729  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:31.236029  1603 raft_consensus.cc:3060] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:31.236145  1677 raft_consensus.cc:2468] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 4.
W20260709 12:59:31.218029  3352 consensus_meta.cc:287] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b: Time spent flushing consensus metadata: real 0.960s	user 0.011s	sys 0.004s
I20260709 12:59:31.238559  3262 consensus_queue.cc:237] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:31.239055  3184 raft_consensus.cc:3060] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:31.241726  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:31.242995  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:31.244129  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:31.245307  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:31.247264  3487 leader_election.cc:290] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:31.233491  1644 leader_election.cc:304] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 12:59:31.232843  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:31.194777  3418 raft_consensus.cc:515] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:31.228629  3466 raft_consensus.cc:3055] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:31.237650  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:31.258526  1571 leader_election.cc:304] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:31.258992  1525 raft_consensus.cc:2468] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 4.
I20260709 12:59:31.259464  1571 leader_election.cc:304] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:31.230780  3465 raft_consensus.cc:493] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:31.248229  1602 raft_consensus.cc:2468] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 2.
I20260709 12:59:31.260747  1644 leader_election.cc:304] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:31.229940  3505 raft_consensus.cc:493] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:31.236969  1496 leader_election.cc:304] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:31.230223  3314 leader_election.cc:290] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:31.232306  3391 leader_election.cc:290] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:31.235010  3337 raft_consensus.cc:2749] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:59:31.261544  3473 consensus_queue.cc:1048] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:31.264358  3505 raft_consensus.cc:3060] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:31.209738  3390 consensus_queue.cc:237] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:31.256613  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:31.246404  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:31.286377  1603 raft_consensus.cc:2468] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 4.
I20260709 12:59:31.279464  1678 raft_consensus.cc:1240] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:31.268689  1497 leader_election.cc:304] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:31.289163  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:31.290195  1525 raft_consensus.cc:2468] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 4.
I20260709 12:59:31.258394  3466 raft_consensus.cc:740] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 12:59:31.265220  1644 leader_election.cc:304] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:31.268810  3482 raft_consensus.cc:2749] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:31.229921  3258 consensus_queue.cc:237] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:31.276571  3487 consensus_queue.cc:1048] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.042s
W20260709 12:59:31.288062  3271 consensus_meta.cc:287] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.793s	user 0.003s	sys 0.008s
I20260709 12:59:31.314991  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:31.265429  3504 raft_consensus.cc:2804] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:31.314523  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:31.269572  3486 raft_consensus.cc:2804] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:31.317252  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:31.272298  3348 raft_consensus.cc:493] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:31.319590  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 54446.7us
I20260709 12:59:31.269024  3500 raft_consensus.cc:493] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:31.291380  3164 raft_consensus.cc:493] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:31.269129  3509 raft_consensus.cc:2804] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:31.274411  3404 consensus_queue.cc:1048] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 12:59:31.294615  3459 raft_consensus.cc:2749] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:31.291991  3494 raft_consensus.cc:493] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:31.276762  3340 raft_consensus.cc:3060] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:31.329316  3504 raft_consensus.cc:493] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
W20260709 12:59:31.321197  3260 consensus_meta.cc:287] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.788s	user 0.008s	sys 0.003s
I20260709 12:59:31.274780  3465 raft_consensus.cc:515] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:31.290735  3488 raft_consensus.cc:515] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:31.325423  3411 consensus_queue.cc:1059] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.100s
I20260709 12:59:31.411430  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:31.324364  3181 raft_consensus.cc:2804] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:31.328384  3486 raft_consensus.cc:493] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:31.272740  3349 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:59:31.363335  3509 raft_consensus.cc:493] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:31.327577  1607 raft_consensus.cc:2468] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 4.
I20260709 12:59:31.294306  3463 consensus_queue.cc:1059] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 12:59:31.448553  1525 raft_consensus.cc:2410] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:59:31.470080  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:31.471179  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:31.472126  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:31.472602  1525 raft_consensus.cc:3060] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:31.439544  3418 leader_election.cc:290] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:31.424603  3466 consensus_queue.cc:260] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:31.364987  3164 raft_consensus.cc:515] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:31.363821  3348 raft_consensus.cc:515] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:31.415846  3475 raft_consensus.cc:515] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:31.440835  3494 raft_consensus.cc:515] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 12:59:31.454596  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 217704us
I20260709 12:59:31.507804  1496 leader_election.cc:304] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:31.465749  3486 raft_consensus.cc:3060] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:59:31.477770  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 190613us
I20260709 12:59:31.445268  3516 raft_consensus.cc:2749] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:31.441116  3504 raft_consensus.cc:3060] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:59:31.475445  3502 log.cc:927] Time spent T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.252s	user 0.000s	sys 0.001s
I20260709 12:59:31.500784  1673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49170 (request call id 1507) took 1052 ms. Trace:
W20260709 12:59:31.504580  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 211334us
I20260709 12:59:31.462380  3181 raft_consensus.cc:493] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:31.509091  1496 leader_election.cc:304] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 12:59:31.332298  3271 raft_consensus.cc:515] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:31.511531  2192 leader_election.cc:304] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:31.478621  1681 raft_consensus.cc:2393] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 4: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 12:59:31.475898  3509 raft_consensus.cc:3060] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:31.445317  3260 raft_consensus.cc:515] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:31.515892  1673 rpcz_store.cc:276] 0709 12:59:30.448504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:30.450208 (+  1704us) service_pool.cc:224] Handling call
0709 12:59:31.482036 (+1031828us) spinlock_profiling.cc:243] Waited 48.4 ms on lock 0x7b54002fce54. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 12:59:31.500718 (+ 18682us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":111290752}
I20260709 12:59:31.524307  1496 leader_election.cc:304] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:31.535007  1571 leader_election.cc:304] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:31.519972  1525 raft_consensus.cc:2468] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 4.
I20260709 12:59:31.520165  1679 raft_consensus.cc:2393] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 4: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 12:59:31.517863  1497 leader_election.cc:304] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
W20260709 12:59:31.509873  3474 consensus_meta.cc:287] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.583s	user 0.009s	sys 0.001s
I20260709 12:59:31.364352  3500 raft_consensus.cc:515] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:31.540958  3526 raft_consensus.cc:2804] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:31.532641  3164 leader_election.cc:290] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:31.536602  1496 leader_election.cc:304] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:31.520774  3181 raft_consensus.cc:3060] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:31.548413  1644 leader_election.cc:304] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:31.539915  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 12:59:31.546028  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 271422us
I20260709 12:59:31.537413  3516 raft_consensus.cc:2749] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:31.537494  3474 raft_consensus.cc:515] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:31.556986  3348 leader_election.cc:290] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:31.557829  3474 leader_election.cc:290] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:31.558467  3475 leader_election.cc:290] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
W20260709 12:59:31.559257  3513 log.cc:927] Time spent T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:59:31.543628  2192 leader_election.cc:304] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:31.560259  3260 leader_election.cc:290] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:31.561373  3404 raft_consensus.cc:2804] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:31.561873  3404 raft_consensus.cc:697] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [term 2 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 12:59:31.551417  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:31.564401  1603 raft_consensus.cc:1275] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:59:31.537717  3527 raft_consensus.cc:2804] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:31.552071  1675 raft_consensus.cc:2393] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 3: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 12:59:31.551708  1525 raft_consensus.cc:2468] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 3.
I20260709 12:59:31.550871  1570 leader_election.cc:304] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:31.554977  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:31.555563  1607 raft_consensus.cc:1275] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:31.566789  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:31.555861  3516 raft_consensus.cc:2749] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:31.568895  1646 leader_election.cc:304] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:31.571774  1570 leader_election.cc:304] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:31.538152  3411 raft_consensus.cc:2764] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260709 12:59:31.575109  1603 raft_consensus.cc:1240] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:31.576016  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:31.576977  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:31.577437  1525 raft_consensus.cc:2468] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 2.
I20260709 12:59:31.578101  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:31.543634  3345 raft_consensus.cc:2804] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:31.581492  1570 leader_election.cc:304] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:31.543365  3526 raft_consensus.cc:697] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 12:59:31.587499  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:31.588004  1525 raft_consensus.cc:3060] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:31.513640  3518 raft_consensus.cc:2749] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:31.573033  3503 raft_consensus.cc:2804] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:31.578900  3441 raft_consensus.cc:2749] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:31.578962  3482 consensus_queue.cc:1048] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
W20260709 12:59:31.593232  3525 log.cc:927] Time spent T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 12:59:31.597118  3475 consensus_queue.cc:1048] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:31.565656  3453 raft_consensus.cc:2804] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:59:31.600473  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 63953.3us
I20260709 12:59:31.571763  3527 raft_consensus.cc:493] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:31.586264  3345 raft_consensus.cc:493] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:31.605271  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
W20260709 12:59:31.599876  3301 consensus_meta.cc:287] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.674s	user 0.005s	sys 0.006s
I20260709 12:59:31.608548  1673 raft_consensus.cc:1240] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:31.608827  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:31.612416  1677 raft_consensus.cc:2468] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 3.
I20260709 12:59:31.612826  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:31.613234  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:31.613888  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:31.609750  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:31.609761  1525 raft_consensus.cc:2468] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 3.
I20260709 12:59:31.614228  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:31.615201  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:31.630312  1677 raft_consensus.cc:2468] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 3.
W20260709 12:59:31.634965  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:31.601001  3503 raft_consensus.cc:493] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:31.614907  1680 raft_consensus.cc:2393] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 3: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 12:59:31.601567  3258 raft_consensus.cc:2749] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:31.632469  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:31.632762  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:31.632458  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:31.635507  1644 leader_election.cc:304] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:31.638456  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:31.641810  1602 raft_consensus.cc:2393] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 3: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 12:59:31.643626  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:31.606202  3453 raft_consensus.cc:493] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:31.649916  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:31.515131  3521 consensus_queue.cc:1059] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.098s
I20260709 12:59:31.585781  3404 consensus_queue.cc:237] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:31.612967  3345 raft_consensus.cc:3060] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:59:31.648036  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 66641.7us
I20260709 12:59:31.650876  1525 raft_consensus.cc:2393] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 3: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 12:59:31.686410  1570 leader_election.cc:304] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:31.662485  1680 raft_consensus.cc:1240] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:31.687268  2190 leader_election.cc:304] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 12:59:31.684149  3271 leader_election.cc:290] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 2 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:31.651765  3526 consensus_queue.cc:237] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:31.652043  3453 raft_consensus.cc:3060] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:59:31.643575  3484 consensus_meta.cc:287] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b: Time spent flushing consensus metadata: real 0.551s	user 0.006s	sys 0.006s
I20260709 12:59:31.598711  3356 consensus_queue.cc:1059] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 12:59:31.696316  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 12:59:31.687764  1570 leader_election.cc:304] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:31.640753  3503 raft_consensus.cc:3060] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:31.611297  3527 raft_consensus.cc:3060] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:31.641211  3390 raft_consensus.cc:2804] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:31.688059  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:31.631865  3301 raft_consensus.cc:515] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:31.639798  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 12:59:31.697273  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:31.699651  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:31.703730  3500 leader_election.cc:290] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:31.712772  3301 leader_election.cc:290] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:31.696187  3354 raft_consensus.cc:515] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:31.704227  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:31.694947  3493 raft_consensus.cc:2804] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:31.674436  3349 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:31.669431  3488 leader_election.cc:290] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:31.723374  2221 raft_consensus.cc:3060] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:31.652313  3474 raft_consensus.cc:2804] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:31.694626  3441 raft_consensus.cc:2804] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:31.709606  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:31.725489  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:31.685284  3504 raft_consensus.cc:515] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:31.734753  3356 raft_consensus.cc:493] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 12:59:31.735149  1678 raft_consensus.cc:1240] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:31.710944  1525 raft_consensus.cc:2468] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 2.
I20260709 12:59:31.736593  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:31.737170  1525 raft_consensus.cc:2468] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 2.
I20260709 12:59:31.735298  3356 raft_consensus.cc:515] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:31.737942  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:31.738588  1525 raft_consensus.cc:2393] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 4: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
W20260709 12:59:31.739363  3483 log.cc:927] Time spent T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.836s	user 0.003s	sys 0.000s
I20260709 12:59:31.740525  3494 leader_election.cc:290] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:31.740859  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:31.741066  3494 consensus_queue.cc:1059] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:31.741829  3494 raft_consensus.cc:3055] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:31.742226  3494 raft_consensus.cc:740] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:31.742815  1599 raft_consensus.cc:1240] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:31.726605  3493 raft_consensus.cc:493] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:31.743317  3493 raft_consensus.cc:3060] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:31.711113  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 12:59:31.744524  1571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:31.715859  1674 raft_consensus.cc:2393] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 4: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
W20260709 12:59:31.745281  2223 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50326 (request call id 513) took 1295 ms (client timeout 1606 ms). Trace:
I20260709 12:59:31.643236  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:31.720335  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:31.722443  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:31.696557  3465 leader_election.cc:290] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:31.724138  3474 raft_consensus.cc:697] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 3 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:31.728305  3441 raft_consensus.cc:493] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:31.729943  3509 raft_consensus.cc:515] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:31.634475  3505 raft_consensus.cc:515] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:31.732059  3340 raft_consensus.cc:2749] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:31.744940  1680 raft_consensus.cc:2468] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 4.
I20260709 12:59:31.741741  1530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49310 (request call id 275) took 1230 ms. Trace:
W20260709 12:59:31.745671  2223 rpcz_store.cc:269] 0709 12:59:30.430049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:30.430189 (+   140us) service_pool.cc:224] Handling call
0709 12:59:30.499037 (+ 68848us) spinlock_profiling.cc:243] Waited 13.9 ms on lock 0x7b5800015c98. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a1548eb71 00007f6a1548ea22 00007f6a1e3a7c09 00007f6a1d501ee0 00007f6a1d5cb0ab 00007f6a1d5cb131 00007f6a1d5790a0 00007f6a1d578984 00007f6a16af36d4 00007f6a16af3662
0709 12:59:30.532235 (+ 33198us) spinlock_profiling.cc:243] Waited 4.67 ms on lock 0x7b5800015c98. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a1548ee9c 00007f6a1548ea5b 00007f6a1e3a7c09 00007f6a1d501ee0 00007f6a1d5cb0ab 00007f6a1d5cb131 00007f6a1d5790a0 00007f6a1d578984 00007f6a16af36d4 00007f6a16af3662
0709 12:59:31.709499 (+1177264us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b5800015c98. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a1548eb71 00007f6a1548eeee 0000000000375939 00007f6a1d5021e0 00007f6a1d5cb0c4 00007f6a1d5cb131 00007f6a1d5790a0 00007f6a1d578984 00007f6a16af36d4 00007f6a16af3662
0709 12:59:31.725012 (+ 15513us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":67105664}
I20260709 12:59:31.735723  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:31.747213  2225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50310 (request call id 448) took 1234 ms. Trace:
I20260709 12:59:31.725164  3390 raft_consensus.cc:697] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 4 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:31.742120  3504 leader_election.cc:290] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:31.739283  3356 leader_election.cc:290] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:31.767477  1606 raft_consensus.cc:2368] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 3. Current term is 4.
I20260709 12:59:31.751228  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:31.769480  1525 raft_consensus.cc:2393] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 3: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 12:59:31.756377  1571 leader_election.cc:304] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
W20260709 12:59:31.754540  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 66860.8us
I20260709 12:59:31.755685  1530 rpcz_store.cc:276] 0709 12:59:30.511797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:30.512263 (+   466us) service_pool.cc:224] Handling call
0709 12:59:30.512562 (+   299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:30.518681 (+  6119us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:30.518711 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:30.521613 (+  2902us) log.cc:844] Serialized 26 byte log entry
0709 12:59:30.650680 (+129067us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:30.650719 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:30.650777 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:31.738834 (+1088057us) spinlock_profiling.cc:243] Waited 2.31 ms on lock 0x7b4400022b4c. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a153ecc85 00007f6a153ed6a2 00007f6a1815f1db 00007f6a1815aaaf 00007f6a1814e86e 00007f6a1814dbb6 00007f6a1814d7d8 00007f6a18157221 00007f6a181571d9 00007f6a18157169
0709 12:59:31.741450 (+  2616us) raft_consensus.cc:1685] finished
0709 12:59:31.741469 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:31.741684 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":612,"raft.queue_time_us":2846,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":1130,"spinlock_wait_cycles":5304576,"thread_start_us":59007,"threads_started":1,"wal-append.queue_time_us":311679}
I20260709 12:59:31.770700  1570 leader_election.cc:304] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:31.770896  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:31.733386  3181 raft_consensus.cc:515] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:31.736392  3519 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:31.759397  1496 leader_election.cc:304] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:31.760167  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:31.758407  2225 rpcz_store.cc:276] 0709 12:59:30.502026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:30.503180 (+  1154us) service_pool.cc:224] Handling call
0709 12:59:30.532930 (+ 29750us) spinlock_profiling.cc:243] Waited 1.28 ms on lock 0x7b5800015c98. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a1548eb71 00007f6a1548ea22 00007f6a1e3a7c09 00007f6a1d501ee0 00007f6a1d5cb0ab 00007f6a1d5cb131 00007f6a1d5790a0 00007f6a1d578984 00007f6a16af36d4 00007f6a16af3662
0709 12:59:31.725349 (+1192419us) spinlock_profiling.cc:243] Waited 10 ms on lock 0x7b5800015c98. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a1548ee9c 00007f6a1548ea5b 00007f6a1e3a7c09 00007f6a1d501ee0 00007f6a1d5cb0ab 00007f6a1d5cb131 00007f6a1d5790a0 00007f6a1d578984 00007f6a16af36d4 00007f6a16af3662
0709 12:59:31.736670 (+ 11321us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26036864}
I20260709 12:59:31.760799  1529 raft_consensus.cc:2468] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 4.
I20260709 12:59:31.755143  3441 raft_consensus.cc:3060] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:31.757148  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:31.775974  1680 raft_consensus.cc:1240] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:31.771499  1530 raft_consensus.cc:2468] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 4.
I20260709 12:59:31.758106  3348 raft_consensus.cc:2749] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:31.780511  1680 raft_consensus.cc:1240] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:31.772320  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:31.778592  3519 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:59:31.760273  3354 leader_election.cc:290] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:31.782716  1570 leader_election.cc:304] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:31.788897  1678 raft_consensus.cc:1240] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:31.743112  3494 consensus_queue.cc:260] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:31.784602  1496 leader_election.cc:304] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:31.761793  3529 consensus_queue.cc:1059] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 12:59:31.791724  1496 leader_election.cc:304] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:31.792276  3342 raft_consensus.cc:2749] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:31.793876  1496 leader_election.cc:304] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:31.795630  1532 raft_consensus.cc:1275] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:59:31.782048  3532 raft_consensus.cc:2804] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:31.787493  3349 raft_consensus.cc:2804] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:31.785941  1530 raft_consensus.cc:2955] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index -1 to 5, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:59:31.821748  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:31.822695  1599 raft_consensus.cc:2393] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 2: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 12:59:31.785121  3465 raft_consensus.cc:2804] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:31.824108  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:31.790557  3486 raft_consensus.cc:515] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:31.795787  3340 raft_consensus.cc:2804] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:31.794804  3516 raft_consensus.cc:2749] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:31.825013  3494 raft_consensus.cc:3060] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:31.823907  3465 raft_consensus.cc:493] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:31.801635  3348 consensus_queue.cc:1059] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 12:59:31.822058  3349 raft_consensus.cc:493] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:31.821520  3532 raft_consensus.cc:493] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:31.860216  3356 raft_consensus.cc:493] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 12:59:31.860726  3509 leader_election.cc:290] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:31.862064  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:31.866326  1680 raft_consensus.cc:3060] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:31.832947  3533 raft_consensus.cc:2749] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:59:31.852421  3340 raft_consensus.cc:493] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:31.796149  3474 consensus_queue.cc:237] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:31.847635  3503 raft_consensus.cc:515] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:31.859395  3465 raft_consensus.cc:3060] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:31.865427  3349 raft_consensus.cc:3060] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:31.868608  3356 raft_consensus.cc:515] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:31.883351  1676 raft_consensus.cc:1275] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:59:31.884377  3181 leader_election.cc:290] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:31.870759  3340 raft_consensus.cc:3060] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:31.886008  3345 raft_consensus.cc:515] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:31.878731  3505 leader_election.cc:290] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:31.887974  3493 raft_consensus.cc:515] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:31.891623  3519 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:31.865999  3532 raft_consensus.cc:3060] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:31.843050  3390 consensus_queue.cc:237] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:31.903571  1528 raft_consensus.cc:1275] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:31.904263  3486 leader_election.cc:290] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:31.904146  3356 leader_election.cc:290] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:31.919862  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:31.920564  1676 raft_consensus.cc:3060] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:31.917835  3486 raft_consensus.cc:493] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:31.917520  3348 raft_consensus.cc:493] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
W20260709 12:59:31.951570  3535 log.cc:927] Time spent T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.181s	user 0.000s	sys 0.001s
I20260709 12:59:31.964237  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:31.966620  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:31.973803  1676 raft_consensus.cc:2468] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 5.
I20260709 12:59:31.932835  3441 raft_consensus.cc:515] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 12:59:31.979995  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 186170us
I20260709 12:59:31.983503  3493 leader_election.cc:290] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 2 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:31.986789  1571 leader_election.cc:304] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:31.987882  1496 leader_election.cc:304] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:31.914950  3508 consensus_queue.cc:1048] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 12:59:31.993086  3264 raft_consensus.cc:493] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:31.980453  2221 raft_consensus.cc:2468] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 4.
I20260709 12:59:32.001873  1607 raft_consensus.cc:1240] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:31.999462  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 12:59:31.956998  3486 raft_consensus.cc:515] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:31.999117  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:32.027745  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:31.993726  3264 raft_consensus.cc:515] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:32.000012  2227 raft_consensus.cc:1240] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:31.950570  1532 raft_consensus.cc:2955] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:59:31.960379  3348 raft_consensus.cc:515] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:32.026449  1646 leader_election.cc:304] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 12:59:32.115272  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 124331us
I20260709 12:59:32.115586  1527 raft_consensus.cc:1240] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:32.117548  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:32.118902  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 12:59:32.127456  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 101109us
I20260709 12:59:32.128757  1496 leader_election.cc:304] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:32.128398  1646 leader_election.cc:304] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:31.990623  3453 raft_consensus.cc:515] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:32.133992  3184 raft_consensus.cc:2804] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:32.134505  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:32.134631  3358 raft_consensus.cc:2749] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:32.135131  1677 raft_consensus.cc:2468] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 4.
I20260709 12:59:32.135273  1673 raft_consensus.cc:2368] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 5. Current term is 6.
I20260709 12:59:32.136123  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:31.998967  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 12:59:32.144842  1646 leader_election.cc:304] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:31.994834  3539 consensus_queue.cc:1059] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.133s
I20260709 12:59:32.116056  3493 raft_consensus.cc:493] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:32.127303  3505 raft_consensus.cc:493] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:32.148413  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 12:59:32.148639  1646 leader_election.cc:304] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:32.156697  1570 leader_election.cc:304] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:32.156854  1646 leader_election.cc:304] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:32.145982  3184 raft_consensus.cc:697] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 4 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:32.132056  3441 leader_election.cc:290] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:32.159163  2191 leader_election.cc:304] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:31.989472  3516 consensus_queue.cc:1059] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.157s
I20260709 12:59:32.147375  3503 leader_election.cc:290] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:32.138721  3540 raft_consensus.cc:493] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:32.168676  2191 leader_election.cc:304] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:32.189980  1680 raft_consensus.cc:2468] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 4.
I20260709 12:59:32.151507  3345 leader_election.cc:290] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 6 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 12:59:32.179567  3541 log.cc:927] Time spent T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:59:32.199762  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 12:59:32.163419  3301 raft_consensus.cc:2749] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:32.149029  3504 raft_consensus.cc:2749] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:59:32.194885  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 66229.1us
I20260709 12:59:32.179477  3539 raft_consensus.cc:2749] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:32.219571  1496 leader_election.cc:304] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:32.162990  3493 raft_consensus.cc:515] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:32.186828  3209 raft_consensus.cc:2749] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:32.166550  3488 raft_consensus.cc:2749] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:32.146055  3527 raft_consensus.cc:515] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:32.219369  2191 leader_election.cc:304] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:32.189935  2222 raft_consensus.cc:2393] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 2: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 12:59:32.190697  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:32.229403  2191 leader_election.cc:304] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:32.202436  3459 raft_consensus.cc:493] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:32.210265  3515 raft_consensus.cc:3055] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:32.165943  3505 raft_consensus.cc:515] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:32.221266  1496 leader_election.cc:304] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:32.182955  3500 consensus_queue.cc:1059] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 12:59:32.231364  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:32.194001  3482 consensus_queue.cc:1048] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 12:59:32.246330  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:32.233503  3305 raft_consensus.cc:2749] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:59:32.249534  3493 leader_election.cc:290] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:32.201663  3340 raft_consensus.cc:515] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:32.251981  1680 raft_consensus.cc:1240] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:32.246902  2191 leader_election.cc:304] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:32.198199  3540 raft_consensus.cc:515] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:32.255018  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:32.259804  2191 leader_election.cc:304] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:32.262871  1497 leader_election.cc:304] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:32.234541  3469 raft_consensus.cc:3060] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:32.256949  2190 leader_election.cc:304] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:32.233276  3470 raft_consensus.cc:2749] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:59:32.264536  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 83360.6us
I20260709 12:59:32.231832  3453 leader_election.cc:290] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:32.264989  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:32.233747  3515 raft_consensus.cc:740] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 12:59:32.304026  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:32.242579  3533 raft_consensus.cc:2749] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:32.325374  1528 raft_consensus.cc:3060] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:32.252043  3550 raft_consensus.cc:3055] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:32.304389  1672 raft_consensus.cc:2393] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 4: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 12:59:32.231320  3184 consensus_queue.cc:237] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:32.266453  3424 raft_consensus.cc:2749] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:59:32.311419  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 48613.5us
I20260709 12:59:32.264107  3491 raft_consensus.cc:2749] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:59:32.312443  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 55579.6us
I20260709 12:59:32.242268  3459 raft_consensus.cc:515] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:32.254302  3209 consensus_queue.cc:1048] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 12:59:32.330581  3492 raft_consensus.cc:493] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 12:59:32.331975  3527 leader_election.cc:290] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:32.332523  3505 leader_election.cc:290] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:32.311690  3486 leader_election.cc:290] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:32.323817  3488 raft_consensus.cc:493] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:32.324077  3301 raft_consensus.cc:493] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:32.335705  1528 raft_consensus.cc:2468] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 5.
I20260709 12:59:32.231827  3532 raft_consensus.cc:515] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:32.337735  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:32.306102  3521 raft_consensus.cc:2749] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:32.304414  3539 raft_consensus.cc:2749] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:32.327291  3264 leader_election.cc:290] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:32.329638  3345 raft_consensus.cc:2804] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:59:32.354409  3545 log.cc:927] Time spent T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 12:59:32.325763  3348 leader_election.cc:290] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:32.328682  3550 raft_consensus.cc:740] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
W20260709 12:59:32.344427  1497 leader_election.cc:336] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Timed out: RequestConsensusVote RPC to 127.0.107.194:40303 timed out after 1.706s (SENT)
I20260709 12:59:32.355926  3556 raft_consensus.cc:2749] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:32.361924  3301 raft_consensus.cc:515] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 12:59:32.361622  3546 log.cc:927] Time spent T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 12:59:32.310923  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:32.367405  1599 raft_consensus.cc:2393] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 5: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 12:59:32.369012  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:32.369812  1497 leader_election.cc:304] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:32.362939  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:32.347689  3470 consensus_queue.cc:1059] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:59:32.375173  3470 raft_consensus.cc:3055] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:32.375545  3470 raft_consensus.cc:740] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 12:59:32.375926  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:32.376403  3470 consensus_queue.cc:260] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:32.367300  3345 raft_consensus.cc:493] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:32.374301  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:32.379127  1523 raft_consensus.cc:3060] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:32.374097  1528 raft_consensus.cc:2376] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 3. Re-sending same reply.
I20260709 12:59:32.377508  1430 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50074 (request call id 230) took 6910 ms. Trace:
W20260709 12:59:32.381383  3548 log.cc:927] Time spent T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.176s	user 0.002s	sys 0.000s
I20260709 12:59:32.381518  3470 raft_consensus.cc:3060] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:32.382352  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:32.360939  3492 raft_consensus.cc:515] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:32.384845  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 12:59:32.387425  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:32.380213  3345 raft_consensus.cc:3060] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:59:32.390997  3549 log.cc:927] Time spent T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:59:32.383673  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:32.379644  1430 rpcz_store.cc:276] 0709 12:59:25.462691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:25.462864 (+   173us) service_pool.cc:224] Handling call
0709 12:59:32.372810 (+6909946us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:28.559249 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:28.596896 (+ 37647us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:28.596929 (+    33us) write_op.cc:435] Acquired schema lock
0709 12:59:28.596948 (+    19us) tablet.cc:662] Decoding operations
0709 12:59:28.597266 (+   318us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:28.597344 (+    78us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:28.597377 (+    33us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:59:28.597578 (+   201us) tablet.cc:701] Row locks acquired
0709 12:59:28.597597 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:59:28.597733 (+   136us) write_op.cc:270] Start()
0709 12:59:28.597839 (+   106us) write_op.cc:276] Timestamp: P: 1783601968597689 usec, L: 0
0709 12:59:28.597859 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:59:28.598545 (+   686us) log.cc:844] Serialized 536 byte log entry
0709 12:59:30.723614 (+2125069us) op_driver.cc:464] REPLICATION: finished
0709 12:59:31.209172 (+485558us) write_op.cc:301] APPLY: starting
0709 12:59:31.210788 (+  1616us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:31.222104 (+ 11316us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:31.232323 (+ 10219us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:31.260216 (+ 27893us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:31.280964 (+ 20748us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:59:31.290318 (+  9354us) write_op.cc:312] APPLY: finished
0709 12:59:31.359933 (+ 69615us) log.cc:844] Serialized 23 byte log entry
0709 12:59:31.415444 (+ 55511us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:31.437384 (+ 21940us) write_op.cc:454] Released schema lock
0709 12:59:31.439911 (+  2527us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:31.502691 (+ 62780us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:31.504755 (+  2064us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":895506,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":447779,"apply.run_cpu_time_us":2662,"apply.run_wall_time_us":271689,"num_ops":1,"prepare.queue_time_us":163799,"prepare.run_cpu_time_us":35654,"prepare.run_wall_time_us":285929,"raft.queue_time_us":874860,"raft.run_cpu_time_us":96917,"raft.run_wall_time_us":770264,"replication_time_us":2065367,"thread_start_us":855384,"threads_started":4,"wal-append.queue_time_us":1086343}]]}
W20260709 12:59:32.393743  3465 consensus_meta.cc:287] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent flushing consensus metadata: real 0.501s	user 0.008s	sys 0.000s
I20260709 12:59:32.394137  3465 raft_consensus.cc:515] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:32.377125  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:32.361652  3488 raft_consensus.cc:515] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:32.398931  1497 leader_election.cc:304] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:32.405251  1497 leader_election.cc:304] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:32.390439  1523 raft_consensus.cc:2468] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 2.
I20260709 12:59:32.353157  3515 consensus_queue.cc:260] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:32.380903  3539 raft_consensus.cc:3060] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:32.381681  3550 consensus_queue.cc:260] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:32.408658  3340 leader_election.cc:290] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:32.416421  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:32.419813  1528 raft_consensus.cc:3060] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:59:32.420147  1531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43010 (request call id 1587) took 1218 ms. Trace:
I20260709 12:59:32.420495  1531 rpcz_store.cc:276] 0709 12:59:31.201913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:31.246839 (+ 44926us) service_pool.cc:224] Handling call
0709 12:59:31.247151 (+   312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:31.984783 (+737632us) spinlock_profiling.cc:243] Waited 2.6 ms on lock 0x7b18003c21a0. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1e38ede1 00007f6a1e39b5b1 00007f6a1815b4bc 00007f6a154a948b 00007f6a1e303ab9 00007f6a154c569b 00007f6a154c393f 00007f6a154c3455 00007f6a185ab060 00007f6a185abbfb 00007f6a185b664b
0709 12:59:31.984943 (+   160us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:31.984972 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:31.985499 (+   527us) log.cc:844] Serialized 26 byte log entry
0709 12:59:32.189818 (+204319us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:32.190757 (+   939us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:32.201409 (+ 10652us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:32.419844 (+218435us) raft_consensus.cc:1685] finished
0709 12:59:32.419863 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:32.420075 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":38756,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":26786,"spinlock_wait_cycles":5972736,"thread_start_us":275564,"threads_started":2,"wal-append.queue_time_us":234384}
I20260709 12:59:32.410148  1644 leader_election.cc:304] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:32.409813  3264 raft_consensus.cc:2749] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:32.409004  3521 raft_consensus.cc:2749] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:59:32.417766  3547 log.cc:927] Time spent T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:59:32.419142  3301 leader_election.cc:290] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:32.445514  3469 raft_consensus.cc:2749] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:32.451748  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 12:59:32.452432  2222 raft_consensus.cc:3060] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:32.426203  1528 raft_consensus.cc:2468] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 6.
I20260709 12:59:32.428402  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:32.453469  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 12:59:32.417696  3349 consensus_meta.cc:287] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.523s	user 0.004s	sys 0.005s
I20260709 12:59:32.458923  3349 raft_consensus.cc:515] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:32.431335  3553 raft_consensus.cc:493] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:32.430405  3497 raft_consensus.cc:2804] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:32.436345  3489 consensus_queue.cc:260] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:32.440411  3488 leader_election.cc:290] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:32.423763  2219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50326 (request call id 519) took 1247 ms. Trace:
I20260709 12:59:32.441809  3550 raft_consensus.cc:3060] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:32.462916  3349 leader_election.cc:290] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:32.454084  1523 raft_consensus.cc:2468] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 4.
I20260709 12:59:32.464140  3345 raft_consensus.cc:515] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:32.465935  3459 leader_election.cc:290] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:32.466671  3460 raft_consensus.cc:3060] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:32.455070  1644 leader_election.cc:304] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:32.459259  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:32.467834  2227 raft_consensus.cc:2393] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 3: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 12:59:32.468487  3497 raft_consensus.cc:697] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 5 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:32.408941  3532 leader_election.cc:290] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:32.459954  3553 raft_consensus.cc:515] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:32.462203  2219 rpcz_store.cc:276] 0709 12:59:31.176864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:31.178559 (+  1695us) service_pool.cc:224] Handling call
0709 12:59:32.414906 (+1236347us) spinlock_profiling.cc:243] Waited 2.4 ms on lock 0x7b5800015c98. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a1548eb71 00007f6a1548ea22 00007f6a1e3a7c09 00007f6a1d501ee0 00007f6a1d5cb0ab 00007f6a1d5cb131 00007f6a1d58cfc0 00007f6a1d577929 00007f6a1d5773d2 00007f6a16aeebd4
0709 12:59:32.423231 (+  8325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:32.423416 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:32.423443 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:32.423486 (+    43us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:32.423520 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:32.423578 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:32.423690 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5526400}
I20260709 12:59:32.423940  3418 raft_consensus.cc:3055] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:32.469838  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:32.483584  3540 leader_election.cc:290] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 12:59:32.484848  1681 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49178 (request call id 1485) took 1498 ms (client timeout 1905 ms). Trace:
W20260709 12:59:32.485237  1681 rpcz_store.cc:269] 0709 12:59:30.986735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:30.986846 (+   111us) service_pool.cc:224] Handling call
0709 12:59:32.484653 (+1497807us) spinlock_profiling.cc:243] Waited 450 ms on lock 0x7b54000b95d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 12:59:32.484788 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1035649152}
I20260709 12:59:32.475234  3301 raft_consensus.cc:2804] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:32.487900  3301 raft_consensus.cc:697] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 6 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:32.488790  3301 consensus_queue.cc:237] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:32.472014  3345 leader_election.cc:290] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 5 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:32.492854  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:32.491185  3497 consensus_queue.cc:237] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:32.494944  1598 raft_consensus.cc:1240] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:32.506672  1672 raft_consensus.cc:1240] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 4 LEADER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 3. Current term is 4. Ops: []
W20260709 12:59:32.508561  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 53324.3us
I20260709 12:59:32.509761  1644 leader_election.cc:304] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:32.511044  1674 raft_consensus.cc:1240] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:32.480701  3489 raft_consensus.cc:3060] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:32.510303  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:32.475940  3418 raft_consensus.cc:740] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 12:59:32.516132  1523 raft_consensus.cc:1275] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:59:32.514348  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:32.520467  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 12:59:32.523694  2227 raft_consensus.cc:1240] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:32.524982  2227 raft_consensus.cc:1240] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:32.526108  2227 raft_consensus.cc:1240] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:32.526765  3497 consensus_queue.cc:1048] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:32.526923  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:32.532039  3539 raft_consensus.cc:2749] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:59:32.539295  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:32.540918  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:32.553032  3553 leader_election.cc:290] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:32.553612  2222 raft_consensus.cc:2410] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:59:32.543288  3418 consensus_queue.cc:260] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:32.554353  1530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43010 (request call id 1592) took 1351 ms. Trace:
I20260709 12:59:32.555100  3418 raft_consensus.cc:3060] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:32.554795  1530 rpcz_store.cc:276] 0709 12:59:31.202727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:31.778786 (+576059us) service_pool.cc:224] Handling call
0709 12:59:31.779048 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:31.785827 (+  6779us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:59:31.981956 (+196129us) log.cc:844] Serialized 14 byte log entry
0709 12:59:32.268438 (+286482us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:32.304594 (+ 36156us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:32.304639 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:32.554129 (+249490us) spinlock_profiling.cc:243] Waited 6.57 ms on lock 0x7b54001b71d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 12:59:32.554191 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:32.554304 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":47269,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":9369,"spinlock_wait_cycles":15101824,"thread_start_us":276759,"threads_started":2,"wal-append.queue_time_us":260688}
W20260709 12:59:32.543835  1496 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.195:44217 timed out after 1.905s (SENT) [suppressed 29 similar messages]
I20260709 12:59:32.511039  3184 raft_consensus.cc:2804] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:32.532076  2219 raft_consensus.cc:1240] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:32.566746  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:32.567559  1528 raft_consensus.cc:2468] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 3.
I20260709 12:59:32.569644  1644 leader_election.cc:304] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:32.572305  2227 raft_consensus.cc:1240] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:32.563930  1601 raft_consensus.cc:2468] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 3.
I20260709 12:59:32.575431  3553 raft_consensus.cc:2804] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:32.565172  3184 raft_consensus.cc:493] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:32.580466  3553 raft_consensus.cc:493] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:32.585955  3553 raft_consensus.cc:3060] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:32.582832  3529 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.732s	user 0.006s	sys 0.013s
I20260709 12:59:32.582966  3184 raft_consensus.cc:3060] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:59:32.587949  3529 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.772s	user 0.006s	sys 0.013s
W20260709 12:59:32.591498  3543 log.cc:927] Time spent T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.641s	user 0.003s	sys 0.004s
W20260709 12:59:32.592016  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:32.591600  2220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50326 (request call id 520) took 1414 ms. Trace:
I20260709 12:59:32.594300  3352 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:50310 (request call id 420) took 6048 ms. Trace:
I20260709 12:59:32.595201  3363 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:50326 (request call id 487) took 5943 ms. Trace:
I20260709 12:59:32.595784  2220 rpcz_store.cc:276] 0709 12:59:31.177186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:31.178515 (+  1329us) service_pool.cc:224] Handling call
0709 12:59:32.591279 (+1412764us) spinlock_profiling.cc:243] Waited 2.52 ms on lock 0x7b5800015c98. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a1548eb71 00007f6a1548eeee 0000000000375939 00007f6a1d5021e0 00007f6a1d5cb0c4 00007f6a1d5cb131 00007f6a1d58cfc0 00007f6a1d577929 00007f6a1d5773d2 00007f6a16aeebd4
0709 12:59:32.591530 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5786880}
I20260709 12:59:32.595580  3314 raft_consensus.cc:3055] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:32.595638  3363 rpcz_store.cc:276] 0709 12:59:26.651737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:26.652464 (+   727us) service_pool.cc:224] Handling call
0709 12:59:27.714973 (+1062509us) spinlock_profiling.cc:243] Waited 2.8 ms on lock 0x7b5800015c98. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a1548eb71 00007f6a1548f1a2 00007f6a1e3d0bb9 00007f6a1d501d88 00007f6a1d5c5a07 00007f6a1d5f7f4e 00007f6a1d5dcfdd 00007f6a1d5dcf89 00007f6a1d5dcf19 00007f6a1d5dcee1
0709 12:59:27.743633 (+ 28660us) ts_tablet_manager.cc:934] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b: Initiating tablet copy from peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
0709 12:59:30.505772 (+2762139us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:59:31.294545 (+788773us) tablet_metadata.cc:665] Metadata flushed
0709 12:59:31.319029 (+ 24484us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:59:31.739872 (+420843us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:59:31.740151 (+   279us) tablet_replica.cc:206] Creating consensus instance
0709 12:59:32.594159 (+854008us) ts_tablet_manager.cc:989] Replica registered.
0709 12:59:32.595133 (+   974us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":39251,"spinlock_wait_cycles":6444928,"tablet-copy.queue_time_us":375008,"thread_start_us":397927,"threads_started":2}
I20260709 12:59:32.598919  3314 raft_consensus.cc:740] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:32.596457  3411 raft_consensus.cc:3055] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:32.604972  3411 raft_consensus.cc:740] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 12:59:32.605225  3314 consensus_queue.cc:260] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:32.605855  3411 consensus_queue.cc:260] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:32.607107  3411 raft_consensus.cc:3060] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:32.595507  3352 rpcz_store.cc:276] 0709 12:59:26.563969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:26.569014 (+  5045us) service_pool.cc:224] Handling call
0709 12:59:27.083675 (+514661us) ts_tablet_manager.cc:934] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b: Initiating tablet copy from peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
0709 12:59:29.639820 (+2556145us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:59:30.257219 (+617399us) tablet_metadata.cc:665] Metadata flushed
0709 12:59:30.257366 (+   147us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:59:31.238513 (+981147us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:59:31.238843 (+   330us) tablet_replica.cc:206] Creating consensus instance
0709 12:59:32.594150 (+1355307us) ts_tablet_manager.cc:989] Replica registered.
0709 12:59:32.594219 (+    69us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":112483,"tablet-copy.queue_time_us":220626,"thread_start_us":253233,"threads_started":2}
I20260709 12:59:32.610885  3352 tablet_copy_client.cc:806] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:32.611490  3352 tablet_copy_client.cc:670] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:32.606575  3314 raft_consensus.cc:3060] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:32.610157  3363 tablet_copy_client.cc:806] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:32.614284  3363 tablet_copy_client.cc:670] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:32.618796  2191 leader_election.cc:304] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:32.620100  2191 leader_election.cc:304] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:32.621770  1677 raft_consensus.cc:1240] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:32.621889  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43010 (request call id 1595) took 1071 ms. Trace:
I20260709 12:59:32.622334  1532 rpcz_store.cc:276] 0709 12:59:31.550349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:31.824299 (+273950us) service_pool.cc:224] Handling call
0709 12:59:31.825760 (+  1461us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:59:31.827779 (+  2019us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:31.827798 (+    19us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:59:31.843710 (+ 15912us) log.cc:844] Serialized 532 byte log entry
0709 12:59:31.950415 (+106705us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:59:32.241224 (+290809us) log.cc:844] Serialized 14 byte log entry
0709 12:59:32.241422 (+   198us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:32.241493 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:32.589953 (+348460us) spinlock_profiling.cc:243] Waited 4.92 ms on lock 0x7b4400022b4c. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a153ecc85 00007f6a153ed6a2 00007f6a1815f1db 00007f6a1815aaaf 00007f6a1814e86e 00007f6a1814dbb6 00007f6a1814d7d8 00007f6a18157221 00007f6a181571d9 00007f6a18157169
0709 12:59:32.617357 (+ 27404us) raft_consensus.cc:1685] finished
0709 12:59:32.621685 (+  4328us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:32.621833 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12429,"raft.queue_time_us":130014,"raft.run_cpu_time_us":287,"raft.run_wall_time_us":22243,"spinlock_wait_cycles":11324800,"thread_start_us":106317,"threads_started":1,"wal-append.queue_time_us":106661}
I20260709 12:59:32.623251  3448 raft_consensus.cc:2749] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:32.623373  3164 raft_consensus.cc:2804] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:32.625639  3465 leader_election.cc:290] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:32.627462  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36200 (request call id 1701) took 1056 ms. Trace:
I20260709 12:59:32.628290  1602 rpcz_store.cc:276] 0709 12:59:31.571395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:31.720835 (+149440us) service_pool.cc:224] Handling call
0709 12:59:32.627306 (+906471us) spinlock_profiling.cc:243] Waited 376 ms on lock 0x7b54002ac954. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 12:59:32.627415 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":865845504}
I20260709 12:59:32.625844  3164 raft_consensus.cc:493] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:32.629882  3164 raft_consensus.cc:3060] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:32.631665  2191 leader_election.cc:304] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:32.642271  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 12:59:32.644058  1679 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49170 (request call id 1520) took 1603 ms (client timeout 1814 ms). Trace:
W20260709 12:59:32.644505  1679 rpcz_store.cc:269] 0709 12:59:31.040408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:31.068043 (+ 27635us) service_pool.cc:224] Handling call
0709 12:59:32.643860 (+1575817us) spinlock_profiling.cc:243] Waited 449 ms on lock 0x7b54000cdfd4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 12:59:32.643998 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1031624960}
I20260709 12:59:32.645924  1497 leader_election.cc:304] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:32.647742  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 12:59:32.648690  2223 raft_consensus.cc:2410] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 12:59:32.650652  1606 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36194 (request call id 1323) took 1412 ms (client timeout 1706 ms). Trace:
W20260709 12:59:32.651003  1606 rpcz_store.cc:269] 0709 12:59:31.238402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:31.250009 (+ 11607us) service_pool.cc:224] Handling call
0709 12:59:31.740721 (+490712us) spinlock_profiling.cc:243] Waited 6.61 ms on lock 0x7b5800017198. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a1548eb71 00007f6a1548ea22 00007f6a1e3a7c09 00007f6a1d501ee0 00007f6a1d5cb0ab 00007f6a1d5cb131 00007f6a1d5790a0 00007f6a1d578984 00007f6a16af36d4 00007f6a16af3662
0709 12:59:32.650458 (+909737us) spinlock_profiling.cc:243] Waited 21.6 ms on lock 0x7b54002ace54. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 12:59:32.650595 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":64903296}
I20260709 12:59:32.651611  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:32.636436  3305 raft_consensus.cc:2749] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:32.654597  3492 leader_election.cc:290] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:32.647701  3448 consensus_queue.cc:1059] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 12:59:32.656901  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:32.657675  1679 raft_consensus.cc:2393] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 2: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
W20260709 12:59:32.662897  3570 log.cc:927] Time spent T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
W20260709 12:59:32.675201  3567 log.cc:927] Time spent T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
W20260709 12:59:32.677448  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 56383.7us
I20260709 12:59:32.679517  1496 leader_election.cc:400] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 pre-election: Vote denied by peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217) with higher term. Message: Invalid argument: T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 5. Current term is 6.
I20260709 12:59:32.679735  1497 leader_election.cc:304] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:32.680310  3550 raft_consensus.cc:2749] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:32.667855  1646 leader_election.cc:304] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:32.675400  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36200 (request call id 1704) took 1082 ms. Trace:
I20260709 12:59:32.679817  1496 leader_election.cc:403] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:59:32.686873  1425 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46274 (request call id 358) took 6852 ms. Trace:
I20260709 12:59:32.682763  2190 leader_election.cc:304] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 12:59:32.684099  1646 leader_election.cc:304] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:32.687269  1425 rpcz_store.cc:276] 0709 12:59:25.834798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:25.837107 (+  2309us) service_pool.cc:224] Handling call
0709 12:59:32.686788 (+6849681us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:29.305047 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:29.305573 (+   526us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:29.305610 (+    37us) write_op.cc:435] Acquired schema lock
0709 12:59:29.305625 (+    15us) tablet.cc:662] Decoding operations
0709 12:59:29.306055 (+   430us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:29.306103 (+    48us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:29.306129 (+    26us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:59:29.306362 (+   233us) tablet.cc:701] Row locks acquired
0709 12:59:29.306386 (+    24us) write_op.cc:260] PREPARE: finished
0709 12:59:29.306511 (+   125us) write_op.cc:270] Start()
0709 12:59:29.306618 (+   107us) write_op.cc:276] Timestamp: P: 1783601969306470 usec, L: 0
0709 12:59:29.306634 (+    16us) op_driver.cc:348] REPLICATION: starting
0709 12:59:29.307223 (+   589us) log.cc:844] Serialized 987 byte log entry
0709 12:59:31.167230 (+1860007us) op_driver.cc:464] REPLICATION: finished
0709 12:59:31.444710 (+277480us) write_op.cc:301] APPLY: starting
0709 12:59:31.444799 (+    89us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:31.446474 (+  1675us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:31.446608 (+   134us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:31.479342 (+ 32734us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:31.479499 (+   157us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:59:31.479546 (+    47us) write_op.cc:312] APPLY: finished
0709 12:59:31.479739 (+   193us) log.cc:844] Serialized 29 byte log entry
0709 12:59:31.479903 (+   164us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:31.479986 (+    83us) write_op.cc:454] Released schema lock
0709 12:59:31.480021 (+    35us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:31.480348 (+   327us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:31.480378 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2495787,"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":273887,"apply.run_cpu_time_us":2469,"apply.run_wall_time_us":35622,"mutex_wait_us":22781,"num_ops":2,"prepare.queue_time_us":168,"prepare.run_cpu_time_us":2434,"prepare.run_wall_time_us":2432,"replication_time_us":1849868,"thread_start_us":155032,"threads_started":1}]]}
I20260709 12:59:32.693953  1679 raft_consensus.cc:1240] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:32.688853  2190 leader_election.cc:304] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
W20260709 12:59:32.695927  1646 consensus_peers.cc:597] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 -> Peer b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373): Couldn't send request to peer b96ce9cc496c49d7818fa983a17b062b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4190d217954f4f798b3a610501115290. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:32.699025  3552 consensus_queue.cc:1059] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 12:59:32.684564  1607 rpcz_store.cc:276] 0709 12:59:31.593250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:31.886053 (+292803us) service_pool.cc:224] Handling call
0709 12:59:31.886381 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:32.025696 (+139315us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:32.675147 (+649451us) spinlock_profiling.cc:243] Waited 115 ms on lock 0x7b54003b1ad4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 12:59:32.675335 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":265111808}
I20260709 12:59:32.697579  3301 raft_consensus.cc:2804] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:32.703482  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:32.704921  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:32.705410  1679 raft_consensus.cc:3060] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:32.705655  1528 raft_consensus.cc:3060] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:32.706749  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:32.706887  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:32.707726  1678 raft_consensus.cc:2393] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 4: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 12:59:32.707906  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:32.708547  1526 raft_consensus.cc:2468] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 2.
I20260709 12:59:32.713340  3363 tablet_copy_client.cc:538] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:32.698122  3469 raft_consensus.cc:2804] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:32.697161  3556 raft_consensus.cc:2749] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:32.714699  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:32.697362  3497 raft_consensus.cc:2749] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:59:32.697950  3404 raft_consensus.cc:2804] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:32.716466  2190 leader_election.cc:304] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:32.718346  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:32.718870  1604 raft_consensus.cc:3060] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:32.726419  1679 raft_consensus.cc:2468] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 4.
I20260709 12:59:32.703887  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:32.714071  3469 raft_consensus.cc:697] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 2 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 12:59:32.727737  1530 raft_consensus.cc:1240] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:32.728163  1496 leader_election.cc:304] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:32.728323  3404 raft_consensus.cc:697] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 3 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 12:59:32.728888  3473 raft_consensus.cc:2749] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:32.728752  3560 consensus_queue.cc:1059] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:32.730144  2190 leader_election.cc:304] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:32.744324  3345 raft_consensus.cc:2804] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:32.744728  3345 raft_consensus.cc:493] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 12:59:32.744941  2190 leader_election.cc:304] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:32.745306  3466 raft_consensus.cc:3060] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:32.746021  3345 raft_consensus.cc:3060] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:32.735280  1675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49170 (request call id 1519) took 1695 ms. Trace:
I20260709 12:59:32.747143  1675 rpcz_store.cc:276] 0709 12:59:31.040171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:31.072207 (+ 32036us) service_pool.cc:224] Handling call
0709 12:59:32.735092 (+1662885us) spinlock_profiling.cc:243] Waited 479 ms on lock 0x7b540017a554. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 12:59:32.735220 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1101518208}
I20260709 12:59:32.740919  1528 raft_consensus.cc:1275] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:32.715662  3571 raft_consensus.cc:2749] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217) with higher term. Message: Invalid argument: T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 5. Current term is 6.
I20260709 12:59:32.716446  3301 raft_consensus.cc:697] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 4 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:32.752628  3301 consensus_queue.cc:237] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:32.701673  3489 consensus_queue.cc:1059] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:59:32.701845  3356 consensus_queue.cc:1059] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 12:59:32.745684  3164 raft_consensus.cc:515] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:32.738734  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36194 (request call id 1320) took 1522 ms. Trace:
I20260709 12:59:32.749435  3319 raft_consensus.cc:2749] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:59:32.750855  3404 consensus_queue.cc:237] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:32.757663  3475 raft_consensus.cc:3055] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:32.757349  3469 consensus_queue.cc:237] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:32.761039  3345 raft_consensus.cc:515] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 12:59:32.761801  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 775168us
I20260709 12:59:32.829671  1571 leader_election.cc:304] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:32.763883  3390 raft_consensus.cc:2804] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:32.764998  3258 raft_consensus.cc:493] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:32.765120  1604 raft_consensus.cc:2410] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 12:59:32.765763  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 609185us
W20260709 12:59:32.837626  1604 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36194 (request call id 1324) took 1598 ms (client timeout 1923 ms). Trace:
I20260709 12:59:32.837831  1570 leader_election.cc:304] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:32.766578  3441 raft_consensus.cc:3060] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:32.771589  3515 raft_consensus.cc:3060] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:32.762537  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:32.780857  1646 leader_election.cc:304] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
W20260709 12:59:32.791720  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:32.874574  1677 raft_consensus.cc:1240] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:59:32.706779  3553 raft_consensus.cc:515] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:32.797130  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:32.797437  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:32.832573  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:32.832798  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:32.833688  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
W20260709 12:59:32.838155  1604 rpcz_store.cc:269] 0709 12:59:31.238785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:31.250308 (+ 11523us) service_pool.cc:224] Handling call
0709 12:59:32.718234 (+1467926us) spinlock_profiling.cc:243] Waited 6.31 ms on lock 0x7b5800017198. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a1548eb71 00007f6a1548ea22 00007f6a1e3a7c09 00007f6a1d501ee0 00007f6a1d5cb0ab 00007f6a1d5cb131 00007f6a1d5790a0 00007f6a1d578984 00007f6a16af36d4 00007f6a16af3662
0709 12:59:32.837568 (+119334us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14523136}
I20260709 12:59:32.841733  1570 leader_election.cc:304] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:32.933403  1600 raft_consensus.cc:1240] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 6 LEADER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 5. Current term is 6. Ops: []
W20260709 12:59:32.875408  3573 log.cc:927] Time spent T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 12:59:32.818567  3560 consensus_queue.cc:1059] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 12:59:32.840579  3460 raft_consensus.cc:493] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:32.942693  3575 log.cc:927] Time spent T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 12:59:32.823596  3493 raft_consensus.cc:493] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:32.954896  3373 raft_consensus.cc:3055] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:32.874177  3349 raft_consensus.cc:2749] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:59:32.843099  3442 raft_consensus.cc:2804] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:32.955628  1673 raft_consensus.cc:1240] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:32.954761  3209 raft_consensus.cc:493] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:32.942341  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 12:59:32.875542  3390 raft_consensus.cc:697] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 5 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:32.959650  2227 raft_consensus.cc:2393] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 5: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 12:59:32.956630  1679 raft_consensus.cc:3060] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:59:32.957808  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 116161us
I20260709 12:59:32.987802  1570 leader_election.cc:304] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:32.801062  1601 rpcz_store.cc:276] 0709 12:59:31.216659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:31.219020 (+  2361us) service_pool.cc:224] Handling call
0709 12:59:32.738525 (+1519505us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b54001946d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 12:59:32.738646 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2926905216}
W20260709 12:59:32.951503  3569 log.cc:927] Time spent T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:59:32.821683  3475 raft_consensus.cc:740] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:32.997596  3475 consensus_queue.cc:260] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:32.999047  3475 raft_consensus.cc:3060] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:32.999926  3363 tablet_bootstrap.cc:492] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b: Bootstrap starting.
I20260709 12:59:32.842958  3532 consensus_queue.cc:1059] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.117s
I20260709 12:59:33.003387  3527 raft_consensus.cc:2749] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:33.009377  1529 raft_consensus.cc:1275] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:33.009690  1679 raft_consensus.cc:2468] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 5.
I20260709 12:59:33.010607  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43010 (request call id 1601) took 1374 ms. Trace:
I20260709 12:59:33.011039  1529 rpcz_store.cc:276] 0709 12:59:31.635759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:31.905081 (+269322us) service_pool.cc:224] Handling call
0709 12:59:31.905348 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:33.009817 (+1104469us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:33.010365 (+   548us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b540031a954. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 12:59:33.010544 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2538471808}
I20260709 12:59:33.012519  3424 consensus_queue.cc:1059] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:33.014895  1571 leader_election.cc:304] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:32.955698  3262 raft_consensus.cc:493] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:33.015859  3262 raft_consensus.cc:515] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:32.974521  1572 leader_election.cc:304] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:32.958881  3356 raft_consensus.cc:2749] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:32.845000  3258 raft_consensus.cc:515] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:32.960486  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
W20260709 12:59:32.953651  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 172882us
W20260709 12:59:32.983572  1495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:32.984082  1673 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251"
dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
mode: GRACEFUL
new_leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:33616
I20260709 12:59:33.021981  1673 raft_consensus.cc:606] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Received request to transfer leadership to TS e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:32.976239  3373 raft_consensus.cc:740] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 12:59:32.985556  3209 raft_consensus.cc:515] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:33.032918  3373 consensus_queue.cc:260] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:33.034164  3373 raft_consensus.cc:3060] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:33.034919  1495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:32.969815  3460 raft_consensus.cc:515] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:33.035727  1600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36194 (request call id 1313) took 1901 ms. Trace:
I20260709 12:59:33.036106  1600 rpcz_store.cc:276] 0709 12:59:31.134849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:31.135048 (+   199us) service_pool.cc:224] Handling call
0709 12:59:31.135344 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:32.957523 (+1822179us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:33.035498 (+ 77975us) spinlock_profiling.cc:243] Waited 1.8 s on lock 0x7b54003b10d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 12:59:33.035675 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4135140608}
I20260709 12:59:33.036914  3460 leader_election.cc:290] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:33.025820  3511 raft_consensus.cc:3055] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:33.037683  3511 raft_consensus.cc:740] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 12:59:33.022046  3412 raft_consensus.cc:493] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:33.017997  3262 leader_election.cc:290] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:32.962114  3486 raft_consensus.cc:2804] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:59:33.022255  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 47865.7us
I20260709 12:59:33.021492  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 384) took 1218 ms. Trace:
I20260709 12:59:32.972600  3348 consensus_queue.cc:1059] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 12:59:33.023347  2226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50326 (request call id 521) took 1845 ms. Trace:
I20260709 12:59:33.023506  3508 raft_consensus.cc:2804] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:33.023816  3356 raft_consensus.cc:493] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:33.060837  3356 raft_consensus.cc:515] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:33.062572  3508 raft_consensus.cc:697] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 5 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:33.063228  3356 leader_election.cc:290] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:33.024564  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:33.025566  3473 raft_consensus.cc:3055] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:33.064656  3473 raft_consensus.cc:740] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 12:59:33.065590  3473 consensus_queue.cc:260] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:33.019945  3258 leader_election.cc:290] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:33.066915  3473 raft_consensus.cc:3060] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:33.019892  3390 consensus_queue.cc:237] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:33.026281  3529 consensus_queue.cc:1059] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:59:33.027344  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 300051us
I20260709 12:59:33.028780  2223 raft_consensus.cc:1240] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 3. Current term is 4. Ops: []
W20260709 12:59:33.029330  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 301255us
I20260709 12:59:33.073084  1497 leader_election.cc:304] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:33.029851  3552 raft_consensus.cc:2804] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:33.030548  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 12:59:33.045837  1673 raft_consensus.cc:1275] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:59:33.034080  3209 leader_election.cc:290] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:33.049845  3486 raft_consensus.cc:493] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:33.097688  1673 raft_consensus.cc:1240] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:33.089933  3441 raft_consensus.cc:2749] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:33.043406  3412 raft_consensus.cc:515] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:33.050983  2226 rpcz_store.cc:276] 0709 12:59:31.177475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:31.177948 (+   473us) service_pool.cc:224] Handling call
0709 12:59:32.513611 (+1335663us) spinlock_profiling.cc:243] Waited 1.05 ms on lock 0x7b5800015c98. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a1548eb71 00007f6a1548ea22 00007f6a1e3a7c09 00007f6a1d501ee0 00007f6a1d5cb0ab 00007f6a1d5cb131 00007f6a1d58cfc0 00007f6a1d577929 00007f6a1d5773d2 00007f6a16aeebd4
0709 12:59:32.513835 (+   224us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:32.514247 (+   412us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:32.514276 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:32.514775 (+   499us) log.cc:844] Serialized 26 byte log entry
0709 12:59:32.584546 (+ 69771us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:32.584592 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:32.584683 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:33.020019 (+435336us) raft_consensus.cc:1685] finished
0709 12:59:33.020042 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:33.023273 (+  3231us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2079,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":14742,"spinlock_wait_cycles":2409728,"thread_start_us":55811,"threads_started":1,"wal-append.queue_time_us":73018}
I20260709 12:59:33.055328  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:33.086647  3508 consensus_queue.cc:237] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:32.977252  3493 raft_consensus.cc:515] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 12:59:33.110399  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 115596us
I20260709 12:59:33.100827  3486 raft_consensus.cc:3060] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:59:33.119992  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:33.099982  3552 raft_consensus.cc:697] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 12:59:33.071717  3184 raft_consensus.cc:515] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:33.087817  3470 consensus_queue.cc:1048] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 12:59:33.094870  3466 consensus_queue.cc:1059] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
W20260709 12:59:33.120173  3418 consensus_meta.cc:287] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent flushing consensus metadata: real 0.565s	user 0.009s	sys 0.005s
I20260709 12:59:33.093057  3491 consensus_queue.cc:1059] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:59:33.101972  3348 consensus_queue.cc:1048] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 12:59:33.209631  3348 raft_consensus.cc:493] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:33.050319  1603 rpcz_store.cc:276] 0709 12:59:31.803370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:32.444753 (+641383us) service_pool.cc:224] Handling call
0709 12:59:32.445024 (+   271us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:32.767859 (+322835us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:32.767889 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:32.768358 (+   469us) log.cc:844] Serialized 26 byte log entry
0709 12:59:32.931366 (+163008us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:32.931877 (+   511us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:32.931956 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:33.021292 (+ 89336us) raft_consensus.cc:1685] finished
0709 12:59:33.021311 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:33.021437 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":322455,"raft.queue_time_us":323128,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":121,"spinlock_wait_cycles":4992,"thread_start_us":162645,"threads_started":1,"wal-append.queue_time_us":209950}
W20260709 12:59:33.185132  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 195962us
W20260709 12:59:33.187119  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:33.076538  1646 leader_election.cc:304] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:33.117770  1679 raft_consensus.cc:2393] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 2: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 12:59:33.241888  3489 raft_consensus.cc:2749] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:33.242738  3271 raft_consensus.cc:493] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:33.243112  3587 consensus_queue.cc:1048] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:59:33.199138  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 126023us
W20260709 12:59:33.194401  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:33.146939  3442 raft_consensus.cc:697] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 4 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:33.250692  3271 raft_consensus.cc:515] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:33.252094  3442 consensus_queue.cc:237] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:33.257395  3482 consensus_queue.cc:1048] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:33.205670  3184 leader_election.cc:290] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:33.212733  1672 raft_consensus.cc:1240] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:33.050736  1572 leader_election.cc:304] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:33.151012  3552 consensus_queue.cc:237] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:33.213112  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 12:59:33.265198  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 43731.2us
I20260709 12:59:33.266320  2220 raft_consensus.cc:2393] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 5: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 12:59:33.218433  3493 leader_election.cc:290] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:33.267206  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:33.261170  1601 raft_consensus.cc:1240] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:33.203413  3465 consensus_queue.cc:1059] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:33.200776  1675 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e"
dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
mode: GRACEFUL
new_leader_uuid: "39a92f5a4352465d8af3af5908fe8642"
 from {username='slave'} at 127.0.0.1:33616
I20260709 12:59:33.218603  3585 consensus_queue.cc:1059] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:33.270977  1675 raft_consensus.cc:606] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Received request to transfer leadership to TS 39a92f5a4352465d8af3af5908fe8642
I20260709 12:59:33.271251  3585 raft_consensus.cc:3055] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:33.271571  1675 raft_consensus.cc:614] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:33.233168  3582 raft_consensus.cc:493] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:33.273298  3532 raft_consensus.cc:2749] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:33.273080  3582 raft_consensus.cc:515] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:33.275153  3585 raft_consensus.cc:740] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:33.275823  3582 leader_election.cc:290] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:33.276520  3585 consensus_queue.cc:260] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:33.278098  3585 raft_consensus.cc:3060] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:33.278620  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:33.278911  3582 raft_consensus.cc:493] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:33.279580  1672 raft_consensus.cc:2468] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 7.
I20260709 12:59:33.279850  3582 raft_consensus.cc:515] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 12:59:33.275053  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 224348us
I20260709 12:59:33.281908  1572 leader_election.cc:304] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:33.282893  3348 raft_consensus.cc:515] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:33.283878  3418 raft_consensus.cc:493] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:33.284721  3418 raft_consensus.cc:515] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:33.285718  3348 leader_election.cc:290] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:33.209658  3529 raft_consensus.cc:2749] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:33.258764  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:33.259562  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:33.287251  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:33.261039  3390 raft_consensus.cc:493] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:33.288242  1600 raft_consensus.cc:2393] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 5: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 12:59:33.259934  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:33.288388  3390 raft_consensus.cc:515] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:33.261859  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:33.289901  1607 raft_consensus.cc:2468] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 2.
I20260709 12:59:33.261158  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:33.262979  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:33.270846  3465 consensus_queue.cc:1243] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer ddf11fc190dd4b898773379c6b129d90 log is divergent from this leader: its last log entry 4.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:59:33.291126  1602 raft_consensus.cc:2468] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 3.
I20260709 12:59:33.291226  3390 leader_election.cc:290] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:33.287516  1599 raft_consensus.cc:2468] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 3.
I20260709 12:59:33.291883  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:33.283049  3582 leader_election.cc:290] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:33.293474  3589 raft_consensus.cc:2749] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:33.294373   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:59:33.295687  1572 leader_election.cc:304] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:33.287417  3418 leader_election.cc:290] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:33.297708  1571 leader_election.cc:304] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:33.298394  3587 raft_consensus.cc:3060] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:33.273257  3533 consensus_queue.cc:1059] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 12:59:33.298844  3589 raft_consensus.cc:2804] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:33.303085  3589 raft_consensus.cc:493] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:33.303581  3589 raft_consensus.cc:3060] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:33.291213  1598 raft_consensus.cc:2410] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:59:33.307435  3412 leader_election.cc:290] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 12:59:33.242368  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 165813us
I20260709 12:59:33.311036  3495 consensus_queue.cc:1059] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:33.312536  3495 raft_consensus.cc:3055] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:33.312955  3495 raft_consensus.cc:740] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:33.299180  3497 raft_consensus.cc:3055] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:33.315609  3497 raft_consensus.cc:740] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:33.317308  3515 raft_consensus.cc:493] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:33.318336  3515 raft_consensus.cc:515] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:33.320502  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:33.321339  2219 raft_consensus.cc:1275] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:59:33.272296  1604 raft_consensus.cc:1275] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:59:33.317174  3497 consensus_queue.cc:260] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:33.326402  3497 raft_consensus.cc:3060] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:33.321380  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:33.314141  3495 consensus_queue.cc:260] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:33.360183  3495 raft_consensus.cc:3060] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:33.382552  2192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:33.390806  3529 raft_consensus.cc:493] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:33.392248  3529 raft_consensus.cc:515] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:33.408077  1525 raft_consensus.cc:1275] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:59:33.409160  3345 leader_election.cc:290] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 2 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:33.420141  3492 raft_consensus.cc:3055] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:33.420775  3492 raft_consensus.cc:740] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 12:59:33.422045  3492 consensus_queue.cc:260] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:33.423765  3492 raft_consensus.cc:3060] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:33.451752  3271 leader_election.cc:290] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 12:59:33.468290  2190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:33.321388  3515 leader_election.cc:290] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 12:59:33.656399  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:33.657650  3486 consensus_meta.cc:287] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.530s	user 0.009s	sys 0.000s
I20260709 12:59:33.680932  3486 raft_consensus.cc:515] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
W20260709 12:59:33.662338  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:33.688371  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:33.689859  3184 raft_consensus.cc:493] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:33.663565  3473 consensus_meta.cc:287] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b: Time spent flushing consensus metadata: real 0.596s	user 0.007s	sys 0.008s
I20260709 12:59:33.691920  3260 raft_consensus.cc:493] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 12:59:33.692704  3260 raft_consensus.cc:515] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:33.693039  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:33.695070  3490 raft_consensus.cc:493] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:33.664319  2219 raft_consensus.cc:1240] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:33.666246  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:33.706215  2218 raft_consensus.cc:2468] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 3.
I20260709 12:59:33.707041  2226 raft_consensus.cc:1275] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:59:33.695724  3490 raft_consensus.cc:515] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:33.708087  3260 leader_election.cc:290] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:33.709779  3490 leader_election.cc:290] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:33.581421  3529 leader_election.cc:290] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:33.711058  3489 raft_consensus.cc:493] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:33.690521  3184 raft_consensus.cc:515] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 12:59:33.665475  1571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:33.658814  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 12:59:33.665403  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:33.662431  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:33.676083  2221 consensus_meta.cc:287] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b: Time spent flushing consensus metadata: real 0.573s	user 0.009s	sys 0.001s
I20260709 12:59:33.659929  1677 raft_consensus.cc:1275] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:59:33.672812  3587 raft_consensus.cc:2749] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:59:33.737084  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:33.807296  1603 consensus_meta.cc:287] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.539s	user 0.009s	sys 0.000s
W20260709 12:59:33.825480  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 507039us
I20260709 12:59:33.718531  3260 consensus_queue.cc:1048] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 12:59:33.808406  1603 raft_consensus.cc:2468] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 3.
W20260709 12:59:33.869877  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:33.676560  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:33.684180  3486 leader_election.cc:290] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 12:59:34.011693  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 154429us
W20260709 12:59:34.012873  3442 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.007s	sys 0.010s
I20260709 12:59:34.009172  3473 raft_consensus.cc:493] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:33.965209  2221 raft_consensus.cc:2468] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 4.
I20260709 12:59:34.029922  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
W20260709 12:59:34.024487  3442 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.544s	user 0.007s	sys 0.011s
I20260709 12:59:34.022013  3492 raft_consensus.cc:493] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:34.029325  1672 raft_consensus.cc:2393] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 7: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 12:59:34.036835  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 382) took 2234 ms. Trace:
W20260709 12:59:34.038153  3508 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.006s	sys 0.004s
I20260709 12:59:34.039029  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:34.039768  1603 raft_consensus.cc:2393] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 4: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 12:59:34.047160  3262 raft_consensus.cc:2749] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:34.029122  3489 raft_consensus.cc:515] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:34.039090  3493 raft_consensus.cc:493] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
W20260709 12:59:34.056188  3508 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.820s	user 0.007s	sys 0.004s
I20260709 12:59:34.074106  1603 raft_consensus.cc:1240] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 2. Current term is 3. Ops: [2.3-2.3]
I20260709 12:59:34.067824  2221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50310 (request call id 461) took 1258 ms. Trace:
W20260709 12:59:34.071383  3589 consensus_meta.cc:287] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.767s	user 0.009s	sys 0.003s
W20260709 12:59:34.101954  1679 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.753s	user 0.025s	sys 0.020s
W20260709 12:59:34.107304  1679 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.843s	user 0.025s	sys 0.020s
W20260709 12:59:34.103129  2220 thread.cc:641] tablet-copy [worker] (thread pool) Time spent creating pthread: real 0.787s	user 0.034s	sys 0.066s
I20260709 12:59:34.072963  3492 raft_consensus.cc:515] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:34.069154  3473 raft_consensus.cc:515] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:34.116274  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
W20260709 12:59:34.110718  2220 thread.cc:608] tablet-copy [worker] (thread pool) Time spent starting thread: real 0.797s	user 0.035s	sys 0.066s
I20260709 12:59:34.119200  1603 raft_consensus.cc:1275] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:34.087100  3314 raft_consensus.cc:3055] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:59:34.109668  3356 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.761s	user 0.013s	sys 0.004s
I20260709 12:59:34.106107  3589 raft_consensus.cc:515] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 12:59:34.123418  3356 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.863s	user 0.014s	sys 0.004s
I20260709 12:59:34.120396  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:34.135349  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:34.054793  1605 rpcz_store.cc:276] 0709 12:59:31.802840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:32.104622 (+301782us) service_pool.cc:224] Handling call
0709 12:59:32.104973 (+   351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:32.762864 (+657891us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:32.762893 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:32.763360 (+   467us) log.cc:844] Serialized 26 byte log entry
0709 12:59:33.100244 (+336884us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:33.675355 (+575111us) log.cc:844] Serialized 14 byte log entry
0709 12:59:34.036371 (+361016us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:34.036468 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:34.036523 (+    55us) raft_consensus.cc:1685] finished
0709 12:59:34.036534 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:34.036661 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1013615,"prepare.queue_time_us":924400,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":1022561,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":104,"spinlock_wait_cycles":40857472,"thread_start_us":403604,"threads_started":2,"wal-append.queue_time_us":372943}
I20260709 12:59:34.121044  3314 raft_consensus.cc:740] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:34.086997  2221 rpcz_store.cc:276] 0709 12:59:32.796024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:32.797944 (+  1920us) service_pool.cc:224] Handling call
0709 12:59:33.030384 (+232440us) spinlock_profiling.cc:243] Waited 9.52 ms on lock 0x7b5800015c98. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a1548ee9c 00007f6a1548ea5b 00007f6a1e3a7c09 00007f6a1d501ee0 00007f6a1d5cb0ab 00007f6a1d5cb131 00007f6a1d5790a0 00007f6a1d578984 00007f6a16af36d4 00007f6a16af3662
0709 12:59:34.032287 (+1001903us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21893376}
I20260709 12:59:34.109813  3493 raft_consensus.cc:515] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:34.130316  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:34.146785  1603 raft_consensus.cc:2393] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 5: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 12:59:34.139755  3184 leader_election.cc:290] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:34.148958  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:34.290491  1673 raft_consensus.cc:2393] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 5: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
W20260709 12:59:34.290966  1571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:34.294243  1672 raft_consensus.cc:2393] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 4: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 12:59:34.296118  3489 leader_election.cc:290] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:34.296835  3489 raft_consensus.cc:493] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:34.297361  3489 raft_consensus.cc:515] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 12:59:34.299412  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:34.300683  1602 raft_consensus.cc:2368] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for earlier term 7. Current term is 8.
W20260709 12:59:34.327201  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 316237us
I20260709 12:59:34.327919  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
W20260709 12:59:34.327201  3404 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.791s	user 0.038s	sys 0.067s
I20260709 12:59:34.317001  3184 raft_consensus.cc:493] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:34.334756  3404 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.023s	user 0.038s	sys 0.068s
W20260709 12:59:34.338150  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:34.333482  3482 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.042s	sys 0.089s
I20260709 12:59:34.340482  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:34.342717  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 12:59:34.340090  3482 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.628s	user 0.042s	sys 0.089s
I20260709 12:59:34.342691  3508 raft_consensus.cc:493] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:34.352031  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:34.351159  3582 raft_consensus.cc:493] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:34.354337  3582 raft_consensus.cc:515] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:34.356667  3582 leader_election.cc:290] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:34.357477  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:34.360621  3560 raft_consensus.cc:493] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:34.361320  3560 raft_consensus.cc:515] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:34.363665  1681 raft_consensus.cc:1240] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:34.363795  3560 leader_election.cc:290] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:34.366634  3508 raft_consensus.cc:515] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:34.367169  3314 consensus_queue.cc:260] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:34.368537  3508 leader_election.cc:290] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:34.368788  3314 raft_consensus.cc:3060] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:34.369637  3184 raft_consensus.cc:515] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:34.371233  3553 leader_election.cc:290] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:34.371999  3553 raft_consensus.cc:493] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:34.372488  3553 raft_consensus.cc:515] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:34.375653  1599 raft_consensus.cc:1240] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:34.376096  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:34.376824  3596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:50326 (request call id 541) took 1064 ms. Trace:
I20260709 12:59:34.376935  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:34.377825  1600 raft_consensus.cc:2393] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 6: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 12:59:34.376845  1602 raft_consensus.cc:3060] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:34.345858  3486 raft_consensus.cc:493] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:34.380548  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:34.387440  3589 leader_election.cc:290] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:34.372641  3184 leader_election.cc:290] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:34.392858  1599 raft_consensus.cc:2468] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 3.
I20260709 12:59:34.379374  1598 raft_consensus.cc:2468] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 4.
I20260709 12:59:34.398314  1607 raft_consensus.cc:1275] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:59:34.383138  3560 raft_consensus.cc:493] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:34.377346  3596 rpcz_store.cc:276] 0709 12:59:33.312754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:33.312937 (+   183us) service_pool.cc:224] Handling call
0709 12:59:34.376713 (+1063776us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-copy.queue_time_us":1022064,"thread_start_us":803826,"threads_started":1}
I20260709 12:59:34.388671  3553 leader_election.cc:290] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:34.404572  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 12:59:34.405519  3495 consensus_meta.cc:287] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 1.045s	user 0.008s	sys 0.003s
I20260709 12:59:34.409327  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 12:59:34.400247  1646 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.702s	user 0.007s	sys 0.007s
I20260709 12:59:34.410705  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
W20260709 12:59:34.408586  3585 consensus_meta.cc:287] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 1.130s	user 0.011s	sys 0.003s
I20260709 12:59:34.401458  3489 leader_election.cc:290] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:34.391328  3486 raft_consensus.cc:515] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:34.410033  1679 raft_consensus.cc:2468] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 2.
W20260709 12:59:34.470140  1646 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.772s	user 0.007s	sys 0.008s
W20260709 12:59:34.469897  2192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:34.408035  3589 raft_consensus.cc:493] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:34.472855  1673 raft_consensus.cc:3060] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:59:34.472817  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 775042us
I20260709 12:59:34.474772  1571 leader_election.cc:304] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:34.476734  1603 raft_consensus.cc:2410] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:59:34.470806  3404 raft_consensus.cc:493] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:34.499073   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:34.479127  3582 raft_consensus.cc:2804] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:34.481194  3489 raft_consensus.cc:493] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:34.479784  3493 leader_election.cc:290] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 12:59:34.485287  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:34.484290  1646 leader_election.cc:304] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:34.492790  3404 raft_consensus.cc:515] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 12:59:34.494397  3497 consensus_meta.cc:287] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 1.167s	user 0.002s	sys 0.008s
I20260709 12:59:34.523415  1602 raft_consensus.cc:2468] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 3.
I20260709 12:59:34.506875  3582 raft_consensus.cc:493] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:34.501053  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:34.507288  3600 raft_consensus.cc:493] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:34.527060  3600 raft_consensus.cc:515] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:34.529436  3600 leader_election.cc:290] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:34.476554  3560 raft_consensus.cc:515] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:34.518544  3601 raft_consensus.cc:493] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:34.531117  3601 raft_consensus.cc:515] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:34.531504  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:34.532302  3560 leader_election.cc:290] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:34.532687  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:34.533375  3601 leader_election.cc:290] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:34.533807  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:34.518581  3585 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:34.535224  3473 leader_election.cc:290] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:34.535017  3585 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:59:34.537321  3585 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:34.537982  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:34.517335  1606 raft_consensus.cc:1240] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:34.518839  3587 raft_consensus.cc:493] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:34.520282  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:34.492412  3508 raft_consensus.cc:493] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:34.488286  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:34.543449  1598 raft_consensus.cc:2468] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 2.
I20260709 12:59:34.543275  3508 raft_consensus.cc:515] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:34.544466  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:34.545145  1598 raft_consensus.cc:2468] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 4.
I20260709 12:59:34.545409  3508 leader_election.cc:290] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:34.489941  3486 leader_election.cc:290] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 12:59:34.547358  3602 log.cc:927] Time spent T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:59:34.548192  1601 raft_consensus.cc:1240] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:34.523584  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:34.549088  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:34.549937  1604 raft_consensus.cc:2410] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:59:34.550796  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:34.554736  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:34.524933  3604 raft_consensus.cc:2804] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:34.539935  1607 raft_consensus.cc:2468] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 3.
I20260709 12:59:34.508644  3489 raft_consensus.cc:515] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:34.541419  1606 raft_consensus.cc:1275] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:59:34.540927  3511 consensus_queue.cc:260] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:34.542457  3587 raft_consensus.cc:515] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:34.568548  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:34.565440  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:34.559554  3604 raft_consensus.cc:493] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:34.570278  1606 raft_consensus.cc:3055] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:34.555215  1605 raft_consensus.cc:2468] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 5.
I20260709 12:59:34.568675  3511 raft_consensus.cc:3060] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:34.570725  1606 raft_consensus.cc:740] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:34.572288  2226 raft_consensus.cc:2468] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 4.
I20260709 12:59:34.573097  1606 consensus_queue.cc:260] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:34.570334  3604 raft_consensus.cc:3060] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:34.574796  1606 raft_consensus.cc:3060] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:34.570726  3587 leader_election.cc:290] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:34.524624  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:34.557555  1673 raft_consensus.cc:2468] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 8.
I20260709 12:59:34.520095  3404 leader_election.cc:290] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:34.551507  1681 raft_consensus.cc:2468] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 6.
I20260709 12:59:34.576119  3560 raft_consensus.cc:493] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:34.534474  1600 raft_consensus.cc:2468] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 4.
I20260709 12:59:34.563043  3473 raft_consensus.cc:493] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:34.569820  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:34.579087  1607 raft_consensus.cc:1275] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:34.573946  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:34.576715  3560 raft_consensus.cc:515] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:34.582630  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:34.571864  3489 leader_election.cc:290] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:34.580384  3497 consensus_queue.cc:1048] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 12:59:34.473351  3589 raft_consensus.cc:515] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:34.588071  1571 leader_election.cc:304] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:34.589881  1571 leader_election.cc:304] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:34.590181  3390 raft_consensus.cc:2804] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:34.586336  1602 raft_consensus.cc:2468] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 3.
I20260709 12:59:34.566843  3582 raft_consensus.cc:3060] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:34.597579  1570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:34.590366  3489 raft_consensus.cc:493] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:34.577029  3473 raft_consensus.cc:515] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:34.600509  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:34.602085  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:34.603269  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:34.604202  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:34.595125  3508 raft_consensus.cc:2804] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:34.605027  2220 raft_consensus.cc:2468] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 3.
I20260709 12:59:34.605436  3508 raft_consensus.cc:493] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:34.605890  3508 raft_consensus.cc:3060] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:34.607599  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:34.608310  2221 raft_consensus.cc:2468] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 4.
I20260709 12:59:34.597360  3390 raft_consensus.cc:697] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 8 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:34.605451  1677 raft_consensus.cc:1240] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:59:34.612793  3560 leader_election.cc:290] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:34.613579  3489 raft_consensus.cc:515] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:34.614705  3448 raft_consensus.cc:3055] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:34.615080  3448 raft_consensus.cc:740] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 12:59:34.615697  3473 leader_election.cc:290] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:34.610149  3390 consensus_queue.cc:237] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:34.607961  3164 leader_election.cc:290] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 5 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:34.615983  3448 consensus_queue.cc:260] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:34.617372  3448 raft_consensus.cc:3060] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:34.627034  1570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:34.615855  3489 leader_election.cc:290] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 12:59:34.863516  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:34.869673  3552 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.328s	user 0.006s	sys 0.024s
W20260709 12:59:34.870111  3552 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.601s	user 0.007s	sys 0.024s
I20260709 12:59:34.872172  3589 leader_election.cc:290] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:34.938123  3604 raft_consensus.cc:515] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:35.747921   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:35.818287  3604 leader_election.cc:290] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 12:59:35.858804  3592 log.cc:927] Time spent T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 1.737s	user 0.009s	sys 0.007s
W20260709 12:59:35.874226  1553 debug-util.cc:398] Leaking SignalData structure 0x7b08000db6a0 after lost signal to thread 434
W20260709 12:59:35.887647  3448 consensus_meta.cc:287] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b: Time spent flushing consensus metadata: real 1.270s	user 0.007s	sys 0.008s
I20260709 12:59:36.886020   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:37.187480  3492 leader_election.cc:290] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:37.218780  3617 raft_consensus.cc:493] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:37.222076  3617 raft_consensus.cc:515] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:37.225811  3617 leader_election.cc:290] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:37.235016  3617 raft_consensus.cc:493] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:37.235867  3617 raft_consensus.cc:515] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 12:59:37.236645  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 2.6096e+06us
I20260709 12:59:37.242331  3262 consensus_queue.cc:1059] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:37.243500  3262 raft_consensus.cc:493] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:37.244004  3262 raft_consensus.cc:515] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:37.245016  3617 leader_election.cc:290] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:37.246060  3262 leader_election.cc:290] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:37.247586  3589 raft_consensus.cc:493] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:37.248090  3589 raft_consensus.cc:515] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:37.249992  3589 leader_election.cc:290] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 12:59:37.251143  2190 connection.cc:256] RPC call timeout handler was delayed by -2.18688378600001s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1908s for a response
W20260709 12:59:37.251646  2190 connection.cc:256] RPC call timeout handler was delayed by -2.108583785999997s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1995s for a response
I20260709 12:59:37.252187  3492 raft_consensus.cc:493] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:37.252737  3492 raft_consensus.cc:515] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 12:59:37.254825  2190 connection.cc:256] RPC call timeout handler was delayed by -1.4763744790000146s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1504s for a response
W20260709 12:59:37.255203  2190 connection.cc:256] RPC call timeout handler was delayed by -1.12459474100001s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17370000000000002s for a response
I20260709 12:59:37.255771  3492 leader_election.cc:290] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 12:59:37.222450  3508 consensus_meta.cc:287] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 2.616s	user 0.008s	sys 0.013s
W20260709 12:59:37.268144  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:37.262120  3582 raft_consensus.cc:515] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:37.273635  3582 leader_election.cc:290] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 12:59:37.281304  1606 consensus_meta.cc:287] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 2.706s	user 0.018s	sys 0.022s
I20260709 12:59:37.275331  3492 raft_consensus.cc:493] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:37.285593  3492 raft_consensus.cc:515] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:37.288218  3492 leader_election.cc:290] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:37.288955  3492 raft_consensus.cc:493] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:37.289624  3492 raft_consensus.cc:515] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:37.258354  3508 raft_consensus.cc:515] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:37.281889  3262 raft_consensus.cc:493] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:37.293723  3262 raft_consensus.cc:515] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:37.296334  3262 leader_election.cc:290] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:37.299033  1606 raft_consensus.cc:1275] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:37.299739  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 404) took 2758 ms. Trace:
I20260709 12:59:37.300050  1606 rpcz_store.cc:276] 0709 12:59:34.541217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:34.569776 (+ 28559us) service_pool.cc:224] Handling call
0709 12:59:34.570116 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:37.299436 (+2729320us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:37.299640 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:37.300987  1570 connection.cc:256] RPC call timeout handler was delayed by -2.610295868000037s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1584s for a response
W20260709 12:59:37.301422  1570 connection.cc:256] RPC call timeout handler was delayed by -2.57069586800003s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1628s for a response
W20260709 12:59:37.301786  1570 connection.cc:256] RPC call timeout handler was delayed by -2.3258958680000319s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19s for a response
W20260709 12:59:37.302100  1570 connection.cc:256] RPC call timeout handler was delayed by -2.3249958680000304s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19010000000000002s for a response
W20260709 12:59:37.302557  1570 connection.cc:256] RPC call timeout handler was delayed by -2.2016958680000016s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20379999999999998s for a response
W20260709 12:59:37.303890  1570 connection.cc:256] RPC call timeout handler was delayed by -2.1206958679999843s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21280000000000002s for a response
W20260709 12:59:37.304199  1570 connection.cc:256] RPC call timeout handler was delayed by -2.1071958680000193s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2143s for a response
I20260709 12:59:37.303514  3582 raft_consensus.cc:493] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:37.305140  3582 raft_consensus.cc:515] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:37.301424  3492 leader_election.cc:290] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:37.308167  3582 leader_election.cc:290] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:37.293390  3508 leader_election.cc:290] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 12:59:37.310405  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:37.311149  3617 raft_consensus.cc:493] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:37.311444  3618 raft_consensus.cc:493] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:37.311693  3617 raft_consensus.cc:515] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:37.312023  3618 raft_consensus.cc:515] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:37.313808  3617 leader_election.cc:290] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:37.313997  3618 leader_election.cc:290] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:37.314503  3618 raft_consensus.cc:493] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:37.315109  3618 raft_consensus.cc:515] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:37.316781  1599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36200 (request call id 1730) took 2795 ms. Trace:
I20260709 12:59:37.317204  1599 rpcz_store.cc:276] 0709 12:59:34.521808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:34.556206 (+ 34398us) service_pool.cc:224] Handling call
0709 12:59:34.556499 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:34.559401 (+  2902us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:59:34.563194 (+  3793us) log.cc:844] Serialized 14 byte log entry
0709 12:59:34.627025 (+ 63831us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:34.627079 (+    54us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:34.627115 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:34.627172 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:37.316702 (+2689530us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1501,"prepare.queue_time_us":3946,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":5247,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":83,"thread_start_us":61894,"threads_started":1,"wal-append.queue_time_us":381938,"wal-append.run_cpu_time_us":1237,"wal-append.run_wall_time_us":1001268}
I20260709 12:59:37.304473  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36200 (request call id 1725) took 2784 ms. Trace:
W20260709 12:59:37.319164  2191 connection.cc:256] RPC call timeout handler was delayed by -1.8833166450000363s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1517s for a response
W20260709 12:59:37.319826  2191 connection.cc:256] RPC call timeout handler was delayed by -1.5818166450000035s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18520000000000003s for a response
I20260709 12:59:37.319782  1601 rpcz_store.cc:276] 0709 12:59:34.520111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:34.520429 (+   318us) service_pool.cc:224] Handling call
0709 12:59:34.520736 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:34.548597 (+ 27861us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:37.304194 (+2755597us) spinlock_profiling.cc:243] Waited 27.2 ms on lock 0x7b54003499d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 12:59:37.304400 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":62664960}
W20260709 12:59:37.304471  1570 connection.cc:256] RPC call timeout handler was delayed by -2.0801958680000325s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21730000000000002s for a response
I20260709 12:59:37.319500  3164 raft_consensus.cc:493] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:37.322983  3164 raft_consensus.cc:515] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 12:59:37.325778  1570 connection.cc:256] RPC call timeout handler was delayed by -2.0549958679999918s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22010000000000002s for a response
W20260709 12:59:37.326349  1570 connection.cc:256] RPC call timeout handler was delayed by -2.0468958680000355s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.221s for a response
W20260709 12:59:37.328327  1570 connection.cc:256] RPC call timeout handler was delayed by -2.0297958680000079s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22290000000000001s for a response
W20260709 12:59:37.328752  1570 connection.cc:256] RPC call timeout handler was delayed by -2.0288958680000064s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.223s for a response
W20260709 12:59:37.329270  1570 connection.cc:256] RPC call timeout handler was delayed by -1.1374915470000246s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1799s for a response
W20260709 12:59:37.329658  1570 connection.cc:256] RPC call timeout handler was delayed by -1.1329915470000174s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1804s for a response
W20260709 12:59:37.330765  1570 connection.cc:256] RPC call timeout handler was delayed by -1.083491547000051s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1859s for a response
W20260709 12:59:37.331120  1570 connection.cc:256] RPC call timeout handler was delayed by -1.0708915470000306s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18730000000000002s for a response
W20260709 12:59:37.331451  1570 connection.cc:256] RPC call timeout handler was delayed by -1.0591915470000117s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1886s for a response
I20260709 12:59:37.325654  1674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50664 (request call id 345) took 3196 ms. Trace:
I20260709 12:59:37.317492  3618 leader_election.cc:290] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:37.337841  1674 rpcz_store.cc:276] 0709 12:59:34.130034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:34.143456 (+ 13422us) service_pool.cc:224] Handling call
0709 12:59:37.324731 (+3181275us) spinlock_profiling.cc:243] Waited 32.3 ms on lock 0x7b5800143798. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a1548eb71 00007f6a1548ea22 00007f6a1e3a7c09 00007f6a1d501ee0 00007f6a1d5cb0ab 00007f6a1d5cb131 00007f6a1d58cfc0 00007f6a1d577929 00007f6a1d5773d2 00007f6a16aeebd4
0709 12:59:37.324930 (+   199us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:37.325177 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:37.325203 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:37.325260 (+    57us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:37.325317 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:37.325371 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:37.325472 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":74339584}
I20260709 12:59:37.325701  3164 leader_election.cc:290] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:37.338126  3508 raft_consensus.cc:493] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:37.341066  3508 raft_consensus.cc:515] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:37.343766  3258 raft_consensus.cc:3055] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:37.344259  3258 raft_consensus.cc:740] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:37.345196  3258 consensus_queue.cc:260] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:37.346447  3258 raft_consensus.cc:3060] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:37.343770  3508 leader_election.cc:290] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:37.366277  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49170 (request call id 1553) took 3012 ms. Trace:
W20260709 12:59:37.371225  1523 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43010 (request call id 1623) took 3964 ms (client timeout 1686 ms). Trace:
I20260709 12:59:37.373633  1525 raft_consensus.cc:1275] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:59:37.375646  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
W20260709 12:59:37.395776  1523 rpcz_store.cc:269] 0709 12:59:33.407067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:37.370882 (+3963815us) service_pool.cc:211] Skipping call since client already timed out
0709 12:59:37.371024 (+   142us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:59:37.398775  1529 raft_consensus.cc:3060] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:37.403614  1527 raft_consensus.cc:1275] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:59:37.405977  1524 raft_consensus.cc:3055] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:37.406369  1524 raft_consensus.cc:740] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 12:59:37.407202  1524 consensus_queue.cc:260] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:37.408191  1524 raft_consensus.cc:3060] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:37.396142  1676 rpcz_store.cc:276] 0709 12:59:34.353568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:34.354219 (+   651us) service_pool.cc:224] Handling call
0709 12:59:34.354633 (+   414us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:34.373176 (+ 18543us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:59:34.373537 (+   361us) log.cc:844] Serialized 14 byte log entry
0709 12:59:34.600795 (+227258us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:34.622803 (+ 22008us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:59:34.624604 (+  1801us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:37.365887 (+2741283us) spinlock_profiling.cc:243] Waited 18.1 ms on lock 0x7b54003f61d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 12:59:37.365940 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:37.366106 (+   166us) inbound_call.cc:177] Queueing success response
0709 12:59:37.393322 (+ 27216us) spinlock_profiling.cc:243] Waited 4.87 ms on lock 0x7b4800041ad8. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1d4dcaa1 00007f6a1d4d3b37 00007f6a1d4d39ca 00007f6a1d5cb26f 00007f6a1d5caf37 00007f6a1d5df55c 00007f6a1d5df508 00007f6a1d5df488 00007f6a1d5df443 00007f6a1d5de6ec 00007f6a1c508a96
Metrics: {"mutex_wait_us":4720,"prepare.queue_time_us":688,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"raft.queue_time_us":28320,"raft.run_cpu_time_us":33799,"raft.run_wall_time_us":3003806,"spinlock_wait_cycles":52843648,"thread_start_us":210760,"threads_started":1,"wal-append.queue_time_us":249462,"wal-append.run_cpu_time_us":1514,"wal-append.run_wall_time_us":1311058}
I20260709 12:59:37.415172  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:37.415921  1528 raft_consensus.cc:2468] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 2.
W20260709 12:59:37.438108  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 59622.2us
I20260709 12:59:37.441346  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:37.442186  1525 raft_consensus.cc:2468] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 3.
I20260709 12:59:37.445511  1524 raft_consensus.cc:1275] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:59:37.450855  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:37.451187  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:37.451980  1527 raft_consensus.cc:2468] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 2.
I20260709 12:59:37.452106  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:37.452786  1525 raft_consensus.cc:2468] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 3.
I20260709 12:59:37.455456  1528 raft_consensus.cc:2468] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 3.
I20260709 12:59:37.458962  1529 raft_consensus.cc:2468] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 5.
I20260709 12:59:37.450773  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:37.461476  1531 raft_consensus.cc:2468] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 3.
I20260709 12:59:37.449386  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:37.462958  1523 raft_consensus.cc:2410] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:59:37.459947  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:37.465503  1526 raft_consensus.cc:2393] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 4: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 12:59:37.475023  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:37.475872  1525 raft_consensus.cc:2468] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 3.
W20260709 12:59:37.485819  1605 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36200 (request call id 1714) took 3152 ms (client timeout 1694 ms). Trace:
W20260709 12:59:37.489753  1605 rpcz_store.cc:269] 0709 12:59:34.333949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:34.335826 (+  1877us) service_pool.cc:224] Handling call
0709 12:59:37.485524 (+3149698us) spinlock_profiling.cc:243] Waited 194 ms on lock 0x7b54002ec054. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 12:59:37.485691 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":445293440}
I20260709 12:59:37.491566  2227 raft_consensus.cc:1240] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:37.492300  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:37.492969  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:37.494297  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:37.495002  2225 raft_consensus.cc:2468] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 4.
W20260709 12:59:37.488164  2218 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 2.883s	user 0.019s	sys 0.030s
I20260709 12:59:37.496747  3618 raft_consensus.cc:493] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:37.497301  3618 raft_consensus.cc:515] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:37.498808  3511 raft_consensus.cc:493] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:37.499306  3511 raft_consensus.cc:515] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:37.500321  1676 raft_consensus.cc:1240] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 4 LEADER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:37.501279  3301 raft_consensus.cc:493] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:37.501860  3301 raft_consensus.cc:515] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:37.502357  3618 leader_election.cc:290] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:37.502803  3482 raft_consensus.cc:493] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:37.503348  3482 raft_consensus.cc:515] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:37.505429  3482 leader_election.cc:290] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:37.505563  3618 raft_consensus.cc:493] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:37.505445  3617 raft_consensus.cc:493] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:37.507266  3617 raft_consensus.cc:515] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:37.509285  3617 leader_election.cc:290] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 12:59:37.510092  1496 connection.cc:256] RPC call timeout handler was delayed by -2.7875871150000648s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1544s for a response
I20260709 12:59:37.510805  3617 raft_consensus.cc:493] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:37.511309  3617 raft_consensus.cc:515] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 12:59:37.512575  2219 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.884s	user 0.022s	sys 0.028s
I20260709 12:59:37.513278  3617 leader_election.cc:290] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:37.506165  3618 raft_consensus.cc:515] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:37.515427  3618 leader_election.cc:290] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 12:59:37.510459  1496 connection.cc:256] RPC call timeout handler was delayed by -2.5346871150000538s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1825s for a response
W20260709 12:59:37.515998  1496 connection.cc:256] RPC call timeout handler was delayed by -2.1880922660000124s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21840000000000004s for a response
W20260709 12:59:37.516299  1496 connection.cc:256] RPC call timeout handler was delayed by -2.0719774380000331s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.223s for a response
I20260709 12:59:37.519172  3618 consensus_queue.cc:1048] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:37.521363  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:37.526090  3301 leader_election.cc:290] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:37.501277  3511 leader_election.cc:290] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:37.528753  1525 raft_consensus.cc:2468] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 2.
I20260709 12:59:37.530140  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:37.530694  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:37.531044  1676 raft_consensus.cc:2393] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 4: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 12:59:37.531559  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:37.531728  1677 raft_consensus.cc:1240] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:37.532114  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:37.532980  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:37.533200  1674 raft_consensus.cc:2468] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 2.
I20260709 12:59:37.533201  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:37.534129  1676 raft_consensus.cc:2468] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 4.
I20260709 12:59:37.534409  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:37.535172  1673 raft_consensus.cc:2393] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 4: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
W20260709 12:59:37.535633  3363 log.cc:927] Time spent T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.053s	user 0.004s	sys 0.000s
I20260709 12:59:37.536233  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 12:59:37.536931  3519 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 12:59:37.535233  1677 raft_consensus.cc:2468] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 4.
I20260709 12:59:37.537298  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:37.540117  1674 raft_consensus.cc:2468] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 4.
W20260709 12:59:37.550253  2190 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 3.220s (SENT) [suppressed 14 similar messages]
I20260709 12:59:37.556532  1525 raft_consensus.cc:2468] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 4.
I20260709 12:59:37.559944  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:37.560649  1675 raft_consensus.cc:3060] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:59:37.564738  3404 raft_consensus.cc:493] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:37.565372  3404 raft_consensus.cc:515] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:37.556041  3482 raft_consensus.cc:493] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:37.607508  2219 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.979s	user 0.022s	sys 0.028s
I20260709 12:59:37.555881  3301 raft_consensus.cc:493] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
W20260709 12:59:37.566942  2218 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.962s	user 0.020s	sys 0.032s
I20260709 12:59:37.608430  2219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50326 (request call id 554) took 3007 ms. Trace:
I20260709 12:59:37.668780  3301 raft_consensus.cc:515] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:37.649446  2219 rpcz_store.cc:276] 0709 12:59:34.601254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:34.601825 (+   571us) service_pool.cc:224] Handling call
0709 12:59:34.606125 (+  4300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:34.626585 (+ 20460us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:34.627729 (+  1144us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:34.628265 (+   536us) log.cc:844] Serialized 26 byte log entry
0709 12:59:37.608035 (+2979770us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:37.608082 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:37.608152 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:37.608207 (+    55us) raft_consensus.cc:1685] finished
0709 12:59:37.608224 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:37.608348 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12053,"raft.queue_time_us":18801,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":44167,"thread_start_us":2979372,"threads_started":1,"wal-append.queue_time_us":1032043,"wal-append.run_cpu_time_us":10693,"wal-append.run_wall_time_us":1168574}
I20260709 12:59:37.627312  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:37.670280  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:37.671438  1673 raft_consensus.cc:2468] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 1.
I20260709 12:59:37.670645  3482 raft_consensus.cc:515] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:37.672782  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 12:59:37.626559  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 162496us
I20260709 12:59:37.727371  1681 raft_consensus.cc:2468] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 5.
I20260709 12:59:37.750064  1677 raft_consensus.cc:1275] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:59:37.757575  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:37.769070  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:37.769877  1605 raft_consensus.cc:2468] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 1.
I20260709 12:59:37.777915  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 12:59:37.864356   436 debug-util.cc:398] Leaking SignalData structure 0x7b080000fa60 after lost signal to thread 2192
I20260709 12:59:37.874236  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:37.883895  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 12:59:37.794610  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:37.856825  3591 log.cc:927] Time spent T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 4.016s	user 0.012s	sys 0.035s
W20260709 12:59:37.888917  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:37.779878  1523 raft_consensus.cc:1275] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:59:37.809870  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:37.897747  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:37.898005  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:37.897781  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:37.899240  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:37.900847  1599 raft_consensus.cc:2393] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 3: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 12:59:37.901683  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:37.902906  1675 raft_consensus.cc:2468] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 4.
I20260709 12:59:37.855742  3482 leader_election.cc:290] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:37.899176  1571 leader_election.cc:304] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
W20260709 12:59:37.904111  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 414170us
I20260709 12:59:37.905041  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:37.908803  1605 raft_consensus.cc:2468] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 2.
I20260709 12:59:37.898138  3301 leader_election.cc:290] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:37.821424  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 12:59:37.910418  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:37.912756  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:37.913906  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:37.911996  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 12:59:37.898802   436 kernel_stack_watchdog.cc:198] Thread 2192 stuck at /apache/dev/git/kudu/src/kudu/rpc/outbound_call.cc:307 for 2245ms:
Kernel stack:
(could not read kernel stack)
User stack:
<Timed out: thread did not respond: maybe it is blocking signals>
I20260709 12:59:37.843494  1676 raft_consensus.cc:2468] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 6.
I20260709 12:59:37.935564  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:37.947456  1673 raft_consensus.cc:2468] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 2.
I20260709 12:59:37.902536  3585 consensus_queue.cc:1059] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.050s
I20260709 12:59:37.948642  1523 raft_consensus.cc:2468] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 4.
I20260709 12:59:37.979820  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:37.984663  1604 raft_consensus.cc:1275] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:59:37.978129  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 79030.9us
I20260709 12:59:37.973310  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 12:59:37.995589  1495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:38.001155  1674 raft_consensus.cc:2393] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 4: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 12:59:37.949101  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:38.002067  1675 raft_consensus.cc:2468] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 2.
W20260709 12:59:37.999819  1497 connection.cc:256] RPC call timeout handler was delayed by -3.8871112319999952s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15700000000000003s for a response
I20260709 12:59:37.999207  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:38.004041  1529 raft_consensus.cc:2468] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 4.
I20260709 12:59:37.951272  3363 tablet_bootstrap.cc:492] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 12:59:38.008221  3363 tablet_bootstrap.cc:492] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b: Bootstrap complete.
I20260709 12:59:38.013092  3363 ts_tablet_manager.cc:1403] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b: Time spent bootstrapping tablet: real 5.013s	user 0.066s	sys 0.036s
I20260709 12:59:38.008826  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:38.010268  3587 raft_consensus.cc:493] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:38.011708  3627 raft_consensus.cc:493] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:37.972834  2218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50326 (request call id 551) took 3377 ms. Trace:
I20260709 12:59:37.971035  1601 raft_consensus.cc:2468] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 3.
I20260709 12:59:38.013402  3348 raft_consensus.cc:2804] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:37.938432  3404 leader_election.cc:290] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:38.015421  3258 raft_consensus.cc:3055] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:38.018157  1571 leader_election.cc:304] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:38.057889  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:38.068585  1525 raft_consensus.cc:2468] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 4.
I20260709 12:59:38.056393  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:38.046511  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:38.069285  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:38.052829  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 12:59:38.046695  1530 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.027s	sys 0.035s
W20260709 12:59:38.069955  1497 connection.cc:256] RPC call timeout handler was delayed by -3.7112505559999818s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.30920000000000003s for a response
I20260709 12:59:38.074060  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 12:59:38.081693  1530 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.694s	user 0.027s	sys 0.040s
I20260709 12:59:38.068939  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:38.081518  1527 raft_consensus.cc:2468] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 2.
I20260709 12:59:38.080760  1524 raft_consensus.cc:2468] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 3.
I20260709 12:59:38.057212  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 12:59:38.083791  1497 connection.cc:256] RPC call timeout handler was delayed by -3.5764949699999988s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16310000000000002s for a response
I20260709 12:59:38.081080  1673 raft_consensus.cc:2468] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 4.
I20260709 12:59:38.083510  1675 raft_consensus.cc:2393] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 4: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 12:59:38.082947  1674 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2"
dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
mode: GRACEFUL
new_leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:33616
W20260709 12:59:38.085162  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 67110.4us
I20260709 12:59:38.085276  1674 raft_consensus.cc:606] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Received request to transfer leadership to TS e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:38.085770  1674 raft_consensus.cc:614] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:59:38.084479  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 3.45704e+06us
W20260709 12:59:38.084209  1497 connection.cc:256] RPC call timeout handler was delayed by -3.5739112320000004s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1918s for a response
W20260709 12:59:38.086629  1497 connection.cc:256] RPC call timeout handler was delayed by -3.5039353099999744s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1904s for a response
I20260709 12:59:37.950845  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:38.084198  1532 raft_consensus.cc:2468] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 4.
W20260709 12:59:38.086997  1497 connection.cc:256] RPC call timeout handler was delayed by -3.1750949699999751s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2077s for a response
I20260709 12:59:38.049212  1680 raft_consensus.cc:2468] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 3.
W20260709 12:59:38.046672  1553 debug-util.cc:398] Leaking SignalData structure 0x7b0800133b00 after lost signal to thread 1464
I20260709 12:59:38.002985  3585 raft_consensus.cc:493] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:38.090634  1571 leader_election.cc:304] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:37.987746  3508 raft_consensus.cc:493] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 12:59:38.023204  3519 raft_consensus.cc:493] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:38.047497  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:38.068409  3258 raft_consensus.cc:740] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:38.073580  3348 raft_consensus.cc:493] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:38.100485  1497 connection.cc:256] RPC call timeout handler was delayed by -3.0982954909999876s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19230000000000003s for a response
I20260709 12:59:38.102708  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:38.087378  3511 raft_consensus.cc:493] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:38.105233  1572 connection.cc:256] RPC call timeout handler was delayed by -3.410254833999943s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21280000000000002s for a response
I20260709 12:59:38.089205  3532 raft_consensus.cc:2804] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:38.108728  1532 raft_consensus.cc:2468] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 4.
I20260709 12:59:38.050685  3587 raft_consensus.cc:515] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:38.111246  3532 raft_consensus.cc:493] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:38.114863  3532 raft_consensus.cc:3060] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:38.046118  3627 raft_consensus.cc:515] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 12:59:38.117681  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 94919.7us
I20260709 12:59:38.118171  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:38.118778  1525 raft_consensus.cc:2468] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 3.
W20260709 12:59:38.119006  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 3.49542e+06us
W20260709 12:59:38.120491  1497 connection.cc:256] RPC call timeout handler was delayed by -2.9715151620000029s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2182s for a response
I20260709 12:59:38.093523  1676 raft_consensus.cc:2468] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 3.
I20260709 12:59:38.123656  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:38.123729  2191 leader_election.cc:304] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:38.109926  3348 raft_consensus.cc:3060] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:38.126400  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:38.126266  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:38.127219  1525 raft_consensus.cc:2468] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 4.
I20260709 12:59:38.127735  1527 raft_consensus.cc:1240] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 LEADER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:38.128101  1529 raft_consensus.cc:2376] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 2. Re-sending same reply.
I20260709 12:59:38.130509  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:38.131247  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:38.132027  1673 raft_consensus.cc:2393] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 5: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 12:59:38.133436  1672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49170 (request call id 1559) took 3644 ms. Trace:
I20260709 12:59:38.133960  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:38.134593  1527 raft_consensus.cc:2468] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 4.
I20260709 12:59:38.135248  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:38.135823  1524 raft_consensus.cc:3060] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:38.099467  3585 raft_consensus.cc:515] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:38.143908  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:38.145164  1525 raft_consensus.cc:3060] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:38.147783  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 57211.9us
I20260709 12:59:38.148669  1571 leader_election.cc:304] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:38.117156  2220 raft_consensus.cc:2468] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 2.
I20260709 12:59:38.155552  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:38.158392  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:38.106493  3508 raft_consensus.cc:515] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:38.163869  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:38.131628  3627 leader_election.cc:290] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:38.111663  3511 raft_consensus.cc:515] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:38.168139  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:38.168524  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:38.168990  1526 raft_consensus.cc:3060] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:38.165640  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:38.169975  1528 raft_consensus.cc:3060] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:38.135284  3404 raft_consensus.cc:2804] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:38.108183  3519 raft_consensus.cc:515] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:38.174407  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:38.175261  1532 raft_consensus.cc:2393] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 6: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 12:59:38.176098  1527 raft_consensus.cc:1240] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:38.179580  1523 raft_consensus.cc:1240] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:38.172444  3404 raft_consensus.cc:493] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:38.183290  1529 raft_consensus.cc:2393] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 4: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 12:59:38.184607  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:38.184849  1527 raft_consensus.cc:1275] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:59:38.185074  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 12:59:38.188417  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:38.188997  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:38.168133  3627 consensus_queue.cc:1048] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 12:59:38.196100  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:38.197397  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:38.198765  1523 raft_consensus.cc:2468] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 6.
I20260709 12:59:38.199887  1525 raft_consensus.cc:2468] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 4.
W20260709 12:59:38.201205  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 52657.6us
I20260709 12:59:38.133875  1672 rpcz_store.cc:276] 0709 12:59:34.489510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:34.521082 (+ 31572us) service_pool.cc:224] Handling call
0709 12:59:34.521422 (+   340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:34.521659 (+   237us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:34.521688 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:34.522213 (+   525us) log.cc:844] Serialized 26 byte log entry
0709 12:59:34.601452 (+ 79239us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:34.602767 (+  1315us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:34.623322 (+ 20555us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:38.133213 (+3509891us) raft_consensus.cc:1685] finished
0709 12:59:38.133235 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:38.133373 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":73147,"threads_started":1,"wal-append.queue_time_us":347332,"wal-append.run_cpu_time_us":1942,"wal-append.run_wall_time_us":1001957}
I20260709 12:59:38.202179  1571 leader_election.cc:304] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:38.182076  3404 raft_consensus.cc:3060] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:38.203089  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:38.204742  1646 leader_election.cc:304] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:38.165505  3258 consensus_queue.cc:260] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 12:59:38.205760  1570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:38.210173  1524 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 5.
I20260709 12:59:38.210958  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:38.211954  1646 leader_election.cc:400] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 election: Vote denied by peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303) with higher term. Message: Invalid argument: T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for earlier term 7. Current term is 8.
I20260709 12:59:38.217037  1646 leader_election.cc:403] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:59:38.217465  1524 raft_consensus.cc:1240] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:59:38.229868  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:38.218061  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:38.231107  1681 raft_consensus.cc:2393] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 4: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 12:59:38.212373  3271 consensus_queue.cc:1059] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
W20260709 12:59:38.229733  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 87223.8us
W20260709 12:59:38.232533  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 96229.5us
I20260709 12:59:38.215996  3635 raft_consensus.cc:493] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:38.241344  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 70848.1us
I20260709 12:59:38.244484  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:38.244831  2191 leader_election.cc:304] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:38.232981  3258 raft_consensus.cc:3060] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:38.244055  1496 leader_election.cc:304] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:38.216559  3599 consensus_queue.cc:1048] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 12:59:38.257184  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:38.257871  1524 raft_consensus.cc:3060] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:59:38.245935  3301 raft_consensus.cc:2749] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:38.246870  3511 leader_election.cc:290] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:38.275543  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:38.275739  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:38.276948  1681 raft_consensus.cc:2468] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 6.
I20260709 12:59:38.277881  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:38.278479  1525 raft_consensus.cc:2468] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 1.
W20260709 12:59:38.279711  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:38.283051  3629 raft_consensus.cc:2804] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:38.283242  3519 leader_election.cc:290] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:38.255511  3632 raft_consensus.cc:493] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:38.293860  3631 log.cc:927] Time spent T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:59:38.294466  3638 raft_consensus.cc:2804] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:38.294255  3632 raft_consensus.cc:515] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:38.277274  1527 raft_consensus.cc:2468] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 3.
I20260709 12:59:38.292439  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:38.297443  1525 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 5.
I20260709 12:59:38.293045  3630 raft_consensus.cc:493] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:38.073021  2218 rpcz_store.cc:276] 0709 12:59:34.595064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:34.596231 (+  1167us) service_pool.cc:224] Handling call
0709 12:59:34.601689 (+  5458us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:34.604640 (+  2951us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:59:37.620577 (+3015937us) log.cc:844] Serialized 14 byte log entry
0709 12:59:37.903941 (+283364us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:37.927357 (+ 23416us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:37.956290 (+ 28933us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:37.972279 (+ 15989us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:37.972742 (+   463us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":347583,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":108892,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":89,"thread_start_us":3291250,"threads_started":2,"wal-append.queue_time_us":314141}
W20260709 12:59:38.294497  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 3.67601e+06us
I20260709 12:59:38.298750  3482 raft_consensus.cc:493] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:38.299256  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:38.299540  1524 raft_consensus.cc:2468] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 8.
I20260709 12:59:38.301043  3627 raft_consensus.cc:2804] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:38.275571  3587 leader_election.cc:290] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:38.283555  3629 raft_consensus.cc:493] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 12:59:38.295854  3363 raft_consensus.cc:359] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 4 LEARNER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:59:38.302301  3508 leader_election.cc:290] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:38.245959  3635 raft_consensus.cc:515] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:38.276932  1676 raft_consensus.cc:1275] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:59:38.343266  1524 raft_consensus.cc:1275] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:59:38.344336  1524 pending_rounds.cc:85] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting all ops after (but not including) 3
I20260709 12:59:38.344579  1524 pending_rounds.cc:107] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:59:38.349783  1524 raft_consensus.cc:2889] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:38.283883  3639 raft_consensus.cc:2804] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:59:38.352105  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:38.374889  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:38.309249  3629 raft_consensus.cc:3060] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:38.376910  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:38.336031  3314 raft_consensus.cc:2804] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:38.384205  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:38.416442  1524 raft_consensus.cc:2468] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 3.
I20260709 12:59:38.351298  3271 raft_consensus.cc:2749] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303) with higher term. Message: Invalid argument: T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for earlier term 7. Current term is 8.
I20260709 12:59:38.380831  3511 raft_consensus.cc:493] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:38.386004  1570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:38.376360  1553 debug-util.cc:398] Leaking SignalData structure 0x7b0800394640 after lost signal to thread 1556
I20260709 12:59:38.431744  3637 raft_consensus.cc:493] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:38.432317  3637 raft_consensus.cc:515] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:38.430485  3511 raft_consensus.cc:515] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:38.435774  3511 leader_election.cc:290] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:38.387416  3649 raft_consensus.cc:493] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:38.376116  3363 raft_consensus.cc:886] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 4 LEARNER]: Ignoring setting pending config change with OpId 4.5 because the committed config has OpId index 5. The config change we are ignoring is: Old config: { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } }. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:59:38.439348  3363 raft_consensus.cc:740] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Initialized, Role: LEARNER
I20260709 12:59:38.439532  2221 raft_consensus.cc:1240] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:38.390475  3585 leader_election.cc:290] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:38.440165  3363 consensus_queue.cc:260] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:59:38.374132  3639 raft_consensus.cc:493] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:38.440887  3585 raft_consensus.cc:493] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:38.441339  3639 raft_consensus.cc:3060] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:38.446928  3649 raft_consensus.cc:515] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 12:59:38.404327  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:38.404678  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:38.307791  3482 raft_consensus.cc:515] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:38.308314  3630 raft_consensus.cc:515] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:38.426802  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
W20260709 12:59:38.427208  1603 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36200 (request call id 1713) took 4112 ms (client timeout 2242 ms). Trace:
W20260709 12:59:38.428314  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:38.430568  3642 raft_consensus.cc:3055] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:59:38.432725  1553 debug-util.cc:398] Leaking SignalData structure 0x7b08003ba900 after lost signal to thread 1631
I20260709 12:59:38.387017  3627 raft_consensus.cc:697] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 6 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:38.465459  1675 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e"
dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
mode: GRACEFUL
new_leader_uuid: "39a92f5a4352465d8af3af5908fe8642"
 from {username='slave'} at 127.0.0.1:33616
I20260709 12:59:38.466121  1675 raft_consensus.cc:606] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Received request to transfer leadership to TS 39a92f5a4352465d8af3af5908fe8642
I20260709 12:59:38.466470  1675 raft_consensus.cc:614] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:38.452544  1528 raft_consensus.cc:2468] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 4.
I20260709 12:59:38.459622  2192 leader_election.cc:304] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:38.461351  1530 raft_consensus.cc:3060] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:38.467180  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 220567us
I20260709 12:59:38.376289  3638 raft_consensus.cc:697] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 4 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
W20260709 12:59:38.468178  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 224838us
I20260709 12:59:38.462906  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 12:59:38.461315  1603 rpcz_store.cc:269] 0709 12:59:34.314530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:34.314732 (+   202us) service_pool.cc:224] Handling call
0709 12:59:38.427007 (+4112275us) spinlock_profiling.cc:243] Waited 148 ms on lock 0x7b54000db454. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 12:59:38.427136 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":340122880}
I20260709 12:59:38.462368  3642 raft_consensus.cc:740] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:38.464407  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:38.434520  3637 leader_election.cc:290] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:38.416229  3314 raft_consensus.cc:493] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:38.469532  1572 connection.cc:256] RPC call timeout handler was delayed by -1.7784318109999617s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19920000000000002s for a response
I20260709 12:59:38.469471  2191 leader_election.cc:304] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
W20260709 12:59:38.470618  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:38.465296  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36200 (request call id 1728) took 3944 ms. Trace:
I20260709 12:59:38.465000  3532 raft_consensus.cc:515] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:38.441422  3585 raft_consensus.cc:515] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:38.473771   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
W20260709 12:59:38.475257  3641 log.cc:927] Time spent T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:59:38.476398  3632 leader_election.cc:290] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:38.513303  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:38.514034  1529 raft_consensus.cc:2376] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 4. Re-sending same reply.
I20260709 12:59:38.477501  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:38.477227  3627 consensus_queue.cc:237] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:38.479557  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:38.481133  1526 raft_consensus.cc:2468] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 5.
I20260709 12:59:38.488718  3363 ts_tablet_manager.cc:1434] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b: Time spent starting tablet: real 0.472s	user 0.009s	sys 0.005s
I20260709 12:59:38.488099  1604 rpcz_store.cc:276] 0709 12:59:34.521273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:34.550439 (+ 29166us) service_pool.cc:224] Handling call
0709 12:59:37.984219 (+3433780us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:38.000469 (+ 16250us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:38.463210 (+462741us) spinlock_profiling.cc:243] Waited 3.43 s on lock 0x7b54002ec050. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b28ad 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 12:59:38.465220 (+  2010us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7896272768}
W20260709 12:59:38.488339  1644 connection.cc:256] RPC call timeout handler was delayed by -3.0102883269999552s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1886s for a response
I20260709 12:59:38.510412   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:38.468465  3635 leader_election.cc:290] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 12:59:38.484630  1572 connection.cc:256] RPC call timeout handler was delayed by -1.7676318109999443s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20040000000000002s for a response
I20260709 12:59:38.519127  1523 raft_consensus.cc:1275] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:59:38.491068  3314 raft_consensus.cc:3060] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:38.530105  1572 connection.cc:256] RPC call timeout handler was delayed by -1.7370318109999516s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20379999999999998s for a response
W20260709 12:59:38.534323  1572 connection.cc:256] RPC call timeout handler was delayed by -1.706431810999959s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20720000000000002s for a response
W20260709 12:59:38.534688  1572 connection.cc:256] RPC call timeout handler was delayed by -1.6155318109999826s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21730000000000002s for a response
W20260709 12:59:38.521842  1644 connection.cc:256] RPC call timeout handler was delayed by -2.7582883269999456s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21660000000000001s for a response
I20260709 12:59:38.537513  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 12:59:38.537786  1644 connection.cc:256] RPC call timeout handler was delayed by -2.6227311750000126s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1674s for a response
W20260709 12:59:38.538194  1644 connection.cc:256] RPC call timeout handler was delayed by -2.391424685000004s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1847s for a response
W20260709 12:59:38.538478  1644 connection.cc:256] RPC call timeout handler was delayed by -2.3774001959999964s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.28809999999999997s for a response
W20260709 12:59:38.525385  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 309668us
W20260709 12:59:38.543936  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 332195us
W20260709 12:59:38.539254  1644 connection.cc:256] RPC call timeout handler was delayed by -2.318614427s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1694s for a response
W20260709 12:59:38.545692  1644 connection.cc:256] RPC call timeout handler was delayed by -2.2846278630000256s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.32280000000000003s for a response
W20260709 12:59:38.546049  1644 connection.cc:256] RPC call timeout handler was delayed by -1.8895169040000042s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24070000000000003s for a response
W20260709 12:59:38.546337  1644 connection.cc:256] RPC call timeout handler was delayed by -1.8799400679999962s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21440000000000003s for a response
W20260709 12:59:38.546609  1644 connection.cc:256] RPC call timeout handler was delayed by -1.7953412699999944s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2802s for a response
I20260709 12:59:38.482513  3643 raft_consensus.cc:493] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:38.514742  3649 leader_election.cc:290] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:38.526782  3532 leader_election.cc:290] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:38.571617  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:38.555532  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:38.556073  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:38.556113  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:38.555442  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:38.556806  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:38.563422  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:38.564190  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
W20260709 12:59:38.555490  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 95965.4us
I20260709 12:59:38.556516  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 12:59:38.533730  1553 debug-util.cc:398] Leaking SignalData structure 0x7b08003394a0 after lost signal to thread 1705
I20260709 12:59:38.518317  3520 raft_consensus.cc:2749] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:59:38.569443  1572 leader_election.cc:304] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
W20260709 12:59:38.571203  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 75325.8us
I20260709 12:59:38.574244  1605 raft_consensus.cc:3060] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:38.574767  1599 raft_consensus.cc:2468] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 4.
I20260709 12:59:38.573087  1674 raft_consensus.cc:2468] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 3.
I20260709 12:59:38.591981  1646 leader_election.cc:304] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 12:59:38.521234  3363 ts_tablet_manager.cc:1467] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b: Tablet startup took 504ms
W20260709 12:59:38.603574  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 64466.7us
I20260709 12:59:38.604800  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:38.605535  1523 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 5.
W20260709 12:59:38.603190  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 133816us
I20260709 12:59:38.607065  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:38.582896  3634 raft_consensus.cc:2804] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:38.608099  1572 leader_election.cc:304] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:38.610291  1572 leader_election.cc:304] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:38.568379  3301 raft_consensus.cc:493] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:38.615615  2191 leader_election.cc:304] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:38.614517  1605 raft_consensus.cc:2468] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 4.
I20260709 12:59:38.614881  3649 raft_consensus.cc:2804] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:38.623508  2190 leader_election.cc:304] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:38.625219  2191 leader_election.cc:304] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:38.625283  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:38.626868  2190 leader_election.cc:304] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:38.627027  2192 leader_election.cc:304] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:38.629655  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:38.616164  3599 raft_consensus.cc:3060] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:38.630342  1523 raft_consensus.cc:2468] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 1.
I20260709 12:59:38.609565  3634 raft_consensus.cc:493] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:38.600775  3404 raft_consensus.cc:515] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:38.616962  3635 raft_consensus.cc:2749] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:59:38.628516  1553 debug-util.cc:398] Leaking SignalData structure 0x7b080031af20 after lost signal to thread 2251
I20260709 12:59:38.627301  3649 raft_consensus.cc:697] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 4 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:38.602104  3639 raft_consensus.cc:515] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:38.607182  3652 consensus_queue.cc:1048] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 12:59:38.648214  3640 raft_consensus.cc:2749] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:59:38.649191  1674 raft_consensus.cc:1275] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:59:38.650022  3659 log.cc:927] Time spent T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.065s	user 0.000s	sys 0.007s
I20260709 12:59:38.650400  3482 leader_election.cc:290] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:38.678947  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:38.679505  3652 raft_consensus.cc:2804] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:38.679956  3652 raft_consensus.cc:493] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:38.630038  3520 raft_consensus.cc:2804] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:38.583647  3643 raft_consensus.cc:515] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:38.600705  3642 consensus_queue.cc:260] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:59:38.666990  3585 leader_election.cc:290] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:38.666726  3656 raft_consensus.cc:2804] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:38.667773  1646 leader_election.cc:304] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:38.698367  3656 raft_consensus.cc:493] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:38.698783  3656 raft_consensus.cc:3060] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:38.700734  1646 leader_election.cc:304] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:38.668278  3651 raft_consensus.cc:2804] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:38.705068  3651 raft_consensus.cc:493] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:38.705488  3651 raft_consensus.cc:3060] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:38.707935  3271 raft_consensus.cc:2804] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:38.708406  3656 raft_consensus.cc:515] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:38.670302  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:38.670636  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:38.643163  3634 raft_consensus.cc:3060] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:38.671274  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:38.673372  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:38.597752  3638 consensus_queue.cc:237] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:38.621281  3301 raft_consensus.cc:515] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:38.687229  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:38.692260  3520 raft_consensus.cc:493] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:38.692134  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:38.693675  1496 leader_election.cc:304] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
W20260709 12:59:38.742110  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 48533.4us
I20260709 12:59:38.708359  3271 raft_consensus.cc:493] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
W20260709 12:59:38.670637  3348 consensus_meta.cc:287] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.526s	user 0.010s	sys 0.000s
I20260709 12:59:38.666887  3653 raft_consensus.cc:2804] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:38.704522  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:38.711108  1529 raft_consensus.cc:2393] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 6: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 12:59:38.713644  1571 leader_election.cc:304] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
W20260709 12:59:38.722388  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 92843.2us
I20260709 12:59:38.680373  3652 raft_consensus.cc:3060] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:38.711329  1523 raft_consensus.cc:2376] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 8. Re-sending same reply.
I20260709 12:59:38.710817  3482 raft_consensus.cc:2804] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:59:38.733682  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 102099us
I20260709 12:59:38.688482  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:38.746464  1676 raft_consensus.cc:3060] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:38.751564  1674 raft_consensus.cc:2468] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 4.
I20260709 12:59:38.700973  3404 leader_election.cc:290] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 5 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:38.691188  3649 consensus_queue.cc:237] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 12:59:38.601414  3363 ts_tablet_manager.cc:1469] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b: Trace:
0709 12:59:26.651737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:26.652464 (+   727us) service_pool.cc:224] Handling call
0709 12:59:27.714973 (+1062509us) spinlock_profiling.cc:243] Waited 2.8 ms on lock 0x7b5800015c98. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a1548eb71 00007f6a1548f1a2 00007f6a1e3d0bb9 00007f6a1d501d88 00007f6a1d5c5a07 00007f6a1d5f7f4e 00007f6a1d5dcfdd 00007f6a1d5dcf89 00007f6a1d5dcf19 00007f6a1d5dcee1
0709 12:59:27.743633 (+ 28660us) ts_tablet_manager.cc:934] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b: Initiating tablet copy from peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
0709 12:59:30.505772 (+2762139us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:59:31.294545 (+788773us) tablet_metadata.cc:665] Metadata flushed
0709 12:59:31.319029 (+ 24484us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:59:31.739872 (+420843us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:59:31.740151 (+   279us) tablet_replica.cc:206] Creating consensus instance
0709 12:59:32.594159 (+854008us) ts_tablet_manager.cc:989] Replica registered.
0709 12:59:32.595133 (+   974us) inbound_call.cc:177] Queueing success response
0709 12:59:32.999517 (+404384us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:59:38.016791 (+5017274us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:59:38.211591 (+194800us) tablet_replica.cc:261] Starting instrumentation
0709 12:59:38.212272 (+   681us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":39251,"mutex_wait_us":19156,"raft.queue_time_us":312,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":8942,"spinlock_wait_cycles":6444928,"tablet-copy.queue_time_us":375008,"tablet-download-pool.queue_time_us":162,"tablet-download-pool.run_cpu_time_us":2565,"tablet-download-pool.run_wall_time_us":97902,"thread_start_us":397927,"threads_started":2}
I20260709 12:59:38.746527  3511 raft_consensus.cc:2804] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:38.715837  3489 consensus_queue.cc:1048] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 12:59:38.694751  1530 raft_consensus.cc:2468] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 4.
I20260709 12:59:38.680014  3655 consensus_queue.cc:1059] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 12:59:38.749513  3271 raft_consensus.cc:3060] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:38.710623  3656 leader_election.cc:290] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 5 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:38.761345  3511 raft_consensus.cc:493] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:38.752722  3482 raft_consensus.cc:493] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
W20260709 12:59:38.754839  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 52962us
I20260709 12:59:38.743257  3520 raft_consensus.cc:3060] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:38.751724  2192 leader_election.cc:304] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
W20260709 12:59:38.757081  1495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:38.751499  3653 raft_consensus.cc:493] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:38.791090  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:38.792320  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:38.792896  1526 raft_consensus.cc:2376] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 4. Re-sending same reply.
I20260709 12:59:38.793747  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:38.794209  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:38.794826  1532 raft_consensus.cc:2376] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 4. Re-sending same reply.
I20260709 12:59:38.759111  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:38.746891  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:38.796286  1528 raft_consensus.cc:2393] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 4: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 12:59:38.763361  3648 consensus_queue.cc:1048] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 12:59:38.766301  3301 leader_election.cc:290] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:38.797333  3301 consensus_queue.cc:1048] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:38.765993  3646 consensus_queue.cc:1048] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 12:59:38.754559  3635 raft_consensus.cc:2804] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:38.799271  3635 raft_consensus.cc:493] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:38.799726  3635 raft_consensus.cc:3060] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:38.769480  3643 leader_election.cc:290] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:38.794342  1526 raft_consensus.cc:2468] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 5.
I20260709 12:59:38.804976  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:38.805653  1524 raft_consensus.cc:2376] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 5. Re-sending same reply.
I20260709 12:59:38.811120  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:38.824286  3635 raft_consensus.cc:515] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:38.827790  1497 leader_election.cc:304] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:38.787932  3511 raft_consensus.cc:3060] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:38.752379  3348 raft_consensus.cc:515] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:38.789093  3653 raft_consensus.cc:3060] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:59:38.833710  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 205633us
I20260709 12:59:38.788784  3482 raft_consensus.cc:3060] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:38.836462  1570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:38.836174  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 46537.2us
W20260709 12:59:38.835011  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 85523.3us
I20260709 12:59:38.842020  1676 raft_consensus.cc:2468] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 5.
W20260709 12:59:38.852955  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 228954us
I20260709 12:59:38.853916  2191 leader_election.cc:304] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:38.845863  3599 raft_consensus.cc:2749] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:38.838404  3656 raft_consensus.cc:2749] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:38.838060  3519 consensus_queue.cc:1059] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
W20260709 12:59:38.908603  1570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:38.918249  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 44472.5us
W20260709 12:59:38.873992  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 122335us
I20260709 12:59:38.867877  2190 leader_election.cc:304] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:38.899757  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 12:59:38.907791  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:38.898277  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:38.913582  1526 raft_consensus.cc:1275] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:59:38.875201  2191 leader_election.cc:304] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:38.957084  2192 leader_election.cc:304] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:38.957732  1527 raft_consensus.cc:2410] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:59:38.962287  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 12:59:38.961704  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 86589.3us
I20260709 12:59:38.915716  1644 leader_election.cc:304] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
W20260709 12:59:38.965220  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 49593.6us
W20260709 12:59:38.970571  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 102767us
I20260709 12:59:38.970966  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:38.971520  2190 leader_election.cc:304] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:38.971764  1675 raft_consensus.cc:2393] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 5: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 12:59:38.972862  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:38.869220  3632 raft_consensus.cc:2804] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:38.976593  2190 leader_election.cc:304] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:38.896123  3348 leader_election.cc:290] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:38.874020  3532 raft_consensus.cc:493] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:38.893172  3667 consensus_queue.cc:1048] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.151s
I20260709 12:59:38.959095  3652 raft_consensus.cc:515] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:39.008029  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:38.922168  3635 leader_election.cc:290] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:38.907667  3671 raft_consensus.cc:2804] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:59:39.045069  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 88078.5us
I20260709 12:59:38.916301  3301 consensus_queue.cc:1048] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.093s
I20260709 12:59:38.900403  3634 raft_consensus.cc:515] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:39.046115  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:38.962857  3639 leader_election.cc:290] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:38.914256  3633 raft_consensus.cc:493] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:38.977188  3599 raft_consensus.cc:2804] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:59:38.979523  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 151801us
I20260709 12:59:38.917531  3520 raft_consensus.cc:515] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:39.053762  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
W20260709 12:59:39.062491  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:38.889039  3629 raft_consensus.cc:515] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 12:59:39.055341  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 78827.2us
I20260709 12:59:38.980469  3632 raft_consensus.cc:493] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:39.047066  3640 raft_consensus.cc:2804] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:38.981001  3655 raft_consensus.cc:2804] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:38.904008  3314 raft_consensus.cc:515] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:38.972275  3665 raft_consensus.cc:2749] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:59:39.079759  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:39.082026  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 103142us
I20260709 12:59:38.969342  3651 raft_consensus.cc:515] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:39.075755  3661 raft_consensus.cc:2804] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:39.082731  3671 raft_consensus.cc:493] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:39.107949  1497 leader_election.cc:304] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:39.128325  1644 leader_election.cc:304] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:39.107338  2190 leader_election.cc:304] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
W20260709 12:59:39.127913  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 83976.2us
I20260709 12:59:39.137831  3629 leader_election.cc:290] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 2 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:39.087513  3644 raft_consensus.cc:493] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:39.139377  3644 raft_consensus.cc:515] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:59:39.141798  3644 leader_election.cc:290] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:39.138167  3511 raft_consensus.cc:515] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:39.144495  3511 leader_election.cc:290] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:39.080485  3532 raft_consensus.cc:515] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:39.147186  1571 leader_election.cc:304] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:39.088281  3599 raft_consensus.cc:493] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:39.109383  3632 raft_consensus.cc:3060] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:39.110644  3655 raft_consensus.cc:493] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:39.110019  3640 raft_consensus.cc:493] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:39.153570  1571 leader_election.cc:304] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:39.156004  1674 raft_consensus.cc:1275] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:59:39.130787  3661 raft_consensus.cc:493] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:39.161525  3661 raft_consensus.cc:3060] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:39.163218  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 77285.6us
I20260709 12:59:39.106846  3633 raft_consensus.cc:515] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:39.135545  3671 raft_consensus.cc:3060] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:39.169445  1644 leader_election.cc:304] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
W20260709 12:59:39.166864  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 59030.1us
I20260709 12:59:39.149648  3656 raft_consensus.cc:2804] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:59:39.166824  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 59571.2us
I20260709 12:59:39.173811  3656 raft_consensus.cc:493] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:39.174818  1497 leader_election.cc:304] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:39.175525  1690 tablet_copy_service.cc:342] P ddf11fc190dd4b898773379c6b129d90: Request end of tablet copy session b96ce9cc496c49d7818fa983a17b062b-04fed4c219e14efb9f9a8eb0d336ceac received from {username='slave'} at 127.0.0.1:50664
I20260709 12:59:39.175697  3489 consensus_queue.cc:1048] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:39.176196  1690 tablet_copy_service.cc:434] P ddf11fc190dd4b898773379c6b129d90: ending tablet copy session b96ce9cc496c49d7818fa983a17b062b-04fed4c219e14efb9f9a8eb0d336ceac on tablet 04fed4c219e14efb9f9a8eb0d336ceac with peer b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:39.176295  3352 tablet_copy_client.cc:538] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:39.174378  3656 raft_consensus.cc:3060] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:39.156762  3665 raft_consensus.cc:2804] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:39.174355  2190 leader_election.cc:304] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:39.152700  3599 raft_consensus.cc:3060] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:59:39.157649  1553 debug-util.cc:398] Leaking SignalData structure 0x7b08003d5280 after lost signal to thread 3502
I20260709 12:59:39.189798  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 12:59:39.186117  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 218648us
I20260709 12:59:39.157318  3655 raft_consensus.cc:3060] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:39.165649  3635 raft_consensus.cc:2804] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:39.166364  3640 raft_consensus.cc:3060] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:39.168866  3652 leader_election.cc:290] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 3 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:39.215157  3652 raft_consensus.cc:2804] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:39.215543  3652 raft_consensus.cc:493] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:39.215862  3652 raft_consensus.cc:3060] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:39.217571  1604 raft_consensus.cc:1275] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:59:39.218616  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:39.218988  3688 raft_consensus.cc:2804] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:39.211139  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:39.219506  3688 raft_consensus.cc:493] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:39.211745  3520 leader_election.cc:290] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 3 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:39.166005  3673 raft_consensus.cc:2749] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:39.212270  3686 consensus_queue.cc:1048] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:39.215780  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:39.165534  3633 leader_election.cc:290] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:39.187230  3647 raft_consensus.cc:2804] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:39.185353  3676 raft_consensus.cc:2764] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:59:39.228235  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 12:59:39.228603  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 59249.8us
I20260709 12:59:39.233050  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:39.238579  1644 leader_election.cc:304] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:39.206928  3635 raft_consensus.cc:493] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:39.238643  1606 raft_consensus.cc:2468] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 3.
I20260709 12:59:39.275687  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
W20260709 12:59:39.276150  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 48390.7us
I20260709 12:59:39.275594  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:39.275287  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:39.220101  3314 leader_election.cc:290] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:39.276806  3635 raft_consensus.cc:3060] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:39.221571  3688 raft_consensus.cc:3060] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:39.243621  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 68953.7us
W20260709 12:59:39.285465  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 111206us
I20260709 12:59:39.185549  3653 raft_consensus.cc:515] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 12:59:39.289985  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 51513us
I20260709 12:59:39.228838  3646 raft_consensus.cc:493] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:39.277060  3667 raft_consensus.cc:2804] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:39.297158  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:39.242987  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:39.276947  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:39.298914  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:39.299486  1528 raft_consensus.cc:3060] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:39.300330  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:39.302342  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:39.302901  1524 raft_consensus.cc:3060] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:39.304740  2192 leader_election.cc:304] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:39.287168  3639 raft_consensus.cc:493] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:39.311267  1497 leader_election.cc:304] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:39.277330  3647 raft_consensus.cc:697] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 5 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:39.307684  3678 consensus_queue.cc:1048] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 12:59:39.308620  3634 leader_election.cc:290] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 6 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:39.309275  3651 leader_election.cc:290] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 5 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:39.293759  3644 raft_consensus.cc:493] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:39.223582  3636 consensus_queue.cc:1048] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.095s
I20260709 12:59:39.246924  3599 raft_consensus.cc:515] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:39.365038  3404 raft_consensus.cc:3055] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:39.368005  3532 leader_election.cc:290] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:39.368606  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:39.369612  3647 consensus_queue.cc:237] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:39.371649  1603 raft_consensus.cc:1240] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:39.299338  3667 raft_consensus.cc:493] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:39.361436  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:39.319947  3673 raft_consensus.cc:2764] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:59:39.310781  3679 consensus_queue.cc:1048] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.137s
I20260709 12:59:39.311405  3681 raft_consensus.cc:2804] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:39.399575  3644 raft_consensus.cc:515] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:39.300015  3646 raft_consensus.cc:515] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:39.411371  1677 raft_consensus.cc:2393] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 3: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 12:59:39.400456  3404 raft_consensus.cc:740] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 12:59:39.424010  3630 leader_election.cc:290] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 12:59:39.428066  3682 log.cc:927] Time spent T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.197s	user 0.000s	sys 0.001s
I20260709 12:59:39.412199  1646 leader_election.cc:304] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:39.426880  3634 raft_consensus.cc:2804] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:59:39.440526  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 129352us
I20260709 12:59:39.366209  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:39.236769  3648 consensus_queue.cc:1048] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.070s
I20260709 12:59:39.372330  3489 consensus_queue.cc:1059] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 12:59:39.412844  3667 raft_consensus.cc:3060] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:39.360785  3639 raft_consensus.cc:515] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 12:59:39.469937  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 165263us
I20260709 12:59:39.482334  1528 raft_consensus.cc:2468] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 5.
I20260709 12:59:39.482949  1523 raft_consensus.cc:2468] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 4.
I20260709 12:59:39.487741  1531 raft_consensus.cc:3060] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:59:39.441332  3681 raft_consensus.cc:493] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:39.497611  1497 leader_election.cc:304] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:39.499084  3404 consensus_queue.cc:260] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:39.500447  3404 raft_consensus.cc:3060] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:39.500731  3657 raft_consensus.cc:3055] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:39.501191  3657 raft_consensus.cc:740] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:39.508550  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:39.481154  3634 raft_consensus.cc:493] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:39.502604  3352 tablet_bootstrap.cc:492] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap starting.
I20260709 12:59:39.509298  1675 raft_consensus.cc:2468] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 4.
I20260709 12:59:39.481570  3630 raft_consensus.cc:493] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:39.515713  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:39.516289  1528 raft_consensus.cc:3060] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:59:39.518860  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 144918us
I20260709 12:59:39.522003  1646 leader_election.cc:304] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:39.524722   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:39.489843  3663 raft_consensus.cc:2749] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:39.535161  1646 leader_election.cc:304] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:39.543834  1528 raft_consensus.cc:2468] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 5.
I20260709 12:59:39.500380  3646 leader_election.cc:290] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:39.503896  3681 raft_consensus.cc:3060] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:39.550166  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:39.546010  1674 raft_consensus.cc:1275] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:59:39.553534  1524 raft_consensus.cc:2468] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 3.
I20260709 12:59:39.518577  3634 raft_consensus.cc:3060] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:39.502126  3657 consensus_queue.cc:260] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:59:39.515508  3665 raft_consensus.cc:697] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 2 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 12:59:39.518625  3633 raft_consensus.cc:2749] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:59:39.557955  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:39.569880  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
W20260709 12:59:39.559191  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 61710.1us
I20260709 12:59:39.563345  3683 raft_consensus.cc:2804] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:39.567003  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 12:59:39.580155  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 287582us
I20260709 12:59:39.611151  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:39.615468  1603 raft_consensus.cc:3060] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:39.555400  3643 raft_consensus.cc:2804] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:39.637099  1532 raft_consensus.cc:2468] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 4.
W20260709 12:59:39.638283  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 109929us
I20260709 12:59:39.530998  3489 consensus_queue.cc:1048] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 12:59:39.639083  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:39.639672  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:39.532092  3630 raft_consensus.cc:515] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:39.639305  2190 leader_election.cc:304] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 12:59:39.559026  3599 leader_election.cc:290] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 12:59:39.636337  3271 consensus_meta.cc:287] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.846s	user 0.015s	sys 0.000s
I20260709 12:59:39.642020  1525 raft_consensus.cc:2376] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 5. Re-sending same reply.
W20260709 12:59:39.568223  3482 consensus_meta.cc:287] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.694s	user 0.011s	sys 0.003s
I20260709 12:59:39.610498  3651 raft_consensus.cc:493] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:39.649637  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:39.639784  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:39.639437  3643 raft_consensus.cc:493] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:39.658167  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:39.643767  3683 raft_consensus.cc:697] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 4 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:39.707464  3635 raft_consensus.cc:515] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:39.657397  3482 raft_consensus.cc:515] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:39.977661  1604 raft_consensus.cc:2393] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 5: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 12:59:39.675136  1603 raft_consensus.cc:2468] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 4.
I20260709 12:59:39.936573  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:39.701066  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:39.935861  2190 leader_election.cc:304] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:39.935765  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
W20260709 12:59:39.774994  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 115679us
I20260709 12:59:39.645833  3633 raft_consensus.cc:493] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:39.696676  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:39.665869  1497 leader_election.cc:304] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:39.935345  2191 leader_election.cc:304] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:39.701613  1531 raft_consensus.cc:2468] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 6.
I20260709 12:59:39.699517  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 12:59:39.726452  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:39.974431  1646 connection.cc:256] RPC call timeout handler was delayed by -3.4507557370000086s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1674s for a response
W20260709 12:59:39.987061  1646 connection.cc:256] RPC call timeout handler was delayed by -3.2950557369999842s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1847s for a response
W20260709 12:59:39.696035  3700 log.cc:927] Time spent T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 12:59:39.987442  1646 connection.cc:256] RPC call timeout handler was delayed by -3.0097557369999777s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21640000000000004s for a response
W20260709 12:59:39.989079  1646 connection.cc:256] RPC call timeout handler was delayed by -1.9828557370000226s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3305s for a response
W20260709 12:59:39.665154  3691 log.cc:927] Time spent T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.173s	user 0.000s	sys 0.001s
W20260709 12:59:39.662807  3684 log.cc:927] Time spent T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
W20260709 12:59:39.708087  3661 consensus_meta.cc:287] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b: Time spent flushing consensus metadata: real 0.546s	user 0.004s	sys 0.010s
W20260709 12:59:39.985517  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 49836.6us
W20260709 12:59:39.694146  3656 consensus_meta.cc:287] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b: Time spent flushing consensus metadata: real 0.516s	user 0.008s	sys 0.001s
I20260709 12:59:39.990140  1646 leader_election.cc:304] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:39.988174  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:40.000367  1675 raft_consensus.cc:3060] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:59:39.688657  3671 consensus_meta.cc:287] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b: Time spent flushing consensus metadata: real 0.514s	user 0.005s	sys 0.008s
W20260709 12:59:39.690879  3701 log.cc:927] Time spent T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 12:59:39.993122  1673 raft_consensus.cc:2393] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 4: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 12:59:39.825654  3676 raft_consensus.cc:493] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:39.982486  3652 consensus_meta.cc:287] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b: Time spent flushing consensus metadata: real 0.766s	user 0.013s	sys 0.007s
I20260709 12:59:39.996407  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:39.982364  3657 raft_consensus.cc:3060] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:39.936997  3644 leader_election.cc:290] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:39.708292  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:39.998545  2190 leader_election.cc:304] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:39.800822  3489 raft_consensus.cc:493] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:39.980095  3643 raft_consensus.cc:3060] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:40.001426  1646 leader_election.cc:304] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:39.663121  3695 raft_consensus.cc:2804] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:39.985188  3653 leader_election.cc:290] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:39.653582  3271 raft_consensus.cc:515] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:39.658325  3651 raft_consensus.cc:515] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 12:59:40.014122  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:39.695156  3665 consensus_queue.cc:237] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:40.033154  3634 raft_consensus.cc:515] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 12:59:40.047094  3688 consensus_meta.cc:287] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent flushing consensus metadata: real 0.751s	user 0.008s	sys 0.000s
I20260709 12:59:40.047891  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:40.038836  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:40.020113  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 12:59:39.669525  3655 raft_consensus.cc:515] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:40.007573  3679 raft_consensus.cc:2804] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:39.990177  3633 raft_consensus.cc:515] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:40.027148  3693 raft_consensus.cc:2804] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:59:40.030928  3404 consensus_meta.cc:287] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b: Time spent flushing consensus metadata: real 0.524s	user 0.008s	sys 0.000s
W20260709 12:59:40.031250  3632 consensus_meta.cc:287] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent flushing consensus metadata: real 0.862s	user 0.006s	sys 0.003s
I20260709 12:59:40.011828  3676 raft_consensus.cc:515] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:40.011672  3652 raft_consensus.cc:515] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:40.038249  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:40.040920  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:40.039108  3520 raft_consensus.cc:2804] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:59:40.070602  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 135366us
I20260709 12:59:39.691643  3640 raft_consensus.cc:515] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:40.062875  2223 raft_consensus.cc:2393] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 4: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 12:59:40.025878  3650 raft_consensus.cc:2749] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:40.064807  3634 leader_election.cc:290] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 4 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:40.067492  3679 raft_consensus.cc:493] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:40.067718  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 12:59:40.009639  3671 raft_consensus.cc:515] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:39.999040  3681 raft_consensus.cc:515] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:40.002905  3656 raft_consensus.cc:515] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:40.071606  3683 consensus_queue.cc:237] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:40.094913  3656 leader_election.cc:290] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 5 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:40.095033  3635 leader_election.cc:290] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:40.002372  3661 raft_consensus.cc:515] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:40.030929  3697 raft_consensus.cc:2749] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:59:40.079254  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 12:59:40.069310  1678 raft_consensus.cc:3060] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:40.012773  3703 consensus_queue.cc:1048] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.058s
I20260709 12:59:40.090868  2222 raft_consensus.cc:2393] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 5: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 12:59:40.092396  3681 leader_election.cc:290] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:40.100215  1675 raft_consensus.cc:2468] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 3.
I20260709 12:59:40.021756  3489 raft_consensus.cc:515] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:40.071166  3632 raft_consensus.cc:515] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:40.082067  3679 raft_consensus.cc:3060] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:40.072922  3693 raft_consensus.cc:697] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 5 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 12:59:40.109730  2224 raft_consensus.cc:2393] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 5: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 12:59:40.065443  3688 raft_consensus.cc:515] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:40.110703  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 12:59:40.110975  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 445237us
I20260709 12:59:40.080471  3520 raft_consensus.cc:697] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 3 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
W20260709 12:59:40.112509  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 69475.4us
I20260709 12:59:40.104760  3633 leader_election.cc:290] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:40.080215  2219 raft_consensus.cc:2468] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 3.
I20260709 12:59:40.115592  2191 leader_election.cc:304] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
W20260709 12:59:40.115278  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 116842us
I20260709 12:59:40.122630  1674 raft_consensus.cc:2468] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 5.
W20260709 12:59:40.125942  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:40.139237  1497 leader_election.cc:304] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
W20260709 12:59:40.117383  3706 log.cc:927] Time spent T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 12:59:40.191908  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 76399.5us
I20260709 12:59:40.192682  2191 leader_election.cc:304] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:40.135200  2226 raft_consensus.cc:1240] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:40.188854  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 12:59:40.497958  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:40.355674  1531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49310 (request call id 349) took 1060 ms. Trace:
W20260709 12:59:40.411437  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:40.479272  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 407) took 1266 ms. Trace:
W20260709 12:59:40.570987  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 377259us
W20260709 12:59:40.235016  1644 leader_election.cc:336] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.686s (SENT)
I20260709 12:59:40.390643  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
W20260709 12:59:40.576869  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 437728us
I20260709 12:59:40.582307  1497 leader_election.cc:304] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:40.439034  1677 raft_consensus.cc:1240] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 3. Current term is 4. Ops: []
W20260709 12:59:40.580470  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:40.571260  1678 raft_consensus.cc:2468] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 4.
I20260709 12:59:40.583917  1497 leader_election.cc:304] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
W20260709 12:59:40.571957  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:40.581049  1605 rpcz_store.cc:276] 0709 12:59:39.212986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:39.215540 (+  2554us) service_pool.cc:224] Handling call
0709 12:59:40.479067 (+1263527us) spinlock_profiling.cc:243] Waited 671 ms on lock 0x7b54000db454. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 12:59:40.479185 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1542489984}
W20260709 12:59:40.577133  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 384541us
I20260709 12:59:40.438611  1673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49170 (request call id 1600) took 1459 ms. Trace:
I20260709 12:59:40.588032  1673 rpcz_store.cc:276] 0709 12:59:38.978922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:39.045669 (+ 66747us) service_pool.cc:224] Handling call
0709 12:59:40.438334 (+1392665us) spinlock_profiling.cc:243] Waited 887 ms on lock 0x7b54002558d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 12:59:40.438507 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2040574848}
W20260709 12:59:40.584028  1678 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49170 (request call id 1602) took 1357 ms (client timeout 1563 ms). Trace:
I20260709 12:59:40.188397  1646 leader_election.cc:304] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
W20260709 12:59:40.119948  3667 consensus_meta.cc:287] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.604s	user 0.001s	sys 0.007s
W20260709 12:59:40.591920  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 403626us
I20260709 12:59:40.596227  1497 leader_election.cc:304] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:40.580327  1531 rpcz_store.cc:276] 0709 12:59:39.295696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:39.311804 (+ 16108us) service_pool.cc:224] Handling call
0709 12:59:40.355487 (+1043683us) spinlock_profiling.cc:243] Waited 87.6 ms on lock 0x7b54001ff9d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 12:59:40.355609 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":201390976}
W20260709 12:59:40.590626  1678 rpcz_store.cc:269] 0709 12:59:39.227005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:39.233715 (+  6710us) service_pool.cc:224] Handling call
0709 12:59:40.037981 (+804266us) spinlock_profiling.cc:243] Waited 3.31 ms on lock 0x7b5800143798. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a1548eb71 00007f6a1548ea22 00007f6a1e3a7c09 00007f6a1d501ee0 00007f6a1d5cb0ab 00007f6a1d5cb131 00007f6a1d5790a0 00007f6a1d578984 00007f6a16af36d4 00007f6a16af3662
0709 12:59:40.583966 (+545985us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7613312}
W20260709 12:59:40.598901  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:40.577874  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 227724us
I20260709 12:59:40.375775  1571 leader_election.cc:304] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
W20260709 12:59:40.600289  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 224599us
W20260709 12:59:40.593138  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 358178us
I20260709 12:59:40.595053  1572 leader_election.cc:304] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:40.120249  2218 raft_consensus.cc:2393] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 5: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 12:59:40.606777  2225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50310 (request call id 481) took 1038 ms. Trace:
I20260709 12:59:40.603018  1527 raft_consensus.cc:1240] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:40.608299  2225 rpcz_store.cc:276] 0709 12:59:39.568493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:39.568626 (+   133us) service_pool.cc:224] Handling call
0709 12:59:40.188704 (+620078us) spinlock_profiling.cc:243] Waited 6.77 ms on lock 0x7b5800015c98. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a1548eb71 00007f6a1548ea22 00007f6a1e3a7c09 00007f6a1d501ee0 00007f6a1d5cb0ab 00007f6a1d5cb131 00007f6a1d5790a0 00007f6a1d578984 00007f6a16af36d4 00007f6a16af3662
0709 12:59:40.606701 (+417997us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15559552}
W20260709 12:59:40.517004  3657 consensus_meta.cc:287] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.504s	user 0.009s	sys 0.000s
I20260709 12:59:40.611694  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:40.300470  1430 catalog_manager.cc:5697] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 1 to 4, leader changed from ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) to 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194). New cstate: current_term: 4 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:40.612860  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:40.169410  3648 raft_consensus.cc:493] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:40.617821  3648 raft_consensus.cc:515] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:40.618290  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 12:59:40.617924  1430 catalog_manager.cc:5697] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 2 to 5, leader changed from ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) to 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194). New cstate: current_term: 5 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:40.618932  2223 raft_consensus.cc:3060] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:40.118803  3489 leader_election.cc:290] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:40.622316  1527 raft_consensus.cc:1240] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:40.124516  3708 raft_consensus.cc:493] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:40.230299  3703 raft_consensus.cc:2804] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:40.596745  3705 raft_consensus.cc:2749] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:40.571213  3642 raft_consensus.cc:3060] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:59:40.623037  1570 leader_election.cc:336] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.584s (SENT)
I20260709 12:59:40.633469  1570 leader_election.cc:304] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:40.123392  3482 leader_election.cc:290] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:40.624022  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 12:59:40.355012  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:40.228457  3629 raft_consensus.cc:2749] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:59:40.601655  3519 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.627s	user 0.015s	sys 0.018s
I20260709 12:59:40.528008  3655 leader_election.cc:290] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 5 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:40.548120  3639 leader_election.cc:290] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:40.350292  3695 raft_consensus.cc:697] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 5 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 12:59:40.308648  3688 leader_election.cc:290] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:40.299172  3651 leader_election.cc:290] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:40.312716  3640 leader_election.cc:290] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 4 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:40.610392  3585 raft_consensus.cc:2804] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:40.371109  3271 leader_election.cc:290] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:40.594300  3661 leader_election.cc:290] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 4 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:40.390306  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
W20260709 12:59:40.611811  3650 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.510s	user 0.024s	sys 0.037s
I20260709 12:59:40.441673  3673 raft_consensus.cc:493] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:40.124420  3710 raft_consensus.cc:2804] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:40.619971  1430 catalog_manager.cc:5697] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 2 to 4, leader changed from e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) to b96ce9cc496c49d7818fa983a17b062b (127.0.107.196). New cstate: current_term: 4 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:40.591643  3633 raft_consensus.cc:2749] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:40.620003  3648 leader_election.cc:290] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:40.610356  3660 raft_consensus.cc:493] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:40.626922  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:40.626905  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:40.307504  3671 leader_election.cc:290] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 5 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:40.596922  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 12:59:40.607179  3663 raft_consensus.cc:2804] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:40.636488  2224 raft_consensus.cc:2393] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 4: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 12:59:40.636858  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 12:59:40.624944  3690 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.017s	sys 0.050s
W20260709 12:59:40.646924  3519 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.675s	user 0.015s	sys 0.019s
I20260709 12:59:40.481048  3679 raft_consensus.cc:515] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:40.188887  3693 consensus_queue.cc:237] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:40.547679  3643 raft_consensus.cc:515] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:40.627027  3703 raft_consensus.cc:493] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:40.624202  3704 raft_consensus.cc:493] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 12:59:40.620878  3314 consensus_queue.cc:1048] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 12:59:40.612082  3667 raft_consensus.cc:515] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:40.733162  2227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50310 (request call id 487) took 1020 ms. Trace:
I20260709 12:59:40.852761  1677 raft_consensus.cc:2393] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 4: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 12:59:40.761032  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:40.845618  1673 raft_consensus.cc:3060] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:40.710068  1496 leader_election.cc:304] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:40.677953  2223 raft_consensus.cc:2468] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 5.
I20260709 12:59:40.760905  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:40.649005  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:40.698644  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
W20260709 12:59:40.855065  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 145088us
I20260709 12:59:40.856995  1525 raft_consensus.cc:3060] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:40.853719  1526 raft_consensus.cc:3060] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:40.858946  2226 raft_consensus.cc:1240] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:40.624884  3630 leader_election.cc:290] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 12:59:40.886353  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 301266us
I20260709 12:59:40.672577  2221 raft_consensus.cc:2393] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 6: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 12:59:40.890915  1497 leader_election.cc:304] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:40.852998  2227 rpcz_store.cc:276] 0709 12:59:39.657853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:40.109794 (+451941us) service_pool.cc:224] Handling call
0709 12:59:40.124557 (+ 14763us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:40.124814 (+   257us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:40.124839 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:40.125343 (+   504us) log.cc:844] Serialized 26 byte log entry
0709 12:59:40.574089 (+448746us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:40.574131 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:40.574201 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:40.677707 (+103506us) raft_consensus.cc:1685] finished
0709 12:59:40.677738 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:40.677895 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":448347,"threads_started":1,"wal-append.queue_time_us":550149}
W20260709 12:59:40.695194  3587 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.018s	sys 0.024s
I20260709 12:59:40.872972  1430 catalog_manager.cc:5697] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: config changed from index -1 to 5, term changed from 4 to 5, leader changed from ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) to <none>, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New cstate: current_term: 5 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:59:40.648660  2219 raft_consensus.cc:1240] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 12:59:40.919725  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:40.674618  3639 raft_consensus.cc:2804] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:40.917129  1674 raft_consensus.cc:1240] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:40.917191  1680 raft_consensus.cc:3060] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:40.648952  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 12:59:40.827641  2218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50310 (request call id 476) took 1290 ms. Trace:
I20260709 12:59:40.789713  3645 raft_consensus.cc:2749] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:59:40.872113  3690 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.831s	user 0.018s	sys 0.052s
I20260709 12:59:40.847098  3703 raft_consensus.cc:3060] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:40.923607  3633 raft_consensus.cc:2804] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:40.846359  3711 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:40.673384  3632 leader_election.cc:290] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:40.761281  3637 raft_consensus.cc:2749] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:40.965404  1526 raft_consensus.cc:2468] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 5.
I20260709 12:59:40.967254  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 12:59:40.647975  3723 raft_consensus.cc:2749] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:40.918715  1675 raft_consensus.cc:2368] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b for earlier term 4. Current term is 5.
I20260709 12:59:40.874487  3585 raft_consensus.cc:493] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:40.925366  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:40.927258  1430 catalog_manager.cc:5697] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 2 to 4, leader changed from b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 4 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:40.928725  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:40.922888  2221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50310 (request call id 475) took 1390 ms. Trace:
I20260709 12:59:40.922626  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 12:59:40.873232  3648 raft_consensus.cc:493] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:40.880329  3710 raft_consensus.cc:697] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 12:59:40.780146  3520 consensus_queue.cc:237] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:40.929315  2220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50310 (request call id 477) took 1379 ms. Trace:
I20260709 12:59:40.930943  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:40.932125  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 12:59:40.919355  3587 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.783s	user 0.041s	sys 0.038s
I20260709 12:59:40.763401  3655 consensus_queue.cc:1059] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.162s
I20260709 12:59:40.904901  3663 raft_consensus.cc:697] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 4 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:40.917153  3688 raft_consensus.cc:2764] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:59:40.947956  1673 raft_consensus.cc:2468] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 5.
W20260709 12:59:40.981078  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 359160us
W20260709 12:59:40.982961  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 359957us
I20260709 12:59:40.984563  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:40.949676  1525 raft_consensus.cc:2468] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 4.
I20260709 12:59:40.820055  3652 leader_election.cc:290] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 5 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:40.874727  3673 raft_consensus.cc:515] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:40.926422  3630 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:40.923671  3639 raft_consensus.cc:493] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:40.964052  2190 leader_election.cc:304] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:41.009061  3639 raft_consensus.cc:3060] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:41.009059  3630 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:59:41.011373  3630 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:40.970839  1430 catalog_manager.cc:5697] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 2 to 4, leader changed from ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) to 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194). New cstate: current_term: 4 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:40.871773  3660 raft_consensus.cc:515] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 12:59:41.014246  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 50297.6us
I20260709 12:59:40.982482  2220 rpcz_store.cc:276] 0709 12:59:39.545406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:39.558282 (+ 12876us) service_pool.cc:224] Handling call
0709 12:59:40.484967 (+926685us) spinlock_profiling.cc:243] Waited 5.38 ms on lock 0x7b5800015c98. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a1548eb71 00007f6a1548ea22 00007f6a1e3a7c09 00007f6a1d501ee0 00007f6a1d5cb0ab 00007f6a1d5cb131 00007f6a1d5790a0 00007f6a1d578984 00007f6a16af36d4 00007f6a16af3662
0709 12:59:40.924946 (+439979us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12372864}
I20260709 12:59:41.015741  3660 leader_election.cc:290] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:41.016541  3696 consensus_queue.cc:1059] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:41.016793  2190 leader_election.cc:304] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:41.017590  3696 consensus_queue.cc:1059] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:59:40.974786  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 172517us
I20260709 12:59:41.018517  3696 raft_consensus.cc:3055] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:40.930194  2218 rpcz_store.cc:276] 0709 12:59:39.537056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:39.555512 (+ 18456us) service_pool.cc:224] Handling call
0709 12:59:40.047772 (+492260us) spinlock_profiling.cc:243] Waited 5.41 ms on lock 0x7b5800015c98. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a1548eb71 00007f6a1548eeee 0000000000375939 00007f6a1d5021e0 00007f6a1d5cb0c4 00007f6a1d5cb131 00007f6a1d5790a0 00007f6a1d578984 00007f6a16af36d4 00007f6a16af3662
0709 12:59:40.827340 (+779568us) spinlock_profiling.cc:243] Waited 48.3 ms on lock 0x7b540069fd54. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 12:59:40.827550 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":123524096}
I20260709 12:59:40.975747  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:40.976745  2223 raft_consensus.cc:2393] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 2: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 12:59:40.630831  3708 raft_consensus.cc:515] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:40.922698  3695 consensus_queue.cc:237] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:40.880079  3704 raft_consensus.cc:515] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 12:59:40.969772  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 374785us
I20260709 12:59:40.959990  3676 leader_election.cc:290] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:40.961728  3633 raft_consensus.cc:493] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:40.973320  2222 raft_consensus.cc:2393] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 5: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 12:59:40.985085  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:41.018914  3696 raft_consensus.cc:740] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 12:59:41.036316  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 12:59:40.980733  3683 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.884s	user 0.015s	sys 0.025s
I20260709 12:59:40.972260  3585 raft_consensus.cc:3060] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:40.972838  2221 rpcz_store.cc:276] 0709 12:59:39.532251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:39.542738 (+ 10487us) service_pool.cc:224] Handling call
0709 12:59:40.354919 (+812181us) spinlock_profiling.cc:243] Waited 4.49 ms on lock 0x7b5800015c98. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a1548ef8c 00007f6a1548eef6 0000000000375939 00007f6a1d5021e0 00007f6a1d5cb0c4 00007f6a1d5cb131 00007f6a1d5790a0 00007f6a1d578984 00007f6a16af36d4 00007f6a16af3662
0709 12:59:40.922812 (+567893us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10321280}
I20260709 12:59:40.974027  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 12:59:40.990311  1571 leader_election.cc:304] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
W20260709 12:59:40.990586  3718 log.cc:927] Time spent T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.210s	user 0.001s	sys 0.000s
W20260709 12:59:40.993573  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:41.035214  3633 raft_consensus.cc:3060] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:41.002998  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:41.031239  3671 raft_consensus.cc:493] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:41.003922  3710 consensus_queue.cc:237] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:41.005053  3643 leader_election.cc:290] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:41.005565  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:41.006116  3663 consensus_queue.cc:237] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:41.060251  3645 raft_consensus.cc:2804] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:41.062314  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 12:59:41.062702  3645 raft_consensus.cc:697] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 4 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:41.063694  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:41.063907  3645 consensus_queue.cc:237] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:41.064916  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:41.066069  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
W20260709 12:59:41.008533  3722 log.cc:927] Time spent T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 12:59:40.979815  2226 raft_consensus.cc:2393] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 6: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 12:59:41.067464  3660 raft_consensus.cc:2804] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:41.013312  1430 catalog_manager.cc:5697] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:41.067951  3660 raft_consensus.cc:697] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 6 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 12:59:41.068290  1679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49170 (request call id 1592) took 2102 ms. Trace:
I20260709 12:59:41.022400  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:41.069664  1677 raft_consensus.cc:2468] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 4.
I20260709 12:59:41.019841  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:41.023595  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 12:59:41.038199  1680 raft_consensus.cc:2468] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 5.
I20260709 12:59:41.040951  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:41.073295  2224 raft_consensus.cc:1217] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 4 LEARNER]: Deduplicated request from leader. Original: 4.4->[4.5-4.5]   Dedup: 4.5->[]
I20260709 12:59:41.074142  2224 raft_consensus.cc:2962] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 4 LEARNER]: Ignoring commit of config change with OpId 4.5 because the committed config has OpId index 5. The config change we are ignoring is: Old config: { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } }. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:59:41.067936  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 12:59:41.068660  1679 rpcz_store.cc:276] 0709 12:59:38.965707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:38.965851 (+   144us) service_pool.cc:224] Handling call
0709 12:59:38.975348 (+  9497us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:40.376376 (+1401028us) spinlock_profiling.cc:243] Waited 25.2 ms on lock 0x7b1800360b80. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1e38ede1 00007f6a1e39b5b1 00007f6a1815b4bc 00007f6a154a948b 00007f6a1e303ab9 00007f6a154c569b 00007f6a154c393f 00007f6a154c3455 00007f6a185ab060 00007f6a185abbfb 00007f6a185b664b
0709 12:59:40.376514 (+   138us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:59:40.376852 (+   338us) log.cc:844] Serialized 14 byte log entry
0709 12:59:40.631843 (+254991us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:40.637621 (+  5778us) log.cc:844] Serialized 26 byte log entry
0709 12:59:40.637781 (+   160us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:40.637819 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:40.637894 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:41.068016 (+430122us) raft_consensus.cc:1685] finished
0709 12:59:41.068115 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:41.068240 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23101,"prepare.queue_time_us":10818,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":159549,"raft.run_cpu_time_us":334,"raft.run_wall_time_us":22993,"spinlock_wait_cycles":57975552,"thread_start_us":358166,"threads_started":2,"wal-append.queue_time_us":495437}
W20260709 12:59:41.003022  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:41.015892  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 12:59:41.044363  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:41.021750  3271 raft_consensus.cc:493] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:41.080806  1497 connection.cc:256] RPC call timeout handler was delayed by -1.9754807990000245s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1663s for a response
I20260709 12:59:41.081219  3271 raft_consensus.cc:515] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:41.081660  2220 raft_consensus.cc:1240] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:41.014050  3679 leader_election.cc:290] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:41.018620  3404 raft_consensus.cc:2804] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:40.965221  3711 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:59:41.083216  3404 raft_consensus.cc:697] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 5 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 12:59:41.084132  3404 consensus_queue.cc:237] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:41.084645  3711 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
W20260709 12:59:41.081223  1497 connection.cc:256] RPC call timeout handler was delayed by -1.9106807989999766s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17350000000000002s for a response
W20260709 12:59:41.085356  1497 connection.cc:256] RPC call timeout handler was delayed by -1.8935807990000058s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1754s for a response
I20260709 12:59:41.019471  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:41.020358  3655 raft_consensus.cc:3055] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:59:41.085682  1497 connection.cc:256] RPC call timeout handler was delayed by -1.7252807990000179s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19410000000000002s for a response
W20260709 12:59:41.049814  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 59582.4us
I20260709 12:59:41.024421  3708 leader_election.cc:290] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:41.085901  3655 raft_consensus.cc:740] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 12:59:41.020017  3650 raft_consensus.cc:493] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:41.086498  3711 consensus_queue.cc:1059] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:41.087656  3679 raft_consensus.cc:3055] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:41.088007  3679 raft_consensus.cc:740] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:41.051541  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:41.018853  3629 raft_consensus.cc:3055] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:41.088802  3679 consensus_queue.cc:260] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:41.086941  3650 raft_consensus.cc:515] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:41.069036  1430 catalog_manager.cc:5697] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:41.090685  3679 raft_consensus.cc:3060] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:41.091601  3650 leader_election.cc:290] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:41.036576  3696 consensus_queue.cc:260] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:41.055280  1674 raft_consensus.cc:1240] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:41.055439  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
W20260709 12:59:41.044700  3683 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.945s	user 0.015s	sys 0.026s
I20260709 12:59:41.020282  3673 leader_election.cc:290] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:41.092696  3696 raft_consensus.cc:3060] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:41.007361  3667 leader_election.cc:290] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:41.089236  3629 raft_consensus.cc:740] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 12:59:41.069118  3660 consensus_queue.cc:237] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:41.035271  3704 leader_election.cc:290] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:40.978629  3648 raft_consensus.cc:515] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:41.094058  3629 consensus_queue.cc:260] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:41.091136  1430 catalog_manager.cc:5697] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } }
W20260709 12:59:41.092828  1497 connection.cc:256] RPC call timeout handler was delayed by -1.4624807989999908s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22330000000000003s for a response
W20260709 12:59:41.092860  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:41.107417  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 81075.4us
I20260709 12:59:41.096446  2191 leader_election.cc:304] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:41.089210  3271 leader_election.cc:290] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:41.100510  1679 raft_consensus.cc:1240] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:41.108577  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:41.097302  2221 raft_consensus.cc:3060] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:41.108578  1572 leader_election.cc:304] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:41.109903  2191 leader_election.cc:400] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 4 election: Vote denied by peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217) with higher term. Message: Invalid argument: T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b for earlier term 4. Current term is 5.
I20260709 12:59:41.110198  2191 leader_election.cc:403] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:59:41.060539  3657 consensus_queue.cc:1059] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 12:59:41.060117  3671 raft_consensus.cc:515] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:41.112152  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:41.060660  3676 consensus_queue.cc:1059] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 12:59:41.112648  1523 raft_consensus.cc:1240] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:41.126785  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:41.127576  1523 raft_consensus.cc:2368] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for earlier term 4. Current term is 5.
I20260709 12:59:41.107568  1430 catalog_manager.cc:5697] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:41.111677  3719 raft_consensus.cc:2804] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:41.117590  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:41.118566  3629 raft_consensus.cc:3060] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:41.118742  1530 raft_consensus.cc:1240] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 12:59:41.133585  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:41.134425  1527 raft_consensus.cc:2393] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 3: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 12:59:41.134639  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:41.135284  1530 raft_consensus.cc:2468] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 4.
I20260709 12:59:41.136122  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:41.136783  1530 raft_consensus.cc:2468] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 3.
I20260709 12:59:41.133531  1524 raft_consensus.cc:2468] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 4.
I20260709 12:59:41.123414  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:41.124121  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:41.073338  3639 raft_consensus.cc:515] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:41.129335  1430 catalog_manager.cc:5697] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:41.111869  1572 leader_election.cc:304] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:41.086839  3655 consensus_queue.cc:260] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:41.141081  2223 raft_consensus.cc:1240] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 5 LEADER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:41.131065  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:41.143620  1526 raft_consensus.cc:2468] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 5.
I20260709 12:59:41.137544  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:41.122110  2191 leader_election.cc:304] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:41.139766  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:41.145493  1523 raft_consensus.cc:2393] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 6: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 12:59:41.147425  1572 leader_election.cc:304] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90
W20260709 12:59:41.137428  1646 leader_election.cc:336] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Timed out: RequestConsensusVote RPC to 127.0.107.194:40303 timed out after 1.588s (SENT)
I20260709 12:59:41.148488  1646 leader_election.cc:304] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:41.150501  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:41.113958  3627 raft_consensus.cc:2749] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:41.152164  2225 raft_consensus.cc:2468] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 6.
I20260709 12:59:41.152475  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:41.153666  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:41.154424  1531 raft_consensus.cc:2368] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for earlier term 4. Current term is 5.
W20260709 12:59:41.130578  3717 log.cc:927] Time spent T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.447s	user 0.002s	sys 0.003s
I20260709 12:59:41.155227  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:41.155789  1531 raft_consensus.cc:2468] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 5.
I20260709 12:59:41.156721  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:41.157326  1526 raft_consensus.cc:2468] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 4.
I20260709 12:59:41.157891  1572 leader_election.cc:304] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:41.158640  3676 raft_consensus.cc:2749] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:41.154687  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:41.159646  1530 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 5.
I20260709 12:59:41.159912  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:41.160615  1524 raft_consensus.cc:3060] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:41.159864  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:41.163004  1497 leader_election.cc:304] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:41.163496  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:41.164799  1497 leader_election.cc:304] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:41.164976  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:41.165803  1603 raft_consensus.cc:2368] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for earlier term 4. Current term is 5.
I20260709 12:59:41.166751  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:41.167083  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:41.168069  1531 raft_consensus.cc:2393] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 7: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 12:59:41.167552  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:41.168814  1527 raft_consensus.cc:2468] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 4.
I20260709 12:59:41.170311  1497 leader_election.cc:304] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:41.167940  1530 raft_consensus.cc:2468] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 4.
W20260709 12:59:41.152639  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 166981us
I20260709 12:59:41.171247  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
W20260709 12:59:41.171658  1570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:41.174621  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:41.171841  1600 raft_consensus.cc:2376] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 5. Re-sending same reply.
I20260709 12:59:41.189440  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:41.152738  3704 raft_consensus.cc:3055] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:41.154639  3729 raft_consensus.cc:2804] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:41.189769  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
W20260709 12:59:41.191941  1680 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50664 (request call id 372) took 1256 ms (client timeout 1674 ms). Trace:
I20260709 12:59:41.199148  2190 leader_election.cc:304] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
W20260709 12:59:41.195531  1680 rpcz_store.cc:269] 0709 12:59:39.935372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:39.996196 (+ 60824us) service_pool.cc:224] Handling call
0709 12:59:41.191788 (+1195592us) spinlock_profiling.cc:243] Waited 908 ms on lock 0x7b540024d454. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 12:59:41.191886 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2089316224}
I20260709 12:59:41.200765  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:41.201421  1603 raft_consensus.cc:2468] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 3.
I20260709 12:59:41.171766  3640 raft_consensus.cc:2804] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:59:41.176244  1570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:41.194478  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:41.189185  3655 raft_consensus.cc:3060] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:41.150383  3727 raft_consensus.cc:2749] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:41.190928  1523 raft_consensus.cc:3060] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:41.195607  1526 raft_consensus.cc:2376] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 5. Re-sending same reply.
I20260709 12:59:41.171393  3637 raft_consensus.cc:2749] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:59:41.175091  3519 raft_consensus.cc:2804] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:41.223937  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:41.192379  3704 raft_consensus.cc:740] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:41.175029  3692 consensus_queue.cc:1059] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:59:41.188836  3632 raft_consensus.cc:3060] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:41.171337  3719 raft_consensus.cc:697] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 5 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 12:59:41.274196  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 12:59:41.212134  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:41.171247  3673 raft_consensus.cc:2749] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:41.223031  1677 raft_consensus.cc:1240] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:41.286566  1677 raft_consensus.cc:1240] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:41.205722  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:41.287631  1525 raft_consensus.cc:3060] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:41.288609  1523 raft_consensus.cc:2468] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 4.
I20260709 12:59:41.225739  3676 raft_consensus.cc:493] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:41.223074  1524 raft_consensus.cc:2468] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 3.
I20260709 12:59:41.223501  3651 raft_consensus.cc:2804] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:41.223883  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:41.228935  1604 raft_consensus.cc:2468] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 4.
I20260709 12:59:41.230023  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:41.300282  1673 raft_consensus.cc:2468] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 5.
I20260709 12:59:41.236739  3639 leader_election.cc:290] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:41.223773  3519 raft_consensus.cc:493] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:41.242771  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:41.306128  1679 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 5.
I20260709 12:59:41.245013  3585 raft_consensus.cc:515] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:41.245146  3703 raft_consensus.cc:515] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:41.215041  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:41.251015  3652 raft_consensus.cc:493] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:41.252404  1674 raft_consensus.cc:1275] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:59:41.228924  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 12:59:41.253692  3642 consensus_meta.cc:287] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.618s	user 0.004s	sys 0.002s
I20260709 12:59:41.257270  3633 raft_consensus.cc:515] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:41.207671  3677 raft_consensus.cc:3055] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:41.209185  1497 leader_election.cc:304] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:41.154942  3314 consensus_queue.cc:1059] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.062s
W20260709 12:59:41.266901  1570 leader_election.cc:336] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.628s (SENT)
I20260709 12:59:41.328105  1570 leader_election.cc:304] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:41.208037  3640 raft_consensus.cc:493] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:41.268953  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
W20260709 12:59:41.268903  1646 leader_election.cc:336] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Timed out: RequestConsensusVote RPC to 127.0.107.194:40303 timed out after 1.694s (SENT)
I20260709 12:59:41.206019  3729 raft_consensus.cc:697] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 5 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:41.219856  1680 raft_consensus.cc:1275] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:59:41.274912  1600 raft_consensus.cc:2468] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 2.
I20260709 12:59:41.219458  3635 consensus_queue.cc:1059] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.059s
I20260709 12:59:41.279188  2223 raft_consensus.cc:1240] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 12:59:41.224334  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:41.292479  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:41.336905  1605 raft_consensus.cc:2393] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 5: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 12:59:41.294842  1523 raft_consensus.cc:1240] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:41.260027  3683 raft_consensus.cc:493] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:41.307181  1525 raft_consensus.cc:2468] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 5.
I20260709 12:59:41.337954  3683 raft_consensus.cc:515] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:41.338577  1523 raft_consensus.cc:1240] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 2. Current term is 3. Ops: []
W20260709 12:59:41.311688  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 102579us
W20260709 12:59:41.325631  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 116519us
I20260709 12:59:41.340461  3683 leader_election.cc:290] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:41.309093  3519 raft_consensus.cc:3060] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:41.340728  1497 leader_election.cc:304] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:41.332355  1528 raft_consensus.cc:1240] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 1. Current term is 2. Ops: []
W20260709 12:59:41.333292  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 72685.1us
I20260709 12:59:41.340441  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:41.342203  1497 leader_election.cc:304] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:41.344465  1530 raft_consensus.cc:1240] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:41.345985  1497 leader_election.cc:304] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:41.326004  1681 raft_consensus.cc:2468] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 3.
I20260709 12:59:41.342164  1646 leader_election.cc:304] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:41.300083  3676 raft_consensus.cc:515] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:41.326519  3677 raft_consensus.cc:740] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 12:59:41.355926  2225 raft_consensus.cc:1240] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:41.329409  3673 raft_consensus.cc:2749] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:41.328109  3651 raft_consensus.cc:697] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 4 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
W20260709 12:59:41.361660  1646 leader_election.cc:336] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Timed out: RequestConsensusVote RPC to 127.0.107.194:40303 timed out after 1.740s (SENT)
I20260709 12:59:41.335302  3640 raft_consensus.cc:3060] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:41.348784  1672 raft_consensus.cc:2393] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 3: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 12:59:41.308233  3709 consensus_queue.cc:1059] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 12:59:41.345176  3639 raft_consensus.cc:2749] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:41.327236  3652 raft_consensus.cc:515] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:41.346614  3301 raft_consensus.cc:493] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:41.359719  3671 leader_election.cc:290] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:41.376644  1646 leader_election.cc:304] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:41.353323  3683 raft_consensus.cc:2804] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:41.358909  3723 raft_consensus.cc:2749] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:41.354732  3511 raft_consensus.cc:2749] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:41.372823  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:41.362044  3271 raft_consensus.cc:3055] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:41.393532  3645 consensus_queue.cc:1059] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:59:41.381397  3742 log.cc:927] Time spent T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 12:59:41.331316  3704 consensus_queue.cc:260] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:41.392925  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:41.400472  1606 raft_consensus.cc:2393] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 4: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
W20260709 12:59:41.393895  2190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:41.386869  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:41.397210  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:41.391181  1525 raft_consensus.cc:1275] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:59:41.404649  3737 log.cc:927] Time spent T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 12:59:41.372298  3719 consensus_queue.cc:237] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:41.407938  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:41.408720  1607 raft_consensus.cc:2393] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 5: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 12:59:41.410310  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:41.410902  1602 raft_consensus.cc:3060] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:41.411738  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:41.412317  1525 raft_consensus.cc:2376] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 4. Re-sending same reply.
I20260709 12:59:41.393492  3271 raft_consensus.cc:740] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:41.385725  3683 raft_consensus.cc:493] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:41.395502  3663 raft_consensus.cc:2749] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:41.419704  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:41.397691  3744 raft_consensus.cc:2749] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:41.422286  1525 raft_consensus.cc:2410] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:59:41.423300  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:41.394966  2221 raft_consensus.cc:2468] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 5.
W20260709 12:59:41.442966  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 94776us
W20260709 12:59:41.443869  1646 leader_election.cc:336] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Timed out: RequestConsensusVote RPC to 127.0.107.194:40303 timed out after 1.792s (SENT)
I20260709 12:59:41.444249  1646 leader_election.cc:304] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:41.446841  2223 raft_consensus.cc:1275] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:59:41.449620  3633 leader_election.cc:290] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:41.455243  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:41.416911  3704 raft_consensus.cc:3060] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:59:41.457635  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 240231us
I20260709 12:59:41.459610  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 12:59:41.421212  3739 log.cc:927] Time spent T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 12:59:41.465179  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:41.465672  1602 raft_consensus.cc:2468] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 3.
I20260709 12:59:41.465804  1525 raft_consensus.cc:2468] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 8.
I20260709 12:59:41.421489  3683 raft_consensus.cc:3060] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:41.467614  1607 raft_consensus.cc:2468] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 4.
I20260709 12:59:41.388110  3301 raft_consensus.cc:515] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:59:41.468859  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:41.468364  2225 raft_consensus.cc:2393] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 5: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 12:59:41.479292  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 12:59:41.480967  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:41.476936  1524 raft_consensus.cc:1240] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 4. Current term is 5. Ops: []
W20260709 12:59:41.496917  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 53093.3us
W20260709 12:59:41.497607  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:41.498441  1646 leader_election.cc:304] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:41.500114  1646 leader_election.cc:304] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:41.492539  3661 raft_consensus.cc:3055] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:41.501436  3661 raft_consensus.cc:740] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
W20260709 12:59:41.478333  3743 log.cc:927] Time spent T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 12:59:41.505877  1646 leader_election.cc:304] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
W20260709 12:59:41.515107  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 174833us
W20260709 12:59:41.494354  3738 log.cc:927] Time spent T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
W20260709 12:59:41.535307  1570 connection.cc:256] RPC call timeout handler was delayed by -1.243026637000014s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20379999999999998s for a response
W20260709 12:59:41.538915  1570 connection.cc:256] RPC call timeout handler was delayed by -1.2124266370000214s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20720000000000002s for a response
W20260709 12:59:41.539264  1570 connection.cc:256] RPC call timeout handler was delayed by -1.1620266369999968s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21280000000000002s for a response
W20260709 12:59:41.493523  3740 log.cc:927] Time spent T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
W20260709 12:59:41.539633  1570 connection.cc:256] RPC call timeout handler was delayed by -1.1503266370000347s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2141s for a response
I20260709 12:59:41.537087  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:41.537648  1525 raft_consensus.cc:1275] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:59:41.540020  1570 connection.cc:256] RPC call timeout handler was delayed by -1.1485266370000318s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2143s for a response
I20260709 12:59:41.540526  1523 raft_consensus.cc:2468] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 5.
W20260709 12:59:41.540625  1570 leader_election.cc:336] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.799s (SENT)
I20260709 12:59:41.541144  1570 leader_election.cc:304] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:41.541556  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:41.470368  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:41.470925  3642 raft_consensus.cc:2749] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:41.492902  3627 raft_consensus.cc:3055] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:41.543368  1571 leader_election.cc:304] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:41.542452  3711 raft_consensus.cc:2749] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:41.420671  3651 consensus_queue.cc:237] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:41.492708  3585 leader_election.cc:290] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:41.501000  1672 raft_consensus.cc:1240] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:41.501472  3716 raft_consensus.cc:2749] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217) with higher term. Message: Invalid argument: T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b for earlier term 4. Current term is 5.
I20260709 12:59:41.504851  3663 raft_consensus.cc:2749] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:41.549345  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:41.415954  3729 consensus_queue.cc:237] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 12:59:41.566288  1570 leader_election.cc:336] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.804s (SENT)
I20260709 12:59:41.566792  1570 leader_election.cc:304] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:41.526904  3679 raft_consensus.cc:2804] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:41.548756  3627 raft_consensus.cc:740] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:41.569151  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:41.545950  3703 leader_election.cc:290] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 2 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:41.571497  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 12:59:41.578126  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:41.595986  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:41.477249  3271 consensus_queue.cc:260] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 12:59:41.609320  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 66047.5us
W20260709 12:59:41.609907  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:41.545258  3727 consensus_queue.cc:1059] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
W20260709 12:59:41.613955  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 47717.4us
I20260709 12:59:41.617810  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:41.618474  1680 raft_consensus.cc:3060] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:41.565531  3676 leader_election.cc:290] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
W20260709 12:59:41.614867  1570 leader_election.cc:336] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.859s (SENT)
I20260709 12:59:41.626132  1570 leader_election.cc:304] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:41.569937  3679 raft_consensus.cc:493] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:41.610737  3635 raft_consensus.cc:2749] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:41.637780  1680 raft_consensus.cc:2468] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 5.
W20260709 12:59:41.644677  2191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:41.547672  3661 consensus_queue.cc:260] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:41.667062  1529 raft_consensus.cc:3055] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:41.623730  3744 raft_consensus.cc:2804] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:41.678205  1529 raft_consensus.cc:740] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 12:59:41.680027  3661 raft_consensus.cc:3060] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:41.675868  3652 leader_election.cc:290] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:41.680778  3751 raft_consensus.cc:3055] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:41.681167  3752 raft_consensus.cc:493] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:41.683575  3753 log.cc:927] Time spent T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 12:59:41.736315  3760 log.cc:927] Time spent T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 12:59:41.642473  3679 raft_consensus.cc:3060] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:41.704618  2190 leader_election.cc:304] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:41.705407  1606 raft_consensus.cc:2393] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 5: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 12:59:41.707069  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:41.707811  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:41.710389  3705 raft_consensus.cc:3055] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:59:41.711697  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:41.759755  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:41.713286  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:41.714998  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:41.719115  3301 leader_election.cc:290] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:41.642163  3271 raft_consensus.cc:3060] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:41.768211  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:41.715047  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:41.724547  1680 raft_consensus.cc:1240] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 4. Current term is 5. Ops: []
W20260709 12:59:41.728864  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 310509us
I20260709 12:59:41.769770  1644 leader_election.cc:304] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:41.771762  1644 leader_election.cc:400] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 pre-election: Vote denied by peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931) with higher term. Message: Invalid argument: T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for earlier term 4. Current term is 5.
I20260709 12:59:41.772818  1644 leader_election.cc:304] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:41.773629  1644 leader_election.cc:304] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:41.774156  1646 leader_election.cc:304] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:41.682260  3756 consensus_queue.cc:1048] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.019s
W20260709 12:59:41.734131  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 119273us
W20260709 12:59:41.775355  1570 leader_election.cc:336] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.873s (SENT)
W20260709 12:59:41.776057  1570 connection.cc:256] RPC call timeout handler was delayed by -1.1233266370000479s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2171s for a response
W20260709 12:59:41.776525  1570 leader_election.cc:336] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.886s (SENT)
W20260709 12:59:41.777166  1570 connection.cc:256] RPC call timeout handler was delayed by -1.121526637000045s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21730000000000002s for a response
W20260709 12:59:41.777647  1570 leader_election.cc:336] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.900s (SENT)
I20260709 12:59:41.777987  1570 leader_election.cc:304] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:41.685577  1529 consensus_queue.cc:260] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:41.736164  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:41.675539  3755 raft_consensus.cc:2749] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:59:41.696944  1681 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49178 (request call id 1541) took 2507 ms (client timeout 2063 ms). Trace:
I20260709 12:59:41.683969  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 12:59:41.780320  1681 rpcz_store.cc:269] 0709 12:59:39.189413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:39.189550 (+   137us) service_pool.cc:224] Handling call
0709 12:59:41.696655 (+2507105us) spinlock_profiling.cc:243] Waited 2.14 s on lock 0x7b5400179654. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 12:59:41.696813 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4911622528}
W20260709 12:59:41.763363  3745 log.cc:927] Time spent T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.320s	user 0.000s	sys 0.001s
I20260709 12:59:41.796068  2223 raft_consensus.cc:1240] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:41.684548  3744 raft_consensus.cc:493] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:41.768946  1602 raft_consensus.cc:3060] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:41.778944  1529 raft_consensus.cc:3060] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:41.727736  3696 consensus_meta.cc:287] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b: Time spent flushing consensus metadata: real 0.634s	user 0.010s	sys 0.000s
I20260709 12:59:41.784116  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:41.804137  1603 raft_consensus.cc:2468] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 3.
I20260709 12:59:41.805063  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
W20260709 12:59:41.758056  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 53551.4us
W20260709 12:59:41.787495  3765 log.cc:927] Time spent T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
W20260709 12:59:41.788118  3758 log.cc:927] Time spent T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.218s	user 0.001s	sys 0.000s
W20260709 12:59:41.789851  3769 log.cc:927] Time spent T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
W20260709 12:59:41.791590  3773 log.cc:927] Time spent T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:59:41.728911  3751 raft_consensus.cc:740] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:41.796793  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:41.738420  3635 raft_consensus.cc:2749] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:59:41.806676  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 105654us
I20260709 12:59:41.810300  2190 leader_election.cc:304] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:41.806030  3301 raft_consensus.cc:2804] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:41.767905  3652 raft_consensus.cc:2749] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:59:41.765785  3705 raft_consensus.cc:740] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 12:59:41.785602  3657 raft_consensus.cc:2749] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:41.795167  3642 raft_consensus.cc:2804] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:41.741716  3716 consensus_queue.cc:1059] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.077s
I20260709 12:59:41.795044  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:41.821219  1604 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 5.
W20260709 12:59:41.833302  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 59739us
I20260709 12:59:41.805217  3637 consensus_queue.cc:1048] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 12:59:41.860520  1644 leader_election.cc:304] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:41.736167  3752 raft_consensus.cc:515] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:41.806777  3744 raft_consensus.cc:3060] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:41.838752  1496 leader_election.cc:304] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:41.785138  3711 consensus_queue.cc:1059] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
W20260709 12:59:41.844319  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 66688.8us
I20260709 12:59:41.846407  1571 leader_election.cc:304] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:41.836616  1602 raft_consensus.cc:2468] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 5.
I20260709 12:59:41.861888  1644 leader_election.cc:304] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:41.839098  3301 raft_consensus.cc:493] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:41.864524  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
W20260709 12:59:41.842521  3519 consensus_meta.cc:287] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent flushing consensus metadata: real 0.501s	user 0.009s	sys 0.001s
I20260709 12:59:41.872252  1600 raft_consensus.cc:1240] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 5 LEADER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:41.847092  3642 raft_consensus.cc:493] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:41.875982  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:41.877388  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:41.877682  1605 raft_consensus.cc:2393] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 4: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 12:59:41.878007  1602 raft_consensus.cc:2468] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 5.
W20260709 12:59:41.876696  1570 leader_election.cc:336] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.901s (SENT)
I20260709 12:59:41.859535  3676 raft_consensus.cc:2804] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:41.852278  3696 raft_consensus.cc:2804] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:41.886389  1603 raft_consensus.cc:2468] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 4.
I20260709 12:59:41.872124  3711 raft_consensus.cc:3055] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:41.888495  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:41.889737  3698 consensus_queue.cc:1059] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.072s
I20260709 12:59:41.890362  3770 raft_consensus.cc:2749] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:41.891161  3648 leader_election.cc:290] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 12:59:41.894240  3632 consensus_meta.cc:287] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent flushing consensus metadata: real 0.611s	user 0.005s	sys 0.003s
I20260709 12:59:41.876973  3723 consensus_queue.cc:1048] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
W20260709 12:59:41.896178  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:41.898970  1672 raft_consensus.cc:1275] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:41.899343  1607 raft_consensus.cc:1240] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:41.888491  1570 leader_election.cc:304] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:41.905303  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:41.866925  3663 raft_consensus.cc:3060] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:59:41.908322  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 46508.1us
I20260709 12:59:41.859547  3587 consensus_queue.cc:1059] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 12:59:41.873785  3703 raft_consensus.cc:2804] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:41.927330  1607 raft_consensus.cc:1240] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:41.872529  3301 raft_consensus.cc:3060] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:41.878240  3775 raft_consensus.cc:2804] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:41.929968  1644 leader_election.cc:304] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:41.933355  1680 raft_consensus.cc:1275] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:41.886951  3642 raft_consensus.cc:3060] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:41.910205  3727 consensus_queue.cc:1243] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer b96ce9cc496c49d7818fa983a17b062b log is divergent from this leader: its last log entry 5.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:59:41.924988  3635 raft_consensus.cc:2749] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:59:41.910068  3779 raft_consensus.cc:3060] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:41.906844  3711 raft_consensus.cc:740] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:41.915704  3632 raft_consensus.cc:2749] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:41.928112  3703 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:41.912492  3710 consensus_queue.cc:1059] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 12:59:42.092335  3711 consensus_queue.cc:260] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:42.093967  3703 raft_consensus.cc:3060] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:41.913201  3676 raft_consensus.cc:697] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 3 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:42.096401  3314 raft_consensus.cc:3055] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:42.096881  3314 raft_consensus.cc:740] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:42.096122  3676 consensus_queue.cc:237] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:42.097667  3314 consensus_queue.cc:260] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:42.099944  1525 raft_consensus.cc:2468] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 3.
I20260709 12:59:42.102190  3585 raft_consensus.cc:3055] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:42.102607  3585 raft_consensus.cc:740] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:42.104013  3585 consensus_queue.cc:260] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:42.105290  3585 raft_consensus.cc:3060] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:42.108729  3779 raft_consensus.cc:2749] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:59:42.109839  3640 consensus_meta.cc:287] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b: Time spent flushing consensus metadata: real 0.730s	user 0.007s	sys 0.001s
I20260709 12:59:42.111423  3677 consensus_queue.cc:260] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:42.054579  3724 raft_consensus.cc:493] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:42.116396  3724 raft_consensus.cc:515] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:42.117688  1528 raft_consensus.cc:1275] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:41.916247  3705 consensus_queue.cc:260] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:42.109789  3779 raft_consensus.cc:3060] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:41.910565  3751 consensus_queue.cc:260] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:41.925052  3696 raft_consensus.cc:697] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 5 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
W20260709 12:59:42.054288  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 122377us
W20260709 12:59:42.105389  3655 consensus_meta.cc:287] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b: Time spent flushing consensus metadata: real 0.898s	user 0.006s	sys 0.002s
I20260709 12:59:42.118625  3724 leader_election.cc:290] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:41.906510  3519 raft_consensus.cc:515] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:42.172207  1532 raft_consensus.cc:2468] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 4.
W20260709 12:59:42.135277  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:42.177821  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 237929us
I20260709 12:59:42.149359  1531 raft_consensus.cc:1275] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:59:42.151763  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:42.179459  1530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43010 (request call id 1655) took 1056 ms. Trace:
W20260709 12:59:42.179641  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:42.151589  3775 raft_consensus.cc:697] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 5 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:42.136785  3696 consensus_queue.cc:237] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:42.119275  3703 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:59:42.184828  3775 consensus_queue.cc:237] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:42.153731  3627 consensus_queue.cc:260] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:42.180255  1530 rpcz_store.cc:276] 0709 12:59:41.122977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:41.172524 (+ 49547us) service_pool.cc:224] Handling call
0709 12:59:41.172807 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:41.344947 (+172140us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:42.179245 (+834298us) spinlock_profiling.cc:243] Waited 171 ms on lock 0x7b540031a954. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 12:59:42.179403 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":394386304}
I20260709 12:59:42.195323  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 12:59:42.195566  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 265680us
W20260709 12:59:42.196049  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:42.196436  1644 leader_election.cc:400] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 election: Vote denied by peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931) with higher term. Message: Invalid argument: T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for earlier term 4. Current term is 5.
I20260709 12:59:42.196786  1644 leader_election.cc:403] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:59:42.198092  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:42.203504  1674 raft_consensus.cc:2468] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 3.
I20260709 12:59:42.200109  1644 leader_election.cc:304] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 12:59:42.207685  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:42.210762  1644 leader_election.cc:304] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 12:59:42.212188  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:42.212419  1496 leader_election.cc:304] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:42.212803  1674 raft_consensus.cc:3060] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:42.212926  1644 leader_election.cc:304] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
W20260709 12:59:42.214857  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 344866us
W20260709 12:59:42.131278  3764 log.cc:927] Time spent T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.318s	user 0.001s	sys 0.000s
W20260709 12:59:42.158243  3683 consensus_meta.cc:287] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.679s	user 0.009s	sys 0.000s
I20260709 12:59:42.175160  3751 raft_consensus.cc:3060] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:42.157246  3779 raft_consensus.cc:2749] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:42.217132  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:42.110302  3640 raft_consensus.cc:515] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 12:59:42.217751  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:42.217643  3704 consensus_meta.cc:287] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.749s	user 0.009s	sys 0.000s
I20260709 12:59:42.125922  3314 raft_consensus.cc:3060] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:42.162056  1598 raft_consensus.cc:1275] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:42.175177  3677 raft_consensus.cc:3060] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:42.219022  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:42.247785  1675 raft_consensus.cc:2468] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 3.
W20260709 12:59:42.247887  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 473817us
W20260709 12:59:42.216223  1570 connection.cc:256] RPC call timeout handler was delayed by -1.0963266370000042s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22010000000000002s for a response
I20260709 12:59:42.210142  3711 raft_consensus.cc:3060] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:42.220903  3271 raft_consensus.cc:2749] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:42.215498  3756 consensus_queue.cc:1048] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 12:59:42.186174  3703 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 12:59:42.249297  3661 consensus_meta.cc:287] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b: Time spent flushing consensus metadata: real 0.521s	user 0.007s	sys 0.003s
I20260709 12:59:42.216557  1677 raft_consensus.cc:2393] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 5: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 12:59:42.180107  3519 leader_election.cc:290] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:42.122082  2219 raft_consensus.cc:2468] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 3.
W20260709 12:59:42.226043  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:42.218307  2190 leader_election.cc:304] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:42.221571  3781 raft_consensus.cc:2749] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931) with higher term. Message: Invalid argument: T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for earlier term 4. Current term is 5.
I20260709 12:59:42.188890  3752 leader_election.cc:290] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:42.231400  3698 consensus_queue.cc:1048] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:59:42.264503  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 46252.9us
W20260709 12:59:42.232937  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 164498us
I20260709 12:59:42.217242  3642 raft_consensus.cc:515] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:42.238483  3640 leader_election.cc:290] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 5 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:42.239131  3716 raft_consensus.cc:3055] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:42.244128  1678 raft_consensus.cc:2410] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:59:42.217249  3724 raft_consensus.cc:2804] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:42.255895  3782 raft_consensus.cc:2804] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:42.159938  3679 raft_consensus.cc:515] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 12:59:42.249042  1570 connection.cc:256] RPC call timeout handler was delayed by -1.088226637000048s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.221s for a response
I20260709 12:59:42.142391  3301 raft_consensus.cc:515] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:42.123723  3705 raft_consensus.cc:3060] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:42.257794  1496 leader_election.cc:304] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:42.223753  3683 raft_consensus.cc:515] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:42.305826  1679 raft_consensus.cc:1240] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 2. Current term is 3. Ops: []
W20260709 12:59:42.282974  1570 connection.cc:256] RPC call timeout handler was delayed by -1.0711266370000203s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22290000000000001s for a response
W20260709 12:59:42.307451  1570 connection.cc:256] RPC call timeout handler was delayed by -1.0702266370000189s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.223s for a response
I20260709 12:59:42.290849  1672 raft_consensus.cc:1275] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:59:42.303013  3660 consensus_queue.cc:1048] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:42.257465  3779 raft_consensus.cc:2804] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:59:42.309126  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 51414.1us
I20260709 12:59:42.324498  1674 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 6.
I20260709 12:59:42.325965  1496 leader_election.cc:304] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:42.280058  3690 raft_consensus.cc:2804] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:59:42.327816  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:42.327085  3644 raft_consensus.cc:2804] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:42.362716  3644 raft_consensus.cc:697] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 12:59:42.363691  3644 consensus_queue.cc:237] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
W20260709 12:59:42.366096  2191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:42.312184  3779 raft_consensus.cc:493] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:42.366983  3779 raft_consensus.cc:3060] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:42.368206  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:42.369481  2225 raft_consensus.cc:1240] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:42.370736  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 12:59:42.371590  2221 raft_consensus.cc:2368] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 4. Current term is 5.
I20260709 12:59:42.333443  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:42.337328  1674 raft_consensus.cc:1240] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:42.372745  1532 raft_consensus.cc:3060] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:42.339102  3642 leader_election.cc:290] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:42.323452  3519 raft_consensus.cc:2804] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:42.378571  3519 raft_consensus.cc:493] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:42.379011  3519 raft_consensus.cc:3060] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:42.381522  3779 raft_consensus.cc:515] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:42.384473  3627 raft_consensus.cc:3060] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:42.343693  3679 leader_election.cc:290] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 12:59:42.388563  2227 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 592) took 1447 ms (client timeout 1674 ms). Trace:
W20260709 12:59:42.389103  2227 rpcz_store.cc:269] 0709 12:59:40.940950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:40.980885 (+ 39935us) service_pool.cc:224] Handling call
0709 12:59:42.388305 (+1407420us) spinlock_profiling.cc:243] Waited 236 ms on lock 0x7b540070e9d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 12:59:42.388486 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":541843200}
I20260709 12:59:42.351079  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49310 (request call id 366) took 1145 ms. Trace:
I20260709 12:59:42.355551  1673 raft_consensus.cc:2368] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 4. Current term is 5.
I20260709 12:59:42.356473  3301 leader_election.cc:290] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:42.406240  2226 raft_consensus.cc:1240] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 5 LEADER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:42.406425  2219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 603) took 1383 ms. Trace:
I20260709 12:59:42.407014  1676 raft_consensus.cc:1240] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:42.406838  3633 consensus_queue.cc:1059] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:42.406477  1497 leader_election.cc:400] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 election: Vote denied by peer b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373) with higher term. Message: Invalid argument: T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 4. Current term is 5.
I20260709 12:59:42.305835  3782 raft_consensus.cc:493] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:42.356930   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:42.358590  3683 leader_election.cc:290] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:42.305881  3724 raft_consensus.cc:493] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:42.280949  3716 raft_consensus.cc:740] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
W20260709 12:59:42.359935  1571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:42.308092  3693 consensus_queue.cc:1048] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 12:59:42.331722  1531 raft_consensus.cc:1240] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:42.370950  1680 raft_consensus.cc:1240] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 12:59:42.399179  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:42.408224  1497 leader_election.cc:403] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:59:42.391708  1526 rpcz_store.cc:276] 0709 12:59:41.205936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:41.333373 (+127437us) service_pool.cc:224] Handling call
0709 12:59:41.357022 (+ 23649us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:41.371800 (+ 14778us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:41.371833 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:41.371876 (+    43us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:41.371908 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:42.350831 (+978923us) spinlock_profiling.cc:243] Waited 14.5 ms on lock 0x7b540002b054. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 12:59:42.350880 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:42.351018 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":33464064}
I20260709 12:59:42.304901  3744 raft_consensus.cc:515] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 12:59:42.446165  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 138207us
I20260709 12:59:42.460829  1572 leader_election.cc:304] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
W20260709 12:59:42.461524  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 55190.5us
W20260709 12:59:42.447654  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 235748us
I20260709 12:59:42.362026  3690 raft_consensus.cc:493] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:42.470818  3690 raft_consensus.cc:3060] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:42.471966  3756 raft_consensus.cc:2749] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:42.475044  2224 raft_consensus.cc:1275] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:59:42.476137  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 432) took 1008 ms. Trace:
I20260709 12:59:42.476503  1606 rpcz_store.cc:276] 0709 12:59:41.467887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:41.496523 (+ 28636us) service_pool.cc:224] Handling call
0709 12:59:42.475973 (+979450us) spinlock_profiling.cc:243] Waited 163 ms on lock 0x7b54000daa54. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 12:59:42.476082 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":375006464}
I20260709 12:59:42.459597  1532 raft_consensus.cc:2468] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 5.
I20260709 12:59:42.419942  3782 raft_consensus.cc:3060] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:42.420233  3655 raft_consensus.cc:493] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:42.445855  3724 raft_consensus.cc:3060] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:59:42.464869  3352 log.cc:927] Time spent T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.785s	user 0.014s	sys 0.001s
I20260709 12:59:42.465200  3716 consensus_queue.cc:260] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:42.469713  2221 raft_consensus.cc:1275] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:59:42.391352  3663 raft_consensus.cc:2749] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:42.470170  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 12:59:42.474442  3780 log.cc:927] Time spent T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.207s	user 0.000s	sys 0.000s
I20260709 12:59:42.462949  1497 leader_election.cc:304] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:42.499825  2223 raft_consensus.cc:2393] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 5: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 12:59:42.407408  2219 rpcz_store.cc:276] 0709 12:59:41.023177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:41.055177 (+ 32000us) service_pool.cc:224] Handling call
0709 12:59:42.406251 (+1351074us) spinlock_profiling.cc:243] Waited 715 ms on lock 0x7b5400680bd4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 12:59:42.406364 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1644428160}
I20260709 12:59:42.486209  1674 raft_consensus.cc:1240] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:42.462644  1644 leader_election.cc:304] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:42.497325  1496 leader_election.cc:400] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 election: Vote denied by peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217) with higher term. Message: Invalid argument: T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 4. Current term is 5.
W20260709 12:59:42.475123  1678 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49178 (request call id 1555) took 1254 ms (client timeout 1622 ms). Trace:
W20260709 12:59:42.504997  1678 rpcz_store.cc:269] 0709 12:59:41.220707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:41.221050 (+   343us) service_pool.cc:224] Handling call
0709 12:59:42.474929 (+1253879us) spinlock_profiling.cc:243] Waited 907 ms on lock 0x7b54000b90d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 12:59:42.475061 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2086739840}
W20260709 12:59:42.501286  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 243957us
I20260709 12:59:42.508630  1570 leader_election.cc:304] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 12:59:42.509363  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 46803.2us
I20260709 12:59:42.510021  1644 leader_election.cc:304] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 12:59:42.510090  1646 leader_election.cc:304] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
W20260709 12:59:42.511132  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:42.511905  1496 leader_election.cc:304] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:42.479239  3708 raft_consensus.cc:2749] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373) with higher term. Message: Invalid argument: T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 4. Current term is 5.
I20260709 12:59:42.517048  1570 leader_election.cc:304] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:42.518280  3645 consensus_queue.cc:1048] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:42.514297  3644 raft_consensus.cc:3060] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:42.518950  3776 consensus_queue.cc:1048] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:42.519868  1572 leader_election.cc:304] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:42.520357  1644 leader_election.cc:304] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:42.527061  1644 leader_election.cc:304] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 12:59:42.520797  2190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:42.531813  1644 leader_election.cc:304] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:42.532559  1678 raft_consensus.cc:1240] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:42.527359  1570 leader_election.cc:304] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 12:59:42.536103  1497 leader_election.cc:336] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Timed out: RequestConsensusVote RPC to 127.0.107.194:40303 timed out after 1.599s (SENT)
I20260709 12:59:42.496886  3703 consensus_queue.cc:1059] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 12:59:42.508932  3633 raft_consensus.cc:2749] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:42.481983  3729 consensus_queue.cc:1048] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 12:59:42.520910  3683 raft_consensus.cc:2764] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:59:42.541604  1530 raft_consensus.cc:1275] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:59:42.528616  3663 raft_consensus.cc:2804] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:42.541692  2190 leader_election.cc:304] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:42.483588  3655 raft_consensus.cc:515] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:42.522197  3716 raft_consensus.cc:3060] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:42.545176  1497 leader_election.cc:304] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:42.545317  1644 leader_election.cc:304] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 12:59:42.531308  3648 raft_consensus.cc:2749] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:42.503618  3314 consensus_queue.cc:1048] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 12:59:42.497138  3752 consensus_queue.cc:1048] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:59:42.527737  3756 raft_consensus.cc:2749] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:59:42.555145  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 190065us
I20260709 12:59:42.531638  3635 raft_consensus.cc:3060] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:42.545823  1526 raft_consensus.cc:1275] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:59:42.536620  3301 raft_consensus.cc:2749] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:42.539705  3679 raft_consensus.cc:2804] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:42.538581  3642 raft_consensus.cc:2804] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:42.540759  3757 raft_consensus.cc:2749] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:42.561674  1527 raft_consensus.cc:1275] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:59:42.559561  1646 leader_election.cc:304] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:42.572098  1570 leader_election.cc:304] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 12:59:42.562641  2192 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:40303 timed out after 1.905s (SENT) [suppressed 49 similar messages]
I20260709 12:59:42.551868  3729 consensus_queue.cc:1243] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer b96ce9cc496c49d7818fa983a17b062b log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:59:42.568818  1644 leader_election.cc:304] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 12:59:42.559640  3511 raft_consensus.cc:2749] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:42.570379  3640 raft_consensus.cc:2804] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:42.577358  3777 consensus_queue.cc:1059] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 12:59:42.553967  3663 raft_consensus.cc:493] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:42.585311  1644 leader_election.cc:304] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 12:59:42.562089  3711 raft_consensus.cc:3060] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:42.564559  3679 raft_consensus.cc:493] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:42.589984  1644 leader_election.cc:304] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 12:59:42.567735  3632 raft_consensus.cc:493] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:42.571434  3652 raft_consensus.cc:493] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:42.571234  3642 raft_consensus.cc:493] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:42.574232  3271 raft_consensus.cc:2804] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:42.602634  1570 leader_election.cc:304] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:42.604382  1570 leader_election.cc:304] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:42.586452  3663 raft_consensus.cc:3060] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:42.574038  3519 raft_consensus.cc:515] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:42.585269  3779 leader_election.cc:290] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:42.570976  3629 consensus_queue.cc:1048] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:59:42.586999  3301 consensus_queue.cc:1048] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 12:59:42.591566  3755 raft_consensus.cc:2749] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:59:42.642084  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:42.591723  3784 raft_consensus.cc:2804] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:42.599306  3657 raft_consensus.cc:2804] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:42.593472  3704 raft_consensus.cc:2804] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:42.599968  3679 raft_consensus.cc:3060] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:42.609920  3642 raft_consensus.cc:3060] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:42.612391  3776 raft_consensus.cc:2804] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:42.617525  3695 raft_consensus.cc:493] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:42.715121  3695 raft_consensus.cc:515] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:42.717545  3695 leader_election.cc:290] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:42.673004  1678 raft_consensus.cc:1240] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:42.719066  3776 raft_consensus.cc:493] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
W20260709 12:59:42.719527  3804 log.cc:927] Time spent T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
W20260709 12:59:42.720940  3794 log.cc:927] Time spent T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 12:59:42.611651  3652 raft_consensus.cc:515] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:42.612658  3792 consensus_queue.cc:1048] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.102s
I20260709 12:59:42.743774  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 423) took 1280 ms. Trace:
I20260709 12:59:42.747658  2226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50326 (request call id 567) took 2016 ms. Trace:
I20260709 12:59:42.707456  3744 leader_election.cc:290] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:42.641990  3648 raft_consensus.cc:2749] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:59:42.699956  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 79791.3us
I20260709 12:59:42.707731  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
W20260709 12:59:42.708632  1497 leader_election.cc:336] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Timed out: RequestConsensusVote RPC to 127.0.107.194:40303 timed out after 1.670s (SENT)
I20260709 12:59:42.704798  3784 raft_consensus.cc:493] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:42.709510  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 119608us
I20260709 12:59:42.611366  3632 raft_consensus.cc:515] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:42.744297  1605 rpcz_store.cc:276] 0709 12:59:41.463532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:41.887633 (+424101us) service_pool.cc:224] Handling call
0709 12:59:41.908529 (+ 20896us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:42.152632 (+244103us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:42.152681 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:42.343528 (+190847us) spinlock_profiling.cc:243] Waited 22.5 ms on lock 0x7b2c0012a788. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a16eaca11 00007f6a16ebc372 00007f6a185eea01 00007f6a185b343a 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2
0709 12:59:42.343956 (+   428us) log.cc:844] Serialized 26 byte log entry
0709 12:59:42.502183 (+158227us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:42.600203 (+ 98020us) log.cc:844] Serialized 14 byte log entry
0709 12:59:42.600399 (+   196us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:42.600468 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:42.721834 (+121366us) raft_consensus.cc:1685] finished
0709 12:59:42.743524 (+ 21690us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:42.743696 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":245072,"prepare.queue_time_us":82265,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":244511,"raft.run_cpu_time_us":230,"raft.run_wall_time_us":9021,"spinlock_wait_cycles":51693312,"thread_start_us":255406,"threads_started":2,"wal-append.queue_time_us":215797}
W20260709 12:59:42.750430  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 177221us
I20260709 12:59:42.560920  3775 consensus_queue.cc:1059] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 12:59:42.748147  2226 rpcz_store.cc:276] 0709 12:59:40.715937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:41.078073 (+362136us) service_pool.cc:224] Handling call
0709 12:59:42.390233 (+1312160us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:42.406760 (+ 16527us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:42.731713 (+324953us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b540070e9d0. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b28ad 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 12:59:42.731878 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3017243904}
I20260709 12:59:42.800050  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
W20260709 12:59:42.762956  3751 consensus_meta.cc:287] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.537s	user 0.002s	sys 0.008s
I20260709 12:59:42.719529  3776 raft_consensus.cc:3060] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:42.817059  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 12:59:42.766142  1497 leader_election.cc:304] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:42.731617  3779 raft_consensus.cc:2804] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:42.781854  1570 leader_election.cc:304] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:42.808326  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:42.723219  3657 raft_consensus.cc:697] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 3 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:42.759456  3271 raft_consensus.cc:697] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 5 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:42.810730  3744 raft_consensus.cc:3055] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:42.708446  3774 consensus_queue.cc:1048] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.089s
I20260709 12:59:42.811097  2221 raft_consensus.cc:1275] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:42.811705  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
W20260709 12:59:42.814788  3802 log.cc:927] Time spent T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
W20260709 12:59:42.815519  3797 log.cc:927] Time spent T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.228s	user 0.001s	sys 0.000s
I20260709 12:59:42.730924  3723 consensus_queue.cc:1059] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.073s
W20260709 12:59:42.838120  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:42.820178  1570 leader_election.cc:304] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 12:59:42.826599  3800 log.cc:927] Time spent T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.183s	user 0.001s	sys 0.000s
I20260709 12:59:42.801365  3784 raft_consensus.cc:3060] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:59:42.901811  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:42.903843  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:42.904709  1673 raft_consensus.cc:2393] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 5: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 12:59:42.906232  1677 raft_consensus.cc:1275] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:59:42.819571  3779 raft_consensus.cc:493] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
W20260709 12:59:42.913750  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 44923.3us
I20260709 12:59:42.840832  3744 raft_consensus.cc:740] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:42.851152  1570 leader_election.cc:304] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:42.844177  3511 raft_consensus.cc:2749] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:59:42.925691  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 225828us
I20260709 12:59:42.919601  1677 raft_consensus.cc:1275] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:59:42.822013  3729 raft_consensus.cc:2749] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:42.933161  1678 raft_consensus.cc:1275] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:59:42.856833  3719 raft_consensus.cc:493] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:42.858958  3751 raft_consensus.cc:2749] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:59:42.936352  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 84100.4us
I20260709 12:59:42.943661  3657 consensus_queue.cc:237] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:42.922315  3782 raft_consensus.cc:515] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:42.944955  3719 raft_consensus.cc:515] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 12:59:42.947597  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:42.914788  3655 leader_election.cc:290] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:42.916146  3779 raft_consensus.cc:3060] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:42.947821  1570 leader_election.cc:304] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:42.900244  3661 raft_consensus.cc:493] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:42.959656  1570 leader_election.cc:304] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:42.932008  3775 raft_consensus.cc:2749] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:59:42.963024  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:42.965493  1675 raft_consensus.cc:1240] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 5. Current term is 6. Ops: []
W20260709 12:59:42.959772  3791 log.cc:927] Time spent T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.229s	user 0.000s	sys 0.000s
I20260709 12:59:42.965996  3704 raft_consensus.cc:697] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 4 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:42.956614  3774 raft_consensus.cc:2764] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:59:42.974728  1570 leader_election.cc:304] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:42.977082  1570 leader_election.cc:304] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:42.977905  3729 consensus_queue.cc:1048] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:42.979264  3729 raft_consensus.cc:2749] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:42.980894  1570 leader_election.cc:304] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:42.981667  3755 raft_consensus.cc:2749] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:42.982344  3716 raft_consensus.cc:493] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:42.983574  3716 raft_consensus.cc:515] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:42.985596  3716 leader_election.cc:290] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:42.985646  1570 leader_election.cc:304] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:42.959371  3511 raft_consensus.cc:493] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:42.957840  3519 leader_election.cc:290] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:42.987792  1570 leader_election.cc:304] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:42.964327  3751 raft_consensus.cc:2804] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:43.000731  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:43.004161  3652 leader_election.cc:290] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:43.006441  3519 raft_consensus.cc:493] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:43.007047  3519 raft_consensus.cc:515] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 12:59:43.008533  3627 consensus_meta.cc:287] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.624s	user 0.009s	sys 0.000s
I20260709 12:59:42.992267  3271 consensus_queue.cc:237] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:42.962212  3661 raft_consensus.cc:515] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:43.010934  3661 leader_election.cc:290] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:42.997283  3511 raft_consensus.cc:515] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:43.013353  3806 raft_consensus.cc:493] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:43.013986  3806 raft_consensus.cc:515] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:43.016247  3806 leader_election.cc:290] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 12:59:43.018697  3788 log.cc:927] Time spent T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.270s	user 0.001s	sys 0.000s
I20260709 12:59:43.019081  3352 tablet_bootstrap.cc:492] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:42.990924  3775 raft_consensus.cc:2749] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:59:43.020177  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49170 (request call id 1627) took 1106 ms. Trace:
I20260709 12:59:43.020706  1681 rpcz_store.cc:276] 0709 12:59:41.913968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:41.914093 (+   125us) service_pool.cc:224] Handling call
0709 12:59:41.914439 (+   346us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:59:41.939397 (+ 24958us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:41.939429 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:59:42.215809 (+276380us) log.cc:844] Serialized 52 byte log entry
0709 12:59:42.456226 (+240417us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:42.456261 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:42.456319 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:43.019925 (+563606us) raft_consensus.cc:1685] finished
0709 12:59:43.019944 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:43.020097 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":194798,"raft.run_cpu_time_us":69,"raft.run_wall_time_us":68,"thread_start_us":231369,"threads_started":2,"wal-append.queue_time_us":290858}
I20260709 12:59:43.009171  3519 leader_election.cc:290] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:42.962702  3655 consensus_queue.cc:1048] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:59:43.020104  3352 tablet_bootstrap.cc:492] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap complete.
I20260709 12:59:43.034502  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:43.013734  3511 leader_election.cc:290] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:43.038609  3352 ts_tablet_manager.cc:1403] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b: Time spent bootstrapping tablet: real 3.536s	user 0.042s	sys 0.048s
I20260709 12:59:43.039271  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:43.040370  3663 raft_consensus.cc:515] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:43.006920  3632 leader_election.cc:290] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:42.996011  3729 raft_consensus.cc:2749] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:43.047617  1605 raft_consensus.cc:1240] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 5 LEADER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:43.049751  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:43.020102  3811 raft_consensus.cc:493] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:42.996878  3757 raft_consensus.cc:2749] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:43.043504  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
W20260709 12:59:43.058007  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 261188us
W20260709 12:59:42.998865  3795 log.cc:927] Time spent T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.351s	user 0.002s	sys 0.000s
I20260709 12:59:43.062232  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
W20260709 12:59:43.021042  3805 log.cc:927] Time spent T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.180s	user 0.001s	sys 0.000s
W20260709 12:59:43.059446  3724 consensus_meta.cc:287] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent flushing consensus metadata: real 0.559s	user 0.006s	sys 0.003s
W20260709 12:59:43.049784  3644 consensus_meta.cc:287] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent flushing consensus metadata: real 0.519s	user 0.009s	sys 0.000s
W20260709 12:59:43.055124  3690 consensus_meta.cc:287] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b: Time spent flushing consensus metadata: real 0.584s	user 0.005s	sys 0.004s
I20260709 12:59:42.967026  3744 consensus_queue.cc:260] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:43.042634  3663 leader_election.cc:290] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:43.119594  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:43.121734  3644 raft_consensus.cc:2749] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:43.065095  3811 raft_consensus.cc:515] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:43.021898  3704 consensus_queue.cc:237] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:43.127974  1600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36200 (request call id 1771) took 1355 ms. Trace:
W20260709 12:59:43.140918  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 219773us
I20260709 12:59:43.143920  1600 rpcz_store.cc:276] 0709 12:59:41.772398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:42.158530 (+386132us) service_pool.cc:224] Handling call
0709 12:59:42.176146 (+ 17616us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:42.176380 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:42.176402 (+    22us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:42.346592 (+170190us) spinlock_profiling.cc:243] Waited 33.1 ms on lock 0x7b2c0012a788. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a16eaca11 00007f6a16ebc372 00007f6a185eea01 00007f6a185b343a 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2
0709 12:59:42.347012 (+   420us) log.cc:844] Serialized 26 byte log entry
0709 12:59:42.529216 (+182204us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:59:42.529254 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:42.529319 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:42.843244 (+313925us) spinlock_profiling.cc:243] Waited 33.4 ms on lock 0x7b4400022b4c. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a153ecc85 00007f6a153ed6a2 00007f6a1815f1db 00007f6a1815aaaf 00007f6a1814e86e 00007f6a1814dbb6 00007f6a1814d7d8 00007f6a18157221 00007f6a181571d9 00007f6a18157169
0709 12:59:43.127741 (+284497us) raft_consensus.cc:1685] finished
0709 12:59:43.127766 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:43.127909 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":152896128,"thread_start_us":181824,"threads_started":1,"wal-append.queue_time_us":223932}
I20260709 12:59:43.054582  3642 raft_consensus.cc:515] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:59:43.154577  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:43.155736  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:43.133766  3755 consensus_queue.cc:1048] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.105s
I20260709 12:59:43.125017  3690 raft_consensus.cc:515] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 12:59:43.366097  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:43.356457  3677 raft_consensus.cc:3055] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:43.367871  3677 raft_consensus.cc:740] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
W20260709 12:59:43.368203  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:43.359959  3799 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.698s	user 0.031s	sys 0.028s
W20260709 12:59:43.369131  3818 log.cc:927] Time spent T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
I20260709 12:59:43.368772  3677 consensus_queue.cc:260] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 12:59:43.364029  2190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:43.370077  3677 raft_consensus.cc:3060] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:59:43.355582  3833 log.cc:927] Time spent T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:59:43.154700  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 12:59:43.351666  3776 consensus_meta.cc:287] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.530s	user 0.010s	sys 0.009s
I20260709 12:59:43.373885  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:43.292932  3813 raft_consensus.cc:493] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:43.302874  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:43.285089  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 201885us
I20260709 12:59:43.373730  3776 raft_consensus.cc:515] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 12:59:43.377087  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:43.228938  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 12:59:43.377743  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
W20260709 12:59:43.369047  3799 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.707s	user 0.031s	sys 0.028s
I20260709 12:59:43.227552  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:43.379271  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:43.383765  1606 raft_consensus.cc:2393] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 4: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
W20260709 12:59:43.376874  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 117586us
W20260709 12:59:43.331104  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 177066us
I20260709 12:59:43.378858  1681 raft_consensus.cc:1275] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:59:43.121479  3724 raft_consensus.cc:515] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
W20260709 12:59:44.216995  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:43.384769  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:44.222805  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
W20260709 12:59:43.466380  1672 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.646s	user 0.017s	sys 0.053s
I20260709 12:59:43.405658  2192 leader_election.cc:304] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
W20260709 12:59:43.790781  3635 consensus_meta.cc:287] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 1.226s	user 0.011s	sys 0.001s
I20260709 12:59:43.256274  2221 pending_rounds.cc:85] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b: Aborting all ops after (but not including) 4
I20260709 12:59:43.377789  3642 leader_election.cc:290] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:44.275043  3632 raft_consensus.cc:493] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:43.398132  3657 consensus_queue.cc:1059] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.893s
I20260709 12:59:44.276965  1646 leader_election.cc:304] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 12:59:43.156432  3655 raft_consensus.cc:493] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:43.385367  1496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:44.276328  3632 raft_consensus.cc:515] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:43.293829  3719 leader_election.cc:290] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:43.363436  3727 raft_consensus.cc:3055] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:44.280530  3727 raft_consensus.cc:740] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:43.146430  3679 raft_consensus.cc:515] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:44.283085  3820 raft_consensus.cc:493] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:43.392663  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:44.283967  3820 raft_consensus.cc:515] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:44.285977  3679 leader_election.cc:290] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:43.447180  3777 raft_consensus.cc:493] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:44.287537  3519 raft_consensus.cc:493] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:44.288511  3519 raft_consensus.cc:515] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:44.289038  3776 leader_election.cc:290] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:44.290200  3704 raft_consensus.cc:493] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:43.300055  3816 consensus_queue.cc:1059] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.999s
I20260709 12:59:44.291529  3809 raft_consensus.cc:493] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 12:59:44.291672  3677 raft_consensus.cc:493] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:44.292196  3809 raft_consensus.cc:515] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:44.292630  3677 raft_consensus.cc:515] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:43.366827  3629 consensus_queue.cc:1048] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.910s
I20260709 12:59:44.275365  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36200 (request call id 1779) took 1238 ms. Trace:
I20260709 12:59:43.586308  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:43.204736  3661 consensus_queue.cc:1048] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 1.093s
I20260709 12:59:44.298146  3815 raft_consensus.cc:3055] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:43.374799  3813 raft_consensus.cc:515] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:44.298763  3815 raft_consensus.cc:740] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:44.276126  1677 raft_consensus.cc:1240] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:44.287118  3676 raft_consensus.cc:493] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:44.300961  3708 raft_consensus.cc:493] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:44.301890  3708 raft_consensus.cc:515] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:43.467234  3352 raft_consensus.cc:359] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:59:44.356509  3352 raft_consensus.cc:740] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Initialized, Role: LEARNER
I20260709 12:59:44.357254  3519 leader_election.cc:290] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:44.358148  1600 raft_consensus.cc:2468] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 3.
I20260709 12:59:44.358750  3809 leader_election.cc:290] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
W20260709 12:59:43.879266  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:44.359449  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 82997.2us
W20260709 12:59:44.360455  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:44.361228  3817 log.cc:927] Time spent T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 1.113s	user 0.013s	sys 0.000s
W20260709 12:59:44.362532  1672 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.477s	user 0.020s	sys 0.067s
I20260709 12:59:43.446329  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:44.364650  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36194 (request call id 1360) took 1320 ms. Trace:
I20260709 12:59:44.365012  1604 rpcz_store.cc:276] 0709 12:59:43.044388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:43.379144 (+334756us) service_pool.cc:224] Handling call
0709 12:59:44.364482 (+985338us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:44.365979  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 12:59:43.781214  3779 consensus_meta.cc:287] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.816s	user 0.007s	sys 0.000s
I20260709 12:59:44.304421  3635 raft_consensus.cc:2749] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:43.797734  3690 leader_election.cc:290] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 4 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
W20260709 12:59:43.427394  3711 consensus_meta.cc:287] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.831s	user 0.010s	sys 0.000s
I20260709 12:59:43.585438  3812 raft_consensus.cc:493] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:43.279991  3663 raft_consensus.cc:493] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:44.300549  3676 raft_consensus.cc:515] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 12:59:44.175015  1601 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.894s	user 0.019s	sys 0.018s
I20260709 12:59:44.287093  3511 raft_consensus.cc:493] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:44.307788  2221 pending_rounds.cc:107] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 12:59:44.354244  3819 raft_consensus.cc:493] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:44.354676  1606 raft_consensus.cc:3060] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:44.299587  3814 raft_consensus.cc:2804] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:59:44.355983  3839 log.cc:927] Time spent T 00000000000000000000000000000000 P 9f38d0e5c9db43a48554defe1153354e: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 12:59:44.357573  3352 consensus_queue.cc:260] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:59:43.220139  3811 leader_election.cc:290] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:44.282084  3632 leader_election.cc:290] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:44.358939  1600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36194 (request call id 1361) took 1314 ms. Trace:
I20260709 12:59:44.282176  3727 consensus_queue.cc:260] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:43.464713  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:44.286558  3820 leader_election.cc:290] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:43.390506  3723 raft_consensus.cc:493] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:44.390789  3834 raft_consensus.cc:493] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:44.391359  3723 raft_consensus.cc:515] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:44.391705  3834 raft_consensus.cc:515] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:44.300347  3831 raft_consensus.cc:493] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:44.392481  3719 raft_consensus.cc:2749] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:44.291145  3644 raft_consensus.cc:493] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:44.390332  3679 raft_consensus.cc:493] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:44.393311  3644 raft_consensus.cc:515] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:44.393628  3679 raft_consensus.cc:515] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:43.589025  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:44.388084  2226 raft_consensus.cc:3060] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 4 LEARNER]: Advancing to term 6
I20260709 12:59:44.395197  1605 raft_consensus.cc:2468] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 3.
W20260709 12:59:44.395803  1605 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36194 (request call id 1363) took 1350 ms (client timeout 1541 ms). Trace:
I20260709 12:59:44.377732  3832 raft_consensus.cc:493] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:44.276238  3271 raft_consensus.cc:493] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:44.388381  1600 rpcz_store.cc:276] 0709 12:59:43.044627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:43.382965 (+338338us) service_pool.cc:224] Handling call
0709 12:59:44.358809 (+975844us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:44.377383  3711 raft_consensus.cc:2749] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:44.356451  3677 leader_election.cc:290] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:44.383374  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:44.381585  2221 raft_consensus.cc:2889] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:44.384397  3657 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:44.384696  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 100333us
W20260709 12:59:44.384966  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 979323us
I20260709 12:59:44.387068  3676 leader_election.cc:290] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 12:59:44.387609  2190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:43.217939  3751 raft_consensus.cc:697] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 5 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:44.390331  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49178 (request call id 1571) took 1003 ms. Trace:
I20260709 12:59:44.291143  3704 raft_consensus.cc:515] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:44.393920  3779 raft_consensus.cc:515] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 12:59:44.383013  1601 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.121s	user 0.028s	sys 0.022s
I20260709 12:59:44.377592  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:44.301136  3813 leader_election.cc:290] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:43.151144  3709 raft_consensus.cc:493] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:44.306213  3724 leader_election.cc:290] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:44.397768  3831 raft_consensus.cc:515] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:44.442472  3727 raft_consensus.cc:3060] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:44.443377  3831 leader_election.cc:290] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 12:59:44.396222  1605 rpcz_store.cc:269] 0709 12:59:43.045067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:43.060567 (+ 15500us) service_pool.cc:224] Handling call
0709 12:59:43.588832 (+528265us) spinlock_profiling.cc:243] Waited 1.87 ms on lock 0x7b5800017198. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a1548eb71 00007f6a1548ea22 00007f6a1e3a7c09 00007f6a1d501ee0 00007f6a1d5cb0ab 00007f6a1d5cb131 00007f6a1d5790a0 00007f6a1d578984 00007f6a16af36d4 00007f6a16af3662
0709 12:59:44.395730 (+806898us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4304256}
I20260709 12:59:44.401366  1679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50664 (request call id 390) took 2639 ms. Trace:
I20260709 12:59:44.402038  3814 raft_consensus.cc:697] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 5 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:44.401639  3663 raft_consensus.cc:515] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:44.402976  3828 consensus_queue.cc:1048] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:43.286963  3789 raft_consensus.cc:493] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:44.412727  3661 consensus_queue.cc:1048] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 12:59:44.296779  1607 rpcz_store.cc:276] 0709 12:59:43.036471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:43.061718 (+ 25247us) service_pool.cc:224] Handling call
0709 12:59:44.222266 (+1160548us) spinlock_profiling.cc:243] Waited 2.25 ms on lock 0x7b5800017198. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a1548eb71 00007f6a1548ea22 00007f6a1e3a7c09 00007f6a1d501ee0 00007f6a1d5cb0ab 00007f6a1d5cb131 00007f6a1d5790a0 00007f6a1d578984 00007f6a16af36d4 00007f6a16af3662
0709 12:59:44.275203 (+ 52937us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5175168}
I20260709 12:59:44.396099  3679 leader_election.cc:290] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:43.256639  3821 raft_consensus.cc:493] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:43.288698  3782 leader_election.cc:290] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:44.413130  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:44.413112  1678 raft_consensus.cc:2468] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 6.
I20260709 12:59:44.383919  3511 raft_consensus.cc:515] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:44.437285  3806 raft_consensus.cc:493] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:44.354650  3655 raft_consensus.cc:515] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:44.416607  1681 rpcz_store.cc:276] 0709 12:59:43.376934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:43.378274 (+  1340us) service_pool.cc:224] Handling call
0709 12:59:43.378551 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:44.296039 (+917488us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:44.380780 (+ 84741us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:44.387750  3816 raft_consensus.cc:3055] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:44.437786  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:44.300401  3815 consensus_queue.cc:260] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:44.445075  1679 rpcz_store.cc:276] 0709 12:59:41.761443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:41.762610 (+  1167us) service_pool.cc:224] Handling call
0709 12:59:41.762969 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:42.307427 (+544458us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:44.398555 (+2091128us) spinlock_profiling.cc:243] Waited 543 ms on lock 0x7b54003e6f54. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 12:59:44.401144 (+  2589us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1248086400}
I20260709 12:59:44.377589  3777 raft_consensus.cc:515] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:44.453358  1600 raft_consensus.cc:2468] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 3.
I20260709 12:59:44.453969  1600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36194 (request call id 1374) took 1084 ms. Trace:
I20260709 12:59:44.454344  1600 rpcz_store.cc:276] 0709 12:59:43.369865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:44.437266 (+1067401us) service_pool.cc:224] Handling call
0709 12:59:44.453880 (+ 16614us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:44.456705  1604 raft_consensus.cc:2410] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:59:44.453965  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:44.387699  3812 raft_consensus.cc:515] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:44.417716  3677 raft_consensus.cc:493] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:44.460337  1677 raft_consensus.cc:2393] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 5: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 12:59:44.462291  3841 raft_consensus.cc:493] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:44.463570  3663 leader_election.cc:290] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:44.463404  3841 raft_consensus.cc:515] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 12:59:44.461826  1604 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36194 (request call id 1356) took 1416 ms (client timeout 1840 ms). Trace:
W20260709 12:59:44.464962  1604 rpcz_store.cc:269] 0709 12:59:43.043377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:44.366288 (+1322911us) service_pool.cc:224] Handling call
0709 12:59:44.459829 (+ 93541us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:44.457623  3819 raft_consensus.cc:515] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:44.467134  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36200 (request call id 1778) took 1431 ms. Trace:
I20260709 12:59:44.467635  1673 raft_consensus.cc:2468] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 3.
I20260709 12:59:44.454970  3816 raft_consensus.cc:740] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:44.471591  3814 consensus_queue.cc:237] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:44.501051  3511 leader_election.cc:290] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:44.453617  3271 raft_consensus.cc:515] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:43.243460  3784 raft_consensus.cc:515] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:44.503080  1679 raft_consensus.cc:2368] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 3. Current term is 4.
I20260709 12:59:44.451046  3657 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:59:44.485857  3819 leader_election.cc:290] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:44.472644  3832 raft_consensus.cc:515] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:44.504190  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:44.503715  1680 raft_consensus.cc:2393] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 6: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 12:59:44.506021  3832 leader_election.cc:290] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:44.506285  3784 leader_election.cc:290] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:44.507902  3655 leader_election.cc:290] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:44.447882  3519 consensus_queue.cc:1059] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.061s
I20260709 12:59:44.510044  3723 leader_election.cc:290] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:44.511365  3782 raft_consensus.cc:493] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:44.511559  1646 leader_election.cc:304] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
W20260709 12:59:44.466553  3786 log.cc:927] Time spent T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 1.946s	user 0.005s	sys 0.014s
I20260709 12:59:44.512096  3782 raft_consensus.cc:515] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:44.474747  3705 consensus_queue.cc:1059] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:44.513690  3705 raft_consensus.cc:3055] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:44.514060  3705 raft_consensus.cc:740] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 12:59:44.515178  3705 consensus_queue.cc:260] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:44.516656  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:44.517794  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:44.437772  3820 consensus_queue.cc:1059] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 12:59:44.458170  3789 raft_consensus.cc:515] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:44.519058  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:44.519768  2227 raft_consensus.cc:2468] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 5.
I20260709 12:59:44.520088  3705 raft_consensus.cc:3060] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:44.520643  3789 leader_election.cc:290] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:44.521325  3789 raft_consensus.cc:2749] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:44.481257  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:44.522176  1677 raft_consensus.cc:2468] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 2.
I20260709 12:59:44.518270  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:44.523011  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:44.523196  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:44.481895  1673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49178 (request call id 1574) took 1097 ms. Trace:
I20260709 12:59:44.523859  1673 rpcz_store.cc:276] 0709 12:59:43.384319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:43.384518 (+   199us) service_pool.cc:224] Handling call
0709 12:59:44.481810 (+1097292us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:44.524677  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:44.525115  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:44.525707  1673 raft_consensus.cc:2468] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 2.
I20260709 12:59:44.527143  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:44.528018  2220 raft_consensus.cc:2468] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 4.
I20260709 12:59:44.474413  3644 leader_election.cc:290] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:44.483144  3806 raft_consensus.cc:515] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:44.483919  3777 leader_election.cc:290] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:44.484222  3632 raft_consensus.cc:493] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:44.485783  1606 raft_consensus.cc:2468] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 3.
I20260709 12:59:44.487167  3352 ts_tablet_manager.cc:1434] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b: Time spent starting tablet: real 1.431s	user 0.009s	sys 0.006s
I20260709 12:59:44.468603  1678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49178 (request call id 1573) took 1078 ms. Trace:
I20260709 12:59:44.488476  3816 consensus_queue.cc:260] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:44.512444  3828 raft_consensus.cc:493] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:44.505519  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:44.462095  3679 raft_consensus.cc:493] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:44.482519  3812 leader_election.cc:290] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 12:59:44.510035  1570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:44.526588  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:44.539841  1679 raft_consensus.cc:2468] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 5.
I20260709 12:59:44.537708  3843 raft_consensus.cc:493] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:44.528486  2226 raft_consensus.cc:1275] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 6 LEARNER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:59:44.467563  3841 leader_election.cc:290] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:44.467583  1601 rpcz_store.cc:276] 0709 12:59:43.036112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:43.048494 (+ 12382us) service_pool.cc:224] Handling call
0709 12:59:43.074923 (+ 26429us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:43.124967 (+ 50044us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:59:43.233454 (+108487us) log.cc:844] Serialized 14 byte log entry
0709 12:59:44.454440 (+1220986us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:44.454548 (+   108us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:44.466748 (+ 12200us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:44.466868 (+   120us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:44.467047 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":60047,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":45,"raft.queue_time_us":3413,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":4329,"thread_start_us":1178340,"threads_started":1,"wal-append.queue_time_us":1147527}
I20260709 12:59:44.543951  1673 raft_consensus.cc:2393] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 5: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 12:59:44.539654  1678 rpcz_store.cc:276] 0709 12:59:43.380934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:43.381166 (+   232us) service_pool.cc:224] Handling call
0709 12:59:44.457218 (+1076052us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:44.543664  3632 raft_consensus.cc:515] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:44.544062  3519 raft_consensus.cc:3055] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:44.544288  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:44.546633  1646 leader_election.cc:304] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:44.503625  3271 leader_election.cc:290] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 12:59:44.546962  1606 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36194 (request call id 1369) took 1421 ms (client timeout 1754 ms). Trace:
I20260709 12:59:44.552242  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 12:59:44.550634  1606 rpcz_store.cc:269] 0709 12:59:43.125676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:43.395228 (+269552us) service_pool.cc:224] Handling call
0709 12:59:44.542224 (+1146996us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:44.553393  2220 raft_consensus.cc:2393] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 3: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 12:59:44.552625  3709 raft_consensus.cc:515] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:44.554705  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:44.558204  1646 leader_election.cc:304] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
W20260709 12:59:44.541361  3352 ts_tablet_manager.cc:1467] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b: Tablet startup took 1493ms
I20260709 12:59:44.559331  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:44.560611  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:44.547674  3519 raft_consensus.cc:740] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 12:59:44.550170  3834 leader_election.cc:290] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:44.570029  3709 leader_election.cc:290] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:44.570525  3828 raft_consensus.cc:515] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:44.573447  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:44.573872  1527 raft_consensus.cc:1275] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:59:44.574527  3782 leader_election.cc:290] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:44.575529  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:44.575773  3519 consensus_queue.cc:260] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:44.576289  1528 raft_consensus.cc:2468] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 4.
I20260709 12:59:44.581781  3820 raft_consensus.cc:493] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:44.572281  2219 raft_consensus.cc:1275] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:59:44.556447  3777 raft_consensus.cc:493] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:44.549837  3677 raft_consensus.cc:515] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:44.582471  3820 raft_consensus.cc:515] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:44.576709  3271 raft_consensus.cc:2804] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:44.570562  3679 raft_consensus.cc:515] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:44.576916  3814 raft_consensus.cc:2804] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:44.603889  1606 raft_consensus.cc:3060] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:44.605177  1679 raft_consensus.cc:1275] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:59:44.605790  3816 raft_consensus.cc:3060] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:44.606508  3708 leader_election.cc:290] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 12:59:44.560518  3352 ts_tablet_manager.cc:1469] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b: Trace:
0709 12:59:26.563969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:26.569014 (+  5045us) service_pool.cc:224] Handling call
0709 12:59:27.083675 (+514661us) ts_tablet_manager.cc:934] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b: Initiating tablet copy from peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
0709 12:59:29.639820 (+2556145us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:59:30.257219 (+617399us) tablet_metadata.cc:665] Metadata flushed
0709 12:59:30.257366 (+   147us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:59:31.238513 (+981147us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:59:31.238843 (+   330us) tablet_replica.cc:206] Creating consensus instance
0709 12:59:32.594150 (+1355307us) ts_tablet_manager.cc:989] Replica registered.
0709 12:59:32.594219 (+    69us) inbound_call.cc:177] Queueing success response
0709 12:59:39.502137 (+6907918us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:59:43.056449 (+3554312us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:59:43.147383 (+ 90934us) tablet_replica.cc:261] Starting instrumentation
0709 12:59:43.148004 (+   621us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":112483,"mutex_wait_us":184753,"raft.queue_time_us":31569,"raft.run_cpu_time_us":221,"raft.run_wall_time_us":225,"tablet-copy.queue_time_us":220626,"tablet-download-pool.queue_time_us":970,"tablet-download-pool.run_cpu_time_us":7252,"tablet-download-pool.run_wall_time_us":6528201,"thread_start_us":253233,"threads_started":2}
I20260709 12:59:44.602368  3777 raft_consensus.cc:515] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:44.605371  1605 raft_consensus.cc:2468] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 3.
I20260709 12:59:44.581799  3519 raft_consensus.cc:3060] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:59:44.608214  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 54870.9us
I20260709 12:59:44.612147  3814 raft_consensus.cc:493] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:44.612634  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:44.618460  1606 raft_consensus.cc:2468] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 4.
W20260709 12:59:44.621069  1606 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36194 (request call id 1377) took 1250 ms (client timeout 1655 ms). Trace:
I20260709 12:59:44.609572  3271 raft_consensus.cc:493] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:44.605443  3842 log.cc:927] Time spent T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 12:59:44.622257  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:44.620779  1604 raft_consensus.cc:3060] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:44.622610  3814 raft_consensus.cc:3060] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:59:44.621431  1606 rpcz_store.cc:269] 0709 12:59:43.371076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:44.554338 (+1183262us) service_pool.cc:224] Handling call
0709 12:59:44.621001 (+ 66663us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:44.622278  3271 raft_consensus.cc:3060] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:44.638698  1677 raft_consensus.cc:2410] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 12:59:44.623732  1605 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36194 (request call id 1368) took 1500 ms (client timeout 1805 ms). Trace:
W20260709 12:59:44.639618  1605 rpcz_store.cc:269] 0709 12:59:43.119259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:44.462034 (+1342775us) service_pool.cc:224] Handling call
0709 12:59:44.619700 (+157666us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:44.641158  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:44.642127  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:44.642484  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:44.642712  3633 raft_consensus.cc:3055] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:44.642905  1528 raft_consensus.cc:2468] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 3.
I20260709 12:59:44.616096  2221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50310 (request call id 503) took 1452 ms. Trace:
I20260709 12:59:44.622439  3834 raft_consensus.cc:493] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:44.643189  3633 raft_consensus.cc:740] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 12:59:44.652226  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:44.651978  3633 consensus_queue.cc:260] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:44.652976  1525 raft_consensus.cc:3060] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:44.653489  3633 raft_consensus.cc:3060] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:44.652364  3819 raft_consensus.cc:493] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:44.562884  3843 raft_consensus.cc:515] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:44.634940  3815 raft_consensus.cc:3060] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:44.658279  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:44.638130  3692 raft_consensus.cc:493] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:44.653360  3655 consensus_queue.cc:1048] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 12:59:44.666163  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:44.667636  3314 raft_consensus.cc:493] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:44.652302  3679 leader_election.cc:290] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:44.663976  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36194 (request call id 1378) took 1292 ms. Trace:
I20260709 12:59:44.672521  3645 raft_consensus.cc:493] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:44.676162  3819 raft_consensus.cc:515] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:44.683220  1605 rpcz_store.cc:276] 0709 12:59:43.371439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:44.647977 (+1276538us) service_pool.cc:224] Handling call
0709 12:59:44.663908 (+ 15931us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:44.685338  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:44.622745  3821 raft_consensus.cc:515] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:44.689659  3692 raft_consensus.cc:515] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:44.664711  1672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49170 (request call id 1639) took 1979 ms. Trace:
I20260709 12:59:44.708797  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:44.702095  1680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49178 (request call id 1572) took 1324 ms. Trace:
I20260709 12:59:44.702751  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
W20260709 12:59:44.704758  2192 leader_election.cc:336] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Timed out: RequestConsensusVote RPC to 127.0.107.194:40303 timed out after 1.760s (SENT)
I20260709 12:59:44.706173  3777 leader_election.cc:290] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:44.716035  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:44.673413  3776 raft_consensus.cc:493] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:44.710634  1680 rpcz_store.cc:276] 0709 12:59:43.377282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:43.379037 (+  1755us) service_pool.cc:224] Handling call
0709 12:59:44.701850 (+1322813us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b54002553d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 12:59:44.702018 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2574566784}
I20260709 12:59:44.706763  1672 rpcz_store.cc:276] 0709 12:59:42.680553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:42.684622 (+  4069us) service_pool.cc:224] Handling call
0709 12:59:42.737778 (+ 53156us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:44.363320 (+1625542us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:44.363374 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:44.364231 (+   857us) log.cc:844] Serialized 26 byte log entry
0709 12:59:44.390158 (+ 25927us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:44.407111 (+ 16953us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:44.436042 (+ 28931us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:44.634818 (+198776us) raft_consensus.cc:1685] finished
0709 12:59:44.634857 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:44.660179 (+ 25322us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":171553,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":18895,"thread_start_us":1578064,"threads_started":2,"wal-append.queue_time_us":91429}
I20260709 12:59:44.668478  3314 raft_consensus.cc:515] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:59:44.726359  1531 raft_consensus.cc:1275] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:44.729964  2191 leader_election.cc:304] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:44.730319  1530 raft_consensus.cc:2468] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 2.
I20260709 12:59:44.729178  3776 raft_consensus.cc:515] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 12:59:44.731359  1674 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49170 (request call id 1640) took 2012 ms (client timeout 2133 ms). Trace:
W20260709 12:59:44.731807  1674 rpcz_store.cc:269] 0709 12:59:42.707145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:42.707433 (+   288us) service_pool.cc:224] Handling call
0709 12:59:44.690225 (+1982792us) spinlock_profiling.cc:243] Waited 615 ms on lock 0x7b5400372654. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 12:59:44.719459 (+ 29234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1414081408}
I20260709 12:59:44.732987  3776 leader_election.cc:290] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:44.733866  1530 raft_consensus.cc:1240] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:59:44.735442  3679 consensus_queue.cc:1048] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:44.737738  1525 raft_consensus.cc:2468] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 6.
I20260709 12:59:44.739317  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43010 (request call id 1667) took 3612 ms. Trace:
I20260709 12:59:44.739681  3819 leader_election.cc:290] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:44.647382  2221 rpcz_store.cc:276] 0709 12:59:43.152705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:43.154730 (+  2025us) service_pool.cc:224] Handling call
0709 12:59:43.232230 (+ 77500us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:59:44.472898 (+1240668us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:44.472946 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:59:44.473794 (+   848us) log.cc:844] Serialized 52 byte log entry
0709 12:59:44.556093 (+ 82299us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:44.557687 (+  1594us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:44.562419 (+  4732us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:44.581138 (+ 18719us) raft_consensus.cc:1685] finished
0709 12:59:44.590283 (+  9145us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:44.604641 (+ 14358us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6840,"raft.queue_time_us":11621,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":131,"thread_start_us":71319,"threads_started":1,"wal-append.queue_time_us":77923}
I20260709 12:59:44.716214  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:44.717628  3704 leader_election.cc:290] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:44.745318  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:44.745697  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:44.746976  3677 leader_election.cc:290] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:44.747735  1526 raft_consensus.cc:3060] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:44.748425  1606 raft_consensus.cc:2393] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 3: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 12:59:44.698393  3834 raft_consensus.cc:515] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:44.748165  3645 raft_consensus.cc:515] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:44.757395  1605 raft_consensus.cc:2468] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 3.
I20260709 12:59:44.755623  2226 raft_consensus.cc:2468] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 2.
I20260709 12:59:44.757824  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:44.799106  1680 raft_consensus.cc:2468] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 2.
W20260709 12:59:44.756628  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 51962.5us
I20260709 12:59:44.740386  3751 consensus_queue.cc:237] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:59:44.760254  1496 leader_election.cc:400] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 election: Vote denied by peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217) with higher term. Message: Invalid argument: T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 3. Current term is 4.
W20260709 12:59:44.766899  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:44.801133  1605 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36194 (request call id 1380) took 1428 ms (client timeout 1818 ms). Trace:
I20260709 12:59:44.726471  3843 leader_election.cc:290] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 12:59:44.804253  1605 rpcz_store.cc:269] 0709 12:59:43.372413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:44.688474 (+1316061us) service_pool.cc:224] Handling call
0709 12:59:44.801085 (+112611us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:44.816394  1496 leader_election.cc:403] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:59:44.747643  3314 leader_election.cc:290] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:44.818703  1678 raft_consensus.cc:2468] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 3.
I20260709 12:59:44.820942  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:44.821709  1678 raft_consensus.cc:2410] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:59:44.819010  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:44.824723  3271 raft_consensus.cc:515] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:44.739748  1529 rpcz_store.cc:276] 0709 12:59:41.126272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:41.253328 (+127056us) service_pool.cc:224] Handling call
0709 12:59:41.253610 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:42.360705 (+1107095us) spinlock_profiling.cc:243] Waited 7.46 ms on lock 0x7b1800077740. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1e38ede1 00007f6a1e39b5b1 00007f6a154942a6 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a1852e858 00007f6a185b2e9d 00007f6a185b283e
0709 12:59:42.361159 (+   454us) spinlock_profiling.cc:243] Waited 8.49 ms on lock 0x7b54004860a0. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a1852e858 00007f6a185b2e9d 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c
0709 12:59:42.361217 (+    58us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:59:42.361529 (+   312us) log.cc:844] Serialized 14 byte log entry
0709 12:59:42.405329 (+ 43800us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:42.405401 (+    72us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:59:42.405448 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:44.738883 (+2333435us) spinlock_profiling.cc:243] Waited 413 ms on lock 0x7b54000c21d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 12:59:44.738960 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:44.739145 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13013,"prepare.queue_time_us":177,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":9166,"raft.run_cpu_time_us":205,"raft.run_wall_time_us":6570,"spinlock_wait_cycles":987310080}
I20260709 12:59:44.827214  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:44.827874  1529 raft_consensus.cc:3060] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:44.828172  1681 raft_consensus.cc:2393] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 5: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 12:59:44.829917  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:44.831141  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:44.831700  1680 raft_consensus.cc:2468] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 3.
I20260709 12:59:44.832495  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:44.833479  1526 raft_consensus.cc:2468] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 4.
I20260709 12:59:44.833855  3777 raft_consensus.cc:493] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:44.834106  3519 raft_consensus.cc:493] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:44.833633  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:44.853649  1526 raft_consensus.cc:1275] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:59:44.857070  3843 raft_consensus.cc:3060] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:44.857138  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 222870us
I20260709 12:59:44.808744  3819 raft_consensus.cc:2804] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:44.862597  1680 raft_consensus.cc:2393] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 9: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
W20260709 12:59:44.866778  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 231536us
I20260709 12:59:44.866175  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:44.871970  1605 raft_consensus.cc:2410] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:59:44.852900  3519 raft_consensus.cc:515] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:44.834477  3777 raft_consensus.cc:515] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:44.873600  2191 leader_election.cc:304] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:44.861639  1496 leader_election.cc:304] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:44.876910  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:44.865411  3776 raft_consensus.cc:493] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:44.891335  3776 raft_consensus.cc:515] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:44.893240  2191 leader_election.cc:304] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:44.893481  3776 leader_election.cc:290] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:44.865325  3819 raft_consensus.cc:493] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:44.894115  3819 raft_consensus.cc:3060] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:59:44.880733  1605 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36194 (request call id 1382) took 1492 ms (client timeout 1840 ms). Trace:
W20260709 12:59:44.882107  3640 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.113s	user 0.014s	sys 0.007s
W20260709 12:59:44.894353  3853 log.cc:927] Time spent T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
W20260709 12:59:44.894639  3640 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.287s	user 0.014s	sys 0.008s
I20260709 12:59:44.895018  3640 raft_consensus.cc:697] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 5 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 12:59:44.896158  3640 consensus_queue.cc:237] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:44.896867  3698 raft_consensus.cc:2804] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:44.897286  3698 raft_consensus.cc:493] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:44.897605  3698 raft_consensus.cc:3060] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:44.882285  3755 raft_consensus.cc:493] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:44.883876  3834 leader_election.cc:290] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:44.888123  3645 leader_election.cc:290] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:44.863672  1601 raft_consensus.cc:2468] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 3.
I20260709 12:59:44.889091  3271 leader_election.cc:290] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 12:59:44.898278  1605 rpcz_store.cc:269] 0709 12:59:43.384498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:44.816605 (+1432107us) service_pool.cc:224] Handling call
0709 12:59:44.876954 (+ 60349us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:44.896175  1673 raft_consensus.cc:2393] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 5: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 12:59:44.882035  1680 raft_consensus.cc:1275] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:44.873854  3820 leader_election.cc:290] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 12:59:44.932552  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 71064.4us
W20260709 12:59:44.937731  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 138696us
I20260709 12:59:44.912928  3519 leader_election.cc:290] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:44.889027  3744 raft_consensus.cc:3060] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:59:44.944809  3855 log.cc:927] Time spent T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:59:44.946161  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:44.952523  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:44.953183  3692 leader_election.cc:290] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:44.954489  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:44.956509  1496 leader_election.cc:304] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:44.957532  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 12:59:44.958112  2226 raft_consensus.cc:2376] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 3. Re-sending same reply.
W20260709 12:59:44.958798  3850 log.cc:927] Time spent T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.279s	user 0.001s	sys 0.000s
I20260709 12:59:44.960210  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:44.960449  3703 raft_consensus.cc:2804] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:44.960822  3703 raft_consensus.cc:493] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:44.961033  1532 raft_consensus.cc:2393] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 4: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
W20260709 12:59:44.965039  1600 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36194 (request call id 1376) took 1594 ms (client timeout 1589 ms). Trace:
W20260709 12:59:44.965507  1600 rpcz_store.cc:269] 0709 12:59:43.370688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:44.964800 (+1594112us) service_pool.cc:211] Skipping call since client already timed out
0709 12:59:44.964954 (+   154us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:59:44.931694  3661 raft_consensus.cc:2804] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:44.966481  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:44.968075  1600 raft_consensus.cc:3060] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:44.969369  2192 leader_election.cc:336] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Timed out: RequestConsensusVote RPC to 127.0.107.194:40303 timed out after 1.905s (SENT)
I20260709 12:59:44.937067  3834 raft_consensus.cc:2804] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:59:44.935092  1601 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36194 (request call id 1379) took 1563 ms (client timeout 1782 ms). Trace:
W20260709 12:59:44.972970  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:44.973724  1496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:44.969857  2192 leader_election.cc:304] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:44.944660  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49170 (request call id 1623) took 3333 ms. Trace:
I20260709 12:59:44.970093  3703 raft_consensus.cc:3060] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:44.987035  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:44.987883  1680 raft_consensus.cc:2468] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 5.
I20260709 12:59:44.968953  3661 raft_consensus.cc:493] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:44.958848  3820 consensus_queue.cc:1048] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 12:59:44.975980  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:44.990947  2190 leader_election.cc:304] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:44.972890  3834 raft_consensus.cc:493] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:44.987075  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:44.983462  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:44.998555  1604 raft_consensus.cc:2468] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 2.
I20260709 12:59:44.999895  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:44.986384  1529 raft_consensus.cc:2468] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 6.
I20260709 12:59:44.967139  3755 raft_consensus.cc:515] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 12:59:45.393138  1606 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36194 (request call id 1359) took 2349 ms (client timeout 2063 ms). Trace:
W20260709 12:59:46.080133  1606 rpcz_store.cc:269] 0709 12:59:43.044157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:44.645752 (+1601595us) service_pool.cc:224] Handling call
0709 12:59:45.392889 (+747137us) spinlock_profiling.cc:243] Waited 59.9 ms on lock 0x7b54000daf54. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 12:59:45.393053 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":137778560}
I20260709 12:59:45.772819  3635 raft_consensus.cc:493] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:45.720738  3856 raft_consensus.cc:493] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:45.330888  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 12:59:45.377414  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:45.322762  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 122166us
W20260709 12:59:45.048750  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 73927us
I20260709 12:59:45.005283  1681 raft_consensus.cc:2468] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 4.
I20260709 12:59:46.094802  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49178 (request call id 1587) took 1124 ms. Trace:
I20260709 12:59:46.095250  1681 rpcz_store.cc:276] 0709 12:59:44.970397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:44.970566 (+   169us) service_pool.cc:224] Handling call
0709 12:59:46.094727 (+1124161us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:46.096328  1680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49178 (request call id 1589) took 1090 ms. Trace:
I20260709 12:59:45.050493  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:45.334478  1603 raft_consensus.cc:2468] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 5.
W20260709 12:59:45.365773  1496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:44.974753  1601 rpcz_store.cc:269] 0709 12:59:43.371979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:44.681392 (+1309413us) service_pool.cc:224] Handling call
0709 12:59:44.932311 (+250919us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:46.110198  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43008 (request call id 1654) took 1273 ms. Trace:
I20260709 12:59:46.110826  1529 rpcz_store.cc:276] 0709 12:59:44.821818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:44.826915 (+  5097us) service_pool.cc:224] Handling call
0709 12:59:46.092999 (+1266084us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:45.058465  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:44.981041  1676 rpcz_store.cc:276] 0709 12:59:41.611091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:41.613066 (+  1975us) service_pool.cc:224] Handling call
0709 12:59:41.686941 (+ 73875us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:42.407442 (+720501us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:44.937371 (+2529929us) spinlock_profiling.cc:243] Waited 640 ms on lock 0x7b5400304154. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 12:59:44.944459 (+  7088us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1472142720}
I20260709 12:59:45.539227  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50664 (request call id 402) took 1058 ms. Trace:
W20260709 12:59:46.085382  1604 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36194 (request call id 1371) took 2933 ms (client timeout 1812 ms). Trace:
W20260709 12:59:45.704880  1600 consensus_meta.cc:287] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.728s	user 0.009s	sys 0.000s
W20260709 12:59:46.115161  1604 rpcz_store.cc:269] 0709 12:59:43.152194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:44.470328 (+1318134us) service_pool.cc:224] Handling call
0709 12:59:46.085104 (+1614776us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:45.231779  1607 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36194 (request call id 1375) took 1861 ms (client timeout 1562 ms). Trace:
W20260709 12:59:46.081470  1606 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36194 (request call id 1355) took 3038 ms (client timeout 2356 ms). Trace:
I20260709 12:59:46.116160  2226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 617) took 1113 ms. Trace:
I20260709 12:59:46.101395  1496 leader_election.cc:304] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:45.208473  1675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49170 (request call id 1633) took 2845 ms. Trace:
W20260709 12:59:46.102034  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 1.16212e+06us
I20260709 12:59:46.112284  1673 raft_consensus.cc:2468] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 5.
I20260709 12:59:46.121199  1673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49178 (request call id 1590) took 1106 ms. Trace:
I20260709 12:59:46.121701  1673 rpcz_store.cc:276] 0709 12:59:45.015279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:45.015396 (+   117us) service_pool.cc:224] Handling call
0709 12:59:46.121123 (+1105727us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:45.013106  3834 raft_consensus.cc:3060] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:46.115262  1600 raft_consensus.cc:2468] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 4.
W20260709 12:59:46.129356  1600 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36194 (request call id 1370) took 2985 ms (client timeout 2170 ms). Trace:
W20260709 12:59:45.782792  3703 consensus_meta.cc:287] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent flushing consensus metadata: real 0.796s	user 0.009s	sys 0.002s
W20260709 12:59:46.129719  1600 rpcz_store.cc:269] 0709 12:59:43.143998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:44.966155 (+1822157us) service_pool.cc:224] Handling call
0709 12:59:46.129281 (+1163126us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:45.336450  3632 leader_election.cc:290] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 12:59:46.135849  1497 leader_election.cc:336] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Timed out: RequestConsensusVote RPC to 127.0.107.194:40303 timed out after 1.541s (SENT)
I20260709 12:59:45.060776  3821 leader_election.cc:290] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 12:59:45.547204  1598 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36194 (request call id 1381) took 2173 ms (client timeout 1968 ms). Trace:
I20260709 12:59:45.168615  3744 raft_consensus.cc:493] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:46.117199  1605 raft_consensus.cc:3060] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:59:46.115921  1607 rpcz_store.cc:269] 0709 12:59:43.370268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:45.214837 (+1844569us) service_pool.cc:211] Skipping call since client already timed out
0709 12:59:45.231695 (+ 16858us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:59:45.177723  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 12:59:45.394258  3814 consensus_meta.cc:287] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.745s	user 0.006s	sys 0.001s
W20260709 12:59:45.146281  3840 log.cc:927] Time spent T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.872s	user 0.004s	sys 0.004s
I20260709 12:59:46.102737  3806 leader_election.cc:290] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:46.113744  1677 rpcz_store.cc:276] 0709 12:59:44.480548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:44.522913 (+ 42365us) service_pool.cc:224] Handling call
0709 12:59:45.538919 (+1016006us) spinlock_profiling.cc:243] Waited 113 ms on lock 0x7b54003e6a54. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 12:59:45.539118 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":259504384}
W20260709 12:59:45.609385  3836 log.cc:927] Time spent T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 1.205s	user 0.005s	sys 0.000s
I20260709 12:59:45.261534  3819 raft_consensus.cc:515] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:46.097122  1680 rpcz_store.cc:276] 0709 12:59:45.005857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:45.006135 (+   278us) service_pool.cc:224] Handling call
0709 12:59:46.095736 (+1089601us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:46.096002 (+   266us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:46.096030 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:46.096075 (+    45us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:59:46.096107 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:46.096160 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:46.096268 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:45.067070  3692 raft_consensus.cc:3060] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:45.461501  1570 leader_election.cc:304] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 12:59:45.394351  3787 log.cc:927] Time spent T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 2.784s	user 0.000s	sys 0.026s
I20260709 12:59:45.158972  3792 raft_consensus.cc:2804] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:46.120239  1675 rpcz_store.cc:276] 0709 12:59:42.363226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:42.363374 (+   148us) service_pool.cc:224] Handling call
0709 12:59:42.363674 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:42.965935 (+602261us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:45.114618 (+2148683us) spinlock_profiling.cc:243] Waited 602 ms on lock 0x7b5400179154. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 12:59:45.208264 (+ 93646us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1383768448}
I20260709 12:59:46.135016  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:46.146369  3841 raft_consensus.cc:493] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:46.084236  3832 raft_consensus.cc:493] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:46.116250  1606 rpcz_store.cc:269] 0709 12:59:43.043075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:46.081271 (+3038196us) service_pool.cc:211] Skipping call since client already timed out
0709 12:59:46.081409 (+   138us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:59:46.136685  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:45.267856  3843 raft_consensus.cc:2749] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217) with higher term. Message: Invalid argument: T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 3. Current term is 4.
I20260709 12:59:46.139003  2227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 616) took 1161 ms. Trace:
I20260709 12:59:46.077189  3777 leader_election.cc:290] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:46.177030  1525 raft_consensus.cc:2410] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for term 4 because replica has last-logged OpId of term: 2 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 12:59:46.178635  1525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43008 (request call id 1657) took 1233 ms. Trace:
I20260709 12:59:46.179019  1525 rpcz_store.cc:276] 0709 12:59:44.945730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:44.945860 (+   130us) service_pool.cc:224] Handling call
0709 12:59:46.178418 (+1232558us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b54000fd054. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 12:59:46.178577 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2828417280}
I20260709 12:59:46.179605  3832 raft_consensus.cc:515] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:46.180364  1525 raft_consensus.cc:1240] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:59:46.181053  1525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49310 (request call id 410) took 1202 ms. Trace:
I20260709 12:59:46.181334  1525 rpcz_store.cc:276] 0709 12:59:44.978445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:46.179807 (+1201362us) service_pool.cc:224] Handling call
0709 12:59:46.180136 (+   329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:46.180798 (+   662us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:46.181001 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:46.182710  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 427) took 4715 ms. Trace:
I20260709 12:59:46.183094  1602 rpcz_store.cc:276] 0709 12:59:41.466971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:41.904483 (+437512us) service_pool.cc:224] Handling call
0709 12:59:41.904775 (+   292us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:42.054425 (+149650us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:42.054452 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:42.214143 (+159691us) log.cc:844] Serialized 26 byte log entry
0709 12:59:42.422075 (+207932us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:42.422122 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:42.422199 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:45.393505 (+2971306us) spinlock_profiling.cc:243] Waited 75.1 ms on lock 0x7b4400022b4c. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a153ecc85 00007f6a153ed6a2 00007f6a1815f1db 00007f6a1815aaaf 00007f6a1814e86e 00007f6a1814dbb6 00007f6a1814d7d8 00007f6a18157221 00007f6a181571d9 00007f6a18157169
0709 12:59:46.182248 (+788743us) raft_consensus.cc:1685] finished
0709 12:59:46.182266 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:46.182523 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":149244,"raft.queue_time_us":215751,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":129,"spinlock_wait_cycles":172841344,"thread_start_us":200383,"threads_started":1,"wal-append.queue_time_us":344600}
I20260709 12:59:46.185057  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:46.176352  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:46.132105  1527 raft_consensus.cc:2468] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 3.
I20260709 12:59:46.186321  1527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49310 (request call id 407) took 1208 ms. Trace:
I20260709 12:59:46.083432  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 12:59:46.121512  2192 connection.cc:256] RPC call timeout handler was delayed by -1.1440799729999753s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1968s for a response
I20260709 12:59:46.094215  3779 leader_election.cc:290] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:46.086122  3657 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:46.126834  3856 raft_consensus.cc:515] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 12:59:46.128309  3640 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.861s	user 0.027s	sys 0.067s
W20260709 12:59:45.503860  3698 consensus_meta.cc:287] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b: Time spent flushing consensus metadata: real 0.606s	user 0.010s	sys 0.000s
I20260709 12:59:45.276782  3752 raft_consensus.cc:493] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:46.145360  1496 leader_election.cc:304] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:46.149413  1497 leader_election.cc:304] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:45.785818  1427 catalog_manager.cc:5697] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 1 to 5, leader changed from e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) to b96ce9cc496c49d7818fa983a17b062b (127.0.107.196). New cstate: current_term: 5 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:46.121867  2226 rpcz_store.cc:276] 0709 12:59:44.981942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:44.982056 (+   114us) service_pool.cc:224] Handling call
0709 12:59:46.095100 (+1113044us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:46.143146  1598 rpcz_store.cc:269] 0709 12:59:43.373250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:45.546589 (+2173339us) service_pool.cc:211] Skipping call since client already timed out
0709 12:59:45.546971 (+   382us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:59:46.157570  1528 raft_consensus.cc:2468] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 3.
W20260709 12:59:46.203131  1602 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 446) took 1555 ms (client timeout 1905 ms). Trace:
I20260709 12:59:46.208114  1528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49310 (request call id 409) took 1230 ms. Trace:
I20260709 12:59:46.150310  3820 raft_consensus.cc:2804] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:46.169694  1604 raft_consensus.cc:2468] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 4.
W20260709 12:59:46.199338  3640 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.936s	user 0.028s	sys 0.068s
I20260709 12:59:46.175042  3711 raft_consensus.cc:493] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:46.175169  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:46.173350  2227 rpcz_store.cc:276] 0709 12:59:44.977364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:44.977489 (+   125us) service_pool.cc:224] Handling call
0709 12:59:46.138934 (+1161445us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:46.186741  1527 rpcz_store.cc:276] 0709 12:59:44.977686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:44.983194 (+  5508us) service_pool.cc:224] Handling call
0709 12:59:46.186262 (+1203068us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:46.194505  3864 raft_consensus.cc:2749] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:44.999336  3661 raft_consensus.cc:3060] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:46.167273  3744 raft_consensus.cc:515] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 12:59:46.197074  1607 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36194 (request call id 1373) took 2827 ms (client timeout 3083 ms). Trace:
I20260709 12:59:46.166846  3828 leader_election.cc:290] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:46.169253  3792 raft_consensus.cc:493] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:46.195657  1532 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.205s	user 0.035s	sys 0.030s
W20260709 12:59:46.206223  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 926477us
I20260709 12:59:46.170598  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:46.152066  3814 raft_consensus.cc:515] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 12:59:46.207520  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 62242us
I20260709 12:59:46.222333  1496 leader_election.cc:304] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:46.222503  3814 leader_election.cc:290] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:46.223181  3821 raft_consensus.cc:2804] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:46.223564  3821 raft_consensus.cc:493] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:46.223912  3821 raft_consensus.cc:3060] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:46.215626  3779 raft_consensus.cc:493] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:46.224635  1530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43008 (request call id 1651) took 1526 ms. Trace:
I20260709 12:59:46.224932  3779 raft_consensus.cc:515] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:46.227043  3779 leader_election.cc:290] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:46.215468  3711 raft_consensus.cc:515] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:46.229326  3711 leader_election.cc:290] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:46.231815  3821 raft_consensus.cc:515] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:46.234438  3821 leader_election.cc:290] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:46.211738  3820 raft_consensus.cc:493] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:46.235105  3820 raft_consensus.cc:3060] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:46.239079  1430 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46260 (request call id 363) took 8302 ms. Trace:
I20260709 12:59:46.240159  3856 leader_election.cc:290] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:46.240477  1606 raft_consensus.cc:2393] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 6: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
W20260709 12:59:46.240978  1606 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36194 (request call id 1358) took 3197 ms (client timeout 3434 ms). Trace:
W20260709 12:59:46.241401  1606 rpcz_store.cc:269] 0709 12:59:43.043910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:46.171848 (+3127938us) service_pool.cc:224] Handling call
0709 12:59:46.240917 (+ 69069us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:46.242290  3744 leader_election.cc:290] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:46.154078  3635 raft_consensus.cc:515] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:46.208545  1528 rpcz_store.cc:276] 0709 12:59:44.978191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:45.148358 (+170167us) service_pool.cc:224] Handling call
0709 12:59:46.208048 (+1059690us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:46.210443  1604 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 453) took 1538 ms (client timeout 1559 ms). Trace:
I20260709 12:59:45.160517  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:46.141620  3703 raft_consensus.cc:515] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:46.198772  3657 raft_consensus.cc:493] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:46.215180  1607 rpcz_store.cc:269] 0709 12:59:43.369539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:46.149306 (+2779767us) service_pool.cc:224] Handling call
0709 12:59:46.197016 (+ 47710us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:46.207628  3843 raft_consensus.cc:2804] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:46.217482  1616 tablet_copy_service.cc:342] P 39a92f5a4352465d8af3af5908fe8642: Request end of tablet copy session b96ce9cc496c49d7818fa983a17b062b-4190d217954f4f798b3a610501115290 received from {username='slave'} at 127.0.0.1:57268
I20260709 12:59:46.216455  1523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49310 (request call id 391) took 1522 ms. Trace:
I20260709 12:59:46.211040  3698 raft_consensus.cc:515] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:46.215406  3632 raft_consensus.cc:2749] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:46.270421  3843 raft_consensus.cc:493] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:46.218641  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:46.218865  1570 leader_election.cc:304] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:46.217119  3752 raft_consensus.cc:515] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 12:59:46.220116  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:46.220490  1531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43008 (request call id 1648) took 1584 ms. Trace:
I20260709 12:59:46.242884  1600 raft_consensus.cc:2468] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 3.
I20260709 12:59:46.274345  1605 raft_consensus.cc:2468] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 3.
W20260709 12:59:46.242960  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 107197us
W20260709 12:59:46.208441  1602 rpcz_store.cc:269] 0709 12:59:44.647647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:46.184775 (+1537128us) service_pool.cc:224] Handling call
0709 12:59:46.203065 (+ 18290us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:46.274983  1616 tablet_copy_service.cc:434] P 39a92f5a4352465d8af3af5908fe8642: ending tablet copy session b96ce9cc496c49d7818fa983a17b062b-4190d217954f4f798b3a610501115290 on tablet 4190d217954f4f798b3a610501115290 with peer b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:46.275770  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:46.275938  1616 rpcz_store.cc:275] Call kudu.tserver.TabletCopyService.EndTabletCopySession from 127.0.0.1:57268 (request call id 459) took 1397 ms. Trace:
I20260709 12:59:46.242373  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:46.276822  1606 raft_consensus.cc:2468] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 3.
W20260709 12:59:46.277307  1606 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 461) took 1279 ms (client timeout 1612 ms). Trace:
W20260709 12:59:46.277559  1606 rpcz_store.cc:269] 0709 12:59:44.997855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:46.242068 (+1244213us) service_pool.cc:224] Handling call
0709 12:59:46.277253 (+ 35185us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:46.276326  1602 raft_consensus.cc:2376] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 5. Re-sending same reply.
I20260709 12:59:46.216348  1672 raft_consensus.cc:2393] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 5: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 12:59:46.217867  3792 raft_consensus.cc:3060] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:59:46.264400  2224 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50326 (request call id 580) took 3464 ms (client timeout 2240 ms). Trace:
W20260709 12:59:46.260558  1604 rpcz_store.cc:269] 0709 12:59:44.672041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:46.134773 (+1462732us) service_pool.cc:224] Handling call
0709 12:59:46.210384 (+ 75611us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:46.265592  1601 raft_consensus.cc:2393] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 5: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
W20260709 12:59:46.281980  2224 rpcz_store.cc:269] 0709 12:59:42.799687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:42.799798 (+   111us) service_pool.cc:224] Handling call
0709 12:59:46.264076 (+3464278us) spinlock_profiling.cc:243] Waited 3.46 s on lock 0x7b5400525b54. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 12:59:46.264226 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7951931648}
W20260709 12:59:46.282707  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 63958.2us
I20260709 12:59:46.270865  1523 rpcz_store.cc:276] 0709 12:59:44.560199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:44.563440 (+  3241us) service_pool.cc:224] Handling call
0709 12:59:44.563971 (+   531us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:44.564705 (+   734us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:59:44.634883 (+ 70178us) log.cc:844] Serialized 14 byte log entry
0709 12:59:44.935943 (+301060us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:44.970909 (+ 34966us) log.cc:844] Serialized 26 byte log entry
0709 12:59:44.971213 (+   304us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:44.972522 (+  1309us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:44.972615 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:45.719844 (+747229us) raft_consensus.cc:1685] finished
0709 12:59:45.719864 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:46.079922 (+360058us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":122238,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":1856,"raft.queue_time_us":5431,"raft.run_cpu_time_us":303,"raft.run_wall_time_us":7478,"thread_start_us":343657,"threads_started":2,"wal-append.queue_time_us":966508}
I20260709 12:59:46.240975  3820 raft_consensus.cc:515] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:46.264962  3635 leader_election.cc:290] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:46.239466  1430 rpcz_store.cc:276] 0709 12:59:37.914619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:37.934935 (+ 20316us) service_pool.cc:224] Handling call
0709 12:59:46.214780 (+8279845us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:41.470919 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:41.721627 (+250708us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:41.737665 (+ 16038us) write_op.cc:435] Acquired schema lock
0709 12:59:41.768284 (+ 30619us) tablet.cc:662] Decoding operations
0709 12:59:41.900675 (+132391us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:41.900733 (+    58us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:41.900770 (+    37us) tablet.cc:685] Acquiring locks for 11 operations
0709 12:59:42.144196 (+243426us) tablet.cc:701] Row locks acquired
0709 12:59:42.144236 (+    40us) write_op.cc:260] PREPARE: finished
0709 12:59:42.144425 (+   189us) write_op.cc:270] Start()
0709 12:59:42.144600 (+   175us) write_op.cc:276] Timestamp: P: 1783601982144358 usec, L: 0
0709 12:59:42.144625 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 12:59:42.145512 (+   887us) log.cc:844] Serialized 4436 byte log entry
0709 12:59:42.591876 (+446364us) op_driver.cc:464] REPLICATION: finished
0709 12:59:43.052289 (+460413us) spinlock_profiling.cc:243] Waited 23.2 ms on lock 0x7b4400022b4c. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a153ecc85 00007f6a153ed6a2 00007f6a1815f1db 00007f6a1815aaaf 00007f6a154a90ac 00007f6a1e303ab9 00007f6a154c569b 00007f6a154c393f 00007f6a154c5c02 00007f6a1bfe9ef0
0709 12:59:43.737352 (+685063us) write_op.cc:301] APPLY: starting
0709 12:59:43.737478 (+   126us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:43.737742 (+   264us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:43.737779 (+    37us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:43.783549 (+ 45770us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:43.783900 (+   351us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0709 12:59:43.783950 (+    50us) write_op.cc:312] APPLY: finished
0709 12:59:43.789412 (+  5462us) log.cc:844] Serialized 83 byte log entry
0709 12:59:44.098855 (+309443us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:44.099004 (+   149us) write_op.cc:454] Released schema lock
0709 12:59:44.099072 (+    68us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:44.099507 (+   435us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:44.099546 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":25,"child_traces":[["op",{"apply.queue_time_us":1083752,"apply.run_cpu_time_us":27130,"apply.run_wall_time_us":374754,"num_ops":11,"prepare.queue_time_us":166429,"prepare.run_cpu_time_us":27639,"prepare.run_wall_time_us":869463,"raft.queue_time_us":171003,"raft.run_cpu_time_us":62479,"raft.run_wall_time_us":877611,"replication_time_us":414932,"spinlock_wait_cycles":53281152,"thread_start_us":1379150,"threads_started":5,"wal-append.queue_time_us":702059,"wal-append.run_cpu_time_us":47230,"wal-append.run_wall_time_us":2371901}]]}
I20260709 12:59:46.264006  3819 leader_election.cc:290] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 3 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:46.267329  3864 raft_consensus.cc:493] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:46.266319  1427 catalog_manager.cc:5697] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 1 to 2, leader changed from 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) to b96ce9cc496c49d7818fa983a17b062b (127.0.107.196). New cstate: current_term: 2 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:46.259989  2191 leader_election.cc:304] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:46.268445  1524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49310 (request call id 386) took 3563 ms. Trace:
I20260709 12:59:46.243084  1530 rpcz_store.cc:276] 0709 12:59:44.699466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:44.734635 (+ 35169us) service_pool.cc:224] Handling call
0709 12:59:44.752379 (+ 17744us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:44.753096 (+   717us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:44.753129 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:44.753673 (+   544us) log.cc:844] Serialized 26 byte log entry
0709 12:59:44.940096 (+186423us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:44.974373 (+ 34277us) log.cc:844] Serialized 14 byte log entry
0709 12:59:44.979175 (+  4802us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:44.979254 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:46.224424 (+1245170us) raft_consensus.cc:1685] finished
0709 12:59:46.224442 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:46.224579 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":35946,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":5239,"raft.run_cpu_time_us":238,"raft.run_wall_time_us":16646,"thread_start_us":186016,"threads_started":1,"wal-append.queue_time_us":1398891}
I20260709 12:59:46.274192  3832 leader_election.cc:290] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:46.186069  3841 raft_consensus.cc:515] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 12:59:46.218050  1532 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.227s	user 0.037s	sys 0.030s
W20260709 12:59:46.270449  1603 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36200 (request call id 1775) took 3236 ms (client timeout 2175 ms). Trace:
I20260709 12:59:46.287830  1524 rpcz_store.cc:276] 0709 12:59:42.576348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:42.576468 (+   120us) service_pool.cc:224] Handling call
0709 12:59:42.576801 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:42.577972 (+  1171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:42.577999 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:42.578037 (+    38us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:42.578068 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:45.479203 (+2901135us) spinlock_profiling.cc:243] Waited 973 us on lock 0x7b54001b53d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 12:59:46.085581 (+606378us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:46.139694 (+ 54113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2237824}
W20260709 12:59:46.278859  1605 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36194 (request call id 1366) took 3213 ms (client timeout 2234 ms). Trace:
W20260709 12:59:46.282393  1601 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 444) took 1649 ms (client timeout 1760 ms). Trace:
I20260709 12:59:46.278439  1598 raft_consensus.cc:2468] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 3.
I20260709 12:59:46.273631  3843 raft_consensus.cc:3060] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:46.281106  1602 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 447) took 1623 ms (client timeout 2013 ms). Trace:
I20260709 12:59:46.281348  3744 raft_consensus.cc:2749] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:46.284440  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 12:59:46.308046  1606 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 450) took 1649 ms (client timeout 2026 ms). Trace:
I20260709 12:59:46.269814  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 12:59:46.308460  1600 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 440) took 1754 ms (client timeout 1863 ms). Trace:
I20260709 12:59:46.308784  1607 raft_consensus.cc:2468] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 4.
I20260709 12:59:46.306413  3814 raft_consensus.cc:493] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:46.309319  1607 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 452) took 1650 ms (client timeout 1968 ms). Trace:
I20260709 12:59:46.309415  3814 raft_consensus.cc:515] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 12:59:46.309660  1607 rpcz_store.cc:269] 0709 12:59:44.659032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:46.269566 (+1610534us) service_pool.cc:224] Handling call
0709 12:59:46.309267 (+ 39701us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:46.274233  1531 rpcz_store.cc:276] 0709 12:59:44.635850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:44.728322 (+ 92472us) service_pool.cc:224] Handling call
0709 12:59:44.728649 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:44.729223 (+   574us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:59:44.867632 (+138409us) log.cc:844] Serialized 14 byte log entry
0709 12:59:45.032707 (+165075us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:45.062170 (+ 29463us) log.cc:844] Serialized 26 byte log entry
0709 12:59:45.062399 (+   229us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:45.062639 (+   240us) log.cc:844] Serialized 14 byte log entry
0709 12:59:46.078389 (+1015750us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:46.078474 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:46.220289 (+141815us) raft_consensus.cc:1685] finished
0709 12:59:46.220310 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:46.220436 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1053753,"prepare.queue_time_us":32243,"prepare.run_cpu_time_us":120,"prepare.run_wall_time_us":33794,"raft.queue_time_us":1024176,"raft.run_cpu_time_us":397,"raft.run_wall_time_us":29370,"thread_start_us":202009,"threads_started":2,"wal-append.queue_time_us":1232375}
I20260709 12:59:46.290064  1570 leader_election.cc:304] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:46.276412  3752 leader_election.cc:290] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 12:59:46.279332  1497 leader_election.cc:336] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Timed out: RequestConsensusVote RPC to 127.0.107.194:40303 timed out after 1.562s (SENT)
I20260709 12:59:46.270828  3657 raft_consensus.cc:515] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:46.276356  1616 rpcz_store.cc:276] 0709 12:59:44.942793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:45.000191 (+ 57398us) service_pool.cc:224] Handling call
0709 12:59:46.275847 (+1275656us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:46.292140  1605 rpcz_store.cc:269] 0709 12:59:43.065162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:44.940394 (+1875232us) service_pool.cc:224] Handling call
0709 12:59:46.278795 (+1338401us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:46.291522  1603 rpcz_store.cc:269] 0709 12:59:43.034106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:43.034227 (+   121us) service_pool.cc:224] Handling call
0709 12:59:46.266178 (+3231951us) spinlock_profiling.cc:243] Waited 2.03 s on lock 0x7b54001a9fd4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 12:59:46.270359 (+  4181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4661099776}
I20260709 12:59:46.287158  3777 consensus_queue.cc:1059] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 12:59:46.316594  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:46.302074  1427 catalog_manager.cc:5697] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 2 to 3, leader changed from 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) to b96ce9cc496c49d7818fa983a17b062b (127.0.107.196). New cstate: current_term: 3 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:59:46.305593  1644 connection.cc:256] RPC call timeout handler was delayed by -1.4198528999999667s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15280000000000002s for a response
W20260709 12:59:46.303999  1598 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 458) took 1436 ms (client timeout 1709 ms). Trace:
W20260709 12:59:46.323177  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 44695.4us
W20260709 12:59:46.323107  1598 rpcz_store.cc:269] 0709 12:59:44.868047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:46.215460 (+1347413us) service_pool.cc:224] Handling call
0709 12:59:46.303924 (+ 88464us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:46.308396  1606 rpcz_store.cc:269] 0709 12:59:44.658451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:46.277962 (+1619511us) service_pool.cc:224] Handling call
0709 12:59:46.307979 (+ 30017us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:46.324023  1497 leader_election.cc:336] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Timed out: RequestConsensusVote RPC to 127.0.107.194:40303 timed out after 1.589s (SENT)
I20260709 12:59:46.286782  1672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49178 (request call id 1591) took 1233 ms. Trace:
W20260709 12:59:46.308820  1600 rpcz_store.cc:269] 0709 12:59:44.578756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:46.130425 (+1551669us) service_pool.cc:224] Handling call
0709 12:59:46.308309 (+177884us) spinlock_profiling.cc:243] Waited 70.9 ms on lock 0x7b540037e1d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 12:59:46.308410 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":162982656}
I20260709 12:59:46.291590  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:46.310570  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:46.291980  3873 raft_consensus.cc:2804] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:46.287514  2219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 618) took 1283 ms. Trace:
W20260709 12:59:46.304301  1602 rpcz_store.cc:269] 0709 12:59:44.654945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:46.275483 (+1620538us) service_pool.cc:224] Handling call
0709 12:59:46.278743 (+  3260us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:46.317553  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
W20260709 12:59:46.317711  1644 connection.cc:256] RPC call timeout handler was delayed by -1.3865528999999697s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1565s for a response
I20260709 12:59:46.324519  1497 leader_election.cc:304] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:46.325340  1607 raft_consensus.cc:3060] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:46.324484  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:46.325893  1603 raft_consensus.cc:2468] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 2.
I20260709 12:59:46.289286  3864 raft_consensus.cc:515] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:46.328264  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:46.328509  1604 raft_consensus.cc:2468] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 5.
W20260709 12:59:46.329774  1604 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 456) took 1495 ms (client timeout 1893 ms). Trace:
W20260709 12:59:46.330109  1604 rpcz_store.cc:269] 0709 12:59:44.834639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:46.282879 (+1448240us) service_pool.cc:224] Handling call
0709 12:59:46.329713 (+ 46834us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:46.330438  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:46.323752  3777 raft_consensus.cc:3055] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:46.330606  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36194 (request call id 1384) took 1496 ms. Trace:
I20260709 12:59:46.331354  3777 raft_consensus.cc:740] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:46.331794  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 448) took 1676 ms. Trace:
W20260709 12:59:46.294114  1601 rpcz_store.cc:269] 0709 12:59:44.632706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:46.137112 (+1504406us) service_pool.cc:224] Handling call
0709 12:59:46.282332 (+145220us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:46.332531  3657 leader_election.cc:290] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:46.332988  1601 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "112134ca2a6243c98c85c27d41496747"
dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
mode: GRACEFUL
new_leader_uuid: "ddf11fc190dd4b898773379c6b129d90"
 from {username='slave'} at 127.0.0.1:48230
W20260709 12:59:46.333271  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 47497.5us
I20260709 12:59:46.333393  1603 rpcz_store.cc:276] 0709 12:59:44.833023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:46.316373 (+1483350us) service_pool.cc:224] Handling call
0709 12:59:46.329394 (+ 13021us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:46.331027  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 12:59:46.327608  1644 connection.cc:256] RPC call timeout handler was delayed by -1.3703529000000003s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1583s for a response
I20260709 12:59:46.333295  1602 raft_consensus.cc:2393] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 4: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 12:59:46.330683  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 12:59:46.334730  1644 connection.cc:256] RPC call timeout handler was delayed by -1.3667528999999945s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1587s for a response
W20260709 12:59:46.335096  1644 connection.cc:256] RPC call timeout handler was delayed by -1.3307528999999931s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1627s for a response
I20260709 12:59:46.335165  1600 raft_consensus.cc:2468] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 3.
I20260709 12:59:46.332126  1606 rpcz_store.cc:276] 0709 12:59:44.655755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:46.324790 (+1669035us) service_pool.cc:224] Handling call
0709 12:59:46.331717 (+  6927us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:46.335443  1644 connection.cc:256] RPC call timeout handler was delayed by -1.2596528999999919s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1706s for a response
W20260709 12:59:46.335783  1644 connection.cc:256] RPC call timeout handler was delayed by -1.124652900000001s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18560000000000001s for a response
I20260709 12:59:46.336042  1600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 445) took 1696 ms. Trace:
W20260709 12:59:46.336090  1644 connection.cc:256] RPC call timeout handler was delayed by -1.0940528999999515s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.189s for a response
I20260709 12:59:46.336455  1600 rpcz_store.cc:276] 0709 12:59:44.639219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:46.325205 (+1685986us) service_pool.cc:224] Handling call
0709 12:59:46.335991 (+ 10786us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:46.336593  1644 connection.cc:256] RPC call timeout handler was delayed by -1.0922528999999486s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1892s for a response
I20260709 12:59:46.337667  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 451) took 1679 ms. Trace:
W20260709 12:59:46.338132  1644 connection.cc:256] RPC call timeout handler was delayed by -1.026552899999956s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1965s for a response
W20260709 12:59:46.336668  1605 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 449) took 1669 ms (client timeout 2192 ms). Trace:
I20260709 12:59:46.316661  3755 leader_election.cc:290] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:46.379047  3832 consensus_queue.cc:1048] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:59:46.384618  3832 consensus_queue.cc:1243] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 log is divergent from this leader: its last log entry 4.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:59:46.380280  1606 raft_consensus.cc:1240] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 12:59:46.382071  1644 leader_election.cc:336] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.627s (SENT)
I20260709 12:59:46.383178  3820 leader_election.cc:290] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:46.339303  3856 consensus_queue.cc:1048] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
W20260709 12:59:46.338879  1605 rpcz_store.cc:269] 0709 12:59:44.658128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:46.317346 (+1659218us) service_pool.cc:224] Handling call
0709 12:59:46.327275 (+  9929us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:46.386812  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 63887.8us
I20260709 12:59:46.387607  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36194 (request call id 1364) took 3342 ms. Trace:
I20260709 12:59:46.379472  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36194 (request call id 1362) took 3334 ms. Trace:
I20260709 12:59:46.338387  1602 rpcz_store.cc:276] 0709 12:59:44.658755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:46.327100 (+1668345us) service_pool.cc:224] Handling call
0709 12:59:46.337614 (+ 10514us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:46.339800  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 457) took 1483 ms. Trace:
W20260709 12:59:46.388314  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 50930us
I20260709 12:59:46.324064  3632 raft_consensus.cc:493] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:46.387578  1644 leader_election.cc:304] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:46.389810  1603 rpcz_store.cc:276] 0709 12:59:43.044856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:46.344719 (+3299863us) service_pool.cc:224] Handling call
0709 12:59:46.378876 (+ 34157us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:46.379086 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:46.379109 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:46.379154 (+    45us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:59:46.379200 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:46.379252 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:46.379397 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:46.389515  1606 rpcz_store.cc:276] 0709 12:59:43.045305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:46.347662 (+3302357us) service_pool.cc:224] Handling call
0709 12:59:46.380013 (+ 32351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:46.387372 (+  7359us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:46.387558 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:46.306603  3831 consensus_queue.cc:1048] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:59:46.392057  1604 rpcz_store.cc:276] 0709 12:59:44.856438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:46.330821 (+1474383us) service_pool.cc:224] Handling call
0709 12:59:46.339735 (+  8914us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:46.380693  1598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 462) took 1366 ms. Trace:
I20260709 12:59:46.388501  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 12:59:46.393033  1571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:46.393039  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:46.328438  3873 raft_consensus.cc:493] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:46.397055  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43008 (request call id 1655) took 1521 ms. Trace:
I20260709 12:59:46.333406  3752 raft_consensus.cc:2804] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:46.397310  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:46.399410  1605 raft_consensus.cc:3060] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:46.397958  1526 rpcz_store.cc:276] 0709 12:59:44.879459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:44.886744 (+  7285us) service_pool.cc:224] Handling call
0709 12:59:44.887118 (+   374us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:44.887504 (+   386us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:44.887532 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:44.888007 (+   475us) log.cc:844] Serialized 26 byte log entry
0709 12:59:46.076169 (+1188162us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:46.393044 (+316875us) log.cc:844] Serialized 14 byte log entry
0709 12:59:46.396742 (+  3698us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:46.396831 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:46.396887 (+    56us) raft_consensus.cc:1685] finished
0709 12:59:46.396897 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:46.397006 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7587,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":210,"thread_start_us":396699,"threads_started":2,"wal-append.queue_time_us":1329251}
I20260709 12:59:46.398736  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:46.400930  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:46.401405  1606 raft_consensus.cc:2468] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 3.
I20260709 12:59:46.400918  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:46.337221  3821 raft_consensus.cc:2749] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:46.387439  1601 raft_consensus.cc:606] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Received request to transfer leadership to TS ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:46.326162  1672 rpcz_store.cc:276] 0709 12:59:45.051096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:45.447505 (+396409us) service_pool.cc:224] Handling call
0709 12:59:46.284476 (+836971us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:46.403865  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:46.405661  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:46.406427  1603 raft_consensus.cc:2393] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 5: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 12:59:46.407951  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:46.408861  2227 raft_consensus.cc:2410] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:59:46.409572  1600 raft_consensus.cc:1240] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:46.328101  2219 rpcz_store.cc:276] 0709 12:59:45.002214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:45.005058 (+  2844us) service_pool.cc:224] Handling call
0709 12:59:46.285888 (+1280830us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:46.411054  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:46.412108  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:46.397431  1598 rpcz_store.cc:276] 0709 12:59:45.013895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:46.324165 (+1310270us) service_pool.cc:224] Handling call
0709 12:59:46.380631 (+ 56466us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:46.414033  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:46.414605  1598 raft_consensus.cc:3060] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:46.403504  3828 raft_consensus.cc:2749] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:46.416170  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:46.417354  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:46.418406  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:46.427145  1600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36194 (request call id 1372) took 3244 ms. Trace:
I20260709 12:59:46.427687  1600 rpcz_store.cc:276] 0709 12:59:43.165714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:46.357577 (+3191863us) service_pool.cc:224] Handling call
0709 12:59:46.409453 (+ 51876us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:46.409885 (+   432us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:46.410061 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:46.400301  3873 raft_consensus.cc:3060] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:46.439565  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 115603us
I20260709 12:59:46.404526  1601 raft_consensus.cc:614] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:46.448191  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:46.449999  1603 raft_consensus.cc:2468] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 4.
I20260709 12:59:46.453588  1646 leader_election.cc:304] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:46.457746  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:46.451341  1427 catalog_manager.cc:5697] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 1 to 3, leader changed from e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) to b96ce9cc496c49d7818fa983a17b062b (127.0.107.196). New cstate: current_term: 3 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:46.460270  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:46.408926  3703 leader_election.cc:290] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 12:59:46.465925  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 340129us
I20260709 12:59:46.458508  1602 raft_consensus.cc:2468] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 3.
I20260709 12:59:46.397135  3632 raft_consensus.cc:515] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:46.463985  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:46.462492  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:46.466573  1496 leader_election.cc:304] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:46.332226  3777 consensus_queue.cc:260] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:46.429975  3752 raft_consensus.cc:697] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 6 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:46.464601  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
W20260709 12:59:46.468559  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 272544us
W20260709 12:59:46.468406  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:46.475455  1606 raft_consensus.cc:2376] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 2. Re-sending same reply.
I20260709 12:59:46.477526  1600 raft_consensus.cc:2376] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 3. Re-sending same reply.
I20260709 12:59:46.476603  1496 leader_election.cc:304] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:46.476061  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:46.479113  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:46.475680  2227 raft_consensus.cc:2468] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 3.
I20260709 12:59:46.480651  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
W20260709 12:59:46.484189  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 102155us
W20260709 12:59:46.486462  2192 connection.cc:256] RPC call timeout handler was delayed by -1.1035799730000235s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2013s for a response
W20260709 12:59:46.486876  2192 connection.cc:256] RPC call timeout handler was delayed by -1.0918799730000046s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2026s for a response
I20260709 12:59:46.455657  3814 leader_election.cc:290] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:46.483525  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:46.496915  1605 raft_consensus.cc:2468] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 4.
W20260709 12:59:46.475411  3863 log.cc:927] Time spent T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.206s	user 0.001s	sys 0.000s
I20260709 12:59:46.503625  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:46.504803  1681 raft_consensus.cc:3060] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:59:46.505798  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:46.506371  1606 raft_consensus.cc:2376] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 3. Re-sending same reply.
I20260709 12:59:46.512244  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:46.468317  3519 raft_consensus.cc:493] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:46.501976  1427 catalog_manager.cc:5697] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 3 to 4, leader changed from e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 4 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:46.473937  3878 raft_consensus.cc:2804] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:46.483392  3821 raft_consensus.cc:2804] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:46.507385  1675 raft_consensus.cc:2468] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 3.
I20260709 12:59:46.522101  2191 leader_election.cc:304] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:46.485544  3698 leader_election.cc:290] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 4 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:46.490491  3820 raft_consensus.cc:2804] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:59:46.519338  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 43922.8us
I20260709 12:59:46.500949  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:46.480261  3755 consensus_queue.cc:1048] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 12:59:46.554541  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:46.796456  1604 raft_consensus.cc:3060] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:46.550879  3841 leader_election.cc:290] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:46.622531  1681 raft_consensus.cc:2468] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 4.
I20260709 12:59:46.799620  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:46.800272  1675 raft_consensus.cc:3060] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:46.524837  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:46.804517  1600 raft_consensus.cc:2468] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 4.
I20260709 12:59:46.810777  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:46.803364  3889 raft_consensus.cc:493] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:46.811353  1674 raft_consensus.cc:3060] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:59:46.606928  2192 leader_election.cc:336] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Timed out: RequestConsensusVote RPC to 127.0.107.194:40303 timed out after 2.013s (SENT)
W20260709 12:59:46.812505  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 205638us
I20260709 12:59:46.813246  3891 raft_consensus.cc:493] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:46.813759  3891 raft_consensus.cc:515] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:46.678218  3877 raft_consensus.cc:2804] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:59:46.806730  1679 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.678s	user 0.004s	sys 0.004s
I20260709 12:59:46.806931  1680 raft_consensus.cc:3060] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:59:46.824826  1679 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.696s	user 0.005s	sys 0.004s
W20260709 12:59:46.805073  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 300521us
W20260709 12:59:46.776335  1481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 95006.2us
W20260709 12:59:46.814134  2192 leader_election.cc:336] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Timed out: RequestConsensusVote RPC to 127.0.107.194:40303 timed out after 2.192s (SENT)
I20260709 12:59:46.808658  1675 raft_consensus.cc:2468] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 6.
I20260709 12:59:46.552687  3843 raft_consensus.cc:515] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:46.810017  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:46.841926  1604 raft_consensus.cc:2468] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 6.
I20260709 12:59:46.815726  3881 raft_consensus.cc:493] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:46.818380  1674 raft_consensus.cc:2468] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 3.
W20260709 12:59:46.819392  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:46.587352  3777 raft_consensus.cc:3060] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:46.811496  3889 raft_consensus.cc:515] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:46.516026  3832 consensus_queue.cc:1059] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.315s
I20260709 12:59:46.818333  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 12:59:46.557204  1496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:46.824448  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:46.870004  3832 raft_consensus.cc:3055] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:46.870468  3832 raft_consensus.cc:740] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:46.869951  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:46.871397  3832 consensus_queue.cc:260] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:46.872681  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:46.873307  1602 raft_consensus.cc:2468] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 2.
I20260709 12:59:46.573124  1427 catalog_manager.cc:5697] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:46.554335  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:46.855805  1681 raft_consensus.cc:3060] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:59:46.709226  3872 log.cc:927] Time spent T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.405s	user 0.001s	sys 0.000s
I20260709 12:59:46.857450  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:46.857770  3632 leader_election.cc:290] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:46.604127  3744 consensus_queue.cc:1059] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.254s
W20260709 12:59:46.680763  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 166173us
W20260709 12:59:46.822942  3834 consensus_meta.cc:287] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent flushing consensus metadata: real 0.652s	user 0.007s	sys 0.003s
I20260709 12:59:46.553768  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:46.786196  3752 consensus_queue.cc:237] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:46.860466  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:46.609684  3519 raft_consensus.cc:515] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:46.860710  3843 leader_election.cc:290] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:46.861944  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:46.906390  1600 raft_consensus.cc:2410] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 6 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:59:46.785912  3696 raft_consensus.cc:493] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:46.865800  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 12:59:46.822057  3661 consensus_meta.cc:287] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b: Time spent flushing consensus metadata: real 0.561s	user 0.005s	sys 0.001s
I20260709 12:59:46.553756  1598 raft_consensus.cc:2468] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 5.
I20260709 12:59:46.806773  3821 raft_consensus.cc:493] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:46.682355  3864 leader_election.cc:290] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:46.872591  3832 raft_consensus.cc:3060] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:46.795809  3820 raft_consensus.cc:493] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:46.923640  1600 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b"
dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
mode: GRACEFUL
new_leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:48230
I20260709 12:59:46.825953  3877 raft_consensus.cc:493] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:46.807534  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 285515us
I20260709 12:59:46.876318  1675 raft_consensus.cc:2468] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 5.
I20260709 12:59:46.896834  1572 leader_election.cc:304] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
W20260709 12:59:46.897531  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 83448.2us
I20260709 12:59:46.899552  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:46.869050  1606 raft_consensus.cc:2468] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 5.
I20260709 12:59:46.926810  2191 leader_election.cc:304] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:46.934401  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:46.935243  1675 raft_consensus.cc:2393] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 3: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 12:59:46.935997  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:46.878604  1427 catalog_manager.cc:5697] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 1 to 2, leader changed from 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) to b96ce9cc496c49d7818fa983a17b062b (127.0.107.196). New cstate: current_term: 2 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:59:46.902905  1607 consensus_meta.cc:287] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.574s	user 0.002s	sys 0.006s
I20260709 12:59:46.905411  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:46.911371  1674 raft_consensus.cc:2468] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 4.
I20260709 12:59:46.912628  1604 raft_consensus.cc:2410] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:59:46.900394  1601 raft_consensus.cc:2410] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:59:46.922497  2190 leader_election.cc:304] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
W20260709 12:59:46.905973  3692 consensus_meta.cc:287] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b: Time spent flushing consensus metadata: real 0.723s	user 0.009s	sys 0.001s
I20260709 12:59:46.924304  1600 raft_consensus.cc:606] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 5 LEADER]: Received request to transfer leadership to TS e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 12:59:46.993008  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 96263.2us
I20260709 12:59:46.933014  2221 raft_consensus.cc:2393] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 4: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 12:59:46.943701  1607 raft_consensus.cc:2468] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 4.
W20260709 12:59:47.006055  1607 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 454) took 2318 ms (client timeout 2094 ms). Trace:
I20260709 12:59:47.007722  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:47.008419  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:47.008790  2221 raft_consensus.cc:2393] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 4: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 12:59:47.010455  1602 raft_consensus.cc:1275] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
W20260709 12:59:47.006858  1607 rpcz_store.cc:269] 0709 12:59:44.687314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:46.310302 (+1622988us) service_pool.cc:224] Handling call
0709 12:59:47.005912 (+695610us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:46.968995  1571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:46.995749  1570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:47.009701  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:46.991915  1606 raft_consensus.cc:1275] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:59:46.997563  1603 raft_consensus.cc:2410] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 12:59:46.873373  3635 consensus_queue.cc:1175] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b96ce9cc496c49d7818fa983a17b062b" responder_term: 6 status { last_received { term: 6 index: 8 } last_committed_idx: 8 last_received_current_leader { term: 6 index: 8 } }
I20260709 12:59:47.017988  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:47.019011  1674 raft_consensus.cc:2410] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:59:46.861147  3881 raft_consensus.cc:515] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:47.012823  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 442) took 2401 ms. Trace:
I20260709 12:59:47.020741  1606 rpcz_store.cc:276] 0709 12:59:44.611629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:46.928287 (+2316658us) service_pool.cc:224] Handling call
0709 12:59:46.933265 (+  4978us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:47.012573 (+ 79308us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:47.012771 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:47.012827  1571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:47.010536  1497 leader_election.cc:304] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:46.999960  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:46.922489  3661 raft_consensus.cc:515] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:46.927911  3820 raft_consensus.cc:3060] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:46.927268  3834 raft_consensus.cc:515] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:46.929349  3821 raft_consensus.cc:3060] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:47.010938  1602 pending_rounds.cc:85] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642: Aborting all ops after (but not including) 5
I20260709 12:59:46.929253  3877 raft_consensus.cc:3060] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:47.032132  1602 pending_rounds.cc:107] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:59:47.032572  1602 raft_consensus.cc:2889] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:47.032697  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 455) took 2192 ms. Trace:
I20260709 12:59:47.033133  1604 rpcz_store.cc:276] 0709 12:59:44.834367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:47.003438 (+2169071us) service_pool.cc:224] Handling call
0709 12:59:47.003760 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:47.017449 (+ 13689us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:47.017477 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:47.026530 (+  9053us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:47.026572 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:47.026632 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:47.026776 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:47.025874  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49310 (request call id 408) took 2040 ms. Trace:
I20260709 12:59:46.910097  3874 consensus_queue.cc:1048] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.093s
I20260709 12:59:47.000618  3864 raft_consensus.cc:2804] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:47.029028  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 12:59:47.029515  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 117037us
I20260709 12:59:47.030272  1681 raft_consensus.cc:2468] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 7.
I20260709 12:59:47.035645  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:47.034624  1529 rpcz_store.cc:276] 0709 12:59:44.977931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:46.133080 (+1155149us) service_pool.cc:224] Handling call
0709 12:59:46.133783 (+   703us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:59:46.148625 (+ 14842us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:46.148660 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:59:46.168270 (+ 19610us) log.cc:844] Serialized 52 byte log entry
0709 12:59:46.514404 (+346134us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:46.514448 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:46.514520 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:47.017771 (+503251us) raft_consensus.cc:1685] finished
0709 12:59:47.017791 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:47.017923 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6127,"raft.queue_time_us":6270,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":5332,"thread_start_us":308554,"threads_started":1,"wal-append.queue_time_us":684054}
I20260709 12:59:47.039167  3632 raft_consensus.cc:493] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:47.055325  1675 raft_consensus.cc:2393] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 5: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 12:59:47.055550  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49310 (request call id 406) took 2078 ms. Trace:
I20260709 12:59:47.041612  3843 raft_consensus.cc:2804] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:47.044382  3661 leader_election.cc:290] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 6 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:47.047353  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:47.049440  3834 leader_election.cc:290] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 12:59:47.062000  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 133592us
W20260709 12:59:47.057489  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:47.018349  3888 raft_consensus.cc:2804] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:47.027328  3692 raft_consensus.cc:2749] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:59:47.036293  3792 consensus_meta.cc:287] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b: Time spent flushing consensus metadata: real 0.745s	user 0.009s	sys 0.000s
I20260709 12:59:47.056165  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:47.060237  1603 raft_consensus.cc:2468] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 3.
I20260709 12:59:47.068840  1675 raft_consensus.cc:2393] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 4: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 12:59:47.060963  3632 raft_consensus.cc:515] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 12:59:47.050066  3873 consensus_meta.cc:287] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b: Time spent flushing consensus metadata: real 0.591s	user 0.005s	sys 0.001s
I20260709 12:59:46.923837  3696 raft_consensus.cc:515] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 12:59:47.081153  2192 leader_election.cc:336] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Timed out: RequestConsensusVote RPC to 127.0.107.194:40303 timed out after 2.677s (SENT)
I20260709 12:59:47.059722  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:47.081988  1497 leader_election.cc:304] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:47.082360  1681 raft_consensus.cc:2393] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 4: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 12:59:47.081636  2192 leader_election.cc:304] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:47.060657  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:47.069118  2190 leader_election.cc:304] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:47.055922  1532 rpcz_store.cc:276] 0709 12:59:44.977395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:44.977515 (+   120us) service_pool.cc:224] Handling call
0709 12:59:44.989125 (+ 11610us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:59:44.989608 (+   483us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:44.989637 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:59:44.990284 (+   647us) log.cc:844] Serialized 52 byte log entry
0709 12:59:46.291555 (+1301271us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:46.291594 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:46.291658 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:47.055346 (+763688us) raft_consensus.cc:1685] finished
0709 12:59:47.055363 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:47.055495 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1048598,"raft.queue_time_us":1597,"raft.run_cpu_time_us":261,"raft.run_wall_time_us":50829,"thread_start_us":1300827,"threads_started":1,"wal-append.queue_time_us":1282038}
I20260709 12:59:47.067651  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 441) took 2457 ms. Trace:
I20260709 12:59:47.089969  1602 rpcz_store.cc:276] 0709 12:59:44.603834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:46.927861 (+2324027us) service_pool.cc:224] Handling call
0709 12:59:47.002435 (+ 74574us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:47.059008 (+ 56573us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:47.059206 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:47.075968  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:47.078286  1598 raft_consensus.cc:1275] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:59:47.078780  3873 raft_consensus.cc:515] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:47.091118  1603 raft_consensus.cc:2468] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 4.
I20260709 12:59:47.051015  3864 raft_consensus.cc:493] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:47.093532  1677 raft_consensus.cc:2393] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 5: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
W20260709 12:59:47.097236  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 44944.5us
I20260709 12:59:47.097656  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:47.103179  1674 raft_consensus.cc:3060] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:59:47.081911  3895 log.cc:927] Time spent T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 12:59:47.075970  3519 leader_election.cc:290] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:47.104578  3692 raft_consensus.cc:2804] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:47.092239  3831 raft_consensus.cc:2804] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:47.105397  3831 raft_consensus.cc:493] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:47.105755  3831 raft_consensus.cc:3060] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:59:47.108080  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 44106.7us
I20260709 12:59:47.109050  3692 raft_consensus.cc:697] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 4 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 12:59:47.110076  3692 consensus_queue.cc:237] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:47.092681  3843 raft_consensus.cc:697] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 12:59:47.112700  3843 consensus_queue.cc:237] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:47.115310  1602 raft_consensus.cc:1240] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:47.116617  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:47.117213  1602 raft_consensus.cc:2468] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 4.
I20260709 12:59:47.118063  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:47.119314  3841 raft_consensus.cc:2749] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:59:47.092453  3888 raft_consensus.cc:697] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 4 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 12:59:47.120031  2190 leader_election.cc:304] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:47.124446  1680 raft_consensus.cc:2468] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 3.
I20260709 12:59:47.126909  1681 raft_consensus.cc:1240] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:47.127887  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:47.128551  1598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 443) took 2505 ms. Trace:
I20260709 12:59:47.129009  1598 rpcz_store.cc:276] 0709 12:59:44.621085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:47.002998 (+2381913us) service_pool.cc:224] Handling call
0709 12:59:47.051698 (+ 48700us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:47.094198 (+ 42500us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:47.126701 (+ 32503us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:47.130259  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:47.131758  1598 raft_consensus.cc:1275] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:59:47.132532  1496 leader_election.cc:304] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:47.132876  1598 raft_consensus.cc:1240] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:47.133332  3841 raft_consensus.cc:2804] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:47.133436  1496 leader_election.cc:304] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:47.133898  3841 raft_consensus.cc:697] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 12:59:47.134294  1496 leader_election.cc:304] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:47.134930  3834 raft_consensus.cc:2804] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:47.134724  3661 consensus_queue.cc:1059] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:47.135500  3841 consensus_queue.cc:237] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:47.128497  2225 raft_consensus.cc:1275] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:47.136736  3881 leader_election.cc:290] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:47.138283  3873 leader_election.cc:290] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 4 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:47.124984  3878 raft_consensus.cc:493] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:47.101428  3864 raft_consensus.cc:3060] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:47.165140  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:47.165774  3834 raft_consensus.cc:697] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 12:59:47.097033  3901 raft_consensus.cc:493] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:47.166491  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 84591us
I20260709 12:59:47.167222  3831 raft_consensus.cc:515] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:47.073609  3792 raft_consensus.cc:515] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:47.171166  3889 leader_election.cc:290] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:47.161480  3709 raft_consensus.cc:2804] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:47.161710  3888 consensus_queue.cc:237] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 12:59:47.176127  1599 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36194 (request call id 1367) took 4100 ms (client timeout 1720 ms). Trace:
I20260709 12:59:47.176582  3820 raft_consensus.cc:515] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:47.177435  1605 raft_consensus.cc:3055] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:47.177897  1681 raft_consensus.cc:1275] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:59:47.098742  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:47.139528  3821 raft_consensus.cc:515] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:47.135432  1571 leader_election.cc:304] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:47.260155  1605 raft_consensus.cc:740] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:47.225239  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
W20260709 12:59:47.225332  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 105382us
I20260709 12:59:47.183076  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:47.120991  3856 raft_consensus.cc:2749] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:47.149760  1677 raft_consensus.cc:2468] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 2.
I20260709 12:59:47.330879  1497 leader_election.cc:304] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:47.358239  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:47.329365  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 12:59:47.259188  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 124958us
I20260709 12:59:47.331347  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:47.345767  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:47.314767  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:47.407497  1678 raft_consensus.cc:3060] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:47.409498  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:47.214097  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:47.330219  1679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49178 (request call id 1593) took 1906 ms. Trace:
I20260709 12:59:47.182515  1674 raft_consensus.cc:2468] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 6.
I20260709 12:59:47.412163  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:47.407997  1675 raft_consensus.cc:2468] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 5.
I20260709 12:59:47.410332  1604 raft_consensus.cc:3060] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:47.260046  1599 rpcz_store.cc:269] 0709 12:59:43.075352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:43.373608 (+298256us) service_pool.cc:224] Handling call
0709 12:59:47.175766 (+3802158us) spinlock_profiling.cc:243] Waited 3.33 s on lock 0x7b54003499d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 12:59:47.175959 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7668262784}
I20260709 12:59:47.410108  1496 leader_election.cc:304] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:47.413631  1681 raft_consensus.cc:2393] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 6: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 12:59:47.363020   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:59:47.408002  1673 raft_consensus.cc:2393] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 6: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 12:59:47.413941  2190 leader_election.cc:304] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:47.422544  2225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50310 (request call id 505) took 1014 ms. Trace:
I20260709 12:59:47.426069  1496 leader_election.cc:304] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:47.441493  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:47.221279  3891 leader_election.cc:290] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:47.447291  3877 raft_consensus.cc:515] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:47.448132  3831 leader_election.cc:290] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 3 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:47.410830  1605 consensus_queue.cc:260] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:59:47.325011  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:47.332592  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:47.240952  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:47.223543  3832 raft_consensus.cc:493] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:47.421131   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:47.418100  1679 rpcz_store.cc:276] 0709 12:59:45.424208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:45.454717 (+ 30509us) service_pool.cc:224] Handling call
0709 12:59:45.530733 (+ 76016us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:46.825294 (+1294561us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:46.825323 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:46.835218 (+  9895us) log.cc:844] Serialized 26 byte log entry
0709 12:59:47.095766 (+260548us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:47.095809 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:47.095887 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:47.330017 (+234130us) raft_consensus.cc:1685] finished
0709 12:59:47.330034 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:47.330163 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":558407,"raft.queue_time_us":591807,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":11862,"thread_start_us":890316,"threads_started":2,"wal-append.queue_time_us":338258}
I20260709 12:59:47.281184  3519 raft_consensus.cc:2804] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:47.425781  2225 rpcz_store.cc:276] 0709 12:59:46.394446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:46.394558 (+   112us) service_pool.cc:224] Handling call
0709 12:59:46.403622 (+  9064us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:47.163307 (+759685us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:47.388205 (+224898us) spinlock_profiling.cc:243] Waited 689 ms on lock 0x7b5400600ed4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 12:59:47.408678 (+ 20473us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1584385920}
W20260709 12:59:47.481487  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 346111us
W20260709 12:59:47.490286  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:47.407620  3709 raft_consensus.cc:493] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:47.547812  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 210150us
I20260709 12:59:47.262064  3878 raft_consensus.cc:3060] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:47.604892  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 197965us
W20260709 12:59:47.601608  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 177695us
I20260709 12:59:47.685413  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 460) took 2709 ms. Trace:
I20260709 12:59:47.453397  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:47.711093  1600 raft_consensus.cc:2468] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 5.
I20260709 12:59:47.712110  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:47.712682  1600 raft_consensus.cc:3060] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:47.697355  2219 raft_consensus.cc:2468] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 4.
I20260709 12:59:47.714443  2219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50310 (request call id 508) took 1269 ms. Trace:
W20260709 12:59:47.484325  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 55314.9us
I20260709 12:59:47.630416  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:47.451350  1673 raft_consensus.cc:1240] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 2. Current term is 3. Ops: []
W20260709 12:59:47.715657  1646 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:40303 timed out after 1.890s (SENT) [suppressed 56 similar messages]
I20260709 12:59:47.661677  2192 leader_election.cc:304] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:47.372016  3751 raft_consensus.cc:3055] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:47.223363  3874 raft_consensus.cc:3055] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:47.324990  3834 consensus_queue.cc:237] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:47.367667  3820 leader_election.cc:290] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:47.382817  3696 leader_election.cc:290] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:47.695693  1604 raft_consensus.cc:2468] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 4.
I20260709 12:59:47.518471  3902 raft_consensus.cc:2764] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:59:47.448920  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:47.679195  1605 raft_consensus.cc:3060] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:47.695199  1571 leader_election.cc:304] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:47.700631  3777 consensus_queue.cc:1048] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:47.707935  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:47.696797  1672 raft_consensus.cc:3060] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:47.694161  1675 raft_consensus.cc:1240] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:47.738607  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:47.715721  1599 raft_consensus.cc:2468] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 2.
I20260709 12:59:47.657313  3856 raft_consensus.cc:2804] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:47.694099  3519 raft_consensus.cc:493] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:47.743240  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 81648.3us
W20260709 12:59:47.723997  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:47.724361  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:47.726416  2191 leader_election.cc:304] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:47.426167  3843 raft_consensus.cc:2804] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:47.450902  3792 leader_election.cc:290] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 5 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:47.449499  3877 leader_election.cc:290] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 4 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:47.305315  3901 raft_consensus.cc:515] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:47.729709  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:47.727105  3874 raft_consensus.cc:740] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 12:59:47.381467  3632 leader_election.cc:290] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:47.734145  2226 raft_consensus.cc:1240] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:47.753768  1675 raft_consensus.cc:2393] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 7: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 12:59:47.755628  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:47.736454  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:47.736686  2225 raft_consensus.cc:1240] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 6 LEARNER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 5. Current term is 6. Ops: []
W20260709 12:59:47.740912  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 45776.8us
I20260709 12:59:47.718858  3751 raft_consensus.cc:740] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:47.746135  1604 raft_consensus.cc:2376] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 5. Re-sending same reply.
I20260709 12:59:47.697877  3709 raft_consensus.cc:3060] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:47.876497  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:47.749562  1605 raft_consensus.cc:1275] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 12:59:47.752393  1646 leader_election.cc:304] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:47.884258  1605 pending_rounds.cc:85] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642: Aborting all ops after (but not including) 5
I20260709 12:59:47.884543  1605 pending_rounds.cc:107] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 12:59:47.884768  1605 raft_consensus.cc:2889] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:47.885095  1678 raft_consensus.cc:2468] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 4.
W20260709 12:59:47.799962  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 73645.9us
I20260709 12:59:47.719471  3832 raft_consensus.cc:515] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:47.818145  3635 raft_consensus.cc:2749] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:59:47.804304  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 481867us
I20260709 12:59:47.776269  3922 raft_consensus.cc:2804] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:47.750262  3519 raft_consensus.cc:3060] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:47.815502  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36200 (request call id 1780) took 1526 ms. Trace:
I20260709 12:59:47.893496  1497 leader_election.cc:304] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:47.845098  3696 raft_consensus.cc:2804] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:47.740371  3856 raft_consensus.cc:493] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:47.754781  3692 raft_consensus.cc:2749] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:47.714831  2219 rpcz_store.cc:276] 0709 12:59:46.444854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:46.456285 (+ 11431us) service_pool.cc:224] Handling call
0709 12:59:47.323729 (+867444us) spinlock_profiling.cc:243] Waited 3.95 ms on lock 0x7b5800015c98. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a1548eb71 00007f6a1548eeee 0000000000375939 00007f6a1d5021e0 00007f6a1d5cb0c4 00007f6a1d5cb131 00007f6a1d5790a0 00007f6a1d578984 00007f6a16af36d4 00007f6a16af3662
0709 12:59:47.714372 (+390643us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9073920}
I20260709 12:59:47.754316  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:47.742602  3820 raft_consensus.cc:2804] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:47.778146  3821 leader_election.cc:290] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 12:59:47.827486  1570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:47.787459  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:47.845285  1677 raft_consensus.cc:1240] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:47.845669  1675 raft_consensus.cc:1240] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:47.866410  1680 raft_consensus.cc:1240] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:47.929889  1680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49170 (request call id 1653) took 1071 ms. Trace:
I20260709 12:59:47.866364  1602 raft_consensus.cc:2468] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 4.
I20260709 12:59:47.930220  1680 rpcz_store.cc:276] 0709 12:59:46.858272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:47.426917 (+568645us) service_pool.cc:224] Handling call
0709 12:59:47.866064 (+439147us) spinlock_profiling.cc:243] Waited 6.18 ms on lock 0x7b5800143798. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a1548eb71 00007f6a1548ea22 00007f6a1e3a7c09 00007f6a1d501ee0 00007f6a1d5cb0ab 00007f6a1d5cb131 00007f6a1d58cfc0 00007f6a1d577929 00007f6a1d5773d2 00007f6a16aeebd4
0709 12:59:47.866250 (+   186us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:47.929656 (+ 63406us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:47.929836 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14213888}
I20260709 12:59:47.710012  1607 rpcz_store.cc:276] 0709 12:59:44.975844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:47.022724 (+2046880us) service_pool.cc:224] Handling call
0709 12:59:47.023056 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:47.037839 (+ 14783us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:59:47.379428 (+341589us) log.cc:844] Serialized 14 byte log entry
0709 12:59:47.685107 (+305679us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:47.685149 (+    42us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:47.685181 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:47.685228 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:47.685333 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":63038,"prepare.queue_time_us":600314,"raft.queue_time_us":90326,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":103,"spinlock_wait_cycles":23315072,"thread_start_us":450609,"threads_started":2}
I20260709 12:59:47.908815  3856 raft_consensus.cc:3060] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:47.937990  1603 raft_consensus.cc:2468] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 5.
I20260709 12:59:47.885735  1571 leader_election.cc:304] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:47.887835  1604 raft_consensus.cc:1275] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:59:47.858777  3864 consensus_meta.cc:287] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.536s	user 0.005s	sys 0.006s
I20260709 12:59:47.883713  1599 raft_consensus.cc:2468] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 7.
I20260709 12:59:47.890050  1600 raft_consensus.cc:2468] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 5.
I20260709 12:59:47.918571  3820 raft_consensus.cc:493] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:47.890523  2191 leader_election.cc:304] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
W20260709 12:59:47.892313  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 148255us
I20260709 12:59:47.941830  1604 raft_consensus.cc:1275] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:59:47.942556  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 56247us
W20260709 12:59:47.928820  3920 log.cc:927] Time spent T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 12:59:47.833674  1679 raft_consensus.cc:3060] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:47.893414  1606 rpcz_store.cc:276] 0709 12:59:46.288888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:47.029349 (+740461us) service_pool.cc:224] Handling call
0709 12:59:47.057066 (+ 27717us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:47.064101 (+  7035us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:47.064135 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:47.096102 (+ 31967us) log.cc:844] Serialized 26 byte log entry
0709 12:59:47.368189 (+272087us) spinlock_profiling.cc:243] Waited 3.3 ms on lock 0x7b18004b88c0. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1e38ede1 00007f6a1e39b5b1 00007f6a154a8e07 00007f6a1e303ab9 00007f6a154c569b 00007f6a154c393f 00007f6a154c5c02 00007f6a1814d20b 00007f6a18152d23 00007f6a181530d1 00007f6a1856ea0f
0709 12:59:47.535769 (+167580us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:47.535814 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:47.535888 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:47.815183 (+279295us) raft_consensus.cc:1685] finished
0709 12:59:47.815208 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:47.815439 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":45161,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":98,"spinlock_wait_cycles":7594368,"thread_start_us":167393,"threads_started":1,"wal-append.queue_time_us":604021}
I20260709 12:59:47.896698  1678 raft_consensus.cc:1240] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:47.899928  3632 raft_consensus.cc:2749] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:47.912917  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:47.913682  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 12:59:47.949385  2226 raft_consensus.cc:3060] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:47.893038  3922 raft_consensus.cc:493] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:47.906853  3828 raft_consensus.cc:2804] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:47.960472  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:47.869939  1674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49170 (request call id 1645) took 1048 ms. Trace:
I20260709 12:59:47.917210  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 12:59:47.891211  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 138919us
I20260709 12:59:47.850870  3843 raft_consensus.cc:697] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 12:59:47.920550  3696 raft_consensus.cc:697] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 6 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 12:59:47.939451  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 12:59:48.142494  2227 raft_consensus.cc:1240] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:48.116523  2226 raft_consensus.cc:2468] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 5.
I20260709 12:59:48.048601  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:48.048141  1532 raft_consensus.cc:1240] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 LEADER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:48.088706  1528 raft_consensus.cc:1240] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 4. Current term is 5. Ops: [4.6-4.6]
W20260709 12:59:48.025204  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:47.961778  2191 leader_election.cc:304] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
W20260709 12:59:48.129231  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 235808us
I20260709 12:59:48.153885  1646 leader_election.cc:304] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b
W20260709 12:59:48.032083  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 75670.5us
I20260709 12:59:48.114125  1526 raft_consensus.cc:1240] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 3. Current term is 4. Ops: []
W20260709 12:59:48.099516  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:48.072561  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
W20260709 12:59:48.149848  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 264186us
I20260709 12:59:48.161386  1571 leader_election.cc:304] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
W20260709 12:59:48.127941  3895 log.cc:927] Time spent T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
I20260709 12:59:48.149602  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49170 (request call id 1662) took 1020 ms. Trace:
I20260709 12:59:47.946812  3820 raft_consensus.cc:3060] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:48.174432  1529 raft_consensus.cc:3060] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:48.168910  1681 rpcz_store.cc:276] 0709 12:59:47.129568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:47.470022 (+340454us) service_pool.cc:224] Handling call
0709 12:59:47.785508 (+315486us) spinlock_profiling.cc:243] Waited 2.95 ms on lock 0x7b5800143798. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a1548eb71 00007f6a1548ea22 00007f6a1e3a7c09 00007f6a1d501ee0 00007f6a1d5cb0ab 00007f6a1d5cb131 00007f6a1d58cfc0 00007f6a1d577929 00007f6a1d5773d2 00007f6a16aeebd4
0709 12:59:47.816156 (+ 30648us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:47.816390 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:59:47.859536 (+ 43146us) log.cc:844] Serialized 14 byte log entry
0709 12:59:48.149178 (+289642us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:48.149245 (+    67us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:48.149295 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:48.149371 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:48.149526 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":43291,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":50326,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":48161,"spinlock_wait_cycles":6791424,"thread_start_us":270907,"threads_started":2,"wal-append.queue_time_us":307718}
I20260709 12:59:48.143126  3632 raft_consensus.cc:493] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:48.177646  1571 leader_election.cc:304] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:48.166327  1530 raft_consensus.cc:2393] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 4: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 12:59:47.955020  3792 raft_consensus.cc:2804] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:47.932085  3874 consensus_queue.cc:260] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 12:59:48.116467  3910 log.cc:927] Time spent T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.715s	user 0.005s	sys 0.000s
I20260709 12:59:47.960629  3922 raft_consensus.cc:3060] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:48.095379  3915 log.cc:927] Time spent T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 12:59:47.946646  3902 raft_consensus.cc:493] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 12:59:48.190691  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 12:59:48.190913  3902 raft_consensus.cc:515] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:48.192368  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:48.193307  3902 leader_election.cc:290] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 12:59:48.168435  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 88781.7us
I20260709 12:59:48.049985  3828 raft_consensus.cc:697] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 6 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:48.195534  3828 consensus_queue.cc:237] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:47.961663  1674 rpcz_store.cc:276] 0709 12:59:46.821745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:47.424925 (+603180us) service_pool.cc:224] Handling call
0709 12:59:47.450429 (+ 25504us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:47.450625 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:59:47.572317 (+121692us) log.cc:844] Serialized 14 byte log entry
0709 12:59:47.869033 (+296716us) log.cc:844] Serialized 14 byte log entry
0709 12:59:47.869323 (+   290us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:47.869574 (+   251us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:47.869649 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:47.869725 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:47.869865 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35181,"prepare.queue_time_us":77773,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":89,"raft.queue_time_us":25809,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":101,"spinlock_wait_cycles":14095744,"thread_start_us":135914,"threads_started":1,"wal-append.queue_time_us":286129}
I20260709 12:59:48.202067  1598 raft_consensus.cc:2468] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 7.
I20260709 12:59:48.096810  3877 consensus_queue.cc:1048] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.093s
I20260709 12:59:48.005476  3832 leader_election.cc:290] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:47.960644  3635 raft_consensus.cc:2749] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:59:48.114509  3924 log.cc:927] Time spent T 00000000000000000000000000000000 P 9f38d0e5c9db43a48554defe1153354e: Append to log took a long time: real 0.202s	user 0.001s	sys 0.000s
I20260709 12:59:48.179694  2227 raft_consensus.cc:1275] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:59:48.218578  1600 raft_consensus.cc:1275] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:59:48.212047  2192 leader_election.cc:304] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:48.159075  2220 raft_consensus.cc:3060] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:48.181313  1497 leader_election.cc:304] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:47.943531  3864 raft_consensus.cc:515] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:48.006125  3692 consensus_queue.cc:1059] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.170s
I20260709 12:59:48.167325  3744 raft_consensus.cc:2749] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:48.188227  1529 raft_consensus.cc:2468] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 3.
I20260709 12:59:48.186254  3752 raft_consensus.cc:2804] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:48.227149  3752 raft_consensus.cc:493] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:48.227594  3752 raft_consensus.cc:3060] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:48.228338  3864 leader_election.cc:290] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:48.229509  1601 raft_consensus.cc:2468] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 3.
I20260709 12:59:48.231647  3936 consensus_queue.cc:1059] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:48.214859  3874 raft_consensus.cc:3060] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:48.232589  3876 consensus_queue.cc:1048] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:48.235345  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:48.236343  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36200 (request call id 1803) took 1037 ms. Trace:
I20260709 12:59:48.237027  1532 raft_consensus.cc:1240] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:48.189312  3632 raft_consensus.cc:515] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:48.203399  1530 raft_consensus.cc:1240] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:59:48.204471  3902 raft_consensus.cc:493] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:48.204645  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:48.205638  1598 raft_consensus.cc:1240] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 6 LEADER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:48.180749  3889 consensus_queue.cc:1048] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.043s
W20260709 12:59:48.207679  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 245973us
W20260709 12:59:48.210542  3929 log.cc:927] Time spent T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:59:48.210793  3792 raft_consensus.cc:697] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 3 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 12:59:48.211009  3892 raft_consensus.cc:2804] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:48.211838  3901 leader_election.cc:290] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:48.211961  3917 consensus_queue.cc:1048] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:59:48.212675  3927 log.cc:927] Time spent T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
W20260709 12:59:48.213459  3928 log.cc:927] Time spent T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 12:59:48.151963  3878 raft_consensus.cc:515] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 12:59:48.216320  3918 log.cc:927] Time spent T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.306s	user 0.000s	sys 0.001s
I20260709 12:59:48.003088  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:47.946879  3751 consensus_queue.cc:260] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 12:59:48.224750  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 55581.8us
I20260709 12:59:48.236733  1603 rpcz_store.cc:276] 0709 12:59:47.199391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:47.441181 (+241790us) service_pool.cc:224] Handling call
0709 12:59:48.236202 (+795021us) spinlock_profiling.cc:243] Waited 433 ms on lock 0x7b54002ac954. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 12:59:48.236291 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":995884800}
I20260709 12:59:48.183789  1672 raft_consensus.cc:2468] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 4.
I20260709 12:59:48.179520  3777 consensus_queue.cc:1059] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 12:59:48.171037  3891 raft_consensus.cc:2804] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:48.248729  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:48.247007  3640 raft_consensus.cc:2764] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:59:48.270170  1528 raft_consensus.cc:3060] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:48.254122  1531 raft_consensus.cc:1240] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 LEADER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:48.258764  1527 raft_consensus.cc:1275] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:59:48.263636  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 51650.2us
W20260709 12:59:48.278182  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 107723us
I20260709 12:59:48.250245  3933 raft_consensus.cc:2804] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:48.273234  3940 raft_consensus.cc:3055] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:48.246918  3902 raft_consensus.cc:515] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:48.290926  3632 leader_election.cc:290] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 12:59:48.285971  3932 log.cc:927] Time spent T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 12:59:48.273602  3891 raft_consensus.cc:493] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:48.309741  3891 raft_consensus.cc:3060] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:48.244735  3843 consensus_queue.cc:237] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:48.280031  1672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49178 (request call id 1601) took 1135 ms. Trace:
I20260709 12:59:48.302779  3922 raft_consensus.cc:515] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:48.296113  3940 raft_consensus.cc:740] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:48.336045  3940 consensus_queue.cc:260] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:48.337363  3940 raft_consensus.cc:3060] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:48.337769  3891 raft_consensus.cc:515] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:48.287250  3933 raft_consensus.cc:493] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:48.338992  3933 raft_consensus.cc:3060] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:48.306260  3752 raft_consensus.cc:515] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 12:59:48.343330  3912 log.cc:927] Time spent T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.802s	user 0.003s	sys 0.000s
I20260709 12:59:48.308681  3902 leader_election.cc:290] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:48.315666  1679 raft_consensus.cc:2468] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 4.
W20260709 12:59:48.325450  1644 leader_election.cc:336] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.528s (SENT)
I20260709 12:59:48.247340  3696 consensus_queue.cc:237] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:48.327163  1672 rpcz_store.cc:276] 0709 12:59:47.141708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:47.309114 (+167406us) service_pool.cc:224] Handling call
0709 12:59:48.276764 (+967650us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:48.335075  3922 leader_election.cc:290] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 12:59:48.333060  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 155484us
I20260709 12:59:48.353075  3902 consensus_queue.cc:1059] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:59:48.354418  3902 raft_consensus.cc:3055] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:59:48.354768  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:48.354857  3902 raft_consensus.cc:740] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:48.345238  1644 leader_election.cc:304] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:48.288177  3751 raft_consensus.cc:3060] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:59:48.357627  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 74428.4us
I20260709 12:59:48.350010  1528 raft_consensus.cc:2468] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 3.
I20260709 12:59:48.355841  3902 consensus_queue.cc:260] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:48.370621  3902 raft_consensus.cc:3060] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:48.371237  3933 raft_consensus.cc:515] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:48.373167  2220 raft_consensus.cc:2468] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 6.
I20260709 12:59:48.355859  3878 leader_election.cc:290] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:48.373567  3933 leader_election.cc:290] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:48.308715  3519 raft_consensus.cc:515] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:48.389339  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36194 (request call id 1383) took 4986 ms. Trace:
I20260709 12:59:48.389732  1605 rpcz_store.cc:276] 0709 12:59:43.403430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:46.524231 (+3120801us) service_pool.cc:224] Handling call
0709 12:59:47.177306 (+653075us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:47.885141 (+707835us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:48.389151 (+504010us) spinlock_profiling.cc:243] Waited 622 ms on lock 0x7b54003499d0. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b28ad 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 12:59:48.389280 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1431464832}
I20260709 12:59:48.391917  1674 raft_consensus.cc:3055] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:48.392339  1674 raft_consensus.cc:740] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:48.387022  1497 leader_election.cc:304] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:48.294865  3792 consensus_queue.cc:237] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:48.396229  1523 raft_consensus.cc:1240] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 LEADER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:48.396461  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 12:59:48.398646  1571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:48.399798  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:48.401438  1679 raft_consensus.cc:1240] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:48.403040  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:48.403836  1680 raft_consensus.cc:2368] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 3. Current term is 4.
I20260709 12:59:48.420017  1676 raft_consensus.cc:2468] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 5.
I20260709 12:59:48.424830  1674 consensus_queue.cc:260] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:48.368994  3709 raft_consensus.cc:515] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:48.433866  1674 raft_consensus.cc:3060] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:48.387208  3889 consensus_queue.cc:1059] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:59:48.444350  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:48.429961  3843 raft_consensus.cc:2804] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:48.447582  1571 leader_election.cc:400] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 election: Vote denied by peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217) with higher term. Message: Invalid argument: T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 3. Current term is 4.
I20260709 12:59:48.448117  1571 leader_election.cc:403] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:59:48.430883  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:48.436281  3635 raft_consensus.cc:493] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:48.449388  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 74046.1us
I20260709 12:59:48.448387  3832 raft_consensus.cc:493] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:48.446879  3892 raft_consensus.cc:697] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 4 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
W20260709 12:59:48.458153  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 217119us
I20260709 12:59:48.449146  3843 raft_consensus.cc:493] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:48.455737  3864 raft_consensus.cc:3055] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:59:48.474326  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 191262us
I20260709 12:59:48.455971  3889 raft_consensus.cc:3060] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:48.473049  3892 consensus_queue.cc:237] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:48.471905  3519 leader_election.cc:290] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 12:59:48.478564  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:48.484157  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:48.484865  1674 raft_consensus.cc:1275] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:59:48.489034  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
W20260709 12:59:48.489457  3944 log.cc:927] Time spent T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:59:48.486902  3819 consensus_queue.cc:1048] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 12:59:48.490056  2192 leader_election.cc:304] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:48.491472  3873 consensus_queue.cc:1059] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:48.492254  3873 consensus_queue.cc:1243] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 log is divergent from this leader: its last log entry 6.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:59:48.492916  1680 raft_consensus.cc:1240] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:48.493476  3877 raft_consensus.cc:3055] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:48.492758  3873 consensus_queue.cc:1059] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:48.493912  3877 raft_consensus.cc:740] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 12:59:48.494413  3873 raft_consensus.cc:3055] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:48.494954  3873 raft_consensus.cc:740] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
W20260709 12:59:48.495570  3930 log.cc:927] Time spent T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.380s	user 0.000s	sys 0.004s
I20260709 12:59:48.495810  3873 consensus_queue.cc:260] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 12:59:48.497213  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 210749us
W20260709 12:59:48.498448  2190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:48.498819  3874 consensus_queue.cc:1059] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:48.499049  1646 leader_election.cc:304] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:48.460800  3843 raft_consensus.cc:3060] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:48.499928  3831 consensus_queue.cc:1059] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:59:48.500245  3856 raft_consensus.cc:515] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:48.500914  3878 raft_consensus.cc:2749] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:48.489828  2226 raft_consensus.cc:2368] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 3. Current term is 4.
I20260709 12:59:48.488932  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:48.504722  1646 leader_election.cc:304] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:48.513669  1646 leader_election.cc:304] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
W20260709 12:59:48.499771  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 174390us
W20260709 12:59:48.502454  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:48.515162  1644 leader_election.cc:336] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.565s (SENT)
I20260709 12:59:48.515585  1644 leader_election.cc:304] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:48.519052  1675 raft_consensus.cc:1275] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:59:48.519999  1644 leader_election.cc:336] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.583s (SENT)
I20260709 12:59:48.455684  3635 raft_consensus.cc:515] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 12:59:48.520802  1644 leader_election.cc:336] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.587s (SENT)
I20260709 12:59:48.474817  3864 raft_consensus.cc:740] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:48.497020  3873 raft_consensus.cc:3060] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:48.524987  1572 leader_election.cc:304] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:48.484987  3891 leader_election.cc:290] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:48.525637  3876 raft_consensus.cc:2804] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:48.538030  3876 raft_consensus.cc:493] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:48.538448  3876 raft_consensus.cc:3060] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:48.539372  1673 raft_consensus.cc:1240] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:48.542834  3777 raft_consensus.cc:493] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:48.543514  3777 raft_consensus.cc:515] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:48.545876  3777 leader_election.cc:290] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:48.528839  1497 leader_election.cc:304] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:48.548172  3856 leader_election.cc:290] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 4 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:48.548810  3909 raft_consensus.cc:2749] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:48.529191  1672 raft_consensus.cc:1240] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:48.532755  3635 leader_election.cc:290] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:48.536866  3941 raft_consensus.cc:2804] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:48.560689  3941 raft_consensus.cc:697] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 5 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:48.561770  3941 consensus_queue.cc:237] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:48.537348  3878 consensus_queue.cc:1048] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:48.530407  1646 leader_election.cc:304] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:48.565095  1646 leader_election.cc:304] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:48.566591  3940 raft_consensus.cc:2749] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:48.568378  3940 raft_consensus.cc:2804] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:48.568758  3940 raft_consensus.cc:493] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:48.569075  3940 raft_consensus.cc:3060] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:48.525826  3828 raft_consensus.cc:2749] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:48.556311  3902 raft_consensus.cc:2764] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:59:48.521401  3947 raft_consensus.cc:493] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:48.475520  3832 raft_consensus.cc:515] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 12:59:48.577865  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:48.513453  3936 raft_consensus.cc:2804] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:59:48.584144  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 72890.6us
I20260709 12:59:48.587011  3909 consensus_queue.cc:1059] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:48.582489  3891 consensus_queue.cc:1048] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 12:59:48.588855  3864 consensus_queue.cc:260] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:48.589025  3876 raft_consensus.cc:515] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:48.590286  3864 raft_consensus.cc:3060] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:48.592162  3709 leader_election.cc:290] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 4 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:48.594434  3947 raft_consensus.cc:515] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:48.596952  3947 leader_election.cc:290] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:48.597818  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:48.598752  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:48.599453  1605 raft_consensus.cc:2376] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 4. Re-sending same reply.
I20260709 12:59:48.600589  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:48.601343  1605 raft_consensus.cc:2393] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 7: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 12:59:48.602062  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:48.602715  3935 raft_consensus.cc:3055] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:48.603308  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:48.603992  1602 raft_consensus.cc:2376] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 4. Re-sending same reply.
I20260709 12:59:48.604401  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 466) took 1579 ms. Trace:
I20260709 12:59:48.605079  3902 raft_consensus.cc:493] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:48.605741  3902 raft_consensus.cc:515] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:48.608098  3902 leader_election.cc:290] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:48.598865  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:48.610965  1603 raft_consensus.cc:2468] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 5.
I20260709 12:59:48.615602  1571 leader_election.cc:304] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:48.557816  3917 raft_consensus.cc:3055] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:48.494772  3877 consensus_queue.cc:260] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:48.603253  3935 raft_consensus.cc:740] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 12:59:48.602803  1604 raft_consensus.cc:2468] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 3.
I20260709 12:59:48.622102  2191 leader_election.cc:304] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:48.652406  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:48.658222  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:48.659035  1604 raft_consensus.cc:3060] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:48.612169  3936 raft_consensus.cc:493] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:48.620592  3947 raft_consensus.cc:2804] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:48.671438  1605 raft_consensus.cc:1275] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:48.669062  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
W20260709 12:59:48.677263  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 148827us
I20260709 12:59:48.677692  2192 leader_election.cc:304] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:48.620463  3752 leader_election.cc:290] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:48.619863  3917 raft_consensus.cc:740] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 12:59:48.690217  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:48.690847  1531 raft_consensus.cc:3060] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:48.604840  1601 rpcz_store.cc:276] 0709 12:59:47.024553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:47.051793 (+ 27240us) service_pool.cc:224] Handling call
0709 12:59:48.604194 (+1552401us) spinlock_profiling.cc:243] Waited 817 ms on lock 0x7b5400058054. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 12:59:48.604329 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1878436608}
W20260709 12:59:48.729929  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 163962us
I20260709 12:59:48.731282  1646 leader_election.cc:304] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:48.732313  1646 leader_election.cc:304] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:48.733325  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:48.689195  2190 leader_election.cc:304] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:48.675294  3877 raft_consensus.cc:3060] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:48.623955  3777 consensus_queue.cc:1048] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.082s
I20260709 12:59:48.657990  1598 raft_consensus.cc:2468] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 3.
I20260709 12:59:48.664515  3831 raft_consensus.cc:2804] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:48.687705  1496 leader_election.cc:304] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:48.729996  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:48.668666  3936 raft_consensus.cc:3060] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:48.768239  1523 raft_consensus.cc:3060] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:48.768652  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 81002.5us
I20260709 12:59:48.673861  3947 raft_consensus.cc:493] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:48.747013  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 57902us
I20260709 12:59:48.665540  3902 consensus_queue.cc:1059] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.071s
I20260709 12:59:48.674000  3709 consensus_queue.cc:1059] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.075s
I20260709 12:59:48.673560  3874 consensus_queue.cc:1048] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 12:59:48.779464   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:48.709456  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
W20260709 12:59:48.784888  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:48.734269  3934 raft_consensus.cc:3060] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:48.751587  3777 consensus_queue.cc:1243] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer ddf11fc190dd4b898773379c6b129d90 log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:59:48.810206  1604 raft_consensus.cc:2468] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 5.
I20260709 12:59:48.735718  1605 raft_consensus.cc:3060] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:48.707736  3692 consensus_queue.cc:1048] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.072s
I20260709 12:59:48.764338  3696 raft_consensus.cc:3060] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:48.771569  3856 raft_consensus.cc:2804] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:48.789119  3947 raft_consensus.cc:3060] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:48.781318  3632 raft_consensus.cc:2804] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:59:48.823438  1570 leader_election.cc:336] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.507s (SENT)
I20260709 12:59:48.799904  3889 raft_consensus.cc:2749] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217) with higher term. Message: Invalid argument: T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 3. Current term is 4.
I20260709 12:59:48.797821  3831 raft_consensus.cc:697] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 4 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
W20260709 12:59:48.873898  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 141667us
I20260709 12:59:48.802917  3902 raft_consensus.cc:493] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:48.907959  1605 raft_consensus.cc:2468] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 4.
I20260709 12:59:48.820785  3752 raft_consensus.cc:493] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
W20260709 12:59:48.944029  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:48.830266  3876 leader_election.cc:290] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:48.836146  3828 raft_consensus.cc:2804] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:59:48.957139  1644 leader_election.cc:336] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.706s (SENT)
I20260709 12:59:48.963353  1644 leader_election.cc:304] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 12:59:48.957368  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 184626us
W20260709 12:59:48.975965  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 419261us
I20260709 12:59:48.913208  1672 raft_consensus.cc:2393] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 3: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
W20260709 12:59:48.987783  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:48.988840  1572 leader_election.cc:400] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 election: Vote denied by peer b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373) with higher term. Message: Invalid argument: T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 3. Current term is 4.
I20260709 12:59:48.866873  3901 raft_consensus.cc:3055] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:48.877378  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:48.873639  3856 raft_consensus.cc:697] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 3 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
W20260709 12:59:49.013955  1571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:48.903421  3661 consensus_queue.cc:1059] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.092s
I20260709 12:59:49.046141  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:48.904258  3709 consensus_queue.cc:1059] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.120s
I20260709 12:59:49.068244  2224 raft_consensus.cc:2393] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 4: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
W20260709 12:59:49.040942  3751 consensus_meta.cc:287] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.679s	user 0.009s	sys 0.001s
I20260709 12:59:49.005527  3901 raft_consensus.cc:740] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:49.137750  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:49.141224  1678 raft_consensus.cc:1240] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:49.024686  3876 raft_consensus.cc:493] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:49.042467  1601 raft_consensus.cc:3060] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:49.147449  3876 raft_consensus.cc:515] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:49.149717  3876 leader_election.cc:290] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:48.959466  3902 raft_consensus.cc:515] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:49.020853  3744 raft_consensus.cc:493] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:49.168246  1672 pending_rounds.cc:85] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90: Aborting all ops after (but not including) 2
I20260709 12:59:49.168669  1672 pending_rounds.cc:107] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 12:59:49.168954  1672 raft_consensus.cc:2889] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:49.169981  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:49.004928  3752 raft_consensus.cc:515] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 12:59:49.383108  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:49.382404  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 704808us
I20260709 12:59:49.211668  1523 raft_consensus.cc:2468] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 4.
I20260709 12:59:49.383949  2192 leader_election.cc:304] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:49.203728  3832 leader_election.cc:290] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:49.085984  3941 consensus_queue.cc:1048] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.300s
I20260709 12:59:49.171628  3856 consensus_queue.cc:237] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:49.201506  3876 raft_consensus.cc:2749] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:59:49.170576  3936 raft_consensus.cc:515] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:49.388844  3936 leader_election.cc:290] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:49.086161  3709 consensus_queue.cc:1243] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:59:49.233657  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:49.070322  3661 consensus_queue.cc:1243] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:59:49.391707  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:49.393673  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 12:59:49.235546  1599 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.017s	sys 0.019s
W20260709 12:59:49.401037  1599 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.728s	user 0.019s	sys 0.024s
W20260709 12:59:49.394747  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 656646us
W20260709 12:59:49.384068  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:49.395308  1602 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.655s	user 0.005s	sys 0.008s
W20260709 12:59:49.403260  1602 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.663s	user 0.005s	sys 0.008s
W20260709 12:59:49.355626  3959 log.cc:927] Time spent T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.616s	user 0.001s	sys 0.000s
W20260709 12:59:49.403057  1498 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.003s	sys 0.006s
W20260709 12:59:49.407173  1498 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.003s	sys 0.006s
W20260709 12:59:49.201666  3820 consensus_meta.cc:287] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent flushing consensus metadata: real 1.018s	user 0.011s	sys 0.000s
I20260709 12:59:49.089895  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:49.409519  1604 raft_consensus.cc:1275] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:59:49.410650  1674 raft_consensus.cc:1275] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:59:49.414685  3963 log.cc:927] Time spent T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.502s	user 0.000s	sys 0.001s
I20260709 12:59:49.415660  3821 raft_consensus.cc:493] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:49.416210  3821 raft_consensus.cc:515] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:49.418205  3821 leader_election.cc:290] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 12:59:49.419248  3965 log.cc:927] Time spent T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.244s	user 0.000s	sys 0.000s
W20260709 12:59:49.419755  3873 consensus_meta.cc:287] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b: Time spent flushing consensus metadata: real 0.861s	user 0.007s	sys 0.002s
I20260709 12:59:49.156900  3917 consensus_queue.cc:260] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:49.420414  3777 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:49.420917  3777 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:59:49.421916  1497 leader_election.cc:304] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:49.422681  3821 raft_consensus.cc:2804] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:49.423058  3821 raft_consensus.cc:493] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:49.423111  3968 log.cc:927] Time spent T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.409s	user 0.000s	sys 0.000s
I20260709 12:59:49.407960  3834 raft_consensus.cc:493] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:49.423431  3902 leader_election.cc:290] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:49.423767  3629 raft_consensus.cc:2804] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:49.424162  3629 raft_consensus.cc:493] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:49.424278  3821 raft_consensus.cc:3060] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:49.424538  3629 raft_consensus.cc:3060] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:59:49.426399  3877 consensus_meta.cc:287] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b: Time spent flushing consensus metadata: real 0.680s	user 0.006s	sys 0.001s
I20260709 12:59:49.348935  3967 raft_consensus.cc:2804] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:49.432108  3752 leader_election.cc:290] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:49.432838  3819 raft_consensus.cc:3055] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:49.433017  1497 leader_election.cc:304] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:49.219745  3751 raft_consensus.cc:493] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
W20260709 12:59:49.401714  3960 log.cc:927] Time spent T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.586s	user 0.001s	sys 0.000s
I20260709 12:59:49.411227  2190 leader_election.cc:304] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
W20260709 12:59:49.409588  3696 consensus_meta.cc:287] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b: Time spent flushing consensus metadata: real 0.576s	user 0.009s	sys 0.000s
I20260709 12:59:49.203395  3744 raft_consensus.cc:515] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:49.453905  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 12:59:49.451916  3892 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.878s	user 0.016s	sys 0.037s
I20260709 12:59:49.157716  3831 consensus_queue.cc:237] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:49.447144  3819 raft_consensus.cc:740] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
W20260709 12:59:49.450541  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 537568us
I20260709 12:59:49.448668  3967 raft_consensus.cc:697] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 5 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:49.348407  3901 consensus_queue.cc:260] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 12:59:49.499400  1531 consensus_meta.cc:287] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent flushing consensus metadata: real 0.808s	user 0.001s	sys 0.009s
I20260709 12:59:49.444847  3661 consensus_queue.cc:1048] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
W20260709 12:59:49.500628  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 89496us
I20260709 12:59:49.517450  3828 raft_consensus.cc:697] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 7 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:49.501266  1646 leader_election.cc:304] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
W20260709 12:59:49.549050  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 47878.4us
W20260709 12:59:49.549467  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:49.455754  3696 raft_consensus.cc:2749] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:49.509166  1531 raft_consensus.cc:2468] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 4.
W20260709 12:59:49.509469  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 76523.9us
W20260709 12:59:49.496791  3892 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.923s	user 0.017s	sys 0.038s
I20260709 12:59:49.503945  3983 raft_consensus.cc:2749] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:49.442780  3834 raft_consensus.cc:515] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 12:59:49.498590  3940 consensus_meta.cc:287] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.929s	user 0.011s	sys 0.000s
I20260709 12:59:49.436856  3820 raft_consensus.cc:515] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:49.515738  3967 consensus_queue.cc:237] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:49.531157  3819 consensus_queue.cc:260] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 12:59:49.532568  1571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:49.535694  3935 consensus_queue.cc:260] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:49.540551  3888 raft_consensus.cc:3055] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:49.509449  3971 raft_consensus.cc:493] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:49.551815  3864 consensus_meta.cc:287] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.934s	user 0.009s	sys 0.001s
I20260709 12:59:49.549934  1646 leader_election.cc:304] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:49.510046  3874 raft_consensus.cc:2804] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:49.467388  3751 raft_consensus.cc:515] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 12:59:49.550866  3843 consensus_meta.cc:287] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent flushing consensus metadata: real 1.027s	user 0.011s	sys 0.000s
I20260709 12:59:49.560499  1497 leader_election.cc:304] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:49.567708  3777 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 12:59:49.558554  3934 consensus_meta.cc:287] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent flushing consensus metadata: real 0.693s	user 0.009s	sys 0.000s
W20260709 12:59:49.579656  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:49.596155  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 46284.1us
W20260709 12:59:49.579910  1570 leader_election.cc:336] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.802s (SENT)
I20260709 12:59:49.596791  1570 leader_election.cc:304] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 12:59:49.581723  1600 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.842s	user 0.001s	sys 0.022s
I20260709 12:59:49.524115  3832 consensus_queue.cc:1059] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 12:59:49.559823  3821 raft_consensus.cc:515] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:49.573166  2190 leader_election.cc:304] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:49.558053  3876 raft_consensus.cc:2804] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:49.570492  3978 raft_consensus.cc:493] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:49.600591  1606 raft_consensus.cc:2468] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 4.
I20260709 12:59:49.590633  3819 raft_consensus.cc:3060] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:49.602319  1600 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.858s	user 0.002s	sys 0.022s
W20260709 12:59:49.603224  1644 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.000s	sys 0.036s
I20260709 12:59:49.604555  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 12:59:49.608568  1644 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.000s	sys 0.036s
I20260709 12:59:49.586108  3888 raft_consensus.cc:740] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 12:59:49.608819  1600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36200 (request call id 1813) took 2177 ms. Trace:
W20260709 12:59:49.609124  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 652343us
I20260709 12:59:49.608920  1604 raft_consensus.cc:2368] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for earlier term 3. Current term is 4.
I20260709 12:59:49.610498  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:49.611061  1604 raft_consensus.cc:2376] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 4. Re-sending same reply.
I20260709 12:59:49.609243  1600 rpcz_store.cc:276] 0709 12:59:47.431585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:48.219463 (+787878us) service_pool.cc:224] Handling call
0709 12:59:48.219717 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:48.221771 (+  2054us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:59:48.389840 (+168069us) log.cc:844] Serialized 14 byte log entry
0709 12:59:49.608508 (+1218668us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:49.608556 (+    48us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:49.608596 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:49.608654 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:49.608765 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21479,"prepare.queue_time_us":33122,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":54,"raft.queue_time_us":305381,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":97,"thread_start_us":1289623,"threads_started":3,"wal-append.queue_time_us":559365}
W20260709 12:59:49.601656  1646 connection.cc:256] RPC call timeout handler was delayed by -1.7063959340000565s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1583s for a response
I20260709 12:59:49.566619  3940 raft_consensus.cc:515] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 12:59:49.613744  1646 connection.cc:256] RPC call timeout handler was delayed by -1.6910959340000318s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16000000000000003s for a response
I20260709 12:59:49.613829  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 12:59:49.614245  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:49.615029  1646 connection.cc:256] RPC call timeout handler was delayed by -1.4183959340000456s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19030000000000002s for a response
W20260709 12:59:49.615746  1646 connection.cc:256] RPC call timeout handler was delayed by -1.3031959340000299s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20310000000000003s for a response
I20260709 12:59:49.614411  1607 raft_consensus.cc:2468] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 3.
W20260709 12:59:49.624431  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 51361.5us
I20260709 12:59:49.602427  3934 raft_consensus.cc:2749] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:49.604409  3876 raft_consensus.cc:493] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:49.636215  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 82213.1us
I20260709 12:59:49.608094  3983 raft_consensus.cc:2764] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:59:49.617522  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:49.632843  3820 leader_election.cc:290] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:49.606819  3935 raft_consensus.cc:3060] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:49.604705  3977 raft_consensus.cc:2804] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:49.636443  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:49.637095  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49170 (request call id 1670) took 1245 ms. Trace:
I20260709 12:59:49.591359  3971 raft_consensus.cc:515] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:49.611826  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:49.641319  3751 leader_election.cc:290] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 12:59:49.663475  3990 log.cc:927] Time spent T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:59:49.631870  3892 raft_consensus.cc:2804] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:49.612315  3978 raft_consensus.cc:515] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 12:59:49.668614  3961 log.cc:927] Time spent T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.717s	user 0.000s	sys 0.009s
I20260709 12:59:49.647078  1680 raft_consensus.cc:2393] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 8: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 12:59:49.670235  2227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50310 (request call id 518) took 1417 ms. Trace:
I20260709 12:59:49.670615  2227 rpcz_store.cc:276] 0709 12:59:48.253031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:48.253194 (+   163us) service_pool.cc:224] Handling call
0709 12:59:48.266521 (+ 13327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:48.458718 (+192197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:48.458751 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:48.463218 (+  4467us) log.cc:844] Serialized 26 byte log entry
0709 12:59:48.658117 (+194899us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:48.681127 (+ 23010us) log.cc:844] Serialized 14 byte log entry
0709 12:59:48.811299 (+130172us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:48.811379 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:49.076172 (+264793us) spinlock_profiling.cc:243] Waited 6.38 ms on lock 0x7b1800079c60. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1e38ede1 00007f6a1e39b5b1 00007f6a154c6522 00007f6a154c87c1 00007f6a154c8779 00007f6a154c8709 00007f6a154c86d1 00007f6a154c79cd 000000000038f354 000000000038f199 00007f6a154a983a
0709 12:59:49.667965 (+591793us) spinlock_profiling.cc:243] Waited 35.5 ms on lock 0x7b4400022b4c. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a153ecc85 00007f6a153ed6a2 00007f6a1815f1db 00007f6a1815aaaf 00007f6a1814e86e 00007f6a1814dbb6 00007f6a1814d7d8 00007f6a18157221 00007f6a181571d9 00007f6a18157169
0709 12:59:49.670064 (+  2099us) raft_consensus.cc:1685] finished
0709 12:59:49.670083 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:49.670176 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":237658,"prepare.queue_time_us":30752,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":6277,"raft.queue_time_us":245675,"raft.run_cpu_time_us":304,"raft.run_wall_time_us":14957,"spinlock_wait_cycles":98065920,"thread_start_us":290745,"threads_started":2,"wal-append.queue_time_us":320645}
I20260709 12:59:49.643576  3821 leader_election.cc:290] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:49.616998  3777 raft_consensus.cc:2749] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:59:49.642910  3876 raft_consensus.cc:3060] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:49.616878  3874 raft_consensus.cc:697] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 4 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 12:59:49.651585  1677 rpcz_store.cc:276] 0709 12:59:48.391320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:48.392911 (+  1591us) service_pool.cc:224] Handling call
0709 12:59:48.393224 (+   313us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:59:48.500336 (+107112us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:48.500366 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:59:48.500952 (+   586us) log.cc:844] Serialized 52 byte log entry
0709 12:59:48.775988 (+275036us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:59:48.776035 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:48.776122 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:49.636868 (+860746us) raft_consensus.cc:1685] finished
0709 12:59:49.636887 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:49.637033 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":106702,"raft.queue_time_us":107613,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":128,"thread_start_us":274283,"threads_started":1,"wal-append.queue_time_us":950272}
I20260709 12:59:49.644563  1600 raft_consensus.cc:2376] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 5. Re-sending same reply.
I20260709 12:59:49.676041  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:49.667039  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:49.676865  1600 raft_consensus.cc:2393] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 3: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 12:59:49.677971  3874 consensus_queue.cc:237] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:49.678982  3971 leader_election.cc:290] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:49.653759  3940 leader_election.cc:290] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:49.615815  3744 leader_election.cc:290] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:49.688076  1607 raft_consensus.cc:2468] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 6.
I20260709 12:59:49.667012  3892 raft_consensus.cc:697] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 4 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 12:59:49.671881  3966 raft_consensus.cc:493] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:49.595113  3843 raft_consensus.cc:515] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:49.670235  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 486) took 1014 ms. Trace:
I20260709 12:59:49.695482  1602 rpcz_store.cc:276] 0709 12:59:48.656000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:48.656130 (+   130us) service_pool.cc:224] Handling call
0709 12:59:48.685472 (+ 29342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:49.403673 (+718201us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:59:49.431026 (+ 27353us) log.cc:844] Serialized 14 byte log entry
0709 12:59:49.507930 (+ 76904us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:49.508498 (+   568us) log.cc:844] Serialized 26 byte log entry
0709 12:59:49.508637 (+   139us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:49.508846 (+   209us) log.cc:844] Serialized 14 byte log entry
0709 12:59:49.508985 (+   139us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:49.509048 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:49.670012 (+160964us) raft_consensus.cc:1685] finished
0709 12:59:49.670032 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:49.670156 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47841,"prepare.queue_time_us":23516,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":64,"raft.queue_time_us":306446,"raft.run_cpu_time_us":316,"raft.run_wall_time_us":24013,"thread_start_us":740119,"threads_started":2,"wal-append.queue_time_us":178320}
W20260709 12:59:49.631139  1646 connection.cc:256] RPC call timeout handler was delayed by -1.0853959340000188s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22730000000000003s for a response
W20260709 12:59:49.697360  1646 connection.cc:256] RPC call timeout handler was delayed by -1.0397383210000157s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1869s for a response
I20260709 12:59:49.698055  1646 leader_election.cc:304] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:49.668917  3978 leader_election.cc:290] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:49.650390  1497 leader_election.cc:304] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:49.693872  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
W20260709 12:59:49.700731  1644 leader_election.cc:336] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.856s (SENT)
I20260709 12:59:49.713676  1646 leader_election.cc:304] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:49.715029  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:49.715639  1602 raft_consensus.cc:2376] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 5. Re-sending same reply.
I20260709 12:59:49.715745  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:49.716451  1600 raft_consensus.cc:3060] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:49.635958  3828 consensus_queue.cc:237] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:49.695528  3977 raft_consensus.cc:697] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 5 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
W20260709 12:59:49.711272  3947 consensus_meta.cc:287] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.840s	user 0.010s	sys 0.000s
I20260709 12:59:49.707824  3940 raft_consensus.cc:2749] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:49.720029  3821 raft_consensus.cc:2804] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:49.727741  3821 raft_consensus.cc:697] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 12:59:49.728653  3821 consensus_queue.cc:237] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:49.723028  3977 consensus_queue.cc:237] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:49.700201  3966 raft_consensus.cc:515] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 12:59:49.725849  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 75535.1us
I20260709 12:59:49.743978  1497 leader_election.cc:304] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:49.726765  3999 raft_consensus.cc:2749] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:49.745071  3940 consensus_queue.cc:1048] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:49.745110  3983 raft_consensus.cc:2764] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
W20260709 12:59:49.731841  1644 leader_election.cc:336] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.890s (SENT)
W20260709 12:59:49.746702  1644 leader_election.cc:336] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.892s (SENT)
I20260709 12:59:49.747089  1644 leader_election.cc:304] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:49.747143  1646 leader_election.cc:304] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
W20260709 12:59:49.741945  1601 consensus_meta.cc:287] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.523s	user 0.006s	sys 0.000s
I20260709 12:59:49.747990  1601 raft_consensus.cc:2468] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 4.
I20260709 12:59:49.748615  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 488) took 1092 ms. Trace:
I20260709 12:59:49.748958  1601 rpcz_store.cc:276] 0709 12:59:48.656520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:48.796694 (+140174us) service_pool.cc:224] Handling call
0709 12:59:49.748540 (+951846us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:49.752322  3940 raft_consensus.cc:2749] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:49.674027  3888 consensus_queue.cc:260] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:49.770764  2192 leader_election.cc:304] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:49.768811  1646 leader_election.cc:304] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:49.742909  3834 leader_election.cc:290] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:49.774498  3978 raft_consensus.cc:493] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:49.775158  3978 raft_consensus.cc:515] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 12:59:49.779023  3996 log.cc:927] Time spent T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 12:59:49.712225  3987 consensus_queue.cc:1059] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 12:59:49.783255  3892 consensus_queue.cc:237] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:49.785595  1603 raft_consensus.cc:2468] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 6.
I20260709 12:59:49.786952  3966 leader_election.cc:290] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:49.787590  3966 raft_consensus.cc:493] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:49.788064  3966 raft_consensus.cc:515] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:49.732064  3947 raft_consensus.cc:515] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:49.793478  3947 leader_election.cc:290] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:49.795361  3997 raft_consensus.cc:2804] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:49.796000  3997 raft_consensus.cc:697] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 5 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 12:59:49.796931  3997 consensus_queue.cc:237] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:49.798864  3843 leader_election.cc:290] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:49.801429  1607 raft_consensus.cc:1275] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:59:49.797000  3629 raft_consensus.cc:515] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 12:59:49.838428  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:49.868947  1600 raft_consensus.cc:2468] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 6.
I20260709 12:59:49.773083  3967 raft_consensus.cc:2749] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:49.862462  3940 raft_consensus.cc:2804] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:59:49.871798  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 127918us
W20260709 12:59:49.867578  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 96932.8us
I20260709 12:59:49.873788  1497 leader_election.cc:304] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
W20260709 12:59:49.874351  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 127706us
I20260709 12:59:49.874991  3973 consensus_queue.cc:1048] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:59:49.876369  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 103261us
I20260709 12:59:49.881456  1607 raft_consensus.cc:1275] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:59:49.878072  1644 leader_election.cc:336] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.965s (SENT)
I20260709 12:59:49.882855  1497 leader_election.cc:304] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:49.884050  1497 leader_election.cc:304] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:49.884692  1646 leader_election.cc:400] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303) with higher term. Message: Invalid argument: T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for earlier term 3. Current term is 4.
I20260709 12:59:49.885409  1646 leader_election.cc:403] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:59:49.889470  3820 raft_consensus.cc:3060] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:49.877257  3888 raft_consensus.cc:3060] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:49.892289  3967 raft_consensus.cc:2749] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303) with higher term. Message: Invalid argument: T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for earlier term 3. Current term is 4.
I20260709 12:59:49.895148  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:49.895931  1607 raft_consensus.cc:3060] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:49.896751  3820 raft_consensus.cc:2749] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:49.877627  3876 raft_consensus.cc:515] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 12:59:49.904109  1644 leader_election.cc:336] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 2.035s (SENT)
I20260709 12:59:49.888870  1497 leader_election.cc:304] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
W20260709 12:59:49.905505  1644 leader_election.cc:336] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 2.044s (SENT)
I20260709 12:59:49.905761  1607 raft_consensus.cc:2468] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 8.
W20260709 12:59:49.906061  1644 leader_election.cc:336] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 2.175s (SENT)
I20260709 12:59:49.883450  3834 raft_consensus.cc:2764] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260709 12:59:49.885397  3983 raft_consensus.cc:3060] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:49.915218  1497 leader_election.cc:304] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
W20260709 12:59:49.915292  1644 leader_election.cc:336] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 2.176s (SENT)
W20260709 12:59:49.916975  1644 leader_election.cc:336] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 2.180s (SENT)
W20260709 12:59:49.917582  1644 leader_election.cc:336] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 2.240s (SENT)
I20260709 12:59:49.918478  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:49.921499  1607 raft_consensus.cc:1275] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:49.918011  1644 leader_election.cc:304] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:49.922204  3934 raft_consensus.cc:3060] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:49.915215  3820 raft_consensus.cc:2804] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:49.926512  3820 raft_consensus.cc:493] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:49.926887  3820 raft_consensus.cc:3060] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:59:49.927142  1571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:49.931005  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:49.923110  1497 leader_election.cc:304] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:49.889417  3828 raft_consensus.cc:493] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:49.934438  1677 raft_consensus.cc:2393] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 6: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 12:59:49.931305  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:49.932744  1531 raft_consensus.cc:1240] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:49.936543  1674 raft_consensus.cc:2468] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 6.
I20260709 12:59:49.941157  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
W20260709 12:59:49.941386  1644 leader_election.cc:336] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 2.339s (SENT)
I20260709 12:59:49.938301  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:49.942370  1644 leader_election.cc:304] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:49.904654  3966 leader_election.cc:290] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:49.940017  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:49.948107  1673 raft_consensus.cc:2468] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 6.
I20260709 12:59:49.945175  1497 leader_election.cc:304] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
W20260709 12:59:49.945447  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:49.923014  3978 leader_election.cc:290] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:49.950103  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 12:59:49.951668  1644 leader_election.cc:336] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 2.526s (SENT)
I20260709 12:59:49.949702  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:49.957454  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:49.957931  1497 leader_election.cc:304] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:49.958209  1674 raft_consensus.cc:2393] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 5: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 12:59:49.938721  3982 raft_consensus.cc:2749] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:59:49.934717  3777 raft_consensus.cc:493] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:49.950969  3834 raft_consensus.cc:2749] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:49.946452  3940 raft_consensus.cc:697] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 6 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:49.969985  3876 leader_election.cc:290] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:49.938969  3744 raft_consensus.cc:493] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:49.956817  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:49.934491  3828 raft_consensus.cc:515] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:49.967207  3519 raft_consensus.cc:3060] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:49.975440  3922 raft_consensus.cc:2749] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:49.991550  1497 leader_election.cc:304] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:49.975733  4006 raft_consensus.cc:2749] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:49.990847  3934 raft_consensus.cc:2749] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:50.011597  3519 raft_consensus.cc:2749] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:50.021456  3629 leader_election.cc:290] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 6 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:49.989408  3744 raft_consensus.cc:515] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:50.032727  1571 leader_election.cc:304] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:49.990643  3777 raft_consensus.cc:515] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:50.037015  1571 leader_election.cc:304] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:50.018177  3820 raft_consensus.cc:515] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:50.043007  3980 raft_consensus.cc:2804] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:50.038431  3940 consensus_queue.cc:237] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:50.044536  3820 leader_election.cc:290] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:50.046108  1523 raft_consensus.cc:1240] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:50.043566  3980 raft_consensus.cc:493] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:50.012171  3834 consensus_queue.cc:1048] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:59:50.037792  3821 raft_consensus.cc:2749] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:50.058367  1497 leader_election.cc:304] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:50.040485  3989 raft_consensus.cc:2804] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:50.036270  3934 consensus_queue.cc:1048] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.018s
W20260709 12:59:50.148949  1644 leader_election.cc:336] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 2.694s (SENT)
W20260709 12:59:50.177431  1644 leader_election.cc:336] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.606s (SENT)
I20260709 12:59:50.061045  3989 raft_consensus.cc:493] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:50.148200  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:50.147112  4002 raft_consensus.cc:3055] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:59:50.098201  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:50.100471  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
W20260709 12:59:50.097345  1598 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 476) took 1501 ms (client timeout 1709 ms). Trace:
I20260709 12:59:50.052335  3980 raft_consensus.cc:3060] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:50.107869  3777 leader_election.cc:290] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:50.111297  3744 leader_election.cc:290] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:50.109890  3901 raft_consensus.cc:3060] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:59:50.126852  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:50.172811  1497 leader_election.cc:304] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
W20260709 12:59:50.175050  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 110337us
W20260709 12:59:50.111138  3990 log.cc:927] Time spent T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:59:50.209771  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 12:59:50.181829  2191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:50.190214  1681 raft_consensus.cc:1275] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:59:50.196717  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:50.195039  3864 raft_consensus.cc:493] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:50.203608  1674 raft_consensus.cc:1240] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:50.213312  1677 raft_consensus.cc:2468] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 3.
I20260709 12:59:50.203773  1673 raft_consensus.cc:1240] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:50.147917  3821 consensus_queue.cc:1048] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 12:59:50.205000  1676 raft_consensus.cc:1240] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:50.206710  1679 raft_consensus.cc:1240] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 5. Current term is 6. Ops: []
W20260709 12:59:50.207791  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 176079us
I20260709 12:59:50.209077  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 12:59:50.216228  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 43508us
I20260709 12:59:50.216969  1497 leader_election.cc:304] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:50.190698  4002 raft_consensus.cc:740] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:50.190438  3989 raft_consensus.cc:3060] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:50.220878  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:50.221765  2227 raft_consensus.cc:2410] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 12:59:50.222554  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:50.227257  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:50.228736  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:50.230808  1572 leader_election.cc:304] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
W20260709 12:59:50.219856  3632 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.265s	user 0.008s	sys 0.018s
I20260709 12:59:50.215471  3640 raft_consensus.cc:493] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:50.235308  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:50.238979  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:50.240178  4018 raft_consensus.cc:2749] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:50.240882  4018 raft_consensus.cc:2749] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:50.218205  3922 raft_consensus.cc:2749] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:59:50.194684  1598 rpcz_store.cc:269] 0709 12:59:48.595774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:48.597519 (+  1745us) service_pool.cc:224] Handling call
0709 12:59:50.094701 (+1497182us) spinlock_profiling.cc:243] Waited 26.6 ms on lock 0x7b5400364a54. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 12:59:50.097243 (+  2542us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":61272448}
I20260709 12:59:50.243276  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:50.244436  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:50.244562  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:50.244895  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 12:59:50.245676  2227 raft_consensus.cc:2410] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:59:50.247148  1646 leader_election.cc:304] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:50.247352  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
W20260709 12:59:50.248124  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 354666us
I20260709 12:59:50.249082  1646 leader_election.cc:304] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:50.250239  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 12:59:50.252439  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:50.245582  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:50.259164  1607 raft_consensus.cc:2376] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 4. Re-sending same reply.
I20260709 12:59:50.261443  3989 raft_consensus.cc:515] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:50.263548  3989 leader_election.cc:290] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:50.266958  3629 consensus_queue.cc:1048] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:59:50.275424  4013 log.cc:927] Time spent T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:59:50.276767  1672 raft_consensus.cc:1275] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:50.278918  4002 consensus_queue.cc:260] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:50.284004  3983 raft_consensus.cc:2749] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:50.235455  3828 leader_election.cc:290] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 12:59:50.294831  3632 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.291s	user 0.008s	sys 0.019s
I20260709 12:59:50.295272  3632 raft_consensus.cc:697] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 12:59:50.296260  3632 consensus_queue.cc:237] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:50.219203  3864 raft_consensus.cc:515] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 12:59:50.311702  1571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:50.318027  2224 raft_consensus.cc:2468] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 7.
W20260709 12:59:50.318890  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 54861.4us
W20260709 12:59:50.319128  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 70110.4us
I20260709 12:59:50.320271  2191 leader_election.cc:304] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:50.320441  1646 leader_election.cc:304] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:50.331596  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:50.332378  1607 raft_consensus.cc:2393] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 6: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 12:59:50.323539  4006 raft_consensus.cc:2804] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:50.331358  3993 raft_consensus.cc:2804] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:59:50.354559  1606 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 480) took 1728 ms (client timeout 1685 ms). Trace:
W20260709 12:59:50.355378  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:50.353999  1646 leader_election.cc:304] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:50.361776  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
W20260709 12:59:50.355110  1606 rpcz_store.cc:269] 0709 12:59:48.626050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:48.628539 (+  2489us) service_pool.cc:224] Handling call
0709 12:59:50.354320 (+1725781us) spinlock_profiling.cc:243] Waited 870 ms on lock 0x7b5400058054. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 12:59:50.354473 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2000518016}
I20260709 12:59:50.319239  3640 raft_consensus.cc:515] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:50.368829  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:50.353271  3891 raft_consensus.cc:2804] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:50.366582  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
W20260709 12:59:50.367511  2190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:50.410635  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:50.364643  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:50.349160  3993 raft_consensus.cc:493] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 12:59:50.411375  1525 raft_consensus.cc:2468] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 4.
I20260709 12:59:50.372434  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:50.412168  1607 raft_consensus.cc:2393] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 6: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 12:59:50.412901  1530 raft_consensus.cc:1240] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:50.411660  1531 raft_consensus.cc:2368] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for earlier term 3. Current term is 4.
I20260709 12:59:50.413574  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:50.412284  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:50.416800  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 12:59:50.358170  4006 raft_consensus.cc:697] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 4 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:50.363356  3988 raft_consensus.cc:2804] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:50.413002  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:50.383781  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:50.431681  2223 raft_consensus.cc:2393] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 6: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 12:59:50.372700  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:50.363540  3909 raft_consensus.cc:493] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:50.377476  1644 leader_election.cc:336] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.511s (SENT)
I20260709 12:59:50.370138  4017 raft_consensus.cc:493] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:50.432132  1603 raft_consensus.cc:2468] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 4.
I20260709 12:59:50.384428  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:50.433552  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:50.441761  1526 raft_consensus.cc:2393] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 5: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 12:59:50.381235  1646 leader_election.cc:304] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:50.435465  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 12:59:50.443025  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 61884.7us
I20260709 12:59:50.441289  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:50.444080  1603 raft_consensus.cc:2393] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 6: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 12:59:50.443084  1599 raft_consensus.cc:2468] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 6.
I20260709 12:59:50.446213  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:50.416731  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 12:59:50.450614  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:50.441220  3909 raft_consensus.cc:515] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:50.452739  3917 raft_consensus.cc:3060] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:50.453670  3909 leader_election.cc:290] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:50.417316  3993 raft_consensus.cc:3060] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:50.455489  3864 leader_election.cc:290] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:50.457084  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 12:59:50.458308  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 12:59:50.459408  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 12:59:50.460121  2224 raft_consensus.cc:2410] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:59:50.445222  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:50.447391  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:50.368494  3973 consensus_queue.cc:1059] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 12:59:50.448565  3982 raft_consensus.cc:2804] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:50.448319  4007 consensus_queue.cc:1048] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:50.437363  3966 raft_consensus.cc:2749] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:50.423558  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 12:59:50.449831  3640 leader_election.cc:290] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:50.449627  4017 raft_consensus.cc:515] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:50.418274  1598 raft_consensus.cc:1275] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:50.461122  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 12:59:50.369798  3820 raft_consensus.cc:493] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:50.525557  3820 raft_consensus.cc:515] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:50.526824  1601 raft_consensus.cc:1240] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:50.447707  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:50.448046  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 12:59:50.429088  1528 raft_consensus.cc:2468] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 5.
I20260709 12:59:50.462075  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 12:59:50.463064  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 85617.9us
I20260709 12:59:50.457430  1525 raft_consensus.cc:2468] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 5.
W20260709 12:59:50.535516  1644 leader_election.cc:336] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.900s (SENT)
I20260709 12:59:50.535641  1525 raft_consensus.cc:1240] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:50.463550  2227 raft_consensus.cc:2468] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 3.
I20260709 12:59:50.464552  2223 raft_consensus.cc:1240] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 5 LEADER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:50.465077  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:50.537292  1607 raft_consensus.cc:2393] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 8: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 12:59:50.435045  3988 raft_consensus.cc:493] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:50.407958  3978 consensus_queue.cc:1059] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 12:59:50.414990  3936 consensus_queue.cc:1048] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 12:59:50.468017  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:50.543601  1526 raft_consensus.cc:3060] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:50.384544  3878 raft_consensus.cc:2804] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:50.442494  3891 raft_consensus.cc:697] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 5 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:50.518160  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:50.529089  1603 raft_consensus.cc:2393] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 6: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 12:59:50.532711  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:50.533465  1531 raft_consensus.cc:1275] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:50.538206  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:50.539193  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:50.546890  1528 raft_consensus.cc:2468] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 4.
I20260709 12:59:50.539822  1525 raft_consensus.cc:1275] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:50.542052  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:50.553593  1528 raft_consensus.cc:1240] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:50.554260  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:50.527966  3820 leader_election.cc:290] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:50.554631  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
W20260709 12:59:50.564194  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 285609us
I20260709 12:59:50.542997  3988 raft_consensus.cc:3060] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:50.590533  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:50.591363  1674 raft_consensus.cc:2393] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 4: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 12:59:50.591264  1529 raft_consensus.cc:2468] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 4.
I20260709 12:59:50.592206  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 12:59:50.576224  2192 leader_election.cc:336] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Timed out: RequestConsensusVote RPC to 127.0.107.194:40303 timed out after 1.709s (SENT)
I20260709 12:59:50.593134  2192 leader_election.cc:304] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:50.592253  1525 raft_consensus.cc:1275] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:50.593360  1530 raft_consensus.cc:1275] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:59:50.601398  1528 raft_consensus.cc:2468] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 5.
I20260709 12:59:50.603601  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:50.607199  1528 raft_consensus.cc:2468] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 5.
I20260709 12:59:50.626011  1526 raft_consensus.cc:2468] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 6.
W20260709 12:59:50.633623  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 57446.5us
I20260709 12:59:50.573452  3878 raft_consensus.cc:697] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 6 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:50.525439  4006 consensus_queue.cc:237] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:59:50.640141  1529 raft_consensus.cc:1240] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:50.643345  1525 raft_consensus.cc:1240] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:50.637444  1528 raft_consensus.cc:1275] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:50.669096  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:50.670163  1529 raft_consensus.cc:2410] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for term 6 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 12:59:50.655901  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 12:59:50.677150  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 136985us
I20260709 12:59:50.651909  3935 raft_consensus.cc:493] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:50.677837  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 233671us
W20260709 12:59:50.681209  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 262645us
I20260709 12:59:50.679870  1646 leader_election.cc:304] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:50.693146  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:50.741778  1525 raft_consensus.cc:3060] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:50.696189  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:50.691147  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:50.744906  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:50.743790  1529 raft_consensus.cc:2393] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 6: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 12:59:50.704041  3978 raft_consensus.cc:2749] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:50.682278  4007 raft_consensus.cc:493] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:50.654246  3891 consensus_queue.cc:237] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:50.710198  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 12:59:50.733631  4024 log.cc:927] Time spent T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 12:59:50.694927  3935 raft_consensus.cc:515] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 12:59:50.736735  3901 consensus_meta.cc:287] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.517s	user 0.009s	sys 0.000s
I20260709 12:59:50.737069  2218 raft_consensus.cc:2468] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 4.
W20260709 12:59:50.738066  4019 log.cc:927] Time spent T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 12:59:50.738447  1644 leader_election.cc:336] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 2.031s (SENT)
W20260709 12:59:50.789186  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 50773.1us
I20260709 12:59:50.738332  3993 raft_consensus.cc:515] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:50.692042  3982 raft_consensus.cc:697] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 6 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
W20260709 12:59:50.743770  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:50.752573  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 49104us
I20260709 12:59:50.711083  3744 raft_consensus.cc:493] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:50.755748  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:50.759230  3997 consensus_queue.cc:1059] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:59:50.760943  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:50.761922  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:50.772491  1523 raft_consensus.cc:2393] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 6: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 12:59:50.774538  1528 raft_consensus.cc:2468] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 9.
I20260709 12:59:50.710582  1527 raft_consensus.cc:1240] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 LEADER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:50.735447  4017 leader_election.cc:290] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:50.778950  1532 raft_consensus.cc:2468] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 5.
W20260709 12:59:50.755815  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 75853.5us
I20260709 12:59:50.784776  1525 raft_consensus.cc:2468] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 6.
I20260709 12:59:50.791926  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:50.771900  4033 raft_consensus.cc:2804] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:50.802502  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:50.804553  1529 raft_consensus.cc:3060] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:50.806540  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:50.806391  3982 consensus_queue.cc:237] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:50.807170  1523 raft_consensus.cc:2468] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 4.
I20260709 12:59:50.813777  1676 raft_consensus.cc:1240] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:50.815001  3993 leader_election.cc:290] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
W20260709 12:59:50.800158  4025 log.cc:927] Time spent T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 12:59:50.829311  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:50.832129  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:50.833134  1525 raft_consensus.cc:2410] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for term 6 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 12:59:50.834941  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:50.835511  1524 raft_consensus.cc:1240] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:50.837097  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:50.838932  1531 raft_consensus.cc:2393] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 6: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
W20260709 12:59:50.840376  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:50.841311  1604 raft_consensus.cc:2468] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 5.
W20260709 12:59:50.827692  3980 consensus_meta.cc:287] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.616s	user 0.005s	sys 0.004s
I20260709 12:59:50.803658  4033 raft_consensus.cc:697] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 8 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:50.765666  4007 raft_consensus.cc:515] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:50.771145  3878 consensus_queue.cc:237] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:50.890529  1600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36200 (request call id 1837) took 1008 ms. Trace:
I20260709 12:59:50.842547  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:50.904609  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:50.799867  3973 consensus_queue.cc:1059] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 12:59:50.907371  3832 raft_consensus.cc:493] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:50.913784  3832 raft_consensus.cc:515] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:50.918363  3832 leader_election.cc:290] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:50.908772  1528 raft_consensus.cc:2468] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 7.
I20260709 12:59:50.920332  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:50.921121  1676 raft_consensus.cc:2393] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 6: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 12:59:50.924475  3935 leader_election.cc:290] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:50.916144  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:50.927891  4043 raft_consensus.cc:3055] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:50.928306  4043 raft_consensus.cc:740] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 12:59:50.905792  1600 rpcz_store.cc:276] 0709 12:59:49.882139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:50.146163 (+264024us) service_pool.cc:224] Handling call
0709 12:59:50.146522 (+   359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:50.146931 (+   409us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:50.146959 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:50.147454 (+   495us) log.cc:844] Serialized 26 byte log entry
0709 12:59:50.468733 (+321279us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:50.468770 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:50.468857 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:50.890198 (+421341us) raft_consensus.cc:1685] finished
0709 12:59:50.890217 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:50.890468 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1486,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":9971,"thread_start_us":320923,"threads_started":1,"wal-append.queue_time_us":490749}
I20260709 12:59:50.908833  1675 raft_consensus.cc:2468] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 3.
I20260709 12:59:50.932590  1675 raft_consensus.cc:1240] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 2. Current term is 3. Ops: []
W20260709 12:59:50.850436  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 48813.6us
I20260709 12:59:50.942461  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:50.943338  1526 raft_consensus.cc:2393] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 6: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 12:59:50.944061  3843 consensus_queue.cc:1059] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:50.944957  3843 raft_consensus.cc:3055] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:50.945317  3843 raft_consensus.cc:740] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 12:59:50.946146  3843 consensus_queue.cc:260] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:50.882443  3909 raft_consensus.cc:3055] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:50.947716  3909 raft_consensus.cc:740] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 12:59:50.948781  3909 consensus_queue.cc:260] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:50.799989  3744 raft_consensus.cc:515] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:50.935382  3922 consensus_queue.cc:1059] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 12:59:50.904567  3988 raft_consensus.cc:515] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:50.955334  1677 raft_consensus.cc:1275] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:59:50.955901  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 126501us
I20260709 12:59:50.959188  1523 pending_rounds.cc:85] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting all ops after (but not including) 2
I20260709 12:59:50.969597  1523 pending_rounds.cc:107] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:59:50.969931  1523 raft_consensus.cc:2889] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:50.889294  3892 consensus_queue.cc:1048] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 12:59:50.960843  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:50.972434  1528 raft_consensus.cc:2376] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 9. Re-sending same reply.
I20260709 12:59:50.973497  4043 consensus_queue.cc:260] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:50.974795  3988 leader_election.cc:290] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 5 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:50.961416  1526 raft_consensus.cc:1240] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:50.962190  1529 raft_consensus.cc:2468] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 6.
I20260709 12:59:50.967149  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:50.977856  1531 raft_consensus.cc:2376] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 4. Re-sending same reply.
I20260709 12:59:50.989045  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:50.938387  3980 raft_consensus.cc:515] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:50.991039  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:50.974853  4043 raft_consensus.cc:3060] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:50.975710  3917 consensus_queue.cc:1048] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 12:59:50.975454  3935 consensus_queue.cc:1048] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 12:59:51.012853  1602 raft_consensus.cc:1240] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:59:50.993707  1531 raft_consensus.cc:2393] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 5: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 12:59:51.015870  2222 raft_consensus.cc:2468] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 6.
I20260709 12:59:50.977448  2221 raft_consensus.cc:1240] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:59:51.021311  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:51.028450  1526 raft_consensus.cc:2376] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 5. Re-sending same reply.
I20260709 12:59:51.027448  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:51.029361  1528 raft_consensus.cc:2376] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 4. Re-sending same reply.
I20260709 12:59:51.029863  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 12:59:51.031139  2191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:51.036513  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:51.037215  1528 raft_consensus.cc:2376] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 5. Re-sending same reply.
I20260709 12:59:51.039126  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:50.991667  4041 consensus_queue.cc:1048] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 12:59:51.052591  3980 leader_election.cc:290] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:51.041250  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:50.993520  3978 consensus_queue.cc:1059] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:59:51.061764  2227 raft_consensus.cc:2468] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 7.
I20260709 12:59:51.064623  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:51.065418  1572 leader_election.cc:304] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:51.066763  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:51.067377  1531 raft_consensus.cc:2376] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 5. Re-sending same reply.
I20260709 12:59:51.030179  3909 raft_consensus.cc:3060] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:51.068495  3901 raft_consensus.cc:3060] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:51.070484  4007 leader_election.cc:290] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:50.992714  4033 consensus_queue.cc:237] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:51.035706  3975 raft_consensus.cc:493] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:51.074133  3975 raft_consensus.cc:515] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:51.026263  3988 consensus_queue.cc:1048] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 12:59:51.078025  3640 raft_consensus.cc:3055] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:51.078470  3640 raft_consensus.cc:740] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 12:59:51.079285  3640 consensus_queue.cc:260] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:51.080071  3901 raft_consensus.cc:2749] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:51.080416  3640 raft_consensus.cc:3060] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:51.081585  3978 raft_consensus.cc:493] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:51.082111  3978 raft_consensus.cc:515] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:51.084164  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:51.084738  1531 raft_consensus.cc:2376] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 5. Re-sending same reply.
I20260709 12:59:51.086700  2191 leader_election.cc:304] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:51.088831  1572 leader_election.cc:304] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:51.097508  3988 raft_consensus.cc:2804] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:51.100175  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:51.101070  3744 leader_election.cc:290] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:51.103932  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 12:59:51.103986  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:51.105441  1526 raft_consensus.cc:2376] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 6. Re-sending same reply.
I20260709 12:59:51.099027  3832 raft_consensus.cc:2804] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:51.097996  3988 raft_consensus.cc:493] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:51.102519  3629 consensus_queue.cc:1048] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 12:59:51.119747  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:51.122854  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:51.123628  1528 raft_consensus.cc:2393] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 3: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 12:59:51.121146  3832 raft_consensus.cc:493] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:51.125663  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:51.126322  1531 raft_consensus.cc:2468] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 4.
I20260709 12:59:51.134424  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:51.135130  1526 raft_consensus.cc:2376] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 6. Re-sending same reply.
I20260709 12:59:51.122457  3988 raft_consensus.cc:3060] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:51.143226  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:51.143996  1528 raft_consensus.cc:2376] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 6. Re-sending same reply.
I20260709 12:59:51.144933  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:51.146062  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:51.146989  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:51.148165  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:51.149152  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:51.149801  1525 raft_consensus.cc:2393] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 6: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 12:59:51.151326  1530 raft_consensus.cc:1275] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:59:51.152309  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:51.150544  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:51.159366  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:51.160221  1531 raft_consensus.cc:2393] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 6: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 12:59:51.160341  3980 raft_consensus.cc:493] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:51.160833  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:51.163645  1526 raft_consensus.cc:3060] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:51.146574  1528 raft_consensus.cc:2468] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 7.
I20260709 12:59:51.126070  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:51.134066  3832 raft_consensus.cc:3060] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:51.170859  1524 raft_consensus.cc:1275] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:59:51.172191  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:51.172789  1528 raft_consensus.cc:3060] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:51.160833  3980 raft_consensus.cc:515] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:51.179669  3980 leader_election.cc:290] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:51.180066  3832 raft_consensus.cc:515] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:51.181753  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:51.185947  1524 raft_consensus.cc:1275] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:59:51.191810  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:51.189962  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:51.196735  1523 raft_consensus.cc:2468] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 4.
I20260709 12:59:51.196949  1526 raft_consensus.cc:2468] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 4.
I20260709 12:59:51.189724  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:51.223341  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:51.225771  1526 raft_consensus.cc:2393] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 5: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 12:59:51.227308  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 12:59:51.228705  2221 raft_consensus.cc:3060] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:51.230266  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:51.231834  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:51.232540  1523 raft_consensus.cc:2393] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 4: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 12:59:51.233528  3975 leader_election.cc:290] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:51.233767  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 12:59:51.227844  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:51.237200  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:51.237880  1523 raft_consensus.cc:2393] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 5: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 12:59:51.237644  3988 raft_consensus.cc:515] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:51.227010  1531 raft_consensus.cc:1240] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 LEADER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:51.228135  3832 leader_election.cc:290] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:51.243402  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:51.246165  1528 raft_consensus.cc:2468] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 5.
I20260709 12:59:51.247480  1523 raft_consensus.cc:2393] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 6: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 12:59:51.253463  1523 raft_consensus.cc:1240] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 5. Current term is 6. Ops: [3.2-5.3]
I20260709 12:59:51.255154  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:51.255995  1523 raft_consensus.cc:2410] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:59:51.259474  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:51.252053  3832 raft_consensus.cc:493] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
W20260709 12:59:51.262111  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:51.257726  3988 leader_election.cc:290] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 4 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:51.261305  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:51.266003  1531 raft_consensus.cc:2376] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 6. Re-sending same reply.
I20260709 12:59:51.265362  3832 raft_consensus.cc:515] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:51.270293  2221 raft_consensus.cc:2468] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 8.
I20260709 12:59:51.271782  1572 leader_election.cc:304] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 12:59:51.274358  3966 raft_consensus.cc:2804] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:51.274652  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:51.274856  3966 raft_consensus.cc:697] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 8 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:51.275291  2227 raft_consensus.cc:2468] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 4.
I20260709 12:59:51.274379  1672 raft_consensus.cc:1240] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:51.275723  3966 consensus_queue.cc:237] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:51.276832  3832 leader_election.cc:290] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:51.277482  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:51.278148  1523 raft_consensus.cc:2368] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 4. Current term is 5.
I20260709 12:59:51.278492  3978 leader_election.cc:290] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:51.275732  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:51.292279  1572 leader_election.cc:304] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 12:59:51.296710  3832 raft_consensus.cc:2804] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:51.297155  3832 raft_consensus.cc:493] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:51.297520  3832 raft_consensus.cc:3060] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:51.301419  1571 leader_election.cc:304] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:51.304250  1523 raft_consensus.cc:1240] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:51.305454  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:51.299137  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:51.306880  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:51.307456  1531 raft_consensus.cc:2468] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 3.
I20260709 12:59:51.308456  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:51.309103  1531 raft_consensus.cc:2393] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 5: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 12:59:51.309789  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:51.310331  1531 raft_consensus.cc:2468] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 5.
I20260709 12:59:51.299927  3820 consensus_queue.cc:1059] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 12:59:51.311340  1530 raft_consensus.cc:1275] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:59:51.303932  3980 raft_consensus.cc:2749] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:59:51.312021  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:51.312704  1525 raft_consensus.cc:2393] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 4: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 12:59:51.313169  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:51.313419  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:51.313833  1524 raft_consensus.cc:2468] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 3.
I20260709 12:59:51.314478  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 12:59:51.315119  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:51.315424  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:51.315865  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:51.316145  1532 raft_consensus.cc:2393] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 4: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 12:59:51.314751  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:51.317027  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:51.317767  1532 raft_consensus.cc:2393] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 3: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 12:59:51.317096  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:51.318770  1525 raft_consensus.cc:2410] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:59:51.291661  3888 raft_consensus.cc:3055] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:51.323303  3888 raft_consensus.cc:740] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 12:59:51.333545  3888 consensus_queue.cc:260] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 12:59:51.334460  4039 log.cc:927] Time spent T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.408s	user 0.002s	sys 0.000s
I20260709 12:59:51.336627  1527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49310 (request call id 436) took 1925 ms. Trace:
I20260709 12:59:51.337078  1527 rpcz_store.cc:276] 0709 12:59:49.410742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:49.410866 (+   124us) service_pool.cc:224] Handling call
0709 12:59:49.411124 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:50.800588 (+1389464us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:51.336344 (+535756us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b540002b054. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 12:59:51.336562 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2981333376}
I20260709 12:59:51.339139  1679 raft_consensus.cc:1275] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:51.340205  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:51.340909  1528 raft_consensus.cc:2468] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 5.
I20260709 12:59:51.344175  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:51.357019  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:51.357669  1531 raft_consensus.cc:3060] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:59:51.358819  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:51.343919  3888 raft_consensus.cc:3060] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:51.364310  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:51.367153  1524 raft_consensus.cc:1275] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:51.368294  1525 raft_consensus.cc:3055] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:51.368703  1525 raft_consensus.cc:740] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 12:59:51.374646  1531 raft_consensus.cc:2468] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 5.
I20260709 12:59:51.378563  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36200 (request call id 1824) took 1727 ms. Trace:
I20260709 12:59:51.379017  1605 rpcz_store.cc:276] 0709 12:59:49.651168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:49.710481 (+ 59313us) service_pool.cc:224] Handling call
0709 12:59:50.097842 (+387361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:50.174531 (+ 76689us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:50.174559 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:50.186116 (+ 11557us) log.cc:844] Serialized 26 byte log entry
0709 12:59:50.437173 (+251057us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:50.437214 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:50.437284 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:50.789796 (+352512us) raft_consensus.cc:1685] finished
0709 12:59:50.789816 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:51.378323 (+588507us) spinlock_profiling.cc:243] Waited 386 ms on lock 0x7b5400364a50. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b28ad 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 12:59:51.378506 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":76234,"raft.queue_time_us":76399,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":9850,"spinlock_wait_cycles":887119744,"thread_start_us":222450,"threads_started":1,"wal-append.queue_time_us":443008}
I20260709 12:59:51.354216  3821 consensus_queue.cc:1048] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 12:59:51.382517  3843 raft_consensus.cc:3060] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:51.369408  1525 consensus_queue.cc:260] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:51.388397  1525 raft_consensus.cc:3060] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:51.389951  3892 raft_consensus.cc:493] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:51.390515  3892 raft_consensus.cc:515] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:51.392671  3892 leader_election.cc:290] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:51.397445  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 498) took 1375 ms. Trace:
I20260709 12:59:51.397881  1602 rpcz_store.cc:276] 0709 12:59:50.022174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:50.198070 (+175896us) service_pool.cc:224] Handling call
0709 12:59:50.285110 (+ 87040us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:51.022297 (+737187us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:51.263726 (+241429us) spinlock_profiling.cc:243] Waited 727 ms on lock 0x7b540035f7d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 12:59:51.397242 (+133516us) spinlock_profiling.cc:243] Waited 69.9 ms on lock 0x7b540035f7d0. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b28ad 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 12:59:51.397380 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1833800448}
W20260709 12:59:51.404448  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:51.405172  3832 raft_consensus.cc:515] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:51.406489  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:51.406755  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:51.407158  1672 raft_consensus.cc:3060] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:59:51.408069  3876 raft_consensus.cc:493] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:51.408586  3876 raft_consensus.cc:515] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:51.412752  4017 raft_consensus.cc:3055] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:51.413166  4017 raft_consensus.cc:740] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 12:59:51.413477  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 12:59:51.414060  2221 raft_consensus.cc:3060] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:51.413949  4017 consensus_queue.cc:260] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:51.415174  4017 raft_consensus.cc:3060] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:51.417975  3917 raft_consensus.cc:3055] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:51.418398  3917 raft_consensus.cc:740] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 12:59:51.419293  3917 consensus_queue.cc:260] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:51.420538  3917 raft_consensus.cc:3060] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:59:51.422514  1604 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36200 (request call id 1820) took 1823 ms (client timeout 2044 ms). Trace:
W20260709 12:59:51.422942  1604 rpcz_store.cc:269] 0709 12:59:49.598612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:49.611615 (+ 13003us) service_pool.cc:224] Handling call
0709 12:59:51.422364 (+1810749us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b54002ace54. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 12:59:51.422460 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2566070656}
W20260709 12:59:51.424024  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 487991us
I20260709 12:59:51.424706  1646 leader_election.cc:304] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:51.425441  1672 raft_consensus.cc:2468] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 5.
I20260709 12:59:51.426137  3828 raft_consensus.cc:2764] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:59:51.436285  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:51.426226  1646 leader_election.cc:304] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 12:59:51.445996  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 58077.3us
I20260709 12:59:51.445391  1525 raft_consensus.cc:1275] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:59:51.447811  2192 leader_election.cc:304] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:51.448288  1525 pending_rounds.cc:85] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting all ops after (but not including) 5
I20260709 12:59:51.448594  1525 pending_rounds.cc:107] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:59:51.448858  1525 raft_consensus.cc:2889] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:51.457283  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:51.457942  1678 raft_consensus.cc:3060] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:51.461726  1495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:51.462399  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:51.463084  1672 raft_consensus.cc:2468] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 5.
I20260709 12:59:51.463181  1532 raft_consensus.cc:1240] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:59:51.464289  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:51.468921  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:51.469826  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:51.464205  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:51.475935  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:51.453541  4017 raft_consensus.cc:493] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:51.480540  4017 raft_consensus.cc:515] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 12:59:51.482963  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 56801.1us
I20260709 12:59:51.483788  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:51.484634  1523 raft_consensus.cc:2393] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 4: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 12:59:51.433462  3876 leader_election.cc:290] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:51.389029  3966 raft_consensus.cc:493] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:51.487445  1532 raft_consensus.cc:2393] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 4: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 12:59:51.510180  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:51.479125  2192 leader_election.cc:304] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:51.490260  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:51.444144  3832 leader_election.cc:290] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:51.496245  1601 raft_consensus.cc:1240] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 8 LEADER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:51.497110  3901 raft_consensus.cc:493] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:51.499667  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:51.485126  4032 raft_consensus.cc:2804] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:51.503034  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:51.543531  1525 raft_consensus.cc:2468] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 6.
I20260709 12:59:51.454869  3744 raft_consensus.cc:493] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:51.508558  2225 raft_consensus.cc:1275] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:59:51.511970  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:51.512763  1604 raft_consensus.cc:3060] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:59:51.513082  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:51.482513  4017 leader_election.cc:290] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:51.515388  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:51.516063  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:51.498871  3966 raft_consensus.cc:515] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:51.519546  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:51.467576  3975 consensus_queue.cc:1048] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 12:59:51.525583  1427 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50074 (request call id 231) took 9815 ms. Trace:
I20260709 12:59:51.526576  1602 raft_consensus.cc:1275] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:59:51.527453  1598 raft_consensus.cc:1240] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:51.559827  1607 raft_consensus.cc:1240] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 4. Current term is 5. Ops: []
W20260709 12:59:51.563143  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 43856.9us
I20260709 12:59:51.531442  1678 raft_consensus.cc:2468] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 4.
I20260709 12:59:51.534201  2218 raft_consensus.cc:1240] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:51.535862  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:51.538113  2220 raft_consensus.cc:1275] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:59:51.538451  1529 raft_consensus.cc:2410] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:59:51.569274  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:51.501748  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 12:59:51.545941  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:51.569973  1605 raft_consensus.cc:2468] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 4.
I20260709 12:59:51.570279  1527 raft_consensus.cc:2468] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 3.
I20260709 12:59:51.544832  1523 raft_consensus.cc:2468] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 5.
W20260709 12:59:51.516470  1496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:51.571028  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:51.518929  3978 raft_consensus.cc:2749] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:59:51.550691  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:51.549871  1524 raft_consensus.cc:2393] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 4: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 12:59:51.556618  1604 raft_consensus.cc:2468] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 5.
I20260709 12:59:51.521260  4002 raft_consensus.cc:3060] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:51.554884  2190 leader_election.cc:304] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:51.550220  1677 raft_consensus.cc:2468] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 4.
I20260709 12:59:51.571708  1599 raft_consensus.cc:2468] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 9.
I20260709 12:59:51.539587  2221 raft_consensus.cc:2468] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 5.
I20260709 12:59:51.584131  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:51.584770  1523 raft_consensus.cc:3060] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:51.579562  1646 leader_election.cc:304] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:51.578272  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:51.591199  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:51.591536  3892 raft_consensus.cc:2804] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:51.591840  1528 raft_consensus.cc:2468] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 6.
I20260709 12:59:51.559078  3940 raft_consensus.cc:493] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:51.560428  4032 raft_consensus.cc:697] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 5 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:51.592139  4007 consensus_queue.cc:1059] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:51.549752  3744 raft_consensus.cc:515] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:51.592718  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:51.592549  3940 raft_consensus.cc:515] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:51.591629  3936 raft_consensus.cc:2749] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:59:51.594417  4051 raft_consensus.cc:493] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:51.594761  3744 leader_election.cc:290] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:51.594933  4051 raft_consensus.cc:515] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:51.596882  4051 leader_election.cc:290] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:51.578356  3997 consensus_queue.cc:1059] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 12:59:51.574271  3640 consensus_queue.cc:1048] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 12:59:51.599840  3966 leader_election.cc:290] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:51.600906  4033 consensus_queue.cc:1059] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:51.601920  4033 raft_consensus.cc:3055] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:51.602283  4033 raft_consensus.cc:740] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:51.547188  3901 raft_consensus.cc:515] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:51.603087  4033 consensus_queue.cc:260] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:51.604305  4033 raft_consensus.cc:3060] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:51.604703  3876 consensus_queue.cc:1048] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:51.605072  3901 leader_election.cc:290] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 12:59:51.605647  1495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:51.553306  1427 rpcz_store.cc:276] 0709 12:59:41.710474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:41.710646 (+   172us) service_pool.cc:224] Handling call
0709 12:59:51.525502 (+9814856us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:47.242377 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:47.243133 (+   756us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:47.243187 (+    54us) write_op.cc:435] Acquired schema lock
0709 12:59:47.243200 (+    13us) tablet.cc:662] Decoding operations
0709 12:59:47.244153 (+   953us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:47.244225 (+    72us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:47.244254 (+    29us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:59:47.244949 (+   695us) tablet.cc:701] Row locks acquired
0709 12:59:47.245001 (+    52us) write_op.cc:260] PREPARE: finished
0709 12:59:47.245189 (+   188us) write_op.cc:270] Start()
0709 12:59:47.245341 (+   152us) write_op.cc:276] Timestamp: P: 1783601987245114 usec, L: 0
0709 12:59:47.245362 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:59:47.352374 (+107012us) log.cc:844] Serialized 2835 byte log entry
0709 12:59:48.459789 (+1107415us) op_driver.cc:464] REPLICATION: finished
0709 12:59:48.830220 (+370431us) write_op.cc:301] APPLY: starting
0709 12:59:48.873668 (+ 43448us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:49.015495 (+141827us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:49.015665 (+   170us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:49.016711 (+  1046us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:49.017032 (+   321us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 12:59:49.017076 (+    44us) write_op.cc:312] APPLY: finished
0709 12:59:49.017439 (+   363us) log.cc:844] Serialized 59 byte log entry
0709 12:59:49.017666 (+   227us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:49.017788 (+   122us) write_op.cc:454] Released schema lock
0709 12:59:49.017853 (+    65us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:49.018264 (+   411us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:49.018292 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5264,"reported_tablets":20,"child_traces":[["op",{"apply.queue_time_us":310159,"apply.run_cpu_time_us":3579,"apply.run_wall_time_us":220666,"num_ops":7,"prepare.queue_time_us":118329,"prepare.run_cpu_time_us":18459,"prepare.run_wall_time_us":511457,"raft.queue_time_us":215290,"raft.run_cpu_time_us":48058,"raft.run_wall_time_us":179018,"replication_time_us":1201998,"thread_start_us":558438,"threads_started":4,"wal-append.queue_time_us":379940,"wal-append.run_cpu_time_us":25101,"wal-append.run_wall_time_us":2249374}]]}
W20260709 12:59:51.606943  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 204545us
W20260709 12:59:51.607828  1570 leader_election.cc:336] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.769s (SENT)
I20260709 12:59:51.608297  1527 raft_consensus.cc:2393] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 3: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 12:59:51.608358  1570 leader_election.cc:304] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:51.610190  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:51.615088  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:51.609725  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:51.624589  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:51.625371  1524 raft_consensus.cc:2468] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 5.
I20260709 12:59:51.627385  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:51.623211  3940 leader_election.cc:290] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:51.643726  1425 catalog_manager.cc:5697] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 5 to 4, leader changed from <none> to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 4 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:59:51.627136  3892 raft_consensus.cc:697] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 5 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 12:59:51.573215  3819 consensus_queue.cc:1048] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
W20260709 12:59:51.706106  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 149798us
I20260709 12:59:51.684315  1644 leader_election.cc:304] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:51.707065  2191 leader_election.cc:304] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:51.708039  2191 leader_election.cc:304] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:51.709180  2191 leader_election.cc:304] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:51.641151  3828 raft_consensus.cc:3055] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:51.666745  1599 raft_consensus.cc:1275] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:59:51.659744  4032 consensus_queue.cc:237] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:51.667207  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:51.667488  1526 raft_consensus.cc:2393] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 3: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 12:59:51.590994  4041 raft_consensus.cc:2749] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:51.667881  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:51.729008  1524 raft_consensus.cc:2393] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 5: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 12:59:51.670241  1523 raft_consensus.cc:2468] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 6.
I20260709 12:59:51.620229  3966 raft_consensus.cc:2749] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:59:51.684785  1570 leader_election.cc:336] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.961s (SENT)
I20260709 12:59:51.736123  1570 leader_election.cc:304] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:51.713614  1599 raft_consensus.cc:1275] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:51.736918  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:51.737759  1525 raft_consensus.cc:2393] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 5: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 12:59:51.728453  3978 raft_consensus.cc:2749] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:51.747571  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:51.748176  1523 raft_consensus.cc:3060] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:51.721226  3940 consensus_queue.cc:1048] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:59:51.731755  1496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:51.757980  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:51.744261  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 12:59:51.751322  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 66567.4us
I20260709 12:59:51.763172  2192 leader_election.cc:304] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
W20260709 12:59:51.764889  1570 leader_election.cc:336] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 2.986s (SENT)
I20260709 12:59:51.749382  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:51.767187  1570 leader_election.cc:304] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:51.767690  1527 raft_consensus.cc:2410] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:59:51.710218  3832 raft_consensus.cc:493] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:51.751430  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:51.769821  1529 raft_consensus.cc:2468] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 4.
I20260709 12:59:51.770143  1497 leader_election.cc:304] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:51.738762  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:51.771274  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:51.771916  1526 raft_consensus.cc:2376] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 6. Re-sending same reply.
I20260709 12:59:51.768838  1425 catalog_manager.cc:5697] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:51.733390  3909 raft_consensus.cc:2804] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:51.711999  3828 raft_consensus.cc:740] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:51.782073  1497 leader_election.cc:304] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:51.784685  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:51.785938  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:51.745193  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:51.711545  3941 consensus_queue.cc:1059] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.070s
I20260709 12:59:51.788619  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:51.768407  3744 raft_consensus.cc:2749] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:51.792155  1525 raft_consensus.cc:2468] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 5.
W20260709 12:59:51.792326  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:51.787953  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:51.783595  2222 raft_consensus.cc:1240] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 4. Current term is 5. Ops: []
W20260709 12:59:51.780753  1570 leader_election.cc:336] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 3.019s (SENT)
W20260709 12:59:51.806740  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 215450us
I20260709 12:59:51.771756  3997 consensus_queue.cc:1048] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
W20260709 12:59:51.786675  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 71485.3us
I20260709 12:59:51.771914  3640 raft_consensus.cc:2804] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:51.783480  3980 raft_consensus.cc:2749] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:51.797960  4007 raft_consensus.cc:2749] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:51.815375  1570 leader_election.cc:304] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:51.783403  3935 raft_consensus.cc:2749] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:51.785367  3909 raft_consensus.cc:493] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:51.789160  3975 consensus_queue.cc:1048] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:59:51.783680  3820 raft_consensus.cc:2749] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:51.819088  2191 leader_election.cc:304] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:51.823293  1425 catalog_manager.cc:5697] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } }
W20260709 12:59:51.828673  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 47951.1us
I20260709 12:59:51.810436  1523 raft_consensus.cc:2468] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 7.
I20260709 12:59:51.784735  3966 raft_consensus.cc:493] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:51.855438  3909 raft_consensus.cc:3060] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:51.785537  3832 raft_consensus.cc:515] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:51.855070  3744 raft_consensus.cc:2749] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:51.852020  3640 raft_consensus.cc:697] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 4 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
W20260709 12:59:51.913208  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 94206.7us
I20260709 12:59:51.941047  1572 leader_election.cc:304] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90
W20260709 12:59:51.952436  1495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:51.889595  3983 raft_consensus.cc:493] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:51.881500  3917 consensus_queue.cc:1048] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.090s
I20260709 12:59:51.815378  3892 consensus_queue.cc:237] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:51.967857  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 12:59:51.969271  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:51.974632  2225 raft_consensus.cc:2410] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 12:59:51.975987  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 193988us
I20260709 12:59:51.974560  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:51.961170  3935 raft_consensus.cc:493] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:51.981195  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 260955us
I20260709 12:59:51.997668  1644 leader_election.cc:304] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:51.982702  1497 leader_election.cc:304] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:51.998885  1673 raft_consensus.cc:1275] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 12:59:51.974987  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 240199us
I20260709 12:59:51.969380  4074 raft_consensus.cc:2804] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:51.943552  3864 consensus_queue.cc:1059] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 12:59:52.003449  1646 leader_election.cc:304] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:52.003646  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:52.004274  1497 leader_election.cc:304] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:52.006337  1644 leader_election.cc:304] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:51.974809  3901 raft_consensus.cc:2804] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:51.972049  1598 raft_consensus.cc:2468] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 5.
I20260709 12:59:51.903151  3966 raft_consensus.cc:515] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:51.979879  1425 catalog_manager.cc:5697] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 1 to 3, leader changed from ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) to b96ce9cc496c49d7818fa983a17b062b (127.0.107.196). New cstate: current_term: 3 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:51.854283  3828 consensus_queue.cc:260] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:52.010838  1604 raft_consensus.cc:2468] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 4.
I20260709 12:59:52.016299  1497 leader_election.cc:304] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:52.003340  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:52.073237  1603 raft_consensus.cc:2468] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 4.
I20260709 12:59:52.002583  3935 raft_consensus.cc:515] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 12:59:52.008046  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 106661us
W20260709 12:59:52.016973  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 166095us
I20260709 12:59:51.997852  3640 consensus_queue.cc:237] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:52.080510  1570 leader_election.cc:304] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:52.080716  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 12:59:52.051218  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 44940.6us
I20260709 12:59:52.001008  3999 raft_consensus.cc:493] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:52.082134  1604 raft_consensus.cc:1240] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:52.058526  4034 raft_consensus.cc:2804] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:52.055124  1646 leader_election.cc:304] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:52.007223  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:52.006228  3820 raft_consensus.cc:2749] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:52.006487  4002 raft_consensus.cc:2749] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:52.098881  1602 raft_consensus.cc:2468] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 6.
W20260709 12:59:52.052073  4067 log.cc:927] Time spent T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.340s	user 0.000s	sys 0.001s
I20260709 12:59:52.017431  3843 raft_consensus.cc:2749] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:59:51.970548  3980 consensus_queue.cc:1048] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 12:59:52.009442  3993 consensus_queue.cc:1048] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 12:59:52.131668  3993 consensus_queue.cc:1048] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:52.013793  4033 consensus_queue.cc:1048] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 12:59:52.133127  1605 raft_consensus.cc:1275] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:52.133306  4033 raft_consensus.cc:2804] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:52.133823  4033 raft_consensus.cc:697] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 5 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:52.134951  3820 raft_consensus.cc:493] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:52.135277  4072 log.cc:927] Time spent T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:59:52.135510  3820 raft_consensus.cc:515] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 12:59:52.136241  4075 log.cc:927] Time spent T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:59:52.017563  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:52.004935  4074 raft_consensus.cc:493] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:52.058537  4079 raft_consensus.cc:2749] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:52.088526  1425 catalog_manager.cc:5697] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 3 to 4, leader changed from 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) to e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:51.973953  3983 raft_consensus.cc:515] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:52.102958  2227 raft_consensus.cc:1275] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:59:52.146093  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 53467.6us
I20260709 12:59:52.116139  3828 raft_consensus.cc:3060] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:59:52.141055  4070 log.cc:927] Time spent T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.181s	user 0.000s	sys 0.001s
W20260709 12:59:52.156323  1495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:52.162449  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 80428.4us
I20260709 12:59:52.165516  1644 leader_election.cc:304] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
W20260709 12:59:52.112829  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 171895us
W20260709 12:59:52.094542  4062 log.cc:927] Time spent T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.306s	user 0.000s	sys 0.005s
I20260709 12:59:52.128599  3941 consensus_queue.cc:1059] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:52.129634  3909 raft_consensus.cc:515] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:52.130309  3935 leader_election.cc:290] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:52.134624  4033 consensus_queue.cc:237] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 12:59:52.077049  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 60868.3us
I20260709 12:59:52.178145  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:52.178800  1497 leader_election.cc:304] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:52.087729  4034 raft_consensus.cc:493] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:52.087431  4081 raft_consensus.cc:2804] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:59:52.115783  4071 log.cc:927] Time spent T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
W20260709 12:59:52.143224  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 62788.2us
I20260709 12:59:52.186117  1570 leader_election.cc:304] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:52.098156  3999 raft_consensus.cc:515] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:52.189868  1497 leader_election.cc:304] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:52.179234  1644 leader_election.cc:304] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:52.144701  4074 raft_consensus.cc:3060] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:52.186427  1425 catalog_manager.cc:5697] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 1 to 2, leader changed from 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:59:52.164371  3820 leader_election.cc:290] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:52.179996  3864 consensus_queue.cc:1243] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 log is divergent from this leader: its last log entry 4.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:59:52.199066  3843 raft_consensus.cc:2764] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260709 12:59:52.184147  2219 raft_consensus.cc:1275] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:52.203753  3980 raft_consensus.cc:2749] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:52.182897  3832 leader_election.cc:290] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:52.185602  4034 raft_consensus.cc:3060] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:52.186796  4079 raft_consensus.cc:2804] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:52.231014  4079 raft_consensus.cc:493] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:52.231473  4079 raft_consensus.cc:3060] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:59:52.203780  4083 log.cc:927] Time spent T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:59:52.236100  4051 raft_consensus.cc:3055] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:52.236579  4051 raft_consensus.cc:740] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:52.237418  4051 consensus_queue.cc:260] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:52.197045  3936 raft_consensus.cc:2749] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:52.242967  3832 raft_consensus.cc:2749] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:52.228009  1497 leader_election.cc:304] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:52.260406  1497 leader_election.cc:304] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:52.264178  1497 leader_election.cc:304] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:52.266090  1497 leader_election.cc:304] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
W20260709 12:59:52.266764  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 80729.3us
I20260709 12:59:52.264034  3820 raft_consensus.cc:2749] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:52.263029  3843 raft_consensus.cc:2804] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:59:52.283599  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 228580us
I20260709 12:59:52.304795  1646 leader_election.cc:304] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:52.300510  1570 leader_election.cc:304] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:52.306329  1570 leader_election.cc:304] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:52.307482  1570 leader_election.cc:304] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:52.324266  4081 raft_consensus.cc:697] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 12:59:52.269755  4099 raft_consensus.cc:2804] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:52.298985  4051 raft_consensus.cc:3060] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:52.298996  3901 raft_consensus.cc:697] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 5 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:52.325582  3941 consensus_queue.cc:1059] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 12:59:52.332186  3820 raft_consensus.cc:2749] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:52.340276  4032 raft_consensus.cc:2804] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:59:52.341557  4078 log.cc:927] Time spent T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.284s	user 0.001s	sys 0.000s
I20260709 12:59:52.298836  4097 raft_consensus.cc:493] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:52.321206  3843 raft_consensus.cc:493] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:52.304662  3966 leader_election.cc:290] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:52.323021  3864 raft_consensus.cc:2804] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:52.322853  4095 raft_consensus.cc:2804] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:52.327679  3632 raft_consensus.cc:2749] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:52.329916  4099 raft_consensus.cc:493] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:52.359061  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:52.353989  4032 raft_consensus.cc:493] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:52.360028  3843 raft_consensus.cc:3060] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:59:52.375279  1557 heartbeater.cc:646] Failed to heartbeat to 127.0.107.254:40423 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.0.107.254:40423 timed out after 15.000s (SENT)
I20260709 12:59:52.374975  3901 consensus_queue.cc:237] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:52.364709  4074 raft_consensus.cc:515] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:52.368522  4099 raft_consensus.cc:3060] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:52.361773  3864 raft_consensus.cc:493] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:52.382925  3864 raft_consensus.cc:3060] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:52.372054  4112 raft_consensus.cc:493] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:52.385510  4112 raft_consensus.cc:515] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:52.387701  4112 leader_election.cc:290] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:52.372413  4032 raft_consensus.cc:3060] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:52.360343  4097 raft_consensus.cc:515] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:52.400710  4097 leader_election.cc:290] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:52.361492  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:52.371369  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:52.361297  4095 raft_consensus.cc:493] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:52.407824  4095 raft_consensus.cc:3060] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:52.361547  3820 raft_consensus.cc:2749] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:59:52.422036  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 156028us
I20260709 12:59:52.423985  1497 leader_election.cc:304] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:52.378774  4074 leader_election.cc:290] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 6 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:52.373734  3909 leader_election.cc:290] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:52.349494  4033 consensus_queue.cc:1059] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.064s
I20260709 12:59:52.373917  3983 leader_election.cc:290] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:52.378351  4079 raft_consensus.cc:515] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:52.457799  3864 raft_consensus.cc:515] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:52.464249  2226 raft_consensus.cc:1275] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 12:59:52.444413  4032 raft_consensus.cc:515] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:52.466009  3909 raft_consensus.cc:493] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:52.466706  3909 raft_consensus.cc:515] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:52.466507  3629 consensus_queue.cc:1048] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:52.467803  4087 raft_consensus.cc:3055] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:52.468211  4087 raft_consensus.cc:740] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:52.428154  4081 consensus_queue.cc:237] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:52.470952  3876 raft_consensus.cc:493] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:52.475203  4051 raft_consensus.cc:3055] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:52.475075  3876 raft_consensus.cc:515] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:52.451583  4095 raft_consensus.cc:515] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:52.475376  4105 raft_consensus.cc:493] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:52.443867   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:52.428098  4112 raft_consensus.cc:2749] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:59:52.460565  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 116179us
I20260709 12:59:52.473626  4079 leader_election.cc:290] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:52.455466  4034 raft_consensus.cc:515] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:52.475680  4051 raft_consensus.cc:740] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:52.439867  4002 raft_consensus.cc:3055] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:52.471786  2226 pending_rounds.cc:85] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b: Aborting all ops after (but not including) 5
I20260709 12:59:52.440419  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:52.440691  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:52.427917  1497 leader_election.cc:304] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:52.482995  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:52.440389  3843 raft_consensus.cc:515] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:52.493834  2226 pending_rounds.cc:107] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 12:59:52.475008  4092 raft_consensus.cc:493] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:52.494632  2227 raft_consensus.cc:2468] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 5.
I20260709 12:59:52.495661  2226 raft_consensus.cc:2889] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:52.494367  1672 raft_consensus.cc:2468] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 6.
I20260709 12:59:52.496891  4095 leader_election.cc:290] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 12:59:52.501063  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 73235us
W20260709 12:59:52.496196  4066 log.cc:927] Time spent T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.598s	user 0.000s	sys 0.003s
I20260709 12:59:52.477500  3876 leader_election.cc:290] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:52.529567  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:52.487038  3941 consensus_queue.cc:1243] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer 39a92f5a4352465d8af3af5908fe8642 log is divergent from this leader: its last log entry 8.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:59:52.452618  3999 leader_election.cc:290] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 12:59:52.494046  4115 log.cc:927] Time spent T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.174s	user 0.002s	sys 0.000s
I20260709 12:59:52.457007  3640 raft_consensus.cc:3055] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:52.469302  3909 leader_election.cc:290] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:52.478246  4105 raft_consensus.cc:515] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:52.448160  2218 raft_consensus.cc:1240] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 3 LEADER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:52.471632  4032 leader_election.cc:290] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:52.435384  4099 raft_consensus.cc:515] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:52.519491  1497 leader_election.cc:304] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:52.518702  4121 consensus_queue.cc:1048] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 12:59:52.526093  3843 leader_election.cc:290] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:52.469275  4087 consensus_queue.cc:260] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:52.493675  4002 raft_consensus.cc:740] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:52.531436  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:52.534708  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:52.586567  1672 raft_consensus.cc:3060] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:59:52.535734  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:52.537040  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:52.587581  1675 raft_consensus.cc:3060] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:59:52.535616  1527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49310 (request call id 469) took 1021 ms. Trace:
I20260709 12:59:52.532224  4114 consensus_queue.cc:1048] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 12:59:52.530418  4118 raft_consensus.cc:2749] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:52.548264  4051 consensus_queue.cc:260] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:52.538784  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 12:59:52.562940  4116 raft_consensus.cc:2749] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:59:52.563714  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 44310.4us
I20260709 12:59:52.612350  1497 leader_election.cc:304] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:52.503811  4092 raft_consensus.cc:515] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:52.566159  4105 leader_election.cc:290] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:52.569778  1679 raft_consensus.cc:1275] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:52.570793  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:52.571651  2224 raft_consensus.cc:3060] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [term 2 LEARNER]: Advancing to term 4
I20260709 12:59:52.572896  4099 leader_election.cc:290] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:52.575488  1673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50664 (request call id 445) took 2353 ms. Trace:
I20260709 12:59:52.626875  1673 rpcz_store.cc:276] 0709 12:59:50.222459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:50.222645 (+   186us) service_pool.cc:224] Handling call
0709 12:59:50.224031 (+  1386us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:51.999265 (+1775234us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:52.575215 (+575950us) spinlock_profiling.cc:243] Waited 1.77 s on lock 0x7b54003e6554. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 12:59:52.575418 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4081313024}
I20260709 12:59:52.545362  3640 raft_consensus.cc:740] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
W20260709 12:59:52.598649  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:52.532047  4100 consensus_queue.cc:1059] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 12:59:52.536227  4033 consensus_queue.cc:1059] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 12:59:52.553148  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:52.619797  1672 raft_consensus.cc:2468] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 7.
I20260709 12:59:52.621042  1497 leader_election.cc:304] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:52.620915  4087 raft_consensus.cc:3060] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:52.624413  4118 raft_consensus.cc:3060] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:52.663089  2224 raft_consensus.cc:1275] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [term 4 LEARNER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:59:52.675979  2191 leader_election.cc:304] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
W20260709 12:59:52.681205  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 60250.2us
I20260709 12:59:52.682263  1675 raft_consensus.cc:2468] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 6.
I20260709 12:59:52.596051  1527 rpcz_store.cc:276] 0709 12:59:51.514564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:51.771073 (+256509us) service_pool.cc:224] Handling call
0709 12:59:51.771431 (+   358us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:59:51.772378 (+   947us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:51.772405 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:59:52.136649 (+364244us) spinlock_profiling.cc:243] Waited 2.58 ms on lock 0x7b2c00000658. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a16eaca11 00007f6a16ebc372 00007f6a185eea01 00007f6a185b343a 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2
0709 12:59:52.137197 (+   548us) log.cc:844] Serialized 52 byte log entry
0709 12:59:52.326524 (+189327us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:52.326567 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:52.326644 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:52.530766 (+204122us) raft_consensus.cc:1685] finished
0709 12:59:52.530787 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:52.535541 (+  4754us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":401,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":13977,"spinlock_wait_cycles":5928832,"thread_start_us":188930,"threads_started":1,"wal-append.queue_time_us":389862}
I20260709 12:59:52.688167  2191 leader_election.cc:304] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:52.673851  4105 consensus_queue.cc:1048] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 12:59:52.691676  4086 raft_consensus.cc:2804] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:52.692274  4086 raft_consensus.cc:697] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 7 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 12:59:52.692996  4092 leader_election.cc:290] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:52.693639  4092 raft_consensus.cc:2804] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:52.694090  4092 raft_consensus.cc:697] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 6 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 12:59:52.693133  4086 consensus_queue.cc:237] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:52.694944  4034 leader_election.cc:290] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:52.697638  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:52.698483  1672 raft_consensus.cc:2468] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 4.
I20260709 12:59:52.699934  2191 leader_election.cc:304] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:52.700821  3892 raft_consensus.cc:2804] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:52.701236  3892 raft_consensus.cc:493] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:52.701548  3892 raft_consensus.cc:3060] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:52.703301  3640 consensus_queue.cc:260] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:52.672353  4090 consensus_queue.cc:1048] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:59:52.706866  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 12:59:52.709168  1497 leader_election.cc:304] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
W20260709 12:59:52.712723  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 81970us
I20260709 12:59:52.672622  3909 raft_consensus.cc:493] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:52.688143  4099 raft_consensus.cc:2749] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:52.696285  3864 leader_election.cc:290] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:52.719543  1497 leader_election.cc:304] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:52.723986  1497 leader_election.cc:304] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:52.730190  4017 raft_consensus.cc:2749] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:52.720989  4092 consensus_queue.cc:237] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:52.726233  1497 leader_election.cc:304] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:52.735878  1497 leader_election.cc:304] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:52.737877  1527 raft_consensus.cc:1275] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:59:52.738268  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:52.738852  1531 raft_consensus.cc:2376] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 4. Re-sending same reply.
I20260709 12:59:52.739681  1527 raft_consensus.cc:1275] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:59:52.739946  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:52.740506  1531 raft_consensus.cc:2468] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 6.
I20260709 12:59:52.750326  1497 leader_election.cc:304] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:52.753317  1644 leader_election.cc:304] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:52.753633  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:52.755481  1644 leader_election.cc:304] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:52.756197  3983 consensus_queue.cc:1048] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:52.756486  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:52.757682  3983 consensus_queue.cc:1048] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:59:52.757736  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:52.758966  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:52.759593  1525 raft_consensus.cc:2468] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 9.
I20260709 12:59:52.760398  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:52.761247  1529 raft_consensus.cc:1275] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:59:52.724089  4081 raft_consensus.cc:2749] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:52.763737  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:52.723829  4099 raft_consensus.cc:2749] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:52.767588  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:52.715941  3909 raft_consensus.cc:515] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:52.779248  1528 raft_consensus.cc:2393] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 6: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 12:59:52.779630  1644 leader_election.cc:304] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:52.753209  4017 raft_consensus.cc:2804] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:52.778903  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:52.754321  4116 raft_consensus.cc:2804] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:52.783149  3988 raft_consensus.cc:493] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:52.762605  3843 raft_consensus.cc:2749] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:52.782269  4017 raft_consensus.cc:493] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:52.791862  4017 raft_consensus.cc:3060] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:52.792246  4120 raft_consensus.cc:2749] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:52.764896  4114 raft_consensus.cc:2804] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:52.794384  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:52.793607  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:52.776924  4079 raft_consensus.cc:2804] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:52.798079  1524 raft_consensus.cc:2468] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 6.
I20260709 12:59:52.777390  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 12:59:52.762244  4034 consensus_queue.cc:1048] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:59:52.806968  1525 raft_consensus.cc:2468] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 6.
I20260709 12:59:52.786680  4116 raft_consensus.cc:493] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:52.821512  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:52.822386  1528 raft_consensus.cc:2393] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 4: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
W20260709 12:59:52.833010  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:52.808899  4079 raft_consensus.cc:493] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:52.764822  3892 raft_consensus.cc:515] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:52.866183  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:52.868883  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:52.869701  1525 raft_consensus.cc:2410] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:59:52.779381  4032 consensus_queue.cc:1048] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 12:59:52.870508  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:52.818321  2218 raft_consensus.cc:1240] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 4 LEADER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:52.771862  4124 consensus_queue.cc:1048] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 12:59:52.810372  4114 raft_consensus.cc:697] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 4 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:52.897421  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:52.898155  1528 raft_consensus.cc:3060] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:59:52.902118  4069 log.cc:927] Time spent T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 1.012s	user 0.000s	sys 0.003s
I20260709 12:59:52.903494  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50664 (request call id 456) took 1496 ms. Trace:
I20260709 12:59:52.903836  1676 rpcz_store.cc:276] 0709 12:59:51.406629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:51.432969 (+ 26340us) service_pool.cc:224] Handling call
0709 12:59:51.462486 (+ 29517us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:51.476787 (+ 14301us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:51.476820 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:51.483164 (+  6344us) log.cc:844] Serialized 26 byte log entry
0709 12:59:51.639387 (+156223us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:51.669607 (+ 30220us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:51.669688 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:52.901439 (+1231751us) spinlock_profiling.cc:243] Waited 2.03 ms on lock 0x7b4400022b4c. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a153ecc85 00007f6a153ed6a2 00007f6a1815f1db 00007f6a1815aaaf 00007f6a1814e86e 00007f6a1814dbb6 00007f6a1814d7d8 00007f6a18157221 00007f6a181571d9 00007f6a18157169
0709 12:59:52.903240 (+  1801us) raft_consensus.cc:1685] finished
0709 12:59:52.903261 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:52.903435 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5697,"raft.queue_time_us":5805,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":30294,"spinlock_wait_cycles":4671616,"thread_start_us":144455,"threads_started":1,"wal-append.queue_time_us":315105}
I20260709 12:59:52.906208  3828 raft_consensus.cc:3055] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:52.906620  3828 raft_consensus.cc:740] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:52.906960  1676 raft_consensus.cc:1240] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:52.907447  3828 consensus_queue.cc:260] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:52.795887  3988 raft_consensus.cc:515] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:52.822993  4116 raft_consensus.cc:3060] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:52.865623  4079 raft_consensus.cc:3060] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:52.913076  3983 consensus_queue.cc:1059] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 12:59:52.887598  3843 raft_consensus.cc:493] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:52.889060  4092 raft_consensus.cc:493] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:52.920434  1523 raft_consensus.cc:1240] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:52.924170  1528 raft_consensus.cc:2468] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 10.
I20260709 12:59:52.925416  3983 consensus_queue.cc:1243] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer b96ce9cc496c49d7818fa983a17b062b log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:59:52.933797  1528 raft_consensus.cc:1240] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:52.922322  4085 raft_consensus.cc:493] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:52.917065  3819 consensus_queue.cc:1059] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 12:59:52.943724  1528 raft_consensus.cc:1275] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:59:52.988268  1528 raft_consensus.cc:1275] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:59:52.918676  3632 consensus_queue.cc:1048] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
W20260709 12:59:52.936991  4127 log.cc:927] Time spent T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
I20260709 12:59:53.005347  1675 raft_consensus.cc:1275] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:59:52.925140  3843 raft_consensus.cc:515] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 12:59:53.067169  4128 log.cc:927] Time spent T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.190s	user 0.000s	sys 0.001s
I20260709 12:59:52.926410  4092 raft_consensus.cc:515] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:53.058322  4109 raft_consensus.cc:493] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:52.977910  4085 raft_consensus.cc:515] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 12:59:53.133734  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:53.055625  4114 consensus_queue.cc:237] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:53.111495  4097 raft_consensus.cc:493] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:53.139298  4097 raft_consensus.cc:515] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:53.141450  4097 leader_election.cc:290] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:53.143132  3843 leader_election.cc:290] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:53.147408  4116 raft_consensus.cc:515] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:53.103012  3909 leader_election.cc:290] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
W20260709 12:59:53.169085  1646 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:40303 timed out after 1.561s (SENT) [suppressed 40 similar messages]
W20260709 12:59:53.162256  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 155264us
I20260709 12:59:53.115808  4109 raft_consensus.cc:515] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:53.178220  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
W20260709 12:59:53.161147  4126 log.cc:927] Time spent T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.299s	user 0.000s	sys 0.001s
I20260709 12:59:53.183876  3843 raft_consensus.cc:493] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:53.173470  3892 leader_election.cc:290] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 5 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:53.184135  3983 raft_consensus.cc:493] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:53.177292  3909 consensus_queue.cc:1048] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
W20260709 12:59:53.228713  4068 log.cc:927] Time spent T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 1.517s	user 0.029s	sys 0.043s
I20260709 12:59:53.229655  4079 raft_consensus.cc:515] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:53.213614  4097 raft_consensus.cc:493] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:53.231882  4097 raft_consensus.cc:515] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:53.213200  3983 raft_consensus.cc:515] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:53.233875  4097 leader_election.cc:290] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:53.234892  3983 leader_election.cc:290] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:53.199626  3843 raft_consensus.cc:515] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 12:59:53.259812  4142 log.cc:927] Time spent T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
I20260709 12:59:53.232292  4085 leader_election.cc:290] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 12:59:53.234933  4118 consensus_meta.cc:287] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent flushing consensus metadata: real 0.522s	user 0.005s	sys 0.005s
I20260709 12:59:53.295747  3921 raft_consensus.cc:493] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:53.324465  4079 leader_election.cc:290] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:53.321750  4097 raft_consensus.cc:493] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 12:59:53.323765  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:53.326277  3843 leader_election.cc:290] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:53.325479  4097 raft_consensus.cc:515] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:53.324731  4092 leader_election.cc:290] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:53.324465  3921 raft_consensus.cc:515] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:53.251506  4074 raft_consensus.cc:493] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:53.328337  1675 raft_consensus.cc:1240] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:53.333626  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36194 (request call id 1422) took 1572 ms. Trace:
W20260709 12:59:53.334837  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 992435us
I20260709 12:59:53.298403  4118 raft_consensus.cc:2749] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:53.336911  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:53.298966  4114 raft_consensus.cc:493] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:53.334729  1603 rpcz_store.cc:276] 0709 12:59:51.761154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:52.073920 (+312766us) service_pool.cc:224] Handling call
0709 12:59:52.074262 (+   342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:52.164283 (+ 90021us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:52.164315 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:52.164762 (+   447us) log.cc:844] Serialized 26 byte log entry
0709 12:59:52.272037 (+107275us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:52.321539 (+ 49502us) log.cc:844] Serialized 14 byte log entry
0709 12:59:53.328423 (+1006884us) spinlock_profiling.cc:243] Waited 1.56 ms on lock 0x7b18003dbd00. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1e38ede1 00007f6a1e39b5b1 00007f6a15440c0a 00007f6a1eb80219 00007f6a154c8a40 00007f6a154c34e4 00007f6a154c3455 00007f6a185ab060 00007f6a185bd716 00007f6a185ce287 00007f6a185ce208
0709 12:59:53.328578 (+   155us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:53.328642 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:53.328678 (+    36us) raft_consensus.cc:1685] finished
0709 12:59:53.333433 (+  4755us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:53.333571 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2497,"prepare.queue_time_us":50713,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":1142021,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":88,"spinlock_wait_cycles":3596544,"thread_start_us":196537,"threads_started":2,"wal-append.queue_time_us":276774}
W20260709 12:59:53.341897  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:53.342445  1678 raft_consensus.cc:1275] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:59:53.342979  1531 raft_consensus.cc:1275] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:59:53.333719  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:53.322870  4116 leader_election.cc:290] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 12:59:53.346232  4135 log.cc:927] Time spent T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.451s	user 0.003s	sys 0.008s
I20260709 12:59:53.333287  4106 raft_consensus.cc:3060] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:53.344362  1675 raft_consensus.cc:2468] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 6.
I20260709 12:59:53.351866  1602 raft_consensus.cc:1240] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:59:53.354166  1571 leader_election.cc:304] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:53.359977  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:53.363360  1605 raft_consensus.cc:2468] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 2.
I20260709 12:59:53.350802  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 508) took 1721 ms. Trace:
I20260709 12:59:53.350530  1572 leader_election.cc:304] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
W20260709 12:59:53.364578  1570 connection.cc:256] RPC call timeout handler was delayed by -1.0221005559999981s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22240000000000004s for a response
W20260709 12:59:53.365576  1570 leader_election.cc:336] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.636s (SENT)
I20260709 12:59:53.366052  1570 leader_election.cc:304] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:53.366009  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:53.366945  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:53.367579  1602 raft_consensus.cc:2468] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 6.
I20260709 12:59:53.364459  1607 rpcz_store.cc:276] 0709 12:59:51.628979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:51.714582 (+ 85603us) service_pool.cc:224] Handling call
0709 12:59:52.448849 (+734267us) spinlock_profiling.cc:243] Waited 4.85 ms on lock 0x7b5800017198. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a1548eb71 00007f6a1548ea22 00007f6a1e3a7c09 00007f6a1d501ee0 00007f6a1d5cb0ab 00007f6a1d5cb131 00007f6a1d58cfc0 00007f6a1d577929 00007f6a1d5773d2 00007f6a16aeebd4
0709 12:59:52.449048 (+   199us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:52.449256 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:59:52.449598 (+   342us) log.cc:844] Serialized 14 byte log entry
0709 12:59:53.350464 (+900866us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:53.350514 (+    50us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:53.350559 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:53.350616 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:53.350748 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":679717,"prepare.queue_time_us":3406,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":680466,"raft.run_cpu_time_us":56,"raft.run_wall_time_us":56,"spinlock_wait_cycles":11147648,"thread_start_us":220784,"threads_started":1,"wal-append.queue_time_us":275455}
I20260709 12:59:53.368952  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:53.371763  1572 leader_election.cc:304] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:53.373710  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:53.375770  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:53.376622  4109 leader_election.cc:290] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:53.335305  4074 raft_consensus.cc:515] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:53.375787  3966 raft_consensus.cc:2749] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:53.373297  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:53.376094  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:53.379850  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:53.394693  2227 raft_consensus.cc:2468] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 6.
I20260709 12:59:53.347352  4145 consensus_queue.cc:1059] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:59:53.382946  4092 consensus_queue.cc:1048] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:53.369801  4097 leader_election.cc:290] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:53.344769  4114 raft_consensus.cc:515] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:53.387388  4074 leader_election.cc:290] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:53.350056  4095 raft_consensus.cc:493] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:53.375715  3901 raft_consensus.cc:2804] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:53.386512  2191 leader_election.cc:304] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:53.392045  2218 raft_consensus.cc:1240] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:53.356285  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:53.369801  4116 raft_consensus.cc:493] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:53.392623  3970 raft_consensus.cc:2804] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:53.419694  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:53.422446  1673 raft_consensus.cc:2410] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:59:53.404752  4007 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 12:59:53.401235  4087 raft_consensus.cc:2749] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:53.412375  4118 raft_consensus.cc:493] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:53.418035  3901 raft_consensus.cc:493] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:53.423918  3970 raft_consensus.cc:493] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:53.423722  4074 raft_consensus.cc:2804] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:53.417943  4095 raft_consensus.cc:515] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:53.424644  4116 raft_consensus.cc:515] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:53.492342  3921 leader_election.cc:290] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:53.498608  4092 raft_consensus.cc:493] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:53.499732  1678 raft_consensus.cc:1240] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:53.501003  4002 consensus_queue.cc:260] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:53.501821  4095 leader_election.cc:290] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:53.502087  4002 raft_consensus.cc:3060] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:53.454838  4007 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:59:53.504189  4007 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:53.504061  4092 raft_consensus.cc:515] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 12:59:53.505338  4157 log.cc:927] Time spent T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 12:59:53.459255  3901 raft_consensus.cc:3060] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:53.460147  4074 raft_consensus.cc:493] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:53.487329  4017 consensus_meta.cc:287] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent flushing consensus metadata: real 0.688s	user 0.011s	sys 0.000s
I20260709 12:59:53.509120  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:53.517475  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:53.519737  1604 raft_consensus.cc:1275] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:59:53.519665  1603 raft_consensus.cc:1240] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:53.516402  4074 raft_consensus.cc:3060] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:53.516484  4105 raft_consensus.cc:493] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
W20260709 12:59:53.522533  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 128537us
I20260709 12:59:53.506603  4092 leader_election.cc:290] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:53.459736  4118 raft_consensus.cc:515] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 12:59:53.530802  1570 leader_election.cc:336] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 2.137s (SENT)
I20260709 12:59:53.525511  1603 raft_consensus.cc:1275] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:59:53.534024  1570 leader_election.cc:304] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:53.533146  1600 raft_consensus.cc:1275] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:59:53.510993  4109 consensus_queue.cc:1059] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 12:59:53.535271  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:53.537425  1603 raft_consensus.cc:3060] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:53.539173  1604 raft_consensus.cc:1275] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:59:53.469676  3970 raft_consensus.cc:3060] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:53.520829  4017 raft_consensus.cc:515] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:53.542726  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:53.543650  1570 leader_election.cc:304] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:53.545038  1570 leader_election.cc:304] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:53.544528  3744 raft_consensus.cc:493] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:53.545724  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:53.547465  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
W20260709 12:59:53.551641  4156 log.cc:927] Time spent T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.219s	user 0.000s	sys 0.001s
I20260709 12:59:53.552044  1603 raft_consensus.cc:2468] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 10.
I20260709 12:59:53.541546  3966 raft_consensus.cc:493] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:53.532194  4166 raft_consensus.cc:493] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:53.560832  1605 raft_consensus.cc:2468] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 3.
I20260709 12:59:53.537245  4095 raft_consensus.cc:2749] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:53.530032  4105 raft_consensus.cc:515] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:53.551949  4114 leader_election.cc:290] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 12:59:53.642356  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 97412.1us
I20260709 12:59:53.623162  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:53.685293  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:53.567018  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:53.698230  1530 raft_consensus.cc:2410] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b for term 7 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:59:53.627143  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:53.652020  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:53.699206  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:53.627492  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:53.698690  1570 leader_election.cc:304] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:53.609417  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:53.700523  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:53.684495  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:53.699916  1530 raft_consensus.cc:2468] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 4.
I20260709 12:59:53.683570  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:53.564936  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:53.703459  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:53.704018  1530 raft_consensus.cc:2468] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 3.
I20260709 12:59:53.702544  1527 raft_consensus.cc:3060] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:53.705101  1530 raft_consensus.cc:1275] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:59:53.706719  1646 leader_election.cc:304] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
W20260709 12:59:53.629889  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:53.701711  1674 raft_consensus.cc:2468] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 3.
W20260709 12:59:53.713936  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:53.714748  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
W20260709 12:59:53.715487  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:53.716080  1530 raft_consensus.cc:3060] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:53.555958  3864 raft_consensus.cc:3060] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:53.553809  4106 raft_consensus.cc:2749] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:53.743466  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:53.627357  4051 raft_consensus.cc:3060] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:53.732661  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:53.566329  3744 raft_consensus.cc:515] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:53.734937  4095 raft_consensus.cc:2804] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:53.655717  4087 raft_consensus.cc:2749] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:53.735813  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:53.736284  3999 consensus_queue.cc:1048] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:53.736833  4114 consensus_queue.cc:1048] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:53.738467  1681 raft_consensus.cc:1240] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:53.738587  3876 consensus_queue.cc:1048] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:53.739058  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:53.743290  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:53.740806  1646 leader_election.cc:304] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:53.744246  1604 raft_consensus.cc:2468] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 3.
I20260709 12:59:53.658023  3828 raft_consensus.cc:3060] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:53.637446  4017 leader_election.cc:290] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:53.618418  3983 raft_consensus.cc:493] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:53.761904  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:53.749615  1525 raft_consensus.cc:2393] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 6: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 12:59:53.645799  3934 raft_consensus.cc:3055] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:53.653855  3921 raft_consensus.cc:493] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:53.711630  4007 raft_consensus.cc:2749] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:53.711918  3888 raft_consensus.cc:3055] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:53.734521  4105 leader_election.cc:290] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:53.763644  1646 leader_election.cc:304] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:53.761989  1529 raft_consensus.cc:1240] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:53.764645  1600 raft_consensus.cc:2468] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 5.
I20260709 12:59:53.719065  3941 consensus_queue.cc:1048] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 12:59:53.641932  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 12:59:53.764882  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 90404us
I20260709 12:59:53.719247  4124 consensus_queue.cc:1059] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 12:59:53.713442  3966 raft_consensus.cc:515] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:53.750635  4095 raft_consensus.cc:493] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
W20260709 12:59:53.784634  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:53.792313  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 93782.5us
I20260709 12:59:53.797246  1570 leader_election.cc:304] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:53.767606  4121 raft_consensus.cc:2804] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:59:53.801909  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:53.804082  1604 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 6.
I20260709 12:59:53.797572  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:53.773752  3888 raft_consensus.cc:740] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 12:59:53.806734  3888 consensus_queue.cc:260] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:53.807265  3966 leader_election.cc:290] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:53.811604  4172 raft_consensus.cc:2749] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:53.813278  4034 raft_consensus.cc:2749] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:59:53.813632  1677 raft_consensus.cc:2410] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b for term 9 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:59:53.749998  3901 raft_consensus.cc:515] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:53.819118  1605 raft_consensus.cc:2393] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 7: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 12:59:53.819360  3888 raft_consensus.cc:3060] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:53.825333  1601 raft_consensus.cc:1240] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:53.788113  4095 raft_consensus.cc:3060] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:53.769259  3934 raft_consensus.cc:740] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 12:59:53.767124  1598 raft_consensus.cc:2468] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 4.
I20260709 12:59:53.829938  1570 leader_election.cc:304] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:53.805434  1529 raft_consensus.cc:2468] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 3.
I20260709 12:59:53.837141  1530 raft_consensus.cc:2468] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 5.
I20260709 12:59:53.838469  1527 raft_consensus.cc:2468] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 6.
I20260709 12:59:53.841948  1529 raft_consensus.cc:1275] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:59:53.840457  1570 leader_election.cc:304] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:53.858542  1601 raft_consensus.cc:1240] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 5 LEADER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:53.858971  2226 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0"
dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
mode: GRACEFUL
new_leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:47682
I20260709 12:59:53.859530  2226 raft_consensus.cc:606] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 4 LEADER]: Received request to transfer leadership to TS e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:53.860505  1570 leader_election.cc:304] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:53.855662  4121 raft_consensus.cc:697] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 10 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:53.720111  4166 raft_consensus.cc:515] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:53.819118  3901 leader_election.cc:290] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:53.862126  4121 consensus_queue.cc:237] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:53.863502  4166 leader_election.cc:290] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:53.865837  1607 raft_consensus.cc:2393] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 7: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 12:59:53.866423  1570 leader_election.cc:304] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
W20260709 12:59:53.838786  4168 log.cc:927] Time spent T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.212s	user 0.001s	sys 0.000s
I20260709 12:59:53.869884  1570 leader_election.cc:304] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:53.872336  4087 raft_consensus.cc:2804] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:53.873728  3744 leader_election.cc:290] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:53.773614  3921 raft_consensus.cc:515] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:53.874272  3901 raft_consensus.cc:2749] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:53.776626  3983 raft_consensus.cc:515] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:53.803112  4118 leader_election.cc:290] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:53.839882  2219 raft_consensus.cc:1275] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:59:53.877434  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 114263us
I20260709 12:59:53.933920  3921 leader_election.cc:290] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:53.874971  4173 raft_consensus.cc:493] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:53.934988  4173 raft_consensus.cc:515] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:59:53.937220  4173 leader_election.cc:290] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:53.937624  3983 leader_election.cc:290] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:53.879213  3632 raft_consensus.cc:493] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:53.938454  3632 raft_consensus.cc:515] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:53.940007  3632 leader_election.cc:290] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:53.877377  1570 leader_election.cc:304] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:53.881560  2226 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4ea41c88222b469fb11229faef735050"
dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
mode: GRACEFUL
new_leader_uuid: "39a92f5a4352465d8af3af5908fe8642"
 from {username='slave'} at 127.0.0.1:47682
I20260709 12:59:53.942703  2226 raft_consensus.cc:606] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Received request to transfer leadership to TS 39a92f5a4352465d8af3af5908fe8642
I20260709 12:59:53.943075  2226 raft_consensus.cc:614] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:53.909447  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:53.895776  2190 leader_election.cc:304] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:53.909003  1678 raft_consensus.cc:2468] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 5.
I20260709 12:59:53.900159  4087 raft_consensus.cc:697] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 7 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:53.916165  3864 raft_consensus.cc:2749] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:53.861114  3966 raft_consensus.cc:2749] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:53.870201  4175 raft_consensus.cc:2804] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:53.910758  4085 consensus_queue.cc:1059] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:59:53.912942  1524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43010 (request call id 1758) took 1173 ms. Trace:
I20260709 12:59:53.950194  1524 rpcz_store.cc:276] 0709 12:59:52.739265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:52.739363 (+    98us) service_pool.cc:224] Handling call
0709 12:59:53.912726 (+1173363us) spinlock_profiling.cc:243] Waited 34.5 ms on lock 0x7b540002b554. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 12:59:53.912868 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":79432448}
I20260709 12:59:53.914568  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:53.903687  1601 raft_consensus.cc:1240] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:53.920257  1602 raft_consensus.cc:1240] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 8 LEADER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 12:59:53.954339  4112 raft_consensus.cc:1064] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1: attempting to promote NON_VOTER b96ce9cc496c49d7818fa983a17b062b to VOTER
I20260709 12:59:53.955986  2226 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5"
dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
mode: GRACEFUL
new_leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:47682
I20260709 12:59:53.956660  2226 raft_consensus.cc:606] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Received request to transfer leadership to TS e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:53.957031  2226 raft_consensus.cc:614] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:53.879590  1604 raft_consensus.cc:1275] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:59:53.957717  4108 raft_consensus.cc:2749] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:53.944283  1681 raft_consensus.cc:2410] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:59:53.956499  4112 consensus_queue.cc:237] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 5, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:53.946635  1496 leader_election.cc:304] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
W20260709 12:59:53.946908  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 69624.7us
I20260709 12:59:53.883116  4106 raft_consensus.cc:2749] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:53.891460  3934 consensus_queue.cc:260] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:53.915293  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 12:59:53.964877  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:53.951702  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:53.952034  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:53.965457  1673 raft_consensus.cc:2468] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 6.
I20260709 12:59:53.965720  1672 raft_consensus.cc:2393] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 7: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 12:59:53.956243  4074 raft_consensus.cc:515] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 12:59:53.944415  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 48769.8us
I20260709 12:59:53.891549  3988 leader_election.cc:290] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:53.959970  3888 raft_consensus.cc:2749] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:53.952633  4175 raft_consensus.cc:493] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
W20260709 12:59:53.931543  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 167987us
I20260709 12:59:53.965165  1570 leader_election.cc:304] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:53.984472  1570 leader_election.cc:304] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:53.966563  1571 leader_election.cc:304] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:53.985929  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:53.991426  1570 leader_election.cc:304] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:53.992648  1570 leader_election.cc:304] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:53.994839  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:53.997509  2227 raft_consensus.cc:1240] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:54.001390  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:54.007200  1673 raft_consensus.cc:2468] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 4.
I20260709 12:59:54.000795  1570 leader_election.cc:304] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:54.007721  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:53.995496  4106 raft_consensus.cc:2749] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:54.012074  1524 raft_consensus.cc:3055] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:54.007913  1646 leader_election.cc:304] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:54.011894  2190 leader_election.cc:304] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:54.012406  1524 raft_consensus.cc:740] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 12:59:54.011400  2192 leader_election.cc:304] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 12:59:54.016176  1497 leader_election.cc:304] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:54.016271  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:54.017376  1526 raft_consensus.cc:2393] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 7: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 12:59:54.017711  1646 leader_election.cc:304] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:54.018519  1496 leader_election.cc:304] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:54.018916  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:54.020150  1497 leader_election.cc:304] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:54.020568  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:53.993988  4175 raft_consensus.cc:3060] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:54.011411  4172 raft_consensus.cc:2749] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:59:54.022912  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:54.024151  3632 raft_consensus.cc:2749] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:59:54.023005  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:54.031945  1530 raft_consensus.cc:2393] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 3: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 12:59:54.033183  1675 raft_consensus.cc:1275] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 9. (term mismatch)
I20260709 12:59:54.033599  1675 pending_rounds.cc:85] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90: Aborting all ops after (but not including) 8
I20260709 12:59:54.033818  1675 pending_rounds.cc:107] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90: Aborting uncommitted NO_OP operation due to leader change: 7.9
I20260709 12:59:54.034044  1675 raft_consensus.cc:2889] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:54.036832  1681 raft_consensus.cc:1275] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:59:54.024704  4120 raft_consensus.cc:2804] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:53.996084  4179 raft_consensus.cc:2804] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:54.028863  1524 consensus_queue.cc:260] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:54.041127  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:54.004405  4108 raft_consensus.cc:2804] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:53.999977  3966 raft_consensus.cc:3060] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:54.015600  2190 leader_election.cc:304] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:54.000588  4173 raft_consensus.cc:493] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:53.998842  4081 consensus_queue.cc:1059] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:59:54.041491  1524 raft_consensus.cc:3060] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:54.041184  1603 raft_consensus.cc:1275] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:59:54.042246  1600 raft_consensus.cc:2468] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 2.
I20260709 12:59:54.016415  3892 raft_consensus.cc:2749] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:54.027520  3888 raft_consensus.cc:2804] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:54.048974  1673 raft_consensus.cc:1240] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:54.048578  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:54.082490  1646 leader_election.cc:304] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:54.030522  4118 raft_consensus.cc:2804] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:54.102488  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:54.054782  2190 leader_election.cc:304] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:54.028110  4002 raft_consensus.cc:2804] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:54.047138  4179 raft_consensus.cc:493] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:54.129498  1529 raft_consensus.cc:2393] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 5: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
W20260709 12:59:54.130410  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 75764.1us
I20260709 12:59:54.131070  1600 raft_consensus.cc:3060] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:54.007696  4087 consensus_queue.cc:237] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:54.024277  4095 raft_consensus.cc:515] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:54.040787  4120 raft_consensus.cc:493] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:54.049559  4108 raft_consensus.cc:493] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:54.194109  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:54.100383  3988 raft_consensus.cc:2804] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:54.047659  4177 raft_consensus.cc:2749] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:54.047861  4097 raft_consensus.cc:493] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:54.035982  3993 consensus_queue.cc:1059] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.155s
I20260709 12:59:54.120563  3888 raft_consensus.cc:493] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:54.047344  4114 consensus_queue.cc:1059] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.149s
I20260709 12:59:54.136497  4118 raft_consensus.cc:493] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:54.190235  4044 raft_consensus.cc:2749] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:54.136693  4178 raft_consensus.cc:2804] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:54.240119  1600 raft_consensus.cc:2468] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 5.
I20260709 12:59:54.052788  4100 consensus_queue.cc:1048] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.171s
I20260709 12:59:54.244081  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:54.137147  4002 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 12:59:54.246841  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:54.312836  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 12:59:54.307451  4181 log.cc:927] Time spent T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.260s	user 0.002s	sys 0.000s
I20260709 12:59:54.099298  4173 raft_consensus.cc:515] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 12:59:54.230471  4183 log.cc:927] Time spent T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 12:59:54.231079  3988 raft_consensus.cc:493] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:54.257815  4178 raft_consensus.cc:493] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 12:59:54.228389  4108 raft_consensus.cc:3060] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:54.197150  4179 raft_consensus.cc:3060] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:54.118271  4092 consensus_queue.cc:1048] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.118s
W20260709 12:59:54.256266  4051 consensus_meta.cc:287] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.504s	user 0.010s	sys 0.000s
I20260709 12:59:54.239210  3888 raft_consensus.cc:3060] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:54.297446  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 104549us
I20260709 12:59:54.243105  4118 raft_consensus.cc:3060] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:59:54.299999  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:54.223881  3892 consensus_queue.cc:1059] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 12:59:54.306234  1644 leader_election.cc:304] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:54.194950  3901 raft_consensus.cc:2749] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:54.314145  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:54.240639  4097 raft_consensus.cc:515] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:54.222237  4120 raft_consensus.cc:3060] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:54.296619  4096 raft_consensus.cc:2749] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:54.308377  4074 leader_election.cc:290] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:54.310105  4177 raft_consensus.cc:493] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:54.329399  1532 raft_consensus.cc:2376] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 6. Re-sending same reply.
I20260709 12:59:54.329501  2190 leader_election.cc:304] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:54.315845  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:54.321296  3988 raft_consensus.cc:3060] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:54.320235  4002 raft_consensus.cc:3060] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:54.320609  4178 raft_consensus.cc:3060] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:54.336305  1600 raft_consensus.cc:2468] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 3.
W20260709 12:59:54.329531  3970 consensus_meta.cc:287] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.730s	user 0.005s	sys 0.005s
I20260709 12:59:54.340555  1644 leader_election.cc:304] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:54.348798  2190 leader_election.cc:304] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:54.349481  1644 leader_election.cc:304] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 12:59:54.342278  4182 log.cc:927] Time spent T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.334s	user 0.001s	sys 0.000s
I20260709 12:59:54.333354  3878 raft_consensus.cc:493] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:54.332778  4081 raft_consensus.cc:493] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:54.352095  1673 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac"
dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:49162
W20260709 12:59:54.357677  1496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:54.343160  4174 log.cc:927] Time spent T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.316s	user 0.000s	sys 0.001s
I20260709 12:59:54.338371  4051 raft_consensus.cc:3060] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:54.353302  3940 raft_consensus.cc:2749] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:54.360353  4017 raft_consensus.cc:493] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:54.370579  3876 consensus_queue.cc:1048] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:59:54.361333  4044 raft_consensus.cc:2804] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:54.352931  3999 raft_consensus.cc:2749] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:59:54.342861  4100 consensus_queue.cc:1048] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 12:59:54.369876  4074 raft_consensus.cc:2804] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:59:54.415815  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 178496us
W20260709 12:59:54.416332  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 49186.4us
I20260709 12:59:54.346031  4177 raft_consensus.cc:515] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:54.357990  4114 consensus_queue.cc:1059] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 12:59:54.361640  3993 consensus_queue.cc:1059] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 12:59:54.382557  4044 raft_consensus.cc:493] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:54.428661  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 408574us
I20260709 12:59:54.357782  3970 raft_consensus.cc:515] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:54.444789  1497 leader_election.cc:304] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:54.445614  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:54.369989  4121 consensus_queue.cc:1048] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 12:59:54.361898  3878 raft_consensus.cc:515] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:54.367496  4081 raft_consensus.cc:515] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:54.387216  4095 leader_election.cc:290] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:54.465219  1678 raft_consensus.cc:2393] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 4: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 12:59:54.379033  4017 raft_consensus.cc:515] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:54.433468  4074 raft_consensus.cc:697] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 5 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 12:59:54.481073  1606 raft_consensus.cc:2393] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 6: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
W20260709 12:59:54.469434  4185 log.cc:927] Time spent T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.170s	user 0.001s	sys 0.000s
I20260709 12:59:54.465734  4044 raft_consensus.cc:3060] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:54.487334  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 138614us
I20260709 12:59:54.469558  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 12:59:54.491053  2226 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.009s	sys 0.035s
W20260709 12:59:54.495656  2226 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.507s	user 0.009s	sys 0.035s
I20260709 12:59:54.495208  4173 leader_election.cc:290] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:54.519436  4074 consensus_queue.cc:237] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:54.520224  4205 consensus_queue.cc:1048] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:54.505077  4095 raft_consensus.cc:493] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:54.532094  4095 raft_consensus.cc:515] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:54.534314  4095 leader_election.cc:290] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:54.531459  4097 leader_election.cc:290] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
W20260709 12:59:54.531289  4197 log.cc:927] Time spent T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
W20260709 12:59:54.551070  4193 log.cc:927] Time spent T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.222s	user 0.000s	sys 0.003s
I20260709 12:59:54.502797  4206 consensus_queue.cc:1048] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 12:59:54.547801  4081 leader_election.cc:290] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 12:59:54.556730  4175 consensus_meta.cc:287] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.513s	user 0.009s	sys 0.000s
I20260709 12:59:54.558772  4002 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:59:54.559770  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50664 (request call id 473) took 1649 ms. Trace:
I20260709 12:59:54.608482  1676 rpcz_store.cc:276] 0709 12:59:52.910359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:52.910675 (+   316us) service_pool.cc:224] Handling call
0709 12:59:52.921988 (+ 11313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:53.960692 (+1038704us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:53.960750 (+    58us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:53.960792 (+    42us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:59:53.960820 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:54.559526 (+598706us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b5400178c54. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 12:59:54.559573 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:54.559708 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2388340608}
I20260709 12:59:54.560081  4108 raft_consensus.cc:515] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:54.539956  3966 raft_consensus.cc:2749] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:54.544405  4017 leader_election.cc:290] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:54.554277  4178 raft_consensus.cc:515] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:54.620054  4178 leader_election.cc:290] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:54.623517  4177 leader_election.cc:290] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:54.624363  4097 raft_consensus.cc:1064] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90: attempting to promote NON_VOTER b96ce9cc496c49d7818fa983a17b062b to VOTER
W20260709 12:59:54.624831  4097 raft_consensus.cc:1068] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90: Unable to promote non-voter b96ce9cc496c49d7818fa983a17b062b: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:59:54.627326  4002 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:54.629325  3988 raft_consensus.cc:515] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:54.632151  4118 raft_consensus.cc:515] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:54.635385  4044 raft_consensus.cc:515] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:54.637504  4044 leader_election.cc:290] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 4 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:54.639420  4007 raft_consensus.cc:3055] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:54.639930  4007 raft_consensus.cc:740] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:54.635455  3934 raft_consensus.cc:3060] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:54.641837  3888 raft_consensus.cc:515] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:54.642866  4032 raft_consensus.cc:3055] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:54.643326  4032 raft_consensus.cc:740] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:54.644253  4032 consensus_queue.cc:260] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:54.609387  4175 raft_consensus.cc:515] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:54.647962  4105 raft_consensus.cc:993] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b: : Instructing follower e46412b3b0b44f01ad5c33d4cfe3d6b1 to start an election
I20260709 12:59:54.648566  4105 raft_consensus.cc:1081] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 4 LEADER]: Signalling peer e46412b3b0b44f01ad5c33d4cfe3d6b1 to start an election
I20260709 12:59:54.614563  4051 raft_consensus.cc:2749] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:54.675442  4118 leader_election.cc:290] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:54.606928  4179 raft_consensus.cc:515] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:54.681975  4179 leader_election.cc:290] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:54.686210  4120 raft_consensus.cc:515] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:54.688652  4120 leader_election.cc:290] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:54.731861  4221 raft_consensus.cc:493] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:54.741262  4222 raft_consensus.cc:2749] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:59:54.739679  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:54.742436  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:54.736847  4221 raft_consensus.cc:515] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:54.743593  1598 raft_consensus.cc:2468] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 4.
I20260709 12:59:54.743765  4222 raft_consensus.cc:493] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:54.744794  4222 raft_consensus.cc:515] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:54.745281  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:54.745725  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 12:59:54.566542  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 127952us
I20260709 12:59:54.752789  1644 leader_election.cc:304] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 12:59:54.753561  1598 raft_consensus.cc:2410] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:59:54.755002  1673 raft_consensus.cc:606] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Received request to transfer leadership
I20260709 12:59:54.755388  1678 raft_consensus.cc:1240] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:54.765837  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:54.766870  1676 raft_consensus.cc:2468] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 6.
I20260709 12:59:54.771487  3632 raft_consensus.cc:493] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:54.772449  3632 raft_consensus.cc:515] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:54.817704  1599 raft_consensus.cc:1240] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:59:54.776836  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:54.863248  1607 raft_consensus.cc:1240] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 7 LEADER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:59:54.888350  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 12:59:54.781960  4221 leader_election.cc:290] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:54.871989  4222 leader_election.cc:290] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:54.835495  3935 raft_consensus.cc:3055] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:54.914923  3935 raft_consensus.cc:740] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 12:59:54.916709  3935 consensus_queue.cc:260] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:54.910614  1673 raft_consensus.cc:614] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:54.919143  3935 raft_consensus.cc:3060] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:54.920437  3940 consensus_queue.cc:1059] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:59:54.862996  4202 log.cc:927] Time spent T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.350s	user 0.002s	sys 0.002s
I20260709 12:59:54.921669  3940 consensus_queue.cc:1243] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer b96ce9cc496c49d7818fa983a17b062b log is divergent from this leader: its last log entry 3.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:59:54.923199  4120 raft_consensus.cc:3055] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:54.923758  4120 raft_consensus.cc:740] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:54.814430  4212 raft_consensus.cc:2804] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:54.924517  4212 raft_consensus.cc:493] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:54.925042  4212 raft_consensus.cc:3060] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:54.925181  4120 consensus_queue.cc:260] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:54.867918  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:54.937093  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:54.938144  1601 raft_consensus.cc:2468] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 6.
W20260709 12:59:54.817279  1606 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 519) took 1463 ms (client timeout 1671 ms). Trace:
W20260709 12:59:54.939208  1606 rpcz_store.cc:269] 0709 12:59:53.353330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.361201 (+  7871us) service_pool.cc:224] Handling call
0709 12:59:54.816620 (+1455419us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b540039e754. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 12:59:54.816957 (+   337us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2499014400}
I20260709 12:59:54.836257  1531 raft_consensus.cc:1275] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 12:59:54.786785  3888 leader_election.cc:290] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 4 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:54.879791  3632 leader_election.cc:290] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:54.830329  3878 leader_election.cc:290] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:54.844444  3934 raft_consensus.cc:493] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:54.871472  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36200 (request call id 1869) took 1312 ms. Trace:
I20260709 12:59:54.951634  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:54.952060  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49170 (request call id 1729) took 1042 ms. Trace:
W20260709 12:59:54.953028  1605 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36200 (request call id 1879) took 1312 ms (client timeout 1653 ms). Trace:
I20260709 12:59:54.953926  4120 raft_consensus.cc:3060] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:54.923856  4108 leader_election.cc:290] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 12:59:54.957638  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 932824us
I20260709 12:59:54.939359  4079 raft_consensus.cc:1064] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90: attempting to promote NON_VOTER b96ce9cc496c49d7818fa983a17b062b to VOTER
I20260709 12:59:54.964021  1572 leader_election.cc:304] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:54.964577  4221 raft_consensus.cc:493] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:54.965082  2226 raft_consensus.cc:3060] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:54.964994  3970 leader_election.cc:290] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:54.818434  4194 raft_consensus.cc:3055] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:54.983732  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:54.816002  4175 leader_election.cc:290] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:54.984633  1676 raft_consensus.cc:3060] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:54.984490  4221 raft_consensus.cc:515] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:54.986763  3632 raft_consensus.cc:493] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:54.987627  3632 raft_consensus.cc:515] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 12:59:54.990315  2192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:54.800379  4051 raft_consensus.cc:493] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:54.997627  4051 raft_consensus.cc:515] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:54.999027  4191 consensus_queue.cc:1048] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:54.776363  1571 leader_election.cc:304] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
W20260709 12:59:55.001140  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 225169us
I20260709 12:59:54.802287  3988 leader_election.cc:290] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 5 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
W20260709 12:59:54.968978  1605 rpcz_store.cc:269] 0709 12:59:53.640207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.695705 (+ 55498us) service_pool.cc:224] Handling call
0709 12:59:54.952493 (+1256788us) spinlock_profiling.cc:243] Waited 56.4 ms on lock 0x7b54002ec054. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 12:59:54.952797 (+   304us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":129692544}
I20260709 12:59:54.968592  1681 rpcz_store.cc:276] 0709 12:59:53.909220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.958702 (+ 49482us) service_pool.cc:224] Handling call
0709 12:59:54.036531 (+ 77829us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:54.037106 (+   575us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:54.951553 (+914447us) spinlock_profiling.cc:243] Waited 77.5 ms on lock 0x7b54000b8bd0. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b28ad 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 12:59:54.951845 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":178326784}
I20260709 12:59:54.977416  1606 raft_consensus.cc:2468] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 4.
I20260709 12:59:54.978070  3876 raft_consensus.cc:493] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:55.005816  4190 raft_consensus.cc:2804] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:55.005731  3876 raft_consensus.cc:515] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:55.006567  4108 raft_consensus.cc:493] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:55.006963  3819 raft_consensus.cc:493] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:54.940747  1531 pending_rounds.cc:85] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting all ops after (but not including) 5
I20260709 12:59:54.890698  2219 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0"
dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
mode: GRACEFUL
new_leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:47682
I20260709 12:59:54.776255  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:54.983754  4222 raft_consensus.cc:493] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:55.007232  1675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49170 (request call id 1721) took 1613 ms. Trace:
I20260709 12:59:54.991225  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:54.968333  1603 rpcz_store.cc:276] 0709 12:59:53.559073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.703412 (+144339us) service_pool.cc:224] Handling call
0709 12:59:54.034994 (+331582us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:54.101657 (+ 66663us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:54.862597 (+760940us) spinlock_profiling.cc:243] Waited 331 ms on lock 0x7b54002ace50. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b28ad 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 12:59:54.871241 (+  8644us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":761944960}
W20260709 12:59:54.994772  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 549949us
I20260709 12:59:54.995007  1676 raft_consensus.cc:2468] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 7.
I20260709 12:59:54.995350  1528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43008 (request call id 1717) took 2245 ms. Trace:
I20260709 12:59:54.996219  4221 leader_election.cc:290] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:55.007961  1531 pending_rounds.cc:107] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:59:55.012600  1531 raft_consensus.cc:2889] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:55.013134  2219 raft_consensus.cc:606] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Received request to transfer leadership to TS e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:55.012894  4222 raft_consensus.cc:515] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:55.013672  2219 raft_consensus.cc:614] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:55.015834  4222 leader_election.cc:290] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:55.016060  4116 leader_election.cc:290] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:55.017303  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:55.011659  1528 rpcz_store.cc:276] 0709 12:59:52.749813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.009166 (+259353us) service_pool.cc:224] Handling call
0709 12:59:53.926761 (+917595us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:59:53.942466 (+ 15705us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:53.942496 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:59:53.945146 (+  2650us) log.cc:844] Serialized 52 byte log entry
0709 12:59:54.001658 (+ 56512us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:54.013187 (+ 11529us) log.cc:844] Serialized 14 byte log entry
0709 12:59:54.021547 (+  8360us) log.cc:844] Serialized 14 byte log entry
0709 12:59:54.477961 (+456414us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:54.478041 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:54.478079 (+    38us) raft_consensus.cc:1685] finished
0709 12:59:54.478092 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:54.638079 (+159987us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b180014dac0. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1e38ede1 00007f6a1e39b5b1 00007f6a154c63f3 00007f6a154c87c1 00007f6a154c8779 00007f6a154c8709 00007f6a154c86d1 00007f6a154c79cd 000000000038f354 000000000038f199 00007f6a154a983a
0709 12:59:54.994938 (+356859us) spinlock_profiling.cc:243] Waited 833 ms on lock 0x7b540002b550. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b28ad 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 12:59:54.995109 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":196575,"prepare.queue_time_us":1003284,"prepare.run_cpu_time_us":119,"prepare.run_wall_time_us":119,"raft.queue_time_us":32994,"raft.run_cpu_time_us":373,"raft.run_wall_time_us":13459,"spinlock_wait_cycles":1948572032,"thread_start_us":506260,"threads_started":2,"wal-append.queue_time_us":152390}
I20260709 12:59:55.020079  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:55.020931  1603 raft_consensus.cc:3060] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:59:54.983111  3934 raft_consensus.cc:515] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:55.009323  4194 raft_consensus.cc:740] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 12:59:54.996467  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:55.026086  1598 raft_consensus.cc:3060] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:55.026691   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:59:54.990310  3632 leader_election.cc:290] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:55.007278  4108 raft_consensus.cc:515] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:54.997172  4192 raft_consensus.cc:2749] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:55.006310  4190 raft_consensus.cc:493] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:55.029439  4108 leader_election.cc:290] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:55.029633  4190 raft_consensus.cc:3060] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:55.006212  2191 leader_election.cc:304] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:55.012102  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:55.031124  1606 raft_consensus.cc:3060] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:55.031790  4051 leader_election.cc:290] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:55.032631  1531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49310 (request call id 481) took 1347 ms. Trace:
I20260709 12:59:55.033658  3640 raft_consensus.cc:3060] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:55.026489  4194 consensus_queue.cc:260] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 12:59:54.981081  1496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:55.033107  1531 rpcz_store.cc:276] 0709 12:59:53.685610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.704067 (+ 18457us) service_pool.cc:224] Handling call
0709 12:59:53.704313 (+   246us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:55.013256 (+1308943us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:55.014550 (+  1294us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54000fdf54. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 12:59:55.032568 (+ 18018us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2601566080}
I20260709 12:59:55.043648  2226 raft_consensus.cc:2468] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 7.
W20260709 12:59:55.009397  4079 raft_consensus.cc:1068] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90: Unable to promote non-voter b96ce9cc496c49d7818fa983a17b062b: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:59:55.047111  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:55.048269  1681 raft_consensus.cc:2410] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:59:55.047325  1600 raft_consensus.cc:3060] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:55.049852  1525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43008 (request call id 1713) took 2300 ms. Trace:
I20260709 12:59:55.050326  1525 rpcz_store.cc:276] 0709 12:59:52.748942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:52.870265 (+121323us) service_pool.cc:224] Handling call
0709 12:59:55.049412 (+2179147us) spinlock_profiling.cc:243] Waited 874 ms on lock 0x7b5400051254. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 12:59:55.049648 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2010216320}
I20260709 12:59:55.025921  3977 raft_consensus.cc:3055] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:55.054186  3977 raft_consensus.cc:740] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:55.055596  3977 consensus_queue.cc:260] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:55.056911  3977 raft_consensus.cc:3060] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:55.058090  1607 raft_consensus.cc:3060] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:55.060227  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:55.061784  1604 raft_consensus.cc:1240] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:55.010808  1675 rpcz_store.cc:276] 0709 12:59:53.393325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.393459 (+   134us) service_pool.cc:224] Handling call
0709 12:59:54.032853 (+639394us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:54.034411 (+  1558us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:54.973162 (+938751us) spinlock_profiling.cc:243] Waited 629 ms on lock 0x7b5400304150. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b28ad 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 12:59:55.007007 (+ 33845us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1446235392}
I20260709 12:59:55.063537  4178 consensus_queue.cc:1059] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:55.064487  4178 consensus_queue.cc:1243] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer 39a92f5a4352465d8af3af5908fe8642 log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:59:55.065234  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:55.065972  1676 raft_consensus.cc:3060] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:55.066295  1601 raft_consensus.cc:1240] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:55.067692  1674 raft_consensus.cc:1240] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:55.067970  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:55.068951  1673 raft_consensus.cc:2410] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:59:55.070062  3876 leader_election.cc:290] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:55.007743  3819 raft_consensus.cc:515] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:55.025095  3934 leader_election.cc:290] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:55.071883  1599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36200 (request call id 1860) took 1556 ms. Trace:
I20260709 12:59:55.072283  1599 rpcz_store.cc:276] 0709 12:59:53.515407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.515532 (+   125us) service_pool.cc:224] Handling call
0709 12:59:54.816950 (+1301418us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:54.932265 (+115315us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:55.071635 (+139370us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b540039e750. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b28ad 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 12:59:55.071788 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2990861568}
I20260709 12:59:55.073891  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:55.068747  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:55.086885  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:55.087229  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:55.087807  1601 raft_consensus.cc:1240] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:55.088052  4194 raft_consensus.cc:3060] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:55.089747  1525 raft_consensus.cc:1240] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:55.070107  1497 leader_election.cc:304] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:55.090938  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:55.092428  1600 raft_consensus.cc:2468] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 7.
I20260709 12:59:55.099802  4212 raft_consensus.cc:515] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:55.072341  3819 leader_election.cc:290] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:55.088174  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:55.086902  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:55.073138  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:55.113989  1678 raft_consensus.cc:3060] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:55.115101  1681 raft_consensus.cc:2393] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 5: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 12:59:55.103618  4212 leader_election.cc:290] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:55.133071  1606 raft_consensus.cc:2468] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 5.
I20260709 12:59:55.134001  1674 raft_consensus.cc:2393] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 7: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 12:59:55.138876  2219 raft_consensus.cc:2468] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 8.
I20260709 12:59:55.143006   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:55.142999  4086 raft_consensus.cc:493] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:55.143810  4086 raft_consensus.cc:515] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:55.123844  4108 consensus_queue.cc:1048] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 12:59:55.147303  3934 raft_consensus.cc:2804] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:55.147756  3934 raft_consensus.cc:493] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:55.148145  3934 raft_consensus.cc:3060] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:55.148598  4007 consensus_queue.cc:260] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:55.150163  4007 raft_consensus.cc:3060] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:55.150789  3935 raft_consensus.cc:2749] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:55.152293  4032 raft_consensus.cc:3060] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:55.142421  2192 leader_election.cc:304] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:55.156798  4033 raft_consensus.cc:3055] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:55.157341  4033 raft_consensus.cc:740] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:55.156905  3819 raft_consensus.cc:2749] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:55.158399  4033 consensus_queue.cc:260] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:55.159909  4033 raft_consensus.cc:3060] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:55.162376  2192 leader_election.cc:304] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:55.163630  4105 raft_consensus.cc:2749] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:55.164592  2192 leader_election.cc:304] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:55.165637  4094 raft_consensus.cc:3060] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:55.166184  2192 leader_election.cc:304] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 12:59:55.146407  4086 leader_election.cc:290] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:55.175907  4190 raft_consensus.cc:515] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:55.176218  4108 consensus_queue.cc:1048] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:59:55.177843  1604 raft_consensus.cc:1275] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:59:55.170516  1607 raft_consensus.cc:2468] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 5.
I20260709 12:59:55.184154  1680 raft_consensus.cc:2468] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 6.
I20260709 12:59:55.186213  1678 raft_consensus.cc:2468] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 5.
I20260709 12:59:55.186954  1603 raft_consensus.cc:2468] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 4.
I20260709 12:59:55.198242  1676 raft_consensus.cc:2468] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 4.
I20260709 12:59:55.201778  1600 raft_consensus.cc:1240] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:55.217427  1676 raft_consensus.cc:1240] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 6. Current term is 7. Ops: []
W20260709 12:59:55.217265  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 147359us
I20260709 12:59:55.215335  2192 leader_election.cc:304] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 12:59:55.211510  4222 raft_consensus.cc:493] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:55.227638  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:55.237900  1571 leader_election.cc:304] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
W20260709 12:59:55.240659  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 234753us
I20260709 12:59:55.241210  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:55.242213  1672 raft_consensus.cc:2410] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 12:59:55.239657  2192 leader_election.cc:304] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
W20260709 12:59:55.244275  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:55.244704  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:55.246591  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:55.248050  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:55.248697  1677 raft_consensus.cc:2468] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 6.
I20260709 12:59:55.249571  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:55.250411  1677 raft_consensus.cc:2410] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 12:59:55.250856  1425 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46258 (request call id 341) took 17628 ms (client timeout 15000 ms). Trace:
I20260709 12:59:55.250976  1681 raft_consensus.cc:2393] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 5: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 12:59:55.252257  1673 raft_consensus.cc:2468] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 4.
W20260709 12:59:55.261781  2190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:55.248711  3819 raft_consensus.cc:2804] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:55.263253  3819 raft_consensus.cc:697] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 5 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 12:59:55.264297  2191 leader_election.cc:304] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 12:59:55.230892  1598 raft_consensus.cc:2468] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 4.
I20260709 12:59:55.259260  4192 raft_consensus.cc:2804] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:55.237473  4222 raft_consensus.cc:515] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:55.252872  4221 consensus_queue.cc:1059] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:59:55.282145  1679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49178 (request call id 1642) took 1215 ms. Trace:
I20260709 12:59:55.265316  3935 raft_consensus.cc:2804] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:55.263492  3892 consensus_queue.cc:1048] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 12:59:55.288703  2192 leader_election.cc:304] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 12:59:55.289690  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:55.236549  4086 consensus_queue.cc:1059] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 12:59:55.286360  1497 leader_election.cc:304] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:55.291970  4043 raft_consensus.cc:2804] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:55.287279  1679 rpcz_store.cc:276] 0709 12:59:53.985034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.985603 (+   569us) service_pool.cc:224] Handling call
0709 12:59:53.985930 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:53.986127 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:59:53.994711 (+  8584us) log.cc:844] Serialized 14 byte log entry
0709 12:59:54.865337 (+870626us) spinlock_profiling.cc:243] Waited 3.69 ms on lock 0x7b1800431920. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1e38ede1 00007f6a1e39b5b1 00007f6a154a8e07 00007f6a1e303ab9 00007f6a154c569b 00007f6a154c393f 00007f6a154c5c02 00007f6a1814d20b 00007f6a18152d23 00007f6a1815323a 00007f6a185bda2a
0709 12:59:55.111373 (+246036us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:55.123239 (+ 11866us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:55.179472 (+ 56233us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:55.185173 (+  5701us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:55.200843 (+ 15670us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7877,"prepare.queue_time_us":8109,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":35,"raft.queue_time_us":28395,"raft.run_cpu_time_us":287,"raft.run_wall_time_us":70510,"spinlock_wait_cycles":8480384,"thread_start_us":106591,"threads_started":1,"wal-append.queue_time_us":1055020}
I20260709 12:59:55.293006  2220 raft_consensus.cc:2468] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 7.
I20260709 12:59:55.293571  1496 leader_election.cc:304] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
W20260709 12:59:55.294128  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:55.294644  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:55.295121  3819 consensus_queue.cc:237] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:55.297147  4205 raft_consensus.cc:493] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:55.297652  4205 raft_consensus.cc:515] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:55.299957  4220 consensus_queue.cc:1059] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 12:59:55.300747  4144 consensus_queue.cc:1059] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.018s
W20260709 12:59:55.301873  4228 log.cc:927] Time spent T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 12:59:55.285332  3888 raft_consensus.cc:2804] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:55.308094  3888 raft_consensus.cc:493] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:55.308542  3888 raft_consensus.cc:3060] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:55.309365  4222 leader_election.cc:290] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:55.283763  1529 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0"
dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:49310
I20260709 12:59:55.311333  1529 raft_consensus.cc:493] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:55.274446  4191 consensus_queue.cc:1059] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 12:59:55.311775  1529 raft_consensus.cc:3060] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:55.312839  4086 raft_consensus.cc:3055] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:55.313272  4086 raft_consensus.cc:740] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 12:59:55.314955  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:55.315629  1527 raft_consensus.cc:3060] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:55.315817  4043 raft_consensus.cc:697] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 7 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 12:59:55.316907  4043 consensus_queue.cc:237] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:55.315358  3934 raft_consensus.cc:515] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 12:59:55.320608  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:55.320724  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:55.321228  3934 leader_election.cc:290] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:55.321419  3640 raft_consensus.cc:2804] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:55.321695  2219 raft_consensus.cc:2393] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 6: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 12:59:55.322011  3640 raft_consensus.cc:697] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 4 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 12:59:55.323179  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:55.323047  3640 consensus_queue.cc:237] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 12:59:55.325282  4230 log.cc:927] Time spent T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 12:59:55.331854  4144 raft_consensus.cc:3055] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:55.332346  4144 raft_consensus.cc:740] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 12:59:55.333307  4144 consensus_queue.cc:260] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:55.349501  3935 raft_consensus.cc:697] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [term 4 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 12:59:55.331854  1523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43010 (request call id 1765) took 2590 ms. Trace:
I20260709 12:59:55.349855  4144 raft_consensus.cc:3060] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:59:55.351861  2192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:55.286895  4192 raft_consensus.cc:697] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 6 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
W20260709 12:59:55.360284  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 66854.1us
I20260709 12:59:55.334132  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:55.311866  4094 raft_consensus.cc:2749] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:59:55.379267  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 196323us
W20260709 12:59:55.381373  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:55.382014  1527 raft_consensus.cc:2468] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 5.
W20260709 12:59:55.385512  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 112859us
I20260709 12:59:55.381542  1496 leader_election.cc:304] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:55.387830  1525 raft_consensus.cc:3060] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:55.352648  1523 rpcz_store.cc:276] 0709 12:59:52.741303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:52.926588 (+185285us) service_pool.cc:224] Handling call
0709 12:59:55.054884 (+2128296us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:55.055565 (+   681us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:55.055595 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:55.056277 (+   682us) log.cc:844] Serialized 26 byte log entry
0709 12:59:55.084594 (+ 28317us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:55.085198 (+   604us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:55.088261 (+  3063us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:55.326546 (+238285us) raft_consensus.cc:1685] finished
0709 12:59:55.326564 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:55.327875 (+  1311us) spinlock_profiling.cc:243] Waited 2.13 s on lock 0x7b5400051250. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b28ad 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 12:59:55.331651 (+  3776us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1721,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":140,"spinlock_wait_cycles":4888489856,"thread_start_us":27843,"threads_started":1,"wal-append.queue_time_us":61821}
I20260709 12:59:55.394174  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:55.394834  1679 raft_consensus.cc:3060] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:55.314296  4086 consensus_queue.cc:260] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:55.400916  1527 raft_consensus.cc:1240] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:55.405409  3921 raft_consensus.cc:2804] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:59:55.251317  1425 rpcz_store.cc:269] 0709 12:59:37.607551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:37.616597 (+  9046us) service_pool.cc:224] Handling call
0709 12:59:38.022489 (+405892us) spinlock_profiling.cc:243] Waited 55.5 ms on lock 0x7b5400411254. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851d090 00007f6a185bbf3a 00007f6a1e3721cc 00007f6a1e47037e 00007f6a1c9312a4 00007f6a1c931232 00007f6a1c931161 00007f6a1c9310dc 00007f6a1c930392 00007f6a168ee48c 00007f6a168ed8c6
0709 12:59:55.229328 (+17206839us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:52.387348 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:52.387909 (+   561us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:52.387950 (+    41us) write_op.cc:435] Acquired schema lock
0709 12:59:52.387964 (+    14us) tablet.cc:662] Decoding operations
0709 12:59:52.388722 (+   758us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:52.388774 (+    52us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:52.388799 (+    25us) tablet.cc:685] Acquiring locks for 6 operations
0709 12:59:52.389281 (+   482us) tablet.cc:701] Row locks acquired
0709 12:59:52.389299 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:59:52.389439 (+   140us) write_op.cc:270] Start()
0709 12:59:52.389544 (+   105us) write_op.cc:276] Timestamp: P: 1783601992389390 usec, L: 0
0709 12:59:52.389560 (+    16us) op_driver.cc:348] REPLICATION: starting
0709 12:59:52.390201 (+   641us) log.cc:844] Serialized 2593 byte log entry
0709 12:59:52.764156 (+373955us) op_driver.cc:464] REPLICATION: finished
0709 12:59:53.271462 (+507306us) write_op.cc:301] APPLY: starting
0709 12:59:53.307348 (+ 35886us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:53.314010 (+  6662us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:53.314156 (+   146us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:53.322024 (+  7868us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:53.322214 (+   190us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 12:59:53.322256 (+    42us) write_op.cc:312] APPLY: finished
0709 12:59:53.322505 (+   249us) log.cc:844] Serialized 53 byte log entry
0709 12:59:53.322689 (+   184us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:53.322796 (+   107us) write_op.cc:454] Released schema lock
0709 12:59:53.322845 (+    49us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:53.323241 (+   396us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:53.323268 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":251929,"reported_tablets":25,"spinlock_wait_cycles":127726336,"child_traces":[["op",{"apply.queue_time_us":458984,"apply.run_cpu_time_us":2644,"apply.run_wall_time_us":67944,"num_ops":6,"prepare.queue_time_us":87033,"prepare.run_cpu_time_us":8130,"prepare.run_wall_time_us":43337,"raft.queue_time_us":165128,"raft.run_cpu_time_us":9944,"raft.run_wall_time_us":466814,"replication_time_us":336083,"thread_start_us":575601,"threads_started":4,"wal-append.queue_time_us":68718,"wal-append.run_cpu_time_us":10761,"wal-append.run_wall_time_us":1868142}]]}
I20260709 12:59:55.384665  4190 leader_election.cc:290] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:55.414618  3921 raft_consensus.cc:697] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 12:59:55.416968  3632 raft_consensus.cc:2804] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:55.418229  4116 raft_consensus.cc:3055] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:59:55.423192  1478 auto_rebalancer.cc:893] Removing replace marker failed: Replica ddf11fc190dd4b898773379c6b129d90 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 12:59:55.391872  4222 raft_consensus.cc:2804] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:55.401058  4194 raft_consensus.cc:493] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:55.424750  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:55.425150  4033 raft_consensus.cc:493] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:55.425549  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:55.426221  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:55.428040  2221 raft_consensus.cc:1240] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:55.429468  4120 raft_consensus.cc:493] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:55.412750  2219 raft_consensus.cc:1275] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:59:55.433504  1497 leader_election.cc:304] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:55.436491  1675 raft_consensus.cc:1275] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 12:59:55.478737  1675 pending_rounds.cc:85] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90: Aborting all ops after (but not including) 4
I20260709 12:59:55.429005  1496 leader_election.cc:304] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:55.439214  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 12:59:55.439666  4175 raft_consensus.cc:3055] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:55.478892  4222 raft_consensus.cc:697] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
W20260709 12:59:55.480628  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:55.481324  2224 raft_consensus.cc:2393] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 6: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 12:59:55.480129  3921 consensus_queue.cc:237] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:55.481120  4222 consensus_queue.cc:237] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:55.480172  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 12:59:55.482928  4032 raft_consensus.cc:493] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:55.483754  3934 raft_consensus.cc:2749] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:55.436426  4105 consensus_queue.cc:1059] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 12:59:55.447180  1430 catalog_manager.cc:5697] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } }
I20260709 12:59:55.435623  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 12:59:55.437460  3935 consensus_queue.cc:237] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:55.456162  1529 raft_consensus.cc:515] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:55.455083  4220 raft_consensus.cc:493] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:55.457759  3888 raft_consensus.cc:515] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 12:59:55.478134  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:55.479264  1675 pending_rounds.cc:107] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90: Aborting uncommitted NO_OP operation due to leader change: 6.5
W20260709 12:59:55.483969  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 50593.4us
I20260709 12:59:55.454531  1679 raft_consensus.cc:2468] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 7.
W20260709 12:59:55.442956  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:55.486289  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 57397.6us
I20260709 12:59:55.483511  4032 raft_consensus.cc:515] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:55.457193  4116 raft_consensus.cc:740] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
W20260709 12:59:55.455725  1478 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
I20260709 12:59:55.464828  1598 raft_consensus.cc:2393] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 7: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 12:59:55.487092  4033 raft_consensus.cc:515] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 12:59:55.497062  4208 log.cc:927] Time spent T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.283s	user 0.004s	sys 0.000s
I20260709 12:59:55.527796  2218 raft_consensus.cc:2410] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:59:55.480274  4175 raft_consensus.cc:740] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:55.538095  2224 raft_consensus.cc:1240] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:59:55.490825  4221 raft_consensus.cc:2804] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:55.527937  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:55.529240  1675 raft_consensus.cc:2889] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:55.465041  3632 raft_consensus.cc:697] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 12:59:55.532953  1571 leader_election.cc:304] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:55.533420  4116 consensus_queue.cc:260] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:55.486022  4194 raft_consensus.cc:515] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 12:59:55.531519  1478 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 12:59:55.543738  1497 leader_election.cc:304] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:55.541483  1646 leader_election.cc:304] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:55.549631  1529 leader_election.cc:290] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:55.496347  4120 raft_consensus.cc:515] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:55.540480  4221 raft_consensus.cc:493] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:55.553431  4221 raft_consensus.cc:3060] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:55.553642  1646 leader_election.cc:304] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:55.554937  1646 leader_election.cc:304] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:55.555720  3878 raft_consensus.cc:2804] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:55.555974  1646 leader_election.cc:304] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:55.556411  3878 raft_consensus.cc:697] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 7 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:55.557600  4124 raft_consensus.cc:2804] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:55.557394  3878 consensus_queue.cc:237] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:55.557994  4124 raft_consensus.cc:493] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:55.558395  4032 leader_election.cc:290] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:55.558370  4124 raft_consensus.cc:3060] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:55.558563  3977 raft_consensus.cc:2804] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:55.559990  4175 consensus_queue.cc:260] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:55.560720  3977 raft_consensus.cc:493] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:55.561096  4175 raft_consensus.cc:3060] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:55.561152  3977 raft_consensus.cc:3060] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:55.530228  4220 raft_consensus.cc:515] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:55.594142  2226 raft_consensus.cc:1240] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 12:59:55.571812  2227 raft_consensus.cc:2468] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 5.
I20260709 12:59:55.598192  3977 raft_consensus.cc:515] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:55.646836  3876 raft_consensus.cc:2804] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:55.648391  4124 raft_consensus.cc:515] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:55.651197  1679 raft_consensus.cc:1240] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:55.563679  4190 raft_consensus.cc:2804] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:55.651326  3977 leader_election.cc:290] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
W20260709 12:59:55.654480  2192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:55.654043  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:55.528885  4192 consensus_queue.cc:237] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:55.651551  4124 leader_election.cc:290] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:55.662277  1526 raft_consensus.cc:1240] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 4. Current term is 6. Ops: []
I20260709 12:59:55.571485  3934 raft_consensus.cc:2804] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:59:55.664959  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:55.666610  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:55.653177  4190 raft_consensus.cc:697] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 7 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:55.658277  4116 raft_consensus.cc:3060] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:55.707237  3977 raft_consensus.cc:493] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:55.702214  1571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:55.702978  3632 consensus_queue.cc:237] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 12:59:55.698067  4244 log.cc:927] Time spent T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.159s	user 0.000s	sys 0.000s
I20260709 12:59:55.653275  4017 raft_consensus.cc:3055] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:55.642937  1430 catalog_manager.cc:5697] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 1 to 5, leader changed from ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) to 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194). New cstate: current_term: 5 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:55.615892  4007 consensus_queue.cc:1048] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.083s
I20260709 12:59:55.718576  1530 raft_consensus.cc:3060] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:55.713037  3977 raft_consensus.cc:515] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 12:59:55.723284  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:55.716017  4017 raft_consensus.cc:740] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 12:59:55.737181  2226 raft_consensus.cc:1240] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 7 LEADER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 6. Current term is 7. Ops: []
W20260709 12:59:55.744060  1570 leader_election.cc:336] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 3.720s (SENT)
I20260709 12:59:55.708022  3934 raft_consensus.cc:493] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:55.756049  1570 leader_election.cc:304] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:55.767696  3977 leader_election.cc:290] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:55.769577  2222 raft_consensus.cc:2468] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 6.
I20260709 12:59:55.770889  2223 raft_consensus.cc:1217] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 4 LEADER]: Deduplicated request from leader. Original: 2.5->[3.6-3.6]   Dedup: 3.6->[]
I20260709 12:59:55.771477  2223 raft_consensus.cc:1240] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 4 LEADER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:59:55.757668  4033 leader_election.cc:290] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:55.780723  4086 raft_consensus.cc:3060] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:55.780448  4017 consensus_queue.cc:260] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:55.781903  4017 raft_consensus.cc:3060] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:55.800172  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:55.759984  3934 raft_consensus.cc:3060] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:55.770395  4116 raft_consensus.cc:493] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:55.801626  1430 catalog_manager.cc:5697] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:55.754914  3888 leader_election.cc:290] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 6 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:55.758695  4220 leader_election.cc:290] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:55.808604  4032 consensus_queue.cc:1059] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:59:55.809588  4032 raft_consensus.cc:3055] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:55.809939  4032 raft_consensus.cc:740] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:55.810889  4032 consensus_queue.cc:260] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:55.811895  1430 catalog_manager.cc:5697] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } }
I20260709 12:59:55.812543  4032 raft_consensus.cc:3060] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:59:55.812937  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:55.813316  1430 catalog_manager.cc:5697] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 2 to 4, leader changed from b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) to 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194). New cstate: current_term: 4 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:55.815070  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36200 (request call id 1884) took 1815 ms. Trace:
I20260709 12:59:55.815470  1602 rpcz_store.cc:276] 0709 12:59:53.999408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.999599 (+   191us) service_pool.cc:224] Handling call
0709 12:59:53.999930 (+   331us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:59:54.007084 (+  7154us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:54.007113 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:59:54.012438 (+  5325us) log.cc:844] Serialized 52 byte log entry
0709 12:59:54.412339 (+399901us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:54.465907 (+ 53568us) log.cc:844] Serialized 14 byte log entry
0709 12:59:54.493620 (+ 27713us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:54.493693 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:54.630569 (+136876us) spinlock_profiling.cc:243] Waited 1.06 ms on lock 0x7b48001e0258. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1d4dcaa1 00007f6a1d4d3b37 00007f6a1d4d39ca 00007f6a1d5cb26f 00007f6a1d5caf37 00007f6a1d5df55c 00007f6a1d5df508 00007f6a1d5df488 00007f6a1d5df443 00007f6a1d5de6ec 00007f6a1c508a96
0709 12:59:55.176463 (+545894us) spinlock_profiling.cc:243] Waited 4.53 ms on lock 0x7b1800069940. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1e38ede1 00007f6a1e39b5b1 00007f6a154c63f3 00007f6a154c87c1 00007f6a154c8779 00007f6a154c8709 00007f6a154c86d1 00007f6a154c79cd 000000000038f354 000000000038f199 00007f6a154a983a
0709 12:59:55.446111 (+269648us) spinlock_profiling.cc:243] Waited 6.74 ms on lock 0x7b4400022b4c. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a153ecc85 00007f6a153ed6a2 00007f6a1815f1db 00007f6a1815aaaf 00007f6a1814e86e 00007f6a1814dbb6 00007f6a1814d7d8 00007f6a18157221 00007f6a181571d9 00007f6a18157169
0709 12:59:55.803118 (+357007us) raft_consensus.cc:1685] finished
0709 12:59:55.803145 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:55.814904 (+ 11759us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6545,"prepare.queue_time_us":53298,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":3033,"raft.queue_time_us":37048,"raft.run_cpu_time_us":2437,"raft.run_wall_time_us":631864,"spinlock_wait_cycles":28361984,"thread_start_us":387218,"threads_started":1,"wal-append.queue_time_us":483149}
I20260709 12:59:55.799562  4194 leader_election.cc:290] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 12:59:55.823647  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 283662us
I20260709 12:59:55.821022  1530 raft_consensus.cc:2468] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 4.
I20260709 12:59:55.826092  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 12:59:55.805544  4120 leader_election.cc:290] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:55.824723  1430 catalog_manager.cc:5697] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 2 to 4, leader changed from 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) to b96ce9cc496c49d7818fa983a17b062b (127.0.107.196). New cstate: current_term: 4 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:55.820962  4220 raft_consensus.cc:493] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:55.840834  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 297600us
I20260709 12:59:55.761847  4190 consensus_queue.cc:237] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:55.838614  1646 leader_election.cc:304] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:55.843516  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:55.844177  3878 consensus_queue.cc:1048] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 12:59:55.858152  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 12:59:55.859324  4241 log.cc:927] Time spent T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 12:59:55.859200  1430 catalog_manager.cc:5697] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 4 to 5, leader changed from e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) to 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194). New cstate: current_term: 5 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } }
W20260709 12:59:55.861554  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:55.864800  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:55.868649  3901 raft_consensus.cc:2749] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:55.868785  4205 leader_election.cc:290] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 12:59:55.870710  4250 log.cc:927] Time spent T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 12:59:55.851656  4120 raft_consensus.cc:2804] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:55.833993  4116 raft_consensus.cc:515] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:55.843535  4220 raft_consensus.cc:515] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 12:59:55.885536  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:55.892182  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 12:59:55.886045  1430 catalog_manager.cc:5697] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } }
W20260709 12:59:55.895262  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 348243us
I20260709 12:59:55.896144  1496 leader_election.cc:304] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:55.937032  1497 leader_election.cc:304] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
W20260709 12:59:55.939908  1496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:55.940442  1496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:55.940755  1496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:55.944672  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 138212us
I20260709 12:59:55.929013  4120 raft_consensus.cc:697] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 5 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:55.955237  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:55.962819  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:55.938967  3921 raft_consensus.cc:2804] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:55.966490  1672 raft_consensus.cc:2393] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 7: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 12:59:55.966558  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:55.984908  1430 catalog_manager.cc:5697] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 3 to 4, leader changed from 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 4 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } }
W20260709 12:59:55.950168  3640 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.006s	sys 0.015s
W20260709 12:59:55.993217  1525 consensus_meta.cc:287] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent flushing consensus metadata: real 0.591s	user 0.009s	sys 0.001s
I20260709 12:59:55.993892  1525 raft_consensus.cc:2468] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 4.
I20260709 12:59:55.998329  1430 catalog_manager.cc:5697] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 2 to 3, leader changed from 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } }
W20260709 12:59:55.994987  3640 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.007s	sys 0.016s
I20260709 12:59:56.021721  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:56.023185  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 12:59:56.026307  2192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:55.967025  3921 raft_consensus.cc:493] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:56.007536  4254 raft_consensus.cc:493] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:56.007287  4242 log.cc:927] Time spent T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.213s	user 0.000s	sys 0.001s
W20260709 12:59:55.971836  2220 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50326 (request call id 628) took 2632 ms (client timeout 1673 ms). Trace:
I20260709 12:59:56.011675  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:55.984344  4222 raft_consensus.cc:2749] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:56.010447  3876 raft_consensus.cc:493] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:56.035037  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:56.044132  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:56.037246  1430 catalog_manager.cc:5697] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 3 to 5, leader changed from 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 5 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:56.038980  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 12:59:56.008351  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 77048.3us
I20260709 12:59:56.046612  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:56.046962  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:56.047640  1678 raft_consensus.cc:2468] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 5.
I20260709 12:59:56.036578  3921 raft_consensus.cc:3060] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:56.047288  3876 raft_consensus.cc:3060] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:56.060067  4120 consensus_queue.cc:237] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:56.062958  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:56.063761  1601 raft_consensus.cc:2468] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 4.
I20260709 12:59:56.063443  1430 catalog_manager.cc:5697] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 1 to 5, leader changed from e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) to b96ce9cc496c49d7818fa983a17b062b (127.0.107.196). New cstate: current_term: 5 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 12:59:56.065002  1430 catalog_manager.cc:5697] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 2 to 3, leader changed from b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
W20260709 12:59:56.070031  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 253804us
W20260709 12:59:56.073380  2192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:56.075217  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 12:59:56.042140  2220 rpcz_store.cc:269] 0709 12:59:53.312814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.312982 (+   168us) service_pool.cc:224] Handling call
0709 12:59:55.892402 (+2579420us) spinlock_profiling.cc:243] Waited 1.95 s on lock 0x7b540045d3d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 12:59:55.945012 (+ 52610us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4493947264}
W20260709 12:59:56.076174  1570 leader_election.cc:336] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.823s (SENT)
I20260709 12:59:56.078841  1570 leader_election.cc:304] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:56.071538  1604 raft_consensus.cc:2468] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 7.
I20260709 12:59:56.066332  1430 catalog_manager.cc:5697] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 4 to 5, leader changed from ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) to 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194). New cstate: current_term: 5 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:59:56.081941  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 152201us
I20260709 12:59:56.103376  2226 raft_consensus.cc:2468] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 5.
W20260709 12:59:56.077250  4243 log.cc:927] Time spent T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.538s	user 0.001s	sys 0.003s
W20260709 12:59:56.076503  4253 log.cc:927] Time spent T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
W20260709 12:59:56.144484  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 64262us
W20260709 12:59:56.079703  4229 log.cc:927] Time spent T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.815s	user 0.003s	sys 0.000s
I20260709 12:59:56.041841  4254 raft_consensus.cc:515] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:56.189451  1572 leader_election.cc:304] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
W20260709 12:59:56.189942  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 226431us
W20260709 12:59:56.193064  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:56.166410  4175 raft_consensus.cc:493] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:56.168093  4032 raft_consensus.cc:493] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
W20260709 12:59:56.212904  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 144346us
W20260709 12:59:56.216065  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 136866us
W20260709 12:59:56.218222  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:56.226552  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49310 (request call id 509) took 1072 ms. Trace:
I20260709 12:59:56.227072  1526 rpcz_store.cc:276] 0709 12:59:55.154087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:55.397721 (+243634us) service_pool.cc:224] Handling call
0709 12:59:55.415649 (+ 17928us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:55.666518 (+250869us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:56.222494 (+555976us) spinlock_profiling.cc:243] Waited 78.4 ms on lock 0x7b54000e9f54. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 12:59:56.226477 (+  3983us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":180406656}
I20260709 12:59:56.231123  1572 leader_election.cc:304] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:56.228065   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:56.238358  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:56.240562  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:56.241246  1604 raft_consensus.cc:3060] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:56.221594  3970 raft_consensus.cc:2749] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:59:56.243657  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:56.247876  2191 leader_election.cc:304] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:56.209712  4191 consensus_queue.cc:1048] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 12:59:56.245930  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:56.252364  1675 raft_consensus.cc:2410] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 12:59:56.252673  1571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:56.253255  2191 leader_election.cc:304] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:56.253785  2224 raft_consensus.cc:2410] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:59:56.267903  1525 raft_consensus.cc:1275] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:56.270349  1678 raft_consensus.cc:1275] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:59:56.268112  2191 leader_election.cc:304] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
W20260709 12:59:56.274801  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:56.269400  1570 leader_election.cc:336] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.864s (SENT)
I20260709 12:59:56.275756  1570 leader_election.cc:304] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:56.243381  4190 raft_consensus.cc:2804] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:56.255695  4043 raft_consensus.cc:2749] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:59:56.269672  4221 consensus_meta.cc:287] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent flushing consensus metadata: real 0.704s	user 0.010s	sys 0.002s
I20260709 12:59:56.255631  3640 raft_consensus.cc:2749] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:56.230096  4175 raft_consensus.cc:515] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:56.292382  4265 raft_consensus.cc:493] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:56.294001  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 12:59:56.295130  4262 log.cc:927] Time spent T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
W20260709 12:59:56.295975  4261 log.cc:927] Time spent T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:59:56.316037  3878 raft_consensus.cc:493] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:56.316587  3878 raft_consensus.cc:515] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:56.317982  1526 pending_rounds.cc:85] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting all ops after (but not including) 7
I20260709 12:59:56.318324  1526 pending_rounds.cc:107] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 12:59:56.318554  1526 raft_consensus.cc:2889] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:56.318885  3921 raft_consensus.cc:515] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 12:59:56.319463  4268 log.cc:927] Time spent T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 12:59:56.280987  4264 raft_consensus.cc:2749] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:56.236696  4032 raft_consensus.cc:515] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:56.281999  4190 raft_consensus.cc:493] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:56.292510  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:56.295970  4220 leader_election.cc:290] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 12:59:56.313329  4259 log.cc:927] Time spent T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 12:59:56.298130  1572 leader_election.cc:304] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
W20260709 12:59:56.310426  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 69472.6us
W20260709 12:59:56.330437  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 85845.6us
I20260709 12:59:56.297763  4144 raft_consensus.cc:2804] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:56.341001  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:56.341741  1525 raft_consensus.cc:3060] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:56.276888  3876 raft_consensus.cc:515] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:56.344108  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:56.345571  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:56.320184  4194 raft_consensus.cc:493] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:56.299281  4221 raft_consensus.cc:515] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:56.346134  2224 raft_consensus.cc:2468] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 7.
I20260709 12:59:56.351634  1529 raft_consensus.cc:2393] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 6: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 12:59:56.322759  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
W20260709 12:59:56.353755  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 56561.5us
I20260709 12:59:56.334292  4190 raft_consensus.cc:3060] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:59:56.358331  4267 log.cc:927] Time spent T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 12:59:56.361907  4175 leader_election.cc:290] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:56.361691  4264 consensus_queue.cc:1048] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:56.364034  1679 raft_consensus.cc:1240] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:56.366132  4269 raft_consensus.cc:493] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:56.366335  4254 leader_election.cc:290] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:56.342756  4144 raft_consensus.cc:493] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:56.367653  1570 leader_election.cc:336] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.981s (SENT)
I20260709 12:59:56.319895  4265 raft_consensus.cc:515] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:56.365459  2192 leader_election.cc:304] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:56.366629  1601 raft_consensus.cc:3060] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:59:56.336520  3640 consensus_queue.cc:1048] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:59:56.405419  3640 consensus_queue.cc:1243] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer ddf11fc190dd4b898773379c6b129d90 log is divergent from this leader: its last log entry 4.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260709 12:59:56.409863  3934 consensus_meta.cc:287] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent flushing consensus metadata: real 0.592s	user 0.007s	sys 0.002s
I20260709 12:59:56.411141  4190 raft_consensus.cc:515] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:56.412405  1598 raft_consensus.cc:2468] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 5.
I20260709 12:59:56.412674  1672 raft_consensus.cc:1275] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:59:56.413357  4221 leader_election.cc:290] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:56.414613  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:56.420727  4221 consensus_queue.cc:1048] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:56.392113  3878 leader_election.cc:290] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:56.422431  4269 raft_consensus.cc:515] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:56.423671  3921 leader_election.cc:290] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:56.424098  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:56.391042  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:56.356734  4194 raft_consensus.cc:515] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 12:59:56.428938  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:56.388664  1673 raft_consensus.cc:1275] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:59:56.435547  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:56.436360  1529 raft_consensus.cc:2468] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 6.
I20260709 12:59:56.438434  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:56.439128  1528 raft_consensus.cc:3060] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:56.440320  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:56.435618  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
W20260709 12:59:56.447556  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:56.452117  1604 raft_consensus.cc:2468] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 7.
I20260709 12:59:56.389578  1525 raft_consensus.cc:2468] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 7.
I20260709 12:59:56.390501  2192 leader_election.cc:304] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:56.362515  4175 raft_consensus.cc:2804] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:56.392870  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:56.398756  4043 raft_consensus.cc:2749] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:59:56.380554  4144 raft_consensus.cc:3060] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:56.399662  4120 raft_consensus.cc:493] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:56.400332  4265 leader_election.cc:290] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:56.410322  3934 raft_consensus.cc:515] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:56.477834  1601 raft_consensus.cc:2468] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 6.
I20260709 12:59:56.478602  3934 leader_election.cc:290] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 12:59:56.479925  4275 log.cc:927] Time spent T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.072s	user 0.001s	sys 0.001s
W20260709 12:59:56.481055  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:56.449152  1528 raft_consensus.cc:2468] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 7.
I20260709 12:59:56.459635  4205 raft_consensus.cc:2804] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:56.460208  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:56.460078  4221 consensus_queue.cc:1048] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:56.457692  4192 raft_consensus.cc:2749] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:59:56.460978  1680 raft_consensus.cc:1275] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 12:59:56.462180  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 71758.3us
I20260709 12:59:56.464649  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:56.483352  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:56.390195  1570 leader_election.cc:304] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:56.490285  1532 raft_consensus.cc:2393] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 6: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 12:59:56.446818  4190 leader_election.cc:290] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 12:59:56.463763  4276 log.cc:927] Time spent T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.091s	user 0.005s	sys 0.000s
W20260709 12:59:56.526129  1496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:56.547873  1496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:56.549018  1496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:56.490128  4205 raft_consensus.cc:493] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:56.551843  4205 raft_consensus.cc:3060] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:56.490202  4120 raft_consensus.cc:515] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:56.553925  1675 pending_rounds.cc:85] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90: Aborting all ops after (but not including) 4
I20260709 12:59:56.554253  4194 leader_election.cc:290] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:56.497607  4175 raft_consensus.cc:697] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 6 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:56.555336  4175 consensus_queue.cc:237] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:56.556595  4221 raft_consensus.cc:493] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:56.557188  4221 raft_consensus.cc:515] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:56.564195  4205 raft_consensus.cc:515] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:56.554265  1675 pending_rounds.cc:107] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90: Aborting uncommitted NO_OP operation due to leader change: 4.5
I20260709 12:59:56.594921  1675 raft_consensus.cc:2889] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:56.522145  4043 raft_consensus.cc:493] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:56.549017  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 250983us
I20260709 12:59:56.596755  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:56.570065  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:56.596275  1572 leader_election.cc:304] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:56.573280  1676 raft_consensus.cc:2468] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 6.
I20260709 12:59:56.601804  1496 leader_election.cc:304] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:56.580484  1677 raft_consensus.cc:2468] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 4.
I20260709 12:59:56.582628  4116 leader_election.cc:290] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 12:59:56.585631  4277 log.cc:927] Time spent T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.174s	user 0.008s	sys 0.003s
I20260709 12:59:56.586835  3876 leader_election.cc:290] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:56.587742  1529 raft_consensus.cc:1275] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:59:56.589900  4144 raft_consensus.cc:515] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:56.594007  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:56.603911  1496 leader_election.cc:304] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:56.604859  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 12:59:56.523250  2192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:56.633551  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
W20260709 12:59:56.609954  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 276103us
I20260709 12:59:56.634456  2226 raft_consensus.cc:3055] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:56.634742  2226 raft_consensus.cc:740] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
W20260709 12:59:56.622735  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:56.635319  2223 raft_consensus.cc:2393] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 6: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 12:59:56.555282  4289 raft_consensus.cc:2749] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:56.605664  4190 consensus_queue.cc:1059] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.090s
I20260709 12:59:56.657648  2227 raft_consensus.cc:1275] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 6 LEARNER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:59:56.923355  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 83080.3us
I20260709 12:59:56.605852  4043 raft_consensus.cc:515] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:56.606571  4194 consensus_queue.cc:1048] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.319s
I20260709 12:59:56.926581  2224 raft_consensus.cc:2468] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 5.
I20260709 12:59:56.688755  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
W20260709 12:59:56.725911  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 129731us
I20260709 12:59:56.605822  3934 raft_consensus.cc:2804] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:56.929873  1676 raft_consensus.cc:2393] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 5: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 12:59:56.690829  2226 consensus_queue.cc:260] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:56.833840  4144 leader_election.cc:290] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 6 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:56.932091  2226 raft_consensus.cc:3060] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:59:56.932394  1646 leader_election.cc:304] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
W20260709 12:59:56.782143  1571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:56.686010  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 328726us
I20260709 12:59:56.933375  3876 raft_consensus.cc:2804] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:56.933768  3876 raft_consensus.cc:493] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:56.934111  3876 raft_consensus.cc:3060] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:56.934593  1646 leader_election.cc:304] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:56.935493  4284 raft_consensus.cc:2804] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:56.936111  4284 raft_consensus.cc:697] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 7 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:56.935801  4043 leader_election.cc:290] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:56.936924  1646 leader_election.cc:304] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:56.937060  4284 consensus_queue.cc:237] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:56.937907  4282 raft_consensus.cc:2804] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:56.938529  4282 raft_consensus.cc:697] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 6 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 12:59:56.939756  4282 consensus_queue.cc:237] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:56.688325  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 12:59:56.935304  1570 leader_election.cc:336] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 2.032s (SENT)
I20260709 12:59:56.946072  2226 raft_consensus.cc:2468] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 6.
I20260709 12:59:56.944839  1677 raft_consensus.cc:2468] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 4.
W20260709 12:59:56.743883  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:56.724833  4289 raft_consensus.cc:493] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:56.950721  4289 raft_consensus.cc:515] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:56.947115  1570 leader_election.cc:304] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:56.953511  1676 raft_consensus.cc:1275] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:59:56.954461  2223 raft_consensus.cc:1275] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:59:56.967865  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:56.969345  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 46390.6us
I20260709 12:59:56.781876  2221 raft_consensus.cc:2393] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 6: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
W20260709 12:59:56.984975  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 49790.5us
W20260709 12:59:56.986202  1570 leader_election.cc:336] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 2.158s (SENT)
I20260709 12:59:56.987130  4175 raft_consensus.cc:2749] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:56.987927  4175 raft_consensus.cc:493] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:56.988391  4175 raft_consensus.cc:515] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:56.751992  4290 raft_consensus.cc:493] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:56.990127  4290 raft_consensus.cc:515] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:56.644384  4116 raft_consensus.cc:2804] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:56.986610  1570 leader_election.cc:304] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 12:59:56.993216  1496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:56.991950  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:56.998174  1571 leader_election.cc:304] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:56.685503  4222 raft_consensus.cc:493] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:56.724988  4033 raft_consensus.cc:493] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:56.656203  4265 raft_consensus.cc:2749] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:56.751904  4221 leader_election.cc:290] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:56.739874  3970 raft_consensus.cc:493] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:56.785933  2219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 648) took 1211 ms. Trace:
W20260709 12:59:57.015633  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:57.033776  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 47643.4us
W20260709 12:59:57.029970  1496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:56.738847  4108 consensus_queue.cc:1059] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.271s
I20260709 12:59:56.979148  3901 raft_consensus.cc:493] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:57.017261  4190 raft_consensus.cc:493] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:57.034708  4116 raft_consensus.cc:697] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 12:59:57.018894  4175 leader_election.cc:290] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:57.045991  4265 raft_consensus.cc:2749] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:57.050308  4205 leader_election.cc:290] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 8 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:57.050550  4221 raft_consensus.cc:493] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:57.016292  4033 raft_consensus.cc:515] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:57.055801  4108 raft_consensus.cc:2804] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:57.083674  4190 raft_consensus.cc:515] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:57.088913  4293 raft_consensus.cc:3055] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:57.089785  3876 raft_consensus.cc:515] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:57.080518  4175 consensus_queue.cc:1048] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 12:59:57.019037  4222 raft_consensus.cc:515] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:57.092411  4032 leader_election.cc:290] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:57.063702  4220 raft_consensus.cc:493] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:57.049829  4289 leader_election.cc:290] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:57.036626  2219 rpcz_store.cc:276] 0709 12:59:55.546270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:55.552882 (+  6612us) service_pool.cc:224] Handling call
0709 12:59:55.625155 (+ 72273us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:55.725797 (+100642us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:55.727987 (+  2190us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:55.768368 (+ 40381us) log.cc:844] Serialized 26 byte log entry
0709 12:59:56.007220 (+238852us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:59:56.292080 (+284860us) log.cc:844] Serialized 14 byte log entry
0709 12:59:56.567913 (+275833us) spinlock_profiling.cc:243] Waited 7.96 ms on lock 0x7b180003e140. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1e38ede1 00007f6a1e39b5b1 00007f6a154c63f3 00007f6a154c87c1 00007f6a154c8779 00007f6a154c8709 00007f6a154c86d1 00007f6a154c79cd 000000000038f354 000000000038f199 00007f6a154a983a
0709 12:59:56.656499 (+ 88586us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:56.686159 (+ 29660us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:56.689760 (+  3601us) raft_consensus.cc:1685] finished
0709 12:59:56.724856 (+ 35096us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:56.751229 (+ 26373us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5352,"prepare.queue_time_us":344266,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":52,"raft.queue_time_us":61248,"raft.run_cpu_time_us":283,"raft.run_wall_time_us":13652,"spinlock_wait_cycles":18297600,"thread_start_us":800153,"threads_started":3,"wal-append.queue_time_us":378978}
I20260709 12:59:57.057677  3901 raft_consensus.cc:515] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:57.094599  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:57.098011  4192 raft_consensus.cc:493] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:57.099691  4290 leader_election.cc:290] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 12:59:57.101557  2191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:57.126910  4265 raft_consensus.cc:493] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:57.105661  3921 raft_consensus.cc:493] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
W20260709 12:59:57.106179  4287 log.cc:927] Time spent T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.685s	user 0.003s	sys 0.000s
I20260709 12:59:57.108608  4264 raft_consensus.cc:493] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:57.062569  4194 raft_consensus.cc:493] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:57.055533  3970 raft_consensus.cc:515] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:57.115345  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:57.124775  4108 raft_consensus.cc:493] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:57.130942  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:57.128803  4220 raft_consensus.cc:515] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:57.105418  4296 raft_consensus.cc:3055] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:57.126427  4293 raft_consensus.cc:740] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:57.139282  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:57.141330  4314 raft_consensus.cc:493] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:57.154013  4108 raft_consensus.cc:3060] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:57.156704  2225 raft_consensus.cc:2468] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 5.
I20260709 12:59:57.159577  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 12:59:57.179572  4314 raft_consensus.cc:515] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:57.180416  3876 leader_election.cc:290] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:57.133376  4221 raft_consensus.cc:515] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:57.210386  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:57.180774  3970 leader_election.cc:290] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:57.211146  1677 raft_consensus.cc:2468] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 5.
I20260709 12:59:57.213121  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
W20260709 12:59:57.215610  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 205679us
I20260709 12:59:57.229200  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:57.155954  4296 raft_consensus.cc:740] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 12:59:57.143088  4265 raft_consensus.cc:515] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:57.238750  4033 leader_election.cc:290] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:57.234055  4205 raft_consensus.cc:493] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 12:59:57.142493  4192 raft_consensus.cc:515] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:57.143996  3921 raft_consensus.cc:515] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:57.153064  4194 raft_consensus.cc:515] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:57.243072  1674 raft_consensus.cc:2393] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 6: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 12:59:57.241067  1679 raft_consensus.cc:3060] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:59:57.151602  4264 raft_consensus.cc:515] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 12:59:57.246943  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 206793us
I20260709 12:59:57.187114  4269 leader_election.cc:290] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:57.228863  4120 leader_election.cc:290] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:57.143980  4116 consensus_queue.cc:237] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:57.230625  3934 raft_consensus.cc:697] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 12:59:57.241360  4043 raft_consensus.cc:493] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:57.269263  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:57.246574  3876 raft_consensus.cc:493] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:57.277915  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 230367us
I20260709 12:59:57.271059  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:57.257037  4309 raft_consensus.cc:493] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:57.250990  1497 connection.cc:256] RPC call timeout handler was delayed by -1.276438660999986s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15400000000000003s for a response
W20260709 12:59:57.283324  1497 connection.cc:256] RPC call timeout handler was delayed by -1.2251386610000168s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1597s for a response
W20260709 12:59:57.305442  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:57.278689  4222 leader_election.cc:290] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:57.278127  3935 raft_consensus.cc:493] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:57.257733  4205 raft_consensus.cc:515] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:57.365255  3935 raft_consensus.cc:515] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:57.356190  4282 raft_consensus.cc:1064] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90: attempting to promote NON_VOTER b96ce9cc496c49d7818fa983a17b062b to VOTER
I20260709 12:59:57.365881  4190 leader_election.cc:290] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:57.282423  3876 raft_consensus.cc:515] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:57.286571  4105 consensus_queue.cc:1048] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.080s
W20260709 12:59:57.388675  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 101507us
I20260709 12:59:57.370675  4120 raft_consensus.cc:493] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:57.280550  4043 raft_consensus.cc:515] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:57.270458  4293 consensus_queue.cc:260] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:57.373098  3977 raft_consensus.cc:493] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:57.377168  3934 consensus_queue.cc:237] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:57.378252  4323 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:57.378875  3876 leader_election.cc:290] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:57.380929  4205 leader_election.cc:290] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:57.384595  1497 leader_election.cc:304] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:57.388084  3935 leader_election.cc:290] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 12:59:57.365820  4307 log.cc:927] Time spent T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
I20260709 12:59:57.293938  4296 consensus_queue.cc:260] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:57.298622  4309 raft_consensus.cc:515] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 12:59:57.390473  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 101949us
I20260709 12:59:57.362241  4222 raft_consensus.cc:493] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:57.373064  4311 raft_consensus.cc:493] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
W20260709 12:59:57.514849  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:57.581637  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:57.552189  1604 raft_consensus.cc:1275] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:59:57.394444  1679 raft_consensus.cc:2468] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 8.
W20260709 12:59:57.514266  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 370923us
I20260709 12:59:57.604423  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:57.605247  1603 raft_consensus.cc:2468] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 3.
I20260709 12:59:57.608006  1599 raft_consensus.cc:1275] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:59:57.613278  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 12:59:57.614259  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 12:59:57.631193  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 238920us
I20260709 12:59:57.615090  2223 raft_consensus.cc:2468] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 4.
W20260709 12:59:57.410722  4317 log.cc:927] Time spent T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 12:59:57.642089  2191 leader_election.cc:304] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:57.444197  4298 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 12:59:57.648496  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:57.554353  4221 leader_election.cc:290] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:57.579962  4284 raft_consensus.cc:493] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:57.551388  4325 raft_consensus.cc:493] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:57.471048  4220 leader_election.cc:290] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:57.443964  3970 raft_consensus.cc:493] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:57.449285  4105 raft_consensus.cc:493] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:57.665704  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 281183us
I20260709 12:59:57.644732  4265 leader_election.cc:290] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:57.679028  2226 raft_consensus.cc:1275] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:59:57.607641  4124 raft_consensus.cc:493] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:57.723524  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 12:59:57.664852  4304 log.cc:927] Time spent T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 12:59:57.666612  3935 raft_consensus.cc:2804] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:57.728019  4105 raft_consensus.cc:515] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 12:59:57.728729  4316 log.cc:927] Time spent T 00000000000000000000000000000000 P 9f38d0e5c9db43a48554defe1153354e: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
W20260709 12:59:57.729513  4319 log.cc:927] Time spent T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
I20260709 12:59:57.729710  1497 leader_election.cc:304] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:57.394690  4120 raft_consensus.cc:515] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:57.412741  3977 raft_consensus.cc:515] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:57.664580  2218 raft_consensus.cc:1275] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:59:57.665450  4192 leader_election.cc:290] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:57.665251  4194 leader_election.cc:290] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:57.634902  4222 raft_consensus.cc:515] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:57.642959  4311 raft_consensus.cc:515] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:57.606916  4323 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:57.730423  4322 raft_consensus.cc:2749] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:58.077195  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:58.080528  1607 raft_consensus.cc:3060] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:57.850730  1598 raft_consensus.cc:1275] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:57.731634  4321 raft_consensus.cc:493] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:58.099205  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:58.099043  4321 raft_consensus.cc:515] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:59:58.099550  4105 leader_election.cc:290] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:58.099871  1598 raft_consensus.cc:2468] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 6.
I20260709 12:59:58.101019  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:58.101385  4321 leader_election.cc:290] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:57.722446  4298 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 12:59:58.101603  1598 raft_consensus.cc:3060] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:57.736532  4325 raft_consensus.cc:515] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:57.725394  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:58.102787  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:58.103315  4298 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:58.103571  2220 raft_consensus.cc:2368] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 5. Current term is 6.
I20260709 12:59:57.732197  3970 raft_consensus.cc:515] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:57.725793  4324 raft_consensus.cc:493] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:58.104197  4324 raft_consensus.cc:515] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:58.105362  3970 leader_election.cc:290] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:58.078047  4264 leader_election.cc:290] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:58.079453  3935 raft_consensus.cc:493] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:58.106252  4324 leader_election.cc:290] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:57.774259  4290 raft_consensus.cc:493] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:58.106995  4290 raft_consensus.cc:515] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:58.109086  4290 leader_election.cc:290] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:58.109694  4325 leader_election.cc:290] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:57.784857  4124 raft_consensus.cc:515] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:58.110771  3935 raft_consensus.cc:3060] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:58.111516  4124 leader_election.cc:290] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 12:59:58.112880  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 383285us
I20260709 12:59:58.113726  1497 leader_election.cc:304] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:58.110378  1598 raft_consensus.cc:2468] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 8.
I20260709 12:59:58.115067  1497 leader_election.cc:304] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:58.115972  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:58.116906  4322 raft_consensus.cc:2749] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:59:57.855242  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:57.986765  4282 consensus_queue.cc:237] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 3, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:57.735248  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 12:59:58.128527  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:58.067454  4336 raft_consensus.cc:493] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:58.131511  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:58.131958  1600 raft_consensus.cc:1275] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:59:58.133791  1646 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.013s	sys 0.033s
I20260709 12:59:58.130283  4322 raft_consensus.cc:2749] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:58.134930  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 12:59:58.136744  1496 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.013s	sys 0.031s
I20260709 12:59:58.131120  4336 raft_consensus.cc:515] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:58.133836  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:58.120230  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
W20260709 12:59:58.136157  1646 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.013s	sys 0.033s
W20260709 12:59:58.138015  1496 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.013s	sys 0.032s
I20260709 12:59:58.138931  2191 leader_election.cc:304] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
W20260709 12:59:58.138406  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 537431us
W20260709 12:59:58.143587  1496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:58.140024  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:57.983585  4335 raft_consensus.cc:493] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:57.984136  4043 leader_election.cc:290] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:57.982303  4309 leader_election.cc:290] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 12:59:58.146003  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:58.165351  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:58.147390  1572 leader_election.cc:304] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
W20260709 12:59:58.148056  1571 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.618s	user 0.008s	sys 0.020s
I20260709 12:59:58.162009  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 12:59:58.159093  1570 connection.cc:256] RPC call timeout handler was delayed by -1.2118169089999924s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15700000000000003s for a response
I20260709 12:59:58.159554  2192 leader_election.cc:304] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90
W20260709 12:59:58.164664  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:58.166276  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:58.161346  4105 raft_consensus.cc:2804] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:59:58.204783  1644 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 2.049s (SENT) [suppressed 26 similar messages]
I20260709 12:59:58.117273  4321 raft_consensus.cc:2749] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:58.144917  4124 raft_consensus.cc:493] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 12:59:58.206061  4309 raft_consensus.cc:493] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:58.205920  4124 raft_consensus.cc:515] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:58.207821  2223 raft_consensus.cc:2468] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 5.
I20260709 12:59:58.208534  4124 leader_election.cc:290] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:58.209427  3901 leader_election.cc:290] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:58.212649  4124 raft_consensus.cc:493] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 12:59:58.213501  4124 raft_consensus.cc:515] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:58.215849  4124 leader_election.cc:290] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:58.216588  4327 raft_consensus.cc:2804] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:59:58.217170  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 57696.6us
W20260709 12:59:58.197028  1496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:58.122008  3935 raft_consensus.cc:515] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:58.176965  4324 raft_consensus.cc:493] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:58.117566  4265 raft_consensus.cc:493] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:58.205427  1681 raft_consensus.cc:2468] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 6.
W20260709 12:59:58.222319  1570 connection.cc:256] RPC call timeout handler was delayed by -1.1785169089999954s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1607s for a response
W20260709 12:59:58.233846  1570 connection.cc:256] RPC call timeout handler was delayed by -1.1117324140000164s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.28250000000000003s for a response
W20260709 12:59:58.224517  1571 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.695s	user 0.008s	sys 0.033s
W20260709 12:59:58.234892  1571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:58.227468  1496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:58.263681  1607 raft_consensus.cc:2468] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 6.
I20260709 12:59:57.732954  4284 raft_consensus.cc:515] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:58.266551  1529 raft_consensus.cc:1275] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:59:58.224436  1572 leader_election.cc:304] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
W20260709 12:59:58.225940  4108 consensus_meta.cc:287] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 1.015s	user 0.014s	sys 0.000s
I20260709 12:59:58.274047  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:58.274896  1607 raft_consensus.cc:2393] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 7: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 12:59:58.157433  2218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50326 (request call id 652) took 1557 ms. Trace:
I20260709 12:59:58.277088  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:58.277721  1530 raft_consensus.cc:2468] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 4.
I20260709 12:59:58.278102  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:58.280457  1526 raft_consensus.cc:1275] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:59:58.281778  2225 raft_consensus.cc:2393] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 6: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
W20260709 12:59:58.281963  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 54781.4us
I20260709 12:59:58.282219  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:58.282958  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:58.283535  1600 raft_consensus.cc:3060] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:58.221562  4325 raft_consensus.cc:493] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:58.218142  4311 leader_election.cc:290] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:58.268004  2221 raft_consensus.cc:2393] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 6: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
W20260709 12:59:58.290843  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 66484.6us
I20260709 12:59:58.291772  1672 raft_consensus.cc:2468] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 4.
I20260709 12:59:58.287323  1598 raft_consensus.cc:2410] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:59:58.233724  4327 raft_consensus.cc:493] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:58.293107  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:58.295161  1607 raft_consensus.cc:3060] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:58.265974  4298 raft_consensus.cc:2749] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:59:58.276654  4290 raft_consensus.cc:493] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:58.298511  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:58.294385  4343 raft_consensus.cc:2804] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:58.298904  4290 raft_consensus.cc:515] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:58.299552  4343 raft_consensus.cc:493] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:58.299965  4343 raft_consensus.cc:3060] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:58.281569  4105 raft_consensus.cc:697] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 8 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 12:59:58.222836  4288 consensus_queue.cc:1048] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 12:59:58.323158  1607 raft_consensus.cc:2468] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 4.
W20260709 12:59:58.331169  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 48006.2us
W20260709 12:59:58.294818  4317 log.cc:927] Time spent T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
W20260709 12:59:58.349856  1644 leader_election.cc:336] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.653s (SENT)
I20260709 12:59:58.351444  1644 leader_election.cc:304] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:58.268792  4265 raft_consensus.cc:515] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:58.330426  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:58.297255  4327 raft_consensus.cc:3060] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:58.164455  4335 raft_consensus.cc:515] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:58.265221  4324 raft_consensus.cc:515] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:58.409471  1600 raft_consensus.cc:2468] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 5.
I20260709 12:59:58.371454  1526 raft_consensus.cc:2410] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:59:58.206579  4309 raft_consensus.cc:515] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 12:59:58.357539  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 63658.4us
I20260709 12:59:58.410573  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:58.411857  1600 raft_consensus.cc:3060] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:59:58.284839  4108 raft_consensus.cc:515] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:58.413877  1531 raft_consensus.cc:1240] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:58.420282  4264 consensus_queue.cc:1048] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:58.425406  4323 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:58.428489  4284 leader_election.cc:290] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:58.429118  4284 raft_consensus.cc:2749] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:59:58.367302  4120 leader_election.cc:290] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:58.367801  4222 leader_election.cc:290] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:58.367187  4336 leader_election.cc:290] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:58.357944  4124 raft_consensus.cc:493] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 12:59:58.433737  4124 raft_consensus.cc:515] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:58.434983  4105 consensus_queue.cc:237] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:58.435904  4124 leader_election.cc:290] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:58.436345  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:58.437618  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:58.440959  4108 leader_election.cc:290] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 12:59:58.441911  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:58.444288  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:58.444940  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:58.445398  1598 raft_consensus.cc:2368] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 4. Current term is 5.
I20260709 12:59:58.445771  1527 raft_consensus.cc:2468] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 5.
I20260709 12:59:58.293418  4325 raft_consensus.cc:515] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 12:59:58.450953  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 101139us
I20260709 12:59:58.364343  4338 raft_consensus.cc:493] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:58.453070  1605 raft_consensus.cc:2393] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 6: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 12:59:58.454916  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:58.455613  1572 leader_election.cc:400] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 pre-election: Vote denied by peer b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373) with higher term. Message: Invalid argument: T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 5. Current term is 6.
I20260709 12:59:58.455982  1572 leader_election.cc:403] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:59:58.458942  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:58.463183  1600 raft_consensus.cc:2468] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 6.
I20260709 12:59:58.469100  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:58.471318  1600 raft_consensus.cc:2393] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 7: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 12:59:58.466414  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:58.437634  4309 leader_election.cc:290] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 12:59:58.485982  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:58.505985  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:58.277376  2218 rpcz_store.cc:276] 0709 12:59:56.588552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:56.609078 (+ 20526us) service_pool.cc:224] Handling call
0709 12:59:57.527622 (+918544us) spinlock_profiling.cc:243] Waited 29.8 ms on lock 0x7b5800015c98. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a1548eb71 00007f6a1548ea22 00007f6a1e3a7c09 00007f6a1d501ee0 00007f6a1d5cb0ab 00007f6a1d5cb131 00007f6a1d58cfc0 00007f6a1d577929 00007f6a1d5773d2 00007f6a16aeebd4
0709 12:59:57.595106 (+ 67484us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:58.078138 (+483032us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:58.145572 (+ 67434us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":68481792}
I20260709 12:59:58.449025  4032 raft_consensus.cc:493] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
W20260709 12:59:58.458482  3934 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.533s	user 0.015s	sys 0.030s
I20260709 12:59:58.356773  4331 consensus_queue.cc:1048] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.146s
W20260709 12:59:58.464380  4220 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.734s	user 0.008s	sys 0.015s
I20260709 12:59:58.529451  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 12:59:58.531213  1495 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.024s	sys 0.011s
I20260709 12:59:58.532635  1600 raft_consensus.cc:2468] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 7.
W20260709 12:59:58.532580  1495 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.024s	sys 0.011s
I20260709 12:59:58.473896  4264 raft_consensus.cc:2749] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373) with higher term. Message: Invalid argument: T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 5. Current term is 6.
W20260709 12:59:58.538949  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 423961us
I20260709 12:59:58.527035  4336 raft_consensus.cc:493] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:58.542513  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 12:59:58.544626  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 379095us
W20260709 12:59:58.534024  4220 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.803s	user 0.008s	sys 0.015s
I20260709 12:59:58.589286  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:58.529270  3977 leader_election.cc:290] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:58.533247  4032 raft_consensus.cc:515] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:58.592798  4336 raft_consensus.cc:515] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:58.592693  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:58.527096  4289 raft_consensus.cc:493] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:58.592490  1646 leader_election.cc:304] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:58.594754  4032 leader_election.cc:290] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:58.644611  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:58.652338  1646 leader_election.cc:304] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 12:59:58.464671  4338 raft_consensus.cc:515] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:58.675031  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:58.637725  4124 raft_consensus.cc:2804] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:58.636313  4144 raft_consensus.cc:493] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:58.735132  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 47454.6us
W20260709 12:59:58.754489  2193 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.019s	sys 0.051s
W20260709 12:59:58.756315  2193 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.020s	sys 0.051s
W20260709 12:59:58.601733  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 338850us
I20260709 12:59:58.737174  1679 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 7.
W20260709 12:59:58.785224  1496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:58.786019  1496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:58.793124  1644 leader_election.cc:336] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.546s (SENT)
I20260709 12:59:58.748135  4124 raft_consensus.cc:493] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:58.647197  4289 raft_consensus.cc:515] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 12:59:58.788789  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 191110us
W20260709 12:59:58.797478  1644 leader_election.cc:336] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.584s (SENT)
I20260709 12:59:58.800320  1644 leader_election.cc:304] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 12:59:58.806980  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 179464us
I20260709 12:59:58.813601  1497 leader_election.cc:304] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
W20260709 12:59:58.817013  1644 leader_election.cc:336] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.594s (SENT)
I20260709 12:59:58.817909  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:58.821751  1604 raft_consensus.cc:1275] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:59:58.759507  4326 raft_consensus.cc:493] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:58.795356  3901 raft_consensus.cc:493] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:58.828621  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36200 (request call id 1927) took 1228 ms. Trace:
I20260709 12:59:58.830919  1600 raft_consensus.cc:2410] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:59:58.801872  4124 raft_consensus.cc:3060] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:59:58.834852  1644 leader_election.cc:336] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.605s (SENT)
I20260709 12:59:58.802044  4032 raft_consensus.cc:2764] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:59:58.829000  1604 rpcz_store.cc:276] 0709 12:59:57.600207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:57.647044 (+ 46837us) service_pool.cc:224] Handling call
0709 12:59:58.821196 (+1174152us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b5800017198. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a1548eb71 00007f6a1548ea22 00007f6a1e3a7c09 00007f6a1d501ee0 00007f6a1d5cb0ab 00007f6a1d5cb131 00007f6a1d58cfc0 00007f6a1d577929 00007f6a1d5773d2 00007f6a16aeebd4
0709 12:59:58.821410 (+   214us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:58.822206 (+   796us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:58.828563 (+  6357us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":25270656}
I20260709 12:59:58.754585  4144 raft_consensus.cc:515] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 12:59:58.835824  1644 leader_election.cc:336] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.607s (SENT)
I20260709 12:59:58.840302  1644 leader_election.cc:304] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:58.824771  4105 raft_consensus.cc:493] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:58.833767  1646 leader_election.cc:304] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:58.843113  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:58.826516  4352 raft_consensus.cc:2749] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:59:58.849457  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 49342.3us
I20260709 12:59:58.850632  1677 raft_consensus.cc:1275] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:59:58.857976  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 555) took 1323 ms. Trace:
I20260709 12:59:58.858385  1602 rpcz_store.cc:276] 0709 12:59:57.534159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:57.604057 (+ 69898us) service_pool.cc:224] Handling call
0709 12:59:58.857290 (+1253233us) spinlock_profiling.cc:243] Waited 15.5 ms on lock 0x7b5800017198. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a1548eb71 00007f6a1548ea22 00007f6a1e3a7c09 00007f6a1d501ee0 00007f6a1d5cb0ab 00007f6a1d5cb131 00007f6a1d58cfc0 00007f6a1d577929 00007f6a1d5773d2 00007f6a16aeebd4
0709 12:59:58.857507 (+   217us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:58.857677 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:58.857701 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:58.857742 (+    41us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:58.857771 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:58.857821 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:58.857920 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":35758848}
I20260709 12:59:58.858450  1497 leader_election.cc:304] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
W20260709 12:59:58.862192  4348 log.cc:927] Time spent T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:59:58.862385  4359 raft_consensus.cc:493] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:58.843639  4325 leader_election.cc:290] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:58.862962  4359 raft_consensus.cc:515] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:58.865947  4347 raft_consensus.cc:2749] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:58.837261  4350 raft_consensus.cc:2749] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:58.868726  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:58.832625  3901 raft_consensus.cc:515] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:58.847221  4324 leader_election.cc:290] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:58.830447  4326 raft_consensus.cc:515] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 12:59:58.946225  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:59.127651  1644 leader_election.cc:336] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.549s (SENT)
I20260709 12:59:58.949030  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:58.951820  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:58.951474  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:58.884274  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 12:59:59.129025  1644 leader_election.cc:336] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.874s (SENT)
I20260709 12:59:58.952164  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:58.851936  4282 raft_consensus.cc:2749] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:59:58.951053  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:58.910274  1497 leader_election.cc:304] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:59.131989  1673 raft_consensus.cc:2393] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 7: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 12:59:58.855127  3977 raft_consensus.cc:493] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:58.836498  4335 leader_election.cc:290] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:58.857056  4284 raft_consensus.cc:2804] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:58.849898  1646 leader_election.cc:304] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 12:59:59.129508  1602 raft_consensus.cc:2468] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 5.
W20260709 12:59:58.954071  4345 log.cc:927] Time spent T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.235s	user 0.001s	sys 0.001s
W20260709 12:59:59.144738  1644 leader_election.cc:336] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.896s (SENT)
W20260709 12:59:58.928236  4344 log.cc:927] Time spent T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.312s	user 0.000s	sys 0.001s
I20260709 12:59:59.150120  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:58.939692  4314 leader_election.cc:290] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:59.176072  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
W20260709 12:59:59.155858  1644 leader_election.cc:336] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.975s (SENT)
I20260709 12:59:59.160683  1679 raft_consensus.cc:2468] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 7.
I20260709 12:59:58.906765  4359 leader_election.cc:290] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:59.180452  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:59.127245  4338 leader_election.cc:290] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:58.849221  4105 raft_consensus.cc:515] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:59.147716  4284 raft_consensus.cc:493] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
W20260709 12:59:59.206204  1570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:59.206790  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 50962.2us
W20260709 12:59:59.210222  1644 leader_election.cc:336] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.986s (SENT)
W20260709 12:59:59.206004  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 295823us
I20260709 12:59:58.878494  4360 consensus_queue.cc:1048] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.298s
I20260709 12:59:59.210465  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:59.155407  4221 raft_consensus.cc:3060] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:59.211583  1497 leader_election.cc:304] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:58.954334  4354 consensus_queue.cc:1048] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.285s
I20260709 12:59:59.212383  4284 raft_consensus.cc:3060] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:59.224977  4314 consensus_queue.cc:1048] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:59.226917  1497 leader_election.cc:304] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:59.230165  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:59.231300  2224 raft_consensus.cc:2468] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 5.
W20260709 12:59:59.231261  1644 leader_election.cc:336] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 2.000s (SENT)
I20260709 12:59:59.232439  1644 leader_election.cc:304] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:59.152122  3977 raft_consensus.cc:515] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:59.235332  1497 leader_election.cc:304] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:59.227077  4220 raft_consensus.cc:2804] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:59.227414  4289 leader_election.cc:290] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:59.241340  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:59.242689  1602 raft_consensus.cc:3060] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:59.234591  4222 raft_consensus.cc:2804] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:59.247164  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 12:59:59.253016  4364 log.cc:927] Time spent T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
I20260709 12:59:59.240957  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:59.256516  4105 leader_election.cc:290] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 12:59:59.246694  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:59.240159  4347 raft_consensus.cc:2749] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:59.240772  4108 raft_consensus.cc:493] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:59.249316  4222 raft_consensus.cc:493] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:59.262547  4222 raft_consensus.cc:3060] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:59.247279  4144 leader_election.cc:290] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:59.261309  4105 raft_consensus.cc:493] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:59.314960  4336 leader_election.cc:290] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:59.315343  4105 raft_consensus.cc:515] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:59.290076  4124 raft_consensus.cc:515] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:59.317596  4105 leader_election.cc:290] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:59.318216  4124 leader_election.cc:290] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
W20260709 12:59:59.313907  4327 consensus_meta.cc:287] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b: Time spent flushing consensus metadata: real 0.863s	user 0.009s	sys 0.000s
W20260709 12:59:59.300045  4343 consensus_meta.cc:287] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.948s	user 0.005s	sys 0.006s
I20260709 12:59:59.304816  4222 raft_consensus.cc:515] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:59.306504  3901 leader_election.cc:290] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:59.307914  4293 raft_consensus.cc:3060] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:59.310225  4296 raft_consensus.cc:3060] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:59.311345  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36200 (request call id 1925) took 1744 ms. Trace:
I20260709 12:59:59.333925  1603 rpcz_store.cc:276] 0709 12:59:57.567120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:57.630684 (+ 63564us) service_pool.cc:224] Handling call
0709 12:59:57.631002 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:58.106880 (+475878us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:58.106914 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:58.106955 (+    41us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:58.106986 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:59.311120 (+1204134us) spinlock_profiling.cc:243] Waited 476 ms on lock 0x7b5400390654. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 12:59:59.311162 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:59.311285 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1094054784}
I20260709 12:59:59.335340  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:59.336031  1603 raft_consensus.cc:2393] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 6: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 12:59:59.336416  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36194 (request call id 1453) took 1035 ms. Trace:
I20260709 12:59:59.336687  1603 rpcz_store.cc:276] 0709 12:59:58.300566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:59.335090 (+1034524us) service_pool.cc:224] Handling call
0709 12:59:59.336353 (+  1263us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:59.337615  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:59.279436  4108 raft_consensus.cc:515] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:59.340746  1602 raft_consensus.cc:2410] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 12:59:59.331730  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 92184.5us
I20260709 12:59:59.341962  1497 leader_election.cc:304] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:59.343393  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:59.344106  1602 raft_consensus.cc:2468] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 6.
I20260709 12:59:59.346024  1529 raft_consensus.cc:1275] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:59:59.346316  1603 raft_consensus.cc:2410] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:59:59.344467  4341 raft_consensus.cc:2749] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:59.342867  4326 leader_election.cc:290] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:59.350498  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:59.342770  4220 raft_consensus.cc:697] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 12:59:59.350761  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:59.351459  1529 raft_consensus.cc:2468] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 7.
I20260709 12:59:59.330557  4327 raft_consensus.cc:515] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:59.353137  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:59.353632  1528 raft_consensus.cc:2468] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 4.
I20260709 12:59:59.354169  1526 raft_consensus.cc:2393] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 7: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 12:59:59.356873  1602 raft_consensus.cc:1275] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:59:59.357534  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36194 (request call id 1446) took 1088 ms. Trace:
I20260709 12:59:59.357826  1602 rpcz_store.cc:276] 0709 12:59:58.269370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:59.347853 (+1078483us) service_pool.cc:224] Handling call
0709 12:59:59.355018 (+  7165us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:59.357243 (+  2225us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:59.357485 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:59.331072  4343 raft_consensus.cc:515] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:59.359543  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:59.360378  1527 raft_consensus.cc:2410] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:59:59.361240  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:59.361670  1528 raft_consensus.cc:1240] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:59.364274  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:59.364926  1526 raft_consensus.cc:2468] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 5.
I20260709 12:59:59.365803  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:59.368026  1531 raft_consensus.cc:1240] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:59:59.368929  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:59.371316  1524 raft_consensus.cc:1240] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:59:59.371526  1528 raft_consensus.cc:1275] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:59:59.367182  4384 raft_consensus.cc:493] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:59.373497  1531 raft_consensus.cc:2468] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 6.
W20260709 12:59:59.377396  1496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:59.374172  4108 leader_election.cc:290] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:59.375360  4222 leader_election.cc:290] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:59.375957  3977 leader_election.cc:290] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:59.375780  4220 consensus_queue.cc:237] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:59.376498  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:59.379647  1531 raft_consensus.cc:1240] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 LEADER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:59.387444  3921 leader_election.cc:290] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:59.390688  1524 raft_consensus.cc:2410] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
W20260709 12:59:59.390290  4369 log.cc:927] Time spent T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.443s	user 0.002s	sys 0.016s
I20260709 12:59:59.391358  1526 raft_consensus.cc:2468] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 7.
I20260709 12:59:59.399417  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:59.400193  1528 raft_consensus.cc:3060] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:59.418179  2190 leader_election.cc:304] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:59.401546  4343 leader_election.cc:290] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:59.379647  4384 raft_consensus.cc:515] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:59.430011  4105 raft_consensus.cc:2749] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:59.424126  4326 consensus_queue.cc:1048] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 12:59:59.430392  1598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36194 (request call id 1449) took 1154 ms. Trace:
I20260709 12:59:59.390056  4284 raft_consensus.cc:515] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:59.654155  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:59.653158  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:59.447727  1528 raft_consensus.cc:2468] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 5.
I20260709 12:59:59.653743  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:59.654083  1677 raft_consensus.cc:1275] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:59:59.666533  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:59.668049  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:59.520925  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:59.668432  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:59.470314  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:59.669282  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:59.443470  2225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50326 (request call id 656) took 1824 ms. Trace:
I20260709 12:59:59.669428  2222 raft_consensus.cc:2410] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 12:59:59.669893  2220 raft_consensus.cc:2468] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 7.
I20260709 12:59:59.653952  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:59.671144  1598 rpcz_store.cc:276] 0709 12:59:58.275964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:58.437341 (+161377us) service_pool.cc:224] Handling call
0709 12:59:59.430142 (+992801us) spinlock_profiling.cc:243] Waited 7.1 ms on lock 0x7b54000da054. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 12:59:59.430290 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16332160}
I20260709 12:59:59.672011  1673 raft_consensus.cc:2410] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:59:59.666383  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:59.672811  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:59.673493  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 12:59:59.522580  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 672751us
I20260709 12:59:59.674552  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:59.675086  1528 raft_consensus.cc:2468] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 5.
I20260709 12:59:59.675856  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:59.676751  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:59.677266  1528 raft_consensus.cc:2468] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 5.
I20260709 12:59:59.677495  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 548) took 2146 ms. Trace:
I20260709 12:59:59.677958  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:59.678510  1528 raft_consensus.cc:3060] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:59.522197  4374 raft_consensus.cc:2749] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:59:59.519780  4282 raft_consensus.cc:2804] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:59.679628  4282 raft_consensus.cc:493] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 12:59:59.679970  4282 raft_consensus.cc:3060] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:59.670885  1678 raft_consensus.cc:2393] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 5: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
W20260709 12:59:59.662765  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 244659us
I20260709 12:59:59.684690  4043 consensus_queue.cc:1048] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:59:59.685784  1528 raft_consensus.cc:2468] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 7.
I20260709 12:59:59.686730  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:59.687247  1528 raft_consensus.cc:2376] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 7. Re-sending same reply.
I20260709 12:59:59.687995  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:59.688448  1528 raft_consensus.cc:2376] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 7. Re-sending same reply.
I20260709 12:59:59.689143  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:59.689072  4043 consensus_queue.cc:1059] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:59.689888  1528 raft_consensus.cc:2393] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 7: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 12:59:59.690269  4357 raft_consensus.cc:3055] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:59.690631  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:59.691373  4309 raft_consensus.cc:493] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:59.691781  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:59.691964  4309 raft_consensus.cc:515] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:59.692778  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:59.693750  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:59.694169  4309 leader_election.cc:290] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:59.699674  2190 leader_election.cc:304] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 12:59:59.700536  4286 raft_consensus.cc:2804] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:59.700587  2190 leader_election.cc:304] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:59.701053  4286 raft_consensus.cc:493] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:59.701390  4286 raft_consensus.cc:3060] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:59.677920  1606 rpcz_store.cc:276] 0709 12:59:57.530863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:57.530979 (+   116us) service_pool.cc:224] Handling call
0709 12:59:57.580162 (+ 49183us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:58.107670 (+527508us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:58.107698 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:58.107745 (+    47us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:58.107778 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:59.677229 (+1569451us) spinlock_profiling.cc:243] Waited 527 ms on lock 0x7b5400267fd4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 12:59:59.677277 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:59.677410 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1212706176}
I20260709 12:59:59.704035  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36194 (request call id 1452) took 1411 ms. Trace:
I20260709 12:59:59.704463  1605 rpcz_store.cc:276] 0709 12:59:58.292701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:58.298270 (+  5569us) service_pool.cc:224] Handling call
0709 12:59:59.703813 (+1405543us) spinlock_profiling.cc:243] Waited 152 ms on lock 0x7b54001a9fd4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 12:59:59.703925 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":350458112}
I20260709 12:59:59.707367  1599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36200 (request call id 1926) took 2128 ms. Trace:
I20260709 12:59:59.707743  1599 rpcz_store.cc:276] 0709 12:59:57.578821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:57.638753 (+ 59932us) service_pool.cc:224] Handling call
0709 12:59:59.706708 (+2067955us) spinlock_profiling.cc:243] Waited 412 ms on lock 0x7b5800017198. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a1548eb71 00007f6a1548ea22 00007f6a1e3a7c09 00007f6a1d501ee0 00007f6a1d5cb0ab 00007f6a1d5cb131 00007f6a1d58cfc0 00007f6a1d577929 00007f6a1d5773d2 00007f6a16aeebd4
0709 12:59:59.706892 (+   184us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:59.707069 (+   177us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:59.707092 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:59.707126 (+    34us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:59.707152 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:59.707202 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:59.707302 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":948744064}
I20260709 12:59:59.709733  1525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49310 (request call id 522) took 1416 ms. Trace:
I20260709 12:59:59.694818  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 12:59:59.711341  1646 connection.cc:256] RPC call timeout handler was delayed by -1.5344127129999947s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18700000000000003s for a response
I20260709 12:59:59.710093  1525 rpcz_store.cc:276] 0709 12:59:58.293156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:58.293358 (+   202us) service_pool.cc:224] Handling call
0709 12:59:58.310502 (+ 17144us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:58.438553 (+128051us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:58.438581 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:58.439044 (+   463us) log.cc:844] Serialized 26 byte log entry
0709 12:59:58.819503 (+380459us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:58.819562 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:59.709383 (+889821us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b540022ae54. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 12:59:59.709427 (+    44us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:59.709471 (+    44us) raft_consensus.cc:1685] finished
0709 12:59:59.709483 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:59.709677 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3480,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":9584,"spinlock_wait_cycles":293600512,"thread_start_us":379635,"threads_started":1,"wal-append.queue_time_us":488322}
I20260709 12:59:59.711450  1528 raft_consensus.cc:2376] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 7. Re-sending same reply.
I20260709 12:59:59.696044  4384 leader_election.cc:290] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:59.696417  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:59.581815  4105 raft_consensus.cc:493] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:59.712809  1607 raft_consensus.cc:2410] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:59:59.523172  1604 raft_consensus.cc:1275] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:59:59.713990  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36200 (request call id 1934) took 1194 ms. Trace:
I20260709 12:59:59.714376  1604 rpcz_store.cc:276] 0709 12:59:58.519347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:59.522573 (+1003226us) service_pool.cc:224] Handling call
0709 12:59:59.522868 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:59.713752 (+190884us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:59.713938 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:59.690678  4357 raft_consensus.cc:740] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 12:59:59.443068  4327 leader_election.cc:290] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 4 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 12:59:59.663648  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 432416us
I20260709 12:59:59.698252  1526 raft_consensus.cc:2468] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 6.
I20260709 12:59:59.727125  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:59.728070  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:59.728266  1680 raft_consensus.cc:2468] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 5.
I20260709 12:59:59.728353  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:59.728747  1528 raft_consensus.cc:3060] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:59.663193  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:59.729646  1674 raft_consensus.cc:2410] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:59:59.670420  2225 rpcz_store.cc:276] 0709 12:59:57.613461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:57.613588 (+   127us) service_pool.cc:224] Handling call
0709 12:59:59.434155 (+1820567us) spinlock_profiling.cc:243] Waited 618 ms on lock 0x7b540054e2d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 12:59:59.437642 (+  3487us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1422255488}
W20260709 12:59:59.664633  1570 leader_election.cc:336] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.731s (SENT)
I20260709 12:59:59.730235  1570 leader_election.cc:304] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:59.666491  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:59.693764  3935 leader_election.cc:290] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 6 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 12:59:59.569480  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 12:59:59.713256  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36194 (request call id 1448) took 1441 ms. Trace:
I20260709 12:59:59.731361  1677 raft_consensus.cc:2393] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 9: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
W20260709 12:59:59.569811  4388 log.cc:927] Time spent T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 12:59:59.665347  4284 leader_election.cc:290] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:59.734493  1607 rpcz_store.cc:276] 0709 12:59:58.272300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:58.352292 (+ 79992us) service_pool.cc:224] Handling call
0709 12:59:59.696291 (+1343999us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b5800017198. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a1548eb71 00007f6a1548ea22 00007f6a1e3a7c09 00007f6a1d501ee0 00007f6a1d5cb0ab 00007f6a1d5cb131 00007f6a1d5790a0 00007f6a1d578984 00007f6a16af36d4 00007f6a16af3662
0709 12:59:59.713206 (+ 16915us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":25328384}
I20260709 12:59:59.738857  1526 raft_consensus.cc:2468] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 7.
I20260709 12:59:59.739799  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:59.740397  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:59.741097  1526 raft_consensus.cc:2410] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:59:59.741888  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
W20260709 12:59:59.741963  1644 leader_election.cc:336] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 2.129s (SENT)
I20260709 12:59:59.518018  4269 raft_consensus.cc:493] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:59.743069  1526 raft_consensus.cc:2410] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:59:59.740936  1524 raft_consensus.cc:2376] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 5. Re-sending same reply.
I20260709 12:59:59.751154  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49178 (request call id 1686) took 1221 ms. Trace:
I20260709 12:59:59.715381  4296 raft_consensus.cc:493] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:59.714643  4331 raft_consensus.cc:2749] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:59.752841  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 12:59:59.753618  1526 raft_consensus.cc:3060] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:59.747048  1528 raft_consensus.cc:2468] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 6.
I20260709 12:59:59.753949  1646 leader_election.cc:304] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 12:59:59.751567  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:59.751129  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:59.756341  1525 raft_consensus.cc:2376] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 5. Re-sending same reply.
I20260709 12:59:59.757097  1680 raft_consensus.cc:1275] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:59:59.758383  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:59.760304  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:59.761162  1676 raft_consensus.cc:3060] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:59.746204  1644 leader_election.cc:304] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:59.763598  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 12:59:59.763643  1497 connection.cc:256] RPC call timeout handler was delayed by -1.590825174000031s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1562s for a response
W20260709 12:59:59.764387  1497 connection.cc:256] RPC call timeout handler was delayed by -1.4999251740000545s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1663s for a response
W20260709 12:59:59.764317  1496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:59.764433  1679 raft_consensus.cc:2468] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 6.
W20260709 12:59:59.764933  1497 connection.cc:256] RPC call timeout handler was delayed by -1.4441251740000212s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17250000000000001s for a response
W20260709 12:59:59.765349  1497 connection.cc:256] RPC call timeout handler was delayed by -1.2929251740000041s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18930000000000002s for a response
W20260709 12:59:59.765723  1497 connection.cc:256] RPC call timeout handler was delayed by -1.2641251740000143s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1925s for a response
W20260709 12:59:59.766007  1497 connection.cc:256] RPC call timeout handler was delayed by -1.2119251740000436s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19830000000000003s for a response
W20260709 12:59:59.766330  1497 connection.cc:256] RPC call timeout handler was delayed by -1.1246251740000162s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20800000000000002s for a response
W20260709 12:59:59.766642  1497 connection.cc:256] RPC call timeout handler was delayed by -1.0454251740000018s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21680000000000002s for a response
W20260709 12:59:59.767052  1497 connection.cc:256] RPC call timeout handler was delayed by -1.0256251740000266s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.219s for a response
I20260709 12:59:59.767731  1497 leader_election.cc:304] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:59.733711  4311 raft_consensus.cc:2749] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:59.773391  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 12:59:59.770143  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 105542us
I20260709 12:59:59.760311  2225 raft_consensus.cc:1275] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [term 4 LEARNER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:59:59.771050  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 12:59:59.771947  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:59.751753  1681 rpcz_store.cc:276] 0709 12:59:58.529790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:58.530023 (+   233us) service_pool.cc:224] Handling call
0709 12:59:58.530310 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:58.530522 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:59:58.839243 (+308721us) log.cc:844] Serialized 14 byte log entry
0709 12:59:59.513508 (+674265us) spinlock_profiling.cc:243] Waited 88.1 ms on lock 0x7b180013b160. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1e38ede1 00007f6a1e39b5b1 00007f6a15440c0a 00007f6a1eb80219 00007f6a154c8a40 00007f6a154c34e4 00007f6a154c3455 00007f6a185ab060 00007f6a185bd716 00007f6a185ce287 00007f6a185ce208
0709 12:59:59.727091 (+213583us) log.cc:844] Serialized 14 byte log entry
0709 12:59:59.750825 (+ 23734us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:59.750879 (+    54us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:59.750926 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:59.750991 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:59.751099 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33562,"prepare.queue_time_us":377152,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":577313,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":107,"spinlock_wait_cycles":202589952,"thread_start_us":597349,"threads_started":3,"wal-append.queue_time_us":306723}
I20260709 12:59:59.747148  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 12:59:59.781790  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:59.764526  4221 consensus_meta.cc:287] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent flushing consensus metadata: real 0.541s	user 0.005s	sys 0.005s
I20260709 12:59:59.819137  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:59.821612  1530 raft_consensus.cc:2410] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:59:59.815655  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:59.815871  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:59.822362  1607 raft_consensus.cc:3060] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:59.822455  1525 raft_consensus.cc:2468] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 7.
I20260709 12:59:59.770550  4296 raft_consensus.cc:515] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:59.817299  2191 leader_election.cc:304] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 12:59:59.774600  4033 raft_consensus.cc:2749] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:59.772729  3921 consensus_queue.cc:1048] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 12:59:59.817854  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:59.758561  3977 raft_consensus.cc:493] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:59.733332  4105 raft_consensus.cc:515] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:59.832973  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:59.833721  1606 raft_consensus.cc:2468] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 3.
I20260709 12:59:59.834121  1599 raft_consensus.cc:2393] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 5: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 12:59:59.818497  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:59.835740  1604 raft_consensus.cc:2468] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 5.
I20260709 12:59:59.819094  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:59.774430  4284 raft_consensus.cc:2749] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:59:59.768759  4387 raft_consensus.cc:493] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:59.840560  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:59.839828  1605 raft_consensus.cc:2410] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:59:59.781790  4175 raft_consensus.cc:493] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 12:59:59.884909  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:59.871641  1607 raft_consensus.cc:2468] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 4.
I20260709 12:59:59.888796  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:59.889402  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:59.826159  4221 raft_consensus.cc:2749] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:59.895008  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:59.890087  1599 raft_consensus.cc:2468] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 4.
I20260709 12:59:59.909304  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:59.897781  1676 raft_consensus.cc:2468] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 6.
I20260709 12:59:59.910012  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:59.915506  1606 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 6.
I20260709 12:59:59.915917  1524 raft_consensus.cc:2468] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 7.
W20260709 12:59:59.908776  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 67191.3us
I20260709 12:59:59.920910  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:59.921172  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 12:59:59.919837  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 152208us
I20260709 12:59:59.922477  1497 leader_election.cc:304] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:59.922712  1604 raft_consensus.cc:1240] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:59.770208  4269 raft_consensus.cc:515] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:59.925403  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
W20260709 12:59:59.928331  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 158452us
I20260709 12:59:59.929220  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:59.933135  1530 raft_consensus.cc:3060] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:59.933341  2223 raft_consensus.cc:2468] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 7.
I20260709 12:59:59.937474  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 12:59:59.938196  2226 raft_consensus.cc:3060] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:59.942507  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:59.943177  1606 raft_consensus.cc:2468] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 6.
I20260709 12:59:59.943789  1646 leader_election.cc:304] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 12:59:59.944924  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:59.829993  4350 raft_consensus.cc:493] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:59.946601  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 12:59:59.841120  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:59.891278  4359 raft_consensus.cc:2804] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:59.981014  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 12:59:59.997864  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:59.985304  1599 raft_consensus.cc:2376] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 6. Re-sending same reply.
I20260709 12:59:59.998355  1497 leader_election.cc:304] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:59.826375  4374 consensus_queue.cc:1048] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.122s
I20260709 12:59:59.996714  2226 raft_consensus.cc:2468] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 5.
I20260709 12:59:59.911422  4265 leader_election.cc:290] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 12:59:59.929809  4108 raft_consensus.cc:493] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:00.000911  1497 leader_election.cc:304] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 12:59:59.931278  4311 raft_consensus.cc:493] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:00.066094  1524 raft_consensus.cc:2393] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 6: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:00:00.065954  1531 raft_consensus.cc:1240] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 LEADER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 3. Current term is 4. Ops: []
W20260709 13:00:00.066237  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 85838.1us
I20260709 13:00:00.066421  1606 raft_consensus.cc:1275] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:00:00.125903  2190 leader_election.cc:304] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
W20260709 12:59:59.943001  4293 consensus_meta.cc:287] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.601s	user 0.012s	sys 0.006s
I20260709 12:59:59.824535  4357 consensus_queue.cc:260] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 12:59:59.928728  4341 raft_consensus.cc:493] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 12:59:59.935402  4336 raft_consensus.cc:2749] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:00:00.076797  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 76026.5us
I20260709 13:00:00.130244  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 12:59:59.838884  4396 consensus_queue.cc:1048] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.163s
I20260709 12:59:59.990260  1526 raft_consensus.cc:2468] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 7.
I20260709 13:00:00.117057  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:00.120872  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:00.141086  1678 raft_consensus.cc:2410] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:59:59.843005  3977 raft_consensus.cc:515] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:00.070891  1605 raft_consensus.cc:2410] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:00:00.130245  1497 leader_election.cc:304] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:00.133021  1599 raft_consensus.cc:2468] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 6.
I20260709 13:00:00.135447  1531 raft_consensus.cc:1275] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:00:00.150367  1531 raft_consensus.cc:1275] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:59:59.931795  4124 consensus_queue.cc:1048] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.146s
I20260709 12:59:59.983289  4264 raft_consensus.cc:493] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:00.162076  4264 raft_consensus.cc:515] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:00.163216  4290 leader_election.cc:290] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:00.164219  4264 leader_election.cc:290] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:00.164990  4120 raft_consensus.cc:2749] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:00.165719  4120 consensus_queue.cc:1059] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:00.166601  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 12:59:59.935685  4175 raft_consensus.cc:515] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
W20260709 13:00:00.170069  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 226371us
I20260709 13:00:00.143702  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 12:59:59.942188  2218 raft_consensus.cc:2468] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 5.
I20260709 13:00:00.067054  4386 raft_consensus.cc:2749] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:59.886586  4387 raft_consensus.cc:515] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 12:59:59.998760  4359 raft_consensus.cc:493] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:00.065804  4284 consensus_queue.cc:1048] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.183s
I20260709 13:00:00.170634  1607 raft_consensus.cc:2410] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 12:59:59.527472   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:00.143847  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:00.173596  1646 leader_election.cc:304] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:00.215003  1677 raft_consensus.cc:3060] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:00.174566  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 44405.2us
I20260709 13:00:00.216509  1497 leader_election.cc:304] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:00.181447  1525 raft_consensus.cc:1275] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:00:00.070042  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:00.075661  4190 raft_consensus.cc:493] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:00.131250  4309 raft_consensus.cc:2749] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:00.068156  2222 raft_consensus.cc:2468] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 4.
I20260709 13:00:00.197978  1530 raft_consensus.cc:2468] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 6.
I20260709 13:00:00.201809  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:00.144590  4220 raft_consensus.cc:2749] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:00.158344  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:00.133129  4350 raft_consensus.cc:515] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:00.210134  1598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 563) took 1357 ms. Trace:
I20260709 13:00:00.273747  1598 rpcz_store.cc:276] 0709 12:59:58.852739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:59.672125 (+819386us) service_pool.cc:224] Handling call
0709 12:59:59.672514 (+   389us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:59.673171 (+   657us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:59.673198 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:59.673667 (+   469us) log.cc:844] Serialized 26 byte log entry
0709 12:59:59.843429 (+169762us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:59.843470 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:59.843538 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:00.209886 (+366348us) raft_consensus.cc:1685] finished
0709 13:00:00.209908 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:00.210072 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":149,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":100,"thread_start_us":169387,"threads_started":1,"wal-append.queue_time_us":534716}
I20260709 13:00:00.275676  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:00.276939  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:00.180611  4222 raft_consensus.cc:2764] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:00:00.155766  4311 raft_consensus.cc:515] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:00.280908  4311 leader_election.cc:290] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:00.169647  4175 leader_election.cc:290] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:00:00.197947  4397 log.cc:927] Time spent T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:00:00.284662  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:00.131107  4108 raft_consensus.cc:515] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:00.211383  3876 consensus_queue.cc:1048] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:00.222133  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:00.287560  1605 raft_consensus.cc:2468] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 4.
I20260709 13:00:00.235942  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:00.246712  4290 raft_consensus.cc:493] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:00.215703  1646 leader_election.cc:304] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:00.185189  4384 raft_consensus.cc:2804] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:00.256263  1497 leader_election.cc:304] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:00.293768  1497 leader_election.cc:304] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:00.285323  1599 raft_consensus.cc:2468] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 5.
I20260709 13:00:00.169653  4340 raft_consensus.cc:3055] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:00.260234  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:00.126739  4282 raft_consensus.cc:515] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:00.262079  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:00.265115  1606 raft_consensus.cc:2468] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 6.
I20260709 13:00:00.297209  1526 raft_consensus.cc:1275] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:00:00.269801  1601 raft_consensus.cc:2468] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 9.
I20260709 13:00:00.172526  4033 consensus_queue.cc:1048] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.097s
I20260709 13:00:00.214116  4359 raft_consensus.cc:3060] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:00.311877  4033 raft_consensus.cc:2804] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:00.312338  4033 raft_consensus.cc:493] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:00:00.312690  4033 raft_consensus.cc:3060] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:00.156661  4341 raft_consensus.cc:515] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:00.315071  4394 log.cc:927] Time spent T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.383s	user 0.000s	sys 0.001s
I20260709 13:00:00.289415  1598 raft_consensus.cc:1275] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:00:00.242650  1571 connection.cc:256] RPC call timeout handler was delayed by -1.4851720610000143s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.169s for a response
W20260709 13:00:00.291721  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 76103.7us
I20260709 13:00:00.272265  4386 raft_consensus.cc:2749] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:00.303444  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:00.304028  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:00.263856  4190 raft_consensus.cc:515] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:00.300434  3970 raft_consensus.cc:493] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:00.311352  4108 leader_election.cc:290] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:00.286164  2219 raft_consensus.cc:2393] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 6: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:00:00.319669  1530 raft_consensus.cc:2393] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 5: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:00:00.319604  1677 raft_consensus.cc:2468] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 5.
I20260709 13:00:00.319931  1529 raft_consensus.cc:2468] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 5.
I20260709 13:00:00.328671  1606 raft_consensus.cc:1240] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:00.334774  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 13:00:00.335016  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 350062us
I20260709 13:00:00.335755  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:00.329859  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:00:00.339775  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:00.341290  2192 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.814s	user 0.012s	sys 0.004s
W20260709 13:00:00.341645  2192 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.814s	user 0.012s	sys 0.004s
W20260709 13:00:00.341897  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 814872us
I20260709 13:00:00.293545  4374 raft_consensus.cc:2749] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:00.365087  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:00.365927  1527 raft_consensus.cc:2393] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 4: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:00:00.366183  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:00.366828  1606 raft_consensus.cc:3060] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:00.301326  3921 raft_consensus.cc:2749] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:00.298688  4309 raft_consensus.cc:2749] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:00.299588  4340 raft_consensus.cc:740] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:00.370952  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:00.376897  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:00.377784  1530 raft_consensus.cc:2410] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:00:00.324258  4175 raft_consensus.cc:493] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:00.316197  4341 leader_election.cc:290] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:00:00.370867  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 425793us
I20260709 13:00:00.387097  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:00.389400  2191 leader_election.cc:304] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:00.339107  3970 raft_consensus.cc:515] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:00.391369  4175 raft_consensus.cc:515] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:00.393755  4175 leader_election.cc:290] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:00.395035  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:00.396214  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:00.396626  4190 leader_election.cc:290] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:00.397265  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:00.397878  1530 raft_consensus.cc:2468] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 7.
I20260709 13:00:00.398695  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:00.399935  1530 raft_consensus.cc:1275] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:00:00.400918  4393 log.cc:927] Time spent T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.241s	user 0.000s	sys 0.001s
I20260709 13:00:00.401911  1606 raft_consensus.cc:2468] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 4.
I20260709 13:00:00.388381  4105 leader_election.cc:290] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:00.412082  1572 leader_election.cc:304] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:00:00.386288  4311 consensus_queue.cc:1048] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:00:00.415362  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36194 (request call id 1458) took 1882 ms. Trace:
I20260709 13:00:00.415853  4282 leader_election.cc:290] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:00.415791  1603 rpcz_store.cc:276] 0709 12:59:58.532873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:59.337384 (+804511us) service_pool.cc:224] Handling call
0709 13:00:00.415176 (+1077792us) spinlock_profiling.cc:243] Waited 7.96 ms on lock 0x7b540041f854. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:00.415301 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18312960}
I20260709 13:00:00.417052  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:00.418215  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:00.419348  4340 consensus_queue.cc:260] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:00.420399  4340 raft_consensus.cc:3060] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:00.382354  2192 leader_election.cc:304] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:00.374123  1529 raft_consensus.cc:2468] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 5.
I20260709 13:00:00.383147  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:00.324594  4396 raft_consensus.cc:493] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:00.426992  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:00.426975  4396 raft_consensus.cc:515] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:00.427549  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:00.428128  1525 raft_consensus.cc:2468] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 10.
I20260709 13:00:00.326339  4384 raft_consensus.cc:697] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 6 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:00.298902  4290 raft_consensus.cc:515] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:00.413568  4269 leader_election.cc:290] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:00.428505  4380 raft_consensus.cc:2804] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:00.428957  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 13:00:00.381846  1644 leader_election.cc:336] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.688s (SENT)
I20260709 13:00:00.429581  1600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36194 (request call id 1454) took 2099 ms. Trace:
I20260709 13:00:00.449730  1644 leader_election.cc:304] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:00.440796  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:00.441821  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:00:00.431039  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:00.439105  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 56827.4us
I20260709 13:00:00.413246  3977 leader_election.cc:290] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:00.476385  2192 leader_election.cc:304] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90
W20260709 13:00:00.440035  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 314226us
I20260709 13:00:00.431263  1603 raft_consensus.cc:3060] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:00:00.475679  1571 leader_election.cc:304] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:00.397172  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:00.426565  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 13:00:00.439486  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 52714.5us
I20260709 13:00:00.482823  1606 raft_consensus.cc:2468] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 6.
I20260709 13:00:00.478605  1571 leader_election.cc:304] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
W20260709 13:00:00.478760  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 96947.9us
I20260709 13:00:00.480000  1646 leader_election.cc:304] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:00.449781  1600 rpcz_store.cc:276] 0709 12:59:58.329996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:58.599528 (+269532us) service_pool.cc:224] Handling call
0709 13:00:00.422620 (+1823092us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b54003b1ad4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:00.429514 (+  6894us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":27964288}
I20260709 13:00:00.485777  1646 leader_election.cc:304] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:00.482334  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:00.427558  4387 leader_election.cc:290] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:00.447821  4327 raft_consensus.cc:2749] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:00.487622  1525 raft_consensus.cc:2376] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 7. Re-sending same reply.
I20260709 13:00:00.489285  2192 leader_election.cc:304] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:00:00.492024  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
W20260709 13:00:00.489997  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:00.486830  1646 leader_election.cc:304] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:00.498111  1646 leader_election.cc:304] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:00.387152  4404 consensus_queue.cc:1048] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.105s
I20260709 13:00:00.500475  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:00.502151  2225 raft_consensus.cc:1240] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:00.473686  4380 raft_consensus.cc:493] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:00.475157  4175 raft_consensus.cc:2804] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:00.517119  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:00.506840  3977 raft_consensus.cc:2804] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:00.518687  4359 raft_consensus.cc:515] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:00.520937  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:00.522259  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:00.545387  1600 raft_consensus.cc:2393] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 5: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:00:00.523996  2191 leader_election.cc:304] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:00.501616  4288 raft_consensus.cc:2804] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:00.481688  4311 raft_consensus.cc:2749] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:00.489470  4269 raft_consensus.cc:2749] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:00.538734  1603 raft_consensus.cc:2468] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 8.
I20260709 13:00:00.539418  1646 leader_election.cc:304] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:00.526153  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:00.540906  1530 raft_consensus.cc:2468] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 5.
I20260709 13:00:00.517659  1525 raft_consensus.cc:2393] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 5: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:00:00.556339  2191 leader_election.cc:304] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:00.541101  4331 raft_consensus.cc:2804] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:00.512540  4190 raft_consensus.cc:2804] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:00.512830  4124 raft_consensus.cc:2749] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:00.491169  4405 raft_consensus.cc:2804] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:00.512603  4402 raft_consensus.cc:2804] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:00.543182  3977 raft_consensus.cc:493] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:00:00.511031  1529 raft_consensus.cc:2468] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 6.
I20260709 13:00:00.579285  2191 leader_election.cc:304] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:00.580766  2191 leader_election.cc:304] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:00.542145  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
W20260709 13:00:00.559041  4286 consensus_meta.cc:287] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b: Time spent flushing consensus metadata: real 0.857s	user 0.008s	sys 0.016s
I20260709 13:00:00.561156  4105 raft_consensus.cc:2804] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:00.541364  4380 raft_consensus.cc:3060] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:00.568390  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:00.573167  4331 raft_consensus.cc:493] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:00.571696  2224 raft_consensus.cc:2393] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 7: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:00:00.542675  4175 raft_consensus.cc:493] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:00.572007  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:00:00.541554  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 44447.5us
I20260709 13:00:00.578068  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:00.583971  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:00.583896  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 13:00:00.585078  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 251805us
I20260709 13:00:00.551323  4350 leader_election.cc:290] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:00.574278  4190 raft_consensus.cc:493] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:00.572762  4284 raft_consensus.cc:2804] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:00.590559  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:00.597458  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:00.553025  1646 leader_election.cc:304] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
W20260709 13:00:00.753556  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 200636us
I20260709 13:00:00.754316  1646 leader_election.cc:304] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:00:00.501143  4384 consensus_queue.cc:237] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:00.571152  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:00.621138  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43010 (request call id 1826) took 1188 ms. Trace:
W20260709 13:00:00.755554  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 135292us
I20260709 13:00:00.755666  1526 rpcz_store.cc:276] 0709 12:59:59.432785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:00.142467 (+709682us) service_pool.cc:224] Handling call
0709 13:00:00.142856 (+   389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:00.297595 (+154739us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:00.620902 (+323307us) spinlock_profiling.cc:243] Waited 154 ms on lock 0x7b54000fe454. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:00:00.621077 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":354209024}
I20260709 13:00:00.757097  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:00.595849  4290 leader_election.cc:290] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:00.658595  1523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43010 (request call id 1817) took 1228 ms. Trace:
W20260709 13:00:00.669473  1570 leader_election.cc:336] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.826s (SENT)
I20260709 13:00:00.578068  4402 raft_consensus.cc:493] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:00.580940  3977 raft_consensus.cc:3060] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:00.703892  1571 leader_election.cc:304] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:00.704998  1527 raft_consensus.cc:2410] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:00:00.578605  4288 raft_consensus.cc:697] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 6 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:00.575389  4405 raft_consensus.cc:493] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:00:00.719113  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:00.592832  2222 raft_consensus.cc:3060] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:00.593178  4382 raft_consensus.cc:3060] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:00.590440  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:00.705530  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:00.584450  4396 leader_election.cc:290] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:00.590874  4395 raft_consensus.cc:2749] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:00.655769  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:00.758280  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:00.961210  1526 raft_consensus.cc:2376] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 7. Re-sending same reply.
I20260709 13:00:00.962325  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:00.963019  1526 raft_consensus.cc:2468] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 6.
I20260709 13:00:00.664546  4331 raft_consensus.cc:3060] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:00.979542  2218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 671) took 1312 ms. Trace:
I20260709 13:00:00.980036  2218 rpcz_store.cc:276] 0709 12:59:59.667360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:59.726900 (+ 59540us) service_pool.cc:224] Handling call
0709 13:00:00.979367 (+1252467us) spinlock_profiling.cc:243] Waited 64.8 ms on lock 0x7b5400600254. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:00.979471 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":149008256}
W20260709 13:00:00.991271  4412 log.cc:927] Time spent T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.336s	user 0.000s	sys 0.000s
I20260709 13:00:00.993330  1531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49310 (request call id 538) took 1227 ms. Trace:
I20260709 13:00:00.993732  1531 rpcz_store.cc:276] 0709 12:59:59.765566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:00.151166 (+385600us) service_pool.cc:224] Handling call
0709 13:00:00.151526 (+   360us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:00.152885 (+  1359us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:00.153045 (+   160us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:00.206512 (+ 53467us) log.cc:844] Serialized 52 byte log entry
0709 13:00:00.477154 (+270642us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:00.547045 (+ 69891us) log.cc:844] Serialized 14 byte log entry
0709 13:00:00.558071 (+ 11026us) log.cc:844] Serialized 14 byte log entry
0709 13:00:00.558479 (+   408us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:00.558557 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:00.993080 (+434523us) raft_consensus.cc:1685] finished
0709 13:00:00.993102 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:00.993268 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7933,"prepare.queue_time_us":73904,"raft.queue_time_us":4494,"raft.run_cpu_time_us":270,"raft.run_wall_time_us":37596,"spinlock_wait_cycles":53548160,"thread_start_us":270051,"threads_started":1,"wal-append.queue_time_us":389520}
I20260709 13:00:00.905952  4402 raft_consensus.cc:3060] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:00.757153  4413 consensus_queue.cc:1048] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.239s
I20260709 13:00:00.702780  4175 raft_consensus.cc:3060] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:00.656126  4105 raft_consensus.cc:493] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:00.750617  4190 raft_consensus.cc:3060] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:00.751890  4350 raft_consensus.cc:493] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:00.830029  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:00.759298  4194 raft_consensus.cc:2804] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:00.768990  1523 rpcz_store.cc:276] 0709 12:59:59.430250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:00.133843 (+703593us) service_pool.cc:224] Handling call
0709 13:00:00.161187 (+ 27344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:00.161387 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:00:00.448244 (+286857us) log.cc:844] Serialized 14 byte log entry
0709 13:00:00.658235 (+209991us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:00.658300 (+    65us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:00.658344 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:00.658408 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:00.658536 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":155089,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":3834,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":47523,"thread_start_us":496148,"threads_started":2}
I20260709 13:00:00.847069  4120 consensus_queue.cc:1048] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:00.574406  4033 raft_consensus.cc:515] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:00.794893  1601 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36200 (request call id 1922) took 3259 ms (client timeout 1870 ms). Trace:
I20260709 13:00:00.897647  1570 leader_election.cc:304] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:00:00.915661  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 211844us
I20260709 13:00:00.656608  4286 raft_consensus.cc:515] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:00.821429  4284 raft_consensus.cc:697] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 5 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:00.820395  4124 raft_consensus.cc:2749] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:00.957135  2226 raft_consensus.cc:1240] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:00.964303  1526 raft_consensus.cc:1275] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:00:00.850579  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:00.961175  2227 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 6 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 6.
I20260709 13:00:00.911768  4282 raft_consensus.cc:2804] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:01.006261  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:01.057863  1527 raft_consensus.cc:2410] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:00:00.933197  4405 raft_consensus.cc:3060] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:00.953755  4324 raft_consensus.cc:2804] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:00:01.028937  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 152158us
W20260709 13:00:01.017791  4293 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.026s	sys 0.061s
W20260709 13:00:01.036432  1601 rpcz_store.cc:269] 0709 12:59:57.495084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:57.495268 (+   184us) service_pool.cc:224] Handling call
0709 13:00:00.754404 (+3259136us) spinlock_profiling.cc:243] Waited 2.54 s on lock 0x7b54001aa9d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:00.754619 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5834073344}
I20260709 13:00:01.018607  4105 raft_consensus.cc:3060] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:00.907986  4269 consensus_queue.cc:1048] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.154s
I20260709 13:00:01.064818  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:01.066452  1599 raft_consensus.cc:1240] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:01.031168  4194 raft_consensus.cc:493] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
W20260709 13:00:01.083384  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 413942us
I20260709 13:00:01.080263  4194 raft_consensus.cc:3060] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:01.093247  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 13:00:01.075304  4293 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.026s	sys 0.062s
I20260709 13:00:01.062390  4282 raft_consensus.cc:493] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:01.068162  4396 raft_consensus.cc:2749] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:01.113047  1570 leader_election.cc:304] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:00.914897  4374 consensus_queue.cc:1048] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.166s
I20260709 13:00:01.034216  4350 raft_consensus.cc:515] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:01.123196  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:01.082983  4324 raft_consensus.cc:697] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 5 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:01.092511  4108 raft_consensus.cc:493] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:01.128598  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 183965us
I20260709 13:00:01.096760  4282 raft_consensus.cc:3060] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:01.118046  4359 leader_election.cc:290] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:01.158775  2218 raft_consensus.cc:1240] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 6. Current term is 7. Ops: []
W20260709 13:00:01.166527  4425 log.cc:927] Time spent T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
W20260709 13:00:01.167966  4415 log.cc:927] Time spent T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
W20260709 13:00:01.169094  2224 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50326 (request call id 666) took 1284 ms (client timeout 1699 ms). Trace:
W20260709 13:00:01.169595  2224 rpcz_store.cc:269] 0709 12:59:59.884499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:59.884614 (+   115us) service_pool.cc:224] Handling call
0709 13:00:01.168857 (+1284243us) spinlock_profiling.cc:243] Waited 684 ms on lock 0x7b540054ef54. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:01.169025 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1572067712}
I20260709 13:00:01.067286  4288 consensus_queue.cc:237] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:01.177788  1524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49310 (request call id 539) took 1412 ms. Trace:
I20260709 13:00:01.138504  4108 raft_consensus.cc:515] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:01.169212  4396 raft_consensus.cc:2804] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:01.186980  4033 leader_election.cc:290] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:01.187471  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:01.188261  4324 consensus_queue.cc:237] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:01.190305  4350 leader_election.cc:290] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:00:01.195271  4417 log.cc:927] Time spent T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:00:01.196225  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36200 (request call id 1932) took 2677 ms. Trace:
I20260709 13:00:01.259802  1602 rpcz_store.cc:276] 0709 12:59:58.518759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:59.358479 (+839720us) service_pool.cc:224] Handling call
0709 13:00:00.429947 (+1071468us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:00.430135 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:00.430158 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:00.430201 (+    43us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:00.430237 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:00.430289 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:01.196041 (+765752us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54003b1ad0. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b28ad 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:01.196165 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2441251200}
I20260709 13:00:01.196597  4286 leader_election.cc:290] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:01.196902  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36194 (request call id 1466) took 1420 ms. Trace:
I20260709 13:00:01.261330  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:01.261674  1607 rpcz_store.cc:276] 0709 12:59:59.776245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:59.888554 (+112309us) service_pool.cc:224] Handling call
0709 13:00:01.196710 (+1308156us) spinlock_profiling.cc:243] Waited 281 ms on lock 0x7b54000daf54. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:01.196844 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":646031104}
I20260709 13:00:01.262095  1527 raft_consensus.cc:2468] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 5.
W20260709 13:00:01.197499  4426 log.cc:927] Time spent T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 13:00:01.198462  4421 log.cc:927] Time spent T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.140s	user 0.000s	sys 0.000s
I20260709 13:00:01.203486  4296 leader_election.cc:290] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:00:01.203827  4340 consensus_meta.cc:287] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.783s	user 0.011s	sys 0.000s
I20260709 13:00:01.157290  4284 consensus_queue.cc:237] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:01.210052  4414 log.cc:927] Time spent T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.382s	user 0.000s	sys 0.001s
I20260709 13:00:01.203847  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49170 (request call id 1771) took 1088 ms. Trace:
I20260709 13:00:01.266865  1676 rpcz_store.cc:276] 0709 13:00:00.115501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:00.115667 (+   166us) service_pool.cc:224] Handling call
0709 13:00:00.116048 (+   381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:00.366932 (+250884us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:00.366966 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:00.369674 (+  2708us) log.cc:844] Serialized 26 byte log entry
0709 13:00:00.751472 (+381798us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:00.751512 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:00.751576 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:01.203626 (+452050us) raft_consensus.cc:1685] finished
0709 13:00:01.203645 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:01.203783 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":52987,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":119,"thread_start_us":568406,"threads_started":2,"wal-append.queue_time_us":709801}
I20260709 13:00:01.203275  1600 raft_consensus.cc:1275] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:00:01.122121  4311 consensus_queue.cc:1048] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 13:00:01.268965  4311 consensus_queue.cc:1243] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 log is divergent from this leader: its last log entry 4.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:00:01.222498  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:01.216491  1524 rpcz_store.cc:276] 0709 12:59:59.765834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:00.156248 (+390414us) service_pool.cc:224] Handling call
0709 13:00:00.197616 (+ 41368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:00.215268 (+ 17652us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:00.215296 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:00.251678 (+ 36382us) log.cc:844] Serialized 26 byte log entry
0709 13:00:00.753701 (+502023us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:00.753743 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:00.753806 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:01.170098 (+416292us) raft_consensus.cc:1685] finished
0709 13:00:01.170114 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:01.177718 (+  7604us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":945,"raft.run_cpu_time_us":234,"raft.run_wall_time_us":36124,"thread_start_us":410043,"threads_started":1,"wal-append.queue_time_us":634270}
W20260709 13:00:01.253626  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 95282.3us
I20260709 13:00:01.276929  4105 raft_consensus.cc:515] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:01.279543  2224 raft_consensus.cc:1240] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 5. Current term is 6. Ops: []
W20260709 13:00:01.287707  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 579570us
I20260709 13:00:01.290787  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:01.293282  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:01.223925  4396 raft_consensus.cc:493] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:01.157104  4432 consensus_queue.cc:1059] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.145s
I20260709 13:00:01.307396  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:01.307999  1524 raft_consensus.cc:3060] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:01.309122  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:01.303871  1572 leader_election.cc:304] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:01.306051  2190 leader_election.cc:304] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:01.305449  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:01.313550  1572 leader_election.cc:304] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:01.306931  4396 raft_consensus.cc:3060] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:01.355854  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:01.356623  1526 raft_consensus.cc:2376] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 7. Re-sending same reply.
I20260709 13:00:01.358414  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:01.359014  1526 raft_consensus.cc:2376] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 6. Re-sending same reply.
I20260709 13:00:01.360406  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:01.364766  1497 leader_election.cc:304] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:01.366225  1497 leader_election.cc:304] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:01.377018  4264 consensus_queue.cc:1059] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:00:01.378983  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 266032us
I20260709 13:00:01.385953  1497 leader_election.cc:304] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:01.379966  1570 leader_election.cc:304] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:01.317529  4296 raft_consensus.cc:2749] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:01.390504  1646 leader_election.cc:304] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:01.395212  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:01.401783  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:01.403054  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:01.396529  1497 leader_election.cc:304] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:01.534423  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:01.535101  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 13:00:01.535122  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 144695us
I20260709 13:00:01.536938  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:01.539979  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:01.541249  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:01.541956  1526 raft_consensus.cc:2468] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 7.
W20260709 13:00:01.547693  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 151241us
I20260709 13:00:01.548751  1497 leader_election.cc:304] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:01.550638  1532 raft_consensus.cc:1275] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:00:01.389473  4429 raft_consensus.cc:2804] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:01.320518  4405 raft_consensus.cc:515] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:01.556631  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:01.572359  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:01.548414  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 569) took 1414 ms. Trace:
I20260709 13:00:01.394142  4342 raft_consensus.cc:493] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:00:01.573096  1526 raft_consensus.cc:2393] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 6: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:00:01.389683  4439 raft_consensus.cc:2749] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:01.536039  4350 raft_consensus.cc:2749] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:01.546350  4033 raft_consensus.cc:2804] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:01.549671  4311 raft_consensus.cc:2749] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:01.609182  1605 rpcz_store.cc:276] 0709 13:00:00.134084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:00.288153 (+154069us) service_pool.cc:224] Handling call
0709 13:00:00.317955 (+ 29802us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:00.318256 (+   301us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:00.318283 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:00.336802 (+ 18519us) log.cc:844] Serialized 26 byte log entry
0709 13:00:00.750839 (+414037us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:00.750881 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:00.750958 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:01.548205 (+797247us) raft_consensus.cc:1685] finished
0709 13:00:01.548223 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:01.548359 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":434,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":13749,"thread_start_us":365751,"threads_started":1,"wal-append.queue_time_us":659209}
I20260709 13:00:01.623301  1527 raft_consensus.cc:3060] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:01.553332  4387 raft_consensus.cc:493] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:01.561161  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:01.560745  4220 raft_consensus.cc:2749] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:01.561594  4429 raft_consensus.cc:493] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:01.630240  4033 raft_consensus.cc:697] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 8 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
W20260709 13:00:01.679329  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 365861us
I20260709 13:00:01.562901  4436 raft_consensus.cc:2804] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:00:01.685504  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 305638us
W20260709 13:00:01.628521  4190 consensus_meta.cc:287] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.597s	user 0.008s	sys 0.001s
I20260709 13:00:01.699399  1527 raft_consensus.cc:2468] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 7.
I20260709 13:00:01.611810  4404 consensus_queue.cc:1048] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.076s
I20260709 13:00:01.700773  1570 leader_election.cc:304] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:01.635949  4446 raft_consensus.cc:2804] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:01.683640  4350 raft_consensus.cc:2749] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:01.711280  1570 leader_election.cc:304] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:01.691896  4429 raft_consensus.cc:3060] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:01.621832  4342 raft_consensus.cc:515] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:00:01.707444  4431 log.cc:927] Time spent T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.452s	user 0.001s	sys 0.001s
I20260709 13:00:01.703622  4436 raft_consensus.cc:493] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:01.733142  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 416501us
I20260709 13:00:01.696324  4105 leader_election.cc:290] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 6 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:00:01.707880  4380 consensus_meta.cc:287] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b: Time spent flushing consensus metadata: real 0.990s	user 0.010s	sys 0.000s
I20260709 13:00:01.738471  1570 leader_election.cc:304] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:00:01.742101  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 193426us
I20260709 13:00:01.746577  1497 leader_election.cc:304] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:01.747951  1497 leader_election.cc:304] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:01.748955  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:01.749382  1497 leader_election.cc:304] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:01.749725  1599 raft_consensus.cc:2393] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 8: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:00:01.750900  1605 raft_consensus.cc:1275] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:00:01.685077  4387 raft_consensus.cc:515] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:01.759753  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:01.710381  4446 raft_consensus.cc:493] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:01.761356  1497 leader_election.cc:304] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:01.767581  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:01.768255  1601 raft_consensus.cc:2468] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 5.
I20260709 13:00:01.761318  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:01.715163  4108 leader_election.cc:290] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:01.771070  1607 raft_consensus.cc:2468] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 2.
I20260709 13:00:01.725773  4311 raft_consensus.cc:2749] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:01.778543  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:01.779332  1599 raft_consensus.cc:2468] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 5.
I20260709 13:00:01.783834  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:01.706967  4190 raft_consensus.cc:515] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:01.751339  4436 raft_consensus.cc:3060] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:01.790264  4311 raft_consensus.cc:2749] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:01.792095  4342 leader_election.cc:290] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
W20260709 13:00:01.797580  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 45574.8us
W20260709 13:00:01.809559  2191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:01.790342  4220 raft_consensus.cc:2804] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:01.783900  4108 raft_consensus.cc:2749] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:01.774186  4446 raft_consensus.cc:3060] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:01.780836  4430 raft_consensus.cc:493] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:00:01.805318  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:01.788488  1599 raft_consensus.cc:1275] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:00:01.756119  4380 raft_consensus.cc:515] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:01.834586  1601 raft_consensus.cc:3060] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:01.835605  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:01.836350  1599 raft_consensus.cc:2468] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 6.
W20260709 13:00:01.828974  1570 leader_election.cc:336] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.570s (SENT)
W20260709 13:00:01.812547  4402 consensus_meta.cc:287] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.791s	user 0.006s	sys 0.004s
W20260709 13:00:01.840906  1524 consensus_meta.cc:287] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent flushing consensus metadata: real 0.525s	user 0.007s	sys 0.000s
I20260709 13:00:01.841475  1524 raft_consensus.cc:2468] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 8.
W20260709 13:00:01.811817  4384 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.001s	sys 0.011s
I20260709 13:00:01.765980  4033 consensus_queue.cc:237] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:01.817402  4220 raft_consensus.cc:493] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:01.829527  4194 consensus_meta.cc:287] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b: Time spent flushing consensus metadata: real 0.710s	user 0.008s	sys 0.002s
I20260709 13:00:01.862087  1601 raft_consensus.cc:2468] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 7.
W20260709 13:00:01.846454  4384 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.002s	sys 0.011s
W20260709 13:00:01.852933  4437 log.cc:927] Time spent T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
W20260709 13:00:01.863276  4440 log.cc:927] Time spent T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.309s	user 0.000s	sys 0.001s
I20260709 13:00:01.847369  4430 raft_consensus.cc:515] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:01.863214  4220 raft_consensus.cc:3060] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:01.865998  4194 raft_consensus.cc:515] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:01.901196  4405 leader_election.cc:290] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:01.903630  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:01.948887  1601 raft_consensus.cc:3060] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:01.903772  4380 leader_election.cc:290] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 6 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:01.904706  4461 raft_consensus.cc:2804] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:01.905260  4190 leader_election.cc:290] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:01.856370  4439 raft_consensus.cc:2804] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:00:01.941404  4175 consensus_meta.cc:287] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.915s	user 0.005s	sys 0.005s
I20260709 13:00:01.973738  4175 raft_consensus.cc:515] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:01.974805  1602 raft_consensus.cc:1240] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 5. Current term is 6. Ops: []
W20260709 13:00:01.976433  4382 consensus_meta.cc:287] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b: Time spent flushing consensus metadata: real 1.006s	user 0.007s	sys 0.007s
I20260709 13:00:01.976930  4382 raft_consensus.cc:2749] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:01.978715  4175 leader_election.cc:290] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:01.952880  4430 leader_election.cc:290] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:01.981000  1531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43008 (request call id 1766) took 1433 ms. Trace:
I20260709 13:00:01.836079  4342 raft_consensus.cc:493] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:01.976965  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:01.863361  4465 consensus_queue.cc:1059] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:00:01.932766  1598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36200 (request call id 1951) took 1521 ms. Trace:
W20260709 13:00:01.933478  4448 log.cc:927] Time spent T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.148s	user 0.005s	sys 0.000s
I20260709 13:00:01.847750  4402 raft_consensus.cc:515] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:02.008795  1678 raft_consensus.cc:2393] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 7: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:00:01.935109  3970 leader_election.cc:290] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:01.931452  4464 raft_consensus.cc:2749] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:01.982638  2219 raft_consensus.cc:2468] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 9.
W20260709 13:00:01.943539  1606 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36200 (request call id 1942) took 1563 ms (client timeout 1950 ms). Trace:
I20260709 13:00:01.945597  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36200 (request call id 1950) took 1534 ms. Trace:
W20260709 13:00:01.947311  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 186040us
I20260709 13:00:01.942091  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:01.960433  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:01.961073  4457 consensus_queue.cc:1059] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 13:00:02.015281  1497 leader_election.cc:304] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
W20260709 13:00:02.013945  1606 rpcz_store.cc:269] 0709 13:00:00.380155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:00.402567 (+ 22412us) service_pool.cc:224] Handling call
0709 13:00:01.943362 (+1540795us) spinlock_profiling.cc:243] Waited 8.43 ms on lock 0x7b540041fd54. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:01.943478 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19391360}
I20260709 13:00:02.016458  1497 leader_election.cc:304] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:02.016603  4457 raft_consensus.cc:3055] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:02.016709  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:02.016986  4457 raft_consensus.cc:740] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:02.014256  1603 rpcz_store.cc:276] 0709 13:00:00.411392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:00.981621 (+570229us) service_pool.cc:224] Handling call
0709 13:00:00.981953 (+   332us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:00.982322 (+   369us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:00.982359 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:00.995518 (+ 13159us) log.cc:844] Serialized 52 byte log entry
0709 13:00:01.152206 (+156688us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:01.152243 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:01.152316 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:01.945361 (+793045us) raft_consensus.cc:1685] finished
0709 13:00:01.945381 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:01.945536 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2836,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":87,"thread_start_us":156315,"threads_started":1,"wal-append.queue_time_us":316305}
W20260709 13:00:01.939138  3977 consensus_meta.cc:287] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.984s	user 0.013s	sys 0.000s
I20260709 13:00:01.863919  2223 raft_consensus.cc:1240] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
W20260709 13:00:01.936580  4396 consensus_meta.cc:287] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.543s	user 0.010s	sys 0.000s
I20260709 13:00:01.969833  4429 raft_consensus.cc:515] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:01.970705  4439 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:01.972622  4450 log.cc:927] Time spent T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.116s	user 0.002s	sys 0.000s
I20260709 13:00:01.983338  1531 rpcz_store.cc:276] 0709 13:00:00.547966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:00.995514 (+447548us) service_pool.cc:224] Handling call
0709 13:00:00.995811 (+   297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:01.157183 (+161372us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:01.157212 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:01.178294 (+ 21082us) log.cc:844] Serialized 26 byte log entry
0709 13:00:01.622798 (+444504us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:01.622844 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:01.623712 (+   868us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:01.980757 (+357045us) raft_consensus.cc:1685] finished
0709 13:00:01.980778 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:01.980932 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":163447,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":41246,"thread_start_us":486013,"threads_started":2,"wal-append.queue_time_us":514629}
I20260709 13:00:01.988977  1598 rpcz_store.cc:276] 0709 13:00:00.411802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:00.983374 (+571572us) service_pool.cc:224] Handling call
0709 13:00:00.983688 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:00.984029 (+   341us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:00.984056 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:00.984511 (+   455us) log.cc:844] Serialized 26 byte log entry
0709 13:00:01.371004 (+386493us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:00:01.371049 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:01.371126 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:01.932539 (+561413us) raft_consensus.cc:1685] finished
0709 13:00:01.932561 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:01.932706 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1317,"raft.run_cpu_time_us":51,"raft.run_wall_time_us":50,"thread_start_us":386086,"threads_started":1,"wal-append.queue_time_us":626507}
I20260709 13:00:01.988610  1602 raft_consensus.cc:2468] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 6.
I20260709 13:00:01.992390  4446 raft_consensus.cc:515] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:02.058993  4446 leader_election.cc:290] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:00:01.974810  2222 consensus_meta.cc:287] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b: Time spent flushing consensus metadata: real 1.002s	user 0.006s	sys 0.005s
I20260709 13:00:02.059816  2222 raft_consensus.cc:2468] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 6.
W20260709 13:00:02.060441  2222 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50326 (request call id 673) took 1552 ms (client timeout 1827 ms). Trace:
W20260709 13:00:02.060832  2222 rpcz_store.cc:269] 0709 13:00:00.508163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:00.512126 (+  3963us) service_pool.cc:224] Handling call
0709 13:00:02.060370 (+1548244us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:02.062122  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:02.062970  2226 raft_consensus.cc:1240] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:02.013684  2220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50326 (request call id 671) took 1532 ms. Trace:
I20260709 13:00:01.994081  4456 raft_consensus.cc:493] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:01.995857  4331 consensus_meta.cc:287] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b: Time spent flushing consensus metadata: real 0.979s	user 0.004s	sys 0.010s
I20260709 13:00:01.976296  4194 leader_election.cc:290] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:00:02.000543  4459 log.cc:927] Time spent T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 13:00:01.954777  4461 raft_consensus.cc:493] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:02.003549  4220 raft_consensus.cc:515] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:01.997908  4350 raft_consensus.cc:493] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:02.006860  4430 raft_consensus.cc:493] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:01.943061  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:02.012398  1601 raft_consensus.cc:2468] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 5.
I20260709 13:00:02.009959  4402 leader_election.cc:290] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:02.014066  4342 raft_consensus.cc:515] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:01.943601  4282 consensus_meta.cc:287] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.760s	user 0.008s	sys 0.004s
I20260709 13:00:02.097210  4350 raft_consensus.cc:515] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:02.100636  4282 raft_consensus.cc:515] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:02.101608  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:02.021298  2225 raft_consensus.cc:2468] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 6.
I20260709 13:00:02.019013  2190 leader_election.cc:304] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:02.015962  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:02.019380  1606 raft_consensus.cc:2393] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 7: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:00:02.103442  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:02.104176  2225 raft_consensus.cc:2393] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 7: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:00:02.103730  1572 leader_election.cc:304] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:00:02.103734  2224 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2228d923442c4e439f7f227db910dad8"
dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
mode: GRACEFUL
new_leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:47682
I20260709 13:00:02.105321  2224 raft_consensus.cc:606] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 4 LEADER]: Received request to transfer leadership to TS e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:02.105438  2225 raft_consensus.cc:1240] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:02.106566  1676 raft_consensus.cc:2393] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 5: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:00:02.019834  1497 leader_election.cc:304] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:02.054553  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:02.017144  4464 raft_consensus.cc:2804] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:00:02.064450  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 209900us
I20260709 13:00:01.993805  4387 leader_election.cc:290] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:02.014108  4472 raft_consensus.cc:3055] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:02.110590  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:01.999363  4436 raft_consensus.cc:515] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:02.014256  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:02.086568  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:02.051136  4465 raft_consensus.cc:2804] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:02.056026  4439 raft_consensus.cc:3060] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:02.093919  2227 raft_consensus.cc:2393] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 4: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:00:02.017858  4457 consensus_queue.cc:260] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:02.064129  4406 raft_consensus.cc:493] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:02.097625  4407 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.988s	user 0.015s	sys 0.015s
I20260709 13:00:02.087800  4331 raft_consensus.cc:515] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:02.090096  4461 raft_consensus.cc:3060] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:02.097756  4430 raft_consensus.cc:515] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:02.087538  4456 raft_consensus.cc:515] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:02.099823  4429 leader_election.cc:290] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 6 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:02.099962  4342 leader_election.cc:290] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:02.100184  4220 leader_election.cc:290] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:00:02.109061  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 90122us
I20260709 13:00:02.111917  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:02.055846  4396 raft_consensus.cc:515] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:02.054595  3977 raft_consensus.cc:515] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:02.081120  2222 raft_consensus.cc:3060] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:02.115643  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:02.117161  4406 raft_consensus.cc:515] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:02.118074  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:02.204010  1673 raft_consensus.cc:2468] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 6.
I20260709 13:00:02.118750  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:02.119326  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:02.205871  1672 raft_consensus.cc:2468] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 5.
I20260709 13:00:02.119962  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:02.120573  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:02.117178  3970 consensus_queue.cc:1059] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:00:02.125521  4436 leader_election.cc:290] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:02.110044  4472 raft_consensus.cc:740] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:00:02.096444  4296 raft_consensus.cc:3055] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:02.126627  1675 raft_consensus.cc:1240] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:02.075157  2220 rpcz_store.cc:276] 0709 13:00:00.481593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:00.499591 (+ 17998us) service_pool.cc:224] Handling call
0709 13:00:00.499971 (+   380us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:00.973421 (+473450us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:00.996136 (+ 22715us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:01.116794 (+120658us) log.cc:844] Serialized 52 byte log entry
0709 13:00:01.609995 (+493201us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:01.860462 (+250467us) log.cc:844] Serialized 14 byte log entry
0709 13:00:01.948654 (+ 88192us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:01.955503 (+  6849us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:02.013410 (+ 57907us) raft_consensus.cc:1685] finished
0709 13:00:02.013439 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:02.013609 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34856,"prepare.queue_time_us":367078,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":60412,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":166,"thread_start_us":896083,"threads_started":3,"wal-append.queue_time_us":573550}
I20260709 13:00:02.150167  2227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50310 (request call id 586) took 1019 ms. Trace:
I20260709 13:00:02.112363  3935 raft_consensus.cc:2804] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:02.157235  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
W20260709 13:00:02.128033  4407 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.038s	user 0.015s	sys 0.016s
I20260709 13:00:02.102583  4282 leader_election.cc:290] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:02.175643  4374 raft_consensus.cc:493] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:02.192972  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:02.240772  2218 raft_consensus.cc:2393] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 6: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:00:02.240476  4374 raft_consensus.cc:515] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:02.193639  4396 leader_election.cc:290] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:02.166479  1678 raft_consensus.cc:2468] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 9.
I20260709 13:00:02.194418  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:02.115480  4465 raft_consensus.cc:493] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:02.115805  4175 raft_consensus.cc:2804] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:02.195212  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:02.197590  1646 leader_election.cc:304] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:00:02.152165  4402 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:02.206063  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:02.164932  4387 raft_consensus.cc:2749] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:02.210022  4269 raft_consensus.cc:493] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:02.247002  1674 raft_consensus.cc:3060] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:02.227769  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
W20260709 13:00:02.276959  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 79460.8us
I20260709 13:00:02.228744  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:02.195693  4457 raft_consensus.cc:3060] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:02.243808  2191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:02.270123  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:02.119237  4484 raft_consensus.cc:493] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:02.229995  2227 rpcz_store.cc:276] 0709 13:00:01.131112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:01.132148 (+  1036us) service_pool.cc:224] Handling call
0709 13:00:01.942919 (+810771us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b5800015c98. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a1548ee9c 00007f6a1548ea5b 00007f6a1e3a7c09 00007f6a1d501ee0 00007f6a1d5cb0ab 00007f6a1d5cb131 00007f6a1d5790a0 00007f6a1d578984 00007f6a16af36d4 00007f6a16af3662
0709 13:00:02.150085 (+207166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":28205184}
I20260709 13:00:02.198340  4220 raft_consensus.cc:493] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:02.234182  1571 leader_election.cc:304] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:02.236604  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:02.239197  4455 raft_consensus.cc:493] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:02.276548  1524 raft_consensus.cc:2393] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 6: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:00:02.246623  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:02.228046  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:00:02.232059  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 212320us
I20260709 13:00:02.293673  1497 leader_election.cc:304] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:02.229317  4296 raft_consensus.cc:740] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
W20260709 13:00:02.257519  4462 log.cc:927] Time spent T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.352s	user 0.000s	sys 0.002s
W20260709 13:00:02.247641  4481 log.cc:927] Time spent T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:00:02.334272  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:02.343066  1531 raft_consensus.cc:2468] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 4.
I20260709 13:00:02.298492  1497 leader_election.cc:304] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:02.251370  2221 raft_consensus.cc:2368] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 5. Current term is 6.
I20260709 13:00:02.301252  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:02.212699  4464 raft_consensus.cc:697] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:00:02.351943  1607 raft_consensus.cc:2393] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 8: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:00:02.345826  4441 raft_consensus.cc:493] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:02.243635  3935 raft_consensus.cc:697] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 7 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
W20260709 13:00:02.344340  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 45940us
I20260709 13:00:02.344908  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:02.355708  1673 raft_consensus.cc:2410] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:00:02.278625  4465 raft_consensus.cc:3060] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:02.245106  4331 leader_election.cc:290] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:02.355859  1497 leader_election.cc:304] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:02.282490  4175 raft_consensus.cc:493] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:02.242607  4374 leader_election.cc:290] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:02.253829  4380 raft_consensus.cc:493] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:02.333977  4387 raft_consensus.cc:493] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:02.296416  4282 raft_consensus.cc:2804] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:02.367908  1673 raft_consensus.cc:1240] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 5 LEADER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:02.368891  2221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50310 (request call id 582) took 1271 ms. Trace:
I20260709 13:00:02.372166  2221 rpcz_store.cc:276] 0709 13:00:01.097305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:01.117778 (+ 20473us) service_pool.cc:224] Handling call
0709 13:00:02.157108 (+1039330us) spinlock_profiling.cc:243] Waited 39.4 ms on lock 0x7b5800015c98. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a1548eb71 00007f6a1548eeee 0000000000375939 00007f6a1d5021e0 00007f6a1d5cb0c4 00007f6a1d5cb131 00007f6a1d5790a0 00007f6a1d578984 00007f6a16af36d4 00007f6a16af3662
0709 13:00:02.366062 (+208954us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":90711680}
I20260709 13:00:02.360142  4441 raft_consensus.cc:515] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:02.376695  4441 leader_election.cc:290] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:02.376510  4439 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:02.303848  4455 raft_consensus.cc:515] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:02.363075  4175 raft_consensus.cc:3060] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:02.385856  2218 raft_consensus.cc:1240] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:02.367835  4296 consensus_queue.cc:260] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:02.369966  4387 raft_consensus.cc:515] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:02.360013  4436 consensus_queue.cc:1059] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 13:00:02.371022  3935 consensus_queue.cc:237] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:02.371891  4490 raft_consensus.cc:2804] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:02.295337  4220 raft_consensus.cc:515] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:02.431677  1674 raft_consensus.cc:2468] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 8.
W20260709 13:00:02.466255  1570 leader_election.cc:336] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 2.825s (SENT)
I20260709 13:00:02.294299  4269 raft_consensus.cc:515] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:02.372376  4485 raft_consensus.cc:2749] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:02.471740  1570 leader_election.cc:304] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:02.291987  4402 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 13:00:02.371464  4380 raft_consensus.cc:515] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:02.301656  4484 raft_consensus.cc:515] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:02.467242  4490 raft_consensus.cc:493] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:02.485200  4490 raft_consensus.cc:3060] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:02.487496  4485 consensus_queue.cc:1048] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:02.492376  4455 leader_election.cc:290] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:02.493124  3977 leader_election.cc:290] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:02.495608  1600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36200 (request call id 1947) took 2085 ms. Trace:
I20260709 13:00:02.495911  2222 raft_consensus.cc:2468] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 8.
I20260709 13:00:02.496027  1600 rpcz_store.cc:276] 0709 13:00:00.410526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:00.969119 (+558593us) service_pool.cc:224] Handling call
0709 13:00:01.202930 (+233811us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:01.268575 (+ 65645us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:02.495408 (+1226833us) spinlock_profiling.cc:243] Waited 190 ms on lock 0x7b54000daf50. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b28ad 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:02.495545 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":436550528}
I20260709 13:00:02.497865  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43010 (request call id 1845) took 1134 ms. Trace:
I20260709 13:00:02.498235  1532 rpcz_store.cc:276] 0709 13:00:01.363508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:01.555526 (+192018us) service_pool.cc:224] Handling call
0709 13:00:01.610563 (+ 55037us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:01.787459 (+176896us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:01.787493 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:01.811563 (+ 24070us) log.cc:844] Serialized 26 byte log entry
0709 13:00:02.091083 (+279520us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:02.497307 (+406224us) log.cc:844] Serialized 14 byte log entry
0709 13:00:02.497516 (+   209us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:02.497600 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:02.497637 (+    37us) raft_consensus.cc:1685] finished
0709 13:00:02.497647 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:02.497809 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":406528,"prepare.queue_time_us":406040,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":25,"raft.queue_time_us":73502,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":9163,"thread_start_us":407155,"threads_started":2,"wal-append.queue_time_us":377465}
I20260709 13:00:02.500851  4461 raft_consensus.cc:515] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:00:02.504400  4476 log.cc:927] Time spent T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 13:00:02.507550  1672 raft_consensus.cc:1240] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:00:02.508934  1672 raft_consensus.cc:1240] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:02.509023  1601 raft_consensus.cc:2468] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 6.
I20260709 13:00:02.510108  1672 raft_consensus.cc:1240] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:02.511475  4387 leader_election.cc:290] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:02.511811  1678 raft_consensus.cc:1240] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:02.512036  4387 raft_consensus.cc:493] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:02.512516  4387 raft_consensus.cc:515] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:02.517076  2224 raft_consensus.cc:1240] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:02.243824  4472 consensus_queue.cc:260] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:02.523532  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 289444us
I20260709 13:00:02.471407  4296 raft_consensus.cc:3060] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:02.533224  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:02.534519  4324 raft_consensus.cc:2804] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:02.535106  4324 raft_consensus.cc:493] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:02.535563  4324 raft_consensus.cc:3060] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:02.537528  4490 raft_consensus.cc:515] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:02.535028  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:02.539093  1672 raft_consensus.cc:2468] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 4.
I20260709 13:00:02.540014  3970 raft_consensus.cc:2749] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:02.540132  4340 raft_consensus.cc:3055] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:02.540686  4340 raft_consensus.cc:740] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:02.541204  4387 leader_election.cc:290] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:00:02.540150  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 73984.5us
I20260709 13:00:02.541857  4387 consensus_queue.cc:1059] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:02.542579  4387 consensus_queue.cc:1243] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Peer ddf11fc190dd4b898773379c6b129d90 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:00:02.543339  4490 leader_election.cc:290] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:02.545827  4461 leader_election.cc:290] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:02.549741  1679 raft_consensus.cc:2468] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 5.
I20260709 13:00:02.498236  4439 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:02.552297  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:02.553221  2226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50310 (request call id 580) took 1462 ms. Trace:
I20260709 13:00:02.574805  1605 raft_consensus.cc:3060] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:02.466185  4282 raft_consensus.cc:697] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 6 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:02.574720  2226 rpcz_store.cc:276] 0709 13:00:01.090953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:01.091133 (+   180us) service_pool.cc:224] Handling call
0709 13:00:02.062773 (+971640us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:02.063414 (+   641us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:02.552989 (+489575us) spinlock_profiling.cc:243] Waited 971 ms on lock 0x7b540069fd50. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b28ad 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:02.553153 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2233858816}
I20260709 13:00:02.580251  4357 raft_consensus.cc:3060] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:02.586931  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 326662us
I20260709 13:00:02.520382  4430 leader_election.cc:290] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:00:02.585981  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 220394us
I20260709 13:00:02.635272  1497 leader_election.cc:304] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:02.595630  1605 raft_consensus.cc:2468] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 6.
I20260709 13:00:02.637763  1497 leader_election.cc:304] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:02.548976  4464 consensus_queue.cc:237] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:02.642140  1601 raft_consensus.cc:1275] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:00:02.648540  4406 leader_election.cc:290] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:02.650413  1497 leader_election.cc:304] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
W20260709 13:00:02.651269  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 96431us
I20260709 13:00:02.657624  1497 leader_election.cc:304] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:02.658536  1571 leader_election.cc:304] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
W20260709 13:00:02.633852  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 169420us
I20260709 13:00:02.541616  4340 consensus_queue.cc:260] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:02.661201  4340 raft_consensus.cc:3060] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:02.661511  2192 leader_election.cc:304] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:00:02.662742  4293 consensus_queue.cc:1059] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:02.664003  1601 raft_consensus.cc:1240] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:02.664487  1605 raft_consensus.cc:1240] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:02.666056  4327 consensus_queue.cc:1048] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:02.667598  4327 raft_consensus.cc:2804] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:02.662041  4175 raft_consensus.cc:515] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:02.677845  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:02.678447  1599 raft_consensus.cc:3060] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:02.678725  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:02.679483  1605 raft_consensus.cc:2410] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:00:02.681845  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:02.682487  1606 raft_consensus.cc:3060] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:02.678118  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:02.685912  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:02.686523  1598 raft_consensus.cc:2468] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 4.
I20260709 13:00:02.688050  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:02.692530  1606 raft_consensus.cc:2468] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 7.
I20260709 13:00:02.676685  1571 leader_election.cc:304] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:02.696298  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:02.697041  1600 raft_consensus.cc:2393] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 6: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:00:02.672159  4439 raft_consensus.cc:2749] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:02.672655  4327 raft_consensus.cc:697] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 7 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:02.699590  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
W20260709 13:00:02.698494  1570 leader_election.cc:336] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.537s (SENT)
I20260709 13:00:02.703706  1570 leader_election.cc:304] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:02.675827  3934 raft_consensus.cc:2749] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:02.683981  3970 raft_consensus.cc:2804] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:02.709942  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:02.711042  1672 raft_consensus.cc:3060] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:02.714226  2191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:02.715656  4492 raft_consensus.cc:2804] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:02.716146  4492 raft_consensus.cc:493] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:02.716506  4492 raft_consensus.cc:3060] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:02.725992  3934 consensus_queue.cc:1059] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:02.695921  4488 raft_consensus.cc:2749] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:02.733433  4424 raft_consensus.cc:493] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:02.734064  4424 raft_consensus.cc:515] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:02.734846  4439 raft_consensus.cc:2804] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:02.735306  4439 raft_consensus.cc:493] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:02.735663  4439 raft_consensus.cc:3060] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:02.741549  1672 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 8.
I20260709 13:00:02.737066  4465 raft_consensus.cc:515] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:02.747901  4466 raft_consensus.cc:3055] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:02.749270  4465 leader_election.cc:290] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:02.740199  4492 raft_consensus.cc:515] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:02.749385  4466 raft_consensus.cc:740] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:00:02.706789  4457 raft_consensus.cc:2749] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:00:02.751211  4480 log.cc:927] Time spent T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.199s	user 0.000s	sys 0.001s
I20260709 13:00:02.710723  3970 raft_consensus.cc:493] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:02.751725  3970 raft_consensus.cc:3060] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:02.752177  4492 leader_election.cc:290] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:02.755062  4402 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:02.755689  4220 leader_election.cc:290] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:02.710436  4290 raft_consensus.cc:2804] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:02.756330  4290 raft_consensus.cc:493] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:02.756709  4290 raft_consensus.cc:3060] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:02.712543  4396 consensus_queue.cc:1059] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:00:02.759799  4269 leader_election.cc:290] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:02.760022  4406 raft_consensus.cc:493] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:02.760502  4406 raft_consensus.cc:515] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:02.762002  4380 leader_election.cc:290] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:02.723218  4282 consensus_queue.cc:237] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:02.763669  4175 leader_election.cc:290] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:02.752604  4466 consensus_queue.cc:260] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:02.736405  4424 leader_election.cc:290] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:02.778481  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:02.780187  1607 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 6.
I20260709 13:00:02.782534  4439 raft_consensus.cc:515] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:02.785399  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:02.713673  4436 consensus_queue.cc:1048] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.074s
I20260709 13:00:02.773334  4406 leader_election.cc:290] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
W20260709 13:00:02.856670  1495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:02.893488  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:02.900183  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:02.904358  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:02.904430  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:02.905717  1600 raft_consensus.cc:2376] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 4. Re-sending same reply.
I20260709 13:00:02.871263  4269 raft_consensus.cc:493] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:02.910209  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:02.911451  1601 raft_consensus.cc:2468] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 6.
I20260709 13:00:02.874751  4284 raft_consensus.cc:493] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:02.920974  1572 leader_election.cc:304] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:00:02.899369  4298 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.009s	sys 0.029s
I20260709 13:00:02.902508  1646 leader_election.cc:304] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:02.910305  3935 raft_consensus.cc:493] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:02.924242  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:02.791404  4327 consensus_queue.cc:237] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:02.927384  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:02.931071  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:02.932053  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:02.898396  4402 raft_consensus.cc:493] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:02.933790  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:02.939507  4324 raft_consensus.cc:515] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:02.940236  4290 raft_consensus.cc:515] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:02.945792  3970 raft_consensus.cc:515] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:02.984810  4402 raft_consensus.cc:515] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:02.985828  3970 leader_election.cc:290] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:02.947201  4264 raft_consensus.cc:2749] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:00:02.952360  1495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:02.987147  4402 leader_election.cc:290] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:02.959144  4284 raft_consensus.cc:515] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:02.959862  4269 raft_consensus.cc:515] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:02.967453  4439 leader_election.cc:290] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:00:02.976981  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 74552.7us
I20260709 13:00:03.005120  1646 leader_election.cc:304] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:02.978204  1599 raft_consensus.cc:2468] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 6.
I20260709 13:00:02.979146  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:03.006471  1605 raft_consensus.cc:2468] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 4.
W20260709 13:00:02.976471  4298 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.686s	user 0.010s	sys 0.029s
W20260709 13:00:03.007877  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 349249us
I20260709 13:00:03.010769  1570 leader_election.cc:304] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:03.012238  1602 raft_consensus.cc:1240] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:03.016491  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:03.017127  2226 raft_consensus.cc:3060] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:03.018047  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:03.018638  1672 raft_consensus.cc:3060] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:00:02.980319  3935 raft_consensus.cc:515] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:03.034201  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 335278us
I20260709 13:00:03.021098  4264 raft_consensus.cc:2804] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:00:03.036151  1496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:03.026202  2221 raft_consensus.cc:2393] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 4: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:00:03.041189  1672 raft_consensus.cc:2468] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 7.
I20260709 13:00:03.043716  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:03.045710  1672 raft_consensus.cc:3060] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:03.045009  4264 raft_consensus.cc:493] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:03.052873  4264 raft_consensus.cc:3060] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:03.048108  4436 consensus_queue.cc:1059] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:03.048949  4387 consensus_queue.cc:1059] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:03.049919  4464 consensus_queue.cc:1059] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:03.050227  4439 consensus_queue.cc:1059] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:03.044561  4282 raft_consensus.cc:2764] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:00:03.085099  1672 raft_consensus.cc:2468] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 10.
I20260709 13:00:03.086164  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:03.078341  2226 raft_consensus.cc:2468] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 7.
I20260709 13:00:03.087357  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:03.108184  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:03.109027  1603 raft_consensus.cc:2393] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 6: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:00:03.087572  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:03.110590  1601 raft_consensus.cc:1240] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:03.109542  2226 raft_consensus.cc:3060] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:03.080927  4499 raft_consensus.cc:3055] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:03.080729  4436 raft_consensus.cc:3055] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:00:03.113123  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 108056us
I20260709 13:00:03.132047  1530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43010 (request call id 1842) took 1769 ms. Trace:
I20260709 13:00:03.133214  1646 leader_election.cc:304] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:03.134537  1646 leader_election.cc:304] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:03.137724  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:03.139391  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:03.133849  1530 rpcz_store.cc:276] 0709 13:00:01.362816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:01.553208 (+190392us) service_pool.cc:224] Handling call
0709 13:00:01.615341 (+ 62133us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:01.703600 (+ 88259us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:00:02.493941 (+790341us) spinlock_profiling.cc:243] Waited 4.29 ms on lock 0x7b180048cac0. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1e38ede1 00007f6a1e39b5b1 00007f6a15440c0a 00007f6a1eb80219 00007f6a154c8a40 00007f6a154c34e4 00007f6a154c3455 00007f6a1bfab3c7 00007f6a185bd9a7 00007f6a185cd0bf 00007f6a185cd038
0709 13:00:02.702148 (+208207us) log.cc:844] Serialized 14 byte log entry
0709 13:00:03.002753 (+300605us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:03.013640 (+ 10887us) log.cc:844] Serialized 26 byte log entry
0709 13:00:03.014001 (+   361us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:03.014253 (+   252us) log.cc:844] Serialized 14 byte log entry
0709 13:00:03.021629 (+  7376us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:03.021700 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:03.131838 (+110138us) raft_consensus.cc:1685] finished
0709 13:00:03.131858 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:03.131989 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12427,"prepare.queue_time_us":790912,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":2731,"raft.queue_time_us":89752,"raft.run_cpu_time_us":405,"raft.run_wall_time_us":20620,"spinlock_wait_cycles":9859840,"thread_start_us":514752,"threads_started":3,"wal-append.queue_time_us":390841}
I20260709 13:00:03.142446  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:03.143775  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:03.144368  1679 raft_consensus.cc:3060] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:03.145188  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:03.146018  1601 raft_consensus.cc:2410] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:00:03.148387  1680 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4190d217954f4f798b3a610501115290"
dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
mode: GRACEFUL
new_leader_uuid: "39a92f5a4352465d8af3af5908fe8642"
 from {username='slave'} at 127.0.0.1:33616
I20260709 13:00:03.149139  1680 raft_consensus.cc:606] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 4 LEADER]: Received request to transfer leadership to TS 39a92f5a4352465d8af3af5908fe8642
I20260709 13:00:03.150751  2226 raft_consensus.cc:2410] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:00:03.124397  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:03.125216  4324 leader_election.cc:290] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:03.115679  4284 leader_election.cc:290] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:03.164181  4284 consensus_queue.cc:1048] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:03.164381  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:03.127516  4290 leader_election.cc:290] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:03.165321  1604 raft_consensus.cc:2410] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:00:03.131878  3935 leader_election.cc:290] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:03.129287  4436 raft_consensus.cc:740] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:00:03.165525  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:03.173861  1600 raft_consensus.cc:3060] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:00:03.174191  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:03.129163  4499 raft_consensus.cc:740] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:00:03.166296  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:03.167186  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:03.168411  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:03.169090  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:03.139590  4516 raft_consensus.cc:2804] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:03.169842  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:03.177750  1599 raft_consensus.cc:2410] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 13:00:03.176573  2191 leader_election.cc:336] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217): Timed out: RequestConsensusVote RPC to 127.0.107.195:44217 timed out after 1.875s (SENT)
I20260709 13:00:03.170921  4269 leader_election.cc:290] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:03.171530  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:03.172758  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:03.174888  1606 raft_consensus.cc:2393] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 8: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:00:03.174811  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:03.137298  4514 raft_consensus.cc:2749] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:03.177176  1603 raft_consensus.cc:2393] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 11: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:00:03.178362  2191 leader_election.cc:304] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:03.179713  1679 raft_consensus.cc:2468] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 7.
I20260709 13:00:03.183590  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:03.184484  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:03.179946  2226 raft_consensus.cc:3060] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 6 LEARNER]: Advancing to term 8
I20260709 13:00:03.182097  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:03.187117  1605 raft_consensus.cc:2393] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 6: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:00:03.188995  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:03.189240  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:03.190511  1603 raft_consensus.cc:2468] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 7.
W20260709 13:00:03.189795  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 49190.7us
I20260709 13:00:03.193579  1673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49178 (request call id 1699) took 1030 ms. Trace:
I20260709 13:00:03.193961  1673 rpcz_store.cc:276] 0709 13:00:02.163553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:02.392600 (+229047us) service_pool.cc:224] Handling call
0709 13:00:02.461225 (+ 68625us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:02.461472 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:02.461498 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:03.028830 (+567332us) spinlock_profiling.cc:243] Waited 963 us on lock 0x7b2c00129ff8. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a16eaca11 00007f6a16ebc372 00007f6a185eea01 00007f6a185b343a 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2
0709 13:00:03.043305 (+ 14475us) log.cc:844] Serialized 26 byte log entry
0709 13:00:03.173909 (+130604us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:00:03.173943 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:03.174065 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:03.193302 (+ 19237us) raft_consensus.cc:1685] finished
0709 13:00:03.193320 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:03.193510 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2215808,"thread_start_us":102280,"threads_started":1,"wal-append.queue_time_us":134958}
I20260709 13:00:03.191596  1646 leader_election.cc:304] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:03.178485  4033 raft_consensus.cc:2804] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:03.198014  1601 raft_consensus.cc:3060] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:03.198820  2191 leader_election.cc:304] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:03.202740  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:03.203270  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:03.203958  1680 raft_consensus.cc:2393] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 8: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:00:03.204136  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:03.207247  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:03.211431  4296 raft_consensus.cc:3055] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:03.211872  4296 raft_consensus.cc:740] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:03.212703  2226 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 8 LEARNER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 8.
W20260709 13:00:03.213570  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:03.213656  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
W20260709 13:00:03.214155  1497 connection.cc:256] RPC call timeout handler was delayed by -1.0830227040000295s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1523s for a response
I20260709 13:00:03.214735  1600 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 8.
I20260709 13:00:03.214800  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:03.216141  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:03.217307  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:03.218235  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:03.218417  4464 raft_consensus.cc:493] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:03.219009  4464 raft_consensus.cc:515] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:03.219405  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:03.220634  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
W20260709 13:00:03.214463  1497 connection.cc:256] RPC call timeout handler was delayed by -1.0092227040000239s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1605s for a response
I20260709 13:00:03.221726  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:03.222467  2226 raft_consensus.cc:2393] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 6: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:00:03.222877  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:03.222960  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:03.223472  2226 raft_consensus.cc:1240] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:03.223534  1531 raft_consensus.cc:2468] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 4.
I20260709 13:00:03.224807  1571 leader_election.cc:304] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:03.224929  2226 raft_consensus.cc:1240] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:03.190438  3935 raft_consensus.cc:2749] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:03.223618  1529 raft_consensus.cc:2468] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 5.
I20260709 13:00:03.227572  1605 raft_consensus.cc:1240] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 5 LEADER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:00:03.228519  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:03.231688  1532 raft_consensus.cc:1240] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:03.232016  1571 leader_election.cc:304] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:03.234334  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:03.234902  1526 raft_consensus.cc:3060] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:03.233572  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:03.236508  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:03.236634  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:03.237197  1529 raft_consensus.cc:2368] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 5. Current term is 6.
I20260709 13:00:03.237917  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:03.238547  1529 raft_consensus.cc:2393] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 4: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
W20260709 13:00:03.221388  4498 log.cc:927] Time spent T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.343s	user 0.001s	sys 0.001s
I20260709 13:00:03.240724  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 13:00:03.241452  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 49960.7us
I20260709 13:00:03.242274  1646 leader_election.cc:304] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:03.243443  1646 leader_election.cc:304] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:03.209270  4382 raft_consensus.cc:2804] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:03.247221  4382 raft_consensus.cc:697] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 7 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
W20260709 13:00:03.247762  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:03.241443  1524 raft_consensus.cc:2368] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 7. Current term is 8.
I20260709 13:00:03.249924  1570 leader_election.cc:304] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:03.251250  1570 leader_election.cc:400] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 pre-election: Vote denied by peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931) with higher term. Message: Invalid argument: T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 5. Current term is 6.
I20260709 13:00:03.252036  1570 leader_election.cc:304] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:03.239285  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:03.256599  1601 raft_consensus.cc:2468] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 7.
I20260709 13:00:03.257373  1529 raft_consensus.cc:2468] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 7.
I20260709 13:00:03.261308  1601 raft_consensus.cc:1240] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:00:03.201635  4516 raft_consensus.cc:697] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 5 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:03.263353  1605 raft_consensus.cc:1275] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:00:03.270320  1605 pending_rounds.cc:85] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642: Aborting all ops after (but not including) 6
I20260709 13:00:03.270823  1605 pending_rounds.cc:107] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:00:03.241345  4402 raft_consensus.cc:2804] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:03.266470  1531 raft_consensus.cc:1240] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:03.274842  2226 raft_consensus.cc:1240] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:03.271102  1605 raft_consensus.cc:2889] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:03.246548  4269 raft_consensus.cc:2804] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:03.273056  2191 leader_election.cc:304] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:00:03.274379  1495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:03.247174  4514 raft_consensus.cc:2764] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:00:03.276686  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:03.277403  1523 raft_consensus.cc:2368] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 7. Current term is 8.
I20260709 13:00:03.248802  4290 raft_consensus.cc:2804] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:03.283329  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:03.284013  1527 raft_consensus.cc:2468] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 6.
I20260709 13:00:03.258827  4324 raft_consensus.cc:2804] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:03.259271  4457 raft_consensus.cc:2749] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:00:03.286887  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:03.263779  4455 raft_consensus.cc:3060] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:03.285916  1526 raft_consensus.cc:2468] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 8.
I20260709 13:00:03.304227  1524 raft_consensus.cc:2393] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 8: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:00:03.248181  4382 consensus_queue.cc:237] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:03.246876  4518 consensus_queue.cc:1048] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:00:03.294104  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:03.306813  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:03.309489  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:03.278892  4402 raft_consensus.cc:493] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:03.315183  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:03.317101  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:03.317925  1526 raft_consensus.cc:2468] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 6.
W20260709 13:00:03.310319  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 66951us
I20260709 13:00:03.310331  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:03.212725  4296 consensus_queue.cc:260] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:03.313228  1531 raft_consensus.cc:2376] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 8. Re-sending same reply.
I20260709 13:00:03.306510  4290 raft_consensus.cc:697] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 7 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:03.309062  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:03.319451  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:03.334836  2226 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4ea41c88222b469fb11229faef735050"
dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
mode: GRACEFUL
new_leader_uuid: "39a92f5a4352465d8af3af5908fe8642"
 from {username='slave'} at 127.0.0.1:47682
I20260709 13:00:03.341699  2226 raft_consensus.cc:606] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 7 LEADER]: Received request to transfer leadership to TS 39a92f5a4352465d8af3af5908fe8642
I20260709 13:00:03.341885  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:03.342335  1646 leader_election.cc:304] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:03.342770  1527 raft_consensus.cc:2468] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 8.
I20260709 13:00:03.265014  4436 consensus_queue.cc:260] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:03.367105  2223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 678) took 2761 ms. Trace:
I20260709 13:00:03.345245  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:03.310012  3935 raft_consensus.cc:2749] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:03.317044  4402 raft_consensus.cc:3060] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:03.249190  4499 consensus_queue.cc:260] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:03.351715  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:03.343596  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:03.311676  4457 raft_consensus.cc:493] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:03.373399  1523 raft_consensus.cc:2468] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 5.
I20260709 13:00:03.317212  4264 raft_consensus.cc:515] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:03.427881  4264 leader_election.cc:290] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:03.371553  1646 leader_election.cc:304] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
W20260709 13:00:03.428635  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 57166.2us
I20260709 13:00:03.429247  4514 raft_consensus.cc:2804] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:03.429761  4514 raft_consensus.cc:697] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 8 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:03.394295  1523 raft_consensus.cc:1240] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 4. Current term is 5. Ops: []
W20260709 13:00:03.394774  1570 leader_election.cc:336] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.585s (SENT)
I20260709 13:00:03.430858  1570 leader_election.cc:304] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:03.367609  2223 rpcz_store.cc:276] 0709 13:00:00.584172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:00.584279 (+   107us) service_pool.cc:224] Handling call
0709 13:00:00.598919 (+ 14640us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:02.020369 (+1421450us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:03.345351 (+1324982us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b5400629154. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:00:03.345566 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2908856064}
W20260709 13:00:03.395879  1495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:03.418459  4524 log.cc:927] Time spent T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:00:03.369731  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:03.419023  4290 consensus_queue.cc:237] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:03.436720  4264 raft_consensus.cc:2749] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:03.448064  4446 raft_consensus.cc:3055] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:03.448592  4446 raft_consensus.cc:740] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:03.449448  4446 consensus_queue.cc:260] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:03.456794  4519 log.cc:927] Time spent T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
I20260709 13:00:03.422502  4436 raft_consensus.cc:3060] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:03.423008  1526 raft_consensus.cc:3055] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:03.467329  1526 raft_consensus.cc:740] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
W20260709 13:00:03.468537  1570 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 2.342s (SENT) [suppressed 52 similar messages]
I20260709 13:00:03.468329  1526 consensus_queue.cc:260] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:03.396435  4516 consensus_queue.cc:237] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:03.421376  4457 raft_consensus.cc:515] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:03.478860  4457 leader_election.cc:290] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:00:03.428025  4522 log.cc:927] Time spent T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.194s	user 0.001s	sys 0.000s
I20260709 13:00:03.488628  2221 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28"
dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
mode: GRACEFUL
new_leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:47682
I20260709 13:00:03.489470  2221 raft_consensus.cc:606] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Received request to transfer leadership to TS e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:03.489858  2221 raft_consensus.cc:614] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:03.371410  3876 raft_consensus.cc:2749] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:00:03.509394  1570 leader_election.cc:336] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.707s (SENT)
I20260709 13:00:03.509949  1570 leader_election.cc:304] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:03.511092  4457 raft_consensus.cc:2749] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:03.430555  4514 consensus_queue.cc:237] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:03.543833  1527 pending_rounds.cc:85] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting all ops after (but not including) 1
I20260709 13:00:03.544366  1527 pending_rounds.cc:107] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting uncommitted NO_OP operation due to leader change: 4.2
I20260709 13:00:03.544713  1527 raft_consensus.cc:2889] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:03.424970  1531 raft_consensus.cc:1275] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:00:03.568598  1495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:03.450531  4446 raft_consensus.cc:3060] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:03.672706  1570 leader_election.cc:336] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.882s (SENT)
I20260709 13:00:03.715703  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:03.716369  1680 raft_consensus.cc:3060] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:03.717209  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:03.719803  1673 raft_consensus.cc:1275] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:00:03.721144  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:03.681713  2221 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9"
dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
mode: GRACEFUL
new_leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:47682
I20260709 13:00:03.727173  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:03.727265  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:03.727869  1677 raft_consensus.cc:2468] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 7.
I20260709 13:00:03.727928  1673 raft_consensus.cc:2468] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 7.
I20260709 13:00:03.729364  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:03.729897  1673 raft_consensus.cc:2468] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 5.
I20260709 13:00:03.741441  1680 raft_consensus.cc:2468] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 7.
W20260709 13:00:03.759719  1570 leader_election.cc:336] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.970s (SENT)
I20260709 13:00:03.860467  1570 leader_election.cc:304] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:00:03.768997  1572 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.000s	sys 0.007s
W20260709 13:00:03.861905  1572 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.599s	user 0.000s	sys 0.008s
I20260709 13:00:03.864275  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:03.865017  1603 raft_consensus.cc:2468] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 7.
I20260709 13:00:03.734005  4269 raft_consensus.cc:697] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 6 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:03.755129  2221 raft_consensus.cc:606] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 4 LEADER]: Received request to transfer leadership to TS e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:00:03.815116  4527 log.cc:927] Time spent T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
W20260709 13:00:03.819777  4455 consensus_meta.cc:287] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.507s	user 0.008s	sys 0.000s
I20260709 13:00:03.907856  4175 raft_consensus.cc:2749] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:03.930348  1646 leader_election.cc:304] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:03.915813  4455 raft_consensus.cc:2749] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:03.850744  4402 raft_consensus.cc:515] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:03.770493  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:03.877545  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:03.877978  1598 raft_consensus.cc:1240] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:03.878001  1601 raft_consensus.cc:1240] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:03.879801  1606 raft_consensus.cc:1240] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 10. Current term is 11. Ops: []
W20260709 13:00:03.886040  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:03.896354  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:03.947098  2226 raft_consensus.cc:1275] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 13:00:03.896544  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 136895us
W20260709 13:00:03.931406  4324 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.617s	user 0.023s	sys 0.086s
W20260709 13:00:03.948429  1570 leader_election.cc:336] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 2.135s (SENT)
I20260709 13:00:03.936640  4515 raft_consensus.cc:2804] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:03.829957  4436 raft_consensus.cc:493] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:03.949554  1495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:03.950918  1570 leader_election.cc:304] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:00:03.949685  4290 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.004s	sys 0.012s
W20260709 13:00:03.950601  4324 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.023s	sys 0.086s
I20260709 13:00:03.971661  1607 raft_consensus.cc:1275] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:00:03.968719  1570 leader_election.cc:304] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:03.975476  1673 raft_consensus.cc:1240] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 8 LEADER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:03.952049  4515 raft_consensus.cc:493] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:03.978816  1570 leader_election.cc:304] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:03.983556  1570 leader_election.cc:304] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:03.952553  2221 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dcad30336a5440bca17cda2724035211"
dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
mode: GRACEFUL
new_leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:47682
W20260709 13:00:03.968910  4290 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.533s	user 0.004s	sys 0.012s
W20260709 13:00:03.987504  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 52445.1us
I20260709 13:00:03.969074  4175 raft_consensus.cc:2749] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:03.975117  4324 raft_consensus.cc:697] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 10 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:03.966809  4542 raft_consensus.cc:493] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
W20260709 13:00:03.995047  1573 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.653s	user 0.008s	sys 0.005s
W20260709 13:00:03.995466  1573 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.721s	user 0.008s	sys 0.005s
I20260709 13:00:03.994791  4542 raft_consensus.cc:515] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:03.986233  4515 raft_consensus.cc:3060] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:04.001472  4542 leader_election.cc:290] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:00:04.016687  1495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:03.990574  2221 raft_consensus.cc:606] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [term 4 LEADER]: Received request to transfer leadership to TS e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:03.992094  4534 raft_consensus.cc:2749] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:03.991321  4530 raft_consensus.cc:2804] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:03.976768  4436 raft_consensus.cc:515] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:04.036331  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:04.041186   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
W20260709 13:00:04.042338  1644 connection.cc:256] RPC call timeout handler was delayed by -2.8790152969999667s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15760000000000002s for a response
I20260709 13:00:03.998912  4541 raft_consensus.cc:493] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
W20260709 13:00:04.056365  1495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:04.059265  1644 connection.cc:256] RPC call timeout handler was delayed by -2.8205152969999858s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16410000000000002s for a response
I20260709 13:00:03.984340  4269 consensus_queue.cc:237] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:04.030409  4175 raft_consensus.cc:493] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:04.059970  1644 connection.cc:256] RPC call timeout handler was delayed by -2.4992152969999779s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1998s for a response
I20260709 13:00:04.005796  4537 raft_consensus.cc:2804] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:00:04.070039  1644 connection.cc:256] RPC call timeout handler was delayed by -2.4533152969999605s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2049s for a response
W20260709 13:00:04.070538  1644 connection.cc:256] RPC call timeout handler was delayed by -2.4020152969999913s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2106s for a response
I20260709 13:00:04.070808  4514 raft_consensus.cc:493] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:04.071065  1644 connection.cc:256] RPC call timeout handler was delayed by -2.3930152969999767s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2116s for a response
W20260709 13:00:04.071408  1644 connection.cc:256] RPC call timeout handler was delayed by -2.3327152969999929s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2183s for a response
W20260709 13:00:04.071777  1644 connection.cc:256] RPC call timeout handler was delayed by -2.0798845460000166s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16240000000000002s for a response
W20260709 13:00:04.072065  1644 connection.cc:256] RPC call timeout handler was delayed by -2.0034330399999476s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1837s for a response
W20260709 13:00:04.072336  1644 connection.cc:256] RPC call timeout handler was delayed by -1.9431330399999638s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1904s for a response
W20260709 13:00:04.072851  1644 connection.cc:256] RPC call timeout handler was delayed by -1.8880033479999838s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1746s for a response
I20260709 13:00:04.071421  4514 raft_consensus.cc:515] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:00:04.073150  1644 connection.cc:256] RPC call timeout handler was delayed by -1.8405330399999684s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20179999999999998s for a response
W20260709 13:00:04.073467  1644 connection.cc:256] RPC call timeout handler was delayed by -1.5001033479999819s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2177s for a response
I20260709 13:00:04.074391  4545 consensus_queue.cc:1048] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:04.074630  4514 leader_election.cc:290] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:04.077467  1644 leader_election.cc:304] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:00:04.078213  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 88761.6us
I20260709 13:00:04.079041  4545 raft_consensus.cc:2749] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:04.079543  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:04.083420  1644 leader_election.cc:304] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:04.045281  4540 raft_consensus.cc:493] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:04.085999  1644 leader_election.cc:304] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:04.089254  4518 raft_consensus.cc:2749] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:04.091208  1644 leader_election.cc:304] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:04.092902  4528 raft_consensus.cc:2749] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:04.094507  1644 leader_election.cc:304] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:04.095827  1644 leader_election.cc:304] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:00:04.081768  4537 raft_consensus.cc:493] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:04.082795  4552 raft_consensus.cc:493] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:04.089847  4516 raft_consensus.cc:2749] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:04.062318  4541 raft_consensus.cc:515] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:04.082530  4175 raft_consensus.cc:515] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:04.043836  4530 raft_consensus.cc:493] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:04.103621  4528 raft_consensus.cc:2749] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:04.107103  4537 raft_consensus.cc:3060] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:04.135565  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:04.137218  4530 raft_consensus.cc:3060] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:04.138320  4547 log.cc:927] Time spent T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:00:04.140105  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:04.140743  1604 raft_consensus.cc:2468] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 6.
I20260709 13:00:04.141623  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:04.142316  1604 raft_consensus.cc:2393] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 6: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:00:04.142422  4472 raft_consensus.cc:3060] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:04.082144  4324 consensus_queue.cc:237] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:04.092171  4540 raft_consensus.cc:515] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:04.125231  4514 raft_consensus.cc:2804] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:00:04.159289  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 63490us
I20260709 13:00:04.160775  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:04.161592  1644 leader_election.cc:304] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:04.150928  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:04.163033  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:04.165566  4402 leader_election.cc:290] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:04.146608  4530 raft_consensus.cc:515] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:04.181273  4530 leader_election.cc:290] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:04.166386  4549 raft_consensus.cc:493] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:04.168301  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:04.182390  1604 raft_consensus.cc:2393] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 6: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:00:04.182116  4549 raft_consensus.cc:515] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:04.183563  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:04.184255  1604 raft_consensus.cc:2468] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 7.
I20260709 13:00:04.184700  4549 leader_election.cc:290] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:04.187393  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:04.116833  4552 raft_consensus.cc:515] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:04.158711  4446 raft_consensus.cc:493] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:04.148178  4484 leader_election.cc:290] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:04.175122  4466 raft_consensus.cc:3060] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:04.175282  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:04.161767  4514 raft_consensus.cc:493] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:04.177126  4175 leader_election.cc:290] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:04.194393  1527 raft_consensus.cc:2468] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 7.
I20260709 13:00:04.192137  4402 raft_consensus.cc:2749] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:04.211262  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:04.191848  4552 leader_election.cc:290] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:04.213376  1604 raft_consensus.cc:2468] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 4.
I20260709 13:00:04.216002  1644 leader_election.cc:304] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:04.199805  4514 raft_consensus.cc:3060] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:04.221221  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:04.221756  1527 raft_consensus.cc:2468] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 6.
I20260709 13:00:04.198762  4532 consensus_queue.cc:1048] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 13:00:04.223847  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 13:00:04.225672  4405 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.978s	user 0.006s	sys 0.018s
I20260709 13:00:04.193073  4446 raft_consensus.cc:515] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:04.215031  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:04.230440  1644 leader_election.cc:304] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:04.218806  4436 leader_election.cc:290] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:04.232854  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:04.235406  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:04.236063  1527 raft_consensus.cc:2468] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 5.
W20260709 13:00:04.231966  4405 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.984s	user 0.006s	sys 0.018s
I20260709 13:00:04.223829  4559 raft_consensus.cc:2804] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:00:04.245018  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:04.234324  4528 raft_consensus.cc:2804] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:04.245884  1644 leader_election.cc:304] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:04.252065  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:04.243049  4559 raft_consensus.cc:493] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:04.253309  1527 raft_consensus.cc:2393] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 8: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:00:04.250479  4516 raft_consensus.cc:2804] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:04.247802  4528 raft_consensus.cc:493] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:04.255146  4516 raft_consensus.cc:493] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:04.258404  1600 raft_consensus.cc:1240] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:04.259238  4516 raft_consensus.cc:3060] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:04.261184  4556 raft_consensus.cc:493] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:04.261914  4350 leader_election.cc:290] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:04.261775  4556 raft_consensus.cc:515] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:04.263036  1530 raft_consensus.cc:2468] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 5.
I20260709 13:00:04.258680  4446 leader_election.cc:290] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:04.254559  4559 raft_consensus.cc:3060] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:04.259146  4528 raft_consensus.cc:3060] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:04.272774  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:04.274358  4384 raft_consensus.cc:993] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b: : Instructing follower e46412b3b0b44f01ad5c33d4cfe3d6b1 to start an election
I20260709 13:00:04.274928  4384 raft_consensus.cc:1081] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 4 LEADER]: Signalling peer e46412b3b0b44f01ad5c33d4cfe3d6b1 to start an election
I20260709 13:00:04.278126  4516 raft_consensus.cc:515] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:04.278628  1528 raft_consensus.cc:1240] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:00:04.313570  1524 raft_consensus.cc:2410] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:00:04.422245  4554 raft_consensus.cc:493] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:04.315933  4515 raft_consensus.cc:515] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:04.422802  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:04.422770  4554 raft_consensus.cc:515] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:04.423771  1528 raft_consensus.cc:2393] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 5: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:00:04.424257  4515 leader_election.cc:290] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:00:04.311038  4565 log.cc:927] Time spent T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
W20260709 13:00:04.424887  1495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:04.312762  4537 raft_consensus.cc:515] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:04.427472  4537 leader_election.cc:290] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:04.285794  1527 raft_consensus.cc:2393] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 8: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:00:04.309379  4516 leader_election.cc:290] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:04.430496  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:04.313527  2225 raft_consensus.cc:1240] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 7 LEADER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:00:04.436659  1528 raft_consensus.cc:3060] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:04.436997  2225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50310 (request call id 596) took 1544 ms. Trace:
I20260709 13:00:04.437414  2225 rpcz_store.cc:276] 0709 13:00:02.892486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:02.892597 (+   111us) service_pool.cc:224] Handling call
0709 13:00:04.313043 (+1420446us) spinlock_profiling.cc:243] Waited 992 us on lock 0x7b5800015c98. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a1548eb71 00007f6a1548ea22 00007f6a1e3a7c09 00007f6a1d501ee0 00007f6a1d5cb0ab 00007f6a1d5cb131 00007f6a1d58cfc0 00007f6a1d577929 00007f6a1d5773d2 00007f6a16aeebd4
0709 13:00:04.313258 (+   215us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:04.436697 (+123439us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:04.436891 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2280704}
I20260709 13:00:04.439229  1497 leader_election.cc:304] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:04.440618  1497 leader_election.cc:304] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:04.441679  1523 raft_consensus.cc:2468] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 6.
I20260709 13:00:04.441936  1497 leader_election.cc:304] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:04.442381  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:04.444227  1497 leader_election.cc:304] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
W20260709 13:00:04.317103  2219 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50310 (request call id 590) took 3017 ms (client timeout 2167 ms). Trace:
W20260709 13:00:04.449694  2219 rpcz_store.cc:269] 0709 13:00:01.299673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:01.393708 (+ 94035us) service_pool.cc:224] Handling call
0709 13:00:04.316912 (+2923204us) spinlock_profiling.cc:243] Waited 299 ms on lock 0x7b54003264d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:04.317025 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":686583040}
I20260709 13:00:04.451491  1497 leader_election.cc:304] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:04.452620  1497 leader_election.cc:304] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:04.453363  4484 raft_consensus.cc:2749] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:04.453967  4484 raft_consensus.cc:2749] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:04.454483  4484 raft_consensus.cc:2749] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:04.456293  1497 leader_election.cc:304] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:04.457048  4436 raft_consensus.cc:2749] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:04.458336  1497 leader_election.cc:304] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:04.449019  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:04.433669  4464 leader_election.cc:290] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:00:04.462002  1570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:04.460307  1497 leader_election.cc:304] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:04.461526  4436 raft_consensus.cc:3060] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:04.444571  4472 raft_consensus.cc:2749] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:04.438337  4466 consensus_queue.cc:1059] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:00:04.468719  4466 raft_consensus.cc:3055] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:04.469159  4466 raft_consensus.cc:740] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:00:04.469684  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
W20260709 13:00:04.470266  1495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:04.448117  4495 raft_consensus.cc:2749] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:04.471369  1523 raft_consensus.cc:2468] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 5.
W20260709 13:00:04.471776  1676 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50664 (request call id 549) took 3169 ms (client timeout 1875 ms). Trace:
W20260709 13:00:04.472169  1676 rpcz_store.cc:269] 0709 13:00:01.302395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:01.305215 (+  2820us) service_pool.cc:224] Handling call
0709 13:00:04.471538 (+3166323us) spinlock_profiling.cc:243] Waited 795 ms on lock 0x7b54000cd354. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:04.471675 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1829000576}
I20260709 13:00:04.473253  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:04.473846  4541 leader_election.cc:290] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:04.474452  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:04.474560  1675 raft_consensus.cc:1240] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:04.487229  1523 raft_consensus.cc:2468] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 4.
I20260709 13:00:04.485169  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:04.482779  1572 leader_election.cc:304] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:04.446134  4350 raft_consensus.cc:2749] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:04.490401  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:04.492120  1523 raft_consensus.cc:2468] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 6.
I20260709 13:00:04.492874  1672 raft_consensus.cc:1240] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 6. Current term is 7. Ops: []
W20260709 13:00:04.500145  2190 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.194s	user 0.004s	sys 0.008s
W20260709 13:00:04.500619  2190 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.195s	user 0.004s	sys 0.008s
W20260709 13:00:04.500923  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 1.19753e+06us
W20260709 13:00:04.505618  1674 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49170 (request call id 1793) took 2391 ms (client timeout 1640 ms). Trace:
W20260709 13:00:04.506099  1674 rpcz_store.cc:269] 0709 13:00:02.114120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:02.116328 (+  2208us) service_pool.cc:224] Handling call
0709 13:00:04.505444 (+2389116us) spinlock_profiling.cc:243] Waited 41.4 ms on lock 0x7b5400372654. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:04.505547 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":95127936}
I20260709 13:00:04.506805  2192 leader_election.cc:304] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:04.507431  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:04.487561  1525 raft_consensus.cc:2368] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 5. Current term is 6.
I20260709 13:00:04.508211  2222 raft_consensus.cc:2368] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 5. Current term is 6.
W20260709 13:00:04.508651  2222 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50310 (request call id 592) took 1617 ms (client timeout 1999 ms). Trace:
W20260709 13:00:04.509043  2222 rpcz_store.cc:269] 0709 13:00:02.891363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:02.898635 (+  7272us) service_pool.cc:224] Handling call
0709 13:00:04.507273 (+1608638us) spinlock_profiling.cc:243] Waited 3.72 ms on lock 0x7b5800015c98. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a1548eb71 00007f6a1548ea22 00007f6a1e3a7c09 00007f6a1d501ee0 00007f6a1d5cb0ab 00007f6a1d5cb131 00007f6a1d5790a0 00007f6a1d578984 00007f6a16af36d4 00007f6a16af3662
0709 13:00:04.508591 (+  1318us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8566528}
I20260709 13:00:04.468873  1530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49310 (request call id 566) took 1266 ms. Trace:
I20260709 13:00:04.510191  1530 rpcz_store.cc:276] 0709 13:00:03.202364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:03.202495 (+   131us) service_pool.cc:224] Handling call
0709 13:00:04.468673 (+1266178us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b540002b054. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:04.468787 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2437108992}
I20260709 13:00:04.506099  4384 consensus_queue.cc:1059] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 13:00:04.508848  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:04.493106  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:04.513207  1525 raft_consensus.cc:2410] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:00:04.503445  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:04.515432  1527 raft_consensus.cc:2393] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 3: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:00:04.521265  1679 raft_consensus.cc:1240] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:04.529031  1525 raft_consensus.cc:1240] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:04.530372  1525 raft_consensus.cc:1275] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:00:04.532413  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 72173.4us
I20260709 13:00:04.533373  1497 leader_election.cc:304] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:04.535450  1572 leader_election.cc:400] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 election: Vote denied by peer b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373) with higher term. Message: Invalid argument: T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 5. Current term is 6.
I20260709 13:00:04.535867  1572 leader_election.cc:403] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:00:04.469998  4466 consensus_queue.cc:260] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:04.537958  2192 leader_election.cc:304] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:04.540138  4387 raft_consensus.cc:2804] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:00:04.565589  1570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:04.558512  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:04.563663  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:04.558212  2225 raft_consensus.cc:1275] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:00:04.564428  1681 raft_consensus.cc:1275] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:00:04.563375  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:04.568125  2226 raft_consensus.cc:2393] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 6: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:00:04.570405  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:04.570968  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:04.568720  1571 leader_election.cc:304] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:04.568018  2190 leader_election.cc:304] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:04.552254  4446 raft_consensus.cc:2749] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373) with higher term. Message: Invalid argument: T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 5. Current term is 6.
I20260709 13:00:04.554771  4541 consensus_queue.cc:1059] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 13:00:04.577282  4541 consensus_queue.cc:1243] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Peer 39a92f5a4352465d8af3af5908fe8642 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:00:04.559329  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:04.559629  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:04.560320  2221 raft_consensus.cc:1275] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:00:04.580425  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:04.588516  4466 raft_consensus.cc:3060] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:04.462123  4528 raft_consensus.cc:515] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:04.591614  1681 raft_consensus.cc:2393] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 7: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:00:04.592721  4528 leader_election.cc:290] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:04.559018  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:04.479100  4559 raft_consensus.cc:515] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:04.595124  1677 raft_consensus.cc:1240] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:04.596316  4559 leader_election.cc:290] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:04.600065  2224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 682) took 2792 ms. Trace:
I20260709 13:00:04.600869  1675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49170 (request call id 1795) took 2483 ms. Trace:
I20260709 13:00:04.601267  1675 rpcz_store.cc:276] 0709 13:00:02.117563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:02.231225 (+113662us) service_pool.cc:224] Handling call
0709 13:00:04.474385 (+2243160us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:04.488725 (+ 14340us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:04.600618 (+111893us) spinlock_profiling.cc:243] Waited 2.24 s on lock 0x7b54000cd350. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b28ad 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:04.600780 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5158588160}
I20260709 13:00:04.477332  4514 raft_consensus.cc:515] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:04.602797  4503 raft_consensus.cc:3055] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:04.603257  4503 raft_consensus.cc:740] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:00:04.604140  4514 leader_election.cc:290] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:04.604066  4503 consensus_queue.cc:260] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:04.605132  4503 raft_consensus.cc:3060] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:04.605580  4190 consensus_queue.cc:1048] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:04.554486  4387 raft_consensus.cc:493] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:04.607462  4387 raft_consensus.cc:3060] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:04.600515  2224 rpcz_store.cc:276] 0709 13:00:01.807891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:02.106208 (+298317us) service_pool.cc:224] Handling call
0709 13:00:02.516774 (+410566us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:02.517460 (+   686us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:04.599815 (+2082355us) spinlock_profiling.cc:243] Waited 410 ms on lock 0x7b54006e0ad0. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b28ad 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:04.599999 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":943557888}
I20260709 13:00:04.547076  1497 leader_election.cc:304] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:04.612813  3934 raft_consensus.cc:2804] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:04.613418  3934 raft_consensus.cc:697] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
W20260709 13:00:04.612890  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 65891.3us
I20260709 13:00:04.614323  3934 consensus_queue.cc:237] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:00:04.616537  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:04.616978  4488 consensus_queue.cc:1048] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:04.618623  1676 raft_consensus.cc:1275] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:00:04.619400  1528 raft_consensus.cc:2468] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 6.
I20260709 13:00:04.619553  1680 raft_consensus.cc:1240] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:04.621599  1528 raft_consensus.cc:1275] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:00:04.616480  1497 leader_election.cc:304] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:04.577426  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:04.635032  1497 leader_election.cc:304] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:04.635387  1672 raft_consensus.cc:2376] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 8. Re-sending same reply.
W20260709 13:00:04.636565  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 67915.5us
I20260709 13:00:04.637418  1571 leader_election.cc:304] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b
W20260709 13:00:04.638643  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 100769us
I20260709 13:00:04.639580  2192 leader_election.cc:304] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:04.538553  4537 raft_consensus.cc:2749] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:04.548970  4384 raft_consensus.cc:3055] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:04.554096  4357 raft_consensus.cc:2804] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:04.549050  4472 raft_consensus.cc:2804] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:00:04.648593  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 80660.2us
I20260709 13:00:04.553375  4556 leader_election.cc:290] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:04.649122  1571 leader_election.cc:304] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:04.651428  2190 leader_election.cc:304] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:04.629379  4436 raft_consensus.cc:2749] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:04.650914  4357 raft_consensus.cc:493] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:04.644569  4541 raft_consensus.cc:2804] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:04.642721  4496 raft_consensus.cc:2804] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:04.650738  4380 raft_consensus.cc:2804] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:04.665861  2192 leader_election.cc:304] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:00:04.663996  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 140938us
I20260709 13:00:04.645205  4384 raft_consensus.cc:740] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:04.642768  4446 raft_consensus.cc:2749] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:04.651882  4435 raft_consensus.cc:2749] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:04.643169  4359 consensus_queue.cc:1059] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
W20260709 13:00:04.683529  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:04.658733  4194 raft_consensus.cc:2804] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:04.658350  4561 raft_consensus.cc:2804] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:04.717423  1672 raft_consensus.cc:1275] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:00:04.644963  4328 consensus_queue.cc:1059] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:00:04.653856  4190 consensus_queue.cc:1048] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:00:04.670166  4529 raft_consensus.cc:2804] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:04.665160  4541 raft_consensus.cc:493] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:04.663592  4413 raft_consensus.cc:2749] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:04.665910  4357 raft_consensus.cc:3060] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:04.672238  4396 raft_consensus.cc:493] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:04.673935  4496 raft_consensus.cc:493] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:04.674265  4472 raft_consensus.cc:697] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
W20260709 13:00:04.745273  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 103239us
I20260709 13:00:04.724545  4561 raft_consensus.cc:493] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:04.689438  4537 consensus_queue.cc:1059] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 13:00:04.718288  4194 raft_consensus.cc:493] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:04.713227  4043 consensus_queue.cc:1059] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:00:04.741782  4541 raft_consensus.cc:3060] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:04.766206  1497 leader_election.cc:304] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:04.784379  1428 catalog_manager.cc:5697] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 reported cstate change: term changed from 3 to 4, leader changed from e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 4 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:04.785451  4557 raft_consensus.cc:2749] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:04.786756  1497 leader_election.cc:304] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:04.787529  4557 raft_consensus.cc:2749] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:04.741393  4458 raft_consensus.cc:2749] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:04.770692  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:04.788717  1497 leader_election.cc:304] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:04.788201  1428 catalog_manager.cc:5697] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 reported cstate change: term changed from 2 to 3, leader changed from e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:04.789180  1530 raft_consensus.cc:3060] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:04.789582  4557 raft_consensus.cc:2749] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:04.790840  1497 leader_election.cc:304] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:04.763299  4505 raft_consensus.cc:3055] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:04.791105  1428 catalog_manager.cc:5697] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 reported cstate change: term changed from 3 to 5, leader changed from b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) to 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194). New cstate: current_term: 5 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:00:04.792006  4505 raft_consensus.cc:740] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:04.792794  4505 consensus_queue.cc:260] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:04.793445  1430 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46260 (request call id 364) took 13427 ms (client timeout 15000 ms). Trace:
I20260709 13:00:04.793972  4505 raft_consensus.cc:3060] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:04.762507  4194 raft_consensus.cc:3060] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:04.778738   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:04.780679  4384 consensus_queue.cc:260] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:04.791543  4557 raft_consensus.cc:2749] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:04.776765  4460 raft_consensus.cc:3055] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:04.795622  4460 raft_consensus.cc:740] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:04.793095  1497 leader_election.cc:304] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:04.776324  4043 raft_consensus.cc:993] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b: : Instructing follower e46412b3b0b44f01ad5c33d4cfe3d6b1 to start an election
I20260709 13:00:04.795903  4384 raft_consensus.cc:3060] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:04.796535  4043 raft_consensus.cc:1081] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 4 LEADER]: Signalling peer e46412b3b0b44f01ad5c33d4cfe3d6b1 to start an election
I20260709 13:00:04.797200  4557 raft_consensus.cc:2749] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:04.798848  4557 consensus_queue.cc:1048] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:04.794785  1428 catalog_manager.cc:5697] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 reported cstate change: term changed from 2 to 5, leader changed from 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 5 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:04.670285  4286 consensus_queue.cc:1059] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.076s
I20260709 13:00:04.826426  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:04.756376  4496 raft_consensus.cc:3060] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:04.757843  4561 raft_consensus.cc:3060] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:04.837792  1530 raft_consensus.cc:2468] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 7.
I20260709 13:00:04.839300  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:04.760942  4396 raft_consensus.cc:515] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:04.848870  4541 raft_consensus.cc:515] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:04.793936  1430 rpcz_store.cc:269] 0709 12:59:51.365689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:51.365918 (+   229us) service_pool.cc:224] Handling call
0709 13:00:04.793353 (+13427435us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:56.719166 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:56.835533 (+116367us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:56.835588 (+    55us) write_op.cc:435] Acquired schema lock
0709 12:59:56.835606 (+    18us) tablet.cc:662] Decoding operations
0709 12:59:56.836963 (+  1357us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:56.837042 (+    79us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:56.837071 (+    29us) tablet.cc:685] Acquiring locks for 14 operations
0709 12:59:56.838241 (+  1170us) tablet.cc:701] Row locks acquired
0709 12:59:56.838287 (+    46us) write_op.cc:260] PREPARE: finished
0709 12:59:56.838472 (+   185us) write_op.cc:270] Start()
0709 12:59:56.838627 (+   155us) write_op.cc:276] Timestamp: P: 1783601996838403 usec, L: 0
0709 12:59:56.838643 (+    16us) op_driver.cc:348] REPLICATION: starting
0709 12:59:57.075300 (+236657us) log.cc:844] Serialized 5542 byte log entry
0709 12:59:58.796037 (+1720737us) op_driver.cc:464] REPLICATION: finished
0709 12:59:59.322224 (+526187us) write_op.cc:301] APPLY: starting
0709 12:59:59.322353 (+   129us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:59.322641 (+   288us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:59.322798 (+   157us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:59.328596 (+  5798us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:59.328893 (+   297us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=14
0709 12:59:59.330724 (+  1831us) write_op.cc:312] APPLY: finished
0709 12:59:59.378805 (+ 48081us) log.cc:844] Serialized 101 byte log entry
0709 12:59:59.409516 (+ 30711us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:59.422741 (+ 13225us) write_op.cc:454] Released schema lock
0709 12:59:59.433697 (+ 10956us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:59.491674 (+ 57977us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:59.501631 (+  9957us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":56344,"reported_tablets":33,"child_traces":[["op",{"apply.queue_time_us":447296,"apply.run_cpu_time_us":7607,"apply.run_wall_time_us":172293,"num_ops":14,"prepare.queue_time_us":205378,"prepare.run_cpu_time_us":22097,"prepare.run_wall_time_us":635444,"raft.queue_time_us":544690,"raft.run_cpu_time_us":34554,"raft.run_wall_time_us":500422,"replication_time_us":1866570,"thread_start_us":987150,"threads_started":4,"wal-append.queue_time_us":321767,"wal-append.run_cpu_time_us":39376,"wal-append.run_wall_time_us":2941697}]]}
I20260709 13:00:04.865636  4541 leader_election.cc:290] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:04.866768  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
W20260709 13:00:04.877030  2190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:04.884975  1530 raft_consensus.cc:2376] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 8. Re-sending same reply.
W20260709 13:00:04.890185  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:04.911751  4359 consensus_queue.cc:1048] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:04.913259  4540 leader_election.cc:290] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:04.884972  4460 consensus_queue.cc:260] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:04.914440  4460 raft_consensus.cc:3060] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:04.916181  4396 leader_election.cc:290] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:04.918957  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:04.919826  1530 raft_consensus.cc:2410] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:00:04.920580  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:04.920867  4540 raft_consensus.cc:493] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:04.921538  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:04.921387  4540 raft_consensus.cc:515] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:04.923388  4540 leader_election.cc:290] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:04.922529  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:04.827019  4328 consensus_queue.cc:1059] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.097s
I20260709 13:00:04.957187  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:04.961750  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 13:00:04.963018  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 297253us
I20260709 13:00:04.960904  1530 raft_consensus.cc:3060] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:04.924037  4540 raft_consensus.cc:493] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:04.968533  2192 leader_election.cc:304] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:04.975104  2192 leader_election.cc:304] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:04.956024  4529 raft_consensus.cc:697] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 7 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:04.954404  4541 raft_consensus.cc:493] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:04.981307  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:04.973707  4435 raft_consensus.cc:2804] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:04.973568  4380 raft_consensus.cc:697] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 7 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:04.976765  4540 raft_consensus.cc:515] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:04.972726  4472 consensus_queue.cc:237] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:05.070781  1524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43008 (request call id 1785) took 1839 ms. Trace:
I20260709 13:00:05.071628  1524 rpcz_store.cc:276] 0709 13:00:03.231516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:03.341348 (+109832us) service_pool.cc:224] Handling call
0709 13:00:05.070173 (+1728825us) spinlock_profiling.cc:243] Waited 880 ms on lock 0x7b54000fda54. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:05.070491 (+   318us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2023121280}
W20260709 13:00:05.075999  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 244844us
I20260709 13:00:04.986505  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 13:00:05.079509  1570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:05.080157  1525 raft_consensus.cc:2368] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 7. Current term is 8.
I20260709 13:00:05.080902  1570 leader_election.cc:304] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:05.070016  1523 raft_consensus.cc:1240] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:05.069128  1527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43010 (request call id 1857) took 1003 ms. Trace:
I20260709 13:00:05.082041  1527 rpcz_store.cc:276] 0709 13:00:04.065337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:04.516133 (+450796us) service_pool.cc:224] Handling call
0709 13:00:04.568707 (+ 52574us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:04.568907 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:00:04.582781 (+ 13874us) log.cc:844] Serialized 14 byte log entry
0709 13:00:05.067988 (+485207us) spinlock_profiling.cc:243] Waited 12.5 ms on lock 0x7b180035fda0. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1e38ede1 00007f6a1e39b5b1 00007f6a1815b4bc 00007f6a154a948b 00007f6a1e303ab9 00007f6a154c569b 00007f6a154c393f 00007f6a154c5c02 00007f6a1814d20b 00007f6a18152d23 00007f6a1815323a
0709 13:00:05.068417 (+   429us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:05.068501 (+    84us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:05.068602 (+   101us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:05.068710 (+   108us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:05.068937 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13533,"prepare.queue_time_us":50334,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"spinlock_wait_cycles":28657920,"thread_start_us":67892,"threads_started":1,"wal-append.queue_time_us":189190}
W20260709 13:00:05.085122  1495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:05.087149  1673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49178 (request call id 1718) took 1356 ms. Trace:
I20260709 13:00:05.126341  1673 rpcz_store.cc:276] 0709 13:00:03.730787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:03.730895 (+   108us) service_pool.cc:224] Handling call
0709 13:00:03.731145 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:03.975905 (+244760us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:05.086465 (+1110560us) spinlock_profiling.cc:243] Waited 244 ms on lock 0x7b54002fab54. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:00:05.086886 (+   421us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":561553792}
I20260709 13:00:05.003619  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 592) took 2320 ms. Trace:
I20260709 13:00:05.067485  1528 raft_consensus.cc:1275] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:00:05.128217  1602 rpcz_store.cc:276] 0709 13:00:02.683078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:02.683198 (+   120us) service_pool.cc:224] Handling call
0709 13:00:02.700166 (+ 16968us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:03.012688 (+312522us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:05.003327 (+1990639us) spinlock_profiling.cc:243] Waited 312 ms on lock 0x7b5400058054. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:00:05.003540 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":717332864}
I20260709 13:00:05.102604  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:05.104290  1607 raft_consensus.cc:1275] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:00:04.988655  2192 leader_election.cc:304] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:05.112320  1678 raft_consensus.cc:1240] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:05.130460  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36200 (request call id 1986) took 1141 ms. Trace:
I20260709 13:00:05.130755  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:05.111990  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:05.132129  1677 raft_consensus.cc:2468] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 6.
I20260709 13:00:05.133591  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:05.134158  1644 leader_election.cc:304] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:05.113612  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:05.114403  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:05.114763  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:05.113692  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:05.137753  1525 raft_consensus.cc:1240] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:05.137753  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 13:00:05.139582  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 150917us
I20260709 13:00:05.116055  1526 raft_consensus.cc:3060] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:05.140941  2192 leader_election.cc:304] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:05.117317  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:05.118360  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:05.118769  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:05.120235  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:05.093554  1571 leader_election.cc:304] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:05.136143  2221 raft_consensus.cc:2468] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 5.
I20260709 13:00:05.136322  2222 raft_consensus.cc:2410] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:00:05.137526  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:05.115293  1606 raft_consensus.cc:1240] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:05.116691  1601 raft_consensus.cc:1240] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:05.135353  1607 rpcz_store.cc:276] 0709 13:00:03.988798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:03.988937 (+   139us) service_pool.cc:224] Handling call
0709 13:00:05.103216 (+1114279us) spinlock_profiling.cc:243] Waited 1.52 ms on lock 0x7b5800017198. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a1548eb71 00007f6a1548ea22 00007f6a1e3a7c09 00007f6a1d501ee0 00007f6a1d5cb0ab 00007f6a1d5cb131 00007f6a1d58cfc0 00007f6a1d577929 00007f6a1d5773d2 00007f6a16aeebd4
0709 13:00:05.103579 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:05.130054 (+ 26475us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:05.130383 (+   329us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3499776}
I20260709 13:00:05.171978  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:05.139984  2220 raft_consensus.cc:2468] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 6.
I20260709 13:00:04.995635  4328 raft_consensus.cc:2804] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:05.182941  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:05.183928  4460 consensus_queue.cc:1048] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:00:05.186009  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:05.188231  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:05.189131  4574 consensus_queue.cc:1059] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:05.190062  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:05.190483  2225 raft_consensus.cc:2468] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 6.
I20260709 13:00:05.191215  4505 raft_consensus.cc:2804] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:05.192035  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:05.192618  1599 raft_consensus.cc:3060] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:05.191931  4586 raft_consensus.cc:3055] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:05.195829  4586 raft_consensus.cc:740] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:05.196412  4559 consensus_queue.cc:1059] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:05.196974  2219 raft_consensus.cc:2468] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 3.
I20260709 13:00:05.197211  4586 consensus_queue.cc:260] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:05.198443  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:05.026144  4540 leader_election.cc:290] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:05.199482  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:05.019412  4529 consensus_queue.cc:237] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:05.200708  4396 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:05.201691  4396 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 13:00:05.024896  4554 leader_election.cc:290] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:05.003197  4435 raft_consensus.cc:697] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 4 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:05.204608  4282 raft_consensus.cc:493] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:05.202493  4586 raft_consensus.cc:3060] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:05.204491  4435 consensus_queue.cc:237] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:05.205521  4282 raft_consensus.cc:515] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:05.191908  4505 raft_consensus.cc:697] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 6 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:05.201716  2220 raft_consensus.cc:3060] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:05.026995  4387 raft_consensus.cc:515] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:05.208492  4282 leader_election.cc:290] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:05.208178  4505 consensus_queue.cc:237] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:05.210232  4387 leader_election.cc:290] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:05.198453  4532 raft_consensus.cc:2749] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:05.202366  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:05.195829  1675 raft_consensus.cc:1275] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:00:05.220602  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 140003us
I20260709 13:00:05.191949  4503 raft_consensus.cc:493] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
W20260709 13:00:05.240432  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 99645.7us
I20260709 13:00:05.284801  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43008 (request call id 1786) took 2048 ms. Trace:
I20260709 13:00:05.288532  1527 raft_consensus.cc:1240] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 LEADER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:05.285297  1526 rpcz_store.cc:276] 0709 13:00:03.231756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:03.370744 (+138988us) service_pool.cc:224] Handling call
0709 13:00:03.422902 (+ 52158us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:04.560274 (+1137372us) spinlock_profiling.cc:243] Waited 710 ms on lock 0x7b58005225d0. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a1850f0aa 00007f6a18591447 00007f6a185a9fe7 00007f6a185ab7de 00007f6a185b5b49 00007f6a185b6416 00007f6a185b2d8f 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4
0709 13:00:05.073758 (+513484us) spinlock_profiling.cc:243] Waited 21.8 ms on lock 0x7b54001d6da0. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a18528a1d 00007f6a1850f1a4 00007f6a18591447 00007f6a185a9fe7 00007f6a185ab7de 00007f6a185b5b49 00007f6a185b6416 00007f6a185b2d8f 00007f6a185b283e 00007f6a1d577419
0709 13:00:05.226091 (+152333us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:00:05.226122 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:05.238212 (+ 12090us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:05.244146 (+  5934us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:05.244246 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:05.280464 (+ 36218us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2692,"raft.queue_time_us":1625,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":9597,"spinlock_wait_cycles":1683044480}
I20260709 13:00:05.294601  1677 raft_consensus.cc:1240] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 4. Current term is 5. Ops: []
W20260709 13:00:05.299641  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 206571us
I20260709 13:00:04.989557  4541 raft_consensus.cc:515] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:05.022984  4561 raft_consensus.cc:515] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:05.306591  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:05.306867  4490 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 13:00:05.307421  4578 raft_consensus.cc:493] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:05.308012  4331 consensus_queue.cc:1048] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.079s
I20260709 13:00:05.308211  4578 raft_consensus.cc:515] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:05.309821  4190 raft_consensus.cc:3060] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:05.310920  4585 raft_consensus.cc:2804] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:00:05.312040  2190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:05.305509  1570 leader_election.cc:304] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:05.245718  1528 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2228d923442c4e439f7f227db910dad8"
dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:49310
I20260709 13:00:05.304760  1526 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9"
dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:49310
I20260709 13:00:05.322628  4328 raft_consensus.cc:697] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 6 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:05.326016  4328 consensus_queue.cc:237] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:05.329133  4296 raft_consensus.cc:3060] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:05.333149  4496 raft_consensus.cc:515] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:05.333386  4380 consensus_queue.cc:237] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:05.333523  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 218845us
I20260709 13:00:05.335237  1531 raft_consensus.cc:2393] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 8: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:00:05.318529  4503 raft_consensus.cc:515] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:05.310710  4402 raft_consensus.cc:493] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:05.341063  4541 leader_election.cc:290] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:05.306505  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:05.343851  4456 leader_election.cc:290] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:05.344674  4396 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:05.294341  4460 consensus_queue.cc:1059] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:00:05.347055  4471 raft_consensus.cc:3055] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:05.349072  1528 raft_consensus.cc:493] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:05.349485  1496 leader_election.cc:304] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:05.339059  4446 raft_consensus.cc:3055] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:05.350823  1599 raft_consensus.cc:2468] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 7.
I20260709 13:00:05.362264  1526 raft_consensus.cc:493] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:05.364892  4574 consensus_queue.cc:1048] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:05.365327  3970 raft_consensus.cc:2804] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:05.310801  4269 raft_consensus.cc:493] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:05.371318  1528 raft_consensus.cc:3060] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:05.374373  1526 raft_consensus.cc:3060] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:05.381860  4460 raft_consensus.cc:3055] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:05.382407  4460 raft_consensus.cc:740] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:05.383644  4460 consensus_queue.cc:260] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:05.384167  4576 log.cc:927] Time spent T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.398s	user 0.001s	sys 0.000s
I20260709 13:00:05.341099  4499 raft_consensus.cc:3060] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:05.386576  1527 raft_consensus.cc:1240] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:05.339120  3934 raft_consensus.cc:493] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:05.366189  4471 raft_consensus.cc:740] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:05.367815  4446 raft_consensus.cc:740] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:05.396525  3970 raft_consensus.cc:697] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 8 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:05.391180  1530 raft_consensus.cc:2468] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 8.
I20260709 13:00:05.399195  4472 raft_consensus.cc:2764] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
W20260709 13:00:05.399890  4194 consensus_meta.cc:287] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b: Time spent flushing consensus metadata: real 0.605s	user 0.004s	sys 0.009s
I20260709 13:00:05.399675  4269 raft_consensus.cc:515] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:05.401234  1497 leader_election.cc:304] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:05.402029  4324 consensus_queue.cc:1048] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:05.402793  4455 raft_consensus.cc:2749] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:00:05.403451  2191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:05.408742  2222 raft_consensus.cc:2468] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 8.
I20260709 13:00:05.419268  1523 raft_consensus.cc:1240] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 7. Current term is 8. Ops: []
W20260709 13:00:05.423718  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 74544.9us
I20260709 13:00:05.423767  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:05.424876  1527 raft_consensus.cc:2468] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 5.
I20260709 13:00:05.425158  1496 leader_election.cc:304] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:05.423460  4194 raft_consensus.cc:515] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:05.426940  2218 raft_consensus.cc:1275] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:00:05.427870  4591 log.cc:927] Time spent T 00000000000000000000000000000000 P 9f38d0e5c9db43a48554defe1153354e: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:00:05.429278  4541 raft_consensus.cc:2749] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:05.423405  4532 consensus_queue.cc:1059] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:00:05.403331  4528 raft_consensus.cc:493] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:05.439836  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:05.429582  4194 leader_election.cc:290] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:00:05.453418  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 47196.6us
I20260709 13:00:05.458879  4529 raft_consensus.cc:493] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:05.459864  4529 raft_consensus.cc:515] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:05.461283  4531 consensus_queue.cc:1059] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:05.463307  1530 raft_consensus.cc:1240] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:05.464843  4559 consensus_queue.cc:1059] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:05.465684  2220 raft_consensus.cc:1275] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:00:05.466395  4528 raft_consensus.cc:515] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:05.469578  4528 leader_election.cc:290] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:05.403307  4402 raft_consensus.cc:515] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:05.463213  4288 raft_consensus.cc:3055] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:05.397686  3934 raft_consensus.cc:515] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:05.450229  4460 raft_consensus.cc:3060] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:05.449720  4541 raft_consensus.cc:2804] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:00:05.469714  4357 consensus_meta.cc:287] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b: Time spent flushing consensus metadata: real 0.662s	user 0.009s	sys 0.002s
I20260709 13:00:05.477425  4288 raft_consensus.cc:740] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:05.473569  4537 raft_consensus.cc:493] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:05.416035  4456 consensus_queue.cc:1059] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 13:00:05.474074  4496 leader_election.cc:290] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:05.473114  4529 leader_election.cc:290] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:05.497069  4537 raft_consensus.cc:515] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:05.497619  4598 consensus_queue.cc:1059] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 13:00:05.497385  4288 consensus_queue.cc:260] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:05.498564  1497 leader_election.cc:304] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:05.500766  4599 raft_consensus.cc:3055] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:00:05.501315  4601 log.cc:927] Time spent T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.066s	user 0.001s	sys 0.001s
I20260709 13:00:05.508260  4402 leader_election.cc:290] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:05.508445  4471 consensus_queue.cc:260] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:05.538591  4503 leader_election.cc:290] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:05.539211  4471 raft_consensus.cc:3060] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:05.509616  4606 raft_consensus.cc:493] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:05.497458  4446 consensus_queue.cc:260] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:05.491009  4531 raft_consensus.cc:3055] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:05.543004  4531 raft_consensus.cc:740] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:05.543217  4446 raft_consensus.cc:3060] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:05.544126  4531 consensus_queue.cc:260] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:05.545542  4531 raft_consensus.cc:3060] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:05.546875  4600 consensus_queue.cc:1175] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b96ce9cc496c49d7818fa983a17b062b" responder_term: 4 status { last_received { term: 4 index: 6 } last_committed_idx: 6 last_received_current_leader { term: 4 index: 6 } }
I20260709 13:00:05.547783  4606 raft_consensus.cc:515] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:05.549016  4402 consensus_queue.cc:1048] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:05.549615  4269 leader_election.cc:290] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:05.550107  4606 leader_election.cc:290] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:00:05.550978  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 64785.9us
I20260709 13:00:05.551739  1644 leader_election.cc:304] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:05.552560  4609 raft_consensus.cc:2804] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:05.553057  4609 raft_consensus.cc:697] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 6 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:05.554097  4609 consensus_queue.cc:237] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:05.555011  4033 raft_consensus.cc:493] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:00:05.555532  4033 raft_consensus.cc:3060] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:05.558137  4607 consensus_queue.cc:1048] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:00:05.560169  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:05.561611  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:05.477141  4578 leader_election.cc:290] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:05.514405  1496 leader_election.cc:304] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
W20260709 13:00:05.514977  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:05.515260  4456 raft_consensus.cc:493] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:05.515406  4529 raft_consensus.cc:3055] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:00:05.518795  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 263131us
I20260709 13:00:05.504069  1528 raft_consensus.cc:515] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:05.520803  2190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:05.485479  4541 raft_consensus.cc:493] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:05.516994  4561 leader_election.cc:290] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:05.525099  4413 raft_consensus.cc:3055] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:05.528885  4598 raft_consensus.cc:3055] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:05.486529  4457 consensus_queue.cc:1048] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.081s
I20260709 13:00:05.532474  4496 raft_consensus.cc:2749] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:05.521327  4599 raft_consensus.cc:740] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:05.534936  4585 raft_consensus.cc:493] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:00:05.536418  4537 leader_election.cc:290] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:05.470285  3970 consensus_queue.cc:237] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:05.532688  4610 raft_consensus.cc:993] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90: : Instructing follower 39a92f5a4352465d8af3af5908fe8642 to start an election
I20260709 13:00:05.538007  1497 leader_election.cc:304] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:00:05.578538  4529 raft_consensus.cc:740] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:05.565210  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:05.566773  1571 leader_election.cc:304] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:05.569350  1530 raft_consensus.cc:1240] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:00:05.592723  2219 raft_consensus.cc:1275] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:00:05.588661  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:05.591488  1528 leader_election.cc:290] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:05.580473  4541 raft_consensus.cc:3060] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:05.564961  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:05.570389  1678 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 8.
I20260709 13:00:05.588567  4598 raft_consensus.cc:740] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:05.586261  4413 raft_consensus.cc:740] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:05.595547  4282 raft_consensus.cc:493] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:05.598122  4585 raft_consensus.cc:3060] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:05.610340  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:05.612260  1570 leader_election.cc:304] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:05.596843  4578 raft_consensus.cc:493] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:05.618722  4529 consensus_queue.cc:260] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:05.619714  1681 raft_consensus.cc:1240] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:05.620291  4561 raft_consensus.cc:2749] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:05.621825  4435 raft_consensus.cc:493] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:05.623044  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 56380.4us
I20260709 13:00:05.623697  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:00:05.624329  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 135853us
I20260709 13:00:05.627080  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 13:00:05.632885  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 54006.5us
W20260709 13:00:05.631414  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 93510.1us
I20260709 13:00:05.630764  1532 raft_consensus.cc:1240] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:05.651342  1605 raft_consensus.cc:1275] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:00:05.570839  4357 raft_consensus.cc:515] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:05.629784  4556 raft_consensus.cc:2804] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:05.689868  4556 raft_consensus.cc:493] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:05.690316  4556 raft_consensus.cc:3060] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:05.688469  2226 raft_consensus.cc:2468] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 6.
I20260709 13:00:05.652415  4190 raft_consensus.cc:2749] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:05.633121  4288 raft_consensus.cc:3060] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:05.634941  4282 raft_consensus.cc:515] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:05.609766  4503 raft_consensus.cc:2804] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:05.610746  4456 raft_consensus.cc:515] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:05.602099  4396 consensus_queue.cc:1048] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 13:00:05.631479  4599 consensus_queue.cc:260] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:00:05.659587  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 55765.2us
I20260709 13:00:05.716583  1570 leader_election.cc:304] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
W20260709 13:00:05.719590  2190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:05.725562  4456 leader_election.cc:290] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:00:05.727115  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:05.659893  4537 raft_consensus.cc:493] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:05.660596  4609 raft_consensus.cc:1081] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 4 LEADER]: Signalling peer 39a92f5a4352465d8af3af5908fe8642 to start an election
I20260709 13:00:05.661206  4598 consensus_queue.cc:260] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:05.662014  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:05.662694  4296 raft_consensus.cc:2804] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:05.663550  4496 raft_consensus.cc:493] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:05.666833  4578 raft_consensus.cc:515] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:05.668406  4529 raft_consensus.cc:3060] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:05.669421  4413 consensus_queue.cc:260] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:05.706113  4033 raft_consensus.cc:515] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:05.679556  1526 raft_consensus.cc:515] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:05.702883  4357 leader_election.cc:290] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 5 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:05.704324  3934 leader_election.cc:290] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:05.668394  4521 raft_consensus.cc:3055] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:05.774439  4578 leader_election.cc:290] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:05.774792  4521 raft_consensus.cc:740] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:05.775730  4598 raft_consensus.cc:3060] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:05.775933  4521 consensus_queue.cc:260] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:05.777427  4521 raft_consensus.cc:3060] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:05.710391  4435 raft_consensus.cc:515] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:05.774431  4585 raft_consensus.cc:515] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:05.780472  4435 leader_election.cc:290] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:05.711434  2227 raft_consensus.cc:1240] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:05.713045  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36200 (request call id 1979) took 1834 ms. Trace:
I20260709 13:00:05.739954  4561 raft_consensus.cc:493] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:05.783183  4561 raft_consensus.cc:515] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:05.748410  4296 raft_consensus.cc:493] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:05.785651  4296 raft_consensus.cc:3060] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:05.785861  4537 raft_consensus.cc:515] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:05.788434  4537 leader_election.cc:290] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:05.780975  4585 leader_election.cc:290] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 5 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:05.794906  2223 raft_consensus.cc:1240] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 7 LEADER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:05.796474  2223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50310 (request call id 605) took 1914 ms. Trace:
I20260709 13:00:05.797089  4282 leader_election.cc:290] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:00:05.797914  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 81465.1us
I20260709 13:00:05.782018  1605 rpcz_store.cc:276] 0709 13:00:03.878896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:03.879021 (+   125us) service_pool.cc:224] Handling call
0709 13:00:03.879301 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:05.689186 (+1809885us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:05.712746 (+ 23560us) spinlock_profiling.cc:243] Waited 1.73 s on lock 0x7b54000db454. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:00:05.712985 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3983449344}
W20260709 13:00:05.730631  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 168543us
I20260709 13:00:05.663596  4324 raft_consensus.cc:493] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:05.742213  1496 leader_election.cc:304] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:05.740973  1572 leader_election.cc:304] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:00:05.672245  4194 raft_consensus.cc:493] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:05.759609  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:05.760739  1527 raft_consensus.cc:1240] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:05.727015  4503 raft_consensus.cc:493] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:05.807337  4503 raft_consensus.cc:3060] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:05.810190  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 73008us
I20260709 13:00:05.811128  1570 leader_election.cc:304] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:05.812733  1570 leader_election.cc:400] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 election: Vote denied by peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931) with higher term. Message: Invalid argument: T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 5. Current term is 6.
I20260709 13:00:05.812762  4529 raft_consensus.cc:2804] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:05.797462  4610 raft_consensus.cc:2955] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 4 LEADER]: Committing config change with OpId 4.5: config changed from index 2 to 5, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:00:05.813277  4529 raft_consensus.cc:493] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:05.813771  4529 raft_consensus.cc:3060] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:05.764459  1526 leader_election.cc:290] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:05.765933  4541 raft_consensus.cc:515] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:05.768617  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:05.756623  4413 raft_consensus.cc:3060] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:05.755098  4496 raft_consensus.cc:515] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:05.770149  1571 leader_election.cc:304] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
W20260709 13:00:05.757385  4505 consensus_queue.cc:1175] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ddf11fc190dd4b898773379c6b129d90" responder_term: 8 status { last_received { term: 7 index: 7 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 7. Current term is 8. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:00:05.770745  4033 leader_election.cc:290] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:05.771108  1681 raft_consensus.cc:1275] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:00:05.748556  4456 raft_consensus.cc:2804] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:05.771992  4528 raft_consensus.cc:3055] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:05.834263  4528 raft_consensus.cc:740] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:05.829699  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:05.819681  4578 raft_consensus.cc:2764] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:00:05.835335  4528 consensus_queue.cc:260] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:05.836725  4528 raft_consensus.cc:3060] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:05.836803   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:05.840236  4599 raft_consensus.cc:3060] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:05.831939  4456 raft_consensus.cc:493] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:05.841836  4456 raft_consensus.cc:3060] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:05.842784  1529 raft_consensus.cc:2468] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 5.
I20260709 13:00:05.773016  1497 leader_election.cc:304] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:00:05.843849  3934 raft_consensus.cc:2804] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:00:05.844055  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 78992.1us
I20260709 13:00:05.844442  3934 raft_consensus.cc:697] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:00:05.844915  1497 leader_election.cc:304] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:05.845710  3934 consensus_queue.cc:237] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:05.796873  2223 rpcz_store.cc:276] 0709 13:00:03.882181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:03.882310 (+   129us) service_pool.cc:224] Handling call
0709 13:00:03.911665 (+ 29355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:05.795458 (+1883793us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:05.796185 (+   727us) spinlock_profiling.cc:243] Waited 1.88 s on lock 0x7b5400456ad4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:00:05.796390 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4330527616}
I20260709 13:00:05.847541  4499 raft_consensus.cc:2804] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:05.847997  4499 raft_consensus.cc:493] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:05.848352  4499 raft_consensus.cc:3060] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:05.805433  4194 raft_consensus.cc:515] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:05.806263  4324 raft_consensus.cc:515] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:05.785280  4561 leader_election.cc:290] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:05.820858  1680 raft_consensus.cc:1275] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 13:00:05.825929  2191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:05.832230  1570 leader_election.cc:304] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:05.797561  4556 raft_consensus.cc:515] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:05.848923  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:00:05.851910  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 81820.5us
I20260709 13:00:05.864674  1571 leader_election.cc:304] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
W20260709 13:00:05.863593  2191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:05.865563  1571 leader_election.cc:304] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:05.825953  4387 raft_consensus.cc:2749] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:00:05.874487  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 177664us
I20260709 13:00:05.875325  1496 leader_election.cc:304] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:05.870621  1644 leader_election.cc:304] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:05.876559  3970 raft_consensus.cc:2804] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:05.873631  4282 consensus_queue.cc:1048] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:00:05.877014  3970 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:05.877424  3970 raft_consensus.cc:3060] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:05.879572  4561 raft_consensus.cc:2749] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:05.880177  4556 leader_election.cc:290] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:00:05.881162  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 66971us
I20260709 13:00:05.859781  4578 raft_consensus.cc:2749] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:05.896451  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:05.903864  1570 leader_election.cc:304] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:05.904897  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:05.905267  1678 raft_consensus.cc:1275] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:00:05.905812  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:05.906167  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:05.906436  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:05.906999  4578 consensus_queue.cc:1048] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:00:05.910063  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:05.908255  1672 raft_consensus.cc:2468] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 4.
I20260709 13:00:05.909584  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:05.883181  4460 consensus_queue.cc:1048] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:00:05.886912  4505 consensus_queue.cc:1048] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:00:05.898768  4556 raft_consensus.cc:2749] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:05.925354  1571 leader_election.cc:304] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:05.927969  4446 raft_consensus.cc:3060] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:05.928602  2224 raft_consensus.cc:1275] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 8 LEARNER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:05.933153  2227 raft_consensus.cc:1240] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:05.948294  1681 raft_consensus.cc:2468] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 7.
I20260709 13:00:05.924454  2220 raft_consensus.cc:3055] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:05.954627  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:05.959453  4194 leader_election.cc:290] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:05.941427  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:05.936018  4537 raft_consensus.cc:2804] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:05.961620  2218 raft_consensus.cc:3055] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:05.969893  1496 leader_election.cc:304] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:05.961839  4190 raft_consensus.cc:493] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:05.957450  2220 raft_consensus.cc:740] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:05.942138  4296 raft_consensus.cc:515] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:00:06.034153  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 146893us
I20260709 13:00:05.977458  4537 raft_consensus.cc:493] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:05.979007  2218 raft_consensus.cc:740] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:06.040150  4537 raft_consensus.cc:3060] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:06.059661  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 127405us
I20260709 13:00:06.047875  4556 raft_consensus.cc:2749] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:06.072118  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:06.074154  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:06.050294  3934 raft_consensus.cc:493] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:06.081799  1570 leader_election.cc:304] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:06.089538  1528 raft_consensus.cc:2468] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 8.
I20260709 13:00:06.063056  4387 raft_consensus.cc:493] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:06.058121  4324 leader_election.cc:290] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:06.090741  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:06.096918  4587 raft_consensus.cc:493] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:06.097517  4587 raft_consensus.cc:515] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:06.099609  4587 leader_election.cc:290] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:06.100700  4446 raft_consensus.cc:2749] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:00:06.101387  4620 log.cc:927] Time spent T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.173s	user 0.000s	sys 0.001s
I20260709 13:00:06.102216  1523 raft_consensus.cc:1275] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:00:06.102809  4542 raft_consensus.cc:493] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:06.103559  4455 raft_consensus.cc:2749] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:06.103338  4542 raft_consensus.cc:515] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:06.105412  4542 leader_election.cc:290] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:06.106555  4350 raft_consensus.cc:493] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:06.094982  4578 raft_consensus.cc:493] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:06.107268  4578 raft_consensus.cc:515] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:06.115280  2190 leader_election.cc:304] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:06.116426  4505 raft_consensus.cc:2804] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:06.116914  4505 raft_consensus.cc:493] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:06.117290  4505 raft_consensus.cc:3060] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:06.119169  4628 log.cc:927] Time spent T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:00:06.126638  4505 raft_consensus.cc:515] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:06.128401  4499 raft_consensus.cc:515] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:06.129127  4505 leader_election.cc:290] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 6 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:06.050355  4190 raft_consensus.cc:515] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:06.095679  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:06.130640  4499 leader_election.cc:290] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:00:06.141516  4625 log.cc:927] Time spent T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.205s	user 0.001s	sys 0.000s
I20260709 13:00:06.186611  1532 raft_consensus.cc:3060] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:06.078823  2220 consensus_queue.cc:260] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:06.131331  4503 raft_consensus.cc:515] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:06.180130  2218 consensus_queue.cc:260] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:06.180394  4350 raft_consensus.cc:515] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:06.190737  4327 consensus_queue.cc:1059] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:06.193310  4456 raft_consensus.cc:515] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:06.176354  4490 raft_consensus.cc:493] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:06.194250  4505 consensus_queue.cc:1059] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:00:06.195451  4631 log.cc:927] Time spent T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:00:06.233515  4490 raft_consensus.cc:515] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:06.195892  4190 leader_election.cc:290] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:06.197379  4537 raft_consensus.cc:515] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:06.235980  4490 leader_election.cc:290] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:06.236454  4537 leader_election.cc:290] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:06.096163  3934 raft_consensus.cc:515] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:06.238617  3934 leader_election.cc:290] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:00:06.209472  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 149358us
W20260709 13:00:06.238938  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 405437us
I20260709 13:00:06.239598  1570 leader_election.cc:304] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:06.239790  4456 leader_election.cc:290] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:06.240259  4532 raft_consensus.cc:2804] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:06.240847  4532 raft_consensus.cc:697] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 7 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:06.241751  4532 consensus_queue.cc:237] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:06.242113  4600 raft_consensus.cc:2749] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:06.243040  4269 consensus_queue.cc:1048] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:00:06.245810  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:06.233603  4499 raft_consensus.cc:493] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:06.247352  4499 raft_consensus.cc:515] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:06.248553  4033 consensus_queue.cc:1059] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:06.248900  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:06.249571  1675 raft_consensus.cc:3060] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:06.251616  4503 leader_election.cc:290] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:06.252297  4503 raft_consensus.cc:493] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:06.252831  4503 raft_consensus.cc:515] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:06.248541  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:06.256630  2220 raft_consensus.cc:3060] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:06.258018  1678 raft_consensus.cc:3060] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:06.209494  1532 raft_consensus.cc:2468] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 5.
I20260709 13:00:06.096326  4460 consensus_queue.cc:1059] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.095s
I20260709 13:00:06.181433  4485 raft_consensus.cc:493] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:06.215631  4471 consensus_queue.cc:1059] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
W20260709 13:00:06.229130  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 344619us
I20260709 13:00:06.229617  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:06.221267  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:06.242350  1644 leader_election.cc:304] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:06.179733  4387 raft_consensus.cc:515] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:06.272419  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:06.233127  4327 raft_consensus.cc:3055] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:06.273597  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:06.278900  1528 raft_consensus.cc:2393] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 6: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:00:06.230288  4578 leader_election.cc:290] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:06.274564  1646 leader_election.cc:304] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:06.222172  4296 leader_election.cc:290] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:06.282709  1525 raft_consensus.cc:1275] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:00:06.249682  4033 raft_consensus.cc:3055] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:06.249593  4499 leader_election.cc:290] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:06.294359  4529 raft_consensus.cc:515] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:06.309567  4529 leader_election.cc:290] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:06.284812  3970 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 13:00:06.284224  1527 raft_consensus.cc:3060] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:06.316201  4296 raft_consensus.cc:493] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:06.316800  4296 raft_consensus.cc:515] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:06.282539  1523 raft_consensus.cc:2468] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 5.
I20260709 13:00:06.284327  1525 pending_rounds.cc:85] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting all ops after (but not including) 6
I20260709 13:00:06.319231  1525 pending_rounds.cc:107] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:00:06.319602  1525 raft_consensus.cc:2889] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:06.319868  1680 raft_consensus.cc:1275] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:00:06.288898  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:06.288910  1531 raft_consensus.cc:1275] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:00:06.291110  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:06.291299  4541 leader_election.cc:290] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:06.294736  4485 raft_consensus.cc:515] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:06.325878  4485 leader_election.cc:290] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:00:06.326967  4627 log.cc:927] Time spent T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.216s	user 0.000s	sys 0.014s
I20260709 13:00:06.327937  4296 leader_election.cc:290] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:06.297003  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:06.297618  1570 leader_election.cc:304] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:06.329566  4296 raft_consensus.cc:2749] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:06.329797  1570 leader_election.cc:304] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:06.331090  1570 leader_election.cc:304] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:06.332535  1570 leader_election.cc:304] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:06.333264  4537 raft_consensus.cc:2749] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:06.295715  4503 leader_election.cc:290] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:06.298831  4559 raft_consensus.cc:2749] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:06.299312  4609 consensus_queue.cc:1059] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:06.298169  1528 raft_consensus.cc:1240] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:00:06.334272  4609 raft_consensus.cc:3055] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:06.334637  4609 raft_consensus.cc:740] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:06.333760  1570 leader_election.cc:400] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: Vote denied by peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931) with higher term. Message: Invalid argument: T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 7. Current term is 8.
I20260709 13:00:06.299829  4599 consensus_queue.cc:1048] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:06.338183  4561 raft_consensus.cc:2749] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:06.302110  4350 leader_election.cc:290] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:06.302467  1646 leader_election.cc:304] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:06.339227  4626 consensus_queue.cc:1048] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:06.341006  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:06.302945  4269 raft_consensus.cc:2804] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:06.342090  4598 raft_consensus.cc:2749] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:06.338167  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:06.343183  1676 raft_consensus.cc:3060] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:06.305542  4359 raft_consensus.cc:3055] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:06.343910  4359 raft_consensus.cc:740] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:06.344700  1523 raft_consensus.cc:1240] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:00:06.345199  4496 leader_election.cc:290] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:06.345798  4609 consensus_queue.cc:260] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:00:06.346318  1529 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43010 (request call id 1860) took 2280 ms (client timeout 1960 ms). Trace:
I20260709 13:00:06.346554  1524 raft_consensus.cc:1275] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:00:06.346974  4269 raft_consensus.cc:697] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 8 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:06.347092  4609 raft_consensus.cc:3060] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:06.347923  4269 consensus_queue.cc:237] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:06.332892  4387 leader_election.cc:290] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:06.353451  2190 leader_election.cc:304] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:06.355400  4380 raft_consensus.cc:2804] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:06.355826  4380 raft_consensus.cc:493] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:06.356153  4380 raft_consensus.cc:3060] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:06.344749  4359 consensus_queue.cc:260] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:06.360314  4288 consensus_queue.cc:1048] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:00:06.361006  1529 rpcz_store.cc:269] 0709 13:00:04.066030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:04.162756 (+ 96726us) service_pool.cc:224] Handling call
0709 13:00:06.346059 (+2183303us) spinlock_profiling.cc:243] Waited 1.52 s on lock 0x7b54002da5d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:06.346214 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3504617728}
I20260709 13:00:06.281824  4456 raft_consensus.cc:2749] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:06.335398  1570 leader_election.cc:403] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:06.286681  4033 raft_consensus.cc:740] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:06.279984  4327 raft_consensus.cc:740] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:06.363957  4033 consensus_queue.cc:260] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:06.364293  4327 consensus_queue.cc:260] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:06.365306  4033 raft_consensus.cc:3060] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:06.328377  4485 raft_consensus.cc:493] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:06.337831  4633 log.cc:927] Time spent T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 13:00:06.359627  2190 leader_election.cc:304] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:06.366931  1646 leader_election.cc:304] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:06.366118  4485 raft_consensus.cc:515] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:06.368029  4599 raft_consensus.cc:2749] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:06.360605  4359 raft_consensus.cc:3060] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:06.368322  4456 raft_consensus.cc:2749] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931) with higher term. Message: Invalid argument: T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 7. Current term is 8.
I20260709 13:00:06.369489  4288 raft_consensus.cc:2804] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:06.369972  4288 raft_consensus.cc:493] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:06.370191  4472 consensus_queue.cc:1048] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:06.336705  1527 raft_consensus.cc:2468] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 7.
I20260709 13:00:06.333904  4537 raft_consensus.cc:2749] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:06.373513  2218 raft_consensus.cc:3060] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:06.376633  2192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:06.365482  4327 raft_consensus.cc:3060] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:06.386180  4472 consensus_queue.cc:1059] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:06.386970  4614 consensus_queue.cc:1048] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:00:06.393989  2190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:06.395792  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:06.396834  1681 raft_consensus.cc:1275] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:00:06.397665  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:06.388480  4585 consensus_queue.cc:1048] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.013s
W20260709 13:00:06.404731  2191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:06.387171  4472 raft_consensus.cc:3055] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:06.406831  4472 raft_consensus.cc:740] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:00:06.407800  4472 consensus_queue.cc:260] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:06.409138  4472 raft_consensus.cc:3060] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:06.410987  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:06.411048  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:06.417904  1525 raft_consensus.cc:1240] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 4. Current term is 5. Ops: []
W20260709 13:00:06.418826  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:06.422742  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 89129.8us
I20260709 13:00:06.388630  1646 leader_election.cc:304] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:06.439349  2191 leader_election.cc:304] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:00:06.440215  1496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:06.382795  4288 raft_consensus.cc:3060] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:06.455503  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:06.458434  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:06.458709  1530 raft_consensus.cc:1275] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 13:00:06.461102  1525 raft_consensus.cc:1240] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:06.461805  2226 raft_consensus.cc:2393] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 5: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:00:06.462072  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:06.456424  1678 raft_consensus.cc:2468] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 8.
I20260709 13:00:06.464540  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:06.465260  2227 raft_consensus.cc:2468] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 6.
I20260709 13:00:06.460106  2190 leader_election.cc:304] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:06.463132  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:06.474292  1675 raft_consensus.cc:2468] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 5.
I20260709 13:00:06.475636  1677 raft_consensus.cc:1240] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:06.475662  2222 raft_consensus.cc:1275] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:00:06.476430  2222 pending_rounds.cc:85] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b: Aborting all ops after (but not including) 6
I20260709 13:00:06.476660  2222 pending_rounds.cc:107] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:00:06.476881  2222 raft_consensus.cc:2889] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:06.478232  1676 raft_consensus.cc:2468] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 5.
I20260709 13:00:06.480677  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:06.481381  2225 raft_consensus.cc:3060] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:06.492852  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:06.493330  4485 leader_election.cc:290] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:06.478282  4402 raft_consensus.cc:493] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:06.495083  4402 raft_consensus.cc:515] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:06.497148  4402 leader_election.cc:290] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:06.499176  1496 leader_election.cc:304] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:06.501103  1496 leader_election.cc:304] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:06.501935  1496 leader_election.cc:304] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:06.502962  4286 consensus_queue.cc:1048] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 13:00:06.503799  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:06.504395  1673 raft_consensus.cc:2468] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 7.
I20260709 13:00:06.504521  4382 raft_consensus.cc:2749] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:06.505045  4499 raft_consensus.cc:2749] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:06.505703  4499 consensus_queue.cc:1048] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:06.503206  1571 leader_election.cc:304] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:06.507014  4499 raft_consensus.cc:2804] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:06.507463  4499 raft_consensus.cc:697] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:00:06.508132  4561 raft_consensus.cc:2804] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:06.508623  4561 raft_consensus.cc:493] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:06.509073  4561 raft_consensus.cc:3060] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:06.509905  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:06.508566  3934 raft_consensus.cc:2804] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:06.511250  3934 raft_consensus.cc:697] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:00:06.512138  3934 consensus_queue.cc:237] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:06.513867  2220 raft_consensus.cc:2468] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 5.
I20260709 13:00:06.514602  4413 raft_consensus.cc:493] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:06.515158  4413 raft_consensus.cc:515] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:06.516610  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:06.517817  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:06.518253  4382 raft_consensus.cc:493] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:06.518993  4382 raft_consensus.cc:515] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:06.508194  1571 leader_election.cc:304] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:06.520444  4456 raft_consensus.cc:2804] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:06.520913  4456 raft_consensus.cc:697] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 5 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:06.521533  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:06.521808  4382 leader_election.cc:290] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:06.522836  4541 raft_consensus.cc:493] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:06.508303  4499 consensus_queue.cc:237] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:06.525189  4541 raft_consensus.cc:515] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:00:06.527706  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 50118.4us
I20260709 13:00:06.527778  1527 raft_consensus.cc:2468] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 8.
I20260709 13:00:06.527813  4598 raft_consensus.cc:2749] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:06.529058  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:06.529763  4598 consensus_queue.cc:1048] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:06.529982  4626 consensus_queue.cc:1059] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:06.530455  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:06.530900  1570 leader_election.cc:304] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:06.531783  4537 raft_consensus.cc:3060] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:06.532305  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:06.532783  2190 leader_election.cc:304] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:06.533638  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:06.534188  1598 raft_consensus.cc:3060] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:06.535033  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:00:06.523175  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 136588us
I20260709 13:00:06.524138  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:06.527305  1673 raft_consensus.cc:1240] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:06.540951  2225 raft_consensus.cc:2468] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 7.
I20260709 13:00:06.542708  2223 raft_consensus.cc:2468] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 6.
I20260709 13:00:06.544055  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:06.544476  2219 raft_consensus.cc:2393] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 6: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:00:06.544771  1601 raft_consensus.cc:2468] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 6.
I20260709 13:00:06.545214  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:06.544806  4286 raft_consensus.cc:2804] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:06.546737  4286 raft_consensus.cc:493] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:06.547096  4286 raft_consensus.cc:3060] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:06.547482  4626 raft_consensus.cc:3055] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:06.547887  4626 raft_consensus.cc:740] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:06.548765  4626 consensus_queue.cc:260] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:06.549556  1524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43010 (request call id 1876) took 1785 ms. Trace:
I20260709 13:00:06.546730  1680 raft_consensus.cc:1275] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:06.550993  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:06.551586  1607 raft_consensus.cc:3060] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:06.552073  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:06.552367  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:06.553279  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:06.553911  4380 raft_consensus.cc:515] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:06.554407  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:06.553920  1600 raft_consensus.cc:2468] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 5.
I20260709 13:00:06.556059  4380 leader_election.cc:290] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:06.549924  1524 rpcz_store.cc:276] 0709 13:00:04.764560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:05.072897 (+308337us) service_pool.cc:224] Handling call
0709 13:00:06.346225 (+1273328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:06.346999 (+   774us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:06.549370 (+202371us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b54002da5d0. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b28ad 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:06.549500 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2927194496}
I20260709 13:00:06.527417  4541 leader_election.cc:290] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:06.556730  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:06.558068  1678 raft_consensus.cc:2468] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 6.
I20260709 13:00:06.558619  1605 raft_consensus.cc:2468] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 4.
I20260709 13:00:06.560561  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:06.536376  4585 raft_consensus.cc:2804] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:06.571712  1676 raft_consensus.cc:1275] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:00:06.572926  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:06.550026  4626 raft_consensus.cc:3060] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:06.569622  1497 leader_election.cc:304] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:06.573295  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:06.518013  4413 leader_election.cc:290] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:06.580082  1600 raft_consensus.cc:2393] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 6: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:00:06.572362  1572 leader_election.cc:304] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:06.576529  1497 leader_election.cc:304] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:06.581413  1497 leader_election.cc:304] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:06.582226  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:06.571332  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:06.583600  1604 raft_consensus.cc:3060] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:06.586201  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:06.586862  1603 raft_consensus.cc:3060] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:06.588255  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:06.588894  1678 raft_consensus.cc:2468] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 8.
I20260709 13:00:06.590408  2224 raft_consensus.cc:2468] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 6.
I20260709 13:00:06.589836  1572 leader_election.cc:304] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:00:06.573559  4402 consensus_queue.cc:1059] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:00:06.595583  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:06.631526  1605 raft_consensus.cc:2468] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 5.
I20260709 13:00:06.634860  2225 raft_consensus.cc:1275] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:00:06.521756  4456 consensus_queue.cc:237] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:06.583103  4541 raft_consensus.cc:2804] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:06.635174  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:06.648391  1607 raft_consensus.cc:2468] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 8.
W20260709 13:00:06.657842  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:06.587335  4503 raft_consensus.cc:493] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:06.575421  4610 consensus_queue.cc:1048] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.064s
I20260709 13:00:06.594581  4585 raft_consensus.cc:697] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 7 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
W20260709 13:00:06.668817  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:06.706326  1428 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46274 (request call id 359) took 28686 ms (client timeout 15000 ms). Trace:
I20260709 13:00:06.698976  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:00:06.715128  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 139991us
I20260709 13:00:06.629944  4350 raft_consensus.cc:2749] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:06.793982  1678 raft_consensus.cc:2468] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 8.
I20260709 13:00:06.688539  1600 raft_consensus.cc:1240] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:06.591554  4296 raft_consensus.cc:2749] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:06.630123  4606 raft_consensus.cc:2804] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:06.594362  4387 raft_consensus.cc:2804] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:00:06.779203  2192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:06.804152  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:00:06.779711  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 55835.9us
I20260709 13:00:06.594193  4282 consensus_queue.cc:1048] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.182s
I20260709 13:00:06.792385  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:06.807181  1680 raft_consensus.cc:3060] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:06.782099  1603 raft_consensus.cc:2468] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 7.
I20260709 13:00:06.629825  4529 consensus_queue.cc:1048] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.151s
I20260709 13:00:06.641872  3970 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:06.668345  4578 raft_consensus.cc:493] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:06.713904  1425 catalog_manager.cc:5697] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:06.686329  4485 raft_consensus.cc:493] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:06.806020  1604 raft_consensus.cc:2468] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 5.
I20260709 13:00:06.820677  1607 raft_consensus.cc:2393] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 7: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:00:06.821871  1646 leader_election.cc:304] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:06.820428  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:06.818315  1496 leader_election.cc:304] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:06.822882  1604 raft_consensus.cc:2393] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 9: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:00:06.706066  4446 consensus_queue.cc:1048] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.104s
I20260709 13:00:06.706722  4614 consensus_queue.cc:1059] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.139s
I20260709 13:00:06.800230  4541 raft_consensus.cc:697] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:00:06.832612  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:06.809072  4296 raft_consensus.cc:493] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:06.838424  1598 raft_consensus.cc:2468] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 5.
I20260709 13:00:06.823375  4578 raft_consensus.cc:515] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:06.841773  1524 raft_consensus.cc:1240] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:06.825465  4496 raft_consensus.cc:493] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:06.795750  4503 raft_consensus.cc:515] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:06.823963  4387 raft_consensus.cc:697] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:00:06.837836  4350 raft_consensus.cc:2804] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:06.871316  1425 catalog_manager.cc:5697] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:06.812539  4606 raft_consensus.cc:493] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:06.870244  2190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:06.878058  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:06.880146  1598 raft_consensus.cc:2468] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 4.
I20260709 13:00:06.845270  4617 raft_consensus.cc:2749] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:06.891938  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:06.828759  4485 raft_consensus.cc:515] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:06.895323  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:06.884629  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:06.904511  1572 leader_election.cc:304] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:00:06.873787  4350 raft_consensus.cc:493] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:06.842799  4296 raft_consensus.cc:515] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:06.881932  4269 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.004s	sys 0.031s
I20260709 13:00:06.941370  2226 raft_consensus.cc:1240] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:00:06.880172  1425 catalog_manager.cc:5697] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 4 to 6, leader changed from ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) to e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193). New cstate: current_term: 6 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 13:00:06.972724  1425 catalog_manager.cc:5697] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 1 to 5, leader changed from e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) to b96ce9cc496c49d7818fa983a17b062b (127.0.107.196). New cstate: current_term: 5 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:00:06.974519  2191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:06.974560  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:06.879009  4606 raft_consensus.cc:3060] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:06.847199  4561 raft_consensus.cc:515] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:06.983006  1601 raft_consensus.cc:1240] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:06.984067  4561 leader_election.cc:290] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:06.986209  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
W20260709 13:00:06.976336  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 71915.1us
I20260709 13:00:06.868197  4496 raft_consensus.cc:515] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:06.989667  4496 leader_election.cc:290] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:00:06.961714  4457 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.978s	user 0.018s	sys 0.023s
W20260709 13:00:06.990404  4457 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.011s	user 0.018s	sys 0.023s
I20260709 13:00:06.992022  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:06.996170  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:06.996796  1599 raft_consensus.cc:2468] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 4.
I20260709 13:00:06.998188  1599 raft_consensus.cc:1240] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 4. Current term is 5. Ops: []
W20260709 13:00:06.999230  4639 log.cc:927] Time spent T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 13:00:06.999660  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:07.000320  1599 raft_consensus.cc:2468] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 7.
I20260709 13:00:06.846544  4585 consensus_queue.cc:237] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:07.003448  1604 raft_consensus.cc:1275] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:00:07.005291  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:07.007704  1604 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4190d217954f4f798b3a610501115290"
dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
 from {username='slave'} at 127.0.0.1:36200
I20260709 13:00:07.008251  1604 raft_consensus.cc:493] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:07.008560  1604 raft_consensus.cc:3060] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:07.011523  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:07.012216  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:07.012877  1603 raft_consensus.cc:2468] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 7.
I20260709 13:00:07.013785  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:07.015010  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:07.015710  1605 raft_consensus.cc:2468] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 6.
I20260709 13:00:07.015060  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:07.017084  1607 raft_consensus.cc:2468] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 7.
I20260709 13:00:07.012217  1600 raft_consensus.cc:2468] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 6.
I20260709 13:00:07.017441  4387 consensus_queue.cc:237] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:07.019163  1603 raft_consensus.cc:1275] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:00:07.019716  4541 consensus_queue.cc:237] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:07.023814  4485 leader_election.cc:290] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:07.023962  1604 raft_consensus.cc:515] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:07.027197  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: true dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:07.027690  4503 leader_election.cc:290] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:07.029493  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:07.031515  4578 leader_election.cc:290] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:07.031625  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:07.032306  1603 raft_consensus.cc:2468] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 7.
W20260709 13:00:07.035449  2218 consensus_meta.cc:287] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b: Time spent flushing consensus metadata: real 0.661s	user 0.007s	sys 0.002s
I20260709 13:00:07.035838  2218 raft_consensus.cc:2468] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 5.
I20260709 13:00:07.036350  2218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 714) took 1127 ms. Trace:
I20260709 13:00:07.036669  2218 rpcz_store.cc:276] 0709 13:00:05.909062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:05.909793 (+   731us) service_pool.cc:224] Handling call
0709 13:00:06.373248 (+463455us) spinlock_profiling.cc:243] Waited 70.4 ms on lock 0x7b54005eb3a0. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a18528a1d 00007f6a1850f1a4 00007f6a18591447 00007f6a185a9fe7 00007f6a185ab7de 00007f6a185b727c 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591
0709 13:00:07.036270 (+663022us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":162009984}
I20260709 13:00:07.029096  1604 leader_election.cc:290] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:00:07.039439  4288 consensus_meta.cc:287] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b: Time spent flushing consensus metadata: real 0.582s	user 0.004s	sys 0.004s
I20260709 13:00:07.039865  4288 raft_consensus.cc:515] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:07.041911  4288 leader_election.cc:290] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 6 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:06.967016  4350 raft_consensus.cc:3060] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:07.044756  1604 raft_consensus.cc:1240] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:06.977675  4460 raft_consensus.cc:493] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:06.932772  4402 consensus_queue.cc:1059] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.143s
I20260709 13:00:07.050408  1604 raft_consensus.cc:1275] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:00:06.975944  4537 raft_consensus.cc:2749] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:06.975404  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:07.047331  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:07.065405  1680 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 9.
I20260709 13:00:07.066217  1607 raft_consensus.cc:2468] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 5.
I20260709 13:00:07.072095  1571 leader_election.cc:304] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:07.066887  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:07.056793  1646 leader_election.cc:304] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
W20260709 13:00:06.794868  1428 rpcz_store.cc:269] 0709 12:59:38.020133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:38.020352 (+   219us) service_pool.cc:224] Handling call
0709 13:00:06.706066 (+28685714us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:05.007253 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:05.007799 (+   546us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:05.007836 (+    37us) write_op.cc:435] Acquired schema lock
0709 13:00:05.007852 (+    16us) tablet.cc:662] Decoding operations
0709 13:00:05.008420 (+   568us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:05.008471 (+    51us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:05.008502 (+    31us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:00:05.008846 (+   344us) tablet.cc:701] Row locks acquired
0709 13:00:05.008860 (+    14us) write_op.cc:260] PREPARE: finished
0709 13:00:05.009004 (+   144us) write_op.cc:270] Start()
0709 13:00:05.009112 (+   108us) write_op.cc:276] Timestamp: P: 1783602005008954 usec, L: 0
0709 13:00:05.009128 (+    16us) op_driver.cc:348] REPLICATION: starting
0709 13:00:05.021290 (+ 12162us) log.cc:844] Serialized 1696 byte log entry
0709 13:00:05.510604 (+489314us) op_driver.cc:464] REPLICATION: finished
0709 13:00:05.690575 (+179971us) write_op.cc:301] APPLY: starting
0709 13:00:05.690726 (+   151us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:05.690923 (+   197us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:05.691079 (+   156us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:05.691768 (+   689us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:05.692063 (+   295us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 13:00:05.692108 (+    45us) write_op.cc:312] APPLY: finished
0709 13:00:05.805205 (+113097us) log.cc:844] Serialized 41 byte log entry
0709 13:00:05.805403 (+   198us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:05.805533 (+   130us) write_op.cc:454] Released schema lock
0709 13:00:05.805592 (+    59us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:05.806098 (+   506us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:05.806132 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2576457,"reported_tablets":25,"child_traces":[["op",{"apply.queue_time_us":173683,"apply.run_cpu_time_us":3238,"apply.run_wall_time_us":115489,"num_ops":4,"prepare.queue_time_us":161798,"prepare.run_cpu_time_us":70241,"prepare.run_wall_time_us":433623,"raft.queue_time_us":80639,"raft.run_cpu_time_us":24850,"raft.run_wall_time_us":90271,"replication_time_us":501236,"thread_start_us":560990,"threads_started":4,"wal-append.queue_time_us":319022,"wal-append.run_cpu_time_us":21450,"wal-append.run_wall_time_us":1457124}]]}
I20260709 13:00:06.932307  4532 raft_consensus.cc:493] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:07.082190  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:07.086915  1646 leader_election.cc:304] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:07.088344  1646 leader_election.cc:304] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:07.092778  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 13:00:06.976128  4269 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.005s	sys 0.033s
I20260709 13:00:07.047191  4460 raft_consensus.cc:515] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:07.137144  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 48878.5us
I20260709 13:00:07.089169  4537 raft_consensus.cc:2804] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:07.076786  4471 raft_consensus.cc:493] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:07.140327  1646 leader_election.cc:304] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:07.094512  4609 raft_consensus.cc:2804] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:07.092702  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: true dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:07.148330  2226 raft_consensus.cc:2468] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 4.
I20260709 13:00:07.103830  4599 raft_consensus.cc:2804] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:07.161393  1602 raft_consensus.cc:2468] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 8.
I20260709 13:00:07.143146  4282 raft_consensus.cc:2749] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:07.142431  4600 raft_consensus.cc:493] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:07.099534  4532 raft_consensus.cc:515] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:07.092911  4559 consensus_queue.cc:1059] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 13:00:07.149010  4609 raft_consensus.cc:493] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:07.154347  4537 raft_consensus.cc:697] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 9 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:07.134651  4402 consensus_queue.cc:1048] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.053s
I20260709 13:00:07.156071  2220 raft_consensus.cc:3060] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:07.173357  1528 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.043s	sys 0.071s
W20260709 13:00:07.187208  1528 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.043s	sys 0.071s
I20260709 13:00:07.122351  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:07.154147  4599 raft_consensus.cc:493] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
W20260709 13:00:07.094617  4640 log.cc:927] Time spent T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
W20260709 13:00:07.104192  4033 consensus_meta.cc:287] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.714s	user 0.007s	sys 0.003s
I20260709 13:00:07.055820  3970 raft_consensus.cc:2804] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:07.151319  4471 raft_consensus.cc:515] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:07.209043  1525 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.043s	sys 0.075s
I20260709 13:00:07.212906  1601 raft_consensus.cc:1240] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 4. Current term is 5. Ops: []
W20260709 13:00:07.220240  1525 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.512s	user 0.044s	sys 0.075s
I20260709 13:00:07.183418  4609 raft_consensus.cc:3060] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:07.187606  4598 raft_consensus.cc:2804] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:00:07.220903  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 402682us
I20260709 13:00:07.295776  1496 leader_election.cc:304] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:07.297283  1496 leader_election.cc:304] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
W20260709 13:00:07.212428  4286 consensus_meta.cc:287] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b: Time spent flushing consensus metadata: real 0.665s	user 0.007s	sys 0.003s
I20260709 13:00:07.193380  4599 raft_consensus.cc:3060] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:07.190292  4578 raft_consensus.cc:493] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:07.224040  1681 raft_consensus.cc:2468] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 9.
I20260709 13:00:07.195886  2218 raft_consensus.cc:1275] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 13:00:07.138168  1425 catalog_manager.cc:5697] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 3 to 4, leader changed from b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) to e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:00:07.309047  2190 leader_election.cc:304] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:07.188000  4600 raft_consensus.cc:515] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:07.364480  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 224256us
I20260709 13:00:07.296093  4380 raft_consensus.cc:493] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:07.302995  4561 raft_consensus.cc:493] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:07.373404  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:07.322415  4485 raft_consensus.cc:2804] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:07.389742  1680 raft_consensus.cc:2468] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 5.
I20260709 13:00:07.389856  4485 raft_consensus.cc:493] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:07.390295  4485 raft_consensus.cc:3060] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:07.322582  4496 raft_consensus.cc:2804] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:07.394284  4496 raft_consensus.cc:493] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:07.394757  4496 raft_consensus.cc:3060] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:07.342356  4357 raft_consensus.cc:2749] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:00:07.350576  4456 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.011s	sys 0.010s
I20260709 13:00:07.301764  3970 raft_consensus.cc:697] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 6 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:07.351148  4505 raft_consensus.cc:493] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:07.311300  3934 consensus_queue.cc:1059] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.104s
I20260709 13:00:07.431135  1425 catalog_manager.cc:5697] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:07.321774  4503 consensus_queue.cc:1048] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.101s
I20260709 13:00:07.351024  4359 consensus_queue.cc:1059] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.070s
W20260709 13:00:07.420024  4499 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.026s	sys 0.059s
I20260709 13:00:07.311638  4286 raft_consensus.cc:515] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:07.437071  2190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:07.350541  4578 raft_consensus.cc:515] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:07.452409  1425 catalog_manager.cc:5697] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 4 to 7, leader changed from ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) to e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193). New cstate: current_term: 7 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
W20260709 13:00:07.419466  4456 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.011s	sys 0.012s
I20260709 13:00:07.219491  4537 consensus_queue.cc:237] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
W20260709 13:00:07.431847  4633 log.cc:927] Time spent T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:00:07.415275  4033 consensus_queue.cc:1059] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
W20260709 13:00:07.474431  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:07.409405  4380 raft_consensus.cc:515] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:07.446869  4499 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.026s	sys 0.059s
I20260709 13:00:07.458807  4359 raft_consensus.cc:3055] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:07.447023  4485 raft_consensus.cc:515] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:07.415496  4282 consensus_queue.cc:1048] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:00:07.417805  4561 raft_consensus.cc:515] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:07.470206  1528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43010 (request call id 1893) took 1028 ms. Trace:
W20260709 13:00:07.481860  4650 log.cc:927] Time spent T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:00:07.472720  3934 raft_consensus.cc:3055] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:07.482553  3970 consensus_queue.cc:237] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:07.419279  4296 leader_election.cc:290] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:00:07.473497  4642 log.cc:927] Time spent T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.164s	user 0.000s	sys 0.001s
I20260709 13:00:07.464998  4578 leader_election.cc:290] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:07.438145  4505 raft_consensus.cc:515] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:07.499734  1425 catalog_manager.cc:5697] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 1 to 7, leader changed from 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) to b96ce9cc496c49d7818fa983a17b062b (127.0.107.196). New cstate: current_term: 7 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:00:07.501739  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:07.501785  1528 rpcz_store.cc:276] 0709 13:00:06.441407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:06.441584 (+   177us) service_pool.cc:224] Handling call
0709 13:00:06.457585 (+ 16001us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:06.462897 (+  5312us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:06.462928 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:06.476948 (+ 14020us) log.cc:844] Serialized 26 byte log entry
0709 13:00:06.593395 (+116447us) spinlock_profiling.cc:243] Waited 23.8 ms on lock 0x7b18004befe0. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1e38ede1 00007f6a1e39b5b1 00007f6a154a8e07 00007f6a1e303ab9 00007f6a154c569b 00007f6a154c393f 00007f6a154c5c02 00007f6a1814d20b 00007f6a18152d23 00007f6a181530d1 00007f6a1856ea0f
0709 13:00:07.189214 (+595819us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:07.189260 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:07.189333 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:07.466198 (+276865us) raft_consensus.cc:1685] finished
0709 13:00:07.466217 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:07.470136 (+  3919us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5424,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":5744,"spinlock_wait_cycles":54766336,"thread_start_us":595605,"threads_started":1,"wal-append.queue_time_us":954796}
I20260709 13:00:07.485773  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:07.455297  4496 raft_consensus.cc:515] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:07.487265  4359 raft_consensus.cc:740] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:07.514958  4600 leader_election.cc:290] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:07.519269  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:07.520255  1607 raft_consensus.cc:3060] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:07.506814  3934 raft_consensus.cc:740] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
W20260709 13:00:07.516913  4648 log.cc:927] Time spent T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.297s	user 0.000s	sys 0.001s
I20260709 13:00:07.522990  1425 catalog_manager.cc:5697] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 4 to 5, leader changed from ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) to b96ce9cc496c49d7818fa983a17b062b (127.0.107.196). New cstate: current_term: 5 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:07.509522  4532 leader_election.cc:290] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:00:07.526820  4585 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.009s	sys 0.004s
W20260709 13:00:07.538805  1496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:07.532593  4644 log.cc:927] Time spent T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.310s	user 0.001s	sys 0.001s
I20260709 13:00:07.538422  1425 catalog_manager.cc:5697] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 3 to 6, leader changed from ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) to b96ce9cc496c49d7818fa983a17b062b (127.0.107.196). New cstate: current_term: 6 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:00:07.541121  4585 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.533s	user 0.010s	sys 0.004s
I20260709 13:00:07.541694  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:07.561789  1532 raft_consensus.cc:3060] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:07.530014  4471 leader_election.cc:290] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:07.565577  1607 raft_consensus.cc:2468] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 6.
W20260709 13:00:07.539232  4647 log.cc:927] Time spent T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:00:07.569351  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:07.570238  1607 raft_consensus.cc:2376] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 6. Re-sending same reply.
W20260709 13:00:07.559645  4350 consensus_meta.cc:287] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent flushing consensus metadata: real 0.517s	user 0.010s	sys 0.000s
I20260709 13:00:07.573735  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:00:07.577018  4646 log.cc:927] Time spent T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
W20260709 13:00:07.577797  4663 log.cc:927] Time spent T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:00:07.578392  1679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50664 (request call id 605) took 1175 ms. Trace:
W20260709 13:00:07.579669  4655 log.cc:927] Time spent T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:00:07.578802  1679 rpcz_store.cc:276] 0709 13:00:06.403100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:06.405763 (+  2663us) service_pool.cc:224] Handling call
0709 13:00:06.406106 (+   343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:06.424225 (+ 18119us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:06.424251 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:06.425502 (+  1251us) log.cc:844] Serialized 26 byte log entry
0709 13:00:06.883561 (+458059us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:06.883599 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:06.883661 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:07.578198 (+694537us) raft_consensus.cc:1685] finished
0709 13:00:07.578216 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:07.578337 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34234,"raft.queue_time_us":23099,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":124,"thread_start_us":457693,"threads_started":1,"wal-append.queue_time_us":893018}
I20260709 13:00:07.580871  2222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 723) took 1049 ms. Trace:
I20260709 13:00:07.581241  2220 raft_consensus.cc:2468] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 6.
W20260709 13:00:07.576884  4653 log.cc:927] Time spent T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
W20260709 13:00:07.584064  2192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:07.573251  4359 consensus_queue.cc:260] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:07.585067  2192 leader_election.cc:304] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:00:07.585623  4656 log.cc:927] Time spent T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
W20260709 13:00:07.589695  4664 log.cc:927] Time spent T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:00:07.584981  4359 raft_consensus.cc:3060] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:07.591172  4617 raft_consensus.cc:3055] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:07.591579  4617 raft_consensus.cc:740] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:07.591746  4585 consensus_queue.cc:1059] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:07.592832  4585 raft_consensus.cc:2749] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:07.593472  4585 raft_consensus.cc:3055] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:07.593778  4585 raft_consensus.cc:740] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:07.595245  1674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50664 (request call id 604) took 1204 ms. Trace:
I20260709 13:00:07.596320  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:07.595640  1674 rpcz_store.cc:276] 0709 13:00:06.390629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:06.396829 (+  6200us) service_pool.cc:224] Handling call
0709 13:00:06.397173 (+   344us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:06.437228 (+ 40055us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:06.437260 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:06.437816 (+   556us) log.cc:844] Serialized 26 byte log entry
0709 13:00:06.883130 (+445314us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:06.883173 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:06.883241 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:07.595043 (+711802us) raft_consensus.cc:1685] finished
0709 13:00:07.595063 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:07.595188 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39678,"raft.queue_time_us":40889,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":6758,"thread_start_us":444467,"threads_started":1,"wal-append.queue_time_us":779222}
I20260709 13:00:07.597028  4505 leader_election.cc:290] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:07.599232  4460 leader_election.cc:290] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:07.602531  1673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50664 (request call id 611) took 1037 ms. Trace:
I20260709 13:00:07.602948  1673 rpcz_store.cc:276] 0709 13:00:06.565600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:06.580636 (+ 15036us) service_pool.cc:224] Handling call
0709 13:00:06.581312 (+   676us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:06.585133 (+  3821us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:00:06.585164 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:06.636613 (+ 51449us) log.cc:844] Serialized 26 byte log entry
0709 13:00:06.700176 (+ 63563us) spinlock_profiling.cc:243] Waited 2.87 ms on lock 0x7b4800041ad8. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1d4dcaa1 00007f6a1d4d3b37 00007f6a1d4d39ca 00007f6a1d5cb26f 00007f6a1d5caf37 00007f6a1d5df55c 00007f6a1d5df508 00007f6a1d5df488 00007f6a1d5df443 00007f6a1d5de6ec 00007f6a1c508a96
0709 13:00:07.183993 (+483817us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:07.184036 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:07.184108 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:07.602218 (+418110us) raft_consensus.cc:1685] finished
0709 13:00:07.602238 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:07.602471 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6880,"raft.queue_time_us":1739,"raft.run_cpu_time_us":2358,"raft.run_wall_time_us":109118,"spinlock_wait_cycles":6592384,"thread_start_us":489848,"threads_started":1,"wal-append.queue_time_us":741419}
I20260709 13:00:07.604717  4503 raft_consensus.cc:493] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:07.605340  4503 raft_consensus.cc:515] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:07.607592  4503 leader_election.cc:290] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:07.596994  1607 raft_consensus.cc:2368] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b for earlier term 5. Current term is 6.
W20260709 13:00:07.592077  4649 log.cc:927] Time spent T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.209s	user 0.001s	sys 0.000s
I20260709 13:00:07.584553  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:07.610387  1571 leader_election.cc:304] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:07.610741  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:07.578886  1425 catalog_manager.cc:5697] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 2 to 3, leader changed from ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) to b96ce9cc496c49d7818fa983a17b062b (127.0.107.196). New cstate: current_term: 3 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:07.581218  2222 rpcz_store.cc:276] 0709 13:00:06.531547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:06.543509 (+ 11962us) service_pool.cc:224] Handling call
0709 13:00:06.572383 (+ 28874us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:06.586370 (+ 13987us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:06.586398 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:06.711101 (+124703us) log.cc:844] Serialized 590 byte log entry
0709 13:00:07.183415 (+472314us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:07.183458 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:07.183529 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:07.580665 (+397136us) raft_consensus.cc:1685] finished
0709 13:00:07.580684 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:07.580816 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":917,"raft.queue_time_us":6446,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":38402,"thread_start_us":471913,"threads_started":1,"wal-append.queue_time_us":760776}
I20260709 13:00:07.621754  1425 catalog_manager.cc:5697] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:07.621811  1571 leader_election.cc:304] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:07.624218  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:07.624965  1680 raft_consensus.cc:2393] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 8: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:00:07.625367  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:07.625420  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:07.626572  1676 raft_consensus.cc:2393] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 5: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:00:07.628491  4598 raft_consensus.cc:493] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:07.628978  4598 raft_consensus.cc:3060] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:07.629357  1678 raft_consensus.cc:1275] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:00:07.630589  1425 catalog_manager.cc:5697] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 13:00:07.632128  1425 catalog_manager.cc:5697] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:07.633791  4521 raft_consensus.cc:3055] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:07.634208  4521 raft_consensus.cc:740] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:07.634411  1425 catalog_manager.cc:5697] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 1 to 5, leader changed from e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) to b96ce9cc496c49d7818fa983a17b062b (127.0.107.196). New cstate: current_term: 5 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:07.636437  1672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49170 (request call id 1833) took 1656 ms. Trace:
W20260709 13:00:07.576915  4654 log.cc:927] Time spent T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:00:07.636210  1425 catalog_manager.cc:5697] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:07.638584  1675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49178 (request call id 1743) took 1064 ms. Trace:
I20260709 13:00:07.567483  3934 consensus_queue.cc:260] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:07.640714  3934 raft_consensus.cc:3060] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:07.640898  1425 catalog_manager.cc:5697] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:07.642459  1425 catalog_manager.cc:5697] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:00:07.644704  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36194 (request call id 1507) took 1106 ms. Trace:
I20260709 13:00:07.586213  2192 leader_election.cc:304] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:00:07.620406  1679 raft_consensus.cc:2468] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 11.
I20260709 13:00:07.614048  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:07.639011  1675 rpcz_store.cc:276] 0709 13:00:06.574677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:06.574810 (+   133us) service_pool.cc:224] Handling call
0709 13:00:06.586396 (+ 11586us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:06.587196 (+   800us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:06.587236 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:06.632831 (+ 45595us) log.cc:844] Serialized 26 byte log entry
0709 13:00:07.173458 (+540627us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:07.173507 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:07.173586 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:07.638370 (+464784us) raft_consensus.cc:1685] finished
0709 13:00:07.638392 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:07.638529 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":453,"raft.queue_time_us":1125,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":1954,"thread_start_us":482447,"threads_started":1,"wal-append.queue_time_us":750777}
I20260709 13:00:07.647862  1673 raft_consensus.cc:2468] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 11.
W20260709 13:00:07.648372  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 62240.3us
I20260709 13:00:07.649318  2192 leader_election.cc:304] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:07.651129  4380 leader_election.cc:290] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:07.631525  4496 leader_election.cc:290] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:07.651948  4485 leader_election.cc:290] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:07.652652  4457 raft_consensus.cc:2804] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:07.653064  4457 raft_consensus.cc:493] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:07.653391  4457 raft_consensus.cc:3060] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:07.617303  1532 raft_consensus.cc:2468] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 6.
I20260709 13:00:07.619113  4350 raft_consensus.cc:515] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:07.659643  4617 consensus_queue.cc:260] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:00:07.660754  4626 consensus_meta.cc:287] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 1.078s	user 0.011s	sys 0.000s
I20260709 13:00:07.636819  1672 rpcz_store.cc:276] 0709 13:00:05.979940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:05.980109 (+   169us) service_pool.cc:224] Handling call
0709 13:00:06.028608 (+ 48499us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:06.243167 (+214559us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:00:06.309163 (+ 65996us) spinlock_profiling.cc:243] Waited 14.8 ms on lock 0x7b4800041ad8. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1d4dcaa1 00007f6a1d4d3b37 00007f6a1d4d39ca 00007f6a1d5cb26f 00007f6a1d5caf37 00007f6a1d5df55c 00007f6a1d5df508 00007f6a1d5df488 00007f6a1d5df443 00007f6a1d5de6ec 00007f6a1c508a96
0709 13:00:06.465756 (+156593us) log.cc:844] Serialized 14 byte log entry
0709 13:00:06.878626 (+412870us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:06.971191 (+ 92565us) log.cc:844] Serialized 26 byte log entry
0709 13:00:06.971326 (+   135us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:06.971355 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:06.971421 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:07.636160 (+664739us) raft_consensus.cc:1685] finished
0709 13:00:07.636255 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:07.636382 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":196051,"prepare.queue_time_us":3668,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":26,"raft.queue_time_us":197755,"raft.run_cpu_time_us":1755,"raft.run_wall_time_us":86323,"spinlock_wait_cycles":33940864,"thread_start_us":600569,"threads_started":2,"wal-append.queue_time_us":951391}
I20260709 13:00:07.673630  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:07.674633  4286 leader_election.cc:290] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:07.679188  4561 leader_election.cc:290] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:07.646737  1606 rpcz_store.cc:276] 0709 13:00:06.532878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:06.534249 (+  1371us) service_pool.cc:224] Handling call
0709 13:00:06.534615 (+   366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:06.535005 (+   390us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:06.535031 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:06.535601 (+   570us) log.cc:844] Serialized 26 byte log entry
0709 13:00:06.882284 (+346683us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:06.882323 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:06.882393 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:07.639567 (+757174us) raft_consensus.cc:1685] finished
0709 13:00:07.639589 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:07.639709 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":460,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":121,"thread_start_us":346189,"threads_started":1,"wal-append.queue_time_us":681868}
I20260709 13:00:07.681129  1606 raft_consensus.cc:1275] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:00:07.683902  4521 consensus_queue.cc:260] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:07.685065  4521 raft_consensus.cc:3060] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:07.687664  4327 raft_consensus.cc:2804] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:07.691112  1601 raft_consensus.cc:1240] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 7. Current term is 8. Ops: [7.7-7.7]
W20260709 13:00:07.808379  1495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:07.679979  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49178 (request call id 1737) took 1177 ms. Trace:
I20260709 13:00:07.710863  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:07.881064  1681 rpcz_store.cc:276] 0709 13:00:06.502111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:06.517575 (+ 15464us) service_pool.cc:224] Handling call
0709 13:00:07.679805 (+1162230us) spinlock_profiling.cc:243] Waited 696 ms on lock 0x7b540024c554. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:07.679904 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1600462592}
W20260709 13:00:07.867125  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 217851us
W20260709 13:00:07.718154  4606 consensus_meta.cc:287] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.618s	user 0.009s	sys 0.000s
I20260709 13:00:07.698769  4380 raft_consensus.cc:493] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:07.867552  4288 raft_consensus.cc:2749] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:07.883144  4606 raft_consensus.cc:515] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:07.883296  2192 leader_election.cc:400] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 5 election: Vote denied by peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303) with higher term. Message: Invalid argument: T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b for earlier term 5. Current term is 6.
I20260709 13:00:07.660669  4350 leader_election.cc:290] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:07.884253  1598 raft_consensus.cc:2368] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 6. Current term is 7.
W20260709 13:00:07.716952  4645 log.cc:927] Time spent T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.411s	user 0.000s	sys 0.001s
I20260709 13:00:07.885176  4296 raft_consensus.cc:493] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:07.885784  4296 raft_consensus.cc:515] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:07.886544  4606 leader_election.cc:290] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:07.886968  1523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49310 (request call id 606) took 1470 ms. Trace:
I20260709 13:00:07.709894  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:07.715793  1677 raft_consensus.cc:3055] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:07.887667  1523 rpcz_store.cc:276] 0709 13:00:06.416785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:06.417005 (+   220us) service_pool.cc:224] Handling call
0709 13:00:06.417343 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:06.417711 (+   368us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:00:06.418063 (+   352us) log.cc:844] Serialized 14 byte log entry
0709 13:00:06.881476 (+463413us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:06.913964 (+ 32488us) log.cc:844] Serialized 26 byte log entry
0709 13:00:06.977285 (+ 63321us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:06.977327 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:06.977397 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:07.716362 (+738965us) spinlock_profiling.cc:243] Waited 8.39 ms on lock 0x7b4400022b4c. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a153ecc85 00007f6a153ed6a2 00007f6a1815f1db 00007f6a1815aaaf 00007f6a1814e86e 00007f6a1814dbb6 00007f6a1814d7d8 00007f6a18157221 00007f6a181571d9 00007f6a18157169
0709 13:00:07.886526 (+170164us) raft_consensus.cc:1685] finished
0709 13:00:07.886706 (+   180us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:07.886883 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":628,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":8342,"raft.run_cpu_time_us":274,"raft.run_wall_time_us":30182,"spinlock_wait_cycles":19294592,"thread_start_us":462994,"threads_started":1,"wal-append.queue_time_us":771969}
I20260709 13:00:07.712368  1605 raft_consensus.cc:1275] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:00:07.689743  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:07.705396  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 13:00:07.891274  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:07.707347  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:07.657186  4190 raft_consensus.cc:2749] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:07.691483  4460 raft_consensus.cc:493] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:07.693009  4359 raft_consensus.cc:493] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:07.707742  4668 log.cc:927] Time spent T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.243s	user 0.000s	sys 0.002s
I20260709 13:00:07.892648  1606 raft_consensus.cc:1275] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:00:07.863698  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:07.698966  4327 raft_consensus.cc:697] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 6 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:07.679339  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36194 (request call id 1513) took 1127 ms. Trace:
I20260709 13:00:07.702112  4609 raft_consensus.cc:515] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:07.884186  2192 leader_election.cc:403] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:00:07.864356  1607 raft_consensus.cc:1240] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:07.894972  4380 raft_consensus.cc:515] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:07.895778  4609 leader_election.cc:290] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:07.693421  4382 raft_consensus.cc:493] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:07.696066  4659 log.cc:927] Time spent T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.136s	user 0.000s	sys 0.002s
W20260709 13:00:07.851788  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 107252us
I20260709 13:00:07.897109  4380 leader_election.cc:290] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
W20260709 13:00:07.884907  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 203581us
I20260709 13:00:07.706926  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:07.892727  4359 raft_consensus.cc:515] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:07.733816  4585 consensus_queue.cc:260] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:07.894157  1602 rpcz_store.cc:276] 0709 13:00:06.551990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:06.552147 (+   157us) service_pool.cc:224] Handling call
0709 13:00:07.679143 (+1126996us) spinlock_profiling.cc:243] Waited 499 ms on lock 0x7b54003b24d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:07.679262 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1148243712}
I20260709 13:00:07.893499  2226 raft_consensus.cc:2468] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 4.
I20260709 13:00:07.889283  1677 raft_consensus.cc:740] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:07.896733  4382 raft_consensus.cc:515] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:07.881754  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:07.923959  1676 raft_consensus.cc:3060] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:07.891242  1605 raft_consensus.cc:1275] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:00:07.737814  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49310 (request call id 605) took 1360 ms. Trace:
I20260709 13:00:07.900056  1674 raft_consensus.cc:2393] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 5: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:00:07.896052  1607 raft_consensus.cc:1240] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:07.889276  4296 leader_election.cc:290] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:00:07.904130  4599 consensus_meta.cc:287] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.572s	user 0.002s	sys 0.007s
I20260709 13:00:07.894469  4327 consensus_queue.cc:237] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:07.872997  1646 leader_election.cc:304] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
W20260709 13:00:07.916492  2190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:07.948985  2190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:07.915767  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:00:07.929175  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 46043.6us
I20260709 13:00:07.925750  1529 rpcz_store.cc:276] 0709 13:00:06.376973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:06.377116 (+   143us) service_pool.cc:224] Handling call
0709 13:00:06.377416 (+   300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:06.387491 (+ 10075us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:06.387521 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:06.388029 (+   508us) log.cc:844] Serialized 26 byte log entry
0709 13:00:06.841816 (+453787us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:06.841867 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:06.841934 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:07.737571 (+895637us) raft_consensus.cc:1685] finished
0709 13:00:07.737591 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:07.737744 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1041,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":5437,"thread_start_us":450876,"threads_started":1,"wal-append.queue_time_us":791271}
I20260709 13:00:07.930902  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:07.927031  1677 consensus_queue.cc:260] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:07.951985  1677 raft_consensus.cc:3060] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:00:07.951323  1605 raft_consensus.cc:2468] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 8.
I20260709 13:00:07.953593  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:07.954428  1602 raft_consensus.cc:2393] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 6: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
W20260709 13:00:07.955488  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 82560.7us
I20260709 13:00:07.957137  1646 leader_election.cc:304] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:07.959851  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:07.970803  1607 raft_consensus.cc:2393] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 7: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:00:07.975805  1646 leader_election.cc:304] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:07.963464  4609 raft_consensus.cc:2749] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:00:07.979729  4661 log.cc:927] Time spent T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.497s	user 0.001s	sys 0.001s
I20260709 13:00:07.981225  4382 leader_election.cc:290] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:07.981614  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:07.982810  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:07.984251  1603 raft_consensus.cc:1275] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:00:07.892670  4460 raft_consensus.cc:515] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:07.973888  4457 raft_consensus.cc:515] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:07.930972  4194 raft_consensus.cc:2749] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303) with higher term. Message: Invalid argument: T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b for earlier term 5. Current term is 6.
I20260709 13:00:07.991773  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:07.989161  1676 raft_consensus.cc:2468] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 9.
I20260709 13:00:07.992295  1605 raft_consensus.cc:2468] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 11.
W20260709 13:00:07.996358  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 372000us
I20260709 13:00:07.998268  1677 raft_consensus.cc:2468] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 6.
I20260709 13:00:07.931764  4598 raft_consensus.cc:515] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:08.003681  2225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50310 (request call id 627) took 1121 ms. Trace:
I20260709 13:00:07.974145  4402 raft_consensus.cc:2749] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:08.004966  2225 rpcz_store.cc:276] 0709 13:00:06.882054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:06.882197 (+   143us) service_pool.cc:224] Handling call
0709 13:00:06.931850 (+ 49653us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:06.967317 (+ 35467us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:06.967347 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:06.967800 (+   453us) log.cc:844] Serialized 26 byte log entry
0709 13:00:07.375233 (+407433us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:07.375271 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:07.375335 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:07.979161 (+603826us) spinlock_profiling.cc:243] Waited 1.6 ms on lock 0x7b4400022b4c. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a153ecc85 00007f6a153ed6a2 00007f6a1815f1db 00007f6a1815aaaf 00007f6a1814e86e 00007f6a1814dbb6 00007f6a1814d7d8 00007f6a18157221 00007f6a181571d9 00007f6a18157169
0709 13:00:07.987542 (+  8381us) raft_consensus.cc:1685] finished
0709 13:00:07.987562 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:08.003616 (+ 16054us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":64437,"raft.queue_time_us":39842,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":41171,"spinlock_wait_cycles":3683712,"thread_start_us":393011,"threads_started":1,"wal-append.queue_time_us":500834}
I20260709 13:00:07.957862  4599 raft_consensus.cc:515] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:08.019958  1599 raft_consensus.cc:2368] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b for earlier term 5. Current term is 6.
W20260709 13:00:08.026327  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 86240.2us
I20260709 13:00:08.030793  4460 leader_election.cc:290] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:08.031877  4676 raft_consensus.cc:493] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:08.032357  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:07.988009  4532 consensus_queue.cc:1059] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:00:07.999213  4033 raft_consensus.cc:2804] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:07.977537  4610 consensus_queue.cc:1048] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
W20260709 13:00:08.018910  4621 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 6 is higher.
I20260709 13:00:08.040220  4678 raft_consensus.cc:493] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
W20260709 13:00:08.078991  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:08.081035  1675 raft_consensus.cc:1240] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:08.081707  2191 leader_election.cc:304] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:08.106630  1677 raft_consensus.cc:1240] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 7. Current term is 8. Ops: []
W20260709 13:00:08.039479  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 62609us
I20260709 13:00:08.112779  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:08.115089  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:08.115795  2224 raft_consensus.cc:2468] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 7.
I20260709 13:00:08.117163  2224 raft_consensus.cc:1240] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 4. Current term is 6. Ops: []
I20260709 13:00:08.120414  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:08.126821  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:08.127501  2226 raft_consensus.cc:2468] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 3.
I20260709 13:00:08.129688  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:08.138917  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:08.139667  1676 raft_consensus.cc:2468] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 8.
I20260709 13:00:08.039647  4033 raft_consensus.cc:493] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:08.149874  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:08.150203  1674 raft_consensus.cc:1240] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:08.130970  1572 leader_election.cc:304] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:00:08.150555  2219 raft_consensus.cc:3060] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:08.151985  4561 raft_consensus.cc:2804] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:08.152396  4561 raft_consensus.cc:493] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:08.152729  4561 raft_consensus.cc:3060] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:08.159740  2225 raft_consensus.cc:1275] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:00:08.098773  4599 leader_election.cc:290] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:08.121634  4357 raft_consensus.cc:2804] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:00:08.176376  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 262976us
I20260709 13:00:08.032478  4676 raft_consensus.cc:515] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:00:08.191712  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 241155us
I20260709 13:00:08.195648  2192 leader_election.cc:304] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:08.150928  4286 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:00:08.149263  4033 raft_consensus.cc:3060] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:08.194926  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:08.211078  1603 raft_consensus.cc:3060] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:08.177891  4359 leader_election.cc:290] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:08.223294  2219 raft_consensus.cc:2468] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 7.
I20260709 13:00:08.230577  1572 leader_election.cc:304] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
W20260709 13:00:08.223692  4665 log.cc:927] Time spent T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.634s	user 0.001s	sys 0.006s
I20260709 13:00:08.122182  4678 raft_consensus.cc:515] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:08.208688  4357 raft_consensus.cc:697] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 9 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
W20260709 13:00:08.243131  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:08.212716  3934 raft_consensus.cc:493] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:08.212113  4282 raft_consensus.cc:493] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:08.246457  4190 raft_consensus.cc:2804] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:08.228403  4505 raft_consensus.cc:2749] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:08.226157  4350 raft_consensus.cc:493] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:08.224568  4286 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:08.304231  1603 raft_consensus.cc:2468] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 8.
I20260709 13:00:08.243968  4359 consensus_queue.cc:1048] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 13:00:08.290822  4457 leader_election.cc:290] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:08.291118  4606 raft_consensus.cc:493] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:08.260673  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 117838us
I20260709 13:00:08.247159  4288 consensus_queue.cc:1048] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:00:08.303500  1571 leader_election.cc:304] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
W20260709 13:00:08.317759  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:08.308564  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 67242.8us
I20260709 13:00:08.320637  4357 consensus_queue.cc:237] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:08.283383  3934 raft_consensus.cc:515] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:08.323554  3934 leader_election.cc:290] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:08.324049  3934 raft_consensus.cc:493] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:08.324502  3934 raft_consensus.cc:515] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:08.325098  4521 consensus_meta.cc:287] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.640s	user 0.011s	sys 0.000s
I20260709 13:00:08.325923  1680 raft_consensus.cc:1275] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:00:08.326355  3934 leader_election.cc:290] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:08.281874  4282 raft_consensus.cc:515] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:08.320680  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:00:08.328845  1495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:08.316253  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:08.330824  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:08.330811  1571 leader_election.cc:304] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:08.309911  4402 raft_consensus.cc:493] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:08.343438  4402 raft_consensus.cc:515] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:08.345003  4282 leader_election.cc:290] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:08.345502  4402 leader_election.cc:290] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:08.338958  4683 consensus_queue.cc:1048] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 13:00:08.346563  1571 leader_election.cc:304] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
W20260709 13:00:08.347172  4679 log.cc:927] Time spent T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
I20260709 13:00:08.347664  4578 raft_consensus.cc:2749] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:08.346757  1600 raft_consensus.cc:1240] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 4. Current term is 6. Ops: []
I20260709 13:00:08.328313  4559 raft_consensus.cc:493] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:00:08.348830  4457 raft_consensus.cc:2804] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:08.349407  4457 raft_consensus.cc:697] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 6 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:08.350296  4457 consensus_queue.cc:237] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:08.351241  1672 raft_consensus.cc:1275] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:00:08.301578  4598 leader_election.cc:290] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:08.343441  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
W20260709 13:00:08.366634  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 136152us
W20260709 13:00:08.348771  4680 log.cc:927] Time spent T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:00:08.339118  3970 raft_consensus.cc:2804] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:08.287120  4350 raft_consensus.cc:515] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:08.370277  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:08.387187  2226 raft_consensus.cc:3060] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:00:08.375555  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:08.380040  4033 raft_consensus.cc:515] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:08.383502  1646 leader_election.cc:304] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:08.352711  3934 raft_consensus.cc:493] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:08.392195  3934 raft_consensus.cc:515] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:08.394523  3934 leader_election.cc:290] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:08.398021  1603 raft_consensus.cc:1240] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:08.391390  1646 leader_election.cc:304] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:08.400506  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:08.387903  3970 raft_consensus.cc:493] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:08.423003  1646 leader_election.cc:304] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:08.352478  4606 raft_consensus.cc:515] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:08.429057  1646 leader_election.cc:304] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:08.429951  4669 raft_consensus.cc:2749] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:08.423027  4610 consensus_queue.cc:1059] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:08.424988  4614 raft_consensus.cc:493] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:08.430725  1673 raft_consensus.cc:2393] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 6: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:00:08.431010  4402 raft_consensus.cc:2749] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:08.432590  4350 leader_election.cc:290] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:08.348824  4559 raft_consensus.cc:515] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:08.400162  4282 raft_consensus.cc:2804] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:08.444144  1497 leader_election.cc:304] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:08.403020  4599 raft_consensus.cc:2804] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:08.430874  3970 raft_consensus.cc:3060] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:08.453712  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:08.454941  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:08.435814  4190 raft_consensus.cc:697] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 7 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:08.444078  4282 raft_consensus.cc:493] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:08.460407  1497 leader_election.cc:304] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:08.461985  1497 leader_election.cc:304] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:08.464603  1497 leader_election.cc:304] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:08.445744  4614 raft_consensus.cc:515] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:08.468289  4697 raft_consensus.cc:2764] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:00:08.469058  4614 leader_election.cc:290] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:08.469192  1497 leader_election.cc:304] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:08.470057  4697 raft_consensus.cc:2804] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:08.470469  4697 raft_consensus.cc:493] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:08.470839  4697 raft_consensus.cc:3060] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:08.470896  1497 leader_election.cc:304] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:08.472932  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:08.457072  4350 raft_consensus.cc:2749] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:08.474466  2224 raft_consensus.cc:2468] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 5.
I20260709 13:00:08.465597  3934 raft_consensus.cc:2749] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:08.475750  4033 leader_election.cc:290] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:08.476442  4559 leader_election.cc:290] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:08.456750  4676 leader_election.cc:290] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:08.481626  4697 raft_consensus.cc:515] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:08.556746  2191 leader_election.cc:304] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:08.482090  2226 raft_consensus.cc:2468] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 6.
I20260709 13:00:08.486550  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:08.460784  2218 raft_consensus.cc:1275] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:00:08.485728  1646 leader_election.cc:304] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
W20260709 13:00:08.559981  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 74338.4us
I20260709 13:00:08.495759  4286 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:08.463992  4282 raft_consensus.cc:3060] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:08.472744  4699 raft_consensus.cc:2804] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:08.497972  4606 leader_election.cc:290] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:08.499095  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:08.513118  3934 raft_consensus.cc:2804] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:00:08.513981  2227 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 722) took 1985 ms (client timeout 1743 ms). Trace:
I20260709 13:00:08.514842  4617 raft_consensus.cc:3060] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:08.522330  4033 raft_consensus.cc:493] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:08.523172  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 609) took 1220 ms. Trace:
I20260709 13:00:08.523788  2222 raft_consensus.cc:1240] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 7 LEADER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:08.526413  2192 leader_election.cc:304] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
W20260709 13:00:08.544492  2190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:08.571823  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 45497.9us
W20260709 13:00:08.565901  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 95080.7us
I20260709 13:00:08.572935  1676 raft_consensus.cc:2468] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 6.
I20260709 13:00:08.574525  1497 leader_election.cc:304] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:08.574134  1571 leader_election.cc:304] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:08.569669  1601 rpcz_store.cc:276] 0709 13:00:07.302796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:07.322154 (+ 19358us) service_pool.cc:224] Handling call
0709 13:00:07.690862 (+368708us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:07.880255 (+189393us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:08.522942 (+642687us) spinlock_profiling.cc:243] Waited 326 ms on lock 0x7b54003b24d0. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b28ad 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:08.523110 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":750492928}
I20260709 13:00:08.576864  2192 leader_election.cc:400] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 5 pre-election: Vote denied by peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303) with higher term. Message: Invalid argument: T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b for earlier term 5. Current term is 6.
W20260709 13:00:08.568310  2227 rpcz_store.cc:269] 0709 13:00:06.528691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:06.530172 (+  1481us) service_pool.cc:224] Handling call
0709 13:00:08.513744 (+1983572us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b54005933d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:08.513908 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2383167232}
I20260709 13:00:08.577215  2192 leader_election.cc:403] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:08.579978  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:08.580585  1676 raft_consensus.cc:2393] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 9: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:00:08.566179  4327 raft_consensus.cc:2804] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:08.569271  4692 raft_consensus.cc:2804] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:08.583688  4587 raft_consensus.cc:2749] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303) with higher term. Message: Invalid argument: T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b for earlier term 5. Current term is 6.
I20260709 13:00:08.578609  4286 raft_consensus.cc:2749] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:08.569159  4699 raft_consensus.cc:493] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:08.567946  4413 consensus_queue.cc:1059] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:00:08.581099  3934 raft_consensus.cc:697] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:00:08.587365  4327 raft_consensus.cc:493] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:08.574558  4599 raft_consensus.cc:697] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 8 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:08.568266  4460 consensus_queue.cc:1059] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:00:08.587675  4692 raft_consensus.cc:493] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:08.601959  4692 raft_consensus.cc:3060] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:08.583364  4350 consensus_queue.cc:1059] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.017s
W20260709 13:00:08.606266  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:08.606545  3934 consensus_queue.cc:237] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:08.595989  4327 raft_consensus.cc:3060] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:08.581261  4033 raft_consensus.cc:515] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:08.611459  4033 leader_election.cc:290] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:08.612520  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:08.612341  4599 consensus_queue.cc:237] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:08.613231  2227 raft_consensus.cc:2468] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 6.
W20260709 13:00:08.614372  2190 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.534s (SENT) [suppressed 10 similar messages]
I20260709 13:00:08.615428  1646 leader_election.cc:304] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:08.583994  4683 consensus_queue.cc:1048] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
W20260709 13:00:08.639081  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:08.585965  4688 consensus_queue.cc:1048] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:00:08.591553  4699 raft_consensus.cc:3060] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:08.642264  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:08.589109  4561 raft_consensus.cc:515] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:08.676453  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 612) took 1348 ms. Trace:
I20260709 13:00:08.676946  1606 rpcz_store.cc:276] 0709 13:00:07.327820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:07.681752 (+353932us) service_pool.cc:224] Handling call
0709 13:00:07.681997 (+   245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:07.893181 (+211184us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:08.666446 (+773265us) spinlock_profiling.cc:243] Waited 210 ms on lock 0x7b5400364a54. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:00:08.676377 (+  9931us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":483847552}
I20260709 13:00:08.640627  4714 raft_consensus.cc:2804] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:08.640537  4033 raft_consensus.cc:2804] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:00:08.713112  1598 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36194 (request call id 1524) took 1781 ms (client timeout 2039 ms). Trace:
I20260709 13:00:08.663182  4382 raft_consensus.cc:493] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:08.665863  4695 raft_consensus.cc:493] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:08.713603  1598 rpcz_store.cc:269] 0709 13:00:06.931434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:06.966737 (+ 35303us) service_pool.cc:224] Handling call
0709 13:00:08.712867 (+1746130us) spinlock_profiling.cc:243] Waited 811 ms on lock 0x7b5400267fd4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:08.713048 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1864363264}
W20260709 13:00:08.717299  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 142846us
I20260709 13:00:08.717059  4721 raft_consensus.cc:493] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
W20260709 13:00:08.724673  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 110331us
I20260709 13:00:08.595045  4190 consensus_queue.cc:237] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:08.731280  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:08.714181  4033 raft_consensus.cc:493] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:08.741461  1497 leader_election.cc:304] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:08.685093  4714 raft_consensus.cc:493] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:08.743368  1497 leader_election.cc:304] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:08.744752  1497 leader_election.cc:304] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:08.754848  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:08.756204  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:08.757202  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:08.757472  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:08.757987  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:08.745633  4714 raft_consensus.cc:3060] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:08.759279  4561 leader_election.cc:290] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:08.743345  4033 raft_consensus.cc:3060] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:08.760854  1673 raft_consensus.cc:1240] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 8. Current term is 9. Ops: [6.7-8.8]
I20260709 13:00:08.761305  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:08.757409  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:08.740995  4350 raft_consensus.cc:493] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:08.767942  4350 raft_consensus.cc:515] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:08.744962  4327 raft_consensus.cc:515] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:08.772469  4350 leader_election.cc:290] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:08.742918  4269 raft_consensus.cc:3055] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:08.733618  4382 raft_consensus.cc:515] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:08.827538  1680 raft_consensus.cc:2468] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 6.
I20260709 13:00:08.774165  4697 leader_election.cc:290] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:08.735384  4695 raft_consensus.cc:515] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:08.823681  4350 raft_consensus.cc:2804] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:08.814581  4269 raft_consensus.cc:740] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
W20260709 13:00:08.841408  4712 log.cc:927] Time spent T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 13:00:08.818547  4460 raft_consensus.cc:493] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:08.843628  4460 raft_consensus.cc:515] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:08.846029  4460 leader_election.cc:290] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:08.736021  4721 raft_consensus.cc:515] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:08.849800  4721 leader_election.cc:290] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:08.855906  4695 leader_election.cc:290] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:08.859027  4724 raft_consensus.cc:2804] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:08.859603  4724 raft_consensus.cc:493] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:08.859957  4724 raft_consensus.cc:3060] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:08.862871  4697 raft_consensus.cc:493] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:08.863476  4697 raft_consensus.cc:515] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:08.865587  4697 leader_election.cc:290] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:08.873515  4692 raft_consensus.cc:515] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:08.877190  4699 raft_consensus.cc:515] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:08.878144  1674 raft_consensus.cc:2468] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 7.
I20260709 13:00:08.881232  4617 raft_consensus.cc:493] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:08.881836  4695 raft_consensus.cc:493] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:08.883302  4714 raft_consensus.cc:515] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:00:08.887502  2190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:08.886493  4382 leader_election.cc:290] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:08.889407  1675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50664 (request call id 622) took 1207 ms. Trace:
I20260709 13:00:08.900285  1675 rpcz_store.cc:276] 0709 13:00:07.682143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:07.715448 (+ 33305us) service_pool.cc:224] Handling call
0709 13:00:07.873421 (+157973us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:08.096138 (+222717us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:08.889150 (+793012us) spinlock_profiling.cc:243] Waited 207 ms on lock 0x7b54002558d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:00:08.889339 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":477106560}
I20260709 13:00:08.888795  4721 raft_consensus.cc:493] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:08.892131  4617 raft_consensus.cc:515] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:08.905601  4617 leader_election.cc:290] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:08.840170  4717 raft_consensus.cc:2804] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:08.906947  4717 raft_consensus.cc:493] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:08.907428  4717 raft_consensus.cc:3060] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:08.840483  4350 raft_consensus.cc:493] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:08.895282  4695 raft_consensus.cc:515] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:08.910948  4350 raft_consensus.cc:3060] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:08.911944  4699 leader_election.cc:290] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:08.912323  4695 leader_election.cc:290] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:08.837723  3970 raft_consensus.cc:515] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:08.912909  4269 consensus_queue.cc:260] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:08.913908  4269 raft_consensus.cc:3060] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:08.914175  3970 leader_election.cc:290] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:08.896072  4697 raft_consensus.cc:493] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:08.915879  4697 raft_consensus.cc:515] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:08.918043  4697 leader_election.cc:290] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:08.903427  4288 consensus_queue.cc:1059] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:08.918977  4288 raft_consensus.cc:3055] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:08.919310  4288 raft_consensus.cc:740] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:08.920361  4692 leader_election.cc:290] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:08.920115  4288 consensus_queue.cc:260] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:08.921320  4288 raft_consensus.cc:3060] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:08.865777  4033 raft_consensus.cc:515] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:08.922963  4721 raft_consensus.cc:515] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:08.923424  4033 leader_election.cc:290] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:00:08.924382  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 179709us
I20260709 13:00:08.925287  1497 leader_election.cc:304] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:08.929749  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:08.930325  2227 raft_consensus.cc:3060] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:08.930505  4721 leader_election.cc:290] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:08.935357  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:08.972616  2222 raft_consensus.cc:3060] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:08.975790  1497 leader_election.cc:304] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:08.979363  2227 raft_consensus.cc:2468] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 7.
I20260709 13:00:08.928947  4697 raft_consensus.cc:2804] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:08.979995  1605 raft_consensus.cc:1240] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 7 LEADER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:08.980558  1497 leader_election.cc:304] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:08.983754  1497 leader_election.cc:304] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:08.981755  1646 leader_election.cc:304] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:08.927381  4282 raft_consensus.cc:515] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:08.932224  4699 consensus_queue.cc:1048] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:00:08.942957  4721 consensus_queue.cc:1059] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:00:08.983479  4359 raft_consensus.cc:493] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:08.969244  4717 raft_consensus.cc:515] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:09.004416  4359 raft_consensus.cc:515] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:08.964478  4724 raft_consensus.cc:515] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:08.982498  4697 raft_consensus.cc:493] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:09.004758  4717 leader_election.cc:290] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:08.999640  2222 raft_consensus.cc:2468] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 6.
I20260709 13:00:09.015667  4717 raft_consensus.cc:493] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:09.011648  4726 raft_consensus.cc:493] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:09.016381  4717 raft_consensus.cc:515] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:09.016500  4726 raft_consensus.cc:515] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:08.988296  4598 raft_consensus.cc:2804] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:09.015452  4697 raft_consensus.cc:3060] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:09.015000  4699 raft_consensus.cc:2804] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:09.014907  4714 leader_election.cc:290] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:09.020141  4726 leader_election.cc:290] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:09.020287  4714 raft_consensus.cc:2804] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:09.006610  4359 leader_election.cc:290] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:09.007210  4724 leader_election.cc:290] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:09.020996  4699 raft_consensus.cc:493] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:09.021451  4699 raft_consensus.cc:3060] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:09.023974  1496 leader_election.cc:304] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:09.020725  4714 raft_consensus.cc:493] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:09.028736  4282 leader_election.cc:290] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:09.024883  4727 raft_consensus.cc:2804] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:09.040285  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36194 (request call id 1535) took 1124 ms. Trace:
W20260709 13:00:09.041258  2190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:09.024307  4724 raft_consensus.cc:493] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:09.019058  4598 raft_consensus.cc:697] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 7 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:09.045629  1605 rpcz_store.cc:276] 0709 13:00:07.916126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:08.002820 (+ 86694us) service_pool.cc:224] Handling call
0709 13:00:08.713002 (+710182us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:08.981086 (+268084us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:09.039080 (+ 57994us) spinlock_profiling.cc:243] Waited 266 ms on lock 0x7b5400267fd4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:00:09.040057 (+   977us) spinlock_profiling.cc:243] Waited 684 ms on lock 0x7b5400267fd0. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b28ad 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:09.040217 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2186513536}
I20260709 13:00:09.045599  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:09.046803  1673 raft_consensus.cc:1275] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:00:09.049543  1675 raft_consensus.cc:3060] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:09.031539  4714 raft_consensus.cc:3060] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:09.061714  4697 raft_consensus.cc:515] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:09.053239  4724 raft_consensus.cc:515] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:09.068929  4697 leader_election.cc:290] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:09.069857  4697 consensus_queue.cc:1048] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:09.071350  4697 raft_consensus.cc:493] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:09.071130  4598 consensus_queue.cc:237] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:09.033675  4717 leader_election.cc:290] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:09.080581  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:09.075615  4357 consensus_queue.cc:1048] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:09.077718  2227 raft_consensus.cc:3060] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:09.077706  1572 leader_election.cc:304] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:00:09.081202  2223 raft_consensus.cc:3060] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:09.087265  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 513200us
I20260709 13:00:09.069595  4724 leader_election.cc:290] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:09.025710  4350 raft_consensus.cc:515] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:09.107439  2227 raft_consensus.cc:1275] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 7. (term mismatch)
I20260709 13:00:09.107952  2227 pending_rounds.cc:85] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b: Aborting all ops after (but not including) 6
I20260709 13:00:09.108186  2227 pending_rounds.cc:107] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 6.7
I20260709 13:00:09.108434  2227 raft_consensus.cc:2917] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Aborting config change with OpId 6.7: Aborted: Op aborted by new leader
W20260709 13:00:09.089569  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 106367us
W20260709 13:00:09.112358  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:09.126557  2223 raft_consensus.cc:2468] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 4.
W20260709 13:00:09.141414  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 93654.9us
I20260709 13:00:09.194100  2227 raft_consensus.cc:2889] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 9 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:09.088171  1675 raft_consensus.cc:2468] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 9.
I20260709 13:00:09.141049  1680 raft_consensus.cc:1240] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:09.195752  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:09.196476  1600 raft_consensus.cc:2468] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 8.
I20260709 13:00:09.197587  4688 consensus_queue.cc:1059] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:09.197926  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:09.198227  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:09.198633  1600 raft_consensus.cc:2468] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 8.
I20260709 13:00:09.198594  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:00:09.199064  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:09.199329  1605 raft_consensus.cc:2393] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 4: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:00:09.195559  2227 pending_rounds.cc:107] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:00:09.199483  1607 raft_consensus.cc:2468] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 5.
I20260709 13:00:09.198900  1496 leader_election.cc:304] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:00:09.200724  2191 leader_election.cc:304] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:09.200922  1607 raft_consensus.cc:1240] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 7. Current term is 8. Ops: [5.7-7.8]
I20260709 13:00:09.201501  4359 raft_consensus.cc:2804] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:09.202075  4359 raft_consensus.cc:697] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 9 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:09.203044  4359 consensus_queue.cc:237] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:09.203807  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:09.204499  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:09.201022  4721 raft_consensus.cc:2804] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:09.205614  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:09.205946  4721 raft_consensus.cc:493] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:09.206391  1523 raft_consensus.cc:2393] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 5: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:00:09.206209  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:09.199692  2227 raft_consensus.cc:2889] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 9 LEARNER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:09.182365  4676 raft_consensus.cc:493] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:09.208458  4676 raft_consensus.cc:515] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:09.208973  1496 leader_election.cc:304] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:09.209697  4721 raft_consensus.cc:3060] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:09.210039  4676 leader_election.cc:290] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:09.083106  4732 raft_consensus.cc:3060] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:09.213332  1496 leader_election.cc:304] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
W20260709 13:00:09.215577  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 137962us
I20260709 13:00:09.154834  4561 raft_consensus.cc:2804] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:09.102526  4296 raft_consensus.cc:493] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:09.215736  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:09.119704  4402 raft_consensus.cc:493] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:09.100358  4697 raft_consensus.cc:515] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:09.177884  4282 raft_consensus.cc:493] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:00:09.110495  4727 raft_consensus.cc:697] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:00:09.213526  4606 raft_consensus.cc:493] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:09.223250  1572 leader_election.cc:304] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:00:09.219295  4578 raft_consensus.cc:2804] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:09.227905  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:09.228132  1528 raft_consensus.cc:1240] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:09.236284  1532 raft_consensus.cc:2468] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 6.
I20260709 13:00:09.229282  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:09.232395  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:09.233141  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:09.233880  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:09.215148  4710 raft_consensus.cc:493] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:09.244765  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:09.243402  4710 raft_consensus.cc:515] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:09.247794  4710 leader_election.cc:290] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:09.237051  1525 raft_consensus.cc:3060] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:09.251469  4676 raft_consensus.cc:2804] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:09.251174  4727 consensus_queue.cc:237] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:09.252054  4676 raft_consensus.cc:697] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 4 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:09.237890  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:09.237908  1527 raft_consensus.cc:2393] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 6: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:00:09.207921  4714 raft_consensus.cc:515] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:09.238006  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:09.258378  1529 raft_consensus.cc:2468] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 8.
I20260709 13:00:09.237720  4282 raft_consensus.cc:515] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:09.259611  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:09.230017  4402 raft_consensus.cc:515] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:09.247611  4734 consensus_queue.cc:1059] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:09.220554  4561 raft_consensus.cc:493] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:09.255009  1530 raft_consensus.cc:1275] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:00:09.284526  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:09.285365  1530 raft_consensus.cc:2410] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:00:09.238142  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:09.241169  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:09.267040  4744 consensus_queue.cc:1048] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:09.276639  4578 raft_consensus.cc:697] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 6 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:09.289489  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:09.295763  1532 raft_consensus.cc:2410] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:00:09.290095  1523 raft_consensus.cc:2393] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 6: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:00:09.286437  1524 raft_consensus.cc:2468] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 6.
I20260709 13:00:09.293900  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:09.253177  4676 consensus_queue.cc:237] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:09.225991  4296 raft_consensus.cc:515] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:09.228173  4457 consensus_queue.cc:1048] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 13:00:09.255069  4738 raft_consensus.cc:2749] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:09.316489  1525 raft_consensus.cc:2468] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 9.
I20260709 13:00:09.316720  4726 raft_consensus.cc:3055] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:09.317170  4726 raft_consensus.cc:740] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:00:09.317457  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:09.318177  1525 raft_consensus.cc:2393] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 6: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:00:09.320892  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:09.322095  4532 raft_consensus.cc:493] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:09.322651  4532 raft_consensus.cc:515] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:09.323058  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:09.324060  4286 raft_consensus.cc:3055] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:09.324422  4286 raft_consensus.cc:740] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:09.324584  4697 leader_election.cc:290] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:09.325169  4598 raft_consensus.cc:493] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:09.325461  3934 raft_consensus.cc:3055] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:09.325847  3934 raft_consensus.cc:740] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:00:09.326064  4711 raft_consensus.cc:493] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:09.288930  4561 raft_consensus.cc:3060] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:09.304231  4728 log.cc:927] Time spent T 00000000000000000000000000000000 P 9f38d0e5c9db43a48554defe1153354e: Append to log took a long time: real 0.255s	user 0.001s	sys 0.001s
I20260709 13:00:09.305032  4350 leader_election.cc:290] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:09.343847  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:09.344489  1530 raft_consensus.cc:3060] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:09.306804  4678 leader_election.cc:290] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:09.307153  4282 leader_election.cc:290] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:09.254253  4606 raft_consensus.cc:515] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:09.307826  4402 leader_election.cc:290] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:09.311275  4699 raft_consensus.cc:515] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:09.311977  4296 leader_election.cc:290] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:09.314381  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:09.323055  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:09.301025  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:09.329941  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:09.326506  4711 raft_consensus.cc:515] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:09.317965  4726 consensus_queue.cc:260] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:09.342836  2223 raft_consensus.cc:2468] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 7.
I20260709 13:00:09.365168  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
W20260709 13:00:09.347611  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 81661.5us
I20260709 13:00:09.345584  1646 leader_election.cc:304] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
W20260709 13:00:09.361052  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 123714us
W20260709 13:00:09.361966  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 126428us
I20260709 13:00:09.362797  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:09.396490  1524 raft_consensus.cc:2393] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 7: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:00:09.324714  4532 leader_election.cc:290] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:09.370105  1525 raft_consensus.cc:2393] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 8: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:00:09.405220  1606 raft_consensus.cc:3060] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:09.417474  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:09.345121  4598 raft_consensus.cc:515] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:00:09.436692  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:09.477288  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 141481us
I20260709 13:00:09.426594  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:09.374794  1530 raft_consensus.cc:2468] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 6.
W20260709 13:00:09.375291  2190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:09.392864  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:09.300475  4737 raft_consensus.cc:2804] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:09.393263  1531 raft_consensus.cc:2393] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 5: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:00:09.489709  1672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49170 (request call id 1854) took 1171 ms. Trace:
I20260709 13:00:09.398381  1526 raft_consensus.cc:2468] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 5.
I20260709 13:00:09.398584  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:09.326776  3934 consensus_queue.cc:260] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:09.646180  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:09.579542  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:09.491971  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 13:00:09.642922  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 162216us
I20260709 13:00:09.559448  1606 raft_consensus.cc:2468] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 9.
I20260709 13:00:09.649887  1532 raft_consensus.cc:2393] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 12: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:00:09.651556  1604 raft_consensus.cc:2393] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 8: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:00:09.490976  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:09.648855  1601 raft_consensus.cc:2468] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 6.
I20260709 13:00:09.491127  1672 rpcz_store.cc:276] 0709 13:00:08.318651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:08.321264 (+  2613us) service_pool.cc:224] Handling call
0709 13:00:08.325225 (+  3961us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:08.351598 (+ 26373us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:09.489407 (+1137809us) spinlock_profiling.cc:243] Waited 25.7 ms on lock 0x7b540024d954. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:00:09.489636 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":59074432}
I20260709 13:00:09.655803  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:09.656351  1604 raft_consensus.cc:2468] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 8.
I20260709 13:00:09.540695  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:09.564949  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
W20260709 13:00:09.434579  4741 log.cc:927] Time spent T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:00:09.646871  1530 raft_consensus.cc:2468] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 6.
I20260709 13:00:09.658432  1524 raft_consensus.cc:2376] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 6. Re-sending same reply.
W20260709 13:00:09.592381  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:09.660303  2192 leader_election.cc:304] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:00:09.655301  1646 leader_election.cc:304] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
W20260709 13:00:09.666735  1495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:09.666492  2192 leader_election.cc:304] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:00:09.424973  4402 raft_consensus.cc:493] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:09.450497  4194 raft_consensus.cc:3055] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:09.667313  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:09.670502  2192 leader_election.cc:304] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:09.521512  4695 raft_consensus.cc:2804] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:09.544160  4598 leader_election.cc:290] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:09.725303  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:09.729241  1601 raft_consensus.cc:2468] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 7.
I20260709 13:00:09.725497  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:09.455370  4726 raft_consensus.cc:3060] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:09.544549  4600 raft_consensus.cc:493] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:09.539412  4606 leader_election.cc:290] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:09.564524  4737 raft_consensus.cc:697] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:00:09.787042  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:09.723130  1604 raft_consensus.cc:2468] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 8.
I20260709 13:00:09.663290  4585 raft_consensus.cc:3060] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:09.747809  1570 leader_election.cc:336] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 2.649s (SENT)
I20260709 13:00:09.797087  1570 leader_election.cc:304] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:09.801188  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:09.802045  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:00:09.801975  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 131614us
W20260709 13:00:09.827458  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:09.800661  4695 raft_consensus.cc:697] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 6 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:09.673034  4714 leader_election.cc:290] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:09.673525  4692 raft_consensus.cc:2804] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:09.723919  4380 raft_consensus.cc:2804] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:09.672029  4288 raft_consensus.cc:2804] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:09.835547  1604 raft_consensus.cc:2468] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 5.
I20260709 13:00:09.722532  4194 raft_consensus.cc:740] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:09.842406  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:09.426934  4578 consensus_queue.cc:237] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:09.846499  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:09.798933  3934 raft_consensus.cc:3060] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:09.539628  4286 consensus_queue.cc:260] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:09.857427  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:09.842185  4380 raft_consensus.cc:493] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:09.726270  4402 raft_consensus.cc:515] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:09.867652  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:09.853121  4606 raft_consensus.cc:2749] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:09.849256  4669 raft_consensus.cc:493] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:09.873508  1532 raft_consensus.cc:2468] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 7.
W20260709 13:00:09.878801  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 232359us
I20260709 13:00:09.846920  4288 raft_consensus.cc:493] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:09.880942  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 133185us
I20260709 13:00:09.852800  4692 raft_consensus.cc:697] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 7 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:09.849947  4532 raft_consensus.cc:493] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:09.799573  4600 raft_consensus.cc:515] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:09.876853  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:09.875903  4471 raft_consensus.cc:2749] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 9 LEARNER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:09.885861  4402 leader_election.cc:290] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:09.886282  4288 raft_consensus.cc:3060] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:09.894989  4669 raft_consensus.cc:515] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:09.898910  4714 raft_consensus.cc:493] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:09.899525  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:09.900563  4327 leader_election.cc:290] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:09.902930  4737 consensus_queue.cc:237] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:09.916294  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:09.936921  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 13:00:09.921960  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:09.920503  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 246858us
I20260709 13:00:09.874411  4380 raft_consensus.cc:3060] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:09.928201  1599 raft_consensus.cc:2468] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 7.
I20260709 13:00:09.932269  1496 leader_election.cc:304] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:00:09.952737  1532 raft_consensus.cc:2393] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 12: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:00:09.882552  4711 leader_election.cc:290] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:09.933923  1526 raft_consensus.cc:2468] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 7.
I20260709 13:00:09.951257  1604 raft_consensus.cc:1275] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:00:09.953763  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 13:00:09.956497  1496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:09.960440  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:09.960856  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:09.958595  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:09.961689  1676 raft_consensus.cc:2393] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 6: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:00:09.965293  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:00:09.936304  4732 consensus_meta.cc:287] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent flushing consensus metadata: real 0.718s	user 0.009s	sys 0.000s
I20260709 13:00:09.965975  1672 raft_consensus.cc:2468] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 9.
I20260709 13:00:09.960314  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:09.984090  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:09.984855  1674 raft_consensus.cc:2468] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 6.
I20260709 13:00:09.993193  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:09.993522  1532 pending_rounds.cc:85] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting all ops after (but not including) 3
I20260709 13:00:09.993994  1532 pending_rounds.cc:107] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:00:09.994367  1532 raft_consensus.cc:2889] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:09.993945  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:09.992395  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:09.937101  4685 raft_consensus.cc:493] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:09.927639  4532 raft_consensus.cc:515] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:09.951010  4471 raft_consensus.cc:493] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:09.966434  4717 raft_consensus.cc:2804] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:09.915012  4695 consensus_queue.cc:237] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:09.981647  4282 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.019280  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:09.982281  4732 raft_consensus.cc:2749] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:10.022320  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:09.937857  4752 consensus_queue.cc:1048] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.070s
I20260709 13:00:09.951653  4714 raft_consensus.cc:515] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:09.929647  4194 consensus_queue.cc:260] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:10.027371  4753 log.cc:927] Time spent T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.185s	user 0.000s	sys 0.001s
I20260709 13:00:10.045641  1528 raft_consensus.cc:2468] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 5.
I20260709 13:00:10.046846  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:10.048051  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
W20260709 13:00:10.048640  1495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:10.052485  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:10.048694  1675 raft_consensus.cc:3060] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:10.032943  4717 raft_consensus.cc:697] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:00:10.016752  4685 raft_consensus.cc:515] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:10.062893  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 260030us
I20260709 13:00:10.028254  4471 raft_consensus.cc:515] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:10.054699  4194 raft_consensus.cc:3060] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:10.071381  2192 leader_election.cc:304] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:00:10.037665  4282 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 13:00:10.028618  4692 consensus_queue.cc:237] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:10.081954  4763 raft_consensus.cc:493] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:10.104000  1675 raft_consensus.cc:2468] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 12.
I20260709 13:00:10.106959  1497 leader_election.cc:304] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:10.110893  1531 raft_consensus.cc:2410] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
W20260709 13:00:10.111810  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 231858us
I20260709 13:00:10.117882  1646 leader_election.cc:304] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:10.102828  4521 raft_consensus.cc:493] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.128407  2190 leader_election.cc:304] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:10.129983  1497 leader_election.cc:304] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:10.098409  4732 consensus_queue.cc:1048] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:00:10.108858  2221 raft_consensus.cc:2468] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 5.
I20260709 13:00:10.135483  4521 raft_consensus.cc:515] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:10.138751  4721 consensus_meta.cc:287] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent flushing consensus metadata: real 0.929s	user 0.011s	sys 0.001s
I20260709 13:00:10.139313  4685 leader_election.cc:290] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:10.139173  4721 raft_consensus.cc:515] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:10.139765  4521 leader_election.cc:290] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:10.141202  4721 leader_election.cc:290] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:10.142016  1530 raft_consensus.cc:2468] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 9.
I20260709 13:00:10.131778  4727 raft_consensus.cc:2749] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:10.137663  4600 leader_election.cc:290] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:10.125407  4717 consensus_queue.cc:237] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:10.147604  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:10.161304  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:10.171571  1676 raft_consensus.cc:2468] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 9.
I20260709 13:00:10.172730  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:10.173441  1606 raft_consensus.cc:2468] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 9.
W20260709 13:00:10.133251  4751 log.cc:927] Time spent T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.852s	user 0.000s	sys 0.021s
I20260709 13:00:10.182507  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:00:10.183157  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 65366.3us
I20260709 13:00:10.105741  4763 raft_consensus.cc:515] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:10.184130  1646 leader_election.cc:304] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:10.136071  4350 raft_consensus.cc:2749] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:10.185305  1646 leader_election.cc:304] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:10.139886  4685 raft_consensus.cc:2749] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:10.186242  1646 leader_election.cc:304] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
W20260709 13:00:10.179530  4750 log.cc:927] Time spent T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
I20260709 13:00:10.143519  4764 raft_consensus.cc:2804] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:10.190948  1646 leader_election.cc:304] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:10.135169  4726 consensus_queue.cc:1048] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 13:00:10.178747  4669 leader_election.cc:290] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:10.199488  1675 raft_consensus.cc:2468] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 8.
I20260709 13:00:10.200611  1646 leader_election.cc:304] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:10.203302  1680 raft_consensus.cc:1240] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 7. Current term is 8. Ops: []
W20260709 13:00:10.217180  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 83639.2us
I20260709 13:00:10.217501  1672 raft_consensus.cc:1240] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 6 LEADER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:00:10.187382  4692 raft_consensus.cc:2804] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:10.218500  2190 leader_election.cc:304] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:10.218881  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:10.219748  1606 raft_consensus.cc:2468] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 6.
I20260709 13:00:10.222961  1674 raft_consensus.cc:1275] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:00:10.223189  4282 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:10.196830  4521 raft_consensus.cc:2749] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:10.224640  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 631) took 1022 ms. Trace:
I20260709 13:00:10.191793  4532 leader_election.cc:290] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:10.225018  1607 rpcz_store.cc:276] 0709 13:00:09.202033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:09.202265 (+   232us) service_pool.cc:224] Handling call
0709 13:00:09.202535 (+   270us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:09.220873 (+ 18338us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:09.220901 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:09.223859 (+  2958us) log.cc:844] Serialized 26 byte log entry
0709 13:00:09.364926 (+141067us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:09.848771 (+483845us) log.cc:844] Serialized 14 byte log entry
0709 13:00:09.856169 (+  7398us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:09.856300 (+   131us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:10.224442 (+368142us) raft_consensus.cc:1685] finished
0709 13:00:10.224468 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:10.224586 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32413,"prepare.queue_time_us":515696,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":28045,"raft.run_cpu_time_us":276,"raft.run_wall_time_us":20670,"thread_start_us":515337,"threads_started":2,"wal-append.queue_time_us":694397}
I20260709 13:00:10.226691  4692 raft_consensus.cc:493] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:10.193694  4714 leader_election.cc:290] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:00:10.226985  4766 log.cc:927] Time spent T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 13:00:10.226712  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:10.229370  1606 raft_consensus.cc:2393] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 5: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:00:10.197180  4764 raft_consensus.cc:493] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:10.230525  1606 raft_consensus.cc:1275] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:00:10.230990  4764 raft_consensus.cc:3060] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:10.215171  4685 raft_consensus.cc:2804] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:10.235193  4685 raft_consensus.cc:493] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:10.235602  4685 raft_consensus.cc:3060] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:10.235983  4699 leader_election.cc:290] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:10.189987  4609 raft_consensus.cc:2804] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:10.189996  4768 raft_consensus.cc:2804] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:10.226353  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 632) took 1023 ms. Trace:
I20260709 13:00:10.244211  1605 rpcz_store.cc:276] 0709 13:00:09.203037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:09.203151 (+   114us) service_pool.cc:224] Handling call
0709 13:00:09.203511 (+   360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:09.274815 (+ 71304us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:09.274849 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:09.275395 (+   546us) log.cc:844] Serialized 26 byte log entry
0709 13:00:09.281207 (+  5812us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:09.281255 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:09.281333 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:10.100533 (+819200us) spinlock_profiling.cc:243] Waited 50.4 ms on lock 0x7b4400022b4c. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a153ecc85 00007f6a153ed6a2 00007f6a1815f1db 00007f6a1815aaaf 00007f6a1814e86e 00007f6a1814dbb6 00007f6a1814d7d8 00007f6a18157221 00007f6a181571d9 00007f6a18157169
0709 13:00:10.226075 (+125542us) raft_consensus.cc:1685] finished
0709 13:00:10.226095 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:10.226294 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17541,"raft.queue_time_us":18823,"spinlock_wait_cycles":120254080,"thread_start_us":58673,"threads_started":2,"wal-append.queue_time_us":4991}
I20260709 13:00:10.245468  4282 raft_consensus.cc:2804] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:10.245529  4688 raft_consensus.cc:493] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:10.246810  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 46279.1us
I20260709 13:00:10.245848  4194 raft_consensus.cc:2804] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:10.248006  4194 raft_consensus.cc:493] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:10.248409  4194 raft_consensus.cc:3060] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:10.249233  1646 leader_election.cc:304] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:10.246100  4282 raft_consensus.cc:493] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:10.252202  1646 leader_election.cc:304] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:10.255530  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:10.254972  4695 raft_consensus.cc:2804] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:10.246857  4688 raft_consensus.cc:515] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:10.259677  4688 leader_election.cc:290] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:10.241714  4505 consensus_queue.cc:1048] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 13:00:10.193332  4769 consensus_queue.cc:1048] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
W20260709 13:00:10.250797  4765 log.cc:927] Time spent T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 13:00:10.242697  4692 raft_consensus.cc:3060] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:10.241501  4585 raft_consensus.cc:493] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.269235  1674 raft_consensus.cc:1275] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:00:10.242445  4609 raft_consensus.cc:493] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:00:10.257748  4695 raft_consensus.cc:493] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:10.275461  4532 consensus_queue.cc:1048] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:10.250108  4768 raft_consensus.cc:493] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:10.278239  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:10.279613  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:10.254161  4282 raft_consensus.cc:3060] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:10.285384  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:10.286789  4776 raft_consensus.cc:493] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.287176  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:10.287312  4776 raft_consensus.cc:515] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:10.288374  4288 raft_consensus.cc:515] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:10.289028  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:10.289480  4776 leader_election.cc:290] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:10.289778  1524 raft_consensus.cc:2393] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 6: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:00:10.290585  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:10.291306  4676 raft_consensus.cc:493] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:10.282859  4609 raft_consensus.cc:3060] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:10.291877  4676 raft_consensus.cc:515] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:10.293916  4676 leader_election.cc:290] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:10.291149  4768 raft_consensus.cc:3060] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:10.296119  4763 leader_election.cc:290] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:10.272986  4471 leader_election.cc:290] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:00:10.299479  4561 consensus_meta.cc:287] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.942s	user 0.008s	sys 0.002s
I20260709 13:00:10.299947  4561 raft_consensus.cc:515] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:10.294847  1529 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 9.
I20260709 13:00:10.304101  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:10.304273  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:10.291733  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:10.311169  1523 raft_consensus.cc:2393] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 5: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:00:10.290392  4288 leader_election.cc:290] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:10.319500  4786 raft_consensus.cc:493] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:10.284232  4695 raft_consensus.cc:3060] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:10.279115  4621 raft_consensus.cc:2804] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:10.323082  4685 raft_consensus.cc:515] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:10.323503  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:10.323958  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:10.324074  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:10.273232  4380 raft_consensus.cc:515] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:10.327661  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:10.284157  4585 raft_consensus.cc:515] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:10.337927  4194 raft_consensus.cc:515] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:10.487166  4769 raft_consensus.cc:493] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.691222  4769 raft_consensus.cc:515] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:10.692366  4585 leader_election.cc:290] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:10.693414  4769 leader_election.cc:290] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:10.535456  4609 raft_consensus.cc:515] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:10.483873  4657 raft_consensus.cc:493] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.694592  4657 raft_consensus.cc:515] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:10.695488  4609 leader_election.cc:290] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:10.360802  4786 raft_consensus.cc:515] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:10.489152  4717 raft_consensus.cc:493] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
W20260709 13:00:10.446091  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:10.697901  4786 leader_election.cc:290] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:00:10.698804  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:10.660434  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 408090us
I20260709 13:00:10.700842  2190 leader_election.cc:304] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:00:10.702744  1524 raft_consensus.cc:2393] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 6: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:00:10.698568  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: true dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:10.706182  1525 raft_consensus.cc:3060] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:10.691498  4194 leader_election.cc:290] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:10.714586  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:10.715165  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:00:10.615284  1496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:10.714915  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:10.718796  1524 raft_consensus.cc:2376] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 6. Re-sending same reply.
I20260709 13:00:10.725335  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:10.731845  2223 raft_consensus.cc:1240] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:10.734915  2218 raft_consensus.cc:1275] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:00:10.735946  4537 raft_consensus.cc:493] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:10.736500  4537 raft_consensus.cc:515] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:10.742977  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:10.743741  1607 raft_consensus.cc:2393] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 8: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:00:10.744166  4282 raft_consensus.cc:515] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:10.742527  1497 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43008 (request call id 1835) took 1094 ms. Trace:
I20260709 13:00:10.689113  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:10.396984  4768 raft_consensus.cc:515] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:10.779577  1497 rpcz_store.cc:276] 0709 13:00:09.648530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:10.742476 (+1093946us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:00:10.784619  1673 raft_consensus.cc:2393] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 9: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:00:10.778501  1601 raft_consensus.cc:2468] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 4.
W20260709 13:00:10.394275  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:10.794453  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 13:00:10.531594  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 280462us
W20260709 13:00:10.476648  1495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:10.780576  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 635) took 1560 ms. Trace:
I20260709 13:00:10.797286  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: true dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:10.742187  4692 raft_consensus.cc:515] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:10.746520  4282 leader_election.cc:290] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:10.799765  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 13:00:10.801389  1497 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:43008 dropped due to backpressure: service queue is full with 50 items
I20260709 13:00:10.803020  1525 raft_consensus.cc:2468] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 6.
I20260709 13:00:10.803342  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:10.809772  1604 raft_consensus.cc:3060] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:10.816166  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:10.817373  1525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43008 (request call id 1831) took 1456 ms. Trace:
I20260709 13:00:10.797874  1603 rpcz_store.cc:276] 0709 13:00:09.220059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:09.221653 (+  1594us) service_pool.cc:224] Handling call
0709 13:00:09.221930 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:09.247050 (+ 25120us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:09.247081 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:09.247122 (+    41us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:09.247151 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:10.764561 (+1517410us) spinlock_profiling.cc:243] Waited 24.9 ms on lock 0x7b540035f7d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:00:10.780375 (+ 15814us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:10.780511 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":57334528}
I20260709 13:00:10.779063  1531 raft_consensus.cc:2468] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 6.
I20260709 13:00:10.731319  4786 raft_consensus.cc:2804] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:10.809005  1681 raft_consensus.cc:2393] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 8: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:00:10.804108  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:10.821743  1600 raft_consensus.cc:3060] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:10.769747  4621 raft_consensus.cc:493] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:10.827633  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:10.827893  1599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 639) took 1157 ms. Trace:
I20260709 13:00:10.829766  1676 raft_consensus.cc:2368] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 7. Current term is 8.
I20260709 13:00:10.828228  1599 rpcz_store.cc:276] 0709 13:00:09.670338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:09.847171 (+176833us) service_pool.cc:224] Handling call
0709 13:00:10.827718 (+980547us) spinlock_profiling.cc:243] Waited 67.9 ms on lock 0x7b5400267ad4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:10.827841 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":156245760}
I20260709 13:00:10.833663  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:10.834270  1675 raft_consensus.cc:3060] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:10.834734  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:10.834949  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:10.835474  2218 raft_consensus.cc:2468] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 7.
I20260709 13:00:10.838104  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:10.799337  4758 raft_consensus.cc:493] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:10.844731  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:10.845180  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:10.845995  1677 raft_consensus.cc:2368] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 8. Current term is 9.
I20260709 13:00:10.398975  4288 consensus_queue.cc:1048] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.424s
I20260709 13:00:10.823051  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:10.809548  1646 leader_election.cc:304] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:10.823604  1527 raft_consensus.cc:2393] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 7: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:00:10.364147  4764 raft_consensus.cc:515] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:10.696666  4717 raft_consensus.cc:515] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:10.783548  4609 raft_consensus.cc:493] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.770216  4561 leader_election.cc:290] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:10.853039  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:10.911129  1531 raft_consensus.cc:2468] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 8.
I20260709 13:00:10.859045  1675 raft_consensus.cc:2468] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 7.
I20260709 13:00:10.862465  1604 raft_consensus.cc:2468] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 9.
W20260709 13:00:10.864271  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 54914.2us
I20260709 13:00:10.914759  1646 leader_election.cc:304] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:10.820080  4786 raft_consensus.cc:493] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:10.873423  4380 leader_election.cc:290] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 6 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:10.875521  4717 leader_election.cc:290] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:10.876005  4609 raft_consensus.cc:515] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:10.879431  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:10.880029  2222 raft_consensus.cc:1240] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:10.880964  2227 raft_consensus.cc:1275] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:00:10.870920  4282 raft_consensus.cc:2804] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:00:10.885378  2221 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50310 (request call id 633) took 3182 ms (client timeout 3515 ms). Trace:
I20260709 13:00:10.818894  1525 rpcz_store.cc:276] 0709 13:00:09.360522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:10.660925 (+1300403us) service_pool.cc:224] Handling call
0709 13:00:10.817295 (+156370us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:10.892608  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 13:00:10.859853  4737 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.608s	user 0.006s	sys 0.057s
W20260709 13:00:10.907800  1532 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.019s	sys 0.035s
W20260709 13:00:10.950922  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 250562us
W20260709 13:00:10.951282  1532 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.684s	user 0.019s	sys 0.035s
I20260709 13:00:10.952231  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43008 (request call id 1828) took 1617 ms. Trace:
I20260709 13:00:10.919965  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:10.882634  4764 leader_election.cc:290] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 6 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:10.954962  2219 raft_consensus.cc:1275] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:00:10.930998  4786 raft_consensus.cc:3060] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:10.901623  4359 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.020s	sys 0.056s
I20260709 13:00:10.940673  1646 leader_election.cc:304] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:00:10.891803  4621 raft_consensus.cc:3060] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:10.808077  1497 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:43008 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49310 (request call id 641)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43008 (request call id 1859)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43008 (request call id 1860)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49310 (request call id 642)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43008 (request call id 1861)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43008 (request call id 1862)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43010 (request call id 1916)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43010 (request call id 1911)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43010 (request call id 1920)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43010 (request call id 1919)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43010 (request call id 1917)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43008 (request call id 1864)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43010 (request call id 1912)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43010 (request call id 1923)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43010 (request call id 1921)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49310 (request call id 643)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43008 (request call id 1865)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43010 (request call id 1918)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49310 (request call id 630)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49310 (request call id 632)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43008 (request call id 1833)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49310 (request call id 633)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49310 (request call id 635)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49310 (request call id 637)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49310 (request call id 638)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49310 (request call id 639)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43008 (request call id 1834)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43008 (request call id 1839)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43008 (request call id 1845)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43008 (request call id 1847)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43008 (request call id 1848)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43008 (request call id 1849)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43010 (request call id 1899)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43010 (request call id 1900)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43010 (request call id 1901)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43010 (request call id 1902)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43010 (request call id 1903)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43010 (request call id 1904)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43010 (request call id 1906)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43010 (request call id 1907)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43010 (request call id 1908)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43010 (request call id 1909)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43010 (request call id 1910)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43010 (request call id 1913)
I20260709 13:00:10.963631  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
W20260709 13:00:10.937925  4781 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.031s	sys 0.051s
I20260709 13:00:10.949198  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:10.972025  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:10.972141  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:10.972627  2224 raft_consensus.cc:1275] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:00:10.972783  1527 raft_consensus.cc:2468] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 6.
I20260709 13:00:10.973248  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:00:10.950331  4788 log.cc:927] Time spent T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:00:10.932133  4778 raft_consensus.cc:3060] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:10.958935  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:10.952607  1532 rpcz_store.cc:276] 0709 13:00:09.335215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:09.992967 (+657752us) service_pool.cc:224] Handling call
0709 13:00:09.993310 (+   343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:09.995018 (+  1708us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:09.995053 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:10.000032 (+  4979us) log.cc:844] Serialized 26 byte log entry
0709 13:00:10.214092 (+214060us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:10.951706 (+737614us) log.cc:844] Serialized 14 byte log entry
0709 13:00:10.951922 (+   216us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:10.951994 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:10.952033 (+    39us) raft_consensus.cc:1685] finished
0709 13:00:10.952043 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:10.952177 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":850527,"threads_started":2,"wal-append.queue_time_us":245328}
W20260709 13:00:10.942914  2221 rpcz_store.cc:269] 0709 13:00:07.702590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:07.707085 (+  4495us) service_pool.cc:224] Handling call
0709 13:00:10.885151 (+3178066us) spinlock_profiling.cc:243] Waited 2.21 s on lock 0x7b5400383954. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:10.885280 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5082001280}
I20260709 13:00:10.944921  4282 raft_consensus.cc:493] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:10.951157  4737 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.707s	user 0.006s	sys 0.057s
I20260709 13:00:10.973577  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:10.982429  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:10.973965  1677 raft_consensus.cc:2468] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 6.
I20260709 13:00:10.975534  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:10.976227  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:11.005237  1603 raft_consensus.cc:2468] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 4.
I20260709 13:00:10.976898  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:11.006192  1601 raft_consensus.cc:3060] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:10.981065  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:10.982190  1572 leader_election.cc:304] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:10.982824  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:10.983402  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:11.008533  1674 raft_consensus.cc:2468] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 6.
W20260709 13:00:10.974212  4781 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.655s	user 0.031s	sys 0.051s
I20260709 13:00:11.004009  1527 raft_consensus.cc:2468] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 5.
I20260709 13:00:10.946565  4711 consensus_queue.cc:1048] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
W20260709 13:00:10.960573  4359 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.683s	user 0.020s	sys 0.056s
I20260709 13:00:11.050392  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:11.051270  1532 raft_consensus.cc:2468] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 6.
I20260709 13:00:10.951990  4532 consensus_queue.cc:1059] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:00:10.974517  4269 raft_consensus.cc:2804] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:00:11.134146  1528 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43008 (request call id 1818) took 1900 ms (client timeout 1959 ms). Trace:
W20260709 13:00:11.134689  1528 rpcz_store.cc:269] 0709 13:00:09.233330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:09.244468 (+ 11138us) service_pool.cc:224] Handling call
0709 13:00:11.133967 (+1889499us) spinlock_profiling.cc:243] Waited 800 ms on lock 0x7b540010ccd4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:11.134085 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1840021760}
I20260709 13:00:11.118562  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:11.116333  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:00:10.981154  4695 consensus_meta.cc:287] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.614s	user 0.007s	sys 0.003s
I20260709 13:00:11.134176  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:11.137867  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:11.139930  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:11.140954  1602 raft_consensus.cc:3060] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:11.131276  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:11.132335  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:10.868397  4758 raft_consensus.cc:515] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:11.001775  4282 raft_consensus.cc:3060] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:11.137812  1679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49178 (request call id 1760) took 1179 ms. Trace:
I20260709 13:00:11.153955  1679 rpcz_store.cc:276] 0709 13:00:09.958803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:09.958928 (+   125us) service_pool.cc:224] Handling call
0709 13:00:11.118437 (+1159509us) spinlock_profiling.cc:243] Waited 1.99 ms on lock 0x7b5800143798. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a1548eb71 00007f6a1548eeee 0000000000375939 00007f6a1d5021e0 00007f6a1d5cb0c4 00007f6a1d5cb131 00007f6a1d5790a0 00007f6a1d578984 00007f6a16af36d4 00007f6a16af3662
0709 13:00:11.137731 (+ 19294us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4621440}
I20260709 13:00:11.143290  1527 raft_consensus.cc:2468] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 7.
W20260709 13:00:11.081312  4773 log.cc:927] Time spent T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:00:11.156018  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:11.156564  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:11.152477  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:11.077919  4752 raft_consensus.cc:2804] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:11.157881  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:11.161064  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:11.129392  4781 raft_consensus.cc:493] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:11.158418  1532 raft_consensus.cc:2468] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 5.
I20260709 13:00:11.184834  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:11.185256  1602 raft_consensus.cc:2468] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 6.
I20260709 13:00:11.138971  4269 raft_consensus.cc:493] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
W20260709 13:00:11.174844  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 245765us
I20260709 13:00:11.185608  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:11.190227  2190 leader_election.cc:304] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:11.190605  1606 raft_consensus.cc:3060] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:10.986127  4706 consensus_queue.cc:1048] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.172s
I20260709 13:00:11.161046  1527 raft_consensus.cc:3060] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:11.186754  1528 raft_consensus.cc:2393] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 8: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:00:11.201774  1528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43008 (request call id 1864) took 1116 ms. Trace:
I20260709 13:00:11.202176  1528 rpcz_store.cc:276] 0709 13:00:10.085328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.149370 (+1064042us) service_pool.cc:224] Handling call
0709 13:00:11.201691 (+ 52321us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:11.183658  2192 leader_election.cc:304] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:11.202544  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:11.203321  1532 raft_consensus.cc:2393] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 6: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:00:10.986366  4561 consensus_queue.cc:1048] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.169s
I20260709 13:00:11.195201  1646 leader_election.cc:304] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:11.189383  4781 raft_consensus.cc:515] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:11.209213  4791 log.cc:927] Time spent T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 13:00:11.203913  2192 leader_election.cc:304] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:00:11.201574  4269 raft_consensus.cc:3060] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:11.213220  2192 leader_election.cc:304] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:11.214093  1496 leader_election.cc:304] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:11.214951  4797 raft_consensus.cc:3055] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:11.215468  4797 raft_consensus.cc:740] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:11.214906  4724 raft_consensus.cc:2764] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:00:11.216634  4797 consensus_queue.cc:260] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:11.218026  4787 raft_consensus.cc:2749] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:11.219501  2192 leader_election.cc:304] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:11.217279  1496 leader_election.cc:304] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:11.220386  4797 raft_consensus.cc:3060] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:11.221686  1496 leader_election.cc:304] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:11.220427  4724 raft_consensus.cc:2804] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:11.222426  4787 raft_consensus.cc:2749] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:11.223453  4532 raft_consensus.cc:2749] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:11.223924  4724 raft_consensus.cc:493] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:11.224439  4724 raft_consensus.cc:3060] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:11.226919  4790 log.cc:927] Time spent T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.174s	user 0.001s	sys 0.000s
I20260709 13:00:11.228287  4717 raft_consensus.cc:2804] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:11.228843  4717 raft_consensus.cc:697] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:00:11.229667  4717 consensus_queue.cc:237] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:11.230872  4585 raft_consensus.cc:2749] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:11.181972  4752 raft_consensus.cc:493] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:11.211138  4380 raft_consensus.cc:2804] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:11.236090  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43008 (request call id 1865) took 1114 ms. Trace:
I20260709 13:00:11.249933  1532 rpcz_store.cc:276] 0709 13:00:10.091567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.202291 (+1110724us) service_pool.cc:224] Handling call
0709 13:00:11.206006 (+  3715us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:11.250923  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:11.253068  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:11.253670  1528 raft_consensus.cc:3060] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:11.236260  1679 raft_consensus.cc:1240] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:11.254904  1606 raft_consensus.cc:2468] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 6.
I20260709 13:00:11.256368  1532 raft_consensus.cc:2393] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 7: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:00:11.242704  1496 leader_election.cc:400] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 election: Vote denied by peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217) with higher term. Message: Invalid argument: T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 8. Current term is 9.
I20260709 13:00:11.246127  1527 raft_consensus.cc:2468] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 7.
I20260709 13:00:11.151968  4695 raft_consensus.cc:515] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:11.268998  1496 leader_election.cc:403] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:00:11.234999  4532 consensus_queue.cc:1059] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 13:00:11.257318  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:11.292048  1532 raft_consensus.cc:2468] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 6.
I20260709 13:00:11.293113  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:11.202454  4745 raft_consensus.cc:493] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:11.236780  4764 raft_consensus.cc:2804] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:11.269763  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:11.271137  2192 leader_election.cc:304] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:00:11.235754  4795 raft_consensus.cc:493] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:11.300283  2192 leader_election.cc:304] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:00:11.235518  4692 leader_election.cc:290] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:11.249589  4752 raft_consensus.cc:3060] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:11.252583  4380 raft_consensus.cc:493] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:11.314901  4380 raft_consensus.cc:3060] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:11.315670  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43008 (request call id 1846) took 1374 ms. Trace:
I20260709 13:00:11.319133  4692 raft_consensus.cc:3055] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:11.319566  4692 raft_consensus.cc:740] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:11.294332  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:11.303354  1678 raft_consensus.cc:2368] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 9. Current term is 10.
I20260709 13:00:11.299520  1527 raft_consensus.cc:2468] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 7.
I20260709 13:00:11.320420  4692 consensus_queue.cc:260] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:11.321230  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:11.321851  1527 raft_consensus.cc:2468] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 9.
I20260709 13:00:11.318800  4585 raft_consensus.cc:2804] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:11.322692  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:11.322919  4585 raft_consensus.cc:697] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 6 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:11.323733  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:11.324404  1527 raft_consensus.cc:2393] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 9: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:00:11.323843  4585 consensus_queue.cc:237] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:11.325160  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 13:00:11.312064  4789 log.cc:927] Time spent T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:00:11.314002  4710 raft_consensus.cc:493] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
W20260709 13:00:11.329218  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:11.318827  1526 rpcz_store.cc:276] 0709 13:00:09.941223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:09.958349 (+ 17126us) service_pool.cc:224] Handling call
0709 13:00:11.315465 (+1357116us) spinlock_profiling.cc:243] Waited 330 ms on lock 0x7b540031ae54. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:11.315610 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":759235840}
I20260709 13:00:11.331947  1526 raft_consensus.cc:1275] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:00:11.332095  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:11.332790  1531 raft_consensus.cc:2468] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 5.
I20260709 13:00:11.333948  1531 raft_consensus.cc:1240] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:11.335294  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49310 (request call id 630) took 1990 ms. Trace:
I20260709 13:00:11.335660  1526 rpcz_store.cc:276] 0709 13:00:09.344621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.331303 (+1986682us) service_pool.cc:224] Handling call
0709 13:00:11.331622 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:11.335036 (+  3414us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:11.335237 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:11.337230  1526 raft_consensus.cc:1275] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:00:11.337734  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43008 (request call id 1833) took 1940 ms. Trace:
I20260709 13:00:11.338083  1526 rpcz_store.cc:276] 0709 13:00:09.397524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.336603 (+1939079us) service_pool.cc:224] Handling call
0709 13:00:11.336901 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:11.337528 (+   627us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:11.337687 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:11.339988  4758 leader_election.cc:290] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:11.305928  4194 raft_consensus.cc:2804] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:11.341753  4194 raft_consensus.cc:697] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [term 6 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:11.322044  2191 leader_election.cc:304] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:11.342731  4194 consensus_queue.cc:237] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:11.343804  2191 leader_election.cc:304] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:00:11.344656  4769 raft_consensus.cc:2749] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:11.344913  2191 leader_election.cc:304] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:00:11.345317  4769 raft_consensus.cc:2804] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:11.345711  4769 raft_consensus.cc:493] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:11.346060  4769 raft_consensus.cc:3060] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:11.290369  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 52450.4us
I20260709 13:00:11.301343  4796 raft_consensus.cc:3060] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:11.349251  4752 raft_consensus.cc:515] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:11.351933  1528 raft_consensus.cc:2468] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 6.
I20260709 13:00:11.353123  1528 raft_consensus.cc:1240] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:11.353669  1528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49310 (request call id 633) took 1947 ms. Trace:
I20260709 13:00:11.353734  4657 leader_election.cc:290] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:11.353994  1528 rpcz_store.cc:276] 0709 13:00:09.406196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.352677 (+1946481us) service_pool.cc:224] Handling call
0709 13:00:11.352974 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:11.353466 (+   492us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:11.353621 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:11.326777  4609 leader_election.cc:290] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:00:11.313110  1529 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49310 (request call id 628) took 2012 ms (client timeout 2125 ms). Trace:
W20260709 13:00:11.361552  1529 rpcz_store.cc:269] 0709 13:00:09.300281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:09.300740 (+   459us) service_pool.cc:224] Handling call
0709 13:00:11.312923 (+2012183us) spinlock_profiling.cc:243] Waited 924 ms on lock 0x7b54001b71d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:11.313046 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2125427072}
I20260709 13:00:11.361923  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:11.320436  1532 raft_consensus.cc:3060] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:11.334519  1531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49310 (request call id 632) took 1941 ms. Trace:
I20260709 13:00:11.365739  1600 raft_consensus.cc:2468] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 9.
I20260709 13:00:11.366899  1528 raft_consensus.cc:1275] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:00:11.367625  1528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49310 (request call id 637) took 1787 ms. Trace:
I20260709 13:00:11.368005  1528 rpcz_store.cc:276] 0709 13:00:09.580513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.358903 (+1778390us) service_pool.cc:224] Handling call
0709 13:00:11.359180 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:11.367362 (+  8182us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:11.367543 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:11.356493  4795 raft_consensus.cc:515] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:11.299315  4764 raft_consensus.cc:493] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:11.365680  1531 rpcz_store.cc:276] 0709 13:00:09.393418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.333483 (+1940065us) service_pool.cc:224] Handling call
0709 13:00:11.333781 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:11.334268 (+   487us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:11.334465 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:11.382001  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49310 (request call id 635) took 1802 ms. Trace:
W20260709 13:00:11.380575  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 164961us
I20260709 13:00:11.380662  1532 raft_consensus.cc:2468] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 7.
I20260709 13:00:11.382421  1526 rpcz_store.cc:276] 0709 13:00:09.579866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.366211 (+1786345us) service_pool.cc:224] Handling call
0709 13:00:11.381510 (+ 15299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:11.381683 (+   173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:11.381706 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:11.381745 (+    39us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:11.381776 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:11.381835 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:11.381944 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:11.342059  4695 leader_election.cc:290] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:11.392491  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:11.392643  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:11.326912  4710 raft_consensus.cc:515] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:11.371507  4758 raft_consensus.cc:2804] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:11.392539  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:11.393487  1531 raft_consensus.cc:3060] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:11.397524  1529 raft_consensus.cc:2468] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 7.
I20260709 13:00:11.398077  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:11.398474  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:11.398710  1526 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 9.
I20260709 13:00:11.393512  1532 raft_consensus.cc:2468] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 8.
I20260709 13:00:11.395978  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:11.399785  1600 raft_consensus.cc:3060] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:11.403923  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43008 (request call id 1834) took 1760 ms. Trace:
I20260709 13:00:11.404387  1532 rpcz_store.cc:276] 0709 13:00:09.643520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.403118 (+1759598us) service_pool.cc:224] Handling call
0709 13:00:11.403433 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:11.403607 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:11.403631 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:11.403674 (+    43us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:11.403709 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:11.403760 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:11.403868 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:11.381029  4764 raft_consensus.cc:3060] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:11.406399  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:11.419174  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:11.411451  1600 raft_consensus.cc:2468] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 8.
I20260709 13:00:11.419437  1605 raft_consensus.cc:3060] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:11.305709  4745 raft_consensus.cc:515] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:11.392084  4609 consensus_queue.cc:1048] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
W20260709 13:00:11.422974  1570 leader_election.cc:336] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.523s (SENT)
I20260709 13:00:11.424099  1526 raft_consensus.cc:1240] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:11.419910  1606 raft_consensus.cc:3060] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:00:11.423056  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49310 (request call id 638) took 1842 ms. Trace:
I20260709 13:00:11.425522  1529 rpcz_store.cc:276] 0709 13:00:09.580771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.398179 (+1817408us) service_pool.cc:224] Handling call
0709 13:00:11.422516 (+ 24337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:11.422711 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:11.422738 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:11.422783 (+    45us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:11.422814 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:11.422865 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:11.422979 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:11.413213  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:11.438941  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49310 (request call id 639) took 1857 ms. Trace:
I20260709 13:00:11.439428  1602 raft_consensus.cc:2468] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 7.
I20260709 13:00:11.439584  1526 rpcz_store.cc:276] 0709 13:00:09.581023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.399331 (+1818308us) service_pool.cc:224] Handling call
0709 13:00:11.422569 (+ 23238us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:11.438493 (+ 15924us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:11.438864 (+   371us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18816}
I20260709 13:00:11.397109  4758 raft_consensus.cc:493] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:11.383563  4785 consensus_queue.cc:1048] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:00:11.444060  1529 raft_consensus.cc:1275] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 7. (term mismatch)
I20260709 13:00:11.405788  4537 leader_election.cc:290] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:11.458078  1529 pending_rounds.cc:85] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting all ops after (but not including) 6
I20260709 13:00:11.458386  1529 pending_rounds.cc:107] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 6.7
I20260709 13:00:11.465988  1606 raft_consensus.cc:2468] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 8.
W20260709 13:00:11.466853  1570 leader_election.cc:336] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.574s (SENT)
I20260709 13:00:11.470152  1526 raft_consensus.cc:1275] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:00:11.470844  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43008 (request call id 1847) took 1513 ms. Trace:
I20260709 13:00:11.471150  1526 rpcz_store.cc:276] 0709 13:00:09.957066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.453685 (+1496619us) service_pool.cc:224] Handling call
0709 13:00:11.469854 (+ 16169us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:11.470563 (+   709us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:11.470791 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:11.472074  1529 raft_consensus.cc:2917] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Aborting config change with OpId 6.7: Aborted: Op aborted by new leader
I20260709 13:00:11.472630  1529 raft_consensus.cc:2889] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:11.466813  1601 raft_consensus.cc:2468] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 9.
I20260709 13:00:11.473915  2192 leader_election.cc:304] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:11.445226  1532 raft_consensus.cc:1275] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:00:11.475099  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43008 (request call id 1845) took 1551 ms. Trace:
I20260709 13:00:11.476950  4809 raft_consensus.cc:493] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:11.405656  4380 raft_consensus.cc:515] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:11.477454  1570 leader_election.cc:336] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.585s (SENT)
I20260709 13:00:11.454510  4758 raft_consensus.cc:3060] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:11.491950  4286 raft_consensus.cc:3060] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:11.496058  4768 leader_election.cc:290] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:11.496237  4717 raft_consensus.cc:493] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:11.497059  4781 leader_election.cc:290] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:11.497692  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:11.498006  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:11.498723  1530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43008 (request call id 1859) took 1430 ms. Trace:
I20260709 13:00:11.499013  1530 rpcz_store.cc:276] 0709 13:00:10.068495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.497774 (+1429279us) service_pool.cc:224] Handling call
0709 13:00:11.498643 (+   869us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:11.499881  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:11.500389  1530 raft_consensus.cc:2376] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 7. Re-sending same reply.
W20260709 13:00:11.501183  1570 leader_election.cc:336] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.594s (SENT)
I20260709 13:00:11.502178  1603 raft_consensus.cc:3060] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:00:11.510136  4802 raft_consensus.cc:493] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:11.511004  4685 leader_election.cc:290] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:11.510828  4802 raft_consensus.cc:515] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:11.513211  4802 leader_election.cc:290] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:11.484297  1532 rpcz_store.cc:276] 0709 13:00:09.923874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.444647 (+1520773us) service_pool.cc:224] Handling call
0709 13:00:11.444934 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:11.474863 (+ 29929us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:11.475049 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:11.514194  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:11.514833  1532 raft_consensus.cc:2468] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 5.
I20260709 13:00:11.515621  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:11.516688  1532 raft_consensus.cc:3055] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:11.517053  1532 raft_consensus.cc:740] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:00:11.517762  1532 consensus_queue.cc:260] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:11.518682  1532 raft_consensus.cc:3060] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:11.428637  4269 raft_consensus.cc:515] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:11.519721  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:11.520599  1523 raft_consensus.cc:2410] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:00:11.520771  4269 leader_election.cc:290] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:11.521009  1523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43008 (request call id 1862) took 1440 ms. Trace:
I20260709 13:00:11.521188  4745 leader_election.cc:290] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:11.491537  4380 leader_election.cc:290] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 6 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:11.496764  4717 raft_consensus.cc:515] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:11.523514  4717 leader_election.cc:290] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:00:11.523934  4621 consensus_meta.cc:287] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.537s	user 0.002s	sys 0.007s
I20260709 13:00:11.510046  1571 leader_election.cc:304] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:11.524374  4621 raft_consensus.cc:515] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:11.526525  4745 consensus_queue.cc:1048] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:11.527957  4745 consensus_queue.cc:1048] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:11.528856  1672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49178 (request call id 1768) took 1526 ms. Trace:
I20260709 13:00:11.529230  1672 rpcz_store.cc:276] 0709 13:00:10.002864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:10.003009 (+   145us) service_pool.cc:224] Handling call
0709 13:00:10.003629 (+   620us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:10.217969 (+214340us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:11.528609 (+1310640us) spinlock_profiling.cc:243] Waited 214 ms on lock 0x7b540017aa54. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:00:11.528801 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":491229440}
I20260709 13:00:11.526026  1571 leader_election.cc:304] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:11.530848  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49170 (request call id 1871) took 1253 ms. Trace:
I20260709 13:00:11.531623  4802 raft_consensus.cc:2804] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:00:11.532394  1495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:11.532106  4802 raft_consensus.cc:493] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:11.533332  4802 raft_consensus.cc:3060] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:11.533878  1528 raft_consensus.cc:3055] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:11.534209  1528 raft_consensus.cc:740] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
W20260709 13:00:11.539749  1570 leader_election.cc:336] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.647s (SENT)
I20260709 13:00:11.543708  4795 leader_election.cc:290] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:11.489192  4752 leader_election.cc:290] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:11.544739  1571 leader_election.cc:304] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:11.545555  4752 raft_consensus.cc:2749] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:11.547942  1571 leader_election.cc:304] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:11.548653  4752 raft_consensus.cc:2804] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:11.549127  4752 raft_consensus.cc:697] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 7 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:11.549979  4752 consensus_queue.cc:237] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:11.550546  4724 raft_consensus.cc:515] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:11.552935  4724 leader_election.cc:290] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:11.483155  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:11.554942  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:11.555621  1526 raft_consensus.cc:2393] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 7: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:00:11.556324  1603 raft_consensus.cc:2468] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 6.
I20260709 13:00:11.483907  4327 raft_consensus.cc:2804] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:11.557081  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:11.508584  4758 raft_consensus.cc:515] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:11.519797  4710 leader_election.cc:290] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:11.502082  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:11.558732  1524 raft_consensus.cc:2410] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:00:11.559135  1524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43008 (request call id 1860) took 1490 ms. Trace:
I20260709 13:00:11.559424  1524 rpcz_store.cc:276] 0709 13:00:10.068772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.501846 (+1433074us) service_pool.cc:224] Handling call
0709 13:00:11.559081 (+ 57235us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:11.560350  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:11.561299  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:11.561389  4758 leader_election.cc:290] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:11.562292  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:11.564337  4692 raft_consensus.cc:3060] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:11.565883  4282 raft_consensus.cc:515] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:11.567225  1681 raft_consensus.cc:1240] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 4. Current term is 6. Ops: []
I20260709 13:00:11.568213  4327 raft_consensus.cc:697] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 9 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:11.522056  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:11.557300  4809 raft_consensus.cc:515] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:11.569139  4327 consensus_queue.cc:237] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:11.570725  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:11.527297  1496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:11.571374  4809 leader_election.cc:290] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:11.573017  4621 leader_election.cc:290] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
W20260709 13:00:11.573760  1496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:11.531205  1676 rpcz_store.cc:276] 0709 13:00:10.276990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:10.277659 (+   669us) service_pool.cc:224] Handling call
0709 13:00:11.530622 (+1252963us) spinlock_profiling.cc:243] Waited 542 ms on lock 0x7b54002e6b54. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:11.530773 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1246227840}
I20260709 13:00:11.557749  1607 raft_consensus.cc:2368] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 8. Current term is 9.
I20260709 13:00:11.576161  1528 consensus_queue.cc:260] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:11.577193  1528 raft_consensus.cc:3060] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:11.577127  1532 raft_consensus.cc:1275] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:00:11.579109  1532 pending_rounds.cc:85] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting all ops after (but not including) 6
I20260709 13:00:11.579926  1532 pending_rounds.cc:107] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:00:11.581414  4796 raft_consensus.cc:2749] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217) with higher term. Message: Invalid argument: T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 8. Current term is 9.
I20260709 13:00:11.581360  1532 raft_consensus.cc:2889] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:11.582751  1523 rpcz_store.cc:276] 0709 13:00:10.080855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.519488 (+1438633us) service_pool.cc:224] Handling call
0709 13:00:11.520955 (+  1467us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:11.583098  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43008 (request call id 1848) took 1619 ms. Trace:
I20260709 13:00:11.583459  1532 rpcz_store.cc:276] 0709 13:00:09.963583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.516347 (+1552764us) service_pool.cc:224] Handling call
0709 13:00:11.516586 (+   239us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:11.582841 (+ 66255us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:11.583043 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:11.583832  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:11.584410  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:11.584784  1605 raft_consensus.cc:2468] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 10.
I20260709 13:00:11.584947  1532 raft_consensus.cc:2376] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 7. Re-sending same reply.
I20260709 13:00:11.585351  4706 raft_consensus.cc:2764] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:00:11.565953  4802 raft_consensus.cc:515] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:11.582252  1527 raft_consensus.cc:2468] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 9.
W20260709 13:00:11.587559  4786 consensus_meta.cc:287] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b: Time spent flushing consensus metadata: real 0.610s	user 0.004s	sys 0.004s
I20260709 13:00:11.588088  4786 raft_consensus.cc:515] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:11.569687  1525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43008 (request call id 1861) took 1496 ms. Trace:
I20260709 13:00:11.589201  2220 raft_consensus.cc:1240] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:00:11.589129  1525 rpcz_store.cc:276] 0709 13:00:10.073521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.521825 (+1448304us) service_pool.cc:224] Handling call
0709 13:00:11.569628 (+ 47803us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:11.590395  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:11.592357  1525 raft_consensus.cc:1240] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 4. Current term is 6. Ops: []
I20260709 13:00:11.593192  1525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43010 (request call id 1899) took 1421 ms. Trace:
I20260709 13:00:11.590801  4802 leader_election.cc:290] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:11.603152  1525 rpcz_store.cc:276] 0709 13:00:10.171562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.591880 (+1420318us) service_pool.cc:224] Handling call
0709 13:00:11.592174 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:11.592931 (+   757us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:11.593138 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:11.604501  1531 raft_consensus.cc:2468] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 9.
I20260709 13:00:11.614260  1524 raft_consensus.cc:2468] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 7.
I20260709 13:00:11.614648  1531 raft_consensus.cc:1240] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:11.663254  1531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43010 (request call id 1902) took 1409 ms. Trace:
I20260709 13:00:11.663838  1531 rpcz_store.cc:276] 0709 13:00:10.253837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.614106 (+1360269us) service_pool.cc:224] Handling call
0709 13:00:11.614483 (+   377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:11.662933 (+ 48450us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:11.663184 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:11.665241  1531 raft_consensus.cc:1240] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:11.556429  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:11.665874  1526 raft_consensus.cc:3060] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:11.501197  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:11.672465  1530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43010 (request call id 1907) took 1139 ms. Trace:
I20260709 13:00:11.672860  1530 rpcz_store.cc:276] 0709 13:00:10.533533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.671656 (+1138123us) service_pool.cc:224] Handling call
0709 13:00:11.671983 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:11.672156 (+   173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:11.672182 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:11.672223 (+    41us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:11.672253 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:11.672303 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:11.672408 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:11.674219  1530 raft_consensus.cc:1240] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:11.675974  1530 raft_consensus.cc:1240] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 6. Current term is 7. Ops: []
W20260709 13:00:11.608820  4801 log.cc:927] Time spent T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.242s	user 0.000s	sys 0.001s
W20260709 13:00:11.612150  1644 leader_election.cc:336] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.545s (SENT)
W20260709 13:00:11.676878  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 64784.3us
W20260709 13:00:11.677567  1644 leader_election.cc:336] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.761s (SENT)
I20260709 13:00:11.615486  1527 raft_consensus.cc:1240] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:11.619961  1524 raft_consensus.cc:1240] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 6. Current term is 7. Ops: [6.9-6.9]
I20260709 13:00:11.585873  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:11.679031  1532 raft_consensus.cc:3060] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:11.629689  1425 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50074 (request call id 232) took 13214 ms (client timeout 15000 ms). Trace:
I20260709 13:00:11.679196  1524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43010 (request call id 1904) took 1354 ms. Trace:
I20260709 13:00:11.679592  1524 rpcz_store.cc:276] 0709 13:00:10.324726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.619395 (+1294669us) service_pool.cc:224] Handling call
0709 13:00:11.619756 (+   361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:11.678926 (+ 59170us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:11.679142 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:11.481118  1529 pending_rounds.cc:107] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:00:11.569183  4282 leader_election.cc:290] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:11.630962  2192 leader_election.cc:304] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
W20260709 13:00:11.682737  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 51879.7us
I20260709 13:00:11.683916  1529 raft_consensus.cc:2889] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:11.684682  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43008 (request call id 1839) took 1898 ms. Trace:
I20260709 13:00:11.685043  1529 rpcz_store.cc:276] 0709 13:00:09.785915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.440929 (+1655014us) service_pool.cc:224] Handling call
0709 13:00:11.441270 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:11.684470 (+243200us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:11.684632 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:11.686400  1526 raft_consensus.cc:2468] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 10.
I20260709 13:00:11.687835  1526 raft_consensus.cc:1275] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:00:11.679454  1425 rpcz_store.cc:269] 0709 12:59:58.431396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:58.431696 (+   300us) service_pool.cc:224] Handling call
0709 13:00:11.629601 (+13197905us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:08.260239 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:08.260914 (+   675us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:08.260964 (+    50us) write_op.cc:435] Acquired schema lock
0709 13:00:08.260984 (+    20us) tablet.cc:662] Decoding operations
0709 13:00:08.262581 (+  1597us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:08.285197 (+ 22616us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:08.285238 (+    41us) tablet.cc:685] Acquiring locks for 18 operations
0709 13:00:08.571035 (+285797us) tablet.cc:701] Row locks acquired
0709 13:00:08.586077 (+ 15042us) write_op.cc:260] PREPARE: finished
0709 13:00:08.598828 (+ 12751us) write_op.cc:270] Start()
0709 13:00:08.643390 (+ 44562us) write_op.cc:276] Timestamp: P: 1783602008590936 usec, L: 0
0709 13:00:08.661322 (+ 17932us) op_driver.cc:348] REPLICATION: starting
0709 13:00:08.829400 (+168078us) log.cc:844] Serialized 7170 byte log entry
0709 13:00:10.015855 (+1186455us) op_driver.cc:464] REPLICATION: finished
0709 13:00:10.298066 (+282211us) write_op.cc:301] APPLY: starting
0709 13:00:10.298147 (+    81us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:10.298465 (+   318us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:10.298574 (+   109us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:10.300380 (+  1806us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:10.300649 (+   269us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=18
0709 13:00:10.300692 (+    43us) write_op.cc:312] APPLY: finished
0709 13:00:10.301026 (+   334us) log.cc:844] Serialized 125 byte log entry
0709 13:00:10.319983 (+ 18957us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:10.320142 (+   159us) write_op.cc:454] Released schema lock
0709 13:00:10.320210 (+    68us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:10.320632 (+   422us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:10.320658 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":37,"child_traces":[["op",{"apply.queue_time_us":270002,"apply.run_cpu_time_us":3833,"apply.run_wall_time_us":22552,"num_ops":18,"prepare.queue_time_us":236139,"prepare.run_cpu_time_us":26959,"prepare.run_wall_time_us":721447,"raft.queue_time_us":502022,"raft.run_cpu_time_us":9741,"raft.run_wall_time_us":231577,"replication_time_us":1320701,"thread_start_us":872561,"threads_started":4,"wal-append.queue_time_us":196109,"wal-append.run_cpu_time_us":42817,"wal-append.run_wall_time_us":2270395}]]}
I20260709 13:00:11.688319  4286 raft_consensus.cc:2804] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:11.688934  4286 raft_consensus.cc:697] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 6 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:11.689559  1526 raft_consensus.cc:1275] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:00:11.633934  1528 raft_consensus.cc:1275] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:00:11.634927  4505 raft_consensus.cc:493] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:11.711655  1528 pending_rounds.cc:85] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting all ops after (but not including) 5
I20260709 13:00:11.712033  1528 pending_rounds.cc:107] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:00:11.712368  1528 raft_consensus.cc:2889] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:11.713060  1528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43008 (request call id 1849) took 1746 ms. Trace:
I20260709 13:00:11.713438  1528 rpcz_store.cc:276] 0709 13:00:09.966931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.533435 (+1566504us) service_pool.cc:224] Handling call
0709 13:00:11.533762 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:11.712837 (+179075us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:11.713009 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:11.640816  4786 leader_election.cc:290] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:11.652410  1426 catalog_manager.cc:5697] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } }
W20260709 13:00:11.599480  4778 consensus_meta.cc:287] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.598s	user 0.008s	sys 0.001s
I20260709 13:00:11.601751  4769 raft_consensus.cc:515] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:11.608120  1523 raft_consensus.cc:1275] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:00:11.679049  1527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43010 (request call id 1903) took 1405 ms. Trace:
I20260709 13:00:11.732038  1527 rpcz_store.cc:276] 0709 13:00:10.273500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.615036 (+1341536us) service_pool.cc:224] Handling call
0709 13:00:11.615314 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:11.678790 (+ 63476us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:11.678992 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:11.690043  1532 raft_consensus.cc:2468] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 8.
I20260709 13:00:11.731585  1523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43010 (request call id 1901) took 1511 ms. Trace:
I20260709 13:00:11.735625  1523 rpcz_store.cc:276] 0709 13:00:10.220135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.607443 (+1387308us) service_pool.cc:224] Handling call
0709 13:00:11.607781 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:11.731300 (+123519us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:11.731529 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:11.689843  4286 consensus_queue.cc:237] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:11.681917  1524 raft_consensus.cc:1240] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 8. Current term is 9. Ops: []
W20260709 13:00:11.632083  1570 leader_election.cc:336] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.696s (SENT)
I20260709 13:00:11.690548  4814 raft_consensus.cc:493] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:11.629410  4764 raft_consensus.cc:515] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:11.693689  2191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:11.730589  4817 raft_consensus.cc:493] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
W20260709 13:00:11.696732  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:11.707415  1531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43010 (request call id 1906) took 1317 ms. Trace:
I20260709 13:00:11.743975  1570 leader_election.cc:304] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:11.763303  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:11.763856  2224 raft_consensus.cc:1240] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:11.744174  1524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43010 (request call id 1913) took 1004 ms. Trace:
I20260709 13:00:11.764348  1524 rpcz_store.cc:276] 0709 13:00:10.739671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.681480 (+941809us) service_pool.cc:224] Handling call
0709 13:00:11.681762 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:11.743891 (+ 62129us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:11.744115 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:11.696115  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 335148us
I20260709 13:00:11.755509  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:11.755962  4692 raft_consensus.cc:493] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:11.757136  4802 raft_consensus.cc:1064] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642: attempting to promote NON_VOTER b96ce9cc496c49d7818fa983a17b062b to VOTER
I20260709 13:00:11.790863  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:11.758276  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:11.759061  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:11.794832  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:11.760017  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:11.760413  4678 consensus_queue.cc:1059] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:11.761148  4786 raft_consensus.cc:493] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:11.761332  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:11.761828  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:11.733641  1426 catalog_manager.cc:5697] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 reported cstate change: term changed from 4 to 5, leader changed from e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 5 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:11.762516  1531 rpcz_store.cc:276] 0709 13:00:10.389722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.664696 (+1274974us) service_pool.cc:224] Handling call
0709 13:00:11.665068 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:11.707083 (+ 42015us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:11.707343 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:11.763347  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 131312us
I20260709 13:00:11.767782  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:11.768498  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:11.769501  1680 raft_consensus.cc:1275] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:00:11.769522  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:11.769771  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:11.810907  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:11.811512  1680 raft_consensus.cc:3060] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:11.812012  4785 consensus_queue.cc:1059] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:11.812815  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:11.763890  1677 raft_consensus.cc:3060] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:11.767087  1496 leader_election.cc:400] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 election: Vote denied by peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217) with higher term. Message: Invalid argument: T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 9. Current term is 10.
I20260709 13:00:11.772989  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:11.770129  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:11.774115  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:11.759353  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:11.796674  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:11.814028  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
W20260709 13:00:11.767019  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:11.815485  1602 raft_consensus.cc:3060] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Advancing to term 6
W20260709 13:00:11.816102  1497 connection.cc:256] RPC call timeout handler was delayed by -3.4599289039999803s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20390000000000003s for a response
I20260709 13:00:11.797495  4692 raft_consensus.cc:515] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:11.808215  2221 raft_consensus.cc:2393] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 7: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:00:11.813549  1496 leader_election.cc:403] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
W20260709 13:00:11.818034  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 51098.5us
I20260709 13:00:11.813953  1603 raft_consensus.cc:2468] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 9.
I20260709 13:00:11.819213  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:11.819403  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:11.819128  1675 raft_consensus.cc:2468] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 6.
I20260709 13:00:11.819854  2226 raft_consensus.cc:2468] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 7.
I20260709 13:00:11.811419  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:11.817083  1497 leader_election.cc:400] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 election: Vote denied by peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303) with higher term. Message: Invalid argument: T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 6. Current term is 7.
W20260709 13:00:11.818986  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 44239us
I20260709 13:00:11.821905  1497 leader_election.cc:400] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 election: Vote denied by peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303) with higher term. Message: Invalid argument: T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 8. Current term is 9.
I20260709 13:00:11.822252  2225 raft_consensus.cc:2393] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 7: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
W20260709 13:00:11.819113  1496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:11.822925  2219 raft_consensus.cc:2393] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 9: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:00:11.813529  1604 raft_consensus.cc:2368] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 5. Current term is 6.
I20260709 13:00:11.820725  2227 raft_consensus.cc:2393] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 7: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:00:11.814946  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:11.734165  4778 raft_consensus.cc:2749] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:11.810442  1601 raft_consensus.cc:3060] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:11.825830  1672 raft_consensus.cc:2393] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 8: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:00:11.819986  1644 leader_election.cc:304] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:11.812955  4758 raft_consensus.cc:3055] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:11.822460  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:11.824487  2224 raft_consensus.cc:2393] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 9: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:00:11.835430  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:11.817381  2220 raft_consensus.cc:1240] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:11.825973  1600 raft_consensus.cc:1275] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:00:11.826737  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:11.828058  1602 raft_consensus.cc:2468] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 6.
I20260709 13:00:11.831411  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:11.847724  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:11.838920  1426 catalog_manager.cc:5697] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 reported cstate change: term changed from 4 to 7, leader changed from 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 7 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:11.848839  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:11.834007  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:11.849472  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:11.849869  1528 raft_consensus.cc:2393] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 7: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:00:11.821655  1646 leader_election.cc:304] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:11.846313  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:11.835179  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:11.836362  1644 leader_election.cc:304] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:00:11.811774  2190 leader_election.cc:304] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:11.851298  1526 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 9.
I20260709 13:00:11.841130  1676 raft_consensus.cc:2468] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 9.
I20260709 13:00:11.852384  2190 leader_election.cc:304] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:11.836989  4758 raft_consensus.cc:740] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:11.853495  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:11.824568  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:11.854451  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:11.774091  4711 raft_consensus.cc:493] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:11.855242  1532 raft_consensus.cc:2410] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:00:11.825342  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:11.839325  1679 raft_consensus.cc:3060] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:11.730796  4505 raft_consensus.cc:515] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:11.856804  2223 raft_consensus.cc:2468] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 5.
I20260709 13:00:11.790539  4745 raft_consensus.cc:2749] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:11.841190  4402 raft_consensus.cc:3060] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:11.818473  4802 raft_consensus.cc:1068] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642: Unable to promote non-voter b96ce9cc496c49d7818fa983a17b062b: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:00:11.838230  1529 raft_consensus.cc:2368] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 7. Current term is 8.
I20260709 13:00:11.793368  4282 raft_consensus.cc:493] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:11.841671  4692 leader_election.cc:290] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:11.812817  4785 consensus_queue.cc:1048] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:00:11.863365  4282 raft_consensus.cc:515] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:11.865401  4282 leader_election.cc:290] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:11.762104  4814 raft_consensus.cc:515] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:11.835742  4795 raft_consensus.cc:2749] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217) with higher term. Message: Invalid argument: T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 9. Current term is 10.
I20260709 13:00:11.844203  1677 raft_consensus.cc:2468] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 7.
I20260709 13:00:11.866945  4764 leader_election.cc:290] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 8 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:11.791822  4796 consensus_queue.cc:1059] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.076s
I20260709 13:00:11.844676  1601 raft_consensus.cc:2468] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 7.
I20260709 13:00:11.867951  4796 raft_consensus.cc:3055] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:11.832792  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:11.868733  1678 raft_consensus.cc:2468] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 7.
I20260709 13:00:11.869041  1527 raft_consensus.cc:2410] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:00:11.849241  1680 raft_consensus.cc:2468] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 9.
I20260709 13:00:11.869434  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:11.845654  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:11.855078  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:11.868381  1672 raft_consensus.cc:1240] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 13:00:11.855618  4711 raft_consensus.cc:515] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:11.838078  4717 consensus_queue.cc:1059] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 13:00:11.878794  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:11.868319  4796 raft_consensus.cc:740] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:00:11.880661  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:11.854022  4758 consensus_queue.cc:260] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:11.854085  1531 raft_consensus.cc:2468] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 6.
I20260709 13:00:11.895787  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 13:00:11.871764  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 50187.7us
I20260709 13:00:11.899111  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:11.878695  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:11.900228  1646 leader_election.cc:304] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:11.870581  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:11.872354  1644 leader_election.cc:304] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:11.875443  2190 leader_election.cc:304] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:11.901101  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:11.870455  1680 raft_consensus.cc:1240] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:11.901376  1598 raft_consensus.cc:2393] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 6: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:00:11.881412  1527 raft_consensus.cc:2393] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 5: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:00:11.882611  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:11.884001  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:11.902705  1532 raft_consensus.cc:2468] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 4.
I20260709 13:00:11.885329  1600 raft_consensus.cc:1240] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 4 LEADER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:00:11.888489  1679 raft_consensus.cc:2468] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 6.
I20260709 13:00:11.891383  2223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50326 (request call id 734) took 1064 ms. Trace:
I20260709 13:00:11.893846  1678 raft_consensus.cc:1240] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:11.934077  2223 rpcz_store.cc:276] 0709 13:00:10.827285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:10.827409 (+   124us) service_pool.cc:224] Handling call
0709 13:00:11.891175 (+1063766us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b5400690354. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:11.891308 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2365565696}
I20260709 13:00:11.897374  1604 raft_consensus.cc:1240] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 9 LEADER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 8. Current term is 9. Ops: [6.7-8.8]
I20260709 13:00:11.935222  1603 raft_consensus.cc:1275] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:00:11.879585  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:11.897972  4815 raft_consensus.cc:2804] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:11.914711  1529 raft_consensus.cc:2393] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 7: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:00:11.923755  4787 raft_consensus.cc:2804] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:00:11.931785  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 56434.6us
I20260709 13:00:11.922935  4785 consensus_queue.cc:1059] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:11.949193  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:11.949963  1598 raft_consensus.cc:2368] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 6. Current term is 7.
I20260709 13:00:11.950790  4778 raft_consensus.cc:2749] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:11.836213  4786 raft_consensus.cc:515] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:11.923034  4692 raft_consensus.cc:2804] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:11.951714  4692 raft_consensus.cc:493] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:00:11.952132  4692 raft_consensus.cc:3060] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:11.952423  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:11.952996  1528 raft_consensus.cc:3060] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:11.953343  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:11.898952  4282 raft_consensus.cc:2804] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:11.957454  4282 raft_consensus.cc:697] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 9 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:11.959013  1525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43010 (request call id 1900) took 1762 ms. Trace:
W20260709 13:00:11.885715  4801 log.cc:927] Time spent T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:00:11.960258  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:11.900270  2219 raft_consensus.cc:2368] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 6. Current term is 7.
I20260709 13:00:11.960834  2226 raft_consensus.cc:3060] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:11.829973  4327 consensus_queue.cc:1059] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.093s
I20260709 13:00:11.936292  1646 leader_election.cc:304] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:11.936986  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:11.938835  1523 raft_consensus.cc:2468] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 7.
I20260709 13:00:11.963011  1646 leader_election.cc:304] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:11.939932  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:11.940857  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:11.964802  1675 raft_consensus.cc:2468] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 5.
I20260709 13:00:11.964056  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:11.940915  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:11.965891  1527 raft_consensus.cc:3060] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:11.942186  1680 raft_consensus.cc:1275] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:00:11.941555  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:11.967669  1531 raft_consensus.cc:2376] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 10. Re-sending same reply.
I20260709 13:00:11.968647  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:11.969324  1531 raft_consensus.cc:3060] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:11.942126  1678 raft_consensus.cc:1240] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:11.944330  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:11.944705  2221 raft_consensus.cc:1240] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:00:11.945084  2218 raft_consensus.cc:1240] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 9 LEADER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:11.942081  1426 catalog_manager.cc:5697] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 reported cstate change: term changed from 8 to 10, leader changed from 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 10 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:11.936558  4717 consensus_queue.cc:1243] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer ddf11fc190dd4b898773379c6b129d90 log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:00:11.979908  4327 raft_consensus.cc:3055] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:11.980337  4327 raft_consensus.cc:740] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:11.945890  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:11.946717  4814 leader_election.cc:290] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:11.959390  1525 rpcz_store.cc:276] 0709 13:00:10.196180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.604080 (+1407900us) service_pool.cc:224] Handling call
0709 13:00:11.604448 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:11.604796 (+   348us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:11.604825 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:11.605315 (+   490us) log.cc:844] Serialized 26 byte log entry
0709 13:00:11.797908 (+192593us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:11.797945 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:11.798007 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:11.958803 (+160796us) raft_consensus.cc:1685] finished
0709 13:00:11.958822 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:11.958957 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9144,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":92,"thread_start_us":192199,"threads_started":1,"wal-append.queue_time_us":307617}
I20260709 13:00:11.959437  4194 raft_consensus.cc:2804] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:11.962294  4785 raft_consensus.cc:3055] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:11.981892  4785 raft_consensus.cc:740] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:11.981979  4194 raft_consensus.cc:697] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 9 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:11.981447  1603 raft_consensus.cc:3060] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:11.982762  4785 consensus_queue.cc:260] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:11.983806  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:11.983978  4785 raft_consensus.cc:3060] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:11.984396  1529 raft_consensus.cc:3060] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:11.947891  4787 raft_consensus.cc:493] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:11.985545  4787 raft_consensus.cc:3060] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:11.986141  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:00:11.947424  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 75151us
I20260709 13:00:11.947825  4820 raft_consensus.cc:2804] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:11.987936  4820 raft_consensus.cc:697] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 9 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:11.958348  4282 consensus_queue.cc:237] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:11.961548  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:11.975095  4269 raft_consensus.cc:2804] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:11.976012  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:11.975772  4796 consensus_queue.cc:260] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:11.976512  4815 raft_consensus.cc:697] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 7 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:11.876564  4678 raft_consensus.cc:3055] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:11.977236  2225 raft_consensus.cc:1275] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:00:11.977739  4778 raft_consensus.cc:2804] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:11.790673  4817 raft_consensus.cc:515] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:11.963891  1646 leader_election.cc:304] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
W20260709 13:00:12.030544  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 66733.2us
I20260709 13:00:12.001562  1644 leader_election.cc:304] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:00:12.003436  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:12.006363  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:11.979110  1426 catalog_manager.cc:5697] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 reported cstate change: term changed from 4 to 5, leader changed from ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) to 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194). New cstate: current_term: 5 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:00:12.006489  2227 raft_consensus.cc:2468] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 8.
I20260709 13:00:12.012315  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:12.032802  1602 raft_consensus.cc:2393] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 12: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
W20260709 13:00:12.018474  1496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:12.023296  1526 raft_consensus.cc:3055] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:12.033532  1526 raft_consensus.cc:740] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:00:12.034403  1526 consensus_queue.cc:260] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:12.035742  1526 raft_consensus.cc:3060] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:12.039705  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:12.043422  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:12.044188  2227 raft_consensus.cc:3060] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:12.045320  1526 raft_consensus.cc:1275] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:00:12.046221  4669 raft_consensus.cc:2804] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:12.046615  4669 raft_consensus.cc:493] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:12.046825  1496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:12.047240  2220 raft_consensus.cc:1240] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:00:12.047887  1602 raft_consensus.cc:1240] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:12.046554  2218 raft_consensus.cc:1275] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:00:12.048787  4402 raft_consensus.cc:2749] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:12.049309  1496 leader_election.cc:304] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:12.049592  4402 raft_consensus.cc:2804] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:12.050016  4402 raft_consensus.cc:493] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:12.050309  1673 raft_consensus.cc:1240] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:12.049057  4505 leader_election.cc:290] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:12.052121  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:12.052871  4724 raft_consensus.cc:2804] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:12.053299  4724 raft_consensus.cc:493] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:12.053555  1601 raft_consensus.cc:2368] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 8. Current term is 9.
I20260709 13:00:12.049918  4717 consensus_queue.cc:1059] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:00:11.988880  4820 consensus_queue.cc:237] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:12.055996  1679 raft_consensus.cc:1275] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:00:12.025936  1603 raft_consensus.cc:2468] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 7.
I20260709 13:00:11.952687  4786 leader_election.cc:290] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:12.059695  1673 raft_consensus.cc:1240] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:12.045571  1644 leader_election.cc:304] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:12.038944  1646 leader_election.cc:304] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:12.061467  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:12.045717  1526 pending_rounds.cc:85] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting all ops after (but not including) 6
I20260709 13:00:12.066273  1526 pending_rounds.cc:107] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:00:12.067487  1426 catalog_manager.cc:5697] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:12.070740  4710 consensus_queue.cc:1048] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:12.063424  1571 leader_election.cc:304] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:12.072327  2219 raft_consensus.cc:1275] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:00:12.083776  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 44920us
I20260709 13:00:12.073180  2227 raft_consensus.cc:2468] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 6.
I20260709 13:00:12.073040  4815 consensus_queue.cc:237] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:12.024667  4758 raft_consensus.cc:3060] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:12.075181  4711 leader_election.cc:290] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:12.029948  4678 raft_consensus.cc:740] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:11.982884  4194 consensus_queue.cc:237] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:12.092135  1571 leader_election.cc:304] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:12.083436  1529 raft_consensus.cc:2468] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 7.
I20260709 13:00:12.081590  2221 raft_consensus.cc:1240] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 6. Current term is 7. Ops: []
W20260709 13:00:12.140545  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 48500.1us
I20260709 13:00:12.095722  1644 leader_election.cc:304] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:12.090142  1528 raft_consensus.cc:2468] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 6.
I20260709 13:00:12.142078  1571 leader_election.cc:304] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:12.054684  4724 raft_consensus.cc:3060] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:12.143658  4802 raft_consensus.cc:2804] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:12.143959  4745 consensus_queue.cc:1059] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:12.095515  2226 raft_consensus.cc:2468] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 8.
I20260709 13:00:12.063896  4669 raft_consensus.cc:3060] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:12.145973  2227 raft_consensus.cc:1240] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:12.043704  4269 raft_consensus.cc:697] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 8 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:12.150907  4269 consensus_queue.cc:237] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:12.082460  1526 raft_consensus.cc:2889] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:12.100736  1602 raft_consensus.cc:1240] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 7 LEADER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:12.103051  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:12.098263  1531 raft_consensus.cc:2468] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 7.
I20260709 13:00:12.104198  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:12.103227  1604 raft_consensus.cc:1240] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 7. Current term is 8. Ops: []
W20260709 13:00:12.108393  1570 leader_election.cc:336] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.807s (SENT)
I20260709 13:00:12.140347  2191 leader_election.cc:304] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:00:12.161612  1570 leader_election.cc:304] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:12.092150  4778 raft_consensus.cc:697] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 8 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:12.096855  4532 raft_consensus.cc:2804] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:00:12.163672  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 68027.4us
W20260709 13:00:12.112489  1495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:12.115132  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:12.166016  1601 raft_consensus.cc:2368] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 9. Current term is 10.
I20260709 13:00:12.166648  2225 raft_consensus.cc:1240] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 13:00:12.109889  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:12.095551  1603 raft_consensus.cc:1240] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:00:12.168489  1599 raft_consensus.cc:1275] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:00:12.105018  1527 raft_consensus.cc:2468] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 7.
I20260709 13:00:12.170071  2218 raft_consensus.cc:2393] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 9: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:00:11.981196  4327 consensus_queue.cc:260] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:12.079932  4402 raft_consensus.cc:3060] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:12.172132  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:12.100199  4706 raft_consensus.cc:2804] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:12.198930  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:12.199663  2225 raft_consensus.cc:3060] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:12.100335  4817 leader_election.cc:290] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:12.165733  4710 raft_consensus.cc:2804] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:00:12.172976  4795 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 13:00:12.209146  4710 raft_consensus.cc:493] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:12.209568  4817 raft_consensus.cc:2749] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:12.209605  4710 raft_consensus.cc:3060] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:12.207439  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:12.206879  1426 catalog_manager.cc:5697] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 reported cstate change: term changed from 3 to 7, leader changed from b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 7 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:12.101181  3934 consensus_queue.cc:1059] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.100s
I20260709 13:00:12.179266  4585 raft_consensus.cc:2804] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:12.171058  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:12.222534  2218 raft_consensus.cc:1240] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:00:12.220433  4190 consensus_queue.cc:1059] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:00:12.221504  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:12.215214  4786 consensus_queue.cc:1048] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 13:00:12.220714  4678 consensus_queue.cc:260] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:12.227129  1426 catalog_manager.cc:5697] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:12.215373  4804 raft_consensus.cc:2749] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:12.250912  2225 raft_consensus.cc:2468] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 6.
I20260709 13:00:12.218611  4706 raft_consensus.cc:697] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 9 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:12.232774  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 13:00:12.242522  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 190102us
I20260709 13:00:12.260349  1426 catalog_manager.cc:5697] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 reported cstate change: term changed from 6 to 8, leader changed from 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 8 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:12.197953  4288 consensus_queue.cc:1059] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:00:12.261121  2226 raft_consensus.cc:2468] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 8.
I20260709 13:00:12.269440  2190 leader_election.cc:304] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:12.261742  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:12.261271  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:12.263374  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:00:12.243891  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 135558us
I20260709 13:00:12.271065  1678 raft_consensus.cc:2393] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 6: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:00:12.270900  1426 catalog_manager.cc:5697] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:12.225205  4585 raft_consensus.cc:493] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
W20260709 13:00:12.274030  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 128864us
W20260709 13:00:12.273013  1570 leader_election.cc:336] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.817s (SENT)
I20260709 13:00:12.275817  1570 leader_election.cc:304] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:00:12.266412  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 172470us
I20260709 13:00:12.283671  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:12.283802  1426 catalog_manager.cc:5697] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 reported cstate change: term changed from 4 to 6, leader changed from e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 6 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:12.290134  1672 raft_consensus.cc:2468] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 9.
I20260709 13:00:12.260004  4380 raft_consensus.cc:493] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:12.259544  4286 raft_consensus.cc:493] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:12.273880  4717 raft_consensus.cc:3055] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:12.279767  4585 raft_consensus.cc:3060] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:12.253523  4802 raft_consensus.cc:697] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 6 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:12.270184  4678 raft_consensus.cc:3060] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:12.380235  1426 catalog_manager.cc:5697] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 reported cstate change: term changed from 4 to 6, leader changed from e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 6 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } }
W20260709 13:00:12.375073  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:12.393834  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 124477us
W20260709 13:00:12.395162  1496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:12.298861  4282 raft_consensus.cc:493] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:12.473717  2190 leader_election.cc:304] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:00:12.370929  4833 raft_consensus.cc:3055] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:00:12.472790  1496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:12.482227  1527 raft_consensus.cc:3055] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:12.482826  1527 raft_consensus.cc:740] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:00:12.272837  4778 consensus_queue.cc:237] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:00:12.481920  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 317073us
W20260709 13:00:12.473924  4825 log.cc:927] Time spent T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.306s	user 0.000s	sys 0.001s
I20260709 13:00:12.394614  4717 raft_consensus.cc:740] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:00:12.489449  1496 leader_election.cc:304] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:12.483659  1527 consensus_queue.cc:260] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:12.481974  4532 raft_consensus.cc:697] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 10 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
W20260709 13:00:12.496742  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 220087us
I20260709 13:00:12.498054  1527 raft_consensus.cc:3060] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:12.503690  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 205306us
I20260709 13:00:12.392701  4380 raft_consensus.cc:515] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:12.481011  4833 raft_consensus.cc:740] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:00:12.481467  4838 raft_consensus.cc:2749] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:00:12.490729  4692 consensus_meta.cc:287] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.538s	user 0.005s	sys 0.010s
I20260709 13:00:12.513024  1527 raft_consensus.cc:1275] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:00:12.523259  1527 pending_rounds.cc:85] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting all ops after (but not including) 6
I20260709 13:00:12.523948  1527 pending_rounds.cc:107] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:00:12.524256  1527 raft_consensus.cc:2889] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:00:12.519021  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 246501us
I20260709 13:00:12.440388  4286 raft_consensus.cc:515] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:12.489856  4849 raft_consensus.cc:2804] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:12.529882  1530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49310 (request call id 644) took 1525 ms. Trace:
I20260709 13:00:12.530346  1530 rpcz_store.cc:276] 0709 13:00:11.004812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.684200 (+679388us) service_pool.cc:224] Handling call
0709 13:00:11.684507 (+   307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:11.685126 (+   619us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:11.685156 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:11.685613 (+   457us) log.cc:844] Serialized 26 byte log entry
0709 13:00:11.846411 (+160798us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:11.846449 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:11.846510 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:12.529638 (+683128us) raft_consensus.cc:1685] finished
0709 13:00:12.529670 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:12.529819 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":114,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":78,"thread_start_us":160438,"threads_started":1,"wal-append.queue_time_us":377017}
W20260709 13:00:12.521700  4828 log.cc:927] Time spent T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.322s	user 0.001s	sys 0.000s
I20260709 13:00:12.484067  4282 raft_consensus.cc:515] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:12.486374  4787 raft_consensus.cc:515] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:12.502226  4848 consensus_queue.cc:1048] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:00:12.491108  4706 consensus_queue.cc:237] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:12.532310  4190 raft_consensus.cc:3055] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:00:12.551357  4832 log.cc:927] Time spent T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.260s	user 0.001s	sys 0.000s
I20260709 13:00:12.559607  4838 consensus_queue.cc:1048] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:00:12.560101  4837 log.cc:927] Time spent T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:00:12.560441  4286 leader_election.cc:290] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:12.562079  4787 leader_election.cc:290] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 8 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:12.562602  4669 raft_consensus.cc:515] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:12.564374  4282 leader_election.cc:290] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:12.543819  4288 raft_consensus.cc:2804] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:12.543558  4764 consensus_queue.cc:1048] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:00:12.565266  2223 raft_consensus.cc:1240] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:00:12.560477  4380 leader_election.cc:290] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:00:12.559059  4835 log.cc:927] Time spent T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.189s	user 0.001s	sys 0.000s
I20260709 13:00:12.525776  4692 raft_consensus.cc:515] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:12.543540  4849 raft_consensus.cc:697] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 7 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:12.566937  4190 raft_consensus.cc:740] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:12.557178  4842 raft_consensus.cc:2749] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:00:12.612604  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 334680us
W20260709 13:00:12.603482  1497 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.000s	sys 0.004s
W20260709 13:00:12.604689  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 115339us
W20260709 13:00:12.559062  4829 log.cc:927] Time spent T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:00:12.615368  1673 raft_consensus.cc:2393] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 9: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:00:12.557332  4711 consensus_queue.cc:1059] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 13:00:12.527972  4802 consensus_queue.cc:237] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:12.621333  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 131063us
I20260709 13:00:12.596948  4859 raft_consensus.cc:493] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:12.628978  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 155356us
I20260709 13:00:12.554869  4532 consensus_queue.cc:237] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:00:12.638780  1495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:12.613454  1497 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.000s	sys 0.005s
W20260709 13:00:12.614202  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 89290.8us
W20260709 13:00:12.602636  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 101725us
W20260709 13:00:12.616182  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 93353.9us
W20260709 13:00:12.640861  1570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:12.601600  4850 raft_consensus.cc:2804] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:12.643198  1497 leader_election.cc:304] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:12.645679  1572 leader_election.cc:304] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
W20260709 13:00:12.631980  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 142939us
I20260709 13:00:12.616240  4288 raft_consensus.cc:697] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [term 7 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:12.618884  4282 raft_consensus.cc:493] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:12.619513  4820 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.000s	sys 0.007s
I20260709 13:00:12.656376  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:12.656680  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:12.657370  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:12.663197  1570 leader_election.cc:304] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:12.665436  1572 leader_election.cc:304] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90
W20260709 13:00:12.665975  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 52181.6us
I20260709 13:00:12.667827  1497 leader_election.cc:304] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:12.670809  1678 raft_consensus.cc:2410] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:00:12.651119  4842 consensus_queue.cc:1059] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:00:12.590881  4833 consensus_queue.cc:260] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:12.673858  1646 leader_election.cc:304] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
W20260709 13:00:12.672063  4820 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.000s	sys 0.008s
I20260709 13:00:12.631153  4745 consensus_queue.cc:1059] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 13:00:12.658675  4190 consensus_queue.cc:260] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:12.709543  4190 raft_consensus.cc:3060] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:12.711230  4841 log.cc:927] Time spent T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:00:12.668820  4850 raft_consensus.cc:697] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:00:12.717250  1681 raft_consensus.cc:1240] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 9 LEADER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:12.658888  4851 consensus_queue.cc:1059] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.048s
W20260709 13:00:12.712865  4855 raft_consensus.cc:670] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b: failed to trigger leader election: Illegal state: only voting members can start elections: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
W20260709 13:00:12.702103  4830 log.cc:927] Time spent T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.180s	user 0.001s	sys 0.000s
W20260709 13:00:12.747318  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 97562.8us
I20260709 13:00:12.634775  4859 raft_consensus.cc:515] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:12.754411  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 100106us
I20260709 13:00:12.709584  4872 raft_consensus.cc:3055] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:12.675439  4282 raft_consensus.cc:515] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:00:12.771215  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 73561us
I20260709 13:00:12.779426  4850 consensus_queue.cc:237] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:12.780153  4878 raft_consensus.cc:2749] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:12.780826  4878 raft_consensus.cc:2749] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:00:12.781404  4878 raft_consensus.cc:2804] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:12.781714  4878 raft_consensus.cc:493] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:12.782044  4878 raft_consensus.cc:3060] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:12.725328  4868 raft_consensus.cc:2804] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:00:12.786518  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 121158us
I20260709 13:00:12.723104  4820 consensus_queue.cc:1059] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.055s
I20260709 13:00:12.772810  4872 raft_consensus.cc:740] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
W20260709 13:00:12.800166  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 126362us
I20260709 13:00:12.804991  1676 raft_consensus.cc:1275] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:00:12.787886  4868 raft_consensus.cc:493] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:12.702025  4849 consensus_queue.cc:237] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:12.833205  1646 leader_election.cc:304] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:12.836005   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:12.840314  4869 consensus_queue.cc:1059] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:12.846467  4745 raft_consensus.cc:3055] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:12.846958  4745 raft_consensus.cc:740] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:12.833837  4868 raft_consensus.cc:3060] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:12.845084  4843 consensus_queue.cc:1048] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 13:00:12.849351  4843 consensus_queue.cc:1059] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:12.853312  4848 raft_consensus.cc:2749] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:12.844828  4820 consensus_queue.cc:1048] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 13:00:12.855536  4804 raft_consensus.cc:3055] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:12.855949  4804 raft_consensus.cc:740] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:12.856704  4820 raft_consensus.cc:2804] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:12.782796  4839 consensus_queue.cc:1059] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.070s
I20260709 13:00:12.849237  4621 consensus_queue.cc:1048] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 13:00:12.852916  4872 consensus_queue.cc:260] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:12.859786  4872 raft_consensus.cc:3060] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:12.860859  4844 log.cc:927] Time spent T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 13:00:12.786278  4380 consensus_queue.cc:1048] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:00:12.856791  4804 consensus_queue.cc:260] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:12.866372  4688 raft_consensus.cc:3055] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:12.866955  4688 raft_consensus.cc:740] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:12.862471  4804 raft_consensus.cc:3060] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:12.868407  4688 consensus_queue.cc:260] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:12.804701  4854 raft_consensus.cc:2804] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:12.805966  4669 leader_election.cc:290] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:12.906311  1676 raft_consensus.cc:1240] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:12.857271  4820 raft_consensus.cc:697] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 7 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
W20260709 13:00:12.935463  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 99411.6us
I20260709 13:00:12.845048  4692 leader_election.cc:290] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
W20260709 13:00:12.925385  4785 consensus_meta.cc:287] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b: Time spent flushing consensus metadata: real 0.941s	user 0.014s	sys 0.000s
I20260709 13:00:12.939474  1646 leader_election.cc:304] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:12.777711  4288 consensus_queue.cc:237] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:12.954938  4845 log.cc:927] Time spent T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.183s	user 0.000s	sys 0.001s
I20260709 13:00:12.924041  4854 raft_consensus.cc:493] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:12.847806  4745 consensus_queue.cc:260] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:12.969322  1599 raft_consensus.cc:1240] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 6. Current term is 7. Ops: []
W20260709 13:00:12.953909  4758 consensus_meta.cc:287] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b: Time spent flushing consensus metadata: real 0.815s	user 0.013s	sys 0.000s
I20260709 13:00:12.942008  4865 raft_consensus.cc:493] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:12.942415  4688 raft_consensus.cc:3060] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:12.980476  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:13.006352  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
W20260709 13:00:13.007747  1496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:13.008452  1496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:12.980676  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:00:12.977442  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:13.015509  1523 raft_consensus.cc:3055] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:13.019448  1523 raft_consensus.cc:740] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:00:13.020371  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:13.021251  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:13.021957  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:13.023095  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:13.023305  1531 raft_consensus.cc:1275] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:00:13.023766  2219 raft_consensus.cc:3060] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:13.021812  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:13.025171  2227 raft_consensus.cc:2468] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 9.
I20260709 13:00:13.028668  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:13.029475  1529 raft_consensus.cc:2468] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 7.
I20260709 13:00:13.035702  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 13:00:13.037591  1495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:13.038245  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:00:13.040027  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 205131us
W20260709 13:00:13.041864  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 278077us
I20260709 13:00:13.043645  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
W20260709 13:00:12.991012  4724 consensus_meta.cc:287] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent flushing consensus metadata: real 0.848s	user 0.014s	sys 0.000s
W20260709 13:00:13.050773  1496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:12.979439  4710 consensus_meta.cc:287] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.769s	user 0.007s	sys 0.007s
W20260709 13:00:13.052656  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 389536us
I20260709 13:00:12.981986  4745 raft_consensus.cc:3060] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:12.991274  4888 raft_consensus.cc:3055] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:12.962971  4854 raft_consensus.cc:3060] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:13.004510  4692 raft_consensus.cc:2804] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:13.056116  1524 raft_consensus.cc:1275] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 13:00:12.992105  4327 raft_consensus.cc:3060] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:13.037811  1523 consensus_queue.cc:260] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:13.060294  2224 raft_consensus.cc:2468] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 8.
I20260709 13:00:12.988669  4769 leader_election.cc:290] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:12.990993  4796 raft_consensus.cc:3060] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:12.991366  4190 consensus_queue.cc:1048] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.090s
W20260709 13:00:13.062388  2192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:13.064531  1604 raft_consensus.cc:1275] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:00:13.067409  1496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:13.063117  1570 leader_election.cc:304] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:00:13.118835  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 54804.5us
I20260709 13:00:13.095398  2219 raft_consensus.cc:2468] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 9.
I20260709 13:00:13.124045  1523 raft_consensus.cc:3060] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:13.000921  4752 raft_consensus.cc:3055] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:13.061121  4269 raft_consensus.cc:493] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.149353  1646 leader_election.cc:304] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:00:13.086875  4888 raft_consensus.cc:740] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
W20260709 13:00:13.157529  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 94490us
I20260709 13:00:12.993492  4868 raft_consensus.cc:515] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:13.162241  1570 leader_election.cc:304] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:00:13.162745  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 494999us
I20260709 13:00:13.186548  1497 leader_election.cc:304] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:13.188416  1497 leader_election.cc:304] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:13.190439  1497 leader_election.cc:304] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:13.192050  1497 leader_election.cc:400] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Vote denied by peer b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373) with higher term. Message: Invalid argument: T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 6. Current term is 7.
I20260709 13:00:13.192595  1497 leader_election.cc:403] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:13.128118  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 13:00:13.213997  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:13.062471  4724 raft_consensus.cc:515] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:00:13.221809  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 59652.3us
W20260709 13:00:13.222472  1495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:13.124605  4878 raft_consensus.cc:515] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:13.145222  4752 raft_consensus.cc:740] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:13.081728  4710 raft_consensus.cc:515] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:13.232595  1497 leader_election.cc:304] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
W20260709 13:00:13.281507  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 56316.7us
W20260709 13:00:13.217856  4815 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.657s	user 0.012s	sys 0.008s
W20260709 13:00:13.251838  1571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:13.231456  1523 raft_consensus.cc:1275] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:00:13.282984  1527 raft_consensus.cc:2393] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 8: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
W20260709 13:00:13.289528  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 140267us
I20260709 13:00:13.157897  4692 raft_consensus.cc:697] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 6 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
W20260709 13:00:13.297150  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 64540us
I20260709 13:00:13.035989  4865 raft_consensus.cc:515] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:13.188249  4282 leader_election.cc:290] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:13.197510  4850 raft_consensus.cc:2749] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:13.059056  4820 consensus_queue.cc:237] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:00:13.309927  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 266322us
I20260709 13:00:13.309548  1601 raft_consensus.cc:3060] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:13.316823  1644 leader_election.cc:304] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:13.311062  1497 leader_election.cc:400] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 election: Vote denied by peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303) with higher term. Message: Invalid argument: T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 5. Current term is 6.
I20260709 13:00:13.318044  1497 leader_election.cc:403] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:00:13.287050  4795 raft_consensus.cc:2749] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373) with higher term. Message: Invalid argument: T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 6. Current term is 7.
I20260709 13:00:13.310804  1646 leader_election.cc:304] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:13.321923  1598 raft_consensus.cc:2393] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 7: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:00:13.163527  4869 consensus_queue.cc:1048] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.139s
I20260709 13:00:13.233462  2219 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4ea41c88222b469fb11229faef735050"
dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
mode: GRACEFUL
new_leader_uuid: "39a92f5a4352465d8af3af5908fe8642"
 from {username='slave'} at 127.0.0.1:47682
I20260709 13:00:13.338405  2219 raft_consensus.cc:606] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Received request to transfer leadership to TS 39a92f5a4352465d8af3af5908fe8642
I20260709 13:00:13.338884  2219 raft_consensus.cc:614] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:00:13.300367  4815 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.732s	user 0.012s	sys 0.008s
I20260709 13:00:13.334522  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:13.289498  4839 raft_consensus.cc:3060] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:13.161418  4269 raft_consensus.cc:515] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:13.301496  4402 consensus_meta.cc:287] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 1.086s	user 0.018s	sys 0.012s
I20260709 13:00:13.361842  4752 consensus_queue.cc:260] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:13.471835  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
W20260709 13:00:13.383104  1496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:13.503211  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:13.460419  4886 raft_consensus.cc:2804] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:13.520207  4867 raft_consensus.cc:2749] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:00:13.462634  4871 log.cc:927] Time spent T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
I20260709 13:00:13.460698  4861 raft_consensus.cc:2804] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:13.461877  4862 raft_consensus.cc:493] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:13.639564  4898 log.cc:927] Time spent T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.168s	user 0.000s	sys 0.005s
I20260709 13:00:13.460973  4884 raft_consensus.cc:2749] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:00:13.554392  4901 log.cc:927] Time spent T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
I20260709 13:00:13.508370  4859 leader_election.cc:290] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:00:13.585264  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 302458us
W20260709 13:00:13.646379  4872 consensus_meta.cc:287] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.786s	user 0.009s	sys 0.015s
I20260709 13:00:13.460822  4891 consensus_queue.cc:1048] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.365s
I20260709 13:00:13.521417  4692 consensus_queue.cc:237] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:13.634313  1495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:13.416893  4848 raft_consensus.cc:2749] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:13.465097  4840 raft_consensus.cc:493] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.336858  4282 raft_consensus.cc:2749] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:13.446988  4834 raft_consensus.cc:2749] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:13.643057  1530 raft_consensus.cc:2468] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 6.
I20260709 13:00:13.643607  1677 raft_consensus.cc:1240] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
W20260709 13:00:13.644253  1496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:13.644444  1603 raft_consensus.cc:2393] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 8: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
W20260709 13:00:13.359603  4585 consensus_meta.cc:287] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b: Time spent flushing consensus metadata: real 0.878s	user 0.008s	sys 0.004s
I20260709 13:00:13.650224  4752 raft_consensus.cc:3060] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:13.656219  1601 raft_consensus.cc:2468] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 9.
I20260709 13:00:13.652712  4861 raft_consensus.cc:493] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:13.652915  4678 consensus_meta.cc:287] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 1.176s	user 0.012s	sys 0.000s
W20260709 13:00:13.543661  4880 log.cc:927] Time spent T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.221s	user 0.000s	sys 0.000s
I20260709 13:00:13.541285  4892 consensus_queue.cc:1048] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.181s
I20260709 13:00:13.671868  1570 leader_election.cc:304] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:00:13.652870  4327 consensus_meta.cc:287] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b: Time spent flushing consensus metadata: real 0.525s	user 0.006s	sys 0.003s
W20260709 13:00:13.668040  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 336804us
I20260709 13:00:13.648178  4795 raft_consensus.cc:2749] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303) with higher term. Message: Invalid argument: T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 5. Current term is 6.
W20260709 13:00:13.682543  2190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:13.359196  4850 consensus_queue.cc:1059] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.315s
I20260709 13:00:13.361021  4402 raft_consensus.cc:515] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:13.350282  4888 consensus_queue.cc:260] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:00:13.693421  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 363980us
I20260709 13:00:13.699595  2219 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "822e65124bb44159b257fd219d28d93c"
dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
mode: GRACEFUL
new_leader_uuid: "39a92f5a4352465d8af3af5908fe8642"
 from {username='slave'} at 127.0.0.1:47682
I20260709 13:00:13.773448  2219 raft_consensus.cc:606] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Received request to transfer leadership to TS 39a92f5a4352465d8af3af5908fe8642
I20260709 13:00:13.773810  2219 raft_consensus.cc:614] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:13.714612  4861 raft_consensus.cc:3060] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:13.759899  4902 log.cc:927] Time spent T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
W20260709 13:00:13.766382  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 94604us
I20260709 13:00:13.768415  4887 raft_consensus.cc:2749] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:00:13.776711  4900 log.cc:927] Time spent T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
I20260709 13:00:13.777483  4863 raft_consensus.cc:493] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:13.778004  4852 raft_consensus.cc:493] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.779789  1646 leader_election.cc:304] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:13.782605  1570 leader_election.cc:304] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:13.697937  4867 raft_consensus.cc:493] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.801302  1570 leader_election.cc:304] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:13.771895  4815 raft_consensus.cc:493] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.812857  1680 raft_consensus.cc:1240] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:13.828514  1678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49170 (request call id 1896) took 1132 ms. Trace:
I20260709 13:00:13.669368  4862 raft_consensus.cc:515] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:13.825371  4847 consensus_queue.cc:1048] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 13:00:13.801123  4269 leader_election.cc:290] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:13.828972  1678 rpcz_store.cc:276] 0709 13:00:12.696347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:12.696828 (+   481us) service_pool.cc:224] Handling call
0709 13:00:12.697184 (+   356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:12.792645 (+ 95461us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:12.792687 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:12.803849 (+ 11162us) log.cc:844] Serialized 26 byte log entry
0709 13:00:13.054864 (+251015us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:13.054907 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:13.054977 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:13.828284 (+773307us) raft_consensus.cc:1685] finished
0709 13:00:13.828306 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:13.828450 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3428,"raft.queue_time_us":81203,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":4133,"thread_start_us":308437,"threads_started":2,"wal-append.queue_time_us":829201}
I20260709 13:00:13.801162  4868 leader_election.cc:290] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:00:13.840934  1571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:13.886274  2223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50326 (request call id 744) took 1874 ms. Trace:
I20260709 13:00:13.887681  2226 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28"
dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
mode: GRACEFUL
new_leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:47682
W20260709 13:00:13.902931  1571 leader_election.cc:336] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217): Timed out: RequestConsensusVote RPC to 127.0.107.195:44217 timed out after 2.040s (SENT)
I20260709 13:00:13.903216  2226 raft_consensus.cc:606] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 6 LEADER]: Received request to transfer leadership to TS e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:00:13.888049  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 86820.7us
I20260709 13:00:13.694360  4840 raft_consensus.cc:515] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:13.883693  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:13.801354  4878 leader_election.cc:290] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:13.902714  2223 rpcz_store.cc:276] 0709 13:00:12.011808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:12.011934 (+   126us) service_pool.cc:224] Handling call
0709 13:00:12.012264 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:12.602444 (+590180us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:13.885971 (+1283527us) spinlock_profiling.cc:243] Waited 542 ms on lock 0x7b540054e2d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:00:13.886207 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1246165888}
I20260709 13:00:13.906595  4872 raft_consensus.cc:2749] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:00:13.907094  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:13.905498  1570 leader_election.cc:304] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:00:13.960356  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 54928.6us
I20260709 13:00:13.820292  4865 leader_election.cc:290] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:13.887244  4888 raft_consensus.cc:3060] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:13.974939  1570 leader_election.cc:304] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:13.712533  4585 raft_consensus.cc:515] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:13.980269  4910 consensus_queue.cc:1048] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
W20260709 13:00:13.916989  4897 log.cc:927] Time spent T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.421s	user 0.003s	sys 0.006s
I20260709 13:00:13.893620  4887 raft_consensus.cc:2749] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:13.983752  1570 leader_election.cc:400] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: Vote denied by peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931) with higher term. Message: Invalid argument: T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 7. Current term is 8.
I20260709 13:00:13.901402  4795 raft_consensus.cc:493] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.832906  4724 leader_election.cc:290] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:13.991453  4893 raft_consensus.cc:2749] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:13.916584  4269 consensus_queue.cc:1048] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.067s
I20260709 13:00:13.978456  4892 raft_consensus.cc:3060] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:13.999339  1570 leader_election.cc:403] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:00:13.999910  4854 consensus_meta.cc:287] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.871s	user 0.008s	sys 0.008s
W20260709 13:00:13.987705  4688 consensus_meta.cc:287] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b: Time spent flushing consensus metadata: real 0.952s	user 0.010s	sys 0.000s
I20260709 13:00:13.837814  4815 raft_consensus.cc:515] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:14.002615  4745 consensus_meta.cc:287] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.914s	user 0.010s	sys 0.006s
I20260709 13:00:13.919238  4884 consensus_queue.cc:1048] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.093s
W20260709 13:00:14.007170  4804 consensus_meta.cc:287] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 1.130s	user 0.011s	sys 0.007s
I20260709 13:00:13.804382  4852 raft_consensus.cc:515] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:13.803881  4863 raft_consensus.cc:515] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:14.075637  4851 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.714s	user 0.056s	sys 0.117s
W20260709 13:00:13.994721  1647 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.016s	sys 0.072s
I20260709 13:00:13.986464  4882 raft_consensus.cc:2749] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:00:14.012915  1497 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.663s	user 0.044s	sys 0.035s
W20260709 13:00:14.060009  1674 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.711s	user 0.045s	sys 0.056s
I20260709 13:00:14.015038  2226 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004"
dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
mode: GRACEFUL
new_leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:47682
I20260709 13:00:14.077354  2220 raft_consensus.cc:2393] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 8: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
W20260709 13:00:14.183276  1674 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.835s	user 0.045s	sys 0.056s
I20260709 13:00:14.183468  2226 raft_consensus.cc:606] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Received request to transfer leadership to TS e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:14.183912  2226 raft_consensus.cc:614] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:00:14.079257  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 95643.5us
I20260709 13:00:14.001672  4868 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.186774  4868 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 13:00:14.188159  4815 leader_election.cc:290] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:14.189237  4868 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:13.981333  4874 consensus_queue.cc:1048] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.385s
W20260709 13:00:14.004822  4802 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.859s	user 0.021s	sys 0.056s
W20260709 13:00:14.190618  4802 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.065s	user 0.021s	sys 0.056s
W20260709 13:00:14.169826  4796 consensus_meta.cc:287] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent flushing consensus metadata: real 1.026s	user 0.008s	sys 0.004s
I20260709 13:00:14.171434  4869 raft_consensus.cc:493] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.192874  4869 raft_consensus.cc:515] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:14.008087  4850 raft_consensus.cc:493] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.898407  4867 raft_consensus.cc:515] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:14.183486  1497 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.833s	user 0.045s	sys 0.035s
I20260709 13:00:14.184840  1570 leader_election.cc:304] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:00:14.182976  1647 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.712s	user 0.016s	sys 0.072s
W20260709 13:00:14.208516  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:14.210618  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
W20260709 13:00:14.211470  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 911525us
I20260709 13:00:14.083920  4887 raft_consensus.cc:2749] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931) with higher term. Message: Invalid argument: T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 7. Current term is 8.
W20260709 13:00:14.166285  4894 log.cc:927] Time spent T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
I20260709 13:00:14.212230  1497 leader_election.cc:304] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
W20260709 13:00:14.278215  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 66072.4us
I20260709 13:00:14.280025  1497 leader_election.cc:304] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
W20260709 13:00:14.195448  4851 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.840s	user 0.056s	sys 0.117s
W20260709 13:00:14.238878  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 54122.7us
I20260709 13:00:14.013900  4795 raft_consensus.cc:515] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:14.281136  4909 raft_consensus.cc:2749] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:14.084246  4854 raft_consensus.cc:515] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:14.214445  4885 raft_consensus.cc:493] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:14.293340  4892 raft_consensus.cc:2749] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:14.284107  1570 leader_election.cc:304] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:14.288297  1497 leader_election.cc:304] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:14.300846  2226 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583"
dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
mode: GRACEFUL
new_leader_uuid: "39a92f5a4352465d8af3af5908fe8642"
 from {username='slave'} at 127.0.0.1:47682
I20260709 13:00:14.301467  2226 raft_consensus.cc:606] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 9 LEADER]: Received request to transfer leadership to TS 39a92f5a4352465d8af3af5908fe8642
I20260709 13:00:14.303848  1570 leader_election.cc:304] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:00:14.307844  2192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:14.309514  1570 leader_election.cc:304] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:14.310688  1497 leader_election.cc:304] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:14.299806  4885 raft_consensus.cc:515] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:14.278347  4802 raft_consensus.cc:493] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:14.312294  1497 leader_election.cc:304] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:14.317817  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:14.318475  1603 raft_consensus.cc:3060] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:14.321344  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:14.322731  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:14.293614  4796 raft_consensus.cc:2749] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:14.294451  4402 leader_election.cc:290] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:14.315258  4724 raft_consensus.cc:2749] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:14.293514  4868 raft_consensus.cc:2749] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:14.326406  1602 raft_consensus.cc:1240] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 9 LEADER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:14.085232  4717 consensus_queue.cc:260] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:00:14.329209  1599 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.983s	user 0.018s	sys 0.027s
I20260709 13:00:14.228817  4850 raft_consensus.cc:515] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:14.312731  4892 raft_consensus.cc:2804] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:00:14.341622  1599 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.996s	user 0.018s	sys 0.027s
I20260709 13:00:14.341427  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:14.312191  4887 raft_consensus.cc:3060] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:14.344118  1603 raft_consensus.cc:2468] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 8.
I20260709 13:00:14.328089  4802 raft_consensus.cc:515] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:14.326886  4851 raft_consensus.cc:2749] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:00:14.351768  1496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:14.351953  4802 leader_election.cc:290] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:00:14.345009  4908 log.cc:927] Time spent T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:00:14.345357  1675 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fbb85f388454464192e052f706a78e65"
dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
mode: GRACEFUL
new_leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:33616
I20260709 13:00:14.346513  1607 raft_consensus.cc:2393] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 6: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:00:14.328678  4286 raft_consensus.cc:493] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:14.349202  1599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36200 (request call id 2080) took 1335 ms. Trace:
I20260709 13:00:14.292963  4863 leader_election.cc:290] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:14.354570  1599 rpcz_store.cc:276] 0709 13:00:13.013759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.013880 (+   121us) service_pool.cc:224] Handling call
0709 13:00:13.014307 (+   427us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:13.014508 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:00:13.345459 (+330951us) log.cc:844] Serialized 14 byte log entry
0709 13:00:14.348617 (+1003158us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:14.348670 (+    53us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:14.348967 (+   297us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:14.349035 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:14.349149 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44868,"prepare.queue_time_us":631340,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":61,"raft.queue_time_us":97,"thread_start_us":1288340,"threads_started":2}
I20260709 13:00:14.356740  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:14.343845  4796 raft_consensus.cc:2749] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:14.345890  4892 raft_consensus.cc:493] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:14.346091  4724 raft_consensus.cc:2749] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:14.357584  1607 raft_consensus.cc:2410] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:00:14.358861  1602 raft_consensus.cc:1275] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:00:14.360276  1496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:14.348456  4717 raft_consensus.cc:3060] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:14.361227  4892 raft_consensus.cc:3060] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:14.369764  1598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36200 (request call id 2077) took 1405 ms. Trace:
I20260709 13:00:14.378677  1598 rpcz_store.cc:276] 0709 13:00:12.964845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:12.964983 (+   138us) service_pool.cc:224] Handling call
0709 13:00:14.369514 (+1404531us) spinlock_profiling.cc:243] Waited 312 ms on lock 0x7b54002675d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:14.369694 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":716817664}
I20260709 13:00:14.374835  1600 raft_consensus.cc:1240] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:14.377009  1526 raft_consensus.cc:1275] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:00:14.382388  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:14.342800  4910 raft_consensus.cc:1064] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642: attempting to promote NON_VOTER b96ce9cc496c49d7818fa983a17b062b to VOTER
W20260709 13:00:14.385573  1645 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.761s	user 0.089s	sys 0.123s
W20260709 13:00:14.386554  1645 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.762s	user 0.089s	sys 0.123s
I20260709 13:00:14.357791  4585 leader_election.cc:290] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 8 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:00:14.392223  2190 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.760s (SENT) [suppressed 45 similar messages]
I20260709 13:00:14.362430  4840 leader_election.cc:290] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:14.408299  1526 raft_consensus.cc:2468] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 7.
I20260709 13:00:14.409641  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:14.410199  1603 raft_consensus.cc:1275] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:00:14.410821  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:14.411545  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:14.414415  2192 leader_election.cc:304] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:14.421371  2192 leader_election.cc:304] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:14.422827  2192 leader_election.cc:304] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:14.423875  2192 leader_election.cc:304] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:14.420210  1604 raft_consensus.cc:2468] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 5.
I20260709 13:00:14.434947  1607 raft_consensus.cc:1275] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:00:14.436990  2192 leader_election.cc:304] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:00:14.438524  1604 raft_consensus.cc:1240] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 8. Current term is 9. Ops: []
W20260709 13:00:14.439348  2227 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.622s	user 0.021s	sys 0.049s
W20260709 13:00:14.439741  2227 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.021s	sys 0.049s
I20260709 13:00:14.357156  4286 raft_consensus.cc:515] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:14.448297  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:14.473219  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:14.474033  1678 raft_consensus.cc:2368] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 8. Current term is 9.
I20260709 13:00:14.475123  1598 raft_consensus.cc:1275] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:00:14.417392  4802 raft_consensus.cc:493] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:14.417919  4909 raft_consensus.cc:493] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:14.476854  1571 leader_election.cc:400] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 election: Vote denied by peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217) with higher term. Message: Invalid argument: T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 8. Current term is 9.
W20260709 13:00:14.442026  4889 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.032s	sys 0.044s
W20260709 13:00:14.453748  4886 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.801s	user 0.015s	sys 0.025s
I20260709 13:00:14.448262  4884 raft_consensus.cc:493] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.443176  4840 raft_consensus.cc:493] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:14.431730  4863 raft_consensus.cc:2749] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:14.439776  4851 raft_consensus.cc:493] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.505554  1571 leader_election.cc:403] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:00:14.479766  4874 raft_consensus.cc:493] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:14.523949  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 48448.3us
I20260709 13:00:14.434394  4688 raft_consensus.cc:2749] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:00:14.483269  4861 consensus_meta.cc:287] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.691s	user 0.001s	sys 0.008s
W20260709 13:00:14.499369  4839 consensus_meta.cc:287] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 1.146s	user 0.007s	sys 0.005s
I20260709 13:00:14.471946  4882 raft_consensus.cc:493] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.477636  4865 raft_consensus.cc:2804] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:14.439828  4585 raft_consensus.cc:2804] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:00:14.512754  4896 log.cc:927] Time spent T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.215s	user 0.000s	sys 0.001s
W20260709 13:00:14.502099  4752 consensus_meta.cc:287] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.787s	user 0.009s	sys 0.001s
I20260709 13:00:14.476776  4917 raft_consensus.cc:493] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:14.519357  1679 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49170 (request call id 1891) took 2459 ms (client timeout 2040 ms). Trace:
I20260709 13:00:14.479503  4914 raft_consensus.cc:493] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.441409  4505 consensus_queue.cc:1048] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.064s
W20260709 13:00:14.511399  4886 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.859s	user 0.015s	sys 0.026s
I20260709 13:00:14.535934  4839 raft_consensus.cc:2749] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:00:14.510996  4889 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.677s	user 0.034s	sys 0.044s
I20260709 13:00:14.516247  4867 leader_election.cc:290] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:14.510922  4795 leader_election.cc:290] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:00:14.541471  1676 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.751s	user 0.005s	sys 0.009s
I20260709 13:00:14.520874  4918 raft_consensus.cc:493] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:14.546748  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:14.525990  4854 leader_election.cc:290] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:00:14.565373  1676 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.775s	user 0.005s	sys 0.009s
W20260709 13:00:14.547652  1679 rpcz_store.cc:269] 0709 13:00:12.058746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:12.061247 (+  2501us) service_pool.cc:224] Handling call
0709 13:00:14.507955 (+2446708us) spinlock_profiling.cc:243] Waited 973 ms on lock 0x7b54002e6b54. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:14.508112 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2237195520}
I20260709 13:00:14.524813  4840 raft_consensus.cc:515] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:14.505203  4802 raft_consensus.cc:515] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:14.564495  4886 raft_consensus.cc:697] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 8 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:14.527758  4857 raft_consensus.cc:2749] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217) with higher term. Message: Invalid argument: T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 8. Current term is 9.
I20260709 13:00:14.521660  4884 raft_consensus.cc:515] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:14.442799  4786 consensus_queue.cc:1048] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.072s
I20260709 13:00:14.512334  4909 raft_consensus.cc:515] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:14.581418  2219 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.001s	sys 0.014s
W20260709 13:00:14.587919  4820 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.795s	user 0.035s	sys 0.023s
W20260709 13:00:14.588488  4820 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.804s	user 0.036s	sys 0.023s
I20260709 13:00:14.588969  1675 raft_consensus.cc:606] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 7 LEADER]: Received request to transfer leadership to TS e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:14.528574  4851 raft_consensus.cc:515] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:14.535789  4865 raft_consensus.cc:493] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:14.589932  4865 raft_consensus.cc:3060] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:14.591288  4851 leader_election.cc:290] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:14.547842  4852 leader_election.cc:290] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:14.559445  4585 raft_consensus.cc:697] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 8 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
W20260709 13:00:14.581861  2219 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.001s	sys 0.014s
I20260709 13:00:14.530556  4861 raft_consensus.cc:515] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:14.595638  4585 consensus_queue.cc:237] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:14.596889  4861 leader_election.cc:290] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:14.564152  4286 leader_election.cc:290] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:00:14.598908  1646 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.788s	user 0.010s	sys 0.010s
W20260709 13:00:14.599978  1646 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.789s	user 0.010s	sys 0.010s
I20260709 13:00:14.548234  4402 raft_consensus.cc:493] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
W20260709 13:00:14.601694  2222 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.938s	user 0.006s	sys 0.014s
W20260709 13:00:14.602097  2222 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.948s	user 0.006s	sys 0.014s
I20260709 13:00:14.568286  4881 raft_consensus.cc:493] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:00:14.539031  4882 raft_consensus.cc:515] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:14.530056  4874 raft_consensus.cc:515] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:14.611923  1606 raft_consensus.cc:2468] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 6.
W20260709 13:00:14.581847  4916 log.cc:927] Time spent T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
W20260709 13:00:14.614490  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 222302us
W20260709 13:00:14.620441  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 140461us
W20260709 13:00:14.612978  4692 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.726s	user 0.009s	sys 0.014s
I20260709 13:00:14.606319  4885 leader_election.cc:290] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:14.626288  1646 leader_election.cc:304] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
W20260709 13:00:14.623828  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 311631us
I20260709 13:00:14.552603  4917 raft_consensus.cc:515] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:14.635425  1497 leader_election.cc:304] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:14.637457  1497 leader_election.cc:304] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:14.642699  1497 leader_election.cc:304] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:14.664875  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:14.617057  4850 leader_election.cc:290] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:14.616015  4286 raft_consensus.cc:493] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:14.564347  4914 raft_consensus.cc:515] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:14.665998  1497 leader_election.cc:400] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303) with higher term. Message: Invalid argument: T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 6. Current term is 7.
I20260709 13:00:14.610924  4402 raft_consensus.cc:515] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:14.571609  4918 raft_consensus.cc:515] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:14.630581  4692 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.741s	user 0.010s	sys 0.015s
I20260709 13:00:14.675115  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 13:00:14.675300  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:14.646488  4815 raft_consensus.cc:2749] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:00:14.682297  4915 log.cc:927] Time spent T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.200s	user 0.001s	sys 0.000s
I20260709 13:00:14.645076  4883 consensus_queue.cc:1048] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.182s
I20260709 13:00:14.675941  4802 leader_election.cc:290] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:14.690404  4928 raft_consensus.cc:493] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:14.707684  4874 leader_election.cc:290] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:14.673393  1497 leader_election.cc:304] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:14.679674  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:14.571391  4886 consensus_queue.cc:237] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:14.696071  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49178 (request call id 1785) took 1684 ms. Trace:
I20260709 13:00:14.678138  4286 raft_consensus.cc:515] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:14.663611  4796 raft_consensus.cc:2749] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:14.644687  4795 raft_consensus.cc:2749] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:14.611464  4881 raft_consensus.cc:515] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:14.665712  4867 raft_consensus.cc:2749] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:14.709522  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:14.717236  1497 leader_election.cc:400] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 election: Vote denied by peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303) with higher term. Message: Invalid argument: T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 8. Current term is 9.
W20260709 13:00:14.699487  4919 log.cc:927] Time spent T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 13:00:14.714538  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:14.669958  4724 consensus_queue.cc:1048] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:00:14.707919  4928 raft_consensus.cc:515] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:14.816502  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:14.818105  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:14.829694  2227 raft_consensus.cc:2468] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 9.
I20260709 13:00:14.697182  4840 leader_election.cc:290] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:00:14.786104  1570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:14.775481  4692 raft_consensus.cc:493] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:14.713943  1676 rpcz_store.cc:276] 0709 13:00:13.011685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.011849 (+   164us) service_pool.cc:224] Handling call
0709 13:00:13.012194 (+   345us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:13.039022 (+ 26828us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:13.039054 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:13.039506 (+   452us) log.cc:844] Serialized 26 byte log entry
0709 13:00:13.790375 (+750869us) spinlock_profiling.cc:243] Waited 4.38 ms on lock 0x7b18000e5480. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1e38ede1 00007f6a1e39b5b1 00007f6a154a8e07 00007f6a1e303ab9 00007f6a154c569b 00007f6a154c393f 00007f6a154c5c02 00007f6a1814d20b 00007f6a18152d23 00007f6a181530d1 00007f6a1856ea0f
0709 13:00:14.568098 (+777723us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:14.568146 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:14.568408 (+   262us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:14.695771 (+127363us) raft_consensus.cc:1685] finished
0709 13:00:14.695790 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:14.696009 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":186624,"raft.queue_time_us":48818,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":40741,"spinlock_wait_cycles":10067840,"thread_start_us":777520,"threads_started":1,"wal-append.queue_time_us":1555230}
I20260709 13:00:14.836119  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:14.837110  4286 leader_election.cc:290] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:14.678732  4885 raft_consensus.cc:2804] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:14.831629  4928 leader_election.cc:290] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
W20260709 13:00:14.828112  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 115453us
W20260709 13:00:14.833006  1570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:14.833462  4926 log.cc:927] Time spent T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.116s	user 0.000s	sys 0.003s
W20260709 13:00:14.790875  2192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:14.713723  4850 raft_consensus.cc:2749] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:14.844460  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 13:00:14.845745  4924 log.cc:927] Time spent T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 13:00:14.838709  4692 raft_consensus.cc:515] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:14.846719  1497 leader_election.cc:304] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:14.714351  4854 raft_consensus.cc:493] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:14.850553  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:14.854147  2227 raft_consensus.cc:2468] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 6.
I20260709 13:00:14.840502  2221 raft_consensus.cc:3060] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:14.698542  4402 leader_election.cc:290] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:14.698698  4865 raft_consensus.cc:515] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:14.714031  4923 raft_consensus.cc:493] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.694527  4917 leader_election.cc:290] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:14.856873  1674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49170 (request call id 1902) took 1509 ms. Trace:
W20260709 13:00:14.857164  4931 log.cc:927] Time spent T 00000000000000000000000000000000 P 9f38d0e5c9db43a48554defe1153354e: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 13:00:14.857492  1497 leader_election.cc:304] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:14.857064  4286 raft_consensus.cc:493] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.705427  4918 leader_election.cc:290] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:14.864329  1497 leader_election.cc:304] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:14.862210  1674 rpcz_store.cc:276] 0709 13:00:13.347629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.347781 (+   152us) service_pool.cc:224] Handling call
0709 13:00:13.348118 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:14.183825 (+835707us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:14.183854 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:14.184308 (+   454us) log.cc:844] Serialized 26 byte log entry
0709 13:00:14.572856 (+388548us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:00:14.572906 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:14.572986 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:14.830177 (+257191us) spinlock_profiling.cc:243] Waited 53.5 ms on lock 0x7b4400022b4c. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a153ecc85 00007f6a153ed6a2 00007f6a1815f1db 00007f6a1815aaaf 00007f6a1814e86e 00007f6a1814dbb6 00007f6a1814d7d8 00007f6a18157221 00007f6a181571d9 00007f6a18157169
0709 13:00:14.856446 (+ 26269us) raft_consensus.cc:1685] finished
0709 13:00:14.856492 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:14.856790 (+   298us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":339195,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":6057,"spinlock_wait_cycles":123126656,"thread_start_us":1215931,"threads_started":2,"wal-append.queue_time_us":444414}
I20260709 13:00:14.856173  4795 raft_consensus.cc:2749] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:14.701195  4914 leader_election.cc:290] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:14.846105  4884 leader_election.cc:290] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:14.871524  4882 leader_election.cc:290] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:14.875042  2219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50326 (request call id 753) took 1059 ms. Trace:
I20260709 13:00:14.694805  4910 consensus_queue.cc:237] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 6, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:14.706393  4909 leader_election.cc:290] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:14.854830  4885 raft_consensus.cc:697] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 9 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:14.867107  4868 raft_consensus.cc:2749] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:14.867481  1497 leader_election.cc:400] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 election: Vote denied by peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303) with higher term. Message: Invalid argument: T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 9. Current term is 10.
W20260709 13:00:14.869297  2224 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 739) took 2996 ms (client timeout 2081 ms). Trace:
I20260709 13:00:14.864380  4850 raft_consensus.cc:2804] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:14.875499  2219 rpcz_store.cc:276] 0709 13:00:13.815829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.815963 (+   134us) service_pool.cc:224] Handling call
0709 13:00:13.816322 (+   359us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:13.818496 (+  2174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:13.818528 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:13.819146 (+   618us) log.cc:844] Serialized 52 byte log entry
0709 13:00:14.595382 (+776236us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:14.595420 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:14.595494 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:14.874799 (+279305us) raft_consensus.cc:1685] finished
0709 13:00:14.874823 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:14.874976 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1746,"raft.queue_time_us":2810,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":213,"thread_start_us":679811,"threads_started":1,"wal-append.queue_time_us":1018391}
I20260709 13:00:14.877121  2191 leader_election.cc:304] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:14.866271  4286 raft_consensus.cc:515] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:14.884065  2224 rpcz_store.cc:269] 0709 13:00:11.872982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.876030 (+  3048us) service_pool.cc:224] Handling call
0709 13:00:14.869109 (+2993079us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b5400621e54. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:14.869226 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2618784128}
I20260709 13:00:14.885505  1497 leader_election.cc:304] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:14.888043  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:14.867520  4867 consensus_queue.cc:1059] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 13:00:14.891148  4795 raft_consensus.cc:493] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.891698  4795 raft_consensus.cc:515] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:14.893739  4796 raft_consensus.cc:2749] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:14.894915  4867 consensus_queue.cc:1243] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Peer 39a92f5a4352465d8af3af5908fe8642 log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
W20260709 13:00:14.895298  4892 consensus_meta.cc:287] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.508s	user 0.007s	sys 0.002s
I20260709 13:00:14.898799  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:14.901175  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:14.894460  4796 raft_consensus.cc:493] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.903234  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:00:14.901638  1497 connection.cc:256] RPC call timeout handler was delayed by -1.4642181669999559s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2081s for a response
I20260709 13:00:14.901980  1605 raft_consensus.cc:2468] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 10.
I20260709 13:00:14.906265  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:14.906752  1605 raft_consensus.cc:1240] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 7. Current term is 8. Ops: [5.7-7.8]
I20260709 13:00:14.860899  4854 raft_consensus.cc:515] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:14.911105  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:14.913722  2218 raft_consensus.cc:2393] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 8: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:00:14.911490  1605 raft_consensus.cc:1275] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:00:14.914336  1605 pending_rounds.cc:85] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642: Aborting all ops after (but not including) 6
I20260709 13:00:14.914729  1605 pending_rounds.cc:107] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:00:14.917851  1605 raft_consensus.cc:2889] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:14.919689  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:14.920444  2218 raft_consensus.cc:2468] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 6.
I20260709 13:00:14.922271  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:14.891198  4688 raft_consensus.cc:493] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.923523  1678 raft_consensus.cc:1275] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 7 index: 10. (index mismatch)
I20260709 13:00:14.936779  4795 leader_election.cc:290] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:14.862610  4923 raft_consensus.cc:515] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:00:14.926312  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:14.901439  4888 consensus_meta.cc:287] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.918s	user 0.007s	sys 0.004s
I20260709 13:00:14.925706  1676 raft_consensus.cc:1275] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:00:14.901212  3934 raft_consensus.cc:493] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.911677  4868 raft_consensus.cc:493] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.945909  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:14.895763  4892 raft_consensus.cc:515] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:14.916038  4933 raft_consensus.cc:2749] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:14.915547  4867 raft_consensus.cc:493] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.913106  4724 raft_consensus.cc:493] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.948011  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
W20260709 13:00:14.938879  4866 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.139s	user 0.010s	sys 0.040s
I20260709 13:00:14.954381  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:14.915084  4934 consensus_queue.cc:1048] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 13:00:14.959257  1676 raft_consensus.cc:3060] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:14.960150  1525 raft_consensus.cc:1240] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:14.960794  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:14.963366  1678 raft_consensus.cc:2468] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 10.
I20260709 13:00:14.964246  1602 raft_consensus.cc:1240] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:14.968197  1523 raft_consensus.cc:2468] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 7.
I20260709 13:00:14.949482  4795 raft_consensus.cc:493] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.921561  4796 raft_consensus.cc:515] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:14.971993  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:14.924109  4883 consensus_queue.cc:1048] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:00:14.981150  2221 raft_consensus.cc:2468] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 10.
W20260709 13:00:14.963873  4866 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.163s	user 0.011s	sys 0.040s
I20260709 13:00:14.955127  4621 raft_consensus.cc:3055] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:14.976326  1525 raft_consensus.cc:1240] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 5. Current term is 6. Ops: []
W20260709 13:00:14.979218  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 46950us
I20260709 13:00:14.982003  2227 raft_consensus.cc:1240] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:14.947345  4688 raft_consensus.cc:515] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:14.950765  3934 raft_consensus.cc:515] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:14.953300  4868 raft_consensus.cc:515] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:14.967114  4850 raft_consensus.cc:697] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:00:14.962224  4863 consensus_queue.cc:1048] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:00:14.996717  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:14.960791  4867 raft_consensus.cc:515] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:14.982468  4621 raft_consensus.cc:740] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:14.961880  4724 raft_consensus.cc:515] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:14.999963  1530 raft_consensus.cc:2468] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 6.
I20260709 13:00:14.970475  4786 consensus_queue.cc:1048] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 13:00:15.007287  1676 raft_consensus.cc:2468] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 8.
W20260709 13:00:14.995229  4887 consensus_meta.cc:287] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.645s	user 0.008s	sys 0.003s
I20260709 13:00:15.022220  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:15.023506  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:15.023939  4854 leader_election.cc:290] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:14.982525  4795 raft_consensus.cc:515] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:15.025830  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 13:00:15.029568  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 49235.1us
I20260709 13:00:14.974326  4885 consensus_queue.cc:237] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:15.031028  2191 leader_election.cc:304] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:00:15.032722  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:15.020860  4946 raft_consensus.cc:493] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:15.034407  1530 raft_consensus.cc:2410] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:00:15.035194  2191 leader_election.cc:304] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:00:15.020618  4692 leader_election.cc:290] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:15.027371  4887 raft_consensus.cc:2749] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:15.042599  4883 raft_consensus.cc:2804] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:15.043157  4883 raft_consensus.cc:493] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:15.043531  4883 raft_consensus.cc:3060] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:15.049078  4288 raft_consensus.cc:2804] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:15.049898  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49178 (request call id 1784) took 2428 ms. Trace:
I20260709 13:00:15.050261  1681 rpcz_store.cc:276] 0709 13:00:12.619195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:12.619424 (+   229us) service_pool.cc:224] Handling call
0709 13:00:12.638273 (+ 18849us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:12.717767 (+ 79494us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:15.046467 (+2328700us) spinlock_profiling.cc:243] Waited 78.8 ms on lock 0x7b5400350a54. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:00:15.047261 (+   794us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":181177600}
I20260709 13:00:15.049722  4288 raft_consensus.cc:697] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 8 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:15.061805  4688 leader_election.cc:290] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:15.063210  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 13:00:15.064517  4937 log.cc:927] Time spent T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.209s	user 0.001s	sys 0.000s
I20260709 13:00:15.041762  4850 consensus_queue.cc:237] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:00:15.068337  2220 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50326 (request call id 748) took 2048 ms (client timeout 1948 ms). Trace:
I20260709 13:00:15.039564  4946 raft_consensus.cc:515] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:15.071538  4795 leader_election.cc:290] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:15.073938  2190 leader_election.cc:304] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
W20260709 13:00:15.068775  2220 rpcz_store.cc:269] 0709 13:00:13.020270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.035410 (+ 15140us) service_pool.cc:224] Handling call
0709 13:00:15.068125 (+2032715us) spinlock_profiling.cc:243] Waited 803 ms on lock 0x7b540045c754. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:15.068271 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1847949568}
I20260709 13:00:15.073477  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:15.075256  1531 raft_consensus.cc:2468] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 9.
I20260709 13:00:15.075794  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:15.076110  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:15.076208  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:15.076390  1676 raft_consensus.cc:3060] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:15.076865  1678 raft_consensus.cc:2410] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:00:15.076967  1531 raft_consensus.cc:2393] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 8: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:00:15.077790  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:15.055529  4286 leader_election.cc:290] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:15.079582  1677 raft_consensus.cc:1240] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:15.082769  1676 raft_consensus.cc:2468] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 6.
I20260709 13:00:15.066461  4923 leader_election.cc:290] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:15.079739  2190 leader_election.cc:304] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:15.083827  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:15.084275  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:15.078186  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:15.085659  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:15.086419  1677 raft_consensus.cc:2410] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:00:15.087117  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:15.088063  4724 leader_election.cc:290] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:15.088832  4288 consensus_queue.cc:237] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:15.091521  4795 raft_consensus.cc:493] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:15.092031  4795 raft_consensus.cc:515] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:15.099936  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:15.103600  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:15.104596  1531 raft_consensus.cc:2393] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 6: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
W20260709 13:00:15.085543  4941 log.cc:927] Time spent T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 13:00:15.110256  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:15.112402  1677 raft_consensus.cc:2410] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 8 because replica has last-logged OpId of term: 6 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 8.
I20260709 13:00:15.083722  4688 consensus_queue.cc:1048] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:00:15.057102  4621 consensus_queue.cc:260] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:15.116258  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:15.219352  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:00:15.210942  1527 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49310 (request call id 667) took 2205 ms (client timeout 1760 ms). Trace:
I20260709 13:00:15.085651  4814 raft_consensus.cc:2804] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:00:15.354094  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 133493us
I20260709 13:00:15.148154  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:15.388334  1606 raft_consensus.cc:2410] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:00:15.094103  4795 leader_election.cc:290] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:00:15.357311  1527 rpcz_store.cc:269] 0709 13:00:13.005489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.006106 (+   617us) service_pool.cc:224] Handling call
0709 13:00:15.210701 (+2204595us) spinlock_profiling.cc:243] Waited 276 ms on lock 0x7b54002dafd4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:15.210863 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":634349952}
W20260709 13:00:15.322613  4873 log.cc:927] Time spent T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 2.196s	user 0.012s	sys 0.003s
I20260709 13:00:15.101814  4764 consensus_queue.cc:1048] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.305s
I20260709 13:00:15.478318  1598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 671) took 1070 ms. Trace:
I20260709 13:00:15.478744  1598 rpcz_store.cc:276] 0709 13:00:14.408301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.408792 (+   491us) service_pool.cc:224] Handling call
0709 13:00:14.474735 (+ 65943us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:14.475571 (+   836us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:15.478133 (+1002562us) spinlock_profiling.cc:243] Waited 33 ms on lock 0x7b54003b24d0. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b28ad 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:15.478261 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":75857152}
I20260709 13:00:15.479781  1672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50664 (request call id 681) took 2956 ms. Trace:
I20260709 13:00:15.480201  1672 rpcz_store.cc:276] 0709 13:00:12.522994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:12.523206 (+   212us) service_pool.cc:224] Handling call
0709 13:00:12.535049 (+ 11843us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:12.535344 (+   295us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:12.535371 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:12.554146 (+ 18775us) log.cc:844] Serialized 26 byte log entry
0709 13:00:12.762855 (+208709us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:12.762894 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:12.762958 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:15.321883 (+2558925us) spinlock_profiling.cc:243] Waited 19.5 ms on lock 0x7b4400022b4c. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a153ecc85 00007f6a153ed6a2 00007f6a1815f1db 00007f6a1815aaaf 00007f6a1814e86e 00007f6a1814dbb6 00007f6a1814d7d8 00007f6a18157221 00007f6a181571d9 00007f6a18157169
0709 13:00:15.479493 (+157610us) raft_consensus.cc:1685] finished
0709 13:00:15.479515 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:15.479723 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":69533,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":2218,"spinlock_wait_cycles":44941056,"thread_start_us":148318,"threads_started":1,"wal-append.queue_time_us":404422}
I20260709 13:00:15.102622  4286 consensus_queue.cc:1048] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.305s
I20260709 13:00:15.093945  4946 leader_election.cc:290] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:15.102391  4951 raft_consensus.cc:2749] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:15.481792  4286 consensus_queue.cc:1243] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 log is divergent from this leader: its last log entry 8.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:00:15.114936  4505 consensus_queue.cc:1048] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.309s
I20260709 13:00:15.409430  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:15.484751  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:15.485831  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:15.408529  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:15.406395  2192 leader_election.cc:304] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:15.488240  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:15.210606  4911 raft_consensus.cc:493] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:15.489176  1527 raft_consensus.cc:2410] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
W20260709 13:00:15.489630  4942 log.cc:927] Time spent T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.556s	user 0.002s	sys 0.000s
I20260709 13:00:15.489430  4911 raft_consensus.cc:515] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:15.490060  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
W20260709 13:00:15.301832  4922 log.cc:927] Time spent T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 13:00:15.490370  4505 raft_consensus.cc:2804] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:15.490877  4505 raft_consensus.cc:493] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:15.490980  4867 leader_election.cc:290] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:00:15.219000  4927 log.cc:927] Time spent T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.363s	user 0.003s	sys 0.000s
I20260709 13:00:15.390357  2219 raft_consensus.cc:1240] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 8 LEADER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:15.434226  4958 consensus_queue.cc:1059] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:15.436695  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36200 (request call id 2083) took 2393 ms. Trace:
W20260709 13:00:15.411233  4952 log.cc:927] Time spent T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.325s	user 0.000s	sys 0.001s
I20260709 13:00:15.390260  4814 raft_consensus.cc:493] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:15.237798  4724 raft_consensus.cc:493] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:15.197351  4883 raft_consensus.cc:515] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:15.449141  1496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:15.450135  4881 leader_election.cc:290] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:15.453459  4862 leader_election.cc:290] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:15.455591  1675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:33616 (request call id 23) took 1114 ms. Trace:
I20260709 13:00:15.456423  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:15.507522  1532 raft_consensus.cc:2468] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 9.
I20260709 13:00:15.458191  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:15.508586  1529 raft_consensus.cc:2468] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 7.
I20260709 13:00:15.509501  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:15.510103  1529 raft_consensus.cc:2468] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 10.
I20260709 13:00:15.461903  4865 leader_election.cc:290] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
W20260709 13:00:15.464159  4935 log.cc:927] Time spent T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.606s	user 0.001s	sys 0.002s
I20260709 13:00:15.464738  4869 leader_election.cc:290] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:00:15.467782  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:15.471203  1680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49170 (request call id 1894) took 3411 ms. Trace:
I20260709 13:00:15.474790  4842 raft_consensus.cc:3055] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:15.216596  4834 raft_consensus.cc:3055] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:15.491293  4505 raft_consensus.cc:3060] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:15.488039  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 81726.7us
I20260709 13:00:15.496945  4814 raft_consensus.cc:3060] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:15.496629  1496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:15.533121  1496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:15.492431  1601 rpcz_store.cc:276] 0709 13:00:13.043241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.043380 (+   139us) service_pool.cc:224] Handling call
0709 13:00:15.436419 (+2393039us) spinlock_profiling.cc:243] Waited 265 ms on lock 0x7b54001694d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:15.436589 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":610000640}
I20260709 13:00:15.535822  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:15.502431  1527 raft_consensus.cc:2468] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 8.
I20260709 13:00:15.539512  1527 raft_consensus.cc:1275] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:00:15.540730  1527 raft_consensus.cc:1240] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:00:15.506619  1675 rpcz_store.cc:276] 0709 13:00:14.344838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.345203 (+   365us) service_pool.cc:224] Handling call
0709 13:00:15.455392 (+1110189us) spinlock_profiling.cc:243] Waited 236 ms on lock 0x7b540031ced4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185ad853 00007f6a1d57b60a 00007f6a16b017d4 00007f6a16b01762 00007f6a16b01691 00007f6a16b0160c 00007f6a16b008c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:15.455486 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":543160192}
I20260709 13:00:15.515980  1680 rpcz_store.cc:276] 0709 13:00:12.059650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:12.060779 (+  1129us) service_pool.cc:224] Handling call
0709 13:00:12.061058 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:13.827164 (+1766106us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:15.470988 (+1643824us) spinlock_profiling.cc:243] Waited 1.75 s on lock 0x7b540024d954. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:00:15.471145 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4028642688}
I20260709 13:00:15.486524  1531 raft_consensus.cc:2393] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 6: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:00:15.521370  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49310 (request call id 676) took 1140 ms. Trace:
I20260709 13:00:15.544731  1526 rpcz_store.cc:276] 0709 13:00:14.380993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.382115 (+  1122us) service_pool.cc:224] Handling call
0709 13:00:15.521187 (+1139072us) spinlock_profiling.cc:243] Waited 25 ms on lock 0x7b54000505d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:15.521315 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":57586048}
I20260709 13:00:15.522974  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:15.548455  1532 raft_consensus.cc:2468] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 9.
I20260709 13:00:15.492506  4892 leader_election.cc:290] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:15.552635  4883 leader_election.cc:290] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:15.554750  1496 leader_election.cc:304] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:15.558938  1532 raft_consensus.cc:1275] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:00:15.518877  4842 raft_consensus.cc:740] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:15.520670  4834 raft_consensus.cc:740] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:00:15.568396  1532 raft_consensus.cc:1275] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:00:15.505306  4724 raft_consensus.cc:515] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:15.565727  2222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50310 (request call id 666) took 2573 ms. Trace:
I20260709 13:00:15.570374  2222 rpcz_store.cc:276] 0709 13:00:12.989753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.004353 (+ 14600us) service_pool.cc:224] Handling call
0709 13:00:13.044397 (+ 40044us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:13.353518 (+309121us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:13.353548 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:13.414789 (+ 61241us) log.cc:844] Serialized 26 byte log entry
0709 13:00:14.604399 (+1189610us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:14.604446 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:15.218363 (+613917us) spinlock_profiling.cc:243] Waited 6.27 ms on lock 0x7b4400022b4c. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a153ecc85 00007f6a153ed6a2 00007f6a1815f1db 00007f6a1815aaaf 00007f6a1814e86e 00007f6a1814dbb6 00007f6a1814d7d8 00007f6a18157221 00007f6a181571d9 00007f6a18157169
0709 13:00:15.473781 (+255418us) spinlock_profiling.cc:243] Waited 309 ms on lock 0x7b5400594054. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:00:15.473844 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:15.562465 (+ 88621us) raft_consensus.cc:1685] finished
0709 13:00:15.562489 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:15.562619 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":123,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":58433,"spinlock_wait_cycles":724461824,"thread_start_us":950504,"threads_started":1,"wal-append.queue_time_us":1408476}
I20260709 13:00:15.557818  4867 raft_consensus.cc:493] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:15.576527  1532 raft_consensus.cc:1240] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:15.581710  4710 leader_election.cc:290] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:15.584534  4814 raft_consensus.cc:515] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:15.585314  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:15.587317  1675 raft_consensus.cc:1240] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 8 LEADER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:15.588027  3934 leader_election.cc:290] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:15.588675  4814 leader_election.cc:290] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 8 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:15.588560  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:15.590282  4286 raft_consensus.cc:3055] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:15.590613  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:15.590317  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:15.562951  4878 consensus_queue.cc:1059] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 13:00:15.590754  4286 raft_consensus.cc:740] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:15.591799  4867 raft_consensus.cc:515] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:15.609750  4842 consensus_queue.cc:260] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:16.021027  4867 leader_election.cc:290] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:15.841841   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
W20260709 13:00:15.842408  2190 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.733s	user 0.017s	sys 0.019s
W20260709 13:00:16.075941  2190 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.967s	user 0.022s	sys 0.028s
W20260709 13:00:16.076398  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 967644us
I20260709 13:00:16.078424  4711 consensus_queue.cc:1059] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:16.080090  4711 raft_consensus.cc:3055] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:16.080475  4711 raft_consensus.cc:740] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:16.081919  4711 consensus_queue.cc:260] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:16.083817  4711 raft_consensus.cc:3060] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:16.087461  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:15.919888  1570 leader_election.cc:304] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:15.840898  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 673) took 1431 ms. Trace:
I20260709 13:00:16.100188  1602 rpcz_store.cc:276] 0709 13:00:14.408955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.409058 (+   103us) service_pool.cc:224] Handling call
0709 13:00:14.441600 (+ 32542us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:14.968125 (+526525us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:15.840175 (+872050us) spinlock_profiling.cc:243] Waited 522 ms on lock 0x7b540035f2d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:00:15.840634 (+   459us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1201610624}
I20260709 13:00:15.855973  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:16.101994  2225 raft_consensus.cc:2368] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 8. Current term is 9.
I20260709 13:00:15.855154  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:15.919814  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:16.103363  1601 raft_consensus.cc:2468] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 9.
W20260709 13:00:15.795531  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 240726us
I20260709 13:00:16.105024  4867 consensus_queue.cc:1059] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:00:16.106196  4867 raft_consensus.cc:3055] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:16.106585  4867 raft_consensus.cc:740] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
W20260709 13:00:15.815498  1571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:15.725351  4868 leader_election.cc:290] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:15.891448  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:15.894914  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:15.624126  4796 leader_election.cc:290] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:15.739554  4802 raft_consensus.cc:3055] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:15.883713  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:15.892217  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:15.993319  4833 raft_consensus.cc:3060] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:15.874991  4282 raft_consensus.cc:493] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:15.875382  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:15.991683  4872 raft_consensus.cc:493] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:15.881747  4190 raft_consensus.cc:493] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:15.991106  4861 raft_consensus.cc:493] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:15.853011  2222 raft_consensus.cc:1240] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:15.989882  4804 raft_consensus.cc:493] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:15.733255  4932 log.cc:927] Time spent T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.881s	user 0.003s	sys 0.000s
I20260709 13:00:16.061620  4710 raft_consensus.cc:493] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:16.137403  1598 raft_consensus.cc:2468] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 8.
W20260709 13:00:16.137033  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 217603us
I20260709 13:00:16.063786  4621 raft_consensus.cc:3060] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:15.871057  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:15.864042  2227 raft_consensus.cc:1240] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:16.060843  4795 raft_consensus.cc:493] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:15.887349  1677 raft_consensus.cc:1275] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:00:15.855705  2220 raft_consensus.cc:1275] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:00:15.890535  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:00:15.798442  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 405532us
I20260709 13:00:15.863636  3934 raft_consensus.cc:2804] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:16.103504  1606 raft_consensus.cc:2468] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 9.
I20260709 13:00:15.887468  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:15.880002  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:00:15.727831  4959 log.cc:927] Time spent T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
W20260709 13:00:15.726383  4960 log.cc:927] Time spent T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
W20260709 13:00:16.141000  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:16.141662  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:15.891242  1680 raft_consensus.cc:1275] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:00:16.137087  4802 raft_consensus.cc:740] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:15.729262  4724 leader_election.cc:290] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:15.619385  4911 leader_election.cc:290] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:16.137141  4867 consensus_queue.cc:260] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:16.177160  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:16.178233  4710 raft_consensus.cc:515] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:16.182518  4866 raft_consensus.cc:2804] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:16.183034  4866 raft_consensus.cc:493] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:16.183451  4866 raft_consensus.cc:3060] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:16.185516  4282 raft_consensus.cc:515] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:16.187795  1680 raft_consensus.cc:1240] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:16.188833  4282 leader_election.cc:290] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:16.190981  1681 raft_consensus.cc:2468] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 9.
I20260709 13:00:16.192087  4861 raft_consensus.cc:515] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:16.195477  4872 raft_consensus.cc:515] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:16.196837  1677 raft_consensus.cc:1275] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:00:16.198267  4872 leader_election.cc:290] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:16.198838  4190 raft_consensus.cc:515] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:16.200927  1676 raft_consensus.cc:2468] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 8.
W20260709 13:00:16.208578  1529 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.011s	sys 0.011s
I20260709 13:00:16.209018  4910 raft_consensus.cc:493] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:16.209829  1497 leader_election.cc:304] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:16.211722  1497 leader_election.cc:304] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:16.212064  4954 raft_consensus.cc:493] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:16.212793  4954 raft_consensus.cc:515] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:16.213304  4532 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:16.214169  4532 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 13:00:16.215286  1523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43008 (request call id 1884) took 1255 ms. Trace:
I20260709 13:00:16.215456  4865 raft_consensus.cc:493] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:16.209085  1529 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.011s	sys 0.011s
I20260709 13:00:16.216082  4865 raft_consensus.cc:515] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:16.217509  4842 raft_consensus.cc:3060] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:16.209848  4910 raft_consensus.cc:515] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:16.218269  4710 leader_election.cc:290] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:00:16.215404  1526 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.002s	sys 0.021s
I20260709 13:00:16.226984  4892 raft_consensus.cc:493] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:16.227775  4892 raft_consensus.cc:515] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:16.228309  4954 leader_election.cc:290] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:00:16.227322  1526 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.002s	sys 0.021s
I20260709 13:00:16.229782  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43010 (request call id 1964) took 1081 ms. Trace:
I20260709 13:00:16.168215  3934 raft_consensus.cc:697] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:00:16.230162  1526 rpcz_store.cc:276] 0709 13:00:15.148207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:15.547362 (+399155us) service_pool.cc:224] Handling call
0709 13:00:15.547606 (+   244us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:15.547790 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:00:15.560739 (+ 12949us) log.cc:844] Serialized 14 byte log entry
0709 13:00:16.229307 (+668568us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:16.229397 (+    90us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:16.229483 (+    86us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:16.229574 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:16.229713 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":12629,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":1503,"thread_start_us":668150,"threads_started":1}
I20260709 13:00:16.220253  4910 leader_election.cc:290] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:16.221402  4802 consensus_queue.cc:260] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:16.232375  4802 raft_consensus.cc:3060] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:16.232697  1673 raft_consensus.cc:1240] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:16.226816  4887 raft_consensus.cc:493] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:16.234292  4887 raft_consensus.cc:515] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:16.215741  1523 rpcz_store.cc:276] 0709 13:00:14.960254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.969265 (+  9011us) service_pool.cc:224] Handling call
0709 13:00:14.971467 (+  2202us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:14.997604 (+ 26137us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:14.997634 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:15.002962 (+  5328us) log.cc:844] Serialized 26 byte log entry
0709 13:00:15.355350 (+352388us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:15.406704 (+ 51354us) log.cc:844] Serialized 14 byte log entry
0709 13:00:15.406916 (+   212us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:15.488234 (+ 81318us) spinlock_profiling.cc:243] Waited 21.3 ms on lock 0x7b540010ccd4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:00:15.488280 (+    46us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:16.214762 (+726482us) raft_consensus.cc:1685] finished
0709 13:00:16.214889 (+   127us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:16.215101 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":51614,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":31142,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":131,"spinlock_wait_cycles":49006464,"thread_start_us":319049,"threads_started":1,"wal-append.queue_time_us":521968}
W20260709 13:00:16.222788  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:16.222395  4795 raft_consensus.cc:515] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:15.874418  4286 consensus_queue.cc:260] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:16.212949  4948 raft_consensus.cc:2749] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:16.220288  4804 raft_consensus.cc:515] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:00:16.202103  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 51960.8us
W20260709 13:00:16.214761  1531 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.015s	sys 0.006s
I20260709 13:00:16.242573  1604 raft_consensus.cc:2468] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 8.
W20260709 13:00:16.249945  1531 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.015s	sys 0.007s
W20260709 13:00:16.253543  1495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:15.622536  4834 consensus_queue.cc:260] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:16.242141  4887 leader_election.cc:290] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:16.246857  4892 leader_election.cc:290] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:16.254185  4861 leader_election.cc:290] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
W20260709 13:00:16.263710  1527 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.012s	sys 0.035s
W20260709 13:00:16.266425  1528 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.010s	sys 0.011s
W20260709 13:00:16.274231  1527 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.705s	user 0.012s	sys 0.036s
W20260709 13:00:16.266477  4885 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.072s	user 0.027s	sys 0.064s
I20260709 13:00:16.264194  4865 leader_election.cc:290] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:00:16.276134  1528 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.726s	user 0.010s	sys 0.012s
W20260709 13:00:16.268399  4944 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 1.233s	user 0.016s	sys 0.014s
I20260709 13:00:16.276535  1496 leader_election.cc:304] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:16.284530  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:16.284597  1524 raft_consensus.cc:1275] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:00:16.285006  2225 raft_consensus.cc:1275] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 9 LEARNER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:00:16.288844  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:16.286290  1524 pending_rounds.cc:85] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting all ops after (but not including) 3
W20260709 13:00:16.282003  4885 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.188s	user 0.027s	sys 0.065s
I20260709 13:00:16.292510  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:16.289824  1524 pending_rounds.cc:107] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:00:16.276402  4286 raft_consensus.cc:3060] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:16.314052  1524 raft_consensus.cc:2889] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:16.286700  4867 raft_consensus.cc:3060] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:16.308411  4944 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 1.357s	user 0.017s	sys 0.014s
I20260709 13:00:16.315719  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 13:00:16.305939  4883 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.013s	sys 0.015s
W20260709 13:00:16.331436  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:16.343389  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 68614.8us
I20260709 13:00:16.344496  2220 raft_consensus.cc:2368] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 6. Current term is 7.
I20260709 13:00:16.324019  4833 raft_consensus.cc:2749] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:00:16.338588  4883 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.014s	sys 0.016s
I20260709 13:00:16.285766  3934 consensus_queue.cc:237] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:16.355340  1674 raft_consensus.cc:2468] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 6.
W20260709 13:00:16.359009  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 120386us
I20260709 13:00:16.363008  4796 raft_consensus.cc:2804] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:16.364046  4866 raft_consensus.cc:515] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:16.366370  4866 leader_election.cc:290] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:16.390097  4887 consensus_queue.cc:1048] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:00:16.390823  4678 raft_consensus.cc:493] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:16.392961  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 123762us
I20260709 13:00:16.394865  4190 leader_election.cc:290] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:16.398473  2191 leader_election.cc:304] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:16.404729  1497 leader_election.cc:304] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:16.409497  4190 raft_consensus.cc:493] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:16.411254  4866 raft_consensus.cc:493] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:16.411890  4866 raft_consensus.cc:515] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:16.414278  4866 leader_election.cc:290] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:16.410243  4190 raft_consensus.cc:515] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:16.415132  1527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43010 (request call id 1958) took 1354 ms. Trace:
I20260709 13:00:16.391680  4678 raft_consensus.cc:515] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:16.419214  4976 raft_consensus.cc:2749] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:16.419368  4892 consensus_queue.cc:1059] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:16.420307  4892 raft_consensus.cc:3055] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:16.420679  4892 raft_consensus.cc:740] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:16.421756  4892 consensus_queue.cc:260] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:16.423151  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43008 (request call id 1887) took 1448 ms. Trace:
I20260709 13:00:16.427023  1528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43008 (request call id 1885) took 1466 ms. Trace:
I20260709 13:00:16.427451  1528 rpcz_store.cc:276] 0709 13:00:14.960531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.980987 (+ 20456us) service_pool.cc:224] Handling call
0709 13:00:15.521377 (+540390us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:15.549549 (+ 28172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:15.549581 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:15.550018 (+   437us) log.cc:844] Serialized 26 byte log entry
0709 13:00:16.335025 (+785007us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:16.343135 (+  8110us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:16.358393 (+ 15258us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:16.358443 (+    50us) raft_consensus.cc:1685] finished
0709 13:00:16.358453 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:16.426769 (+ 68316us) spinlock_profiling.cc:243] Waited 532 ms on lock 0x7b54000505d0. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b28ad 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:16.426966 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9777,"raft.queue_time_us":27891,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":82,"spinlock_wait_cycles":1223927552,"thread_start_us":732271,"threads_started":1,"wal-append.queue_time_us":660081}
I20260709 13:00:16.432518  4678 leader_election.cc:290] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:16.433349  4795 leader_election.cc:290] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:16.404320  4865 raft_consensus.cc:2749] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:16.444732  1525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43010 (request call id 1970) took 1206 ms. Trace:
I20260709 13:00:16.445204  1525 rpcz_store.cc:276] 0709 13:00:15.218058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:15.577684 (+359626us) service_pool.cc:224] Handling call
0709 13:00:15.578014 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:16.178820 (+600806us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:16.178870 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:16.182985 (+  4115us) log.cc:844] Serialized 26 byte log entry
0709 13:00:16.343606 (+160621us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:16.343638 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:16.358443 (+ 14805us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:16.399507 (+ 41064us) raft_consensus.cc:1685] finished
0709 13:00:16.399526 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:16.423241 (+ 23715us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":228743,"raft.queue_time_us":411207,"raft.run_cpu_time_us":233,"raft.run_wall_time_us":227,"thread_start_us":505562,"threads_started":2,"wal-append.queue_time_us":178513}
I20260709 13:00:16.446952  1570 leader_election.cc:304] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:16.415524  1527 rpcz_store.cc:276] 0709 13:00:15.061020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:15.541430 (+480410us) service_pool.cc:224] Handling call
0709 13:00:15.541713 (+   283us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:15.564143 (+ 22430us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:15.564175 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:15.564693 (+   518us) log.cc:844] Serialized 52 byte log entry
0709 13:00:16.335842 (+771149us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:16.338508 (+  2666us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:16.348889 (+ 10381us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:16.414881 (+ 65992us) raft_consensus.cc:1685] finished
0709 13:00:16.414899 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:16.415071 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":462728,"raft.queue_time_us":22310,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":3687,"thread_start_us":705887,"threads_started":1,"wal-append.queue_time_us":757753}
I20260709 13:00:16.461750  4796 raft_consensus.cc:493] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:16.462589  4796 raft_consensus.cc:3060] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:16.465147  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 77546.8us
I20260709 13:00:16.469094  4787 consensus_queue.cc:1059] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:16.469955  4787 raft_consensus.cc:3055] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:16.472003  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:00:16.473179  4967 log.cc:927] Time spent T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 13:00:16.477150  1524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43008 (request call id 1881) took 1517 ms. Trace:
I20260709 13:00:16.477584  4815 raft_consensus.cc:493] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:16.477581  1524 rpcz_store.cc:276] 0709 13:00:14.959285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.959424 (+   139us) service_pool.cc:224] Handling call
0709 13:00:14.975309 (+ 15885us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:16.320847 (+1345538us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:16.475713 (+154866us) spinlock_profiling.cc:243] Waited 1.08 ms on lock 0x7b54001b1320. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a1852adc0 00007f6a185b6a02 00007f6a185b2dd6 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2
0709 13:00:16.476887 (+  1174us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b54000eb354. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:00:16.477093 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3005120640}
I20260709 13:00:16.478471  4815 raft_consensus.cc:515] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:16.478984  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:16.469714  4786 consensus_queue.cc:1048] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:16.470347  4787 raft_consensus.cc:740] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:16.470196  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:16.479738  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:16.442593  4804 leader_election.cc:290] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:16.500200  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:00:16.498567  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 330903us
W20260709 13:00:16.499775  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 46858.2us
I20260709 13:00:16.423528  1529 rpcz_store.cc:276] 0709 13:00:14.975105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:15.511050 (+535945us) service_pool.cc:224] Handling call
0709 13:00:15.511403 (+   353us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:15.511761 (+   358us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:15.511791 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:15.512255 (+   464us) log.cc:844] Serialized 26 byte log entry
0709 13:00:15.588980 (+ 76725us) spinlock_profiling.cc:243] Waited 2.47 ms on lock 0x7b1800380ec0. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1e38ede1 00007f6a1e39b5b1 00007f6a154a8e07 00007f6a1e303ab9 00007f6a154c569b 00007f6a154c393f 00007f6a154c5c02 00007f6a1814d20b 00007f6a18152d23 00007f6a181530d1 00007f6a1856ea0f
0709 13:00:16.217071 (+628091us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:16.392477 (+175406us) log.cc:844] Serialized 14 byte log entry
0709 13:00:16.395470 (+  2993us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:16.396941 (+  1471us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:16.399363 (+  2422us) raft_consensus.cc:1685] finished
0709 13:00:16.404412 (+  5049us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:16.423090 (+ 18678us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2798,"raft.run_cpu_time_us":347,"raft.run_wall_time_us":8385,"spinlock_wait_cycles":5677312,"thread_start_us":802536,"threads_started":2,"wal-append.queue_time_us":805825}
I20260709 13:00:16.506819  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:16.509179  4678 consensus_queue.cc:1048] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:16.511775  4892 raft_consensus.cc:3060] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:16.512109  4787 consensus_queue.cc:260] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:16.512840  4717 raft_consensus.cc:493] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:16.513144  1528 raft_consensus.cc:1275] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:00:16.513474  4795 raft_consensus.cc:493] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:16.514132  4795 raft_consensus.cc:515] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:16.514497  1570 leader_election.cc:304] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
W20260709 13:00:16.515866  4505 consensus_meta.cc:287] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b: Time spent flushing consensus metadata: real 0.965s	user 0.012s	sys 0.010s
I20260709 13:00:16.516571  4795 leader_election.cc:290] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:16.516340  4505 raft_consensus.cc:515] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:16.517480  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:16.514591  1673 raft_consensus.cc:2393] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 6: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:00:16.477008  4532 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:16.477393  4913 raft_consensus.cc:493] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:16.502616  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:16.523140  2227 raft_consensus.cc:2393] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 7: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:00:16.514179  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:16.522786  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:16.524958  1646 leader_election.cc:304] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
W20260709 13:00:16.526029  2191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:16.513152  1675 raft_consensus.cc:2468] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 8.
I20260709 13:00:16.533078  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
W20260709 13:00:16.523864  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 119273us
I20260709 13:00:16.532423   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:16.531840  1571 leader_election.cc:304] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
W20260709 13:00:16.525516  4969 log.cc:927] Time spent T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.191s	user 0.000s	sys 0.001s
W20260709 13:00:16.533092  4966 log.cc:927] Time spent T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
I20260709 13:00:16.551714  1681 raft_consensus.cc:2468] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 7.
I20260709 13:00:16.523177  4787 raft_consensus.cc:3060] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:16.552060  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:16.523929  4190 leader_election.cc:290] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:16.518647  4505 leader_election.cc:290] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:16.549120  4678 raft_consensus.cc:2804] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:00:16.551713  4963 log.cc:927] Time spent T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.174s	user 0.004s	sys 0.000s
I20260709 13:00:16.560141  4717 raft_consensus.cc:515] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:16.525094  4913 raft_consensus.cc:515] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:16.576771  1496 leader_election.cc:304] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:16.577818  4717 leader_election.cc:290] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:16.578490  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:16.579070  1523 raft_consensus.cc:2393] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 8: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:00:16.530354  4965 consensus_queue.cc:1059] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:00:16.578462  4717 raft_consensus.cc:2804] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:16.579799  4717 raft_consensus.cc:493] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:16.580152  4717 raft_consensus.cc:3060] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:16.521073  4834 raft_consensus.cc:3060] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:16.582829  4842 raft_consensus.cc:493] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:16.561299  4532 raft_consensus.cc:2804] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:16.583581  4842 raft_consensus.cc:515] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:16.584187  4532 raft_consensus.cc:493] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:16.584559  4532 raft_consensus.cc:3060] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:16.585757  4842 leader_election.cc:290] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:16.558055  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:16.586714  4842 raft_consensus.cc:493] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:16.587263  4842 raft_consensus.cc:515] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:16.588587  4965 raft_consensus.cc:3055] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:16.588989  4965 raft_consensus.cc:740] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:16.589772  4842 leader_election.cc:290] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:16.589931  4965 consensus_queue.cc:260] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:16.590962  4802 raft_consensus.cc:493] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:16.591531  4965 raft_consensus.cc:3060] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:16.569449  1571 leader_election.cc:304] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:16.570981  4815 leader_election.cc:290] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:16.591569  4802 raft_consensus.cc:515] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:16.573119  4190 raft_consensus.cc:2804] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:16.592525  1497 leader_election.cc:304] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:16.592928  4190 raft_consensus.cc:493] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:16.555042  4866 raft_consensus.cc:493] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:16.575555  4862 raft_consensus.cc:2804] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:16.593791  1571 leader_election.cc:304] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:16.594219  4862 raft_consensus.cc:493] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:16.594718  4862 raft_consensus.cc:3060] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:16.582923  1527 raft_consensus.cc:1275] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:00:16.596567  1524 raft_consensus.cc:2468] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 6.
I20260709 13:00:16.579355  4913 leader_election.cc:290] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:00:16.567409  4983 log.cc:927] Time spent T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:00:16.598927  4913 raft_consensus.cc:2804] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:16.571741  4678 raft_consensus.cc:493] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:16.594517  4887 raft_consensus.cc:2804] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:16.529618  4786 consensus_queue.cc:1048] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 13:00:16.600208  4887 raft_consensus.cc:493] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:16.593695  4866 raft_consensus.cc:515] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:16.603715  4887 raft_consensus.cc:3060] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:16.605301  4866 leader_election.cc:290] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:16.605991  4866 raft_consensus.cc:2804] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:16.606348  4866 raft_consensus.cc:493] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:16.600787  4190 raft_consensus.cc:3060] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:16.607844  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:16.607662  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:16.608522  1646 leader_election.cc:304] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:16.608845  1527 raft_consensus.cc:2468] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 7.
I20260709 13:00:16.609491  1497 leader_election.cc:304] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:16.599845  4678 raft_consensus.cc:3060] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:16.610883  1497 leader_election.cc:304] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:16.611063  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:16.611644  1524 raft_consensus.cc:3060] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:16.612054  1497 leader_election.cc:304] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:16.613299  1497 leader_election.cc:304] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:16.613729  4866 raft_consensus.cc:3060] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:16.618054  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:16.621379  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:16.622042  1680 raft_consensus.cc:2468] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 7.
I20260709 13:00:16.622681  2220 raft_consensus.cc:2468] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 7.
I20260709 13:00:16.625279  4948 raft_consensus.cc:2749] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:16.599363  4913 raft_consensus.cc:493] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:16.626299  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
W20260709 13:00:16.635914  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:16.649091  3934 raft_consensus.cc:2804] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:16.649564  3934 raft_consensus.cc:493] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:16.649889  1524 raft_consensus.cc:2468] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 7.
I20260709 13:00:16.649912  3934 raft_consensus.cc:3060] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:16.651515  1531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43010 (request call id 1959) took 1583 ms. Trace:
I20260709 13:00:16.655843  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:16.591728  4842 raft_consensus.cc:493] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:16.665913  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 57504.8us
I20260709 13:00:16.652124  4913 raft_consensus.cc:3060] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:00:16.669898  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 56684.1us
I20260709 13:00:16.653275  4892 raft_consensus.cc:493] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:16.653757  1531 rpcz_store.cc:276] 0709 13:00:15.068145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:15.543029 (+474884us) service_pool.cc:224] Handling call
0709 13:00:15.543336 (+   307us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:15.562117 (+ 18781us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:15.562151 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:15.566330 (+  4179us) log.cc:844] Serialized 52 byte log entry
0709 13:00:16.278255 (+711925us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:16.549638 (+271383us) log.cc:844] Serialized 14 byte log entry
0709 13:00:16.558924 (+  9286us) log.cc:844] Serialized 14 byte log entry
0709 13:00:16.560136 (+  1212us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:16.575665 (+ 15529us) spinlock_profiling.cc:243] Waited 2.31 ms on lock 0x7b1800255160. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1e38ede1 00007f6a1e39b5b1 00007f6a154c63f3 00007f6a154c87c1 00007f6a154c8779 00007f6a154c8709 00007f6a154c86d1 00007f6a154c79cd 000000000038f354 000000000038f199 00007f6a154a983a
0709 13:00:16.623435 (+ 47770us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:16.651260 (+ 27825us) raft_consensus.cc:1685] finished
0709 13:00:16.651284 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:16.651450 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":501167,"prepare.queue_time_us":282681,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":63,"raft.queue_time_us":25777,"raft.run_cpu_time_us":263,"raft.run_wall_time_us":265,"spinlock_wait_cycles":5320064,"thread_start_us":898822,"threads_started":2,"wal-append.queue_time_us":689271}
I20260709 13:00:16.664649  4867 raft_consensus.cc:2804] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:16.682165  4946 raft_consensus.cc:2749] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:16.682680  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:16.683198  1602 raft_consensus.cc:1275] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:00:16.684391  4710 raft_consensus.cc:493] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:16.684587  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:16.685232  1603 raft_consensus.cc:3060] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:00:16.684401  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:16.686784  1497 leader_election.cc:304] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:16.694378  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:16.676640  4842 raft_consensus.cc:515] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:16.697050  4842 leader_election.cc:290] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:16.697587  4842 raft_consensus.cc:493] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:16.698465  1497 leader_election.cc:304] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:16.699409  4948 raft_consensus.cc:2804] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:16.699832  4948 raft_consensus.cc:493] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:16.700152  4948 raft_consensus.cc:3060] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:16.700749  4946 raft_consensus.cc:2804] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:16.701159  4946 raft_consensus.cc:493] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:16.701550  4946 raft_consensus.cc:3060] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:16.702525  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:16.703454  2227 raft_consensus.cc:1275] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:16.701265  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:16.705619  2224 raft_consensus.cc:2393] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 7: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:00:16.707651  1646 leader_election.cc:304] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
W20260709 13:00:16.709757  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:16.710901  4885 raft_consensus.cc:2749] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:16.711730  4892 raft_consensus.cc:515] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:16.712019  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:16.683117  4912 raft_consensus.cc:2804] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:16.714147  4912 raft_consensus.cc:697] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 10 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:16.714277  4892 leader_election.cc:290] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:16.715206  4912 consensus_queue.cc:237] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:16.654918  4796 raft_consensus.cc:515] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:16.698096  4842 raft_consensus.cc:515] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:16.722162  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:16.681183  4867 raft_consensus.cc:493] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:16.747413  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:16.749402  1598 raft_consensus.cc:2468] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 7.
I20260709 13:00:16.718302  4190 raft_consensus.cc:515] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:16.751595  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:16.764307  4892 raft_consensus.cc:493] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:16.769608  4892 raft_consensus.cc:515] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:16.771476  4532 raft_consensus.cc:515] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:16.772295  4892 leader_election.cc:290] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:16.774031  4532 leader_election.cc:290] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:16.774914  1680 raft_consensus.cc:1240] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:00:16.776999  4717 raft_consensus.cc:515] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:16.742117  4802 leader_election.cc:290] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:16.778126  4866 raft_consensus.cc:515] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:16.778930  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:00:16.783010  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 57630.4us
I20260709 13:00:16.790606  1673 raft_consensus.cc:1240] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:16.743464  4867 raft_consensus.cc:3060] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:16.785597  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:16.786574  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:16.780717  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:16.796965  2225 raft_consensus.cc:1240] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:16.797610  4796 leader_election.cc:290] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:16.787261  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:16.798327  1605 raft_consensus.cc:3060] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:16.803470  2192 leader_election.cc:304] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:16.803918  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:16.804838  4787 consensus_queue.cc:1048] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:16.805608  1681 raft_consensus.cc:2468] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 7.
I20260709 13:00:16.778842  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:16.806921  4815 raft_consensus.cc:493] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:16.807037  1600 raft_consensus.cc:2468] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 9.
I20260709 13:00:16.807188  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:16.807811  1599 raft_consensus.cc:2468] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 6.
W20260709 13:00:16.808225  1571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:16.809553  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:16.810503  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:16.777717  4946 raft_consensus.cc:515] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:16.812866  4862 raft_consensus.cc:515] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:16.719668  4678 raft_consensus.cc:515] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:16.822960  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:16.823447  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:16.824129  1676 raft_consensus.cc:3060] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:16.783354  4988 log.cc:927] Time spent T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:00:16.836440  4946 leader_election.cc:290] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:00:16.827857  4980 log.cc:927] Time spent T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.319s	user 0.000s	sys 0.001s
I20260709 13:00:16.825063  1605 raft_consensus.cc:2468] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 7.
I20260709 13:00:16.814836  4990 raft_consensus.cc:493] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:16.829445  4678 leader_election.cc:290] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:16.767874  4710 raft_consensus.cc:515] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:16.827461  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:16.840337  2190 leader_election.cc:304] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:00:16.841172  1571 leader_election.cc:304] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:16.782642  4190 leader_election.cc:290] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:16.846837  1679 raft_consensus.cc:2393] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 10: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:00:16.806622  4787 raft_consensus.cc:2749] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:00:16.844249  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:16.852839  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:16.858726  1676 raft_consensus.cc:2468] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 10.
I20260709 13:00:16.864415  1644 leader_election.cc:304] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:16.866631  4621 raft_consensus.cc:2804] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:16.867152  4621 raft_consensus.cc:493] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:16.866901  4872 consensus_queue.cc:1048] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:16.867664  4621 raft_consensus.cc:3060] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:16.869401  4872 consensus_queue.cc:1048] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:16.870954  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:16.871166  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
W20260709 13:00:16.884250  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:16.887902  4842 leader_election.cc:290] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:16.881417  2224 raft_consensus.cc:2376] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 8. Re-sending same reply.
I20260709 13:00:16.851362  4532 consensus_queue.cc:1048] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:00:16.898423  2223 raft_consensus.cc:2468] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 10.
I20260709 13:00:16.846442  4815 raft_consensus.cc:515] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:16.883042  4190 raft_consensus.cc:2804] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:16.838991  4990 raft_consensus.cc:515] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:16.898113  4505 raft_consensus.cc:2804] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:16.853791  4892 consensus_queue.cc:1059] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 13:00:16.905995  4717 leader_election.cc:290] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:16.912277  4190 raft_consensus.cc:493] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:16.922740  4190 raft_consensus.cc:3060] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:16.911391  4862 leader_election.cc:290] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:16.928447  3934 raft_consensus.cc:515] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:00:16.929425  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 88328.3us
I20260709 13:00:16.931998  3934 leader_election.cc:290] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:16.933856  1607 raft_consensus.cc:3055] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:16.934294  1607 raft_consensus.cc:740] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:16.934772  3934 raft_consensus.cc:493] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:16.945420  1571 leader_election.cc:304] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:16.918242  4505 raft_consensus.cc:493] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
W20260709 13:00:16.949556  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 125215us
I20260709 13:00:16.951406  3934 raft_consensus.cc:515] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:00:16.953642  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 147125us
I20260709 13:00:16.954890  2190 leader_election.cc:304] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:16.932638  4796 raft_consensus.cc:493] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:16.956198  3934 leader_election.cc:290] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:16.931682  4892 consensus_queue.cc:1243] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer b96ce9cc496c49d7818fa983a17b062b log is divergent from this leader: its last log entry 8.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:00:16.965015  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:16.952384  4505 raft_consensus.cc:3060] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:16.968309  2190 leader_election.cc:304] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:16.963141  4834 raft_consensus.cc:493] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:16.962893  4865 raft_consensus.cc:2749] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:16.986231  4710 leader_election.cc:290] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:16.988233  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:16.989464  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:16.990459  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:16.990615  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:16.991006  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:16.991829  1523 raft_consensus.cc:2410] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:00:16.992265  2190 leader_election.cc:304] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:16.992622  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:16.992878  4796 raft_consensus.cc:515] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:16.993417  1523 raft_consensus.cc:2468] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 9.
I20260709 13:00:16.993948  4958 consensus_queue.cc:1048] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:16.994318  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:16.994877  4834 raft_consensus.cc:515] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:16.995674  1532 raft_consensus.cc:1240] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:16.956426  4862 raft_consensus.cc:2804] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:16.991655  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:16.993463  4965 raft_consensus.cc:2749] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:17.002516  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:17.002516  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:17.003062  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:17.003752  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:16.953399  4717 raft_consensus.cc:493] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:16.996419  4990 leader_election.cc:290] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:17.009262  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:17.005169  3934 raft_consensus.cc:493] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.022115  4717 raft_consensus.cc:515] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:17.046330  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:17.014555  4621 raft_consensus.cc:515] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:17.047923  4717 leader_election.cc:290] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:17.048444  4621 leader_election.cc:290] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:17.015974  1675 raft_consensus.cc:1275] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:00:17.014997  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:17.050400  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:17.051501  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:17.052467  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:17.045519  4948 raft_consensus.cc:515] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:17.053042  1530 raft_consensus.cc:2468] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 7.
I20260709 13:00:17.053928  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:17.021579  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:17.027500  4815 leader_election.cc:290] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:17.028066  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:17.029882  4796 leader_election.cc:290] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:16.970165  4787 consensus_queue.cc:1048] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 13:00:17.030556  1644 leader_election.cc:304] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:17.030922  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:17.031371  4834 leader_election.cc:290] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:16.992658  4786 raft_consensus.cc:2749] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:17.015445  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 13:00:17.033277  4997 log.cc:927] Time spent T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.252s	user 0.000s	sys 0.003s
I20260709 13:00:17.034422  1526 raft_consensus.cc:1275] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:00:17.035261  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:17.036516  4866 leader_election.cc:290] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:17.010298  2190 leader_election.cc:304] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:17.039745  4867 raft_consensus.cc:515] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:16.986388  4190 raft_consensus.cc:515] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:17.041852  1523 pending_rounds.cc:85] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting all ops after (but not including) 6
I20260709 13:00:17.042423  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:17.043159  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:17.044932  4862 raft_consensus.cc:697] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 10 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:17.046150  3934 raft_consensus.cc:515] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:17.126705  1523 pending_rounds.cc:107] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting uncommitted NO_OP operation due to leader change: 8.7
I20260709 13:00:17.010038  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 13:00:17.127270  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 132608us
W20260709 13:00:17.075594  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:17.045617  1679 raft_consensus.cc:3060] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:17.065109  1572 leader_election.cc:400] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 election: Vote denied by peer b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373) with higher term. Message: Invalid argument: T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 8. Current term is 9.
I20260709 13:00:17.062899  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:17.126750  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:17.067615  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:17.091938  1680 raft_consensus.cc:2468] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 6.
I20260709 13:00:17.128291  2190 leader_election.cc:304] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:17.128929  4862 consensus_queue.cc:237] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:17.129511  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:17.092070  1529 raft_consensus.cc:2468] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 7.
W20260709 13:00:17.130841  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 168405us
I20260709 13:00:17.128778  2227 raft_consensus.cc:2468] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 7.
I20260709 13:00:17.131429  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:17.131963  1529 raft_consensus.cc:2468] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 5.
I20260709 13:00:17.054512  1530 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 9.
I20260709 13:00:17.036270  1497 leader_election.cc:304] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:17.054426  4948 leader_election.cc:290] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:17.061167  1603 raft_consensus.cc:2468] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 7.
I20260709 13:00:17.127974  1524 raft_consensus.cc:2468] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 3.
I20260709 13:00:17.134227  1571 leader_election.cc:304] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
W20260709 13:00:17.099628  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 310002us
I20260709 13:00:17.109025  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:17.127696  1523 raft_consensus.cc:2889] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:17.137787  4948 consensus_queue.cc:1048] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:17.137444  1674 raft_consensus.cc:2468] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 6.
W20260709 13:00:17.139022  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 108546us
I20260709 13:00:17.054586  4883 raft_consensus.cc:493] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.137454  1525 raft_consensus.cc:3060] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:17.140828  3934 leader_election.cc:290] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:17.141630  4878 consensus_queue.cc:1059] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 13:00:17.116211  4796 raft_consensus.cc:493] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:17.146929  1528 raft_consensus.cc:2468] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 6.
I20260709 13:00:17.148525  4710 consensus_queue.cc:1059] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:00:17.154845  1602 raft_consensus.cc:1240] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:17.155194  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:17.155404  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:17.149410  1572 leader_election.cc:400] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 pre-election: Vote denied by peer b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373) with higher term. Message: Invalid argument: T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 6. Current term is 7.
I20260709 13:00:17.059118  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:17.155972  1676 raft_consensus.cc:2468] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 8.
I20260709 13:00:17.155962  1572 leader_election.cc:403] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:17.156940  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:17.157711  1526 raft_consensus.cc:2468] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 8.
I20260709 13:00:17.158684  1532 raft_consensus.cc:1240] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:17.109882  4887 raft_consensus.cc:515] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:17.159905  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:17.123363  4621 raft_consensus.cc:2749] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:17.132169  4865 raft_consensus.cc:2804] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:17.124111  4834 raft_consensus.cc:493] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:17.164547  3934 raft_consensus.cc:2749] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:17.193198  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:17.193449  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:17.193744  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:17.194154  1524 raft_consensus.cc:2410] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:00:17.059228  4913 raft_consensus.cc:515] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:00:17.198139  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 138026us
I20260709 13:00:17.198910  1530 raft_consensus.cc:3060] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:17.159993  4990 raft_consensus.cc:2804] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:17.154631  4958 raft_consensus.cc:2804] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:17.202584  1644 leader_election.cc:304] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:17.202797  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:17.203388  1526 raft_consensus.cc:3060] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:17.203599  1571 leader_election.cc:304] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:17.204653  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:17.205297  1528 raft_consensus.cc:2468] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 5.
I20260709 13:00:17.206434  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:17.204927  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:17.205536  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:17.208285  1598 raft_consensus.cc:2410] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:00:17.191051  4865 raft_consensus.cc:493] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:17.211434  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:17.212985  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:17.212106  1603 raft_consensus.cc:2468] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 7.
I20260709 13:00:17.213583  1524 raft_consensus.cc:3060] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:17.213449  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 83544.1us
W20260709 13:00:17.216135  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 179960us
I20260709 13:00:17.217377  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:17.159529  4802 consensus_queue.cc:1048] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:00:17.222949  1602 raft_consensus.cc:2468] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 8.
I20260709 13:00:17.212510  4958 raft_consensus.cc:697] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 7 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
W20260709 13:00:17.232301  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 83014.2us
I20260709 13:00:17.223261  1599 raft_consensus.cc:1240] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:17.165130  4796 raft_consensus.cc:515] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:17.223663  4885 consensus_queue.cc:1059] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:17.223071  5008 consensus_queue.cc:1048] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:00:17.204093  4505 raft_consensus.cc:515] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:17.231068  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:17.268733  1681 raft_consensus.cc:2468] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 5.
I20260709 13:00:17.247285  1528 raft_consensus.cc:2468] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 7.
I20260709 13:00:17.211292  4990 raft_consensus.cc:697] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 6 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:17.228494  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:17.221902  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:17.250556  1572 leader_election.cc:304] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:17.273974  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 13:00:17.275157  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 100663us
I20260709 13:00:17.273635  4885 consensus_queue.cc:1243] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:00:17.278965  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:17.279420  1572 leader_election.cc:304] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:17.160351  4883 raft_consensus.cc:515] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:17.210340  4878 raft_consensus.cc:2749] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373) with higher term. Message: Invalid argument: T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 6. Current term is 7.
I20260709 13:00:17.266088  1679 raft_consensus.cc:2468] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 9.
I20260709 13:00:17.214370  4842 raft_consensus.cc:2804] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:17.262041  1644 leader_election.cc:304] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:17.214727  4865 raft_consensus.cc:3060] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:17.222922  4621 raft_consensus.cc:2749] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:17.269380  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:17.270404  1526 raft_consensus.cc:2468] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 10.
I20260709 13:00:17.198832  4834 raft_consensus.cc:515] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:17.272007  3934 raft_consensus.cc:493] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:17.274564  1528 raft_consensus.cc:2468] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 5.
I20260709 13:00:17.223668  4190 leader_election.cc:290] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:17.276809  1532 raft_consensus.cc:2368] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for earlier term 8. Current term is 9.
I20260709 13:00:17.277930  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:17.279800  1602 raft_consensus.cc:2410] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:00:17.260826  1530 raft_consensus.cc:2468] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 8.
I20260709 13:00:17.286921  1524 raft_consensus.cc:2468] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 7.
I20260709 13:00:17.280412  1496 leader_election.cc:304] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:17.216940  5006 consensus_queue.cc:1059] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.069s
W20260709 13:00:17.291644  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 72643.3us
I20260709 13:00:17.306442  1600 raft_consensus.cc:1275] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:00:17.272539  5013 raft_consensus.cc:493] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.291013  1529 raft_consensus.cc:2468] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 7.
I20260709 13:00:17.298380  1672 raft_consensus.cc:3060] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:17.298934  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:17.317420  1530 raft_consensus.cc:2393] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 9: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
W20260709 13:00:17.322942  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:17.283818  4842 raft_consensus.cc:493] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:17.325757  1599 raft_consensus.cc:1240] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:17.298406  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:17.303368  3934 raft_consensus.cc:515] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:17.304236  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:17.299114  4711 consensus_queue.cc:1059] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 13:00:17.305811  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:17.306486  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:17.307018  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:17.330209  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:17.330474  1603 raft_consensus.cc:2468] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 7.
I20260709 13:00:17.307211  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:17.330241  1602 raft_consensus.cc:3060] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:17.307531  1532 raft_consensus.cc:1240] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:00:17.307675  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:17.308372  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:17.332198  1529 raft_consensus.cc:1240] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:00:17.294071  4885 raft_consensus.cc:2764] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:00:17.332551  1606 raft_consensus.cc:3060] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:17.312682  1525 raft_consensus.cc:2468] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 8.
I20260709 13:00:17.315752  1496 leader_election.cc:304] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:17.288617  4892 raft_consensus.cc:2749] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:00:17.301143  2191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:17.327653  1526 raft_consensus.cc:2468] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 8.
I20260709 13:00:17.335492  1526 raft_consensus.cc:1240] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:17.279784  4804 consensus_queue.cc:1048] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:00:17.333559  1604 raft_consensus.cc:3060] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:17.336645  1526 raft_consensus.cc:1275] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:00:17.327345  1528 raft_consensus.cc:2468] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 7.
I20260709 13:00:17.339797  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:17.295073  5016 raft_consensus.cc:493] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:17.313463  4678 raft_consensus.cc:2804] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:17.343451  1529 raft_consensus.cc:1240] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:17.345103  1603 raft_consensus.cc:2393] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 7: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:00:17.328776  4842 raft_consensus.cc:3060] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:17.351490  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:17.352213  1605 raft_consensus.cc:2468] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 8.
W20260709 13:00:17.353786  1571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:17.352296  1598 raft_consensus.cc:1275] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:00:17.350855  5015 raft_consensus.cc:2804] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:17.360611  4887 leader_election.cc:290] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:17.365273  1644 leader_election.cc:304] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:17.366128  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:17.341022  4621 raft_consensus.cc:493] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.369518  1600 raft_consensus.cc:2468] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 6.
I20260709 13:00:17.340754  4867 leader_election.cc:290] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:17.381516  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:17.386914  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:17.387786  1600 raft_consensus.cc:2410] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:00:17.388576  1497 leader_election.cc:304] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:17.391490  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:00:17.390602  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 62955.6us
I20260709 13:00:17.393384  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:17.393749  1646 leader_election.cc:304] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:17.332348  5013 raft_consensus.cc:515] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:17.378672  5015 raft_consensus.cc:493] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:17.400432  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:17.378347  4678 raft_consensus.cc:697] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 7 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
W20260709 13:00:17.398190  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 88282.9us
I20260709 13:00:17.402915  1644 leader_election.cc:304] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:17.394824  1497 leader_election.cc:304] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:00:17.399154  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:17.404057  1603 raft_consensus.cc:2468] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 6.
I20260709 13:00:17.404637  1497 leader_election.cc:304] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:17.404947  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:17.406067  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:17.395834  1601 raft_consensus.cc:2393] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 8: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:00:17.401454  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:17.409325  1497 leader_election.cc:304] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:17.415602  1524 raft_consensus.cc:1275] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 13:00:17.389497  4946 raft_consensus.cc:2804] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:17.416061  1524 pending_rounds.cc:85] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting all ops after (but not including) 6
I20260709 13:00:17.421248  1524 pending_rounds.cc:107] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:00:17.421587  1524 raft_consensus.cc:2889] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:17.421909  1524 pending_rounds.cc:107] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:00:17.422120  1524 raft_consensus.cc:2889] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:17.425736  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:17.428023  1603 raft_consensus.cc:2393] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 10: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:00:17.429741  1672 raft_consensus.cc:2468] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 8.
I20260709 13:00:17.431592  1601 raft_consensus.cc:1240] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:17.394572  4913 leader_election.cc:290] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:17.400641  4867 raft_consensus.cc:2749] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:17.356065  5016 raft_consensus.cc:515] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:17.461921  4867 raft_consensus.cc:2804] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:17.388729  4621 raft_consensus.cc:515] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:17.462744  4948 raft_consensus.cc:2804] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:17.462281  4678 consensus_queue.cc:237] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:17.463296  4948 raft_consensus.cc:697] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:00:17.464363  4948 consensus_queue.cc:237] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:17.464951  4621 leader_election.cc:290] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:17.421106  4946 raft_consensus.cc:493] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:17.466902  4946 raft_consensus.cc:3060] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:17.402731  5015 raft_consensus.cc:3060] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:17.379031  4990 consensus_queue.cc:237] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:17.345376  4958 consensus_queue.cc:237] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:17.474331  1570 leader_election.cc:304] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:17.462461  4867 raft_consensus.cc:493] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:17.470638  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:00:17.479065  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 69820.8us
I20260709 13:00:17.479996  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:17.481678  1679 raft_consensus.cc:1240] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:00:17.480031  1497 leader_election.cc:304] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:17.460069  4796 leader_election.cc:290] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:17.528079  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:17.529232  5028 raft_consensus.cc:2749] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:00:17.528468  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 48453.6us
I20260709 13:00:17.529940  5028 raft_consensus.cc:2749] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:17.542858  4834 leader_election.cc:290] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:17.546612  1602 raft_consensus.cc:2468] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 9.
I20260709 13:00:17.513428  1603 raft_consensus.cc:2468] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 5.
I20260709 13:00:17.520200  4913 raft_consensus.cc:2749] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:17.520920  5022 raft_consensus.cc:2749] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:17.557176  5008 raft_consensus.cc:493] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.521590  5024 raft_consensus.cc:2804] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:17.557709  5008 raft_consensus.cc:515] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:17.558187  5024 raft_consensus.cc:697] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 10 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:17.559162  5024 consensus_queue.cc:237] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:17.559880  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 88398.9us
I20260709 13:00:17.561216  1570 leader_election.cc:304] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
W20260709 13:00:17.522590  5018 log.cc:927] Time spent T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
I20260709 13:00:17.523125  4787 raft_consensus.cc:493] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.563225  4878 raft_consensus.cc:2804] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:17.562901  4787 raft_consensus.cc:515] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:17.563627  4878 raft_consensus.cc:493] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:17.524935  2219 raft_consensus.cc:1240] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:17.565806  1604 raft_consensus.cc:2468] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 9.
I20260709 13:00:17.526201  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:17.500586  1607 consensus_queue.cc:260] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:17.555467  1571 leader_election.cc:304] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:17.555986  4892 raft_consensus.cc:2749] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:17.523272  4883 leader_election.cc:290] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:17.566865  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:17.483148  4867 raft_consensus.cc:3060] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:17.567893  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 174242us
I20260709 13:00:17.577404  1606 raft_consensus.cc:2468] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 9.
I20260709 13:00:17.566921  2225 raft_consensus.cc:3060] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:17.589751  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:17.585279  1604 raft_consensus.cc:1240] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 6. Current term is 7. Ops: []
W20260709 13:00:17.604691  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 201841us
I20260709 13:00:17.608546  1599 raft_consensus.cc:1240] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:17.609428  5016 leader_election.cc:290] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:17.616197  1606 raft_consensus.cc:1240] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:17.588860  4787 leader_election.cc:290] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
W20260709 13:00:17.611660  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 56282.5us
W20260709 13:00:17.611562  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 295910us
I20260709 13:00:17.612962  1644 leader_election.cc:304] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:17.622632  1672 raft_consensus.cc:2468] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 8.
I20260709 13:00:17.622882  1603 raft_consensus.cc:2468] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 12.
I20260709 13:00:17.624806  1496 leader_election.cc:304] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:17.610096  5013 leader_election.cc:290] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:17.568069  4878 raft_consensus.cc:3060] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:17.552923  4866 raft_consensus.cc:3055] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:17.624595  1606 raft_consensus.cc:1275] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:00:17.628540  1679 raft_consensus.cc:1240] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:17.631345  1571 leader_election.cc:304] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:17.633298  1523 raft_consensus.cc:1240] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:17.632941  2190 leader_election.cc:304] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:17.632843  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:17.636144  1607 raft_consensus.cc:3060] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:17.637713  1603 raft_consensus.cc:1275] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:17.643507  1604 raft_consensus.cc:1275] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:00:17.645041  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:17.625231  4892 raft_consensus.cc:2804] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:17.649130  5032 raft_consensus.cc:2749] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:17.649709  4883 raft_consensus.cc:2804] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:17.652452  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:17.652788  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:17.654074  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:17.632705  5016 raft_consensus.cc:2804] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:17.664745  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:17.668166  2225 raft_consensus.cc:2468] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 10.
I20260709 13:00:17.607503  4865 raft_consensus.cc:515] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:17.629606  4866 raft_consensus.cc:740] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:17.674968  1531 raft_consensus.cc:3060] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:17.675196  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:17.676445  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:17.677806  1606 raft_consensus.cc:1240] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 6 LEADER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:17.679677  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:17.680974  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:17.682099  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:17.687052  1604 raft_consensus.cc:2468] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 12.
I20260709 13:00:17.690960  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:17.692051  1604 raft_consensus.cc:2410] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:00:17.667820  4678 raft_consensus.cc:2804] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:17.693025  1644 leader_election.cc:304] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:00:17.694866  1531 raft_consensus.cc:2468] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 8.
I20260709 13:00:17.677425  5030 raft_consensus.cc:493] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.675243  4892 raft_consensus.cc:697] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 8 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:17.655285  4887 consensus_queue.cc:1059] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:00:17.704716  1570 leader_election.cc:304] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:17.694320  5016 raft_consensus.cc:697] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
W20260709 13:00:17.712455  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 76953.8us
I20260709 13:00:17.734606  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:00:17.735970  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 48798us
I20260709 13:00:17.737954  1644 leader_election.cc:304] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:17.705886  4678 raft_consensus.cc:697] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 8 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:17.698282  5025 consensus_queue.cc:1048] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:00:17.699643  4842 raft_consensus.cc:515] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:17.699247  4990 consensus_queue.cc:1048] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:00:17.718735  5008 leader_election.cc:290] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:00:17.764000  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 68901us
I20260709 13:00:17.719350  5032 raft_consensus.cc:2804] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:17.766347  5032 raft_consensus.cc:493] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:17.766816  5032 raft_consensus.cc:3060] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:17.740384  4887 raft_consensus.cc:2804] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:17.772344  1602 raft_consensus.cc:2368] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for earlier term 7. Current term is 8.
W20260709 13:00:17.773311  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:17.772923  2190 leader_election.cc:304] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:17.777364  3934 leader_election.cc:290] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:17.758267  4883 raft_consensus.cc:697] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [term 8 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:17.778762  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:17.783860  5023 raft_consensus.cc:2804] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:17.781939  4787 raft_consensus.cc:2804] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:17.719054  5035 consensus_queue.cc:1059] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 13:00:17.739429  5031 consensus_queue.cc:1059] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:00:17.771353  4887 raft_consensus.cc:493] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:17.708158  5030 raft_consensus.cc:515] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:17.789433  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
W20260709 13:00:17.790602  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 52720.7us
I20260709 13:00:17.791697  5031 raft_consensus.cc:3055] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:17.790436  4787 raft_consensus.cc:697] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 8 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:17.799258  4887 raft_consensus.cc:3060] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:17.799651  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:17.802320  1673 raft_consensus.cc:3060] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:00:17.802708  1644 leader_election.cc:304] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:17.805591  5031 raft_consensus.cc:740] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:17.809309  5031 consensus_queue.cc:260] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:17.811095  5024 raft_consensus.cc:2804] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:17.811509  5024 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:17.811868  5024 raft_consensus.cc:3060] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:17.815522  1644 leader_election.cc:304] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:17.816170  1673 raft_consensus.cc:2468] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 8.
I20260709 13:00:17.816884  4842 leader_election.cc:290] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:17.810578  5031 raft_consensus.cc:3060] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:17.786854  4892 consensus_queue.cc:237] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:17.820464  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:17.821055  1600 raft_consensus.cc:2376] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 6. Re-sending same reply.
I20260709 13:00:17.822082  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:17.822783  1598 raft_consensus.cc:2468] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 6.
I20260709 13:00:17.823354  4913 raft_consensus.cc:3055] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:17.823568  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:17.823746  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:17.824221  1598 raft_consensus.cc:2468] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 5.
W20260709 13:00:17.801765  5037 log.cc:927] Time spent T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 13:00:17.786278  5023 raft_consensus.cc:493] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:17.822021  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:17.806979  4678 consensus_queue.cc:237] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:17.824889  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:17.828567  1571 leader_election.cc:304] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:17.811872  4804 raft_consensus.cc:3055] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:17.845955  4804 raft_consensus.cc:740] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:17.788105  5016 consensus_queue.cc:237] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:17.846937  4804 consensus_queue.cc:260] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:17.847980  4804 raft_consensus.cc:3060] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:17.849979  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:17.851758  1644 leader_election.cc:304] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:17.854058  1644 leader_election.cc:304] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:17.825637  4913 raft_consensus.cc:740] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:00:17.849629  5028 raft_consensus.cc:2804] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:17.849357  5023 raft_consensus.cc:3060] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:17.904330  4710 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.014s	sys 0.032s
I20260709 13:00:17.858181  4865 leader_election.cc:290] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 8 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:17.857800  4532 raft_consensus.cc:2804] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:17.899160  4815 raft_consensus.cc:493] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:17.934826  4710 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.014s	sys 0.033s
I20260709 13:00:17.939810  5039 raft_consensus.cc:2804] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:00:17.940793  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 86813us
I20260709 13:00:17.912161  5028 raft_consensus.cc:493] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
W20260709 13:00:17.945096  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 240452us
I20260709 13:00:17.935024  4532 raft_consensus.cc:493] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:17.947396  1570 leader_election.cc:304] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:17.857810  4787 consensus_queue.cc:237] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:17.955766  1644 leader_election.cc:304] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:17.940510  5039 raft_consensus.cc:697] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 8 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
W20260709 13:00:17.949008  5034 log.cc:927] Time spent T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.242s	user 0.000s	sys 0.001s
W20260709 13:00:17.958796  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:17.959193  5046 log.cc:927] Time spent T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:00:17.965478  1530 raft_consensus.cc:1240] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:00:17.948431  5028 raft_consensus.cc:3060] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:18.003680  4872 raft_consensus.cc:3055] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:18.004158  4872 raft_consensus.cc:740] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:17.908252  4883 consensus_queue.cc:237] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:17.952584  5025 raft_consensus.cc:2804] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:00:17.995467  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:18.010648  1681 raft_consensus.cc:3060] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:18.005319  1673 raft_consensus.cc:1240] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
W20260709 13:00:17.997516  5014 log.cc:927] Time spent T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.674s	user 0.004s	sys 0.000s
I20260709 13:00:17.956812  4842 raft_consensus.cc:2804] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:17.813934   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:17.954965  4532 raft_consensus.cc:3060] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:17.996882  5038 log.cc:927] Time spent T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.147s	user 0.000s	sys 0.000s
I20260709 13:00:18.011107  5025 raft_consensus.cc:493] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:18.017270  4878 raft_consensus.cc:515] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:17.945187  4815 raft_consensus.cc:515] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:17.976112  1570 leader_election.cc:304] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:18.021083  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:17.957753  4946 raft_consensus.cc:515] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:18.042841  1681 raft_consensus.cc:1275] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:00:18.018994  4842 raft_consensus.cc:493] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
W20260709 13:00:18.065326  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 113222us
I20260709 13:00:18.057436  1680 raft_consensus.cc:1275] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:00:18.066424  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 90386.1us
I20260709 13:00:18.067736  1570 leader_election.cc:304] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:18.072482  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:18.072706  1570 leader_election.cc:304] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:17.992942  4912 consensus_queue.cc:1059] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:00:18.075101  4892 consensus_queue.cc:1048] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:18.075724  4710 consensus_queue.cc:1048] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:18.076728  5006 raft_consensus.cc:2804] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:18.077732  2219 raft_consensus.cc:1275] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:00:17.982782  4913 consensus_queue.cc:260] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:18.060923  5053 raft_consensus.cc:2749] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:18.028976  5025 raft_consensus.cc:3060] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:18.079344  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:18.115068  2225 raft_consensus.cc:2468] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 8.
I20260709 13:00:18.079267  1607 raft_consensus.cc:1275] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:00:18.116334  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 695) took 1389 ms. Trace:
I20260709 13:00:18.073159  1526 raft_consensus.cc:2468] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 7.
I20260709 13:00:18.083307  4866 consensus_queue.cc:260] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:18.054034  4815 leader_election.cc:290] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:18.085546  4910 raft_consensus.cc:3055] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:00:18.052230  5015 consensus_meta.cc:287] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent flushing consensus metadata: real 0.569s	user 0.008s	sys 0.001s
I20260709 13:00:18.061257  5039 consensus_queue.cc:237] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:18.089429  4867 raft_consensus.cc:515] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:18.078997  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:18.093569  1644 leader_election.cc:400] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 election: Vote denied by peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931) with higher term. Message: Invalid argument: T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for earlier term 8. Current term is 9.
I20260709 13:00:18.099321  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:18.148702  1644 leader_election.cc:403] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:00:18.148934  2222 raft_consensus.cc:2468] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 7.
I20260709 13:00:18.103785  3934 consensus_queue.cc:1059] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:18.116684  1607 rpcz_store.cc:276] 0709 13:00:16.726649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:16.752485 (+ 25836us) service_pool.cc:224] Handling call
0709 13:00:16.815100 (+ 62615us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:17.460982 (+645882us) spinlock_profiling.cc:243] Waited 4.18 ms on lock 0x7b5400188920. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a1853106f 00007f6a185a9f60 00007f6a185ab7de 00007f6a185b5b49 00007f6a185b6416 00007f6a185b2d8f 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62
0709 13:00:18.078950 (+617968us) spinlock_profiling.cc:243] Waited 7.12 ms on lock 0x7b5400188920. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a1852adc0 00007f6a185b5d87 00007f6a185b6470 00007f6a185b2d8f 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c
0709 13:00:18.116053 (+ 37103us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:18.116274 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":25996800}
I20260709 13:00:18.069541  4842 raft_consensus.cc:3060] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:18.135378  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:18.138067  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:18.154525  2219 raft_consensus.cc:2468] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 4.
I20260709 13:00:18.136179  4802 raft_consensus.cc:2804] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:18.142807  4878 leader_election.cc:290] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:18.135219  5050 raft_consensus.cc:2804] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:18.100899  5006 raft_consensus.cc:493] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:18.160482  1570 leader_election.cc:304] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:18.103940  4865 raft_consensus.cc:493] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:18.210316  5006 raft_consensus.cc:3060] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:18.162914  4866 raft_consensus.cc:3060] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:18.181731  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:18.203820  4802 raft_consensus.cc:697] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 8 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:18.167996  5050 raft_consensus.cc:493] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:18.226994  1530 raft_consensus.cc:2393] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 8: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:00:18.039660  4872 consensus_queue.cc:260] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:00:18.188524  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 120400us
I20260709 13:00:18.187755  5053 consensus_queue.cc:1048] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:00:18.224270  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:18.114953  5032 raft_consensus.cc:515] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:18.139425  4910 raft_consensus.cc:740] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:18.159726  5015 raft_consensus.cc:515] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:00:18.359050  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 115430us
I20260709 13:00:18.358587  1644 leader_election.cc:304] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
W20260709 13:00:18.372017  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 269366us
I20260709 13:00:18.375440  4990 raft_consensus.cc:2804] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:18.458364  4990 raft_consensus.cc:697] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 7 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
W20260709 13:00:18.459003  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 323905us
I20260709 13:00:18.459446  4990 consensus_queue.cc:237] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:18.460917  5044 consensus_queue.cc:1048] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:18.461440  2190 leader_election.cc:304] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:18.372673  4885 raft_consensus.cc:2749] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931) with higher term. Message: Invalid argument: T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for earlier term 8. Current term is 9.
I20260709 13:00:18.463318  4758 raft_consensus.cc:2804] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:18.400174  4912 consensus_queue.cc:1059] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 13:00:18.463698  4758 raft_consensus.cc:493] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:18.460038  1570 leader_election.cc:304] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:18.464757  1570 leader_election.cc:304] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:18.464881  4678 raft_consensus.cc:2804] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:18.465277  4678 raft_consensus.cc:493] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:18.465468  5049 raft_consensus.cc:2749] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:18.465616  4678 raft_consensus.cc:3060] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:18.467011  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:18.467588  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 441408us
I20260709 13:00:18.421216  1672 raft_consensus.cc:1240] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:18.466709  1570 leader_election.cc:304] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:18.475495  4710 raft_consensus.cc:2804] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:18.475898  4710 raft_consensus.cc:493] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:18.476262  4710 raft_consensus.cc:3060] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:18.481031  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:18.481859  1526 raft_consensus.cc:2393] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 6: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:00:18.483775  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:18.484431  1681 raft_consensus.cc:1240] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:00:18.484483  1526 raft_consensus.cc:2393] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 10: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:00:18.485899  1679 raft_consensus.cc:1275] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:00:18.486359  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:18.485917  1675 raft_consensus.cc:1275] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:00:18.488531  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:18.489493  4913 raft_consensus.cc:3060] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:18.490474  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:18.492584  1497 leader_election.cc:304] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:18.494115  3934 raft_consensus.cc:3060] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:18.495018  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:18.496451  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:18.497113  1528 raft_consensus.cc:2393] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 10: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:00:18.498482  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:18.499125  1528 raft_consensus.cc:2393] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 6: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:00:18.501322  1497 leader_election.cc:304] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:18.504971  1497 leader_election.cc:304] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:18.515158  5049 consensus_queue.cc:1048] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:18.520181  5030 leader_election.cc:290] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:18.520816  5030 raft_consensus.cc:2749] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:18.521513  1606 raft_consensus.cc:1275] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 6. (term mismatch)
I20260709 13:00:18.521862  1606 pending_rounds.cc:85] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642: Aborting all ops after (but not including) 5
I20260709 13:00:18.522090  1606 pending_rounds.cc:107] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642: Aborting uncommitted NO_OP operation due to leader change: 6.6
I20260709 13:00:18.522318  1606 raft_consensus.cc:2889] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:18.523823  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:18.524367  1606 raft_consensus.cc:2376] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 7. Re-sending same reply.
W20260709 13:00:18.524930  5055 log.cc:927] Time spent T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.233s	user 0.000s	sys 0.001s
I20260709 13:00:18.525614  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:18.529809  4867 leader_election.cc:290] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:18.534699  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:18.534638  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:18.536469  1606 raft_consensus.cc:2468] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 8.
I20260709 13:00:18.537786  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:18.539119  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:18.541036  1603 raft_consensus.cc:1275] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:00:18.541916  5054 raft_consensus.cc:3055] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:18.542325  5054 raft_consensus.cc:740] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:18.542439  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:18.545959  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:18.546195  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:18.546734  1607 raft_consensus.cc:2393] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 11: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:00:18.521442  5030 raft_consensus.cc:2749] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:18.547052  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:18.546730  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
W20260709 13:00:18.548543  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 190040us
I20260709 13:00:18.549573  1644 leader_election.cc:304] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:00:18.550966  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:18.553520  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:18.554186  1601 raft_consensus.cc:1275] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:18.360170  5050 raft_consensus.cc:3060] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:18.464097  4758 raft_consensus.cc:3060] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:18.424492  4872 raft_consensus.cc:3060] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:18.575476  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:18.469983  4786 raft_consensus.cc:493] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:18.357184  4865 raft_consensus.cc:515] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:18.567821  4885 raft_consensus.cc:2804] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:00:18.582137  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 418614us
I20260709 13:00:18.472962  5015 leader_election.cc:290] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:18.582644  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:18.586040  3934 raft_consensus.cc:2749] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:18.582350  4958 raft_consensus.cc:493] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:18.570487  4862 consensus_queue.cc:1048] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:00:18.573238  4892 consensus_queue.cc:1048] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:00:18.457237  5056 consensus_queue.cc:1059] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.472s
I20260709 13:00:18.641259  1646 leader_election.cc:304] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:18.589874  4711 raft_consensus.cc:2749] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:00:18.588230  4621 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.014s	sys 0.029s
I20260709 13:00:18.601055  4885 raft_consensus.cc:493] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:18.689756  1680 raft_consensus.cc:1275] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:00:18.575927  4802 consensus_queue.cc:237] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:18.622949  4912 consensus_queue.cc:1059] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.085s
W20260709 13:00:18.653632  5028 consensus_meta.cc:287] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.654s	user 0.008s	sys 0.002s
W20260709 13:00:18.652611  5023 consensus_meta.cc:287] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.718s	user 0.005s	sys 0.005s
I20260709 13:00:18.792908  4865 leader_election.cc:290] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:18.792757  5023 raft_consensus.cc:515] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:18.658697  4505 leader_election.cc:290] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 8 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:18.795200  5023 leader_election.cc:290] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:00:18.796705  5025 consensus_meta.cc:287] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.636s	user 0.008s	sys 0.000s
I20260709 13:00:18.797154  5025 raft_consensus.cc:515] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:18.743515  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:18.803239  1681 raft_consensus.cc:2393] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 10: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
W20260709 13:00:18.659116  4532 consensus_meta.cc:287] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.613s	user 0.007s	sys 0.003s
I20260709 13:00:18.804230  4532 raft_consensus.cc:515] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:18.659366  4842 raft_consensus.cc:515] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:18.806250  4532 leader_election.cc:290] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:18.572710  4910 consensus_queue.cc:260] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:18.687260  5024 consensus_meta.cc:287] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.875s	user 0.008s	sys 0.003s
I20260709 13:00:18.807817  5024 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:18.624078  4878 consensus_queue.cc:1059] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 13:00:18.652022  4946 leader_election.cc:290] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:18.591326  4786 raft_consensus.cc:515] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:18.812543  4786 leader_election.cc:290] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:18.753207  5029 consensus_queue.cc:1059] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.248s
I20260709 13:00:18.813867  5029 raft_consensus.cc:493] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:18.543283  5054 consensus_queue.cc:260] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:18.815287  5032 leader_election.cc:290] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:18.815474  5054 raft_consensus.cc:3060] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:18.816875  5032 raft_consensus.cc:3055] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:18.817237  5032 raft_consensus.cc:740] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:18.818027  5032 consensus_queue.cc:260] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:18.807284  4842 leader_election.cc:290] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:18.814365  5029 raft_consensus.cc:515] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:18.818981  4912 raft_consensus.cc:3055] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:00:18.742561  5058 log.cc:927] Time spent T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.310s	user 0.001s	sys 0.000s
I20260709 13:00:18.792634  5028 raft_consensus.cc:515] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:18.770184  1675 raft_consensus.cc:1240] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:18.688546  4885 raft_consensus.cc:3060] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:18.791332  5063 log.cc:927] Time spent T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:00:18.810403  5024 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:18.822260  4862 raft_consensus.cc:3055] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:00:18.753063  5057 log.cc:927] Time spent T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.283s	user 0.000s	sys 0.000s
I20260709 13:00:18.743002  5065 raft_consensus.cc:3055] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:18.831187  4946 raft_consensus.cc:493] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
W20260709 13:00:18.851825  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 279973us
I20260709 13:00:18.751590  5067 consensus_queue.cc:1059] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.372s
W20260709 13:00:18.656947  4887 consensus_meta.cc:287] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.828s	user 0.008s	sys 0.002s
I20260709 13:00:18.649670  4958 raft_consensus.cc:515] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:18.831908  5031 consensus_meta.cc:287] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 1.014s	user 0.006s	sys 0.005s
W20260709 13:00:18.657114  4804 consensus_meta.cc:287] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.801s	user 0.006s	sys 0.005s
I20260709 13:00:18.833009  4912 raft_consensus.cc:740] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
W20260709 13:00:18.764526  4621 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.730s	user 0.016s	sys 0.030s
I20260709 13:00:18.855350  5065 raft_consensus.cc:740] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
W20260709 13:00:18.886317  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:18.921718  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:18.894280  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 389396us
I20260709 13:00:18.850687  4862 raft_consensus.cc:740] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
W20260709 13:00:18.867599  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 414677us
I20260709 13:00:18.924791  1570 leader_election.cc:304] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:18.897522  5024 raft_consensus.cc:3055] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:18.931890  1497 leader_election.cc:304] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:18.935278  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
W20260709 13:00:18.928020  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 286869us
I20260709 13:00:18.919123  4711 raft_consensus.cc:2749] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:18.947300  5028 leader_election.cc:290] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:18.948252  4912 consensus_queue.cc:260] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:18.949537  4912 raft_consensus.cc:3060] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:18.931735  5024 raft_consensus.cc:740] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:18.951889  5024 consensus_queue.cc:260] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:18.952994  5024 raft_consensus.cc:3060] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:18.867789  4946 raft_consensus.cc:515] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:18.957418  4946 leader_election.cc:290] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:00:18.934973  4866 consensus_meta.cc:287] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.576s	user 0.006s	sys 0.002s
I20260709 13:00:18.958704  1600 raft_consensus.cc:2410] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:00:18.960834  1600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36200 (request call id 2125) took 1307 ms. Trace:
I20260709 13:00:18.961221  1600 rpcz_store.cc:276] 0709 13:00:17.653513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:17.821711 (+168198us) service_pool.cc:224] Handling call
0709 13:00:18.960588 (+1138877us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b540035f7d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:18.960740 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2587088256}
I20260709 13:00:18.962026  1526 raft_consensus.cc:2410] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:00:18.964637  4892 raft_consensus.cc:2749] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:00:18.965031  5062 log.cc:927] Time spent T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.335s	user 0.005s	sys 0.002s
I20260709 13:00:18.970836  4990 raft_consensus.cc:493] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:18.940987  5067 raft_consensus.cc:493] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:18.942875  4862 consensus_queue.cc:260] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:18.974164  2192 leader_election.cc:304] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:18.975167  1497 leader_election.cc:304] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:18.923595  5025 leader_election.cc:290] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:18.928738  5041 raft_consensus.cc:493] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:18.894364  4887 raft_consensus.cc:515] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:18.984521  1497 leader_election.cc:304] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:18.942723  5089 raft_consensus.cc:493] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
W20260709 13:00:18.979008  5006 consensus_meta.cc:287] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.603s	user 0.009s	sys 0.000s
I20260709 13:00:19.004484  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:18.971436  4990 raft_consensus.cc:515] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:19.011729  1681 raft_consensus.cc:1240] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:19.180295  2226 raft_consensus.cc:1240] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 8 LEADER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:19.030741  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 13:00:19.081584  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:19.191395  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:19.107964  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:19.031389  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:19.201702  2225 raft_consensus.cc:2468] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 8.
W20260709 13:00:19.186972  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 52987.9us
W20260709 13:00:19.194470  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 183877us
I20260709 13:00:19.029266  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:19.179224  5087 raft_consensus.cc:493] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:18.980870  4913 raft_consensus.cc:2749] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:19.198348  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:19.179072  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:18.995209  4804 raft_consensus.cc:493] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:19.101841  5050 consensus_meta.cc:287] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.514s	user 0.008s	sys 0.001s
I20260709 13:00:19.243958  2218 raft_consensus.cc:2393] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 8: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:00:19.031672  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:19.057606  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:19.063419  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:19.063692  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 13:00:19.043920  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:19.238777  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 314068us
I20260709 13:00:19.201787  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 13:00:18.999105  4710 consensus_meta.cc:287] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.520s	user 0.010s	sys 0.000s
I20260709 13:00:19.003610  4815 raft_consensus.cc:493] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:19.206598  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:19.251837  1681 raft_consensus.cc:2393] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 8: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
W20260709 13:00:19.251186  1570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:19.252708  1676 raft_consensus.cc:1240] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:19.254482  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:19.253630  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:19.003494  4505 raft_consensus.cc:2804] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:19.260928  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:19.260587  1570 leader_election.cc:304] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:19.262970  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:19.308490  1528 raft_consensus.cc:2468] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 8.
I20260709 13:00:19.000221  4862 raft_consensus.cc:3060] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:19.309273  1531 raft_consensus.cc:2368] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 8. Current term is 9.
I20260709 13:00:19.178638  5080 raft_consensus.cc:2764] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:00:19.178409  5075 raft_consensus.cc:2804] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:19.090158  5016 raft_consensus.cc:493] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:19.007860  5067 raft_consensus.cc:515] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:19.259284  4710 raft_consensus.cc:515] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:19.303094  2219 raft_consensus.cc:1240] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:00:19.305109  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:19.305946  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:19.335704  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:19.336045  1678 raft_consensus.cc:2393] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 9: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:00:19.303480  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:19.254696  5029 leader_election.cc:290] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:19.311458  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:19.315851  1674 raft_consensus.cc:1275] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:00:19.341655  2227 raft_consensus.cc:3060] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:19.304307  5086 raft_consensus.cc:493] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:19.206254  5013 raft_consensus.cc:493] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:19.323236  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:19.309160  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:19.324290  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:19.322472  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:19.245661  5015 raft_consensus.cc:493] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:19.336530  2221 raft_consensus.cc:2468] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 8.
I20260709 13:00:19.304131  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:19.348218  1600 raft_consensus.cc:3060] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:19.003556  5041 raft_consensus.cc:515] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:19.303718  4958 leader_election.cc:290] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:00:19.339282  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 78764.7us
I20260709 13:00:19.339674  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:19.240305  4865 consensus_queue.cc:1048] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.087s
I20260709 13:00:19.351064  1528 raft_consensus.cc:3060] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:19.202742  4946 raft_consensus.cc:493] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:19.078864  5089 raft_consensus.cc:515] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:19.318154  1497 leader_election.cc:304] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
W20260709 13:00:19.362421  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 44340.6us
I20260709 13:00:19.363847  1497 leader_election.cc:304] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:19.078945  4758 raft_consensus.cc:515] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:19.319315  5069 log.cc:927] Time spent T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:00:19.307603  4505 raft_consensus.cc:493] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:19.369923  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:19.370251  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:19.338567  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:19.340289  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:19.207583  4885 raft_consensus.cc:515] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:19.315048  5075 raft_consensus.cc:493] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:19.353204  1680 raft_consensus.cc:2468] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 10.
W20260709 13:00:19.339839  4678 consensus_meta.cc:287] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.874s	user 0.010s	sys 0.037s
I20260709 13:00:19.012908  5006 raft_consensus.cc:515] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:19.256217  4804 raft_consensus.cc:515] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:19.388088  1674 raft_consensus.cc:2393] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 6: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:00:19.403100  3934 raft_consensus.cc:2749] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:19.404104  1497 leader_election.cc:304] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:19.370850  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:19.307286  4815 raft_consensus.cc:515] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:19.422827  3934 raft_consensus.cc:2749] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:00:19.258496  5050 raft_consensus.cc:515] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:19.327310  4913 consensus_queue.cc:1048] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:00:19.416704  2222 raft_consensus.cc:2393] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 10: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:00:19.432401  4887 leader_election.cc:290] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:19.434365  4758 leader_election.cc:290] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 8 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:19.423746  3934 raft_consensus.cc:493] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:19.339764  4878 raft_consensus.cc:3060] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:19.437260  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:19.450186  1678 raft_consensus.cc:1240] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:19.422354  1675 raft_consensus.cc:2393] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 10: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
W20260709 13:00:19.367341  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 124568us
W20260709 13:00:19.425381  1571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:19.372052  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:19.376215  5080 raft_consensus.cc:2749] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:19.334602  5016 raft_consensus.cc:515] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:19.454128  1600 raft_consensus.cc:2468] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 6.
I20260709 13:00:19.350117  5039 consensus_queue.cc:1059] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.079s
I20260709 13:00:19.142819  5065 consensus_queue.cc:260] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:19.386842  4505 raft_consensus.cc:3060] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:19.452013  2224 raft_consensus.cc:2468] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 10.
I20260709 13:00:19.428344  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:19.452924  3934 raft_consensus.cc:515] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:19.376816  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:19.457854  1605 raft_consensus.cc:2393] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 8: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:00:19.257937  5087 raft_consensus.cc:515] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:19.358327  5013 raft_consensus.cc:515] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:19.466005  1529 raft_consensus.cc:2393] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 11: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:00:19.358546  5015 raft_consensus.cc:515] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:19.387193  5044 consensus_queue.cc:1059] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 13:00:19.367758  4946 raft_consensus.cc:515] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:19.465150  1674 raft_consensus.cc:1240] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:19.468516  2192 leader_election.cc:304] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:19.421887  5075 raft_consensus.cc:3060] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:19.466953  5066 consensus_queue.cc:1059] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:00:19.471268  3934 leader_election.cc:290] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:19.474287  2227 raft_consensus.cc:2468] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 8.
I20260709 13:00:19.475492  1646 leader_election.cc:304] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:19.368430  4958 consensus_queue.cc:1059] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.091s
I20260709 13:00:19.481767  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:19.504704  3934 consensus_queue.cc:1048] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:19.506865  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:19.415127  4678 raft_consensus.cc:515] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:19.508771  1526 raft_consensus.cc:3060] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:19.510775  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:19.511371  1529 raft_consensus.cc:2393] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 6: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
W20260709 13:00:19.512841  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 44415.3us
I20260709 13:00:19.512109  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:19.515439  2227 raft_consensus.cc:2393] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 8: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:00:19.513240  1531 raft_consensus.cc:3060] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:19.435122  5029 consensus_queue.cc:1048] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 13:00:19.352721  5086 raft_consensus.cc:515] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:19.513859  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 192627us
I20260709 13:00:19.511652  5088 consensus_queue.cc:1048] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 13:00:19.519229  4912 raft_consensus.cc:2749] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:19.467197  4758 consensus_queue.cc:1048] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.047s
W20260709 13:00:19.519726  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 44304.5us
I20260709 13:00:19.463511  5056 consensus_queue.cc:1059] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 13:00:19.520443  1674 raft_consensus.cc:1240] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:19.527304  1606 raft_consensus.cc:2393] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 8: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:00:19.532600  1531 raft_consensus.cc:2468] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 8.
W20260709 13:00:19.529531  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 125518us
I20260709 13:00:19.519435  5043 raft_consensus.cc:2749] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:19.519979  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:19.539387  1529 raft_consensus.cc:2393] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 9: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:00:19.532145  2192 leader_election.cc:304] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:19.536762  1497 leader_election.cc:304] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:19.537106  2190 leader_election.cc:304] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
W20260709 13:00:19.540273  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 234941us
I20260709 13:00:19.538321  1646 leader_election.cc:304] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:19.545243  2227 raft_consensus.cc:1275] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:00:19.546797  1674 raft_consensus.cc:1240] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:19.549012  2192 leader_election.cc:304] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:19.510116  4621 consensus_queue.cc:1048] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:00:19.574895  1497 leader_election.cc:304] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
W20260709 13:00:19.549093  1572 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.196:37373 timed out after 1.745s (SENT) [suppressed 31 similar messages]
W20260709 13:00:19.585024  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:19.585440  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:19.585942  4887 raft_consensus.cc:493] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:19.586431  4887 raft_consensus.cc:515] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:19.586627  1572 leader_election.cc:304] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:19.587980  5093 consensus_queue.cc:1059] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:19.588693  4887 leader_election.cc:290] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:00:19.531706  5024 consensus_meta.cc:287] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.578s	user 0.012s	sys 0.000s
I20260709 13:00:19.463689  5027 consensus_queue.cc:1048] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.082s
I20260709 13:00:19.589298  4887 raft_consensus.cc:2749] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:19.595860  1497 leader_election.cc:304] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
W20260709 13:00:19.596153  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 57903.4us
I20260709 13:00:19.596415  3934 raft_consensus.cc:2804] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:19.576292  5066 raft_consensus.cc:2749] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:19.576588  5039 raft_consensus.cc:493] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:19.686556  5039 raft_consensus.cc:515] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:19.688900  5039 leader_election.cc:290] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:19.573539  5080 raft_consensus.cc:2804] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:19.674644  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:19.581602  4990 leader_election.cc:290] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:19.690475  5089 leader_election.cc:290] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:19.690907  2227 raft_consensus.cc:1240] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:19.691429  4804 leader_election.cc:290] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:19.582852  4912 raft_consensus.cc:2804] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:00:19.697283  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 101494us
I20260709 13:00:19.698230  1497 leader_election.cc:304] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:19.676086  4758 raft_consensus.cc:493] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:19.681720  4815 leader_election.cc:290] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:19.681910  5085 raft_consensus.cc:2804] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:00:19.682833  5084 log.cc:927] Time spent T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.215s	user 0.001s	sys 0.000s
I20260709 13:00:19.578444  5025 raft_consensus.cc:493] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:19.692628  5016 leader_election.cc:290] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:00:19.684418  5095 log.cc:927] Time spent T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.177s	user 0.000s	sys 0.000s
I20260709 13:00:19.685341  4710 leader_election.cc:290] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:19.685627  5067 leader_election.cc:290] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:00:19.683619  5090 log.cc:927] Time spent T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.230s	user 0.001s	sys 0.000s
I20260709 13:00:19.685473  4958 raft_consensus.cc:2804] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:19.693111  4912 raft_consensus.cc:493] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
W20260709 13:00:19.778736  1570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:19.766924  5016 raft_consensus.cc:2749] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:19.765739  4892 raft_consensus.cc:493] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:19.770603  4912 raft_consensus.cc:3060] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:19.726603  5025 raft_consensus.cc:515] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:19.724399  4758 raft_consensus.cc:515] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:19.740157  5085 raft_consensus.cc:697] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 8 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:19.767900  4958 raft_consensus.cc:493] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:19.821646  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 272103us
W20260709 13:00:19.793558  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 244625us
I20260709 13:00:19.820624  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49170 (request call id 1954) took 1332 ms. Trace:
I20260709 13:00:19.785068  4885 leader_election.cc:290] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
W20260709 13:00:19.794291  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 125560us
I20260709 13:00:19.777329  4710 raft_consensus.cc:493] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:19.780283  5050 leader_election.cc:290] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:19.792192  5015 leader_election.cc:290] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:19.823117  1677 rpcz_store.cc:276] 0709 13:00:18.484047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:18.487271 (+  3224us) service_pool.cc:224] Handling call
0709 13:00:18.487531 (+   260us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:18.592520 (+104989us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:18.592550 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:18.599267 (+  6717us) log.cc:844] Serialized 26 byte log entry
0709 13:00:18.903248 (+303981us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:18.903286 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:18.904043 (+   757us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:19.815963 (+911920us) raft_consensus.cc:1685] finished
0709 13:00:19.815982 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:19.816115 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":98870,"raft.queue_time_us":316591,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":135,"thread_start_us":303607,"threads_started":1,"wal-append.queue_time_us":824917}
I20260709 13:00:19.824908  2192 leader_election.cc:304] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:00:19.816351  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 229818us
I20260709 13:00:19.789294  5006 leader_election.cc:290] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:19.833117  1572 leader_election.cc:304] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:19.833772  1526 raft_consensus.cc:2468] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 8.
W20260709 13:00:19.834153  4862 consensus_meta.cc:287] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.518s	user 0.008s	sys 0.001s
W20260709 13:00:19.834728  5097 log.cc:927] Time spent T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.139s	user 0.002s	sys 0.000s
W20260709 13:00:19.828886  1679 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.055s	sys 0.059s
I20260709 13:00:19.842957  1529 raft_consensus.cc:1240] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
W20260709 13:00:19.844846  1679 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.056s	sys 0.059s
I20260709 13:00:19.823990  4958 raft_consensus.cc:3060] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:19.822271  5093 consensus_queue.cc:1243] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer b96ce9cc496c49d7818fa983a17b062b log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:00:19.848507  1526 raft_consensus.cc:1240] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:19.802155  4892 raft_consensus.cc:515] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:19.851636  1526 raft_consensus.cc:1275] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:00:19.853549  1528 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 10.
I20260709 13:00:19.852972  1531 raft_consensus.cc:1275] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:00:19.856797  2192 leader_election.cc:304] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:19.858568  1526 raft_consensus.cc:1240] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:00:19.848851  5016 raft_consensus.cc:493] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:19.860220  5016 raft_consensus.cc:515] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:19.864466  1528 raft_consensus.cc:1275] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:19.859856  1526 raft_consensus.cc:1240] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:19.866783  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 707) took 1329 ms. Trace:
I20260709 13:00:19.867252  1606 rpcz_store.cc:276] 0709 13:00:18.537455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:18.537563 (+   108us) service_pool.cc:224] Handling call
0709 13:00:19.866534 (+1328971us) spinlock_profiling.cc:243] Waited 989 ms on lock 0x7b540037e1d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:19.866712 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2274043136}
I20260709 13:00:19.871219  5016 leader_election.cc:290] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:19.830312  4710 raft_consensus.cc:515] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:19.875319  4710 leader_election.cc:290] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:19.872426  1531 raft_consensus.cc:1275] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:00:19.832347  5013 leader_election.cc:290] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:19.896409  1531 pending_rounds.cc:85] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting all ops after (but not including) 4
I20260709 13:00:19.897663  1531 pending_rounds.cc:107] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:00:19.898823  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:19.899750  1606 raft_consensus.cc:2468] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 9.
I20260709 13:00:19.901001  1531 raft_consensus.cc:2889] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:19.902523  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:19.907655  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:19.910027  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:19.910800  1607 raft_consensus.cc:2468] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 9.
W20260709 13:00:19.926292  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 93259.6us
I20260709 13:00:19.927819  1572 leader_election.cc:304] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:19.931241  5105 raft_consensus.cc:2749] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:00:19.932152  5113 raft_consensus.cc:493] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:19.932855  5113 raft_consensus.cc:515] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:19.934844  5116 raft_consensus.cc:2749] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:19.935586  5114 consensus_queue.cc:1048] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.078s
I20260709 13:00:19.937588  5110 raft_consensus.cc:493] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:19.938212  5110 raft_consensus.cc:515] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:19.940582  5110 leader_election.cc:290] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:19.941664  5113 leader_election.cc:290] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:19.894021  5025 leader_election.cc:290] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
W20260709 13:00:19.855929  5096 log.cc:927] Time spent T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.142s	user 0.002s	sys 0.000s
I20260709 13:00:19.962610  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:20.008466  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
W20260709 13:00:20.009938  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 94274.9us
I20260709 13:00:20.010833  2192 leader_election.cc:304] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90
W20260709 13:00:20.013449  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 315326us
W20260709 13:00:20.078130  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 150380us
I20260709 13:00:20.079228  1572 leader_election.cc:304] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:20.080507  1572 leader_election.cc:304] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:20.076177  1606 raft_consensus.cc:2376] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 7. Re-sending same reply.
I20260709 13:00:19.852511  4678 leader_election.cc:290] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:19.894083  4965 raft_consensus.cc:2749] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:19.893832  4862 raft_consensus.cc:2749] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:20.130275  1524 raft_consensus.cc:1240] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:20.131811  1524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43010 (request call id 2003) took 1132 ms. Trace:
I20260709 13:00:20.132285  1524 rpcz_store.cc:276] 0709 13:00:18.998882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:18.998994 (+   112us) service_pool.cc:224] Handling call
0709 13:00:20.129587 (+1130593us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b5800002a98. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a1548eb71 00007f6a1548ea22 00007f6a1e3a7c09 00007f6a1d501ee0 00007f6a1d5cb0ab 00007f6a1d5cb131 00007f6a1d58cfc0 00007f6a1d577929 00007f6a1d5773d2 00007f6a16aeebd4
0709 13:00:20.130078 (+   491us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:20.130931 (+   853us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:20.131738 (+   807us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":28174208}
I20260709 13:00:20.132862  1572 leader_election.cc:304] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
W20260709 13:00:20.114794  2218 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.001s	sys 0.014s
W20260709 13:00:20.135303  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 58727.8us
I20260709 13:00:20.136286  1497 leader_election.cc:304] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:19.900161  5086 leader_election.cc:290] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:00:20.135627  2218 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.002s	sys 0.015s
I20260709 13:00:20.116035  5109 raft_consensus.cc:2749] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:00:20.107436  5103 log.cc:927] Time spent T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.379s	user 0.001s	sys 0.000s
I20260709 13:00:20.008033  5105 raft_consensus.cc:493] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.143827  1673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49170 (request call id 1955) took 1659 ms. Trace:
I20260709 13:00:20.148087  1497 leader_election.cc:304] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:20.149212  5032 raft_consensus.cc:3060] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:20.142180  5109 raft_consensus.cc:2749] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:20.141932  5104 consensus_queue.cc:1048] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 13:00:20.151865  1679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49170 (request call id 1961) took 1148 ms. Trace:
I20260709 13:00:20.166311  1605 raft_consensus.cc:3055] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:20.229506  1605 raft_consensus.cc:740] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:20.166900  1673 rpcz_store.cc:276] 0709 13:00:18.484347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:18.487829 (+  3482us) service_pool.cc:224] Handling call
0709 13:00:18.488114 (+   285us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:18.921947 (+433833us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:18.921981 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:18.940329 (+ 18348us) log.cc:844] Serialized 26 byte log entry
0709 13:00:19.327606 (+387277us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:19.327637 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:19.327690 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:20.143606 (+815916us) raft_consensus.cc:1685] finished
0709 13:00:20.143629 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:20.143765 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":104166,"raft.queue_time_us":316292,"raft.run_cpu_time_us":51,"raft.run_wall_time_us":52,"thread_start_us":627201,"threads_started":2,"wal-append.queue_time_us":534877}
W20260709 13:00:20.126351  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 115603us
I20260709 13:00:20.232597  2192 leader_election.cc:304] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:00:20.233310  1646 leader_election.cc:304] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:20.127810  5110 raft_consensus.cc:2804] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:20.228188  1679 rpcz_store.cc:276] 0709 13:00:19.003742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:19.003861 (+   119us) service_pool.cc:224] Handling call
0709 13:00:19.004292 (+   431us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:19.099787 (+ 95495us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:19.099819 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:19.188952 (+ 89133us) log.cc:844] Serialized 26 byte log entry
0709 13:00:19.845305 (+656353us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:19.845350 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:19.845431 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:20.151607 (+306176us) raft_consensus.cc:1685] finished
0709 13:00:20.151634 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:20.151796 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":70082,"raft.queue_time_us":97643,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":12977,"thread_start_us":605020,"threads_started":1,"wal-append.queue_time_us":910060}
I20260709 13:00:20.118541  5006 raft_consensus.cc:2749] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:00:20.238765  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 90764.5us
I20260709 13:00:20.241489  1497 leader_election.cc:304] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:20.243535  1497 leader_election.cc:304] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:20.134379  5113 raft_consensus.cc:2804] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:00:20.240176  3934 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.030s	sys 0.041s
I20260709 13:00:20.109704  5087 leader_election.cc:290] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:20.245770  1497 leader_election.cc:304] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:20.246551  2192 leader_election.cc:304] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
W20260709 13:00:20.248276  3934 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.030s	sys 0.041s
I20260709 13:00:20.260099  3934 raft_consensus.cc:697] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:00:20.260933  3934 consensus_queue.cc:237] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:20.248473  5015 raft_consensus.cc:2749] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:20.262902  4965 raft_consensus.cc:2804] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:20.263411  4965 raft_consensus.cc:493] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:20.248574  5067 raft_consensus.cc:2804] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:20.263775  4965 raft_consensus.cc:3060] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:20.264214  5067 raft_consensus.cc:697] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 6 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:20.248636  5016 raft_consensus.cc:2749] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:20.249284  1605 consensus_queue.cc:260] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:20.266685  1605 raft_consensus.cc:3060] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:20.267194  5107 log.cc:927] Time spent T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.368s	user 0.001s	sys 0.000s
I20260709 13:00:20.166324  5086 raft_consensus.cc:493] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.269250  5086 raft_consensus.cc:515] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:20.271502  5086 leader_election.cc:290] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:20.117702  5085 consensus_queue.cc:237] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:20.272603  5113 raft_consensus.cc:493] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:20.275336  4758 leader_election.cc:290] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:20.250950  1497 leader_election.cc:304] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
W20260709 13:00:20.304219  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 57736us
I20260709 13:00:20.306049  1605 raft_consensus.cc:1275] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:00:20.303651  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 52769.2us
I20260709 13:00:20.309641  1497 leader_election.cc:304] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
W20260709 13:00:20.241130  5102 log.cc:927] Time spent T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.449s	user 0.001s	sys 0.000s
W20260709 13:00:20.319886  2191 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.726s	user 0.000s	sys 0.015s
W20260709 13:00:20.320245  2191 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.726s	user 0.000s	sys 0.015s
I20260709 13:00:20.241479  5110 raft_consensus.cc:493] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:20.311153  1570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:20.249354  4878 consensus_meta.cc:287] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.792s	user 0.009s	sys 0.000s
I20260709 13:00:20.311640  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:20.250157  5104 raft_consensus.cc:2749] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:20.327183  4878 raft_consensus.cc:2749] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:20.327641  1600 raft_consensus.cc:2468] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 8.
W20260709 13:00:20.293143  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 146273us
W20260709 13:00:20.253499  4505 consensus_meta.cc:287] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b: Time spent flushing consensus metadata: real 0.772s	user 0.004s	sys 0.004s
I20260709 13:00:20.249295  4892 leader_election.cc:290] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:20.252542  4190 raft_consensus.cc:3055] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:20.251775  4865 raft_consensus.cc:3055] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:20.327824  5104 raft_consensus.cc:3060] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:20.277878  5086 raft_consensus.cc:493] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:20.334049  2192 leader_election.cc:304] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:00:20.335491  1527 raft_consensus.cc:1240] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 LEADER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:00:20.335951  1644 leader_election.cc:304] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:20.324710  5013 raft_consensus.cc:2749] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:20.337663  1605 raft_consensus.cc:1240] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 6. Current term is 7. Ops: []
W20260709 13:00:20.338824  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 206136us
I20260709 13:00:20.311609  5015 raft_consensus.cc:2804] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:20.336954  1570 leader_election.cc:304] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:20.342939  1646 leader_election.cc:304] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:20.275449  5113 raft_consensus.cc:3060] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:20.332072  5110 raft_consensus.cc:3060] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:20.345858  1600 raft_consensus.cc:1275] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:00:20.347692  1644 leader_election.cc:304] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:20.339983  4190 raft_consensus.cc:740] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:20.349718  5071 raft_consensus.cc:493] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.358876  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:20.359175  5122 raft_consensus.cc:493] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.359652  1599 raft_consensus.cc:2393] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 7: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:00:20.336905  4815 consensus_queue.cc:1048] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 13:00:20.339532  4865 raft_consensus.cc:740] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:20.351681  4885 raft_consensus.cc:2804] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:20.338266  4505 raft_consensus.cc:515] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:20.351203  5049 raft_consensus.cc:2749] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:20.368853  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:20.356426  5015 raft_consensus.cc:697] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:00:20.362316  5066 raft_consensus.cc:2804] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:20.377935  4865 consensus_queue.cc:260] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:20.346621  5086 raft_consensus.cc:515] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:20.385994  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43010 (request call id 2006) took 1379 ms. Trace:
I20260709 13:00:20.392143  3934 raft_consensus.cc:493] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:20.392933  2223 raft_consensus.cc:2393] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 7: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:00:20.389619  1532 rpcz_store.cc:276] 0709 13:00:19.006894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:19.007023 (+   129us) service_pool.cc:224] Handling call
0709 13:00:19.007353 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:19.063087 (+ 55734us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:19.063121 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:19.256366 (+193245us) log.cc:844] Serialized 26 byte log entry
0709 13:00:19.532476 (+276110us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:19.533069 (+   593us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:19.534064 (+   995us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:20.385746 (+851682us) raft_consensus.cc:1685] finished
0709 13:00:20.385767 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:20.385921 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":49258,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":21705,"thread_start_us":188306,"threads_started":1,"wal-append.queue_time_us":411802}
I20260709 13:00:20.398862  4190 consensus_queue.cc:260] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:20.400210  4190 raft_consensus.cc:3060] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:20.400641  5041 leader_election.cc:290] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:20.402168  2222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50310 (request call id 688) took 1371 ms. Trace:
W20260709 13:00:20.402727  4878 consensus_queue.cc:1175] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" responder_term: 10 status { last_received { term: 9 index: 7 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 9. Current term is 10. Ops: [9.8-9.8]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:00:20.403613  1680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50664 (request call id 740) took 1206 ms. Trace:
I20260709 13:00:20.404032  1680 rpcz_store.cc:276] 0709 13:00:19.197006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:19.198065 (+  1059us) service_pool.cc:224] Handling call
0709 13:00:20.403368 (+1205303us) spinlock_profiling.cc:243] Waited 115 ms on lock 0x7b5400304154. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:20.403518 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":265356672}
I20260709 13:00:20.405205  5015 consensus_queue.cc:237] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:20.407574  5115 raft_consensus.cc:2749] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:00:20.408473  5115 raft_consensus.cc:493] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:20.409804  1672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49170 (request call id 1960) took 1414 ms. Trace:
I20260709 13:00:20.379060  4842 consensus_queue.cc:1048] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:00:20.368732  4885 raft_consensus.cc:493] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:20.368458  5087 raft_consensus.cc:2764] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:00:20.402550  2222 rpcz_store.cc:276] 0709 13:00:19.030314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:19.030462 (+   148us) service_pool.cc:224] Handling call
0709 13:00:20.401935 (+1371473us) spinlock_profiling.cc:243] Waited 226 ms on lock 0x7b5400657a54. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:20.402074 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":519033216}
I20260709 13:00:20.410171  1672 rpcz_store.cc:276] 0709 13:00:18.995615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:19.003362 (+  7747us) service_pool.cc:224] Handling call
0709 13:00:19.064007 (+ 60645us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:19.463159 (+399152us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:19.463192 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:19.482187 (+ 18995us) log.cc:844] Serialized 26 byte log entry
0709 13:00:19.788568 (+306381us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:19.788613 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:20.409399 (+620786us) spinlock_profiling.cc:243] Waited 374 ms on lock 0x7b540010c554. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:00:20.409450 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:20.409497 (+    47us) raft_consensus.cc:1685] finished
0709 13:00:20.409510 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:20.409744 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9184,"raft.queue_time_us":10366,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":14540,"spinlock_wait_cycles":860022656,"thread_start_us":256196,"threads_started":1,"wal-append.queue_time_us":305426}
I20260709 13:00:20.392675  3934 raft_consensus.cc:515] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:20.236656  5105 raft_consensus.cc:515] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:20.409004  5115 raft_consensus.cc:515] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:20.385787  5112 raft_consensus.cc:2804] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:20.385135  5016 raft_consensus.cc:493] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.422312  5006 raft_consensus.cc:493] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.359633  5122 raft_consensus.cc:515] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:20.424443  4505 leader_election.cc:290] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:20.375928  4758 consensus_queue.cc:1059] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:00:20.358069  5067 consensus_queue.cc:237] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:20.385320  5066 raft_consensus.cc:493] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
W20260709 13:00:20.421820  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 45944.9us
I20260709 13:00:20.378552  4710 consensus_queue.cc:1048] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:00:20.364867  5071 raft_consensus.cc:515] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:20.444507  1497 leader_election.cc:304] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:20.416287  4885 raft_consensus.cc:3060] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:20.446921  3934 leader_election.cc:290] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:20.465052  3934 raft_consensus.cc:2804] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:20.465420  3934 raft_consensus.cc:493] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:20.465806  3934 raft_consensus.cc:3060] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:20.460788  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:20.466818  1599 raft_consensus.cc:3060] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:20.456777  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:20.459100  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 13:00:20.456333  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 108620us
I20260709 13:00:20.463816  1497 leader_election.cc:304] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:20.438771  5070 raft_consensus.cc:2749] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:20.471360  1532 raft_consensus.cc:2393] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 7: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:00:20.472681  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:20.476147  1524 raft_consensus.cc:2468] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 6.
I20260709 13:00:20.472411  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:20.472959  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:20.477490  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:20.477572  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:20.479681  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:20.480630  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:20.481144  1531 raft_consensus.cc:2468] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 6.
I20260709 13:00:20.481843  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:20.478442  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:20.485605  1530 raft_consensus.cc:2393] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 8: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:00:20.487114  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:20.488013  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:20.450299  4842 raft_consensus.cc:493] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:00:20.447781  5119 raft_consensus.cc:493] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.455106  5066 raft_consensus.cc:3060] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:20.520921  5119 raft_consensus.cc:515] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:20.510176  5086 leader_election.cc:290] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:20.523186  5119 leader_election.cc:290] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:20.471517  4678 consensus_queue.cc:1048] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.054s
I20260709 13:00:20.492903  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:20.527264  1530 raft_consensus.cc:2368] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 8. Current term is 9.
I20260709 13:00:20.528000  5110 raft_consensus.cc:515] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:20.528745  3934 raft_consensus.cc:515] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:20.448982  5112 raft_consensus.cc:697] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 8 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:20.494515  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:20.529358  5066 raft_consensus.cc:515] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:20.530491  1532 raft_consensus.cc:2393] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 11: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:00:20.492764  5015 raft_consensus.cc:2749] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:20.496094  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:20.500048  5064 raft_consensus.cc:3055] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:20.494505  5125 consensus_queue.cc:1048] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 13:00:20.486215  4878 consensus_queue.cc:1048] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:00:20.507191  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:20.509011  5071 leader_election.cc:290] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
W20260709 13:00:20.509701  5075 consensus_meta.cc:287] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent flushing consensus metadata: real 0.979s	user 0.008s	sys 0.000s
I20260709 13:00:20.471686  5050 consensus_queue.cc:1059] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:00:20.510241  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:20.447518  5006 raft_consensus.cc:515] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:20.511720  4842 raft_consensus.cc:515] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:20.466301  5049 raft_consensus.cc:493] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.494465  5088 consensus_queue.cc:1059] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:00:20.470593  5093 raft_consensus.cc:493] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.515997  5105 leader_election.cc:290] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:00:20.518491  4958 consensus_meta.cc:287] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b: Time spent flushing consensus metadata: real 0.663s	user 0.007s	sys 0.001s
I20260709 13:00:20.531945  1524 raft_consensus.cc:2468] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 7.
I20260709 13:00:20.542004  1599 raft_consensus.cc:2468] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 7.
I20260709 13:00:20.531912  1527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43010 (request call id 2004) took 1532 ms. Trace:
I20260709 13:00:20.576769  1527 rpcz_store.cc:276] 0709 13:00:18.999191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:18.999313 (+   122us) service_pool.cc:224] Handling call
0709 13:00:19.809641 (+810328us) spinlock_profiling.cc:243] Waited 886 us on lock 0x7b5800002a98. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a1548eb71 00007f6a1548ea22 00007f6a1e3a7c09 00007f6a1d501ee0 00007f6a1d5cb0ab 00007f6a1d5cb131 00007f6a1d58cfc0 00007f6a1d577929 00007f6a1d5773d2 00007f6a16aeebd4
0709 13:00:19.809831 (+   190us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:20.350359 (+540528us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:20.531682 (+181323us) spinlock_profiling.cc:243] Waited 525 ms on lock 0x7b540031ae54. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:00:20.531855 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1210509440}
I20260709 13:00:20.537775  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43008 (request call id 1923) took 1356 ms. Trace:
I20260709 13:00:20.577598  1570 leader_election.cc:304] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:20.577895  1529 rpcz_store.cc:276] 0709 13:00:19.181630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:19.573410 (+391780us) service_pool.cc:224] Handling call
0709 13:00:19.840369 (+266959us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:19.849978 (+  9609us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:20.537587 (+687609us) spinlock_profiling.cc:243] Waited 245 ms on lock 0x7b54000eb350. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b28ad 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:20.537718 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":562856320}
I20260709 13:00:20.538509  2218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50310 (request call id 696) took 1357 ms. Trace:
I20260709 13:00:20.528124  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
W20260709 13:00:20.547483  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 79204.7us
I20260709 13:00:20.579991  1572 leader_election.cc:304] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:20.531349  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:20.552057  1674 raft_consensus.cc:1240] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:20.545476  1678 raft_consensus.cc:2468] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 7.
W20260709 13:00:20.491972  5118 log.cc:927] Time spent T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.189s	user 0.001s	sys 0.000s
I20260709 13:00:20.445140  5016 raft_consensus.cc:515] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:20.540992  5113 raft_consensus.cc:515] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:20.558961  5075 raft_consensus.cc:515] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:20.570025  1644 leader_election.cc:304] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:20.571002  5115 leader_election.cc:290] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:20.571722  5024 raft_consensus.cc:493] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.572211  3934 leader_election.cc:290] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:20.573138  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:00:20.574278  5091 log.cc:927] Time spent T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 1.121s	user 0.015s	sys 0.006s
I20260709 13:00:20.599270  1572 leader_election.cc:304] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:20.531788  5066 leader_election.cc:290] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:20.537310  4910 raft_consensus.cc:3060] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:20.583142  1570 leader_election.cc:400] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 election: Vote denied by peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931) with higher term. Message: Invalid argument: T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 8. Current term is 9.
I20260709 13:00:20.605249  1570 leader_election.cc:304] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:20.606910  5139 raft_consensus.cc:2749] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:00:20.607954  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:20.608223  1527 raft_consensus.cc:1240] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:20.610950  1531 raft_consensus.cc:2468] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 7.
I20260709 13:00:20.611094  1644 leader_election.cc:304] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:20.608767  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
W20260709 13:00:20.583559  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 93726.5us
I20260709 13:00:20.590157  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:20.613085  1523 raft_consensus.cc:1240] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:20.591786  1532 raft_consensus.cc:2410] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:00:20.590055  1599 raft_consensus.cc:1240] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:00:20.535192  5104 raft_consensus.cc:2749] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:20.600829  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:20.615439  1602 raft_consensus.cc:3060] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:20.616173  4842 leader_election.cc:290] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:20.601439  5119 raft_consensus.cc:493] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:20.579064  2218 rpcz_store.cc:276] 0709 13:00:19.180833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:19.265296 (+ 84463us) service_pool.cc:224] Handling call
0709 13:00:19.335064 (+ 69768us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:19.456370 (+121306us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:19.456401 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:19.503946 (+ 47545us) log.cc:844] Serialized 26 byte log entry
0709 13:00:20.140671 (+636725us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:20.140717 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:20.538137 (+397420us) spinlock_profiling.cc:243] Waited 121 ms on lock 0x7b5400383954. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:00:20.538178 (+    41us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:20.538219 (+    41us) raft_consensus.cc:1685] finished
0709 13:00:20.538230 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:20.538437 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":278341888,"thread_start_us":591269,"threads_started":1,"wal-append.queue_time_us":340441}
I20260709 13:00:20.532099  5064 raft_consensus.cc:740] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:20.564378  4965 raft_consensus.cc:515] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:20.619488  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:20.620097  1599 raft_consensus.cc:2468] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 9.
I20260709 13:00:20.620512  4965 leader_election.cc:290] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:20.620939  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:20.530623  5112 consensus_queue.cc:237] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:20.589191  4190 raft_consensus.cc:2749] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:20.610321  5015 consensus_queue.cc:1048] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:00:20.618431  5119 raft_consensus.cc:515] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:20.589404  5109 raft_consensus.cc:2804] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:00:20.603314  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 260448us
I20260709 13:00:20.603688  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:20.604368  1529 raft_consensus.cc:1275] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:00:20.628275  1602 raft_consensus.cc:2468] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 9.
I20260709 13:00:20.604519  5050 raft_consensus.cc:3060] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:20.605474  5086 raft_consensus.cc:2804] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:20.589560  4958 raft_consensus.cc:515] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:20.631704  4912 consensus_meta.cc:287] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.812s	user 0.009s	sys 0.000s
I20260709 13:00:20.664119  4912 raft_consensus.cc:515] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:20.666294  4912 leader_election.cc:290] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:20.637018  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:20.581997  5093 raft_consensus.cc:515] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:20.645054  1646 leader_election.cc:304] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:00:20.645609  1571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:20.668510  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:20.670184  1601 raft_consensus.cc:3060] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:20.646903  4190 consensus_queue.cc:1059] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:20.653488  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:20.636508  5113 leader_election.cc:290] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 10 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:20.655403  5006 leader_election.cc:290] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:20.562708  5049 raft_consensus.cc:515] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:20.625753  5109 raft_consensus.cc:493] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:20.602931  5024 raft_consensus.cc:515] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:20.619457  5064 consensus_queue.cc:260] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:20.651887  5086 raft_consensus.cc:493] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:20.667215  1525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49310 (request call id 719) took 1665 ms. Trace:
I20260709 13:00:20.654475  4842 consensus_queue.cc:1048] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 13:00:20.636310  5017 raft_consensus.cc:3055] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:20.626364  5067 raft_consensus.cc:2804] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:20.669093  1607 raft_consensus.cc:2393] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 7: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:00:20.671314  5140 raft_consensus.cc:2749] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:20.672801  2219 raft_consensus.cc:1240] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:20.673941  4958 leader_election.cc:290] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
W20260709 13:00:20.674451  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 59942us
I20260709 13:00:20.703621  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:20.676615  4885 raft_consensus.cc:515] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:20.678736  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:20.704553  1607 raft_consensus.cc:2468] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 9.
I20260709 13:00:20.683452  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:20.684715  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:20.685077  5070 raft_consensus.cc:493] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.685406  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:20.685583  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:20.686374  2221 raft_consensus.cc:1240] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 8 LEADER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:20.707434  2225 raft_consensus.cc:2393] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 9: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:00:20.701288  5086 raft_consensus.cc:3060] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:20.687528  5050 raft_consensus.cc:2749] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:20.688213  5093 leader_election.cc:290] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:20.703929  5017 raft_consensus.cc:740] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:20.689397  1601 raft_consensus.cc:2468] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 10.
I20260709 13:00:20.694881  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:20.698875  5064 raft_consensus.cc:3060] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:20.701629  1525 rpcz_store.cc:276] 0709 13:00:19.002082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:19.002191 (+   109us) service_pool.cc:224] Handling call
0709 13:00:19.029676 (+ 27485us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:19.309974 (+280298us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:19.310007 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:19.310050 (+    43us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:19.310081 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:20.666980 (+1356899us) spinlock_profiling.cc:243] Waited 280 ms on lock 0x7b540015c554. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:00:20.667025 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:20.667155 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":644191488}
I20260709 13:00:20.713863  1525 raft_consensus.cc:1240] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:00:20.714553  5049 leader_election.cc:290] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:20.676869  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:20.715636  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:20.716573  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:20.717561  1602 raft_consensus.cc:3060] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:20.719669  4958 consensus_queue.cc:1059] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:20.721129  5113 raft_consensus.cc:3055] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:20.721391  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:20.721570  2191 leader_election.cc:304] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:20.722052  2224 raft_consensus.cc:2468] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 8.
I20260709 13:00:20.709242  5070 raft_consensus.cc:515] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:20.725044  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:20.725255  1603 raft_consensus.cc:2468] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 11.
I20260709 13:00:20.705459  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:20.705808  2222 raft_consensus.cc:2468] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 10.
I20260709 13:00:20.705252  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:00:20.701493  5080 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.929s	user 0.026s	sys 0.024s
I20260709 13:00:20.686192  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:20.708050  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:20.699388  4912 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:20.701359  1646 connection.cc:256] RPC call timeout handler was delayed by -1.4180345979999629s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.27480000000000004s for a response
I20260709 13:00:20.696146  5109 raft_consensus.cc:3060] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:20.686203  4190 raft_consensus.cc:3055] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:20.702029  5067 raft_consensus.cc:493] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:20.786983  5123 raft_consensus.cc:2804] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:20.726162  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:20.803539  1600 raft_consensus.cc:2393] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 6: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:00:20.727746  1602 raft_consensus.cc:2468] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 11.
I20260709 13:00:20.788400  2223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50310 (request call id 687) took 1780 ms. Trace:
I20260709 13:00:20.790949  1646 leader_election.cc:304] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:00:20.791002  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:20.790525  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
W20260709 13:00:20.793334  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 83039.4us
W20260709 13:00:20.791939  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 64953.9us
W20260709 13:00:20.790328  5080 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.046s	user 0.027s	sys 0.024s
I20260709 13:00:20.811412  2226 raft_consensus.cc:2393] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 8: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:00:20.794929  5067 raft_consensus.cc:3060] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:20.795385  5146 raft_consensus.cc:493] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.813508  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:20.795066  4912 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:20.728086  4887 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 13:00:20.738327  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:20.717587  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:20.726764  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:20.732620  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:20.807068  2223 rpcz_store.cc:276] 0709 13:00:19.008104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:19.008285 (+   181us) service_pool.cc:224] Handling call
0709 13:00:20.788140 (+1779855us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b5400690354. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:20.788315 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2638332160}
I20260709 13:00:20.815927  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:20.810362  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:20.811146  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:20.792938  4190 raft_consensus.cc:740] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:20.725168  5070 leader_election.cc:290] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:20.790865  5113 raft_consensus.cc:740] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:20.814484  1599 raft_consensus.cc:2393] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 9: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:00:20.813494  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:20.814977  1646 leader_election.cc:304] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:20.816723  2225 raft_consensus.cc:2376] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 8. Re-sending same reply.
I20260709 13:00:20.727702  4892 raft_consensus.cc:493] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.816929  2218 raft_consensus.cc:3060] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:20.817565  2191 leader_election.cc:304] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:20.803464  5123 raft_consensus.cc:493] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:20.827731  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:20.828966  2223 raft_consensus.cc:2468] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 7.
I20260709 13:00:20.829262  1646 leader_election.cc:304] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:20.830312  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:20.812566  5112 raft_consensus.cc:2804] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:20.832655  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:20.812716  5080 raft_consensus.cc:697] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:00:20.831670  5071 raft_consensus.cc:2749] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:20.834923  5080 consensus_queue.cc:237] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:20.831502  5123 raft_consensus.cc:3060] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:20.838079  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:20.833609  4286 raft_consensus.cc:2749] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:20.834017  4872 raft_consensus.cc:493] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:20.841389  4872 raft_consensus.cc:515] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:20.812731  5013 raft_consensus.cc:493] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:20.843027  5013 raft_consensus.cc:515] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:20.845006  2191 leader_election.cc:304] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:20.845203  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:20.846300  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:20.849097  1600 raft_consensus.cc:2468] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 8.
I20260709 13:00:20.859125  1600 raft_consensus.cc:1240] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:20.852926  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:20.849843  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:20.863247  1607 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 10.
I20260709 13:00:20.865017  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:20.865293  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:20.865891  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:20.873853  1598 raft_consensus.cc:2468] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 9.
I20260709 13:00:20.866210  1600 raft_consensus.cc:1240] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 8 LEADER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:20.867303  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:20.873699  1646 leader_election.cc:304] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:20.874558  1599 raft_consensus.cc:1240] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:00:20.876873  1607 raft_consensus.cc:1240] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:00:20.815140  5088 consensus_queue.cc:1048] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:00:20.882274  1600 raft_consensus.cc:1240] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:00:20.882977  1572 leader_election.cc:304] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:20.882330  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:20.900225  1598 raft_consensus.cc:1240] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 6. Current term is 7. Ops: [4.7-6.8]
I20260709 13:00:20.901507  1607 raft_consensus.cc:1240] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:20.902760  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:20.903201  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:20.902786  1497 leader_election.cc:304] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:20.904589  3934 raft_consensus.cc:3060] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:20.902803  1572 leader_election.cc:304] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:20.905328  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:20.905898  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:20.866838  5071 raft_consensus.cc:2804] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:20.919247  5049 raft_consensus.cc:2804] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:20.919888  5049 raft_consensus.cc:493] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:20.919994  5154 raft_consensus.cc:2749] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:20.920351  5049 raft_consensus.cc:3060] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:20.926772  5112 raft_consensus.cc:697] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 10 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:20.927973  5112 consensus_queue.cc:237] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:20.928087  1572 leader_election.cc:304] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:00:20.929440  5093 raft_consensus.cc:2804] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:20.929889  5093 raft_consensus.cc:493] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:20.930245  5093 raft_consensus.cc:3060] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:20.940033  5093 raft_consensus.cc:515] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:20.903744  4842 raft_consensus.cc:2749] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:20.839754  4892 raft_consensus.cc:515] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:20.820019  5146 raft_consensus.cc:515] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:20.881639  4286 raft_consensus.cc:2804] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:20.957845  2222 raft_consensus.cc:2468] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 6.
I20260709 13:00:20.941345  1572 leader_election.cc:304] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:20.914031  5071 raft_consensus.cc:493] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:20.908409  5044 raft_consensus.cc:3055] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:20.942956  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:20.965996  2225 raft_consensus.cc:2468] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 7.
I20260709 13:00:20.913655  5043 raft_consensus.cc:2955] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [term 7 LEADER]: Committing config change with OpId 4.5: config changed from index 2 to 5, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:00:20.955088  5115 raft_consensus.cc:493] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.961429  1572 leader_election.cc:304] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:20.982105  3934 raft_consensus.cc:2749] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:20.968037  5006 raft_consensus.cc:2749] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:20.984901  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:20.985416  5146 leader_election.cc:290] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:00:20.986619  5145 log.cc:927] Time spent T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:00:20.987001  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:20.988266  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 721) took 1077 ms. Trace:
I20260709 13:00:20.906800  4190 consensus_queue.cc:260] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:20.989094  5117 log.cc:927] Time spent T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.656s	user 0.001s	sys 0.000s
I20260709 13:00:20.989935  1680 raft_consensus.cc:1275] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:00:20.990631  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:20.991225  1530 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 10.
I20260709 13:00:20.991614  5050 consensus_queue.cc:1059] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:20.992110  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:20.992444  5109 raft_consensus.cc:515] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:20.986936  5088 raft_consensus.cc:493] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.993161  2227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50310 (request call id 703) took 1810 ms. Trace:
I20260709 13:00:20.993590  5140 raft_consensus.cc:493] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:20.994379  5140 raft_consensus.cc:515] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:20.996093  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 129019us
I20260709 13:00:20.993497  5088 raft_consensus.cc:515] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:00:20.967206  5143 log.cc:927] Time spent T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.271s	user 0.001s	sys 0.000s
I20260709 13:00:20.997903  1646 leader_election.cc:304] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:20.998930  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:21.002211  4887 raft_consensus.cc:493] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:21.007689  4887 raft_consensus.cc:515] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:21.000730  5115 raft_consensus.cc:515] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:21.009948  4887 leader_election.cc:290] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:20.993582  2227 rpcz_store.cc:276] 0709 13:00:19.182607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:19.691726 (+509119us) service_pool.cc:224] Handling call
0709 13:00:19.692266 (+   540us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:19.692643 (+   377us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:19.692670 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:19.741168 (+ 48498us) log.cc:844] Serialized 564 byte log entry
0709 13:00:20.014085 (+272917us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:20.014121 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:20.014180 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:20.988401 (+974221us) spinlock_profiling.cc:243] Waited 2.65 ms on lock 0x7b4400022b4c. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a153ecc85 00007f6a153ed6a2 00007f6a1815f1db 00007f6a1815aaaf 00007f6a1814e86e 00007f6a1814dbb6 00007f6a1814d7d8 00007f6a18157221 00007f6a181571d9 00007f6a18157169
0709 13:00:20.992750 (+  4349us) raft_consensus.cc:1685] finished
0709 13:00:20.992771 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:20.993100 (+   329us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6105856,"thread_start_us":233350,"threads_started":1,"wal-append.queue_time_us":475188}
I20260709 13:00:20.964845  5071 raft_consensus.cc:3060] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:21.010547  5115 leader_election.cc:290] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:00:20.970284  5144 log.cc:927] Time spent T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
I20260709 13:00:20.967566  4912 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:20.962628  4286 raft_consensus.cc:493] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:21.019520  4286 raft_consensus.cc:3060] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:20.977361  4885 leader_election.cc:290] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:20.945273  5113 consensus_queue.cc:260] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:20.990283  5086 raft_consensus.cc:515] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:20.988700  1604 rpcz_store.cc:276] 0709 13:00:19.910883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:19.911017 (+   134us) service_pool.cc:224] Handling call
0709 13:00:19.911371 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:19.963854 (+ 52483us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:00:19.963881 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:19.964330 (+   449us) log.cc:844] Serialized 26 byte log entry
0709 13:00:20.539012 (+574682us) spinlock_profiling.cc:243] Waited 4.02 ms on lock 0x7b180048bb00. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1e38ede1 00007f6a1e39b5b1 00007f6a154a8e07 00007f6a1e303ab9 00007f6a154c569b 00007f6a154c393f 00007f6a154c5c02 00007f6a1814d20b 00007f6a18152d23 00007f6a181530d1 00007f6a1856ea0f
0709 13:00:20.710531 (+171519us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:20.710570 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:20.710616 (+    46us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:20.988029 (+277413us) raft_consensus.cc:1685] finished
0709 13:00:20.988049 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:20.988206 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52070,"raft.queue_time_us":96286,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":59813,"spinlock_wait_cycles":9243520,"thread_start_us":171342,"threads_started":1,"wal-append.queue_time_us":709194}
W20260709 13:00:20.970786  5147 log.cc:927] Time spent T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:00:20.851907  5017 consensus_queue.cc:260] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:20.985559  1524 raft_consensus.cc:3060] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:20.964442  5044 raft_consensus.cc:740] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:20.964450  4872 leader_election.cc:290] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:00:20.986619  5111 log.cc:927] Time spent T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.858s	user 0.002s	sys 0.000s
I20260709 13:00:21.005656  1646 leader_election.cc:304] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:00:21.006102  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 44791.3us
I20260709 13:00:21.006701  5006 raft_consensus.cc:2749] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:21.007145  5032 raft_consensus.cc:2749] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:21.045609  2219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 766) took 1740 ms. Trace:
I20260709 13:00:21.046036  2219 rpcz_store.cc:276] 0709 13:00:19.305226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:19.811300 (+506074us) service_pool.cc:224] Handling call
0709 13:00:19.826835 (+ 15535us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:20.703181 (+876346us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:21.045398 (+342217us) spinlock_profiling.cc:243] Waited 846 ms on lock 0x7b5400621e54. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:00:21.045557 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1945241856}
I20260709 13:00:21.011174  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:21.049856  2218 raft_consensus.cc:2468] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 11.
W20260709 13:00:21.051208  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 45627.7us
I20260709 13:00:21.042819  1572 leader_election.cc:304] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:00:21.029316  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 71275.9us
I20260709 13:00:21.029425  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:21.030630  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
W20260709 13:00:21.032449  5151 log.cc:927] Time spent T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.068s	user 0.000s	sys 0.002s
I20260709 13:00:21.033694  5086 leader_election.cc:290] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:21.034888  5140 leader_election.cc:290] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:21.035115  1525 raft_consensus.cc:1240] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:21.036355  2220 raft_consensus.cc:1275] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:21.066864  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:21.038162  2222 raft_consensus.cc:1240] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:21.067603  1530 raft_consensus.cc:3060] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:21.003883  5050 consensus_queue.cc:1243] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Peer b96ce9cc496c49d7818fa983a17b062b log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:00:21.039276  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:21.043401  1644 leader_election.cc:304] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:21.047053  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:21.047480  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:21.002998  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:21.059450  1572 leader_election.cc:304] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
W20260709 13:00:21.056488  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:21.063840  1524 raft_consensus.cc:2468] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 9.
I20260709 13:00:21.048426  5044 consensus_queue.cc:260] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:21.080475  2219 raft_consensus.cc:1240] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [term 8 LEADER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:21.091758  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:21.073908  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 13:00:21.153232  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:21.106743  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:21.154021  1530 raft_consensus.cc:2468] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 7.
I20260709 13:00:21.154209  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:21.154834  2222 raft_consensus.cc:2468] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 7.
I20260709 13:00:21.074009  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:21.109264  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 713) took 1850 ms. Trace:
I20260709 13:00:21.134414  3934 consensus_queue.cc:1059] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
W20260709 13:00:21.111728  1571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:21.078835  1678 raft_consensus.cc:2393] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 9: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:00:21.118928  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:21.051617  4872 raft_consensus.cc:2749] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:21.158334  1646 leader_election.cc:304] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:21.052983  5088 leader_election.cc:290] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:21.070525  4878 raft_consensus.cc:2749] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:21.159718  2222 raft_consensus.cc:1240] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:21.103229  5065 raft_consensus.cc:3060] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:21.158427  1497 leader_election.cc:304] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:21.160247  2220 raft_consensus.cc:3060] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:21.162400  1646 leader_election.cc:304] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:00:21.206761  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 48425.3us
W20260709 13:00:21.207257  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 44925.4us
I20260709 13:00:21.208184  1646 leader_election.cc:304] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:21.208427  1644 leader_election.cc:304] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:21.094357  5104 raft_consensus.cc:493] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:21.156417  1603 rpcz_store.cc:276] 0709 13:00:19.258811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:19.258938 (+   127us) service_pool.cc:224] Handling call
0709 13:00:21.109112 (+1850174us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b54001aa9d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:21.109206 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3025456000}
I20260709 13:00:21.156816  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:21.150753  5093 leader_election.cc:290] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:21.105767  5016 leader_election.cc:290] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:21.189141  4892 leader_election.cc:290] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:21.216876  2222 raft_consensus.cc:1240] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 10. Current term is 11. Ops: [8.9-10.10]
I20260709 13:00:21.217087  3934 consensus_queue.cc:1059] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:00:21.156525  5013 leader_election.cc:290] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:21.217585  5146 raft_consensus.cc:2804] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:21.110721  5056 consensus_queue.cc:1059] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.075s
I20260709 13:00:21.165519  5115 raft_consensus.cc:3055] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:21.156342  5152 raft_consensus.cc:493] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:21.053192  4786 consensus_queue.cc:1175] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ddf11fc190dd4b898773379c6b129d90" responder_term: 10 status { last_received { term: 9 index: 10 } last_committed_idx: 10 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 9. Current term is 10. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:00:21.166682  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 107299us
I20260709 13:00:21.158911  5109 leader_election.cc:290] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:21.167549  4862 raft_consensus.cc:2804] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:21.163990  5140 raft_consensus.cc:2749] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:21.168251  4286 raft_consensus.cc:515] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:21.172955  1526 raft_consensus.cc:1275] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:00:21.166071  5044 raft_consensus.cc:3060] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:21.174728  4842 consensus_queue.cc:1059] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:21.181321  5122 leader_election.cc:290] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:21.136402  5049 raft_consensus.cc:515] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:21.127991  5071 raft_consensus.cc:515] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:21.127868  5123 raft_consensus.cc:515] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:21.098361  5110 leader_election.cc:290] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:21.167117  5067 raft_consensus.cc:515] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:21.187767  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:21.171876  1523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43008 (request call id 1922) took 1990 ms. Trace:
I20260709 13:00:21.194185  1531 raft_consensus.cc:1275] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:21.208998  1497 leader_election.cc:304] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:21.206650  2225 raft_consensus.cc:1240] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 9. Current term is 10. Ops: []
W20260709 13:00:21.210181  2190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:21.079533  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:21.213214  1570 leader_election.cc:304] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:21.209295  1644 leader_election.cc:304] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:21.209295  1646 leader_election.cc:304] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:21.163259  5050 consensus_queue.cc:1059] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:21.088897  5032 raft_consensus.cc:2749] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:00:21.217770  2218 raft_consensus.cc:1240] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:21.222970  2191 leader_election.cc:304] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:21.216571  5064 raft_consensus.cc:2749] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:21.219468  5104 raft_consensus.cc:515] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:21.225373  5138 consensus_queue.cc:1048] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 13:00:21.218701  4872 raft_consensus.cc:2804] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:21.216387  5088 raft_consensus.cc:2749] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:21.314422  2224 raft_consensus.cc:2368] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for earlier term 11. Current term is 12.
I20260709 13:00:21.312630  1525 raft_consensus.cc:1240] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 6. Current term is 7. Ops: []
W20260709 13:00:21.320374  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 97549.1us
I20260709 13:00:21.209798  5070 raft_consensus.cc:493] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:21.322728  4286 leader_election.cc:290] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:21.267020  1572 leader_election.cc:304] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:21.263388  5056 consensus_queue.cc:1243] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 log is divergent from this leader: its last log entry 9.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:00:21.262897  5146 raft_consensus.cc:697] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:00:21.262475  5115 raft_consensus.cc:740] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:00:21.268370  4862 raft_consensus.cc:493] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:21.270691  4965 consensus_queue.cc:1175] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" responder_term: 9 status { last_received { term: 9 index: 10 } last_committed_idx: 10 last_received_current_leader { term: 9 index: 10 } }
I20260709 13:00:21.268502  5152 raft_consensus.cc:515] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:21.305497  2227 raft_consensus.cc:2468] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 7.
W20260709 13:00:21.321979  2190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:21.312456  5123 leader_election.cc:290] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:00:21.284765  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:21.331128  4885 raft_consensus.cc:2804] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:00:21.320124  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 107031us
W20260709 13:00:21.352576  1570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:21.320490  1600 raft_consensus.cc:2468] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 10.
I20260709 13:00:21.354391  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:21.323988  5071 leader_election.cc:290] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:21.322765  5140 raft_consensus.cc:2804] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:21.324046  5049 leader_election.cc:290] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:00:21.329031  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 119823us
I20260709 13:00:21.261209  2220 raft_consensus.cc:2468] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 9.
W20260709 13:00:21.330519  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 121605us
I20260709 13:00:21.357672  1497 leader_election.cc:304] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:21.284512  1523 rpcz_store.cc:276] 0709 13:00:19.181367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:19.540529 (+359162us) service_pool.cc:224] Handling call
0709 13:00:19.540775 (+   246us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:20.613456 (+1072681us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:21.171652 (+558196us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54001b5dd4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:00:21.171819 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2465913728}
W20260709 13:00:21.309325  5120 log.cc:927] Time spent T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.833s	user 0.005s	sys 0.000s
W20260709 13:00:21.333220  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 66317.9us
I20260709 13:00:21.328509  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:21.329874  5110 raft_consensus.cc:2804] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:21.324563  4872 raft_consensus.cc:697] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 7 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:21.348173  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:21.348340  1674 raft_consensus.cc:1275] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:21.348958  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:00:21.319734  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 110523us
I20260709 13:00:21.386999  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:21.376478  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:21.387854  1679 raft_consensus.cc:2410] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:00:21.388804  1679 raft_consensus.cc:1275] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:00:21.389153  1598 raft_consensus.cc:1240] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:21.385106  5110 raft_consensus.cc:493] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:21.389910  5110 raft_consensus.cc:3060] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:21.390285  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:21.391063  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:21.391214  5115 consensus_queue.cc:260] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:21.358507  3934 raft_consensus.cc:2749] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:21.392527  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:21.392647  5115 raft_consensus.cc:3060] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:21.332284  5070 raft_consensus.cc:515] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:21.354979  1604 raft_consensus.cc:3060] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:21.362448  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:21.361352  1497 leader_election.cc:304] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:21.339591  5050 raft_consensus.cc:2749] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:21.342322  4862 raft_consensus.cc:3060] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:21.342724  4892 raft_consensus.cc:493] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:21.363691  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:21.363293  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:21.380585  1678 raft_consensus.cc:3060] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:00:21.383535  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:21.384543  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:21.386094  1680 raft_consensus.cc:2410] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:00:21.350054  1677 raft_consensus.cc:1240] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:21.333273  5013 raft_consensus.cc:2804] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:21.391850  1674 raft_consensus.cc:2393] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 13: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:00:21.398535  3934 raft_consensus.cc:2749] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:21.359892  1523 raft_consensus.cc:1275] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:00:21.363209  4505 raft_consensus.cc:2749] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:21.441220  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:21.407513  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:21.400825  1646 leader_election.cc:304] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:21.403579  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:21.410442  1599 raft_consensus.cc:1240] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:21.412355  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:21.455767  1600 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 10.
I20260709 13:00:21.409143  1528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49310 (request call id 725) took 2107 ms. Trace:
I20260709 13:00:21.456297  1679 raft_consensus.cc:2410] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for term 10 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:00:21.457218  1528 rpcz_store.cc:276] 0709 13:00:19.301463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:19.865452 (+563989us) service_pool.cc:224] Handling call
0709 13:00:19.865730 (+   278us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:19.869090 (+  3360us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:19.869119 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:19.869569 (+   450us) log.cc:844] Serialized 26 byte log entry
0709 13:00:20.319530 (+449961us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:20.319563 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:20.319635 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:21.308655 (+989020us) spinlock_profiling.cc:243] Waited 3.88 ms on lock 0x7b4400022b4c. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a153ecc85 00007f6a153ed6a2 00007f6a1815f1db 00007f6a1815aaaf 00007f6a1814e86e 00007f6a1814dbb6 00007f6a1814d7d8 00007f6a18157221 00007f6a181571d9 00007f6a18157169
0709 13:00:21.408732 (+100077us) raft_consensus.cc:1685] finished
0709 13:00:21.408752 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:21.409090 (+   338us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2903,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":84,"spinlock_wait_cycles":8927616,"thread_start_us":449618,"threads_started":1,"wal-append.queue_time_us":523140}
I20260709 13:00:21.350389  5032 raft_consensus.cc:493] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:21.356600  5140 raft_consensus.cc:493] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:21.461975  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:21.462741  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:21.462986  4892 raft_consensus.cc:515] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:00:21.467886  2191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:21.399225  1497 leader_election.cc:304] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:21.468526  1674 raft_consensus.cc:2368] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b for earlier term 7. Current term is 8.
W20260709 13:00:21.409108  1606 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 715) took 1507 ms (client timeout 1937 ms). Trace:
W20260709 13:00:21.470968  1606 rpcz_store.cc:269] 0709 13:00:19.902116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:19.902273 (+   157us) service_pool.cc:224] Handling call
0709 13:00:21.408962 (+1506689us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b54000db454. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:21.409056 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":254816000}
I20260709 13:00:21.363039  4885 raft_consensus.cc:697] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 9 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
W20260709 13:00:21.478268  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 77515.9us
I20260709 13:00:21.480140  1646 leader_election.cc:304] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:21.482550  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:21.477126  5140 raft_consensus.cc:3060] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:21.495549  2191 leader_election.cc:400] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 election: Vote denied by peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217) with higher term. Message: Invalid argument: T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b for earlier term 7. Current term is 8.
I20260709 13:00:21.495963  2191 leader_election.cc:403] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:00:21.460284  5013 raft_consensus.cc:493] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:21.498934  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:21.503737  1598 raft_consensus.cc:2468] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 9.
I20260709 13:00:21.395133  5093 consensus_queue.cc:1048] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.103s
I20260709 13:00:21.504241  4958 raft_consensus.cc:3060] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:21.511053  5162 log.cc:927] Time spent T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.179s	user 0.001s	sys 0.000s
I20260709 13:00:21.485525  1604 raft_consensus.cc:2468] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 12.
I20260709 13:00:21.513633  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:21.499269  5013 raft_consensus.cc:3060] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:21.528234  2191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:21.516873  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:21.407807  5154 consensus_queue.cc:1059] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.093s
I20260709 13:00:21.511361  4892 leader_election.cc:290] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:21.481737  4912 raft_consensus.cc:2749] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:00:21.548709  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 68668.5us
I20260709 13:00:21.549597  1646 leader_election.cc:304] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:21.507666  5016 raft_consensus.cc:2804] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:21.502390  5064 raft_consensus.cc:2804] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:21.546988  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:21.534736  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:21.551420  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:21.477367  5032 raft_consensus.cc:515] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:21.555630  1675 raft_consensus.cc:2393] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 10: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:00:21.515936  5075 leader_election.cc:290] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:21.410673  5146 consensus_queue.cc:237] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:21.554311  2192 leader_election.cc:304] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:21.560873  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:21.552333  5016 raft_consensus.cc:493] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:21.567894  2192 leader_election.cc:304] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:21.553695  5056 raft_consensus.cc:3055] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:21.570055  5178 consensus_queue.cc:1059] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:21.571063  5171 raft_consensus.cc:2804] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:21.571139  5152 leader_election.cc:290] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:21.503417  4885 consensus_queue.cc:237] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:21.578907  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:21.556059  5154 raft_consensus.cc:2749] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:21.574581  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:21.584697  4802 raft_consensus.cc:3055] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:21.595441  5152 raft_consensus.cc:3055] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:00:21.599784  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 200637us
I20260709 13:00:21.558059  5067 leader_election.cc:290] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:21.563489  5104 leader_election.cc:290] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:21.537770  4872 consensus_queue.cc:237] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:21.573356  5056 raft_consensus.cc:740] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:21.605626  5171 raft_consensus.cc:697] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 7 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:21.586127  5178 consensus_queue.cc:1059] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 6, Time since last communication: 0.092s
I20260709 13:00:21.630752  5152 raft_consensus.cc:740] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:21.589053  4912 consensus_queue.cc:1059] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.211s
I20260709 13:00:21.634516  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:21.738037  1529 raft_consensus.cc:1240] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:00:21.705724  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:21.737762  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:21.740517  1678 raft_consensus.cc:2468] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 12.
I20260709 13:00:21.801083  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:21.801352  2191 leader_election.cc:304] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:21.657969  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:21.567536  5016 raft_consensus.cc:3060] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:21.800120  1672 raft_consensus.cc:2393] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 4: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:00:21.786970  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:21.792407  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
W20260709 13:00:21.804404  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 236589us
W20260709 13:00:21.804735  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 236517us
I20260709 13:00:21.630623  5093 raft_consensus.cc:493] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:21.808146  5093 raft_consensus.cc:515] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:21.808336  2192 leader_election.cc:304] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:21.805507  1528 raft_consensus.cc:3060] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:21.807354  1677 raft_consensus.cc:2468] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 8.
I20260709 13:00:21.801165  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:21.614748  5017 raft_consensus.cc:3060] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:21.810747  1678 raft_consensus.cc:2393] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 10: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:00:21.813521  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:21.815984  1606 raft_consensus.cc:3060] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:21.722213  5169 log.cc:927] Time spent T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:00:21.814457  1600 raft_consensus.cc:1240] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 10. Current term is 11. Ops: []
W20260709 13:00:21.717085  5161 log.cc:927] Time spent T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.213s	user 0.001s	sys 0.000s
W20260709 13:00:21.692096  5162 log.cc:927] Time spent T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:00:21.823908  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:21.823323  2192 leader_election.cc:304] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:21.818652  1604 raft_consensus.cc:1240] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:21.631052  5123 raft_consensus.cc:2804] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:21.821102  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:21.824548  1599 raft_consensus.cc:2468] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 10.
I20260709 13:00:21.696691  5070 leader_election.cc:290] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:21.630741  4286 raft_consensus.cc:493] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:21.825098  1605 raft_consensus.cc:1240] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:21.846318  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:21.847393  1675 raft_consensus.cc:2393] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 8: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:00:21.652134  5154 raft_consensus.cc:493] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:21.624053  4802 raft_consensus.cc:740] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:21.826786  1528 raft_consensus.cc:2468] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 7.
I20260709 13:00:21.852347  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:21.852183  4802 consensus_queue.cc:260] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:00:21.853518  5174 log.cc:927] Time spent T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:00:21.853611  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:21.854491  1528 raft_consensus.cc:3060] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:21.831529  4878 raft_consensus.cc:493] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:21.772327  4892 raft_consensus.cc:493] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:21.808329  5185 consensus_queue.cc:1059] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 13:00:21.826484  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:21.841009  4862 raft_consensus.cc:515] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:21.810796  5043 raft_consensus.cc:2804] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:21.828249  5093 leader_election.cc:290] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:21.861929  1528 raft_consensus.cc:2468] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 8.
I20260709 13:00:21.905328  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:21.863704  1529 raft_consensus.cc:2468] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 10.
I20260709 13:00:21.876699  1680 raft_consensus.cc:1240] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 7 LEADER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:21.905939  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49310 (request call id 741) took 1065 ms. Trace:
I20260709 13:00:21.884663  1525 raft_consensus.cc:2410] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:00:21.793207  5171 consensus_queue.cc:237] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:21.906518  1532 rpcz_store.cc:276] 0709 13:00:20.840853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:21.154691 (+313838us) service_pool.cc:224] Handling call
0709 13:00:21.155004 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:21.155235 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:00:21.155260 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:21.155697 (+   437us) log.cc:844] Serialized 26 byte log entry
0709 13:00:21.338972 (+183275us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:21.339005 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:21.339068 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:21.905707 (+566639us) raft_consensus.cc:1685] finished
0709 13:00:21.905727 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:21.905883 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":183001,"threads_started":1,"wal-append.queue_time_us":304280}
I20260709 13:00:21.906843  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:21.914016  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
W20260709 13:00:21.905414  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 82188.6us
I20260709 13:00:21.855970  5116 raft_consensus.cc:2804] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:21.881860  1606 raft_consensus.cc:2468] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 10.
I20260709 13:00:21.917779  2192 leader_election.cc:304] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:21.857116  5070 raft_consensus.cc:2749] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:21.925902  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:21.927323  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:21.931171  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:21.931885  1529 raft_consensus.cc:2468] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 8.
I20260709 13:00:21.916290  5043 raft_consensus.cc:697] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 12 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:21.865240  4892 raft_consensus.cc:515] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:21.825557  5152 consensus_queue.cc:260] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:21.921753  5032 leader_election.cc:290] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:00:21.945281  1570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:21.855551  4286 raft_consensus.cc:515] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:21.935598  5123 raft_consensus.cc:697] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 9 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:21.877586  5154 raft_consensus.cc:515] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:21.929865  5116 raft_consensus.cc:697] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 10 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:21.882104  4878 raft_consensus.cc:515] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:21.957386  1529 raft_consensus.cc:1240] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
W20260709 13:00:21.963114  2191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:21.965214  5110 consensus_meta.cc:287] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.575s	user 0.006s	sys 0.004s
I20260709 13:00:21.953205  4862 leader_election.cc:290] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:00:21.960850  5183 log.cc:927] Time spent T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.152s	user 0.002s	sys 0.000s
I20260709 13:00:21.964401  5064 raft_consensus.cc:493] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:21.967504  5013 raft_consensus.cc:515] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:21.966187  4958 raft_consensus.cc:2749] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217) with higher term. Message: Invalid argument: T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b for earlier term 7. Current term is 8.
W20260709 13:00:21.986900  2190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:21.953022  5123 consensus_queue.cc:237] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:22.004556  2190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:22.013078  5125 consensus_queue.cc:1048] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:21.979130  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:21.975212  4878 leader_election.cc:290] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:00:21.984172  5065 consensus_meta.cc:287] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.768s	user 0.009s	sys 0.002s
I20260709 13:00:22.020128  1496 leader_election.cc:304] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:21.977624  5154 leader_election.cc:290] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:21.987032  5013 leader_election.cc:290] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:22.049677  2224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50326 (request call id 795) took 1212 ms. Trace:
I20260709 13:00:22.050112  2224 rpcz_store.cc:276] 0709 13:00:20.837656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:20.902973 (+ 65317us) service_pool.cc:224] Handling call
0709 13:00:22.049488 (+1146515us) spinlock_profiling.cc:243] Waited 411 ms on lock 0x7b54003264d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:22.049618 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":944211200}
I20260709 13:00:22.026326  5182 raft_consensus.cc:493] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
W20260709 13:00:21.978560  5184 log.cc:927] Time spent T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
W20260709 13:00:21.973894  5176 log.cc:927] Time spent T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:00:22.029392  1527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49310 (request call id 743) took 1118 ms. Trace:
I20260709 13:00:22.031608  1496 leader_election.cc:304] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:22.019374  5188 raft_consensus.cc:493] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:22.032364  5180 raft_consensus.cc:2749] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:21.976490  5043 consensus_queue.cc:237] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:21.972324  5187 raft_consensus.cc:2804] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:21.966282  5140 raft_consensus.cc:515] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:22.044777  5119 leader_election.cc:290] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:21.976272  4892 leader_election.cc:290] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:21.978008  5190 consensus_queue.cc:1059] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.109s
I20260709 13:00:21.978829  5116 consensus_queue.cc:237] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:22.052253  4286 leader_election.cc:290] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:21.979154  5064 raft_consensus.cc:3060] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:22.062404  1673 raft_consensus.cc:2410] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
W20260709 13:00:22.063352  5197 log.cc:927] Time spent T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 13:00:22.114272  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 99863us
I20260709 13:00:22.153074  1646 leader_election.cc:400] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 pre-election: Vote denied by peer b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373) with higher term. Message: Invalid argument: T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for earlier term 11. Current term is 12.
I20260709 13:00:22.153439  1646 leader_election.cc:403] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:22.154672  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:22.155741  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:22.103137  4878 raft_consensus.cc:493] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:22.157763  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:22.157606  4878 raft_consensus.cc:515] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:22.158344  2218 raft_consensus.cc:2468] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 6.
I20260709 13:00:22.160516  4878 leader_election.cc:290] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:22.172888  5066 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:22.173478  5066 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:22.176331  5066 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:22.067294  1527 rpcz_store.cc:276] 0709 13:00:20.910955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:21.160681 (+249726us) service_pool.cc:224] Handling call
0709 13:00:22.028638 (+867957us) spinlock_profiling.cc:243] Waited 19.7 ms on lock 0x7b5800002a98. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a1548eb71 00007f6a1548ea22 00007f6a1e3a7c09 00007f6a1d501ee0 00007f6a1d5cb0ab 00007f6a1d5cb131 00007f6a1d58cfc0 00007f6a1d577929 00007f6a1d5773d2 00007f6a16aeebd4
0709 13:00:22.028872 (+   234us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:22.029060 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:22.029087 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:22.029130 (+    43us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:22.029160 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:22.029215 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:22.029325 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":45264768}
W20260709 13:00:22.145408  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 113896us
I20260709 13:00:22.177724  1496 leader_election.cc:304] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:22.178582  5180 raft_consensus.cc:2749] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:22.180333  1496 leader_election.cc:304] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:00:22.181238  5180 raft_consensus.cc:2804] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:22.181634  5180 raft_consensus.cc:493] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:22.182026  5180 raft_consensus.cc:3060] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:22.184068  1523 raft_consensus.cc:1240] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:22.185088  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:21.683997   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:22.186327  4878 consensus_queue.cc:1059] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:22.187157  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:22.187367  4878 raft_consensus.cc:3055] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:22.187781  4878 raft_consensus.cc:740] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:22.188011  1523 raft_consensus.cc:2393] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 5: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:00:22.188551  4878 consensus_queue.cc:260] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:22.189821  1523 raft_consensus.cc:2955] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 2 to 5, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:00:22.192039  1604 raft_consensus.cc:1275] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:00:22.192804  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:22.193416  1529 raft_consensus.cc:2468] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 8.
I20260709 13:00:22.194319  1607 raft_consensus.cc:1275] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:00:22.157084  5025 raft_consensus.cc:2749] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373) with higher term. Message: Invalid argument: T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for earlier term 11. Current term is 12.
I20260709 13:00:21.972874  5110 raft_consensus.cc:515] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:22.195096  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:22.195593  1603 raft_consensus.cc:1240] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:22.195767  1532 raft_consensus.cc:2368] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b for earlier term 7. Current term is 8.
I20260709 13:00:22.196333  5110 leader_election.cc:290] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:22.185905  1599 raft_consensus.cc:2393] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 8: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:00:22.165500  5044 raft_consensus.cc:3055] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:22.197844  5044 raft_consensus.cc:740] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:22.198614  5044 consensus_queue.cc:260] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:22.198972  5027 consensus_queue.cc:1059] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:22.199951  5044 raft_consensus.cc:3060] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:22.204531  5067 raft_consensus.cc:3055] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:22.163605  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:22.167044  2220 raft_consensus.cc:1275] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:00:22.205566  2190 leader_election.cc:304] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:22.206135  1675 raft_consensus.cc:1275] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:00:22.206394  5027 raft_consensus.cc:3055] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:22.206795  5027 raft_consensus.cc:740] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:22.167313  5140 leader_election.cc:290] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:22.167917  1681 raft_consensus.cc:2393] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 8: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:00:22.207373  1675 raft_consensus.cc:1240] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:22.160918  5056 consensus_queue.cc:260] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:22.207641  5027 consensus_queue.cc:260] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:22.168561  5187 raft_consensus.cc:697] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 11 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:22.208947  5027 raft_consensus.cc:3060] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:22.209316  5187 consensus_queue.cc:237] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:22.210031  2190 leader_election.cc:400] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 election: Vote denied by peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931) with higher term. Message: Invalid argument: T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b for earlier term 7. Current term is 8.
I20260709 13:00:22.145730  5013 raft_consensus.cc:2749] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:22.202522  4865 raft_consensus.cc:3060] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:22.169137  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:22.212960  2218 raft_consensus.cc:3060] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:22.204944  5067 raft_consensus.cc:740] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:22.216002  5067 consensus_queue.cc:260] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:22.217190  5067 raft_consensus.cc:3060] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:22.169472  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:22.169153  1606 raft_consensus.cc:1275] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:00:22.169775  1646 leader_election.cc:304] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
W20260709 13:00:22.219230  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 49552.3us
W20260709 13:00:22.220139  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:22.220779  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:22.146957  5188 raft_consensus.cc:515] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:22.223265  5188 leader_election.cc:290] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:22.223817  5025 raft_consensus.cc:2804] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:22.224222  5025 raft_consensus.cc:493] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
W20260709 13:00:22.224715  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:22.225102  5122 raft_consensus.cc:3055] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:22.225477  5122 raft_consensus.cc:740] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:22.226292  5122 consensus_queue.cc:260] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:22.227645  5122 raft_consensus.cc:3060] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:22.227895  5071 consensus_queue.cc:1048] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:00:22.160367  1674 raft_consensus.cc:1240] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:22.204211  5016 raft_consensus.cc:515] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:22.208264  5056 raft_consensus.cc:3060] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:22.231071  5016 leader_election.cc:290] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:22.150393  5133 raft_consensus.cc:493] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:22.231655  5016 consensus_queue.cc:1048] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:22.189769  4878 raft_consensus.cc:3060] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:22.232349  5013 consensus_queue.cc:1059] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:22.233877  5013 consensus_queue.cc:1243] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer ddf11fc190dd4b898773379c6b129d90 log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:00:22.234313  5013 raft_consensus.cc:3055] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:22.194255  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:22.235603  1529 raft_consensus.cc:2393] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 10: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:00:22.236176  1528 raft_consensus.cc:2393] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 11: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:00:22.236688  2226 raft_consensus.cc:2468] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 10.
I20260709 13:00:22.236876  1606 raft_consensus.cc:1240] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:22.219099  1598 raft_consensus.cc:2393] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 8: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:00:22.238610  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:22.219099  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49310 (request call id 735) took 1761 ms. Trace:
I20260709 13:00:22.239187  1526 rpcz_store.cc:276] 0709 13:00:20.458000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:20.458140 (+   140us) service_pool.cc:224] Handling call
0709 13:00:21.172636 (+714496us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:21.275771 (+103135us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:22.218889 (+943118us) spinlock_profiling.cc:243] Waited 689 ms on lock 0x7b540015c050. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b28ad 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:22.219032 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1583749376}
I20260709 13:00:22.068957  5182 raft_consensus.cc:515] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:22.240483  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:22.248836  1644 leader_election.cc:304] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:22.240586  2218 raft_consensus.cc:2468] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 8.
W20260709 13:00:22.173352  2191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:22.252451  1570 leader_election.cc:304] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
W20260709 13:00:22.144343  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 226644us
I20260709 13:00:22.224560  5025 raft_consensus.cc:3060] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:22.255625  1497 leader_election.cc:304] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:22.256428  4867 raft_consensus.cc:2749] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:22.256845  1497 leader_election.cc:304] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:22.257603  4867 raft_consensus.cc:3060] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:22.235881  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:22.259691  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:22.261359  1570 leader_election.cc:304] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:22.260917  1644 leader_election.cc:304] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:22.263819  2192 leader_election.cc:304] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:22.264904  1496 leader_election.cc:304] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:22.262857  4892 consensus_queue.cc:1059] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:00:22.232055  5133 raft_consensus.cc:515] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:22.206544  5114 raft_consensus.cc:2804] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:22.267113  5114 raft_consensus.cc:493] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:22.267521  5114 raft_consensus.cc:3060] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:22.267798  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:22.266216  4885 raft_consensus.cc:2804] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:22.269941  1496 leader_election.cc:304] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:22.276739  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:22.277340  1606 raft_consensus.cc:3060] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:22.279490  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:22.234617  5013 raft_consensus.cc:740] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:00:22.271045  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:22.284605  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 13:00:22.268254  5177 log.cc:927] Time spent T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.776s	user 0.004s	sys 0.000s
I20260709 13:00:22.280128  1607 raft_consensus.cc:2468] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 8.
I20260709 13:00:22.288112  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:22.288827  1607 raft_consensus.cc:2393] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 10: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:00:22.289634  1606 raft_consensus.cc:2468] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 11.
I20260709 13:00:22.268633  5109 raft_consensus.cc:2804] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:22.269606  5154 raft_consensus.cc:2804] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:22.293107  1607 raft_consensus.cc:1240] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:22.292888  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:22.291824  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:22.267539  4910 raft_consensus.cc:2804] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:22.294893  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:22.271350  4885 raft_consensus.cc:493] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:22.274197  5115 raft_consensus.cc:3060] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:22.314455  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 76382.6us
W20260709 13:00:22.316139  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 46273us
I20260709 13:00:22.323933  1680 raft_consensus.cc:1275] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:00:22.324358  1680 pending_rounds.cc:85] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90: Aborting all ops after (but not including) 5
I20260709 13:00:22.324577  1680 pending_rounds.cc:107] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:00:22.324826  1680 raft_consensus.cc:2889] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:22.326063  2190 leader_election.cc:304] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:22.316110  5216 raft_consensus.cc:2749] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:22.283200  5157 raft_consensus.cc:2764] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
I20260709 13:00:22.262640  5016 consensus_queue.cc:1059] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:00:22.262950  5140 consensus_queue.cc:1048] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:00:22.267163  4862 consensus_queue.cc:1059] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:00:22.365128  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:22.379709  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:22.280890  4913 consensus_queue.cc:1048] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
W20260709 13:00:22.372268  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 44751.7us
I20260709 13:00:22.376971  1646 leader_election.cc:304] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:22.388031  1646 leader_election.cc:304] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:22.301064  4910 raft_consensus.cc:493] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:22.320891  4885 raft_consensus.cc:3060] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:22.280787  5104 consensus_queue.cc:1048] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.085s
I20260709 13:00:22.389853  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:22.290840  1606 raft_consensus.cc:2955] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 2 to 5, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:00:22.365290  5154 raft_consensus.cc:697] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 8 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
W20260709 13:00:22.400028  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 127498us
I20260709 13:00:22.270816  5196 consensus_queue.cc:1059] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.136s
I20260709 13:00:22.372154  5202 raft_consensus.cc:3060] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:22.393716  4910 raft_consensus.cc:3060] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:22.408875  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:22.396935  5179 raft_consensus.cc:2804] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:22.379076  5066 consensus_queue.cc:1048] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:00:22.403290  5112 raft_consensus.cc:2749] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:22.413308  1497 leader_election.cc:304] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:22.429348  5087 raft_consensus.cc:3055] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:22.447423  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:22.448105  1607 raft_consensus.cc:2376] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 10. Re-sending same reply.
W20260709 13:00:22.448895  5203 log.cc:927] Time spent T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:00:22.445292  4758 consensus_queue.cc:1059] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 13:00:22.452929  5200 raft_consensus.cc:3055] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:22.453333  5200 raft_consensus.cc:740] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:22.389691  5013 consensus_queue.cc:260] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:22.433528  5179 raft_consensus.cc:697] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 8 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:22.447908  5087 raft_consensus.cc:740] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:22.486073  4867 raft_consensus.cc:2749] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:22.486858  4913 raft_consensus.cc:2804] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:22.461369  5188 consensus_queue.cc:1059] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 13:00:22.489239  4910 raft_consensus.cc:515] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:22.454335  5200 consensus_queue.cc:260] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:22.515048  4913 raft_consensus.cc:697] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:00:22.526708  4913 consensus_queue.cc:237] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:22.527153  4910 leader_election.cc:290] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:22.528009  4910 raft_consensus.cc:493] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:22.528453  4910 raft_consensus.cc:515] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:00:22.530552  2190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:22.541416  5202 raft_consensus.cc:2749] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:22.461565  5154 consensus_queue.cc:237] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:22.551877  5205 log.cc:927] Time spent T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.138s	user 0.000s	sys 0.001s
I20260709 13:00:22.552794  1673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49170 (request call id 1981) took 1142 ms. Trace:
I20260709 13:00:22.523020  4867 raft_consensus.cc:493] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:22.506222  5182 leader_election.cc:290] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:00:22.532218  5198 log.cc:927] Time spent T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:00:22.553279  1673 rpcz_store.cc:276] 0709 13:00:21.410454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:21.412089 (+  1635us) service_pool.cc:224] Handling call
0709 13:00:22.552580 (+1140491us) spinlock_profiling.cc:243] Waited 606 ms on lock 0x7b54002fc954. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:22.552733 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1394410880}
I20260709 13:00:22.531590  5179 consensus_queue.cc:237] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:22.565455  2226 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 768) took 1876 ms (client timeout 1968 ms). Trace:
I20260709 13:00:22.567957  1679 raft_consensus.cc:1240] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 7. Current term is 8. Ops: []
W20260709 13:00:22.565917  2226 rpcz_store.cc:269] 0709 13:00:20.688979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:20.817162 (+128183us) service_pool.cc:224] Handling call
0709 13:00:22.565251 (+1748089us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b54005b3bd4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:22.565379 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3162117376}
I20260709 13:00:22.568557  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:22.564459  4867 raft_consensus.cc:515] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:22.573662  2226 raft_consensus.cc:1275] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:00:22.575904  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:22.576653  1680 raft_consensus.cc:2468] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 9.
I20260709 13:00:22.580199  5024 leader_election.cc:290] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
W20260709 13:00:22.583487  5212 log.cc:927] Time spent T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:00:22.585819  2220 raft_consensus.cc:2468] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 8.
I20260709 13:00:22.586139  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:22.586892  1607 raft_consensus.cc:2468] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 9.
I20260709 13:00:22.556653  2218 raft_consensus.cc:2468] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 10.
I20260709 13:00:22.587090  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:22.587880  1598 raft_consensus.cc:2468] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 11.
I20260709 13:00:22.524006  5064 raft_consensus.cc:515] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:22.589543  5067 raft_consensus.cc:493] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:22.602569  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:22.603852  1571 leader_election.cc:304] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:22.605917  1571 leader_election.cc:304] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:22.609047  2223 raft_consensus.cc:2468] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 4.
I20260709 13:00:22.598523  5067 raft_consensus.cc:515] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:22.646857  5173 raft_consensus.cc:493] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:22.647967  5207 log.cc:927] Time spent T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
I20260709 13:00:22.647492  5173 raft_consensus.cc:515] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:22.659046  5206 log.cc:927] Time spent T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
W20260709 13:00:22.661559  2192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:22.666095  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 55505.8us
I20260709 13:00:22.571743  5114 raft_consensus.cc:515] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:22.668705  1678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49178 (request call id 1835) took 1121 ms. Trace:
I20260709 13:00:22.610481  4910 leader_election.cc:290] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:22.564755  5087 consensus_queue.cc:260] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:22.673707  1678 rpcz_store.cc:276] 0709 13:00:21.547842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:21.825945 (+278103us) service_pool.cc:224] Handling call
0709 13:00:21.826222 (+   277us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:21.856696 (+ 30474us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:21.856731 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:21.877455 (+ 20724us) log.cc:844] Serialized 26 byte log entry
0709 13:00:22.085615 (+208160us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:22.085661 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:22.085741 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:22.668446 (+582705us) raft_consensus.cc:1685] finished
0709 13:00:22.668471 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:22.668634 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30104,"raft.queue_time_us":36340,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":12399,"thread_start_us":157019,"threads_started":1,"wal-append.queue_time_us":353953}
I20260709 13:00:22.672426  1646 leader_election.cc:304] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:22.612329  4867 leader_election.cc:290] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:22.701583  1646 leader_election.cc:304] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:22.704632  5065 consensus_queue.cc:1059] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:22.697254  5053 consensus_queue.cc:1059] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 13:00:22.706267  4872 raft_consensus.cc:3055] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:22.699829  5032 consensus_queue.cc:1059] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 13:00:22.706746  4872 raft_consensus.cc:740] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:22.683087  5112 consensus_queue.cc:1059] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
W20260709 13:00:22.743314  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:22.694830  5024 raft_consensus.cc:2804] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:22.705742  5065 raft_consensus.cc:3055] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:22.694428  5140 consensus_queue.cc:1059] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
W20260709 13:00:22.739811  5122 consensus_meta.cc:287] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.512s	user 0.007s	sys 0.004s
I20260709 13:00:22.757019  5173 leader_election.cc:290] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:22.752849  5110 consensus_queue.cc:1048] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:22.767024  5068 raft_consensus.cc:493] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:22.767669  4190 raft_consensus.cc:3060] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:22.755052  5065 raft_consensus.cc:740] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:22.747422  5196 raft_consensus.cc:2804] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:22.756911  5067 leader_election.cc:290] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:22.780840  5196 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:22.799062  5056 consensus_meta.cc:287] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.566s	user 0.001s	sys 0.010s
I20260709 13:00:22.782626  5025 raft_consensus.cc:515] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:22.801581  5025 leader_election.cc:290] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:22.801898  5113 raft_consensus.cc:3060] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:22.802202  5065 consensus_queue.cc:260] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:22.803387  5065 raft_consensus.cc:3060] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:22.804628  1673 raft_consensus.cc:1240] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:22.806130  1528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43008 (request call id 1955) took 1115 ms. Trace:
I20260709 13:00:22.806602  1528 rpcz_store.cc:276] 0709 13:00:21.690889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:21.905063 (+214174us) service_pool.cc:224] Handling call
0709 13:00:22.805865 (+900802us) spinlock_profiling.cc:243] Waited 330 ms on lock 0x7b540015ca54. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:22.806048 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":758386048}
I20260709 13:00:22.749361  5024 raft_consensus.cc:493] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:00:22.814818  5024 raft_consensus.cc:3060] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:22.767776  5068 raft_consensus.cc:515] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:22.818215  5068 leader_election.cc:290] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:22.820858  5112 consensus_queue.cc:1059] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:00:22.791110  5086 raft_consensus.cc:3055] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:22.804631  5196 raft_consensus.cc:3060] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:22.782924  5032 consensus_queue.cc:1059] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
W20260709 13:00:22.836438  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:22.789156  5140 consensus_queue.cc:1059] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:00:22.840193  1599 raft_consensus.cc:1275] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:00:22.840602  1599 pending_rounds.cc:85] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642: Aborting all ops after (but not including) 7
I20260709 13:00:22.840801  1599 pending_rounds.cc:107] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:00:22.841005  1599 raft_consensus.cc:2889] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:00:22.841652  4878 consensus_meta.cc:287] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.609s	user 0.003s	sys 0.004s
I20260709 13:00:22.842254  1603 raft_consensus.cc:2468] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 5.
I20260709 13:00:22.833253  5086 raft_consensus.cc:740] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:22.843369  5086 consensus_queue.cc:260] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:22.844641  5086 raft_consensus.cc:3060] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:22.843792  4787 raft_consensus.cc:493] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:22.847635  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
W20260709 13:00:22.849871  1570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:22.848534  1646 leader_election.cc:304] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:22.851346  2224 raft_consensus.cc:2393] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 9: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
W20260709 13:00:22.864713  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 258876us
I20260709 13:00:22.867383  1571 leader_election.cc:304] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
W20260709 13:00:22.851899  4892 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.012s	sys 0.014s
I20260709 13:00:22.886442  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:22.871562  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:22.851475  4883 raft_consensus.cc:493] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:22.891690  1496 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.048s	sys 0.037s
I20260709 13:00:22.861145  5032 consensus_queue.cc:1243] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer 39a92f5a4352465d8af3af5908fe8642 log is divergent from this leader: its last log entry 9.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:00:22.895715  1572 leader_election.cc:304] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:22.863063  4190 raft_consensus.cc:2749] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:00:22.890369  4892 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.013s	sys 0.014s
W20260709 13:00:22.907372  1496 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.048s	sys 0.037s
W20260709 13:00:22.904423  1495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:22.909364  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 534771us
I20260709 13:00:22.893553  5114 leader_election.cc:290] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:22.898379  5122 raft_consensus.cc:2749] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:00:22.916571  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 49311.3us
I20260709 13:00:22.863261  4787 raft_consensus.cc:515] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:22.912458  5032 raft_consensus.cc:2804] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:22.924494  5032 raft_consensus.cc:697] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 10 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
W20260709 13:00:22.926986  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 513777us
I20260709 13:00:22.928947  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:22.929347  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:22.871676  5224 consensus_queue.cc:1048] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 13:00:22.929577  1528 raft_consensus.cc:2468] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 8.
I20260709 13:00:22.930230  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:22.930377  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:22.931897  1532 raft_consensus.cc:1240] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:00:22.929987  1523 raft_consensus.cc:2468] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 7.
I20260709 13:00:22.949743  1530 raft_consensus.cc:2468] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 6.
I20260709 13:00:22.950896  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:22.951169  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 13:00:22.926402  5181 log.cc:927] Time spent T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 1.243s	user 0.006s	sys 0.000s
I20260709 13:00:22.949819  1571 leader_election.cc:304] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:22.933547  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:22.918689  4878 raft_consensus.cc:493] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:22.963215  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:22.925311  5032 consensus_queue.cc:237] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:22.923641  4190 raft_consensus.cc:2749] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:22.956212  1528 raft_consensus.cc:3060] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:22.900842  4883 raft_consensus.cc:515] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:22.922055  5225 raft_consensus.cc:2749] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:22.964112  1530 raft_consensus.cc:2468] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 9.
I20260709 13:00:22.965284  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:23.007509  1523 raft_consensus.cc:3060] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:22.992313  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 13:00:22.995404  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 45773.3us
I20260709 13:00:23.009523  1571 leader_election.cc:304] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:22.952901  5227 raft_consensus.cc:493] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:23.012629  1528 raft_consensus.cc:2468] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 9.
I20260709 13:00:23.013348  1530 raft_consensus.cc:1240] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 LEADER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:00:23.014386  1528 raft_consensus.cc:1275] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:00:23.015779  1528 raft_consensus.cc:1240] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:23.008674  1531 raft_consensus.cc:2468] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 11.
I20260709 13:00:23.024447  1571 leader_election.cc:304] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:23.025722  4190 raft_consensus.cc:3060] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:00:23.003371  5180 consensus_meta.cc:287] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent flushing consensus metadata: real 0.815s	user 0.006s	sys 0.005s
I20260709 13:00:22.997789  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:22.999442  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:23.000527  1678 raft_consensus.cc:1240] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:23.027160  1525 raft_consensus.cc:1240] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:23.033464  1527 raft_consensus.cc:2468] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 9.
W20260709 13:00:22.995589  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:23.037524  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:23.038250  1677 raft_consensus.cc:2393] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 6: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
W20260709 13:00:23.038728  5213 log.cc:927] Time spent T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
I20260709 13:00:23.040196  2224 raft_consensus.cc:2468] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 7.
W20260709 13:00:23.026820  5191 log.cc:927] Time spent T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:00:23.036096  1571 leader_election.cc:304] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:00:23.031659  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 183202us
I20260709 13:00:22.995860  5235 raft_consensus.cc:2749] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:23.022578  5227 raft_consensus.cc:515] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:23.020103  5242 raft_consensus.cc:493] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:22.993366  4878 raft_consensus.cc:515] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:23.034170  5180 raft_consensus.cc:515] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:23.022078  1530 raft_consensus.cc:1240] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:00:23.060575  1646 leader_election.cc:304] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:23.062382  1523 raft_consensus.cc:2468] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 8.
W20260709 13:00:23.087260  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 51276.8us
I20260709 13:00:23.101593  1571 leader_election.cc:304] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:23.101702  4190 raft_consensus.cc:2749] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:23.102860  1571 leader_election.cc:304] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:23.102886  1646 leader_election.cc:304] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:00:23.092304  2192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:23.070282  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:23.035341  5049 raft_consensus.cc:2749] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:23.107806  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:23.074039  5227 leader_election.cc:290] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:00:23.079129  4885 consensus_meta.cc:287] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.676s	user 0.010s	sys 0.000s
I20260709 13:00:23.124468  4885 raft_consensus.cc:515] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:23.090066  5243 consensus_queue.cc:1059] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:00:23.087453  5235 raft_consensus.cc:2749] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:23.110742  4910 raft_consensus.cc:2749] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:00:23.111178  5232 raft_consensus.cc:2749] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:23.078244  5242 raft_consensus.cc:515] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:23.080737  4878 leader_election.cc:290] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:23.113677  4872 consensus_queue.cc:260] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:23.119186  1646 leader_election.cc:304] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
W20260709 13:00:23.120401  5228 log.cc:927] Time spent T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:00:23.068598  5216 raft_consensus.cc:3055] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:00:23.070622  5115 consensus_meta.cc:287] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent flushing consensus metadata: real 0.697s	user 0.010s	sys 0.001s
I20260709 13:00:23.071929  4787 leader_election.cc:290] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:23.121526  5086 raft_consensus.cc:2804] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:00:23.063364  5236 log.cc:927] Time spent T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 13:00:23.127166  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:23.127920  1672 raft_consensus.cc:1275] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 9 index: 10. (term mismatch)
I20260709 13:00:23.143004  1672 pending_rounds.cc:85] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90: Aborting all ops after (but not including) 9
I20260709 13:00:23.066269  5025 consensus_queue.cc:1048] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.072s
I20260709 13:00:23.072011  4883 leader_election.cc:290] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:23.136467  1571 leader_election.cc:304] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:23.089694  5180 leader_election.cc:290] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:00:23.111218  5234 log.cc:927] Time spent T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:00:23.143345  1672 pending_rounds.cc:107] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:00:23.075477  5024 raft_consensus.cc:515] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:23.146389  1672 raft_consensus.cc:2889] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:23.146674  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:23.151362  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:23.091141  5196 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:23.142482  5086 raft_consensus.cc:493] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:23.138849  5216 raft_consensus.cc:740] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:00:23.149582  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:23.153752  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:23.152566  5224 raft_consensus.cc:2804] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:23.142433  4872 raft_consensus.cc:3060] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:23.141448  5235 consensus_queue.cc:1059] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 13:00:23.144290  5115 raft_consensus.cc:2749] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:23.145309  5140 raft_consensus.cc:493] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:23.167940  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:23.158174  5086 raft_consensus.cc:3060] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:23.159730  5224 raft_consensus.cc:493] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:23.165998  5235 consensus_queue.cc:1243] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer ddf11fc190dd4b898773379c6b129d90 log is divergent from this leader: its last log entry 7.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:00:23.167922  5065 raft_consensus.cc:2764] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
I20260709 13:00:23.190762  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:23.191054  1572 leader_election.cc:304] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:23.180380  5224 raft_consensus.cc:3060] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:23.197522  2221 raft_consensus.cc:2468] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 6.
I20260709 13:00:23.205910  1572 leader_election.cc:304] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:23.205665  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:23.186199  5025 raft_consensus.cc:2804] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:23.179913  5140 raft_consensus.cc:515] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:23.218439  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:23.203984  4286 raft_consensus.cc:493] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:23.223371  4286 raft_consensus.cc:515] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:23.224503  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:23.202997  5235 raft_consensus.cc:2749] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:23.210760  4910 raft_consensus.cc:2749] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:23.226876  2219 raft_consensus.cc:2393] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 8: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:00:23.229383  1679 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4faabc98f1164ba881cfb477657da505"
dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
mode: GRACEFUL
new_leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:33616
I20260709 13:00:23.230235  1679 raft_consensus.cc:606] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 8 LEADER]: Received request to transfer leadership to TS e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:23.230321  5196 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:23.231281  5140 leader_election.cc:290] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:23.219367  4885 leader_election.cc:290] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:23.218551  5025 raft_consensus.cc:493] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:23.233026  5025 raft_consensus.cc:3060] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:23.234071  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:23.234901  1679 raft_consensus.cc:2368] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b for earlier term 10. Current term is 11.
I20260709 13:00:23.236356  1679 raft_consensus.cc:1240] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:23.238055  1679 raft_consensus.cc:1275] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:00:23.241012  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:23.241614  1680 raft_consensus.cc:2468] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 4.
I20260709 13:00:23.242882  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:23.246219  1680 raft_consensus.cc:1275] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:00:23.249657  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:23.250483  1680 raft_consensus.cc:2393] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 8: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:00:23.251883  5024 leader_election.cc:290] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:23.184836  5216 consensus_queue.cc:260] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:23.253012  5216 raft_consensus.cc:3060] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:23.254408  5242 leader_election.cc:290] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:00:23.220700  5246 log.cc:927] Time spent T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:00:23.256078  2220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 780) took 1003 ms. Trace:
I20260709 13:00:23.256493  2220 rpcz_store.cc:276] 0709 13:00:22.252495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:22.291188 (+ 38693us) service_pool.cc:224] Handling call
0709 13:00:23.255906 (+964718us) spinlock_profiling.cc:243] Waited 205 ms on lock 0x7b540050f5d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:23.256015 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":471289728}
I20260709 13:00:23.258147  2220 raft_consensus.cc:1275] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:00:23.263083  5146 raft_consensus.cc:493] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:23.263669  5146 raft_consensus.cc:515] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:23.264904  5016 raft_consensus.cc:493] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:23.265415  5016 raft_consensus.cc:515] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:00:23.266229  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 311307us
I20260709 13:00:23.266386  5115 consensus_queue.cc:1048] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:23.267400  5016 leader_election.cc:290] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:23.269896  5226 raft_consensus.cc:493] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:23.270491  5226 raft_consensus.cc:515] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:23.273048  5226 leader_election.cc:290] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:23.274215  2191 leader_election.cc:400] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 10 pre-election: Vote denied by peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217) with higher term. Message: Invalid argument: T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b for earlier term 10. Current term is 11.
I20260709 13:00:23.269907  5013 raft_consensus.cc:3060] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:23.281329  5025 raft_consensus.cc:515] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:23.283041  5253 raft_consensus.cc:493] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:23.283994  5253 raft_consensus.cc:515] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:23.285658  5099 consensus_queue.cc:1048] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:23.286175  5253 leader_election.cc:290] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:23.282923  4872 raft_consensus.cc:493] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:23.287385  4872 raft_consensus.cc:515] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:23.287784  5056 raft_consensus.cc:3055] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:23.288239  5056 raft_consensus.cc:740] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:23.289108  5056 consensus_queue.cc:260] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:23.290185  2220 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751"
dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
mode: GRACEFUL
new_leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:47682
I20260709 13:00:23.290871  2220 raft_consensus.cc:606] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 7 LEADER]: Received request to transfer leadership to TS e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:23.293501  1598 raft_consensus.cc:3055] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:23.293891  1598 raft_consensus.cc:740] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:23.288354  5025 leader_election.cc:290] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:23.294723  2225 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5"
dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
mode: GRACEFUL
new_leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:47682
W20260709 13:00:23.305310  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 186224us
I20260709 13:00:23.306083  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:23.307046  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:23.307448  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:23.309062  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:23.286712  2191 leader_election.cc:304] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:23.265731  5146 leader_election.cc:290] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:23.294634  1598 consensus_queue.cc:260] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:23.555246  2222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50310 (request call id 718) took 2486 ms. Trace:
I20260709 13:00:23.980804  2222 rpcz_store.cc:276] 0709 13:00:21.068699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:21.221047 (+152348us) service_pool.cc:224] Handling call
0709 13:00:21.221346 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:21.443178 (+221832us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:21.443213 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:21.443257 (+    44us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:21.443287 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:23.554968 (+2111681us) spinlock_profiling.cc:243] Waited 222 ms on lock 0x7b5400325ad4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:00:23.555017 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:23.555155 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":509661056}
W20260709 13:00:23.984193  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:23.312168  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
W20260709 13:00:23.538396  2223 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50326 (request call id 793) took 2701 ms (client timeout 1553 ms). Trace:
W20260709 13:00:23.985791  2223 rpcz_store.cc:269] 0709 13:00:20.836970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:20.839221 (+  2251us) service_pool.cc:224] Handling call
0709 13:00:23.538199 (+2698978us) spinlock_profiling.cc:243] Waited 1.68 s on lock 0x7b5400601b54. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:23.538320 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3872988032}
W20260709 13:00:23.376303  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 53761.8us
W20260709 13:00:23.496812  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 231900us
I20260709 13:00:23.989398  5115 raft_consensus.cc:493] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:23.990060  5115 raft_consensus.cc:515] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:23.334213  5242 raft_consensus.cc:493] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:23.992851  5115 leader_election.cc:290] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:23.290489  5056 raft_consensus.cc:3060] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:23.559199  2192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:23.309652  1675 raft_consensus.cc:2468] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 9.
W20260709 13:00:23.660648  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:23.334537  5130 raft_consensus.cc:2804] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:24.002331  1497 leader_election.cc:304] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:23.605782  5016 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:23.711483  5216 raft_consensus.cc:493] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:24.003623  1497 leader_election.cc:304] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:23.298848  4802 raft_consensus.cc:3060] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:24.004415  3934 raft_consensus.cc:2749] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:24.004165  5216 raft_consensus.cc:515] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:24.005093  3934 raft_consensus.cc:2749] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:23.360574  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:23.794617  5232 raft_consensus.cc:493] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:23.992573  5242 raft_consensus.cc:515] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:24.010584  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:24.023262  5066 raft_consensus.cc:493] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:24.023193  2219 raft_consensus.cc:1275] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:24.011337  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:24.025414  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:24.012176  1497 leader_election.cc:304] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:24.026183  2220 raft_consensus.cc:3060] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:24.026576  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 13:00:23.397017  2227 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 773) took 2681 ms (client timeout 3347 ms). Trace:
W20260709 13:00:23.372644  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:23.334148  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:24.027621  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:23.314169  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:23.313920  1604 raft_consensus.cc:1240] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
W20260709 13:00:23.504016  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:24.029309  1529 raft_consensus.cc:2468] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 4.
I20260709 13:00:24.031674  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:24.032119  1497 leader_election.cc:304] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:24.032895  3934 raft_consensus.cc:3060] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:24.017544  5238 consensus_queue.cc:1059] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:23.360036  5224 raft_consensus.cc:515] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:00:24.035727  1680 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.009s	sys 0.011s
W20260709 13:00:24.036193  1680 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.009s	sys 0.011s
I20260709 13:00:23.549160  5154 raft_consensus.cc:3055] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:23.410885  4872 leader_election.cc:290] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:24.019714  5253 raft_consensus.cc:493] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
W20260709 13:00:24.020270  5013 consensus_meta.cc:287] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent flushing consensus metadata: real 0.744s	user 0.008s	sys 0.001s
I20260709 13:00:24.003362  5016 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 13:00:23.342589  5099 consensus_queue.cc:1048] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.694s
I20260709 13:00:24.028329  1524 raft_consensus.cc:2468] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 7.
W20260709 13:00:24.027257  2227 rpcz_store.cc:269] 0709 13:00:20.699060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:21.010834 (+311774us) service_pool.cc:224] Handling call
0709 13:00:23.380021 (+2369187us) spinlock_profiling.cc:243] Waited 256 ms on lock 0x7b540051a754. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:23.380122 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":587681536}
I20260709 13:00:24.015496  1677 raft_consensus.cc:3060] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:24.009836  1530 raft_consensus.cc:3060] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:24.033142  1674 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.004s	sys 0.012s
I20260709 13:00:24.034371  1497 leader_election.cc:304] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:00:23.311185  5025 raft_consensus.cc:493] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.002883  5130 raft_consensus.cc:493] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:24.060401  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:23.555403  4946 leader_election.cc:290] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:23.771467  5039 raft_consensus.cc:493] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
W20260709 13:00:24.049782  1496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:23.542248  1672 raft_consensus.cc:1240] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 9. Current term is 10. Ops: []
W20260709 13:00:24.033790  5109 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.652s	user 0.020s	sys 0.020s
W20260709 13:00:24.055723  1674 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.005s	sys 0.012s
I20260709 13:00:24.035529  5235 raft_consensus.cc:493] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.064575  3934 raft_consensus.cc:2749] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:24.044643  2220 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 11.
I20260709 13:00:24.036101  5115 raft_consensus.cc:2749] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:24.023938  5066 raft_consensus.cc:515] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:24.076531  2218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50310 (request call id 725) took 1226 ms. Trace:
I20260709 13:00:24.096067  1496 leader_election.cc:304] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:24.045187  5154 raft_consensus.cc:740] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
W20260709 13:00:24.080356  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 46077.7us
I20260709 13:00:24.050987  5173 raft_consensus.cc:493] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:24.034835  5232 raft_consensus.cc:515] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:24.051534  5185 raft_consensus.cc:493] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:00:24.094200  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:23.553103  5086 raft_consensus.cc:515] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:24.095930  2218 rpcz_store.cc:276] 0709 13:00:22.849654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:23.225440 (+375786us) service_pool.cc:224] Handling call
0709 13:00:23.225774 (+   334us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:23.226151 (+   377us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:23.226177 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:23.227642 (+  1465us) log.cc:844] Serialized 52 byte log entry
0709 13:00:23.487989 (+260347us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:23.488037 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:23.488126 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:24.076300 (+588174us) raft_consensus.cc:1685] finished
0709 13:00:24.076321 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:24.076468 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2806,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":120,"thread_start_us":190282,"threads_started":1,"wal-append.queue_time_us":777068}
I20260709 13:00:24.110399  1497 leader_election.cc:304] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:00:24.120198  3934 raft_consensus.cc:2804] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:00:24.092060  5109 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.720s	user 0.020s	sys 0.020s
I20260709 13:00:24.082713  5130 raft_consensus.cc:3060] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:24.083630  5013 raft_consensus.cc:2804] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:24.053849  5253 raft_consensus.cc:515] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:24.128336  3934 raft_consensus.cc:493] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:24.136739  3934 raft_consensus.cc:3060] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:24.128667  1530 raft_consensus.cc:2468] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 9.
I20260709 13:00:24.134104  5064 leader_election.cc:290] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:24.134196  5119 raft_consensus.cc:2804] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:24.146502  1673 raft_consensus.cc:1240] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:00:24.149900  3934 raft_consensus.cc:515] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:24.126008  5251 raft_consensus.cc:493] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:24.146267  5119 raft_consensus.cc:493] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:24.124084  5146 consensus_queue.cc:1048] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:00:24.099797  5235 raft_consensus.cc:515] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:24.130075  5109 raft_consensus.cc:697] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 7 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:24.094782  5025 raft_consensus.cc:515] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:24.166589  1674 raft_consensus.cc:1240] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:00:24.168740  5154 consensus_queue.cc:260] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:24.153585  5119 raft_consensus.cc:3060] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:24.098483  5039 raft_consensus.cc:515] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:24.164896  5133 leader_election.cc:290] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:24.154218  5242 leader_election.cc:290] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:24.149099  5013 raft_consensus.cc:697] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
W20260709 13:00:24.430068  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:24.150800  5262 raft_consensus.cc:493] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.128921  5173 raft_consensus.cc:515] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:24.169270  5216 leader_election.cc:290] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:24.403959  5252 raft_consensus.cc:493] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.130702  5185 raft_consensus.cc:515] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:24.441087  5154 raft_consensus.cc:3060] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:24.432353  5224 leader_election.cc:290] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:24.491485  5039 leader_election.cc:290] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:24.498971  3934 leader_election.cc:290] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:24.460117  4946 raft_consensus.cc:493] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.236308  5251 raft_consensus.cc:515] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:24.460350  5115 raft_consensus.cc:493] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
W20260709 13:00:24.512156  5260 log.cc:927] Time spent T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.366s	user 0.000s	sys 0.000s
W20260709 13:00:24.512841  5263 log.cc:927] Time spent T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.413s	user 0.001s	sys 0.000s
I20260709 13:00:24.485073  5252 raft_consensus.cc:515] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:24.528000  1678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49170 (request call id 1997) took 1378 ms. Trace:
I20260709 13:00:24.529765  5066 leader_election.cc:290] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:24.532002  5185 leader_election.cc:290] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
W20260709 13:00:24.533308  5266 log.cc:927] Time spent T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 13:00:24.534150  5257 log.cc:927] Time spent T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260709 13:00:24.678210  1680 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.640s	user 0.004s	sys 0.006s
W20260709 13:00:24.649683  2221 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50326 (request call id 791) took 3813 ms (client timeout 1934 ms). Trace:
I20260709 13:00:24.668525  3934 raft_consensus.cc:493] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.672817  1678 rpcz_store.cc:276] 0709 13:00:23.149542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:23.149995 (+   453us) service_pool.cc:224] Handling call
0709 13:00:23.150298 (+   303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:23.150637 (+   339us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:00:23.150681 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:23.154060 (+  3379us) log.cc:844] Serialized 26 byte log entry
0709 13:00:23.357467 (+203407us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:23.357505 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:23.357572 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:24.527723 (+1170151us) raft_consensus.cc:1685] finished
0709 13:00:24.527746 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:24.527913 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8158,"raft.queue_time_us":53954,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":5376,"thread_start_us":186449,"threads_started":1,"wal-append.queue_time_us":1005876}
I20260709 13:00:24.567562  5224 raft_consensus.cc:493] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.679657  1676 raft_consensus.cc:1275] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 13:00:24.680645  1573 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.647s	user 0.002s	sys 0.007s
W20260709 13:00:24.553366  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:24.681576  1680 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.004s	sys 0.006s
W20260709 13:00:24.675544  1675 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.636s	user 0.007s	sys 0.002s
I20260709 13:00:24.670471  5235 leader_election.cc:290] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:00:24.735580  1523 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.007s	sys 0.003s
W20260709 13:00:24.703459  1529 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.002s	sys 0.009s
I20260709 13:00:24.767167  5232 leader_election.cc:290] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:24.767910  5253 leader_election.cc:290] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:00:24.742836  1571 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.691s	user 0.001s	sys 0.014s
W20260709 13:00:24.768656  1571 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.717s	user 0.002s	sys 0.016s
W20260709 13:00:24.768972  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 717728us
I20260709 13:00:24.551137  5109 consensus_queue.cc:237] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:00:24.769524  2221 rpcz_store.cc:269] 0709 13:00:20.836473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:20.874584 (+ 38111us) service_pool.cc:224] Handling call
0709 13:00:24.649423 (+3774839us) spinlock_profiling.cc:243] Waited 2.21 s on lock 0x7b540033e5d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:24.649587 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5084795648}
W20260709 13:00:24.770325  1675 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.733s	user 0.009s	sys 0.017s
W20260709 13:00:24.747169  1497 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.011s	sys 0.004s
W20260709 13:00:24.684798  2192 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.001s	sys 0.009s
I20260709 13:00:24.771643  3934 raft_consensus.cc:515] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:24.764324  5251 leader_election.cc:290] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:00:24.767185  1523 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.634s	user 0.008s	sys 0.004s
I20260709 13:00:24.773765  3934 leader_election.cc:290] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:00:24.772279  2192 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.598s	user 0.003s	sys 0.015s
I20260709 13:00:24.774147  5173 leader_election.cc:290] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:00:24.774717  1529 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.008s	sys 0.010s
W20260709 13:00:24.774497  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 600196us
W20260709 13:00:24.777908  1573 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.745s	user 0.003s	sys 0.008s
W20260709 13:00:24.771844  1497 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.635s	user 0.011s	sys 0.006s
I20260709 13:00:24.766003  5086 leader_election.cc:290] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:24.456854  5262 raft_consensus.cc:515] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:24.672070  4946 raft_consensus.cc:515] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:00:24.778079  2193 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.732s	user 0.005s	sys 0.013s
W20260709 13:00:25.051983  2192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:24.777393  1677 consensus_meta.cc:287] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.722s	user 0.005s	sys 0.004s
I20260709 13:00:25.320891  1677 raft_consensus.cc:1275] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 5. (term mismatch)
I20260709 13:00:25.321384  1677 pending_rounds.cc:85] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90: Aborting all ops after (but not including) 4
I20260709 13:00:25.321615  1677 pending_rounds.cc:107] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 13:00:25.321847  1677 raft_consensus.cc:2889] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:25.247447  1675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49178 (request call id 1865) took 1924 ms. Trace:
W20260709 13:00:24.944717  1646 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.906s	user 0.009s	sys 0.047s
W20260709 13:00:25.332422  1646 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.294s	user 0.015s	sys 0.059s
W20260709 13:00:25.151779  1572 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.119s	user 0.028s	sys 0.039s
W20260709 13:00:25.333056  1572 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.300s	user 0.028s	sys 0.047s
W20260709 13:00:25.116096  2190 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.067s	user 0.026s	sys 0.039s
W20260709 13:00:25.335762  2190 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.287s	user 0.026s	sys 0.048s
I20260709 13:00:24.774250  1523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49310 (request call id 765) took 1471 ms. Trace:
W20260709 13:00:25.313612  2193 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.268s	user 0.017s	sys 0.058s
I20260709 13:00:25.336838  1523 rpcz_store.cc:276] 0709 13:00:23.302372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:23.302495 (+   123us) service_pool.cc:224] Handling call
0709 13:00:23.302812 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:23.303003 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:00:23.767983 (+464980us) log.cc:844] Serialized 14 byte log entry
0709 13:00:24.773868 (+1005885us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:24.773924 (+    56us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:24.773964 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:24.774039 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:24.774189 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38997,"prepare.queue_time_us":93700,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":10033,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":85,"thread_start_us":1385890,"threads_started":3,"wal-append.queue_time_us":399689,"wal-append.run_cpu_time_us":1051,"wal-append.run_wall_time_us":1001081}
I20260709 13:00:25.331406  1680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50664 (request call id 784) took 2080 ms. Trace:
I20260709 13:00:25.313999  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50664 (request call id 787) took 1310 ms. Trace:
W20260709 13:00:25.319686  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 1.20937e+06us
I20260709 13:00:25.313235  3934 raft_consensus.cc:493] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:25.343366  3934 raft_consensus.cc:515] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:00:25.344661  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:25.341400  1680 rpcz_store.cc:276] 0709 13:00:23.252112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:23.252414 (+   302us) service_pool.cc:224] Handling call
0709 13:00:23.252795 (+   381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:23.253001 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:00:23.470705 (+217704us) log.cc:844] Serialized 14 byte log entry
0709 13:00:25.330962 (+1860257us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:25.331066 (+   104us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:25.331123 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:25.331195 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:25.331340 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1474,"prepare.queue_time_us":876031,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":42,"raft.queue_time_us":46991,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":7626,"thread_start_us":2075715,"threads_started":3,"wal-append.queue_time_us":772261}
I20260709 13:00:25.322552  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49178 (request call id 1864) took 2011 ms. Trace:
I20260709 13:00:25.369379  1677 rpcz_store.cc:276] 0709 13:00:23.310863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:23.544280 (+233417us) service_pool.cc:224] Handling call
0709 13:00:24.015376 (+471096us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:25.322281 (+1306905us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:25.322490 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:25.432253  5273 raft_consensus.cc:493] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:25.432979  5273 raft_consensus.cc:515] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:25.336067  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 1.30333e+06us
I20260709 13:00:25.341637  1676 rpcz_store.cc:276] 0709 13:00:24.003359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:24.662276 (+658917us) service_pool.cc:224] Handling call
0709 13:00:24.679341 (+ 17065us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:25.313676 (+634335us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:25.313919 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:25.323140  1675 rpcz_store.cc:276] 0709 13:00:23.323017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:24.000205 (+677188us) service_pool.cc:224] Handling call
0709 13:00:24.000563 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:24.000796 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:00:24.771192 (+770396us) log.cc:844] Serialized 14 byte log entry
0709 13:00:25.247068 (+475876us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:25.247129 (+    61us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:25.247173 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:25.247239 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:25.247376 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7266,"prepare.queue_time_us":164266,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":29,"raft.queue_time_us":108,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":10181,"thread_start_us":1208880,"threads_started":2}
W20260709 13:00:24.746074  5263 log.cc:927] Time spent T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:00:24.769146  5025 leader_election.cc:290] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:24.670034  5016 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:00:24.775836  5238 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.725s	user 0.002s	sys 0.016s
W20260709 13:00:25.278470  5154 consensus_meta.cc:287] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.790s	user 0.008s	sys 0.000s
I20260709 13:00:25.099133  5173 raft_consensus.cc:493] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.776330  5252 leader_election.cc:290] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:24.943945  5275 raft_consensus.cc:493] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.675894  5115 raft_consensus.cc:515] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:00:25.531697  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 189065us
I20260709 13:00:25.440725  5251 raft_consensus.cc:493] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:25.191882  5039 raft_consensus.cc:493] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:25.478359  5193 raft_consensus.cc:493] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:25.495941  3934 leader_election.cc:290] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:00:25.530913  5238 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.485s	user 0.013s	sys 0.035s
I20260709 13:00:24.698904  5013 consensus_queue.cc:237] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:25.528548  5277 raft_consensus.cc:493] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.853355  5224 raft_consensus.cc:515] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:25.529649  5025 raft_consensus.cc:493] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:25.543108  5252 raft_consensus.cc:493] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:25.533744  5276 raft_consensus.cc:493] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:25.555279  5119 consensus_meta.cc:287] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent flushing consensus metadata: real 1.123s	user 0.005s	sys 0.004s
I20260709 13:00:25.607131  3934 raft_consensus.cc:493] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
W20260709 13:00:25.567281  5109 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.795s	user 0.025s	sys 0.008s
I20260709 13:00:25.623073  3934 raft_consensus.cc:515] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:25.639380  3934 leader_election.cc:290] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:25.640087  3934 raft_consensus.cc:493] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:25.640607  3934 raft_consensus.cc:515] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:25.642760  3934 leader_election.cc:290] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:25.643373  3934 raft_consensus.cc:493] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:25.545470  5039 raft_consensus.cc:515] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:25.617549  5238 raft_consensus.cc:493] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:25.547034  5251 raft_consensus.cc:515] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:25.671473  5119 raft_consensus.cc:515] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:25.673532  5123 raft_consensus.cc:493] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:25.542891  5275 raft_consensus.cc:515] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:25.603859  5277 raft_consensus.cc:515] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:25.605962  5016 raft_consensus.cc:493] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:25.541009  5280 consensus_queue.cc:1048] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.077s
I20260709 13:00:25.618023  5252 raft_consensus.cc:515] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:25.637605  5109 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.865s	user 0.025s	sys 0.009s
I20260709 13:00:25.636603  5269 raft_consensus.cc:493] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:25.682152  4946 leader_election.cc:290] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:25.549410  5193 raft_consensus.cc:515] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:25.698176  3934 raft_consensus.cc:515] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:00:25.757019  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:25.759014  1572 leader_election.cc:304] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
W20260709 13:00:25.706427  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 241654us
I20260709 13:00:25.676222  5274 raft_consensus.cc:493] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:25.610219  5025 raft_consensus.cc:515] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:25.787894  5119 leader_election.cc:290] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:25.788209  5025 leader_election.cc:290] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:25.789455  5284 raft_consensus.cc:2749] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:25.792287  5193 leader_election.cc:290] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:25.792629  5200 raft_consensus.cc:3060] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:25.794215  5251 leader_election.cc:290] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:25.795898  5152 raft_consensus.cc:3060] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:25.635758  5276 raft_consensus.cc:515] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:25.800607  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:25.801142  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:25.801695  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:25.801990  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:25.802250  5276 leader_election.cc:290] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:25.802500  5271 raft_consensus.cc:493] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:25.803135  5271 raft_consensus.cc:515] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:25.804090  4802 consensus_meta.cc:287] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 1.800s	user 0.006s	sys 0.003s
I20260709 13:00:25.805133  1600 raft_consensus.cc:2410] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:00:25.805449  5271 leader_election.cc:290] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:00:25.806747  1600 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36200 (request call id 2169) took 2500 ms (client timeout 1712 ms). Trace:
I20260709 13:00:25.807075  5243 raft_consensus.cc:493] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:25.807425  5268 raft_consensus.cc:493] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:25.635982  5273 leader_election.cc:290] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:25.542366  5173 raft_consensus.cc:515] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:25.773686  1497 connection.cc:256] RPC call timeout handler was delayed by -1.9544043180000017s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3347s for a response
I20260709 13:00:25.688580  5262 leader_election.cc:290] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:25.690618  5224 leader_election.cc:290] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:25.778126  5269 raft_consensus.cc:515] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:25.783778  1603 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 741) took 3506 ms (client timeout 1763 ms). Trace:
W20260709 13:00:25.858318  1603 rpcz_store.cc:269] 0709 13:00:22.277543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:22.278339 (+   796us) service_pool.cc:224] Handling call
0709 13:00:25.783563 (+3505224us) spinlock_profiling.cc:243] Waited 542 ms on lock 0x7b54003b06d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:25.783684 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1246536448}
I20260709 13:00:25.785283  3934 leader_election.cc:290] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:25.785765  5274 raft_consensus.cc:515] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:25.807163  1600 rpcz_store.cc:269] 0709 13:00:23.306678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:23.306827 (+   149us) service_pool.cc:224] Handling call
0709 13:00:25.806456 (+2499629us) spinlock_profiling.cc:243] Waited 2.5 s on lock 0x7b54002ac954. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:25.806636 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5743375104}
I20260709 13:00:25.860155  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:25.860963  2190 leader_election.cc:304] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:25.815071  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:25.817447  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:25.862100  2190 leader_election.cc:304] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:25.818382  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:00:25.821816  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:25.863121  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:25.825116  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:25.828444  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
W20260709 13:00:25.809118  5281 log.cc:927] Time spent T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.264s	user 0.000s	sys 0.001s
I20260709 13:00:25.781410  4946 raft_consensus.cc:493] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:25.769068  5123 raft_consensus.cc:515] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:25.774914  5016 raft_consensus.cc:515] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:25.712729  5238 raft_consensus.cc:515] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:25.807763  5243 raft_consensus.cc:515] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:25.887048  5285 consensus_queue.cc:1048] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.073s
I20260709 13:00:25.864506  1528 raft_consensus.cc:3060] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:25.860970  1532 raft_consensus.cc:2468] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 13.
I20260709 13:00:25.863773  1676 raft_consensus.cc:2468] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 8.
I20260709 13:00:25.898881  5292 raft_consensus.cc:493] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:25.964267  1644 connection.cc:256] RPC call timeout handler was delayed by -2.0232558499999982s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23550000000000001s for a response
I20260709 13:00:25.912110  5252 leader_election.cc:290] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:00:25.964758  1644 connection.cc:256] RPC call timeout handler was delayed by -1.6634769000000347s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17120000000000002s for a response
W20260709 13:00:25.965106  1644 connection.cc:256] RPC call timeout handler was delayed by -1.4139362680000431s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21789999999999998s for a response
I20260709 13:00:25.965225  5252 raft_consensus.cc:493] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:25.965799  5252 raft_consensus.cc:515] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:25.967631  5100 raft_consensus.cc:493] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:25.867208  5289 raft_consensus.cc:493] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:25.832453  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:25.968302  5296 raft_consensus.cc:493] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:25.950299  2226 raft_consensus.cc:2468] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 8.
I20260709 13:00:25.970248  2225 raft_consensus.cc:606] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Received request to transfer leadership to TS e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:25.970630  2225 raft_consensus.cc:614] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:25.969712  5296 raft_consensus.cc:515] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:25.971112  5066 raft_consensus.cc:493] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:25.970863  5100 raft_consensus.cc:515] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:25.971611  5066 raft_consensus.cc:515] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:25.973129  5100 leader_election.cc:290] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:25.973277  5238 leader_election.cc:290] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:25.974080  5238 raft_consensus.cc:493] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:25.892521  5039 leader_election.cc:290] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:25.975001  5039 raft_consensus.cc:493] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:25.969383  1531 raft_consensus.cc:2468] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 8.
I20260709 13:00:25.975481  5039 raft_consensus.cc:515] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:25.864573  1646 leader_election.cc:304] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:25.866159  1680 raft_consensus.cc:1240] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:25.978639  5196 raft_consensus.cc:2749] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:25.908444  5277 leader_election.cc:290] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:25.909615  5275 leader_election.cc:290] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:25.912642  5053 raft_consensus.cc:3055] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:25.980466  5053 raft_consensus.cc:740] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:25.983701  1674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50664 (request call id 786) took 1980 ms. Trace:
W20260709 13:00:25.968449  1497 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.196:37373 timed out after 3.347s (SENT) [suppressed 13 similar messages]
I20260709 13:00:25.820309  5268 raft_consensus.cc:515] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:25.928344  5032 raft_consensus.cc:3055] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:25.858963  5119 raft_consensus.cc:493] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:25.917145  5099 raft_consensus.cc:2804] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:25.895309  5115 leader_election.cc:290] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:25.973150  5122 raft_consensus.cc:493] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
W20260709 13:00:25.974354  2226 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50310 (request call id 731) took 3086 ms (client timeout 1754 ms). Trace:
I20260709 13:00:25.985905  5122 raft_consensus.cc:515] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:25.986181  2226 rpcz_store.cc:269] 0709 13:00:22.888154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:22.915045 (+ 26891us) service_pool.cc:224] Handling call
0709 13:00:25.974171 (+3059126us) spinlock_profiling.cc:243] Waited 2.99 s on lock 0x7b540059c4d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:25.974274 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6887296384}
I20260709 13:00:25.987107  5243 leader_election.cc:290] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
W20260709 13:00:25.987320  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 204847us
I20260709 13:00:25.982559  5179 raft_consensus.cc:3055] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:25.987601  5296 leader_election.cc:290] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:25.991732  5146 raft_consensus.cc:493] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:25.979605  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 115107us
I20260709 13:00:25.992341  5146 raft_consensus.cc:515] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:25.984900  5032 raft_consensus.cc:740] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:25.994029  5032 consensus_queue.cc:260] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:25.979511  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49310 (request call id 774) took 1931 ms. Trace:
I20260709 13:00:26.006479  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:25.995502  1600 raft_consensus.cc:1240] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:25.990583  5119 raft_consensus.cc:515] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:25.910856  5137 raft_consensus.cc:2804] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:25.997009  1603 raft_consensus.cc:1240] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
W20260709 13:00:25.957523  2224 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50310 (request call id 728) took 3107 ms (client timeout 1605 ms). Trace:
I20260709 13:00:25.968621  5289 raft_consensus.cc:515] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:25.981379  5053 consensus_queue.cc:260] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:26.003038  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:26.041436  1604 raft_consensus.cc:3060] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:26.004066  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
W20260709 13:00:26.041941  1496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:26.004316  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:26.043032  1676 raft_consensus.cc:2410] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b for term 12 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:00:26.044055  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:26.004727  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:26.007150  1675 raft_consensus.cc:2468] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 9.
I20260709 13:00:26.046875  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:26.047050  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:25.888782  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:26.008080  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
W20260709 13:00:26.008199  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 199247us
I20260709 13:00:26.045586  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:25.870555  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:26.049593  1672 raft_consensus.cc:2468] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 10.
I20260709 13:00:26.049959  1530 raft_consensus.cc:3060] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:26.050474  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:00:25.953720  5130 consensus_meta.cc:287] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b: Time spent flushing consensus metadata: real 1.806s	user 0.010s	sys 0.000s
I20260709 13:00:25.871215  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:25.870929  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 13:00:26.010295  1644 connection.cc:256] RPC call timeout handler was delayed by -1.3555789480000726s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1505s for a response
I20260709 13:00:26.010808  1528 raft_consensus.cc:2468] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 12.
I20260709 13:00:26.018275  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:26.018715  1605 raft_consensus.cc:1275] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:00:26.052659  1644 connection.cc:256] RPC call timeout handler was delayed by -1.336174938000056s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1549s for a response
W20260709 13:00:26.053053  1644 connection.cc:256] RPC call timeout handler was delayed by -1.0384253830000603s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.194s for a response
W20260709 13:00:26.053334  1644 connection.cc:256] RPC call timeout handler was delayed by -1.0024863419999974s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19330000000000003s for a response
I20260709 13:00:26.053622  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:00:26.053795  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 191777us
I20260709 13:00:26.054260  1644 leader_election.cc:304] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:25.988516  5122 leader_election.cc:290] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:25.937765  4867 raft_consensus.cc:493] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:26.019265  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:26.062386  1602 raft_consensus.cc:3060] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:25.875193  5173 leader_election.cc:290] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:25.872843  5274 leader_election.cc:290] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:25.934406  5244 raft_consensus.cc:493] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:25.865419  5025 raft_consensus.cc:493] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:25.876361  5262 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:26.055716  5200 raft_consensus.cc:493] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:26.021049  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:25.870251  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 13:00:26.025223  1646 connection.cc:256] RPC call timeout handler was delayed by -1.3380984470000499s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1505s for a response
I20260709 13:00:26.005641  1529 rpcz_store.cc:276] 0709 13:00:24.047985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:24.050032 (+  2047us) service_pool.cc:224] Handling call
0709 13:00:24.050280 (+   248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:24.130515 (+ 80235us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:00:24.151961 (+ 21446us) log.cc:844] Serialized 14 byte log entry
0709 13:00:24.775275 (+623314us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:24.775324 (+    49us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:24.775364 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:25.979306 (+1203942us) spinlock_profiling.cc:243] Waited 80 ms on lock 0x7b540022ae54. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:00:25.979347 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:25.979458 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9057,"prepare.queue_time_us":22214,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":1513,"raft.queue_time_us":1332,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":77,"spinlock_wait_cycles":183987584,"thread_start_us":622382,"threads_started":1,"wal-append.queue_time_us":1075991}
W20260709 13:00:26.028673  2224 rpcz_store.cc:269] 0709 13:00:22.850449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:22.871296 (+ 20847us) service_pool.cc:224] Handling call
0709 13:00:25.957305 (+3086009us) spinlock_profiling.cc:243] Waited 149 ms on lock 0x7b540059cc54. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:25.957438 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":343132032}
I20260709 13:00:26.022640  2225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:47682 (request call id 15) took 2728 ms. Trace:
W20260709 13:00:26.032573  1572 connection.cc:256] RPC call timeout handler was delayed by -1.9632619939999927s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1605s for a response
I20260709 13:00:26.033445  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:26.035105  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:26.035996  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:26.038198  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:26.051260  1672 raft_consensus.cc:2393] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 11: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:00:26.009107  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:26.048332  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:26.052234  1601 raft_consensus.cc:3060] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:26.051805  1523 raft_consensus.cc:3060] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:26.030911  5196 raft_consensus.cc:493] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:26.055019  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:25.994443  5146 leader_election.cc:290] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:25.857676  5251 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:26.040702  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:26.056540  1680 raft_consensus.cc:2468] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 11.
I20260709 13:00:26.056146  1675 raft_consensus.cc:2393] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 12: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
W20260709 13:00:26.057065  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 88659.3us
I20260709 13:00:26.057502  1571 leader_election.cc:304] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:26.058226  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:26.052430  1527 raft_consensus.cc:2468] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 5.
I20260709 13:00:26.059531  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:25.984074  1674 rpcz_store.cc:276] 0709 13:00:24.003089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:24.245286 (+242197us) service_pool.cc:224] Handling call
0709 13:00:24.441747 (+196461us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:24.455547 (+ 13800us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:24.455577 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:24.456086 (+   509us) log.cc:844] Serialized 26 byte log entry
0709 13:00:24.775651 (+319565us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:24.775685 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:25.784938 (+1009253us) spinlock_profiling.cc:243] Waited 4.13 ms on lock 0x7b54000a4954. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:00:25.784990 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:25.983445 (+198455us) raft_consensus.cc:1685] finished
0709 13:00:25.983463 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:25.983646 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":27306,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":172967,"spinlock_wait_cycles":9496320,"thread_start_us":319252,"threads_started":1,"wal-append.queue_time_us":1074986}
I20260709 13:00:25.995009  5268 leader_election.cc:290] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:25.977797  5039 leader_election.cc:290] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:26.065478  3934 raft_consensus.cc:493] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:25.878561  5269 leader_election.cc:290] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:25.995093  5179 raft_consensus.cc:740] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:26.028465  5115 raft_consensus.cc:493] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:26.028046  5277 raft_consensus.cc:493] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:26.073693  1530 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 11.
I20260709 13:00:25.918361  1427 catalog_manager.cc:5697] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 4 to 5, leader changed from b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) to e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193). New cstate: current_term: 5 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:26.032168  5137 raft_consensus.cc:493] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:26.081651  1604 raft_consensus.cc:2468] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 11.
I20260709 13:00:26.031850  5068 raft_consensus.cc:493] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:25.995456  5292 raft_consensus.cc:515] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:26.077184  5032 raft_consensus.cc:3060] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:25.869700  5154 consensus_queue.cc:1048] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.151s
I20260709 13:00:26.031394  4946 raft_consensus.cc:515] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:26.034027  5238 raft_consensus.cc:515] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:26.291273  2219 raft_consensus.cc:2468] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 6.
W20260709 13:00:26.267515  1646 connection.cc:256] RPC call timeout handler was delayed by -1.2984984470000427s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1549s for a response
I20260709 13:00:26.292683  1677 raft_consensus.cc:2468] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 6.
I20260709 13:00:26.232422  1681 raft_consensus.cc:1275] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:00:26.293766  1600 raft_consensus.cc:2393] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 10: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
W20260709 13:00:26.293962  1572 connection.cc:256] RPC call timeout handler was delayed by -1.8291619940000032s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1754s for a response
I20260709 13:00:26.291828  2226 raft_consensus.cc:2468] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 9.
W20260709 13:00:26.170832  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 76763.7us
I20260709 13:00:26.267927  2218 raft_consensus.cc:2468] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 10.
W20260709 13:00:26.294776  1646 connection.cc:256] RPC call timeout handler was delayed by -1.1517984470000329s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17120000000000002s for a response
I20260709 13:00:26.293751  1603 raft_consensus.cc:2468] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 8.
I20260709 13:00:26.292616  1607 raft_consensus.cc:2468] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 13.
I20260709 13:00:26.290841  2225 rpcz_store.cc:276] 0709 13:00:23.294268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:23.294555 (+   287us) service_pool.cc:224] Handling call
0709 13:00:26.022426 (+2727871us) spinlock_profiling.cc:243] Waited 2.67 s on lock 0x7b540059c4d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185ad853 00007f6a1d57b60a 00007f6a16b017d4 00007f6a16b01762 00007f6a16b01691 00007f6a16b0160c 00007f6a16b008c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:26.022538 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6131783040}
I20260709 13:00:26.298130  1681 pending_rounds.cc:85] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90: Aborting all ops after (but not including) 8
I20260709 13:00:26.292479  1526 raft_consensus.cc:2468] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 7.
I20260709 13:00:26.091302  2191 leader_election.cc:304] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:26.293648  1605 raft_consensus.cc:2393] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 11: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:00:26.300696  1646 leader_election.cc:304] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:26.229944  1525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49310 (request call id 770) took 2849 ms. Trace:
I20260709 13:00:26.144472  1602 raft_consensus.cc:2468] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 12.
I20260709 13:00:26.055982  5099 raft_consensus.cc:697] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 9 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:26.299212  3934 raft_consensus.cc:515] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:26.060034  5130 raft_consensus.cc:515] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:26.301384  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:26.224591  5289 leader_election.cc:290] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:26.298009  5280 raft_consensus.cc:493] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:26.332389  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:26.631316  1604 raft_consensus.cc:2468] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 7.
I20260709 13:00:26.631176  5280 raft_consensus.cc:515] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:26.632331  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:26.632638  5123 leader_election.cc:290] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
W20260709 13:00:26.333331  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 275909us
I20260709 13:00:26.429301  1598 raft_consensus.cc:3060] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:26.336930  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:26.362645  1601 raft_consensus.cc:2468] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 10.
I20260709 13:00:26.426949  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:00:26.223097  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:26.629346  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 226388us
I20260709 13:00:26.354288  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:26.638622  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:26.635588  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:26.300022  5196 raft_consensus.cc:515] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:26.424604  1599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 740) took 4147 ms. Trace:
I20260709 13:00:26.650068  1599 rpcz_store.cc:276] 0709 13:00:22.277029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:22.277219 (+   190us) service_pool.cc:224] Handling call
0709 13:00:22.291122 (+ 13903us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:22.841387 (+550265us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:26.424358 (+3582971us) spinlock_profiling.cc:243] Waited 549 ms on lock 0x7b540035f2d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:00:26.424528 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1262032768}
I20260709 13:00:26.551016  5238 leader_election.cc:290] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:26.390071  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:26.651516  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:26.549544  5179 consensus_queue.cc:260] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:26.220535  5016 leader_election.cc:290] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:26.417783  1523 raft_consensus.cc:2468] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 11.
W20260709 13:00:26.652763  1570 connection.cc:256] RPC call timeout handler was delayed by -3.6004090339999948s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2073s for a response
W20260709 13:00:26.653375  1570 connection.cc:256] RPC call timeout handler was delayed by -3.2212589889999776s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1605s for a response
W20260709 13:00:26.653802  1570 connection.cc:256] RPC call timeout handler was delayed by -3.0268101599999682s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.199s for a response
I20260709 13:00:26.403364  5269 raft_consensus.cc:2804] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:00:26.654237  1570 connection.cc:256] RPC call timeout handler was delayed by -2.8333589889999757s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2036s for a response
W20260709 13:00:26.654644  1570 connection.cc:256] RPC call timeout handler was delayed by -2.8255537489999938s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1754s for a response
I20260709 13:00:26.553748  4286 leader_election.cc:290] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:00:26.657413  1570 connection.cc:256] RPC call timeout handler was delayed by -2.8223562489999949s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18520000000000003s for a response
W20260709 13:00:26.639859  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:26.657523  1527 raft_consensus.cc:1240] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:26.403039  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:26.390869  5251 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:26.659113  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:26.300380  1681 pending_rounds.cc:107] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:00:26.096868  5244 raft_consensus.cc:515] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:26.427630  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:00:26.427881  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 336658us
I20260709 13:00:26.659657  1681 raft_consensus.cc:2889] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:26.428290  4815 raft_consensus.cc:2804] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:26.660804  4815 raft_consensus.cc:493] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:26.306272  5067 raft_consensus.cc:2749] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:26.656692  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:26.298944  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:26.633131  1604 raft_consensus.cc:2393] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 11: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:00:26.064746  5013 raft_consensus.cc:493] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:26.639040  1680 raft_consensus.cc:2468] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 13.
I20260709 13:00:26.659317  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:26.679641  1527 raft_consensus.cc:2468] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 8.
I20260709 13:00:26.640292  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:26.679930  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:26.680509  2225 raft_consensus.cc:3060] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:26.641288  1603 raft_consensus.cc:2468] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 9.
W20260709 13:00:26.659948  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:26.302346  5200 raft_consensus.cc:515] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:26.295876  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:26.683765  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:26.684276  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:26.684444  3934 leader_election.cc:290] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:00:26.685063  1570 connection.cc:256] RPC call timeout handler was delayed by -2.1517884759999788s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1786s for a response
W20260709 13:00:26.685465  1570 connection.cc:256] RPC call timeout handler was delayed by -1.4542884759999879s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2561s for a response
I20260709 13:00:26.686033  1570 leader_election.cc:304] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:26.077014  5065 raft_consensus.cc:2804] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:26.661661  2222 raft_consensus.cc:2468] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 8.
I20260709 13:00:26.290645  5242 raft_consensus.cc:493] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:26.354971  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:26.692221  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:26.694164  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:26.085091  5285 consensus_queue.cc:1048] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.603s
I20260709 13:00:26.660972  4912 raft_consensus.cc:493] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:26.154723  5173 consensus_queue.cc:1048] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.509s
I20260709 13:00:26.306063  5068 raft_consensus.cc:515] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:26.709681  5068 leader_election.cc:290] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:26.219797  5119 leader_election.cc:290] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:26.424037  1673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49178 (request call id 1862) took 3113 ms. Trace:
I20260709 13:00:26.712452  1673 rpcz_store.cc:276] 0709 13:00:23.310383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:23.313509 (+  3126us) service_pool.cc:224] Handling call
0709 13:00:23.313750 (+   241us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:24.147003 (+833253us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:26.423727 (+2276724us) spinlock_profiling.cc:243] Waited 833 ms on lock 0x7b54002e6b54. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:00:26.423950 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1914792832}
I20260709 13:00:26.688791  5065 raft_consensus.cc:493] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:26.389570  5268 raft_consensus.cc:493] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:26.089867  5262 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:26.089407  5025 raft_consensus.cc:515] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:26.301625  5137 raft_consensus.cc:3060] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:26.223047  5252 leader_election.cc:290] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:26.221589  5232 raft_consensus.cc:3055] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:26.668967  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:26.669598  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:26.234896  5087 raft_consensus.cc:3060] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:26.660404  2191 leader_election.cc:304] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
W20260709 13:00:26.078902  5243 consensus_queue.cc:1175] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" responder_term: 5 status { last_received { term: 5 index: 4 } last_committed_idx: 4 last_received_current_leader { term: 5 index: 4 } }
I20260709 13:00:26.655217  4946 leader_election.cc:290] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:26.086529  5291 raft_consensus.cc:493] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:26.654587  5269 raft_consensus.cc:493] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:26.087333  5053 raft_consensus.cc:3060] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:26.306761  5277 raft_consensus.cc:515] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:26.388962  5115 raft_consensus.cc:515] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:26.196498  5241 raft_consensus.cc:493] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:26.664793  5066 leader_election.cc:290] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:26.656535  5130 leader_election.cc:290] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 5 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:26.670311  5093 consensus_queue.cc:1059] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:00:26.693549  5179 raft_consensus.cc:3060] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:26.706626  5280 leader_election.cc:290] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:26.665009  5099 consensus_queue.cc:237] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:26.711663  5224 raft_consensus.cc:2749] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:26.699633  5242 raft_consensus.cc:515] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:26.763075  5241 raft_consensus.cc:515] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:26.727893  5232 raft_consensus.cc:740] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:26.742914  5196 leader_election.cc:290] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:26.723567  5268 raft_consensus.cc:515] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:26.789361  5268 leader_election.cc:290] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:26.739565  5292 leader_election.cc:290] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:26.752877  5269 raft_consensus.cc:3060] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:26.741971  5244 leader_election.cc:290] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:26.767587  5298 raft_consensus.cc:3055] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:26.795050  5298 raft_consensus.cc:740] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:26.796116  5298 consensus_queue.cc:260] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:26.797518  5298 raft_consensus.cc:3060] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:26.771337  5242 leader_election.cc:290] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:26.774256  5277 leader_election.cc:290] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:26.775233  5251 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:26.779487  5262 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:26.753044  5291 raft_consensus.cc:515] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:26.800436  5269 raft_consensus.cc:515] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:26.801612  5291 leader_election.cc:290] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:26.802937  5269 leader_election.cc:290] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:26.652047  1525 rpcz_store.cc:276] 0709 13:00:23.380819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:24.008845 (+628026us) service_pool.cc:224] Handling call
0709 13:00:24.036515 (+ 27670us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:24.039351 (+  2836us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:24.039382 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:24.039424 (+    42us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:24.039453 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:26.229598 (+2190145us) spinlock_profiling.cc:243] Waited 2.56 ms on lock 0x7b54000505d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:00:26.229652 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:26.229823 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5897984}
I20260709 13:00:26.660270  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 13:00:26.662351  1496 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.006s	sys 0.014s
W20260709 13:00:26.840788  1496 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.784s	user 0.006s	sys 0.014s
I20260709 13:00:26.841634  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:26.696573  1570 leader_election.cc:304] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:26.844769  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:26.689549  1598 raft_consensus.cc:1275] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:00:26.653450  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:26.649173  1528 raft_consensus.cc:1275] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:00:26.847028  1598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36200 (request call id 2168) took 4239 ms. Trace:
I20260709 13:00:26.847452  1528 pending_rounds.cc:85] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting all ops after (but not including) 5
I20260709 13:00:26.658524  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:26.847510  1598 rpcz_store.cc:276] 0709 13:00:22.607656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:22.607820 (+   164us) service_pool.cc:224] Handling call
0709 13:00:22.608147 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:23.293403 (+685256us) spinlock_profiling.cc:243] Waited 305 ms on lock 0x7b540018fc20. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a1852adc0 00007f6a185b51c0 00007f6a185b6231 00007f6a185b2d8f 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c
0709 13:00:26.429082 (+3135679us) spinlock_profiling.cc:243] Waited 2.43 s on lock 0x7b58005189d0. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a1850f0aa 00007f6a18591447 00007f6a185a9fe7 00007f6a185ab7de 00007f6a185b5b49 00007f6a185b6416 00007f6a185b2d8f 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4
0709 13:00:26.846303 (+417221us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:26.846799 (+   496us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6279579136}
I20260709 13:00:26.850183  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:26.851220  1598 raft_consensus.cc:2468] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 7.
I20260709 13:00:26.852241  1523 raft_consensus.cc:2468] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 7.
I20260709 13:00:26.852545  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:26.848037  1528 pending_rounds.cc:107] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:00:26.839496  1526 raft_consensus.cc:2468] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 7.
I20260709 13:00:26.853219  1528 raft_consensus.cc:2889] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:26.669206  1599 raft_consensus.cc:2468] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 5.
I20260709 13:00:26.839625  1529 raft_consensus.cc:1275] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:00:26.856556  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:26.857405  1599 raft_consensus.cc:2468] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 7.
I20260709 13:00:26.858580  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:26.860216  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:26.651903  1600 raft_consensus.cc:2468] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 10.
I20260709 13:00:26.687003  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:26.862413  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:00:26.748225  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 87924.1us
I20260709 13:00:26.863798  1604 raft_consensus.cc:2393] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 9: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:00:26.865056  1600 raft_consensus.cc:1240] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:00:26.865803  1604 raft_consensus.cc:1275] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:00:26.865734  2191 leader_election.cc:304] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:26.427210  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:26.694844  1607 raft_consensus.cc:2468] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 8.
I20260709 13:00:26.867538  1605 raft_consensus.cc:2468] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 6.
I20260709 13:00:26.869601  1607 raft_consensus.cc:1240] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:26.657809  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:26.870831  1674 raft_consensus.cc:2468] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 9.
I20260709 13:00:26.674304  1672 raft_consensus.cc:2410] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:00:26.713625  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:26.873417  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:26.873603  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:26.695348  1676 raft_consensus.cc:2393] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 11: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:00:26.702685  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:26.692166  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:26.874398  1672 raft_consensus.cc:2468] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 8.
I20260709 13:00:26.692890  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:26.714254  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:26.689489  5013 raft_consensus.cc:515] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:26.701813  2225 raft_consensus.cc:2468] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 8.
I20260709 13:00:26.085752  4867 raft_consensus.cc:515] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:26.721118  5065 raft_consensus.cc:3060] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:26.691756  4802 raft_consensus.cc:493] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:26.763921  5115 leader_election.cc:290] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:26.750526  5041 raft_consensus.cc:2804] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:26.673846  4815 raft_consensus.cc:3060] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:26.884856  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 188279us
I20260709 13:00:26.904596  1570 leader_election.cc:304] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:26.647816  1601 raft_consensus.cc:2468] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 8.
W20260709 13:00:26.951471  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:26.952116  1571 leader_election.cc:304] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:26.713191  4912 raft_consensus.cc:515] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:26.964936  5137 raft_consensus.cc:515] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:26.875958  1680 raft_consensus.cc:2468] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 7.
I20260709 13:00:26.967414  5137 leader_election.cc:290] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 8 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:26.890516  5100 raft_consensus.cc:2804] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:26.968178  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:26.969206  1680 raft_consensus.cc:3060] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:26.970824  5100 raft_consensus.cc:493] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:26.971370  5100 raft_consensus.cc:3060] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:00:26.633698  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 562319us
I20260709 13:00:26.705753  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:26.787119  5200 leader_election.cc:290] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:26.781036  5232 consensus_queue.cc:260] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:26.785995  5241 leader_election.cc:290] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:26.738579  2227 raft_consensus.cc:1275] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:26.715181  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50664 (request call id 777) took 3475 ms. Trace:
I20260709 13:00:26.689147  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:26.867274  1606 raft_consensus.cc:3060] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:26.874629  1673 raft_consensus.cc:3060] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:26.882860  5013 leader_election.cc:290] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:26.877130  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:26.875098  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:26.845942  1524 raft_consensus.cc:2468] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 9.
I20260709 13:00:26.885250  4867 leader_election.cc:290] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:26.871551  1602 raft_consensus.cc:2468] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 9.
I20260709 13:00:26.861562  1427 catalog_manager.cc:5697] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 1 to 4, leader changed from e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) to b96ce9cc496c49d7818fa983a17b062b (127.0.107.196). New cstate: current_term: 4 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
W20260709 13:00:26.945395  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 90044.8us
I20260709 13:00:26.950242  1604 raft_consensus.cc:1275] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:00:26.891757  5115 consensus_queue.cc:1059] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.098s
I20260709 13:00:26.891506  5041 raft_consensus.cc:493] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:26.889420  5025 leader_election.cc:290] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:26.885457  5093 raft_consensus.cc:2804] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:26.886408  5277 raft_consensus.cc:493] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:26.892096  5238 raft_consensus.cc:493] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:26.886499  4802 raft_consensus.cc:515] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:26.887089  5280 raft_consensus.cc:493] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
W20260709 13:00:27.443306  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:27.333595  1680 raft_consensus.cc:2468] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 5.
I20260709 13:00:27.051726  1598 raft_consensus.cc:2410] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b for term 8 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:00:27.050473  1600 raft_consensus.cc:1240] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:27.199540  1674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49178 (request call id 1875) took 1128 ms. Trace:
W20260709 13:00:27.190927  1677 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.510s	user 0.005s	sys 0.015s
I20260709 13:00:27.200577  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49178 (request call id 1869) took 1174 ms. Trace:
I20260709 13:00:27.182638  1607 raft_consensus.cc:1275] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:00:27.448009  1674 rpcz_store.cc:276] 0709 13:00:26.071115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:26.299747 (+228632us) service_pool.cc:224] Handling call
0709 13:00:27.199288 (+899541us) spinlock_profiling.cc:243] Waited 208 ms on lock 0x7b54002fce54. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:27.199458 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":479363328}
I20260709 13:00:27.453104  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:27.454157  1680 raft_consensus.cc:2468] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 6.
I20260709 13:00:27.450742  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 766) took 1142 ms. Trace:
I20260709 13:00:27.450799  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 752) took 1276 ms. Trace:
I20260709 13:00:27.454216  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:27.204473  4912 leader_election.cc:290] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:27.450726  1524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43010 (request call id 2062) took 1034 ms. Trace:
I20260709 13:00:27.452241  1600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36200 (request call id 2183) took 1440 ms. Trace:
I20260709 13:00:27.456420  1604 rpcz_store.cc:276] 0709 13:00:26.169389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:26.946891 (+777502us) service_pool.cc:224] Handling call
0709 13:00:26.949689 (+  2798us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:27.445506 (+495817us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:27.445692 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:27.460811  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:27.461182  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 756) took 1270 ms. Trace:
I20260709 13:00:27.457695  1524 rpcz_store.cc:276] 0709 13:00:26.410652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:26.410800 (+   148us) service_pool.cc:224] Handling call
0709 13:00:26.844240 (+433440us) spinlock_profiling.cc:243] Waited 25.6 ms on lock 0x7b5800002a98. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a1548eb71 00007f6a1548ea22 00007f6a1e3a7c09 00007f6a1d501ee0 00007f6a1d5cb0ab 00007f6a1d5cb131 00007f6a1d5790a0 00007f6a1d578984 00007f6a16af36d4 00007f6a16af3662
0709 13:00:27.445210 (+600970us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":58895104}
I20260709 13:00:27.451522  1676 rpcz_store.cc:276] 0709 13:00:26.025603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:26.043777 (+ 18174us) service_pool.cc:224] Handling call
0709 13:00:27.200208 (+1156431us) spinlock_profiling.cc:243] Waited 650 ms on lock 0x7b540024de54. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:27.200365 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1496117504}
I20260709 13:00:27.455008  1602 rpcz_store.cc:276] 0709 13:00:26.308285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:26.657561 (+349276us) service_pool.cc:224] Handling call
0709 13:00:27.444809 (+787248us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:27.049796  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 385082us
I20260709 13:00:27.457125  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:27.462487  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 751) took 1293 ms. Trace:
I20260709 13:00:27.065742  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:27.458340  1600 rpcz_store.cc:276] 0709 13:00:26.012280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:26.866380 (+854100us) service_pool.cc:224] Handling call
0709 13:00:26.984108 (+117728us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:27.451965 (+467857us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:27.452183 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:27.463311  1604 rpcz_store.cc:276] 0709 13:00:26.191125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:27.459726 (+1268601us) service_pool.cc:224] Handling call
0709 13:00:27.460267 (+   541us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:27.460735 (+   468us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:27.460781 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:27.460842 (+    61us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:27.460886 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:27.460961 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:27.461109 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:27.465287  1599 raft_consensus.cc:3060] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:27.467478  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 446917us
W20260709 13:00:27.467662  4815 consensus_meta.cc:287] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b: Time spent flushing consensus metadata: real 0.554s	user 0.008s	sys 0.003s
I20260709 13:00:27.468202  4815 raft_consensus.cc:515] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:27.468447  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:27.468874  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 13:00:27.469098  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 564827us
I20260709 13:00:27.469834  2219 raft_consensus.cc:2393] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 10: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:00:27.470045  1570 leader_election.cc:304] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:27.470854  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:27.472404  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:27.473681  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:27.066740  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:27.464121  1607 rpcz_store.cc:276] 0709 13:00:26.169160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:26.870635 (+701475us) service_pool.cc:224] Handling call
0709 13:00:27.051692 (+181057us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:27.452387 (+400695us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:27.462424 (+ 10037us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:27.457453  1674 raft_consensus.cc:2468] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 6.
I20260709 13:00:27.450482  5041 raft_consensus.cc:3060] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:27.357410  5291 raft_consensus.cc:493] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:27.455505  5093 raft_consensus.cc:493] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:27.481962  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:27.468502  1644 leader_election.cc:304] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:27.417897  5100 raft_consensus.cc:515] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:27.490922  5296 raft_consensus.cc:2804] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:27.491519  5296 raft_consensus.cc:493] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:27.491952  5296 raft_consensus.cc:3060] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:27.495165  1672 raft_consensus.cc:2410] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 13:00:27.492048  5122 raft_consensus.cc:2804] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:27.497429  1678 raft_consensus.cc:2393] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 11: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
W20260709 13:00:27.497628  1497 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.695s	user 0.011s	sys 0.012s
I20260709 13:00:27.494962  2227 raft_consensus.cc:2468] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 4.
W20260709 13:00:27.503340  1571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:27.073004  5292 consensus_queue.cc:1048] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.464s
I20260709 13:00:27.492277  5110 raft_consensus.cc:2804] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:27.505947  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:27.502630  2218 raft_consensus.cc:2468] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 8.
W20260709 13:00:27.505828  1497 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.870s	user 0.012s	sys 0.013s
I20260709 13:00:27.489909  5093 raft_consensus.cc:3060] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:27.509146  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:27.507962  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:27.510572  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:27.500888  5122 raft_consensus.cc:493] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:27.038807  2225 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "770925e70faa4a16a275abd5282f5284"
dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
mode: GRACEFUL
new_leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:47682
I20260709 13:00:27.516031  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:27.516436  2222 raft_consensus.cc:2468] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 9.
I20260709 13:00:27.515467  2221 raft_consensus.cc:2410] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 13:00:27.519205  1607 raft_consensus.cc:1275] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:00:27.519471  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:27.522356  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:00:27.516378  1426 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46274 (request call id 360) took 22739 ms (client timeout 15000 ms). Trace:
I20260709 13:00:27.523064  2225 raft_consensus.cc:606] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Received request to transfer leadership to TS e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:27.525147  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49178 (request call id 1870) took 1488 ms. Trace:
I20260709 13:00:27.529222  1598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 757) took 1324 ms. Trace:
I20260709 13:00:27.510404  5110 raft_consensus.cc:493] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:27.529580  1598 rpcz_store.cc:276] 0709 13:00:26.205308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:26.852109 (+646801us) service_pool.cc:224] Handling call
0709 13:00:27.526377 (+674268us) spinlock_profiling.cc:243] Waited 185 ms on lock 0x7b54002675d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:27.529160 (+  2783us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":424822656}
I20260709 13:00:27.528252  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 754) took 1305 ms. Trace:
I20260709 13:00:27.529762  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 764) took 1217 ms. Trace:
I20260709 13:00:27.533174  1607 rpcz_store.cc:276] 0709 13:00:26.307838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:27.478946 (+1171108us) service_pool.cc:224] Handling call
0709 13:00:27.508069 (+ 29123us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:27.522385 (+ 14316us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:27.524864 (+  2479us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:27.524065  5032 consensus_meta.cc:287] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 1.142s	user 0.008s	sys 0.010s
I20260709 13:00:27.533288  1600 raft_consensus.cc:1275] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:00:27.492749  5238 raft_consensus.cc:515] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:27.520331  5122 raft_consensus.cc:3060] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:27.534288  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 899104us
I20260709 13:00:27.532740  1601 rpcz_store.cc:276] 0709 13:00:26.169811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:26.953495 (+783684us) service_pool.cc:224] Handling call
0709 13:00:26.954028 (+   533us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:27.455074 (+501046us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:27.455107 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:27.455172 (+    65us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:27.455199 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:27.464973 (+  9774us) spinlock_profiling.cc:243] Waited 490 ms on lock 0x7b5400267ad4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:00:27.465024 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:27.475080 (+ 10056us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1127019392}
I20260709 13:00:27.539819  1679 raft_consensus.cc:1275] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:00:27.535172  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:27.540820  1680 raft_consensus.cc:2393] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 7: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:00:27.532105  2225 raft_consensus.cc:614] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:27.537034  1570 leader_election.cc:304] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:27.543138  5066 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:27.543781  5066 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:27.546206  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 77860.6us
I20260709 13:00:27.538964  1676 raft_consensus.cc:2468] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 9.
I20260709 13:00:27.547952  1600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 759) took 1249 ms. Trace:
I20260709 13:00:27.548228  1600 rpcz_store.cc:276] 0709 13:00:26.291826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:27.478916 (+1187090us) service_pool.cc:224] Handling call
0709 13:00:27.501279 (+ 22363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:27.536226 (+ 34947us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:27.540638 (+  4412us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:27.549927  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:27.524708  1681 rpcz_store.cc:276] 0709 13:00:23.239881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:23.240002 (+   121us) service_pool.cc:224] Handling call
0709 13:00:23.240252 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:26.660846 (+3420594us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:26.711365 (+ 50519us) spinlock_profiling.cc:243] Waited 2.99 s on lock 0x7b540031d3d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:00:26.715125 (+  3760us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6881086720}
I20260709 13:00:27.552798  5064 raft_consensus.cc:493] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:27.553507  5064 raft_consensus.cc:515] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:27.506619  5277 raft_consensus.cc:515] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:27.524138  1427 catalog_manager.cc:5697] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:27.534565  5110 raft_consensus.cc:3060] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:27.559669  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:27.557597  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 760) took 1257 ms. Trace:
W20260709 13:00:27.546828  5286 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.715s	user 0.015s	sys 0.035s
I20260709 13:00:27.513242  5280 raft_consensus.cc:515] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:27.561056  1604 rpcz_store.cc:276] 0709 13:00:26.300007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:27.481421 (+1181414us) service_pool.cc:224] Handling call
0709 13:00:27.513206 (+ 31785us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:27.552056 (+ 38850us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:27.552101 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:27.557345 (+  5244us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:27.557385 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:27.557440 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:27.557547 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:27.563716  1672 raft_consensus.cc:1240] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:27.554581  4802 leader_election.cc:290] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:27.567325  2227 raft_consensus.cc:1240] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:27.564164  1603 raft_consensus.cc:2468] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 8.
I20260709 13:00:27.527397  1677 rpcz_store.cc:276] 0709 13:00:26.036994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:26.668929 (+631935us) service_pool.cc:224] Handling call
0709 13:00:26.679123 (+ 10194us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:26.679549 (+   426us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:26.679578 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:26.680112 (+   534us) log.cc:844] Serialized 52 byte log entry
0709 13:00:27.495287 (+815175us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:27.506933 (+ 11646us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:27.514588 (+  7655us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:27.514628 (+    40us) raft_consensus.cc:1685] finished
0709 13:00:27.514639 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:27.525105 (+ 10466us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":89,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":8435,"thread_start_us":777995,"threads_started":1,"wal-append.queue_time_us":791471}
W20260709 13:00:27.570145  5286 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.808s	user 0.015s	sys 0.036s
I20260709 13:00:27.536957  5291 raft_consensus.cc:515] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:27.577956  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36200 (request call id 2191) took 1563 ms. Trace:
W20260709 13:00:27.572031  5165 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 13:00:27.583912  5269 raft_consensus.cc:2749] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:27.586585  5292 raft_consensus.cc:493] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:27.587303  5292 raft_consensus.cc:515] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:27.581491  1603 rpcz_store.cc:276] 0709 13:00:26.014203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:26.688832 (+674629us) service_pool.cc:224] Handling call
0709 13:00:27.574916 (+886084us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:27.594084  5292 leader_election.cc:290] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:27.595636  5064 leader_election.cc:290] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:27.596926  5066 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:00:27.582805  5065 consensus_meta.cc:287] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.637s	user 0.012s	sys 0.002s
I20260709 13:00:27.603950  5065 raft_consensus.cc:515] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:27.580950  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 13:00:27.614302  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 114783us
I20260709 13:00:27.615337  5100 leader_election.cc:290] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:27.591099  4815 leader_election.cc:290] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:27.606562  5065 leader_election.cc:290] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:27.615353  5241 raft_consensus.cc:2804] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:27.635650  5241 raft_consensus.cc:493] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:27.636082  5241 raft_consensus.cc:3060] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:27.625911  1675 raft_consensus.cc:2393] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 10: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
W20260709 13:00:27.525777  1426 rpcz_store.cc:269] 0709 13:00:04.775164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:04.775433 (+   269us) service_pool.cc:224] Handling call
0709 13:00:27.513988 (+22738555us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:12.806205 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:12.987197 (+180992us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:12.987230 (+    33us) write_op.cc:435] Acquired schema lock
0709 13:00:12.987246 (+    16us) tablet.cc:662] Decoding operations
0709 13:00:13.666795 (+679549us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:13.670087 (+  3292us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:13.678025 (+  7938us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:00:14.164551 (+486526us) tablet.cc:701] Row locks acquired
0709 13:00:14.167174 (+  2623us) write_op.cc:260] PREPARE: finished
0709 13:00:14.212450 (+ 45276us) write_op.cc:270] Start()
0709 13:00:14.279275 (+ 66825us) write_op.cc:276] Timestamp: P: 1783602014206090 usec, L: 0
0709 13:00:14.284562 (+  5287us) op_driver.cc:348] REPLICATION: starting
0709 13:00:14.385077 (+100515us) log.cc:844] Serialized 4795 byte log entry
0709 13:00:14.933583 (+548506us) op_driver.cc:464] REPLICATION: finished
0709 13:00:15.586907 (+653324us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b4400022b4c. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a153ecc85 00007f6a153ed6a2 00007f6a1815f1db 00007f6a1815aaaf 00007f6a154a90ac 00007f6a1e303ab9 00007f6a154c569b 00007f6a154c393f 00007f6a154c5c02 00007f6a1bfe9ef0
0709 13:00:16.235233 (+648326us) write_op.cc:301] APPLY: starting
0709 13:00:16.235419 (+   186us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:16.235791 (+   372us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:16.235827 (+    36us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:16.346636 (+110809us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:16.416508 (+ 69872us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=12
0709 13:00:16.423581 (+  7073us) write_op.cc:312] APPLY: finished
0709 13:00:16.469274 (+ 45693us) log.cc:844] Serialized 89 byte log entry
0709 13:00:16.559714 (+ 90440us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:16.671028 (+111314us) write_op.cc:454] Released schema lock
0709 13:00:16.681078 (+ 10050us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:16.752512 (+ 71434us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:16.752548 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":26375,"reported_tablets":45,"child_traces":[["op",{"apply.queue_time_us":1301267,"apply.run_cpu_time_us":24554,"apply.run_wall_time_us":508224,"num_ops":12,"prepare.queue_time_us":162407,"prepare.run_cpu_time_us":42266,"prepare.run_wall_time_us":1826151,"raft.queue_time_us":63829,"raft.run_cpu_time_us":31843,"raft.run_wall_time_us":1425023,"replication_time_us":648842,"spinlock_wait_cycles":28307840,"thread_start_us":1813139,"threads_started":5,"wal-append.queue_time_us":488001,"wal-append.run_cpu_time_us":28507,"wal-append.run_wall_time_us":2415683}]]}
I20260709 13:00:27.628598  1644 leader_election.cc:304] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:27.619999  2226 raft_consensus.cc:2468] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 8.
I20260709 13:00:27.643463  1570 leader_election.cc:304] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:27.645684  1570 leader_election.cc:304] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:27.647856  5280 leader_election.cc:290] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:00:27.648155  5314 log.cc:927] Time spent T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:00:27.641960  1427 catalog_manager.cc:5697] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 2 to 5, leader changed from e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 5 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } }
I20260709 13:00:27.662735  4802 raft_consensus.cc:2749] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:27.666347  1599 raft_consensus.cc:2468] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 9.
W20260709 13:00:27.678960  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 50502.4us
I20260709 13:00:27.679811  5277 leader_election.cc:290] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:27.679965  1644 leader_election.cc:304] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:27.681149  1644 leader_election.cc:304] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:27.682072  5064 raft_consensus.cc:2804] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:27.682482  5064 raft_consensus.cc:493] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:27.682905  5064 raft_consensus.cc:3060] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:27.682979  5296 raft_consensus.cc:515] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:27.685318  5296 leader_election.cc:290] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:27.686898  5025 raft_consensus.cc:2804] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:27.695384  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 749) took 1526 ms. Trace:
I20260709 13:00:27.695888  1605 rpcz_store.cc:276] 0709 13:00:26.168652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:26.868555 (+699903us) service_pool.cc:224] Handling call
0709 13:00:26.869167 (+   612us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:27.462430 (+593263us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:00:27.495158 (+ 32728us) log.cc:844] Serialized 14 byte log entry
0709 13:00:27.691759 (+196601us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:27.691811 (+    52us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:27.691863 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:27.691927 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:27.695316 (+  3389us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":104908,"prepare.queue_time_us":14038,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":56,"raft.queue_time_us":621976,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":207,"spinlock_wait_cycles":31488,"thread_start_us":159669,"threads_started":1,"wal-append.queue_time_us":160571}
I20260709 13:00:27.619853  5032 consensus_queue.cc:1059] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.054s
W20260709 13:00:27.701663  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 194262us
I20260709 13:00:27.687433  5025 raft_consensus.cc:493] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:27.712119  1606 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 11.
I20260709 13:00:27.715250  5065 raft_consensus.cc:2804] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:27.716771  5269 raft_consensus.cc:2804] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:27.717552  5269 raft_consensus.cc:697] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 9 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:27.718955  5269 consensus_queue.cc:237] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:27.720513  1675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49178 (request call id 1868) took 1695 ms. Trace:
I20260709 13:00:27.720918  1675 rpcz_store.cc:276] 0709 13:00:26.025264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:26.630501 (+605237us) service_pool.cc:224] Handling call
0709 13:00:27.720284 (+1089783us) spinlock_profiling.cc:243] Waited 958 ms on lock 0x7b54000cdfd4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:27.720452 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2203971968}
W20260709 13:00:27.722862  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 77319.5us
I20260709 13:00:27.723732  1570 leader_election.cc:304] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:27.724726  5296 raft_consensus.cc:2804] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:27.725282  5296 raft_consensus.cc:697] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 8 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:27.725821  1599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 755) took 1555 ms. Trace:
I20260709 13:00:27.726253  1599 rpcz_store.cc:276] 0709 13:00:26.170031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:26.859809 (+689778us) service_pool.cc:224] Handling call
0709 13:00:27.725628 (+865819us) spinlock_profiling.cc:243] Waited 604 ms on lock 0x7b540037e1d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:27.725762 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1390006528}
I20260709 13:00:27.726361  5296 consensus_queue.cc:237] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:27.728842  5013 raft_consensus.cc:3055] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:27.729347  5013 raft_consensus.cc:740] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:00:27.732914  2222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50326 (request call id 829) took 1040 ms. Trace:
I20260709 13:00:27.733505  2222 rpcz_store.cc:276] 0709 13:00:26.692500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:26.692637 (+   137us) service_pool.cc:224] Handling call
0709 13:00:27.732659 (+1040022us) spinlock_profiling.cc:243] Waited 611 ms on lock 0x7b540054ef54. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:27.732828 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1404468096}
I20260709 13:00:27.738592  1679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50664 (request call id 776) took 4499 ms. Trace:
I20260709 13:00:27.738925  1571 leader_election.cc:304] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:27.739132  1679 rpcz_store.cc:276] 0709 13:00:23.239063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:23.239178 (+   115us) service_pool.cc:224] Handling call
0709 13:00:23.239478 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:27.541817 (+4302339us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:27.738297 (+196480us) spinlock_profiling.cc:243] Waited 3.95 s on lock 0x7b54003e6f54. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:00:27.738516 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9092954240}
W20260709 13:00:27.758517  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 303591us
I20260709 13:00:27.711928  5025 raft_consensus.cc:3060] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:27.714493  1427 catalog_manager.cc:5697] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 1 to 4, leader changed from ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) to e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:27.761505  1673 raft_consensus.cc:2468] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 9.
I20260709 13:00:27.763468  1644 leader_election.cc:304] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:27.764227  1605 raft_consensus.cc:1240] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
W20260709 13:00:27.764828  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 60883.2us
W20260709 13:00:27.765468  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:27.765745  1644 leader_election.cc:304] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
W20260709 13:00:27.766153  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:27.766216  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:27.766584  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
W20260709 13:00:27.779691  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 79657.4us
W20260709 13:00:27.785923  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:27.791937  1644 leader_election.cc:304] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:27.775709  5032 raft_consensus.cc:2804] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:27.779070  5065 raft_consensus.cc:697] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 12 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:27.730544  5013 consensus_queue.cc:260] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:27.803364  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:27.810328  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:27.812738  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:27.813454  2227 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 11.
I20260709 13:00:27.814592  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:27.815843  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:27.818928  1604 raft_consensus.cc:1240] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:27.821365  5110 raft_consensus.cc:515] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:27.824587  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 13:00:27.830780  5306 log.cc:927] Time spent T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:00:27.831007  5291 leader_election.cc:290] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:27.831625  5331 raft_consensus.cc:2804] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:27.831944  5291 raft_consensus.cc:493] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:27.800073  5032 raft_consensus.cc:493] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:27.838346  5291 raft_consensus.cc:515] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:27.841557  1497 leader_election.cc:304] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:27.842135  5115 raft_consensus.cc:493] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:27.853982  5115 raft_consensus.cc:515] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:27.854995  5326 raft_consensus.cc:493] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:27.855574  5326 raft_consensus.cc:515] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:27.855998  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:27.856257  5115 leader_election.cc:290] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:27.856889  5115 raft_consensus.cc:2749] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:27.818334  5241 raft_consensus.cc:515] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:27.857824  5326 leader_election.cc:290] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:27.859231  5241 leader_election.cc:290] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:27.859635  2226 raft_consensus.cc:1275] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:00:27.843165  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:27.856844  5232 raft_consensus.cc:3060] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:27.861634  5122 raft_consensus.cc:515] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:27.847833  5032 raft_consensus.cc:3060] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:27.863926  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:27.855504  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:27.858409  5326 raft_consensus.cc:2804] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:27.849416  2222 raft_consensus.cc:2468] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 8.
I20260709 13:00:27.849836  5013 raft_consensus.cc:3060] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:27.850469  1496 leader_election.cc:304] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:27.851774  1571 leader_election.cc:304] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:27.852042  5238 leader_election.cc:290] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:27.852689  5291 leader_election.cc:290] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:27.857343  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:27.865552  1603 raft_consensus.cc:2468] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 9.
I20260709 13:00:27.807534  5093 raft_consensus.cc:515] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:27.856717  1607 raft_consensus.cc:2468] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 7.
I20260709 13:00:27.855067  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:27.858070  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:27.867375  5331 raft_consensus.cc:697] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 11 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:27.867985  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:27.989415  1605 raft_consensus.cc:2393] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 8: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
W20260709 13:00:27.978691  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:27.869298  1606 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36200 (request call id 2175) took 1865 ms (client timeout 1549 ms). Trace:
I20260709 13:00:27.870371  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
W20260709 13:00:28.068519  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 276759us
I20260709 13:00:27.867739  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:28.071913  2218 raft_consensus.cc:2468] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 4.
I20260709 13:00:28.072049  2191 leader_election.cc:304] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:27.984928  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:27.988893  2220 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28"
dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
mode: GRACEFUL
new_leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:47682
W20260709 13:00:27.939273  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 150266us
I20260709 13:00:28.073396  1602 raft_consensus.cc:2393] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 11: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
W20260709 13:00:27.981880  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:28.070255  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:27.808332  5165 raft_consensus.cc:2804] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:00:28.074649  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:28.073499  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:28.070843  1606 rpcz_store.cc:269] 0709 13:00:26.003716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:26.003834 (+   118us) service_pool.cc:224] Handling call
0709 13:00:27.869031 (+1865197us) spinlock_profiling.cc:243] Waited 824 ms on lock 0x7b54003499d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:27.869195 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1896329600}
I20260709 13:00:28.035041  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:28.077020  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49170 (request call id 2019) took 1362 ms. Trace:
W20260709 13:00:27.992162  5322 log.cc:927] Time spent T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.293s	user 0.000s	sys 0.003s
I20260709 13:00:28.074213  2220 raft_consensus.cc:606] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 6 LEADER]: Received request to transfer leadership to TS e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:28.086007  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:28.087020  1600 raft_consensus.cc:2393] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 6: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:00:28.067688  5326 raft_consensus.cc:493] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:28.088852  5326 raft_consensus.cc:3060] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:28.089792  1644 leader_election.cc:304] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:28.090891  5137 raft_consensus.cc:2804] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:00:28.087081  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 61152.6us
W20260709 13:00:28.096330  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 46563.5us
I20260709 13:00:28.085948  1604 raft_consensus.cc:2410] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:00:27.992520  4912 raft_consensus.cc:3055] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:28.095368  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:28.098784  1598 raft_consensus.cc:2468] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 8.
I20260709 13:00:28.097481  1606 raft_consensus.cc:2368] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 8. Current term is 9.
I20260709 13:00:28.048425  5298 raft_consensus.cc:493] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:28.098133  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 247813us
I20260709 13:00:28.048169  5296 raft_consensus.cc:493] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:28.099905  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:27.873662  5241 raft_consensus.cc:493] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:00:28.098223  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:28.102497  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:27.867600  5286 raft_consensus.cc:493] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:28.102903  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:28.103699  2191 leader_election.cc:304] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:28.107074  1602 raft_consensus.cc:2393] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 9: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
W20260709 13:00:28.107600  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 255934us
I20260709 13:00:28.099380  1603 raft_consensus.cc:2376] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 10. Re-sending same reply.
I20260709 13:00:28.007618  5064 raft_consensus.cc:515] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:28.092545  5165 raft_consensus.cc:493] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:28.107506  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:27.990079  5041 raft_consensus.cc:515] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:28.113152  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:28.114029  1606 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 11.
I20260709 13:00:28.112277  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:28.047669  5025 raft_consensus.cc:515] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:28.115304  1601 raft_consensus.cc:1275] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 13:00:28.102298  5291 raft_consensus.cc:2804] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:28.098711  4912 raft_consensus.cc:740] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:27.987042  5065 consensus_queue.cc:237] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:28.116621  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:28.127013  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:28.131845  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:00:28.127746  2192 leader_election.cc:336] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Timed out: RequestConsensusVote RPC to 127.0.107.194:40303 timed out after 1.763s (SENT)
I20260709 13:00:28.132661  1606 raft_consensus.cc:2410] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:00:28.130724  1605 raft_consensus.cc:2468] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 9.
I20260709 13:00:28.132643  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:28.132553  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:28.114125  5165 raft_consensus.cc:3060] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:28.133929  1603 raft_consensus.cc:2468] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 13.
I20260709 13:00:28.134905  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:28.138034  4815 raft_consensus.cc:2804] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:28.139102  5099 consensus_queue.cc:1048] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:28.140251  5241 raft_consensus.cc:515] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:28.141791  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:28.127307  5137 raft_consensus.cc:697] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 5 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:28.132221  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:28.131472  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:28.144279  1600 raft_consensus.cc:2468] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 10.
I20260709 13:00:28.142612  2223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50310 (request call id 735) took 1151 ms. Trace:
I20260709 13:00:28.142393  5241 leader_election.cc:290] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:28.113045  5238 raft_consensus.cc:2804] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:28.146488  1607 raft_consensus.cc:2393] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 8: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:00:28.132540  2192 leader_election.cc:304] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:28.144896  2223 rpcz_store.cc:276] 0709 13:00:26.991321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:26.995765 (+  4444us) service_pool.cc:224] Handling call
0709 13:00:27.868443 (+872678us) spinlock_profiling.cc:243] Waited 1.87 ms on lock 0x7b5800015c98. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a1548eb71 00007f6a1548eeee 0000000000375939 00007f6a1d5021e0 00007f6a1d5cb0c4 00007f6a1d5cb131 00007f6a1d5790a0 00007f6a1d578984 00007f6a16af36d4 00007f6a16af3662
0709 13:00:28.092852 (+224409us) spinlock_profiling.cc:243] Waited 3.92 ms on lock 0x7b5800015c98. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a1548ef8c 00007f6a1548eef6 0000000000375939 00007f6a1d5021e0 00007f6a1d5cb0c4 00007f6a1d5cb131 00007f6a1d5790a0 00007f6a1d578984 00007f6a16af36d4 00007f6a16af3662
0709 13:00:28.142533 (+ 49681us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13330048}
I20260709 13:00:28.138526  4815 raft_consensus.cc:493] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:28.110682  5298 raft_consensus.cc:515] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:28.143440  5165 raft_consensus.cc:515] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:28.128048  5286 raft_consensus.cc:515] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:28.128486  5296 raft_consensus.cc:515] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:28.143612  5137 consensus_queue.cc:237] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:28.148634  1572 leader_election.cc:304] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
W20260709 13:00:28.379515  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 233405us
W20260709 13:00:28.380019  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 266302us
W20260709 13:00:28.189208  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 45345.5us
I20260709 13:00:28.168298  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50664 (request call id 806) took 1176 ms. Trace:
I20260709 13:00:28.401436  1496 leader_election.cc:304] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:28.400525  1681 rpcz_store.cc:276] 0709 13:00:26.992353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:27.595667 (+603314us) service_pool.cc:224] Handling call
0709 13:00:27.595964 (+   297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:27.618236 (+ 22272us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:27.618312 (+    76us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:27.642972 (+ 24660us) log.cc:844] Serialized 26 byte log entry
0709 13:00:27.704337 (+ 61365us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:00:27.704375 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:27.704780 (+   405us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:27.991643 (+286863us) spinlock_profiling.cc:243] Waited 2.78 ms on lock 0x7b240038a938. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a1534c9c4 00007f6a1534aacb 00007f6a15505dc9 00007f6a15505a55 00007f6a1550509d 00007f6a1813710e 00007f6a1814e88c 00007f6a1814dbb6 00007f6a1814d7d8 00007f6a18157221
0709 13:00:28.167974 (+176331us) raft_consensus.cc:1685] finished
0709 13:00:28.167997 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:28.168226 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4164,"raft.queue_time_us":15959,"raft.run_cpu_time_us":258,"raft.run_wall_time_us":56200,"spinlock_wait_cycles":6393216,"thread_start_us":60522,"threads_started":1,"wal-append.queue_time_us":55850}
I20260709 13:00:28.402806  5315 raft_consensus.cc:2804] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:28.403291  1496 leader_election.cc:304] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:28.403317  5315 raft_consensus.cc:493] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:28.403620  4867 consensus_queue.cc:1059] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:28.404078  5315 raft_consensus.cc:3060] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:28.193969  1673 raft_consensus.cc:2468] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 9.
I20260709 13:00:28.128738  5291 raft_consensus.cc:493] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:28.411579  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 261917us
I20260709 13:00:28.409128  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:00:28.261564  5337 log.cc:927] Time spent T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:00:28.148591  5238 raft_consensus.cc:493] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:28.432996  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 295390us
I20260709 13:00:28.268406  5100 raft_consensus.cc:3060] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:28.408679  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:28.166421  5330 raft_consensus.cc:2804] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:28.433701  1601 raft_consensus.cc:2468] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 7.
W20260709 13:00:28.437016  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 168797us
I20260709 13:00:28.407450  5025 leader_election.cc:290] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:28.150436  5110 leader_election.cc:290] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:28.432695  5291 raft_consensus.cc:3060] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:28.315255  5041 leader_election.cc:290] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:28.448578  1571 leader_election.cc:304] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
W20260709 13:00:28.449115  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 338882us
I20260709 13:00:28.411708  4815 raft_consensus.cc:3060] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:28.452194  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:28.453145  1679 raft_consensus.cc:2468] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 11.
I20260709 13:00:28.453233  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:28.437584  5238 raft_consensus.cc:3060] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:28.453840  1601 raft_consensus.cc:2376] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 9. Re-sending same reply.
I20260709 13:00:28.316814  5032 raft_consensus.cc:515] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:28.455861  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:28.456593  1644 leader_election.cc:304] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:28.461355  5326 raft_consensus.cc:515] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:28.355453  5331 consensus_queue.cc:237] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:28.454509  5330 raft_consensus.cc:697] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 11 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:28.463667  5342 raft_consensus.cc:2804] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:28.465390  1646 leader_election.cc:304] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:28.470341  1605 raft_consensus.cc:3060] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:28.472308  1644 leader_election.cc:304] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:28.085831  1676 rpcz_store.cc:276] 0709 13:00:26.714919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:27.551974 (+837055us) service_pool.cc:224] Handling call
0709 13:00:27.582597 (+ 30623us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:27.606005 (+ 23408us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:00:27.778931 (+172926us) log.cc:844] Serialized 14 byte log entry
0709 13:00:28.076480 (+297549us) log.cc:844] Serialized 14 byte log entry
0709 13:00:28.076653 (+   173us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:28.076706 (+    53us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:28.076758 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:28.076829 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:28.076954 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45314,"prepare.queue_time_us":92078,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":63,"raft.queue_time_us":46943,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":7493,"spinlock_wait_cycles":34325760,"thread_start_us":323984,"threads_started":2}
I20260709 13:00:28.473835  1644 leader_election.cc:304] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:28.474905  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:28.476511  5025 raft_consensus.cc:2804] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:28.161263  4912 consensus_queue.cc:260] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:28.468725  5064 leader_election.cc:290] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
W20260709 13:00:28.479830  2192 leader_election.cc:336] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Timed out: RequestConsensusVote RPC to 127.0.107.194:40303 timed out after 2.002s (SENT)
I20260709 13:00:28.481118  1572 leader_election.cc:304] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:28.470055  5110 raft_consensus.cc:2749] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:28.483863  5241 raft_consensus.cc:2804] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:28.484293  5241 raft_consensus.cc:493] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:28.484654  5241 raft_consensus.cc:3060] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:28.485272  5093 leader_election.cc:290] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:28.474731  5342 raft_consensus.cc:493] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:28.486712  5342 raft_consensus.cc:3060] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:28.487560  1644 leader_election.cc:304] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:28.487206  5330 consensus_queue.cc:237] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:28.478166  5336 raft_consensus.cc:2749] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:28.491250  5298 leader_election.cc:290] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:28.493886  5286 leader_election.cc:290] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:28.476938  5025 raft_consensus.cc:493] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:28.494590  5025 raft_consensus.cc:3060] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:28.495606  5326 leader_election.cc:290] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:28.496096  5336 raft_consensus.cc:2764] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:00:28.496888  5336 consensus_queue.cc:1048] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:28.497294  1644 leader_election.cc:304] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:28.497666  5336 consensus_queue.cc:1243] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:00:28.497979  5335 consensus_queue.cc:1048] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:28.498683  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:28.499198  4912 raft_consensus.cc:3060] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:28.495718  5064 raft_consensus.cc:2804] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:28.499944  5064 raft_consensus.cc:697] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 8 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:28.500324  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:28.500905  5064 consensus_queue.cc:237] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:28.501458  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:28.502795  5340 raft_consensus.cc:2804] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:28.498046  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:28.511129  1606 raft_consensus.cc:2468] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 12.
I20260709 13:00:28.513881  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:28.514398  5340 raft_consensus.cc:697] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 9 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:28.521152  1599 raft_consensus.cc:3060] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:28.521035  5340 consensus_queue.cc:237] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:28.521001  1646 leader_election.cc:304] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
W20260709 13:00:28.519246  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 77687.3us
W20260709 13:00:28.527153  1571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:28.527489  1571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:28.529323  1599 raft_consensus.cc:1275] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:00:28.507483  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:28.531306  1601 raft_consensus.cc:2393] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 8: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:00:28.519136  5241 raft_consensus.cc:515] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:28.533326  5241 leader_election.cc:290] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:28.535854  5274 consensus_queue.cc:1048] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:28.538573  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:28.539512  1679 raft_consensus.cc:2393] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 11: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:00:28.516832  5093 raft_consensus.cc:2749] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:28.542959  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:28.543725  2221 raft_consensus.cc:2393] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 11: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:00:28.548264  5342 raft_consensus.cc:515] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:28.551034  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:28.551812  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:28.551184  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:28.554147  2218 raft_consensus.cc:2393] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 8: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:00:28.525168  5335 raft_consensus.cc:2804] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:28.563117  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:28.569041  1572 leader_election.cc:304] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:00:28.549871  5336 raft_consensus.cc:2804] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:28.573164  1646 leader_election.cc:304] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:28.516599  5326 consensus_queue.cc:1048] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:00:28.595849  5342 leader_election.cc:290] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:28.558393  5335 raft_consensus.cc:493] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:28.596856  5335 raft_consensus.cc:3060] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:28.543948  4815 raft_consensus.cc:515] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:28.612100  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 56046.5us
I20260709 13:00:28.610733  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:00:28.614379  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:28.609488  2221 raft_consensus.cc:2376] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 8. Re-sending same reply.
I20260709 13:00:28.580752  5336 raft_consensus.cc:493] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:28.621222  5336 raft_consensus.cc:3060] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:28.621395  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:28.622170  1526 raft_consensus.cc:2468] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 8.
I20260709 13:00:28.618289  1604 raft_consensus.cc:2468] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 8.
W20260709 13:00:28.619829  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 122599us
W20260709 13:00:28.621541  2192 leader_election.cc:336] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Timed out: RequestConsensusVote RPC to 127.0.107.194:40303 timed out after 1.623s (SENT)
I20260709 13:00:28.630780  1572 leader_election.cc:304] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:00:28.637295  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:28.638019  1531 raft_consensus.cc:2468] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 9.
I20260709 13:00:28.612635  5326 raft_consensus.cc:2804] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:28.645524  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:28.648082  2191 leader_election.cc:304] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:28.627979  5093 raft_consensus.cc:2804] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:28.645349  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:28.652855  1523 raft_consensus.cc:2468] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 9.
I20260709 13:00:28.653743  5344 raft_consensus.cc:493] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:28.654374  5344 raft_consensus.cc:515] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:28.660713  2191 leader_election.cc:304] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:28.671842  5274 raft_consensus.cc:2804] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:28.672055  5335 raft_consensus.cc:515] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:28.672530  5274 raft_consensus.cc:697] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 11 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:28.674330  5274 consensus_queue.cc:237] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:28.675257  5335 leader_election.cc:290] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:28.676792  5137 raft_consensus.cc:2804] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:28.677357  5137 raft_consensus.cc:697] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 9 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:28.645314  5326 raft_consensus.cc:493] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:28.650315  5110 raft_consensus.cc:2804] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:00:28.681568  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 827911us
I20260709 13:00:28.652495  5093 raft_consensus.cc:493] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:28.684024  1572 leader_election.cc:304] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:28.685990  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:28.689509  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:28.686864  1528 raft_consensus.cc:2468] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 8.
I20260709 13:00:28.687090  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
W20260709 13:00:28.690080  2192 leader_election.cc:336] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Timed out: RequestConsensusVote RPC to 127.0.107.194:40303 timed out after 2.170s (SENT)
I20260709 13:00:28.686401  4815 leader_election.cc:290] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:28.661419  5032 leader_election.cc:290] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:28.692649  1523 raft_consensus.cc:2468] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 8.
I20260709 13:00:28.696990  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:28.699518  2192 leader_election.cc:304] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:28.679919  5100 raft_consensus.cc:2749] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:28.683738  5110 raft_consensus.cc:493] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:28.682828  5326 raft_consensus.cc:3060] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:28.651232  5025 raft_consensus.cc:515] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:28.703037  1527 raft_consensus.cc:3060] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:28.692441  5093 raft_consensus.cc:3060] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:28.683835  5238 raft_consensus.cc:515] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:28.709385  5110 raft_consensus.cc:3060] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:28.709127  5321 raft_consensus.cc:2749] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:28.710433  5344 leader_election.cc:290] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:28.727445  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:28.728791  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 13:00:28.729240  5349 log.cc:927] Time spent T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
I20260709 13:00:28.729470  1528 raft_consensus.cc:2468] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 8.
I20260709 13:00:28.729890  5025 leader_election.cc:290] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
W20260709 13:00:28.731413  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 70123.2us
I20260709 13:00:28.732242  1572 leader_election.cc:304] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:28.733475  1646 leader_election.cc:304] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:28.734369  5025 raft_consensus.cc:2749] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:00:28.734824  5343 log.cc:927] Time spent T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:00:28.735321  1528 raft_consensus.cc:1275] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:00:28.735468  1646 leader_election.cc:304] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:28.735973  5351 consensus_queue.cc:1048] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:00:28.736377  5025 raft_consensus.cc:2749] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:00:28.738420  5346 log.cc:927] Time spent T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:00:28.738981  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:28.739811  1607 raft_consensus.cc:2393] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 11: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:00:28.743100  5165 leader_election.cc:290] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:28.746769  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:28.747704  1523 raft_consensus.cc:2410] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:00:28.737187  1646 leader_election.cc:304] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:28.776455  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 13:00:28.778254  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 46101us
I20260709 13:00:28.778257  5296 leader_election.cc:290] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:28.707103  5137 consensus_queue.cc:237] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:28.779465  5122 leader_election.cc:290] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:28.797075  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:28.797703  1530 raft_consensus.cc:3060] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:00:28.778467  5238 leader_election.cc:290] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:28.799320  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 13:00:28.780582  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:28.800072  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:28.781306  1646 leader_election.cc:304] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:28.781227  5025 consensus_queue.cc:1048] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:28.728142  5315 raft_consensus.cc:515] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:28.750377  1497 leader_election.cc:304] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:28.716526  5291 raft_consensus.cc:515] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:28.795420  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:28.795586  1572 leader_election.cc:304] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:28.795588  1532 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 11.
I20260709 13:00:28.796233  4815 raft_consensus.cc:2749] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:28.809016  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
W20260709 13:00:28.809762  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 93506us
I20260709 13:00:28.805119  1605 raft_consensus.cc:2410] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:00:28.805123  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:28.811821  1525 raft_consensus.cc:2410] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:00:28.813529  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:28.813732  5296 raft_consensus.cc:2749] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:28.813997  5315 leader_election.cc:290] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:28.814129  1678 raft_consensus.cc:3060] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:28.815596  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:28.816190  1673 raft_consensus.cc:2468] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 7.
I20260709 13:00:28.817175  1526 raft_consensus.cc:2393] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 7: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:00:28.818051  5291 leader_election.cc:290] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:28.818915  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:28.819540  1528 raft_consensus.cc:2468] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 8.
I20260709 13:00:28.819005  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:28.820326  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:28.820982  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:28.821163  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:28.821542  1532 raft_consensus.cc:3060] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:28.821882  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:28.822882  1497 leader_election.cc:304] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:28.822984  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:28.824868  1497 leader_election.cc:304] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:28.819774  2225 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce"
dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
mode: GRACEFUL
new_leader_uuid: "39a92f5a4352465d8af3af5908fe8642"
 from {username='slave'} at 127.0.0.1:47682
I20260709 13:00:28.819855  1675 raft_consensus.cc:1240] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:28.826814  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:28.827399  1527 raft_consensus.cc:2468] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 8.
I20260709 13:00:28.826086  2225 raft_consensus.cc:606] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Received request to transfer leadership to TS 39a92f5a4352465d8af3af5908fe8642
I20260709 13:00:28.827980  2225 raft_consensus.cc:614] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:28.791246  5344 raft_consensus.cc:2749] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:28.794018  5351 raft_consensus.cc:2804] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:28.838692  1598 raft_consensus.cc:2393] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 12: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:00:28.813544  1572 leader_election.cc:304] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:28.842918  1678 raft_consensus.cc:2468] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 7.
I20260709 13:00:28.843158  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:28.843606  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:28.844738  2191 leader_election.cc:304] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:28.845346  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 13:00:28.842615  1496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:28.846933  1496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:28.853048  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:28.853268  5238 raft_consensus.cc:2749] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:28.848739  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:28.853772  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:28.855118  1523 raft_consensus.cc:2468] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 8.
W20260709 13:00:28.855571  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 74342.1us
I20260709 13:00:28.856228  1607 raft_consensus.cc:2393] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 11: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:00:28.856807  1646 leader_election.cc:304] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:28.860498  5110 raft_consensus.cc:515] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:28.826170  5064 raft_consensus.cc:2804] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:28.862882  5064 raft_consensus.cc:493] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:28.863286  5064 raft_consensus.cc:3060] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:28.839641  5342 raft_consensus.cc:2804] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:00:28.867435  5357 log.cc:927] Time spent T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:00:28.869400  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:28.853379  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
W20260709 13:00:28.870381  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 188828us
I20260709 13:00:28.869616  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:28.872007  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:28.872722  1674 raft_consensus.cc:2368] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 8. Current term is 9.
I20260709 13:00:28.873143  1681 raft_consensus.cc:3060] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:28.842008  4867 raft_consensus.cc:2804] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:28.872176  1571 leader_election.cc:304] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:28.842370  5351 raft_consensus.cc:493] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:28.877434  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:28.880299  1532 raft_consensus.cc:2468] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 5.
I20260709 13:00:28.877813  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:28.879864  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:28.881145  1598 raft_consensus.cc:2468] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 10.
I20260709 13:00:28.879563  1571 leader_election.cc:304] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:28.862568  5110 leader_election.cc:290] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:28.883340  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:28.886266  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:28.887073  1675 raft_consensus.cc:2393] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 9: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:00:28.887876  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:28.877411  4815 raft_consensus.cc:2804] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:28.863348  5326 raft_consensus.cc:515] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:28.892851  2190 leader_election.cc:304] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:28.893220   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
W20260709 13:00:28.893922  2192 leader_election.cc:336] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Timed out: RequestConsensusVote RPC to 127.0.107.194:40303 timed out after 1.843s (SENT)
I20260709 13:00:28.895996   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:28.881840  5351 raft_consensus.cc:3060] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:28.888842  5296 consensus_queue.cc:1059] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:00:28.897742  5321 raft_consensus.cc:3055] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:28.881858  4912 raft_consensus.cc:2804] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:28.885540  5238 raft_consensus.cc:2804] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:28.901182  5100 raft_consensus.cc:2804] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:28.902263  5238 raft_consensus.cc:493] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:28.902489  5100 raft_consensus.cc:493] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:28.902792  5238 raft_consensus.cc:3060] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:28.902957  5100 raft_consensus.cc:3060] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:28.903192  1646 leader_election.cc:304] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:28.901201  4912 raft_consensus.cc:493] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:28.903911  4912 raft_consensus.cc:3060] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:28.899255  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:28.905680  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:28.883929  5165 raft_consensus.cc:2749] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:28.915150  5032 raft_consensus.cc:2804] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:28.915628  5032 raft_consensus.cc:493] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:00:28.916035  5032 raft_consensus.cc:3060] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:28.916056  5093 raft_consensus.cc:515] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:28.919190  1603 raft_consensus.cc:2393] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 6: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:00:28.920552  5093 leader_election.cc:290] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:28.921512  5341 raft_consensus.cc:3055] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:28.921993  5341 raft_consensus.cc:740] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:00:28.887509  4867 raft_consensus.cc:697] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:00:28.922894  5341 consensus_queue.cc:260] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:28.927942  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:00:28.942842  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 117661us
I20260709 13:00:28.898094  5321 raft_consensus.cc:740] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:28.931147  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:28.950263  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:28.952214  1646 leader_election.cc:304] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:28.952200  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:28.957762  1598 raft_consensus.cc:2368] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b for earlier term 9. Current term is 10.
I20260709 13:00:28.959298  1646 leader_election.cc:304] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:28.960279  1646 leader_election.cc:304] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:28.962020  1646 leader_election.cc:304] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:28.965886  1646 leader_election.cc:304] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:28.971361  1681 raft_consensus.cc:2468] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 7.
I20260709 13:00:28.972425  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:28.972746  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:28.973294  1605 raft_consensus.cc:2468] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 7.
I20260709 13:00:28.974313  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:28.974606  1497 leader_election.cc:304] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:28.975021  1601 raft_consensus.cc:2376] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 12. Re-sending same reply.
I20260709 13:00:28.976112  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:28.976541  5013 raft_consensus.cc:2764] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:00:28.976835  5368 consensus_queue.cc:1048] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:28.942752  4815 raft_consensus.cc:697] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 7 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:28.976801  1599 raft_consensus.cc:2468] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 13.
I20260709 13:00:28.973551  1604 raft_consensus.cc:2376] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 11. Re-sending same reply.
I20260709 13:00:28.977345  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
W20260709 13:00:28.979780  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 81842.3us
W20260709 13:00:28.981015  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 85426.6us
I20260709 13:00:28.991344  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:28.992079  1598 raft_consensus.cc:2376] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 11. Re-sending same reply.
I20260709 13:00:28.942526  5241 consensus_queue.cc:1048] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:00:28.995400  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:28.996209  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:28.996789  1607 raft_consensus.cc:3060] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:28.999624  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:29.000344  1601 raft_consensus.cc:2468] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 8.
I20260709 13:00:28.970196  5025 raft_consensus.cc:2749] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:29.005875  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:29.006573  1598 raft_consensus.cc:3060] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:29.010524  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:28.993165  5335 raft_consensus.cc:2804] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:28.993901  5330 raft_consensus.cc:2804] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:00:29.017771  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 51948.6us
I20260709 13:00:29.021013  1646 leader_election.cc:304] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:29.030164  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:29.033095  4815 consensus_queue.cc:237] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:29.035025  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:00:29.035785  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 59857.3us
I20260709 13:00:29.037137  1606 raft_consensus.cc:2393] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 8: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:00:29.035956  1681 raft_consensus.cc:2410] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:00:29.006971  5341 raft_consensus.cc:3060] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:28.949326  4867 consensus_queue.cc:237] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:29.010568  5342 raft_consensus.cc:493] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:29.023834  5298 raft_consensus.cc:493] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.020211  5335 raft_consensus.cc:493] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:29.045475  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:29.052681  1606 raft_consensus.cc:2368] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b for earlier term 9. Current term is 10.
I20260709 13:00:29.052810  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:29.053577  1681 raft_consensus.cc:2393] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 5: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:00:29.043218  1497 leader_election.cc:304] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:29.039016  5344 raft_consensus.cc:493] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:29.075570  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 88284.9us
I20260709 13:00:29.079614  1530 raft_consensus.cc:2468] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 11.
W20260709 13:00:29.094892  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 73944.4us
I20260709 13:00:29.047799  5342 raft_consensus.cc:3060] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:29.051574  5065 raft_consensus.cc:2804] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:29.043790  5326 leader_election.cc:290] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:29.051528  5335 raft_consensus.cc:3060] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:29.107412  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:29.116671  2190 leader_election.cc:304] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:29.108546  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:29.121726  1606 raft_consensus.cc:2393] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 11: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:00:29.122424  5330 raft_consensus.cc:697] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 10 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:29.123585  5330 consensus_queue.cc:237] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:29.092379  5331 raft_consensus.cc:2804] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:29.091508  5291 raft_consensus.cc:2764] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:00:29.092752  5013 raft_consensus.cc:2804] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:00:29.159559  5374 log.cc:927] Time spent T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:00:29.056420  5032 raft_consensus.cc:515] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:29.151351  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:29.115651  5315 raft_consensus.cc:493] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.268882  5315 raft_consensus.cc:515] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:29.271025  5315 leader_election.cc:290] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:29.117646  5065 raft_consensus.cc:493] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:29.272238  5065 raft_consensus.cc:3060] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:29.274528  5367 log.cc:927] Time spent T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.155s	user 0.000s	sys 0.000s
W20260709 13:00:29.275663  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 147595us
I20260709 13:00:29.251554  1524 raft_consensus.cc:2468] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 7.
W20260709 13:00:29.246768  1496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:29.073532  5298 raft_consensus.cc:515] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:29.253543  1529 raft_consensus.cc:1240] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:00:29.254842  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:00:29.261502  2192 leader_election.cc:336] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Timed out: RequestConsensusVote RPC to 127.0.107.194:40303 timed out after 2.725s (SENT)
I20260709 13:00:29.262480  5331 raft_consensus.cc:493] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:29.267362  5110 raft_consensus.cc:493] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
W20260709 13:00:29.277770  1496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:29.300084  1604 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 11.
I20260709 13:00:29.304556  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:29.307554  1605 raft_consensus.cc:1275] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:00:29.245826  5013 raft_consensus.cc:493] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:29.310179  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:29.098030  5344 raft_consensus.cc:515] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:29.332089  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:29.370193  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:29.040973  5321 consensus_queue.cc:260] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:29.301394  5099 raft_consensus.cc:2804] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:29.391105  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:29.317233  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:29.372661  2226 raft_consensus.cc:2410] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 13:00:29.311234  5336 consensus_meta.cc:287] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.672s	user 0.005s	sys 0.005s
I20260709 13:00:29.382491  1606 raft_consensus.cc:2393] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 8: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:00:29.383809  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:29.404846  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:29.306099  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:29.305333  5331 raft_consensus.cc:3060] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:29.390887  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:29.416185  2218 raft_consensus.cc:2393] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 8: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:00:29.404331  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:29.404935  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:29.386607  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:29.417761  5336 raft_consensus.cc:515] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:29.418453  1673 raft_consensus.cc:2393] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 14: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:00:29.418957  1677 raft_consensus.cc:2393] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 10: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:00:29.419376  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:29.420557  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:29.407688  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:29.420758  5100 raft_consensus.cc:515] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:29.421321  1526 raft_consensus.cc:2468] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 7.
I20260709 13:00:29.407856  2219 raft_consensus.cc:1275] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 13:00:29.408246  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:29.422014  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:29.408461  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:29.422645  1604 raft_consensus.cc:2468] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 10.
I20260709 13:00:29.422960  5100 leader_election.cc:290] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 10 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:29.423785  1673 raft_consensus.cc:2393] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 7: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:00:29.424875  1673 raft_consensus.cc:1240] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:29.426028  1673 raft_consensus.cc:1240] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 9. Current term is 10. Ops: []
W20260709 13:00:29.412865  5064 consensus_meta.cc:287] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.549s	user 0.004s	sys 0.005s
I20260709 13:00:29.391460  5099 raft_consensus.cc:493] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:29.426987  5099 raft_consensus.cc:3060] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:29.426929  5064 raft_consensus.cc:515] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:29.428172  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 166798us
I20260709 13:00:29.429593  1673 raft_consensus.cc:1240] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:29.415004  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:29.430637  2222 raft_consensus.cc:3060] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:29.416752  1676 raft_consensus.cc:1240] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:29.371928  5110 raft_consensus.cc:515] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:29.423578  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:29.409143  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:29.445075  1603 raft_consensus.cc:2393] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 9: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:00:29.415573  5335 raft_consensus.cc:515] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:29.323714  5013 raft_consensus.cc:3060] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:29.416179  5376 log.cc:927] Time spent T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
I20260709 13:00:29.463953  1598 raft_consensus.cc:2468] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 9.
I20260709 13:00:29.465317  1496 leader_election.cc:304] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:29.469928  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:29.426594  5238 raft_consensus.cc:515] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:29.472072  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:29.527186  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:29.480499  1607 raft_consensus.cc:2468] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 14.
I20260709 13:00:29.509774  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 13:00:29.507071  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 416809us
I20260709 13:00:29.502707  1605 raft_consensus.cc:2468] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 9.
I20260709 13:00:29.592870  1678 raft_consensus.cc:2468] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 9.
W20260709 13:00:29.423539  5352 log.cc:927] Time spent T 00000000000000000000000000000000 P 9f38d0e5c9db43a48554defe1153354e: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:00:29.572206  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:29.624833  1523 raft_consensus.cc:2410] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:00:29.625844  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:29.626452  1523 raft_consensus.cc:3060] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Advancing to term 9
W20260709 13:00:29.467338  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 59899.2us
I20260709 13:00:29.529995  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 13:00:29.627701  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:29.623001  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:29.629735  1527 raft_consensus.cc:2410] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for term 11 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:00:29.621392  1571 leader_election.cc:304] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:29.623816  1531 raft_consensus.cc:2393] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 10: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:00:29.530470  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 13:00:29.524737  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 59533.5us
W20260709 13:00:29.634275  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 357648us
I20260709 13:00:29.568224  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:29.636533  1532 raft_consensus.cc:2468] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 5.
W20260709 13:00:29.638109  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 170987us
I20260709 13:00:29.638576  1646 leader_election.cc:304] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:29.658587  1525 raft_consensus.cc:2393] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 11: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:00:29.660583  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:00:29.628803  1497 connection.cc:256] RPC call timeout handler was delayed by -1.8030309060000036s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19540000000000002s for a response
W20260709 13:00:29.618813  5382 log.cc:927] Time spent T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
I20260709 13:00:29.667805  1646 leader_election.cc:304] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:29.668694  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:29.671319  1600 raft_consensus.cc:2368] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b for earlier term 7. Current term is 8.
I20260709 13:00:29.415679  4912 raft_consensus.cc:515] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:29.648161  5330 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.023s	sys 0.010s
I20260709 13:00:29.672338  1572 leader_election.cc:304] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:29.507936  5373 raft_consensus.cc:2749] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:29.673280  1496 leader_election.cc:400] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Vote denied by peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217) with higher term. Message: Invalid argument: T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 8. Current term is 9.
I20260709 13:00:29.675489  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:29.676019  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:29.677762  1496 leader_election.cc:403] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:29.678217  2225 raft_consensus.cc:2410] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:00:29.677138  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:29.677353  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
W20260709 13:00:29.685356  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 53994.5us
I20260709 13:00:29.687777  5099 raft_consensus.cc:515] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:29.689339  2190 leader_election.cc:304] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:29.691004  5274 consensus_queue.cc:1048] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:29.691941  4912 leader_election.cc:290] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:29.693544  5274 consensus_queue.cc:1048] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:29.694881  5360 raft_consensus.cc:2804] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:29.695477  5360 raft_consensus.cc:493] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:29.695819  5360 raft_consensus.cc:3060] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:29.677708  5330 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.023s	sys 0.011s
I20260709 13:00:29.739389  1496 leader_election.cc:304] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:29.742873  1523 raft_consensus.cc:2468] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 9.
I20260709 13:00:29.698122  1680 raft_consensus.cc:1240] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 8. Current term is 9. Ops: []
W20260709 13:00:29.718508  5342 consensus_meta.cc:287] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent flushing consensus metadata: real 0.591s	user 0.005s	sys 0.001s
I20260709 13:00:29.698632  1530 raft_consensus.cc:1240] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:29.694906  5372 consensus_queue.cc:1059] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 13:00:29.700543  5321 raft_consensus.cc:3060] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:29.710193  2190 leader_election.cc:304] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:29.718609  5298 leader_election.cc:290] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:29.723903  1679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50664 (request call id 819) took 1166 ms. Trace:
I20260709 13:00:29.696666  5380 raft_consensus.cc:2804] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:00:29.707933  5110 leader_election.cc:290] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:29.677443  5025 raft_consensus.cc:2804] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:29.670778  5377 consensus_queue.cc:1059] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:00:29.669906  5137 consensus_queue.cc:1059] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
W20260709 13:00:29.771097  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 80474.5us
I20260709 13:00:29.697790  2223 raft_consensus.cc:2393] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 9: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
W20260709 13:00:29.686477  5339 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.019s	sys 0.022s
W20260709 13:00:29.761231  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 93513.9us
I20260709 13:00:29.755352  4867 raft_consensus.cc:2749] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217) with higher term. Message: Invalid argument: T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 8. Current term is 9.
I20260709 13:00:29.696288  5238 leader_election.cc:290] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:29.766505  1496 leader_election.cc:304] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
W20260709 13:00:29.741957  5351 consensus_meta.cc:287] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.806s	user 0.007s	sys 0.000s
I20260709 13:00:29.768530  1679 rpcz_store.cc:276] 0709 13:00:28.557695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:28.831722 (+274027us) service_pool.cc:224] Handling call
0709 13:00:28.850319 (+ 18597us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:28.876176 (+ 25857us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:28.876203 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:28.890295 (+ 14092us) log.cc:844] Serialized 26 byte log entry
0709 13:00:29.085264 (+194969us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:29.085300 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:29.085368 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:29.723650 (+638282us) raft_consensus.cc:1685] finished
0709 13:00:29.723673 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:29.723830 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":22212,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":7269,"thread_start_us":154046,"threads_started":1,"wal-append.queue_time_us":337789}
I20260709 13:00:29.778491  2190 leader_election.cc:304] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:29.762971  5291 raft_consensus.cc:2749] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:29.761449  2222 raft_consensus.cc:2468] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 6.
I20260709 13:00:29.705540  5099 leader_election.cc:290] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:29.778134  5372 raft_consensus.cc:2804] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:29.781462  5380 raft_consensus.cc:697] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 14 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:29.781788  1496 leader_election.cc:304] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
W20260709 13:00:29.775806  5339 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.830s	user 0.019s	sys 0.023s
I20260709 13:00:29.783222  5377 raft_consensus.cc:3055] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:29.782332  5351 raft_consensus.cc:515] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:29.783771  5389 raft_consensus.cc:2804] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:29.783370  5100 consensus_queue.cc:1048] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:29.784735  5388 raft_consensus.cc:3055] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:29.786638  5360 raft_consensus.cc:515] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:29.787050  5386 consensus_queue.cc:1048] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:29.787508  5369 consensus_queue.cc:1048] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:29.790359  5344 leader_election.cc:290] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:29.790860  2190 leader_election.cc:304] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:29.792968  4815 raft_consensus.cc:2804] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:00:29.797117  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:29.726608  5065 raft_consensus.cc:515] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:00:29.800520  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 129632us
I20260709 13:00:29.782853  5368 raft_consensus.cc:2749] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:29.755837  5331 raft_consensus.cc:515] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:29.806634  5093 raft_consensus.cc:2749] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:29.768739  5342 raft_consensus.cc:515] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:29.778121  5025 raft_consensus.cc:697] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 9 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:29.820853  5238 raft_consensus.cc:493] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:00:29.823606  1675 raft_consensus.cc:1240] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:29.825380  1496 leader_election.cc:304] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:29.943725  5360 leader_election.cc:290] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:29.949728  5013 raft_consensus.cc:515] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:29.943787  5351 leader_election.cc:290] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:29.948577  5335 leader_election.cc:290] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:29.950855  5064 leader_election.cc:290] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:00:29.914687  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 44899.3us
W20260709 13:00:29.913986  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 55199.4us
I20260709 13:00:29.868803  5032 leader_election.cc:290] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
W20260709 13:00:29.980818  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 155539us
I20260709 13:00:29.983168  1676 raft_consensus.cc:1240] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 12. Current term is 13. Ops: []
W20260709 13:00:29.985967  1496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:29.988229  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:29.849857  5344 raft_consensus.cc:493] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.850144  5389 raft_consensus.cc:697] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 7 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:29.862774  5331 leader_election.cc:290] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:00:29.913513  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:29.864420  5065 leader_election.cc:290] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:29.821568  5315 raft_consensus.cc:2749] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:29.865027  1681 raft_consensus.cc:2393] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 8: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
W20260709 13:00:29.845355  1570 connection.cc:256] RPC call timeout handler was delayed by -1.4044754459999922s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15180000000000002s for a response
I20260709 13:00:29.808357  5377 raft_consensus.cc:740] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:29.921118   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:00:29.918706  5392 log.cc:927] Time spent T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.050s	user 0.000s	sys 0.004s
I20260709 13:00:29.860534  1678 raft_consensus.cc:1240] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 10. Current term is 11. Ops: []
W20260709 13:00:29.997350  1570 connection.cc:256] RPC call timeout handler was delayed by -1.3972754459999805s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1526s for a response
W20260709 13:00:29.997697  1570 connection.cc:256] RPC call timeout handler was delayed by -1.3252754459999778s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16060000000000002s for a response
I20260709 13:00:29.866072  1672 raft_consensus.cc:1240] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:29.862937  5336 leader_election.cc:290] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:29.979353  5372 raft_consensus.cc:697] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [term 8 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
W20260709 13:00:29.852773  5341 consensus_meta.cc:287] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent flushing consensus metadata: real 0.810s	user 0.010s	sys 0.000s
I20260709 13:00:29.913560  5386 raft_consensus.cc:2749] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:29.935145  5378 raft_consensus.cc:3055] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:29.937390  1680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50664 (request call id 821) took 1063 ms. Trace:
I20260709 13:00:29.938555  1600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 774) took 1039 ms. Trace:
I20260709 13:00:29.823657  4815 raft_consensus.cc:493] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:30.008404  1600 rpcz_store.cc:276] 0709 13:00:28.898816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:28.898964 (+   148us) service_pool.cc:224] Handling call
0709 13:00:29.938329 (+1039365us) spinlock_profiling.cc:243] Waited 763 ms on lock 0x7b5400168fd4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:29.938495 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1755841792}
I20260709 13:00:30.008992  1524 raft_consensus.cc:2410] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:00:29.859054  5380 consensus_queue.cc:237] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:29.819667  5388 raft_consensus.cc:740] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:30.012748  5388 consensus_queue.cc:260] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:30.013548  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 204256us
I20260709 13:00:30.013867  5388 raft_consensus.cc:3060] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:29.851743  5383 raft_consensus.cc:493] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:30.015084  5383 raft_consensus.cc:515] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:29.822427  5099 consensus_queue.cc:1048] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:00:30.007699  1680 rpcz_store.cc:276] 0709 13:00:28.874197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:28.874347 (+   150us) service_pool.cc:224] Handling call
0709 13:00:28.882165 (+  7818us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:29.758479 (+876314us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:29.937083 (+178604us) spinlock_profiling.cc:243] Waited 816 ms on lock 0x7b54000b8bd4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:00:29.937297 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1876286208}
I20260709 13:00:30.019676  5377 consensus_queue.cc:260] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:30.021024  5377 raft_consensus.cc:3060] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:30.021720  5383 leader_election.cc:290] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:30.007609  5378 raft_consensus.cc:740] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:30.024991  4815 raft_consensus.cc:3060] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:30.026422  5411 consensus_queue.cc:1059] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:00:30.028553  5388 raft_consensus.cc:3055] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:30.029033  5388 raft_consensus.cc:740] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:30.029947  5388 consensus_queue.cc:260] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:29.974586  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 302284us
I20260709 13:00:29.996953  1526 raft_consensus.cc:2393] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 6: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
W20260709 13:00:29.997999  1570 connection.cc:256] RPC call timeout handler was delayed by -1.3126754459999574s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16200000000000003s for a response
I20260709 13:00:29.861438  1679 raft_consensus.cc:1240] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:30.032214  1572 leader_election.cc:304] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:00:29.999188  1673 raft_consensus.cc:1240] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:30.033743  5403 consensus_queue.cc:1048] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:29.980221  5238 raft_consensus.cc:515] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:29.984391  5291 raft_consensus.cc:2749] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:30.015657  5342 leader_election.cc:290] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:30.036424  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:30.014314  5408 consensus_queue.cc:1059] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 13:00:30.042907  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:30.043524  1600 raft_consensus.cc:3060] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:30.024730  5013 leader_election.cc:290] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:00:30.031629  1570 connection.cc:256] RPC call timeout handler was delayed by -1.0966754460000061s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18600000000000003s for a response
W20260709 13:00:29.996460  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:30.045042  1570 connection.cc:256] RPC call timeout handler was delayed by -1.0534754459999931s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1908s for a response
W20260709 13:00:30.045404  1570 connection.cc:256] RPC call timeout handler was delayed by -1.0516754459999902s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.191s for a response
W20260709 13:00:30.045699  1570 connection.cc:256] RPC call timeout handler was delayed by -1.0345754459999625s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19290000000000002s for a response
W20260709 13:00:30.040055  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 86508.1us
I20260709 13:00:30.039064  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:30.047668  1607 raft_consensus.cc:2393] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 10: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:00:30.047994  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:30.048596  1678 raft_consensus.cc:3060] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:30.049475  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 258756us
I20260709 13:00:30.049691  1496 leader_election.cc:304] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:30.049845  1676 raft_consensus.cc:1240] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:30.050608  1571 leader_election.cc:304] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:30.060700  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:30.034749  5025 consensus_queue.cc:237] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:30.050876  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:30.061803  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:30.051393  5041 consensus_queue.cc:1059] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:00:30.051765  5238 leader_election.cc:290] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:30.053431  1677 raft_consensus.cc:1275] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 13:00:30.065868  1677 pending_rounds.cc:85] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90: Aborting all ops after (but not including) 4
I20260709 13:00:30.053782  1606 raft_consensus.cc:1275] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:00:30.060179  5291 raft_consensus.cc:2804] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:30.055228  1681 raft_consensus.cc:1240] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:30.034485  5298 raft_consensus.cc:493] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:30.073092  1675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50664 (request call id 823) took 1087 ms. Trace:
I20260709 13:00:29.998633  5344 raft_consensus.cc:515] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:30.062393  1605 raft_consensus.cc:3060] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:30.058364  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:30.061311  1599 raft_consensus.cc:3060] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:30.051333  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:30.065943  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:30.080241  1603 raft_consensus.cc:2393] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 9: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:00:30.073529  1675 rpcz_store.cc:276] 0709 13:00:28.985596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:28.987411 (+  1815us) service_pool.cc:224] Handling call
0709 13:00:28.987690 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:29.973091 (+985401us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:30.072854 (+ 99763us) spinlock_profiling.cc:243] Waited 836 ms on lock 0x7b54000a4954. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:00:30.073034 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1922174848}
I20260709 13:00:30.082953  1598 raft_consensus.cc:1275] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:00:30.073292  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:30.076088  1677 pending_rounds.cc:107] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:00:30.083899  1677 raft_consensus.cc:2889] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:30.034485  5321 raft_consensus.cc:2804] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:30.086740  1676 raft_consensus.cc:2393] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 7: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:00:30.086898  1606 raft_consensus.cc:1275] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:00:30.045970  5388 raft_consensus.cc:3060] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:30.084746  5409 consensus_queue.cc:1059] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:00:30.084997  5298 raft_consensus.cc:515] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:30.097314  5122 consensus_queue.cc:1059] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:30.097747  5298 leader_election.cc:290] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:30.072520  4912 raft_consensus.cc:493] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:30.099462  4912 raft_consensus.cc:515] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:30.101930  4912 leader_election.cc:290] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:30.088672  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:30.103202  2218 raft_consensus.cc:2468] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 8.
I20260709 13:00:30.089370  1679 raft_consensus.cc:1275] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:00:30.103489  5389 consensus_queue.cc:237] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:30.090955  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:30.110795  2223 raft_consensus.cc:3060] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:00:30.091725  2190 leader_election.cc:304] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:30.064850  5093 raft_consensus.cc:2749] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:00:30.094357  1497 connection.cc:256] RPC call timeout handler was delayed by -1.3557874890000221s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1948s for a response
I20260709 13:00:30.112476  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:30.085327  5383 raft_consensus.cc:493] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:30.092355  5291 raft_consensus.cc:697] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:00:30.089862  5412 consensus_queue.cc:1059] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:30.130254  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:30.131083  1674 raft_consensus.cc:2468] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 9.
I20260709 13:00:30.105573  5122 raft_consensus.cc:3055] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:30.098767  5344 leader_election.cc:290] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:30.086030  2192 leader_election.cc:304] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:30.116816  1605 raft_consensus.cc:2468] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 7.
I20260709 13:00:30.116153  1599 raft_consensus.cc:2468] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 11.
W20260709 13:00:30.119580  1497 connection.cc:256] RPC call timeout handler was delayed by -1.3498375679999981s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2939s for a response
I20260709 13:00:30.067430  5408 consensus_queue.cc:1059] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 13:00:30.158603  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:30.031601  5372 consensus_queue.cc:237] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:30.198051  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 67725us
W20260709 13:00:30.206918  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 88126.4us
I20260709 13:00:30.210785  1600 raft_consensus.cc:2468] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 13.
W20260709 13:00:30.206027  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:30.205739  1678 raft_consensus.cc:2468] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 8.
W20260709 13:00:30.207809  1497 connection.cc:256] RPC call timeout handler was delayed by -1.237887489000002s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20790000000000003s for a response
I20260709 13:00:30.214406  1598 raft_consensus.cc:3060] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:30.215685  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
W20260709 13:00:30.198042  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 106408us
I20260709 13:00:30.218834  1606 raft_consensus.cc:3060] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:30.201117  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 50509.8us
I20260709 13:00:30.224313  1599 raft_consensus.cc:1275] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:00:30.227736  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 158953us
I20260709 13:00:30.230829  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:30.225510  1571 leader_election.cc:304] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
W20260709 13:00:30.233014  2191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:30.233048  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:30.233973  1600 raft_consensus.cc:3060] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:30.235939  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:30.236570  1523 raft_consensus.cc:3060] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:30.206883  5122 raft_consensus.cc:740] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:30.213655  5368 raft_consensus.cc:3055] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:30.245198  5368 raft_consensus.cc:740] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:00:30.245688  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:30.246246  1531 raft_consensus.cc:3060] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:30.246062  5368 consensus_queue.cc:260] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:30.247287  5368 raft_consensus.cc:3060] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:30.247449  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:30.208415  5321 raft_consensus.cc:697] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 6 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:30.248144  1530 raft_consensus.cc:2468] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 7.
I20260709 13:00:30.248585  5321 consensus_queue.cc:237] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:30.249017  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:30.249574  1530 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 11.
I20260709 13:00:30.242425  5093 raft_consensus.cc:2804] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:30.250891  5093 raft_consensus.cc:493] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:30.251286  5093 raft_consensus.cc:3060] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:30.251653  5165 consensus_queue.cc:1048] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:30.242779  5364 raft_consensus.cc:2804] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:00:30.243208  5417 log.cc:927] Time spent T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 13:00:30.243880  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:30.244118  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:30.239571  5381 raft_consensus.cc:3055] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:30.254432  5381 raft_consensus.cc:740] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:30.254595  1525 raft_consensus.cc:2393] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 9: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:00:30.239573  5041 consensus_queue.cc:1048] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 13:00:30.255537  5381 consensus_queue.cc:260] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:30.243880  1529 raft_consensus.cc:1275] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:00:30.256795  5381 raft_consensus.cc:3060] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:30.259016  1529 raft_consensus.cc:1275] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:00:30.259356  2225 raft_consensus.cc:1240] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:00:30.244153  5378 consensus_queue.cc:260] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:30.243106  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:30.241737  1571 leader_election.cc:304] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
W20260709 13:00:30.296056  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 59485.2us
I20260709 13:00:30.297782  5364 raft_consensus.cc:697] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 11 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:30.295353  5165 raft_consensus.cc:2804] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:30.302858  1675 raft_consensus.cc:1275] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:00:30.216014  5137 consensus_queue.cc:1059] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 13:00:30.306931  1646 leader_election.cc:304] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:30.312161  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:30.312769  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
W20260709 13:00:30.313453  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 234706us
I20260709 13:00:30.225795  5409 raft_consensus.cc:493] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:30.213335  5383 raft_consensus.cc:515] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:30.304891  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:30.316560  1523 raft_consensus.cc:2468] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 10.
I20260709 13:00:30.316862  1676 raft_consensus.cc:1240] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:30.331808  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:30.311374  1572 leader_election.cc:304] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:30.231829  5342 raft_consensus.cc:493] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:30.327397  1646 leader_election.cc:304] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:30.334867  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:30.262542  5412 raft_consensus.cc:2749] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:30.335724  1646 leader_election.cc:304] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:30.346733  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
W20260709 13:00:30.349323  2191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:30.349855  1531 raft_consensus.cc:2468] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 9.
I20260709 13:00:30.351150  1530 raft_consensus.cc:1240] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:30.261417  5330 consensus_queue.cc:1048] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.072s
I20260709 13:00:30.342458  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:30.348863  2192 leader_election.cc:304] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:30.351979  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:30.354506  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:30.356976  1523 raft_consensus.cc:2393] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 10: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:00:30.355238  1598 raft_consensus.cc:2468] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 10.
I20260709 13:00:30.360389  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:30.362146  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:30.362896  1607 raft_consensus.cc:2393] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 11: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:00:30.336323  5380 raft_consensus.cc:2804] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:30.368351  1646 leader_election.cc:304] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:30.364182  2221 raft_consensus.cc:1240] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:30.343930  5413 raft_consensus.cc:3055] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:30.342428  5379 raft_consensus.cc:2804] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:30.367808  2224 raft_consensus.cc:1275] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:00:30.325104  5065 consensus_queue.cc:1048] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:00:30.325282  5025 consensus_queue.cc:1048] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:00:30.366604  1606 raft_consensus.cc:2468] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 8.
I20260709 13:00:30.370550  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:30.371729  2222 raft_consensus.cc:2468] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 10.
I20260709 13:00:30.337433  5165 raft_consensus.cc:697] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 8 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:30.379598  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:30.373364  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:30.355437  4912 raft_consensus.cc:2804] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:30.350884  5238 raft_consensus.cc:2804] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:30.380744  1529 raft_consensus.cc:2468] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 7.
I20260709 13:00:30.388633  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:30.383598  2192 leader_election.cc:304] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:30.390051  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:30.384104  1646 leader_election.cc:304] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:30.384342  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:30.390991  1599 raft_consensus.cc:2393] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 9: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:00:30.385262  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:30.385993  1676 raft_consensus.cc:1275] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:00:30.392685  1603 raft_consensus.cc:2368] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b for earlier term 9. Current term is 10.
I20260709 13:00:30.393657  1598 raft_consensus.cc:1240] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:30.388528  1600 raft_consensus.cc:2468] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 8.
I20260709 13:00:30.388959  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:30.389050  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:30.397495  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:30.335108  4815 raft_consensus.cc:515] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:30.398250  1529 raft_consensus.cc:2393] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 11: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:00:30.398763  2220 raft_consensus.cc:1275] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:00:30.400202  1646 leader_election.cc:304] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:30.400223  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:30.399693  1607 raft_consensus.cc:1275] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:00:30.347151  5342 raft_consensus.cc:515] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:30.298939  5122 consensus_queue.cc:260] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:30.378504  5331 raft_consensus.cc:2804] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:30.357854  5335 consensus_queue.cc:1048] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:00:30.412174  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:30.415974  2192 leader_election.cc:304] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:30.417023  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:30.418568  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:30.406741  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:30.374356  5413 raft_consensus.cc:740] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:30.409821  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:30.411504  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:30.338858  5409 raft_consensus.cc:515] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:30.390035  5238 raft_consensus.cc:493] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:30.385967  5380 raft_consensus.cc:697] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 7 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:30.381628  5165 consensus_queue.cc:237] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:30.437381  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:30.436976  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:30.404277  4912 raft_consensus.cc:697] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 13 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:30.392457  5379 raft_consensus.cc:697] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 11 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:30.440438  1601 raft_consensus.cc:2468] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 10.
I20260709 13:00:30.425822  5331 raft_consensus.cc:697] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 10 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:30.442502  2192 leader_election.cc:304] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:30.426611  1646 leader_election.cc:304] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:30.407027  5099 raft_consensus.cc:2804] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:30.412776  5364 consensus_queue.cc:237] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:30.407160  5351 raft_consensus.cc:2804] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:30.421416  2225 raft_consensus.cc:1240] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:00:30.415681  5344 raft_consensus.cc:493] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:30.531210  4912 consensus_queue.cc:237] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:30.436779  5296 consensus_queue.cc:1175] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b96ce9cc496c49d7818fa983a17b062b" responder_term: 8 status { last_received { term: 8 index: 8 } last_committed_idx: 8 last_received_current_leader { term: 8 index: 8 } }
I20260709 13:00:30.445482  2223 raft_consensus.cc:2468] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 8.
I20260709 13:00:30.379186  5412 consensus_queue.cc:1048] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:00:30.448788  1603 raft_consensus.cc:2393] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 8: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:00:30.380380  5274 consensus_queue.cc:1059] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 7.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:00:30.535684  5351 raft_consensus.cc:697] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 8 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:30.535329  5379 consensus_queue.cc:237] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:30.536000  5274 raft_consensus.cc:3055] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:30.536441  5274 raft_consensus.cc:740] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:30.532133  5344 raft_consensus.cc:515] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:30.537283  5274 consensus_queue.cc:260] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 7.10, Last appended by leader: 10, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:30.364979  5291 consensus_queue.cc:237] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:30.391407  5339 consensus_queue.cc:1048] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:00:30.421689  1598 raft_consensus.cc:2393] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 14: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:00:30.420974  5032 raft_consensus.cc:2804] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:30.540321  1676 raft_consensus.cc:1275] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:00:30.594136  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:30.476580  1674 raft_consensus.cc:1275] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:00:30.544955  1496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:30.451418  5238 raft_consensus.cc:3060] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:30.471588  5122 raft_consensus.cc:3060] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:30.594426  1676 pending_rounds.cc:85] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90: Aborting all ops after (but not including) 4
W20260709 13:00:30.569175  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:30.605424  1676 pending_rounds.cc:107] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:00:30.605755  1676 raft_consensus.cc:2889] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:30.476588  5360 raft_consensus.cc:3055] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:30.538532  5274 raft_consensus.cc:3060] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:30.539727  5403 raft_consensus.cc:493] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:30.509392  5336 raft_consensus.cc:493] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:30.450956  1428 catalog_manager.cc:5697] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } }
I20260709 13:00:30.594801  1524 raft_consensus.cc:3060] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:30.451040  5401 consensus_queue.cc:1048] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.170s
I20260709 13:00:30.546229  5408 raft_consensus.cc:2749] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:30.473820  5411 raft_consensus.cc:2804] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:30.531278  5387 raft_consensus.cc:2749] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:30.453255  5064 consensus_queue.cc:1059] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.147s
W20260709 13:00:30.601094  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 158668us
I20260709 13:00:30.436986  5407 consensus_queue.cc:1048] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.183s
W20260709 13:00:30.610080  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 157436us
I20260709 13:00:30.617727  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:30.618511  1530 raft_consensus.cc:2393] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 14: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:00:30.621361  2192 leader_election.cc:304] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:00:30.609609  5377 consensus_meta.cc:287] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b: Time spent flushing consensus metadata: real 0.588s	user 0.015s	sys 0.006s
W20260709 13:00:30.612298  5388 consensus_meta.cc:287] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b: Time spent flushing consensus metadata: real 0.513s	user 0.007s	sys 0.010s
I20260709 13:00:30.633170  2190 leader_election.cc:304] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:30.608824  5360 raft_consensus.cc:740] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:30.635468  2190 leader_election.cc:304] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
W20260709 13:00:30.636566  1495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:30.641664  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:30.646406  1529 pending_rounds.cc:85] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting all ops after (but not including) 4
I20260709 13:00:30.646836  1529 pending_rounds.cc:107] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:00:30.647083  1529 raft_consensus.cc:2889] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:30.536630  5351 consensus_queue.cc:237] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:30.615377  5411 raft_consensus.cc:493] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
W20260709 13:00:30.657001  5348 consensus_queue.cc:1175] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" responder_term: 7 status { last_received { term: 7 index: 10 } last_committed_idx: 10 last_received_current_leader { term: 7 index: 10 } }
W20260709 13:00:30.658525  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:30.614614  5336 raft_consensus.cc:515] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:30.648411  5412 raft_consensus.cc:2804] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:30.639928  5064 raft_consensus.cc:2749] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:30.653024  5411 raft_consensus.cc:3060] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:00:30.664769  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 43484us
W20260709 13:00:30.677289  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:30.609541  5380 consensus_queue.cc:237] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:30.658387  5025 raft_consensus.cc:3055] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:30.643615  5386 consensus_queue.cc:1048] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:00:30.682523  1530 raft_consensus.cc:1240] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 9. Current term is 10. Ops: [7.8-9.9]
I20260709 13:00:30.614796  5403 raft_consensus.cc:515] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:30.684998  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
W20260709 13:00:30.687885  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 52493.8us
I20260709 13:00:30.673691  5344 leader_election.cc:290] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:30.680210  2192 leader_election.cc:304] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:30.610945  5413 consensus_queue.cc:260] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:30.697903  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:30.709089  2227 raft_consensus.cc:2468] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 6.
I20260709 13:00:30.680838  5032 raft_consensus.cc:697] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 8 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:30.664278  5093 raft_consensus.cc:515] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:30.681384  5025 raft_consensus.cc:740] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
W20260709 13:00:30.729540  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 49405.9us
I20260709 13:00:30.730386  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:30.730481  2192 leader_election.cc:400] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 election: Vote denied by peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303) with higher term. Message: Invalid argument: T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b for earlier term 9. Current term is 10.
I20260709 13:00:30.691644  5387 raft_consensus.cc:2804] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:30.729892  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:30.744768  1675 raft_consensus.cc:2393] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 10: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:00:30.695669  4815 leader_election.cc:290] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:30.694988  5369 raft_consensus.cc:2804] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:30.694757  5412 raft_consensus.cc:697] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 10 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
W20260709 13:00:30.789291  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 57717.7us
I20260709 13:00:30.643230  5371 consensus_queue.cc:1048] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.136s
I20260709 13:00:30.736898  5387 raft_consensus.cc:493] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:30.712885  5342 leader_election.cc:290] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:30.839315  5032 consensus_queue.cc:237] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:30.840751  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:30.840750  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:30.841964  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:30.950532  1532 raft_consensus.cc:3060] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:30.852036  5403 leader_election.cc:290] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:30.853343  1606 raft_consensus.cc:2368] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 9. Current term is 10.
I20260709 13:00:30.880640  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:30.658185  5331 consensus_queue.cc:237] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:30.834762  5426 log.cc:927] Time spent T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.175s	user 0.001s	sys 0.000s
I20260709 13:00:30.764462  5377 raft_consensus.cc:2749] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:00:30.846061  2190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:30.950959  1530 raft_consensus.cc:3060] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:30.879830  5413 raft_consensus.cc:3060] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:30.963635  5424 log.cc:927] Time spent T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.542s	user 0.001s	sys 0.000s
I20260709 13:00:30.953660  5373 raft_consensus.cc:493] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:30.967346  5442 log.cc:927] Time spent T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:00:30.944526  5387 raft_consensus.cc:3060] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:30.964722  5368 consensus_meta.cc:287] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent flushing consensus metadata: real 0.661s	user 0.007s	sys 0.004s
I20260709 13:00:30.964257  5110 raft_consensus.cc:493] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:30.729871  5360 consensus_queue.cc:260] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:30.992410  1532 raft_consensus.cc:2468] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 8.
I20260709 13:00:30.971226  5025 consensus_queue.cc:260] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:30.929741  5429 consensus_queue.cc:1059] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.102s
I20260709 13:00:31.018003  5025 raft_consensus.cc:3060] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:31.018445  5434 log.cc:927] Time spent T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
W20260709 13:00:31.021186  5435 log.cc:927] Time spent T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.289s	user 0.001s	sys 0.000s
I20260709 13:00:31.021733  2221 raft_consensus.cc:2468] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 13.
I20260709 13:00:31.027143  5360 raft_consensus.cc:3060] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:31.027370  5093 leader_election.cc:290] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:00:31.031147  5427 log.cc:927] Time spent T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.318s	user 0.001s	sys 0.000s
I20260709 13:00:31.031949  1524 raft_consensus.cc:2468] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 9.
I20260709 13:00:31.013677  1523 raft_consensus.cc:2468] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 7.
W20260709 13:00:31.034411  1497 connection.cc:256] RPC call timeout handler was delayed by -1.2904685380000274s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21760000000000002s for a response
W20260709 13:00:31.035005  1497 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:40303 timed out after 1.521s (SENT) [suppressed 63 similar messages]
I20260709 13:00:31.016340  5110 raft_consensus.cc:515] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:31.012765  1530 raft_consensus.cc:2468] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 9.
I20260709 13:00:31.039884  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
W20260709 13:00:30.993690  5430 log.cc:927] Time spent T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 13:00:31.045918  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:31.046636  1524 raft_consensus.cc:3060] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:31.013520  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 586985us
I20260709 13:00:31.048044  1646 leader_election.cc:304] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:31.049794  1646 leader_election.cc:304] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:31.051118  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:31.030071  5238 raft_consensus.cc:515] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:30.994418  5409 leader_election.cc:290] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:31.052204  1646 leader_election.cc:304] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:31.063046  1530 raft_consensus.cc:2468] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 10.
I20260709 13:00:31.038779  5110 leader_election.cc:290] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:00:31.057389  5441 log.cc:927] Time spent T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:00:31.060552  1524 raft_consensus.cc:2468] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 9.
W20260709 13:00:31.065373  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:31.069368  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:31.070117  1532 raft_consensus.cc:2468] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 5.
I20260709 13:00:31.071771  2190 leader_election.cc:304] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:30.997525  5373 raft_consensus.cc:515] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:31.080220  1603 raft_consensus.cc:1275] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:00:31.085115  1605 raft_consensus.cc:1240] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 8. Current term is 9. Ops: [8.10-8.10]
I20260709 13:00:31.053608  5025 raft_consensus.cc:2749] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:00:31.098994  5446 raft_consensus.cc:2804] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:31.099841  5446 raft_consensus.cc:697] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 9 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:31.100780  5446 consensus_queue.cc:237] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:31.101392  1530 raft_consensus.cc:1275] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:00:31.097790  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 62805.6us
I20260709 13:00:31.103868  1530 raft_consensus.cc:1275] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:00:31.104781  1532 raft_consensus.cc:1275] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:00:31.110800  5440 raft_consensus.cc:2804] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:31.113863  5373 leader_election.cc:290] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:31.013898  5412 consensus_queue.cc:237] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:31.118325  5238 leader_election.cc:290] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:31.120955  1524 raft_consensus.cc:1275] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:00:31.123594  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:31.076102  5064 raft_consensus.cc:2749] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:31.065374  5330 consensus_queue.cc:1048] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 13:00:31.123201  5025 raft_consensus.cc:493] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:31.103605  5369 raft_consensus.cc:697] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 9 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
W20260709 13:00:31.128675  5441 log.cc:927] Time spent T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 13:00:31.161082  1495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:31.102968  5401 consensus_queue.cc:1048] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:00:31.128413  5440 raft_consensus.cc:697] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 10 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:31.162595  5025 raft_consensus.cc:515] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:31.102806  5439 consensus_queue.cc:1059] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.092s
W20260709 13:00:31.167583  5381 consensus_meta.cc:287] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b: Time spent flushing consensus metadata: real 0.910s	user 0.011s	sys 0.004s
W20260709 13:00:31.177057  1497 connection.cc:256] RPC call timeout handler was delayed by -1.0477331699999581s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.47409999999999997s for a response
W20260709 13:00:31.177623  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 43768.2us
W20260709 13:00:31.193900  1496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:31.157543  5335 consensus_queue.cc:1048] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:00:31.188367  5373 raft_consensus.cc:493] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:31.216466  5373 raft_consensus.cc:515] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:31.219069  5369 consensus_queue.cc:237] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:31.220021  5387 raft_consensus.cc:515] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:31.196758  5439 consensus_queue.cc:1059] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:00:31.224789  5439 raft_consensus.cc:3055] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:31.225178  5439 raft_consensus.cc:740] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:31.206331  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:31.207820  1605 raft_consensus.cc:1275] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:00:31.211015  5440 consensus_queue.cc:237] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:31.228785  5411 consensus_meta.cc:287] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b: Time spent flushing consensus metadata: real 0.538s	user 0.009s	sys 0.000s
I20260709 13:00:31.222395  5387 leader_election.cc:290] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 10 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:31.235901  5377 raft_consensus.cc:3055] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:31.236347  5377 raft_consensus.cc:740] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:31.237139  5377 consensus_queue.cc:260] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:31.247014  1525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49310 (request call id 814) took 1016 ms. Trace:
I20260709 13:00:31.226037  5439 consensus_queue.cc:260] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:31.241925  2218 raft_consensus.cc:2468] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 8.
I20260709 13:00:31.247498  1525 rpcz_store.cc:276] 0709 13:00:30.230740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:30.255215 (+ 24475us) service_pool.cc:224] Handling call
0709 13:00:30.260798 (+  5583us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:30.261175 (+   377us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:00:30.380085 (+118910us) log.cc:844] Serialized 14 byte log entry
0709 13:00:30.677864 (+297779us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:30.684830 (+  6966us) log.cc:844] Serialized 26 byte log entry
0709 13:00:30.684983 (+   153us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:30.685022 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:30.685085 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:31.246767 (+561682us) raft_consensus.cc:1685] finished
0709 13:00:31.246788 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:31.246946 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":88956,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":1376,"raft.queue_time_us":1756,"raft.run_cpu_time_us":296,"raft.run_wall_time_us":42380,"thread_start_us":372411,"threads_started":2,"wal-append.queue_time_us":347766}
I20260709 13:00:31.269940  5409 consensus_queue.cc:1048] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 13:00:31.231925  5411 raft_consensus.cc:515] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:31.274276  1497 leader_election.cc:304] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:31.270483  5439 raft_consensus.cc:3060] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:31.288352  2223 raft_consensus.cc:1240] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 9 LEADER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:00:31.287333  5409 raft_consensus.cc:2749] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:00:31.280701  5373 leader_election.cc:290] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:31.291244  1497 leader_election.cc:304] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:31.296631  1497 leader_election.cc:304] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:31.297384  5437 raft_consensus.cc:2749] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:31.298098  5437 consensus_queue.cc:1048] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:31.298925  5373 raft_consensus.cc:2749] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:31.298244  1497 leader_election.cc:304] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:31.299883  4867 raft_consensus.cc:2749] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:31.300561  1497 leader_election.cc:304] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:31.301451  5378 raft_consensus.cc:3060] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:31.303062  5373 raft_consensus.cc:2804] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:31.303471  5373 raft_consensus.cc:493] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:31.303803  5373 raft_consensus.cc:3060] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:00:31.305292  2191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:31.305812  2191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:31.306272  2191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:31.313099  2191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:31.317574  2221 raft_consensus.cc:1240] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:31.317662  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:31.318485  2219 raft_consensus.cc:2393] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 10: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:00:31.319870  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:31.320585  2219 raft_consensus.cc:2393] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 6: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:00:31.321724  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:31.322432  5100 raft_consensus.cc:3055] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:31.322911  5100 raft_consensus.cc:740] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:31.323148  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:31.323446  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:31.323659  5100 consensus_queue.cc:260] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:31.324836  5100 raft_consensus.cc:3060] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:31.325250  2226 raft_consensus.cc:1275] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:31.326522  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:31.327036  2226 raft_consensus.cc:3060] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:31.331696  4867 raft_consensus.cc:493] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:31.332248  5025 leader_election.cc:290] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:31.322480  2219 raft_consensus.cc:2393] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 10: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:00:31.336266  1497 leader_election.cc:304] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:31.337388  5437 raft_consensus.cc:2749] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:31.344563  1497 leader_election.cc:304] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:31.345175  5411 leader_election.cc:290] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:31.347111  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:31.334461  2226 raft_consensus.cc:2468] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 9.
I20260709 13:00:31.347828  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:31.348093  1528 raft_consensus.cc:1275] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:00:31.349211  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:31.349941  1530 raft_consensus.cc:2393] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 8: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:00:31.353047  1528 raft_consensus.cc:1240] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:31.352147  5110 consensus_queue.cc:1048] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 13:00:31.360287  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:31.360688  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:31.361328  1529 raft_consensus.cc:2468] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 12.
I20260709 13:00:31.361255  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:31.345940  5368 raft_consensus.cc:2749] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:00:31.364360  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
W20260709 13:00:31.352222  5462 log.cc:927] Time spent T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.083s	user 0.000s	sys 0.002s
I20260709 13:00:31.353222  4912 raft_consensus.cc:493] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:31.332259  4867 raft_consensus.cc:515] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:31.386364  4912 raft_consensus.cc:515] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:31.388116  4867 leader_election.cc:290] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:31.388621  4912 leader_election.cc:290] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:31.353053  5025 raft_consensus.cc:493] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:31.389585  5025 raft_consensus.cc:515] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:31.391736  5025 leader_election.cc:290] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:00:31.403905  5450 log.cc:927] Time spent T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.134s	user 0.003s	sys 0.000s
I20260709 13:00:31.405279  5373 raft_consensus.cc:515] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:31.407737  5373 leader_election.cc:290] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:31.365549  1528 raft_consensus.cc:2468] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 11.
I20260709 13:00:31.384924  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:31.427158  1529 raft_consensus.cc:3060] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:00:31.409322  5122 raft_consensus.cc:493] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:31.380805  1572 leader_election.cc:304] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:00:31.410485  5093 consensus_queue.cc:1048] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:31.411799  5321 consensus_queue.cc:1048] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:00:31.421279  5432 log.cc:927] Time spent T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.405s	user 0.000s	sys 0.001s
W20260709 13:00:31.422484  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:31.427843  2224 raft_consensus.cc:2468] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 11.
W20260709 13:00:31.383473  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:31.429502  1528 raft_consensus.cc:1275] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:31.586869  1527 raft_consensus.cc:1240] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 LEADER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 8. Current term is 9. Ops: []
W20260709 13:00:31.668591  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 287879us
I20260709 13:00:31.537740  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:31.669673  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:31.559808  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:31.672000  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:31.431989  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:31.672830  1525 raft_consensus.cc:2393] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 11: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:00:31.673395  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 13:00:31.643025  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 259839us
W20260709 13:00:31.436570  2190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:31.606148  1571 leader_election.cc:304] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:31.678045  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49310 (request call id 808) took 1449 ms. Trace:
W20260709 13:00:31.678517  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 72486.7us
I20260709 13:00:31.678467  1526 rpcz_store.cc:276] 0709 13:00:30.228751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:30.238317 (+  9566us) service_pool.cc:224] Handling call
0709 13:00:30.238552 (+   235us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:30.539404 (+300852us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:30.539432 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:30.539482 (+    50us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:30.539516 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:31.677802 (+1138286us) spinlock_profiling.cc:243] Waited 301 ms on lock 0x7b54002db4d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:00:31.677847 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:31.677964 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":691536128}
I20260709 13:00:31.682009  2225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50310 (request call id 766) took 1416 ms. Trace:
I20260709 13:00:31.683535  2227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50326 (request call id 847) took 1357 ms. Trace:
W20260709 13:00:31.684185  1495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:31.684578  1528 raft_consensus.cc:2393] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 7: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:00:31.686852  1599 raft_consensus.cc:1240] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 7. Current term is 8. Ops: [4.7-7.9]
I20260709 13:00:31.537367  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
W20260709 13:00:31.687525  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:31.687760  1532 raft_consensus.cc:2393] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 6: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
W20260709 13:00:31.688019  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:31.688616  1530 raft_consensus.cc:2393] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 10: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:00:31.688918  1599 raft_consensus.cc:1240] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 10. Current term is 11. Ops: [9.9-10.10]
I20260709 13:00:31.684044  2227 rpcz_store.cc:276] 0709 13:00:30.325857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:30.325977 (+   120us) service_pool.cc:224] Handling call
0709 13:00:31.683376 (+1357399us) spinlock_profiling.cc:243] Waited 296 ms on lock 0x7b540050a5d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:31.683481 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":681660288}
W20260709 13:00:31.688954  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:31.691409  1599 raft_consensus.cc:1275] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:00:31.673780  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:31.693928  1644 leader_election.cc:304] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:31.694228  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:31.695039  1528 raft_consensus.cc:2393] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 10: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:00:31.696026  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:31.695063  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:31.697357  1677 raft_consensus.cc:3060] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:31.696923  1679 raft_consensus.cc:2410] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for term 9 because replica has last-logged OpId of term: 8 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 13:00:31.698038  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:31.698170  1599 raft_consensus.cc:1240] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:00:31.691454  5122 raft_consensus.cc:515] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:31.705065  1601 raft_consensus.cc:1240] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 9. Current term is 10. Ops: [8.8-9.9]
I20260709 13:00:31.706564  1607 raft_consensus.cc:1240] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:31.682507  2225 rpcz_store.cc:276] 0709 13:00:30.265808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:30.266071 (+   263us) service_pool.cc:224] Handling call
0709 13:00:30.266405 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:30.531687 (+265282us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:31.681720 (+1150033us) spinlock_profiling.cc:243] Waited 155 ms on lock 0x7b540059c4d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:00:31.681924 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":355970944}
I20260709 13:00:31.711477  1605 raft_consensus.cc:1240] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:31.713152  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:31.713635  1680 raft_consensus.cc:1275] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:00:31.713768  1598 raft_consensus.cc:1240] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:31.689709  5296 raft_consensus.cc:2804] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:31.713768  1674 raft_consensus.cc:2468] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 9.
I20260709 13:00:31.692921  5238 raft_consensus.cc:2749] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:31.715427  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:31.711210  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:31.722122  1599 raft_consensus.cc:3060] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:31.717402  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:31.723187  1679 raft_consensus.cc:2393] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 8: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:00:31.718375  1530 raft_consensus.cc:1275] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:00:31.722091  1532 raft_consensus.cc:2393] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 8: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:00:31.719679  1672 raft_consensus.cc:1275] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:31.710297  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:31.725404  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:31.704625  4912 raft_consensus.cc:493] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:31.727792  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:31.726104  1674 raft_consensus.cc:2468] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 10.
I20260709 13:00:31.737512  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:31.738117  1598 raft_consensus.cc:3060] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:31.716135  5379 raft_consensus.cc:2749] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:00:31.747212  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:31.729598  1528 raft_consensus.cc:1275] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:00:31.740379  2191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:31.748485  2191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:31.740860  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:31.749445  1532 raft_consensus.cc:2393] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 6: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:00:31.751708  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:31.755220  1528 raft_consensus.cc:2410] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:00:31.736799  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:31.730123  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:31.734509  5099 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:31.802158  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 54894.2us
I20260709 13:00:31.732286  5296 raft_consensus.cc:697] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 9 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:31.811596  1605 raft_consensus.cc:1240] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:31.746479  4867 raft_consensus.cc:493] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:31.854635  1599 raft_consensus.cc:2468] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 10.
I20260709 13:00:31.868402  5296 consensus_queue.cc:237] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:31.875106  2191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:31.765272  5373 raft_consensus.cc:493] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:31.810762  5099 raft_consensus.cc:3060] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:31.740983  5330 consensus_queue.cc:1059] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.083s
I20260709 13:00:31.741773  4912 raft_consensus.cc:515] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:31.940096  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:31.940538  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:31.941289  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:00:31.885543  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 74919.8us
I20260709 13:00:31.886370  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:31.801385  5110 consensus_queue.cc:1059] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.087s
W20260709 13:00:31.935109  5465 log.cc:927] Time spent T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.175s	user 0.001s	sys 0.000s
I20260709 13:00:31.936149  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:31.937793  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:31.946575  1600 raft_consensus.cc:2393] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 10: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
W20260709 13:00:31.939687  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 199723us
I20260709 13:00:31.939608  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:31.943595  1496 leader_election.cc:304] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:31.944718  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:31.956725  1599 raft_consensus.cc:2468] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 9.
W20260709 13:00:31.948410  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 213539us
I20260709 13:00:31.955245  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:31.955578  1601 raft_consensus.cc:2368] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 8. Current term is 9.
I20260709 13:00:31.945904  1673 raft_consensus.cc:2468] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 11.
I20260709 13:00:31.876637  5381 raft_consensus.cc:493] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:31.851756  5348 consensus_queue.cc:1048] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.103s
I20260709 13:00:31.876025  4867 raft_consensus.cc:515] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:32.105990  5427 log.cc:927] Time spent T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 13:00:32.033710  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:32.111518  1673 raft_consensus.cc:2468] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 9.
I20260709 13:00:32.019066  1598 raft_consensus.cc:2468] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 11.
I20260709 13:00:32.113404  4867 leader_election.cc:290] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:00:32.072873  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 112845us
I20260709 13:00:31.940168  5373 raft_consensus.cc:515] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:32.067137  5238 raft_consensus.cc:493] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:32.067510  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 50118.1us
I20260709 13:00:32.118877  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:32.133797  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:32.134594  1601 raft_consensus.cc:2393] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 14: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:00:32.120052  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:32.135272  1523 raft_consensus.cc:2468] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 9.
W20260709 13:00:32.088477  1495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:32.142647  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:31.963212  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:32.016640  1679 raft_consensus.cc:2468] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 9.
I20260709 13:00:32.074158  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 13:00:32.130308  1644 leader_election.cc:336] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.506s (SENT)
I20260709 13:00:32.092417  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:32.158378  1497 leader_election.cc:304] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:32.160651  1497 leader_election.cc:304] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:32.161850  1497 leader_election.cc:304] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:32.085517  5368 raft_consensus.cc:2804] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:00:31.961374  5464 log.cc:927] Time spent T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 13:00:32.134588  1599 raft_consensus.cc:2410] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:00:32.118901  1598 raft_consensus.cc:1240] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:32.177701  1532 raft_consensus.cc:1275] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:00:32.181125  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:32.004927  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:32.182763  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:32.183460  1599 raft_consensus.cc:2393] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 10: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:00:32.032541  5411 raft_consensus.cc:493] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:32.072036  4912 leader_election.cc:290] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:32.162901  5032 raft_consensus.cc:493] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:32.168664  4867 raft_consensus.cc:2749] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:32.136849  5238 raft_consensus.cc:515] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:32.190097  1677 raft_consensus.cc:2468] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 10.
I20260709 13:00:32.175688  5447 raft_consensus.cc:493] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:00:32.193603  1570 leader_election.cc:304] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:32.193945  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:32.216823  1530 raft_consensus.cc:2468] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 8.
I20260709 13:00:32.216854  5389 raft_consensus.cc:2749] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:32.184623  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:32.194875  5411 raft_consensus.cc:515] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:32.194379  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 250860us
W20260709 13:00:32.193459  1529 consensus_meta.cc:287] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent flushing consensus metadata: real 0.668s	user 0.009s	sys 0.000s
I20260709 13:00:32.218923  1529 raft_consensus.cc:2468] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 7.
I20260709 13:00:32.174347  5368 raft_consensus.cc:493] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:32.212848  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:32.136421  5381 raft_consensus.cc:515] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:32.199456  5369 raft_consensus.cc:493] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:32.228500  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:32.229308  1677 raft_consensus.cc:2393] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 8: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
W20260709 13:00:32.231127  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 95066us
W20260709 13:00:32.231031  1606 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36194 (request call id 1671) took 1836 ms (client timeout 1621 ms). Trace:
I20260709 13:00:32.192559  5110 consensus_queue.cc:1048] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:00:32.219072  4867 raft_consensus.cc:2749] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:00:32.238210  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:32.239526  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:32.233388  1606 rpcz_store.cc:269] 0709 13:00:30.394215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:30.402380 (+  8165us) service_pool.cc:224] Handling call
0709 13:00:32.230833 (+1828453us) spinlock_profiling.cc:243] Waited 435 ms on lock 0x7b54000dbe54. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:32.230964 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1001492352}
I20260709 13:00:32.224445  5368 raft_consensus.cc:3060] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:32.231899  1571 leader_election.cc:304] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:32.225450  5371 raft_consensus.cc:493] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:32.248306  5296 raft_consensus.cc:2804] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:32.248737  5296 raft_consensus.cc:493] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:32.249065  5296 raft_consensus.cc:3060] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:32.232304  1496 leader_election.cc:304] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:32.255820  2223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50326 (request call id 862) took 1163 ms. Trace:
I20260709 13:00:32.213846  5032 raft_consensus.cc:515] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:32.256297  2223 rpcz_store.cc:276] 0709 13:00:31.092511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.092660 (+   149us) service_pool.cc:224] Handling call
0709 13:00:31.107401 (+ 14741us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:31.288811 (+181410us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:32.255536 (+966725us) spinlock_profiling.cc:243] Waited 181 ms on lock 0x7b540051a754. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:00:32.255749 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":415582080}
I20260709 13:00:32.247758  1571 leader_election.cc:304] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
W20260709 13:00:32.274341  5468 log.cc:927] Time spent T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:00:32.274899  4867 raft_consensus.cc:2804] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:32.275403  4867 raft_consensus.cc:493] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:32.275792  4867 raft_consensus.cc:3060] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:32.235805  5369 raft_consensus.cc:515] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:32.279312  5411 leader_election.cc:290] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:32.219525  5447 raft_consensus.cc:515] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:32.231897  5479 raft_consensus.cc:2749] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:32.255633  5476 consensus_queue.cc:1048] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:00:32.284898  5482 raft_consensus.cc:2804] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:00:32.285869  5466 log.cc:927] Time spent T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 13:00:32.241695  5321 consensus_queue.cc:1059] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:00:32.287124  5381 leader_election.cc:290] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:00:32.291356  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 129583us
I20260709 13:00:32.288211  1571 leader_election.cc:304] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
W20260709 13:00:32.287621  5471 log.cc:927] Time spent T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
I20260709 13:00:32.301460  1497 leader_election.cc:304] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
W20260709 13:00:32.287791  5472 log.cc:927] Time spent T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:00:32.255107  5348 consensus_queue.cc:1048] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:00:32.319517  4867 raft_consensus.cc:515] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:32.317097  5348 consensus_queue.cc:1243] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer 39a92f5a4352465d8af3af5908fe8642 log is divergent from this leader: its last log entry 9.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:00:32.299531  5369 leader_election.cc:290] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:32.323750  5373 leader_election.cc:290] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:32.325562  4867 leader_election.cc:290] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:32.325829  5373 consensus_queue.cc:1059] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:32.298558  5482 raft_consensus.cc:493] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:32.330775  5482 raft_consensus.cc:3060] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:32.263201  5099 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:32.271953  5387 consensus_queue.cc:1059] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:00:32.264021  5371 raft_consensus.cc:515] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:32.336697  5238 leader_election.cc:290] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:32.305956  5032 leader_election.cc:290] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:32.312801  5389 raft_consensus.cc:3055] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:32.314977  5110 raft_consensus.cc:493] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:32.344120  5110 raft_consensus.cc:515] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:32.316084  5321 raft_consensus.cc:2804] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:32.330049  5479 raft_consensus.cc:2749] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:00:32.369360  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 137134us
I20260709 13:00:32.346464  5389 raft_consensus.cc:740] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
W20260709 13:00:32.373459  1646 connection.cc:256] RPC call timeout handler was delayed by -1.0334826859999566s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1542s for a response
W20260709 13:00:32.374029  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 128459us
I20260709 13:00:32.380410  1603 raft_consensus.cc:1275] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:00:32.382647  1570 leader_election.cc:336] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.518s (SENT)
W20260709 13:00:32.370958  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 116211us
I20260709 13:00:32.347352  5321 raft_consensus.cc:697] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 10 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:32.384241  1570 leader_election.cc:304] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:32.389441  2192 leader_election.cc:304] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:32.390204  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:32.392530  1680 raft_consensus.cc:3060] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:32.393720  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:32.394599  1678 raft_consensus.cc:2393] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 6: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:00:32.368932  5483 raft_consensus.cc:3055] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:00:32.389660  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 66981.5us
I20260709 13:00:32.400910  2192 leader_election.cc:304] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:00:32.384902  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 67974.6us
I20260709 13:00:32.349238  5032 consensus_queue.cc:1048] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:00:32.371492  5110 leader_election.cc:290] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:32.410620  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:32.401281  5483 raft_consensus.cc:740] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:00:32.414996  5483 consensus_queue.cc:260] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:32.416078  5483 raft_consensus.cc:3060] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:32.404714  5378 raft_consensus.cc:2804] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:32.416774  5378 raft_consensus.cc:697] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 10 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:32.417707  5378 consensus_queue.cc:237] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:32.407653  5411 raft_consensus.cc:493] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:32.419549  5423 log.cc:927] Time spent T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 1.888s	user 0.013s	sys 0.022s
I20260709 13:00:32.393265  5387 consensus_queue.cc:1059] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:00:32.420650  5387 raft_consensus.cc:3055] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:32.421018  5387 raft_consensus.cc:740] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:32.421845  5405 raft_consensus.cc:3055] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:32.421669  5296 raft_consensus.cc:515] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:32.387072  5064 raft_consensus.cc:3055] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:32.422557  5064 raft_consensus.cc:740] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:32.422958  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:32.423565  1673 raft_consensus.cc:2468] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 9.
I20260709 13:00:32.423417  5064 consensus_queue.cc:260] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:32.423949  2224 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50326 (request call id 859) took 2044 ms (client timeout 1542 ms). Trace:
I20260709 13:00:32.424189  5296 leader_election.cc:290] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:32.424451  5064 raft_consensus.cc:3060] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:32.424850  5296 raft_consensus.cc:2749] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:32.419214  5321 consensus_queue.cc:237] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:32.427085  2220 raft_consensus.cc:1275] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:00:32.427574  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:32.419183  5411 raft_consensus.cc:515] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:32.417603  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:32.430254  5411 leader_election.cc:290] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:32.421859  5387 consensus_queue.cc:260] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:32.404584  5348 raft_consensus.cc:2804] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:32.431988  5348 raft_consensus.cc:697] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 11 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:32.432340  5387 raft_consensus.cc:3060] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:32.432952  5348 consensus_queue.cc:237] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:32.424377  2224 rpcz_store.cc:269] 0709 13:00:30.379706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:30.379885 (+   179us) service_pool.cc:224] Handling call
0709 13:00:32.423749 (+2043864us) spinlock_profiling.cc:243] Waited 974 ms on lock 0x7b5400456ad4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:32.423881 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2239659392}
I20260709 13:00:32.441828  1680 raft_consensus.cc:2468] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 12.
I20260709 13:00:32.403893  1497 leader_election.cc:304] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:32.406363  5351 raft_consensus.cc:493] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
W20260709 13:00:32.449914  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 46103.1us
I20260709 13:00:32.452921  1529 raft_consensus.cc:1275] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:00:32.422315  5405 raft_consensus.cc:740] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:32.457430  1644 leader_election.cc:304] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:32.457652  1529 raft_consensus.cc:1275] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:00:32.458763  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:32.459412  1529 raft_consensus.cc:2468] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 6.
I20260709 13:00:32.456293  5351 raft_consensus.cc:515] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:32.444763  5389 consensus_queue.cc:260] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:32.513651  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:32.455735  5485 raft_consensus.cc:3060] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:32.458807  1496 leader_election.cc:304] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
W20260709 13:00:32.471473  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 88861.5us
I20260709 13:00:32.528741  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:32.529359  1672 raft_consensus.cc:3060] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:32.529649  1570 leader_election.cc:336] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.526s (SENT)
I20260709 13:00:32.530133  1570 leader_election.cc:304] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:32.466909  5447 leader_election.cc:290] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:32.497856  5368 raft_consensus.cc:515] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:32.476409  2224 raft_consensus.cc:1240] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 8. Current term is 9. Ops: [8.10-8.10]
I20260709 13:00:32.477795  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 13:00:32.532779  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 74052.1us
I20260709 13:00:32.478415  2225 raft_consensus.cc:1240] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 10 LEADER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:32.526057  1571 leader_election.cc:304] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:32.479678  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:32.534294  1530 raft_consensus.cc:2468] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 7.
I20260709 13:00:32.489164  2222 raft_consensus.cc:1275] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:00:32.501243  2219 raft_consensus.cc:1240] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
W20260709 13:00:32.535079  1570 leader_election.cc:336] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.606s (SENT)
W20260709 13:00:32.522924  5041 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.702s	user 0.000s	sys 0.013s
I20260709 13:00:32.501979  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:32.509021  5439 raft_consensus.cc:2804] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:32.500412  1646 leader_election.cc:304] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:00:32.522435  1497 connection.cc:256] RPC call timeout handler was delayed by -1.4644424869999284s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16210000000000002s for a response
I20260709 13:00:32.479010  2221 raft_consensus.cc:1275] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:00:32.499657  5364 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.408s	user 0.027s	sys 0.012s
I20260709 13:00:32.538316  1674 raft_consensus.cc:1240] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:32.540355  2226 raft_consensus.cc:1275] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:00:32.545485  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:32.546248  1529 raft_consensus.cc:2468] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 9.
W20260709 13:00:32.543126  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 85787.1us
I20260709 13:00:32.547263  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:32.548038  1529 raft_consensus.cc:2393] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 11: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:00:32.548846  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:32.549579  1529 raft_consensus.cc:2393] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 9: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:00:32.550177  5470 raft_consensus.cc:2749] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:00:32.550369  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 50069us
W20260709 13:00:32.551389  2218 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50326 (request call id 844) took 2309 ms (client timeout 1506 ms). Trace:
W20260709 13:00:32.551826  2218 rpcz_store.cc:269] 0709 13:00:30.242142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:30.242258 (+   116us) service_pool.cc:224] Handling call
0709 13:00:32.551194 (+2308936us) spinlock_profiling.cc:243] Waited 862 ms on lock 0x7b54005933d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:32.551305 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1983337856}
I20260709 13:00:32.553331  2220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50326 (request call id 863) took 1460 ms. Trace:
I20260709 13:00:32.553748  2220 rpcz_store.cc:276] 0709 13:00:31.093042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.093151 (+   109us) service_pool.cc:224] Handling call
0709 13:00:32.426766 (+1333615us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:32.427437 (+   671us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:32.553112 (+125675us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b5400456ad0. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b28ad 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:32.553268 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3053275008}
I20260709 13:00:32.556795  1497 leader_election.cc:304] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:32.563601  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:32.564277  1529 raft_consensus.cc:2376] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 7. Re-sending same reply.
I20260709 13:00:32.565093  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:32.539534  5494 raft_consensus.cc:2749] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:32.567128  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:32.567353  5495 consensus_queue.cc:1048] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:32.567550  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:32.568352  1674 raft_consensus.cc:2393] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 9: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:00:32.566438  1570 leader_election.cc:304] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:32.536235  5405 consensus_queue.cc:260] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:32.571426  5476 raft_consensus.cc:2749] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:32.571709  5405 raft_consensus.cc:3060] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:32.571950  5238 consensus_queue.cc:1059] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:32.566934  5488 raft_consensus.cc:2804] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:32.573559  5488 raft_consensus.cc:493] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:32.573931  5488 raft_consensus.cc:3060] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:32.575034  5489 raft_consensus.cc:493] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:32.575587  5489 raft_consensus.cc:515] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:32.571197  5479 raft_consensus.cc:2749] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:32.578750  5489 leader_election.cc:290] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:32.580446  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:32.543393  5439 raft_consensus.cc:493] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:32.581524  5439 raft_consensus.cc:3060] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:32.582320  5494 raft_consensus.cc:493] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:32.582950  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:32.582850  5494 raft_consensus.cc:515] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:32.583539  1530 raft_consensus.cc:2376] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 9. Re-sending same reply.
I20260709 13:00:32.584450  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:32.585481  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:32.586055  1530 raft_consensus.cc:2376] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 9. Re-sending same reply.
I20260709 13:00:32.587220  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:32.571120  1570 leader_election.cc:304] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:32.587518  1674 raft_consensus.cc:1240] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:32.565606  1529 raft_consensus.cc:2376] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 8. Re-sending same reply.
I20260709 13:00:32.469223  5369 raft_consensus.cc:493] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:32.589288  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:32.590291  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:32.591619  1599 raft_consensus.cc:1275] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:00:32.593667  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:32.594457  1530 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 11.
I20260709 13:00:32.595501  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:32.596292  1530 raft_consensus.cc:2468] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 7.
I20260709 13:00:32.597393  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:32.616268  1603 raft_consensus.cc:1275] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 13:00:32.614895  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 43852.9us
I20260709 13:00:32.618611  1570 leader_election.cc:304] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:32.619764  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:32.620514  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:32.620851  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 13:00:32.542093  5041 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.722s	user 0.000s	sys 0.014s
I20260709 13:00:32.621644  1681 raft_consensus.cc:2468] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 8.
I20260709 13:00:32.621981  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:32.539368  5291 raft_consensus.cc:2804] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:00:32.547811  5364 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.472s	user 0.028s	sys 0.012s
I20260709 13:00:32.621448  1529 raft_consensus.cc:2468] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 7.
I20260709 13:00:32.625993  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:32.652756  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:32.629405  1599 raft_consensus.cc:1275] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:00:32.654531  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:32.657634  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:32.658236  1529 raft_consensus.cc:2376] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 8. Re-sending same reply.
I20260709 13:00:32.655463  5291 raft_consensus.cc:697] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:00:32.613651  4912 raft_consensus.cc:493] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:32.659941  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:32.660533  1599 raft_consensus.cc:1275] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:00:32.669328  1530 raft_consensus.cc:3060] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:32.660959  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:32.624137  5238 raft_consensus.cc:2804] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:32.574323  5387 consensus_queue.cc:1048] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.080s
I20260709 13:00:32.667210  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:32.679618  1532 raft_consensus.cc:3060] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:32.670643  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:32.584940  5494 leader_election.cc:290] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:32.621986  5371 leader_election.cc:290] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:00:32.673950  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 55447.8us
I20260709 13:00:32.674839  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 13:00:32.672588  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:32.660254  5476 raft_consensus.cc:3060] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:32.687150  1570 leader_election.cc:304] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:32.686573  1601 raft_consensus.cc:1275] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:00:32.624313  5493 consensus_queue.cc:1048] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 13:00:32.622457  5369 raft_consensus.cc:515] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:32.718797  1495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:32.719767  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 174643us
I20260709 13:00:32.723937  1530 raft_consensus.cc:2468] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 6.
I20260709 13:00:32.725392  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:32.725908  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:32.726786  2218 raft_consensus.cc:2393] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 6: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:00:32.675034  5238 raft_consensus.cc:493] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
W20260709 13:00:32.692564  5490 log.cc:927] Time spent T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.219s	user 0.001s	sys 0.000s
I20260709 13:00:32.708195  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:32.712971  5500 consensus_queue.cc:1048] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:00:32.714527  5368 leader_election.cc:290] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:32.715372  1598 raft_consensus.cc:1275] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:00:32.716084  5517 consensus_queue.cc:1048] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:32.727407  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 13:00:32.707947  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 151167us
I20260709 13:00:32.665333  5065 consensus_queue.cc:1048] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:00:32.580451  5482 raft_consensus.cc:515] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:32.746899  2218 raft_consensus.cc:1240] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 11 LEADER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:32.759814  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:32.629272  5496 consensus_queue.cc:1048] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.067s
I20260709 13:00:32.693753  5383 leader_election.cc:290] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:32.764333  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:32.801431  2220 raft_consensus.cc:2468] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 8.
I20260709 13:00:32.783812  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 13:00:32.784291  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 285057us
I20260709 13:00:32.786576  1527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43010 (request call id 2068) took 2557 ms. Trace:
I20260709 13:00:32.787577  5336 leader_election.cc:290] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:32.763726  1529 raft_consensus.cc:1275] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:00:32.676055  4912 raft_consensus.cc:515] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:32.790351  1532 raft_consensus.cc:2468] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 8.
I20260709 13:00:32.757470  5238 raft_consensus.cc:3060] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:32.671043  5498 consensus_queue.cc:1048] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.099s
I20260709 13:00:32.796532  1497 leader_election.cc:304] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:32.802469  1527 rpcz_store.cc:276] 0709 13:00:30.229395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:30.229512 (+   117us) service_pool.cc:224] Handling call
0709 13:00:30.250397 (+ 20885us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:31.668960 (+1418563us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:32.786297 (+1117337us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b540031bd54. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:00:32.786483 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3073406208}
I20260709 13:00:32.790465  5032 consensus_queue.cc:1048] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 13:00:32.763595  5494 raft_consensus.cc:2749] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:00:32.827237  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:32.862133  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 65692.5us
I20260709 13:00:32.862947  1497 leader_election.cc:304] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:32.802471  2224 raft_consensus.cc:2393] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 8: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
W20260709 13:00:32.841509  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:32.864741  1532 raft_consensus.cc:1275] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:00:32.866107  1532 raft_consensus.cc:1240] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 9. Current term is 10. Ops: [7.8-9.9]
I20260709 13:00:32.843988  1672 raft_consensus.cc:2468] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 10.
I20260709 13:00:32.846997  1528 raft_consensus.cc:1275] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:00:32.849514  5463 log.cc:927] Time spent T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 1.039s	user 0.000s	sys 0.002s
I20260709 13:00:32.792533  1530 raft_consensus.cc:2468] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 9.
I20260709 13:00:32.868547  1528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43008 (request call id 2010) took 1177 ms. Trace:
W20260709 13:00:32.878847  5499 log.cc:927] Time spent T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.185s	user 0.000s	sys 0.001s
I20260709 13:00:32.880059  4912 leader_election.cc:290] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:32.881350  1497 leader_election.cc:304] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:32.888227  1529 raft_consensus.cc:1275] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:00:32.874912  1528 rpcz_store.cc:276] 0709 13:00:31.690705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.846332 (+1155627us) service_pool.cc:224] Handling call
0709 13:00:32.846645 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:32.868315 (+ 21670us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:32.868498 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:32.864568  5368 raft_consensus.cc:2749] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:00:32.902909  5369 leader_election.cc:290] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:00:32.917670  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 125144us
W20260709 13:00:32.935070  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 132593us
I20260709 13:00:32.911361  4867 raft_consensus.cc:2749] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:00:32.940448  1571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:32.914479  5351 leader_election.cc:290] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:32.879928  5041 consensus_queue.cc:1059] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 13:00:32.912539  5479 raft_consensus.cc:493] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
W20260709 13:00:32.941447  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 218309us
W20260709 13:00:32.944519  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 248784us
W20260709 13:00:32.949844  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 68613.1us
I20260709 13:00:32.950623  1497 leader_election.cc:304] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:32.930111  5371 raft_consensus.cc:493] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:32.931885  5482 leader_election.cc:290] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:32.799266  5291 consensus_queue.cc:237] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:32.992233  1497 leader_election.cc:400] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 election: Vote denied by peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303) with higher term. Message: Invalid argument: T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 8. Current term is 9.
W20260709 13:00:32.994218  5503 log.cc:927] Time spent T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.346s	user 0.001s	sys 0.000s
I20260709 13:00:32.995412  5513 consensus_queue.cc:1048] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.136s
I20260709 13:00:32.997496  5513 consensus_queue.cc:1048] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:32.997723  5488 raft_consensus.cc:515] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:32.998550  5509 raft_consensus.cc:2749] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:00:32.999357  5487 log.cc:927] Time spent T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.293s	user 0.001s	sys 0.000s
I20260709 13:00:32.999202  5238 raft_consensus.cc:515] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:00:33.000270  5501 log.cc:927] Time spent T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.205s	user 0.001s	sys 0.000s
I20260709 13:00:33.000370  1601 raft_consensus.cc:1240] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:33.001420  5514 raft_consensus.cc:493] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:33.002007  5514 raft_consensus.cc:515] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:33.004340  5514 leader_election.cc:290] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:00:33.005472  5510 log.cc:927] Time spent T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.138s	user 0.000s	sys 0.001s
W20260709 13:00:33.006733  5491 log.cc:927] Time spent T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.338s	user 0.001s	sys 0.000s
I20260709 13:00:33.014271  5238 leader_election.cc:290] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:32.959352  5371 raft_consensus.cc:515] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:33.021569  5371 leader_election.cc:290] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:33.023501  5488 leader_election.cc:290] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:00:33.025132  5506 log.cc:927] Time spent T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.227s	user 0.000s	sys 0.003s
W20260709 13:00:33.034173  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 94694.8us
I20260709 13:00:33.010376  5485 raft_consensus.cc:2749] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:00:33.049104  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 57045.9us
I20260709 13:00:33.051729  1497 leader_election.cc:304] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:33.059048  2190 leader_election.cc:304] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:33.062197  1497 leader_election.cc:304] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
W20260709 13:00:33.064482  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 114213us
I20260709 13:00:33.067016  1570 leader_election.cc:304] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:33.033505  4867 raft_consensus.cc:2764] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:00:32.953562  5479 raft_consensus.cc:515] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:33.076692  2190 leader_election.cc:304] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
W20260709 13:00:33.234148  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 172037us
W20260709 13:00:33.109855  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:33.178498  1495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:33.031864  5476 raft_consensus.cc:2749] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:33.177809  1531 raft_consensus.cc:2468] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 10.
I20260709 13:00:33.234619  1571 leader_election.cc:304] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:33.070113  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
W20260709 13:00:33.238377  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:33.187016  5512 raft_consensus.cc:493] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:33.074895  5522 log.cc:927] Time spent T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:00:33.211239  5122 leader_election.cc:290] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:33.080401  5520 raft_consensus.cc:2804] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:33.079767  5100 consensus_queue.cc:1048] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.179s
W20260709 13:00:33.246057  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 169434us
I20260709 13:00:33.246236  5364 raft_consensus.cc:2804] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:33.251606  5099 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:00:33.168673  5452 log.cc:927] Time spent T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 1.899s	user 0.004s	sys 0.006s
I20260709 13:00:33.278258  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:33.284494  1526 raft_consensus.cc:3060] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:33.259336  5377 raft_consensus.cc:3060] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:33.065995  5509 raft_consensus.cc:2749] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:33.047269  5351 consensus_queue.cc:1048] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.196s
W20260709 13:00:33.264081  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:33.271739  5364 raft_consensus.cc:493] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:33.287963  5364 raft_consensus.cc:3060] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:33.292094  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:33.268215  5520 raft_consensus.cc:493] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:33.293576  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:33.267167  5482 raft_consensus.cc:2749] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:00:33.075031  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 122742us
I20260709 13:00:33.294569  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:33.307958  1681 raft_consensus.cc:3060] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:33.309401  1674 raft_consensus.cc:1275] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:00:33.292729  5520 raft_consensus.cc:3060] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:33.311923  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:33.312484  1678 raft_consensus.cc:3060] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:33.268625  5530 raft_consensus.cc:493] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:33.315012  5530 raft_consensus.cc:515] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:33.317773  5530 leader_election.cc:290] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:33.322111  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:00:33.266440  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 199526us
I20260709 13:00:33.043239  5439 raft_consensus.cc:515] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:33.087574  5387 raft_consensus.cc:493] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:33.050115  5514 consensus_queue.cc:1048] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.214s
I20260709 13:00:33.272918  1523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43008 (request call id 2021) took 1133 ms. Trace:
W20260709 13:00:33.273401  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 222281us
I20260709 13:00:33.274075  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:33.065872  5065 consensus_queue.cc:1048] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.202s
W20260709 13:00:33.280383  2190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:33.273537  1603 raft_consensus.cc:1240] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:33.083285  5527 consensus_queue.cc:1048] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.222s
W20260709 13:00:33.134799  5528 log.cc:927] Time spent T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:00:33.276121  5360 raft_consensus.cc:493] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:33.293125  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:33.350068  1646 leader_election.cc:304] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:33.292722  1677 raft_consensus.cc:3060] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:33.324821  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:33.167600  5373 raft_consensus.cc:2749] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:33.330780  2191 leader_election.cc:304] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:33.280166  5511 raft_consensus.cc:493] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:33.332732  1570 leader_election.cc:304] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:00:33.334704  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 57294.3us
I20260709 13:00:33.337584  1681 raft_consensus.cc:2468] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 10.
I20260709 13:00:33.338356  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:33.292007  5479 leader_election.cc:290] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:33.276741  5533 raft_consensus.cc:2804] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:33.336433  1523 rpcz_store.cc:276] 0709 13:00:32.134889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.135936 (+  1047us) service_pool.cc:224] Handling call
0709 13:00:33.070050 (+934114us) spinlock_profiling.cc:243] Waited 956 us on lock 0x7b5c0007c08c. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1bf1d161 00007f6a1c0bea79 00007f6a1d5789b6 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:33.267900 (+197850us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2199808}
I20260709 13:00:33.357621  1677 raft_consensus.cc:2468] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 11.
I20260709 13:00:33.383749  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 13:00:33.384356  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 53704.2us
I20260709 13:00:33.384658  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:33.385185  5447 raft_consensus.cc:3055] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:33.385614  5447 raft_consensus.cc:740] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:33.345563  5438 raft_consensus.cc:493] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:33.386793  5438 raft_consensus.cc:515] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:33.387527  1496 leader_election.cc:304] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:33.388725  5438 leader_election.cc:290] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:33.389691  5511 raft_consensus.cc:515] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:33.390353  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:33.373365  1600 raft_consensus.cc:2468] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 10.
I20260709 13:00:33.392657  1497 leader_election.cc:304] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
W20260709 13:00:33.394609  5529 log.cc:927] Time spent T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.167s	user 0.000s	sys 0.000s
I20260709 13:00:33.395926  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:33.396517  1525 raft_consensus.cc:2376] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 9. Re-sending same reply.
W20260709 13:00:33.396978  1525 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43008 (request call id 2016) took 1643 ms (client timeout 2082 ms). Trace:
W20260709 13:00:33.397317  1525 rpcz_store.cc:269] 0709 13:00:31.753470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:33.395666 (+1642196us) service_pool.cc:224] Handling call
0709 13:00:33.396926 (+  1260us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:33.398307  1525 raft_consensus.cc:3055] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:33.359054  5099 raft_consensus.cc:493] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:33.400043  5099 raft_consensus.cc:515] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:33.401577  5474 raft_consensus.cc:493] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:33.402120  5099 leader_election.cc:290] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:33.402091  5474 raft_consensus.cc:515] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:33.403623  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 79213.6us
I20260709 13:00:33.404306  5474 leader_election.cc:290] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:33.404362  1570 leader_election.cc:304] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:33.405622  1570 leader_election.cc:304] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:33.406162  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:33.406776  2223 raft_consensus.cc:1240] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 9 LEADER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:00:33.407298  1570 leader_election.cc:304] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:33.408331  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:33.410115  1677 raft_consensus.cc:1240] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:33.357913  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:33.411156  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:33.374485  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:33.398588  1525 raft_consensus.cc:740] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:00:33.378441  1532 raft_consensus.cc:1240] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 LEADER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:00:33.372915  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:33.413071  1524 raft_consensus.cc:2468] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 7.
I20260709 13:00:33.384406  2220 raft_consensus.cc:2468] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 9.
I20260709 13:00:33.390502  1679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49178 (request call id 1907) took 1673 ms. Trace:
I20260709 13:00:33.414806  1679 rpcz_store.cc:276] 0709 13:00:31.717494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.727521 (+ 10027us) service_pool.cc:224] Handling call
0709 13:00:33.390310 (+1662789us) spinlock_profiling.cc:243] Waited 282 ms on lock 0x7b5400179154. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:33.390432 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":649647872}
I20260709 13:00:33.374490  1571 leader_election.cc:304] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:33.416128  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:33.408958  1674 raft_consensus.cc:2468] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 8.
I20260709 13:00:33.343281  5100 raft_consensus.cc:493] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:33.412099  1598 raft_consensus.cc:2468] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 11.
I20260709 13:00:33.421239  1678 raft_consensus.cc:2468] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 10.
I20260709 13:00:33.422343  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:33.422061  1496 leader_election.cc:304] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:33.335872  5482 consensus_queue.cc:1048] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.085s
W20260709 13:00:33.427589  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 53183.8us
I20260709 13:00:33.378374  5535 raft_consensus.cc:2749] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:33.269163  5512 raft_consensus.cc:515] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:33.428864  1646 leader_election.cc:304] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:33.432075  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 13:00:33.434371  1571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:33.427982  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:33.428195  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:33.384425  5405 raft_consensus.cc:2749] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:33.433563  1525 consensus_queue.cc:260] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:33.467991  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 13:00:33.427384  5518 log.cc:927] Time spent T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.363s	user 0.001s	sys 0.000s
I20260709 13:00:33.440311  2224 raft_consensus.cc:2376] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 6. Re-sending same reply.
I20260709 13:00:33.469058  5488 consensus_queue.cc:1059] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:33.469544  2223 raft_consensus.cc:2468] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 8.
I20260709 13:00:33.469700  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:33.424469  5122 raft_consensus.cc:2749] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:33.424778  5533 raft_consensus.cc:697] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 10 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:33.470497  5479 raft_consensus.cc:493] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:33.496753  5479 raft_consensus.cc:515] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:33.497956  1528 raft_consensus.cc:1275] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:00:33.498801  5479 leader_election.cc:290] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:33.426409  5440 consensus_queue.cc:1048] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:00:33.470777  1678 raft_consensus.cc:1275] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:00:33.471303  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 49322us
I20260709 13:00:33.473219  5532 consensus_queue.cc:1048] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:33.503078  2190 leader_election.cc:304] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:33.505004  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:33.505692  5041 raft_consensus.cc:2804] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:33.505853  1678 raft_consensus.cc:2410] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:00:33.506155  5041 raft_consensus.cc:493] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:33.507678  5369 consensus_queue.cc:1048] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:33.475788  5439 leader_election.cc:290] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:33.492136  5488 consensus_queue.cc:1243] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer b96ce9cc496c49d7818fa983a17b062b log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:00:33.506538  5041 raft_consensus.cc:3060] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:33.513741  5507 log.cc:927] Time spent T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.799s	user 0.001s	sys 0.003s
I20260709 13:00:33.515928  5511 leader_election.cc:290] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:33.477950  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
W20260709 13:00:33.517545  5508 log.cc:927] Time spent T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:00:33.517750  2220 raft_consensus.cc:3060] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:00:33.408733  5496 consensus_queue.cc:1059] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.075s
I20260709 13:00:33.377966  5360 raft_consensus.cc:515] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:33.520097  5512 leader_election.cc:290] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:33.520886  2226 raft_consensus.cc:1275] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:00:33.521330  5360 leader_election.cc:290] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:33.343127  5387 raft_consensus.cc:515] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:33.493525  5335 raft_consensus.cc:2749] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:33.386458  5447 consensus_queue.cc:260] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:33.523236  5387 leader_election.cc:290] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:33.434954  5438 consensus_queue.cc:1048] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.089s
I20260709 13:00:33.481413  5509 raft_consensus.cc:2749] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:33.525352  5291 raft_consensus.cc:2804] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:33.525791  5291 raft_consensus.cc:493] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:33.526170  5291 raft_consensus.cc:3060] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:33.527202  5041 raft_consensus.cc:515] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:33.529386  5041 leader_election.cc:290] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:33.529434  1675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49170 (request call id 2067) took 1110 ms. Trace:
I20260709 13:00:33.530428  5479 raft_consensus.cc:493] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:33.529999  1675 rpcz_store.cc:276] 0709 13:00:32.418768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.438928 (+ 20160us) service_pool.cc:224] Handling call
0709 13:00:32.448393 (+  9465us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:32.884219 (+435826us) spinlock_profiling.cc:243] Waited 4.58 ms on lock 0x7b4800041ad8. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1d4dcaa1 00007f6a1d4d3b37 00007f6a1d4d39ca 00007f6a1d5cb26f 00007f6a1d5caf37 00007f6a1d5df55c 00007f6a1d5df508 00007f6a1d5df488 00007f6a1d5df443 00007f6a1d5de6ec 00007f6a1c508a96
0709 13:00:32.920076 (+ 35857us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:32.920109 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:32.946829 (+ 26720us) log.cc:844] Serialized 26 byte log entry
0709 13:00:33.282749 (+335920us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:33.282783 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:33.322809 (+ 40026us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:33.529152 (+206343us) raft_consensus.cc:1685] finished
0709 13:00:33.529172 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:33.529379 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27318,"raft.queue_time_us":48400,"raft.run_cpu_time_us":2078,"raft.run_wall_time_us":383512,"spinlock_wait_cycles":10538240,"thread_start_us":743606,"threads_started":2,"wal-append.queue_time_us":356435}
I20260709 13:00:33.531384  5479 raft_consensus.cc:515] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:33.433164  5330 consensus_queue.cc:1048] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.099s
I20260709 13:00:33.482841  1525 raft_consensus.cc:3060] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:33.533376  5479 leader_election.cc:290] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:33.534993  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:33.481595  2191 leader_election.cc:304] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:33.419555  5513 raft_consensus.cc:2749] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:33.536336  5377 raft_consensus.cc:2749] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:00:33.536178  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 54684.1us
I20260709 13:00:33.465649  5476 raft_consensus.cc:2804] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:33.489392  1571 leader_election.cc:304] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:33.424548  5296 raft_consensus.cc:2749] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:00:33.491011  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 62274.7us
I20260709 13:00:33.431514  5373 raft_consensus.cc:2804] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:00:33.566926  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 80193.2us
I20260709 13:00:33.495801  5533 consensus_queue.cc:237] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:33.470269  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:33.570008  1526 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 12.
I20260709 13:00:33.570367  1524 raft_consensus.cc:2410] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:00:33.529564  1527 raft_consensus.cc:1275] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:00:33.541200  1525 raft_consensus.cc:1275] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:00:33.541479  1572 leader_election.cc:304] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:33.543128  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:33.543792  1523 raft_consensus.cc:2468] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 6.
I20260709 13:00:33.545425  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:33.430073  5100 raft_consensus.cc:515] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:33.546175  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:33.546926  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:33.439881  1570 leader_election.cc:304] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:33.575269  2226 raft_consensus.cc:2410] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for term 11 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:00:33.539745  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:33.576288  1528 raft_consensus.cc:3060] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:00:33.558490  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
W20260709 13:00:33.493916  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 101321us
I20260709 13:00:33.576574  1572 leader_election.cc:304] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:33.576917  1679 raft_consensus.cc:3060] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:33.577204  1497 leader_election.cc:304] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:33.559793  1646 leader_election.cc:304] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:33.572201  1673 raft_consensus.cc:2468] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 6.
I20260709 13:00:33.573215  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:33.578140  1674 raft_consensus.cc:2468] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 10.
I20260709 13:00:33.574820  1678 raft_consensus.cc:1275] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 13:00:33.578861  1678 pending_rounds.cc:85] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90: Aborting all ops after (but not including) 7
I20260709 13:00:33.578735  2191 leader_election.cc:304] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:33.579150  1678 pending_rounds.cc:107] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:00:33.579399  1678 raft_consensus.cc:2889] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:33.424371  5531 raft_consensus.cc:2749] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:00:33.581002  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:00:33.581730  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 141968us
I20260709 13:00:33.583542  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:33.587191  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:33.587911  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:33.588387  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:33.588949  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:33.589967  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:33.589165  1600 raft_consensus.cc:2410] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:00:33.594273  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:33.596925  1599 raft_consensus.cc:2393] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 7: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:00:33.579679  1571 leader_election.cc:304] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
W20260709 13:00:33.559212  5378 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.764s	user 0.015s	sys 0.010s
I20260709 13:00:33.510305  5364 raft_consensus.cc:515] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:33.606372  1497 leader_election.cc:400] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 election: Vote denied by peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303) with higher term. Message: Invalid argument: T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 9. Current term is 10.
I20260709 13:00:33.627149  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:00:33.620162  1571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:33.604485  1679 raft_consensus.cc:2468] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 9.
I20260709 13:00:33.635110  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:00:33.691247  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 85027.5us
I20260709 13:00:33.691720  1598 raft_consensus.cc:2393] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 9: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:00:33.692063  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:33.692258  1644 leader_election.cc:304] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:00:33.692526  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:33.635676  2221 raft_consensus.cc:2468] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 9.
I20260709 13:00:33.570823  5476 raft_consensus.cc:697] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 10 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:33.638417  1603 raft_consensus.cc:2468] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 10.
I20260709 13:00:33.632459  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:33.693137  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:33.693737  1599 raft_consensus.cc:2468] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 8.
W20260709 13:00:33.688160  5490 log.cc:927] Time spent T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:00:33.694162  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:33.693941  5476 consensus_queue.cc:237] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:33.643728  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 801) took 1945 ms. Trace:
I20260709 13:00:33.697669  1602 rpcz_store.cc:276] 0709 13:00:31.694030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.694134 (+   104us) service_pool.cc:224] Handling call
0709 13:00:31.694437 (+   303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:31.734847 (+ 40410us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:31.734876 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:31.742216 (+  7340us) log.cc:844] Serialized 26 byte log entry
0709 13:00:31.833502 (+ 91286us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:32.184667 (+351165us) log.cc:844] Serialized 14 byte log entry
0709 13:00:32.184862 (+   195us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:32.882129 (+697267us) spinlock_profiling.cc:243] Waited 14.2 ms on lock 0x7b1800387a60. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1e38ede1 00007f6a1e39b5b1 00007f6a154c63f3 00007f6a154c87c1 00007f6a154c8779 00007f6a154c8709 00007f6a154c86d1 00007f6a154c79cd 000000000038f354 000000000038f199 00007f6a154a983a
0709 13:00:33.634829 (+752700us) spinlock_profiling.cc:243] Waited 40.2 ms on lock 0x7b54000daa54. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:00:33.634891 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:33.634936 (+    45us) raft_consensus.cc:1685] finished
0709 13:00:33.634947 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:33.638861 (+  3914us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":996,"prepare.queue_time_us":17437,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":26670,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":5353,"spinlock_wait_cycles":124913152,"thread_start_us":320439,"threads_started":2,"wal-append.queue_time_us":324489,"wal-append.run_cpu_time_us":3479,"wal-append.run_wall_time_us":1239076}
I20260709 13:00:33.559271  5407 consensus_queue.cc:1059] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.073s
I20260709 13:00:33.595626  5373 raft_consensus.cc:697] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:00:33.699857  5514 raft_consensus.cc:3055] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:33.582062  5512 raft_consensus.cc:2804] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:33.700242  5514 raft_consensus.cc:740] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:33.700690  5512 raft_consensus.cc:697] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 10 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:33.701200  5514 consensus_queue.cc:260] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:33.701575  5512 consensus_queue.cc:237] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:33.702239  1497 leader_election.cc:304] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:33.702450  5514 raft_consensus.cc:3060] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:33.703708  1497 leader_election.cc:304] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:33.703908  5389 raft_consensus.cc:3060] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:33.701570  1602 raft_consensus.cc:1240] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:00:33.712200  1527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43010 (request call id 2121) took 1156 ms. Trace:
I20260709 13:00:33.712725  1527 rpcz_store.cc:276] 0709 13:00:32.555689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.873737 (+318048us) service_pool.cc:224] Handling call
0709 13:00:33.529251 (+655514us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:33.570805 (+ 41554us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:33.711953 (+141148us) spinlock_profiling.cc:243] Waited 614 ms on lock 0x7b540002bf50. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b28ad 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:33.712121 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1412013952}
I20260709 13:00:33.699363  5494 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:33.700311  5373 consensus_queue.cc:237] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:33.714694  5494 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:33.721873  4867 raft_consensus.cc:2749] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:33.727481  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:00:33.730880  2192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:33.733332  5493 consensus_queue.cc:1048] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:00:33.647709  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 47039.2us
W20260709 13:00:33.640734  5538 log.cc:927] Time spent T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
W20260709 13:00:33.604151  5378 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.819s	user 0.016s	sys 0.010s
I20260709 13:00:33.576781  5041 consensus_queue.cc:1059] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.065s
I20260709 13:00:33.737911  5041 consensus_queue.cc:1243] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 log is divergent from this leader: its last log entry 12.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:00:33.602830  5488 raft_consensus.cc:2804] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:33.738549  5488 raft_consensus.cc:493] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:33.739024  5488 raft_consensus.cc:3060] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:33.608002  5513 raft_consensus.cc:2804] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:33.740368  5513 raft_consensus.cc:493] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:33.740842  5513 raft_consensus.cc:3060] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:33.595112  5110 raft_consensus.cc:2749] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:33.608264  5369 raft_consensus.cc:493] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:33.602545  5532 raft_consensus.cc:2749] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:33.743202  5369 raft_consensus.cc:515] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:33.748088  5378 consensus_queue.cc:1048] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:00:33.754768  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:33.755653  2191 leader_election.cc:304] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:33.756544  5041 consensus_queue.cc:1048] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:33.758268  5041 raft_consensus.cc:2804] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:33.758837  5041 raft_consensus.cc:697] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 9 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:33.759855  5041 consensus_queue.cc:237] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:33.765956  4867 raft_consensus.cc:2764] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:00:33.770251  1603 pending_rounds.cc:85] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642: Aborting all ops after (but not including) 9
I20260709 13:00:33.770620  1603 pending_rounds.cc:107] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 13:00:33.770897  1603 raft_consensus.cc:2889] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:33.778888  1680 raft_consensus.cc:1240] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:00:33.689307  2227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50326 (request call id 870) took 1211 ms. Trace:
I20260709 13:00:33.700064  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:33.783684  2227 rpcz_store.cc:276] 0709 13:00:32.477964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.478072 (+   108us) service_pool.cc:224] Handling call
0709 13:00:32.478298 (+   226us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:32.720728 (+242430us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:32.720762 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:32.720805 (+    43us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:32.720837 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:33.649778 (+928941us) spinlock_profiling.cc:243] Waited 242 ms on lock 0x7b540069fd54. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:00:33.689099 (+ 39321us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:33.689249 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":557086592}
I20260709 13:00:33.634233  5534 raft_consensus.cc:2804] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:33.569674  5387 consensus_queue.cc:1048] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.079s
I20260709 13:00:33.638136  5509 raft_consensus.cc:2749] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:33.645957  5093 raft_consensus.cc:3055] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:00:33.796483  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 236785us
W20260709 13:00:33.796818  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 104645us
W20260709 13:00:33.814796  1644 leader_election.cc:336] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.518s (SENT)
I20260709 13:00:33.815268  1644 leader_election.cc:304] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:00:33.690330  5540 log.cc:927] Time spent T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:00:33.804936  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36200 (request call id 2261) took 1097 ms. Trace:
I20260709 13:00:33.819977  1601 rpcz_store.cc:276] 0709 13:00:32.707518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.714289 (+  6771us) service_pool.cc:224] Handling call
0709 13:00:32.714637 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:33.000838 (+286201us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:33.804663 (+803825us) spinlock_profiling.cc:243] Waited 277 ms on lock 0x7b54002ec054. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:00:33.804864 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":636694400}
I20260709 13:00:33.689457  5032 raft_consensus.cc:3055] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:33.820971  1646 leader_election.cc:304] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:33.641955  5520 raft_consensus.cc:515] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:33.829572  2218 raft_consensus.cc:1240] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:33.797843  5534 raft_consensus.cc:493] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:33.832580  2220 raft_consensus.cc:2468] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 10.
I20260709 13:00:33.812371  5535 raft_consensus.cc:2804] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:33.811822  5330 raft_consensus.cc:2804] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:33.838167  1646 leader_election.cc:304] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
W20260709 13:00:33.905918  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 67850.2us
I20260709 13:00:33.815093  5093 raft_consensus.cc:740] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:33.908624  1646 leader_election.cc:304] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
W20260709 13:00:33.910008  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:33.822942  5032 raft_consensus.cc:740] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
W20260709 13:00:33.926472  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 229635us
I20260709 13:00:33.833447  5500 raft_consensus.cc:2749] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:33.837328  5534 raft_consensus.cc:3060] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:33.851317  5330 raft_consensus.cc:493] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:33.851164  5535 raft_consensus.cc:493] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:33.851766  5383 raft_consensus.cc:2804] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:33.950680  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:33.912004  5331 raft_consensus.cc:2764] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
W20260709 13:00:33.981072  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:34.009087  5494 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:34.008767  5032 consensus_queue.cc:260] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:33.833827  5336 consensus_queue.cc:1048] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.118s
I20260709 13:00:33.939342  5335 raft_consensus.cc:2804] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:34.016383  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:33.963385  5360 raft_consensus.cc:493] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:33.967710  5330 raft_consensus.cc:3060] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:34.037734  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 205773us
W20260709 13:00:34.053825  1644 leader_election.cc:336] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.676s (SENT)
I20260709 13:00:34.054337  1644 leader_election.cc:304] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:33.944689  5439 consensus_queue.cc:1059] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.084s
I20260709 13:00:34.012478  5535 raft_consensus.cc:3060] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:34.019872  5335 raft_consensus.cc:493] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:00:34.018433  5479 raft_consensus.cc:493] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:34.082239  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 378604us
I20260709 13:00:34.086182  1497 leader_election.cc:304] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:34.089529  1497 leader_election.cc:304] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:34.032052  5383 raft_consensus.cc:697] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 6 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:34.053865  5369 leader_election.cc:290] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:34.078015  5335 raft_consensus.cc:3060] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:34.094218  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:34.102949  1532 raft_consensus.cc:3060] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:34.098030  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 44255.7us
W20260709 13:00:34.107563  1644 leader_election.cc:336] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.686s (SENT)
I20260709 13:00:34.107995  1644 leader_election.cc:304] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:34.099933  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:34.100446  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:34.109148  1523 raft_consensus.cc:3060] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:34.109167  1526 raft_consensus.cc:3060] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:34.102744  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:34.111120  1527 raft_consensus.cc:2468] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 12.
I20260709 13:00:34.035349  5496 consensus_queue.cc:1059] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 13:00:34.118479  1526 raft_consensus.cc:2468] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 9.
I20260709 13:00:34.119282  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:34.128171  1527 raft_consensus.cc:2393] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 7: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:00:34.129042  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:34.129629  1527 raft_consensus.cc:3060] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:34.128190  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 13:00:34.123257  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:34.143288  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:34.144359  1525 raft_consensus.cc:2393] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 6: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
W20260709 13:00:34.084472  5505 consensus_queue.cc:1175] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" responder_term: 5 status { last_received { term: 5 index: 7 } last_committed_idx: 7 last_received_current_leader { term: 5 index: 7 } }
I20260709 13:00:34.157107  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:34.070580  5360 raft_consensus.cc:515] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:34.165241  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 57720.5us
I20260709 13:00:34.113657  5438 raft_consensus.cc:3055] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:34.099052  5485 raft_consensus.cc:2749] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:00:34.160521  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 224181us
I20260709 13:00:34.120028  4867 raft_consensus.cc:493] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:34.165973  1644 leader_election.cc:336] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.689s (SENT)
W20260709 13:00:34.186524  1644 leader_election.cc:336] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.717s (SENT)
I20260709 13:00:34.091899  5479 raft_consensus.cc:515] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:34.109717  5439 raft_consensus.cc:2749] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:34.170775  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:34.191445  1524 raft_consensus.cc:2410] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:00:34.173242  1527 raft_consensus.cc:2468] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 12.
I20260709 13:00:34.171125  1532 raft_consensus.cc:2468] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 10.
I20260709 13:00:34.166312  5336 raft_consensus.cc:3055] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:00:34.119170  5539 log.cc:927] Time spent T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.430s	user 0.001s	sys 0.000s
I20260709 13:00:34.183200  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:34.210978  1525 raft_consensus.cc:2410] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:00:34.158278  1526 raft_consensus.cc:2468] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 14.
I20260709 13:00:34.129351  5553 raft_consensus.cc:493] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:34.195230  1644 leader_election.cc:336] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.651s (SENT)
I20260709 13:00:34.209815  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:34.216180  1527 raft_consensus.cc:2376] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 7. Re-sending same reply.
I20260709 13:00:34.172909  5438 raft_consensus.cc:740] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:34.209024  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
W20260709 13:00:34.212460  1528 consensus_meta.cc:287] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent flushing consensus metadata: real 0.630s	user 0.008s	sys 0.000s
W20260709 13:00:34.222795  5549 log.cc:927] Time spent T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.311s	user 0.000s	sys 0.001s
W20260709 13:00:34.223150  5536 log.cc:927] Time spent T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:00:34.199851  5336 raft_consensus.cc:740] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:34.205654  1523 raft_consensus.cc:2468] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 7.
I20260709 13:00:34.188962  5520 leader_election.cc:290] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:34.221403  5093 consensus_queue.cc:260] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:34.225579  5541 log.cc:927] Time spent T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.372s	user 0.000s	sys 0.001s
W20260709 13:00:34.214548  1644 leader_election.cc:336] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.766s (SENT)
W20260709 13:00:34.593734  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 379239us
W20260709 13:00:34.594441  1644 leader_election.cc:336] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.665s (SENT)
W20260709 13:00:34.595273  1644 leader_election.cc:336] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.974s (SENT)
I20260709 13:00:34.595631  1644 leader_election.cc:304] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:00:34.596616  5575 log.cc:927] Time spent T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.168s	user 0.000s	sys 0.000s
I20260709 13:00:34.597151  5470 raft_consensus.cc:2749] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:00:34.261582  2192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:34.261724  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:34.242736  1528 raft_consensus.cc:2468] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 9.
W20260709 13:00:34.337261  1570 leader_election.cc:336] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 2.082s (SENT)
W20260709 13:00:34.631318  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 89276.9us
I20260709 13:00:34.599488  2192 leader_election.cc:304] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:34.579526  2218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50310 (request call id 772) took 1178 ms. Trace:
I20260709 13:00:35.041219  5587 raft_consensus.cc:493] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:36.836799  5587 raft_consensus.cc:515] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:35.078984  5588 raft_consensus.cc:493] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:36.839233  5587 leader_election.cc:290] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:35.119760  5589 raft_consensus.cc:493] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
W20260709 13:00:34.458626  1497 leader_election.cc:336] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Timed out: RequestConsensusVote RPC to 127.0.107.194:40303 timed out after 1.521s (SENT)
W20260709 13:00:34.875154  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:35.097415  1428 catalog_manager.cc:5697] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 4 to 7, leader changed from 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 7 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } }
W20260709 13:00:35.079442  1496 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.751s	user 0.013s	sys 0.006s
I20260709 13:00:36.875579  1428 catalog_manager.cc:5697] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 6 to 9, leader changed from e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) to 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194). New cstate: current_term: 9 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:34.366171  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 13:00:36.880396  1524 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43010 (request call id 2125) took 2644 ms (client timeout 1692 ms). Trace:
W20260709 13:00:36.880764  1524 rpcz_store.cc:269] 0709 13:00:34.235522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:34.327342 (+ 91820us) service_pool.cc:224] Handling call
0709 13:00:36.880291 (+2552949us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:34.367374  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:36.883579  1525 raft_consensus.cc:3060] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:35.101310  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 13:00:35.049742  1528 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49310 (request call id 868) took 1514 ms (client timeout 1891 ms). Trace:
W20260709 13:00:36.889881  1528 rpcz_store.cc:269] 0709 13:00:33.535481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:33.539515 (+  4034us) service_pool.cc:224] Handling call
0709 13:00:35.049653 (+1510138us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:35.017584  1532 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.617s	user 0.018s	sys 0.000s
W20260709 13:00:36.905668  1532 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.506s	user 0.021s	sys 0.000s
I20260709 13:00:34.696518  1598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 816) took 1007 ms. Trace:
I20260709 13:00:35.049026  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:35.003924  1602 raft_consensus.cc:1240] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 10 LEADER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:36.911129  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36194 (request call id 1706) took 3325 ms. Trace:
I20260709 13:00:36.911470  1602 rpcz_store.cc:276] 0709 13:00:33.586089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:33.705471 (+119382us) service_pool.cc:224] Handling call
0709 13:00:33.705868 (+   397us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:35.003747 (+1297879us) spinlock_profiling.cc:243] Waited 88.3 ms on lock 0x7b540029b420. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a1852adc0 00007f6a185b51c0 00007f6a185b6231 00007f6a185b2d8f 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c
0709 13:00:36.910835 (+1907088us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:36.911048 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":202987392}
I20260709 13:00:35.021586  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36194 (request call id 1696) took 1437 ms. Trace:
I20260709 13:00:34.391554  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36200 (request call id 2266) took 1052 ms. Trace:
I20260709 13:00:36.914109  1607 rpcz_store.cc:276] 0709 13:00:33.339324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:33.339427 (+   103us) service_pool.cc:224] Handling call
0709 13:00:33.339738 (+   311us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:33.345312 (+  5574us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:33.345339 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:33.363905 (+ 18566us) log.cc:844] Serialized 52 byte log entry
0709 13:00:33.496002 (+132097us) spinlock_profiling.cc:243] Waited 6.36 ms on lock 0x7b48001e0258. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1d4dcaa1 00007f6a1d4d3b37 00007f6a1d4d39ca 00007f6a1d5cb26f 00007f6a1d5caf37 00007f6a1d5df55c 00007f6a1d5df508 00007f6a1d5df488 00007f6a1d5df443 00007f6a1d5de6ec 00007f6a1c508a96
0709 13:00:33.580000 (+ 83998us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:00:33.580044 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:33.580113 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:34.385820 (+805707us) spinlock_profiling.cc:243] Waited 6.38 ms on lock 0x7b240019b548. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a1534c9c4 00007f6a1534aacb 00007f6a15505dc9 00007f6a15505a55 00007f6a15504fb0 00007f6a1817b488 00007f6a1817bbe8 00007f6a18153398 00007f6a1814e76a 00007f6a1814dbb6
0709 13:00:34.391296 (+  5476us) raft_consensus.cc:1685] finished
0709 13:00:34.391319 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:34.391487 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5932,"raft.run_cpu_time_us":841,"raft.run_wall_time_us":147138,"spinlock_wait_cycles":29304576,"thread_start_us":199305,"threads_started":1,"wal-append.queue_time_us":434360,"wal-append.run_cpu_time_us":6560,"wal-append.run_wall_time_us":1567186}
W20260709 13:00:36.916024  1607 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 834) took 2794 ms (client timeout 1873 ms). Trace:
W20260709 13:00:36.916383  1607 rpcz_store.cc:269] 0709 13:00:34.122055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:36.915842 (+2793787us) service_pool.cc:211] Skipping call since client already timed out
0709 13:00:36.915964 (+   122us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:00:36.917222  1607 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 835) took 2658 ms (client timeout 2008 ms). Trace:
W20260709 13:00:36.917518  1607 rpcz_store.cc:269] 0709 13:00:34.258996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:36.917077 (+2658081us) service_pool.cc:211] Skipping call since client already timed out
0709 13:00:36.917175 (+    98us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:00:36.918219  1607 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 831) took 2797 ms (client timeout 2211 ms). Trace:
I20260709 13:00:34.599802  1644 leader_election.cc:304] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:00:36.920989  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 2.32127e+06us
I20260709 13:00:36.921692  1644 leader_election.cc:304] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
W20260709 13:00:34.417057  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:35.084676  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:34.258239  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:00:36.607605  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:36.626451  1531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49310 (request call id 864) took 3116 ms. Trace:
I20260709 13:00:36.665303  1419 maintenance_manager.cc:419] P 9f38d0e5c9db43a48554defe1153354e: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033735
W20260709 13:00:36.707823  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 2.37114e+06us
I20260709 13:00:36.729076  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49310 (request call id 855) took 3367 ms. Trace:
I20260709 13:00:36.927068  1570 leader_election.cc:304] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:36.925899  1529 rpcz_store.cc:276] 0709 13:00:33.362049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:33.362513 (+   464us) service_pool.cc:224] Handling call
0709 13:00:33.362877 (+   364us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:33.363236 (+   359us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:33.363262 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:33.379092 (+ 15830us) log.cc:844] Serialized 52 byte log entry
0709 13:00:33.573934 (+194842us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:33.645931 (+ 71997us) log.cc:844] Serialized 14 byte log entry
0709 13:00:33.646150 (+   219us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:33.646223 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:34.813054 (+1166831us) spinlock_profiling.cc:243] Waited 13.8 ms on lock 0x7b180001ab00. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1e38ede1 00007f6a1e39b5b1 00007f6a154c63f3 00007f6a154c87c1 00007f6a154c8779 00007f6a154c8709 00007f6a154c86d1 00007f6a154c79cd 000000000038f354 000000000038f199 00007f6a154a983a
0709 13:00:36.728702 (+1915648us) raft_consensus.cc:1685] finished
0709 13:00:36.728821 (+   119us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:36.729011 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26461,"prepare.queue_time_us":277638,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":43575,"raft.run_cpu_time_us":238,"raft.run_wall_time_us":14923,"spinlock_wait_cycles":31769856,"thread_start_us":121838,"threads_started":2,"wal-append.queue_time_us":372419,"wal-append.run_cpu_time_us":4315,"wal-append.run_wall_time_us":1003168}
I20260709 13:00:36.733671  1527 raft_consensus.cc:1217] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Deduplicated request from leader. Original: 5.7->[7.8-8.9]   Dedup: 7.8->[8.9-8.9]
I20260709 13:00:36.925153  1531 rpcz_store.cc:276] 0709 13:00:33.509891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:33.523305 (+ 13414us) service_pool.cc:224] Handling call
0709 13:00:33.523636 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:33.523997 (+   361us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:00:33.524256 (+   259us) log.cc:844] Serialized 14 byte log entry
0709 13:00:33.720902 (+196646us) spinlock_profiling.cc:243] Waited 3.82 ms on lock 0x7b1800041560. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1e38ede1 00007f6a1e39b5b1 00007f6a154c6522 00007f6a154c87c1 00007f6a154c8779 00007f6a154c8709 00007f6a154c86d1 00007f6a154c79cd 000000000038f354 000000000038f199 00007f6a154a983a
0709 13:00:33.784755 (+ 63853us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:33.785289 (+   534us) log.cc:844] Serialized 26 byte log entry
0709 13:00:33.785428 (+   139us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:33.785464 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:33.785535 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:36.626069 (+2840534us) raft_consensus.cc:1685] finished
0709 13:00:36.626181 (+   112us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:36.626372 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25303,"prepare.queue_time_us":508,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":29,"raft.queue_time_us":53146,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":5057,"spinlock_wait_cycles":8794496,"thread_start_us":234706,"threads_started":2,"wal-append.queue_time_us":119276,"wal-append.run_cpu_time_us":21934,"wal-append.run_wall_time_us":1933730}
I20260709 13:00:34.430675  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 13:00:36.931632  2220 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50326 (request call id 878) took 2501 ms (client timeout 1930 ms). Trace:
W20260709 13:00:36.932040  2220 rpcz_store.cc:269] 0709 13:00:34.430264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:34.430391 (+   127us) service_pool.cc:224] Handling call
0709 13:00:36.931562 (+2501171us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:34.439388  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:35.261417  2226 raft_consensus.cc:1275] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:00:36.934947  2226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50310 (request call id 784) took 1675 ms. Trace:
I20260709 13:00:36.935288  2226 rpcz_store.cc:276] 0709 13:00:35.259542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:35.260689 (+  1147us) service_pool.cc:224] Handling call
0709 13:00:35.261046 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:36.934625 (+1673579us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:36.934886 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:36.627094  5065 raft_consensus.cc:493] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:36.938746  5378 raft_consensus.cc:493] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.938923  5603 raft_consensus.cc:2804] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:36.637041  5100 leader_election.cc:290] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:34.831940  5364 leader_election.cc:290] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:34.821009  5368 raft_consensus.cc:493] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:36.714517  5373 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.892s	user 0.010s	sys 0.029s
I20260709 13:00:35.258782  2221 raft_consensus.cc:1240] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 9 LEADER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:00:36.944167  5500 raft_consensus.cc:2749] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:36.944355  2221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50310 (request call id 783) took 1688 ms. Trace:
I20260709 13:00:35.247172  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:36.945916  2224 raft_consensus.cc:2393] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 12: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:00:34.188575  4867 raft_consensus.cc:515] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:34.822564  5025 raft_consensus.cc:493] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:00:36.913323  1606 rpcz_store.cc:276] 0709 13:00:33.583978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:33.695035 (+111057us) service_pool.cc:224] Handling call
0709 13:00:33.695326 (+   291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:33.906977 (+211651us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:33.907005 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:33.945446 (+ 38441us) log.cc:844] Serialized 26 byte log entry
0709 13:00:34.329652 (+384206us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:34.346253 (+ 16601us) log.cc:844] Serialized 14 byte log entry
0709 13:00:34.347097 (+   844us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:34.347372 (+   275us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:35.021309 (+673937us) raft_consensus.cc:1685] finished
0709 13:00:35.021333 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:35.021515 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":15939,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":14637,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":170,"thread_start_us":488975,"threads_started":2,"wal-append.queue_time_us":564755,"wal-append.run_cpu_time_us":3909,"wal-append.run_wall_time_us":1026509}
I20260709 13:00:36.948212  5025 raft_consensus.cc:515] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:36.925151  1672 raft_consensus.cc:2468] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 10.
W20260709 13:00:36.949636  1672 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50664 (request call id 882) took 2915 ms (client timeout 1873 ms). Trace:
W20260709 13:00:36.949972  1672 rpcz_store.cc:269] 0709 13:00:34.034751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:34.189596 (+154845us) service_pool.cc:224] Handling call
0709 13:00:36.949539 (+2759943us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:36.701745  5032 raft_consensus.cc:3060] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:36.939311  5378 raft_consensus.cc:515] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:34.620028  5093 raft_consensus.cc:3060] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:36.944805  2221 rpcz_store.cc:276] 0709 13:00:35.256504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:35.258053 (+  1549us) service_pool.cc:224] Handling call
0709 13:00:35.258461 (+   408us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:36.944063 (+1685602us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:36.944294 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:34.532707  5291 consensus_meta.cc:287] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent flushing consensus metadata: real 0.991s	user 0.002s	sys 0.009s
I20260709 13:00:36.938289  5065 raft_consensus.cc:515] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:36.960194  5291 raft_consensus.cc:515] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:36.961702  5065 leader_election.cc:290] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:36.962267  5291 leader_election.cc:290] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:35.459599  5296 raft_consensus.cc:493] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:36.963466  5296 raft_consensus.cc:515] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:36.964355  1531 raft_consensus.cc:1240] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:00:36.965040  1531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43010 (request call id 2126) took 2729 ms. Trace:
I20260709 13:00:36.965513  5296 leader_election.cc:290] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:00:34.664347  5330 consensus_meta.cc:287] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.586s	user 0.007s	sys 0.003s
W20260709 13:00:34.628408  5335 consensus_meta.cc:287] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.524s	user 0.010s	sys 0.000s
I20260709 13:00:34.953713  5336 consensus_queue.cc:260] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:36.974473  5336 raft_consensus.cc:3060] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:34.604511  5360 leader_election.cc:290] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
W20260709 13:00:36.768113  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:34.217298  5383 consensus_queue.cc:237] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:34.572520  5389 consensus_meta.cc:287] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.868s	user 0.010s	sys 0.001s
I20260709 13:00:37.044287  5032 raft_consensus.cc:493] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.045639  5606 raft_consensus.cc:493] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:34.361792  5438 consensus_queue.cc:260] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:00:36.760891  2190 connection.cc:256] RPC call timeout handler was delayed by -1.5033924809999917s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18910000000000002s for a response
I20260709 13:00:34.237332  5439 raft_consensus.cc:493] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.041888  5383 raft_consensus.cc:493] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:34.582626  5447 raft_consensus.cc:3060] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:37.050488  5606 raft_consensus.cc:515] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:34.628218  5479 leader_election.cc:290] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:37.055935  5479 raft_consensus.cc:493] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.049320  5439 raft_consensus.cc:515] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:37.056522  5479 raft_consensus.cc:515] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:35.826599  5485 raft_consensus.cc:493] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
W20260709 13:00:34.419057  5488 consensus_meta.cc:287] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.651s	user 0.008s	sys 0.003s
I20260709 13:00:36.741751  5505 raft_consensus.cc:2804] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:35.092759  5509 raft_consensus.cc:2749] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:00:34.655102  5513 consensus_meta.cc:287] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.914s	user 0.001s	sys 0.014s
I20260709 13:00:34.233995  5514 raft_consensus.cc:493] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:35.941324  5520 raft_consensus.cc:493] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:35.065886  5530 raft_consensus.cc:493] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
W20260709 13:00:34.848826  5533 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.729s	user 0.003s	sys 0.003s
W20260709 13:00:36.869681  1427 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46258 (request call id 342) took 36271 ms (client timeout 15000 ms). Trace:
I20260709 13:00:36.877822  1428 catalog_manager.cc:5697] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:00:36.842352  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 2.38378e+06us
I20260709 13:00:36.967958  1524 raft_consensus.cc:1240] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
W20260709 13:00:36.782935  1526 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.352s	user 0.042s	sys 0.038s
I20260709 13:00:36.895315  1525 raft_consensus.cc:2468] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 6.
W20260709 13:00:37.147079  1525 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43010 (request call id 2133) took 2906 ms (client timeout 1925 ms). Trace:
W20260709 13:00:37.147547  1525 rpcz_store.cc:269] 0709 13:00:34.240061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:34.328297 (+ 88236us) service_pool.cc:224] Handling call
0709 13:00:37.146784 (+2818487us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:36.929665  1527 raft_consensus.cc:1240] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 8. Current term is 9. Ops: [7.8-8.9]
I20260709 13:00:36.965346  1531 rpcz_store.cc:276] 0709 13:00:34.235789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:36.930197 (+2694408us) service_pool.cc:224] Handling call
0709 13:00:36.930563 (+   366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:36.964757 (+ 34194us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:36.964981 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:37.158849  1526 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.728s	user 0.042s	sys 0.039s
W20260709 13:00:36.787153  1571 connection.cc:256] RPC call timeout handler was delayed by -1.1107335970000349s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1778s for a response
W20260709 13:00:36.780177  1572 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.659s	user 0.007s	sys 0.014s
W20260709 13:00:36.948562  1606 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 829) took 2828 ms (client timeout 2515 ms). Trace:
W20260709 13:00:37.171056  1606 rpcz_store.cc:269] 0709 13:00:34.120611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:36.948393 (+2827782us) service_pool.cc:211] Skipping call since client already timed out
0709 13:00:36.948505 (+   112us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:00:36.918504  1607 rpcz_store.cc:269] 0709 13:00:34.121259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:36.918083 (+2796824us) service_pool.cc:211] Skipping call since client already timed out
0709 13:00:36.918178 (+    95us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:00:36.829134  1628 debug-util.cc:398] Leaking SignalData structure 0x7b0800267ee0 after lost signal to thread 434
I20260709 13:00:36.907486  1598 rpcz_store.cc:276] 0709 13:00:33.689163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:33.692266 (+  3103us) service_pool.cc:224] Handling call
0709 13:00:34.696287 (+1004021us) spinlock_profiling.cc:243] Waited 253 ms on lock 0x7b54001a95d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:34.696454 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":582892928}
I20260709 13:00:37.127535  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43008 (request call id 2029) took 3026 ms. Trace:
I20260709 13:00:36.946067  1644 leader_election.cc:304] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:36.995241  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:37.129315  1600 raft_consensus.cc:1275] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
W20260709 13:00:36.943580  5373 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 3.123s	user 0.011s	sys 0.029s
I20260709 13:00:37.049437  5383 raft_consensus.cc:515] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:37.197968  5383 leader_election.cc:290] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:37.191280  1532 rpcz_store.cc:276] 0709 13:00:34.100388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:34.193068 (+ 92680us) service_pool.cc:224] Handling call
0709 13:00:34.193430 (+   362us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:34.248737 (+ 55307us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:34.248770 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:34.249211 (+   441us) log.cc:844] Serialized 26 byte log entry
0709 13:00:36.906114 (+2656903us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:36.922883 (+ 16769us) log.cc:844] Serialized 14 byte log entry
0709 13:00:37.126537 (+203654us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:37.126734 (+   197us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:37.126840 (+   106us) raft_consensus.cc:1685] finished
0709 13:00:37.126874 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:37.127216 (+   342us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44749,"prepare.queue_time_us":16020,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":46,"raft.queue_time_us":124630,"raft.run_cpu_time_us":8946,"raft.run_wall_time_us":84394,"spinlock_wait_cycles":290048,"thread_start_us":2694661,"threads_started":4,"wal-append.queue_time_us":423110,"wal-append.run_cpu_time_us":1633,"wal-append.run_wall_time_us":1001663}
I20260709 13:00:37.202725  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:37.073945  5479 leader_election.cc:290] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:36.963193  1570 leader_election.cc:304] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:00:36.913209  1602 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 826) took 2861 ms (client timeout 1849 ms). Trace:
I20260709 13:00:34.650202  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:37.043202  1673 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 12.
I20260709 13:00:37.208958  5093 raft_consensus.cc:2749] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:37.210244  1532 raft_consensus.cc:3060] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:37.210775  1673 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49170 (request call id 2083) took 3196 ms (client timeout 1778 ms). Trace:
W20260709 13:00:37.211223  1673 rpcz_store.cc:269] 0709 13:00:34.014725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:34.016101 (+  1376us) service_pool.cc:224] Handling call
0709 13:00:37.210300 (+3194199us) spinlock_profiling.cc:243] Waited 3.03 s on lock 0x7b540024de54. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:37.210483 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6958817664}
I20260709 13:00:37.213104  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:37.213944  1673 raft_consensus.cc:2468] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 7.
I20260709 13:00:35.425944  5486 raft_consensus.cc:493] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.216547  5486 raft_consensus.cc:515] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:37.078692  5488 raft_consensus.cc:515] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:37.221200  5488 leader_election.cc:290] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:00:36.894860  2191 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.195:44217 timed out after 2.008s (SENT) [suppressed 33 similar messages]
W20260709 13:00:37.222904  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 327976us
I20260709 13:00:36.997295  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:37.232012  1681 raft_consensus.cc:3060] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:37.235522  1603 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 828) took 3142 ms (client timeout 1673 ms). Trace:
W20260709 13:00:37.236158  1603 rpcz_store.cc:269] 0709 13:00:34.093296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:34.649902 (+556606us) service_pool.cc:224] Handling call
0709 13:00:37.235213 (+2585311us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:36.849936  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 2.25052e+06us
I20260709 13:00:37.239828  5486 leader_election.cc:290] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:00:36.967703  2224 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50310 (request call id 782) took 1721 ms (client timeout 1778 ms). Trace:
W20260709 13:00:34.653311  5535 consensus_meta.cc:287] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.567s	user 0.006s	sys 0.002s
I20260709 13:00:37.246584  5535 raft_consensus.cc:515] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:37.247972  1496 leader_election.cc:304] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:37.249029  1680 raft_consensus.cc:1240] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:37.249773  5535 leader_election.cc:290] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
W20260709 13:00:34.385726  5543 log.cc:927] Time spent T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.388s	user 0.001s	sys 0.001s
W20260709 13:00:34.427335  5546 log.cc:927] Time spent T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.456s	user 0.000s	sys 0.010s
W20260709 13:00:34.439930  5548 log.cc:927] Time spent T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.352s	user 0.001s	sys 0.000s
I20260709 13:00:34.537993  5550 raft_consensus.cc:493] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.271039  5550 raft_consensus.cc:515] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:34.224931  5553 raft_consensus.cc:515] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:37.277185  5553 leader_election.cc:290] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:00:34.384087  5555 log.cc:927] Time spent T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.272s	user 0.001s	sys 0.000s
I20260709 13:00:36.836571  2218 rpcz_store.cc:276] 0709 13:00:33.401414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:33.404999 (+  3585us) service_pool.cc:224] Handling call
0709 13:00:33.405294 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:33.829995 (+424701us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:34.579183 (+749188us) spinlock_profiling.cc:243] Waited 424 ms on lock 0x7b5400325ad4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:00:34.579449 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":975418112}
I20260709 13:00:36.969623  4867 leader_election.cc:290] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:37.279065  1531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43010 (request call id 2128) took 3042 ms. Trace:
I20260709 13:00:37.279527  1601 raft_consensus.cc:2468] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 10.
I20260709 13:00:36.746381  5558 raft_consensus.cc:493] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:36.950402  5025 leader_election.cc:290] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:37.067140  2219 raft_consensus.cc:1275] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
W20260709 13:00:35.122025  5559 log.cc:927] Time spent T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.731s	user 0.005s	sys 0.003s
I20260709 13:00:36.962280  5065 raft_consensus.cc:493] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:34.383503  5560 log.cc:927] Time spent T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.144s	user 0.000s	sys 0.000s
I20260709 13:00:35.509433  5122 raft_consensus.cc:493] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:34.358471  5562 log.cc:927] Time spent T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.166s	user 0.005s	sys 0.012s
W20260709 13:00:34.383363  5566 log.cc:927] Time spent T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
I20260709 13:00:36.966776  5330 raft_consensus.cc:515] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:34.451332  5564 log.cc:927] Time spent T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 13:00:36.951485  5496 raft_consensus.cc:493] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:36.945015  5500 raft_consensus.cc:2804] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:37.047979  5032 raft_consensus.cc:515] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:37.031620  5291 raft_consensus.cc:493] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:36.973336  5335 raft_consensus.cc:515] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:36.943056  5368 raft_consensus.cc:515] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:37.024395  5378 leader_election.cc:290] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:36.951985  5470 raft_consensus.cc:493] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.079608  5505 raft_consensus.cc:493] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:37.081892  5513 raft_consensus.cc:515] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:37.082562  5514 raft_consensus.cc:515] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:37.282809  1601 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 823) took 3273 ms (client timeout 1845 ms). Trace:
W20260709 13:00:37.309216  1601 rpcz_store.cc:269] 0709 13:00:34.009657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:35.048747 (+1039090us) service_pool.cc:224] Handling call
0709 13:00:37.282529 (+2233782us) spinlock_profiling.cc:243] Waited 369 ms on lock 0x7b5400058054. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:37.282722 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":849297280}
I20260709 13:00:37.311373  1601 raft_consensus.cc:1275] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:00:37.311564  5514 leader_election.cc:290] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:37.083106  5520 raft_consensus.cc:515] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:37.312232  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 833) took 3190 ms. Trace:
I20260709 13:00:37.284847  5558 raft_consensus.cc:515] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:34.657151  5534 consensus_meta.cc:287] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b: Time spent flushing consensus metadata: real 0.640s	user 0.008s	sys 0.000s
W20260709 13:00:36.747989  5561 log.cc:927] Time spent T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 2.356s	user 0.013s	sys 0.011s
I20260709 13:00:37.319914  5558 leader_election.cc:290] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:37.292659  2227 raft_consensus.cc:2468] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 6.
I20260709 13:00:37.296319  1530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49310 (request call id 867) took 3760 ms. Trace:
I20260709 13:00:37.083693  5530 raft_consensus.cc:515] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:37.079510  5485 raft_consensus.cc:515] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:37.321712  1530 rpcz_store.cc:276] 0709 13:00:33.535230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:33.567388 (+ 32158us) service_pool.cc:224] Handling call
0709 13:00:33.567724 (+   336us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:00:33.573149 (+  5425us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:33.573180 (+    31us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:00:33.582129 (+  8949us) log.cc:844] Serialized 78 byte log entry
0709 13:00:34.065166 (+483037us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:34.065212 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:34.065286 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:37.295689 (+3230403us) raft_consensus.cc:1685] finished
0709 13:00:37.295730 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:37.296073 (+   343us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4976,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":32152,"thread_start_us":375295,"threads_started":1,"wal-append.queue_time_us":512495}
I20260709 13:00:37.322955  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36200 (request call id 2269) took 3982 ms. Trace:
I20260709 13:00:37.300158  1679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50664 (request call id 879) took 3521 ms. Trace:
I20260709 13:00:37.077965  5438 raft_consensus.cc:3060] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:00:34.642585  5571 log.cc:927] Time spent T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 13:00:34.386003  5572 raft_consensus.cc:2749] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:36.878842  5587 raft_consensus.cc:493] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:36.839145  5588 raft_consensus.cc:515] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:36.840107  5589 raft_consensus.cc:515] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:37.045912  5590 raft_consensus.cc:493] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.737162  5592 raft_consensus.cc:493] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:36.771683  5594 raft_consensus.cc:493] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:36.930122  5596 consensus_queue.cc:1048] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:36.890045  5597 raft_consensus.cc:493] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.038792  5598 raft_consensus.cc:493] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:36.939457  5603 raft_consensus.cc:493] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:37.047293  5605 raft_consensus.cc:493] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:37.038808  5608 raft_consensus.cc:493] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.060761  5606 leader_election.cc:290] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:37.135774  5599 raft_consensus.cc:493] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
W20260709 13:00:37.139204  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:37.140257  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 90696.5us
W20260709 13:00:37.143146  1427 rpcz_store.cc:269] 0709 13:00:00.655769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:00.849420 (+193651us) service_pool.cc:224] Handling call
0709 13:00:36.869570 (+36020150us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:28.400638 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:28.401340 (+   702us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:28.401395 (+    55us) write_op.cc:435] Acquired schema lock
0709 13:00:28.401414 (+    19us) tablet.cc:662] Decoding operations
0709 13:00:28.402167 (+   753us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:28.402259 (+    92us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:28.402288 (+    29us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:00:28.403043 (+   755us) tablet.cc:701] Row locks acquired
0709 13:00:28.403091 (+    48us) write_op.cc:260] PREPARE: finished
0709 13:00:28.404681 (+  1590us) write_op.cc:270] Start()
0709 13:00:28.404847 (+   166us) write_op.cc:276] Timestamp: P: 1783602028404598 usec, L: 0
0709 13:00:28.404868 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:00:28.454173 (+ 49305us) log.cc:844] Serialized 2084 byte log entry
0709 13:00:28.896171 (+441998us) op_driver.cc:464] REPLICATION: finished
0709 13:00:29.036148 (+139977us) write_op.cc:301] APPLY: starting
0709 13:00:29.043270 (+  7122us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:29.043454 (+   184us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:29.043590 (+   136us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:29.097602 (+ 54012us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:29.264955 (+167353us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 13:00:29.265012 (+    57us) write_op.cc:312] APPLY: finished
0709 13:00:29.265345 (+   333us) log.cc:844] Serialized 47 byte log entry
0709 13:00:29.265542 (+   197us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:29.265654 (+   112us) write_op.cc:454] Released schema lock
0709 13:00:29.265713 (+    59us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:29.266136 (+   423us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:29.266164 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":9352780,"reported_tablets":42,"child_traces":[["op",{"apply.queue_time_us":105661,"apply.run_cpu_time_us":3509,"apply.run_wall_time_us":257927,"num_ops":5,"prepare.queue_time_us":517849,"prepare.run_cpu_time_us":26458,"prepare.run_wall_time_us":292095,"raft.queue_time_us":159439,"raft.run_cpu_time_us":23705,"raft.run_wall_time_us":94533,"replication_time_us":491100,"thread_start_us":623733,"threads_started":4,"wal-append.queue_time_us":215550,"wal-append.run_cpu_time_us":62857,"wal-append.run_wall_time_us":1977603}]]}
I20260709 13:00:37.150328  1525 raft_consensus.cc:1240] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 11. Current term is 12. Ops: [9.6-11.7]
W20260709 13:00:37.152263  1497 leader_election.cc:336] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Timed out: RequestConsensusVote RPC to 127.0.107.194:40303 timed out after 1.711s (SENT)
W20260709 13:00:37.153187  5533 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 3.033s	user 0.007s	sys 0.004s
I20260709 13:00:37.151841  1428 catalog_manager.cc:5697] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 5 to 10, leader changed from ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) to 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194). New cstate: current_term: 10 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:37.154538  1527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43008 (request call id 2038) took 3048 ms. Trace:
W20260709 13:00:37.170495  1572 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.049s	user 0.007s	sys 0.015s
I20260709 13:00:37.186435  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 824) took 3173 ms. Trace:
I20260709 13:00:37.189121  1674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50664 (request call id 881) took 3218 ms. Trace:
I20260709 13:00:37.075810  5439 leader_election.cc:290] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:37.199517  1672 raft_consensus.cc:2393] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 10: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
W20260709 13:00:37.191324  1628 debug-util.cc:398] Leaking SignalData structure 0x7b080033c320 after lost signal to thread 1464
I20260709 13:00:37.192351  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43010 (request call id 2124) took 2957 ms. Trace:
W20260709 13:00:37.193786  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 247681us
I20260709 13:00:37.195029  1600 pending_rounds.cc:85] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642: Aborting all ops after (but not including) 8
I20260709 13:00:37.200563  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 827) took 3128 ms. Trace:
I20260709 13:00:37.127535  1528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43008 (request call id 2041) took 3020 ms. Trace:
I20260709 13:00:37.194607  5336 raft_consensus.cc:2749] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:37.201274  1524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43008 (request call id 2040) took 3094 ms. Trace:
W20260709 13:00:37.208184  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 244979us
W20260709 13:00:37.228557  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 55777.1us
W20260709 13:00:37.206370  1602 rpcz_store.cc:269] 0709 13:00:34.051690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:36.913012 (+2861322us) service_pool.cc:211] Skipping call since client already timed out
0709 13:00:36.913130 (+   118us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:00:37.230839  1598 raft_consensus.cc:1240] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 8. Current term is 9. Ops: []
W20260709 13:00:37.240795  2224 rpcz_store.cc:269] 0709 13:00:35.246719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:35.246848 (+   129us) service_pool.cc:224] Handling call
0709 13:00:36.967641 (+1720793us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:37.250543  1680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49170 (request call id 2081) took 3311 ms. Trace:
I20260709 13:00:37.238443  1603 raft_consensus.cc:1275] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:00:37.253058  1532 raft_consensus.cc:2468] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 9.
I20260709 13:00:37.257062  5509 raft_consensus.cc:2804] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:37.257177  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:37.257781  5612 raft_consensus.cc:493] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:37.240705  2192 leader_election.cc:304] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:37.263129  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43008 (request call id 2036) took 3158 ms. Trace:
I20260709 13:00:37.263358  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36200 (request call id 2265) took 3924 ms. Trace:
I20260709 13:00:37.252265  5535 raft_consensus.cc:493] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.273509  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49170 (request call id 2060) took 5574 ms. Trace:
I20260709 13:00:37.315430  1523 raft_consensus.cc:2410] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:00:37.289997  5065 raft_consensus.cc:515] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:37.292533  5122 raft_consensus.cc:515] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:37.308622  5505 raft_consensus.cc:3060] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:37.285827  2219 pending_rounds.cc:85] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b: Aborting all ops after (but not including) 10
W20260709 13:00:37.401571  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:37.323979  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:37.449234  1606 rpcz_store.cc:276] 0709 13:00:34.010030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:37.172309 (+3162279us) service_pool.cc:224] Handling call
0709 13:00:37.172965 (+   656us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:37.173407 (+   442us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:37.173429 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:37.173487 (+    58us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:37.173514 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:37.182816 (+  9302us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:37.182943 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:37.297822  1599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 822) took 3333 ms. Trace:
I20260709 13:00:37.324723  5485 leader_election.cc:290] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:37.293170  1681 raft_consensus.cc:2468] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 9.
I20260709 13:00:37.298843  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49170 (request call id 2078) took 3730 ms. Trace:
I20260709 13:00:37.299367  1675 raft_consensus.cc:1240] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:37.449647  1524 rpcz_store.cc:276] 0709 13:00:34.106341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:36.881552 (+2775211us) service_pool.cc:224] Handling call
0709 13:00:36.881907 (+   355us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:37.158356 (+276449us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:37.200807 (+ 42451us) spinlock_profiling.cc:243] Waited 85.8 ms on lock 0x7b54001ff4d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:00:37.201123 (+   316us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":197351296}
I20260709 13:00:37.306782  5335 leader_election.cc:290] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:37.307628  1678 raft_consensus.cc:1240] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 11. Current term is 12. Ops: []
W20260709 13:00:37.417415  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:37.450920  1607 rpcz_store.cc:276] 0709 13:00:34.071986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:37.199186 (+3127200us) service_pool.cc:224] Handling call
0709 13:00:37.199694 (+   508us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:37.200104 (+   410us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:37.200134 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:37.200197 (+    63us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:37.200224 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:37.200282 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:37.200391 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:37.398505  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:37.448880  1527 rpcz_store.cc:276] 0709 13:00:34.105815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:34.216861 (+111046us) service_pool.cc:224] Handling call
0709 13:00:36.733484 (+2516623us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:37.151437 (+417953us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:37.154147 (+  2710us) spinlock_profiling.cc:243] Waited 2.48 s on lock 0x7b540015c050. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b28ad 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:37.154364 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5703078656}
I20260709 13:00:37.462508  5488 raft_consensus.cc:493] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:37.467268  5597 raft_consensus.cc:515] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:37.469704  5093 consensus_queue.cc:1059] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:37.470465  5488 raft_consensus.cc:515] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:37.471185  5093 raft_consensus.cc:3055] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:37.471650  1598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 825) took 3461 ms. Trace:
I20260709 13:00:37.462428  2219 pending_rounds.cc:107] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 13:00:37.469213  1600 pending_rounds.cc:107] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:00:37.472704  1600 raft_consensus.cc:2889] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:37.471976  5603 raft_consensus.cc:3060] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:37.468760  5389 consensus_queue.cc:1048] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:37.300611  5500 raft_consensus.cc:493] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:37.298147  5330 leader_election.cc:290] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:37.467492  1644 leader_election.cc:304] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:37.474517  5296 raft_consensus.cc:493] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.449988  1605 rpcz_store.cc:276] 0709 13:00:33.339059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:33.339157 (+    98us) service_pool.cc:224] Handling call
0709 13:00:33.357562 (+ 18405us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:33.357951 (+   389us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:33.357979 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:33.379315 (+ 21336us) log.cc:844] Serialized 26 byte log entry
0709 13:00:33.633026 (+253711us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:33.633069 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:33.633136 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:37.262813 (+3629677us) raft_consensus.cc:1685] finished
0709 13:00:37.262860 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:37.263124 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10247,"raft.queue_time_us":88,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":45996,"thread_start_us":167539,"threads_started":1,"wal-append.queue_time_us":396305}
I20260709 13:00:37.485759  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:37.486191  1527 raft_consensus.cc:1240] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 11. Current term is 12. Ops: [9.8-11.9]
I20260709 13:00:37.486732  5500 raft_consensus.cc:3060] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:37.308301  5470 raft_consensus.cc:515] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:00:37.488624  1628 debug-util.cc:398] Leaking SignalData structure 0x7b0800392c20 after lost signal to thread 1556
W20260709 13:00:37.489035  1628 debug-util.cc:398] Leaking SignalData structure 0x7b08002d7700 after lost signal to thread 1557
I20260709 13:00:37.489390  5598 raft_consensus.cc:515] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:37.472097  1598 rpcz_store.cc:276] 0709 13:00:34.010307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:37.190355 (+3180048us) service_pool.cc:224] Handling call
0709 13:00:37.190993 (+   638us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:37.450267 (+259274us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:37.471389 (+ 21122us) spinlock_profiling.cc:243] Waited 35.5 ms on lock 0x7b5400267fd4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:00:37.471573 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":81656704}
I20260709 13:00:37.450098  1674 rpcz_store.cc:276] 0709 13:00:33.970226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:33.970394 (+   168us) service_pool.cc:224] Handling call
0709 13:00:34.238428 (+268034us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:37.130047 (+2891619us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:37.130102 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:37.131358 (+  1256us) log.cc:844] Serialized 26 byte log entry
0709 13:00:37.173775 (+ 42417us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:37.173822 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:37.188485 (+ 14663us) spinlock_profiling.cc:243] Waited 2.89 s on lock 0x7b540017a054. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:00:37.188536 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:37.188599 (+    63us) raft_consensus.cc:1685] finished
0709 13:00:37.188611 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:37.188912 (+   301us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5913,"raft.run_cpu_time_us":309,"raft.run_wall_time_us":311,"spinlock_wait_cycles":6648202112,"thread_start_us":41776,"threads_started":1,"wal-append.queue_time_us":48008}
I20260709 13:00:37.491058  5608 raft_consensus.cc:515] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:37.492038  5598 leader_election.cc:290] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:37.492862  5612 raft_consensus.cc:515] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:37.493460  5608 leader_election.cc:290] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:37.494445  5605 raft_consensus.cc:515] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:37.495106  5065 leader_election.cc:290] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:37.364223  5530 leader_election.cc:290] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:37.495692  1527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43010 (request call id 2129) took 3256 ms. Trace:
I20260709 13:00:37.495456  5599 raft_consensus.cc:515] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:37.491989  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:37.496483  1497 leader_election.cc:304] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:37.466246  1525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43010 (request call id 2127) took 3230 ms. Trace:
I20260709 13:00:37.471621  5093 raft_consensus.cc:740] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:37.497191  5612 leader_election.cc:290] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:37.463397  5553 raft_consensus.cc:493] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:37.491539  1523 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43010 (request call id 2131) took 3252 ms (client timeout 1930 ms). Trace:
I20260709 13:00:37.498302  5093 consensus_queue.cc:260] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:37.480378  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:37.499708  5514 raft_consensus.cc:2749] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:37.475428  2219 raft_consensus.cc:2889] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:00:37.500221  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 260019us
I20260709 13:00:37.303314  5032 leader_election.cc:290] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:37.483942  5296 raft_consensus.cc:515] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:37.299623  5496 raft_consensus.cc:515] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:37.480242  5488 leader_election.cc:290] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:37.449545  1529 rpcz_store.cc:276] 0709 13:00:34.235130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:36.928023 (+2692893us) service_pool.cc:224] Handling call
0709 13:00:36.928339 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:36.928540 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:00:36.928847 (+   307us) log.cc:844] Serialized 14 byte log entry
0709 13:00:36.999061 (+ 70214us) log.cc:844] Serialized 14 byte log entry
0709 13:00:37.191604 (+192543us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:37.191710 (+   106us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:37.191810 (+   100us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:37.191913 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:37.192137 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32827,"prepare.queue_time_us":8898,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":85,"raft.queue_time_us":78402,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":143,"thread_start_us":220521,"threads_started":2,"wal-append.queue_time_us":90882}
I20260709 13:00:37.501363  5582 raft_consensus.cc:493] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.308599  5550 leader_election.cc:290] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:37.482386  5592 raft_consensus.cc:515] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:37.504218  5378 raft_consensus.cc:493] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:00:37.504009  5582 raft_consensus.cc:515] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:37.494938  1530 raft_consensus.cc:2468] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 9.
I20260709 13:00:37.505060  5378 raft_consensus.cc:515] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:37.505772  5592 leader_election.cc:290] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:37.505970  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 13:00:37.498881  1523 rpcz_store.cc:269] 0709 13:00:34.239595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:35.101038 (+861443us) service_pool.cc:224] Handling call
0709 13:00:37.491244 (+2390206us) spinlock_profiling.cc:243] Waited 427 ms on lock 0x7b54000fdf54. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:37.491454 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":980975488}
I20260709 13:00:37.506738  1530 raft_consensus.cc:2468] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 6.
I20260709 13:00:37.508050  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:37.508733  1530 raft_consensus.cc:2376] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 9. Re-sending same reply.
I20260709 13:00:37.508857  5594 raft_consensus.cc:515] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:37.509888  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:37.510135  5589 leader_election.cc:290] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:00:37.500969  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 349022us
W20260709 13:00:37.495929  2227 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50326 (request call id 879) took 3050 ms (client timeout 1925 ms). Trace:
I20260709 13:00:37.498100  5553 raft_consensus.cc:515] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:37.449565  1680 rpcz_store.cc:276] 0709 13:00:33.938952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:33.939370 (+   418us) service_pool.cc:224] Handling call
0709 13:00:33.939678 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:37.249527 (+3309849us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:37.250192 (+   665us) spinlock_profiling.cc:243] Waited 3.31 s on lock 0x7b540017a554. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:00:37.250488 (+   296us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7610654592}
I20260709 13:00:37.500066  5093 raft_consensus.cc:3060] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:37.502316  2219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 824) took 2677 ms. Trace:
I20260709 13:00:37.500511  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:37.506556  1673 raft_consensus.cc:2468] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 10.
I20260709 13:00:37.507966  5378 leader_election.cc:290] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:37.519214  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:37.519932  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
W20260709 13:00:37.520464  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 53118.6us
I20260709 13:00:37.522084  5065 raft_consensus.cc:2749] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:37.502997  1600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 814) took 3814 ms. Trace:
I20260709 13:00:37.510933  5590 raft_consensus.cc:515] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:37.511569  5587 raft_consensus.cc:515] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:37.523221  1600 rpcz_store.cc:276] 0709 13:00:33.688616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:33.728652 (+ 40036us) service_pool.cc:224] Handling call
0709 13:00:33.728964 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:37.473416 (+3744452us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:37.502691 (+ 29275us) spinlock_profiling.cc:243] Waited 3.4 s on lock 0x7b5400057654. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:00:37.502928 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7818089344}
I20260709 13:00:37.524928  1523 raft_consensus.cc:1275] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:00:37.525341  5587 leader_election.cc:290] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:37.366235  5368 leader_election.cc:290] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:37.483842  5588 leader_election.cc:290] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:37.304131  5291 raft_consensus.cc:515] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:37.487036  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:37.524358  2219 rpcz_store.cc:276] 0709 13:00:34.824511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:34.825627 (+  1116us) service_pool.cc:224] Handling call
0709 13:00:34.825911 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:37.500816 (+2674905us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:37.501951 (+  1135us) spinlock_profiling.cc:243] Waited 2.24 s on lock 0x7b54005b3bd4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:00:37.502216 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5153878400}
I20260709 13:00:37.504199  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:37.513466  5582 leader_election.cc:290] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:37.525691  1525 rpcz_store.cc:276] 0709 13:00:34.236038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:37.149024 (+2912986us) service_pool.cc:224] Handling call
0709 13:00:37.149821 (+   797us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:37.461054 (+311233us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:37.466187 (+  5133us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:37.528630  5291 leader_election.cc:290] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:37.508762  1570 leader_election.cc:304] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:37.529915  1525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49310 (request call id 869) took 3278 ms. Trace:
I20260709 13:00:37.505985  5296 leader_election.cc:290] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:37.512518  5496 leader_election.cc:290] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:37.483150  5122 leader_election.cc:290] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:37.450572  1676 rpcz_store.cc:276] 0709 13:00:31.699095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.716000 (+ 16905us) service_pool.cc:224] Handling call
0709 13:00:33.390431 (+1674431us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:33.390790 (+   359us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:33.390818 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:33.391305 (+   487us) log.cc:844] Serialized 26 byte log entry
0709 13:00:33.558975 (+167670us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:33.559021 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:33.559103 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:37.263867 (+3704764us) raft_consensus.cc:1685] finished
0709 13:00:37.263909 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:37.272906 (+  8997us) spinlock_profiling.cc:243] Waited 1.66 s on lock 0x7b5400179150. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b28ad 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:37.273333 (+   427us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1081,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":82,"spinlock_wait_cycles":3807484800,"thread_start_us":167294,"threads_started":1,"wal-append.queue_time_us":255723}
I20260709 13:00:37.531105  1570 leader_election.cc:304] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:37.496858  1674 raft_consensus.cc:2468] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 6.
W20260709 13:00:37.490468  1628 debug-util.cc:398] Leaking SignalData structure 0x7b080040d8c0 after lost signal to thread 1631
I20260709 13:00:37.532153  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:37.312711  1601 rpcz_store.cc:276] 0709 13:00:34.121762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:37.310090 (+3188328us) service_pool.cc:224] Handling call
0709 13:00:37.310765 (+   675us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:37.311850 (+  1085us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:37.312124 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:37.451002  5509 raft_consensus.cc:493] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:37.318342  5534 raft_consensus.cc:515] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:37.518520  2227 rpcz_store.cc:269] 0709 13:00:34.430551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:34.431711 (+  1160us) service_pool.cc:224] Handling call
0709 13:00:37.455882 (+3024171us) spinlock_profiling.cc:243] Waited 293 ms on lock 0x7b5400601b54. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:37.480619 (+ 24737us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":673531136}
W20260709 13:00:37.515604  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:37.533166  5122 raft_consensus.cc:2804] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:37.520565  1680 raft_consensus.cc:2468] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 11.
I20260709 13:00:37.535194  5534 leader_election.cc:290] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:37.513809  1675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49178 (request call id 1924) took 3562 ms. Trace:
I20260709 13:00:37.536011  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:37.537192  5535 raft_consensus.cc:515] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:37.506907  5550 raft_consensus.cc:2749] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:37.489820  5470 leader_election.cc:290] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:37.519222  1524 raft_consensus.cc:2468] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 7.
I20260709 13:00:37.533250  5509 raft_consensus.cc:3060] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:37.324540  1679 rpcz_store.cc:276] 0709 13:00:33.778162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:33.783497 (+  5335us) service_pool.cc:224] Handling call
0709 13:00:33.783868 (+   371us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:33.798533 (+ 14665us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:33.798570 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:33.799131 (+   561us) log.cc:844] Serialized 26 byte log entry
0709 13:00:34.062325 (+263194us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:34.062554 (+   229us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:34.063177 (+   623us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:37.299698 (+3236521us) raft_consensus.cc:1685] finished
0709 13:00:37.299743 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:37.299991 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14239,"raft.queue_time_us":29432,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":5028,"thread_start_us":222599,"threads_started":1,"wal-append.queue_time_us":388843}
I20260709 13:00:37.463467  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 832) took 3334 ms. Trace:
I20260709 13:00:37.526353  1527 rpcz_store.cc:276] 0709 13:00:34.239042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:37.484994 (+3245952us) service_pool.cc:224] Handling call
0709 13:00:37.485684 (+   690us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:37.486627 (+   943us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:37.495614 (+  8987us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:37.510237  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:37.532605  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:37.546217  1603 rpcz_store.cc:276] 0709 13:00:34.121502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:37.237170 (+3115668us) service_pool.cc:224] Handling call
0709 13:00:37.237894 (+   724us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:37.449160 (+211266us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:37.455587 (+  6427us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:37.546614  1681 raft_consensus.cc:2393] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 10: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:00:37.511689  5594 leader_election.cc:290] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:37.528129  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:37.395556  5520 leader_election.cc:290] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:37.525777  1523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43010 (request call id 2132) took 3285 ms. Trace:
I20260709 13:00:37.532840  1676 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 12.
I20260709 13:00:37.544468  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:37.530404  1525 rpcz_store.cc:276] 0709 13:00:34.252022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:37.528874 (+3276852us) service_pool.cc:224] Handling call
0709 13:00:37.529284 (+   410us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:37.529512 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:37.529541 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:37.529593 (+    52us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:37.529642 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:37.529709 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:37.529835 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:37.550838  1523 rpcz_store.cc:276] 0709 13:00:34.239824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:37.513179 (+3273355us) service_pool.cc:224] Handling call
0709 13:00:37.524493 (+ 11314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:37.525470 (+   977us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:37.525687 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:37.543253  1598 raft_consensus.cc:1240] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:37.449151  1528 rpcz_store.cc:276] 0709 13:00:34.106563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:36.890766 (+2784203us) service_pool.cc:224] Handling call
0709 13:00:36.891600 (+   834us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:36.909901 (+ 18301us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:36.909933 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:36.910437 (+   504us) log.cc:844] Serialized 26 byte log entry
0709 13:00:37.126521 (+216084us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:37.126631 (+   110us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:37.126742 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:37.126839 (+    97us) raft_consensus.cc:1685] finished
0709 13:00:37.126873 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:37.127216 (+   343us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":80644,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":84,"spinlock_wait_cycles":1593216,"thread_start_us":233128,"threads_started":2,"wal-append.queue_time_us":138227}
I20260709 13:00:37.553442  1674 raft_consensus.cc:2393] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 10: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:00:37.527217  1529 raft_consensus.cc:2376] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 9. Re-sending same reply.
I20260709 13:00:37.510522  1530 raft_consensus.cc:2468] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 10.
I20260709 13:00:37.520545  1673 raft_consensus.cc:2376] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 9. Re-sending same reply.
I20260709 13:00:37.521710  1644 leader_election.cc:304] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:37.536550  1675 rpcz_store.cc:276] 0709 13:00:33.951562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:33.951694 (+   132us) service_pool.cc:224] Handling call
0709 13:00:37.298856 (+3347162us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:37.465906 (+167050us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:37.513583 (+ 47677us) spinlock_profiling.cc:243] Waited 3.29 s on lock 0x7b54002fce50. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b28ad 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:37.513751 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7560151424}
I20260709 13:00:37.323434  1604 rpcz_store.cc:276] 0709 13:00:33.340053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:33.341960 (+  1907us) service_pool.cc:224] Handling call
0709 13:00:33.342241 (+   281us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:00:33.347211 (+  4970us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:33.347237 (+    26us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:00:33.372625 (+ 25388us) log.cc:844] Serialized 78 byte log entry
0709 13:00:33.828054 (+455429us) spinlock_profiling.cc:243] Waited 33.6 ms on lock 0x7b180036ce80. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1e38ede1 00007f6a1e39b5b1 00007f6a154a8e07 00007f6a1e303ab9 00007f6a154c569b 00007f6a154c393f 00007f6a154c5c02 00007f6a1814d20b 00007f6a18152d23 00007f6a181530d1 00007f6a1856ea0f
0709 13:00:33.907351 (+ 79297us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:00:34.057606 (+150255us) log.cc:844] Serialized 14 byte log entry
0709 13:00:34.079909 (+ 22303us) log.cc:844] Serialized 14 byte log entry
0709 13:00:34.083426 (+  3517us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:34.083638 (+   212us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:34.388627 (+304989us) spinlock_profiling.cc:243] Waited 3.08 ms on lock 0x7b180036ce80. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1e38ede1 00007f6a1e39b5b1 00007f6a154c6557 00007f6a154c87c1 00007f6a154c8779 00007f6a154c8709 00007f6a154c86d1 00007f6a154c79cd 000000000038f354 000000000038f199 00007f6a154a983a
0709 13:00:34.391451 (+  2824us) spinlock_profiling.cc:243] Waited 4.15 ms on lock 0x7b180036ce80. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1e38ede1 00007f6a1e39b5b1 00007f6a154c63f3 00007f6a154c87c1 00007f6a154c8779 00007f6a154c8709 00007f6a154c86d1 00007f6a154c79cd 000000000038f354 000000000038f199 00007f6a154a983a
0709 13:00:36.747191 (+2355740us) spinlock_profiling.cc:243] Waited 36.9 ms on lock 0x7b4400022b4c. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a153ecc85 00007f6a153ed6a2 00007f6a1815f1db 00007f6a1815aaaf 00007f6a1814e86e 00007f6a1814dbb6 00007f6a1814d7d8 00007f6a18157221 00007f6a181571d9 00007f6a18157169
0709 13:00:37.322372 (+575181us) raft_consensus.cc:1685] finished
0709 13:00:37.322428 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:37.322761 (+   333us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22041,"prepare.queue_time_us":90367,"prepare.run_cpu_time_us":91,"prepare.run_wall_time_us":6940,"raft.queue_time_us":15426,"raft.run_cpu_time_us":342,"raft.run_wall_time_us":34445,"spinlock_wait_cycles":178807040,"thread_start_us":191506,"threads_started":2,"wal-append.queue_time_us":582457}
I20260709 13:00:37.531154  5296 raft_consensus.cc:2749] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:37.558480  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:37.559242  2218 raft_consensus.cc:2468] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 11.
I20260709 13:00:37.561218  1525 raft_consensus.cc:1275] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:00:37.558370  2191 leader_election.cc:304] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:37.279557  1531 rpcz_store.cc:276] 0709 13:00:34.236261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:37.155330 (+2919069us) service_pool.cc:224] Handling call
0709 13:00:37.155902 (+   572us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:37.156705 (+   803us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:37.156734 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:37.157591 (+   857us) log.cc:844] Serialized 52 byte log entry
0709 13:00:37.186295 (+ 28704us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:37.229630 (+ 43335us) log.cc:844] Serialized 14 byte log entry
0709 13:00:37.252436 (+ 22806us) log.cc:844] Serialized 14 byte log entry
0709 13:00:37.256341 (+  3905us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:37.256413 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:37.262322 (+  5909us) spinlock_profiling.cc:243] Waited 11.1 ms on lock 0x7b180036cee0. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1e38ede1 00007f6a1e39b5b1 00007f6a154c63f3 00007f6a154c87c1 00007f6a154c8779 00007f6a154c8709 00007f6a154c86d1 00007f6a154c79cd 000000000038f354 000000000038f199 00007f6a154a983a
0709 13:00:37.278501 (+ 16179us) raft_consensus.cc:1685] finished
0709 13:00:37.278648 (+   147us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:37.278851 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27656,"prepare.queue_time_us":39252,"prepare.run_cpu_time_us":106,"prepare.run_wall_time_us":114,"raft.queue_time_us":14636,"raft.run_cpu_time_us":643,"raft.run_wall_time_us":12650,"spinlock_wait_cycles":26186880,"thread_start_us":31657,"threads_started":2,"wal-append.queue_time_us":92316}
I20260709 13:00:37.562196  1680 raft_consensus.cc:2393] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 10: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
W20260709 13:00:37.504047  2192 connection.cc:256] RPC call timeout handler was delayed by -2.7512254370000164s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1845s for a response
W20260709 13:00:37.562813  2192 connection.cc:256] RPC call timeout handler was delayed by -2.6963254370000413s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1906s for a response
W20260709 13:00:37.563184  2192 connection.cc:256] RPC call timeout handler was delayed by -2.6053193139999848s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1849s for a response
W20260709 13:00:37.564020  2192 connection.cc:256] RPC call timeout handler was delayed by -2.5937597780000488s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1673s for a response
I20260709 13:00:37.471638  5597 leader_election.cc:290] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:37.564548  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:37.521876  5553 leader_election.cc:290] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:37.565673  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 13:00:37.567677  2192 connection.cc:256] RPC call timeout handler was delayed by -2.4918954180000128s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1642s for a response
I20260709 13:00:37.530377  5513 leader_election.cc:290] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:37.533921  5122 raft_consensus.cc:697] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 9 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:37.517673  1428 catalog_manager.cc:5697] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 5 to 8, leader changed from 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) to b96ce9cc496c49d7818fa983a17b062b (127.0.107.196). New cstate: current_term: 8 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
W20260709 13:00:37.568456  2192 connection.cc:256] RPC call timeout handler was delayed by -1.9797954180000374s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2211s for a response
I20260709 13:00:37.529301  5605 leader_election.cc:290] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:37.575433  5122 consensus_queue.cc:237] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:37.450541  1526 rpcz_store.cc:276] 0709 13:00:34.105197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:34.211921 (+106724us) service_pool.cc:224] Handling call
0709 13:00:34.212303 (+   382us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:34.248002 (+ 35699us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:34.248034 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:34.328540 (+ 80506us) log.cc:844] Serialized 52 byte log entry
0709 13:00:35.826292 (+1497752us) spinlock_profiling.cc:243] Waited 4.8 ms on lock 0x7b4800002dd8. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1d4dcaa1 00007f6a1d4d3b37 00007f6a1d4d39ca 00007f6a1d5cb26f 00007f6a1d5caf37 00007f6a1d5df55c 00007f6a1d5df508 00007f6a1d5df488 00007f6a1d5df443 00007f6a1d5de6ec 00007f6a1c508a96
0709 13:00:37.167812 (+1341520us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:37.169501 (+  1689us) log.cc:844] Serialized 14 byte log entry
0709 13:00:37.245111 (+ 75610us) spinlock_profiling.cc:243] Waited 29.2 ms on lock 0x7b1800398e00. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1e38ede1 00007f6a1e39b5b1 00007f6a1815b4bc 00007f6a154a948b 00007f6a1e303ab9 00007f6a154c569b 00007f6a154c393f 00007f6a154c5c02 00007f6a1814d20b 00007f6a18152d23 00007f6a1815323a
0709 13:00:37.252930 (+  7819us) log.cc:844] Serialized 14 byte log entry
0709 13:00:37.255725 (+  2795us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:37.256769 (+  1044us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:37.258893 (+  2124us) raft_consensus.cc:1685] finished
0709 13:00:37.258911 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:37.263052 (+  4141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":59676,"prepare.queue_time_us":23524,"prepare.run_cpu_time_us":105,"prepare.run_wall_time_us":106,"raft.queue_time_us":51822,"raft.run_cpu_time_us":13545,"raft.run_wall_time_us":1573492,"spinlock_wait_cycles":78118528,"thread_start_us":2744275,"threads_started":2,"wal-append.queue_time_us":360727,"wal-append.run_cpu_time_us":1706,"wal-append.run_wall_time_us":1001727}
I20260709 13:00:37.580206  5505 raft_consensus.cc:515] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:37.580821  1428 catalog_manager.cc:5697] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 5 to 6, leader changed from ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) to e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193). New cstate: current_term: 6 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } }
I20260709 13:00:37.581892  1527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49310 (request call id 870) took 3329 ms. Trace:
I20260709 13:00:37.453902  1599 rpcz_store.cc:276] 0709 13:00:33.964001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:34.008779 (+ 44778us) service_pool.cc:224] Handling call
0709 13:00:34.009145 (+   366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:34.009538 (+   393us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:00:34.009839 (+   301us) log.cc:844] Serialized 14 byte log entry
0709 13:00:34.107002 (+ 97163us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:34.156332 (+ 49330us) log.cc:844] Serialized 26 byte log entry
0709 13:00:34.156467 (+   135us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:34.156501 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:34.156571 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:37.297323 (+3140752us) raft_consensus.cc:1685] finished
0709 13:00:37.297369 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:37.297598 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":52908,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":4071,"raft.queue_time_us":8756,"raft.run_cpu_time_us":235,"raft.run_wall_time_us":16203,"thread_start_us":96507,"threads_started":1,"wal-append.queue_time_us":209264}
I20260709 13:00:37.584354  5493 raft_consensus.cc:493] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.584627  5590 leader_election.cc:290] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:37.584995  5493 raft_consensus.cc:515] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:37.585611  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:37.586268  1674 raft_consensus.cc:2468] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 10.
I20260709 13:00:37.587212  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:37.587447  1570 leader_election.cc:304] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:37.587848  5493 leader_election.cc:290] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:37.580720  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:37.588758  1676 raft_consensus.cc:2468] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 12.
I20260709 13:00:37.589192  1570 leader_election.cc:304] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:37.586891  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:37.586573  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:37.580129  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:37.589507  5513 raft_consensus.cc:2749] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:37.589730  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:37.587870  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:00:37.590958  1628 debug-util.cc:398] Leaking SignalData structure 0x7b080040e100 after lost signal to thread 1705
I20260709 13:00:37.592662  2191 leader_election.cc:304] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:37.593670  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:37.593262  1428 catalog_manager.cc:5697] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 3 to 5, leader changed from ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) to 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194). New cstate: current_term: 5 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:37.595516  1523 raft_consensus.cc:1275] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 13:00:37.597442  1675 raft_consensus.cc:1275] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:00:37.597929  5534 raft_consensus.cc:2804] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:00:37.570834  2192 connection.cc:256] RPC call timeout handler was delayed by -1.9059066980000239s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18730000000000002s for a response
W20260709 13:00:37.613852  2192 connection.cc:256] RPC call timeout handler was delayed by -1.8294723690000296s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2515s for a response
W20260709 13:00:37.613963  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 94291.9us
W20260709 13:00:37.614259  2192 connection.cc:256] RPC call timeout handler was delayed by -1.7269380280000064s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2008s for a response
I20260709 13:00:37.582393  1527 rpcz_store.cc:276] 0709 13:00:34.252327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:37.552496 (+3300169us) service_pool.cc:224] Handling call
0709 13:00:37.581380 (+ 28884us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:37.581562 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:37.581585 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:37.581623 (+    38us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:37.581655 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:37.581702 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:37.581823 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:37.498904  5599 leader_election.cc:290] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:37.458580  1677 rpcz_store.cc:276] 0709 13:00:33.567969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:33.568421 (+   452us) service_pool.cc:224] Handling call
0709 13:00:33.568712 (+   291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:33.688313 (+119601us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:33.688348 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:33.789170 (+100822us) log.cc:844] Serialized 26 byte log entry
0709 13:00:34.029800 (+240630us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:34.029875 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:34.030018 (+   143us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:37.298251 (+3268233us) raft_consensus.cc:1685] finished
0709 13:00:37.298292 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:37.298621 (+   329us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":76210,"raft.queue_time_us":118573,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":104380,"thread_start_us":199852,"threads_started":1,"wal-append.queue_time_us":350830}
I20260709 13:00:37.629372  1678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49178 (request call id 1923) took 3683 ms. Trace:
I20260709 13:00:37.612854  1523 pending_rounds.cc:85] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting all ops after (but not including) 7
I20260709 13:00:37.634047  2191 leader_election.cc:304] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:37.641302  1523 pending_rounds.cc:107] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:00:37.641903  1523 raft_consensus.cc:2889] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:37.613178  5534 raft_consensus.cc:493] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:37.643991  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43010 (request call id 2130) took 3404 ms. Trace:
I20260709 13:00:37.629850  1678 rpcz_store.cc:276] 0709 13:00:33.945485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:33.945648 (+   163us) service_pool.cc:224] Handling call
0709 13:00:34.010651 (+ 65003us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:37.526973 (+3516322us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:37.611661 (+ 84688us) spinlock_profiling.cc:243] Waited 3.3 s on lock 0x7b54002fc954. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:00:37.629317 (+ 17656us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7581832576}
I20260709 13:00:37.666697  5534 raft_consensus.cc:3060] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:37.645778  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
W20260709 13:00:37.668627  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 52669.7us
I20260709 13:00:37.633770  5605 raft_consensus.cc:2749] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:37.676976  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:37.646011  5378 raft_consensus.cc:2804] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:37.643906  5514 raft_consensus.cc:2804] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:37.678999  1673 raft_consensus.cc:1275] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:00:37.684970  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:37.684705  1428 catalog_manager.cc:5697] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 2 to 7, leader changed from b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) to 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194). New cstate: current_term: 7 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:37.686178  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:37.680924  5378 raft_consensus.cc:493] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:00:37.677673  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:00:37.675850  1497 leader_election.cc:336] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Timed out: RequestConsensusVote RPC to 127.0.107.194:40303 timed out after 1.785s (SENT)
I20260709 13:00:37.687175  1676 raft_consensus.cc:1240] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:37.619832  5535 leader_election.cc:290] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:37.671581  5590 raft_consensus.cc:2804] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:37.674126  2219 raft_consensus.cc:2468] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 9.
I20260709 13:00:37.687759  1675 raft_consensus.cc:2468] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 10.
I20260709 13:00:37.678447  1604 raft_consensus.cc:2468] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 11.
I20260709 13:00:37.682639  5514 raft_consensus.cc:493] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:37.687151  5378 raft_consensus.cc:3060] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:00:37.699991  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 110944us
I20260709 13:00:37.698400  2191 leader_election.cc:304] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:37.696203  5514 raft_consensus.cc:3060] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:37.665735  1532 rpcz_store.cc:276] 0709 13:00:34.239327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:37.512143 (+3272816us) service_pool.cc:224] Handling call
0709 13:00:37.512542 (+   399us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:37.512866 (+   324us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:00:37.514277 (+  1411us) log.cc:844] Serialized 14 byte log entry
0709 13:00:37.643512 (+129235us) log.cc:844] Serialized 14 byte log entry
0709 13:00:37.643677 (+   165us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:37.643719 (+    42us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:37.643766 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:37.643828 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:37.643938 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":2690,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":42,"raft.queue_time_us":16486,"thread_start_us":114268,"threads_started":1}
I20260709 13:00:37.721292  1428 catalog_manager.cc:5697] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 3 to 5, leader changed from ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) to 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194). New cstate: current_term: 5 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:37.724393  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:37.723464  1428 catalog_manager.cc:5697] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:37.725711  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:37.726270  1679 raft_consensus.cc:3060] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:37.727474  5505 leader_election.cc:290] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:37.728252  2221 raft_consensus.cc:1240] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 8. Current term is 9. Ops: [8.10-8.10]
I20260709 13:00:37.730801  5582 raft_consensus.cc:2804] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:37.731339  5582 raft_consensus.cc:697] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 9 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:37.723330  1676 raft_consensus.cc:1275] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:00:37.687729  5553 consensus_queue.cc:1059] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
W20260709 13:00:37.748785  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 54322.5us
I20260709 13:00:37.749861  2191 leader_election.cc:304] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:37.701785  5590 raft_consensus.cc:697] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 12 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:37.754316  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:00:37.757922  1628 debug-util.cc:398] Leaking SignalData structure 0x7b08003dc220 after lost signal to thread 2251
I20260709 13:00:37.760473  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:00:37.765197  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 243669us
I20260709 13:00:37.769506  1675 raft_consensus.cc:1275] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:00:37.709172  5500 raft_consensus.cc:515] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:00:37.777101  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 414177us
W20260709 13:00:37.781877  1702 debug-util.cc:398] Leaking SignalData structure 0x7b08003d16a0 after lost signal to thread 434
I20260709 13:00:37.782289   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:37.785511  5637 raft_consensus.cc:2804] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:37.796129  5637 raft_consensus.cc:493] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:37.796618  5637 raft_consensus.cc:3060] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:37.800643  4867 consensus_queue.cc:1059] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:37.801718  4867 raft_consensus.cc:3055] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:37.802093  4867 raft_consensus.cc:740] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:00:37.783202  5590 consensus_queue.cc:237] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:37.803109  4867 consensus_queue.cc:260] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:37.804425  4867 raft_consensus.cc:3060] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:37.786140  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:00:37.814352  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 160505us
W20260709 13:00:37.834434  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 79691.4us
I20260709 13:00:37.765983  5582 consensus_queue.cc:237] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 7.10, Last appended by leader: 10, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:37.848398  1496 leader_election.cc:304] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
W20260709 13:00:37.858044  5624 log.cc:927] Time spent T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
W20260709 13:00:37.859787  1628 debug-util.cc:398] Leaking SignalData structure 0x7b0800155400 after lost signal to thread 5501
W20260709 13:00:37.860227  1628 debug-util.cc:398] Leaking SignalData structure 0x7b0800395460 after lost signal to thread 5512
I20260709 13:00:37.867551  5500 leader_election.cc:290] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:37.885766  5514 raft_consensus.cc:515] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:37.888401  5599 raft_consensus.cc:2804] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:00:37.891423  1702 debug-util.cc:398] Leaking SignalData structure 0x7b0800120100 after lost signal to thread 1464
I20260709 13:00:37.892071  1679 raft_consensus.cc:2468] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 11.
W20260709 13:00:37.892289  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 210449us
W20260709 13:00:37.895458  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 46105.1us
W20260709 13:00:37.904357  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:37.891446  5599 raft_consensus.cc:493] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:37.912896  1570 leader_election.cc:304] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
W20260709 13:00:37.913223  1702 debug-util.cc:398] Leaking SignalData structure 0x7b08001a9900 after lost signal to thread 1497
W20260709 13:00:37.912606  1497 leader_election.cc:336] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Timed out: RequestConsensusVote RPC to 127.0.107.194:40303 timed out after 1.948s (SENT)
W20260709 13:00:37.914753  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 82505.7us
I20260709 13:00:37.919986  5639 consensus_queue.cc:1048] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
W20260709 13:00:37.922247  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 127924us
I20260709 13:00:37.923295  1644 leader_election.cc:304] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:00:37.924789  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 228234us
I20260709 13:00:37.929168  5122 raft_consensus.cc:3055] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:37.929625  5122 raft_consensus.cc:740] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:37.915617  5599 raft_consensus.cc:3060] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:37.930495  5122 consensus_queue.cc:260] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:00:37.931593  1572 connection.cc:256] RPC call timeout handler was delayed by -1.0723618710000551s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1778s for a response
I20260709 13:00:37.932044  5122 raft_consensus.cc:3060] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:37.940403  1497 leader_election.cc:304] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:37.934846  5596 raft_consensus.cc:493] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:37.942358  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:37.946521  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:37.947224  1679 raft_consensus.cc:2468] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 8.
W20260709 13:00:37.948439  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:37.913376  5509 raft_consensus.cc:515] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:37.951560  1702 debug-util.cc:398] Leaking SignalData structure 0x7b08001a9c40 after lost signal to thread 1524
I20260709 13:00:37.951313  5596 raft_consensus.cc:515] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:00:37.951958  1702 debug-util.cc:398] Leaking SignalData structure 0x7b08000c7820 after lost signal to thread 1525
W20260709 13:00:37.952741  1702 debug-util.cc:398] Leaking SignalData structure 0x7b0800122de0 after lost signal to thread 1556
W20260709 13:00:37.953006  1702 debug-util.cc:398] Leaking SignalData structure 0x7b0800122e40 after lost signal to thread 1557
I20260709 13:00:37.953263  5509 leader_election.cc:290] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:00:37.953946  1702 debug-util.cc:398] Leaking SignalData structure 0x7b080036ba80 after lost signal to thread 1607
I20260709 13:00:37.953672  5587 consensus_queue.cc:1059] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:37.944345  5594 raft_consensus.cc:2804] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:37.954202  5588 consensus_queue.cc:1048] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:00:37.941501  5597 raft_consensus.cc:2749] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:37.897665  5603 raft_consensus.cc:515] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:37.930424  5378 raft_consensus.cc:515] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:37.941712  5093 raft_consensus.cc:493] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.926354  5637 raft_consensus.cc:515] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:37.955202  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 71803.8us
I20260709 13:00:37.958031  1600 raft_consensus.cc:1240] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:37.963596  1644 leader_election.cc:304] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
W20260709 13:00:37.954629  1702 debug-util.cc:398] Leaking SignalData structure 0x7b08002e80c0 after lost signal to thread 1631
I20260709 13:00:37.954241  1526 raft_consensus.cc:1240] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:37.959388  1571 leader_election.cc:304] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
W20260709 13:00:37.992209  1702 debug-util.cc:398] Leaking SignalData structure 0x7b080036cb00 after lost signal to thread 1644
I20260709 13:00:37.992913  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
W20260709 13:00:37.962775  5629 log.cc:927] Time spent T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
W20260709 13:00:38.000769  1702 debug-util.cc:398] Leaking SignalData structure 0x7b080035ef40 after lost signal to thread 1647
I20260709 13:00:37.949461  5493 raft_consensus.cc:2749] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:37.958033  5596 leader_election.cc:290] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:37.958094  5378 leader_election.cc:290] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:00:38.007126  1702 debug-util.cc:398] Leaking SignalData structure 0x7b08003aab00 after lost signal to thread 1672
W20260709 13:00:38.007987  1702 debug-util.cc:398] Leaking SignalData structure 0x7b08003792c0 after lost signal to thread 1705
I20260709 13:00:37.954820  5594 raft_consensus.cc:493] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:37.994191  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:38.003804  1570 leader_election.cc:304] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:00:38.004592  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 45266.9us
I20260709 13:00:38.004853  5514 leader_election.cc:290] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:38.005137  5590 raft_consensus.cc:2804] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:37.965637  5637 leader_election.cc:290] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 13 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:37.957823  5603 leader_election.cc:290] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:37.955891  5588 raft_consensus.cc:3055] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:38.010005  2190 leader_election.cc:304] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
W20260709 13:00:38.013769  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 50273.7us
W20260709 13:00:38.020244  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 123787us
I20260709 13:00:37.958851  5553 consensus_queue.cc:1048] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 13:00:38.011364  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:37.958943  5093 raft_consensus.cc:515] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:38.009750  5594 raft_consensus.cc:3060] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:38.025264  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:38.025794  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:38.026968  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:38.027580  1680 raft_consensus.cc:3060] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:37.955372  5587 consensus_queue.cc:1048] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.067s
W20260709 13:00:38.032454  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:38.010787  5330 raft_consensus.cc:2764] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
I20260709 13:00:38.014087  5599 raft_consensus.cc:515] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:38.015450  5590 raft_consensus.cc:493] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:38.047106  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:38.037446  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:38.052845  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:38.056360  5639 raft_consensus.cc:2804] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:38.056834  5639 raft_consensus.cc:493] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:38.057164  5639 raft_consensus.cc:3060] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:38.041824  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 49417.3us
I20260709 13:00:38.065894  1602 raft_consensus.cc:2468] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 10.
I20260709 13:00:38.066305  1680 raft_consensus.cc:2468] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 7.
W20260709 13:00:38.066840  1702 debug-util.cc:398] Leaking SignalData structure 0x7b08002762e0 after lost signal to thread 2220
I20260709 13:00:38.068241  1600 raft_consensus.cc:2468] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 10.
I20260709 13:00:38.022336  5596 raft_consensus.cc:2749] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:38.070144  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:00:38.071151  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:38.021185  5588 raft_consensus.cc:740] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:00:38.072111  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:38.070732  5594 raft_consensus.cc:515] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:00:38.086810  1497 leader_election.cc:336] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Timed out: RequestConsensusVote RPC to 127.0.107.194:40303 timed out after 1.954s (SENT)
W20260709 13:00:38.088809  1702 debug-util.cc:398] Leaking SignalData structure 0x7b0800102b40 after lost signal to thread 2227
I20260709 13:00:38.053434  5590 raft_consensus.cc:3060] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:38.094018  1607 raft_consensus.cc:3060] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:00:38.094411  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 67012.8us
I20260709 13:00:38.097244  1497 leader_election.cc:304] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:38.033587  5534 raft_consensus.cc:515] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:38.100086  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:38.102066  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:38.101218  2190 leader_election.cc:304] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
W20260709 13:00:38.103915  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 100251us
I20260709 13:00:38.104547  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:38.105871  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:38.106805  2227 raft_consensus.cc:2410] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:00:38.108533  5093 leader_election.cc:290] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:38.109392  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:38.109575  2221 raft_consensus.cc:1275] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:00:38.109988  1604 raft_consensus.cc:2468] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 11.
I20260709 13:00:38.110351  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:38.110498  5330 consensus_queue.cc:1048] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:38.111140  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:38.111531  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:38.109999  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:00:38.112980  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:38.113404  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:38.113760  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:38.106209  5291 raft_consensus.cc:2749] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:38.115221  5588 consensus_queue.cc:260] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:38.116330  5588 raft_consensus.cc:3060] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:00:38.118834  1702 debug-util.cc:398] Leaking SignalData structure 0x7b0800097520 after lost signal to thread 2251
W20260709 13:00:38.119364  1702 debug-util.cc:398] Leaking SignalData structure 0x7b080033a520 after lost signal to thread 4867
W20260709 13:00:38.119589  1702 debug-util.cc:398] Leaking SignalData structure 0x7b080031e6a0 after lost signal to thread 5025
W20260709 13:00:38.119850  1702 debug-util.cc:398] Leaking SignalData structure 0x7b08001b2280 after lost signal to thread 5093
I20260709 13:00:38.120044  5599 leader_election.cc:290] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:00:38.120537  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 67322.8us
W20260709 13:00:38.121508  1497 leader_election.cc:336] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Timed out: RequestConsensusVote RPC to 127.0.107.194:40303 timed out after 1.975s (SENT)
I20260709 13:00:38.122258  1497 leader_election.cc:304] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:38.123581  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:38.125103  1680 raft_consensus.cc:3060] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:38.126116  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:38.126952  1526 raft_consensus.cc:2393] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 12: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:00:38.112895  1601 raft_consensus.cc:2468] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 9.
W20260709 13:00:38.120076  1702 debug-util.cc:398] Leaking SignalData structure 0x7b08003b4b80 after lost signal to thread 5291
I20260709 13:00:38.033285  5296 consensus_queue.cc:1059] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.065s
I20260709 13:00:38.134598  1607 raft_consensus.cc:2468] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 12.
W20260709 13:00:38.138042  1702 debug-util.cc:398] Leaking SignalData structure 0x7b0800096660 after lost signal to thread 5330
W20260709 13:00:38.139425  1702 debug-util.cc:398] Leaking SignalData structure 0x7b0800219be0 after lost signal to thread 5335
I20260709 13:00:38.139140  1571 leader_election.cc:304] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:38.141718  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:38.142221  1644 leader_election.cc:304] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:00:38.142407  2221 raft_consensus.cc:2468] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 8.
I20260709 13:00:38.142902  5605 consensus_queue.cc:1048] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:38.125221  4867 raft_consensus.cc:2749] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:00:38.156134  1702 debug-util.cc:398] Leaking SignalData structure 0x7b080020a880 after lost signal to thread 5360
W20260709 13:00:38.156572  1702 debug-util.cc:398] Leaking SignalData structure 0x7b08003cec20 after lost signal to thread 5364
W20260709 13:00:38.156793  1702 debug-util.cc:398] Leaking SignalData structure 0x7b08000483e0 after lost signal to thread 5368
I20260709 13:00:38.159861  1571 leader_election.cc:304] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:38.139917  5486 raft_consensus.cc:2804] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:38.205788  1526 raft_consensus.cc:1275] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
W20260709 13:00:38.209249  1702 debug-util.cc:398] Leaking SignalData structure 0x7b0800350860 after lost signal to thread 5383
W20260709 13:00:38.209713  1702 debug-util.cc:398] Leaking SignalData structure 0x7b080039fc00 after lost signal to thread 5389
I20260709 13:00:38.171499  1570 leader_election.cc:304] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:38.178370  1677 raft_consensus.cc:1240] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:38.178956  5534 leader_election.cc:290] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:38.179191  5122 raft_consensus.cc:2804] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:00:38.183260  5651 log.cc:927] Time spent T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:00:38.184123  5594 leader_election.cc:290] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:38.185623  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 13:00:38.213094  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 53328.3us
I20260709 13:00:38.214524  2218 raft_consensus.cc:2393] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 9: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:00:38.186401  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:38.187120  5493 raft_consensus.cc:2804] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:38.187974  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:38.187146  5500 consensus_queue.cc:1048] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:00:38.190920  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:38.191232  5496 consensus_queue.cc:1048] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:38.191788  2190 leader_election.cc:304] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:38.218318  1675 raft_consensus.cc:2393] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 11: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:00:38.192462  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:38.192560  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:38.193416  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:38.193976  2223 raft_consensus.cc:3060] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:38.198494  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:38.199064  1497 leader_election.cc:304] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
W20260709 13:00:38.199862  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:38.204486  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:38.207466  1526 pending_rounds.cc:85] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting all ops after (but not including) 5
I20260709 13:00:38.220602  1526 pending_rounds.cc:107] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:00:38.220887  1526 raft_consensus.cc:2889] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:38.212900  2191 leader_election.cc:304] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
W20260709 13:00:38.216336  1702 debug-util.cc:398] Leaking SignalData structure 0x7b0800401100 after lost signal to thread 5438
W20260709 13:00:38.224315  1702 debug-util.cc:398] Leaking SignalData structure 0x7b0800148900 after lost signal to thread 5439
W20260709 13:00:38.224648  1702 debug-util.cc:398] Leaking SignalData structure 0x7b0800269420 after lost signal to thread 5447
I20260709 13:00:38.154479  5296 consensus_queue.cc:1243] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer ddf11fc190dd4b898773379c6b129d90 log is divergent from this leader: its last log entry 8.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:00:38.217108  2222 raft_consensus.cc:2393] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 11: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:00:38.207072  5486 raft_consensus.cc:493] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:38.236514  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:38.237696  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 45997.6us
W20260709 13:00:38.242507  1702 debug-util.cc:398] Leaking SignalData structure 0x7b0800405120 after lost signal to thread 5479
W20260709 13:00:38.242944  1702 debug-util.cc:398] Leaking SignalData structure 0x7b08003df060 after lost signal to thread 5488
W20260709 13:00:38.243263  1702 debug-util.cc:398] Leaking SignalData structure 0x7b0800401180 after lost signal to thread 5513
W20260709 13:00:38.243429  1702 debug-util.cc:398] Leaking SignalData structure 0x7b0800401120 after lost signal to thread 5514
W20260709 13:00:38.243726  1702 debug-util.cc:398] Leaking SignalData structure 0x7b08004010c0 after lost signal to thread 5533
W20260709 13:00:38.243857  1702 debug-util.cc:398] Leaking SignalData structure 0x7b0800401200 after lost signal to thread 5534
W20260709 13:00:38.243973  1702 debug-util.cc:398] Leaking SignalData structure 0x7b0800381600 after lost signal to thread 5535
W20260709 13:00:38.244115  1702 debug-util.cc:398] Leaking SignalData structure 0x7b08003d4c20 after lost signal to thread 5543
W20260709 13:00:38.244273  1702 debug-util.cc:398] Leaking SignalData structure 0x7b0800318ac0 after lost signal to thread 5546
W20260709 13:00:38.244479  1702 debug-util.cc:398] Leaking SignalData structure 0x7b0800331840 after lost signal to thread 5548
W20260709 13:00:38.244617  1702 debug-util.cc:398] Leaking SignalData structure 0x7b08003eeea0 after lost signal to thread 5550
W20260709 13:00:38.244740  1702 debug-util.cc:398] Leaking SignalData structure 0x7b08001a2a60 after lost signal to thread 5553
W20260709 13:00:38.244866  1702 debug-util.cc:398] Leaking SignalData structure 0x7b08003a44a0 after lost signal to thread 5555
W20260709 13:00:38.245000  1702 debug-util.cc:398] Leaking SignalData structure 0x7b080038d800 after lost signal to thread 5560
W20260709 13:00:38.245118  1702 debug-util.cc:398] Leaking SignalData structure 0x7b0800280360 after lost signal to thread 5562
W20260709 13:00:38.245245  1702 debug-util.cc:398] Leaking SignalData structure 0x7b08001cd9c0 after lost signal to thread 5564
W20260709 13:00:38.245357  1702 debug-util.cc:398] Leaking SignalData structure 0x7b08003d5d00 after lost signal to thread 5566
W20260709 13:00:38.245515  1702 debug-util.cc:398] Leaking SignalData structure 0x7b0800223aa0 after lost signal to thread 5571
W20260709 13:00:38.245698  1702 debug-util.cc:398] Leaking SignalData structure 0x7b08003f1560 after lost signal to thread 5572
I20260709 13:00:38.238593  2224 raft_consensus.cc:2468] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 11.
I20260709 13:00:38.251353  1572 leader_election.cc:304] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:38.251600  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:38.252768  1681 raft_consensus.cc:2468] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 11.
I20260709 13:00:38.216920  5493 raft_consensus.cc:493] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:38.264055  5493 raft_consensus.cc:3060] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:38.264467  5646 log.cc:927] Time spent T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.167s	user 0.000s	sys 0.001s
I20260709 13:00:38.218127  5603 raft_consensus.cc:2804] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:38.251401  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:38.266877  5603 raft_consensus.cc:493] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:38.219295  5122 raft_consensus.cc:697] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 11 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:38.267324  5603 raft_consensus.cc:3060] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:38.268184  5122 consensus_queue.cc:237] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:38.251542  5650 raft_consensus.cc:2804] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:38.256368  1572 leader_election.cc:304] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:38.256984  5592 raft_consensus.cc:2749] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:38.258234  5530 consensus_queue.cc:1048] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:38.258818  5534 raft_consensus.cc:2804] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:38.273370  5534 raft_consensus.cc:493] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:38.273782  5534 raft_consensus.cc:3060] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:00:38.259320  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 60368.9us
I20260709 13:00:38.279072  5637 consensus_queue.cc:1048] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:00:38.235863  5093 raft_consensus.cc:2749] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:38.247025  5486 raft_consensus.cc:3060] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:38.263286  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:38.279420  1497 leader_election.cc:304] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:38.271200  5650 raft_consensus.cc:697] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 7 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:38.286067  1571 leader_election.cc:304] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:38.287380  1680 raft_consensus.cc:2468] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 11.
I20260709 13:00:38.293097  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 13:00:38.294248  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 106142us
W20260709 13:00:38.304437  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 48144.9us
I20260709 13:00:38.306201  1572 leader_election.cc:304] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:38.272603  5590 raft_consensus.cc:515] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:38.308316  1496 leader_election.cc:304] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
W20260709 13:00:38.310348  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 151198us
I20260709 13:00:38.282955  5378 consensus_queue.cc:1048] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 13:00:38.307121  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:38.312920  1572 leader_election.cc:304] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:38.314030  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:38.316339  1646 leader_election.cc:304] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:38.326119  1572 leader_election.cc:304] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:38.326987  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:38.289525  4867 raft_consensus.cc:2749] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:38.331079  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:38.331686  1529 raft_consensus.cc:3060] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:38.333396  2223 raft_consensus.cc:1275] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:00:38.334520  1605 raft_consensus.cc:2393] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 11: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:00:38.313736  5530 raft_consensus.cc:2804] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:00:38.334976  1644 connection.cc:256] RPC call timeout handler was delayed by -3.0584139590000063s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16920000000000002s for a response
I20260709 13:00:38.314067  5587 raft_consensus.cc:2749] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:38.316663  5296 raft_consensus.cc:3060] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:38.338781  1644 connection.cc:256] RPC call timeout handler was delayed by -2.8487139590000083s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1925s for a response
W20260709 13:00:38.339128  1644 connection.cc:256] RPC call timeout handler was delayed by -2.8442139590000011s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.193s for a response
I20260709 13:00:38.316061  5093 raft_consensus.cc:2804] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:38.338904  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:38.336779  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:38.327888  5599 raft_consensus.cc:2804] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:00:38.346407  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 58213.3us
I20260709 13:00:38.346414  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:38.349714  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:38.349989  1646 leader_election.cc:304] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:38.350226  5589 raft_consensus.cc:2804] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:38.350612  5589 raft_consensus.cc:493] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:38.350777  5360 consensus_queue.cc:1059] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 13:00:38.351087  5589 raft_consensus.cc:3060] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:38.351881  5360 raft_consensus.cc:3055] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:38.352239  5360 raft_consensus.cc:740] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:38.353117  5360 consensus_queue.cc:260] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:38.356381  5553 raft_consensus.cc:3055] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:38.356899  5553 raft_consensus.cc:740] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:38.357615  5032 consensus_queue.cc:1059] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:38.357942  5553 consensus_queue.cc:260] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:38.359160  5653 log.cc:927] Time spent T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 13:00:38.334597  5594 raft_consensus.cc:2749] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:38.359182  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:38.344847  1523 raft_consensus.cc:3060] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:38.375617  5650 consensus_queue.cc:237] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:38.377923  5470 raft_consensus.cc:3055] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:38.378432  5470 raft_consensus.cc:740] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:38.344965  5330 raft_consensus.cc:2804] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:38.379060  5330 raft_consensus.cc:493] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:38.379388  5470 consensus_queue.cc:260] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:38.358523  5032 raft_consensus.cc:2804] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:38.379248  2218 raft_consensus.cc:1240] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:38.387732  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:38.345453  5093 raft_consensus.cc:493] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:38.339653  5530 raft_consensus.cc:493] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:38.342756  5122 consensus_queue.cc:1048] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
W20260709 13:00:38.400043  5659 log.cc:927] Time spent T 00000000000000000000000000000000 P 9f38d0e5c9db43a48554defe1153354e: Append to log took a long time: real 0.157s	user 0.000s	sys 0.003s
I20260709 13:00:38.367506  5360 raft_consensus.cc:3060] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:38.395743  1570 leader_election.cc:304] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:38.382510  5330 raft_consensus.cc:3060] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:38.382790  5599 raft_consensus.cc:697] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:00:38.389832  5032 raft_consensus.cc:493] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:00:38.392344  5093 raft_consensus.cc:3060] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:38.391736  5530 raft_consensus.cc:3060] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:38.363054  5534 raft_consensus.cc:515] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:38.439625  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 89712.8us
I20260709 13:00:38.433600  5470 raft_consensus.cc:3060] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:38.467939  1646 leader_election.cc:304] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:38.468269  2190 leader_election.cc:304] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:38.444442  5590 leader_election.cc:290] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:38.446777  5592 raft_consensus.cc:2804] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:00:38.447577  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 57814.9us
I20260709 13:00:38.449812  5603 raft_consensus.cc:515] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:38.450832  1497 leader_election.cc:304] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
W20260709 13:00:38.451017  5662 log.cc:927] Time spent T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
W20260709 13:00:38.451972  1495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:38.457477  5655 log.cc:927] Time spent T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.193s	user 0.001s	sys 0.000s
I20260709 13:00:38.459250  5599 consensus_queue.cc:237] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:38.458949  5330 raft_consensus.cc:515] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:38.462128  5656 log.cc:927] Time spent T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
I20260709 13:00:38.462368  2221 raft_consensus.cc:1240] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:38.463567  5534 leader_election.cc:290] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:00:38.463747  5657 log.cc:927] Time spent T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.208s	user 0.001s	sys 0.000s
I20260709 13:00:38.470600  2190 leader_election.cc:304] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:38.494953  5534 raft_consensus.cc:2749] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:00:38.497673  5589 raft_consensus.cc:515] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:38.497900  5093 raft_consensus.cc:515] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:38.436021  5032 raft_consensus.cc:3060] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:00:38.504448  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:38.473241  1526 raft_consensus.cc:1275] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 7 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260709 13:00:38.508210  5534 consensus_queue.cc:1048] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:00:38.440909  5553 raft_consensus.cc:3060] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:38.509857  5603 leader_election.cc:290] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:38.511080  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:38.511866  1676 raft_consensus.cc:3060] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:00:38.486573  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:38.513140  1532 raft_consensus.cc:3060] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:38.514449  5493 raft_consensus.cc:515] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:38.515756  1672 raft_consensus.cc:1240] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:38.516600  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:38.517206  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:38.517897  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:38.470984  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:38.518419  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:38.518844  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:38.519384  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:38.519714  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:38.518458  1601 raft_consensus.cc:3060] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:38.441421  5486 raft_consensus.cc:515] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:38.472486  5648 raft_consensus.cc:2749] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:00:38.501047  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:38.501899  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:38.530125  1529 raft_consensus.cc:2468] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 7.
I20260709 13:00:38.530296  2223 raft_consensus.cc:3060] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:38.501125  5589 leader_election.cc:290] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:38.519105  1677 raft_consensus.cc:2393] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 11: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:00:38.528792  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:38.528409  1676 raft_consensus.cc:2468] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 10.
I20260709 13:00:38.500357  5639 raft_consensus.cc:515] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:38.535117  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:38.487564  5660 raft_consensus.cc:2804] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:38.483736  5592 raft_consensus.cc:697] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 7 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:38.485248  5612 raft_consensus.cc:2749] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:38.539950  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:38.543174  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:38.534830  1532 raft_consensus.cc:2468] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 11.
I20260709 13:00:38.544073  1607 raft_consensus.cc:2410] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:00:38.546693  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:38.547523  1529 raft_consensus.cc:3060] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:38.549188  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 108097us
I20260709 13:00:38.549408  2190 leader_election.cc:304] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:38.552773  1604 raft_consensus.cc:2410] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b for term 14 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:00:38.542892  1646 leader_election.cc:304] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:38.540474  5660 raft_consensus.cc:493] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:38.579260  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:38.580574  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:38.550009  5486 leader_election.cc:290] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 8 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:38.591943  1606 raft_consensus.cc:2410] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 13:00:38.592491  1529 raft_consensus.cc:2468] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 8.
I20260709 13:00:38.592856  5530 raft_consensus.cc:515] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:38.593811  2190 leader_election.cc:304] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:38.594864  5486 raft_consensus.cc:2804] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:38.595381  5486 raft_consensus.cc:697] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 8 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:38.596310  5486 consensus_queue.cc:237] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:38.601327  2226 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0"
dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
mode: GRACEFUL
new_leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:47682
I20260709 13:00:38.602221  2226 raft_consensus.cc:606] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 10 LEADER]: Received request to transfer leadership to TS e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:38.605731  5639 leader_election.cc:290] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 10 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:38.556031  5648 raft_consensus.cc:2804] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:38.611198  5648 raft_consensus.cc:697] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 11 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:38.611878  5093 leader_election.cc:290] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:38.612238  5648 consensus_queue.cc:237] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:38.614948  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 72153.6us
I20260709 13:00:38.616169  5496 raft_consensus.cc:2804] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:38.616746  5496 raft_consensus.cc:697] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 10 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
W20260709 13:00:38.619467  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:38.614847  2221 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41"
dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
mode: GRACEFUL
new_leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:47682
I20260709 13:00:38.620184  2221 raft_consensus.cc:606] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 10 LEADER]: Received request to transfer leadership to TS e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:38.620733  1523 raft_consensus.cc:2468] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 7.
I20260709 13:00:38.618258  1646 leader_election.cc:304] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:38.627404  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:38.617612  5496 consensus_queue.cc:237] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:38.628443  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:38.635488  1571 leader_election.cc:304] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:38.636816  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:38.638398  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:38.639122  1523 raft_consensus.cc:3060] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:38.643175  2190 leader_election.cc:304] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:38.574064  5660 raft_consensus.cc:3060] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:38.655695  2223 raft_consensus.cc:2468] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 12.
I20260709 13:00:38.663009  1572 leader_election.cc:304] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:38.642608  5335 raft_consensus.cc:2764] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:00:38.645344  5589 raft_consensus.cc:2804] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:38.673990  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:38.715931  1523 raft_consensus.cc:2468] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 10.
W20260709 13:00:38.719878  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:38.720835  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 48857.4us
I20260709 13:00:38.675783  5639 raft_consensus.cc:2804] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:38.675097  5590 raft_consensus.cc:2804] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:38.745337  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:38.663998  5122 consensus_queue.cc:1059] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 13:00:38.705804  5553 raft_consensus.cc:493] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:38.750000  5553 raft_consensus.cc:515] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:38.731181  5655 log.cc:927] Time spent T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:00:38.737198  5093 raft_consensus.cc:493] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:38.781666  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:38.741562  5589 raft_consensus.cc:697] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 10 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:38.783208  1601 raft_consensus.cc:2468] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 11.
I20260709 13:00:38.747402  5530 leader_election.cc:290] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:38.752208  5590 raft_consensus.cc:697] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 12 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:38.809298  1600 raft_consensus.cc:1275] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:00:38.755041  5639 raft_consensus.cc:697] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 7 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
W20260709 13:00:38.821785  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:38.807063  5599 raft_consensus.cc:493] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:38.780340  5122 raft_consensus.cc:3055] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:38.823236  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:00:38.826186  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 208031us
I20260709 13:00:38.826977  1646 leader_election.cc:304] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:38.752094  5592 consensus_queue.cc:237] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:38.824889  5122 raft_consensus.cc:740] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
W20260709 13:00:38.852098  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 91626.9us
I20260709 13:00:38.854882  1678 raft_consensus.cc:1275] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 7 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260709 13:00:38.856734  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:38.860471  1601 raft_consensus.cc:2468] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 9.
I20260709 13:00:38.818010  5032 raft_consensus.cc:515] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:38.864429  2190 leader_election.cc:304] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:38.815789  5093 raft_consensus.cc:515] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:38.866266  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:38.871731  1598 raft_consensus.cc:1240] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:38.882642  2221 raft_consensus.cc:3060] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:38.876329  5589 consensus_queue.cc:237] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:38.889544  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:38.890202  1602 raft_consensus.cc:3060] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:38.891192  5668 raft_consensus.cc:2804] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:00:38.893515  5672 log.cc:927] Time spent T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:00:38.903616  2223 raft_consensus.cc:1275] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 13:00:38.904145  2223 pending_rounds.cc:85] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b: Aborting all ops after (but not including) 9
I20260709 13:00:38.904381  2223 pending_rounds.cc:107] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 13:00:38.904606  2223 raft_consensus.cc:2889] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:38.906704  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:38.911762  1603 raft_consensus.cc:1240] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 14. Current term is 15. Ops: []
I20260709 13:00:38.875551  1646 leader_election.cc:304] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:38.913383  1672 raft_consensus.cc:1240] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:38.917325  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
W20260709 13:00:38.919369  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:38.919251  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:38.920840  2218 raft_consensus.cc:2468] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 8.
I20260709 13:00:38.834343  5599 raft_consensus.cc:515] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:38.923434  1603 raft_consensus.cc:2410] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 13:00:38.925828  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 50385.1us
I20260709 13:00:38.924418  1678 raft_consensus.cc:1275] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:00:38.907956  5650 raft_consensus.cc:2804] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:00:38.919154  5656 log.cc:927] Time spent T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 13:00:38.922259  5676 log.cc:927] Time spent T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 13:00:38.908427  5668 raft_consensus.cc:697] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 12 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:38.923434  5690 raft_consensus.cc:493] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:38.959640  2223 raft_consensus.cc:1240] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:38.959568  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 13:00:38.963677  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 54364.5us
I20260709 13:00:38.956599  1646 leader_election.cc:304] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:00:38.942369  5643 consensus_queue.cc:1048] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 13:00:38.957990  5668 consensus_queue.cc:237] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:00:38.955327  5296 consensus_meta.cc:287] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.610s	user 0.010s	sys 0.000s
I20260709 13:00:38.974295  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:38.973163  5690 raft_consensus.cc:515] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:38.980849  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:38.979130  5690 leader_election.cc:290] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:38.937227  5686 raft_consensus.cc:2804] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:38.987408  5686 raft_consensus.cc:493] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:00:38.987843  5686 raft_consensus.cc:3060] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:38.988317  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:38.995579  1602 raft_consensus.cc:2468] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 12.
W20260709 13:00:39.003922  5678 log.cc:927] Time spent T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.085s	user 0.000s	sys 0.002s
I20260709 13:00:39.004241  5690 consensus_queue.cc:1048] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:00:39.005268  1603 raft_consensus.cc:1240] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:39.008095  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:39.015013  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:39.017045  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:39.017688  1646 leader_election.cc:304] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:38.937762  5122 consensus_queue.cc:260] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:39.019924  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:39.017858  2227 raft_consensus.cc:2468] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 9.
I20260709 13:00:39.021907  1646 leader_election.cc:304] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:39.022321  5686 raft_consensus.cc:515] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:39.024173  5605 raft_consensus.cc:2749] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:39.025014  5605 raft_consensus.cc:2749] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:00:39.025316  5438 consensus_queue.cc:1059] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:39.024995  5686 leader_election.cc:290] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:38.905725  5590 consensus_queue.cc:237] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:38.914227  5639 consensus_queue.cc:237] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:39.029309  5335 consensus_queue.cc:1059] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:00:39.030274  5335 raft_consensus.cc:3055] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:39.030620  5335 raft_consensus.cc:740] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:39.026453  5686 raft_consensus.cc:3055] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:39.031636  5093 leader_election.cc:290] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:39.031420  5335 consensus_queue.cc:260] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:39.032084  5686 raft_consensus.cc:740] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
W20260709 13:00:39.032759  5677 log.cc:927] Time spent T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.187s	user 0.000s	sys 0.000s
I20260709 13:00:39.033243  5686 consensus_queue.cc:260] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:39.035138  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:39.036048  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
W20260709 13:00:39.045405  5470 consensus_meta.cc:287] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.574s	user 0.005s	sys 0.006s
W20260709 13:00:39.053381  1495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:39.053823  2221 raft_consensus.cc:2468] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 9.
I20260709 13:00:38.974061  5553 leader_election.cc:290] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:38.974517  5500 raft_consensus.cc:2804] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:38.972353  5650 raft_consensus.cc:697] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 10 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:39.015499  5296 raft_consensus.cc:2749] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:39.035507  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:39.059634  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:39.060276  2219 raft_consensus.cc:1240] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:39.060887  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:39.022392  5122 raft_consensus.cc:3060] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:39.074295  1572 leader_election.cc:304] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:39.077919  1672 raft_consensus.cc:1275] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:00:39.087590  1604 raft_consensus.cc:1240] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 8. Current term is 9. Ops: []
W20260709 13:00:39.089094  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:39.061933  5500 raft_consensus.cc:493] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:39.095170  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 71454.7us
I20260709 13:00:39.095811  1646 leader_election.cc:304] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:39.093595  5500 raft_consensus.cc:3060] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:39.117138  5470 consensus_queue.cc:1059] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:39.086887  5553 consensus_queue.cc:1048] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:00:39.112567  5496 raft_consensus.cc:2749] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:39.121690  5496 raft_consensus.cc:3055] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:39.118132  5470 consensus_queue.cc:1059] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:00:39.104311  5335 raft_consensus.cc:3060] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:39.125438  5496 raft_consensus.cc:740] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:39.131479  2226 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2"
dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
mode: GRACEFUL
new_leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:47682
W20260709 13:00:39.133948  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 53929.4us
I20260709 13:00:39.122907  5032 leader_election.cc:290] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:39.111018  5698 raft_consensus.cc:2804] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:00:39.167981  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 46054.7us
I20260709 13:00:39.146502  2226 raft_consensus.cc:606] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 11 LEADER]: Received request to transfer leadership to TS e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:39.146016  1571 leader_election.cc:304] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
W20260709 13:00:39.160717  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:39.132974  5505 consensus_queue.cc:1048] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:00:39.161599  5599 leader_election.cc:290] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:39.146452  5637 consensus_queue.cc:1048] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:00:39.186184  5692 consensus_queue.cc:1059] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 13:00:39.187368  5692 raft_consensus.cc:3055] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:39.187722  5692 raft_consensus.cc:740] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:39.188561  5692 consensus_queue.cc:260] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:39.190182  5702 log.cc:927] Time spent T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:00:39.131589  5650 consensus_queue.cc:237] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:39.193207  5291 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:39.193783  2192 leader_election.cc:304] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
W20260709 13:00:39.194830  1571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:39.177815  5698 raft_consensus.cc:697] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 9 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
W20260709 13:00:39.198835  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:39.210327  1497 connection.cc:256] RPC call timeout handler was delayed by -3.2496793790000424s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19870000000000002s for a response
W20260709 13:00:39.210923  1497 connection.cc:256] RPC call timeout handler was delayed by -3.2172793790000469s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20230000000000004s for a response
W20260709 13:00:39.211282  1497 connection.cc:256] RPC call timeout handler was delayed by -3.2127793790000396s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2028s for a response
W20260709 13:00:39.211623  1497 connection.cc:256] RPC call timeout handler was delayed by -2.6412793790000251s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2663s for a response
I20260709 13:00:39.193814  4867 raft_consensus.cc:493] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:39.215731  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:39.213444  5705 raft_consensus.cc:3055] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:39.182955  5496 consensus_queue.cc:260] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:39.217237  5705 raft_consensus.cc:740] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:39.217579  2192 leader_election.cc:304] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:39.218176  5705 consensus_queue.cc:260] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:39.219372  5705 raft_consensus.cc:3060] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:39.217964  5645 raft_consensus.cc:2749] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:00:39.207157  5660 consensus_meta.cc:287] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.542s	user 0.010s	sys 0.000s
I20260709 13:00:39.204795  5553 raft_consensus.cc:493] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:39.193822  5291 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 13:00:39.278157  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:39.278812  1526 raft_consensus.cc:3060] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:39.204351  5687 raft_consensus.cc:493] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:39.208009  5587 raft_consensus.cc:493] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:39.217619  5703 log.cc:927] Time spent T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:00:39.294620  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 13:00:39.278432  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:39.281958  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:39.290118  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:39.291580  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:39.289395  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:39.184767  5640 consensus_queue.cc:1048] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:00:39.300565  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
W20260709 13:00:39.302197  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 84717.1us
I20260709 13:00:39.302963  2192 leader_election.cc:304] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:39.315778  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 13:00:39.312738  5667 log.cc:927] Time spent T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:00:39.290057  5553 raft_consensus.cc:515] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:39.281553  5660 raft_consensus.cc:515] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:39.306308  5643 raft_consensus.cc:2749] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:39.336234  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:39.383181  5493 leader_election.cc:290] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
W20260709 13:00:39.431056  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:39.373970  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:39.377291  1532 raft_consensus.cc:1240] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:39.336434  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:39.364964  5553 leader_election.cc:290] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:39.313131  5698 consensus_queue.cc:237] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:39.361531  5716 log.cc:927] Time spent T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 13:00:39.296761  5587 raft_consensus.cc:515] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:39.298348  5687 raft_consensus.cc:515] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:39.361961  1675 raft_consensus.cc:2393] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 12: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:00:39.364941  5660 leader_election.cc:290] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:39.412381  5722 raft_consensus.cc:493] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:39.362327  5708 raft_consensus.cc:2749] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:39.382932  5713 raft_consensus.cc:2749] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:39.301163  4867 raft_consensus.cc:515] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:39.462021  4867 leader_election.cc:290] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:39.358424  1529 raft_consensus.cc:2468] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 12.
I20260709 13:00:39.449741  1524 raft_consensus.cc:2468] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 12.
W20260709 13:00:39.451529  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 256475us
I20260709 13:00:39.453547  1528 raft_consensus.cc:2468] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 11.
W20260709 13:00:39.455787  1495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:39.459877  5291 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:00:39.466197  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:39.467833  1527 raft_consensus.cc:2393] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 9: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:00:39.467604  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:39.466053  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:39.487735  1525 raft_consensus.cc:2468] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 7.
I20260709 13:00:39.488660  1532 raft_consensus.cc:3060] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:39.463558  5714 log.cc:927] Time spent T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.173s	user 0.001s	sys 0.000s
I20260709 13:00:39.469857  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:39.467689  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:39.490904  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 13:00:39.465430  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 269663us
I20260709 13:00:39.476208  4867 consensus_queue.cc:1048] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.012s
I20260709 13:00:39.489603  1529 raft_consensus.cc:2376] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 12. Re-sending same reply.
W20260709 13:00:39.493784  1570 connection.cc:256] RPC call timeout handler was delayed by -3.0931965640000385s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1778s for a response
W20260709 13:00:39.494915  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:39.465724  5122 raft_consensus.cc:493] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:39.504792  1532 raft_consensus.cc:2468] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 8.
I20260709 13:00:39.507109  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:39.520108  1672 raft_consensus.cc:1240] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 7. Current term is 8. Ops: []
W20260709 13:00:39.522011  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 219123us
I20260709 13:00:39.522858  2192 leader_election.cc:304] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
W20260709 13:00:39.523486  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 61004.5us
W20260709 13:00:39.523736  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 378531us
I20260709 13:00:39.521255  5122 raft_consensus.cc:515] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:39.525561  5718 consensus_queue.cc:1048] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:00:39.527607  5122 leader_election.cc:290] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:39.521584  5500 raft_consensus.cc:515] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:39.529300  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:39.531634  1598 raft_consensus.cc:2468] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 10.
I20260709 13:00:39.539844  5699 raft_consensus.cc:2749] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:39.540458  5720 raft_consensus.cc:493] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
W20260709 13:00:39.541877  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:39.519083  5553 raft_consensus.cc:493] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:39.543516  1524 raft_consensus.cc:1240] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:00:39.545020  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:39.547057  2225 raft_consensus.cc:2393] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 12: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:00:39.548146  5725 raft_consensus.cc:493] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:39.548702  5725 raft_consensus.cc:515] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:39.549901  5500 leader_election.cc:290] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:39.550787  5500 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:39.551232  1570 leader_election.cc:304] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:39.552165  5720 raft_consensus.cc:515] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:39.551282  5500 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:39.553431  5729 raft_consensus.cc:3060] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:39.555084  5718 raft_consensus.cc:493] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:39.555600  5500 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:39.551230  2192 leader_election.cc:304] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:39.557822  1497 leader_election.cc:304] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:39.558178  5733 raft_consensus.cc:493] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:39.558897  5699 raft_consensus.cc:3060] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:39.558676  5599 raft_consensus.cc:2749] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:39.558769  5733 raft_consensus.cc:515] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:39.558497  2192 leader_election.cc:304] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:39.565949  2192 leader_election.cc:304] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:39.567442  1497 leader_election.cc:304] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:39.568311  1528 raft_consensus.cc:2393] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 10: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
W20260709 13:00:39.573068  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:39.580000  1497 leader_election.cc:304] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:39.469017  5722 raft_consensus.cc:515] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:39.556049  5718 raft_consensus.cc:515] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:39.588627  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:39.597934  1607 raft_consensus.cc:3060] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:39.588572  5711 raft_consensus.cc:2749] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:39.589071  5587 leader_election.cc:290] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:39.586884  5493 consensus_queue.cc:1059] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 13:00:39.594107  1526 raft_consensus.cc:2468] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 10.
I20260709 13:00:39.595889  5728 raft_consensus.cc:2749] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:00:39.589231  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:39.612164  1604 raft_consensus.cc:2393] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 12: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:00:39.599869  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:39.600831  1678 raft_consensus.cc:1275] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:00:39.613206  1679 raft_consensus.cc:2410] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:00:39.603557  1672 raft_consensus.cc:1240] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:39.571465  5720 leader_election.cc:290] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:39.608752  2192 leader_election.cc:304] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:39.609581  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:39.615741  1680 raft_consensus.cc:2468] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 10.
I20260709 13:00:39.610304  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:39.617080  1676 raft_consensus.cc:2468] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 13.
I20260709 13:00:39.596078  5722 leader_election.cc:290] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:39.618392  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:00:39.622874  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 100121us
I20260709 13:00:39.626155  1674 raft_consensus.cc:2393] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 10: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:00:39.627144  2192 leader_election.cc:304] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:00:39.630199  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 79050.6us
I20260709 13:00:39.571215  5553 raft_consensus.cc:515] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:39.614781  5291 raft_consensus.cc:2749] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:39.635836  1679 raft_consensus.cc:1275] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:00:39.634351  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:39.639133  1607 raft_consensus.cc:2468] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 12.
I20260709 13:00:39.615200  5733 leader_election.cc:290] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:39.614621  5687 leader_election.cc:290] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:39.644472  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:39.607788  5500 consensus_queue.cc:1059] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:00:39.624075  5720 consensus_queue.cc:1059] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:00:39.656669  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:39.658524  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:39.660960  1607 raft_consensus.cc:2393] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 11: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:00:39.661142  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:39.661832  1602 raft_consensus.cc:2468] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 11.
I20260709 13:00:39.642154  5711 raft_consensus.cc:2804] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:39.665140  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:39.667296  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:39.672387  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:00:39.674777  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 52522us
I20260709 13:00:39.674865  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:39.675557  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:39.675661  1602 raft_consensus.cc:2468] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 6.
I20260709 13:00:39.673874  1599 raft_consensus.cc:2468] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 9.
I20260709 13:00:39.676400  1607 raft_consensus.cc:2368] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 11. Current term is 12.
I20260709 13:00:39.680068  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:39.680429  5726 raft_consensus.cc:2749] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:39.680886  1605 raft_consensus.cc:2468] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 7.
I20260709 13:00:39.681807  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:39.682369  1605 raft_consensus.cc:2468] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 8.
I20260709 13:00:39.682971  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:39.683593  1526 raft_consensus.cc:2468] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 10.
I20260709 13:00:39.684399  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:39.680176  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:39.685482  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:39.685988  1602 raft_consensus.cc:2393] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 9: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:00:39.670778  5291 consensus_queue.cc:1059] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 13:00:39.686780  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:39.687506  1602 raft_consensus.cc:2393] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 11: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:00:39.687383  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:39.688153  1607 raft_consensus.cc:2393] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 10: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:00:39.688642  1602 raft_consensus.cc:1275] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:00:39.688990  1602 pending_rounds.cc:85] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642: Aborting all ops after (but not including) 5
I20260709 13:00:39.689210  1602 pending_rounds.cc:107] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:00:39.689419  1602 raft_consensus.cc:2889] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:39.691813  5732 raft_consensus.cc:2804] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:39.692317  5732 raft_consensus.cc:493] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:39.692675  5732 raft_consensus.cc:3060] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:39.686396  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:39.686532  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:39.697474  1496 leader_election.cc:304] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:39.669590  5493 raft_consensus.cc:3055] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:00:39.669981  5711 raft_consensus.cc:493] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:39.698498  1603 raft_consensus.cc:2468] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 8.
W20260709 13:00:39.712729  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 94041.5us
I20260709 13:00:39.714622  2192 leader_election.cc:304] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:39.702602  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:39.716503  1605 raft_consensus.cc:2393] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 13: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:00:39.714322  1496 leader_election.cc:304] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:39.716365  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:39.717370  1526 raft_consensus.cc:2468] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 8.
I20260709 13:00:39.720096  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:39.720835  1599 raft_consensus.cc:2368] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 11. Current term is 12.
I20260709 13:00:39.724798  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:39.751225  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:39.759574  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:39.759820  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:39.672737  5687 consensus_queue.cc:1048] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:00:39.762614  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:39.702183  5493 raft_consensus.cc:740] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
W20260709 13:00:39.763608  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 188086us
I20260709 13:00:39.715721  5711 raft_consensus.cc:3060] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:39.765273  1646 leader_election.cc:304] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:39.767204  5587 raft_consensus.cc:3055] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:39.767472  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:39.751544  5588 raft_consensus.cc:2804] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:39.726177  5291 raft_consensus.cc:2804] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:39.770874  1528 raft_consensus.cc:3060] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:00:39.769835  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 55285.1us
I20260709 13:00:39.774757  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:39.774926  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:39.772270  5587 raft_consensus.cc:740] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:00:39.777132  5493 consensus_queue.cc:260] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:39.777134  5587 consensus_queue.cc:260] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:39.778252  5493 raft_consensus.cc:3060] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:39.778473  5587 raft_consensus.cc:3060] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:39.761375  5639 raft_consensus.cc:2749] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:00:39.782733  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 172475us
I20260709 13:00:39.781797  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 13:00:39.784179  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:39.775960  2192 leader_election.cc:304] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:39.791870  5378 raft_consensus.cc:2749] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:00:39.792927  5553 leader_election.cc:290] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:39.786000  5708 raft_consensus.cc:493] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:39.794533  5708 raft_consensus.cc:515] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:39.796663  5708 leader_election.cc:290] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:39.770515  5470 raft_consensus.cc:2804] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:39.799226  5470 raft_consensus.cc:697] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 12 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:39.800164  5470 consensus_queue.cc:237] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:39.800935  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:39.801596  1523 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 12.
I20260709 13:00:39.802014  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:39.775763  5588 raft_consensus.cc:493] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:39.774649  5291 raft_consensus.cc:493] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:39.806561  2192 leader_election.cc:304] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:39.812019  1497 leader_election.cc:304] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:39.813266  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:39.794559  5699 raft_consensus.cc:2749] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:39.813045  5588 raft_consensus.cc:3060] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:39.812760  5520 consensus_queue.cc:1059] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 13:00:39.805691  5718 leader_election.cc:290] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:39.814263  5291 raft_consensus.cc:3060] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:39.816920  5734 consensus_queue.cc:1048] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.103s
I20260709 13:00:39.817509  5741 consensus_queue.cc:1059] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.116s
I20260709 13:00:39.821866  5599 raft_consensus.cc:493] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:39.822155  1528 raft_consensus.cc:2468] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 12.
I20260709 13:00:39.838316  5599 raft_consensus.cc:515] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:39.838845  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:39.840065  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:39.840497  5599 leader_election.cc:290] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:39.841089  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 13:00:39.841619  5685 log.cc:927] Time spent T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.874s	user 0.000s	sys 0.004s
I20260709 13:00:39.842273  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:39.823413  1602 raft_consensus.cc:1275] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:00:39.823674  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:39.816032  5687 raft_consensus.cc:2804] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:39.844009  5687 raft_consensus.cc:493] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:39.844400  5687 raft_consensus.cc:3060] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:39.833428  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:39.847227  5741 raft_consensus.cc:3055] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:39.843575  1526 raft_consensus.cc:2468] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 6.
I20260709 13:00:39.848399  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 13:00:39.848896  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:39.849478  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:39.822960  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:39.828286  5378 raft_consensus.cc:2749] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:39.851054  1523 raft_consensus.cc:2468] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 7.
I20260709 13:00:39.851907  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:39.852849  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:39.853466  1523 raft_consensus.cc:2393] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 12: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:00:39.854174  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:39.837787  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:39.855804  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:39.856488  1528 raft_consensus.cc:2393] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 12: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
W20260709 13:00:39.856685  2192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:39.850565  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:39.857954  1497 leader_election.cc:304] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:39.860036  1523 raft_consensus.cc:2468] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 8.
I20260709 13:00:39.861315  1523 raft_consensus.cc:1275] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:00:39.847663  5741 raft_consensus.cc:740] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:00:39.864787  5741 consensus_queue.cc:260] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:39.865811  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:39.866822  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:39.875648  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:39.870924  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:39.873049  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 13:00:39.876518  5705 consensus_meta.cc:287] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.657s	user 0.011s	sys 0.000s
I20260709 13:00:39.871886  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:39.877439  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:39.877911  2222 raft_consensus.cc:1240] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:00:39.866454  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:39.879053  2223 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 12.
I20260709 13:00:39.866066  5741 raft_consensus.cc:3060] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:00:39.881191  5709 log.cc:927] Time spent T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.587s	user 0.007s	sys 0.005s
I20260709 13:00:39.875926  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:39.872283  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:39.882941  2218 raft_consensus.cc:2393] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 7: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:00:39.886788  1497 leader_election.cc:304] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:39.869814  5725 leader_election.cc:290] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:39.889739  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:39.890597  2225 raft_consensus.cc:2468] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 8.
I20260709 13:00:39.872439  5587 raft_consensus.cc:2749] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:39.874007  5726 raft_consensus.cc:3055] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:39.891822  5726 raft_consensus.cc:740] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:39.892644  5726 consensus_queue.cc:260] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:39.893842  5726 raft_consensus.cc:3060] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:39.885789  5612 raft_consensus.cc:493] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:39.895303  5612 raft_consensus.cc:515] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:39.897413  5612 leader_election.cc:290] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:39.900925  5729 raft_consensus.cc:2749] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:39.902040  1603 raft_consensus.cc:2410] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:00:39.902206  1523 raft_consensus.cc:1275] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:00:39.902289  1527 raft_consensus.cc:1240] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:39.903805  5687 raft_consensus.cc:515] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:39.898460  1525 raft_consensus.cc:1275] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:00:39.890844  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:39.905912  1607 raft_consensus.cc:2468] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 11.
I20260709 13:00:39.909010  1570 leader_election.cc:304] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:39.920075  5725 raft_consensus.cc:2804] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:39.920526  5725 raft_consensus.cc:493] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:39.920863  5725 raft_consensus.cc:3060] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:00:39.924401  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 210168us
W20260709 13:00:39.931761  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 146555us
I20260709 13:00:39.935083  1570 leader_election.cc:304] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:00:39.936218  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 49543.7us
I20260709 13:00:39.936926  1497 leader_election.cc:304] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:39.937561  5748 raft_consensus.cc:2749] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:39.938310  1497 leader_election.cc:400] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 election: Vote denied by peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303) with higher term. Message: Invalid argument: T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 11. Current term is 12.
I20260709 13:00:39.938782  1570 leader_election.cc:304] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:39.938927  5587 raft_consensus.cc:2804] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:39.939316  5587 raft_consensus.cc:493] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:39.939810  1524 raft_consensus.cc:1275] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:00:39.939697  5587 raft_consensus.cc:3060] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:39.940374  1570 leader_election.cc:304] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:39.934491  5599 raft_consensus.cc:2749] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:00:39.932802  1644 leader_election.cc:304] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:39.942584  5493 raft_consensus.cc:2749] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:39.943518  5729 raft_consensus.cc:2749] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:00:39.938603  1497 leader_election.cc:403] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:00:39.946192  1497 leader_election.cc:304] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:39.947468  1644 leader_election.cc:304] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:39.948231  5493 raft_consensus.cc:2749] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:39.948592  1644 leader_election.cc:304] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:39.949350  5493 raft_consensus.cc:2749] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:39.946252  1570 leader_election.cc:304] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:39.946813  5599 raft_consensus.cc:2749] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303) with higher term. Message: Invalid argument: T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 11. Current term is 12.
W20260709 13:00:39.953011  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 46203.5us
I20260709 13:00:39.955242  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:39.956764  1644 leader_election.cc:304] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:00:39.960242  5705 consensus_queue.cc:1059] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:39.952500  1570 leader_election.cc:304] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:39.933712  5335 raft_consensus.cc:493] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:39.976649  1644 leader_election.cc:304] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:39.982059  1680 raft_consensus.cc:1240] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 12 LEADER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:39.981914  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:39.986862  1607 raft_consensus.cc:2368] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 11. Current term is 12.
I20260709 13:00:39.955410  5729 raft_consensus.cc:2804] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:00:39.994586  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 48482.7us
I20260709 13:00:39.974870  1570 leader_election.cc:304] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:39.909452  5711 raft_consensus.cc:515] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:40.046121  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 71347.6us
I20260709 13:00:40.047717  1570 leader_election.cc:304] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:39.962818  5612 raft_consensus.cc:2804] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:40.002202  1497 leader_election.cc:304] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:40.045377  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:39.987799  5705 raft_consensus.cc:2804] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:40.046401  1644 leader_election.cc:304] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:00:40.055208  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:39.973598  5514 consensus_queue.cc:1048] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.078s
I20260709 13:00:39.988224  5734 raft_consensus.cc:2749] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:39.994311  5470 raft_consensus.cc:2749] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:00:39.994509  5748 raft_consensus.cc:2749] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:00:40.066084  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 91917.3us
I20260709 13:00:40.066802  1644 leader_election.cc:304] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:00:39.999802  5729 raft_consensus.cc:493] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:40.070567  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:40.050361  5612 raft_consensus.cc:493] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:40.070559  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:40.074347  2227 raft_consensus.cc:2468] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 7.
I20260709 13:00:40.055941  5708 raft_consensus.cc:2749] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:40.059821  5705 raft_consensus.cc:493] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:40.055723  5553 raft_consensus.cc:2749] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:00:40.090791  5750 log.cc:927] Time spent T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 13:00:40.062466  5663 raft_consensus.cc:2749] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:40.077565  1607 raft_consensus.cc:2393] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 15: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:00:40.095940  1675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49170 (request call id 2115) took 1472 ms. Trace:
I20260709 13:00:40.071622  5599 raft_consensus.cc:493] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.106101  5330 leader_election.cc:290] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:40.071316  5687 leader_election.cc:290] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:39.990996  5335 raft_consensus.cc:515] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:40.095300  5753 raft_consensus.cc:2749] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:40.100973  1644 leader_election.cc:304] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:40.104238  1675 rpcz_store.cc:276] 0709 13:00:38.623729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:38.623874 (+   145us) service_pool.cc:224] Handling call
0709 13:00:40.095683 (+1471809us) spinlock_profiling.cc:243] Waited 734 ms on lock 0x7b54002553d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:40.095841 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1687457536}
I20260709 13:00:40.106274  5599 raft_consensus.cc:515] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:40.106793  5493 raft_consensus.cc:2804] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:40.077907  5729 raft_consensus.cc:3060] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:40.064814  5588 raft_consensus.cc:515] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:40.103813  5612 raft_consensus.cc:3060] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:40.100932  5705 raft_consensus.cc:3060] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:00:40.130614  5757 log.cc:927] Time spent T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.208s	user 0.003s	sys 0.000s
I20260709 13:00:40.122711  5648 raft_consensus.cc:993] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b: : Instructing follower e46412b3b0b44f01ad5c33d4cfe3d6b1 to start an election
I20260709 13:00:40.148350  5725 raft_consensus.cc:515] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:40.149147  5470 raft_consensus.cc:493] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:00:40.149691  5470 raft_consensus.cc:515] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:40.133224  1529 raft_consensus.cc:2393] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 13: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:00:40.132915  1600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36194 (request call id 1711) took 1615 ms. Trace:
I20260709 13:00:40.152415  5725 leader_election.cc:290] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:40.152117  5698 raft_consensus.cc:493] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.153532  5698 raft_consensus.cc:515] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:40.154920  5493 raft_consensus.cc:697] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 8 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:40.155743  5698 leader_election.cc:290] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:40.151589  1600 rpcz_store.cc:276] 0709 13:00:38.517390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:38.518729 (+  1339us) service_pool.cc:224] Handling call
0709 13:00:38.787015 (+268286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:38.810961 (+ 23946us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:40.132693 (+1321732us) spinlock_profiling.cc:243] Waited 268 ms on lock 0x7b54001a9fd0. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b28ad 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:40.132828 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":616361728}
I20260709 13:00:40.123099  5335 leader_election.cc:290] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:40.123759  5730 raft_consensus.cc:3055] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:40.126137  5692 raft_consensus.cc:3060] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:40.129009  5711 leader_election.cc:290] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 10 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:40.129844  5291 raft_consensus.cc:515] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:40.159694  5729 raft_consensus.cc:515] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:40.132050  5588 leader_election.cc:290] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:40.132447  5599 leader_election.cc:290] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:40.137528  5637 consensus_queue.cc:1048] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:40.056723  5732 raft_consensus.cc:515] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:40.098963  5587 raft_consensus.cc:515] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:40.143740  5664 raft_consensus.cc:2749] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:40.144389  5746 consensus_queue.cc:1059] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:40.163475  5705 raft_consensus.cc:515] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:00:40.189623  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 83024.2us
W20260709 13:00:40.189872  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 126338us
I20260709 13:00:40.192853  5732 leader_election.cc:290] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:40.193826  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:40.160609  5730 raft_consensus.cc:740] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:40.214763  1600 raft_consensus.cc:3060] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:40.148368  5648 raft_consensus.cc:1081] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 10 LEADER]: Signalling peer e46412b3b0b44f01ad5c33d4cfe3d6b1 to start an election
I20260709 13:00:40.218947  1525 raft_consensus.cc:1275] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:00:40.220423  1526 raft_consensus.cc:1275] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:40.221650  5730 consensus_queue.cc:260] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:40.222636  5291 leader_election.cc:290] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:40.216984  1572 leader_election.cc:304] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:00:40.230866  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:40.228324  5725 raft_consensus.cc:2804] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:40.231520  5725 raft_consensus.cc:493] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:40.231726  1525 raft_consensus.cc:2393] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 10: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:00:40.232038  5725 raft_consensus.cc:3060] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:40.155993  5493 consensus_queue.cc:237] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:40.235497  5747 raft_consensus.cc:3055] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:40.235764  1600 raft_consensus.cc:2468] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 10.
W20260709 13:00:40.239326  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 237202us
I20260709 13:00:40.240414  1497 leader_election.cc:304] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:40.241160  1600 raft_consensus.cc:3055] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:40.241602  1600 raft_consensus.cc:740] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:40.242436  1600 consensus_queue.cc:260] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:40.243494  1600 raft_consensus.cc:3060] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:40.245594  1601 raft_consensus.cc:1240] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 12 LEADER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:40.238708  5729 leader_election.cc:290] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:40.256510  1497 leader_election.cc:304] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:40.257609  5599 raft_consensus.cc:2804] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:40.258045  5599 raft_consensus.cc:493] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:40.258455  5599 raft_consensus.cc:3060] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:40.258988  1497 leader_election.cc:400] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303) with higher term. Message: Invalid argument: T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 11. Current term is 12.
I20260709 13:00:40.262467  1497 leader_election.cc:304] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:40.235932  5747 raft_consensus.cc:740] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:40.251128  5732 consensus_queue.cc:1048] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:00:40.446009  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:40.451524  5762 raft_consensus.cc:2749] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:40.451666  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:40.288898  1523 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41"
dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:49310
I20260709 13:00:40.288594  1524 raft_consensus.cc:1275] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 13:00:40.440474  5719 log.cc:927] Time spent T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 1.052s	user 0.008s	sys 0.005s
I20260709 13:00:40.451189  1529 raft_consensus.cc:1240] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:40.317775  2192 leader_election.cc:304] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:00:40.454474  5520 raft_consensus.cc:993] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b: : Instructing follower e46412b3b0b44f01ad5c33d4cfe3d6b1 to start an election
I20260709 13:00:40.456022  5520 raft_consensus.cc:1081] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 11 LEADER]: Signalling peer e46412b3b0b44f01ad5c33d4cfe3d6b1 to start an election
I20260709 13:00:40.456033  5764 raft_consensus.cc:2804] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:40.454509  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:40.456810  5764 raft_consensus.cc:697] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 10 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:40.457082  2221 raft_consensus.cc:2468] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 10.
I20260709 13:00:40.457796  5764 consensus_queue.cc:237] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:40.361764  1570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:40.284413  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 13:00:40.304610  5679 log.cc:927] Time spent T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 1.386s	user 0.001s	sys 0.004s
I20260709 13:00:40.463229  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:40.454600  2222 raft_consensus.cc:1240] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 10 LEADER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:40.435024  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36200 (request call id 2294) took 1565 ms. Trace:
I20260709 13:00:40.250607  5730 raft_consensus.cc:3060] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:40.412762  1527 raft_consensus.cc:1240] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:40.332903  5705 leader_election.cc:290] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:40.360549  2220 raft_consensus.cc:2468] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 9.
I20260709 13:00:40.447325  1496 leader_election.cc:304] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:40.317970  1607 raft_consensus.cc:1240] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:40.291509  5725 raft_consensus.cc:515] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:40.464308  5717 log.cc:927] Time spent T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 1.070s	user 0.004s	sys 0.000s
I20260709 13:00:40.337261  5686 raft_consensus.cc:3060] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:40.415715  5715 consensus_queue.cc:1048] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 13:00:40.469240  5762 raft_consensus.cc:3060] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:40.386618  5612 raft_consensus.cc:515] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:40.416929  1598 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36200 (request call id 2301) took 1544 ms (client timeout 2020 ms). Trace:
W20260709 13:00:40.471874  1598 rpcz_store.cc:269] 0709 13:00:38.872118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:38.906396 (+ 34278us) service_pool.cc:224] Handling call
0709 13:00:40.416716 (+1510320us) spinlock_profiling.cc:243] Waited 556 ms on lock 0x7b54001685d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:40.416831 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1278136192}
I20260709 13:00:40.438839  5594 consensus_queue.cc:1048] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:00:40.473592  5612 leader_election.cc:290] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:40.318547  5603 raft_consensus.cc:493] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.417447  2219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50326 (request call id 900) took 1476 ms. Trace:
W20260709 13:00:40.468741  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 52493.3us
W20260709 13:00:40.389816  5752 log.cc:927] Time spent T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.295s	user 0.001s	sys 0.000s
I20260709 13:00:40.415632  5640 consensus_queue.cc:1048] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 13:00:40.443528  2226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:47682 (request call id 21) took 1320 ms. Trace:
I20260709 13:00:40.474812  2219 rpcz_store.cc:276] 0709 13:00:38.941443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:38.945793 (+  4350us) service_pool.cc:224] Handling call
0709 13:00:39.055983 (+110190us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:39.070363 (+ 14380us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:40.417230 (+1346867us) spinlock_profiling.cc:243] Waited 91.7 ms on lock 0x7b540069fd50. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b28ad 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:40.417365 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":210995072}
I20260709 13:00:40.475250  2226 rpcz_store.cc:276] 0709 13:00:39.123277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:39.131309 (+  8032us) service_pool.cc:224] Handling call
0709 13:00:40.443224 (+1311915us) spinlock_profiling.cc:243] Waited 153 ms on lock 0x7b5400133e20. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a1852e5e7 00007f6a185adc68 00007f6a185ad84a 00007f6a1d57b60a 00007f6a16b017d4 00007f6a16b01762 00007f6a16b01691 00007f6a16b0160c 00007f6a16b008c2 00007f6a168ee48c
0709 13:00:40.443435 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":351579520}
I20260709 13:00:40.476174  5725 leader_election.cc:290] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:40.476527  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43010 (request call id 2149) took 1030 ms. Trace:
I20260709 13:00:40.559785  1532 rpcz_store.cc:276] 0709 13:00:39.446381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:39.521558 (+ 75177us) service_pool.cc:224] Handling call
0709 13:00:39.521892 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:39.532601 (+ 10709us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:00:39.643671 (+111070us) log.cc:844] Serialized 14 byte log entry
0709 13:00:39.931311 (+287640us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:39.936636 (+  5325us) log.cc:844] Serialized 26 byte log entry
0709 13:00:39.936781 (+   145us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:40.334809 (+398028us) spinlock_profiling.cc:243] Waited 2.14 ms on lock 0x7b1800404860. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1e38ede1 00007f6a1e39b5b1 00007f6a15440c0a 00007f6a1eb80219 00007f6a154c8a40 00007f6a154c34e4 00007f6a154c3455 00007f6a1bfab3c7 00007f6a185bd9a7 00007f6a185cd0bf 00007f6a185cd038
0709 13:00:40.335051 (+   242us) log.cc:844] Serialized 14 byte log entry
0709 13:00:40.335260 (+   209us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:40.335338 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:40.389011 (+ 53673us) spinlock_profiling.cc:243] Waited 1.24 ms on lock 0x7b4400022b4c. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a153ecc85 00007f6a153ed6a2 00007f6a1815f1db 00007f6a1815aaaf 00007f6a1814e86e 00007f6a1814dbb6 00007f6a1814d7d8 00007f6a18157221 00007f6a181571d9 00007f6a18157169
0709 13:00:40.476315 (+ 87304us) raft_consensus.cc:1685] finished
0709 13:00:40.476335 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:40.476474 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37293,"prepare.queue_time_us":533190,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":81,"raft.queue_time_us":36483,"raft.run_cpu_time_us":358,"raft.run_wall_time_us":27560,"spinlock_wait_cycles":7770880,"thread_start_us":317670,"threads_started":2,"wal-append.queue_time_us":394778}
I20260709 13:00:40.466461  1601 rpcz_store.cc:276] 0709 13:00:38.869841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:38.870028 (+   187us) service_pool.cc:224] Handling call
0709 13:00:38.909232 (+ 39204us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:40.246104 (+1336872us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:40.434709 (+188605us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b54001694d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:00:40.434951 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3073152256}
W20260709 13:00:40.434128  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:40.563391  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:40.565128  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:40.569533  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:40.571349  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:40.572475  5760 raft_consensus.cc:493] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.263841  5587 leader_election.cc:290] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:40.573056  5760 raft_consensus.cc:515] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:40.479779  5761 consensus_queue.cc:1048] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:40.479790  2224 raft_consensus.cc:1240] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 8 LEADER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:40.480721  2226 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce"
dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
mode: GRACEFUL
new_leader_uuid: "39a92f5a4352465d8af3af5908fe8642"
 from {username='slave'} at 127.0.0.1:47682
I20260709 13:00:40.575383  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:40.481356  5603 raft_consensus.cc:515] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:40.576586  5760 leader_election.cc:290] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:40.577543  5603 leader_election.cc:290] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:40.297878  5470 leader_election.cc:290] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:40.339258  5699 raft_consensus.cc:993] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b: : Instructing follower e46412b3b0b44f01ad5c33d4cfe3d6b1 to start an election
I20260709 13:00:40.579057  1603 raft_consensus.cc:1275] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:00:40.578619  5699 raft_consensus.cc:1081] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 10 LEADER]: Signalling peer e46412b3b0b44f01ad5c33d4cfe3d6b1 to start an election
I20260709 13:00:40.580235  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:40.580893  1680 raft_consensus.cc:3060] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:40.575784  2226 raft_consensus.cc:606] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Received request to transfer leadership to TS 39a92f5a4352465d8af3af5908fe8642
I20260709 13:00:40.584905  2226 raft_consensus.cc:614] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:40.318634  5728 raft_consensus.cc:493] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:40.441753  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:40.286309  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:40.452916  1523 raft_consensus.cc:493] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:40.484124  5747 consensus_queue.cc:260] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:40.310963  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:40.485888  5640 consensus_queue.cc:1059] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:40.482847  5534 consensus_queue.cc:1059] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
W20260709 13:00:40.464542  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 202158us
W20260709 13:00:40.488610  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:40.352515  1644 leader_election.cc:336] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 2.012s (SENT)
I20260709 13:00:40.687685  1644 leader_election.cc:304] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:40.502041  5599 raft_consensus.cc:515] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:40.484723  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 167032us
I20260709 13:00:40.520789  1529 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2"
dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:49310
I20260709 13:00:40.692233  1529 raft_consensus.cc:493] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:40.692667  1529 raft_consensus.cc:3060] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:40.531271  1572 leader_election.cc:304] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
W20260709 13:00:40.693972  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 162806us
I20260709 13:00:40.362143  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:40.293481  1600 raft_consensus.cc:1275] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:00:40.378490  1646 leader_election.cc:304] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:40.463486  2227 raft_consensus.cc:2393] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 8: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:00:40.551898  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:40.695475  2220 raft_consensus.cc:3060] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:40.266929  5291 raft_consensus.cc:2804] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:40.363107  5496 raft_consensus.cc:3060] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:40.557041  5762 raft_consensus.cc:2749] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:40.559244  1674 raft_consensus.cc:1275] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:00:40.712683  1674 pending_rounds.cc:85] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90: Aborting all ops after (but not including) 6
I20260709 13:00:40.712975  1674 pending_rounds.cc:107] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:00:40.713224  1674 raft_consensus.cc:2889] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:40.587795  1523 raft_consensus.cc:3060] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:40.589854  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:40.590831  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:40.593823  1680 raft_consensus.cc:2468] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 11.
I20260709 13:00:40.599835  1497 leader_election.cc:400] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 election: Vote denied by peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303) with higher term. Message: Invalid argument: T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 11. Current term is 12.
I20260709 13:00:40.600170  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:40.603300  2225 raft_consensus.cc:2468] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 12.
I20260709 13:00:40.623602  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:00:40.639495  1428 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46260 (request call id 365) took 31205 ms (client timeout 15000 ms). Trace:
I20260709 13:00:40.639120  1430 catalog_manager.cc:5697] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 8 to 10, leader changed from ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) to 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194). New cstate: current_term: 10 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:40.705358  5291 raft_consensus.cc:493] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:40.716048  1531 raft_consensus.cc:2468] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 12.
I20260709 13:00:40.717713  5291 raft_consensus.cc:3060] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:40.717391  1430 catalog_manager.cc:5697] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:40.718461  1531 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0"
dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:49310
I20260709 13:00:40.640430  5760 raft_consensus.cc:3055] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:40.719067  1531 raft_consensus.cc:493] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:40.719521  1531 raft_consensus.cc:3060] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:00:40.723001  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 123305us
I20260709 13:00:40.723820  1497 leader_election.cc:304] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:40.641064  1672 raft_consensus.cc:2468] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 13.
I20260709 13:00:40.724141  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:40.724771  1678 raft_consensus.cc:2468] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 10.
I20260709 13:00:40.725407  1571 leader_election.cc:304] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:40.725907  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:40.715519  5698 consensus_queue.cc:1059] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 13:00:40.727027  5698 consensus_queue.cc:1243] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer b96ce9cc496c49d7818fa983a17b062b log is divergent from this leader: its last log entry 10.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:00:40.727602  5698 raft_consensus.cc:2749] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:40.729141  5698 raft_consensus.cc:3055] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:40.729529  5698 raft_consensus.cc:740] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:40.730966  5760 raft_consensus.cc:740] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:40.715693  5493 raft_consensus.cc:2804] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:40.732607  5493 raft_consensus.cc:697] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 12 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:40.710180  5500 raft_consensus.cc:2749] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:40.733558  2227 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24"
dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
mode: GRACEFUL
new_leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:47682
I20260709 13:00:40.593484  5728 raft_consensus.cc:515] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:40.687009  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 81653.1us
W20260709 13:00:40.701848  5789 log.cc:927] Time spent T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 13:00:40.704779  1496 leader_election.cc:304] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:40.695125  1600 pending_rounds.cc:85] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642: Aborting all ops after (but not including) 7
W20260709 13:00:40.706148  1570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:40.738341  1600 pending_rounds.cc:107] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642: Aborting uncommitted NO_OP operation due to leader change: 7.8
W20260709 13:00:40.708812  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 330397us
I20260709 13:00:40.739151  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:40.709697  2220 raft_consensus.cc:2468] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 8.
I20260709 13:00:40.734709  2227 raft_consensus.cc:606] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 6 LEADER]: Received request to transfer leadership to TS e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:40.714361  1673 raft_consensus.cc:2468] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 12.
I20260709 13:00:40.740577  1675 raft_consensus.cc:1240] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 8 LEADER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:40.741978  1675 raft_consensus.cc:1275] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:00:40.742201  2191 leader_election.cc:304] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:40.739779  1646 leader_election.cc:304] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:40.735098  1678 raft_consensus.cc:1240] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:40.733932  1532 raft_consensus.cc:1240] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:40.732895  1672 raft_consensus.cc:1275] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:00:40.743134  1600 raft_consensus.cc:2889] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:40.755308  1646 leader_election.cc:304] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b
W20260709 13:00:40.751256  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 52224.5us
I20260709 13:00:40.731797  5599 leader_election.cc:290] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:40.710696  5727 raft_consensus.cc:2804] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:40.769119  2223 raft_consensus.cc:2393] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 13: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:00:40.759061  1675 raft_consensus.cc:1275] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:00:40.760401  1496 leader_election.cc:304] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:40.765904  1646 leader_election.cc:304] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:00:40.757884  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 51141.7us
W20260709 13:00:40.716475  1428 rpcz_store.cc:269] 0709 13:00:09.434406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:09.449690 (+ 15284us) service_pool.cc:224] Handling call
0709 13:00:40.639378 (+31189688us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:38.035204 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:38.035838 (+   634us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:38.035896 (+    58us) write_op.cc:435] Acquired schema lock
0709 13:00:38.035914 (+    18us) tablet.cc:662] Decoding operations
0709 13:00:38.106279 (+ 70365us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:38.106372 (+    93us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:38.106403 (+    31us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:00:38.179915 (+ 73512us) tablet.cc:701] Row locks acquired
0709 13:00:38.179969 (+    54us) write_op.cc:260] PREPARE: finished
0709 13:00:38.180187 (+   218us) write_op.cc:270] Start()
0709 13:00:38.180349 (+   162us) write_op.cc:276] Timestamp: P: 1783602038180087 usec, L: 0
0709 13:00:38.180391 (+    42us) op_driver.cc:348] REPLICATION: starting
0709 13:00:38.181077 (+   686us) log.cc:844] Serialized 4456 byte log entry
0709 13:00:38.398784 (+217707us) spinlock_profiling.cc:243] Waited 5.71 ms on lock 0x7b4400022b4c. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a153ecc85 00007f6a153ed6a2 00007f6a1815f1db 00007f6a1815aaaf 00007f6a1814e86e 00007f6a1814dbb6 00007f6a1814d7d8 00007f6a18157221 00007f6a181571d9 00007f6a18157169
0709 13:00:38.627294 (+228510us) op_driver.cc:464] REPLICATION: finished
0709 13:00:38.853321 (+226027us) write_op.cc:301] APPLY: starting
0709 13:00:38.876566 (+ 23245us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:38.903574 (+ 27008us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:38.903623 (+    49us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:39.050865 (+147242us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:39.086291 (+ 35426us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=22
0709 13:00:39.103119 (+ 16828us) write_op.cc:312] APPLY: finished
0709 13:00:39.163285 (+ 60166us) log.cc:844] Serialized 83 byte log entry
0709 13:00:39.174450 (+ 11165us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:39.179655 (+  5205us) write_op.cc:454] Released schema lock
0709 13:00:39.191441 (+ 11786us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:39.220916 (+ 29475us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:39.220949 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4510607,"reported_tablets":35,"child_traces":[["op",{"apply.queue_time_us":197941,"apply.run_cpu_time_us":6168,"apply.run_wall_time_us":376286,"num_ops":11,"prepare.queue_time_us":208920,"prepare.run_cpu_time_us":30186,"prepare.run_wall_time_us":231319,"raft.queue_time_us":225732,"raft.run_cpu_time_us":28517,"raft.run_wall_time_us":131660,"replication_time_us":446721,"spinlock_wait_cycles":13201536,"thread_start_us":375158,"threads_started":4,"wal-append.queue_time_us":61105,"wal-append.run_cpu_time_us":33311,"wal-append.run_wall_time_us":1973056}]]}
I20260709 13:00:40.762621  1572 leader_election.cc:304] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:00:40.795392  2227 raft_consensus.cc:1275] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:00:40.745060  5686 raft_consensus.cc:493] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.788735  1531 raft_consensus.cc:515] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:40.798815  1523 raft_consensus.cc:515] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:40.751756  5732 raft_consensus.cc:2749] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:00:40.853482  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 87639.3us
W20260709 13:00:40.850807  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 510492us
W20260709 13:00:40.847088  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 123353us
W20260709 13:00:40.847756  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 50986us
I20260709 13:00:40.849010  1527 raft_consensus.cc:1240] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:40.779513  1529 raft_consensus.cc:515] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:40.757936  5730 raft_consensus.cc:2749] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:00:40.752445  5762 raft_consensus.cc:2749] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:40.850227  5599 raft_consensus.cc:2804] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:00:40.819199  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 58864.3us
I20260709 13:00:40.761528  5553 consensus_queue.cc:1048] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.093s
I20260709 13:00:40.858101  1497 leader_election.cc:304] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:40.859982  5664 consensus_queue.cc:1048] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:40.802861  5590 consensus_queue.cc:1048] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 13:00:40.731964  5760 consensus_queue.cc:260] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:40.861927  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 70052.6us
I20260709 13:00:40.864682  1599 raft_consensus.cc:1275] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:00:40.899963  1529 leader_election.cc:290] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:40.865044  5660 raft_consensus.cc:2804] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:40.783183  5727 raft_consensus.cc:493] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:40.868902  1531 leader_election.cc:290] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:00:40.765761  5791 log.cc:927] Time spent T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:00:40.719089  1430 catalog_manager.cc:5697] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 9 to 11, leader changed from 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195), now has a pending config: VOTER e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193), VOTER 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194), VOTER ddf11fc190dd4b898773379c6b129d90 (127.0.107.195), VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196). New cstate: current_term: 11 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } } pending_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:00:40.892891  1678 raft_consensus.cc:1240] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:40.756698  5470 consensus_queue.cc:1048] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.098s
I20260709 13:00:40.781047  5438 raft_consensus.cc:2804] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:40.846746  5296 raft_consensus.cc:2804] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:40.895334  1604 raft_consensus.cc:1240] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:40.908172  5727 raft_consensus.cc:3060] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:40.922348  5760 raft_consensus.cc:3060] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:40.924240  1681 raft_consensus.cc:1275] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:00:40.803238  5729 consensus_queue.cc:1059] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.118s
I20260709 13:00:40.900416  1496 leader_election.cc:304] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:40.855734  1523 leader_election.cc:290] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:00:40.905716  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 47705.2us
I20260709 13:00:40.867449  5686 raft_consensus.cc:515] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:40.901304  5732 raft_consensus.cc:3060] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:40.804085  5726 raft_consensus.cc:2804] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:40.898087  5599 raft_consensus.cc:697] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:00:40.947726  5715 consensus_queue.cc:1059] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:00:40.943207  5296 raft_consensus.cc:697] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 8 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:40.952127  5296 consensus_queue.cc:237] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:40.953316  1672 raft_consensus.cc:1240] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:00:40.953837  5599 consensus_queue.cc:237] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:40.928313  1430 catalog_manager.cc:5697] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } }
I20260709 13:00:40.973289  1677 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fbb85f388454464192e052f706a78e65"
dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
mode: GRACEFUL
new_leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:33616
I20260709 13:00:40.974006  1677 raft_consensus.cc:606] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 9 LEADER]: Received request to transfer leadership to TS e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:40.936970  5705 raft_consensus.cc:493] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.977239  1430 catalog_manager.cc:5697] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:40.926672  5660 raft_consensus.cc:697] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 10 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:40.978921  1430 catalog_manager.cc:5697] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 10 to 13, leader changed from 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 13 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:00:40.979162  5660 consensus_queue.cc:237] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:40.980290  1430 catalog_manager.cc:5697] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:00:40.948482  5726 raft_consensus.cc:493] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:40.981509  1430 catalog_manager.cc:5697] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } }
I20260709 13:00:40.982192  5726 raft_consensus.cc:3060] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:40.866888  5698 consensus_queue.cc:260] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:40.986279  1430 catalog_manager.cc:5697] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 4 to 10. New cstate: current_term: 10 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:40.984719  1497 leader_election.cc:304] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:40.927134  5739 raft_consensus.cc:493] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.944591  5612 raft_consensus.cc:2804] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:40.943936  5438 raft_consensus.cc:493] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:40.895512  5493 consensus_queue.cc:237] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:00:40.983543  5779 log.cc:927] Time spent T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 13:00:40.925637  5592 consensus_queue.cc:1048] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.065s
W20260709 13:00:41.047199  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 62580.4us
I20260709 13:00:41.019904  1430 catalog_manager.cc:5697] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 4 to 8, leader changed from b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) to 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194). New cstate: current_term: 8 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:00:41.041631  1570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:41.039569  5438 raft_consensus.cc:3060] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:41.072100  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:41.069594  1430 catalog_manager.cc:5697] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 4 to 6, leader changed from ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) to e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193). New cstate: current_term: 6 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } }
I20260709 13:00:41.073520  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:41.077147  1570 leader_election.cc:304] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:41.078002  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:41.074433  1430 catalog_manager.cc:5697] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 5 to 11. New cstate: current_term: 11 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } }
I20260709 13:00:41.079169  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: true dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:41.079720  1598 raft_consensus.cc:3060] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:41.080000  1430 catalog_manager.cc:5697] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 2 to 6, leader changed from b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) to 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194). New cstate: current_term: 6 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:41.047833  5698 raft_consensus.cc:3060] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:41.093722  1430 catalog_manager.cc:5697] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } }
I20260709 13:00:41.095180  1570 leader_election.cc:304] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:41.099002  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:41.048347  5587 raft_consensus.cc:2749] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:41.048512  5762 raft_consensus.cc:493] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:41.102630  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:41.103592  1600 raft_consensus.cc:2393] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 13: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:00:41.103668  1570 leader_election.cc:304] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:41.072956  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:41.104669  1601 raft_consensus.cc:2393] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 10: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:00:41.102628  1430 catalog_manager.cc:5697] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 5 to 9, leader changed from ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) to 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194). New cstate: current_term: 9 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:41.105916  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:41.106294  1430 catalog_manager.cc:5697] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:00:40.988757  5705 raft_consensus.cc:515] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:41.109038  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:41.110581  1430 catalog_manager.cc:5697] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 4 to 10. New cstate: current_term: 10 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } }
W20260709 13:00:41.115347  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 172886us
I20260709 13:00:41.115655  1570 leader_election.cc:304] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:41.110489  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:41.070600  5486 consensus_queue.cc:1048] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 13:00:41.120664  1570 leader_election.cc:304] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:41.099500  5723 raft_consensus.cc:2749] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:00:41.121345  1418 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.420s	user 0.002s	sys 0.038s
W20260709 13:00:41.123293  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:41.111361  5728 leader_election.cc:290] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:41.127053  1644 leader_election.cc:304] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:00:41.115542  5729 raft_consensus.cc:2749] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:41.121948  5553 raft_consensus.cc:2749] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:41.127040  1570 leader_election.cc:304] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:41.138191  1644 leader_election.cc:304] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:00:41.124958  5470 raft_consensus.cc:493] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.143548  5535 raft_consensus.cc:2804] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:41.126817  5530 raft_consensus.cc:2804] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:41.129705  5664 raft_consensus.cc:493] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.150036  1598 raft_consensus.cc:2468] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 11.
I20260709 13:00:41.144055  5496 raft_consensus.cc:493] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.127403  5697 consensus_queue.cc:1048] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:00:41.112725  1430 catalog_manager.cc:5697] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: config changed from index 2 to 5, term changed from 4 to 7, leader changed from ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) to b96ce9cc496c49d7818fa983a17b062b (127.0.107.196), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 7 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:00:41.150422  1644 leader_election.cc:304] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:41.148638  5535 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:41.146113  5710 raft_consensus.cc:493] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:41.159734  1430 catalog_manager.cc:5697] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:00:41.160377  5496 raft_consensus.cc:515] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:41.161963  5291 raft_consensus.cc:515] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:41.179142  5797 log.cc:927] Time spent T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 13:00:41.180593  5668 raft_consensus.cc:2804] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:41.112414  5762 raft_consensus.cc:515] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:41.187570  5730 consensus_queue.cc:1048] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:00:41.149053  5530 raft_consensus.cc:493] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:41.192428  1430 catalog_manager.cc:5697] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } }
I20260709 13:00:41.182332  5500 raft_consensus.cc:2749] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:41.147923  5664 raft_consensus.cc:515] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:41.038923  5739 raft_consensus.cc:515] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:41.149626  5470 raft_consensus.cc:515] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:41.189458  5535 raft_consensus.cc:3060] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:41.190495  5727 raft_consensus.cc:515] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:41.219285  5530 raft_consensus.cc:3060] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:41.222533  5796 log.cc:927] Time spent T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
I20260709 13:00:41.193545  5710 raft_consensus.cc:515] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:41.213850  1430 catalog_manager.cc:5697] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:41.231129  5587 raft_consensus.cc:493] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.251040  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
W20260709 13:00:41.251318  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 266728us
I20260709 13:00:41.251706  1526 raft_consensus.cc:2376] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 12. Re-sending same reply.
I20260709 13:00:41.246384  1430 catalog_manager.cc:5697] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:41.259231  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:41.263528  1529 raft_consensus.cc:2393] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 8: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
W20260709 13:00:41.252102  5798 log.cc:927] Time spent T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 13:00:41.247452  5612 raft_consensus.cc:697] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
W20260709 13:00:41.272037  2191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:41.241808  5804 consensus_queue.cc:1059] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:00:41.243001  5726 raft_consensus.cc:515] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:41.275949  1523 raft_consensus.cc:1275] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:00:41.250638  5500 consensus_queue.cc:1048] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:00:41.269114  1430 catalog_manager.cc:5697] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } }
I20260709 13:00:41.296046  1430 catalog_manager.cc:5697] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:00:41.278851  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:41.297364  1529 raft_consensus.cc:3060] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:41.279011  1497 leader_election.cc:304] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:41.282452  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:41.253261  5587 raft_consensus.cc:515] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:41.300243  2227 raft_consensus.cc:1275] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:00:41.303824  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:41.303377  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:41.306226  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:41.303354  1430 catalog_manager.cc:5697] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:00:41.309881  1430 catalog_manager.cc:5697] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 5 to 8, leader changed from 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 8 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:00:41.313161  1430 catalog_manager.cc:5697] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 4 to 7, leader changed from e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) to 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194). New cstate: current_term: 7 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:41.316118  2227 raft_consensus.cc:2368] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 7. Current term is 8.
I20260709 13:00:41.317104  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:41.318429  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:41.323992  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 13:00:41.325728  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 49182.4us
I20260709 13:00:41.331859  1529 raft_consensus.cc:2468] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 13.
W20260709 13:00:41.332559  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 137467us
I20260709 13:00:41.341740  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:41.342345  1679 raft_consensus.cc:3060] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:00:41.345413  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 402566us
I20260709 13:00:41.333216  5438 raft_consensus.cc:515] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:41.333810  5496 leader_election.cc:290] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:41.359735  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:41.343418  5668 raft_consensus.cc:697] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 12 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:41.341388  5812 raft_consensus.cc:2749] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:41.351585  5664 leader_election.cc:290] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:41.379446  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:41.379701  1672 raft_consensus.cc:1240] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:41.380105  2219 raft_consensus.cc:3055] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:41.380628  2219 raft_consensus.cc:740] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:41.381500  5470 leader_election.cc:290] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:41.381841  2219 consensus_queue.cc:260] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:41.382843  2219 raft_consensus.cc:3060] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:41.384344  5747 raft_consensus.cc:3060] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:41.381534  5812 consensus_queue.cc:1059] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
W20260709 13:00:41.387086  5805 log.cc:927] Time spent T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 13:00:41.388736  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: true dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:41.389329  2224 raft_consensus.cc:3055] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:41.389621  2224 raft_consensus.cc:740] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:41.390363  2224 consensus_queue.cc:260] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:41.391520  1679 raft_consensus.cc:2468] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 11.
I20260709 13:00:41.391649  2224 raft_consensus.cc:3060] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:41.392534  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50664 (request call id 929) took 1408 ms. Trace:
I20260709 13:00:41.392789  1496 leader_election.cc:304] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:41.396982  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:41.397504  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 14 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:41.398283  1679 raft_consensus.cc:2410] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 13:00:41.350157  5730 consensus_queue.cc:1048] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:00:41.391682  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:41.400478  1673 raft_consensus.cc:1240] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:41.407974  2224 raft_consensus.cc:2468] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 11.
I20260709 13:00:41.409041  2219 raft_consensus.cc:2468] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 11.
I20260709 13:00:41.404004  1681 rpcz_store.cc:276] 0709 13:00:39.983756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:39.991193 (+  7437us) service_pool.cc:224] Handling call
0709 13:00:40.052542 (+ 61349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:40.924643 (+872101us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:41.392284 (+467641us) spinlock_profiling.cc:243] Waited 871 ms on lock 0x7b54002fba54. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:00:41.392454 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2004052736}
I20260709 13:00:41.370311  5291 leader_election.cc:290] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:41.368360  5762 leader_election.cc:290] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:41.438192  5291 raft_consensus.cc:2804] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:41.438812  5762 raft_consensus.cc:493] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.439332  5762 raft_consensus.cc:515] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:41.440032  5438 leader_election.cc:290] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:41.415135  5599 raft_consensus.cc:3055] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:41.441386  5762 leader_election.cc:290] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:41.449520  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 13:00:41.450618  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 123533us
I20260709 13:00:41.380386  5727 leader_election.cc:290] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:41.452733  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:41.456670  2227 raft_consensus.cc:2468] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 12.
I20260709 13:00:41.457726  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:41.441972  5762 raft_consensus.cc:493] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:41.458590  1646 leader_election.cc:304] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:41.463048  2219 raft_consensus.cc:1275] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 13:00:41.456164  5732 consensus_meta.cc:287] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent flushing consensus metadata: real 0.508s	user 0.007s	sys 0.003s
I20260709 13:00:41.445508  5599 raft_consensus.cc:740] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
W20260709 13:00:41.460376  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 67680.2us
I20260709 13:00:41.448963  5697 raft_consensus.cc:493] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.438812  5291 raft_consensus.cc:697] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:00:41.453383  1497 leader_election.cc:304] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:41.370764  5612 consensus_queue.cc:237] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:41.484087  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 14 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:41.487908  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:41.466471  5438 raft_consensus.cc:2804] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:41.479269  5697 raft_consensus.cc:515] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:41.496601  1497 leader_election.cc:304] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:41.476394  5732 raft_consensus.cc:2749] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:41.502553  1526 raft_consensus.cc:1240] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:41.504340  1528 raft_consensus.cc:1240] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:41.507794  1497 leader_election.cc:304] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:00:41.464712  5762 raft_consensus.cc:515] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:41.511762  1526 raft_consensus.cc:1240] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:41.513015  2225 raft_consensus.cc:2468] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 9.
I20260709 13:00:41.497695  5438 raft_consensus.cc:493] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:41.519923  1497 leader_election.cc:400] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 election: Vote denied by peer b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373) with higher term. Message: Invalid argument: T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 7. Current term is 8.
I20260709 13:00:41.529021  1497 leader_election.cc:403] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:00:41.533015  2226 raft_consensus.cc:2468] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 12.
I20260709 13:00:41.503928  5826 raft_consensus.cc:2749] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:41.513882  5827 raft_consensus.cc:2804] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:41.537323  5587 leader_election.cc:290] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:41.538144  5438 raft_consensus.cc:3060] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:41.477577  5668 consensus_queue.cc:237] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:41.542486  5732 raft_consensus.cc:2804] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:41.559362  5827 raft_consensus.cc:697] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:00:41.567672  5827 consensus_queue.cc:237] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:41.551678  5822 raft_consensus.cc:3060] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:41.577237  1526 raft_consensus.cc:1275] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 13:00:41.577703  1526 pending_rounds.cc:85] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting all ops after (but not including) 7
I20260709 13:00:41.577916  1526 pending_rounds.cc:107] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:00:41.578164  1526 raft_consensus.cc:2889] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:00:41.583292  5821 log.cc:927] Time spent T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:00:41.584030  5697 leader_election.cc:290] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:41.591542  5762 leader_election.cc:290] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:41.561332  5291 consensus_queue.cc:237] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:41.560331  5732 raft_consensus.cc:493] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:41.599988   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:00:41.600152  5732 raft_consensus.cc:3060] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:41.601917   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:41.710994  1418 maintenance_manager.cc:643] P 9f38d0e5c9db43a48554defe1153354e: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 4.785s	user 0.178s	sys 0.080s Metrics: {"bytes_written":30152,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":304366,"dirs.run_cpu_time_us":458,"dirs.run_wall_time_us":8807,"drs_written":1,"lbm_read_time_us":444,"lbm_reads_lt_1ms":4,"lbm_write_time_us":151855,"lbm_writes_1-10_ms":3,"lbm_writes_10-100_ms":5,"lbm_writes_lt_1ms":26,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"thread_start_us":381298,"threads_started":2,"update_count":11,"wal-append.queue_time_us":366725}
I20260709 13:00:41.713131  5803 raft_consensus.cc:3055] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:41.713624  5803 raft_consensus.cc:740] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:41.716292  5739 leader_election.cc:290] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:41.718163  5710 leader_election.cc:290] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:41.719203  5535 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:41.721801  5705 leader_election.cc:290] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:41.723841  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:41.724858  1680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49170 (request call id 2139) took 1022 ms. Trace:
I20260709 13:00:41.725358  1419 maintenance_manager.cc:419] P 9f38d0e5c9db43a48554defe1153354e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 9967 bytes on disk
W20260709 13:00:41.727326  1644 leader_election.cc:336] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.548s (SENT)
W20260709 13:00:41.736495  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 216722us
I20260709 13:00:41.728065  5664 consensus_queue.cc:1048] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:00:41.729871  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:41.730124  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:41.738811  2219 raft_consensus.cc:3060] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:00:41.731483  5795 log.cc:927] Time spent T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.870s	user 0.003s	sys 0.002s
I20260709 13:00:41.732281  1527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49310 (request call id 938) took 1248 ms. Trace:
I20260709 13:00:41.737325  1497 leader_election.cc:304] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:41.740918  1527 rpcz_store.cc:276] 0709 13:00:40.483668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:40.485190 (+  1522us) service_pool.cc:224] Handling call
0709 13:00:40.485490 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:40.856641 (+371151us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:41.731934 (+875293us) spinlock_profiling.cc:243] Waited 363 ms on lock 0x7b54002dafd4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:00:41.732201 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":835659648}
I20260709 13:00:41.742648  1680 rpcz_store.cc:276] 0709 13:00:40.702407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:40.715357 (+ 12950us) service_pool.cc:224] Handling call
0709 13:00:41.723692 (+1008335us) spinlock_profiling.cc:243] Waited 4.22 ms on lock 0x7b5800143798. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a1548eb71 00007f6a1548ea22 00007f6a1e3a7c09 00007f6a1d501ee0 00007f6a1d5cb0ab 00007f6a1d5cb131 00007f6a1d5790a0 00007f6a1d578984 00007f6a16af36d4 00007f6a16af3662
0709 13:00:41.724778 (+  1086us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9715968}
I20260709 13:00:41.744199  1497 leader_election.cc:304] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:41.742295  5438 raft_consensus.cc:515] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:41.748193  1497 leader_election.cc:304] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:41.722056  5535 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:41.753490  1526 raft_consensus.cc:1240] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:41.758911  2219 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 13.
I20260709 13:00:41.761194  1525 raft_consensus.cc:1275] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:00:41.767469  5822 raft_consensus.cc:2749] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373) with higher term. Message: Invalid argument: T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 7. Current term is 8.
I20260709 13:00:41.767591  5732 raft_consensus.cc:515] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:41.765107  1418 maintenance_manager.cc:643] P 9f38d0e5c9db43a48554defe1153354e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.022s	user 0.002s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":371,"lbm_reads_lt_1ms":4}
I20260709 13:00:41.770712  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:41.752545  5812 raft_consensus.cc:2749] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:41.772935  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:41.776060  1530 raft_consensus.cc:3060] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:41.773870  1528 raft_consensus.cc:1240] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 LEADER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:00:41.771975  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:41.774952  1526 raft_consensus.cc:2393] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 9: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:00:41.777858  1525 raft_consensus.cc:2468] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 10.
I20260709 13:00:41.805327  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:41.806003  1526 raft_consensus.cc:3060] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:41.760723  5811 raft_consensus.cc:2804] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:00:41.808149  2190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:41.809623  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:41.809841  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:41.801282  5535 raft_consensus.cc:493] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.845880  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49178 (request call id 1956) took 1279 ms. Trace:
I20260709 13:00:41.846340  1676 rpcz_store.cc:276] 0709 13:00:40.566711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:40.567101 (+   390us) service_pool.cc:224] Handling call
0709 13:00:40.567461 (+   360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:40.567880 (+   419us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:40.567910 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:40.568385 (+   475us) log.cc:844] Serialized 26 byte log entry
0709 13:00:40.655957 (+ 87572us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:40.655997 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:40.656070 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:41.730960 (+1074890us) spinlock_profiling.cc:243] Waited 6.41 ms on lock 0x7b4400022b4c. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a153ecc85 00007f6a153ed6a2 00007f6a1815f1db 00007f6a1815aaaf 00007f6a1814e86e 00007f6a1814dbb6 00007f6a1814d7d8 00007f6a18157221 00007f6a181571d9 00007f6a18157169
0709 13:00:41.812553 (+ 81593us) raft_consensus.cc:1685] finished
0709 13:00:41.812577 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:41.845814 (+ 33237us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1219,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":109,"spinlock_wait_cycles":14737280,"thread_start_us":87182,"threads_started":1,"wal-append.queue_time_us":282065}
I20260709 13:00:41.860381  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:41.861135  1525 raft_consensus.cc:2468] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 12.
I20260709 13:00:41.863711  1644 leader_election.cc:304] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:41.867547  1644 leader_election.cc:304] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:41.868757  5804 raft_consensus.cc:3060] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:41.869626  5640 raft_consensus.cc:3055] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:41.870054  5640 raft_consensus.cc:740] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:41.873391  5686 leader_election.cc:290] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:41.874053  5686 consensus_queue.cc:1048] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:41.881263  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:41.882210  1680 raft_consensus.cc:2410] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b for term 10 because replica has last-logged OpId of term: 8 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
W20260709 13:00:41.878479  2191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:41.890977  2191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:41.891312  2191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:41.892582  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:41.893289  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49310 (request call id 943) took 1307 ms. Trace:
I20260709 13:00:41.893961  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:41.894301  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:41.893679  1532 rpcz_store.cc:276] 0709 13:00:40.585777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:40.586792 (+  1015us) service_pool.cc:224] Handling call
0709 13:00:40.601133 (+ 14341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:40.743650 (+142517us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:41.893068 (+1149418us) spinlock_profiling.cc:243] Waited 133 ms on lock 0x7b54001b53d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:00:41.893232 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":304969472}
I20260709 13:00:41.895344  2226 raft_consensus.cc:1240] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:00:41.817562  5811 raft_consensus.cc:697] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:00:41.910465  1675 raft_consensus.cc:1275] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:00:41.911123  1644 leader_election.cc:304] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:00:41.917199  5470 raft_consensus.cc:2804] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:41.919399  5470 raft_consensus.cc:697] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 13 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:41.917761  5686 raft_consensus.cc:3060] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:41.865236  5534 raft_consensus.cc:3055] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:41.927721  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:41.928476  1524 raft_consensus.cc:2468] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 10.
I20260709 13:00:41.929868  2191 leader_election.cc:304] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:41.932670  1530 raft_consensus.cc:2468] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 11.
I20260709 13:00:41.934445  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:41.935117  1530 raft_consensus.cc:3060] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:41.935986  1526 raft_consensus.cc:2468] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 13.
I20260709 13:00:41.852174  5535 raft_consensus.cc:515] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:41.940136  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:41.865635  5520 consensus_queue.cc:1059] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.061s
W20260709 13:00:41.956152  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 829211us
I20260709 13:00:41.917309  5764 consensus_queue.cc:1048] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
W20260709 13:00:41.931149  5801 log.cc:927] Time spent T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:00:41.988866  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:41.957463  1672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50664 (request call id 941) took 1219 ms. Trace:
W20260709 13:00:41.959165  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:41.930218  5534 raft_consensus.cc:740] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:41.918460  5761 consensus_queue.cc:1059] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:00:41.917904  5826 consensus_queue.cc:1048] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:00:41.984715  1570 leader_election.cc:304] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:41.985497  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:41.986181  1532 raft_consensus.cc:2468] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 10.
I20260709 13:00:41.993592  1523 raft_consensus.cc:2468] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 8.
I20260709 13:00:41.950747  5723 raft_consensus.cc:2749] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:00:41.991573  1672 rpcz_store.cc:276] 0709 13:00:40.738390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:40.954249 (+215859us) service_pool.cc:224] Handling call
0709 13:00:40.954559 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:41.380267 (+425708us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:41.947041 (+566774us) spinlock_profiling.cc:243] Waited 425 ms on lock 0x7b54002c0454. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:00:41.957388 (+ 10347us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":977338240}
I20260709 13:00:41.991631  1530 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 13.
I20260709 13:00:42.001365  5535 leader_election.cc:290] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:41.984050  5592 raft_consensus.cc:2749] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:42.009066  5438 leader_election.cc:290] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:42.011701  5603 raft_consensus.cc:3055] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:42.014350  5660 raft_consensus.cc:993] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90: : Instructing follower e46412b3b0b44f01ad5c33d4cfe3d6b1 to start an election
I20260709 13:00:42.014756  5811 consensus_queue.cc:237] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:42.004689  5732 leader_election.cc:290] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:42.017733  5804 raft_consensus.cc:2749] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:00:41.995260  5530 consensus_meta.cc:287] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.753s	user 0.011s	sys 0.000s
I20260709 13:00:42.006201  5668 raft_consensus.cc:493] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.950060  5470 consensus_queue.cc:237] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:41.963721  5587 raft_consensus.cc:493] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:42.019217  5803 consensus_queue.cc:260] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:42.023288  5815 raft_consensus.cc:993] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b: : Instructing follower e46412b3b0b44f01ad5c33d4cfe3d6b1 to start an election
I20260709 13:00:42.027230  1605 raft_consensus.cc:1275] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:00:41.985688  5697 raft_consensus.cc:2749] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:42.045868  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:42.050808  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:00:42.052230  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 67608.7us
I20260709 13:00:42.053316  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:42.061256  1606 raft_consensus.cc:2468] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 9.
I20260709 13:00:42.046903  5590 raft_consensus.cc:493] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.042513  5603 raft_consensus.cc:740] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:42.032517  5639 raft_consensus.cc:493] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:42.061306  1570 leader_election.cc:304] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:42.062860  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:42.064049  1600 raft_consensus.cc:3060] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:42.064232  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:00:42.138437  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 77246.2us
I20260709 13:00:42.056650  5660 raft_consensus.cc:1081] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 9 LEADER]: Signalling peer e46412b3b0b44f01ad5c33d4cfe3d6b1 to start an election
I20260709 13:00:42.144668  1570 leader_election.cc:304] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:42.058255  5727 raft_consensus.cc:493] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:42.168322  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:42.175825  1600 raft_consensus.cc:2468] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 12.
I20260709 13:00:42.176338  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:42.180516  1605 raft_consensus.cc:3060] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:42.063396  5764 raft_consensus.cc:1081] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 6 LEADER]: Signalling peer e46412b3b0b44f01ad5c33d4cfe3d6b1 to start an election
W20260709 13:00:42.140125  5827 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.007s	sys 0.027s
I20260709 13:00:42.062950  5739 raft_consensus.cc:2749] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:00:42.048558  5530 raft_consensus.cc:515] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:42.142987  5732 raft_consensus.cc:493] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.138020  5815 raft_consensus.cc:493] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:42.191221  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:42.186901  1570 leader_election.cc:304] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:42.197783  1570 leader_election.cc:304] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:42.146026  5698 raft_consensus.cc:2804] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:42.052565  5668 raft_consensus.cc:515] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:42.143895  5803 raft_consensus.cc:3060] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:42.063915  5587 raft_consensus.cc:515] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:42.177707  5818 raft_consensus.cc:493] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:42.185420  5762 raft_consensus.cc:2749] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 LEADER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:00:42.188094  5827 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.617s	user 0.010s	sys 0.027s
I20260709 13:00:42.188678  5690 raft_consensus.cc:2749] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:00:42.209753  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 269853us
I20260709 13:00:42.216907  1604 raft_consensus.cc:1240] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:42.193325  5804 raft_consensus.cc:493] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.142720  5639 raft_consensus.cc:515] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:42.197882  5686 raft_consensus.cc:2749] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:42.196307  5723 consensus_queue.cc:1048] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:00:42.186730  5727 raft_consensus.cc:515] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:42.150243  5592 consensus_queue.cc:1048] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 13:00:42.138274  5590 raft_consensus.cc:515] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:42.225225  1600 raft_consensus.cc:1240] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:42.201407  5698 raft_consensus.cc:493] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:42.209864  5296 raft_consensus.cc:493] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.210980  5747 raft_consensus.cc:2804] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:42.282744  1599 raft_consensus.cc:1275] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:00:42.282318  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 352569us
I20260709 13:00:42.270766  2190 leader_election.cc:304] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:42.199308  5594 consensus_queue.cc:1059] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:00:42.200466  5732 raft_consensus.cc:515] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:42.209052  5815 raft_consensus.cc:515] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:42.305434  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 860) took 2397 ms. Trace:
I20260709 13:00:42.213121  5739 raft_consensus.cc:493] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:42.209606  5813 raft_consensus.cc:2749] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:42.312841  5590 leader_election.cc:290] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:42.314024  5727 leader_election.cc:290] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:00:42.314819  5837 log.cc:927] Time spent T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
W20260709 13:00:42.315646  5840 log.cc:927] Time spent T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:00:42.316308  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:42.318651  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:42.322422  5723 raft_consensus.cc:493] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:42.324107  5592 raft_consensus.cc:493] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:42.304529  5725 raft_consensus.cc:493] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:42.218482  5818 raft_consensus.cc:515] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:42.277820  5664 raft_consensus.cc:493] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:42.281880  5660 raft_consensus.cc:493] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:42.230993  5764 consensus_queue.cc:1059] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.115s
W20260709 13:00:42.368898  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 98238.1us
I20260709 13:00:42.425769  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:42.426406  2225 raft_consensus.cc:3060] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:42.431038  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:42.431679  2226 raft_consensus.cc:2468] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 9.
W20260709 13:00:42.369095  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 1.24308e+06us
I20260709 13:00:42.433728  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:00:42.347199  5795 log.cc:927] Time spent T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:00:42.228997  5804 raft_consensus.cc:515] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:42.347824  5698 raft_consensus.cc:3060] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:42.374917  5809 consensus_queue.cc:1048] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:00:42.375574  5826 raft_consensus.cc:493] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.376566  5639 leader_election.cc:290] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:42.370357  1602 rpcz_store.cc:276] 0709 13:00:39.907568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:40.141907 (+234339us) service_pool.cc:224] Handling call
0709 13:00:40.142272 (+   365us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:40.142630 (+   358us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:40.142688 (+    58us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:40.143319 (+   631us) log.cc:844] Serialized 52 byte log entry
0709 13:00:40.254958 (+111639us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:00:40.587179 (+332221us) log.cc:844] Serialized 14 byte log entry
0709 13:00:40.587741 (+   562us) log.cc:844] Serialized 14 byte log entry
0709 13:00:41.123033 (+535292us) spinlock_profiling.cc:243] Waited 2.01 ms on lock 0x7b18004953a0. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1e38ede1 00007f6a1e39b5b1 00007f6a15440c0a 00007f6a1eb80219 00007f6a18169d70 00007f6a1815d293 00007f6a18152cea 00007f6a1815323a 00007f6a185bda2a 00007f6a185cd0bf 00007f6a185cd038
0709 13:00:41.222731 (+ 99698us) spinlock_profiling.cc:243] Waited 3.19 ms on lock 0x7b18004953a0. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1e38ede1 00007f6a1e39b5b1 00007f6a154942a6 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1d4dcaa1 00007f6a1d4d3b37 00007f6a1d4d39ca 00007f6a1d5cb26f
0709 13:00:41.223983 (+  1252us) spinlock_profiling.cc:243] Waited 2.97 ms on lock 0x7b48001e0258. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1d4dcaa1 00007f6a1d4d3b37 00007f6a1d4d39ca 00007f6a1d5cb26f 00007f6a1d5caf37 00007f6a1d5df55c 00007f6a1d5df508 00007f6a1d5df488 00007f6a1d5df443 00007f6a1d5de6ec 00007f6a1c508a96
0709 13:00:41.439015 (+215032us) spinlock_profiling.cc:243] Waited 6.57 ms on lock 0x7b18004953a0. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1e38ede1 00007f6a1e39b5b1 00007f6a154c63f3 00007f6a154c87c1 00007f6a154c8779 00007f6a154c8709 00007f6a154c86d1 00007f6a154c79cd 000000000038f354 000000000038f199 00007f6a154a983a
0709 13:00:41.948174 (+509159us) spinlock_profiling.cc:243] Waited 1.13 ms on lock 0x7b18004953a0. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1e38ede1 00007f6a1e39b5b1 00007f6a15440c0a 00007f6a1eb80219 00007f6a154c8a40 00007f6a154c34e4 00007f6a154c3455 00007f6a185ab060 00007f6a185bd716 00007f6a185ce287 00007f6a185ce208
0709 13:00:42.304387 (+356213us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:42.305146 (+   759us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:42.305200 (+    54us) raft_consensus.cc:1685] finished
0709 13:00:42.305211 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:42.305372 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1258932,"prepare.queue_time_us":60775,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":60,"raft.queue_time_us":837265,"raft.run_cpu_time_us":6275,"raft.run_wall_time_us":658559,"spinlock_wait_cycles":36502144,"thread_start_us":774800,"threads_started":3,"wal-append.queue_time_us":342143,"wal-append.run_cpu_time_us":4422,"wal-append.run_wall_time_us":1670031}
I20260709 13:00:42.389011  1606 raft_consensus.cc:2468] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 15.
I20260709 13:00:42.281543  5599 consensus_queue.cc:260] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:42.378840  5729 raft_consensus.cc:493] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.377435  5848 raft_consensus.cc:2804] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:42.423600  5486 consensus_queue.cc:1059] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:00:42.390200  5813 raft_consensus.cc:493] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:42.443091  2226 raft_consensus.cc:1275] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:42.446321  2225 raft_consensus.cc:2468] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 11.
I20260709 13:00:42.437371  5686 raft_consensus.cc:493] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:42.561349  1598 raft_consensus.cc:1275] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:00:42.507455  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:42.508173  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:42.506243  5826 raft_consensus.cc:515] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:42.519920  5732 leader_election.cc:290] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:42.419687  5723 raft_consensus.cc:515] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:42.379172  5739 raft_consensus.cc:515] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:42.578910  5739 leader_election.cc:290] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:42.580312  5726 leader_election.cc:290] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 13 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:42.522266  5815 leader_election.cc:290] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:42.522864  5804 leader_election.cc:290] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:42.523008  5668 leader_election.cc:290] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:42.523736  5587 leader_election.cc:290] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:42.366212  5296 raft_consensus.cc:515] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:42.525280  5590 raft_consensus.cc:493] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:42.500581  5530 leader_election.cc:290] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:00:42.499188  5836 log.cc:927] Time spent T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.203s	user 0.000s	sys 0.000s
W20260709 13:00:42.500084  5842 log.cc:927] Time spent T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 13:00:42.456800  1675 raft_consensus.cc:2393] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 11: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
W20260709 13:00:42.534346  1529 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.013s	sys 0.051s
I20260709 13:00:42.544130  1600 raft_consensus.cc:1240] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 10. Current term is 11. Ops: []
W20260709 13:00:42.656517  1529 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.014s	sys 0.051s
I20260709 13:00:42.545125  1602 raft_consensus.cc:1275] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 13:00:42.544688  5534 consensus_queue.cc:260] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:42.485319  5839 log.cc:927] Time spent T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.188s	user 0.000s	sys 0.000s
W20260709 13:00:42.564467  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:42.566341  1606 raft_consensus.cc:1240] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:42.440191  5761 raft_consensus.cc:493] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:42.514724  5698 raft_consensus.cc:515] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:42.547428  5697 raft_consensus.cc:3055] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:42.569478  5686 raft_consensus.cc:515] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:42.569659  5847 raft_consensus.cc:493] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.576465  5723 leader_election.cc:290] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:42.576850  5809 raft_consensus.cc:3055] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:42.428194  5660 raft_consensus.cc:515] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:00:42.625835  1496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:42.643561  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 319825us
I20260709 13:00:42.748299  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:42.749158  1572 leader_election.cc:304] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:00:42.748118  5534 raft_consensus.cc:3060] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:42.750497  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:42.751132  1600 raft_consensus.cc:2468] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 12.
I20260709 13:00:42.751425  5864 raft_consensus.cc:2804] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:42.751817  5864 raft_consensus.cc:493] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:42.751984  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:42.753055  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:42.564211  5802 raft_consensus.cc:493] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:42.754063  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:42.754191  5802 raft_consensus.cc:515] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:42.746076  5847 raft_consensus.cc:515] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:42.756407  5802 leader_election.cc:290] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:42.756686  5847 leader_election.cc:290] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:42.420826  5725 raft_consensus.cc:515] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:42.438390  5846 consensus_queue.cc:1048] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.147s
I20260709 13:00:42.649750  1605 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 13.
I20260709 13:00:42.428402  5664 raft_consensus.cc:515] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:42.427453  5592 raft_consensus.cc:515] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:42.576289  5826 leader_election.cc:290] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:42.657112  1602 pending_rounds.cc:85] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642: Aborting all ops after (but not including) 7
W20260709 13:00:42.654120  1570 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 2.026s (SENT) [suppressed 26 similar messages]
I20260709 13:00:42.765187  1602 pending_rounds.cc:107] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 13:00:42.583786  5599 raft_consensus.cc:3060] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:42.555389  5729 raft_consensus.cc:515] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:42.680712   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:42.683436  1601 raft_consensus.cc:1275] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:00:42.732020  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 196814us
I20260709 13:00:42.679175  5726 consensus_queue.cc:1048] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 13:00:42.570894  5813 raft_consensus.cc:515] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:42.746295  5809 raft_consensus.cc:740] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:42.685899  5697 raft_consensus.cc:740] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:42.657612  5594 consensus_queue.cc:1243] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:00:42.655857  5590 raft_consensus.cc:515] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:42.765513  1602 raft_consensus.cc:2889] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:42.656219  5668 raft_consensus.cc:493] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:42.774863  5723 consensus_queue.cc:1059] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:00:42.777227  5813 leader_election.cc:290] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:42.793855  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:42.760174  5864 raft_consensus.cc:3060] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:42.798717  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 143443us
W20260709 13:00:42.799553  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 374192us
W20260709 13:00:42.801934  2191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:42.806408  1600 raft_consensus.cc:2468] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 9.
I20260709 13:00:42.760386  5811 raft_consensus.cc:493] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:42.831746  1525 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24"
dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:49310
I20260709 13:00:42.841270  1525 raft_consensus.cc:493] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:42.841655  1525 raft_consensus.cc:3060] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:42.833298  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:42.839722  5686 leader_election.cc:290] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:42.842579  1530 raft_consensus.cc:2468] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 9.
I20260709 13:00:42.765517  5739 consensus_queue.cc:1048] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.057s
I20260709 13:00:42.686482  5761 raft_consensus.cc:515] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:42.855671  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:42.811023  5848 raft_consensus.cc:697] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 13 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
W20260709 13:00:42.858503  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 204430us
I20260709 13:00:42.823340  5534 raft_consensus.cc:493] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:42.858777  1602 raft_consensus.cc:2393] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 11: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:00:42.821641  5815 raft_consensus.cc:493] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:42.846645  5726 raft_consensus.cc:493] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.870426  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:00:42.875478  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 74992.3us
I20260709 13:00:42.877745  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:42.878520  1675 raft_consensus.cc:3060] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:00:42.860334  5803 consensus_meta.cc:287] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.648s	user 0.010s	sys 0.000s
I20260709 13:00:42.881569  5660 leader_election.cc:290] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:42.845033  5668 raft_consensus.cc:515] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:42.885952  1525 raft_consensus.cc:515] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:42.873834  5534 raft_consensus.cc:515] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:42.908598  1677 raft_consensus.cc:2468] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 11.
I20260709 13:00:42.894696  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:42.900121  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:42.883193  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:42.906154  1572 leader_election.cc:304] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:00:42.909896  1602 raft_consensus.cc:2468] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 13.
I20260709 13:00:42.910888  1525 leader_election.cc:290] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:00:42.907323  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 131367us
I20260709 13:00:42.840458  5860 consensus_queue.cc:1059] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.068s
I20260709 13:00:42.909523  1601 raft_consensus.cc:2393] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 9: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:00:42.913815  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:42.916849  1601 raft_consensus.cc:1240] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:42.910494  5534 leader_election.cc:290] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:00:42.920855  2190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:42.922269  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:42.846843  5811 raft_consensus.cc:515] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:42.923468  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:42.924113  2227 raft_consensus.cc:3060] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:00:42.928334  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 104623us
I20260709 13:00:42.929239  1646 leader_election.cc:304] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:42.930522  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:42.873561  5686 consensus_queue.cc:1048] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:00:42.933035  1646 leader_election.cc:304] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:42.875540  5815 raft_consensus.cc:515] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:42.897666  5726 raft_consensus.cc:515] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:42.953959  2227 raft_consensus.cc:2468] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 13.
I20260709 13:00:42.869907  5697 consensus_queue.cc:260] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:42.918963  5530 consensus_queue.cc:1048] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:00:42.933236  5877 raft_consensus.cc:2804] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:42.937518  5861 raft_consensus.cc:2804] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:42.967895  5660 raft_consensus.cc:2804] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:42.970296  2225 raft_consensus.cc:2410] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:00:42.936975  5296 leader_election.cc:290] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:42.905061  5809 consensus_queue.cc:260] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:42.978989  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 55520.8us
I20260709 13:00:42.930760  5870 consensus_queue.cc:1048] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 13:00:42.961621  5698 leader_election.cc:290] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:42.978829  5861 raft_consensus.cc:493] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:42.985087  5877 raft_consensus.cc:697] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 11 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:43.001569  5861 raft_consensus.cc:3060] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:43.012611  5761 leader_election.cc:290] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:43.015302  5877 consensus_queue.cc:237] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:42.950450  5848 consensus_queue.cc:237] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:42.994850  5486 consensus_queue.cc:1059] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.013s
I20260709 13:00:43.005084  5592 leader_election.cc:290] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:42.985700  5884 consensus_queue.cc:1059] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:00:43.008030  5590 leader_election.cc:290] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:43.007717  5664 leader_election.cc:290] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:00:43.020735  5866 log.cc:927] Time spent T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260709 13:00:43.009606  5873 raft_consensus.cc:493] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:00:43.031826  1675 raft_consensus.cc:2468] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 13.
W20260709 13:00:43.036039  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:43.040091  5668 leader_election.cc:290] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:43.040452  5815 leader_election.cc:290] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:43.042151  5762 raft_consensus.cc:493] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:43.031071  5873 raft_consensus.cc:515] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:43.042789  5762 raft_consensus.cc:515] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:43.043785  5833 raft_consensus.cc:493] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:43.044364  5833 raft_consensus.cc:515] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:43.045148  5873 leader_election.cc:290] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:43.047302  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49178 (request call id 1969) took 1154 ms. Trace:
I20260709 13:00:43.047696  1677 rpcz_store.cc:276] 0709 13:00:41.892502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.893701 (+  1199us) service_pool.cc:224] Handling call
0709 13:00:43.047139 (+1153438us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54002fb054. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:43.047244 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2329503488}
I20260709 13:00:43.048532  5762 leader_election.cc:290] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:43.048887  5603 consensus_queue.cc:260] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:43.028483  5726 leader_election.cc:290] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:43.051591  5811 leader_election.cc:290] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:43.054816  5668 raft_consensus.cc:493] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:43.055398  5668 raft_consensus.cc:515] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:43.056432  5850 raft_consensus.cc:493] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:43.056524  5809 raft_consensus.cc:3060] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:43.057056  5850 raft_consensus.cc:515] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:43.060892  5668 leader_election.cc:290] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:43.062376  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:43.060416  5864 raft_consensus.cc:515] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:43.063288  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:43.063592  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:43.064615  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:43.065798  5530 raft_consensus.cc:493] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:00:43.070175  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:43.076332  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:43.078238  1678 raft_consensus.cc:3060] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:00:43.082888  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 114291us
I20260709 13:00:43.085278  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:43.046463  5833 leader_election.cc:290] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:43.088878  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:43.089160  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:43.089105  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:43.062513  5818 leader_election.cc:290] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:43.092536  1605 raft_consensus.cc:2393] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 10: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:00:43.091799  1646 leader_election.cc:304] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:43.124424  1679 raft_consensus.cc:1240] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:00:43.126610  1646 leader_election.cc:304] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:43.086884  5660 raft_consensus.cc:697] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 12 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:43.080750  5530 raft_consensus.cc:515] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:43.128309  5818 raft_consensus.cc:2804] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:00:43.153614  1646 leader_election.cc:304] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:43.127519  5871 consensus_queue.cc:1048] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:00:43.158790  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:43.159680  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:43.160449  2219 raft_consensus.cc:2468] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 10.
I20260709 13:00:43.159014  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:43.161296  5730 consensus_queue.cc:1048] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 13:00:43.168017  5530 leader_election.cc:290] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:43.149178  5668 raft_consensus.cc:2804] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:43.170513  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:43.171396  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 13:00:43.178982  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 52525.1us
I20260709 13:00:43.181049  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:43.154981  5818 raft_consensus.cc:493] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:43.150638  5590 consensus_queue.cc:1059] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:00:43.169865  5876 raft_consensus.cc:2804] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:43.188772  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:43.189843  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:43.194231  1523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43010 (request call id 2177) took 1268 ms. Trace:
I20260709 13:00:43.194638  1523 rpcz_store.cc:276] 0709 13:00:41.925970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.998747 (+ 72777us) service_pool.cc:224] Handling call
0709 13:00:41.999057 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:42.227808 (+228751us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:42.227840 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:42.227884 (+    44us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:42.227914 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:43.194010 (+966096us) spinlock_profiling.cc:243] Waited 229 ms on lock 0x7b540031b854. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:00:43.194055 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:43.194177 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":525645184}
I20260709 13:00:43.197749  5850 leader_election.cc:290] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:43.185669  5818 raft_consensus.cc:3060] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:43.203223  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:43.205430  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:43.211081  5848 raft_consensus.cc:493] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:43.211773  5848 raft_consensus.cc:515] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:43.190572  5876 raft_consensus.cc:493] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:43.213459  5876 raft_consensus.cc:3060] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:43.214012  5848 leader_election.cc:290] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:43.216428  1678 raft_consensus.cc:2468] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 11.
I20260709 13:00:43.202584  5861 raft_consensus.cc:515] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:43.217938  1672 raft_consensus.cc:2393] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 10: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:00:43.218875  5861 leader_election.cc:290] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:00:43.230448  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:43.236555  2192 leader_election.cc:304] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:00:43.248554  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:43.250084  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:43.250726  1602 raft_consensus.cc:2393] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 9: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:00:43.248682  1497 leader_election.cc:304] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:43.250159  5726 raft_consensus.cc:2804] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:43.253170  5726 raft_consensus.cc:493] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:43.253273  5851 raft_consensus.cc:2764] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader election decision vote started in defunct term 12: won
I20260709 13:00:43.253657  5726 raft_consensus.cc:3060] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:43.229291  5660 consensus_queue.cc:237] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:43.263078  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:43.264006  1525 raft_consensus.cc:2410] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:00:43.265094  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:43.265784  1531 raft_consensus.cc:1275] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:43.267697  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:43.268790  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:43.269340  1525 raft_consensus.cc:2468] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 10.
I20260709 13:00:43.270206  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:43.267692  1524 raft_consensus.cc:1240] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 12. Current term is 13. Ops: [9.6-12.8]
I20260709 13:00:43.273216  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:43.305807  5640 consensus_queue.cc:260] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:43.307197  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:43.308501  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:43.272748  1497 leader_election.cc:304] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:43.317767  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:43.318464  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 13:00:43.318929  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 46257.7us
I20260709 13:00:43.319263  1530 raft_consensus.cc:2393] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 7: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:00:43.319702  1497 leader_election.cc:304] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:43.320036  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:43.320557  1530 raft_consensus.cc:2376] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 11. Re-sending same reply.
I20260709 13:00:43.321362  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:43.321831  1530 raft_consensus.cc:2376] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 8. Re-sending same reply.
I20260709 13:00:43.322431  1497 leader_election.cc:304] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:43.322840  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:43.323310  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:43.322547  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:43.324445  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:43.325485  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:43.326076  1530 raft_consensus.cc:2468] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 9.
W20260709 13:00:43.326282  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:43.331106  5898 log.cc:927] Time spent T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:00:43.344205  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:43.345616  1531 raft_consensus.cc:1240] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 LEADER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:00:43.343853  5850 raft_consensus.cc:2749] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:43.251089  5818 raft_consensus.cc:515] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:43.357905  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:43.331286  5587 raft_consensus.cc:2749] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:43.365525  1602 raft_consensus.cc:2468] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 11.
I20260709 13:00:43.366695  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:00:43.367496  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 45140.4us
W20260709 13:00:43.368327  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:43.368975  1532 raft_consensus.cc:2393] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 9: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:00:43.370285  5876 raft_consensus.cc:515] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:43.384235  5535 raft_consensus.cc:493] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:43.384507  5876 leader_election.cc:290] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:43.384907  5535 raft_consensus.cc:515] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:43.351794  5892 raft_consensus.cc:2749] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:00:43.387215  5876 raft_consensus.cc:493] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:43.387791  5876 raft_consensus.cc:515] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:43.389976  5876 leader_election.cc:290] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:43.358235  5869 raft_consensus.cc:493] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:43.390679  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:43.391091  5869 raft_consensus.cc:515] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:43.392648  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:43.393273  1601 raft_consensus.cc:2468] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 6.
I20260709 13:00:43.394807  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:43.395916  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:43.396919  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:43.396706  5726 raft_consensus.cc:515] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:43.347710  5833 raft_consensus.cc:493] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:43.397749  1601 raft_consensus.cc:2410] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:00:43.398365  5833 raft_consensus.cc:515] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:43.399680  5640 raft_consensus.cc:3060] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:43.400581  5833 leader_election.cc:290] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:43.401221  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:43.368036  2192 leader_election.cc:304] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:00:43.404066  5761 raft_consensus.cc:2804] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:43.404445  5761 raft_consensus.cc:493] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:43.404796  5761 raft_consensus.cc:3060] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:43.405589  5818 leader_election.cc:290] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:43.410495  5864 leader_election.cc:290] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:00:43.411675  2190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:43.416350  1602 raft_consensus.cc:2410] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 13 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:00:43.420053  1606 raft_consensus.cc:1275] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 13:00:43.424415  5880 log.cc:927] Time spent T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.453s	user 0.001s	sys 0.002s
I20260709 13:00:43.425576  5535 leader_election.cc:290] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:00:43.431344  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 63153.4us
I20260709 13:00:43.432308  1497 leader_election.cc:304] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:43.393257  5869 leader_election.cc:290] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:43.439625  1497 leader_election.cc:304] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:43.433663  5895 raft_consensus.cc:493] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:00:43.419697  5668 raft_consensus.cc:697] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 13 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
W20260709 13:00:43.439445  5905 log.cc:927] Time spent T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.073s	user 0.000s	sys 0.004s
I20260709 13:00:43.444092  1606 raft_consensus.cc:1275] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:00:43.442420  5833 raft_consensus.cc:2749] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:43.444046  1497 leader_election.cc:304] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:43.450201  5500 raft_consensus.cc:493] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:43.442047  5850 raft_consensus.cc:2749] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:00:43.440856  5899 log.cc:927] Time spent T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.110s	user 0.004s	sys 0.000s
I20260709 13:00:43.457819  5500 raft_consensus.cc:515] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:43.459010  5833 raft_consensus.cc:2749] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:43.459898  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:43.473007  1606 raft_consensus.cc:3060] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:43.460531  1598 raft_consensus.cc:1240] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:43.453815  5726 leader_election.cc:290] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 10 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:43.442538  5895 raft_consensus.cc:515] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:43.482787  5895 leader_election.cc:290] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:43.483210  2224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50310 (request call id 829) took 1059 ms. Trace:
I20260709 13:00:43.483631  2224 rpcz_store.cc:276] 0709 13:00:42.424064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.434971 (+ 10907us) service_pool.cc:224] Handling call
0709 13:00:42.505966 (+ 70995us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:42.873030 (+367064us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:42.873063 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:42.873109 (+    46us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:42.873141 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:43.482954 (+609813us) spinlock_profiling.cc:243] Waited 367 ms on lock 0x7b5400383954. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:00:43.483003 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:43.483141 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":843640192}
I20260709 13:00:43.486483  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:43.487110  2224 raft_consensus.cc:2468] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 7.
I20260709 13:00:43.487540  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36200 (request call id 2328) took 1465 ms. Trace:
I20260709 13:00:43.488238  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:43.490223  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:43.490847  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:43.487941  1604 rpcz_store.cc:276] 0709 13:00:42.022492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.031859 (+  9367us) service_pool.cc:224] Handling call
0709 13:00:42.032125 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:42.224733 (+192608us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:43.487329 (+1262596us) spinlock_profiling.cc:243] Waited 181 ms on lock 0x7b54003b1ad4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:00:43.487486 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":416522112}
I20260709 13:00:43.491737  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:43.492296  2221 raft_consensus.cc:3060] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:43.488291  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:43.492430  1675 raft_consensus.cc:1240] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:00:43.457265  1497 leader_election.cc:304] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:43.470441  1678 raft_consensus.cc:1240] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 13 LEADER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:00:43.471657  5500 leader_election.cc:290] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:43.457201  5535 raft_consensus.cc:493] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:43.495806  1497 leader_election.cc:304] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
W20260709 13:00:43.495643  5847 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.738s	user 0.042s	sys 0.071s
I20260709 13:00:43.502394  5875 consensus_queue.cc:1059] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:00:43.498138  5847 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.740s	user 0.042s	sys 0.071s
I20260709 13:00:43.508097  2221 raft_consensus.cc:2468] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 10.
I20260709 13:00:43.510006  2219 raft_consensus.cc:1240] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 12. Current term is 13. Ops: [12.12-12.12]
W20260709 13:00:43.510129  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 347404us
I20260709 13:00:43.498056  5850 raft_consensus.cc:2749] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:43.496244  5732 raft_consensus.cc:2804] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:43.496085  5833 raft_consensus.cc:493] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:43.509814  5851 raft_consensus.cc:493] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:43.553071  2191 leader_election.cc:304] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:43.553484  2219 raft_consensus.cc:1275] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:00:43.505263  5535 raft_consensus.cc:515] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:43.546963  5732 raft_consensus.cc:493] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:43.562564  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:43.565466  1525 raft_consensus.cc:2468] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 15.
I20260709 13:00:43.566231  5732 raft_consensus.cc:3060] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:43.566685  1526 raft_consensus.cc:1240] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:43.569243  1646 leader_election.cc:304] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:00:43.587119  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:43.589208  1644 leader_election.cc:304] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:00:43.559782  5858 log.cc:927] Time spent T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.803s	user 0.003s	sys 0.000s
I20260709 13:00:43.591511  1572 leader_election.cc:304] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:00:43.589753  1606 raft_consensus.cc:2468] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 10.
I20260709 13:00:43.595394  1572 leader_election.cc:304] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:43.587387  1646 leader_election.cc:304] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:43.559877  5875 raft_consensus.cc:493] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:43.598037  1572 leader_election.cc:304] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:43.594700  5895 raft_consensus.cc:2804] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:43.590198  5881 raft_consensus.cc:3060] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:43.601446  5690 raft_consensus.cc:2749] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:43.596524  5846 raft_consensus.cc:2804] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:43.552126  5833 raft_consensus.cc:515] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:43.497743  5668 consensus_queue.cc:237] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:43.603368  1646 leader_election.cc:304] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:43.607995  1644 leader_election.cc:304] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:00:43.604358  5813 raft_consensus.cc:2804] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:43.601727  5890 raft_consensus.cc:2749] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:43.615231  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:43.619268  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:43.620922  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:43.617882  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:43.627964  2219 raft_consensus.cc:2393] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 10: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:00:43.560330  5851 raft_consensus.cc:515] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:43.608774  5903 raft_consensus.cc:2804] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:43.632926  1525 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fbb85f388454464192e052f706a78e65"
dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:43010
I20260709 13:00:43.623566  1646 leader_election.cc:304] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:43.609508  5846 raft_consensus.cc:493] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:43.628268  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:43.633688  1525 raft_consensus.cc:493] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:43.632223  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:43.610705  5895 raft_consensus.cc:697] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 13 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:43.635116  1525 raft_consensus.cc:3060] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:43.635092  1598 raft_consensus.cc:3060] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:43.634446  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:43.639424  2218 raft_consensus.cc:2468] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 11.
I20260709 13:00:43.636106  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:43.604261  5698 consensus_queue.cc:1059] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:00:43.636762  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:43.637310  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36200 (request call id 2329) took 1614 ms. Trace:
I20260709 13:00:43.637981  1677 raft_consensus.cc:1275] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:00:43.640679  1676 raft_consensus.cc:2468] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 8.
I20260709 13:00:43.621932  5909 raft_consensus.cc:2749] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:43.640597  1603 rpcz_store.cc:276] 0709 13:00:42.037480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.037686 (+   206us) service_pool.cc:224] Handling call
0709 13:00:42.038029 (+   343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:42.048446 (+ 10417us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:42.048480 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:42.055822 (+  7342us) log.cc:844] Serialized 26 byte log entry
0709 13:00:42.388634 (+332812us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:42.389506 (+   872us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:42.389581 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:43.503637 (+1114056us) spinlock_profiling.cc:243] Waited 24.2 ms on lock 0x7b4400022b4c. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a153ecc85 00007f6a153ed6a2 00007f6a1815f1db 00007f6a1815aaaf 00007f6a1814e86e 00007f6a1814dbb6 00007f6a1814d7d8 00007f6a18157221 00007f6a181571d9 00007f6a18157169
0709 13:00:43.632532 (+128895us) raft_consensus.cc:1685] finished
0709 13:00:43.632553 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:43.637249 (+  4696us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12385,"raft.queue_time_us":13465,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":2516,"spinlock_wait_cycles":55586176,"thread_start_us":234712,"threads_started":1,"wal-append.queue_time_us":516976}
I20260709 13:00:43.604876  5875 raft_consensus.cc:515] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:43.625192  5908 raft_consensus.cc:493] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:00:43.644181  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:43.645581  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:43.622262  5690 raft_consensus.cc:493] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:00:43.631057  5818 raft_consensus.cc:2804] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:43.665884  1525 raft_consensus.cc:515] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:43.670215  1525 leader_election.cc:290] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:43.639047  5438 raft_consensus.cc:2749] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:43.677302  5833 leader_election.cc:290] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:43.679210  5875 leader_election.cc:290] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:43.679977  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:43.666855  5818 raft_consensus.cc:493] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:43.681495  5818 raft_consensus.cc:3060] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:43.679999  2192 leader_election.cc:304] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:00:43.683689  5882 raft_consensus.cc:2804] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:43.684229  5882 raft_consensus.cc:697] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 10 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
W20260709 13:00:43.684561  5913 log.cc:927] Time spent T 00000000000000000000000000000000 P 9f38d0e5c9db43a48554defe1153354e: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:00:43.685110  5882 consensus_queue.cc:237] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:43.639386  1646 leader_election.cc:304] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:43.636780  5813 raft_consensus.cc:697] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 10 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:43.647774  5727 raft_consensus.cc:3055] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:43.649771  5851 leader_election.cc:290] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:43.633589  5903 raft_consensus.cc:493] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:43.651763  5895 consensus_queue.cc:237] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:43.612618  5886 consensus_queue.cc:1048] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:00:43.636602  5846 raft_consensus.cc:3060] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:43.655544  1679 raft_consensus.cc:2468] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 11.
I20260709 13:00:43.661510  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:43.662679  5535 leader_election.cc:290] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:43.661633  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:43.711081  1603 raft_consensus.cc:3060] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:43.690788  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:00:43.691172  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 51834.5us
I20260709 13:00:43.712397  1646 leader_election.cc:304] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:43.697680  1525 raft_consensus.cc:1275] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:00:43.666062  5907 log.cc:927] Time spent T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:00:43.710186  1598 raft_consensus.cc:2468] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 16.
I20260709 13:00:43.717237  2220 raft_consensus.cc:2468] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 9.
I20260709 13:00:43.702642  5520 raft_consensus.cc:493] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:43.702183  5909 raft_consensus.cc:2804] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:43.721750  1646 leader_election.cc:304] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:43.724071  1607 raft_consensus.cc:1240] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:43.698006  5747 raft_consensus.cc:493] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:43.725215  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 13:00:43.704206  5914 log.cc:927] Time spent T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:00:43.700821  5727 raft_consensus.cc:740] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:43.706362  5592 raft_consensus.cc:493] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:43.737684  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:43.738401  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:43.739535  1646 leader_election.cc:304] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:43.744380  5813 consensus_queue.cc:237] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:43.698982  5690 raft_consensus.cc:515] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:43.749780  1646 leader_election.cc:304] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:43.682807  5908 raft_consensus.cc:515] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:43.720038  5438 raft_consensus.cc:2749] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:43.748374  5729 leader_election.cc:290] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:43.705466  5761 raft_consensus.cc:515] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:43.767555  1599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 872) took 1231 ms. Trace:
I20260709 13:00:43.767980  1599 rpcz_store.cc:276] 0709 13:00:42.536597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.536791 (+   194us) service_pool.cc:224] Handling call
0709 13:00:42.537080 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:42.575797 (+ 38717us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:42.575829 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:42.575879 (+    50us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:42.575909 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:43.767331 (+1191422us) spinlock_profiling.cc:243] Waited 38.5 ms on lock 0x7b54001946d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:00:43.767376 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:43.767497 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":88614272}
I20260709 13:00:43.768574  5761 leader_election.cc:290] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:43.724843  5594 consensus_queue.cc:1048] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 13:00:43.750820  5592 raft_consensus.cc:515] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:43.769459  5594 consensus_queue.cc:1243] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer ddf11fc190dd4b898773379c6b129d90 log is divergent from this leader: its last log entry 8.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:00:43.770247  1598 raft_consensus.cc:2468] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 11.
I20260709 13:00:43.766799  5603 raft_consensus.cc:3060] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:43.752280  5732 raft_consensus.cc:515] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:43.748095  5876 raft_consensus.cc:2804] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:00:43.773298  5876 raft_consensus.cc:697] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 16 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:43.773917  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:43.774312  2224 raft_consensus.cc:1275] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:00:43.774703  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:43.775275  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:43.775767  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:43.776347  5726 raft_consensus.cc:493] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:43.776382  2219 raft_consensus.cc:2468] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 13.
I20260709 13:00:43.777858  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:43.778443  1598 raft_consensus.cc:3060] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:43.708931  5903 raft_consensus.cc:3060] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:43.736207  5747 raft_consensus.cc:3060] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:43.735803  5909 raft_consensus.cc:493] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:00:43.726874  5520 raft_consensus.cc:515] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:43.720841  5861 consensus_queue.cc:1059] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:00:43.773244  5732 leader_election.cc:290] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:43.759634  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:43.720767  5686 consensus_queue.cc:1048] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:00:43.757156  5660 raft_consensus.cc:2749] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:43.763180  5818 raft_consensus.cc:515] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:43.766530  5908 leader_election.cc:290] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:43.747762  5727 consensus_queue.cc:260] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:43.750512  5890 raft_consensus.cc:2749] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:00:43.778810  1678 raft_consensus.cc:1240] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:00:43.753099  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:43.822607  1525 raft_consensus.cc:2468] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 10.
I20260709 13:00:43.779934  2225 raft_consensus.cc:1240] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:43.774534  2226 raft_consensus.cc:3055] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:43.781701  1679 raft_consensus.cc:1275] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:00:43.780390  1526 raft_consensus.cc:1240] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:43.783390  1603 raft_consensus.cc:2468] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 14.
I20260709 13:00:43.781431  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:43.791743  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:43.792089  1646 leader_election.cc:304] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:43.826309  1646 leader_election.cc:304] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:43.827147  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:43.793001  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:43.828248  5500 raft_consensus.cc:2804] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:43.828657  5908 raft_consensus.cc:2749] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:43.828708  5500 raft_consensus.cc:493] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:43.829268  5500 raft_consensus.cc:3060] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:43.793490  1523 raft_consensus.cc:1275] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:00:43.830749  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:43.831208  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:43.831801  1570 leader_election.cc:304] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:43.831959  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:43.833210  5729 raft_consensus.cc:2749] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:43.834141  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:43.834779  1524 raft_consensus.cc:2376] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 13. Re-sending same reply.
I20260709 13:00:43.837937  1570 leader_election.cc:304] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:43.787551  2191 leader_election.cc:304] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:43.839344  5729 raft_consensus.cc:2749] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:43.841372  5729 consensus_queue.cc:1048] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:43.810727  1496 leader_election.cc:304] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:00:43.771205  5592 leader_election.cc:290] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:43.814859  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:43.816757  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:43.785511  5851 raft_consensus.cc:493] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:43.842595  1531 raft_consensus.cc:3060] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:43.843035  5851 raft_consensus.cc:515] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:43.845484  5851 leader_election.cc:290] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:43.819794  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:43.824124  2226 raft_consensus.cc:740] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:43.847849  2226 consensus_queue.cc:260] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:43.848914  2226 raft_consensus.cc:3060] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:43.849202  2190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:43.851449  1525 raft_consensus.cc:1275] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:00:43.851751  5851 raft_consensus.cc:2764] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
W20260709 13:00:43.852087  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:43.853878  1496 leader_election.cc:304] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:43.854971  5851 raft_consensus.cc:2749] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:43.856176  1496 leader_election.cc:304] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:43.862780  1531 raft_consensus.cc:2468] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 16.
I20260709 13:00:43.776875  5726 raft_consensus.cc:515] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:43.813006  5909 raft_consensus.cc:3060] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:43.867316  1570 leader_election.cc:304] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:43.774223  5876 consensus_queue.cc:237] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:43.876724  1570 leader_election.cc:304] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:43.878716  1601 raft_consensus.cc:1240] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 13. Current term is 14. Ops: []
I20260709 13:00:43.881486  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:43.867481  1598 raft_consensus.cc:2468] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 12.
I20260709 13:00:43.882241  1601 raft_consensus.cc:2393] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 16: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:00:43.879315  1496 leader_election.cc:304] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:43.865622  5727 raft_consensus.cc:3060] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:43.886891  1570 leader_election.cc:304] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:43.884418  1646 leader_election.cc:304] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:43.889638  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:43.889856  1646 leader_election.cc:304] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:43.890519  5860 raft_consensus.cc:2749] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:43.890682  5873 raft_consensus.cc:2804] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:00:43.891346  5873 raft_consensus.cc:697] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 14 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:43.890937  1570 leader_election.cc:304] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:43.892190  5860 raft_consensus.cc:2749] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:43.869361  5761 raft_consensus.cc:2749] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:43.861956  2226 raft_consensus.cc:2468] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 7.
I20260709 13:00:43.892308  5873 consensus_queue.cc:237] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:43.893049  1570 leader_election.cc:304] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:43.870105  5729 raft_consensus.cc:2749] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:43.898895  1644 leader_election.cc:304] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:43.901688  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:43.903864  1570 leader_election.cc:304] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:43.904686  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:43.907195  1644 leader_election.cc:304] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:43.885116  5587 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:43.880182  5851 raft_consensus.cc:2749] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:43.910036  1644 leader_election.cc:304] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:00:43.887943  5833 raft_consensus.cc:2749] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:43.925511  1570 leader_election.cc:304] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
W20260709 13:00:43.914090  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 126895us
I20260709 13:00:43.882966  5803 consensus_queue.cc:1059] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:00:43.915444  5872 raft_consensus.cc:2749] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:43.916039  5520 leader_election.cc:290] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:43.917590  5500 raft_consensus.cc:515] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:43.897254  5877 raft_consensus.cc:2804] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:43.933506  5877 raft_consensus.cc:493] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:43.933972  5877 raft_consensus.cc:3060] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:43.899540  5802 raft_consensus.cc:2804] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:43.910305  5535 consensus_queue.cc:1048] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 13:00:43.919404  5881 raft_consensus.cc:2749] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:43.920020  5850 consensus_queue.cc:1048] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:43.922940  5587 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 13:00:43.928557  2191 leader_election.cc:304] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
W20260709 13:00:43.989168  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 60706.4us
I20260709 13:00:43.990026  2191 leader_election.cc:304] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:43.931156  5847 raft_consensus.cc:2749] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:00:43.933055  5862 log.cc:927] Time spent T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 1.134s	user 0.005s	sys 0.000s
I20260709 13:00:43.939494  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:43.902869  5860 raft_consensus.cc:2804] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:43.906770  5686 raft_consensus.cc:2749] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:43.957003  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:43.967413  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:43.999022  1530 raft_consensus.cc:3060] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:44.098768  1528 raft_consensus.cc:2393] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 10: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:00:44.152904  1530 raft_consensus.cc:2468] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 10.
W20260709 13:00:44.154074  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 244113us
I20260709 13:00:44.159564  5726 leader_election.cc:290] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:44.161801  5587 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:44.164486  1530 raft_consensus.cc:1240] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:44.167001  1672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49170 (request call id 2151) took 1103 ms. Trace:
I20260709 13:00:44.167837  1672 rpcz_store.cc:276] 0709 13:00:43.063243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:43.063365 (+   122us) service_pool.cc:224] Handling call
0709 13:00:44.165985 (+1102620us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b54000a4954. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:44.166941 (+   956us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":325145472}
I20260709 13:00:44.162375  5587 raft_consensus.cc:493] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
W20260709 13:00:44.169260  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 243828us
I20260709 13:00:44.169945  1570 leader_election.cc:304] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:00:44.170269  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:44.169122  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
W20260709 13:00:44.186064  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 369949us
I20260709 13:00:43.944130  5802 raft_consensus.cc:493] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:00:44.094096  5520 raft_consensus.cc:2749] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:44.142693  5861 raft_consensus.cc:2804] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:44.172194  5729 raft_consensus.cc:2764] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
W20260709 13:00:44.174265  5858 log.cc:927] Time spent T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.231s	user 0.000s	sys 0.000s
W20260709 13:00:44.261277  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 91419.2us
I20260709 13:00:44.265288  1570 leader_election.cc:304] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:44.272946  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 13:00:44.273356  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:44.274897  1528 raft_consensus.cc:2393] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 13: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:00:44.254315  5802 raft_consensus.cc:3060] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:44.249159  5818 leader_election.cc:290] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:44.252967  5860 raft_consensus.cc:697] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 11 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:44.243745  5931 raft_consensus.cc:2749] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:44.262987  5861 raft_consensus.cc:493] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:44.271976  5590 raft_consensus.cc:2749] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:44.281685  5923 raft_consensus.cc:2749] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:44.303453  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43010 (request call id 2182) took 2375 ms. Trace:
I20260709 13:00:44.310300  1529 rpcz_store.cc:276] 0709 13:00:41.927584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.007842 (+ 80258us) service_pool.cc:224] Handling call
0709 13:00:42.030877 (+ 23035us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:42.031192 (+   315us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:42.031218 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:42.031681 (+   463us) log.cc:844] Serialized 26 byte log entry
0709 13:00:42.656884 (+625203us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:42.656923 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:42.656982 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:43.932432 (+1275450us) spinlock_profiling.cc:243] Waited 2.12 ms on lock 0x7b4400022b4c. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a153ecc85 00007f6a153ed6a2 00007f6a1815f1db 00007f6a1815aaaf 00007f6a1814e86e 00007f6a1814dbb6 00007f6a1814d7d8 00007f6a18157221 00007f6a181571d9 00007f6a18157169
0709 13:00:44.298340 (+365908us) raft_consensus.cc:1685] finished
0709 13:00:44.298360 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:44.303382 (+  5022us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":93,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":81,"spinlock_wait_cycles":4881280,"thread_start_us":624862,"threads_started":1,"wal-append.queue_time_us":707109}
I20260709 13:00:44.241732  5587 raft_consensus.cc:515] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:44.299947  5861 raft_consensus.cc:3060] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:00:44.314785  5747 consensus_meta.cc:287] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.501s	user 0.007s	sys 0.001s
W20260709 13:00:44.321503  5813 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.001s	sys 0.019s
W20260709 13:00:44.330303  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 63774.5us
W20260709 13:00:44.329857  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 339924us
I20260709 13:00:44.333365  2191 leader_election.cc:304] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:44.338557  1570 leader_election.cc:304] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:44.349416  5926 raft_consensus.cc:2749] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:44.351344  1570 leader_election.cc:304] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:44.353464  2191 leader_election.cc:304] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
W20260709 13:00:44.334231  5813 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.001s	sys 0.020s
W20260709 13:00:44.369230  2191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:44.370498  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 13:00:44.372557  1570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:44.331156  5747 raft_consensus.cc:515] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:44.372032  2225 raft_consensus.cc:1240] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 13:00:44.374146  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:44.364959  5882 raft_consensus.cc:2804] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:44.372522  2218 raft_consensus.cc:1240] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:44.385629  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:44.386169  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:44.411521  1606 raft_consensus.cc:2468] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 11.
I20260709 13:00:44.412400  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:44.383579  5698 raft_consensus.cc:3060] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:44.416535  5846 consensus_meta.cc:287] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.698s	user 0.002s	sys 0.007s
I20260709 13:00:44.386422  5500 leader_election.cc:290] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:44.416792  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:44.417533  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:44.418362  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:44.384095  5935 raft_consensus.cc:2804] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:44.427934  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:44.422902  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:44.430375  1598 raft_consensus.cc:2410] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 14 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:00:44.423364  1600 raft_consensus.cc:1240] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:00:44.424628  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:44.425679  5938 raft_consensus.cc:493] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:44.391049  5882 raft_consensus.cc:493] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:44.435106  5943 consensus_queue.cc:1048] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:00:44.436497  5892 consensus_queue.cc:1059] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:44.445046  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:44.447028  5882 raft_consensus.cc:3060] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:44.447525  5892 raft_consensus.cc:3055] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:44.447842  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:44.448189  1677 raft_consensus.cc:3060] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:44.450167  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:44.446128  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:44.451408  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:44.452059  1673 raft_consensus.cc:2468] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 13.
I20260709 13:00:44.453361  1672 raft_consensus.cc:1275] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:44.455263  1672 raft_consensus.cc:1240] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:44.456387  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:44.457566  1677 raft_consensus.cc:2468] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 7.
I20260709 13:00:44.447918  5892 raft_consensus.cc:740] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:00:44.460846  5747 leader_election.cc:290] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:44.460613  5892 consensus_queue.cc:260] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:44.462302  5892 raft_consensus.cc:3060] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:44.340698  5860 consensus_queue.cc:237] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:44.422554  5846 raft_consensus.cc:515] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:44.475303  1605 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 879) took 1909 ms (client timeout 2214 ms). Trace:
I20260709 13:00:44.458063  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:00:44.475809  1605 rpcz_store.cc:269] 0709 13:00:42.565657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.899792 (+334135us) service_pool.cc:224] Handling call
0709 13:00:44.475082 (+1575290us) spinlock_profiling.cc:243] Waited 183 ms on lock 0x7b5400364a54. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:44.475236 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":420588288}
I20260709 13:00:44.478056  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:44.477509  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:44.478544  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:44.479051  1677 raft_consensus.cc:3055] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:44.479535  1677 raft_consensus.cc:740] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
W20260709 13:00:44.479295  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 86666.2us
I20260709 13:00:44.495165  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:44.480298  1677 consensus_queue.cc:260] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:44.503115  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:44.507961  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:44.509290  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:44.509500  1496 leader_election.cc:304] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:44.509859  2225 raft_consensus.cc:2376] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 7. Re-sending same reply.
I20260709 13:00:44.510957  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:44.511615  2226 raft_consensus.cc:2468] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 13.
I20260709 13:00:44.433652  5935 raft_consensus.cc:493] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:44.515136  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:44.512120  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:44.512374  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:44.513180  1497 leader_election.cc:304] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:44.510648  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:44.510718  1496 leader_election.cc:304] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:44.513653  1677 raft_consensus.cc:3060] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:44.518956  1496 leader_election.cc:304] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:44.512797  5879 raft_consensus.cc:2749] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:44.508509  5926 raft_consensus.cc:493] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:44.541347  1677 raft_consensus.cc:2468] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 10.
I20260709 13:00:44.544662  1496 leader_election.cc:304] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:44.532339  1497 leader_election.cc:304] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:44.535229  5850 raft_consensus.cc:2749] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:44.547676  2219 raft_consensus.cc:2468] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 7.
I20260709 13:00:44.522042  5935 raft_consensus.cc:3060] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:44.536268  5943 raft_consensus.cc:2804] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:44.475795  5938 raft_consensus.cc:515] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:44.536166  5827 raft_consensus.cc:476] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 LEADER]: Not starting pre-election -- already a leader
I20260709 13:00:44.528465  5892 raft_consensus.cc:2804] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:00:44.538499  5903 consensus_meta.cc:287] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.724s	user 0.005s	sys 0.005s
I20260709 13:00:44.528319  5812 consensus_queue.cc:1048] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:00:44.559113  5892 raft_consensus.cc:493] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:44.572098  5892 raft_consensus.cc:3060] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:44.573335  5697 raft_consensus.cc:3060] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:44.577230  1644 leader_election.cc:304] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:44.579689  2227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50310 (request call id 837) took 1093 ms. Trace:
I20260709 13:00:44.580333  5802 raft_consensus.cc:515] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:44.580123  2227 rpcz_store.cc:276] 0709 13:00:43.486375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:43.486821 (+   446us) service_pool.cc:224] Handling call
0709 13:00:43.686751 (+199930us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:43.686951 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:00:43.737062 (+ 50111us) log.cc:844] Serialized 14 byte log entry
0709 13:00:43.809227 (+ 72165us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:43.809281 (+    54us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:43.809329 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:43.809394 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:44.579498 (+770104us) spinlock_profiling.cc:243] Waited 200 ms on lock 0x7b540069fd50. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b28ad 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:44.579622 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":54625,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":116,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":100,"spinlock_wait_cycles":459196288,"thread_start_us":121531,"threads_started":2,"wal-append.queue_time_us":70620}
I20260709 13:00:44.581653  1672 raft_consensus.cc:1240] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 11. Current term is 12. Ops: []
W20260709 13:00:44.566587  5727 consensus_meta.cc:287] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.667s	user 0.004s	sys 0.001s
I20260709 13:00:44.559834  5879 raft_consensus.cc:2804] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:44.560755  5943 raft_consensus.cc:697] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:00:44.587432  5686 raft_consensus.cc:2749] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:44.587608  5879 raft_consensus.cc:697] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:00:44.557274  5587 leader_election.cc:290] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:44.538268  5932 consensus_queue.cc:1059] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 13:00:44.561079  5827 raft_consensus.cc:2749] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:44.592329  1603 raft_consensus.cc:1275] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:00:44.592721  1603 pending_rounds.cc:85] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642: Aborting all ops after (but not including) 5
I20260709 13:00:44.592908  1603 pending_rounds.cc:107] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:00:44.593201  1603 raft_consensus.cc:2889] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:44.595278  5938 leader_election.cc:290] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:44.596346  5932 raft_consensus.cc:3055] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:44.596760  5932 raft_consensus.cc:740] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:00:44.547969  5926 raft_consensus.cc:515] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:44.604602  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 72325.6us
I20260709 13:00:44.605492  1497 leader_election.cc:304] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:44.606424  1497 leader_election.cc:304] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:44.607793  5723 raft_consensus.cc:3055] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:44.608217  5723 raft_consensus.cc:740] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:44.609010  5723 consensus_queue.cc:260] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:44.609723  5926 leader_election.cc:290] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:44.568776  5903 raft_consensus.cc:515] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:44.610702  5938 raft_consensus.cc:2749] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:44.612613  1674 raft_consensus.cc:1240] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:44.596691  5725 leader_election.cc:290] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:44.613148  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:44.588034  5943 consensus_queue.cc:237] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:44.614619  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 13:00:44.617161  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 80724.1us
W20260709 13:00:44.607060  5909 consensus_meta.cc:287] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.729s	user 0.009s	sys 0.001s
I20260709 13:00:44.615535  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:00:44.605070  5877 consensus_meta.cc:287] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.671s	user 0.005s	sys 0.005s
I20260709 13:00:44.627233  5877 raft_consensus.cc:515] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:44.614595  5698 raft_consensus.cc:2749] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:44.622200  1607 raft_consensus.cc:2393] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 9: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:00:44.624079  5747 consensus_queue.cc:1059] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:00:44.625175  5296 raft_consensus.cc:3055] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:44.619292  5530 raft_consensus.cc:493] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:44.592795  5861 raft_consensus.cc:515] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:44.664331  5530 raft_consensus.cc:515] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:44.665544  5903 leader_election.cc:290] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:44.666950  5861 leader_election.cc:290] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:44.660810  5296 raft_consensus.cc:740] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
W20260709 13:00:44.678220  5937 log.cc:927] Time spent T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.258s	user 0.001s	sys 0.000s
I20260709 13:00:44.701676  1606 raft_consensus.cc:2468] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 10.
I20260709 13:00:44.597571  5804 consensus_queue.cc:1048] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:00:44.613399  5827 raft_consensus.cc:2749] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:44.634400  5909 raft_consensus.cc:515] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:44.616923  5938 raft_consensus.cc:493] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:44.621448  5723 raft_consensus.cc:3060] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:00:44.705447  1495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:44.588502  5879 consensus_queue.cc:237] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:44.729511  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:00:44.731287  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 148359us
I20260709 13:00:44.732498  1676 raft_consensus.cc:1240] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:44.732578  1644 leader_election.cc:304] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:44.737671  1644 leader_election.cc:304] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:44.661332  5932 consensus_queue.cc:260] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:44.748162  5877 leader_election.cc:290] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:00:44.754325  5948 log.cc:927] Time spent T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 13:00:44.757155  5872 raft_consensus.cc:3055] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:44.757618  5872 raft_consensus.cc:740] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:44.758775  5818 consensus_queue.cc:1059] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:44.760239  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36200 (request call id 2357) took 1143 ms. Trace:
I20260709 13:00:44.760644  1604 rpcz_store.cc:276] 0709 13:00:43.616872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:43.624883 (+  8011us) service_pool.cc:224] Handling call
0709 13:00:43.625177 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:44.264549 (+639372us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:00:44.287621 (+ 23072us) log.cc:844] Serialized 14 byte log entry
0709 13:00:44.512968 (+225347us) log.cc:844] Serialized 14 byte log entry
0709 13:00:44.616018 (+103050us) spinlock_profiling.cc:243] Waited 2.68 ms on lock 0x7b18004a9500. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1e38ede1 00007f6a1e39b5b1 00007f6a15440c0a 00007f6a1eb80219 00007f6a154c8a40 00007f6a154c34e4 00007f6a154c3455 00007f6a185ab060 00007f6a185bd716 00007f6a185ce287 00007f6a185ce208
0709 13:00:44.616397 (+   379us) log.cc:844] Serialized 14 byte log entry
0709 13:00:44.616665 (+   268us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:44.616717 (+    52us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:44.616763 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:44.759357 (+142594us) spinlock_profiling.cc:243] Waited 1.51 ms on lock 0x7b18004a9500. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1e38ede1 00007f6a1e39b5b1 00007f6a154942a6 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419
0709 13:00:44.760007 (+   650us) spinlock_profiling.cc:243] Waited 628 ms on lock 0x7b54002ec054. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:00:44.760042 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:44.760182 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":143193,"prepare.queue_time_us":23299,"prepare.run_cpu_time_us":138,"prepare.run_wall_time_us":7135,"raft.queue_time_us":171360,"raft.run_cpu_time_us":390,"raft.run_wall_time_us":20696,"spinlock_wait_cycles":1452906368,"thread_start_us":190405,"threads_started":1,"wal-append.queue_time_us":259272}
I20260709 13:00:44.758482  5438 raft_consensus.cc:3055] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:44.763607  5438 raft_consensus.cc:740] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:44.764556  5438 consensus_queue.cc:260] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:00:44.768355  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:44.724069  5938 raft_consensus.cc:515] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:44.737574  5908 raft_consensus.cc:2749] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:44.773308  5530 leader_election.cc:290] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:44.785398  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:44.787518  1646 leader_election.cc:304] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:44.788409  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:44.744935  5664 raft_consensus.cc:2749] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:44.796204  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:44.773371  5938 leader_election.cc:290] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:44.801817  2223 raft_consensus.cc:2468] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 9.
I20260709 13:00:44.798745  1531 raft_consensus.cc:1275] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:00:44.812342  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:44.813670  5730 consensus_queue.cc:1048] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:44.783721  5802 leader_election.cc:290] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:44.832546  1677 raft_consensus.cc:1240] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:00:44.833932  1678 raft_consensus.cc:1240] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:44.834857  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:44.831478  1672 raft_consensus.cc:1240] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:44.837062  1681 raft_consensus.cc:1275] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:00:44.785130  5851 consensus_queue.cc:1059] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
W20260709 13:00:44.847223  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 229403us
I20260709 13:00:44.847535  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:44.839839  1679 pending_rounds.cc:85] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90: Aborting all ops after (but not including) 9
I20260709 13:00:44.848402  1572 leader_election.cc:304] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:44.848886  1679 pending_rounds.cc:107] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90: Aborting uncommitted NO_OP operation due to leader change: 8.10
I20260709 13:00:44.849352  1679 raft_consensus.cc:2889] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:44.843971  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:44.808409  5686 raft_consensus.cc:3055] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:44.862552  1572 leader_election.cc:304] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
W20260709 13:00:44.864916  2191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:44.866072  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:44.868507  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:44.871306  1599 raft_consensus.cc:1275] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:00:44.877736  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:44.878396  1681 raft_consensus.cc:2468] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 13.
I20260709 13:00:44.846624  5903 raft_consensus.cc:2749] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:44.845824  5848 raft_consensus.cc:493] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:44.836663  5938 raft_consensus.cc:493] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:44.896270  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:44.886358  1531 raft_consensus.cc:1275] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:00:44.892503  1680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50664 (request call id 960) took 1299 ms. Trace:
I20260709 13:00:44.847225  5833 raft_consensus.cc:493] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:44.896490  1607 raft_consensus.cc:1240] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:44.897436  1680 rpcz_store.cc:276] 0709 13:00:43.593137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:43.593351 (+   214us) service_pool.cc:224] Handling call
0709 13:00:43.593633 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:43.606732 (+ 13099us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:43.606763 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:43.606809 (+    46us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:00:43.606836 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:44.892277 (+1285441us) spinlock_profiling.cc:243] Waited 12.9 ms on lock 0x7b5400178c54. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:00:44.892323 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:44.892446 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":29650176}
I20260709 13:00:44.867369  5827 raft_consensus.cc:493] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:44.941562  1531 raft_consensus.cc:1275] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:00:44.863808  5686 raft_consensus.cc:740] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:44.870000  5877 raft_consensus.cc:2749] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:00:44.945534  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 54522.3us
I20260709 13:00:44.949255  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:44.874316  5875 raft_consensus.cc:2804] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:44.948408  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:44.963590  1605 raft_consensus.cc:1240] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:44.943027  5938 raft_consensus.cc:515] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:44.870277  5553 consensus_queue.cc:1059] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.079s
I20260709 13:00:44.993642  1603 raft_consensus.cc:1240] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:44.927289  5594 raft_consensus.cc:493] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:44.930385  5926 raft_consensus.cc:493] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:44.889288  5739 consensus_queue.cc:1048] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.102s
I20260709 13:00:44.929782  5851 raft_consensus.cc:493] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:44.881119  5882 raft_consensus.cc:515] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:44.929438  5848 raft_consensus.cc:515] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:44.961916  5928 log.cc:927] Time spent T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.700s	user 0.004s	sys 0.000s
I20260709 13:00:44.941074  5860 raft_consensus.cc:493] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.016501  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:44.837095  5935 raft_consensus.cc:515] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:44.975319  1496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:44.970958  1646 leader_election.cc:304] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:44.965711  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:45.013643  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
W20260709 13:00:44.999250  2223 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50310 (request call id 840) took 1509 ms (client timeout 1986 ms). Trace:
I20260709 13:00:44.957710  5952 raft_consensus.cc:493] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:44.928337  5725 consensus_queue.cc:1059] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.100s
W20260709 13:00:45.040501  5957 log.cc:927] Time spent T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
W20260709 13:00:45.026950  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 56085us
I20260709 13:00:45.024650  5952 raft_consensus.cc:515] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:45.034258  5818 raft_consensus.cc:2749] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:00:45.035125  5553 raft_consensus.cc:3055] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:00:45.044185  5955 log.cc:927] Time spent T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.172s	user 0.000s	sys 0.001s
I20260709 13:00:45.062836  5851 raft_consensus.cc:515] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:44.993968  5909 leader_election.cc:290] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
W20260709 13:00:45.020401  2223 rpcz_store.cc:269] 0709 13:00:43.489615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:43.490602 (+   987us) service_pool.cc:224] Handling call
0709 13:00:44.999023 (+1508421us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b540059cc54. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:44.999149 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3013692672}
I20260709 13:00:45.041095  5860 raft_consensus.cc:515] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:45.019287  5875 raft_consensus.cc:697] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 7 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:45.082093  2224 raft_consensus.cc:1240] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:45.000257  5943 raft_consensus.cc:3055] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:44.966403  5850 raft_consensus.cc:493] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:44.998023  5846 leader_election.cc:290] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:44.943917  5849 consensus_queue.cc:1048] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.100s
I20260709 13:00:45.084721  2218 raft_consensus.cc:1240] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
W20260709 13:00:45.083829  5892 consensus_meta.cc:287] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent flushing consensus metadata: real 0.511s	user 0.010s	sys 0.001s
I20260709 13:00:45.088884  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:44.972656  5879 raft_consensus.cc:493] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:45.021697  5926 raft_consensus.cc:515] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:45.083869  5553 raft_consensus.cc:740] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:45.096318  5952 leader_election.cc:290] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:45.021486  5594 raft_consensus.cc:515] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:45.130590  5875 consensus_queue.cc:237] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:45.110491  5943 raft_consensus.cc:740] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:00:45.067785  5732 raft_consensus.cc:493] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.133796  1604 raft_consensus.cc:1275] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:00:45.092643  5882 leader_election.cc:290] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:44.956120  5686 consensus_queue.cc:260] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:45.105878  5938 leader_election.cc:290] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:45.105719  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:45.137619  1606 raft_consensus.cc:2468] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 12.
I20260709 13:00:44.961848  5827 raft_consensus.cc:515] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:44.950636  5833 raft_consensus.cc:515] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:45.115279  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 153963us
I20260709 13:00:44.961877  5885 consensus_queue.cc:1059] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.236s
W20260709 13:00:45.118774  2190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:45.123603  1523 raft_consensus.cc:2376] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 16. Re-sending same reply.
I20260709 13:00:45.126310  5892 raft_consensus.cc:515] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:45.126571  5879 raft_consensus.cc:515] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:45.090808  5535 consensus_queue.cc:1059] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:00:45.133304  5943 consensus_queue.cc:260] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:45.104254  5848 leader_election.cc:290] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:45.158696  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:45.147205  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:45.138250  5935 leader_election.cc:290] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:45.160647  2223 raft_consensus.cc:1275] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:00:45.161657  2221 raft_consensus.cc:2393] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 12: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:00:45.119879  5850 raft_consensus.cc:515] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:45.164608  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:45.165428  1526 raft_consensus.cc:2368] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 12. Current term is 13.
W20260709 13:00:45.162204  5863 log.cc:927] Time spent T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 2.381s	user 0.010s	sys 0.047s
I20260709 13:00:45.133241  5732 raft_consensus.cc:515] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:45.167431  1679 raft_consensus.cc:2393] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 12: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:00:45.130328  5296 consensus_queue.cc:260] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:45.168267  5938 consensus_queue.cc:1059] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:45.168488  5963 raft_consensus.cc:493] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:45.169207  5850 leader_election.cc:290] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:45.169787  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:45.196482  5690 leader_election.cc:290] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:45.200505  5732 leader_election.cc:290] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:45.200706  2226 raft_consensus.cc:1275] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:00:45.202024  5892 leader_election.cc:290] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:45.203189  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:00:45.204221  5956 log.cc:927] Time spent T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:00:45.204340  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:45.190040  5296 raft_consensus.cc:3060] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:45.178176  5851 leader_election.cc:290] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:45.200927  5827 leader_election.cc:290] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:45.166985  1497 leader_election.cc:304] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
W20260709 13:00:45.211639  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 44758.4us
I20260709 13:00:45.212435  1497 leader_election.cc:304] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:45.213205  5851 raft_consensus.cc:2749] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:00:45.213919  5851 raft_consensus.cc:2749] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:45.214214  5872 consensus_queue.cc:260] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:45.215274  5872 raft_consensus.cc:3060] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:45.217605  1497 leader_election.cc:304] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:45.218997  1497 leader_election.cc:304] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
W20260709 13:00:45.177289  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 102236us
I20260709 13:00:45.189265  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:45.167090  5668 raft_consensus.cc:493] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:45.195240  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:45.176530  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:45.225628  1497 leader_election.cc:304] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:45.176436  5943 raft_consensus.cc:3060] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:00:45.236357  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 48245.8us
W20260709 13:00:45.235843  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 50565.2us
I20260709 13:00:45.238054  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:45.242573  1497 leader_election.cc:304] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:45.244140  5972 raft_consensus.cc:493] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.244824  5972 raft_consensus.cc:515] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:45.248061  1604 pending_rounds.cc:85] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642: Aborting all ops after (but not including) 7
I20260709 13:00:45.248369  1604 pending_rounds.cc:107] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:00:45.248639  1604 raft_consensus.cc:2889] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:45.248704  1497 leader_election.cc:304] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
W20260709 13:00:45.249601  1495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:45.250033  5850 raft_consensus.cc:2749] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:45.250706  5850 raft_consensus.cc:2749] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:45.240864  2192 leader_election.cc:304] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:00:45.255648  2226 raft_consensus.cc:1275] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:00:45.258054  1606 raft_consensus.cc:1240] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:45.259178  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:45.260309  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:45.260887  1529 raft_consensus.cc:2468] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 10.
I20260709 13:00:45.261601  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:45.189836  5938 raft_consensus.cc:3055] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:00:45.235495  5846 raft_consensus.cc:493] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:45.268344  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:45.277997  2192 leader_election.cc:304] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:00:45.239883  5851 raft_consensus.cc:2749] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:00:45.212613  5963 raft_consensus.cc:515] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:45.247665  5892 raft_consensus.cc:2749] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:45.266059  5938 raft_consensus.cc:740] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:00:45.257189  5725 consensus_queue.cc:1048] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.059s
I20260709 13:00:45.266209  5826 consensus_queue.cc:1048] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 13:00:45.247761  5668 raft_consensus.cc:515] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:45.267256  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:45.400386  1529 raft_consensus.cc:2393] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 7: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:00:45.401471  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 13:00:45.369114  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:45.299172  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:45.412144  5926 leader_election.cc:290] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:00:45.402786  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 138319us
I20260709 13:00:45.257416  5931 raft_consensus.cc:493] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:45.319305  5881 raft_consensus.cc:2804] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:45.416283  5690 raft_consensus.cc:493] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:45.367200  5833 leader_election.cc:290] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:45.355774  5964 raft_consensus.cc:2804] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:45.364400  5879 leader_election.cc:290] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:45.433435  1529 raft_consensus.cc:1275] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:00:45.293138  5846 raft_consensus.cc:515] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:00:45.436247  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 158344us
I20260709 13:00:45.437500  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:45.433562  5690 raft_consensus.cc:515] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:45.429607  5881 raft_consensus.cc:493] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:45.437541  2192 leader_election.cc:304] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:45.432461  5827 raft_consensus.cc:2749] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:45.445233  5690 leader_election.cc:290] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:45.455415  5851 raft_consensus.cc:493] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:45.456025  5851 raft_consensus.cc:515] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:45.457247  2220 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 849) took 3565 ms (client timeout 2215 ms). Trace:
W20260709 13:00:45.457670  2220 rpcz_store.cc:269] 0709 13:00:41.892072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.894065 (+  1993us) service_pool.cc:224] Handling call
0709 13:00:45.457062 (+3562997us) spinlock_profiling.cc:243] Waited 1.78 s on lock 0x7b54005618d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:45.457174 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4088477568}
I20260709 13:00:45.458252  5851 leader_election.cc:290] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:45.438866  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:45.460556  1529 raft_consensus.cc:2468] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 9.
I20260709 13:00:45.433029  5931 raft_consensus.cc:515] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:45.442621  5881 raft_consensus.cc:3060] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:00:45.502756  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 65289.1us
I20260709 13:00:45.443029  5964 raft_consensus.cc:697] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 12 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
W20260709 13:00:45.523952  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 56613.3us
I20260709 13:00:45.522294  2192 leader_election.cc:304] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
W20260709 13:00:45.510354  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 43751.2us
W20260709 13:00:45.539009  1570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:45.592792  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 67474.8us
W20260709 13:00:45.594604  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 72403.6us
I20260709 13:00:45.593663  5980 raft_consensus.cc:2749] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:45.647328  5963 leader_election.cc:290] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:45.649583  1523 raft_consensus.cc:2468] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 12.
I20260709 13:00:45.441145  5938 consensus_queue.cc:260] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:45.657644  5938 raft_consensus.cc:3060] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:45.661732  5931 leader_election.cc:290] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:00:45.667685  5985 log.cc:927] Time spent T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 13:00:45.673214  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:45.673926  1527 raft_consensus.cc:2468] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 11.
I20260709 13:00:45.605983  5826 raft_consensus.cc:493] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:45.676224  5826 raft_consensus.cc:515] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:45.592681  5725 raft_consensus.cc:493] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:45.687404  5725 raft_consensus.cc:515] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:45.689698  5725 leader_election.cc:290] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:45.635753  5699 consensus_queue.cc:1048] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 13:00:45.700169  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:00:45.700198  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:45.703914  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:45.706055  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:45.636425  5952 raft_consensus.cc:493] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.714010  1532 raft_consensus.cc:1275] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:00:45.639356  5882 raft_consensus.cc:2749] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:00:45.718083  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:45.678493  5826 leader_election.cc:290] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:45.695533  5964 consensus_queue.cc:237] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:45.712327  5640 consensus_queue.cc:1048] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 13:00:45.707944  5726 consensus_queue.cc:1048] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:00:45.727361  5952 raft_consensus.cc:515] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:45.769400  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 157406us
I20260709 13:00:45.775066  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:45.775795  1523 raft_consensus.cc:2468] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 7.
I20260709 13:00:45.782140  5872 consensus_queue.cc:1048] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:00:45.785044  5976 consensus_queue.cc:1059] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:00:45.786146  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:45.789072  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:45.789472  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:45.790010  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:45.790181  2221 raft_consensus.cc:2468] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 9.
I20260709 13:00:45.791088  2223 raft_consensus.cc:2468] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 9.
I20260709 13:00:45.793596  5739 raft_consensus.cc:3055] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:45.793979  5739 raft_consensus.cc:740] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:45.794780  5739 consensus_queue.cc:260] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:45.796193  5952 leader_election.cc:290] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:45.796731  5952 raft_consensus.cc:493] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
W20260709 13:00:45.800189  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 162162us
I20260709 13:00:45.800450  1572 leader_election.cc:304] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:45.802842  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:45.803391  1572 leader_election.cc:304] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:00:45.804224  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:45.804715  2192 leader_election.cc:304] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:45.781776  5881 raft_consensus.cc:515] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:45.797228  5952 raft_consensus.cc:515] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:45.806350  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:45.809943  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:45.792217  5846 leader_election.cc:290] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:45.813519  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:45.809742  5296 raft_consensus.cc:2804] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:45.815017  5296 raft_consensus.cc:493] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:45.815390  5296 raft_consensus.cc:3060] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:45.800915  5668 leader_election.cc:290] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:00:45.823632  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:45.805984  5747 raft_consensus.cc:2804] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:45.814790  5882 raft_consensus.cc:2804] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:45.840112  5882 raft_consensus.cc:493] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:45.840567  5882 raft_consensus.cc:3060] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:45.842420  5861 raft_consensus.cc:493] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.842985  5861 raft_consensus.cc:515] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:45.843940  5952 leader_election.cc:290] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:45.456496   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:00:45.848351  5971 log.cc:927] Time spent T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.193s	user 0.003s	sys 0.000s
I20260709 13:00:45.851482  1496 leader_election.cc:304] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:45.852873  1496 leader_election.cc:304] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:45.830169  5747 raft_consensus.cc:493] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
W20260709 13:00:45.870855  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 87766.2us
I20260709 13:00:45.871233  5881 leader_election.cc:290] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 13 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:45.864630  5943 raft_consensus.cc:2804] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:45.882179  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:45.881595  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:45.884230  1677 raft_consensus.cc:2393] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 11: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:00:45.889381  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:45.866895  5826 raft_consensus.cc:3060] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:45.890367  1672 raft_consensus.cc:3060] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:45.890575  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:45.892783  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:45.896781  1605 raft_consensus.cc:3060] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:00:45.898258  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:45.878866  5747 raft_consensus.cc:3060] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:45.876886  5861 leader_election.cc:290] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:45.902052  1673 raft_consensus.cc:1240] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 14 LEADER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 13. Current term is 14. Ops: []
I20260709 13:00:45.901253  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:45.878096  5943 raft_consensus.cc:493] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:45.905810  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:45.910265  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:45.884896  5879 consensus_queue.cc:1059] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
W20260709 13:00:45.986786  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 83604.8us
I20260709 13:00:45.895469  5699 raft_consensus.cc:493] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.987609  2190 leader_election.cc:304] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:45.990442  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:45.993108  1605 raft_consensus.cc:2468] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 13.
I20260709 13:00:45.994107  1672 raft_consensus.cc:2468] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 14.
I20260709 13:00:45.999238  2190 leader_election.cc:304] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:45.911399  5592 raft_consensus.cc:493] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.007081  1644 leader_election.cc:304] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:46.008205  1570 leader_election.cc:400] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 pre-election: Vote denied by peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931) with higher term. Message: Invalid argument: T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 12. Current term is 13.
I20260709 13:00:46.008585  1570 leader_election.cc:403] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:46.012729  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:46.014199  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:46.015522  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:46.016100  2219 raft_consensus.cc:2468] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 9.
I20260709 13:00:46.017496  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:46.018064  2219 raft_consensus.cc:3060] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:46.023407  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:46.023407  1497 leader_election.cc:304] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:46.025281  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:45.912369  5943 raft_consensus.cc:3060] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:46.027997  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:46.028276  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:46.029346  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:46.029632  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:46.030230  1606 raft_consensus.cc:2468] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 7.
I20260709 13:00:46.031095  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:46.031029  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:46.032166  1570 leader_election.cc:304] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:46.025650  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:46.035691  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:46.036289  2220 raft_consensus.cc:2468] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 7.
I20260709 13:00:46.039436  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:46.039901  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:46.041026  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:46.039361  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:46.042995  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:46.026503  5697 raft_consensus.cc:2749] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:00:46.010962  5846 raft_consensus.cc:493] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:46.025950  5592 raft_consensus.cc:515] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:46.159297  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:46.046000  5810 raft_consensus.cc:2749] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:46.161489  1604 raft_consensus.cc:1275] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:00:46.001977  5699 raft_consensus.cc:515] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:46.179791  5997 log.cc:927] Time spent T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.277s	user 0.001s	sys 0.000s
W20260709 13:00:46.187359  5994 log.cc:927] Time spent T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
W20260709 13:00:46.189579  5991 log.cc:927] Time spent T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.270s	user 0.001s	sys 0.000s
W20260709 13:00:46.190627  5995 log.cc:927] Time spent T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
I20260709 13:00:46.205679  1599 raft_consensus.cc:1240] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
W20260709 13:00:46.170492  5938 consensus_meta.cc:287] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent flushing consensus metadata: real 0.512s	user 0.009s	sys 0.002s
I20260709 13:00:46.192864  2219 raft_consensus.cc:2468] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 14.
W20260709 13:00:46.211853  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:46.216585  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 193082us
W20260709 13:00:46.231858  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:46.155689  5879 raft_consensus.cc:493] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:46.269515  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:46.270701  1496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:46.275174  1598 raft_consensus.cc:1275] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:00:46.290787  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:46.156502  5846 raft_consensus.cc:515] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:46.315352  5699 leader_election.cc:290] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:46.317173  5976 consensus_queue.cc:1048] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 13:00:46.319773  5977 raft_consensus.cc:2749] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:00:46.321234  5296 consensus_meta.cc:287] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.505s	user 0.010s	sys 0.000s
I20260709 13:00:46.321667  5296 raft_consensus.cc:515] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:46.308734  5938 raft_consensus.cc:2804] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:46.323280  5938 raft_consensus.cc:493] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:46.323688  5938 raft_consensus.cc:3060] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:46.323304  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:46.323446  5876 raft_consensus.cc:493] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:46.327484  1680 raft_consensus.cc:2468] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 7.
I20260709 13:00:46.332741  2191 leader_election.cc:304] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
W20260709 13:00:46.320091  5998 log.cc:927] Time spent T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.163s	user 0.000s	sys 0.000s
I20260709 13:00:46.328014  5876 raft_consensus.cc:515] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:46.339850  1675 raft_consensus.cc:1240] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 13 LEADER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 13:00:46.315949  5668 raft_consensus.cc:493] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:46.340979  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36200 (request call id 2372) took 1445 ms. Trace:
I20260709 13:00:46.358982  1603 rpcz_store.cc:276] 0709 13:00:44.895552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.897054 (+  1502us) service_pool.cc:224] Handling call
0709 13:00:44.993471 (+ 96417us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:44.994136 (+   665us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:46.340772 (+1346636us) spinlock_profiling.cc:243] Waited 96.1 ms on lock 0x7b540039e250. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b28ad 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:46.340908 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":221115264}
W20260709 13:00:46.340576  5978 log.cc:927] Time spent T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.704s	user 0.001s	sys 0.001s
I20260709 13:00:46.358512  6002 raft_consensus.cc:2749] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931) with higher term. Message: Invalid argument: T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 12. Current term is 13.
I20260709 13:00:46.304795  5879 raft_consensus.cc:515] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:46.370685  5895 raft_consensus.cc:493] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:46.371708  5592 leader_election.cc:290] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:46.379141  6005 raft_consensus.cc:493] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.399030  6005 raft_consensus.cc:515] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:46.400652  5895 raft_consensus.cc:515] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:46.401623  6005 leader_election.cc:290] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:46.379760  6013 raft_consensus.cc:2749] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:00:46.384608  5882 consensus_meta.cc:287] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b: Time spent flushing consensus metadata: real 0.544s	user 0.009s	sys 0.000s
I20260709 13:00:46.402815  5895 leader_election.cc:290] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:46.403031  5882 raft_consensus.cc:515] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:46.404950  5876 leader_election.cc:290] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
W20260709 13:00:46.370944  5992 log.cc:927] Time spent T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:00:46.406519  5882 leader_election.cc:290] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 13 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:46.405576  2218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 859) took 1956 ms. Trace:
I20260709 13:00:46.408185  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:46.386718  5846 leader_election.cc:290] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:46.408198  2218 rpcz_store.cc:276] 0709 13:00:44.448628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.448787 (+   159us) service_pool.cc:224] Handling call
0709 13:00:44.449081 (+   294us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:45.124088 (+675007us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:46.405292 (+1281204us) spinlock_profiling.cc:243] Waited 635 ms on lock 0x7b540054e2d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:00:46.405472 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1461345536}
I20260709 13:00:46.366032  5668 raft_consensus.cc:515] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:46.434109  5972 leader_election.cc:290] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:46.356693  5699 raft_consensus.cc:2804] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:46.444548  5699 raft_consensus.cc:493] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:46.445009  5699 raft_consensus.cc:3060] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:46.445281  5668 leader_election.cc:290] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:00:46.443949  5986 log.cc:927] Time spent T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.641s	user 0.002s	sys 0.000s
I20260709 13:00:46.432049  5553 consensus_queue.cc:260] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:46.453311  5553 raft_consensus.cc:3060] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:46.471194  1673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49178 (request call id 1991) took 1963 ms. Trace:
I20260709 13:00:46.471722  1673 rpcz_store.cc:276] 0709 13:00:44.507792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.508941 (+  1149us) service_pool.cc:224] Handling call
0709 13:00:44.540096 (+ 31155us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:45.907875 (+1367779us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:46.470898 (+563023us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b540024c554. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:00:46.471122 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3132040064}
I20260709 13:00:46.478335  5860 leader_election.cc:290] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:46.478760  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49178 (request call id 1993) took 1635 ms. Trace:
I20260709 13:00:46.479149  1681 rpcz_store.cc:276] 0709 13:00:44.842888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.992436 (+149548us) service_pool.cc:224] Handling call
0709 13:00:44.992706 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:45.776181 (+783475us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:00:45.776477 (+   296us) log.cc:844] Serialized 14 byte log entry
0709 13:00:46.033228 (+256751us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:46.033277 (+    49us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:46.033318 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:46.478481 (+445163us) spinlock_profiling.cc:243] Waited 783 ms on lock 0x7b54000b7cd4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:00:46.478530 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:46.478701 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":119681,"prepare.queue_time_us":10076,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":125433,"spinlock_wait_cycles":2023624704,"thread_start_us":136719,"threads_started":1,"wal-append.queue_time_us":371081}
W20260709 13:00:46.480837  5826 consensus_meta.cc:287] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent flushing consensus metadata: real 0.581s	user 0.008s	sys 0.000s
I20260709 13:00:46.481287  5826 raft_consensus.cc:2749] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:46.482460  5698 raft_consensus.cc:3055] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:46.482903  5698 raft_consensus.cc:740] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:46.483796  5698 consensus_queue.cc:260] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:00:46.486222  5747 consensus_meta.cc:287] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.567s	user 0.004s	sys 0.002s
I20260709 13:00:46.487174  2224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 858) took 2100 ms. Trace:
I20260709 13:00:46.487571  2224 rpcz_store.cc:276] 0709 13:00:44.386825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.386932 (+   107us) service_pool.cc:224] Handling call
0709 13:00:44.387190 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:45.109887 (+722697us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:46.486933 (+1377046us) spinlock_profiling.cc:243] Waited 695 ms on lock 0x7b540033e5d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:00:46.487110 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1597778304}
I20260709 13:00:46.488864  5739 raft_consensus.cc:3060] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:46.491048  5296 leader_election.cc:290] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:46.491927  5879 leader_election.cc:290] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:46.484984  5698 raft_consensus.cc:3060] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:46.504840  5802 raft_consensus.cc:3055] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:46.505358  5802 raft_consensus.cc:740] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:46.506234  5802 consensus_queue.cc:260] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:46.507900  5802 raft_consensus.cc:3060] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:46.511570  2224 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0"
dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
mode: GRACEFUL
new_leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:47682
I20260709 13:00:46.512228  2224 raft_consensus.cc:606] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 12 LEADER]: Received request to transfer leadership to TS e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:46.513938  5594 leader_election.cc:290] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:46.534718  2224 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59"
dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
mode: GRACEFUL
new_leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:47682
I20260709 13:00:46.535369  2224 raft_consensus.cc:606] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 10 LEADER]: Received request to transfer leadership to TS e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:46.536084  2222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50326 (request call id 939) took 1347 ms. Trace:
I20260709 13:00:46.536481  2222 rpcz_store.cc:276] 0709 13:00:45.188440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:45.188944 (+   504us) service_pool.cc:224] Handling call
0709 13:00:45.189273 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:45.294028 (+104755us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:45.294057 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:45.294096 (+    39us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:00:45.294136 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:46.535840 (+1241704us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b54001329d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:00:46.535895 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:46.536023 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":240521088}
I20260709 13:00:46.519079  5909 raft_consensus.cc:493] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
W20260709 13:00:46.548817  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:46.503775  5747 raft_consensus.cc:515] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:46.553961  1601 raft_consensus.cc:2468] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 9.
I20260709 13:00:46.554862  5747 leader_election.cc:290] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:00:46.556006  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:46.558401  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:46.560624  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:46.561420  1673 raft_consensus.cc:2393] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 12: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:00:46.563838  1673 raft_consensus.cc:1275] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:00:46.566422  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:46.568714  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:46.571353  1673 raft_consensus.cc:1240] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:46.571394  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36200 (request call id 2374) took 1675 ms. Trace:
I20260709 13:00:46.572517  1674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50664 (request call id 981) took 1235 ms. Trace:
I20260709 13:00:46.574102  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:00:46.575169  5970 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.789s	user 0.010s	sys 0.018s
W20260709 13:00:46.575556  5970 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.790s	user 0.010s	sys 0.018s
I20260709 13:00:46.572914  1674 rpcz_store.cc:276] 0709 13:00:45.336722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:45.336879 (+   157us) service_pool.cc:224] Handling call
0709 13:00:45.355122 (+ 18243us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:45.404702 (+ 49580us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:45.404731 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:45.405168 (+   437us) log.cc:844] Serialized 26 byte log entry
0709 13:00:46.496700 (+1091532us) spinlock_profiling.cc:243] Waited 2.3 ms on lock 0x7b18000b61a0. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1e38ede1 00007f6a1e39b5b1 00007f6a154a8e07 00007f6a1e303ab9 00007f6a154c569b 00007f6a154c393f 00007f6a154c5c02 00007f6a1814d20b 00007f6a18152d23 00007f6a181530d1 00007f6a1856ea0f
0709 13:00:46.572154 (+ 75454us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:00:46.572189 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:46.572247 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:46.572288 (+    41us) raft_consensus.cc:1685] finished
0709 13:00:46.572298 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:46.572468 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49177,"raft.queue_time_us":60729,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":6754,"spinlock_wait_cycles":5293440,"thread_start_us":75248,"threads_started":1,"wal-append.queue_time_us":1138179}
I20260709 13:00:46.577358  5833 raft_consensus.cc:3055] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:46.571946  1602 rpcz_store.cc:276] 0709 13:00:44.896133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.896250 (+   117us) service_pool.cc:224] Handling call
0709 13:00:44.896526 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:45.607330 (+710804us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:00:45.643324 (+ 35994us) log.cc:844] Serialized 14 byte log entry
0709 13:00:45.865253 (+221929us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:45.865307 (+    54us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:00:45.865406 (+    99us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:46.480959 (+615553us) spinlock_profiling.cc:243] Waited 17.3 ms on lock 0x7b18003998e0. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1e38ede1 00007f6a1e39b5b1 00007f6a154c63f3 00007f6a154c87c1 00007f6a154c8779 00007f6a154c8709 00007f6a154c86d1 00007f6a154c79cd 000000000038f354 000000000038f199 00007f6a154a983a
0709 13:00:46.571149 (+ 90190us) spinlock_profiling.cc:243] Waited 631 ms on lock 0x7b54001694d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:00:46.571199 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:46.571321 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":84522,"prepare.queue_time_us":36538,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":49,"raft.queue_time_us":115584,"raft.run_cpu_time_us":275,"raft.run_wall_time_us":10806,"spinlock_wait_cycles":1491407616,"thread_start_us":215941,"threads_started":1,"wal-append.queue_time_us":242975}
I20260709 13:00:46.572429  5932 raft_consensus.cc:3060] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:46.579241  1675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49170 (request call id 2176) took 2141 ms. Trace:
I20260709 13:00:46.579607  1675 rpcz_store.cc:276] 0709 13:00:44.438002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.440529 (+  2527us) service_pool.cc:224] Handling call
0709 13:00:44.440867 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:46.356526 (+1915659us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:46.578999 (+222473us) spinlock_profiling.cc:243] Waited 1.9 s on lock 0x7b54002fbf54. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:00:46.579184 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4367056256}
I20260709 13:00:46.577787  5833 raft_consensus.cc:740] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:00:46.581444  5833 consensus_queue.cc:260] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:46.581815  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:46.582592  5833 raft_consensus.cc:3060] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:46.583992  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 296921us
I20260709 13:00:46.526698  6015 raft_consensus.cc:493] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:46.590580  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:46.591395  1681 raft_consensus.cc:2468] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 11.
I20260709 13:00:46.594453  5761 raft_consensus.cc:993] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b: : Instructing follower e46412b3b0b44f01ad5c33d4cfe3d6b1 to start an election
I20260709 13:00:46.594992  5761 raft_consensus.cc:1081] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 10 LEADER]: Signalling peer e46412b3b0b44f01ad5c33d4cfe3d6b1 to start an election
I20260709 13:00:46.596244  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:46.588909  5534 raft_consensus.cc:493] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.597857  5534 raft_consensus.cc:515] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:46.585067  5909 raft_consensus.cc:515] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:46.599923  5534 leader_election.cc:290] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:46.600353  5909 leader_election.cc:290] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:46.551047  5664 raft_consensus.cc:493] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.601235  5664 raft_consensus.cc:515] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:46.602860  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:46.603057  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:46.603669  2223 raft_consensus.cc:3060] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:46.604657  5951 raft_consensus.cc:493] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:46.605512  2218 raft_consensus.cc:2393] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 13: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:00:46.608894  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:46.609532  2222 raft_consensus.cc:2468] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 11.
I20260709 13:00:46.603217  5664 leader_election.cc:290] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:46.612332  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:46.617427  1677 raft_consensus.cc:2468] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 11.
I20260709 13:00:46.616480  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:46.623301  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:46.626920  1677 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29"
dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
mode: GRACEFUL
new_leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:33616
I20260709 13:00:46.627535  1677 raft_consensus.cc:606] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Received request to transfer leadership to TS e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:46.628136  1677 raft_consensus.cc:614] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:00:46.629760  1495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:46.602341  5699 raft_consensus.cc:515] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:46.631309  5879 raft_consensus.cc:493] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:46.634968  5879 raft_consensus.cc:515] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:46.635830  5870 raft_consensus.cc:493] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.636360  5870 raft_consensus.cc:515] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:46.636996  5879 leader_election.cc:290] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:46.637424  5938 raft_consensus.cc:515] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:46.638331  5870 leader_election.cc:290] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:46.639513  5938 leader_election.cc:290] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:46.641132  1497 leader_election.cc:304] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:46.617403  6015 raft_consensus.cc:515] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:00:46.642638  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 635678us
I20260709 13:00:46.646335  2227 raft_consensus.cc:2468] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 9.
I20260709 13:00:46.647394  6015 leader_election.cc:290] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:46.650058  1497 leader_election.cc:304] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:46.651847  1644 leader_election.cc:304] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:46.658396  2223 raft_consensus.cc:2468] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 10.
W20260709 13:00:46.659513  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:46.659762  1570 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.011s	sys 0.027s
W20260709 13:00:46.660487  1570 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.011s	sys 0.027s
I20260709 13:00:46.660346  1497 leader_election.cc:304] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
W20260709 13:00:46.648869  5943 consensus_meta.cc:287] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent flushing consensus metadata: real 0.600s	user 0.009s	sys 0.000s
I20260709 13:00:46.659269  1571 leader_election.cc:304] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:46.661824  1497 leader_election.cc:304] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
W20260709 13:00:46.661075  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 629028us
W20260709 13:00:46.686628  1607 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.007s	sys 0.006s
W20260709 13:00:46.687017  1607 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.007s	sys 0.007s
I20260709 13:00:46.686326  1644 leader_election.cc:304] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:46.688128  1497 leader_election.cc:304] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:46.662833  1572 leader_election.cc:304] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:46.648303  5875 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.686538  1570 leader_election.cc:304] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:46.692934  1497 leader_election.cc:304] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:46.695654  1644 leader_election.cc:304] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:46.659852  5938 raft_consensus.cc:2749] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:46.696063  1497 leader_election.cc:304] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:46.657976  6015 raft_consensus.cc:2749] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:46.698764  1644 leader_election.cc:304] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:46.605162  5951 raft_consensus.cc:515] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:46.659061  6016 raft_consensus.cc:493] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:46.661499  5923 raft_consensus.cc:493] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.683769  5879 raft_consensus.cc:2804] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:00:46.723448  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:46.693193  5851 raft_consensus.cc:2749] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:46.691006  5909 raft_consensus.cc:2749] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:00:46.788086  1496 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.000s	sys 0.052s
W20260709 13:00:46.788479  1496 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.510s	user 0.000s	sys 0.052s
I20260709 13:00:46.748315  6009 raft_consensus.cc:2749] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:46.698400  5861 raft_consensus.cc:2749] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:46.657612  5664 consensus_queue.cc:1048] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:00:46.773919  5953 raft_consensus.cc:493] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:46.773819  6018 raft_consensus.cc:2804] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:00:46.776484  6015 raft_consensus.cc:493] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:46.777407  5732 raft_consensus.cc:493] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:46.778571  5827 raft_consensus.cc:493] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.661291  5747 consensus_queue.cc:1048] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:00:46.698954  5873 raft_consensus.cc:2749] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:46.697685  6023 raft_consensus.cc:2749] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:46.684101  5870 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.703025  1644 leader_election.cc:304] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:46.749083  5908 raft_consensus.cc:2804] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:00:46.786031  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:46.819996  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:46.694093  5943 raft_consensus.cc:515] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:46.792224  5826 raft_consensus.cc:493] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:46.749907  5803 consensus_queue.cc:1048] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:00:46.784696  5879 raft_consensus.cc:493] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:46.698752  5875 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:46.820919  1646 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.025s	sys 0.045s
I20260709 13:00:46.772964  5938 consensus_queue.cc:1059] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:00:46.787856  5923 raft_consensus.cc:515] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:46.826757  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 123807us
W20260709 13:00:46.825619  1646 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.025s	sys 0.045s
I20260709 13:00:46.828114  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 13:00:46.835783  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 837452us
I20260709 13:00:46.836656  1646 leader_election.cc:304] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:46.838646  1528 raft_consensus.cc:1240] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:00:46.816143  6018 raft_consensus.cc:697] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:00:46.842087  1681 raft_consensus.cc:1275] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:00:46.842965  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:46.842507  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:00:46.844105  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:46.845301  1527 raft_consensus.cc:1275] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 9. (term mismatch)
I20260709 13:00:46.819643  5908 raft_consensus.cc:493] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:46.845728  1527 pending_rounds.cc:85] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting all ops after (but not including) 8
I20260709 13:00:46.847009  1527 pending_rounds.cc:107] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 13:00:46.847271  1527 raft_consensus.cc:2889] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:46.826398  5879 raft_consensus.cc:3060] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:46.837280  5977 raft_consensus.cc:2804] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:46.819445  5827 raft_consensus.cc:515] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:46.816321  6015 raft_consensus.cc:515] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:46.856174  1673 raft_consensus.cc:1275] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:00:46.859056  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:46.844997  5291 raft_consensus.cc:493] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.819464  5732 raft_consensus.cc:515] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:46.850931  6008 raft_consensus.cc:493] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:46.829097  5826 raft_consensus.cc:515] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:46.860695  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:46.849272  5699 leader_election.cc:290] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 8 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:46.865820  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:46.845809  5873 raft_consensus.cc:2749] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:00:46.887893  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:46.890048  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:46.849210  5908 raft_consensus.cc:3060] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:46.850076  5932 raft_consensus.cc:493] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:46.898196  1523 raft_consensus.cc:2393] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 13: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
W20260709 13:00:46.896605  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:46.855574  5977 raft_consensus.cc:493] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:46.821197  5953 raft_consensus.cc:515] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:46.787592  6016 raft_consensus.cc:515] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:46.826968  5870 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:46.908752  5875 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:46.910153  5827 leader_election.cc:290] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:46.895706  6018 consensus_queue.cc:237] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:46.861016  5726 consensus_queue.cc:1048] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:00:46.903474  5932 raft_consensus.cc:515] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:46.912889  5953 leader_election.cc:290] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:46.859726  6024 consensus_queue.cc:1048] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.068s
I20260709 13:00:46.889113  5291 raft_consensus.cc:515] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:46.858014  5938 consensus_queue.cc:1048] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:00:46.920944  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:46.922040  1646 leader_election.cc:304] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:46.964447  1532 raft_consensus.cc:2468] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 10.
I20260709 13:00:46.896190  5803 raft_consensus.cc:493] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:46.911798  5826 leader_election.cc:290] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:46.904233  5977 raft_consensus.cc:3060] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:46.917063  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:46.930816  2219 raft_consensus.cc:1275] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 13:00:46.931965  6028 log.cc:927] Time spent T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:00:46.904014  6008 raft_consensus.cc:515] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:46.915520  6016 leader_election.cc:290] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:46.936075  5932 leader_election.cc:290] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:46.940326  1525 raft_consensus.cc:2410] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:00:46.963521  5923 leader_election.cc:290] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:00:46.999477  1525 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43010 (request call id 2208) took 2211 ms (client timeout 1977 ms). Trace:
W20260709 13:00:47.004809  1525 rpcz_store.cc:269] 0709 13:00:44.787721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.788185 (+   464us) service_pool.cc:224] Handling call
0709 13:00:46.999281 (+2211096us) spinlock_profiling.cc:243] Waited 2.15 s on lock 0x7b54002dafd4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:46.999412 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4946187136}
I20260709 13:00:46.992599  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:46.962270  5908 raft_consensus.cc:515] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:46.917879  6023 consensus_queue.cc:1048] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 13:00:46.994064  1644 leader_election.cc:304] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:47.008374  5908 leader_election.cc:290] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:47.008968  5970 raft_consensus.cc:2804] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:47.009392  5970 raft_consensus.cc:493] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:47.010308  5970 raft_consensus.cc:3060] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:46.972791  6024 consensus_queue.cc:1048] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:00:47.012008  5938 raft_consensus.cc:493] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.012545  5938 raft_consensus.cc:515] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:47.014628  5938 leader_election.cc:290] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:47.015326  5879 raft_consensus.cc:515] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:47.017582  1524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43010 (request call id 2217) took 2126 ms. Trace:
I20260709 13:00:46.983009  5470 raft_consensus.cc:493] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.974607  5803 raft_consensus.cc:515] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:46.976249  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43010 (request call id 2220) took 1306 ms. Trace:
I20260709 13:00:47.018008  1524 rpcz_store.cc:276] 0709 13:00:44.891395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.978961 (+ 87566us) service_pool.cc:224] Handling call
0709 13:00:45.023319 (+ 44358us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:00:45.156240 (+132921us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:45.156269 (+    29us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:00:45.178472 (+ 22203us) log.cc:844] Serialized 78 byte log entry
0709 13:00:45.422705 (+244233us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:45.430071 (+  7366us) log.cc:844] Serialized 14 byte log entry
0709 13:00:45.431017 (+   946us) log.cc:844] Serialized 14 byte log entry
0709 13:00:45.431235 (+   218us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:45.431303 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:46.493621 (+1062318us) spinlock_profiling.cc:243] Waited 1.53 ms on lock 0x7b180031dda0. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1e38ede1 00007f6a1e39b5b1 00007f6a154c6522 00007f6a154c87c1 00007f6a154c8779 00007f6a154c8709 00007f6a154c86d1 00007f6a154c79cd 000000000038f354 000000000038f199 00007f6a154a983a
0709 13:00:46.996630 (+503009us) spinlock_profiling.cc:243] Waited 17 ms on lock 0x7b180031dda0. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1e38ede1 00007f6a1e39b5b1 00007f6a154c63f3 00007f6a154c87c1 00007f6a154c8779 00007f6a154c8709 00007f6a154c86d1 00007f6a154c79cd 000000000038f354 000000000038f199 00007f6a154a983a
0709 13:00:47.017375 (+ 20745us) raft_consensus.cc:1685] finished
0709 13:00:47.017395 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:47.017530 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33222,"prepare.queue_time_us":39962,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":72,"raft.queue_time_us":14900,"raft.run_cpu_time_us":298,"raft.run_wall_time_us":6299,"spinlock_wait_cycles":42564608,"thread_start_us":263206,"threads_started":2,"wal-append.queue_time_us":190273}
I20260709 13:00:47.029124  1529 rpcz_store.cc:276] 0709 13:00:45.669941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:45.670061 (+   120us) service_pool.cc:224] Handling call
0709 13:00:45.670334 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:46.624435 (+954101us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:00:46.624463 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:46.624503 (+    40us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:46.624536 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:46.976026 (+351490us) spinlock_profiling.cc:243] Waited 608 ms on lock 0x7b54001b62d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:00:46.976071 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:46.976188 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":84555,"raft.run_cpu_time_us":534,"raft.run_wall_time_us":535,"spinlock_wait_cycles":1398099712,"thread_start_us":345819,"threads_started":1}
I20260709 13:00:46.971005  5535 raft_consensus.cc:2749] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:46.999722  1523 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59"
dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:49310
I20260709 13:00:46.997237  6008 leader_election.cc:290] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:47.032980  1523 raft_consensus.cc:493] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:47.002266  5951 leader_election.cc:290] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:47.033486  1523 raft_consensus.cc:3060] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:00:47.016693  5989 log.cc:927] Time spent T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 1.135s	user 0.006s	sys 0.013s
I20260709 13:00:47.041109  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:47.041709  1524 raft_consensus.cc:3060] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:47.010315  5870 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:47.028829  5908 raft_consensus.cc:493] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.050410  1523 raft_consensus.cc:515] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:47.052469  1523 leader_election.cc:290] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:47.057492  5977 raft_consensus.cc:515] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:47.060640  5803 leader_election.cc:290] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:47.061957  6015 leader_election.cc:290] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:47.032053  5470 raft_consensus.cc:515] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:00:47.081982  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.085635  5470 leader_election.cc:290] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:47.089500  5970 raft_consensus.cc:515] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:47.090633  5879 leader_election.cc:290] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:47.092074  5977 leader_election.cc:290] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:47.097847  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:47.098960  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:47.147324  1532 raft_consensus.cc:2410] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:00:47.098485  1524 raft_consensus.cc:2468] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 12.
I20260709 13:00:47.071022  5908 raft_consensus.cc:515] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:47.149879  5908 leader_election.cc:290] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:47.104619  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36194 (request call id 1784) took 1074 ms. Trace:
W20260709 13:00:47.105407  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 446226us
W20260709 13:00:47.106177  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 443535us
I20260709 13:00:47.151428  1572 leader_election.cc:304] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:00:47.153211  5943 leader_election.cc:290] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:47.153911  5867 raft_consensus.cc:2804] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:47.154361  5867 raft_consensus.cc:493] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:47.154704  5867 raft_consensus.cc:3060] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:00:47.106899  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 420450us
I20260709 13:00:47.155448  1570 leader_election.cc:304] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:47.156046  6016 raft_consensus.cc:493] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:47.156569  6016 raft_consensus.cc:515] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:47.157435  5976 raft_consensus.cc:493] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:47.158785  5875 raft_consensus.cc:2749] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:00:47.106784  5877 raft_consensus.cc:2749] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:47.107414  6019 raft_consensus.cc:2804] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:47.078150  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:47.108850  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:47.107133  5690 raft_consensus.cc:3060] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:00:47.127489  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.167338  1528 raft_consensus.cc:2468] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 10.
W20260709 13:00:47.171922  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.128083  5892 raft_consensus.cc:3055] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:47.132223  5970 leader_election.cc:290] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
W20260709 13:00:47.139809  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.141955  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:47.158007  5976 raft_consensus.cc:515] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:47.160892  1600 raft_consensus.cc:1240] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 10. Current term is 11. Ops: []
W20260709 13:00:47.185603  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.185882  1675 raft_consensus.cc:1240] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:00:47.186596  1600 raft_consensus.cc:1275] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:00:47.187693  1600 raft_consensus.cc:1240] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:47.161362  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:47.157431  1570 leader_election.cc:304] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:47.188545  1532 raft_consensus.cc:2468] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 9.
I20260709 13:00:47.163008  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:47.164710  1525 raft_consensus.cc:3060] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:47.150595  1606 rpcz_store.cc:276] 0709 13:00:46.030130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:46.032175 (+  2045us) service_pool.cc:224] Handling call
0709 13:00:46.032485 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:46.290069 (+257584us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:46.290099 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:46.290575 (+   476us) log.cc:844] Serialized 26 byte log entry
0709 13:00:46.648456 (+357881us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:46.660254 (+ 11798us) log.cc:844] Serialized 14 byte log entry
0709 13:00:47.104020 (+443766us) spinlock_profiling.cc:243] Waited 20.7 ms on lock 0x7b1800153d60. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1e38ede1 00007f6a1e39b5b1 00007f6a15440c0a 00007f6a1eb80219 00007f6a154c8a40 00007f6a154c34e4 00007f6a154c3455 00007f6a185ab060 00007f6a185bd716 00007f6a185ce287 00007f6a185ce208
0709 13:00:47.104223 (+   203us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:47.104298 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:47.104340 (+    42us) raft_consensus.cc:1685] finished
0709 13:00:47.104429 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:47.104558 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3478,"prepare.queue_time_us":12747,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":2379,"raft.queue_time_us":769287,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":184,"spinlock_wait_cycles":47655296,"thread_start_us":614603,"threads_started":2,"wal-append.queue_time_us":278363}
W20260709 13:00:47.168998  1495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.191367  1570 leader_election.cc:304] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:47.192359  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:47.173374  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:47.175838  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:47.166096  6019 raft_consensus.cc:493] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:47.176879  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:47.178280  6016 leader_election.cc:290] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:47.181933  1526 raft_consensus.cc:3060] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:47.197126  1570 leader_election.cc:304] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:47.183040  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:47.183758  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:47.184523  2227 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5"
dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
mode: GRACEFUL
new_leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:47682
I20260709 13:00:47.198719  2227 raft_consensus.cc:606] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 9 LEADER]: Received request to transfer leadership to TS e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:47.195269  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:47.202446  1604 raft_consensus.cc:2468] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 10.
I20260709 13:00:47.174748  5892 raft_consensus.cc:740] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:00:47.203938  2192 leader_election.cc:304] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:47.202838  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:47.210522  2192 leader_election.cc:304] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:47.190449  6012 raft_consensus.cc:493] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:47.218276  2192 leader_election.cc:304] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:00:47.237138  1528 raft_consensus.cc:1240] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:47.194700  6002 raft_consensus.cc:2749] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:47.244496  1525 raft_consensus.cc:2468] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 8.
I20260709 13:00:47.254946  1605 raft_consensus.cc:1240] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:47.195647  6019 raft_consensus.cc:3060] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:47.198031  5723 raft_consensus.cc:2749] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:47.264604  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:47.235271  5810 raft_consensus.cc:2749] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:47.215265  5982 raft_consensus.cc:2749] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:47.195955  5885 consensus_queue.cc:1048] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 13:00:47.279857  1599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36194 (request call id 1782) took 1250 ms. Trace:
I20260709 13:00:47.281311  1677 raft_consensus.cc:1240] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:47.297168  1572 leader_election.cc:304] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:00:47.284322  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 14 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:47.291539  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:47.302768  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:47.291168  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:47.301882  1599 rpcz_store.cc:276] 0709 13:00:46.029571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:46.029687 (+   116us) service_pool.cc:224] Handling call
0709 13:00:46.029980 (+   293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:46.260959 (+230979us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:47.279620 (+1018661us) spinlock_profiling.cc:243] Waited 175 ms on lock 0x7b54003b10d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:00:47.279799 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":403470592}
I20260709 13:00:47.303980  1572 leader_election.cc:304] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:00:47.304102  1526 raft_consensus.cc:2468] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 11.
I20260709 13:00:47.279982  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:47.264683  1497 leader_election.cc:304] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:47.306190  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:47.306386  1497 leader_election.cc:304] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:47.282829  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
W20260709 13:00:47.273300  6029 log.cc:927] Time spent T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.368s	user 0.001s	sys 0.000s
I20260709 13:00:47.312273  5747 raft_consensus.cc:2804] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:47.312687  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:47.307292  1681 raft_consensus.cc:3060] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:47.261142  5848 raft_consensus.cc:2804] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:47.313354  6015 raft_consensus.cc:2749] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:47.313858  5848 raft_consensus.cc:697] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 13 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:47.315845  1497 leader_election.cc:304] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:47.316970  6008 raft_consensus.cc:3060] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:47.297453  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:47.309764  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:47.318107  2226 raft_consensus.cc:3060] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:47.319594  6015 raft_consensus.cc:2749] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:47.321048  1497 leader_election.cc:304] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:47.322165  1497 leader_election.cc:304] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:47.213325  6016 raft_consensus.cc:2804] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:47.322889  5938 raft_consensus.cc:2749] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:47.322999  6016 raft_consensus.cc:493] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:00:47.323426  6016 raft_consensus.cc:3060] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:47.323591  5938 raft_consensus.cc:2749] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:47.312870  5939 raft_consensus.cc:2804] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:47.323909  5848 consensus_queue.cc:237] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:47.325158  6015 consensus_queue.cc:1048] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:47.312764  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:47.310727  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:47.307417  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:47.303532  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:47.330639  1675 raft_consensus.cc:2468] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 12.
I20260709 13:00:47.275121  5291 leader_election.cc:290] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:47.334427  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:47.338382  1531 raft_consensus.cc:2393] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 13: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:00:47.334699  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:47.339793  2227 raft_consensus.cc:1240] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:47.339138  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:47.335460  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:47.265352  5934 raft_consensus.cc:3055] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:47.336534  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:47.336822  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:47.335047  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:47.346038  1528 raft_consensus.cc:2368] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 9. Current term is 10.
I20260709 13:00:47.337509  1532 raft_consensus.cc:1240] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:47.346807  2226 raft_consensus.cc:2468] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 10.
I20260709 13:00:47.340022  1525 raft_consensus.cc:3060] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:47.287395  5804 raft_consensus.cc:493] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:00:47.342073  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:47.334147  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:47.342700  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:47.357622  1673 raft_consensus.cc:2393] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 11: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:00:47.276232  5976 leader_election.cc:290] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:47.277042  5875 raft_consensus.cc:493] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.341061  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 14 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:47.351819  1528 raft_consensus.cc:1240] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:47.327069  5879 raft_consensus.cc:493] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:47.360630  1681 raft_consensus.cc:2468] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 8.
I20260709 13:00:47.328495  5810 raft_consensus.cc:493] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:47.336982  5939 raft_consensus.cc:697] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 10 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:47.354869  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:47.331254  5747 raft_consensus.cc:697] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 9 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:47.368847  1676 raft_consensus.cc:1240] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:00:47.263546  6012 raft_consensus.cc:515] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:47.370589  2191 leader_election.cc:304] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:47.337064  6015 raft_consensus.cc:493] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:47.344918  5934 raft_consensus.cc:740] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:47.374161  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:47.274825  5892 consensus_queue.cc:260] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:47.344239  5923 consensus_queue.cc:1059] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:00:47.373848  5982 raft_consensus.cc:493] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:47.366206  5804 raft_consensus.cc:515] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:47.381819  6015 raft_consensus.cc:515] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:47.388530  5690 raft_consensus.cc:2749] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:47.389990  6015 leader_election.cc:290] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:47.369207  5875 raft_consensus.cc:515] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:47.371992  5879 raft_consensus.cc:515] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:47.399786  5939 consensus_queue.cc:237] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:47.392199  5982 raft_consensus.cc:515] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:47.407524  6012 leader_election.cc:290] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:47.407967  5982 leader_election.cc:290] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:47.410126  6008 raft_consensus.cc:2749] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:47.412307  6019 raft_consensus.cc:515] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:47.413928  6019 leader_election.cc:290] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:47.363418  1525 raft_consensus.cc:2468] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 10.
I20260709 13:00:47.455464  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:47.458456  1523 raft_consensus.cc:1240] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 7. Current term is 8. Ops: []
W20260709 13:00:47.467720  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.475507  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:47.493290  1602 pending_rounds.cc:85] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642: Aborting all ops after (but not including) 11
I20260709 13:00:47.493571  1604 raft_consensus.cc:1275] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:00:47.499560  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:47.503890  2219 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0"
dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
mode: GRACEFUL
new_leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:47682
W20260709 13:00:47.504686  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.505097  2219 raft_consensus.cc:606] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Received request to transfer leadership to TS e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:47.501551  1496 leader_election.cc:304] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:47.505645  2219 raft_consensus.cc:614] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:47.493767  1602 pending_rounds.cc:107] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642: Aborting uncommitted NO_OP operation due to leader change: 12.12
I20260709 13:00:47.506924  1602 raft_consensus.cc:2889] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:47.373901  5810 raft_consensus.cc:515] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:47.494153  2191 leader_election.cc:304] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:47.543144  2219 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583"
dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
mode: GRACEFUL
new_leader_uuid: "39a92f5a4352465d8af3af5908fe8642"
 from {username='slave'} at 127.0.0.1:47682
I20260709 13:00:47.380719  5761 raft_consensus.cc:2804] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:47.555148  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:47.559607  5827 raft_consensus.cc:493] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.560580  5827 raft_consensus.cc:515] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:47.561861  2219 raft_consensus.cc:606] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Received request to transfer leadership to TS 39a92f5a4352465d8af3af5908fe8642
I20260709 13:00:47.562498  2219 raft_consensus.cc:614] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:47.572574  5810 leader_election.cc:290] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:47.573917  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:47.574990  5833 raft_consensus.cc:2804] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:47.575650  5833 raft_consensus.cc:493] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:47.576112  5833 raft_consensus.cc:3060] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:47.577051  5747 consensus_queue.cc:237] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:47.580567  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:47.581707  1598 raft_consensus.cc:2468] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 7.
I20260709 13:00:47.410151  6016 raft_consensus.cc:515] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:47.584626  1644 leader_election.cc:304] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:47.397437  5934 consensus_queue.cc:260] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:47.565171  5932 consensus_queue.cc:1059] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:00:47.563055  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:47.576488  5732 leader_election.cc:290] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:00:47.597406  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.590476  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:47.592988  5934 raft_consensus.cc:3060] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:47.622489  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:47.617870  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:47.596794  1601 raft_consensus.cc:2468] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 11.
I20260709 13:00:47.618592  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:47.603986  5864 raft_consensus.cc:3055] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:47.619206  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:47.614323  5827 leader_election.cc:290] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:47.586601  6016 leader_election.cc:290] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:47.623816  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:47.596006  5804 leader_election.cc:290] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:47.599689  5875 leader_election.cc:290] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:47.588725  5879 leader_election.cc:290] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:47.668790  1600 raft_consensus.cc:2468] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 13.
I20260709 13:00:47.670107  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:47.590821  5761 raft_consensus.cc:493] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:47.672043  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:47.674904  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:47.675295  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:47.676260  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:47.677575  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:47.678068  5690 raft_consensus.cc:493] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
W20260709 13:00:47.679034  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RunLeaderElection -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 89815.2us
W20260709 13:00:47.587700  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 81228.3us
I20260709 13:00:47.661979  5864 raft_consensus.cc:740] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:47.680930  5864 consensus_queue.cc:260] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:00:47.683264  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.616796  6019 raft_consensus.cc:493] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.691489   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:00:47.691188  6019 raft_consensus.cc:515] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:47.663090  1605 raft_consensus.cc:2468] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 9.
I20260709 13:00:47.572669  5686 raft_consensus.cc:3060] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:47.601395  6008 raft_consensus.cc:3055] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:47.676281  1602 raft_consensus.cc:2393] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 11: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:00:47.616520  6014 raft_consensus.cc:493] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.588969  6007 raft_consensus.cc:2749] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:00:47.623697  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 129790us
I20260709 13:00:47.594558  6012 raft_consensus.cc:493] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:47.658533  1644 leader_election.cc:304] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:47.678296  1598 raft_consensus.cc:2468] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 8.
I20260709 13:00:47.695411  1607 raft_consensus.cc:2468] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 12.
I20260709 13:00:47.615046  5809 raft_consensus.cc:493] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:47.679443  1606 raft_consensus.cc:2468] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 11.
I20260709 13:00:47.709832  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: true dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:47.682319  1646 leader_election.cc:304] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:47.591624  5815 consensus_queue.cc:1059] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.119s
I20260709 13:00:47.718935  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:47.694458  6019 leader_election.cc:290] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:47.721899  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:47.700923  6008 raft_consensus.cc:740] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:00:47.672279  5761 raft_consensus.cc:3060] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:47.713786  5864 raft_consensus.cc:3060] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:00:47.726518  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 103072us
W20260709 13:00:47.728641  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.679068  5690 raft_consensus.cc:515] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:47.734647  1604 raft_consensus.cc:2393] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 11: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:00:47.724741  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:47.738065  5903 raft_consensus.cc:2749] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:47.738159  5660 consensus_queue.cc:1048] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 13:00:47.740448  6008 consensus_queue.cc:260] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:47.742302  6008 raft_consensus.cc:3060] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:47.742800  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:47.743700  1675 raft_consensus.cc:2468] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 9.
I20260709 13:00:47.749244  6007 raft_consensus.cc:2804] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:47.750185  6007 raft_consensus.cc:697] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 12 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:47.750803  1571 leader_election.cc:304] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:47.753593  1602 raft_consensus.cc:1240] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:47.758890  5809 raft_consensus.cc:515] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:47.736377  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:00:47.768612  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 86557.6us
I20260709 13:00:47.769964  1646 leader_election.cc:304] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:47.771715  6012 raft_consensus.cc:515] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:47.776484  5699 consensus_queue.cc:1059] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:00:47.777027  2190 leader_election.cc:304] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:47.778558  5486 consensus_queue.cc:1059] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:47.778995  5848 raft_consensus.cc:3055] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:00:47.779495  5848 raft_consensus.cc:740] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:47.780133  5486 raft_consensus.cc:3055] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:47.780650  5486 raft_consensus.cc:740] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:47.780776  5848 consensus_queue.cc:260] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:47.783005  1603 raft_consensus.cc:2468] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 12.
I20260709 13:00:47.784075  5699 raft_consensus.cc:2749] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:47.784857  5935 consensus_queue.cc:1059] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:47.785331  5520 raft_consensus.cc:3055] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:47.785905  5520 raft_consensus.cc:740] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:47.753630  5553 raft_consensus.cc:2804] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:47.787395  5553 raft_consensus.cc:493] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:47.787773  5553 raft_consensus.cc:3060] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:47.790772  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:47.793087  5438 raft_consensus.cc:3060] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:47.800089  5849 raft_consensus.cc:2804] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:47.801043  5849 raft_consensus.cc:697] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 8 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:47.787002  5982 raft_consensus.cc:993] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b: : Instructing follower e46412b3b0b44f01ad5c33d4cfe3d6b1 to start an election
I20260709 13:00:47.804708   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:00:47.811221  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 77667.2us
W20260709 13:00:47.770468  5867 consensus_meta.cc:287] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.615s	user 0.002s	sys 0.012s
I20260709 13:00:47.774492  6012 leader_election.cc:290] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:47.814862  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:47.816838  1679 raft_consensus.cc:1275] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:00:47.825752  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: true dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:47.782069  5486 consensus_queue.cc:260] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:47.833606  5486 raft_consensus.cc:3060] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:47.824577  5848 raft_consensus.cc:3060] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:47.836892  5690 leader_election.cc:290] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:47.831214  1681 raft_consensus.cc:2468] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 12.
I20260709 13:00:47.843001  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:47.842744  5833 raft_consensus.cc:515] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:47.843798  5909 raft_consensus.cc:493] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.844357  5909 raft_consensus.cc:515] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:47.845875  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:47.847152  1677 raft_consensus.cc:2468] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 8.
I20260709 13:00:47.847213  5833 leader_election.cc:290] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:47.832337  5867 raft_consensus.cc:515] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:47.852881  5867 leader_election.cc:290] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:47.854861  5815 raft_consensus.cc:1081] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 9 LEADER]: Signalling peer e46412b3b0b44f01ad5c33d4cfe3d6b1 to start an election
I20260709 13:00:47.856264  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:47.857026  2219 raft_consensus.cc:3060] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:47.859617  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:00:47.861562  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 91952.1us
W20260709 13:00:47.865326  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.863940  1496 leader_election.cc:304] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
W20260709 13:00:47.867368  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.867569  5535 raft_consensus.cc:2749] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:47.869107  1680 raft_consensus.cc:1240] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:47.869596  1605 raft_consensus.cc:2393] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 12: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:00:47.762502  6014 raft_consensus.cc:515] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:47.869369  1497 leader_election.cc:304] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
W20260709 13:00:47.878417  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 54625.2us
I20260709 13:00:47.802300  5849 consensus_queue.cc:237] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:47.877169  5932 raft_consensus.cc:2804] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:47.888458  5892 raft_consensus.cc:3060] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:47.884167  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:47.895795  1675 raft_consensus.cc:3060] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:47.894973  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 14 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:47.861472  5732 consensus_queue.cc:1048] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.018s
I20260709 13:00:47.897325  1644 leader_election.cc:304] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:47.902956  1600 raft_consensus.cc:2393] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 8: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
W20260709 13:00:47.902971  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.905807  2222 raft_consensus.cc:1240] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:00:47.883790  5932 raft_consensus.cc:493] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:47.901840  5833 raft_consensus.cc:2804] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:47.909761  5972 raft_consensus.cc:493] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.910223  2223 raft_consensus.cc:2468] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 11.
I20260709 13:00:47.916859  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:47.906901  5932 raft_consensus.cc:3060] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:47.917852  2227 raft_consensus.cc:2410] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 14 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 13:00:47.910310  5972 raft_consensus.cc:515] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:47.917698  5826 raft_consensus.cc:493] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.926080  1674 raft_consensus.cc:2468] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 13.
I20260709 13:00:47.926877  5826 raft_consensus.cc:515] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:47.929267  5826 leader_election.cc:290] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:47.939325  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:47.935592  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:47.940896  2222 raft_consensus.cc:2468] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 12.
I20260709 13:00:47.917826  5833 raft_consensus.cc:697] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:00:47.943728  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:47.943943  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:47.946380  5934 raft_consensus.cc:2804] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:47.950796  5934 raft_consensus.cc:493] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:47.951202  5934 raft_consensus.cc:3060] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:47.952350  6014 leader_election.cc:290] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:47.953961  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:47.955967  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:47.956341  1572 leader_election.cc:304] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
W20260709 13:00:47.957067  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 85114.5us
I20260709 13:00:47.958109  2222 raft_consensus.cc:1275] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:00:47.960285  5875 raft_consensus.cc:2749] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:47.960661  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:47.962870  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:47.960323  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:47.963431  2222 raft_consensus.cc:3060] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:47.964546  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:47.913971  5747 consensus_queue.cc:1059] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:00:47.966487  5747 raft_consensus.cc:3055] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:47.966878  5747 raft_consensus.cc:740] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:47.967816  5747 consensus_queue.cc:260] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:47.969061  5747 raft_consensus.cc:3060] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:47.970988  5668 raft_consensus.cc:493] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.971590  5668 raft_consensus.cc:515] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:47.937834  6007 consensus_queue.cc:237] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:47.973677  5668 leader_election.cc:290] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:47.974439  2222 raft_consensus.cc:2468] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 13.
I20260709 13:00:47.975853  1644 leader_election.cc:304] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:47.977037  1644 leader_election.cc:304] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:47.978045  5976 raft_consensus.cc:2804] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:47.950158  5809 leader_election.cc:290] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:47.978597  5976 raft_consensus.cc:493] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:47.979064  5976 raft_consensus.cc:3060] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:47.984782  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:47.986125  2219 raft_consensus.cc:2468] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 8.
I20260709 13:00:47.987624  1601 raft_consensus.cc:1275] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:00:47.987609  1675 raft_consensus.cc:2468] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 12.
I20260709 13:00:47.988202  5520 consensus_queue.cc:260] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:47.989737  1674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49170 (request call id 2203) took 1402 ms. Trace:
I20260709 13:00:47.990070  1674 rpcz_store.cc:276] 0709 13:00:46.587859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:46.588178 (+   319us) service_pool.cc:224] Handling call
0709 13:00:47.989557 (+1401379us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b54002e6b54. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:47.989664 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2994629888}
I20260709 13:00:47.962780  5833 consensus_queue.cc:237] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:47.978124  1644 leader_election.cc:304] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
W20260709 13:00:47.999250  6061 log.cc:927] Time spent T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.114s	user 0.002s	sys 0.000s
W20260709 13:00:48.009367  6060 log.cc:927] Time spent T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.266s	user 0.000s	sys 0.002s
W20260709 13:00:48.010825  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 98813.4us
I20260709 13:00:48.012876  1646 leader_election.cc:304] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:48.014030  5873 raft_consensus.cc:2804] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:48.014499  5873 raft_consensus.cc:493] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
W20260709 13:00:48.015028  6054 log.cc:927] Time spent T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.136s	user 0.000s	sys 0.002s
I20260709 13:00:48.016491  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:48.017468  1606 raft_consensus.cc:2468] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 11.
W20260709 13:00:48.018086  6058 log.cc:927] Time spent T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.121s	user 0.000s	sys 0.003s
I20260709 13:00:47.999532  2192 leader_election.cc:304] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:48.002400  5664 raft_consensus.cc:2804] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:48.002133  5934 raft_consensus.cc:515] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:48.004693  5686 raft_consensus.cc:493] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.000360  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
W20260709 13:00:48.019047  6057 log.cc:927] Time spent T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.137s	user 0.002s	sys 0.002s
I20260709 13:00:48.023532  5553 raft_consensus.cc:515] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:48.014164  5972 leader_election.cc:290] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:48.004531  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:48.014955  5873 raft_consensus.cc:3060] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:48.037528  1604 raft_consensus.cc:1275] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:00:48.051349  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:00:48.045487  1571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.047704  1572 leader_election.cc:304] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:48.053539  5686 raft_consensus.cc:515] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:48.056062  5686 leader_election.cc:290] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
W20260709 13:00:48.061892  1570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.064754  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:48.063778  1570 leader_election.cc:304] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:48.068706  5849 raft_consensus.cc:2749] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:00:48.073436  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:48.081877  1529 pending_rounds.cc:85] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting all ops after (but not including) 7
I20260709 13:00:48.082294  1529 pending_rounds.cc:107] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:00:48.082167  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:48.082644  1529 raft_consensus.cc:2889] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:48.088299  1523 raft_consensus.cc:1275] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:00:48.088879  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:48.083570  2226 raft_consensus.cc:1275] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:00:48.089323  1526 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5"
dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:49310
W20260709 13:00:48.099020  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 86311us
I20260709 13:00:48.089608  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:48.100275  1525 raft_consensus.cc:2468] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 13.
I20260709 13:00:48.100618  5553 leader_election.cc:290] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:48.069254  5664 raft_consensus.cc:697] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 11 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:48.101442  5934 leader_election.cc:290] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:48.102605  1526 raft_consensus.cc:493] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:48.103013  1430 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46260 (request call id 366) took 10342 ms. Trace:
I20260709 13:00:48.103037  1526 raft_consensus.cc:3060] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:48.102115  5664 consensus_queue.cc:237] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:48.107426  5871 raft_consensus.cc:493] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:48.098886  1497 leader_election.cc:304] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:48.083067  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:48.103399  1430 rpcz_store.cc:276] 0709 13:00:37.760622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:37.777943 (+ 17321us) service_pool.cc:224] Handling call
0709 13:00:48.102785 (+10324842us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:43.063744 (+     0us) spinlock_profiling.cc:243] Waited 887 us on lock 0x7b54004110a8. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1e96f9e1 00007f6a1e96e64c 00007f6a1bffdadc 00007f6a1bfe90a6 00007f6a1bfe8d58 00007f6a1bfed9f1 00007f6a1bfed9a9 00007f6a1bfed939 00007f6a1bfed901 00007f6a1bfecb2d 000000000038f354
0709 13:00:43.063831 (+    87us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:43.064410 (+   579us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:43.064442 (+    32us) write_op.cc:435] Acquired schema lock
0709 13:00:43.064455 (+    13us) tablet.cc:662] Decoding operations
0709 13:00:43.066225 (+  1770us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:43.066278 (+    53us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:43.066309 (+    31us) tablet.cc:685] Acquiring locks for 27 operations
0709 13:00:43.167386 (+101077us) tablet.cc:701] Row locks acquired
0709 13:00:43.167412 (+    26us) write_op.cc:260] PREPARE: finished
0709 13:00:43.167590 (+   178us) write_op.cc:270] Start()
0709 13:00:43.167809 (+   219us) write_op.cc:276] Timestamp: P: 1783602043167533 usec, L: 0
0709 13:00:43.167833 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:00:43.229223 (+ 61390us) log.cc:844] Serialized 10938 byte log entry
0709 13:00:43.793211 (+563988us) op_driver.cc:464] REPLICATION: finished
0709 13:00:44.295354 (+502143us) write_op.cc:301] APPLY: starting
0709 13:00:44.295449 (+    95us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:44.665642 (+370193us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:44.665669 (+    27us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:45.115504 (+449835us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:45.115860 (+   356us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=54,key_file_lookups=54,delta_file_lookups=54,mrs_lookups=0
0709 13:00:45.115910 (+    50us) write_op.cc:312] APPLY: finished
0709 13:00:45.116403 (+   493us) log.cc:844] Serialized 236 byte log entry
0709 13:00:45.116629 (+   226us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:45.116866 (+   237us) write_op.cc:454] Released schema lock
0709 13:00:45.116928 (+    62us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:45.117356 (+   428us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:45.117383 (+    27us) write_op.cc:454] Released schema lock
0709 13:00:46.478177 (+1360794us) spinlock_profiling.cc:243] Waited 2.75 ms on lock 0x7b18002efd80. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1e38ede1 00007f6a1e39b5b1 00007f6a154c6522 00007f6a154c87c1 00007f6a154c8779 00007f6a154c8709 00007f6a154c86d1 00007f6a154c79cd 000000000038f354 000000000038f199 00007f6a154a983a
Metrics: {"mutex_wait_us":23238,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":498072,"apply.run_cpu_time_us":41047,"apply.run_wall_time_us":822001,"cfile_cache_hit":106,"cfile_cache_hit_bytes":110982,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6221,"cfile_init":2,"lbm_read_time_us":1227,"lbm_reads_lt_1ms":12,"num_ops":27,"prepare.queue_time_us":658247,"prepare.run_cpu_time_us":39045,"prepare.run_wall_time_us":1333017,"raft.queue_time_us":107328,"raft.run_cpu_time_us":52404,"raft.run_wall_time_us":456681,"replication_time_us":625209,"spinlock_wait_cycles":8362752,"thread_start_us":1241993,"threads_started":4,"wal-append.queue_time_us":1733753,"wal-append.run_cpu_time_us":24997,"wal-append.run_wall_time_us":2291410}]]}
I20260709 13:00:48.121618  5932 raft_consensus.cc:515] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:48.128535  1679 raft_consensus.cc:2393] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 11: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
W20260709 13:00:48.128980  1571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.096227  5668 raft_consensus.cc:2804] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:00:48.132963  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 133685us
I20260709 13:00:48.134230  1524 raft_consensus.cc:1240] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:48.135186  2223 raft_consensus.cc:1240] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 13:00:48.145259  5932 leader_election.cc:290] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:48.146068  5877 raft_consensus.cc:2749] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:48.123880  5827 raft_consensus.cc:2749] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:48.156335  5909 leader_election.cc:290] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:48.157742  5668 raft_consensus.cc:697] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 8 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
W20260709 13:00:48.159158  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 60423.9us
I20260709 13:00:48.160182  1497 leader_election.cc:304] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:48.161262  1497 leader_election.cc:304] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:48.162196  5892 raft_consensus.cc:2804] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:48.162707  5892 raft_consensus.cc:493] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:48.163048  5892 raft_consensus.cc:3060] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:48.123750  5875 raft_consensus.cc:2749] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:48.166909  5827 raft_consensus.cc:2749] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:48.108162  5871 raft_consensus.cc:515] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:48.171734  5871 leader_election.cc:290] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:48.172818  1497 leader_election.cc:304] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:48.108009  5761 raft_consensus.cc:515] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:48.158892  5668 consensus_queue.cc:237] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:48.172029  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 124445us
I20260709 13:00:48.141948  1571 leader_election.cc:304] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
W20260709 13:00:48.177388  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 113739us
I20260709 13:00:48.174800  1526 raft_consensus.cc:515] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:48.185771  1526 leader_election.cc:290] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:48.183794  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
W20260709 13:00:48.193903  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 52646.3us
I20260709 13:00:48.196414  2227 raft_consensus.cc:2393] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 12: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:00:48.198939  1496 leader_election.cc:304] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:48.191363  6014 raft_consensus.cc:2804] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:48.183532  5932 raft_consensus.cc:2749] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:00:48.226240  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 56923.8us
I20260709 13:00:48.227216  1571 leader_election.cc:304] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:48.230358  1570 leader_election.cc:304] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:48.231940  2192 leader_election.cc:304] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:48.232595  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:48.238698  2223 raft_consensus.cc:1240] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:48.235141  1679 raft_consensus.cc:2468] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 8.
I20260709 13:00:48.229252  5827 raft_consensus.cc:2804] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:48.237702  5867 raft_consensus.cc:2804] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:48.227257  6014 raft_consensus.cc:697] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 12 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:48.218029  5864 consensus_queue.cc:1059] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
W20260709 13:00:48.254319  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.249243  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:48.212569  5976 raft_consensus.cc:515] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:48.255195  1497 leader_election.cc:304] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:48.257558  1571 leader_election.cc:304] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:48.259210  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:48.261277  1679 raft_consensus.cc:3060] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:48.248335  5815 consensus_queue.cc:1048] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 13:00:48.258435  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:48.245921  5827 raft_consensus.cc:493] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:48.236114  6019 consensus_queue.cc:1048] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 13:00:48.270704  1677 raft_consensus.cc:2393] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 10: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:00:48.270821  1674 raft_consensus.cc:3060] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:48.269126  5885 raft_consensus.cc:493] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.248780  5867 raft_consensus.cc:493] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:48.260216  5699 raft_consensus.cc:2749] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:48.269933  1425 catalog_manager.cc:5697] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 3 to 9. New cstate: current_term: 9 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:00:48.287696  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 60665.9us
I20260709 13:00:48.275504  1680 raft_consensus.cc:2468] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 7.
I20260709 13:00:48.271605  5827 raft_consensus.cc:3060] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:48.277079  5520 raft_consensus.cc:3060] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:48.300405  6014 consensus_queue.cc:237] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:48.301414  5698 raft_consensus.cc:2804] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:48.301903  5698 raft_consensus.cc:493] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:48.302240  5698 raft_consensus.cc:3060] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:48.292140  5939 consensus_queue.cc:1059] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 13:00:48.299356  6002 raft_consensus.cc:2749] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:48.277661  5761 leader_election.cc:290] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:48.285341  5867 raft_consensus.cc:3060] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:48.310068  1496 leader_election.cc:304] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:48.283177  5932 raft_consensus.cc:3060] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:48.273880  5909 raft_consensus.cc:493] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
W20260709 13:00:48.306779  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 80305.8us
I20260709 13:00:48.289444  5869 raft_consensus.cc:493] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:48.308727  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 65117.3us
I20260709 13:00:48.328171  5909 raft_consensus.cc:515] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:48.335085  1497 leader_election.cc:304] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:48.275725  5885 raft_consensus.cc:515] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:48.339218  1497 leader_election.cc:304] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:48.340065  5732 raft_consensus.cc:2804] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:48.340469  5732 raft_consensus.cc:493] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:48.340867  5732 raft_consensus.cc:3060] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:48.315611  6008 raft_consensus.cc:2804] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:48.345137  2223 raft_consensus.cc:1240] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:48.358872  1497 leader_election.cc:304] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:48.347976  5826 raft_consensus.cc:2804] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:48.362390  5826 raft_consensus.cc:493] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:48.362838  5826 raft_consensus.cc:3060] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:48.348588  6008 raft_consensus.cc:493] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:48.315227  6007 consensus_queue.cc:1048] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:00:48.350193  5833 raft_consensus.cc:493] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
W20260709 13:00:48.370402  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 49921.4us
I20260709 13:00:48.374383  6020 raft_consensus.cc:2804] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:48.376406  6020 raft_consensus.cc:493] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:48.330701  5869 raft_consensus.cc:515] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:48.373588  2192 leader_election.cc:304] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:48.377440  6020 raft_consensus.cc:3060] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:48.367707  1425 catalog_manager.cc:5697] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 4 to 6, leader changed from b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 6 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:00:48.379573  1570 leader_election.cc:304] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:48.369539  6008 raft_consensus.cc:3060] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:48.380808  6065 log.cc:927] Time spent T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260709 13:00:48.388330  1524 raft_consensus.cc:1240] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:48.376652  5909 leader_election.cc:290] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:48.389658  5976 leader_election.cc:290] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:48.397648  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:48.398283  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:48.398538  1530 raft_consensus.cc:1240] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:00:48.399138  1526 raft_consensus.cc:2393] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 11: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:00:48.399008  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:48.399674  1525 raft_consensus.cc:2468] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 9.
W20260709 13:00:48.400558  6066 log.cc:927] Time spent T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
I20260709 13:00:48.398473  1531 raft_consensus.cc:2368] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 12. Current term is 13.
I20260709 13:00:48.405380  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:48.406833  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:48.407410  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 13:00:48.407436  6063 log.cc:927] Time spent T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
I20260709 13:00:48.410427  5885 leader_election.cc:290] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:48.410897  5867 raft_consensus.cc:515] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:48.413017  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:48.406401  1497 leader_election.cc:304] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:48.423632  1677 raft_consensus.cc:2468] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 11.
W20260709 13:00:48.424497  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 50935.6us
I20260709 13:00:48.385900  5809 raft_consensus.cc:2749] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:48.407188  1425 catalog_manager.cc:5697] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:48.375135  5833 raft_consensus.cc:515] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:00:48.433208  2190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.415102  5932 raft_consensus.cc:2749] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:48.429867  5810 consensus_queue.cc:1059] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
W20260709 13:00:48.446460  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:48.426970  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 45249.1us
W20260709 13:00:48.430617  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 51123.4us
I20260709 13:00:48.441774  1571 leader_election.cc:304] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:48.416332  5747 raft_consensus.cc:2749] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:48.448675  6012 raft_consensus.cc:2804] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:48.448674  1570 leader_election.cc:304] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:48.457418  5867 leader_election.cc:290] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:48.458302  5932 raft_consensus.cc:2749] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:00:48.461313  5873 raft_consensus.cc:515] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:48.464006  1529 raft_consensus.cc:1275] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
W20260709 13:00:48.481010  1571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:48.443341  6064 log.cc:927] Time spent T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.176s	user 0.000s	sys 0.001s
I20260709 13:00:48.465731  1646 leader_election.cc:304] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:48.431823  5486 raft_consensus.cc:493] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.471846  1570 leader_election.cc:400] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 election: Vote denied by peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931) with higher term. Message: Invalid argument: T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 9. Current term is 10.
I20260709 13:00:48.430119  5885 consensus_queue.cc:1059] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:00:48.474220  1674 raft_consensus.cc:2468] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 13.
I20260709 13:00:48.475935  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:48.476728  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:48.477311  5864 raft_consensus.cc:2749] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:48.454260  1679 raft_consensus.cc:2468] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 13.
I20260709 13:00:48.484529  2224 raft_consensus.cc:2468] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 8.
I20260709 13:00:48.480521  1529 pending_rounds.cc:85] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting all ops after (but not including) 7
I20260709 13:00:48.467532  6012 raft_consensus.cc:493] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:48.499729  1425 catalog_manager.cc:5697] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 5 to 8, leader changed from ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) to b96ce9cc496c49d7818fa983a17b062b (127.0.107.196). New cstate: current_term: 8 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:48.508383  6012 raft_consensus.cc:3060] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:48.509598  1425 catalog_manager.cc:5697] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:48.490794  5486 raft_consensus.cc:515] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:48.512388  5486 leader_election.cc:290] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:48.493865  1570 leader_election.cc:304] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:48.498257  5869 leader_election.cc:290] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:48.507015  1529 pending_rounds.cc:107] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:00:48.513291  1529 raft_consensus.cc:2889] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:48.516714  5892 raft_consensus.cc:515] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:48.518047  1527 raft_consensus.cc:1240] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:00:48.519397  5976 raft_consensus.cc:2955] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 13 LEADER]: Committing config change with OpId 9.8: config changed from index 5 to 8, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:00:48.520539  6012 raft_consensus.cc:515] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:48.529731  5892 leader_election.cc:290] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:48.532152  1677 raft_consensus.cc:2468] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 13.
I20260709 13:00:48.535317  1681 raft_consensus.cc:1240] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 8 LEADER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:48.537628  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:48.538331  1674 raft_consensus.cc:3060] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:48.534576  1425 catalog_manager.cc:5697] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 5 to 8, leader changed from e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) to b96ce9cc496c49d7818fa983a17b062b (127.0.107.196). New cstate: current_term: 8 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:00:48.541249  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 47499.5us
I20260709 13:00:48.525362  6012 leader_election.cc:290] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:48.544072  1571 leader_election.cc:304] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
W20260709 13:00:48.545646  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 80030.8us
W20260709 13:00:48.546947  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 140642us
I20260709 13:00:48.548280  1497 leader_election.cc:304] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:48.548487  6080 raft_consensus.cc:493] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.548915  6080 raft_consensus.cc:515] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:48.549431  1497 leader_election.cc:304] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:48.487774  5982 consensus_queue.cc:1048] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.052s
I20260709 13:00:48.551914  1496 leader_election.cc:304] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:48.556113  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:48.556917  1525 raft_consensus.cc:2410] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:00:48.563007  5861 raft_consensus.cc:2749] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:48.564347  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:48.565425  1673 raft_consensus.cc:1240] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:48.531898  6020 raft_consensus.cc:515] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:48.569554  6020 leader_election.cc:290] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:48.554636  5815 consensus_queue.cc:1048] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 13:00:48.571642  1646 leader_election.cc:304] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:48.573449  5668 raft_consensus.cc:2749] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:48.573812  1646 leader_election.cc:304] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:00:48.555742  6069 log.cc:927] Time spent T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
I20260709 13:00:48.573727  6076 raft_consensus.cc:2749] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:48.580291  6076 consensus_queue.cc:1048] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:00:48.577930  1425 catalog_manager.cc:5697] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 3 to 8, leader changed from b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 8 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:00:48.545463  6019 raft_consensus.cc:2749] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:48.582122  5732 raft_consensus.cc:515] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:48.582938  6078 raft_consensus.cc:2804] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:48.582763  1425 catalog_manager.cc:5697] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:48.583402  5873 leader_election.cc:290] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:48.587323  5827 raft_consensus.cc:515] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:48.525632  5698 raft_consensus.cc:515] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:48.556442  5864 raft_consensus.cc:2804] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:48.565323  1570 leader_election.cc:304] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:48.570171  6020 raft_consensus.cc:2749] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:48.590947  1531 raft_consensus.cc:2468] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 8.
I20260709 13:00:48.591490  1646 leader_election.cc:304] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:48.588516  1425 catalog_manager.cc:5697] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:00:48.592175  5864 raft_consensus.cc:697] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 13 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:48.598330  5686 raft_consensus.cc:2749] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:48.603374  5698 leader_election.cc:290] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:48.601599  1425 catalog_manager.cc:5697] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:48.604614  6012 raft_consensus.cc:2749] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:48.602440  5864 consensus_queue.cc:237] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:48.583547  6078 raft_consensus.cc:697] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:00:48.589541  5664 consensus_queue.cc:1048] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:00:48.607540  6078 consensus_queue.cc:237] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:48.608098  1425 catalog_manager.cc:5697] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 7 to 9, leader changed from ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) to b96ce9cc496c49d7818fa983a17b062b (127.0.107.196). New cstate: current_term: 9 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:48.609820  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:48.620236  1677 raft_consensus.cc:2393] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 12: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:00:48.611246  6080 leader_election.cc:290] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:48.589293  5761 raft_consensus.cc:3055] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:48.618590  1674 raft_consensus.cc:2468] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 12.
W20260709 13:00:48.628140  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 72202us
I20260709 13:00:48.628862  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:48.631283  1673 raft_consensus.cc:3060] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:48.631474  1571 leader_election.cc:304] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:48.632725  1425 catalog_manager.cc:5697] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 6 to 7, leader changed from ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) to b96ce9cc496c49d7818fa983a17b062b (127.0.107.196). New cstate: current_term: 7 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:48.592950  5827 leader_election.cc:290] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:48.615981  5732 leader_election.cc:290] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:48.634495  1425 catalog_manager.cc:5697] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:48.570276  6008 raft_consensus.cc:515] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:00:48.641593  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 89163.4us
I20260709 13:00:48.643158  1497 leader_election.cc:304] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
W20260709 13:00:48.645704  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 54335.1us
I20260709 13:00:48.635782  5873 raft_consensus.cc:2749] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:48.630110  5761 raft_consensus.cc:740] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:48.648634  1497 leader_election.cc:304] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:00:48.640261  6019 raft_consensus.cc:2804] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:00:48.660142  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 108311us
I20260709 13:00:48.661881  1496 leader_election.cc:304] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:48.671249  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:48.643517  5826 raft_consensus.cc:515] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:48.661029  5827 raft_consensus.cc:2804] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:48.660202  5732 raft_consensus.cc:2804] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:48.687914  1602 raft_consensus.cc:1240] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:48.672412  6020 raft_consensus.cc:2804] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:48.690791  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:48.693882  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:48.693843  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:48.690737  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:00:48.694236  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 49615.4us
I20260709 13:00:48.695560  2226 raft_consensus.cc:2468] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 14.
I20260709 13:00:48.694470  1604 raft_consensus.cc:2468] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 11.
I20260709 13:00:48.697700  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:48.658774  5909 consensus_queue.cc:1059] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 13:00:48.671720  5698 raft_consensus.cc:493] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:48.701138  1600 raft_consensus.cc:2468] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 11.
I20260709 13:00:48.672652  6019 raft_consensus.cc:697] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 12 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:48.704133  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:48.706247  2192 leader_election.cc:304] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:48.711623  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:48.715807  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:48.693755  5861 raft_consensus.cc:493] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:00:48.714399  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:48.720549  1570 leader_election.cc:304] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:48.723630  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:48.723390  6019 consensus_queue.cc:237] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:00:48.724642  6075 log.cc:927] Time spent T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:00:48.724961  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:48.726019  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:48.726711  1601 raft_consensus.cc:2393] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 9: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:00:48.727447  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:48.722075  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: true dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:48.729380  1600 raft_consensus.cc:3060] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:48.724007  2192 leader_election.cc:304] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:48.731760  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:48.733176  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:48.735030  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:48.736516  1601 raft_consensus.cc:2368] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 8. Current term is 9.
I20260709 13:00:48.695406  6080 consensus_queue.cc:1059] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:00:48.738080  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:48.738759  1598 raft_consensus.cc:3060] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:48.736480  5726 raft_consensus.cc:2804] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:48.740373  5726 raft_consensus.cc:493] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:48.740756  5726 raft_consensus.cc:3060] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:48.717504  6002 raft_consensus.cc:493] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:00:48.744784  1604 raft_consensus.cc:2468] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 12.
I20260709 13:00:48.727926  5723 raft_consensus.cc:3055] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:48.751979  5723 raft_consensus.cc:740] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:48.753021  5723 consensus_queue.cc:260] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:48.730469  6082 raft_consensus.cc:493] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:48.737612  6085 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:48.754940  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:48.755406  6085 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:48.756291  6002 raft_consensus.cc:515] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:48.756753  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:48.758219  6085 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:48.754323  5723 raft_consensus.cc:3060] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:48.758827  1679 raft_consensus.cc:1275] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:48.715497  5698 raft_consensus.cc:515] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:48.761353  5698 leader_election.cc:290] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:48.763479  5982 consensus_queue.cc:1048] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:48.763825  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:48.763950  6014 raft_consensus.cc:3055] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:48.765255  6080 raft_consensus.cc:3055] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:48.765667  6080 raft_consensus.cc:740] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:00:48.754930  6082 raft_consensus.cc:515] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:48.766535  6080 consensus_queue.cc:260] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:48.767287  5932 raft_consensus.cc:493] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.764406  6014 raft_consensus.cc:740] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:48.764503  2218 raft_consensus.cc:2955] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 5 to 8, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:00:48.771767  5833 leader_election.cc:290] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:48.768872  6014 consensus_queue.cc:260] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:48.767848  5932 raft_consensus.cc:515] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:48.775707  1602 raft_consensus.cc:2468] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 6.
I20260709 13:00:48.689910  5761 consensus_queue.cc:260] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:48.747874  1646 leader_election.cc:304] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:48.779462  5826 leader_election.cc:290] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:48.780176  5909 raft_consensus.cc:2804] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:48.780623  5909 raft_consensus.cc:493] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:48.781023  5909 raft_consensus.cc:3060] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:48.781234  1646 leader_election.cc:304] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:48.784289  5934 consensus_queue.cc:1059] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:00:48.785219  5934 raft_consensus.cc:2804] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:48.785590  5934 raft_consensus.cc:493] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:48.785919  5761 raft_consensus.cc:3060] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:48.736780  5939 raft_consensus.cc:2749] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:00:48.788503  1603 raft_consensus.cc:2468] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 11.
I20260709 13:00:48.788830  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:48.789170  5668 raft_consensus.cc:3055] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:48.789582  5668 raft_consensus.cc:740] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:48.791602  1601 raft_consensus.cc:3060] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:48.764346  1599 raft_consensus.cc:3060] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:48.736925  5869 raft_consensus.cc:2749] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:48.763609  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:48.785951  5934 raft_consensus.cc:3060] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:48.782366  1646 leader_election.cc:304] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:48.798595  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: true dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:48.758457  6002 leader_election.cc:290] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:48.806855  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:48.807796  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:48.776769  5932 leader_election.cc:290] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:48.768033  6080 raft_consensus.cc:3060] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:48.846800  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:48.847473  2227 raft_consensus.cc:2468] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 11.
I20260709 13:00:48.848353  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:48.852459  2223 raft_consensus.cc:1275] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:00:48.852751  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 175768us
I20260709 13:00:48.854705  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:48.857115  1644 leader_election.cc:304] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:00:48.858295  1598 raft_consensus.cc:2468] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 14.
I20260709 13:00:48.859544  1674 raft_consensus.cc:2393] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 7: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:00:48.860001  1606 raft_consensus.cc:2393] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 10: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:00:48.794426  5935 consensus_queue.cc:1059] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.014s
I20260709 13:00:48.860786  1570 leader_election.cc:400] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 election: Vote denied by peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931) with higher term. Message: Invalid argument: T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 12. Current term is 13.
I20260709 13:00:48.870463  1603 raft_consensus.cc:1240] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:00:48.804190  6012 raft_consensus.cc:493] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:48.853876  1600 raft_consensus.cc:2468] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 10.
I20260709 13:00:48.870611  1570 leader_election.cc:403] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:00:48.870772  1644 leader_election.cc:304] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:48.886263  1673 raft_consensus.cc:2468] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 9.
I20260709 13:00:48.887696  1570 leader_election.cc:304] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:48.846606  5976 raft_consensus.cc:2804] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:48.790450  5668 consensus_queue.cc:260] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:48.850922  6008 leader_election.cc:290] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:48.892359   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:48.801013  5861 raft_consensus.cc:515] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:48.912875  1603 raft_consensus.cc:1275] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:00:48.918928  1603 pending_rounds.cc:85] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642: Aborting all ops after (but not including) 6
I20260709 13:00:48.919159  1603 pending_rounds.cc:107] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:00:48.919394  1603 raft_consensus.cc:2889] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:48.870970  5732 raft_consensus.cc:697] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:00:48.890300  5871 raft_consensus.cc:2804] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:48.890585  5976 raft_consensus.cc:493] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:00:48.934722  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:48.883155  6020 raft_consensus.cc:697] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:00:48.890049  5972 raft_consensus.cc:2749] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:48.894536  5869 raft_consensus.cc:3055] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:00:48.934355  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:48.937510  1524 raft_consensus.cc:3060] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:48.944547  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:48.944777  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:48.947254  1529 raft_consensus.cc:2468] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 8.
I20260709 13:00:48.947762  1531 raft_consensus.cc:1275] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:00:48.900206  5827 raft_consensus.cc:697] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:00:48.948884  1525 raft_consensus.cc:2393] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 14: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
W20260709 13:00:48.937570  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 49969.5us
I20260709 13:00:48.955034  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:48.957130  1527 raft_consensus.cc:3060] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:48.955948  1673 raft_consensus.cc:1275] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:00:48.956278  1681 raft_consensus.cc:2410] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:00:48.954237  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:48.960922  1571 leader_election.cc:304] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:48.958225  1570 leader_election.cc:304] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:48.945986  5976 raft_consensus.cc:3060] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:48.931517  5871 raft_consensus.cc:493] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:48.969851  1523 raft_consensus.cc:1275] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:00:48.937546  6082 leader_election.cc:290] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:48.948768  5553 raft_consensus.cc:2749] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:48.988300  1602 raft_consensus.cc:1275] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:00:48.989814  1570 leader_election.cc:304] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:48.983809  5871 raft_consensus.cc:3060] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:48.990722  5732 consensus_queue.cc:237] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:48.974777  5698 consensus_queue.cc:1048] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 13:00:48.996382  5885 raft_consensus.cc:2749] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:49.000257  1601 raft_consensus.cc:2468] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 12.
I20260709 13:00:48.972779  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
W20260709 13:00:48.974385  1495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.975198  6020 consensus_queue.cc:237] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:48.974905  1528 raft_consensus.cc:2955] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 5 to 8, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:00:48.948467  5869 raft_consensus.cc:740] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
W20260709 13:00:48.979301  6094 log.cc:927] Time spent T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:00:48.939388  1606 raft_consensus.cc:2955] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 5 to 8, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:00:48.986299  1524 raft_consensus.cc:2468] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 10.
I20260709 13:00:48.954012  6078 raft_consensus.cc:493] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:48.959975  5668 raft_consensus.cc:3060] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:48.912892  6012 raft_consensus.cc:515] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:49.017208  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.022729  2192 leader_election.cc:304] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:48.983467  5939 raft_consensus.cc:2804] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:00:49.000126  1497 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:40303 timed out after 1.662s (SENT) [suppressed 15 similar messages]
W20260709 13:00:49.042901  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 181031us
I20260709 13:00:49.044759  2191 leader_election.cc:304] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:49.031206  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:49.033877  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:49.051837  1601 raft_consensus.cc:3060] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:00:48.992916  5747 raft_consensus.cc:2749] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:48.999265  5972 raft_consensus.cc:493] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:49.074509  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 51918us
I20260709 13:00:49.080823  6019 raft_consensus.cc:493] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.053921  5810 raft_consensus.cc:2749] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:49.083499  2191 leader_election.cc:304] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:49.104182  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:49.106714  1601 raft_consensus.cc:2468] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 8.
I20260709 13:00:49.077469  6014 raft_consensus.cc:3060] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:49.109330  2226 raft_consensus.cc:1240] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:00:49.090173  5486 raft_consensus.cc:2749] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:00:49.080051  5939 raft_consensus.cc:697] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 9 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:49.113099  1644 leader_election.cc:304] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:00:49.113348  1532 raft_consensus.cc:1240] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:49.081437  6080 raft_consensus.cc:493] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.066308  5699 consensus_queue.cc:1048] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:00:49.057330  6078 raft_consensus.cc:515] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:49.078646  5972 raft_consensus.cc:515] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:49.118471  5875 raft_consensus.cc:493] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.144660  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:49.146399  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:49.141562  2226 raft_consensus.cc:1275] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:00:49.114508  6088 raft_consensus.cc:493] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.081236  5827 consensus_queue.cc:237] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:49.111564  6019 raft_consensus.cc:515] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:49.168077  5877 raft_consensus.cc:493] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:49.178052  5877 raft_consensus.cc:515] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:49.179039  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:49.130175  6080 raft_consensus.cc:515] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:49.196540  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:49.159076  5664 raft_consensus.cc:2764] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:00:49.120167  5869 consensus_queue.cc:260] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:49.226091  1599 raft_consensus.cc:2468] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 13.
I20260709 13:00:49.227211  6002 raft_consensus.cc:2749] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931) with higher term. Message: Invalid argument: T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 12. Current term is 13.
I20260709 13:00:49.227375  6080 leader_election.cc:290] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:49.231621  1527 raft_consensus.cc:2468] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 12.
I20260709 13:00:49.234454  1598 raft_consensus.cc:2468] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 11.
I20260709 13:00:49.235761  1530 raft_consensus.cc:2468] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 11.
I20260709 13:00:49.182024  5861 leader_election.cc:290] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:49.155026  5875 raft_consensus.cc:515] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:49.247531  5640 raft_consensus.cc:2749] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:49.172633  6088 raft_consensus.cc:515] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:49.271310  5726 consensus_meta.cc:287] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b: Time spent flushing consensus metadata: real 0.530s	user 0.006s	sys 0.005s
I20260709 13:00:49.271793  5726 raft_consensus.cc:515] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:49.273188  5909 raft_consensus.cc:515] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:49.273885  5726 leader_election.cc:290] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:49.184267  6100 consensus_queue.cc:1048] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.090s
W20260709 13:00:49.303537  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 303443us
I20260709 13:00:49.235550  5849 consensus_queue.cc:1059] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 13:00:49.304946  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:49.325870  1532 raft_consensus.cc:2393] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 10: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:00:49.293506  6012 leader_election.cc:290] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:49.329185  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:49.331120  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:49.332397  1525 raft_consensus.cc:1275] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:00:49.351125  1531 raft_consensus.cc:2468] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 10.
I20260709 13:00:49.337064  6019 leader_election.cc:290] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:49.338336  1497 leader_election.cc:304] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:49.352103  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:49.352859  1531 raft_consensus.cc:3060] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:00:49.352638  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:49.339448  2227 raft_consensus.cc:2468] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 9.
I20260709 13:00:49.287744  5934 raft_consensus.cc:515] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:49.353199  1497 leader_election.cc:304] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:49.354517  1497 leader_election.cc:400] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 election: Vote denied by peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303) with higher term. Message: Invalid argument: T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 8. Current term is 9.
I20260709 13:00:49.351970  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:49.355361  1532 raft_consensus.cc:3060] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:49.354799  1497 leader_election.cc:403] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:00:49.354826  6089 raft_consensus.cc:2749] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:49.355535  6082 raft_consensus.cc:2749] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:00:49.357005  6103 log.cc:927] Time spent T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
I20260709 13:00:49.355571  1525 raft_consensus.cc:2368] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 7. Current term is 8.
W20260709 13:00:49.357930  6108 log.cc:927] Time spent T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 13:00:49.358723  1525 raft_consensus.cc:1240] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 LEADER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 13:00:49.347465  2224 raft_consensus.cc:2468] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 10.
I20260709 13:00:49.359508  1497 leader_election.cc:304] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:49.236922  5939 consensus_queue.cc:237] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:49.364876  1497 leader_election.cc:304] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:49.369067  1497 leader_election.cc:304] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:49.371672  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:49.374387  1529 raft_consensus.cc:2393] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 13: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:00:49.375078  1531 raft_consensus.cc:2468] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 12.
I20260709 13:00:49.376789  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:49.377414  2226 raft_consensus.cc:2468] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 8.
I20260709 13:00:49.378937  1570 leader_election.cc:304] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:00:49.373091  5723 consensus_meta.cc:287] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.614s	user 0.005s	sys 0.005s
I20260709 13:00:49.415555  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:49.416097  1570 leader_election.cc:304] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:49.414911  2222 raft_consensus.cc:1275] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:00:49.417651  1497 leader_election.cc:304] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:49.415004  1525 raft_consensus.cc:1240] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 LEADER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:49.419986  1570 leader_election.cc:400] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: Vote denied by peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931) with higher term. Message: Invalid argument: T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 7. Current term is 8.
I20260709 13:00:49.423327  1570 leader_election.cc:403] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:49.419883  1497 leader_election.cc:304] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
W20260709 13:00:49.436672  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 266200us
I20260709 13:00:49.420842  6076 raft_consensus.cc:2804] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:00:49.423185  6008 raft_consensus.cc:2749] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:00:49.477541  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 45230us
I20260709 13:00:49.481359  5723 raft_consensus.cc:2749] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931) with higher term. Message: Invalid argument: T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 7. Current term is 8.
I20260709 13:00:49.491412  6128 raft_consensus.cc:493] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:49.491897  1570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.492012  6088 leader_election.cc:290] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:00:49.492821  6117 log.cc:927] Time spent T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 13:00:49.491979  6128 raft_consensus.cc:515] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:00:49.478229  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 58429.9us
W20260709 13:00:49.494369  6104 log.cc:927] Time spent T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.218s	user 0.000s	sys 0.001s
I20260709 13:00:49.494805  6128 leader_election.cc:290] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:49.495153  1527 raft_consensus.cc:1275] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:49.497299  1523 raft_consensus.cc:1240] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:49.497073  6118 consensus_queue.cc:1048] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:00:49.499752  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:49.501581  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:49.503206  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:49.503782  1599 raft_consensus.cc:2468] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 11.
W20260709 13:00:49.507634  6109 log.cc:927] Time spent T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:00:49.482447  6078 leader_election.cc:290] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:00:49.515538  6112 log.cc:927] Time spent T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.156s	user 0.000s	sys 0.001s
I20260709 13:00:49.518307  5877 leader_election.cc:290] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:49.430576  6093 raft_consensus.cc:2804] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:49.523125  6093 raft_consensus.cc:697] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:00:49.524237  6093 consensus_queue.cc:237] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:49.434609  5972 leader_election.cc:290] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:49.430820  6116 raft_consensus.cc:2749] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:49.371747  5810 consensus_queue.cc:1059] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 13:00:49.419214  6091 raft_consensus.cc:493] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.418639  6012 raft_consensus.cc:2749] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:00:49.421180  5867 consensus_queue.cc:1048] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 13:00:49.420899  5892 consensus_queue.cc:1048] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 13:00:49.548265  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:49.551777  1681 raft_consensus.cc:2393] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 11: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
W20260709 13:00:49.542214  5976 consensus_meta.cc:287] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.553s	user 0.003s	sys 0.007s
I20260709 13:00:49.546983  5520 raft_consensus.cc:3055] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:49.547253  6076 raft_consensus.cc:697] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:00:49.588249  5875 leader_election.cc:290] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:00:49.588984  1495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.589907  5934 leader_election.cc:290] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:49.541788  6128 consensus_queue.cc:1048] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 13:00:49.569609  5520 raft_consensus.cc:740] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:49.595889  5892 raft_consensus.cc:493] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:49.605343  6076 consensus_queue.cc:237] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:49.542407  6091 raft_consensus.cc:515] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:00:49.594517  5871 consensus_meta.cc:287] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.604s	user 0.005s	sys 0.002s
I20260709 13:00:49.621968  1532 raft_consensus.cc:2468] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 9.
I20260709 13:00:49.624396  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:49.625066  2222 raft_consensus.cc:2468] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 13.
I20260709 13:00:49.561892  5976 raft_consensus.cc:515] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:49.595918  5520 consensus_queue.cc:260] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:49.630901  5520 raft_consensus.cc:3060] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:49.636334  6082 raft_consensus.cc:2749] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:49.596499  5892 raft_consensus.cc:515] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:49.627355  5871 raft_consensus.cc:515] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:49.649758  5871 leader_election.cc:290] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:49.625761  6089 raft_consensus.cc:2749] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303) with higher term. Message: Invalid argument: T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 8. Current term is 9.
I20260709 13:00:49.694031  5976 leader_election.cc:290] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:49.718128  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:49.718858  1606 raft_consensus.cc:2468] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 12.
W20260709 13:00:49.725137  6014 consensus_meta.cc:287] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.606s	user 0.009s	sys 0.001s
I20260709 13:00:49.726799  1604 raft_consensus.cc:1275] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:00:49.727064  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:49.733655  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:49.734891  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:49.735530  1674 raft_consensus.cc:2468] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 11.
I20260709 13:00:49.737320  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:49.737604  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:49.738210  1674 raft_consensus.cc:2468] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 13.
I20260709 13:00:49.739042  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:49.740378  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:49.740967  1678 raft_consensus.cc:2468] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 8.
I20260709 13:00:49.742149  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:49.727144  1604 pending_rounds.cc:85] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642: Aborting all ops after (but not including) 8
W20260709 13:00:49.749310  2190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.742839  1678 raft_consensus.cc:2368] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 11. Current term is 12.
I20260709 13:00:49.855157  5827 raft_consensus.cc:493] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.873981  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:49.874759  1528 raft_consensus.cc:2468] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 9.
I20260709 13:00:49.869099  1604 pending_rounds.cc:107] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:00:49.878885  1604 raft_consensus.cc:2889] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:00:49.867650  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 143361us
I20260709 13:00:49.886195  1644 leader_election.cc:304] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:49.887408  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:49.742187  6091 leader_election.cc:290] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:49.888070  1673 raft_consensus.cc:3060] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:49.890885  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:49.891762  1532 raft_consensus.cc:2468] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 11.
I20260709 13:00:49.894840  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:49.895741  1678 raft_consensus.cc:2368] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 11. Current term is 12.
I20260709 13:00:49.895936  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:49.896531  1532 raft_consensus.cc:3060] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:49.897226  1644 leader_election.cc:304] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:49.899022  6100 consensus_queue.cc:1048] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:49.901329  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:49.902822  5892 leader_election.cc:290] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:49.906095  1496 leader_election.cc:304] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:49.906561  1679 raft_consensus.cc:1275] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:00:49.889921  5864 raft_consensus.cc:493] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.908178  1496 leader_election.cc:304] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:49.907413  1677 raft_consensus.cc:1275] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:00:49.908177  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:49.891932  5699 raft_consensus.cc:493] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.909626  1644 leader_election.cc:304] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:49.915197  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:49.915848  1571 leader_election.cc:304] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:49.916289  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:49.918392  1496 leader_election.cc:400] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 election: Vote denied by peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217) with higher term. Message: Invalid argument: T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 11. Current term is 12.
I20260709 13:00:49.918732  1496 leader_election.cc:403] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:00:49.896332  5934 raft_consensus.cc:2749] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:49.921097  1571 leader_election.cc:304] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:49.922950  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:49.923828  1496 leader_election.cc:400] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: Vote denied by peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217) with higher term. Message: Invalid argument: T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 11. Current term is 12.
I20260709 13:00:49.924152  1496 leader_election.cc:403] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:49.875398  5827 raft_consensus.cc:515] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:49.924597  5877 raft_consensus.cc:2804] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:49.927711  5877 raft_consensus.cc:493] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:49.911505  6100 raft_consensus.cc:2804] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:49.918184  5972 raft_consensus.cc:2804] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:49.911281  6091 raft_consensus.cc:2804] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:49.919786  5699 raft_consensus.cc:515] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:49.917369  5864 raft_consensus.cc:515] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:49.962795  6118 raft_consensus.cc:493] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
W20260709 13:00:49.956362  6120 log.cc:927] Time spent T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.419s	user 0.003s	sys 0.000s
W20260709 13:00:49.968284  6092 log.cc:927] Time spent T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.985s	user 0.000s	sys 0.005s
I20260709 13:00:49.968348  6118 raft_consensus.cc:515] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:49.971320  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36194 (request call id 1800) took 1274 ms. Trace:
W20260709 13:00:49.972196  6097 log.cc:927] Time spent T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.997s	user 0.000s	sys 0.004s
I20260709 13:00:49.952932  5810 raft_consensus.cc:493] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:49.971764  1605 rpcz_store.cc:276] 0709 13:00:48.696490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:48.699176 (+  2686us) service_pool.cc:224] Handling call
0709 13:00:48.702893 (+  3717us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:48.741078 (+ 38185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:48.741108 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:48.741628 (+   520us) log.cc:844] Serialized 26 byte log entry
0709 13:00:48.856249 (+114621us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:48.856285 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:48.856352 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:49.965960 (+1109608us) spinlock_profiling.cc:243] Waited 946 us on lock 0x7b4400022b4c. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a153ecc85 00007f6a153ed6a2 00007f6a1815f1db 00007f6a1815aaaf 00007f6a1814e86e 00007f6a1814dbb6 00007f6a1814d7d8 00007f6a18157221 00007f6a181571d9 00007f6a18157169
0709 13:00:49.970803 (+  4843us) raft_consensus.cc:1685] finished
0709 13:00:49.970829 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:49.971045 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2348,"raft.queue_time_us":9896,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":21848,"spinlock_wait_cycles":2176384,"thread_start_us":114258,"threads_started":1,"wal-append.queue_time_us":212080}
I20260709 13:00:49.950862  6100 raft_consensus.cc:697] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 10 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:49.927181  1673 raft_consensus.cc:2468] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 8.
I20260709 13:00:49.928174  6002 raft_consensus.cc:2804] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:49.974925  6002 raft_consensus.cc:493] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:49.975482  6002 raft_consensus.cc:3060] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:49.976178  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36194 (request call id 1808) took 1277 ms. Trace:
I20260709 13:00:49.973328  5810 raft_consensus.cc:515] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:49.976577  1604 rpcz_store.cc:276] 0709 13:00:48.698452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:48.747792 (+ 49340us) service_pool.cc:224] Handling call
0709 13:00:48.794939 (+ 47147us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:49.879413 (+1084474us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:49.975914 (+ 96501us) spinlock_profiling.cc:243] Waited 931 ms on lock 0x7b5400057154. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:00:49.976116 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2142383872}
I20260709 13:00:49.979089  5972 raft_consensus.cc:697] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 12 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:49.930577  5877 raft_consensus.cc:3060] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:49.973255  6118 leader_election.cc:290] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:49.924943  6088 consensus_queue.cc:1048] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 13:00:49.966033  6020 consensus_queue.cc:1048] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 13:00:49.932552  6130 raft_consensus.cc:2749] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217) with higher term. Message: Invalid argument: T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 11. Current term is 12.
I20260709 13:00:49.974511  6100 consensus_queue.cc:237] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:49.984301  1532 raft_consensus.cc:2468] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 12.
I20260709 13:00:49.962529  6076 raft_consensus.cc:2749] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:49.986395  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:49.992019  1497 leader_election.cc:304] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:49.980222  5869 raft_consensus.cc:3060] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:49.983829  6091 raft_consensus.cc:493] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:49.993978  1526 raft_consensus.cc:2393] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 14: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:00:49.980219  5864 leader_election.cc:290] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:49.994405  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:49.996600  1529 raft_consensus.cc:3060] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:49.928133  6012 consensus_queue.cc:1048] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 13:00:49.998631  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:50.003605  5935 raft_consensus.cc:493] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:50.004041  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:50.067015  5935 raft_consensus.cc:515] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:50.004745  6002 raft_consensus.cc:515] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:50.007956  6122 log.cc:927] Time spent T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.512s	user 0.000s	sys 0.002s
I20260709 13:00:50.076649  6002 leader_election.cc:290] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:50.009235  1606 raft_consensus.cc:1275] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:00:50.079696  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:50.008935  2222 raft_consensus.cc:1275] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:00:50.009874  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:00:50.008961  6135 log.cc:927] Time spent T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 13:00:50.011220  1605 raft_consensus.cc:1275] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 9. (term mismatch)
I20260709 13:00:50.011795  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:50.013964  5827 leader_election.cc:290] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:50.098003  1605 pending_rounds.cc:85] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642: Aborting all ops after (but not including) 8
I20260709 13:00:49.980134  5972 consensus_queue.cc:237] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:49.997884  6082 raft_consensus.cc:2804] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:50.016682  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:49.996850  6091 raft_consensus.cc:3060] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:50.021096  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:50.021148  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:50.022689  2227 raft_consensus.cc:1275] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:49.991324  5732 raft_consensus.cc:2749] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217) with higher term. Message: Invalid argument: T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 11. Current term is 12.
I20260709 13:00:50.024670  5699 leader_election.cc:290] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:50.027226  2224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 894) took 1231 ms. Trace:
I20260709 13:00:50.039110  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36200 (request call id 2438) took 1278 ms. Trace:
I20260709 13:00:50.022584  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36200 (request call id 2422) took 1354 ms. Trace:
I20260709 13:00:50.042755  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:50.043795  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:50.127983  2218 raft_consensus.cc:2393] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 9: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:00:50.044066  1531 raft_consensus.cc:1275] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:00:50.045123  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 13:00:50.046953  6119 log.cc:927] Time spent T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.556s	user 0.005s	sys 0.000s
I20260709 13:00:50.053208  1572 leader_election.cc:304] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:50.061443  5976 consensus_queue.cc:1048] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:50.062546  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:50.063244  6088 consensus_queue.cc:1048] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:50.077091  1529 raft_consensus.cc:2468] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 14.
I20260709 13:00:50.078290  1604 raft_consensus.cc:2468] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 11.
I20260709 13:00:50.080933  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:49.997004  1496 leader_election.cc:304] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:50.080036  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:00:50.097195  1495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.141872  2192 leader_election.cc:304] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:50.099071  1605 pending_rounds.cc:107] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642: Aborting uncommitted NO_OP operation due to leader change: 7.9
I20260709 13:00:50.127094  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:50.142997  1605 raft_consensus.cc:2889] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:50.143180  1600 raft_consensus.cc:3060] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:50.128265  1532 raft_consensus.cc:2468] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 11.
I20260709 13:00:50.127833  1607 rpcz_store.cc:276] 0709 13:00:48.668214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:48.668365 (+   151us) service_pool.cc:224] Handling call
0709 13:00:48.683359 (+ 14994us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:48.696832 (+ 13473us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:48.696863 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:48.732507 (+ 35644us) log.cc:844] Serialized 26 byte log entry
0709 13:00:48.993885 (+261378us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:49.142793 (+148908us) log.cc:844] Serialized 14 byte log entry
0709 13:00:49.240103 (+ 97310us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:49.240211 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:49.971635 (+731424us) spinlock_profiling.cc:243] Waited 8.96 ms on lock 0x7b4400022b4c. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a153ecc85 00007f6a153ed6a2 00007f6a1815f1db 00007f6a1815aaaf 00007f6a1814e86e 00007f6a1814dbb6 00007f6a1814d7d8 00007f6a18157221 00007f6a181571d9 00007f6a18157169
0709 13:00:50.022298 (+ 50663us) raft_consensus.cc:1685] finished
0709 13:00:50.022389 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:50.022517 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":188231,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":4784,"raft.queue_time_us":31124,"raft.run_cpu_time_us":244,"raft.run_wall_time_us":21116,"spinlock_wait_cycles":20604160,"thread_start_us":374473,"threads_started":3,"wal-append.queue_time_us":177611}
W20260709 13:00:50.141892  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 144960us
I20260709 13:00:50.131592  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 13:00:50.131541  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 78443.5us
I20260709 13:00:50.126981  2224 rpcz_store.cc:276] 0709 13:00:48.795670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:48.798351 (+  2681us) service_pool.cc:224] Handling call
0709 13:00:50.027034 (+1228683us) spinlock_profiling.cc:243] Waited 493 ms on lock 0x7b540059c4d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:50.027141 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1133521664}
I20260709 13:00:50.146917  1674 raft_consensus.cc:1240] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:50.127763  1603 rpcz_store.cc:276] 0709 13:00:48.761074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:48.984018 (+222944us) service_pool.cc:224] Handling call
0709 13:00:48.984725 (+   707us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:49.083494 (+ 98769us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:49.083527 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:49.094331 (+ 10804us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:00:49.094372 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:50.038848 (+944476us) spinlock_profiling.cc:243] Waited 89.9 ms on lock 0x7b54000daa54. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:00:50.038903 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:50.039041 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":206876032}
I20260709 13:00:50.130470  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:50.151535  1526 raft_consensus.cc:1240] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 13. Current term is 14. Ops: []
I20260709 13:00:50.147735  2226 raft_consensus.cc:2468] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 11.
I20260709 13:00:50.152356  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:00:50.152043  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 226339us
I20260709 13:00:50.112661  6082 raft_consensus.cc:493] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:50.140515  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 219621us
I20260709 13:00:50.163316  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:50.164012  1677 raft_consensus.cc:2468] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 11.
I20260709 13:00:50.165493  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:50.169785  1677 raft_consensus.cc:1240] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 13. Current term is 14. Ops: []
I20260709 13:00:50.134131  5553 raft_consensus.cc:2749] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:50.170190  6076 consensus_queue.cc:1059] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:00:50.179709  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:50.180008  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:50.170064  6131 raft_consensus.cc:2804] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:50.180688  1678 raft_consensus.cc:3060] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:50.164944  6082 raft_consensus.cc:3060] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:50.183981  5871 consensus_queue.cc:1059] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:50.180249  6076 raft_consensus.cc:3055] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:50.187739  6076 raft_consensus.cc:740] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:00:50.188616  6076 consensus_queue.cc:260] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:50.173245  5877 raft_consensus.cc:515] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:50.156371  5827 raft_consensus.cc:2804] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:50.214810  5827 raft_consensus.cc:697] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:00:50.215780  5827 consensus_queue.cc:237] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:00:50.218752  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 172771us
I20260709 13:00:50.220870  1497 leader_election.cc:304] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:50.221980  1497 leader_election.cc:304] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:50.225206  5909 leader_election.cc:290] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:50.225907  5909 raft_consensus.cc:3055] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:50.226387  5909 raft_consensus.cc:740] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:50.226739  5935 leader_election.cc:290] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:50.230481  1598 raft_consensus.cc:2393] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 12: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:00:50.230792  5877 leader_election.cc:290] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:50.236135  5815 raft_consensus.cc:493] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:50.236754  5815 raft_consensus.cc:515] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:50.238248  1600 raft_consensus.cc:2468] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 12.
I20260709 13:00:50.171664  5810 leader_election.cc:290] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:50.242540  1678 raft_consensus.cc:2468] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 14.
I20260709 13:00:50.177145  1571 leader_election.cc:304] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
W20260709 13:00:50.249300  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 72237.7us
I20260709 13:00:50.253598  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:50.180883  6131 raft_consensus.cc:697] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 11 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:50.255832  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:50.257776  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:50.254192  2224 raft_consensus.cc:3060] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:50.259630  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:50.262567  1571 leader_election.cc:304] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:50.249220  5732 raft_consensus.cc:2749] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:50.268087  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:50.248978  6080 raft_consensus.cc:2749] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:50.253502  6116 raft_consensus.cc:2804] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:50.270753  1678 raft_consensus.cc:3060] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:00:50.274564  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 52651.5us
I20260709 13:00:50.276742  1497 leader_election.cc:304] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:50.277997  1497 leader_election.cc:304] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:50.281592  6093 raft_consensus.cc:2804] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:50.282037  6093 raft_consensus.cc:493] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:50.282428  6093 raft_consensus.cc:3060] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:50.282971  2192 leader_election.cc:304] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:50.278803  6116 raft_consensus.cc:493] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:50.284900  6116 raft_consensus.cc:3060] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:50.285768  5699 raft_consensus.cc:2749] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:50.286191  1678 raft_consensus.cc:2468] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 12.
I20260709 13:00:50.287354  5815 leader_election.cc:290] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:50.297916  1571 leader_election.cc:304] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:50.264614  5553 raft_consensus.cc:493] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:00:50.301162  2224 raft_consensus.cc:2468] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 14.
I20260709 13:00:50.270503  6125 raft_consensus.cc:2804] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:00:50.302409  5885 raft_consensus.cc:2804] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:50.269049  5877 consensus_queue.cc:1059] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:00:50.301389  5699 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:50.298913  6089 raft_consensus.cc:2804] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:50.306275  2190 leader_election.cc:304] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:00:50.316736  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 150833us
I20260709 13:00:50.317693  1644 leader_election.cc:304] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:00:50.305374  5885 raft_consensus.cc:697] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 12 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:50.339524  5885 consensus_queue.cc:237] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:50.346603  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:50.348649  6076 raft_consensus.cc:3060] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:50.306164  5877 raft_consensus.cc:3055] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:00:50.354820  2191 leader_election.cc:304] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:50.303900  6128 consensus_queue.cc:1048] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:00:50.311168  6089 raft_consensus.cc:493] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:50.305269  6125 raft_consensus.cc:697] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 14 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:50.303300  5553 raft_consensus.cc:515] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:50.315577  5699 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:50.323750  5976 raft_consensus.cc:2804] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:50.379829  6089 raft_consensus.cc:3060] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:50.359036  5877 raft_consensus.cc:740] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
W20260709 13:00:50.381637  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 58901.8us
I20260709 13:00:50.315737  5732 consensus_queue.cc:1048] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.073s
I20260709 13:00:50.362088  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:50.354362  5869 raft_consensus.cc:2749] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:00:50.392012  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 227752us
W20260709 13:00:50.402942  1570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.367081  5935 raft_consensus.cc:2749] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:50.394589  6144 raft_consensus.cc:493] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:50.307224  5909 consensus_queue.cc:260] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:50.364621  6093 raft_consensus.cc:515] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:50.324810  6131 consensus_queue.cc:237] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:50.403283  1644 leader_election.cc:304] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:50.421681  1644 leader_election.cc:304] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
W20260709 13:00:50.419552  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 116271us
I20260709 13:00:50.423549  1497 leader_election.cc:304] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:50.400125  6082 raft_consensus.cc:515] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:50.404023  5976 raft_consensus.cc:697] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 11 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:50.434561  1570 leader_election.cc:304] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:50.430387  1644 leader_election.cc:304] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
W20260709 13:00:50.439030  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 71004.8us
I20260709 13:00:50.439891  1605 raft_consensus.cc:1275] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:00:50.447988  1601 raft_consensus.cc:1275] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:00:50.424607  5869 raft_consensus.cc:493] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:50.470275  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 106282us
I20260709 13:00:50.453848  2190 leader_election.cc:304] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:50.423147  6153 raft_consensus.cc:2804] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:50.413149  6144 raft_consensus.cc:515] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:50.433296  6076 raft_consensus.cc:2749] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:50.439263  5909 raft_consensus.cc:3060] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:50.562022  2227 raft_consensus.cc:1275] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:00:50.440750  6152 raft_consensus.cc:2764] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:00:50.419090  6116 raft_consensus.cc:515] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:50.453049  5875 raft_consensus.cc:2749] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:50.468676  5972 raft_consensus.cc:2804] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:00:50.576376  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 146058us
I20260709 13:00:50.468912  6118 raft_consensus.cc:493] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:50.476276  6153 raft_consensus.cc:493] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:00:50.578281  1644 leader_election.cc:304] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:00:50.469466  6080 consensus_queue.cc:1048] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.123s
I20260709 13:00:50.454360  5939 consensus_queue.cc:1048] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.130s
W20260709 13:00:50.633526  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.423619  5877 consensus_queue.cc:260] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:00:50.576840  6146 log.cc:927] Time spent T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.164s	user 0.000s	sys 0.001s
W20260709 13:00:50.644289  6164 log.cc:927] Time spent T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.190s	user 0.000s	sys 0.000s
I20260709 13:00:50.645073  5699 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:50.647012  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:50.678450  1601 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 13.
W20260709 13:00:50.645469  6145 log.cc:927] Time spent T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:00:50.606372  5972 raft_consensus.cc:697] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 12 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:50.443292  6125 consensus_queue.cc:237] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:50.635746  5809 raft_consensus.cc:2749] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:50.652657  6082 leader_election.cc:290] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:00:50.655545  6149 log.cc:927] Time spent T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.213s	user 0.000s	sys 0.000s
I20260709 13:00:50.656208  6144 leader_election.cc:290] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:00:50.656834  6150 log.cc:927] Time spent T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.234s	user 0.000s	sys 0.000s
I20260709 13:00:50.657655  6116 leader_election.cc:290] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:50.658067  6152 raft_consensus.cc:2804] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:00:50.659096  6137 log.cc:927] Time spent T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:00:50.476289  5869 raft_consensus.cc:515] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:50.678985  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 202193us
I20260709 13:00:50.646196  6118 raft_consensus.cc:515] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:50.648168  5976 consensus_queue.cc:237] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:50.637418  6153 raft_consensus.cc:3060] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:50.703969  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 289136us
I20260709 13:00:50.754951  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:50.754837  1672 raft_consensus.cc:1275] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:00:50.773952  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:50.788668  1681 raft_consensus.cc:3060] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:50.771201  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:00:50.768524  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 89919us
I20260709 13:00:50.707983  5877 raft_consensus.cc:3060] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:50.789966  1497 leader_election.cc:304] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:50.691556  5640 raft_consensus.cc:493] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:50.784391  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:50.790912  5640 raft_consensus.cc:515] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:50.769593  6154 raft_consensus.cc:493] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:50.694916  5867 consensus_queue.cc:1175] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" responder_term: 14 status { last_received { term: 11 index: 7 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 13. Current term is 14. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:00:50.796868  1646 leader_election.cc:304] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:50.799207  1527 raft_consensus.cc:1275] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:00:50.799578  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:50.804601  1531 raft_consensus.cc:3060] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:00:50.808655  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 332476us
I20260709 13:00:50.786011  6152 raft_consensus.cc:697] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 14 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:50.830190  5809 raft_consensus.cc:493] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:50.778606  6020 consensus_queue.cc:1048] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.063s
I20260709 13:00:50.847837  1530 raft_consensus.cc:1240] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:00:50.797673  6082 raft_consensus.cc:2749] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:50.849766  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:50.849118  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:50.807775  6076 raft_consensus.cc:493] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:50.840216  6091 consensus_meta.cc:287] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent flushing consensus metadata: real 0.709s	user 0.005s	sys 0.005s
I20260709 13:00:50.835101  5939 raft_consensus.cc:493] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.859627  2224 raft_consensus.cc:3060] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:50.860049  1529 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 13.
I20260709 13:00:50.865139  1531 raft_consensus.cc:2468] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 12.
I20260709 13:00:50.871505  2227 raft_consensus.cc:1275] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 13:00:50.874946  2227 pending_rounds.cc:85] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b: Aborting all ops after (but not including) 10
I20260709 13:00:50.875236  2227 pending_rounds.cc:107] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 13:00:50.875510  2227 raft_consensus.cc:2889] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:50.838188  6168 raft_consensus.cc:2749] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:00:50.885113  2224 raft_consensus.cc:2468] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 9.
I20260709 13:00:50.848498  6174 raft_consensus.cc:493] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:50.809329  6080 consensus_queue.cc:1048] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.068s
I20260709 13:00:50.893088   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:00:50.899420  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 49683.6us
I20260709 13:00:50.872833  6076 raft_consensus.cc:515] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:50.903285  6170 log.cc:927] Time spent T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
W20260709 13:00:50.900297  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 49596.8us
I20260709 13:00:50.808437  6154 raft_consensus.cc:515] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:50.852514  5972 consensus_queue.cc:237] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:50.855779  5809 raft_consensus.cc:515] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:50.887620  6177 raft_consensus.cc:493] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:50.921901  6163 log.cc:927] Time spent T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
I20260709 13:00:50.922326  6180 consensus_queue.cc:1048] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.008s
I20260709 13:00:50.924350  6076 leader_election.cc:290] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:50.924636  6152 consensus_queue.cc:237] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:50.927166  6177 raft_consensus.cc:515] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:50.925104  6176 raft_consensus.cc:493] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:50.876688  6091 raft_consensus.cc:515] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:50.959827  1673 raft_consensus.cc:1275] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:00:50.891844  6116 raft_consensus.cc:493] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:50.884699  5939 raft_consensus.cc:515] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:50.969293  5939 leader_election.cc:290] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:50.889609  5923 consensus_queue.cc:1048] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.073s
I20260709 13:00:50.962805  6175 consensus_queue.cc:1048] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 13:00:50.964910  6100 raft_consensus.cc:493] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:50.967077  5869 leader_election.cc:290] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:50.995270  5809 leader_election.cc:290] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:50.996372  6118 leader_election.cc:290] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:50.900791  6174 raft_consensus.cc:515] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:50.997401  5939 raft_consensus.cc:493] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.997946  5939 raft_consensus.cc:515] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:50.998683  6174 leader_election.cc:290] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:50.973266  6116 raft_consensus.cc:515] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:51.000023  5939 leader_election.cc:290] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:51.000837  6116 leader_election.cc:290] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:51.002455  5553 leader_election.cc:290] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:51.003167  6091 leader_election.cc:290] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:50.971740  6176 raft_consensus.cc:515] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:51.005846  6176 leader_election.cc:290] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:51.007604  6153 raft_consensus.cc:515] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:51.009789  6153 leader_election.cc:290] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:51.007810  6162 raft_consensus.cc:493] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:51.011896  6162 raft_consensus.cc:515] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:51.014228  6162 leader_election.cc:290] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:51.023263  1681 raft_consensus.cc:2468] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 12.
I20260709 13:00:51.023922  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:51.030627  1603 raft_consensus.cc:2468] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 13.
I20260709 13:00:51.033401  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:51.035742  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:51.036082  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:51.036690  1600 raft_consensus.cc:2468] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 14.
I20260709 13:00:51.038671  2192 leader_election.cc:304] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:00:51.061323  6176 raft_consensus.cc:2804] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:51.065191  6176 raft_consensus.cc:493] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:51.065582  6176 raft_consensus.cc:3060] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:51.065821  2221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50326 (request call id 965) took 1017 ms. Trace:
I20260709 13:00:51.066251  2221 rpcz_store.cc:276] 0709 13:00:50.048724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:50.151280 (+102556us) service_pool.cc:224] Handling call
0709 13:00:51.065598 (+914318us) spinlock_profiling.cc:243] Waited 687 ms on lock 0x7b5400600ed4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:51.065756 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1579354368}
I20260709 13:00:51.007894  6154 leader_election.cc:290] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:51.070768  2227 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5"
dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
mode: GRACEFUL
new_leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:47682
I20260709 13:00:51.071707  2227 raft_consensus.cc:606] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Received request to transfer leadership to TS e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:51.072095  2227 raft_consensus.cc:614] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:51.019079  6100 raft_consensus.cc:515] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:51.085301  6089 consensus_meta.cc:287] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent flushing consensus metadata: real 0.677s	user 0.009s	sys 0.001s
I20260709 13:00:51.085777  6089 raft_consensus.cc:515] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:51.088042  6177 leader_election.cc:290] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:51.132784  1526 raft_consensus.cc:1240] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:00:51.060583  6118 raft_consensus.cc:493] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.059126  5869 raft_consensus.cc:493] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:51.162091  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 949317us
I20260709 13:00:51.088315  6100 leader_election.cc:290] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:51.168656  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:00:51.158983  1481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 53159.4us
I20260709 13:00:51.187007  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:51.188426  1681 raft_consensus.cc:2468] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 11.
I20260709 13:00:51.187865  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:51.193672  1572 leader_election.cc:304] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:51.194006  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:51.193558  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:51.174841  6197 raft_consensus.cc:493] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:51.182152  5553 raft_consensus.cc:493] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.233253  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:51.162683  6118 raft_consensus.cc:515] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:51.224117  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:51.166436  5869 raft_consensus.cc:515] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:51.166934  6168 consensus_queue.cc:1048] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:00:51.234057  2220 raft_consensus.cc:2468] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 14.
I20260709 13:00:51.241663  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:51.245692  6179 raft_consensus.cc:2749] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:51.247730  5761 raft_consensus.cc:493] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.248256  5761 raft_consensus.cc:515] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:51.250357  5761 leader_election.cc:290] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:51.245563  6089 leader_election.cc:290] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:51.194491  5939 raft_consensus.cc:493] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.187872  6116 raft_consensus.cc:493] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:51.260866  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:51.222855  6175 raft_consensus.cc:493] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.282289  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:51.281683  1529 raft_consensus.cc:1275] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:00:51.283488  1497 leader_election.cc:304] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:51.285408  2222 raft_consensus.cc:2410] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 13:00:51.287333  1531 raft_consensus.cc:1275] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:00:51.241575  6190 raft_consensus.cc:493] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:51.288249  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:51.296720  1527 raft_consensus.cc:2468] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 12.
I20260709 13:00:51.281359  6089 raft_consensus.cc:493] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:51.197753  6176 raft_consensus.cc:515] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:51.297776  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:51.282490  2218 raft_consensus.cc:3060] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:51.282627  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 119597us
I20260709 13:00:51.287477  6175 raft_consensus.cc:515] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:51.289187  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:51.299697  2191 leader_election.cc:304] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
W20260709 13:00:51.289733  6194 log.cc:927] Time spent T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:00:51.290205  6159 raft_consensus.cc:2804] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:51.306547  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:51.289785  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:51.308132  1529 raft_consensus.cc:2468] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 12.
W20260709 13:00:51.292999  6156 log.cc:927] Time spent T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.641s	user 0.000s	sys 0.003s
I20260709 13:00:51.294165  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:51.296288  6130 raft_consensus.cc:493] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.239254  5553 raft_consensus.cc:515] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:51.294999  5892 consensus_queue.cc:1048] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 13:00:51.294902  5869 leader_election.cc:290] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:51.312029  2222 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "770925e70faa4a16a275abd5282f5284"
dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
mode: GRACEFUL
new_leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:47682
I20260709 13:00:51.337950  2225 raft_consensus.cc:2393] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 14: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:00:51.333329  2222 raft_consensus.cc:606] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 7 LEADER]: Received request to transfer leadership to TS e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:51.297690  6089 raft_consensus.cc:515] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:51.280539  5939 raft_consensus.cc:515] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:51.306699  6093 leader_election.cc:290] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:51.312175  5815 raft_consensus.cc:2804] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:51.287777  6116 raft_consensus.cc:515] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:51.237102  6197 raft_consensus.cc:515] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:51.355284  2218 raft_consensus.cc:2468] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 10.
I20260709 13:00:51.340279  6159 raft_consensus.cc:697] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:00:51.377419  1532 raft_consensus.cc:2468] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 7.
I20260709 13:00:51.296723  6190 raft_consensus.cc:515] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:51.350433  5815 raft_consensus.cc:493] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:51.333356  6130 raft_consensus.cc:515] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:51.385118  5815 raft_consensus.cc:3060] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:00:51.422751  6198 log.cc:927] Time spent T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 13:00:51.439247  6144 raft_consensus.cc:493] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
W20260709 13:00:51.442348  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 194212us
I20260709 13:00:51.442430  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:51.446735  1681 raft_consensus.cc:2468] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 14.
I20260709 13:00:51.448009  2191 leader_election.cc:304] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:51.452598  1679 raft_consensus.cc:1240] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 11. Current term is 12. Ops: []
W20260709 13:00:51.441269  6196 log.cc:927] Time spent T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 13:00:51.448742  1497 leader_election.cc:304] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:51.445001  6118 leader_election.cc:290] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:51.448436  6144 raft_consensus.cc:515] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:51.485314  6144 leader_election.cc:290] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:51.486394  6175 leader_election.cc:290] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:51.487851  5553 leader_election.cc:290] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:51.479892  5732 raft_consensus.cc:2804] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:51.489665  5732 raft_consensus.cc:697] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:00:51.490769  5732 consensus_queue.cc:237] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:51.493314  6175 raft_consensus.cc:493] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:51.493922  6175 raft_consensus.cc:515] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:00:51.495347  6199 log.cc:927] Time spent T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 13:00:51.496162  6175 leader_election.cc:290] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:00:51.497118  6202 log.cc:927] Time spent T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:00:51.481945  1572 leader_election.cc:304] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:00:51.473330  6204 raft_consensus.cc:493] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:51.516605  6130 leader_election.cc:290] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:51.439152  6159 consensus_queue.cc:237] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:51.520890  5939 leader_election.cc:290] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:51.522298  6197 leader_election.cc:290] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:51.523545  6190 leader_election.cc:290] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:51.525563  6116 leader_election.cc:290] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:51.510603  5553 raft_consensus.cc:2804] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:51.526407  5553 raft_consensus.cc:493] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:51.526803  5553 raft_consensus.cc:3060] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:51.527230  1524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43008 (request call id 2158) took 1481 ms. Trace:
I20260709 13:00:51.527710  1524 rpcz_store.cc:276] 0709 13:00:50.045770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:50.045896 (+   126us) service_pool.cc:224] Handling call
0709 13:00:50.046220 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:50.046687 (+   467us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:50.046713 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:50.047184 (+   471us) log.cc:844] Serialized 26 byte log entry
0709 13:00:50.321147 (+273963us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:50.362383 (+ 41236us) log.cc:844] Serialized 14 byte log entry
0709 13:00:50.362609 (+   226us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:50.362702 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:51.526734 (+1164032us) spinlock_profiling.cc:243] Waited 3.17 ms on lock 0x7b2c0001bf68. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a16863291 00007f6a1687e0ca 00007f6a185ac4ad 00007f6a185b3f8e 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2
0709 13:00:51.526850 (+   116us) raft_consensus.cc:1685] finished
0709 13:00:51.526958 (+   108us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:51.527131 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":42158,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":1865,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":30704,"spinlock_wait_cycles":7281024,"thread_start_us":273459,"threads_started":1,"wal-append.queue_time_us":356833}
I20260709 13:00:51.536689  5640 leader_election.cc:290] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:51.539919  6082 raft_consensus.cc:493] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.540513  6082 raft_consensus.cc:515] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:51.546224  6089 leader_election.cc:290] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:51.513900  6204 raft_consensus.cc:515] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:51.552608  6205 raft_consensus.cc:493] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:51.542484  6082 leader_election.cc:290] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:51.553448  6089 raft_consensus.cc:493] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:51.611416  1602 raft_consensus.cc:1275] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:00:51.612690  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:51.605105  6208 raft_consensus.cc:493] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:51.618345  1604 raft_consensus.cc:1275] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260709 13:00:51.618836  1604 pending_rounds.cc:85] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642: Aborting all ops after (but not including) 8
I20260709 13:00:51.619064  1604 pending_rounds.cc:107] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 13:00:51.619293  1604 raft_consensus.cc:2889] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:51.620551  1600 raft_consensus.cc:1275] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:00:51.621289  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:51.589588  6168 raft_consensus.cc:493] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:51.627298  6168 raft_consensus.cc:515] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:51.637548  5553 raft_consensus.cc:515] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:51.638651  6204 leader_election.cc:290] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:51.630391  6168 leader_election.cc:290] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:51.721004  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:51.721747  1606 raft_consensus.cc:2468] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 7.
W20260709 13:00:51.720067  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 71111.7us
I20260709 13:00:51.729950  6213 raft_consensus.cc:493] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:51.616286  6089 raft_consensus.cc:515] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:51.559749  6205 raft_consensus.cc:515] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:51.734519  6143 consensus_queue.cc:1048] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 13:00:51.724511  5815 raft_consensus.cc:515] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:51.737006  6159 consensus_queue.cc:1048] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:51.724326  6080 raft_consensus.cc:493] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:51.745299  6080 raft_consensus.cc:515] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:51.747902  6080 leader_election.cc:290] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:51.751423  5934 raft_consensus.cc:493] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.751952  5934 raft_consensus.cc:515] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:51.753968  5934 leader_election.cc:290] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:51.729405  6168 consensus_queue.cc:1048] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 13:00:51.757653  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:51.744616  1606 raft_consensus.cc:1275] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:00:51.730578  6213 raft_consensus.cc:515] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:51.760327  6213 leader_election.cc:290] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:51.762130  6089 leader_election.cc:290] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:51.640935  6208 raft_consensus.cc:515] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:51.764773  6208 leader_election.cc:290] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:51.738596  5553 leader_election.cc:290] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:51.757782  6205 leader_election.cc:290] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:51.780843  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:51.781538  1681 raft_consensus.cc:2410] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 13:00:51.785002  1679 raft_consensus.cc:1275] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:00:51.783596  6168 raft_consensus.cc:493] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:51.787297  6168 raft_consensus.cc:515] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:51.789628  6168 leader_election.cc:290] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:51.795384  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:51.796228  6100 raft_consensus.cc:493] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:51.800424  6007 raft_consensus.cc:493] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:51.800940  5815 leader_election.cc:290] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:51.798429  6100 raft_consensus.cc:515] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:51.803547  6100 leader_election.cc:290] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:51.806391  1571 leader_election.cc:304] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:51.810962  1571 leader_election.cc:304] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:51.801126  6007 raft_consensus.cc:515] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:51.818702  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:51.819631  1679 raft_consensus.cc:3060] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:51.821192  6154 consensus_queue.cc:1048] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:51.824172  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:51.823329  5871 consensus_queue.cc:1059] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:51.825083  5871 raft_consensus.cc:3055] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:51.825639  5871 raft_consensus.cc:740] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
W20260709 13:00:51.826397  6191 log.cc:927] Time spent T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.636s	user 0.008s	sys 0.017s
I20260709 13:00:51.826452  5871 consensus_queue.cc:260] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:51.828311  6007 leader_election.cc:290] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:51.828676  1598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36194 (request call id 1829) took 1378 ms. Trace:
I20260709 13:00:51.821910  6159 raft_consensus.cc:493] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:51.828352  1673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49170 (request call id 2265) took 1063 ms. Trace:
I20260709 13:00:51.819214  6184 consensus_queue.cc:1059] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 13:00:51.830751  6184 raft_consensus.cc:3055] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:51.830888  5871 raft_consensus.cc:3060] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:51.831156  6184 raft_consensus.cc:740] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:51.832098  6184 consensus_queue.cc:260] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:51.833225  1607 raft_consensus.cc:1240] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:00:51.833267  6184 raft_consensus.cc:3060] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:51.829697  6159 raft_consensus.cc:515] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:51.835043  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:51.819655  6204 raft_consensus.cc:3060] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:51.836472  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:51.837986  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:51.838541  1607 raft_consensus.cc:2468] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 8.
I20260709 13:00:51.840839  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:51.842869  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:51.842957  6174 raft_consensus.cc:2804] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:51.843585  6174 raft_consensus.cc:697] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 12 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:51.845369  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:51.846082  1601 raft_consensus.cc:2468] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 10.
I20260709 13:00:51.847162  1679 raft_consensus.cc:2468] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 10.
I20260709 13:00:51.846006  1606 raft_consensus.cc:1275] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:00:51.830252  1673 rpcz_store.cc:276] 0709 13:00:50.765199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:50.765376 (+   177us) service_pool.cc:224] Handling call
0709 13:00:50.785309 (+ 19933us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:50.960289 (+174980us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:51.828098 (+867809us) spinlock_profiling.cc:243] Waited 174 ms on lock 0x7b540010c554. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:00:51.828258 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":400527744}
I20260709 13:00:51.850193  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:51.851686  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:51.852852  1679 raft_consensus.cc:2410] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:00:51.829093  1598 rpcz_store.cc:276] 0709 13:00:50.450244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:50.450359 (+   115us) service_pool.cc:224] Handling call
0709 13:00:50.475820 (+ 25461us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:50.633025 (+157205us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:50.633061 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:50.634274 (+  1213us) log.cc:844] Serialized 26 byte log entry
0709 13:00:51.031864 (+397590us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:51.283936 (+252072us) log.cc:844] Serialized 14 byte log entry
0709 13:00:51.284219 (+   283us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:51.284288 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:51.825849 (+541561us) spinlock_profiling.cc:243] Waited 9.5 ms on lock 0x7b4400022b4c. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a153ecc85 00007f6a153ed6a2 00007f6a1815f1db 00007f6a1815aaaf 00007f6a1814e86e 00007f6a1814dbb6 00007f6a1814d7d8 00007f6a18157221 00007f6a181571d9 00007f6a18157169
0709 13:00:51.828412 (+  2563us) raft_consensus.cc:1685] finished
0709 13:00:51.828509 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:51.828623 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":322933,"prepare.run_cpu_time_us":2090,"prepare.run_wall_time_us":6053,"raft.queue_time_us":98225,"raft.run_cpu_time_us":261,"raft.run_wall_time_us":27759,"spinlock_wait_cycles":21853440,"thread_start_us":802231,"threads_started":3,"wal-append.queue_time_us":548825}
I20260709 13:00:51.836427  6159 leader_election.cc:290] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:51.865284  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:51.866046  1600 raft_consensus.cc:2468] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 12.
I20260709 13:00:51.849975  6007 raft_consensus.cc:493] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.861593  1570 leader_election.cc:304] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:51.864804  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:51.863360  6089 raft_consensus.cc:493] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:51.869925  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:51.870070  6089 raft_consensus.cc:515] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:51.873433  1570 leader_election.cc:304] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:51.875806  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:51.853761  5871 raft_consensus.cc:493] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:51.876659  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:51.878832  1679 raft_consensus.cc:2468] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 13.
I20260709 13:00:51.863706  6205 consensus_queue.cc:1048] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:00:51.880577  6159 raft_consensus.cc:493] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:51.881347  6176 leader_election.cc:290] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 14 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:51.875828  6213 raft_consensus.cc:2804] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:51.882362  6213 raft_consensus.cc:493] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:51.881273  6159 raft_consensus.cc:515] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:51.882781  6213 raft_consensus.cc:3060] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:51.884975  6159 leader_election.cc:290] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:51.886940  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:51.855743  6180 raft_consensus.cc:493] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:51.888113  6180 raft_consensus.cc:515] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:51.890192  6180 leader_election.cc:290] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:51.854470  6174 consensus_queue.cc:237] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:51.902115  6204 raft_consensus.cc:2749] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:51.881933  6089 leader_election.cc:290] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:51.907316  5972 raft_consensus.cc:493] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:51.908150  5972 raft_consensus.cc:515] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:51.912705  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:51.914361  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:51.916150  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:51.916893  1532 raft_consensus.cc:2393] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 11: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:00:51.917752  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:51.919888  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:51.920167  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:51.920814  1527 raft_consensus.cc:2468] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 16.
I20260709 13:00:51.921208  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:51.921723  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:51.922422  1531 raft_consensus.cc:2393] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 13: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:00:51.925207  6213 raft_consensus.cc:515] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:51.874696  6007 raft_consensus.cc:515] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:51.926539  5761 raft_consensus.cc:493] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.920751  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:51.929917  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:51.931151  6189 raft_consensus.cc:493] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:51.931741  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:51.941973  1530 raft_consensus.cc:2468] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 14.
I20260709 13:00:51.942097  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:51.931908  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:51.933272  1646 leader_election.cc:304] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:51.933996  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:51.935572  2220 raft_consensus.cc:1240] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 13. Current term is 14. Ops: []
I20260709 13:00:51.936067  2222 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2"
dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
mode: GRACEFUL
new_leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:47682
I20260709 13:00:51.943555  2222 raft_consensus.cc:606] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Received request to transfer leadership to TS e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:51.936190  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:51.942827  1524 raft_consensus.cc:2393] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 9: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
W20260709 13:00:51.944693  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 71351.7us
I20260709 13:00:51.945672  1570 leader_election.cc:304] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:51.946033  2222 raft_consensus.cc:614] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:51.937803  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:51.940970  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:51.943717  2223 raft_consensus.cc:1240] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:00:51.946928  6189 raft_consensus.cc:515] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:51.948999  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:51.951433  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:51.952661  2225 raft_consensus.cc:2368] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for earlier term 9. Current term is 10.
I20260709 13:00:51.952039  1681 raft_consensus.cc:2468] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 7.
I20260709 13:00:51.953954  2224 raft_consensus.cc:2468] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 14.
I20260709 13:00:51.957495  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:51.963476  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:51.963881  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:51.964885  1570 leader_election.cc:304] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:51.965534  1524 raft_consensus.cc:1275] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:00:51.941596  5923 raft_consensus.cc:2749] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:51.967906  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:51.968209  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:51.979198  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:51.979929  1681 raft_consensus.cc:2468] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 7.
I20260709 13:00:51.981846  1570 leader_election.cc:304] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:51.953611  6088 raft_consensus.cc:2749] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:00:51.983865  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 535950us
I20260709 13:00:51.953222  6208 raft_consensus.cc:493] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.985309  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:51.985625  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:51.990208  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:51.990868  1679 raft_consensus.cc:3060] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:51.987859  1607 raft_consensus.cc:2468] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 11.
I20260709 13:00:51.992475  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:51.993217  1681 raft_consensus.cc:2468] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 12.
I20260709 13:00:51.939988  5871 raft_consensus.cc:515] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:51.995968  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:52.000748  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:52.001931  1528 raft_consensus.cc:1275] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:00:51.970332  6002 raft_consensus.cc:2749] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:51.950726  5761 raft_consensus.cc:515] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:52.010322  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:52.012774  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:52.020193  2219 raft_consensus.cc:2468] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 9.
I20260709 13:00:52.016554  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:51.979336  6203 consensus_queue.cc:1048] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:00:51.988720  6192 consensus_queue.cc:1048] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:00:52.027571  1679 raft_consensus.cc:2468] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 12.
I20260709 13:00:52.053903  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 13:00:52.054307  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 63133.1us
I20260709 13:00:52.087599  2224 raft_consensus.cc:2468] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 9.
I20260709 13:00:52.046909  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:52.029055  2192 leader_election.cc:304] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:00:52.090306  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:52.216570  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:52.091774  2190 leader_election.cc:304] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:52.099897  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:51.996634  6131 raft_consensus.cc:2804] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:51.990479  6019 raft_consensus.cc:2804] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:52.125422  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:51.994359  6152 raft_consensus.cc:493] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
W20260709 13:00:52.004958  6167 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.009s	user 0.024s	sys 0.032s
I20260709 13:00:52.209585  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:52.241925  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:52.213407  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:00:52.218575  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 189602us
I20260709 13:00:51.999264  6208 raft_consensus.cc:515] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:52.066651  6193 raft_consensus.cc:493] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:00:52.240341  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:52.246165  2223 raft_consensus.cc:2468] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 10.
I20260709 13:00:52.246515  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 13:00:52.237391  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 145802us
I20260709 13:00:52.247849  2192 leader_election.cc:304] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:52.252063  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:52.219913  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:52.010815  6012 raft_consensus.cc:2804] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:52.222889  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:52.234854  1679 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496"
dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
mode: GRACEFUL
new_leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:33616
I20260709 13:00:52.012089  5972 leader_election.cc:290] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:52.252982  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:52.212749  6159 raft_consensus.cc:493] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.261438  1679 raft_consensus.cc:606] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Received request to transfer leadership to TS e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:52.273842  1679 raft_consensus.cc:614] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:52.212457  6178 raft_consensus.cc:493] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:52.256057  2192 leader_election.cc:304] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:00:52.264776  2221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50310 (request call id 919) took 1078 ms. Trace:
I20260709 13:00:52.230211  6131 raft_consensus.cc:493] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:52.253078  6167 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.278s	user 0.024s	sys 0.035s
I20260709 13:00:52.281598  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:52.277990  2221 rpcz_store.cc:276] 0709 13:00:51.171529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:51.171655 (+   126us) service_pool.cc:224] Handling call
0709 13:00:51.186165 (+ 14510us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:51.391257 (+205092us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:00:51.560132 (+168875us) log.cc:844] Serialized 14 byte log entry
0709 13:00:51.987666 (+427534us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:51.987715 (+    49us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:00:51.987753 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:52.249357 (+261604us) spinlock_profiling.cc:243] Waited 199 ms on lock 0x7b540045c754. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:00:52.249403 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:52.249515 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":302771,"prepare.queue_time_us":49585,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":26,"raft.queue_time_us":266748,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":14966,"spinlock_wait_cycles":458555136,"thread_start_us":314641,"threads_started":2,"wal-append.queue_time_us":169888}
I20260709 13:00:52.280432  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:52.250996  6129 raft_consensus.cc:2804] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:52.259440  5815 raft_consensus.cc:2749] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:52.236559  6019 raft_consensus.cc:493] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:00:52.284890  6159 raft_consensus.cc:515] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:52.291556  5849 raft_consensus.cc:993] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b: : Instructing follower e46412b3b0b44f01ad5c33d4cfe3d6b1 to start an election
I20260709 13:00:52.292097  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:52.293552  6007 leader_election.cc:290] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:52.294312  5871 leader_election.cc:290] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:52.294497  2220 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24"
dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
mode: GRACEFUL
new_leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:47682
I20260709 13:00:52.295066  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:52.295106  5761 leader_election.cc:290] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:52.299176  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:52.329703  2220 raft_consensus.cc:606] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 8 LEADER]: Received request to transfer leadership to TS e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:52.299234  1604 raft_consensus.cc:1240] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 12 LEADER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:52.301640  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:52.258419  6152 raft_consensus.cc:515] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:52.269609  6012 raft_consensus.cc:493] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:52.326308  6179 raft_consensus.cc:493] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.366575  6179 raft_consensus.cc:515] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:52.363481  6173 raft_consensus.cc:493] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:00:52.367900  6173 raft_consensus.cc:515] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:52.368939  6179 leader_election.cc:290] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:52.347764  5815 raft_consensus.cc:1081] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 7 LEADER]: Signalling peer e46412b3b0b44f01ad5c33d4cfe3d6b1 to start an election
I20260709 13:00:52.349925  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:52.351076  6091 raft_consensus.cc:493] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:52.350327  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:52.351859  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:52.352578  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:52.370604  1679 raft_consensus.cc:2468] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 8.
I20260709 13:00:52.300135  6131 raft_consensus.cc:3060] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:52.265175  6193 raft_consensus.cc:515] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:52.356536  2227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 913) took 1096 ms. Trace:
W20260709 13:00:52.308624  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 57321.4us
I20260709 13:00:52.358623  6019 raft_consensus.cc:3060] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:52.359051  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:52.359685  6189 leader_election.cc:290] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:52.360250  1644 leader_election.cc:304] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:52.328181  6208 leader_election.cc:290] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:52.391150  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:52.366918  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:52.335920  6128 raft_consensus.cc:493] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.401749  1673 raft_consensus.cc:1275] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:00:52.391988  2221 raft_consensus.cc:2468] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 9.
I20260709 13:00:52.372817  1570 leader_election.cc:304] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
W20260709 13:00:52.294649  6222 log.cc:927] Time spent T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.316s	user 0.000s	sys 0.002s
I20260709 13:00:52.377688  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:00:52.358282  6220 log.cc:927] Time spent T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.500s	user 0.003s	sys 0.008s
I20260709 13:00:52.377571  1680 raft_consensus.cc:2393] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 12: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:00:52.381383  1679 raft_consensus.cc:1240] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:52.369515  5810 raft_consensus.cc:2804] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:52.382977  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:52.304383  6129 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:52.385715  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:00:52.361248  6184 consensus_meta.cc:287] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.518s	user 0.007s	sys 0.001s
I20260709 13:00:52.307839  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:00:52.338147  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 56551us
I20260709 13:00:52.366642  6012 raft_consensus.cc:3060] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:52.380154  2227 rpcz_store.cc:276] 0709 13:00:51.260073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:51.269203 (+  9130us) service_pool.cc:224] Handling call
0709 13:00:51.276617 (+  7414us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:51.277061 (+   444us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:51.277090 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:51.785967 (+508877us) spinlock_profiling.cc:243] Waited 2.83 ms on lock 0x7b2c00047ae8. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a16eaca11 00007f6a16ebc372 00007f6a185eea01 00007f6a185b343a 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2
0709 13:00:51.786359 (+   392us) log.cc:844] Serialized 26 byte log entry
0709 13:00:52.066939 (+280580us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:52.066979 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:52.067044 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:52.356171 (+289127us) raft_consensus.cc:1685] finished
0709 13:00:52.356192 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:52.356466 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":126,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":3341,"spinlock_wait_cycles":6509440,"thread_start_us":280206,"threads_started":1,"wal-append.queue_time_us":463224}
I20260709 13:00:52.415577  2220 raft_consensus.cc:1275] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
W20260709 13:00:52.415189  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:52.301285  6178 raft_consensus.cc:515] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:52.369385  6162 consensus_queue.cc:1059] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:00:52.379495  6089 raft_consensus.cc:493] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:52.438727  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:52.439150  1644 leader_election.cc:304] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:52.394014  6082 raft_consensus.cc:493] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:52.456735  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:52.440721  1603 raft_consensus.cc:2468] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 8.
I20260709 13:00:52.459808  2190 leader_election.cc:304] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:00:52.456499  6224 log.cc:927] Time spent T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 13:00:52.463389  2190 leader_election.cc:304] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:52.460626  2192 leader_election.cc:304] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:00:52.440254  6125 raft_consensus.cc:2804] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:00:52.411341  6168 raft_consensus.cc:2749] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:52.476150  1676 raft_consensus.cc:1275] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:00:52.476608  6162 consensus_queue.cc:1243] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer 39a92f5a4352465d8af3af5908fe8642 log is divergent from this leader: its last log entry 12.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:00:52.477718  5761 raft_consensus.cc:2749] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:52.473289  1644 leader_election.cc:304] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:52.478466  5761 raft_consensus.cc:3055] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:52.478808  5976 raft_consensus.cc:2749] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:52.479247  6190 raft_consensus.cc:2804] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:52.478845  5761 raft_consensus.cc:740] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:52.479915  6190 raft_consensus.cc:493] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:52.480276  6190 raft_consensus.cc:3060] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:52.483369  6178 leader_election.cc:290] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:52.486852  6178 raft_consensus.cc:2749] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:52.480343  5761 consensus_queue.cc:260] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:52.488641  5761 raft_consensus.cc:3060] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:52.489135  5976 raft_consensus.cc:493] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.489638  5976 raft_consensus.cc:515] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:52.492743  5976 leader_election.cc:290] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:52.488626  6190 raft_consensus.cc:515] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:52.496130  6193 leader_election.cc:290] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:52.497725  6152 leader_election.cc:290] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:52.497933  1646 leader_election.cc:304] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:52.499800  6190 leader_election.cc:290] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 10 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:52.499600  5976 raft_consensus.cc:2749] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:52.505519  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:52.506340  2227 raft_consensus.cc:2468] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 14.
I20260709 13:00:52.508365  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:52.508984  2222 raft_consensus.cc:2468] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 11.
I20260709 13:00:52.510288  6185 raft_consensus.cc:993] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b: : Instructing follower e46412b3b0b44f01ad5c33d4cfe3d6b1 to start an election
I20260709 13:00:52.513890  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:52.454991  6129 raft_consensus.cc:3060] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:52.514999  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:52.515654  6159 leader_election.cc:290] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:52.530340  6159 consensus_queue.cc:1059] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:00:52.516912  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:52.514258  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:52.531255  5923 consensus_queue.cc:1048] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:52.533215  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:52.533226  1571 leader_election.cc:304] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:52.418249  6167 consensus_queue.cc:1048] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.110s
I20260709 13:00:52.415433  6173 leader_election.cc:290] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:52.519232  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:52.465266  6176 raft_consensus.cc:2804] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:52.444741  5871 consensus_queue.cc:1048] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.083s
I20260709 13:00:52.525930  6125 raft_consensus.cc:493] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:52.515556  1646 leader_election.cc:304] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:52.383514  6091 raft_consensus.cc:515] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:52.543069  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:52.560144  1605 raft_consensus.cc:3060] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:00:52.538445  1681 raft_consensus.cc:2468] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 13.
I20260709 13:00:52.560323  1673 raft_consensus.cc:1275] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 13:00:52.561405  1673 pending_rounds.cc:85] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90: Aborting all ops after (but not including) 7
I20260709 13:00:52.561671  1673 pending_rounds.cc:107] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:00:52.538882  5699 raft_consensus.cc:1081] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 8 LEADER]: Signalling peer e46412b3b0b44f01ad5c33d4cfe3d6b1 to start an election
I20260709 13:00:52.462626  6082 raft_consensus.cc:515] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:52.545516  6002 raft_consensus.cc:2804] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:52.408704  6128 raft_consensus.cc:515] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:52.561904  1673 raft_consensus.cc:2889] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:52.547050  1672 raft_consensus.cc:1275] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 13:00:52.563373  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 48081.7us
I20260709 13:00:52.458065  6089 raft_consensus.cc:515] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:52.560732  6125 raft_consensus.cc:3060] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:52.575757  6012 raft_consensus.cc:515] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:52.576872  6089 leader_election.cc:290] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:52.577222  2222 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583"
dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
mode: GRACEFUL
new_leader_uuid: "39a92f5a4352465d8af3af5908fe8642"
 from {username='slave'} at 127.0.0.1:47682
I20260709 13:00:52.577436  6089 raft_consensus.cc:3055] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:00:52.577785  6089 raft_consensus.cc:740] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:00:52.578269  2221 raft_consensus.cc:1240] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:52.536839  6208 raft_consensus.cc:493] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:52.578922  6208 raft_consensus.cc:515] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:52.580164  6012 leader_election.cc:290] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:52.580883  6082 leader_election.cc:290] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:52.564882  6192 raft_consensus.cc:2804] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:00:52.570225  2226 raft_consensus.cc:1275] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 13:00:52.542054  6187 raft_consensus.cc:2749] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:52.540645  1571 leader_election.cc:304] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:52.532416  6007 consensus_queue.cc:1059] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.028s
I20260709 13:00:52.577800  2222 raft_consensus.cc:606] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Received request to transfer leadership to TS 39a92f5a4352465d8af3af5908fe8642
I20260709 13:00:52.583230  2222 raft_consensus.cc:614] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:52.583881  1571 leader_election.cc:304] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:52.584084  6192 raft_consensus.cc:697] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 14 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:52.582615  2226 pending_rounds.cc:85] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b: Aborting all ops after (but not including) 9
I20260709 13:00:52.585660  2226 pending_rounds.cc:107] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:00:52.585179  6192 consensus_queue.cc:237] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:52.585888  2226 raft_consensus.cc:2889] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:52.573715  6002 raft_consensus.cc:493] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:52.569197  2191 leader_election.cc:304] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:00:52.587704  6002 raft_consensus.cc:3060] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:52.588234   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:00:52.588840  5849 raft_consensus.cc:2804] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:52.589246  5849 raft_consensus.cc:493] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:52.589612  5849 raft_consensus.cc:3060] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:52.580968  6208 leader_election.cc:290] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:52.591208  1528 raft_consensus.cc:1275] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:00:52.592136  6128 leader_election.cc:290] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:52.585279  6007 raft_consensus.cc:3055] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:00:52.578567  6089 consensus_queue.cc:260] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:52.592826  6007 raft_consensus.cc:740] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:52.593713  6007 consensus_queue.cc:260] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:52.587203  6173 raft_consensus.cc:2749] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:52.595007  6007 raft_consensus.cc:3060] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:52.555016  6174 consensus_queue.cc:1059] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:00:52.597558  6174 raft_consensus.cc:3055] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:52.597911  6174 raft_consensus.cc:740] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:52.598749  6174 consensus_queue.cc:260] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:52.600028  6174 raft_consensus.cc:3060] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:52.588460  2191 leader_election.cc:304] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:52.557722  6188 raft_consensus.cc:493] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:52.606995  2191 leader_election.cc:304] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:52.607393  1646 leader_election.cc:400] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 election: Vote denied by peer b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373) with higher term. Message: Invalid argument: T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for earlier term 9. Current term is 10.
I20260709 13:00:52.607687  1646 leader_election.cc:403] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:00:52.608079  1571 leader_election.cc:304] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:52.609777  1646 leader_election.cc:304] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:52.611119  1646 leader_election.cc:304] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:52.546093  6205 consensus_queue.cc:1048] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:00:52.615804  2191 leader_election.cc:304] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:00:52.619377  1572 leader_election.cc:304] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:00:52.614069  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 227951us
I20260709 13:00:52.587095  5923 raft_consensus.cc:3060] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:52.629841  1497 leader_election.cc:304] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:52.631475  1646 leader_election.cc:304] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:00:52.623631  5520 raft_consensus.cc:2749] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:52.632682  1646 leader_election.cc:304] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:00:52.637076  1497 leader_election.cc:304] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:52.638077  1572 leader_election.cc:304] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:52.639690  2226 raft_consensus.cc:1275] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:00:52.606894  5699 raft_consensus.cc:2749] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:00:52.643002  1646 leader_election.cc:304] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:00:52.615051  5909 raft_consensus.cc:2749] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373) with higher term. Message: Invalid argument: T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for earlier term 9. Current term is 10.
I20260709 13:00:52.647686  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:52.642071  6208 raft_consensus.cc:2804] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:52.641387  1572 leader_election.cc:304] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:52.645695  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:52.621510  6179 raft_consensus.cc:2749] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:52.647305  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:52.650832  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:52.630851  6100 raft_consensus.cc:2749] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:52.654970  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:52.655212  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:52.633671  5871 raft_consensus.cc:2749] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:52.642239  6152 raft_consensus.cc:2804] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:52.643091  6082 raft_consensus.cc:2804] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:52.639144  5761 raft_consensus.cc:2804] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:52.647229  5976 raft_consensus.cc:2804] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:52.672408  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:52.648029  6223 raft_consensus.cc:2804] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:52.624244  6188 raft_consensus.cc:515] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:52.663105  6080 raft_consensus.cc:2804] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:52.650378  6208 raft_consensus.cc:493] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:00:52.656522  5877 raft_consensus.cc:2749] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:00:52.633351  6012 consensus_queue.cc:1048] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 13:00:52.688784  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:52.691520  6235 consensus_queue.cc:1048] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:52.692175  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:52.686429  6223 raft_consensus.cc:493] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:52.735396  6223 raft_consensus.cc:3060] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:52.698807  5761 raft_consensus.cc:697] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 12 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:52.701188  5849 raft_consensus.cc:515] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:52.708500  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:52.677515  5976 raft_consensus.cc:493] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:52.742115  1606 raft_consensus.cc:1240] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 13. Current term is 14. Ops: []
I20260709 13:00:52.708704  2191 leader_election.cc:304] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:52.667393  1497 leader_election.cc:304] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:52.664160  6152 raft_consensus.cc:493] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:52.668376  6082 raft_consensus.cc:493] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:52.725023  1571 leader_election.cc:304] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:00:52.769449  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 44537.8us
I20260709 13:00:52.720780  6080 raft_consensus.cc:493] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:52.722976  6208 raft_consensus.cc:3060] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:00:52.767855  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 100531us
I20260709 13:00:52.778065  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:52.781837  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:52.785846  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:52.789178  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:52.794466  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:52.798293  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:52.799985  1524 raft_consensus.cc:2468] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 12.
I20260709 13:00:52.818640  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:52.827389  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:52.745107  5976 raft_consensus.cc:3060] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:52.745811  6189 raft_consensus.cc:2749] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:52.829886  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:52.769362  6152 raft_consensus.cc:3060] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:52.836768  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:52.773964  6082 raft_consensus.cc:3060] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:52.794968  5877 raft_consensus.cc:2804] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:52.836195  1529 raft_consensus.cc:2468] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 14.
I20260709 13:00:52.841799  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:52.768828  6091 leader_election.cc:290] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:52.795259  6080 raft_consensus.cc:3060] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:52.834771  2192 leader_election.cc:304] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:52.833917  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:52.794154  5553 raft_consensus.cc:2749] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:52.740813  6002 raft_consensus.cc:515] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:52.863837  1525 raft_consensus.cc:2468] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 12.
W20260709 13:00:52.878751  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 225097us
I20260709 13:00:52.880044  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:00:52.882108  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 47459.1us
I20260709 13:00:52.883661  6171 raft_consensus.cc:2749] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:52.794732  6179 consensus_queue.cc:1048] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.066s
W20260709 13:00:52.887089  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 60804.7us
I20260709 13:00:52.862891  5877 raft_consensus.cc:493] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:52.882066  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:00:52.980000  1495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:52.978325  5877 raft_consensus.cc:3060] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:52.990012  1496 leader_election.cc:304] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
W20260709 13:00:52.991425  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:53.005985  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 123074us
I20260709 13:00:53.026726  1605 raft_consensus.cc:2468] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 10.
I20260709 13:00:52.997952  5520 raft_consensus.cc:493] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.991910  6246 raft_consensus.cc:493] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:53.013044  6237 raft_consensus.cc:2804] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:00:53.125870  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 241656us
I20260709 13:00:52.899667  5761 consensus_queue.cc:237] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:53.126770  1572 leader_election.cc:304] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:53.041993  6128 raft_consensus.cc:493] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:53.118245  5520 raft_consensus.cc:515] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:53.122206  6125 consensus_meta.cc:287] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.546s	user 0.008s	sys 0.001s
I20260709 13:00:53.127558  6237 raft_consensus.cc:493] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:53.129295  6247 raft_consensus.cc:2749] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:00:53.145015  6229 log.cc:927] Time spent T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.460s	user 0.001s	sys 0.001s
W20260709 13:00:53.171382  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 179085us
I20260709 13:00:53.175503  1497 leader_election.cc:304] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:53.176698  1497 leader_election.cc:304] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:53.149677  6188 leader_election.cc:290] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:53.165808  6237 raft_consensus.cc:3060] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:53.171236  5849 leader_election.cc:290] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 13 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:00:53.207195  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:53.119231  6246 raft_consensus.cc:515] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:53.195109  1706 heartbeater.cc:646] Failed to heartbeat to 127.0.107.254:40423 (2 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.0.107.254:40423 timed out after 15.000s (SENT)
I20260709 13:00:53.222527  1644 leader_election.cc:304] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:53.156097  6128 raft_consensus.cc:515] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:53.166006  6125 raft_consensus.cc:515] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:00:53.235224  6239 log.cc:927] Time spent T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.242s	user 0.001s	sys 0.000s
W20260709 13:00:53.235421  6254 log.cc:927] Time spent T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
W20260709 13:00:53.236826  6241 log.cc:927] Time spent T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.222s	user 0.000s	sys 0.000s
W20260709 13:00:53.238428  6238 log.cc:927] Time spent T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:00:53.200183  6270 raft_consensus.cc:2749] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:53.255596  6270 consensus_queue.cc:1048] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:00:53.217701  6204 raft_consensus.cc:2764] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:00:53.257324  6204 consensus_queue.cc:1048] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:00:53.221136  6236 log.cc:927] Time spent T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.341s	user 0.000s	sys 0.001s
I20260709 13:00:53.267799  6205 raft_consensus.cc:493] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:53.268548  6205 raft_consensus.cc:515] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:53.272182  6248 log.cc:927] Time spent T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.263s	user 0.002s	sys 0.000s
W20260709 13:00:53.275902  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 53455.9us
W20260709 13:00:53.281615  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 388018us
I20260709 13:00:53.283535  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49178 (request call id 2064) took 1280 ms. Trace:
I20260709 13:00:53.197480  6244 raft_consensus.cc:493] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:53.283990  1677 rpcz_store.cc:276] 0709 13:00:52.003425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:52.003560 (+   135us) service_pool.cc:224] Handling call
0709 13:00:52.003919 (+   359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:52.048084 (+ 44165us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:52.048120 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:52.071983 (+ 23863us) log.cc:844] Serialized 26 byte log entry
0709 13:00:52.539303 (+467320us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:52.539353 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:52.540059 (+   706us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:53.283301 (+743242us) raft_consensus.cc:1685] finished
0709 13:00:53.283325 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:53.283470 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5625,"raft.queue_time_us":5602,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":35525,"spinlock_wait_cycles":7424,"thread_start_us":303525,"threads_started":1,"wal-append.queue_time_us":515025}
W20260709 13:00:53.296346  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 289563us
I20260709 13:00:53.297410  2192 leader_election.cc:304] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
W20260709 13:00:53.305435  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 315660us
I20260709 13:00:53.307269   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:53.214278  6188 raft_consensus.cc:2749] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:53.308683  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
W20260709 13:00:53.279544  5923 consensus_meta.cc:287] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.639s	user 0.010s	sys 0.000s
I20260709 13:00:53.275126  6002 leader_election.cc:290] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:00:53.304322  1498 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.003s	sys 0.003s
I20260709 13:00:53.280519  5972 raft_consensus.cc:2749] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:53.307399  6244 raft_consensus.cc:515] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:53.318099  5982 raft_consensus.cc:2804] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:00:53.372431  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 190456us
W20260709 13:00:53.319725  1498 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.522s	user 0.003s	sys 0.003s
I20260709 13:00:53.384368  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:53.385152  1570 leader_election.cc:304] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:00:53.385221  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 77633.6us
I20260709 13:00:53.319087  5923 raft_consensus.cc:2749] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:53.410420  1526 raft_consensus.cc:1240] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:53.414289  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:53.417186  1677 raft_consensus.cc:3060] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:53.349587  6007 consensus_meta.cc:287] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.754s	user 0.008s	sys 0.004s
W20260709 13:00:53.380798  6258 log.cc:927] Time spent T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.190s	user 0.001s	sys 0.000s
W20260709 13:00:53.371618  6129 consensus_meta.cc:287] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b: Time spent flushing consensus metadata: real 0.832s	user 0.011s	sys 0.000s
I20260709 13:00:53.437288  1603 raft_consensus.cc:1275] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:00:53.334497  6235 consensus_queue.cc:1048] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.093s
I20260709 13:00:53.387104  5982 raft_consensus.cc:697] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 10 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:53.419800  1496 leader_election.cc:304] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:53.386920  6246 leader_election.cc:290] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:53.478223  1677 raft_consensus.cc:2468] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 9.
I20260709 13:00:53.431936  5972 consensus_queue.cc:1048] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:00:53.479748  5934 raft_consensus.cc:493] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.483928  5934 raft_consensus.cc:515] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:53.441679  5923 raft_consensus.cc:493] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:53.491178  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:53.492955  1497 leader_election.cc:304] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
W20260709 13:00:53.493165  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 108066us
I20260709 13:00:53.434110  6002 raft_consensus.cc:493] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:53.495241  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:53.495394  1497 leader_election.cc:304] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:53.499735  1497 leader_election.cc:304] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
W20260709 13:00:53.500087  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 336163us
I20260709 13:00:53.489274  5520 leader_election.cc:290] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:53.438803  6129 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:53.483671  6218 raft_consensus.cc:493] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:00:53.486074  6251 raft_consensus.cc:493] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
W20260709 13:00:53.500766  6131 consensus_meta.cc:287] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b: Time spent flushing consensus metadata: real 1.102s	user 0.007s	sys 0.006s
I20260709 13:00:53.493996  6247 raft_consensus.cc:493] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:53.510690  5934 leader_election.cc:290] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:53.497043  6205 leader_election.cc:290] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:53.542976  6154 raft_consensus.cc:493] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:53.509786  6002 raft_consensus.cc:515] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:53.557624  6125 leader_election.cc:290] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:53.555531  6261 raft_consensus.cc:2749] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:53.514732  6128 leader_election.cc:290] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:00:53.570104  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 61074us
W20260709 13:00:53.571538  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 151836us
I20260709 13:00:53.547922  6218 raft_consensus.cc:515] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:53.500087  5923 raft_consensus.cc:515] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:53.549459  6131 raft_consensus.cc:515] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:53.579093  1644 leader_election.cc:304] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:53.580490  1496 leader_election.cc:304] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:53.579370  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:53.561848  6235 raft_consensus.cc:2749] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:00:53.585867  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:53.562933  6125 raft_consensus.cc:493] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
W20260709 13:00:53.575749  6223 consensus_meta.cc:287] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.840s	user 0.008s	sys 0.003s
I20260709 13:00:53.545814  5982 consensus_queue.cc:237] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:53.579648  6174 consensus_meta.cc:287] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.979s	user 0.010s	sys 0.003s
I20260709 13:00:53.592036  2222 raft_consensus.cc:1275] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:00:53.551890  6247 raft_consensus.cc:515] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:53.591409  5934 raft_consensus.cc:2749] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:53.594964  1496 leader_election.cc:304] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:53.550339  6251 raft_consensus.cc:515] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:53.564880  6154 raft_consensus.cc:515] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:53.587904  6244 leader_election.cc:290] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:00:53.596113  6257 log.cc:927] Time spent T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.187s	user 0.001s	sys 0.000s
I20260709 13:00:53.614967  6131 leader_election.cc:290] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:00:53.616366  6152 consensus_meta.cc:287] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.754s	user 0.007s	sys 0.003s
I20260709 13:00:53.616933  6152 raft_consensus.cc:515] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:53.617981  1674 raft_consensus.cc:1240] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:53.618498  6247 leader_election.cc:290] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:53.619807  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:53.591885  6277 raft_consensus.cc:493] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:53.596156  6235 raft_consensus.cc:2749] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:53.589793  6268 raft_consensus.cc:493] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
W20260709 13:00:53.604725  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 102778us
I20260709 13:00:53.594360  6125 raft_consensus.cc:515] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:53.596287  6242 log.cc:927] Time spent T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.244s	user 0.000s	sys 0.001s
I20260709 13:00:53.613857  6271 raft_consensus.cc:2749] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:53.594931  6281 raft_consensus.cc:2749] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:53.650975  5972 raft_consensus.cc:493] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.651669  5972 raft_consensus.cc:515] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:53.653939  5972 leader_election.cc:290] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:53.655100  6002 leader_election.cc:290] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:53.657074  6251 leader_election.cc:290] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:53.629606  6213 leader_election.cc:290] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:53.599648  6223 raft_consensus.cc:515] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:53.610276  5877 consensus_meta.cc:287] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.610s	user 0.006s	sys 0.001s
I20260709 13:00:53.631825  5761 raft_consensus.cc:493] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:00:53.634428  6278 raft_consensus.cc:2749] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:53.636500  6089 raft_consensus.cc:3060] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:53.641196  6235 raft_consensus.cc:2749] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:00:53.642064  6208 consensus_meta.cc:287] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.811s	user 0.004s	sys 0.006s
I20260709 13:00:53.595463  6267 consensus_queue.cc:1059] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.066s
W20260709 13:00:53.738061  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 75771.7us
I20260709 13:00:53.747561  1681 raft_consensus.cc:1240] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 13:00:53.749068  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:53.749714  2227 raft_consensus.cc:2468] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 12.
W20260709 13:00:53.768118  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 173262us
I20260709 13:00:53.771510  1496 leader_election.cc:304] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:53.773576  1496 leader_election.cc:304] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:00:53.775511  1496 leader_election.cc:304] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:53.777519  1496 leader_election.cc:304] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:53.798105  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:53.783365  1602 raft_consensus.cc:1240] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:53.798367  1496 leader_election.cc:304] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:53.776696  6235 raft_consensus.cc:2749] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:53.767082  6261 raft_consensus.cc:493] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:53.769104  6131 raft_consensus.cc:493] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:53.737571  6268 raft_consensus.cc:515] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:53.638584  6277 raft_consensus.cc:515] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:53.808053  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:53.739056  5877 raft_consensus.cc:515] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:53.741192  5761 raft_consensus.cc:515] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:53.746299  6251 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
W20260709 13:00:53.799626  6080 consensus_meta.cc:287] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent flushing consensus metadata: real 0.918s	user 0.009s	sys 0.001s
I20260709 13:00:53.746990  6213 consensus_queue.cc:1048] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.059s
I20260709 13:00:53.807257  5810 raft_consensus.cc:493] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:00:53.814050  6278 raft_consensus.cc:2804] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:53.831720  1674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49170 (request call id 2294) took 1187 ms. Trace:
I20260709 13:00:53.837281  2222 raft_consensus.cc:1240] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:53.852135  1674 rpcz_store.cc:276] 0709 13:00:52.645087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:52.646746 (+  1659us) service_pool.cc:224] Handling call
0709 13:00:52.654805 (+  8059us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:53.618351 (+963546us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:53.831443 (+213092us) spinlock_profiling.cc:243] Waited 963 ms on lock 0x7b54003e6a54. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:00:53.831632 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2214937216}
I20260709 13:00:53.774922  5923 leader_election.cc:290] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:53.778434  6152 leader_election.cc:290] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:53.748693  6208 raft_consensus.cc:515] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:53.814716  6261 raft_consensus.cc:515] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:53.818431  6131 raft_consensus.cc:515] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:53.827901  6275 raft_consensus.cc:493] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:53.828240  5810 raft_consensus.cc:3060] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:53.884699  1606 raft_consensus.cc:1240] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 16. Current term is 17. Ops: []
I20260709 13:00:53.828145  6259 raft_consensus.cc:493] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:53.834476  6235 raft_consensus.cc:2749] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:53.893157  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:53.896140  1606 raft_consensus.cc:2468] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 11.
I20260709 13:00:53.825568  6080 raft_consensus.cc:515] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:00:53.826990  6019 consensus_meta.cc:287] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 1.386s	user 0.011s	sys 0.001s
I20260709 13:00:53.841686  6278 raft_consensus.cc:493] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:53.868852  6271 raft_consensus.cc:2749] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:53.878841  6129 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 14 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:53.824875  6284 raft_consensus.cc:2749] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:53.863677  6218 leader_election.cc:290] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:53.879037  6276 raft_consensus.cc:493] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:00:53.903085  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
W20260709 13:00:53.894670  6082 consensus_meta.cc:287] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent flushing consensus metadata: real 1.027s	user 0.006s	sys 0.006s
W20260709 13:00:53.904808  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 101483us
I20260709 13:00:53.932370  1496 leader_election.cc:304] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
W20260709 13:00:53.903791  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 90333.4us
I20260709 13:00:53.835347  6251 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:53.915277  1570 leader_election.cc:304] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:53.933900  6282 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:53.934960  6205 raft_consensus.cc:2804] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:53.935385  6205 raft_consensus.cc:493] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:53.935773  6205 raft_consensus.cc:3060] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:53.936278  6277 leader_election.cc:290] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:53.937402  6268 leader_election.cc:290] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:53.938607  5877 leader_election.cc:290] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:53.893018  6275 raft_consensus.cc:515] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:53.941274  6275 leader_election.cc:290] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:53.943012  6080 leader_election.cc:290] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:53.943815  1525 raft_consensus.cc:1240] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:53.898854  6259 raft_consensus.cc:515] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:53.946439  2227 raft_consensus.cc:2468] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 13.
I20260709 13:00:53.947671  6259 leader_election.cc:290] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:53.947844  6205 raft_consensus.cc:515] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:53.950057  1570 leader_election.cc:304] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:53.950724  6251 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:00:53.951037  6243 log.cc:927] Time spent T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 1.051s	user 0.004s	sys 0.000s
I20260709 13:00:53.951332  1571 leader_election.cc:304] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:53.951608  2225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 920) took 1879 ms. Trace:
I20260709 13:00:53.951959  2225 rpcz_store.cc:276] 0709 13:00:52.072494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:52.072733 (+   239us) service_pool.cc:224] Handling call
0709 13:00:52.073039 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:52.409534 (+336495us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:52.409564 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:52.409606 (+    42us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:00:52.409636 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:53.951372 (+1541736us) spinlock_profiling.cc:243] Waited 336 ms on lock 0x7b54005b3bd4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:00:53.951420 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:53.951551 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":773201280}
I20260709 13:00:53.952576  6275 raft_consensus.cc:2749] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:53.953801  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:00:53.953992  1495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:53.933349  5976 consensus_meta.cc:287] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 1.077s	user 0.010s	sys 0.001s
I20260709 13:00:53.955021  5976 raft_consensus.cc:515] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:53.956280  6205 leader_election.cc:290] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:53.956687  1601 raft_consensus.cc:1240] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:53.957022  5976 leader_election.cc:290] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:53.957723  1672 raft_consensus.cc:1240] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:53.958041  6286 consensus_queue.cc:1048] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.069s
I20260709 13:00:53.958586  5923 raft_consensus.cc:2804] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:53.959136  5923 raft_consensus.cc:697] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 9 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:53.960021  5923 consensus_queue.cc:237] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:53.957329  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36200 (request call id 2487) took 1545 ms. Trace:
I20260709 13:00:53.934530  6282 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:53.963665  1601 rpcz_store.cc:276] 0709 13:00:52.411976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:52.458585 (+ 46609us) service_pool.cc:224] Handling call
0709 13:00:53.956329 (+1497744us) spinlock_profiling.cc:243] Waited 4.48 ms on lock 0x7b5800017198. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a1548eb71 00007f6a1548ea22 00007f6a1e3a7c09 00007f6a1d501ee0 00007f6a1d5cb0ab 00007f6a1d5cb131 00007f6a1d58cfc0 00007f6a1d577929 00007f6a1d5773d2 00007f6a16aeebd4
0709 13:00:53.956511 (+   182us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:53.957092 (+   581us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:53.957266 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10303872}
I20260709 13:00:53.968307  1601 raft_consensus.cc:1240] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:00:53.901891  6278 raft_consensus.cc:3060] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:53.910382  6237 consensus_meta.cc:287] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent flushing consensus metadata: real 0.680s	user 0.009s	sys 0.001s
I20260709 13:00:53.972445  1496 leader_election.cc:304] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:53.895038  6180 raft_consensus.cc:493] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:53.975625  1570 leader_election.cc:304] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:53.987879  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:53.971035  6276 raft_consensus.cc:515] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:53.996294  6276 leader_election.cc:290] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:53.974287  6089 raft_consensus.cc:2749] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:54.001430  6287 raft_consensus.cc:493] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:54.002112  6287 raft_consensus.cc:515] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:54.004484  6287 leader_election.cc:290] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:54.005681  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:53.968863  6223 leader_election.cc:290] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:53.904119  6019 raft_consensus.cc:515] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:54.020489  1526 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "770925e70faa4a16a275abd5282f5284"
dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:49310
I20260709 13:00:54.021188  1526 raft_consensus.cc:493] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:54.021610  1526 raft_consensus.cc:3060] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:53.974570  6125 leader_election.cc:290] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:54.022233  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:53.977735  6270 raft_consensus.cc:493] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:54.023679  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
W20260709 13:00:54.024168  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 48646.9us
I20260709 13:00:54.028962  1570 leader_election.cc:304] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:54.025784  1523 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24"
dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:49310
I20260709 13:00:54.029871  1523 raft_consensus.cc:493] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:54.030252  1523 raft_consensus.cc:3060] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:53.965127  6082 raft_consensus.cc:515] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:54.034636  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:54.022318  6089 raft_consensus.cc:2749] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:54.022987  6223 raft_consensus.cc:493] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.022769  6292 raft_consensus.cc:493] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:54.032949  6276 raft_consensus.cc:2804] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:54.051450  1530 raft_consensus.cc:2393] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 10: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:00:53.991060  6180 raft_consensus.cc:515] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:54.032027  5976 raft_consensus.cc:493] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:00:54.032855  6267 raft_consensus.cc:493] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:53.989223  6237 raft_consensus.cc:515] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:54.047286  5827 raft_consensus.cc:493] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:54.049230  5877 raft_consensus.cc:2804] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:54.034982  6270 raft_consensus.cc:515] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:54.055292  6276 raft_consensus.cc:493] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:54.056296  1526 raft_consensus.cc:515] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:54.048126  6208 leader_election.cc:290] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:54.051851  6223 raft_consensus.cc:515] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:54.075583  6276 raft_consensus.cc:3060] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:54.070089  5761 leader_election.cc:290] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:54.070180  5877 raft_consensus.cc:493] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:54.082842  6180 leader_election.cc:290] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:54.084312  6282 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:54.126201  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36200 (request call id 2488) took 1713 ms. Trace:
I20260709 13:00:54.087908  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:54.092656  6270 leader_election.cc:290] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:54.092832  6237 leader_election.cc:290] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:54.073813  5827 raft_consensus.cc:515] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:54.160097  1607 raft_consensus.cc:1240] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 9 LEADER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:00:54.105387  6278 raft_consensus.cc:515] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:54.058719  6292 raft_consensus.cc:515] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:54.108819  1523 raft_consensus.cc:515] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:54.111441  1531 raft_consensus.cc:1240] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:54.115192  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:54.130643  2222 raft_consensus.cc:2393] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 14: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:00:54.063405  5976 raft_consensus.cc:515] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:54.132479  1603 rpcz_store.cc:276] 0709 13:00:52.413179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:52.460181 (+ 47002us) service_pool.cc:224] Handling call
0709 13:00:52.819578 (+359397us) spinlock_profiling.cc:243] Waited 3.61 ms on lock 0x7b5800017198. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a1548eb71 00007f6a1548ea22 00007f6a1e3a7c09 00007f6a1d501ee0 00007f6a1d5cb0ab 00007f6a1d5cb131 00007f6a1d58cfc0 00007f6a1d577929 00007f6a1d5773d2 00007f6a16aeebd4
0709 13:00:52.819782 (+   204us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:53.437777 (+617995us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:54.125930 (+688153us) spinlock_profiling.cc:243] Waited 616 ms on lock 0x7b540039e254. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:00:54.126137 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1424367104}
I20260709 13:00:54.133998  1526 leader_election.cc:290] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:54.136147  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: true dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
W20260709 13:00:54.160892  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 125260us
W20260709 13:00:54.159229  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 98908us
I20260709 13:00:54.132000  6193 raft_consensus.cc:493] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:00:54.163820  1532 raft_consensus.cc:1240] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:54.164072  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:54.167300  2219 raft_consensus.cc:3055] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:54.168102  2219 raft_consensus.cc:740] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:54.168186  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:54.167393  6193 raft_consensus.cc:515] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:54.168972  1527 raft_consensus.cc:3060] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:54.170701  6193 leader_election.cc:290] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:54.168967  2219 consensus_queue.cc:260] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:54.175752  2219 raft_consensus.cc:3060] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:54.179374  6284 consensus_queue.cc:1059] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:00:54.180433  6284 raft_consensus.cc:3055] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:54.180832  6284 raft_consensus.cc:740] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:00:54.181742  6284 consensus_queue.cc:260] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:54.183238  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:54.184043  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:54.187376  1646 leader_election.cc:304] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:54.132313  5877 raft_consensus.cc:3060] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:00:54.157795  6253 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.669s	user 0.001s	sys 0.006s
W20260709 13:00:54.158882  6295 log.cc:927] Time spent T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:00:54.186453  1523 leader_election.cc:290] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:54.070935  6267 raft_consensus.cc:515] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:54.201514  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: true dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:54.165416  6184 raft_consensus.cc:493] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:54.186771  2190 leader_election.cc:304] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:54.115788  6261 leader_election.cc:290] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:54.187875  1524 raft_consensus.cc:2468] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 10.
I20260709 13:00:54.206645  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:54.206975  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:54.207298  1523 raft_consensus.cc:3060] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:54.208186  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:54.205883  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:54.208837  1524 raft_consensus.cc:2468] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 14.
I20260709 13:00:54.208405  6129 raft_consensus.cc:2749] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:54.209751  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:54.210379  1524 raft_consensus.cc:2468] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 12.
I20260709 13:00:54.211283  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:54.211822  1524 raft_consensus.cc:2468] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 10.
W20260709 13:00:54.206681  6289 log.cc:927] Time spent T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
I20260709 13:00:54.212582  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:54.213239  1524 raft_consensus.cc:2368] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 13. Current term is 14.
I20260709 13:00:54.075052  5810 raft_consensus.cc:515] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:54.215633  5810 leader_election.cc:290] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:54.213943  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:54.216972  1524 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 13.
I20260709 13:00:54.213891  5827 leader_election.cc:290] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:00:54.192556  6253 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.712s	user 0.002s	sys 0.007s
I20260709 13:00:54.157406  6185 raft_consensus.cc:493] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:54.183183  6284 raft_consensus.cc:3060] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:54.192636  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:54.227322  1523 raft_consensus.cc:2468] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 15.
I20260709 13:00:54.180545  1527 raft_consensus.cc:2468] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 17.
I20260709 13:00:54.165270  5699 raft_consensus.cc:493] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:54.217447  2220 raft_consensus.cc:1240] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 14. Current term is 15. Ops: []
I20260709 13:00:54.220008  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:54.190173  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:54.228503  1526 raft_consensus.cc:3060] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:54.228866  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:54.228749  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:54.229492  2224 raft_consensus.cc:3060] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:54.230283  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:54.221071  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:54.221323  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:54.231803  1524 raft_consensus.cc:2393] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 12: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:00:54.231389  2218 raft_consensus.cc:2468] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 9.
I20260709 13:00:54.191879  2219 raft_consensus.cc:2468] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 8.
I20260709 13:00:54.223256  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:54.202194  2225 raft_consensus.cc:3055] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:54.234051  5934 raft_consensus.cc:2749] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:54.234488  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:54.235051  5976 leader_election.cc:290] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:54.235208  1531 raft_consensus.cc:1240] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:54.235332  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:54.236056  2218 raft_consensus.cc:3060] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:54.236261  6223 leader_election.cc:290] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:54.217499  6292 leader_election.cc:290] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:54.234197  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:54.239408  2220 raft_consensus.cc:1240] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 13. Current term is 14. Ops: []
I20260709 13:00:54.195758  6187 consensus_queue.cc:1059] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:00:54.197427  6294 raft_consensus.cc:493] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:54.233134  2225 raft_consensus.cc:740] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:54.244606  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
W20260709 13:00:54.244196  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:54.245532  2218 raft_consensus.cc:2468] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 12.
I20260709 13:00:54.245281  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:54.251088  1527 raft_consensus.cc:2468] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 13.
I20260709 13:00:54.257627  2224 raft_consensus.cc:2468] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 15.
I20260709 13:00:54.247594  6294 raft_consensus.cc:515] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:54.245549  2190 leader_election.cc:304] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:54.266883  6193 raft_consensus.cc:2804] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:00:54.267506  6193 raft_consensus.cc:697] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 15 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:54.268364  6193 consensus_queue.cc:237] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:54.274083  6267 leader_election.cc:290] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:54.274549  6294 leader_election.cc:290] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:54.276392  6176 raft_consensus.cc:493] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:00:54.276981  6176 raft_consensus.cc:3060] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:54.279037  6082 leader_election.cc:290] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:54.280195  5877 raft_consensus.cc:515] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:54.248487  2225 consensus_queue.cc:260] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:54.281330  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:54.281862  2225 raft_consensus.cc:3060] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:54.282897  1526 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 14.
I20260709 13:00:54.246408  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:54.283995  1523 raft_consensus.cc:2468] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 8.
W20260709 13:00:54.288894  6262 log.cc:927] Time spent T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 1.075s	user 0.002s	sys 0.005s
I20260709 13:00:54.280642  6278 leader_election.cc:290] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:54.290016  6291 raft_consensus.cc:493] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:54.290613  6291 raft_consensus.cc:515] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:54.297338  6278 raft_consensus.cc:493] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:54.242913  6019 leader_election.cc:290] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:54.244529  5827 raft_consensus.cc:493] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.298007  6278 raft_consensus.cc:515] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:54.223313  6184 raft_consensus.cc:515] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:54.307866  6305 log.cc:927] Time spent T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:00:54.311887  6154 leader_election.cc:290] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:54.315001  2225 raft_consensus.cc:2468] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 9.
I20260709 13:00:54.294353  6176 raft_consensus.cc:515] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:54.314446  6228 log.cc:927] Time spent T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 1.573s	user 0.001s	sys 0.011s
I20260709 13:00:54.300366  6082 raft_consensus.cc:493] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.246769  5699 raft_consensus.cc:515] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:54.308372   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:54.231384  6185 raft_consensus.cc:515] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:54.278561  6276 raft_consensus.cc:515] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:54.346812  2223 raft_consensus.cc:3060] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:54.347906  5699 leader_election.cc:290] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:00:54.411798  2190 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.864s (SENT)
I20260709 13:00:54.303473  5827 raft_consensus.cc:515] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:54.485680  2223 raft_consensus.cc:2468] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 10.
I20260709 13:00:54.483889  6292 raft_consensus.cc:493] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:54.338016  6291 leader_election.cc:290] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:54.480212  5553 raft_consensus.cc:493] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.481441  6019 raft_consensus.cc:493] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.479676  5699 raft_consensus.cc:493] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:54.336253  6082 raft_consensus.cc:515] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:54.486855  6292 raft_consensus.cc:515] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:54.531196  6255 raft_consensus.cc:493] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:00:54.531932  6255 raft_consensus.cc:515] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:54.506920  6019 raft_consensus.cc:515] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:54.538228  6019 leader_election.cc:290] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:54.542898  1572 leader_election.cc:304] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:00:54.543908  6185 leader_election.cc:290] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:54.546772  6272 raft_consensus.cc:2804] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:54.547235  6272 raft_consensus.cc:493] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:54.547583  6272 raft_consensus.cc:3060] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:54.547955  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:54.548549  1677 raft_consensus.cc:3060] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:54.552291  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:54.552898  1673 raft_consensus.cc:2468] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 9.
I20260709 13:00:54.552001  6302 consensus_queue.cc:1059] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 13:00:54.555368  6302 raft_consensus.cc:3055] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:54.555716  6302 raft_consensus.cc:740] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:54.560278  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:54.561197  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:54.564280  1677 raft_consensus.cc:2468] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 13.
I20260709 13:00:54.571427  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:54.593590  6292 leader_election.cc:290] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:54.595727  5972 raft_consensus.cc:3055] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:54.596190  5972 raft_consensus.cc:740] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:54.596597  6302 consensus_queue.cc:260] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:54.596931  5972 consensus_queue.cc:260] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:54.597656  6302 raft_consensus.cc:3060] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:54.597872  5972 raft_consensus.cc:3060] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:54.599184  6278 leader_election.cc:290] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:54.600910  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:54.601648  1679 raft_consensus.cc:2393] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 10: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:00:54.503747  5553 raft_consensus.cc:515] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:54.604198  5553 leader_election.cc:290] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:54.563786  6255 leader_election.cc:290] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:54.606369  6176 leader_election.cc:290] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:54.483045  6308 raft_consensus.cc:3055] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:54.613883  6184 leader_election.cc:290] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:54.614524  6308 raft_consensus.cc:740] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:54.635159  6308 consensus_queue.cc:260] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:54.636515  6308 raft_consensus.cc:3060] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:54.640110  5827 leader_election.cc:290] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:00:54.640790  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:54.664644  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:54.620236  5877 leader_election.cc:290] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:54.516466  5699 raft_consensus.cc:515] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:54.641872  6019 consensus_queue.cc:1059] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:00:54.682484  6168 raft_consensus.cc:493] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:00:54.683086  6168 raft_consensus.cc:515] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:54.648425  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:54.685480  5699 leader_election.cc:290] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:54.648542  6082 leader_election.cc:290] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:54.692370  1673 raft_consensus.cc:1275] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:00:54.650209  2191 leader_election.cc:304] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:54.652612  1497 leader_election.cc:304] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:54.654582  6278 raft_consensus.cc:493] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:54.656348  6184 consensus_queue.cc:1059] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:54.666265  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:54.669538  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:54.676388  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
W20260709 13:00:54.699246  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 46739.7us
I20260709 13:00:54.700026  1497 leader_election.cc:304] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
W20260709 13:00:54.676625  6245 log.cc:927] Time spent T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.594s	user 0.000s	sys 0.003s
I20260709 13:00:54.677536  1679 raft_consensus.cc:1240] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:00:54.676278  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:54.601584  6276 leader_election.cc:290] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:54.668080  6152 raft_consensus.cc:493] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.683409  6019 raft_consensus.cc:3055] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:54.621286  1524 raft_consensus.cc:2410] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:00:54.642526  6255 consensus_queue.cc:1059] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:00:54.693877  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 43757us
I20260709 13:00:54.710587  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:54.711675  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: true dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:54.713263  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:54.720320  1679 raft_consensus.cc:3060] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:54.720428  1605 raft_consensus.cc:3060] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:54.713416  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:54.714890  1497 leader_election.cc:304] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:54.724263  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:54.725858  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:54.726076  1497 leader_election.cc:304] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:54.793952  6176 raft_consensus.cc:493] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.709616  6159 consensus_queue.cc:1048] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.082s
I20260709 13:00:54.705647  6278 raft_consensus.cc:515] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:54.827658  6252 raft_consensus.cc:2804] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:54.739347  1599 raft_consensus.cc:1240] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 14. Current term is 15. Ops: []
I20260709 13:00:54.767968  2192 leader_election.cc:304] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:54.760668  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49170 (request call id 2297) took 1476 ms. Trace:
I20260709 13:00:54.730909  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:54.762185  2221 raft_consensus.cc:1240] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:54.740000  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:54.829463  1603 raft_consensus.cc:2393] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 10: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:00:54.702788  6260 raft_consensus.cc:2804] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:54.710572  6019 raft_consensus.cc:740] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:54.707968  6128 raft_consensus.cc:2749] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:54.746249  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:54.785444  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:54.842015  1679 raft_consensus.cc:2468] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 8.
I20260709 13:00:54.843030  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:54.737684  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:54.718263  2191 leader_election.cc:304] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:00:54.733204  5827 raft_consensus.cc:2804] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:54.843914  1600 raft_consensus.cc:3060] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:54.716444  6152 raft_consensus.cc:515] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:54.782138  1605 raft_consensus.cc:2468] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 12.
I20260709 13:00:54.815117  6131 leader_election.cc:290] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:54.846680  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:54.848675  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: true dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:54.849226  1677 raft_consensus.cc:3060] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:54.828306  6278 leader_election.cc:290] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:54.818856  6267 raft_consensus.cc:493] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.702322  6082 raft_consensus.cc:2749] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:54.757365  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:54.769711  1570 leader_election.cc:304] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
W20260709 13:00:54.810297  6266 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.010s	sys 0.010s
W20260709 13:00:54.863009  6266 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.011s	sys 0.011s
I20260709 13:00:54.822079  1646 leader_election.cc:304] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:54.864908  1646 leader_election.cc:304] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:54.865711  1646 leader_election.cc:304] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
W20260709 13:00:54.823534  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 97542.8us
I20260709 13:00:54.868144  1497 leader_election.cc:304] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:54.869563  6091 consensus_queue.cc:1059] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:54.870318  6091 consensus_queue.cc:1243] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer 39a92f5a4352465d8af3af5908fe8642 log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:00:54.871217  6303 raft_consensus.cc:2749] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:54.872192  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:54.874282  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:54.875202  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:54.830457  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:54.829517  1598 raft_consensus.cc:2468] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 12.
I20260709 13:00:54.878080  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:54.830911  2221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 933) took 1250 ms. Trace:
I20260709 13:00:54.878892  2221 rpcz_store.cc:276] 0709 13:00:53.580665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:53.580833 (+   168us) service_pool.cc:224] Handling call
0709 13:00:54.761782 (+1180949us) spinlock_profiling.cc:243] Waited 1.07 ms on lock 0x7b5800015c98. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a1548eb71 00007f6a1548ea22 00007f6a1e3a7c09 00007f6a1d501ee0 00007f6a1d5cb0ab 00007f6a1d5cb131 00007f6a1d58cfc0 00007f6a1d577929 00007f6a1d5773d2 00007f6a16aeebd4
0709 13:00:54.761991 (+   209us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:54.830635 (+ 68644us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:54.830849 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2451328}
I20260709 13:00:54.829819  1681 rpcz_store.cc:276] 0709 13:00:53.283821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:53.283997 (+   176us) service_pool.cc:224] Handling call
0709 13:00:53.284365 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:53.748010 (+463645us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:54.760387 (+1012377us) spinlock_profiling.cc:243] Waited 463 ms on lock 0x7b54002c0454. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:00:54.760602 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1064783232}
I20260709 13:00:54.840580  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:54.879673  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:00:54.810506  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 398750us
W20260709 13:00:54.835477  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 67600.4us
I20260709 13:00:54.791877  6287 raft_consensus.cc:493] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:54.819110  6143 raft_consensus.cc:3055] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:54.852110  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:54.847244  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49170 (request call id 2293) took 2194 ms. Trace:
W20260709 13:00:54.845541  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 127345us
I20260709 13:00:54.841642  6260 raft_consensus.cc:493] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:54.858529  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:54.859814  5827 raft_consensus.cc:697] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:00:54.861173  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:00:54.891072  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 121443us
I20260709 13:00:54.830739  6223 consensus_queue.cc:1059] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.031s
I20260709 13:00:54.860523  6168 leader_election.cc:290] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:54.874315  6159 raft_consensus.cc:3055] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:54.883375  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:54.884055  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:54.828680  5976 raft_consensus.cc:493] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:54.915740  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:54.916119  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:54.878845  1601 raft_consensus.cc:2468] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 15.
I20260709 13:00:54.915650  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:54.854030  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:54.727738  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:54.878288  1603 raft_consensus.cc:2468] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 12.
I20260709 13:00:54.842522  6189 raft_consensus.cc:2749] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:00:54.828346  6252 raft_consensus.cc:697] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:00:54.888072  2191 leader_election.cc:304] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:54.891834  1570 leader_election.cc:304] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:54.892381  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:54.893442  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:54.895028  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:54.895829  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:54.889124  1646 leader_election.cc:304] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:54.886799  1676 rpcz_store.cc:276] 0709 13:00:52.644191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:52.644308 (+   117us) service_pool.cc:224] Handling call
0709 13:00:52.644600 (+   292us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:52.644924 (+   324us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:52.644952 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:52.648854 (+  3902us) log.cc:844] Serialized 26 byte log entry
0709 13:00:52.824412 (+175558us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:52.874717 (+ 50305us) log.cc:844] Serialized 14 byte log entry
0709 13:00:52.874964 (+   247us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:52.875040 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:54.081891 (+1206851us) spinlock_profiling.cc:243] Waited 1.61 ms on lock 0x7b18003bdd60. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1e38ede1 00007f6a1e39b5b1 00007f6a154c63f3 00007f6a154c87c1 00007f6a154c8779 00007f6a154c8709 00007f6a154c86d1 00007f6a154c79cd 000000000038f354 000000000038f199 00007f6a154a983a
0709 13:00:54.676043 (+594152us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b4400022b4c. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a153ecc85 00007f6a153ed6a2 00007f6a1815f1db 00007f6a1815aaaf 00007f6a1814e86e 00007f6a1814dbb6 00007f6a1814d7d8 00007f6a18157221 00007f6a181571d9 00007f6a18157169
0709 13:00:54.838626 (+162583us) raft_consensus.cc:1685] finished
0709 13:00:54.838649 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:54.838818 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":85783,"prepare.queue_time_us":42703,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":5897,"raft.run_cpu_time_us":254,"raft.run_wall_time_us":16552,"spinlock_wait_cycles":29043456,"thread_start_us":147098,"threads_started":1,"wal-append.queue_time_us":233259}
I20260709 13:00:54.898581  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:54.902335  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:54.903688  1598 raft_consensus.cc:1240] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:54.851425  5849 raft_consensus.cc:2804] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:54.906126  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:54.907442  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 13:00:54.908946  1571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:54.911254  1600 raft_consensus.cc:2468] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 14.
I20260709 13:00:54.913398  1526 raft_consensus.cc:2468] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 8.
I20260709 13:00:54.896986  6260 raft_consensus.cc:3060] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:54.898742  6007 raft_consensus.cc:2804] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:55.021239  2223 raft_consensus.cc:2393] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 8: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:00:54.922824  1677 raft_consensus.cc:2468] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 9.
I20260709 13:00:54.839838  6176 raft_consensus.cc:515] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:55.024452  6176 leader_election.cc:290] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:54.924386  1607 raft_consensus.cc:2393] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 17: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:00:54.926196  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:55.025835  2221 raft_consensus.cc:2468] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 14.
I20260709 13:00:54.888726  6143 raft_consensus.cc:740] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:54.915259  5827 consensus_queue.cc:237] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:55.027148  6143 consensus_queue.cc:260] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:55.028334  6143 raft_consensus.cc:3060] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:54.992302  6152 leader_election.cc:290] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:54.889120  6267 raft_consensus.cc:515] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:55.033746  6267 leader_election.cc:290] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:54.923444  6128 raft_consensus.cc:493] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:54.898274  6285 raft_consensus.cc:2804] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:55.034475  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:55.034857  6285 raft_consensus.cc:493] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:55.035351  6285 raft_consensus.cc:3060] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:55.035859  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:55.036085  5732 consensus_queue.cc:1059] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:54.903090  5972 raft_consensus.cc:2804] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:00:54.932106  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:55.008312  1673 raft_consensus.cc:2468] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 12.
I20260709 13:00:55.042752  5972 raft_consensus.cc:697] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 15 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:55.043542  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:55.043674  5972 consensus_queue.cc:237] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:55.044188  1673 raft_consensus.cc:2468] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 12.
I20260709 13:00:55.044994  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:54.946847  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:55.045974  1678 raft_consensus.cc:2468] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 12.
I20260709 13:00:55.046846  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:54.930482  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:54.953727  1527 raft_consensus.cc:2468] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 15.
I20260709 13:00:55.048730  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:55.049304  1527 raft_consensus.cc:2468] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 12.
W20260709 13:00:55.010031  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 118289us
I20260709 13:00:54.998873  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:55.012761  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:00:55.013477  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 124449us
I20260709 13:00:55.050612  1570 leader_election.cc:304] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:55.053841  1570 leader_election.cc:304] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:55.054544  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:55.047377  1678 raft_consensus.cc:2468] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 12.
I20260709 13:00:55.037020  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:00:55.005354  1425 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50074 (request call id 233) took 33844 ms (client timeout 15000 ms). Trace:
W20260709 13:00:55.038766  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 107556us
I20260709 13:00:55.051873  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:55.040298  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:55.041370  1526 raft_consensus.cc:1240] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 13. Current term is 14. Ops: []
I20260709 13:00:55.037992  1496 leader_election.cc:304] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:55.050575  1527 raft_consensus.cc:1240] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 16. Current term is 17. Ops: []
I20260709 13:00:55.055358  1607 raft_consensus.cc:2468] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 14.
I20260709 13:00:55.060664  1496 leader_election.cc:304] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:55.021764  1571 leader_election.cc:304] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:55.061283  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:54.902966  6184 raft_consensus.cc:2804] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:55.054988  1570 leader_election.cc:400] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 election: Vote denied by peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931) with higher term. Message: Invalid argument: T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 13. Current term is 14.
I20260709 13:00:55.063073  1570 leader_election.cc:403] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:00:54.913023  6159 raft_consensus.cc:740] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:00:55.066080  1570 leader_election.cc:304] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:55.066823  1680 raft_consensus.cc:1240] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 12. Current term is 13. Ops: []
W20260709 13:00:55.067831  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 179833us
I20260709 13:00:55.067775  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:00:55.068840  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 47094.6us
I20260709 13:00:55.096240  1523 raft_consensus.cc:1240] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 14. Current term is 15. Ops: []
I20260709 13:00:55.071311  1675 raft_consensus.cc:2468] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 14.
I20260709 13:00:55.037235  6203 raft_consensus.cc:2804] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:54.902626  5909 consensus_queue.cc:1059] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.160s
I20260709 13:00:55.107183  1673 raft_consensus.cc:2393] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 12: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:00:55.107888  1496 leader_election.cc:304] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:55.115322  1496 leader_election.cc:304] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:55.065034  6272 raft_consensus.cc:515] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:55.037120  5747 raft_consensus.cc:2804] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:55.109840  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:55.109863  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:55.126382  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:55.038223  6007 raft_consensus.cc:493] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:00:55.055368  5849 raft_consensus.cc:697] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 13 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:55.034564  6128 raft_consensus.cc:515] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:54.917301  6019 consensus_queue.cc:260] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:55.111475  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 52976.6us
I20260709 13:00:54.896728  6287 raft_consensus.cc:515] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:55.063838  6080 raft_consensus.cc:2749] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:55.067725  6204 raft_consensus.cc:2804] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:54.915251  5976 raft_consensus.cc:515] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:00:55.117431  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:55.132313  1598 raft_consensus.cc:2468] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 12.
I20260709 13:00:55.133967  1523 raft_consensus.cc:1240] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:55.171427  1680 raft_consensus.cc:1275] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:00:55.119905  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:55.136014  1679 raft_consensus.cc:2468] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 13.
I20260709 13:00:55.137729  1496 leader_election.cc:304] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:55.101440  6176 raft_consensus.cc:2749] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:55.189378  1532 raft_consensus.cc:3060] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:55.067467  6205 raft_consensus.cc:2749] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931) with higher term. Message: Invalid argument: T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 13. Current term is 14.
W20260709 13:00:55.057273  1425 rpcz_store.cc:269] 0709 13:00:21.163367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:21.165516 (+  2149us) service_pool.cc:224] Handling call
0709 13:00:55.005240 (+33839724us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:48.991186 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:48.991818 (+   632us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:48.991872 (+    54us) write_op.cc:435] Acquired schema lock
0709 13:00:48.991891 (+    19us) tablet.cc:662] Decoding operations
0709 13:00:48.995617 (+  3726us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:48.995716 (+    99us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:48.995744 (+    28us) tablet.cc:685] Acquiring locks for 13 operations
0709 13:00:48.996984 (+  1240us) tablet.cc:701] Row locks acquired
0709 13:00:48.997035 (+    51us) write_op.cc:260] PREPARE: finished
0709 13:00:48.997214 (+   179us) write_op.cc:270] Start()
0709 13:00:48.997370 (+   156us) write_op.cc:276] Timestamp: P: 1783602048997146 usec, L: 0
0709 13:00:48.997402 (+    32us) op_driver.cc:348] REPLICATION: starting
0709 13:00:48.998083 (+   681us) log.cc:844] Serialized 5133 byte log entry
0709 13:00:49.970491 (+972408us) spinlock_profiling.cc:243] Waited 46.3 ms on lock 0x7b1800170aa0. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1e38ede1 00007f6a1e39b5b1 00007f6a154c63f3 00007f6a154c87c1 00007f6a154c8779 00007f6a154c8709 00007f6a154c86d1 00007f6a154c79cd 000000000038f354 000000000038f199 00007f6a154a983a
0709 13:00:50.384447 (+413956us) op_driver.cc:464] REPLICATION: finished
0709 13:00:50.901481 (+517034us) write_op.cc:301] APPLY: starting
0709 13:00:50.901592 (+   111us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:51.033412 (+131820us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:51.041940 (+  8528us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:51.424200 (+382260us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:51.424536 (+   336us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=26,key_file_lookups=26,delta_file_lookups=26,mrs_lookups=0
0709 13:00:51.424599 (+    63us) write_op.cc:312] APPLY: finished
0709 13:00:51.425021 (+   422us) log.cc:844] Serialized 121 byte log entry
0709 13:00:51.605021 (+180000us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:51.620215 (+ 15194us) write_op.cc:454] Released schema lock
0709 13:00:51.712458 (+ 92243us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:51.740483 (+ 28025us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:51.741419 (+   936us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":364931,"reported_tablets":36,"child_traces":[["op",{"apply.queue_time_us":516741,"apply.run_cpu_time_us":51675,"apply.run_wall_time_us":827969,"cfile_cache_hit":54,"cfile_cache_hit_bytes":58571,"num_ops":13,"prepare.queue_time_us":177592,"prepare.run_cpu_time_us":23192,"prepare.run_wall_time_us":442096,"raft.queue_time_us":350464,"raft.run_cpu_time_us":35419,"raft.run_wall_time_us":95316,"replication_time_us":1386873,"spinlock_wait_cycles":106392320,"thread_start_us":885467,"threads_started":5,"wal-append.queue_time_us":690442,"wal-append.run_cpu_time_us":21096,"wal-append.run_wall_time_us":2343315}]]}
I20260709 13:00:55.204015  1672 raft_consensus.cc:2468] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 13.
I20260709 13:00:55.101347  6244 raft_consensus.cc:2804] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:00:55.147498  1572 leader_election.cc:304] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:55.166316  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:55.272375  1681 raft_consensus.cc:3060] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:55.261042  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 13:00:55.280381  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 132994us
I20260709 13:00:55.096025  6012 raft_consensus.cc:2749] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:00:55.071867  6002 raft_consensus.cc:2804] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:55.104626  6184 raft_consensus.cc:697] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 12 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
W20260709 13:00:55.240494  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 102839us
I20260709 13:00:55.240010  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 13:00:55.176832  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 65493.3us
I20260709 13:00:55.285856  1525 raft_consensus.cc:2468] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 12.
I20260709 13:00:55.195019  6088 raft_consensus.cc:3055] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:00:55.143862  5747 raft_consensus.cc:493] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:55.237951  6007 raft_consensus.cc:3060] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:55.294585  6277 raft_consensus.cc:2804] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:55.303946  1529 raft_consensus.cc:3060] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:55.183538  6272 leader_election.cc:290] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:55.131136  6189 raft_consensus.cc:493] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:00:55.101892  6278 consensus_queue.cc:1048] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.212s
I20260709 13:00:55.166759  6091 raft_consensus.cc:2749] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:55.320079  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:55.246922  5909 raft_consensus.cc:493] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:55.195617  6283 consensus_queue.cc:1059] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.125s
I20260709 13:00:55.116852  6273 raft_consensus.cc:2749] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:55.321973  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:55.316952  5761 raft_consensus.cc:493] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:55.325356  1571 leader_election.cc:304] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:55.329711  1532 raft_consensus.cc:2468] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 13.
I20260709 13:00:55.351346  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:55.331442  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:55.273509  5976 leader_election.cc:290] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:55.316982  6244 raft_consensus.cc:697] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 17 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:55.254508  6204 raft_consensus.cc:493] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
W20260709 13:00:55.372529  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 47242.1us
I20260709 13:00:55.373740  1571 leader_election.cc:304] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:55.326902  1496 leader_election.cc:304] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:55.191890  6276 raft_consensus.cc:3055] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:55.317601  6088 raft_consensus.cc:740] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:55.187067  6275 consensus_queue.cc:1059] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.146s
I20260709 13:00:55.319116  5747 raft_consensus.cc:3060] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:55.319496  6277 raft_consensus.cc:493] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:55.331254  6082 raft_consensus.cc:2804] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:55.390807  1523 raft_consensus.cc:2468] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 12.
I20260709 13:00:55.142836  6252 consensus_queue.cc:237] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:55.344007  6189 raft_consensus.cc:515] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:55.375994  6204 raft_consensus.cc:3060] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:00:55.386770  6266 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.004s	sys 0.014s
I20260709 13:00:55.425702  1529 raft_consensus.cc:2468] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 15.
I20260709 13:00:55.385541  6255 raft_consensus.cc:2804] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:00:55.376734  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 49924us
I20260709 13:00:55.426836  1571 leader_election.cc:304] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:55.139205  6159 consensus_queue.cc:260] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:55.377149  6276 raft_consensus.cc:740] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:55.388952  6273 raft_consensus.cc:2804] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:55.370007  1681 raft_consensus.cc:2468] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 8.
I20260709 13:00:55.390313  6277 raft_consensus.cc:3060] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:55.389312  6283 raft_consensus.cc:2804] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:55.353958  5909 raft_consensus.cc:515] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:55.425403  6266 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.004s	sys 0.014s
I20260709 13:00:55.374179  5761 raft_consensus.cc:515] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:55.457883  1530 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.025s	sys 0.058s
I20260709 13:00:55.526347  1680 raft_consensus.cc:2468] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 8.
I20260709 13:00:55.426806  6185 raft_consensus.cc:493] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:00:55.321238  6002 raft_consensus.cc:493] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:55.388360  5849 consensus_queue.cc:237] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:55.423761  6184 consensus_queue.cc:237] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:55.434757  6091 raft_consensus.cc:493] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.471457  1426 catalog_manager.cc:5697] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 5 to 11, leader changed from 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) to e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193). New cstate: current_term: 11 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:55.441897  6273 raft_consensus.cc:493] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:55.430287  6255 raft_consensus.cc:493] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:55.458230  6283 raft_consensus.cc:493] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:55.540077  5877 raft_consensus.cc:2804] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:00:55.535701  1530 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.635s	user 0.040s	sys 0.073s
I20260709 13:00:55.544215  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:00:55.538175  6317 log.cc:927] Time spent T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.301s	user 0.000s	sys 0.001s
W20260709 13:00:55.549862  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:55.527141  6278 raft_consensus.cc:493] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:55.504362  6203 raft_consensus.cc:697] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 10 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
W20260709 13:00:55.485075  6223 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.018s	sys 0.020s
I20260709 13:00:55.546000  6002 raft_consensus.cc:3060] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:00:55.564829  5827 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.008s	sys 0.016s
I20260709 13:00:55.589792  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:55.478456  6244 consensus_queue.cc:237] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:55.549938  6159 raft_consensus.cc:3060] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:55.597026  1680 raft_consensus.cc:2468] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 14.
I20260709 13:00:55.571640  6255 raft_consensus.cc:3060] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:55.601701  2226 raft_consensus.cc:1240] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 14. Current term is 15. Ops: [12.12-14.13]
I20260709 13:00:55.458863  6088 consensus_queue.cc:260] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:55.582057  6128 leader_election.cc:290] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:55.566025  6273 raft_consensus.cc:3060] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:00:55.597918  5827 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.008s	sys 0.017s
W20260709 13:00:55.605616  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:55.588850  5877 raft_consensus.cc:493] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:55.593837  6260 consensus_meta.cc:287] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b: Time spent flushing consensus metadata: real 0.537s	user 0.009s	sys 0.000s
W20260709 13:00:55.593935  6223 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.649s	user 0.019s	sys 0.020s
I20260709 13:00:55.575260  6283 raft_consensus.cc:3060] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:00:55.609040  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 497561us
I20260709 13:00:55.594790  1644 leader_election.cc:304] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
W20260709 13:00:55.606184  5972 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.016s	sys 0.039s
I20260709 13:00:55.610472  2226 raft_consensus.cc:1240] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:55.611637  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:55.614006  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:55.693262  2223 raft_consensus.cc:2393] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 14: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:00:55.547904  6185 raft_consensus.cc:515] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:55.617089  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:55.616158  1426 catalog_manager.cc:5697] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 9 to 10, leader changed from b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) to e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193). New cstate: current_term: 10 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:55.617765  1680 raft_consensus.cc:1275] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:00:55.618737  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:55.695200  2227 raft_consensus.cc:2468] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 10.
I20260709 13:00:55.618966  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:55.596436  6193 raft_consensus.cc:493] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:55.623340  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:55.624344  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 385701us
W20260709 13:00:55.624795  1646 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.007s	sys 0.031s
W20260709 13:00:55.698849  1646 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.633s	user 0.007s	sys 0.031s
W20260709 13:00:55.699198  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 633321us
W20260709 13:00:55.698879  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:55.698418  2190 leader_election.cc:304] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:55.701200  2190 leader_election.cc:304] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
W20260709 13:00:55.632027  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:55.551939  6276 consensus_queue.cc:260] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:55.702785  6276 raft_consensus.cc:3060] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:55.703953  5827 raft_consensus.cc:493] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:55.704512  5827 raft_consensus.cc:515] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:55.705715  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 13:00:55.706298  6318 log.cc:927] Time spent T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:00:55.709962  6185 leader_election.cc:290] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:55.711539  2225 raft_consensus.cc:3060] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:55.710104  6193 raft_consensus.cc:515] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:55.678253  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:55.565656  6091 raft_consensus.cc:515] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:55.689388  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:55.715306  6323 consensus_queue.cc:1059] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:00:55.688498  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 93789.1us
I20260709 13:00:55.716733  1644 leader_election.cc:304] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:55.717289  6267 raft_consensus.cc:3055] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:00:55.717669  6267 raft_consensus.cc:740] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:55.717968  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:55.712576  6185 raft_consensus.cc:2804] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:55.715140  6193 leader_election.cc:290] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:55.718461  6267 consensus_queue.cc:260] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:55.710913  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:55.719770  6193 raft_consensus.cc:2804] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:00:55.719352  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:55.720270  6193 raft_consensus.cc:697] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 15 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:55.720702  2223 raft_consensus.cc:2468] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 14.
I20260709 13:00:55.721122  5976 raft_consensus.cc:2749] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:55.719054  6185 raft_consensus.cc:493] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:55.716985  6152 consensus_queue.cc:1059] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 13:00:55.722148  6185 raft_consensus.cc:3060] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:55.706634  5827 leader_election.cc:290] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:55.717222  1426 catalog_manager.cc:5697] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 5 to 8, leader changed from e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) to 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194). New cstate: current_term: 8 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } }
I20260709 13:00:55.720329  6267 raft_consensus.cc:3060] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:55.723271  1646 leader_election.cc:304] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:55.639003  5877 raft_consensus.cc:3060] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:55.729724  2225 raft_consensus.cc:2410] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:00:55.594404  6278 raft_consensus.cc:515] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:55.735918  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:55.737138  2223 raft_consensus.cc:2468] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 14.
W20260709 13:00:55.696668  5972 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.650s	user 0.018s	sys 0.039s
I20260709 13:00:55.690876  6303 raft_consensus.cc:2749] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 LEADER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:55.700198  6223 raft_consensus.cc:2804] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:55.693351  6162 raft_consensus.cc:493] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.695701  6088 raft_consensus.cc:3060] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:00:55.753223  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:55.725026  6091 leader_election.cc:290] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:00:55.754108  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 155628us
I20260709 13:00:55.755409  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:55.764190  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:55.765031  1530 raft_consensus.cc:2393] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 10: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:00:55.687747  6260 raft_consensus.cc:515] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:55.803483  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:55.804373  1524 raft_consensus.cc:2393] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 8: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:00:55.804912  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49178 (request call id 2088) took 1132 ms. Trace:
I20260709 13:00:55.722317  5976 consensus_queue.cc:1059] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 13:00:55.740799  6189 leader_election.cc:290] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:55.800771  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 13:00:55.819801  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 96582.8us
I20260709 13:00:55.753397  6223 raft_consensus.cc:493] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:55.806136  1677 raft_consensus.cc:1240] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:55.806905  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:55.754742  1678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49178 (request call id 2085) took 1082 ms. Trace:
I20260709 13:00:55.809427  6152 raft_consensus.cc:3055] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:55.809707  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:55.810613  6082 raft_consensus.cc:493] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:55.812016  6275 consensus_queue.cc:1048] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:55.813701  1531 raft_consensus.cc:1275] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:00:55.814458  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:55.816471  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 13:00:55.805346  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 117921us
I20260709 13:00:55.874096  1570 leader_election.cc:304] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
W20260709 13:00:55.874926  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:55.875475  1570 leader_election.cc:304] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:55.876991  1570 leader_election.cc:304] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:55.721534  6193 consensus_queue.cc:237] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:55.822366  1525 raft_consensus.cc:1275] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:00:55.805336  1681 rpcz_store.cc:276] 0709 13:00:54.672915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.892693 (+219778us) service_pool.cc:224] Handling call
0709 13:00:55.804750 (+912057us) spinlock_profiling.cc:243] Waited 355 ms on lock 0x7b54000b86d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:55.804860 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":816885632}
I20260709 13:00:55.880151  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:55.880805  1681 raft_consensus.cc:2468] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 13.
I20260709 13:00:55.843534  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:55.884869  1679 raft_consensus.cc:1240] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 15 LEADER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 14. Current term is 15. Ops: [14.13-14.13]
W20260709 13:00:55.850544  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 132124us
I20260709 13:00:55.842773  1678 rpcz_store.cc:276] 0709 13:00:54.672198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.056193 (+383995us) service_pool.cc:224] Handling call
0709 13:00:55.056574 (+   381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:55.056787 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:00:55.552978 (+496191us) log.cc:844] Serialized 14 byte log entry
0709 13:00:55.754344 (+201366us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:55.754400 (+    56us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:55.754459 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:55.754525 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:55.754682 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2139,"prepare.queue_time_us":555855,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"thread_start_us":646916,"threads_started":2}
I20260709 13:00:55.855285  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49170 (request call id 2311) took 1130 ms. Trace:
I20260709 13:00:55.795958  6162 raft_consensus.cc:515] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:55.867830  6082 raft_consensus.cc:3060] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:55.890301  6278 leader_election.cc:290] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:55.799468  6091 raft_consensus.cc:493] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:55.890960  6278 consensus_queue.cc:1059] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:55.891384  6091 raft_consensus.cc:515] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:55.893428  6091 leader_election.cc:290] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:00:55.894018  6322 log.cc:927] Time spent T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
W20260709 13:00:55.898245  6007 consensus_meta.cc:287] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.576s	user 0.008s	sys 0.000s
I20260709 13:00:55.900879  6082 raft_consensus.cc:515] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:55.888433  1644 leader_election.cc:304] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:00:55.852209  6285 consensus_meta.cc:287] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.816s	user 0.008s	sys 0.002s
I20260709 13:00:55.888649  1677 rpcz_store.cc:276] 0709 13:00:54.725383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.060153 (+334770us) service_pool.cc:224] Handling call
0709 13:00:55.805967 (+745814us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:55.842304 (+ 36337us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:55.855060 (+ 12756us) spinlock_profiling.cc:243] Waited 746 ms on lock 0x7b54000b86d0. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b28ad 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:55.855221 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1714712320}
I20260709 13:00:55.867930  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:55.889118  1496 leader_election.cc:304] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:55.820390  5827 raft_consensus.cc:493] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.906221  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:55.946215  2225 raft_consensus.cc:3060] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:00:55.938702  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 49646.3us
W20260709 13:00:55.940358  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 52021.6us
I20260709 13:00:55.956856  1496 leader_election.cc:304] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:55.955405  1426 catalog_manager.cc:5697] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 5 to 6, leader changed from 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) to e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193). New cstate: current_term: 6 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } }
W20260709 13:00:55.954357  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:55.959820  2225 raft_consensus.cc:2468] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 13.
I20260709 13:00:55.852756  6223 raft_consensus.cc:3060] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:55.747504  6203 consensus_queue.cc:237] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:55.851696  6152 raft_consensus.cc:740] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:55.969020  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 13:00:55.915081  6321 log.cc:927] Time spent T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.161s	user 0.000s	sys 0.001s
I20260709 13:00:55.915587  6162 leader_election.cc:290] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:00:55.972189  6332 log.cc:927] Time spent T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:00:55.972469  6082 leader_election.cc:290] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:55.917627  5976 raft_consensus.cc:493] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.973349  5976 raft_consensus.cc:515] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:55.975574  1426 catalog_manager.cc:5697] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:55.982125  2223 raft_consensus.cc:1275] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:00:55.988445  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:55.901669  5972 raft_consensus.cc:2804] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:55.907227  6007 raft_consensus.cc:515] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:55.955361  6343 log.cc:927] Time spent T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:00:55.992063  2223 raft_consensus.cc:1240] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:00:55.993983  6344 raft_consensus.cc:493] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.994361  6082 raft_consensus.cc:2804] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:55.975517  5976 leader_election.cc:290] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
W20260709 13:00:56.001439  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 124504us
W20260709 13:00:56.003592  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 187416us
I20260709 13:00:55.941887  5761 leader_election.cc:290] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:55.852357  6324 consensus_queue.cc:1059] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 5, Time since last communication: 0.174s
W20260709 13:00:56.013108  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 192247us
I20260709 13:00:56.003458  5972 raft_consensus.cc:493] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:56.016749  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 49134.2us
I20260709 13:00:55.982677  6128 raft_consensus.cc:3055] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:55.999285  1426 catalog_manager.cc:5697] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:55.994973  6356 raft_consensus.cc:493] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.024111  1677 raft_consensus.cc:1240] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:56.031224  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:56.012625  6328 raft_consensus.cc:2804] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:55.955571  6285 raft_consensus.cc:515] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:55.966074  5827 raft_consensus.cc:515] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:56.031272  6162 raft_consensus.cc:493] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.035492  6125 raft_consensus.cc:2749] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:56.036196  6012 raft_consensus.cc:3055] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:56.038538  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:56.055418  1570 leader_election.cc:304] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:56.057687  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:56.022363  6082 raft_consensus.cc:697] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:00:56.070189  1572 leader_election.cc:304] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:56.024835  5972 raft_consensus.cc:3060] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:56.034238  6328 raft_consensus.cc:493] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:56.024853  6128 raft_consensus.cc:740] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:00:56.025703  6347 raft_consensus.cc:2804] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:56.025997  5976 raft_consensus.cc:2749] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:56.032505  6275 raft_consensus.cc:2804] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:00:56.068663  6302 consensus_meta.cc:287] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 1.440s	user 0.012s	sys 0.000s
I20260709 13:00:56.020922  1646 leader_election.cc:304] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:56.104342  1524 raft_consensus.cc:2468] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 11.
I20260709 13:00:56.024452  6259 consensus_queue.cc:1048] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 13:00:56.010596  6344 raft_consensus.cc:515] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:56.024597  6265 consensus_queue.cc:1048] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.058s
I20260709 13:00:56.034565  6356 raft_consensus.cc:515] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:56.122268  6125 consensus_queue.cc:1059] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.007s
W20260709 13:00:56.129866  5747 consensus_meta.cc:287] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.713s	user 0.010s	sys 0.000s
I20260709 13:00:56.131047  6285 leader_election.cc:290] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:00:56.131415  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 76109.6us
I20260709 13:00:56.076570  6162 raft_consensus.cc:515] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:56.116807  6328 raft_consensus.cc:3060] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:56.069320  6324 raft_consensus.cc:493] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
W20260709 13:00:56.145568  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 385796us
I20260709 13:00:56.121888  6334 raft_consensus.cc:493] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.119748  6347 raft_consensus.cc:493] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:56.069196  6012 raft_consensus.cc:740] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:56.072168  6152 consensus_queue.cc:260] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:56.175925  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:56.177363  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:56.122529  6275 raft_consensus.cc:493] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:56.180364  1523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43010 (request call id 2321) took 1010 ms. Trace:
I20260709 13:00:56.171725  6302 raft_consensus.cc:2804] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:56.195731  2191 leader_election.cc:304] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:56.196987  1523 rpcz_store.cc:276] 0709 13:00:55.170476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.321691 (+151215us) service_pool.cc:224] Handling call
0709 13:00:56.178469 (+856778us) spinlock_profiling.cc:243] Waited 40.7 ms on lock 0x7b54002ed1d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:56.180295 (+  1826us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":93683968}
I20260709 13:00:56.198505  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:56.216312  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:00:56.221228  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 46722.7us
I20260709 13:00:56.173403  6260 leader_election.cc:290] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 10 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:56.223984  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:56.204161  6275 raft_consensus.cc:3060] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:56.185298  6347 raft_consensus.cc:3060] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:00:56.236006  1672 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49170 (request call id 2308) took 1538 ms (client timeout 1732 ms). Trace:
I20260709 13:00:56.172086  5747 raft_consensus.cc:515] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:00:56.236611  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 163927us
W20260709 13:00:56.239285  1672 rpcz_store.cc:269] 0709 13:00:54.697817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.731042 (+ 33225us) service_pool.cc:224] Handling call
0709 13:00:56.235838 (+1504796us) spinlock_profiling.cc:243] Waited 268 ms on lock 0x7b54003f61d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:56.235947 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":617381248}
I20260709 13:00:56.240950  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:56.183986  6334 raft_consensus.cc:515] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:56.245785  1497 leader_election.cc:304] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:56.178891  6324 raft_consensus.cc:515] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:56.265069  1680 raft_consensus.cc:1240] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 12 LEADER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 11. Current term is 12. Ops: []
W20260709 13:00:56.260120  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 190018us
I20260709 13:00:56.267306  1572 leader_election.cc:304] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:56.271912  6351 raft_consensus.cc:3055] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:00:56.272395  6351 raft_consensus.cc:740] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:56.273240  6351 consensus_queue.cc:260] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:56.274734  6359 raft_consensus.cc:2749] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:56.275411  6346 consensus_queue.cc:1048] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 13:00:56.275715  6162 leader_election.cc:290] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:56.276947  6327 consensus_queue.cc:1059] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.043s
I20260709 13:00:56.277657  6369 raft_consensus.cc:2749] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:00:56.278126  6350 log.cc:927] Time spent T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:00:56.283881  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
W20260709 13:00:56.323460  6283 consensus_meta.cc:287] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.624s	user 0.010s	sys 0.010s
I20260709 13:00:56.330621  6223 raft_consensus.cc:515] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:56.335855  6347 raft_consensus.cc:515] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:56.337993  6334 leader_election.cc:290] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:00:56.332705  5877 consensus_meta.cc:287] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.585s	user 0.008s	sys 0.000s
W20260709 13:00:56.332759  6255 consensus_meta.cc:287] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.716s	user 0.004s	sys 0.003s
I20260709 13:00:56.340763  5909 leader_election.cc:290] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:56.343529  6287 leader_election.cc:290] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:56.257831  6007 leader_election.cc:290] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:00:56.333287  1529 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43008 (request call id 2216) took 1443 ms (client timeout 1880 ms). Trace:
I20260709 13:00:56.343473  6275 raft_consensus.cc:515] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:56.219964  6128 consensus_queue.cc:260] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:56.235805  6082 consensus_queue.cc:237] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:56.249866  6012 consensus_queue.cc:260] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:56.407490  6327 consensus_queue.cc:1243] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer ddf11fc190dd4b898773379c6b129d90 log is divergent from this leader: its last log entry 15.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
W20260709 13:00:56.408435  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:56.409729  6002 consensus_meta.cc:287] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.807s	user 0.008s	sys 0.000s
I20260709 13:00:56.238675  5849 raft_consensus.cc:493] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:56.274513  6351 raft_consensus.cc:3060] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:00:56.412201  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:56.414474  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 147645us
W20260709 13:00:56.416149  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 193934us
I20260709 13:00:56.412659  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:56.251222  6260 raft_consensus.cc:2804] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:56.417702  1674 raft_consensus.cc:3055] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:00:56.642031  1674 raft_consensus.cc:740] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:56.418319  1526 raft_consensus.cc:1240] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 14. Current term is 15. Ops: []
I20260709 13:00:56.644081  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:56.419030  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:56.253334  6125 raft_consensus.cc:493] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
W20260709 13:00:56.346649  6273 consensus_meta.cc:287] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent flushing consensus metadata: real 0.709s	user 0.002s	sys 0.003s
W20260709 13:00:56.446269  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 250611us
W20260709 13:00:56.449615  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 79059.8us
I20260709 13:00:56.657591  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:56.658573  1497 leader_election.cc:304] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
W20260709 13:00:56.446168  6276 consensus_meta.cc:287] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.743s	user 0.009s	sys 0.001s
I20260709 13:00:56.411599  6346 raft_consensus.cc:2749] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:00:56.455482  1529 rpcz_store.cc:269] 0709 13:00:54.889449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.892139 (+  2690us) service_pool.cc:224] Handling call
0709 13:00:56.333042 (+1440903us) spinlock_profiling.cc:243] Waited 293 ms on lock 0x7b54001400d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:56.333185 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":674781952}
I20260709 13:00:56.418072  6272 raft_consensus.cc:3055] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:00:56.679286  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:56.680148  1605 raft_consensus.cc:2393] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 13: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
W20260709 13:00:56.467273  6088 consensus_meta.cc:287] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.671s	user 0.015s	sys 0.001s
W20260709 13:00:56.468938  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:56.446171  6174 raft_consensus.cc:2804] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:00:56.453135  6353 log.cc:927] Time spent T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.180s	user 0.005s	sys 0.000s
W20260709 13:00:56.471489  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 439569us
I20260709 13:00:56.698534  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:00:56.630147  6365 log.cc:927] Time spent T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
W20260709 13:00:56.631606  6185 consensus_meta.cc:287] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b: Time spent flushing consensus metadata: real 0.908s	user 0.009s	sys 0.000s
W20260709 13:00:56.526129  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:56.459331  5877 raft_consensus.cc:515] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:56.710394  1646 leader_election.cc:304] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:56.711346  1646 leader_election.cc:304] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:56.459163  6255 raft_consensus.cc:515] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:56.555915   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:56.525440  6375 raft_consensus.cc:493] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
W20260709 13:00:56.620302  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:56.514420  1572 leader_election.cc:304] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
W20260709 13:00:56.596259  6337 log.cc:927] Time spent T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.640s	user 0.004s	sys 0.001s
I20260709 13:00:56.730934  2224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50310 (request call id 952) took 1113 ms. Trace:
I20260709 13:00:56.731344  2224 rpcz_store.cc:276] 0709 13:00:55.618032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.618171 (+   139us) service_pool.cc:224] Handling call
0709 13:00:55.618539 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:55.722986 (+104447us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:55.723015 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:55.723460 (+   445us) log.cc:844] Serialized 26 byte log entry
0709 13:00:55.804988 (+ 81528us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:55.805023 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:56.597188 (+792165us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b5400600ed4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:00:56.597236 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:56.711863 (+114627us) raft_consensus.cc:1685] finished
0709 13:00:56.711885 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:56.730873 (+ 18988us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6054,"raft.queue_time_us":96582,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":28597,"spinlock_wait_cycles":239474944,"thread_start_us":81226,"threads_started":1,"wal-append.queue_time_us":501881}
I20260709 13:00:56.455664  6302 raft_consensus.cc:697] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 12 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:56.513067  5849 raft_consensus.cc:515] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:56.480800  6002 raft_consensus.cc:515] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:56.447360  6283 raft_consensus.cc:515] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:56.462283  5909 raft_consensus.cc:493] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.535794  1527 raft_consensus.cc:1240] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:56.470598  5827 leader_election.cc:290] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:56.547030  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:56.525635  6356 leader_election.cc:290] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:00:56.535003  1532 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43008 (request call id 2213) took 1660 ms (client timeout 2153 ms). Trace:
W20260709 13:00:56.475430  6267 consensus_meta.cc:287] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.738s	user 0.009s	sys 0.001s
I20260709 13:00:56.554975  6303 raft_consensus.cc:493] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
W20260709 13:00:56.544137  6204 consensus_meta.cc:287] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 1.085s	user 0.009s	sys 0.002s
I20260709 13:00:56.531082  6152 raft_consensus.cc:3060] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:56.542301  6277 consensus_meta.cc:287] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 1.078s	user 0.011s	sys 0.002s
W20260709 13:00:56.628964  6159 consensus_meta.cc:287] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent flushing consensus metadata: real 1.026s	user 0.009s	sys 0.000s
I20260709 13:00:56.598584  6223 leader_election.cc:290] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:56.593858  6328 raft_consensus.cc:515] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:56.583964  6292 raft_consensus.cc:493] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:00:56.645898  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:56.808298  1523 raft_consensus.cc:2410] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:00:56.647392  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:56.648595  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:56.780519  6091 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.644265  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:56.712890  6185 raft_consensus.cc:515] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:56.657529  2191 leader_election.cc:304] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:56.660236  1497 leader_election.cc:304] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:56.670601  1528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43010 (request call id 2309) took 1640 ms. Trace:
I20260709 13:00:56.642944  1674 consensus_queue.cc:260] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:56.844937  1674 raft_consensus.cc:3060] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:56.574919  6012 raft_consensus.cc:3060] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:56.695487  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43010 (request call id 2314) took 1653 ms. Trace:
I20260709 13:00:56.661937  6125 raft_consensus.cc:515] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:56.692884  6330 raft_consensus.cc:493] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.645702  6260 raft_consensus.cc:493] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:56.679606  6272 raft_consensus.cc:740] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:56.709007  6324 leader_election.cc:290] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:56.651930  6278 raft_consensus.cc:493] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:56.870875  6260 raft_consensus.cc:3060] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:56.871246  6278 raft_consensus.cc:515] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:56.871459  6272 consensus_queue.cc:260] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:56.872654  6272 raft_consensus.cc:3060] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:56.873523  6278 leader_election.cc:290] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:56.717731  6275 leader_election.cc:290] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:56.688117  5732 raft_consensus.cc:2749] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:56.656845  6308 raft_consensus.cc:493] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:56.874938  6308 raft_consensus.cc:515] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:56.875736  6380 raft_consensus.cc:493] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:56.876269  6380 raft_consensus.cc:515] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:56.877079  6308 leader_election.cc:290] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:56.716218  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:56.723846  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:56.878238  6380 leader_election.cc:290] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:56.729326  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
W20260709 13:00:56.735595  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 221265us
I20260709 13:00:56.878798  6331 raft_consensus.cc:2804] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:56.699501  6287 raft_consensus.cc:493] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:56.879204  1572 leader_election.cc:304] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:56.879580  6287 raft_consensus.cc:515] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:56.879961  6275 raft_consensus.cc:2749] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:56.880335  5849 leader_election.cc:290] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:56.880980  1572 leader_election.cc:304] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:56.882606  1572 leader_election.cc:304] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:56.740046  2219 raft_consensus.cc:1240] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 15 LEADER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 13:00:56.739715  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:56.699355  6174 raft_consensus.cc:493] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:00:56.788322  5909 raft_consensus.cc:515] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:56.782873  2218 raft_consensus.cc:1275] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:00:56.887189  1572 leader_election.cc:304] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:56.739456  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:56.740334  2224 raft_consensus.cc:1240] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 12. Current term is 13. Ops: []
W20260709 13:00:56.782861  1532 rpcz_store.cc:269] 0709 13:00:54.874122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.874978 (+   856us) service_pool.cc:224] Handling call
0709 13:00:56.534838 (+1659860us) spinlock_profiling.cc:243] Waited 314 ms on lock 0x7b54000e9f54. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:56.534949 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":721088896}
I20260709 13:00:56.781136  1672 raft_consensus.cc:2376] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 13. Re-sending same reply.
W20260709 13:00:56.797494  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 324459us
I20260709 13:00:56.722752  6276 raft_consensus.cc:493] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.669744  6273 raft_consensus.cc:515] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:56.737203  6128 raft_consensus.cc:3060] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:56.647059  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:56.894193  1601 raft_consensus.cc:2468] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 9.
I20260709 13:00:56.798398  6204 raft_consensus.cc:515] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:56.810880  1599 raft_consensus.cc:2393] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 11: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:00:56.809602  2190 leader_election.cc:304] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:56.811404  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:56.651657  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:56.812424  1604 raft_consensus.cc:2393] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 15: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:00:56.797324  6355 raft_consensus.cc:2804] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:56.728875  6344 leader_election.cc:290] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:56.879226  6331 raft_consensus.cc:493] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:56.721073  6007 consensus_queue.cc:1059] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.083s
W20260709 13:00:56.850807  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 190643us
I20260709 13:00:56.816391  6292 raft_consensus.cc:515] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:56.890358  6174 raft_consensus.cc:3060] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:56.845726  1526 rpcz_store.cc:276] 0709 13:00:55.042454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.094599 (+ 52145us) service_pool.cc:224] Handling call
0709 13:00:56.348873 (+1254274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:56.643579 (+294706us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:56.695301 (+ 51722us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b54001400d0. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b28ad 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:56.695430 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2882169600}
I20260709 13:00:56.949553  1527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49310 (request call id 1141) took 1131 ms. Trace:
I20260709 13:00:56.846239  1528 rpcz_store.cc:276] 0709 13:00:55.030509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.049130 (+ 18621us) service_pool.cc:224] Handling call
0709 13:00:55.059247 (+ 10117us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:55.301031 (+241784us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:00:55.322066 (+ 21035us) log.cc:844] Serialized 14 byte log entry
0709 13:00:55.797979 (+475913us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:55.798237 (+   258us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:55.798507 (+   270us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:56.670299 (+871792us) spinlock_profiling.cc:243] Waited 242 ms on lock 0x7b54000618d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:00:56.670360 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:56.670531 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":29680,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":42,"raft.queue_time_us":90027,"raft.run_cpu_time_us":42,"raft.run_wall_time_us":42,"spinlock_wait_cycles":555497344,"thread_start_us":475147,"threads_started":2,"wal-append.queue_time_us":291671,"wal-append.run_cpu_time_us":1238,"wal-append.run_wall_time_us":1028077}
W20260709 13:00:56.852145  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 194723us
I20260709 13:00:56.791539  6303 raft_consensus.cc:515] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:56.838075  6091 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:56.866874  5827 consensus_queue.cc:1059] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:56.867656  6370 raft_consensus.cc:2804] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:00:56.728205  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:56.887243  1646 leader_election.cc:304] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:56.888406  2225 raft_consensus.cc:2393] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 10: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:00:56.892118  1674 raft_consensus.cc:1275] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 13. (term mismatch)
I20260709 13:00:56.895133  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:56.649725  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:56.803273  6277 raft_consensus.cc:515] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:56.928373  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:56.929211  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:56.941502  6331 raft_consensus.cc:3060] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:56.966883  6273 leader_election.cc:290] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:56.941994  6203 raft_consensus.cc:493] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.851933  6265 raft_consensus.cc:493] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.967828  6203 raft_consensus.cc:515] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:56.968029  6265 raft_consensus.cc:515] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:56.969900  6203 leader_election.cc:290] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:56.970144  6265 leader_election.cc:290] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:56.896978  6302 consensus_queue.cc:237] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:56.894694  6330 raft_consensus.cc:515] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:56.970973  6287 leader_election.cc:290] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:56.971832  6255 leader_election.cc:290] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:56.936250  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:00:56.972275  5972 consensus_meta.cc:287] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.850s	user 0.005s	sys 0.010s
W20260709 13:00:56.938817  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 129312us
I20260709 13:00:56.942479  1497 leader_election.cc:304] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:56.974866  6277 leader_election.cc:290] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:56.792032  6364 raft_consensus.cc:2804] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:56.793241  6379 raft_consensus.cc:3060] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:56.975603  6287 raft_consensus.cc:2804] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:00:56.976209  6287 raft_consensus.cc:697] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:00:56.977074  6287 consensus_queue.cc:237] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:56.975718  6364 raft_consensus.cc:493] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:56.978185  6364 raft_consensus.cc:3060] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:56.972728  5972 raft_consensus.cc:515] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:56.979171  1599 raft_consensus.cc:2393] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 13: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:00:56.979589  1676 raft_consensus.cc:2393] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 13: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:00:56.890609  6356 raft_consensus.cc:2749] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:56.947685  6193 raft_consensus.cc:2764] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:00:56.980055  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:56.891935  6267 raft_consensus.cc:493] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.980814  1599 raft_consensus.cc:2393] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 15: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:00:56.980710  6267 raft_consensus.cc:515] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:56.966971  6283 leader_election.cc:290] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:56.951462  6376 raft_consensus.cc:493] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.983140  6376 raft_consensus.cc:515] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:56.975373  1497 leader_election.cc:304] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:56.953133  1527 rpcz_store.cc:276] 0709 13:00:55.817838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.991164 (+173326us) service_pool.cc:224] Handling call
0709 13:00:56.535625 (+544461us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:56.781616 (+245991us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:56.949349 (+167733us) spinlock_profiling.cc:243] Waited 544 ms on lock 0x7b54000e9f50. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b28ad 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:56.949493 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1251604864}
W20260709 13:00:56.984920  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 97805.4us
I20260709 13:00:56.954994  2191 leader_election.cc:304] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:56.928031  6355 raft_consensus.cc:493] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:56.925756  6278 raft_consensus.cc:493] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:56.959635  1674 pending_rounds.cc:85] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90: Aborting all ops after (but not including) 12
I20260709 13:00:57.017975  1674 pending_rounds.cc:107] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90: Aborting uncommitted NO_OP operation due to leader change: 14.13
I20260709 13:00:57.018277  1674 raft_consensus.cc:2889] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:57.019089  1674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50664 (request call id 1087) took 1777 ms. Trace:
I20260709 13:00:56.961314  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:57.019475  1674 rpcz_store.cc:276] 0709 13:00:55.241269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.621498 (+380229us) service_pool.cc:224] Handling call
0709 13:00:55.621776 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:56.349595 (+727819us) spinlock_profiling.cc:243] Waited 66.7 ms on lock 0x7b540034f920. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a1852adc0 00007f6a185b51c0 00007f6a185b6231 00007f6a185b2d8f 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c
0709 13:00:57.018785 (+669190us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:57.019027 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":153410432}
I20260709 13:00:56.927661  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:56.909716  6276 raft_consensus.cc:515] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:56.963487  6292 leader_election.cc:290] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:56.963768  6185 leader_election.cc:290] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:56.979948  6328 leader_election.cc:290] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:56.964141  1598 raft_consensus.cc:3060] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:56.965418  6204 leader_election.cc:290] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:56.965934  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:56.736488  6375 raft_consensus.cc:515] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:00:56.975288  6372 log.cc:927] Time spent T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 13:00:56.983363  1599 raft_consensus.cc:1240] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:56.926024  6244 raft_consensus.cc:2749] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:00:56.985222  1497 leader_election.cc:304] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:56.986078  1646 leader_election.cc:304] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:00:57.034336  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 79430.7us
I20260709 13:00:56.960819  6370 raft_consensus.cc:493] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:57.042982  6174 raft_consensus.cc:515] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:57.043839  6370 raft_consensus.cc:3060] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:56.958282  6189 consensus_queue.cc:1048] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:00:57.020344  1604 raft_consensus.cc:2468] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 10.
I20260709 13:00:57.025821  1607 raft_consensus.cc:1275] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:00:57.039108  1603 raft_consensus.cc:2468] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 12.
I20260709 13:00:57.021041  5732 raft_consensus.cc:2749] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:00:57.024045  6168 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
I20260709 13:00:56.983811  6338 raft_consensus.cc:493] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.032392  1599 raft_consensus.cc:1240] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:57.034248  1601 raft_consensus.cc:2393] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 15: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:00:57.035322  2191 leader_election.cc:304] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:57.017381  6273 raft_consensus.cc:493] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:57.039332  6330 leader_election.cc:290] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:57.039814  6185 raft_consensus.cc:2749] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:00:57.047547  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 61545.6us
I20260709 13:00:57.062486  1646 leader_election.cc:304] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:57.063616  1646 leader_election.cc:304] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:57.064632  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:57.065503  1674 raft_consensus.cc:2393] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 10: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:00:56.963970  6091 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:57.048252  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:57.066279  1527 raft_consensus.cc:3060] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:57.048844  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 63707.5us
I20260709 13:00:57.066372  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:57.045710  1604 raft_consensus.cc:1240] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:57.050832  6383 consensus_queue.cc:1059] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:00:57.052368  5827 raft_consensus.cc:3060] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:57.048177  1606 raft_consensus.cc:2393] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 11: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:00:57.067541  1497 leader_election.cc:304] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:57.019371  6351 raft_consensus.cc:2749] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:57.056020  1598 raft_consensus.cc:2468] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 12.
I20260709 13:00:56.981243  5972 leader_election.cc:290] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:56.898164  1572 leader_election.cc:304] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:57.024930  6355 raft_consensus.cc:3060] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:57.039198  6375 leader_election.cc:290] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:57.071902  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:57.074180  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:57.074440  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 16 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:57.098003  1607 raft_consensus.cc:1275] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:00:56.890965  6275 raft_consensus.cc:2749] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:00:57.105799  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 207730us
I20260709 13:00:57.102125  1602 raft_consensus.cc:2393] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 11: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:00:57.032124  6260 raft_consensus.cc:515] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:57.131667  6260 leader_election.cc:290] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:57.133028  5732 raft_consensus.cc:2804] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:00:57.132930  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 65459.8us
I20260709 13:00:57.133561  5732 raft_consensus.cc:493] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:57.133970  5732 raft_consensus.cc:3060] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:57.134701  6184 consensus_queue.cc:1059] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 13:00:57.135700  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:57.135960  6184 raft_consensus.cc:3055] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:57.136358  6184 raft_consensus.cc:740] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:57.137065  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:57.136972  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:57.138221  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:57.138594  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:57.138792  1524 raft_consensus.cc:3060] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:57.139143  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:57.139775  6091 consensus_queue.cc:1059] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:57.140323  1525 raft_consensus.cc:1240] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:57.139809  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:57.141784  1532 raft_consensus.cc:3060] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:57.144824  6379 raft_consensus.cc:2749] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:57.145082  6174 leader_election.cc:290] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:57.145488  1524 raft_consensus.cc:2468] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 9.
I20260709 13:00:57.137176  6184 consensus_queue.cc:260] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:57.147212  6276 leader_election.cc:290] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:57.148041  6303 leader_election.cc:290] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:57.148964  6125 leader_election.cc:290] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:57.149394  1497 leader_election.cc:304] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
W20260709 13:00:57.149992  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:57.150395  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:57.152431  6128 raft_consensus.cc:2749] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:57.153910  5747 leader_election.cc:290] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:57.155793  1532 raft_consensus.cc:2468] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 15.
I20260709 13:00:57.081642  6338 raft_consensus.cc:515] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:57.163487  6338 leader_election.cc:290] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:57.164285  1677 raft_consensus.cc:2468] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 8.
I20260709 13:00:57.127314  6374 raft_consensus.cc:2749] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:57.157474  5877 leader_election.cc:290] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:57.167841  6376 leader_election.cc:290] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:57.127214  6368 raft_consensus.cc:2749] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:57.059356  6391 raft_consensus.cc:2749] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:57.126597  6328 raft_consensus.cc:2804] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:57.159096  5909 leader_election.cc:290] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:57.159761  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:57.173051  1674 raft_consensus.cc:3060] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:57.111142  5849 consensus_queue.cc:1048] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.064s
I20260709 13:00:57.175223  6338 raft_consensus.cc:493] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.175762  6338 raft_consensus.cc:515] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:57.025223  6278 raft_consensus.cc:515] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:57.059870  6193 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.177039  6193 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:57.178254  6278 leader_election.cc:290] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:57.178834  6278 raft_consensus.cc:493] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:57.179267  6278 raft_consensus.cc:515] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:57.180382  6193 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:57.181159  6278 leader_election.cc:290] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:57.181725  6338 leader_election.cc:290] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:00:57.184837  6386 log.cc:927] Time spent T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.165s	user 0.000s	sys 0.000s
I20260709 13:00:57.188823  1528 raft_consensus.cc:1275] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:00:57.189284  1528 pending_rounds.cc:85] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting all ops after (but not including) 4
I20260709 13:00:57.189507  1528 pending_rounds.cc:107] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:00:57.189720  1528 raft_consensus.cc:2889] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:57.191016  1523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43010 (request call id 2329) took 1151 ms. Trace:
W20260709 13:00:57.198050  6381 log.cc:927] Time spent T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.256s	user 0.000s	sys 0.002s
W20260709 13:00:57.205300  1676 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49178 (request call id 2101) took 1217 ms (client timeout 1611 ms). Trace:
W20260709 13:00:57.205811  1676 rpcz_store.cc:269] 0709 13:00:55.988030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.988163 (+   133us) service_pool.cc:224] Handling call
0709 13:00:57.205063 (+1216900us) spinlock_profiling.cc:243] Waited 990 ms on lock 0x7b54000b7cd4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:57.205232 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2277550464}
I20260709 13:00:57.147243  6184 raft_consensus.cc:3060] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:57.211417  6159 raft_consensus.cc:3055] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:57.211937  6159 raft_consensus.cc:740] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:00:57.158448  1644 leader_election.cc:304] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:00:57.212960  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 54598.8us
I20260709 13:00:57.214099  6338 raft_consensus.cc:493] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:57.214920  6329 raft_consensus.cc:2749] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:00:57.215246  1532 raft_consensus.cc:1240] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:57.215970  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:57.216543  1525 raft_consensus.cc:3060] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:57.214609  6338 raft_consensus.cc:515] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:57.218360  6338 leader_election.cc:290] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:57.107440  6002 leader_election.cc:290] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:57.228040  6347 leader_election.cc:290] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:57.228521  6329 consensus_queue.cc:1059] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:57.229765  6329 raft_consensus.cc:3055] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:57.230170  6329 raft_consensus.cc:740] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:57.231307  6329 consensus_queue.cc:260] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:57.232736  6329 raft_consensus.cc:3060] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:57.237165  1496 leader_election.cc:304] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:57.237555  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:57.238189  1677 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 14.
I20260709 13:00:57.239154  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:57.239784  1677 raft_consensus.cc:2468] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 12.
I20260709 13:00:57.240562  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:57.241380  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:57.242890  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:57.244640  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:57.249312  1674 raft_consensus.cc:2468] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 14.
I20260709 13:00:57.191700  1523 rpcz_store.cc:276] 0709 13:00:56.040977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:56.240697 (+199720us) service_pool.cc:224] Handling call
0709 13:00:57.188317 (+947620us) spinlock_profiling.cc:243] Waited 561 ms on lock 0x7b54000c21d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:57.190944 (+  2627us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1289892736}
I20260709 13:00:57.253624  1527 raft_consensus.cc:2468] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 9.
W20260709 13:00:57.106133  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:57.259382  6347 raft_consensus.cc:2749] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:00:57.261268  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 13:00:57.261812  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 334439us
I20260709 13:00:57.263085  2192 leader_election.cc:304] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:57.262108  1523 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 14.
I20260709 13:00:57.267727  2192 leader_election.cc:304] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:57.268924  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:57.098217  6088 raft_consensus.cc:2804] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:57.270892  1531 raft_consensus.cc:1217] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Deduplicated request from leader. Original: 11.11->[13.12-14.13]   Dedup: 13.12->[14.13-14.13]
I20260709 13:00:57.271438  1531 raft_consensus.cc:1240] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 14. Current term is 15. Ops: [13.12-14.13]
I20260709 13:00:57.272073  1530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49310 (request call id 1149) took 1002 ms. Trace:
I20260709 13:00:57.273203  1496 leader_election.cc:304] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
W20260709 13:00:57.273357  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:57.274148  2192 leader_election.cc:304] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:00:57.276117  1571 leader_election.cc:304] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:57.275118  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:57.272534  1530 rpcz_store.cc:276] 0709 13:00:56.269423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:56.661206 (+391783us) service_pool.cc:224] Handling call
0709 13:00:56.661612 (+   406us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:56.671480 (+  9868us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:56.671510 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:56.672140 (+   630us) log.cc:844] Serialized 52 byte log entry
0709 13:00:56.815904 (+143764us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:00:57.270192 (+454288us) log.cc:844] Serialized 14 byte log entry
0709 13:00:57.270475 (+   283us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:57.270544 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:57.270585 (+    41us) raft_consensus.cc:1685] finished
0709 13:00:57.270596 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:57.272011 (+  1415us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9444,"prepare.queue_time_us":134889,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":10367,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":19040,"thread_start_us":487185,"threads_started":2,"wal-append.queue_time_us":325643}
I20260709 13:00:57.279928  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:57.279228  1525 raft_consensus.cc:2468] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 13.
I20260709 13:00:57.280790  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:57.281282  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:57.282419  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:57.282974  1529 raft_consensus.cc:3060] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:57.285037  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:57.285254  1497 leader_election.cc:304] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:57.285646  1524 raft_consensus.cc:2468] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 12.
I20260709 13:00:57.289875  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:57.292375  1527 raft_consensus.cc:2468] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 12.
I20260709 13:00:57.291531  1497 leader_election.cc:304] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:57.294238  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:57.295331  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:57.295621  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:57.296093  1525 raft_consensus.cc:2368] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 13. Current term is 14.
I20260709 13:00:57.296442  2224 raft_consensus.cc:1275] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:00:57.291421  1496 leader_election.cc:304] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:57.297901  2223 raft_consensus.cc:1275] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:00:57.099984  6273 raft_consensus.cc:515] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:57.268663  6374 raft_consensus.cc:2749] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:57.299341  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:57.298393  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:57.302004  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:57.302620  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:57.097438  6369 consensus_queue.cc:1048] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.183s
I20260709 13:00:57.302940  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:57.303644  1644 leader_election.cc:304] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:57.278473  6328 raft_consensus.cc:697] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 13 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
W20260709 13:00:57.268652  6341 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.029s	sys 0.032s
W20260709 13:00:57.323053  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 46999.1us
I20260709 13:00:57.324117  1571 leader_election.cc:304] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:00:57.328855  1571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:57.270109  6019 raft_consensus.cc:3060] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:57.334390  1529 raft_consensus.cc:2468] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 11.
I20260709 13:00:57.314476  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:57.338845  1530 raft_consensus.cc:2468] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 12.
I20260709 13:00:57.339973  1525 raft_consensus.cc:1240] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:57.340751  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:57.341919  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:57.275079  6193 raft_consensus.cc:2749] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:57.278776  6125 raft_consensus.cc:493] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.304494  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:57.283427  6266 raft_consensus.cc:2804] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:57.353650  6174 raft_consensus.cc:2804] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:57.321756  1523 raft_consensus.cc:2393] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 13: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:00:57.212826  6159 consensus_queue.cc:260] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:57.294307  5761 raft_consensus.cc:2804] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:57.266886  6364 raft_consensus.cc:515] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:57.338212  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:57.339471  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:57.363227  1607 raft_consensus.cc:2468] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 8.
I20260709 13:00:57.274818  6088 raft_consensus.cc:493] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:00:57.343696  1644 leader_election.cc:304] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:57.346156  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:57.321980  6285 raft_consensus.cc:493] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.293855  6346 raft_consensus.cc:2749] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:57.348204  1678 raft_consensus.cc:1240] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 15 LEADER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 13:00:57.368523  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:57.306927  6082 raft_consensus.cc:3060] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:57.348327  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:57.376341  1607 raft_consensus.cc:2393] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 14: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:00:57.355436  1570 leader_election.cc:304] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:57.358248  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:00:57.335785  6341 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.029s	sys 0.033s
I20260709 13:00:57.310226  6091 raft_consensus.cc:2804] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:00:57.365739  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:57.345474  5976 raft_consensus.cc:2804] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:57.198305  6331 raft_consensus.cc:515] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:57.378448  1646 leader_election.cc:304] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:57.411371  1674 raft_consensus.cc:2393] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 15: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:00:57.380107  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:57.415179  1599 raft_consensus.cc:2468] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 12.
I20260709 13:00:57.384435  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:57.416452  1607 raft_consensus.cc:3060] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:57.354003  6266 raft_consensus.cc:493] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
W20260709 13:00:57.419384  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 64028.4us
I20260709 13:00:57.421226  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:57.428202  1570 leader_election.cc:304] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:57.346199  6376 consensus_queue.cc:1059] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
W20260709 13:00:57.433751  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 55412.5us
I20260709 13:00:57.367394  5761 raft_consensus.cc:493] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:57.437739  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:57.365520  6088 raft_consensus.cc:3060] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:57.442854  1602 raft_consensus.cc:1240] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 13. Current term is 14. Ops: []
I20260709 13:00:57.439064  1646 leader_election.cc:304] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:57.374958  6174 raft_consensus.cc:697] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 13 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:57.444231  6378 raft_consensus.cc:493] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:57.448850  1646 leader_election.cc:304] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:57.454146  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:57.360330  6125 raft_consensus.cc:515] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:57.465588  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:57.455363  1570 leader_election.cc:304] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:57.477389  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:57.432055  6272 raft_consensus.cc:2804] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:57.434370  6266 raft_consensus.cc:3060] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:57.478163  1672 raft_consensus.cc:2368] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 13. Current term is 14.
I20260709 13:00:57.380760  6369 raft_consensus.cc:2804] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:57.441270  6370 raft_consensus.cc:515] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:57.428826  6091 raft_consensus.cc:697] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:00:57.431982  5976 raft_consensus.cc:697] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 13 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:57.436410  6391 raft_consensus.cc:2749] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:57.479734  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:57.378774  6285 raft_consensus.cc:515] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:57.467533  6283 raft_consensus.cc:2804] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:00:57.476606  1570 leader_election.cc:304] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:57.369024  6292 consensus_queue.cc:1059] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.096s
I20260709 13:00:57.480983  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:57.445358  5761 raft_consensus.cc:3060] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:57.446614  6276 raft_consensus.cc:493] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.453521  6324 raft_consensus.cc:2749] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:57.497108  1526 raft_consensus.cc:1240] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 15. Current term is 16. Ops: []
I20260709 13:00:57.487567  6351 raft_consensus.cc:2764] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:00:57.493325  1570 leader_election.cc:400] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 pre-election: Vote denied by peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931) with higher term. Message: Invalid argument: T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 13. Current term is 14.
I20260709 13:00:57.482694  6002 raft_consensus.cc:2804] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:57.504746  1601 raft_consensus.cc:2468] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 13.
I20260709 13:00:57.496305  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:57.474447  6359 consensus_queue.cc:1048] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:00:57.496482  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:57.485414  1646 leader_election.cc:304] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:57.492489  6377 raft_consensus.cc:2804] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:57.509105  6377 raft_consensus.cc:493] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:57.509502  6377 raft_consensus.cc:3060] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:57.511838  6125 leader_election.cc:290] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:57.498999  6276 raft_consensus.cc:515] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:57.515430  6091 consensus_queue.cc:237] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:57.515976  6285 leader_election.cc:290] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:57.516618  6276 leader_election.cc:290] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:57.481617  6369 raft_consensus.cc:493] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:57.518427  6369 raft_consensus.cc:3060] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:57.519771  6273 leader_election.cc:290] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:57.481801  6378 raft_consensus.cc:515] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:57.501684  1495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:57.523177  6378 leader_election.cc:290] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:57.499054  6174 consensus_queue.cc:237] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:57.525264  1607 raft_consensus.cc:2468] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 13.
I20260709 13:00:57.497182  6205 raft_consensus.cc:2764] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:00:57.470404  6328 consensus_queue.cc:237] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:57.518119  5732 raft_consensus.cc:515] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:57.528530  5732 leader_election.cc:290] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:57.503319  1570 leader_election.cc:403] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:57.529150  6378 raft_consensus.cc:2749] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:57.500998  6283 raft_consensus.cc:697] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 15 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:57.530473  1570 leader_election.cc:304] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:57.530282  6283 consensus_queue.cc:237] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:57.526952  1646 leader_election.cc:304] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:57.532869  1646 leader_election.cc:304] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:57.533617  6323 raft_consensus.cc:3060] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:57.533799  6356 raft_consensus.cc:3060] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:00:57.534075  6378 raft_consensus.cc:2749] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:57.534758  6371 raft_consensus.cc:493] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.535291  6371 raft_consensus.cc:515] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:57.537416  6371 leader_election.cc:290] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:57.537925  6371 raft_consensus.cc:2804] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:57.538260  6335 consensus_queue.cc:1048] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.185s
I20260709 13:00:57.539793  1646 leader_election.cc:304] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:57.541460  6324 raft_consensus.cc:2749] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:00:57.542156  6324 consensus_queue.cc:1059] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:00:57.543223  6324 raft_consensus.cc:3055] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:00:57.514959  5976 consensus_queue.cc:237] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:57.543598  6324 raft_consensus.cc:740] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:57.544540  6324 consensus_queue.cc:260] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:57.545898  6324 raft_consensus.cc:3060] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:00:57.547564  6396 log.cc:927] Time spent T 00000000000000000000000000000000 P 9f38d0e5c9db43a48554defe1153354e: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 13:00:57.487708  6272 raft_consensus.cc:697] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 9 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:57.538055  1602 raft_consensus.cc:1275] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:00:57.568954  1523 raft_consensus.cc:1240] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 14. Current term is 15. Ops: []
I20260709 13:00:57.570261  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:57.549631  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:00:57.550341  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:57.573928  6351 consensus_queue.cc:1059] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:57.573621  1677 raft_consensus.cc:2468] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 13.
I20260709 13:00:57.577808  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:00:57.548980  6390 log.cc:927] Time spent T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:00:57.506476  6002 raft_consensus.cc:493] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:57.590312  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:57.508169  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
W20260709 13:00:57.590533  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 287728us
I20260709 13:00:57.577222  6371 raft_consensus.cc:697] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 11 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:57.620054  1672 raft_consensus.cc:1275] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:00:57.613185  6205 raft_consensus.cc:493] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.582911  6351 raft_consensus.cc:3055] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:00:57.589744  6002 raft_consensus.cc:3060] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:57.639226  1672 raft_consensus.cc:1275] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:00:57.620976  2190 leader_election.cc:304] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:57.657928  1600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36194 (request call id 1873) took 1015 ms. Trace:
I20260709 13:00:57.662482  1604 raft_consensus.cc:1240] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 13 LEADER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:57.658401  1600 rpcz_store.cc:276] 0709 13:00:56.642608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:56.643151 (+   543us) service_pool.cc:224] Handling call
0709 13:00:56.643463 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:56.860838 (+217375us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:56.860871 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:56.860914 (+    43us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:56.860943 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:57.657682 (+796739us) spinlock_profiling.cc:243] Waited 217 ms on lock 0x7b54002ac954. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:00:57.657735 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:57.657869 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":499463936}
I20260709 13:00:57.614446  6374 consensus_queue.cc:1059] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 13:00:57.669170  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
W20260709 13:00:57.669651  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 55626.1us
I20260709 13:00:57.618458  6383 consensus_queue.cc:1059] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:00:57.638456  6364 leader_election.cc:290] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:57.674206  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:57.675659  1672 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 14.
I20260709 13:00:57.676518  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:57.682143  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:57.683089  2219 raft_consensus.cc:2468] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 11.
I20260709 13:00:57.629226  6265 consensus_queue.cc:1048] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 13:00:57.645207  6351 raft_consensus.cc:740] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:57.650192  6007 raft_consensus.cc:493] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.691282  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:57.692965  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:57.696686  2219 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 14.
I20260709 13:00:57.693616  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:57.661589  6252 raft_consensus.cc:476] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 LEADER]: Not starting pre-election -- already a leader
I20260709 13:00:57.651312  6205 raft_consensus.cc:515] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:57.704253  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:57.704859  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:57.709271  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:57.709909  2227 raft_consensus.cc:2468] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 10.
I20260709 13:00:57.710752  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:57.713613  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:57.714248  1600 raft_consensus.cc:2468] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 13.
I20260709 13:00:57.711786  2218 raft_consensus.cc:2393] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 12: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:00:57.719347  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:57.716562  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:57.720623  1600 raft_consensus.cc:2393] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 15: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:00:57.721745  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
W20260709 13:00:57.715179  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 44341.3us
I20260709 13:00:57.722878  2219 raft_consensus.cc:1240] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 14. Current term is 15. Ops: [12.12-14.13]
I20260709 13:00:57.726451  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:57.696837  6331 leader_election.cc:290] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:00:57.711531  6395 log.cc:927] Time spent T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.230s	user 0.001s	sys 0.000s
I20260709 13:00:57.725937  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 13:00:57.713078  6355 consensus_meta.cc:287] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.516s	user 0.009s	sys 0.001s
I20260709 13:00:57.732221  1646 leader_election.cc:304] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:57.736521  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:57.742133  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:57.747433  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 16 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:57.698189  6404 raft_consensus.cc:2804] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:00:57.834144  6407 log.cc:927] Time spent T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
W20260709 13:00:57.896044  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:57.786283  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:00:57.785681  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 53548.8us
I20260709 13:00:57.902994  1672 raft_consensus.cc:1275] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:00:57.912086  1530 raft_consensus.cc:1275] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:00:57.803153  2191 leader_election.cc:304] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:57.982583  6404 raft_consensus.cc:697] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 9 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:57.982834  6342 raft_consensus.cc:493] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:57.983897  6342 raft_consensus.cc:515] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:57.742934  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:57.985883  6260 raft_consensus.cc:2749] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:57.785454  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:57.988334  2220 raft_consensus.cc:2393] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 15: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:00:57.794138  2226 raft_consensus.cc:1240] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:57.801249  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:57.793813  5976 raft_consensus.cc:2749] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:57.995585  6342 leader_election.cc:290] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:57.699744  6007 raft_consensus.cc:515] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:57.836540  6266 raft_consensus.cc:515] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:57.997905  1646 leader_election.cc:304] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:57.665549  6272 consensus_queue.cc:237] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:58.000008  6266 leader_election.cc:290] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:58.000515  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:58.001462  6364 raft_consensus.cc:493] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.002092  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:00:57.838682  6329 consensus_meta.cc:287] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.605s	user 0.005s	sys 0.005s
I20260709 13:00:57.797284  6351 consensus_queue.cc:260] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:57.735965  6352 consensus_queue.cc:1048] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.070s
I20260709 13:00:57.786612  6355 raft_consensus.cc:515] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:58.012717  1673 raft_consensus.cc:1240] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:00:57.840819  6356 raft_consensus.cc:2749] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931) with higher term. Message: Invalid argument: T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 13. Current term is 14.
I20260709 13:00:58.014184  6355 leader_election.cc:290] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:57.711383  6371 consensus_queue.cc:237] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:57.817716  6377 raft_consensus.cc:515] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:58.018699  6377 leader_election.cc:290] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:57.743098  6378 consensus_queue.cc:1048] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.062s
I20260709 13:00:58.019331  1600 raft_consensus.cc:2393] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 11: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:00:58.020833  1528 raft_consensus.cc:1240] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 9. Current term is 10. Ops: []
W20260709 13:00:57.830171  6403 log.cc:927] Time spent T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.191s	user 0.000s	sys 0.001s
W20260709 13:00:57.895721  1571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:57.925513  6205 leader_election.cc:290] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:57.931028  1529 raft_consensus.cc:1240] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:57.933794  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:58.028657  1527 raft_consensus.cc:2376] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 15. Re-sending same reply.
I20260709 13:00:57.951340  1598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 975) took 1300 ms. Trace:
I20260709 13:00:58.029215  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:57.960173  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36194 (request call id 1876) took 1314 ms. Trace:
I20260709 13:00:57.973323  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 987) took 1246 ms. Trace:
I20260709 13:00:57.970521  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:57.964912  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:58.002005  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:58.002810  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 16 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:58.031534  1523 raft_consensus.cc:2393] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 16: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:00:58.030181  1603 rpcz_store.cc:276] 0709 13:00:56.645231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:56.645659 (+   428us) service_pool.cc:224] Handling call
0709 13:00:57.959713 (+1314054us) spinlock_profiling.cc:243] Waited 230 ms on lock 0x7b54002670d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:57.959980 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":530136320}
I20260709 13:00:57.818038  6323 raft_consensus.cc:2749] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:57.987349  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:57.987318  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:57.820704  6369 raft_consensus.cc:515] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:58.030443  1606 rpcz_store.cc:276] 0709 13:00:56.709508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:56.928161 (+218653us) service_pool.cc:224] Handling call
0709 13:00:57.955216 (+1027055us) spinlock_profiling.cc:243] Waited 86 ms on lock 0x7b5400057654. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:57.955476 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":197795712}
I20260709 13:00:58.035991  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:58.003187  1532 raft_consensus.cc:1240] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:58.029740  1598 rpcz_store.cc:276] 0709 13:00:56.650501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:56.694797 (+ 44296us) service_pool.cc:224] Handling call
0709 13:00:57.950762 (+1255965us) spinlock_profiling.cc:243] Waited 85.6 ms on lock 0x7b54003b1fd4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:57.951049 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":196802944}
I20260709 13:00:58.036484  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:58.034279  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:58.042870  1681 raft_consensus.cc:2393] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 13: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:00:58.043313  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:00:57.984704  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 181493us
I20260709 13:00:58.018499  6007 leader_election.cc:290] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:58.042766  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:58.050153  2227 raft_consensus.cc:2393] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 15: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:00:58.034574  1677 raft_consensus.cc:2468] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 14.
I20260709 13:00:58.057448  1530 raft_consensus.cc:1240] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:57.984805  6404 consensus_queue.cc:237] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:58.059821  2191 leader_election.cc:304] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:58.062077  2191 leader_election.cc:304] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:58.063024  6360 raft_consensus.cc:2804] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:58.063604  6360 raft_consensus.cc:493] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:58.065164  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:58.065828  6360 raft_consensus.cc:3060] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:58.002295  6364 raft_consensus.cc:515] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:58.053552  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:58.065228  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:58.065299  6193 raft_consensus.cc:2749] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:00:58.057829  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:58.077155  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:58.079123  1676 raft_consensus.cc:1275] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:00:58.081069  1675 raft_consensus.cc:1275] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:00:58.081928  6364 leader_election.cc:290] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:58.083549  6369 leader_election.cc:290] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:58.084491  1523 raft_consensus.cc:2376] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 13. Re-sending same reply.
I20260709 13:00:58.087673  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
W20260709 13:00:58.088212  6324 consensus_meta.cc:287] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.542s	user 0.012s	sys 0.006s
I20260709 13:00:58.088696  6369 consensus_queue.cc:1059] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:58.090088  6369 raft_consensus.cc:3055] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:58.066263  1672 raft_consensus.cc:2468] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 8.
I20260709 13:00:58.103134  1598 raft_consensus.cc:2393] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 14: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:00:58.090621  6369 raft_consensus.cc:740] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:58.106297  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:58.109546  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:58.110564  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:58.090181  6335 raft_consensus.cc:2749] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:58.083585  6193 consensus_queue.cc:1059] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:00:58.115515  1673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50664 (request call id 1101) took 1040 ms. Trace:
I20260709 13:00:58.117617  1673 rpcz_store.cc:276] 0709 13:00:57.075181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.075313 (+   132us) service_pool.cc:224] Handling call
0709 13:00:57.127172 (+ 51859us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:58.013173 (+886001us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.115143 (+101970us) spinlock_profiling.cc:243] Waited 885 ms on lock 0x7b54002558d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:00:58.115436 (+   293us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2035483008}
W20260709 13:00:58.125936  5827 consensus_meta.cc:287] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent flushing consensus metadata: real 0.858s	user 0.006s	sys 0.010s
I20260709 13:00:58.130297  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:00:58.136783  1495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.142803  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:58.145220  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:58.146095  1598 raft_consensus.cc:2376] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 12. Re-sending same reply.
I20260709 13:00:58.147089  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:58.147439  1672 raft_consensus.cc:1240] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:58.120556  6369 consensus_queue.cc:260] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:58.159525  6331 raft_consensus.cc:3055] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:58.160049  6331 raft_consensus.cc:740] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:58.161266  6331 consensus_queue.cc:260] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:58.152732  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 155257us
I20260709 13:00:58.166497  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:58.118141  6422 consensus_queue.cc:1059] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 13:00:58.177709  1606 raft_consensus.cc:2468] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 14.
W20260709 13:00:58.179265  6082 consensus_meta.cc:287] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent flushing consensus metadata: real 0.772s	user 0.009s	sys 0.011s
I20260709 13:00:58.180078  6082 raft_consensus.cc:2749] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:58.181751  6331 raft_consensus.cc:3060] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:00:58.185002  1495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:58.175535  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 86272.4us
I20260709 13:00:58.190795  1598 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 14.
I20260709 13:00:58.165174  5827 raft_consensus.cc:2749] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:58.192988  6143 raft_consensus.cc:3055] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:58.195190  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:58.196522  1600 raft_consensus.cc:2393] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 15: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:00:58.195289  6143 raft_consensus.cc:740] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:58.198768  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:58.208499  1602 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 14.
I20260709 13:00:58.207988  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:58.221710  1602 raft_consensus.cc:1240] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 15 LEADER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 14. Current term is 15. Ops: []
I20260709 13:00:58.218405  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 16 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:58.230883  6143 consensus_queue.cc:260] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:58.230903  1602 raft_consensus.cc:1240] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 9 LEADER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:58.233793  6267 leader_election.cc:290] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:58.236055  1602 raft_consensus.cc:1240] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 13. Current term is 14. Ops: []
I20260709 13:00:58.236756  1680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50664 (request call id 1094) took 1171 ms. Trace:
I20260709 13:00:58.239471  1680 rpcz_store.cc:276] 0709 13:00:57.064904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.065048 (+   144us) service_pool.cc:224] Handling call
0709 13:00:57.065313 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:57.276887 (+211574us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:57.276918 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:57.276958 (+    40us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:00:57.276988 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.236262 (+959274us) spinlock_profiling.cc:243] Waited 211 ms on lock 0x7b54000b90d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:00:58.236374 (+   112us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:58.236585 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":486180096}
I20260709 13:00:58.236903  6382 raft_consensus.cc:493] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:58.242348  6382 raft_consensus.cc:515] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:58.237707  5849 raft_consensus.cc:3055] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:58.244830  5849 raft_consensus.cc:740] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:58.246006  5849 consensus_queue.cc:260] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:58.247247  5849 raft_consensus.cc:3060] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:58.238302  6369 raft_consensus.cc:3060] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:00:58.254724  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 56540.4us
W20260709 13:00:58.258970  6427 log.cc:927] Time spent T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.156s	user 0.000s	sys 0.003s
I20260709 13:00:58.259940  1602 raft_consensus.cc:1240] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:58.261631  1602 raft_consensus.cc:1240] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 11 LEADER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:58.265319  1677 raft_consensus.cc:1275] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:00:58.269832  1646 leader_election.cc:304] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:58.274384  6402 raft_consensus.cc:3055] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:58.276690  1598 raft_consensus.cc:2468] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 12.
I20260709 13:00:58.285827  6402 raft_consensus.cc:740] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:58.279362  6382 leader_election.cc:290] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:58.199741  6374 consensus_queue.cc:1059] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.112s
I20260709 13:00:58.263052  1602 raft_consensus.cc:1240] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:58.279191  1606 raft_consensus.cc:2410] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b for term 16 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
W20260709 13:00:58.297909  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 72765.8us
I20260709 13:00:58.298806  6159 raft_consensus.cc:3060] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:58.299592  1497 leader_election.cc:304] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:58.300617  6382 raft_consensus.cc:2804] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:58.301232  6382 raft_consensus.cc:493] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:58.301707  6382 raft_consensus.cc:3060] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:58.303272  6176 raft_consensus.cc:3055] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:58.303808  6176 raft_consensus.cc:740] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
W20260709 13:00:58.304368  6431 log.cc:927] Time spent T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.205s	user 0.002s	sys 0.000s
I20260709 13:00:58.305119  6176 consensus_queue.cc:260] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:58.307374  6402 consensus_queue.cc:260] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:58.308723  6402 raft_consensus.cc:3060] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:58.311758  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:58.312527  1532 raft_consensus.cc:2468] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 13.
I20260709 13:00:58.314029  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:58.314759  1531 raft_consensus.cc:2468] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 17.
I20260709 13:00:58.314131  6176 raft_consensus.cc:3060] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:58.320511  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:58.321568  1603 raft_consensus.cc:2393] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 13: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:00:58.323400  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:58.325152  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:58.325904  1531 raft_consensus.cc:3060] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:00:58.312389  6184 consensus_meta.cc:287] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 1.102s	user 0.008s	sys 0.012s
I20260709 13:00:58.327551  6370 leader_election.cc:290] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:58.328624  1673 raft_consensus.cc:1275] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:00:58.323431  6002 consensus_meta.cc:287] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.526s	user 0.009s	sys 0.006s
I20260709 13:00:58.330353  6002 raft_consensus.cc:515] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:58.331657  1601 raft_consensus.cc:2368] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 12. Current term is 13.
I20260709 13:00:58.336092  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:58.338289  1532 raft_consensus.cc:2468] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 15.
I20260709 13:00:58.341329  1644 leader_election.cc:304] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:58.350996  1606 raft_consensus.cc:1240] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:58.353449  1531 raft_consensus.cc:2468] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 13.
I20260709 13:00:58.344301  2191 leader_election.cc:304] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:58.362062  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49170 (request call id 2355) took 1006 ms. Trace:
I20260709 13:00:58.337344  6184 raft_consensus.cc:2749] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:58.368712  1602 raft_consensus.cc:1275] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:00:58.348870  6002 leader_election.cc:290] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:58.362586  1681 rpcz_store.cc:276] 0709 13:00:57.350240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.420973 (+ 70733us) service_pool.cc:224] Handling call
0709 13:00:58.347101 (+926128us) spinlock_profiling.cc:243] Waited 609 ms on lock 0x7b540031ced4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:58.356407 (+  9306us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1401602304}
I20260709 13:00:58.341307  6382 raft_consensus.cc:515] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:58.374765  6267 raft_consensus.cc:2804] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:58.386588  1644 leader_election.cc:304] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
W20260709 13:00:58.387497  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 99453.2us
I20260709 13:00:58.385046  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:58.387388  6302 raft_consensus.cc:3055] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:58.389038  6302 raft_consensus.cc:740] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:58.389362  6374 raft_consensus.cc:2804] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:00:58.389705  5761 consensus_meta.cc:287] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b: Time spent flushing consensus metadata: real 0.882s	user 0.007s	sys 0.011s
I20260709 13:00:58.390079  6302 consensus_queue.cc:260] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:58.391505  6193 raft_consensus.cc:3055] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:00:58.392042  6193 raft_consensus.cc:740] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:58.389814  6374 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:58.392707  6374 raft_consensus.cc:3060] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:00:58.393823  6019 consensus_meta.cc:287] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 1.028s	user 0.005s	sys 0.013s
W20260709 13:00:58.394200  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 124534us
I20260709 13:00:58.385994  6267 raft_consensus.cc:493] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:58.397135  1673 raft_consensus.cc:2393] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 13: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:00:58.397985  1605 raft_consensus.cc:2468] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 10.
I20260709 13:00:58.402688  6244 raft_consensus.cc:493] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.403227  6244 raft_consensus.cc:515] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:58.403334  6376 consensus_queue.cc:1048] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:00:58.404552  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.413275  1571 leader_election.cc:304] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:58.413460  5761 raft_consensus.cc:515] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:58.415908  5761 leader_election.cc:290] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:58.416786  2219 raft_consensus.cc:1240] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 10. Current term is 11. Ops: []
W20260709 13:00:58.413228  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.418886  6193 consensus_queue.cc:260] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:58.420192  6193 raft_consensus.cc:3060] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:58.376479  6360 raft_consensus.cc:515] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:58.395022  1646 leader_election.cc:304] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:58.428431  1644 leader_election.cc:304] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:58.436115  1644 leader_election.cc:304] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:58.424878  6267 raft_consensus.cc:3060] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:58.446067  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:58.446838  1598 raft_consensus.cc:3060] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:58.437831  6019 raft_consensus.cc:2749] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:58.438344  6184 raft_consensus.cc:2804] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:00:58.475309  6184 raft_consensus.cc:493] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:58.476027  6184 raft_consensus.cc:3060] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:00:58.479967  1605 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 977) took 1799 ms (client timeout 1518 ms). Trace:
W20260709 13:00:58.480489  1605 rpcz_store.cc:269] 0709 13:00:56.680664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:56.693310 (+ 12646us) service_pool.cc:224] Handling call
0709 13:00:58.479705 (+1786395us) spinlock_profiling.cc:243] Waited 1.69 s on lock 0x7b54000db454. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:58.479886 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3896167680}
W20260709 13:00:58.449735  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 49231.4us
I20260709 13:00:58.453176  1602 raft_consensus.cc:1275] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
W20260709 13:00:58.454021  6428 log.cc:927] Time spent T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.356s	user 0.002s	sys 0.002s
I20260709 13:00:58.454562  6391 raft_consensus.cc:2749] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:00:58.462379  6143 raft_consensus.cc:3060] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:58.483120  6275 raft_consensus.cc:493] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:58.483954  6275 raft_consensus.cc:515] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:58.467971  6360 leader_election.cc:290] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:58.470853  6324 raft_consensus.cc:2804] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:58.486840  6324 raft_consensus.cc:697] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 13 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:58.487498  6275 leader_election.cc:290] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:58.487908  6324 consensus_queue.cc:237] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:58.471626  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:00:58.472244  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 77310.2us
I20260709 13:00:58.491204  1606 raft_consensus.cc:2368] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 8. Current term is 9.
I20260709 13:00:58.492497  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:58.492707  1571 leader_election.cc:400] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 pre-election: Vote denied by peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217) with higher term. Message: Invalid argument: T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 13. Current term is 14.
I20260709 13:00:58.493314  1606 raft_consensus.cc:2393] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 13: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:00:58.493682  6302 raft_consensus.cc:3060] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:58.493984  1571 leader_election.cc:304] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:58.494884  6275 raft_consensus.cc:2749] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:00:58.495798  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:58.496093  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:00:58.496390  6429 log.cc:927] Time spent T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.270s	user 0.003s	sys 0.000s
I20260709 13:00:58.496846  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:58.497766  1606 raft_consensus.cc:1275] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:00:58.498267  1602 raft_consensus.cc:2468] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 15.
I20260709 13:00:58.499437  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:58.500098  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:58.473773  1601 raft_consensus.cc:1275] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:00:58.497817  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:58.503609  1599 raft_consensus.cc:3060] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:00:58.506896  6432 log.cc:927] Time spent T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.284s	user 0.001s	sys 0.000s
W20260709 13:00:58.507601  6088 consensus_meta.cc:287] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.891s	user 0.011s	sys 0.007s
I20260709 13:00:58.508155  6088 raft_consensus.cc:515] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:58.508419  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:58.509400  1673 raft_consensus.cc:2393] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 15: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:00:58.513042  6088 leader_election.cc:290] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:58.514410  2221 raft_consensus.cc:2410] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:00:58.515398  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
W20260709 13:00:58.522418  6433 log.cc:927] Time spent T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.182s	user 0.001s	sys 0.000s
I20260709 13:00:58.523326  1572 leader_election.cc:304] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:58.532074  2222 raft_consensus.cc:1240] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 9 LEADER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:58.535132  1673 raft_consensus.cc:1240] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:00:58.539700  2223 raft_consensus.cc:1275] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:00:58.541898  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 13:00:58.562137  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 67543us
I20260709 13:00:58.543345  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:58.566509  1598 raft_consensus.cc:2468] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 16.
I20260709 13:00:58.534581  1497 leader_election.cc:304] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:00:58.538396  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:58.551379  6273 raft_consensus.cc:493] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:58.591768  6273 raft_consensus.cc:515] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:58.585070  1599 raft_consensus.cc:2468] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 14.
I20260709 13:00:58.595501  6159 consensus_queue.cc:1048] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:58.550835  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:58.536089  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:58.595623  6273 leader_election.cc:290] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:00:58.595831  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 61343.2us
I20260709 13:00:58.597503  1571 leader_election.cc:304] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:58.597357  1605 raft_consensus.cc:2393] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 13: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:00:58.596426  6370 raft_consensus.cc:2804] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:58.534785  6358 raft_consensus.cc:2804] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:00:58.545653  6382 leader_election.cc:290] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:58.537484  6244 leader_election.cc:290] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:58.612746  6352 consensus_queue.cc:1048] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 13:00:58.613045  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:58.552515  6351 raft_consensus.cc:3060] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:58.600485  6370 raft_consensus.cc:493] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:58.506496  6267 raft_consensus.cc:515] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:00:58.613343  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 90218.5us
I20260709 13:00:58.615564  6369 raft_consensus.cc:493] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.622648  1497 leader_election.cc:304] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:58.623071  6244 raft_consensus.cc:2749] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:00:58.622918  6369 raft_consensus.cc:515] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:58.624001  6267 leader_election.cc:290] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:58.620599  6302 raft_consensus.cc:2749] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:00:58.625505  6369 leader_election.cc:290] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:58.628120  1572 leader_election.cc:304] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:58.629035  6302 raft_consensus.cc:2749] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:00:58.629806  1572 leader_election.cc:304] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:58.608958  6358 raft_consensus.cc:493] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:58.624682  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36200 (request call id 2525) took 1258 ms. Trace:
W20260709 13:00:58.631067  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 80971.8us
I20260709 13:00:58.625690  1497 leader_election.cc:304] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:58.635113  1599 raft_consensus.cc:1275] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:00:58.619240  6370 raft_consensus.cc:3060] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:58.641199  6382 raft_consensus.cc:2804] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:58.632720  1607 rpcz_store.cc:276] 0709 13:00:57.341706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.526014 (+184308us) service_pool.cc:224] Handling call
0709 13:00:58.497719 (+971705us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:58.498066 (+   347us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:58.498096 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:58.498161 (+    65us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:58.498202 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.498280 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:58.585119 (+ 86839us) spinlock_profiling.cc:243] Waited 932 ms on lock 0x7b54000db450. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b28ad 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:58.600005 (+ 14886us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4976,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":85,"spinlock_wait_cycles":2143333120}
I20260709 13:00:58.641505  6342 raft_consensus.cc:2804] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:58.636507  6358 raft_consensus.cc:3060] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:58.658273  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:58.611029  6404 consensus_queue.cc:1059] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 13:00:58.654978  6356 raft_consensus.cc:2749] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:58.635684  6374 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:58.648295  6382 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:58.620431  6324 consensus_queue.cc:1059] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:00:58.670879  6404 raft_consensus.cc:3055] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:00:58.671396  6404 raft_consensus.cc:740] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:58.672369  6404 consensus_queue.cc:260] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:58.675218  1599 raft_consensus.cc:2468] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 10.
W20260709 13:00:58.675561  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 45905.9us
I20260709 13:00:58.673727  6404 raft_consensus.cc:3060] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:58.675812  6143 raft_consensus.cc:493] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:00:58.682538  6143 raft_consensus.cc:515] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:58.684854  6143 leader_election.cc:290] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:58.686367  6324 raft_consensus.cc:3055] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:00:58.687716  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.654423  6342 raft_consensus.cc:493] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
W20260709 13:00:58.691605  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 195888us
I20260709 13:00:58.676486  1572 leader_election.cc:304] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:58.697700  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:58.698194  1673 raft_consensus.cc:1240] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 14. Current term is 15. Ops: []
I20260709 13:00:58.698349  1607 raft_consensus.cc:2376] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 14. Re-sending same reply.
I20260709 13:00:58.696301  6342 raft_consensus.cc:3060] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:58.700573  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:58.668040  6382 raft_consensus.cc:3060] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:58.645124  6088 consensus_queue.cc:1059] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:00:58.704553  6267 raft_consensus.cc:3055] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:58.704982  6267 raft_consensus.cc:740] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:58.714939  1646 leader_election.cc:304] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:58.686829  6324 raft_consensus.cc:740] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:58.714236  6356 raft_consensus.cc:2749] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:00:58.720852  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:58.721638  1607 raft_consensus.cc:3060] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:58.729173  1607 raft_consensus.cc:2468] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 14.
I20260709 13:00:58.734987  1571 leader_election.cc:304] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:58.736577  1571 leader_election.cc:304] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:58.737001  6273 consensus_queue.cc:1048] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:58.738639  6244 raft_consensus.cc:2749] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:00:58.738806  6302 raft_consensus.cc:2764] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:00:58.739476  6244 consensus_queue.cc:1048] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:00:58.740829  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:58.741466  2221 raft_consensus.cc:3060] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:58.742259  6374 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:00:58.744612  6331 consensus_meta.cc:287] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b: Time spent flushing consensus metadata: real 0.562s	user 0.006s	sys 0.006s
I20260709 13:00:58.748775  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:58.749552  1678 raft_consensus.cc:3060] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:58.715917  6088 consensus_queue.cc:1059] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
W20260709 13:00:58.756633  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:58.760548  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 45692.4us
I20260709 13:00:58.762023  2221 raft_consensus.cc:2468] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 14.
I20260709 13:00:58.771445  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:58.771999  1524 raft_consensus.cc:3060] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:58.772495  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:58.774180  1678 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 15.
I20260709 13:00:58.776738  6324 consensus_queue.cc:260] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:58.778683  6324 raft_consensus.cc:3060] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:58.780292  5976 raft_consensus.cc:2749] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:00:58.781219  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:58.781937  1531 raft_consensus.cc:2468] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 9.
I20260709 13:00:58.785423  6184 raft_consensus.cc:515] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:58.785830  6370 raft_consensus.cc:515] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:58.770871  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:58.788014  6382 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:58.790984  2225 raft_consensus.cc:2410] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 16 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 13:00:58.791239  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 13:00:58.792112  2192 leader_election.cc:336] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Timed out: RequestConsensusVote RPC to 127.0.107.194:40303 timed out after 1.518s (SENT)
I20260709 13:00:58.711874  6143 consensus_queue.cc:1048] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 13:00:58.808111  6370 leader_election.cc:290] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:58.794673  1532 raft_consensus.cc:1240] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 14. Current term is 15. Ops: []
I20260709 13:00:58.795562  6342 raft_consensus.cc:515] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:58.805015  2192 leader_election.cc:304] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:58.813853  1644 leader_election.cc:304] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:58.814846  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:00:58.813113  1600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36200 (request call id 2526) took 1471 ms. Trace:
W20260709 13:00:58.818949  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 142586us
I20260709 13:00:58.824546  1531 raft_consensus.cc:2393] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 15: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:00:58.823308  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:58.829232  6159 raft_consensus.cc:493] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.829790  6159 raft_consensus.cc:515] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:58.831928  6159 leader_election.cc:290] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:58.832439  6159 raft_consensus.cc:493] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:58.821053  6143 raft_consensus.cc:2804] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:58.833696  6143 raft_consensus.cc:493] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:58.833806  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:58.834111  6143 raft_consensus.cc:3060] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:58.834538  2221 raft_consensus.cc:3060] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:58.838730  6244 consensus_queue.cc:1059] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:58.839789  6244 raft_consensus.cc:3055] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:58.840149  6244 raft_consensus.cc:740] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:58.840988  6244 consensus_queue.cc:260] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:58.832983  6159 raft_consensus.cc:515] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:58.846434  2221 raft_consensus.cc:2468] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 12.
I20260709 13:00:58.826292  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:58.842335  6244 raft_consensus.cc:3060] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:58.758931  6267 consensus_queue.cc:260] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:58.823506  6374 raft_consensus.cc:2749] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:58.858572  1497 leader_election.cc:304] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:58.815871  6356 consensus_queue.cc:1048] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:00:58.816665  1600 rpcz_store.cc:276] 0709 13:00:57.341977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.207886 (+865909us) service_pool.cc:224] Handling call
0709 13:00:58.292662 (+ 84776us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:58.360097 (+ 67435us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:00:58.588080 (+227983us) log.cc:844] Serialized 14 byte log entry
0709 13:00:58.712276 (+124196us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:58.712325 (+    49us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:00:58.715133 (+  2808us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.715209 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:58.812954 (+ 97745us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b540035f7d0. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b28ad 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:00:58.813057 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1050,"prepare.queue_time_us":262244,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":15191,"raft.run_cpu_time_us":243,"raft.run_wall_time_us":2902,"spinlock_wait_cycles":26736512,"thread_start_us":233255,"threads_started":2,"wal-append.queue_time_us":176988}
I20260709 13:00:58.860710  5976 raft_consensus.cc:493] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:58.870781  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.865124  1571 leader_election.cc:304] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:58.866233  6391 raft_consensus.cc:493] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:00:58.861287  6358 raft_consensus.cc:515] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:58.870131  6370 raft_consensus.cc:2749] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:58.886108  6338 consensus_queue.cc:1048] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
W20260709 13:00:58.891157  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 99107us
I20260709 13:00:58.894726  6302 raft_consensus.cc:2804] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:00:58.895553  2192 leader_election.cc:336] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Timed out: RequestConsensusVote RPC to 127.0.107.194:40303 timed out after 1.566s (SENT)
I20260709 13:00:58.897456  2192 leader_election.cc:304] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:58.899184  1572 leader_election.cc:304] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:58.903855  5747 raft_consensus.cc:2749] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:00:58.905810  6193 raft_consensus.cc:2749] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:58.912376  6203 raft_consensus.cc:3055] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:58.909598  1496 leader_election.cc:304] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:58.897230  6302 raft_consensus.cc:493] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:58.915472  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 66484.5us
I20260709 13:00:58.876534  5976 raft_consensus.cc:515] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:58.894524  6391 raft_consensus.cc:515] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:58.917667  6302 raft_consensus.cc:3060] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:58.919126  6338 consensus_queue.cc:1048] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:00:58.926187  6370 consensus_queue.cc:1059] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.013s
I20260709 13:00:58.939672  6370 raft_consensus.cc:3055] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:00:58.940126  6370 raft_consensus.cc:740] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:00:58.940991  6370 consensus_queue.cc:260] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:58.942183  6370 raft_consensus.cc:3060] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:58.915248  5747 consensus_queue.cc:1048] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 13:00:58.919343  6273 raft_consensus.cc:2804] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:58.944607  6273 raft_consensus.cc:493] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:58.945026  6273 raft_consensus.cc:3060] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:58.912850  6203 raft_consensus.cc:740] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:58.947388  6302 raft_consensus.cc:515] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:58.947587  6203 consensus_queue.cc:260] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:58.949096  6203 raft_consensus.cc:3060] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:58.949895  6302 leader_election.cc:290] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:58.951862  6358 leader_election.cc:290] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 18 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:58.957036  1646 leader_election.cc:304] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:58.958420  6382 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 15 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:00:58.961275  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.961938  1680 raft_consensus.cc:1240] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:00:58.962826  1673 raft_consensus.cc:1275] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:00:58.963858  6369 raft_consensus.cc:493] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.964323  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:58.965657  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:58.966897  6267 raft_consensus.cc:3060] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:58.969048  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:58.969631  1675 raft_consensus.cc:3060] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:00:58.967175  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 71691.9us
I20260709 13:00:58.972332  5976 leader_election.cc:290] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:58.972890  5976 raft_consensus.cc:2749] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:00:58.973716  5976 raft_consensus.cc:493] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.974287  5976 raft_consensus.cc:515] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:58.974607  6391 leader_election.cc:290] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:58.964444  6342 leader_election.cc:290] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:58.975785  2225 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c"
dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
mode: GRACEFUL
new_leader_uuid: "39a92f5a4352465d8af3af5908fe8642"
 from {username='slave'} at 127.0.0.1:47682
W20260709 13:00:58.954512  6445 log.cc:927] Time spent T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.230s	user 0.000s	sys 0.005s
I20260709 13:00:58.977221  6275 consensus_queue.cc:1059] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:58.977620  5747 consensus_queue.cc:1048] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:58.967217  1677 raft_consensus.cc:1240] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 13:00:58.926908  1572 leader_election.cc:304] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:58.979420  6356 raft_consensus.cc:2749] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:00:58.980453  6342 raft_consensus.cc:493] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:58.981118  6342 raft_consensus.cc:515] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:58.927256  6184 leader_election.cc:290] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:58.982710  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:58.982874  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 13:00:58.983729  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.964372  6369 raft_consensus.cc:515] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:58.985146  1675 raft_consensus.cc:2468] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 15.
I20260709 13:00:58.985363  6275 raft_consensus.cc:3055] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:00:58.985780  6275 raft_consensus.cc:740] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:58.986246  6369 leader_election.cc:290] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:58.986280  1571 leader_election.cc:304] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:58.983253  6159 leader_election.cc:290] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:58.976827  2225 raft_consensus.cc:606] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Received request to transfer leadership to TS 39a92f5a4352465d8af3af5908fe8642
I20260709 13:00:59.004220  2225 raft_consensus.cc:614] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:58.991515  1427 catalog_manager.cc:5697] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 reported cstate change: term changed from 5 to 6, leader changed from b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 6 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:59.005609  6302 raft_consensus.cc:2804] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:00:58.980618  2192 leader_election.cc:304] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
W20260709 13:00:58.980408  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 53602.8us
I20260709 13:00:59.007493  6356 consensus_queue.cc:1059] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:59.008162  2192 leader_election.cc:304] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:59.009114  6376 raft_consensus.cc:2749] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:59.009752  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:59.009943  1572 leader_election.cc:304] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:59.010226  1524 raft_consensus.cc:2468] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 14.
I20260709 13:00:59.010676  1681 raft_consensus.cc:2393] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 15: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:00:59.011068  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:59.011823  1675 raft_consensus.cc:2468] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 10.
I20260709 13:00:59.014245  1524 raft_consensus.cc:1275] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:00:58.983433  2219 raft_consensus.cc:2468] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 13.
I20260709 13:00:59.021167  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:59.022866  1676 raft_consensus.cc:1240] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 14. Current term is 15. Ops: [14.7-14.7]
I20260709 13:00:59.025427  2192 leader_election.cc:304] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:00:59.028621  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 46848.6us
I20260709 13:00:59.006377  6302 raft_consensus.cc:697] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 15 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:59.040088  1646 leader_election.cc:304] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:59.017999  6376 raft_consensus.cc:2749] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:58.981606  5747 consensus_queue.cc:1059] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 13:00:59.058491  2219 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59"
dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
mode: GRACEFUL
new_leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:47682
I20260709 13:00:59.059229  2219 raft_consensus.cc:606] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Received request to transfer leadership to TS e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:59.058925  6159 raft_consensus.cc:493] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.060189  6159 raft_consensus.cc:515] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:59.066416  6439 consensus_queue.cc:1048] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 13:00:59.059579  2219 raft_consensus.cc:614] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:00:59.077391  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 57823.9us
I20260709 13:00:59.039407  6193 raft_consensus.cc:2749] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:59.094907  6143 raft_consensus.cc:515] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:59.095605  5976 leader_election.cc:290] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:59.096266  1678 raft_consensus.cc:1240] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:58.986691  6275 consensus_queue.cc:260] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:59.090329  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:59.094986  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 13:00:59.112253  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 257622us
I20260709 13:00:59.106076  1496 leader_election.cc:304] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:59.076736  6342 leader_election.cc:290] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:59.123215  2192 leader_election.cc:304] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:59.124657  2219 raft_consensus.cc:2468] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 13.
W20260709 13:00:59.130014  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 121104us
I20260709 13:00:59.133356  1497 leader_election.cc:304] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:59.121625  6358 raft_consensus.cc:2804] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:00:59.147620  2191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:59.124722  6338 raft_consensus.cc:2804] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:59.166198  2219 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b"
dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
mode: GRACEFUL
new_leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:47682
I20260709 13:00:59.168190  2219 raft_consensus.cc:606] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Received request to transfer leadership to TS e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:59.168610  2219 raft_consensus.cc:614] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:59.131943  6351 raft_consensus.cc:493] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.189271  1646 leader_election.cc:304] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:59.133296  6342 consensus_queue.cc:1059] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:00:59.192297  1427 catalog_manager.cc:5697] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 reported cstate change: term changed from 7 to 8, leader changed from ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) to 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194). New cstate: current_term: 8 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } }
I20260709 13:00:59.172295  6374 raft_consensus.cc:2804] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:59.186326  6275 raft_consensus.cc:3060] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:59.167057  6338 raft_consensus.cc:493] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:59.178988  6356 raft_consensus.cc:3055] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:59.199852  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 13:00:59.203971  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 107050us
I20260709 13:00:59.193499  6088 raft_consensus.cc:2804] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:59.194614  6159 leader_election.cc:290] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:59.205030  6374 raft_consensus.cc:697] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 12 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:00:59.172776  6302 consensus_queue.cc:237] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:00:59.207571  6448 log.cc:927] Time spent T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
I20260709 13:00:59.204627  6338 raft_consensus.cc:3060] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:59.213920  2225 raft_consensus.cc:2468] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 10.
I20260709 13:00:59.206431  6088 raft_consensus.cc:493] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:59.198386  6456 raft_consensus.cc:2749] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:59.204361  6356 raft_consensus.cc:740] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:59.193097  6351 raft_consensus.cc:515] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:59.217494  6159 raft_consensus.cc:3055] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:00:59.227763  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:59.228466  6143 leader_election.cc:290] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:59.240804  6358 raft_consensus.cc:493] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
W20260709 13:00:59.270884  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 139770us
W20260709 13:00:59.262262  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 130176us
I20260709 13:00:59.222985  6342 raft_consensus.cc:2749] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:00:59.304260  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:59.304975  1603 raft_consensus.cc:3060] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:00:59.284260  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 135912us
I20260709 13:00:59.290970  6273 raft_consensus.cc:515] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:00:59.281571  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 61256.1us
I20260709 13:00:59.302138  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:59.300974  1572 leader_election.cc:304] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:59.295469  6159 raft_consensus.cc:740] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:00:59.302482  1607 raft_consensus.cc:1240] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 15. Current term is 16. Ops: [14.11-15.12]
I20260709 13:00:59.304098  1604 raft_consensus.cc:3055] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:00:59.302107  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 85838.6us
I20260709 13:00:59.300411  1598 raft_consensus.cc:1240] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:00:59.309176  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:59.310360  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:59.317116  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:59.294389  6088 raft_consensus.cc:3060] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:59.317343  1600 raft_consensus.cc:2393] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 15: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:00:59.317750  1676 raft_consensus.cc:2468] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 13.
W20260709 13:00:59.321092  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 189427us
I20260709 13:00:59.318549  1604 raft_consensus.cc:740] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:59.308481  1646 leader_election.cc:304] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
W20260709 13:00:59.307974  6457 log.cc:927] Time spent T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.090s	user 0.000s	sys 0.008s
I20260709 13:00:59.325770  6273 leader_election.cc:290] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:59.325799  6143 raft_consensus.cc:2804] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:59.327138  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:59.330428  6143 raft_consensus.cc:493] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:59.330924  6143 raft_consensus.cc:3060] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:00:59.332250  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:59.332698  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:59.333968  6159 consensus_queue.cc:260] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:59.335024  6176 raft_consensus.cc:493] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:59.335330  6159 raft_consensus.cc:3060] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:59.335927  6244 raft_consensus.cc:3055] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:00:59.336311  6244 raft_consensus.cc:740] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:59.336889  6356 consensus_queue.cc:260] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:59.337150  6244 consensus_queue.cc:260] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:59.338268  6356 raft_consensus.cc:3060] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:59.338201  6244 raft_consensus.cc:3060] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:59.341322  6466 raft_consensus.cc:2749] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:59.342126  6461 consensus_queue.cc:1059] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:00:59.342968  6453 consensus_queue.cc:1059] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:59.297297  6184 raft_consensus.cc:493] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:59.344563  6461 raft_consensus.cc:3055] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:00:59.345023  6455 log.cc:927] Time spent T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 13:00:59.345920  2227 raft_consensus.cc:1275] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:00:59.344282  6184 raft_consensus.cc:515] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:59.346297  1646 leader_election.cc:304] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:59.300117  6358 raft_consensus.cc:3060] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:59.343778  6453 consensus_queue.cc:1243] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer b96ce9cc496c49d7818fa983a17b062b log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:00:59.297437  6404 raft_consensus.cc:493] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:59.347705  1496 leader_election.cc:304] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:59.226593  6374 consensus_queue.cc:237] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:59.300657  6439 raft_consensus.cc:493] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:59.353133  1606 raft_consensus.cc:2393] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 11: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:00:59.353648  1681 raft_consensus.cc:2468] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 13.
I20260709 13:00:59.327065  1427 catalog_manager.cc:5697] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:00:59.344952  6461 raft_consensus.cc:740] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:59.359704  1497 leader_election.cc:304] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:59.364219  5732 raft_consensus.cc:2804] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:59.364661  5732 raft_consensus.cc:493] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:59.364971  6351 leader_election.cc:290] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
W20260709 13:00:59.367460  1496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:59.367920  1496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:59.363695  6088 raft_consensus.cc:515] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:59.368929  1603 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 15.
I20260709 13:00:59.360615  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:59.358855  6404 raft_consensus.cc:515] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:59.372185  6088 leader_election.cc:290] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:59.372605  6404 leader_election.cc:290] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:59.354537  6203 raft_consensus.cc:2804] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:00:59.364987  5732 raft_consensus.cc:3060] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:59.376266  6143 raft_consensus.cc:515] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:59.377842  6184 leader_election.cc:290] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:59.378432  6439 raft_consensus.cc:515] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:59.380399  2227 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004"
dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
mode: GRACEFUL
new_leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:47682
I20260709 13:00:59.383383  2192 leader_election.cc:304] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:59.361541  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:59.352154  6176 raft_consensus.cc:515] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:59.391659  6267 raft_consensus.cc:493] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
W20260709 13:00:59.392979  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:59.427819  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:59.382483  1677 raft_consensus.cc:2468] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 8.
I20260709 13:00:59.424057  2227 raft_consensus.cc:606] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Received request to transfer leadership to TS e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:59.428596  2227 raft_consensus.cc:614] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:00:59.431351  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 56927us
I20260709 13:00:59.353390  6466 raft_consensus.cc:493] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:00:59.445429  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:59.446141  2218 raft_consensus.cc:3060] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:00:59.441164  5747 raft_consensus.cc:493] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.448053  5747 raft_consensus.cc:515] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:59.450234  5747 leader_election.cc:290] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:59.450873  6159 raft_consensus.cc:2749] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:00:59.451632  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 95104.1us
I20260709 13:00:59.452611  1497 leader_election.cc:304] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
W20260709 13:00:59.454784  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 100543us
I20260709 13:00:59.456466  1570 leader_election.cc:304] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:59.457816  1570 leader_election.cc:304] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:59.471155  1604 consensus_queue.cc:260] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:59.472679  1604 raft_consensus.cc:3060] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:59.479417  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:59.480136  2226 raft_consensus.cc:2468] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 12.
I20260709 13:00:59.481387  1646 leader_election.cc:304] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:59.482208  6351 raft_consensus.cc:2804] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:59.482618  6351 raft_consensus.cc:493] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:59.483006  6351 raft_consensus.cc:3060] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:59.483669  1604 raft_consensus.cc:1275] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:00:59.483454  6338 raft_consensus.cc:515] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:59.485765  6338 leader_election.cc:290] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:00:59.486631  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:59.491003  6461 consensus_queue.cc:260] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:59.491593  1496 leader_election.cc:304] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:59.494079  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:59.494099  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:59.495718  1604 raft_consensus.cc:2410] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:00:59.497521  6463 raft_consensus.cc:2804] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:00:59.493880  1427 catalog_manager.cc:5697] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 reported cstate change: term changed from 4 to 9, leader changed from b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 9 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:59.498260  6463 raft_consensus.cc:697] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 15 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:59.499280  6463 consensus_queue.cc:237] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:59.502851  6456 raft_consensus.cc:2749] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:00:59.505956  6439 leader_election.cc:290] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:00:59.507493  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 124191us
I20260709 13:00:59.508054  6176 leader_election.cc:290] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:59.508437  2192 leader_election.cc:304] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:59.423902  6203 raft_consensus.cc:697] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 14 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:59.510130  1681 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457"
dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
mode: GRACEFUL
new_leader_uuid: "39a92f5a4352465d8af3af5908fe8642"
 from {username='slave'} at 127.0.0.1:33616
I20260709 13:00:59.517653  2218 raft_consensus.cc:2468] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 15.
I20260709 13:00:59.518770  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:59.522027  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:59.524457  1677 raft_consensus.cc:2393] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 11: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:00:59.526422  1646 leader_election.cc:304] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:59.492508  6461 raft_consensus.cc:3060] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:59.443192  6331 raft_consensus.cc:2804] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:59.530890  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:00:59.533993  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 76264.5us
I20260709 13:00:59.535410  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:59.535907  2226 raft_consensus.cc:3060] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:59.537686  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:59.539532  1678 raft_consensus.cc:1275] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:00:59.519447  6176 raft_consensus.cc:2749] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:00:59.542848  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:00:59.543624  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:59.443950  6267 raft_consensus.cc:515] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:59.545902  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:59.498152  6143 leader_election.cc:290] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:59.546680  1599 raft_consensus.cc:1275] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:00:59.549472  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:59.549899  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:59.527374  6273 raft_consensus.cc:2804] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:59.521998  6088 raft_consensus.cc:493] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:00:59.554916  1602 raft_consensus.cc:2468] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 14.
I20260709 13:00:59.494031  6466 raft_consensus.cc:515] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:59.571002  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:59.534735  6331 raft_consensus.cc:493] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:59.535076  5976 raft_consensus.cc:2804] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:00:59.559650  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 68185.3us
I20260709 13:00:59.537380  6338 raft_consensus.cc:2749] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:00:59.559365  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 106899us
I20260709 13:00:59.572703  1496 leader_election.cc:304] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:00:59.577131  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:59.576337  1681 raft_consensus.cc:606] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 10 LEADER]: Received request to transfer leadership to TS 39a92f5a4352465d8af3af5908fe8642
I20260709 13:00:59.578403  1599 pending_rounds.cc:85] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642: Aborting all ops after (but not including) 12
I20260709 13:00:59.577757  1600 raft_consensus.cc:3060] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:59.580121  1570 leader_election.cc:304] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:59.544183  6184 raft_consensus.cc:493] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:00:59.582329  6464 raft_consensus.cc:2804] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:59.582468  6475 consensus_queue.cc:1048] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 13:00:59.589514  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:59.590346  2219 raft_consensus.cc:2393] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 12: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:00:59.591588  2226 raft_consensus.cc:2468] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 11.
I20260709 13:00:59.578711  1599 pending_rounds.cc:107] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642: Aborting uncommitted NO_OP operation due to leader change: 14.13
I20260709 13:00:59.598888  1599 raft_consensus.cc:2889] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:59.599670  1646 leader_election.cc:304] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:00:59.607717  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:00:59.608508  1524 raft_consensus.cc:2393] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 11: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:00:59.610558  1497 leader_election.cc:304] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:59.577299  6331 raft_consensus.cc:3060] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:59.577788  6273 raft_consensus.cc:697] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:00:59.591202  6404 raft_consensus.cc:493] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:59.620002  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 56646.1us
I20260709 13:00:59.591717  5976 raft_consensus.cc:697] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 15 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:59.585681  6464 raft_consensus.cc:493] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:59.559365  5732 raft_consensus.cc:515] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:59.625787  1572 leader_election.cc:304] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:59.611586  6456 raft_consensus.cc:2764] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader election decision vote started in defunct term 13: won
I20260709 13:00:59.572317  6088 raft_consensus.cc:515] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:59.628232  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 57644.8us
I20260709 13:00:59.614279  6143 raft_consensus.cc:2804] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:59.624508  6338 raft_consensus.cc:2749] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:59.628774  6464 raft_consensus.cc:3060] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:59.612022  6184 raft_consensus.cc:515] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:59.616864  6358 raft_consensus.cc:515] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:59.638322  6472 log.cc:927] Time spent T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 13:00:59.622437  6203 consensus_queue.cc:237] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:59.646145  6456 consensus_queue.cc:1059] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:00:59.647666  6334 raft_consensus.cc:493] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:59.648186  1426 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46258 (request call id 343) took 31264 ms (client timeout 15000 ms). Trace:
I20260709 13:00:59.649068  6088 leader_election.cc:290] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:59.649607  1570 leader_election.cc:304] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:59.648063  6267 leader_election.cc:290] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:59.651497  6466 leader_election.cc:290] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:59.626353  6302 consensus_queue.cc:1048] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 13:00:59.655665  6351 raft_consensus.cc:515] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:59.655879  5976 consensus_queue.cc:237] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:00:59.656678  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 74084.4us
I20260709 13:00:59.837088  6358 leader_election.cc:290] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:59.821465  6376 raft_consensus.cc:493] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.888016  6376 raft_consensus.cc:515] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:59.875198  6464 raft_consensus.cc:515] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:59.722733  6331 raft_consensus.cc:515] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:59.889616  2227 raft_consensus.cc:1240] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:59.890475  6464 leader_election.cc:290] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:59.891300  6331 leader_election.cc:290] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 13 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:59.892874  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:59.894022  6351 leader_election.cc:290] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:59.894933  1676 raft_consensus.cc:2393] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 13: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:00:59.882280  5747 raft_consensus.cc:2749] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:59.896454  1497 leader_election.cc:304] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:00:59.897367  6464 raft_consensus.cc:3060] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:59.897848  1497 leader_election.cc:304] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:00:59.838528  6356 raft_consensus.cc:3055] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:59.899135  1681 raft_consensus.cc:1240] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 12. Current term is 13. Ops: []
W20260709 13:00:59.857226  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:59.787324  1605 raft_consensus.cc:2410] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for term 18 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
W20260709 13:00:59.799460  1496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:59.758409  6467 raft_consensus.cc:493] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.901136  6467 raft_consensus.cc:515] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:59.903774  6467 leader_election.cc:290] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:00:59.830443  6391 raft_consensus.cc:493] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.641500  6143 raft_consensus.cc:697] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 11 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:00:59.782415  6184 leader_election.cc:290] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:00:59.779480  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 13:00:59.671011  1426 rpcz_store.cc:269] 0709 13:00:28.351797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:28.352008 (+   211us) service_pool.cc:224] Handling call
0709 13:00:28.745152 (+393144us) spinlock_profiling.cc:243] Waited 245 ms on lock 0x7b5400411254. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851d090 00007f6a185bbf3a 00007f6a1e3721cc 00007f6a1e47037e 00007f6a1c9312a4 00007f6a1c931232 00007f6a1c931161 00007f6a1c9310dc 00007f6a1c930392 00007f6a168ee48c 00007f6a168ed8c6
0709 13:00:59.611127 (+30865975us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:57.030477 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:57.031083 (+   606us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:57.034106 (+  3023us) write_op.cc:435] Acquired schema lock
0709 13:00:57.034126 (+    20us) tablet.cc:662] Decoding operations
0709 13:00:57.050185 (+ 16059us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:57.050236 (+    51us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:57.050269 (+    33us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:00:57.050802 (+   533us) tablet.cc:701] Row locks acquired
0709 13:00:57.050822 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:00:57.050966 (+   144us) write_op.cc:270] Start()
0709 13:00:57.051089 (+   123us) write_op.cc:276] Timestamp: P: 1783602057050916 usec, L: 0
0709 13:00:57.051105 (+    16us) op_driver.cc:348] REPLICATION: starting
0709 13:00:57.051755 (+   650us) log.cc:844] Serialized 2472 byte log entry
0709 13:00:57.812400 (+760645us) op_driver.cc:464] REPLICATION: finished
0709 13:00:57.847316 (+ 34916us) write_op.cc:301] APPLY: starting
0709 13:00:57.847387 (+    71us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:57.851293 (+  3906us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:57.851397 (+   104us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:57.930954 (+ 79557us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:57.931407 (+   453us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=12,mrs_lookups=0
0709 13:00:57.931488 (+    81us) write_op.cc:312] APPLY: finished
0709 13:00:57.932402 (+   914us) log.cc:844] Serialized 65 byte log entry
0709 13:00:57.976619 (+ 44217us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:58.044396 (+ 67777us) write_op.cc:454] Released schema lock
0709 13:00:58.050729 (+  6333us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:58.102522 (+ 51793us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:58.102565 (+    43us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":47,"spinlock_wait_cycles":563239168,"child_traces":[["op",{"apply.queue_time_us":32650,"apply.run_cpu_time_us":12747,"apply.run_wall_time_us":255039,"cfile_cache_hit":26,"cfile_cache_hit_bytes":29255,"num_ops":6,"prepare.queue_time_us":784572,"prepare.run_cpu_time_us":53468,"prepare.run_wall_time_us":276573,"raft.queue_time_us":198840,"raft.run_cpu_time_us":8334,"raft.run_wall_time_us":60692,"replication_time_us":753888,"thread_start_us":506673,"threads_started":4,"wal-append.queue_time_us":365743,"wal-append.run_cpu_time_us":37454,"wal-append.run_wall_time_us":1508363}]]}
I20260709 13:00:59.709975  6334 raft_consensus.cc:515] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:59.627152  6404 raft_consensus.cc:515] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:59.866408  6439 raft_consensus.cc:493] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.728593  6273 consensus_queue.cc:237] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:00:59.711416  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 81312.3us
W20260709 13:00:59.869834  6481 log.cc:927] Time spent T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.152s	user 0.000s	sys 0.007s
W20260709 13:00:59.870250  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 220746us
I20260709 13:00:59.866819  5732 leader_election.cc:290] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:00:59.879004  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:00:59.884305  1600 raft_consensus.cc:2468] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 15.
W20260709 13:00:59.776749  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:59.835208  6462 consensus_queue.cc:1048] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:59.735097  1603 raft_consensus.cc:2410] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:00:59.911471  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:59.904412  6391 raft_consensus.cc:515] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:00:59.916867  2218 raft_consensus.cc:3060] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:00:59.921449  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:59.917958  1681 raft_consensus.cc:3060] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:59.899359  6356 raft_consensus.cc:740] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:00:59.935120  2227 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24"
dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
mode: GRACEFUL
new_leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:47682
I20260709 13:00:59.935806  2227 raft_consensus.cc:606] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Received request to transfer leadership to TS e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:00:59.936192  2227 raft_consensus.cc:614] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:59.947664  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:00:59.948482  2219 raft_consensus.cc:2468] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 10.
I20260709 13:00:59.914842  6450 raft_consensus.cc:2749] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:00:59.956418  2218 raft_consensus.cc:2468] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 14.
W20260709 13:00:59.960140  1496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:59.971910  2225 raft_consensus.cc:1240] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:00:59.962852  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:59.964439  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:59.964500  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:59.964632  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:00:59.966593  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:59.970733  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:00:59.991293  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:00:59.991957  1602 raft_consensus.cc:3060] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:59.916505  6439 raft_consensus.cc:515] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:00:59.995438  1572 leader_election.cc:304] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
W20260709 13:00:59.998183  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:59.998057  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
W20260709 13:00:59.998643  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:00.001269  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:01:00.002571  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 70290.5us
I20260709 13:01:00.007033  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:00.013005  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:00:59.973518  6464 raft_consensus.cc:2749] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:59.987277  6482 raft_consensus.cc:493] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.018405  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:00.005407  6275 raft_consensus.cc:493] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:00:59.987087  6487 raft_consensus.cc:493] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:00:59.986196  6466 raft_consensus.cc:493] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.028086  1646 leader_election.cc:304] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:01:00.033838  1523 raft_consensus.cc:1275] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:01:00.034706  1678 raft_consensus.cc:1240] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:00.035449  2192 leader_election.cc:304] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:00.011844  6302 raft_consensus.cc:2804] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:59.975628  6184 consensus_queue.cc:1059] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.048s
I20260709 13:01:00.036621  6460 consensus_queue.cc:1059] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 13:01:00.040535   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:01:00.034457  6470 raft_consensus.cc:2749] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:00.042387   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:00.046633  1602 raft_consensus.cc:2468] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 12.
I20260709 13:01:00.028889  6275 raft_consensus.cc:515] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:00.038450  6487 raft_consensus.cc:515] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:00.055332  1676 raft_consensus.cc:2468] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 13.
I20260709 13:01:00.055270  6193 raft_consensus.cc:2749] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:00.058279  6244 consensus_queue.cc:1059] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:00.059707  1496 leader_election.cc:304] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:00.060932  5732 raft_consensus.cc:2804] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:00.061519  5732 raft_consensus.cc:697] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:00.062523  5732 consensus_queue.cc:237] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:00.039417  6203 raft_consensus.cc:2804] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:00.064502  6203 raft_consensus.cc:697] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 14 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:00.072904  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:00.037457  6302 raft_consensus.cc:493] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:00.083493  6391 leader_election.cc:290] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:00.083894  1497 leader_election.cc:304] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
W20260709 13:01:00.085069  6479 log.cc:927] Time spent T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
I20260709 13:01:00.037870  6466 raft_consensus.cc:515] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:00.088758  6466 leader_election.cc:290] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:00.038466  6456 consensus_queue.cc:1059] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.052s
I20260709 13:01:00.090571  6456 raft_consensus.cc:3055] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:00.090981  6456 raft_consensus.cc:740] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:00.092198  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:00.025804  6356 consensus_queue.cc:260] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:00.093000  2225 raft_consensus.cc:2393] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 11: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:01:00.093408  6356 raft_consensus.cc:3060] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:00.094799  6404 leader_election.cc:290] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:00.021409  6143 consensus_queue.cc:237] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:00.097784  6184 raft_consensus.cc:993] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90: : Instructing follower 39a92f5a4352465d8af3af5908fe8642 to start an election
I20260709 13:01:00.099112  6088 raft_consensus.cc:1081] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 10 LEADER]: Signalling peer 39a92f5a4352465d8af3af5908fe8642 to start an election
I20260709 13:01:00.101312  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:00.101953  1604 raft_consensus.cc:2468] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 13.
I20260709 13:01:00.075866  1677 raft_consensus.cc:2468] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 11.
I20260709 13:01:00.064522  6439 leader_election.cc:290] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:00.082686  6203 consensus_queue.cc:237] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:00.111629  1606 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457"
dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
 from {username='slave'} at 127.0.0.1:36200
I20260709 13:01:00.111961  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:00.088761  6275 leader_election.cc:290] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:00.112975  1606 raft_consensus.cc:493] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:00.086474  6487 leader_election.cc:290] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:00.104774  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:00.118791  1676 raft_consensus.cc:2468] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 13.
I20260709 13:01:00.085338  1497 leader_election.cc:304] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:00.104936  1646 leader_election.cc:304] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:00.091892  6456 consensus_queue.cc:260] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:00.052184  6464 raft_consensus.cc:493] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.113355  1606 raft_consensus.cc:3060] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:00.104080  1681 raft_consensus.cc:2468] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 14.
I20260709 13:01:00.120357  1571 leader_election.cc:304] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:00.123986  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:00.065222  6338 consensus_queue.cc:1059] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 13:01:00.106156  6302 raft_consensus.cc:3060] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:00.128156  6456 raft_consensus.cc:3060] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:00.108196  6159 raft_consensus.cc:3060] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:00.134334  1604 raft_consensus.cc:1275] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:01:00.135182  6495 log.cc:927] Time spent T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 13:01:00.136467  6358 consensus_queue.cc:1048] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:01:00.137421  6334 leader_election.cc:290] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:00.122319  6391 raft_consensus.cc:2804] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:00.138095  6391 raft_consensus.cc:493] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:00.138429  6391 raft_consensus.cc:3060] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:00.106948  6351 raft_consensus.cc:3055] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:00.140125  6351 raft_consensus.cc:740] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:00.121352  6376 leader_election.cc:290] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:00.036921  6482 raft_consensus.cc:515] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:00.141064  6351 consensus_queue.cc:260] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:00.143854  6482 leader_election.cc:290] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:00.144618  2191 leader_election.cc:304] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:00.144681  1601 raft_consensus.cc:1275] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:01:00.146425  6376 raft_consensus.cc:2804] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:00.146886  6376 raft_consensus.cc:493] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:00.147228  6376 raft_consensus.cc:3060] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:01:00.151475  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 76174.7us
I20260709 13:01:00.152336  2192 leader_election.cc:304] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:00.155473  6334 raft_consensus.cc:2749] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:01:00.155663  6464 raft_consensus.cc:515] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:00.157812  6464 leader_election.cc:290] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:00.106096  6331 raft_consensus.cc:493] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.163130  6331 raft_consensus.cc:515] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:00.165202  6331 leader_election.cc:290] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:01:00.166002  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 80773us
I20260709 13:01:00.166517  6467 raft_consensus.cc:2749] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:00.171133  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:00.168200  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:00.154386  2192 leader_election.cc:304] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:00.174979  1672 raft_consensus.cc:2393] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 16: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
W20260709 13:01:00.175462  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 55196us
I20260709 13:01:00.175777  1496 leader_election.cc:304] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:00.183813  6467 raft_consensus.cc:2804] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:00.184410  6467 raft_consensus.cc:697] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:00.185333  6467 consensus_queue.cc:237] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:00.185850  2192 leader_election.cc:304] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:00.187135  2192 leader_election.cc:304] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:00.187848  6494 raft_consensus.cc:2804] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:00.188099  6193 consensus_queue.cc:1048] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:00.189805  6193 raft_consensus.cc:3060] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:00.191447  1497 leader_election.cc:400] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 election: Vote denied by peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303) with higher term. Message: Invalid argument: T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 12. Current term is 13.
I20260709 13:01:00.191859  1497 leader_election.cc:403] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:01:00.193447  1497 leader_election.cc:400] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303) with higher term. Message: Invalid argument: T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 8. Current term is 9.
I20260709 13:01:00.142464  6351 raft_consensus.cc:3060] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:00.195441  2192 leader_election.cc:304] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
W20260709 13:01:00.194332  1644 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.507s (SENT) [suppressed 16 similar messages]
I20260709 13:01:00.191622  6422 raft_consensus.cc:2749] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:00.196628  6464 raft_consensus.cc:2749] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303) with higher term. Message: Invalid argument: T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 12. Current term is 13.
I20260709 13:01:00.199769  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:00.217890  2192 leader_election.cc:304] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:00.204715  6193 raft_consensus.cc:2749] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:00.205224  6494 raft_consensus.cc:697] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 15 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:00.170390  1606 raft_consensus.cc:515] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:00.229926  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:00.230602  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:00.253007  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:00.254374  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:00.246075  1598 raft_consensus.cc:2468] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 11.
I20260709 13:01:00.223695  6334 raft_consensus.cc:3060] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:00.260707  1601 raft_consensus.cc:2468] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 13.
W20260709 13:01:00.262092  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:00.253816  1607 raft_consensus.cc:2468] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 16.
I20260709 13:01:00.258196  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:00.258177  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:00.263813  1672 raft_consensus.cc:3055] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:00.223915  6374 raft_consensus.cc:2749] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:00.225531  6275 raft_consensus.cc:2804] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:00.260234  1606 leader_election.cc:290] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:00.265370  2192 leader_election.cc:304] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:00.267220  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:00.271538  2226 raft_consensus.cc:3060] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:00.264110  1672 raft_consensus.cc:740] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:00.230213  6465 raft_consensus.cc:493] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:00.246472  6453 raft_consensus.cc:3055] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:00.258006  6466 raft_consensus.cc:493] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.230799  6404 consensus_queue.cc:1048] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:01:00.279076  1672 consensus_queue.cc:260] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:00.292049  1672 raft_consensus.cc:3060] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:00.277213  6275 raft_consensus.cc:493] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:00.266283  6464 consensus_queue.cc:1048] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:01:00.293591  6391 raft_consensus.cc:515] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:00.296092  6391 leader_election.cc:290] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:00.279198  6453 raft_consensus.cc:740] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:00.292937  6193 raft_consensus.cc:493] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:00.293334  6275 raft_consensus.cc:3060] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:00.298594  2226 raft_consensus.cc:2468] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 11.
I20260709 13:01:00.302440  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:00.311921  2218 raft_consensus.cc:1240] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:00.312011  1672 raft_consensus.cc:2468] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 11.
I20260709 13:01:00.307154  1674 raft_consensus.cc:1240] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:00.307117  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:00.312088  1607 raft_consensus.cc:3060] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:00.308751  1677 raft_consensus.cc:1275] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 13:01:00.317497  1571 leader_election.cc:304] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
W20260709 13:01:00.327059  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 132737us
W20260709 13:01:00.329037  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 134733us
W20260709 13:01:00.334746  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:00.329416  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:00.310039  6439 raft_consensus.cc:2749] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:00.380568  1523 raft_consensus.cc:2468] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 10.
I20260709 13:01:00.354496  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:00.381407  1524 raft_consensus.cc:2468] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 16.
I20260709 13:01:00.379710  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:00.385707  1497 leader_election.cc:304] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:00.325872  6143 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.384657  1530 raft_consensus.cc:2468] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 11.
I20260709 13:01:00.392284  6143 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:00.395512  6143 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:00.395533  6302 raft_consensus.cc:515] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:00.397351  6275 raft_consensus.cc:515] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:00.397917  6159 raft_consensus.cc:2749] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:00.300626  6193 raft_consensus.cc:515] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:00.389446  5976 raft_consensus.cc:493] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.389022  6494 consensus_queue.cc:237] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:00.400100  6302 leader_election.cc:290] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:00.401314  6450 raft_consensus.cc:3055] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:00.384591  6369 raft_consensus.cc:493] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:00.292042  6466 raft_consensus.cc:515] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:00.353677  6462 raft_consensus.cc:2804] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:00.416613  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:00.404793  6493 raft_consensus.cc:493] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
W20260709 13:01:00.423206  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 72093.8us
I20260709 13:01:00.426049  1607 raft_consensus.cc:2468] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 14.
I20260709 13:01:00.291436  6465 raft_consensus.cc:515] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:00.299610  6453 consensus_queue.cc:260] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:00.443174  1646 leader_election.cc:304] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
W20260709 13:01:00.428743  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 163427us
I20260709 13:01:00.352795  5747 consensus_queue.cc:1048] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 13:01:00.356997  6456 consensus_queue.cc:1059] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.062s
I20260709 13:01:00.440698  1603 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 15.
W20260709 13:01:00.419920  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:00.417936  6439 raft_consensus.cc:493] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:00.443867  1497 leader_election.cc:304] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:00.456748  6456 raft_consensus.cc:3055] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:00.457234  6456 raft_consensus.cc:740] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:00.457427  6342 raft_consensus.cc:2749] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:00.458093  6456 consensus_queue.cc:260] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:01:00.459200  6504 log.cc:927] Time spent T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:01:00.459451  6342 consensus_queue.cc:1048] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:00.462448  1497 leader_election.cc:304] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:00.451754  1646 leader_election.cc:304] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:00.464288  6324 raft_consensus.cc:2804] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:00.464799  6324 raft_consensus.cc:697] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 14 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:00.465596  6324 consensus_queue.cc:237] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:00.467976  2190 leader_election.cc:304] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:00.433249  6450 raft_consensus.cc:740] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:00.468953  2190 leader_election.cc:304] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
W20260709 13:01:00.469959  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:00.469514  6450 consensus_queue.cc:260] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:00.470643  6450 raft_consensus.cc:3060] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:00.439369  6331 raft_consensus.cc:493] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:00.471223  6331 raft_consensus.cc:515] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:00.473440  6331 leader_election.cc:290] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:00.473620  6404 raft_consensus.cc:2804] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:00.452323  6439 raft_consensus.cc:515] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:00.476011  6439 leader_election.cc:290] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:00.476724  6439 raft_consensus.cc:2804] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:00.430045  5976 raft_consensus.cc:515] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:00.478400  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:00.479127  5976 leader_election.cc:290] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:00.479728  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:00.480338  1677 raft_consensus.cc:2468] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 10.
I20260709 13:01:00.481104  6487 raft_consensus.cc:493] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.481814  5976 raft_consensus.cc:493] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:00.481630  6487 raft_consensus.cc:515] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:00.474058  6404 raft_consensus.cc:493] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:00.483036  6404 raft_consensus.cc:3060] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:00.484076  6487 leader_election.cc:290] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:00.430150  6422 raft_consensus.cc:493] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:00.487586  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:00.488574  1497 leader_election.cc:304] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:00.447984  2192 leader_election.cc:304] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:01:00.486310  2191 leader_election.cc:304] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:00.495687  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:00.497228  1603 raft_consensus.cc:2468] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 14.
I20260709 13:01:00.477121  6439 raft_consensus.cc:493] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:00.443208  6273 raft_consensus.cc:2804] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:00.502328  1646 leader_election.cc:304] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
W20260709 13:01:00.499415  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 51519.4us
I20260709 13:01:00.470877  5747 raft_consensus.cc:493] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.459414  6456 raft_consensus.cc:3060] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:00.447055  6462 raft_consensus.cc:697] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 11 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:00.515046  1497 leader_election.cc:304] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:00.418491  6501 consensus_queue.cc:1048] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:01:00.513810  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:00.488047  6391 raft_consensus.cc:2749] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:00.482326  5976 raft_consensus.cc:515] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:00.522611  2218 raft_consensus.cc:1240] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:00.440958  6369 raft_consensus.cc:515] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:00.524526  1677 raft_consensus.cc:2468] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 14.
I20260709 13:01:00.512247  6439 raft_consensus.cc:3060] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:00.499060  6507 raft_consensus.cc:2804] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:01:00.545790  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 43543us
I20260709 13:01:00.518606  6159 raft_consensus.cc:2804] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:00.523351  6487 raft_consensus.cc:493] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.521628  6273 raft_consensus.cc:697] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:00.543957  6203 raft_consensus.cc:2804] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:00.552810  6514 raft_consensus.cc:2804] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:00.553364  6514 raft_consensus.cc:493] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:00.553732  6514 raft_consensus.cc:3060] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:00.554065  6369 leader_election.cc:290] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:00.541745  6244 consensus_queue.cc:1059] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 13:01:00.501657  6422 raft_consensus.cc:515] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:00.561437  6193 leader_election.cc:290] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:00.561630  6462 consensus_queue.cc:237] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:00.522429  5747 raft_consensus.cc:515] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:00.566229  6487 raft_consensus.cc:515] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:00.581180  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 54876.7us
I20260709 13:01:00.447398  6493 raft_consensus.cc:515] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:00.545045  6467 raft_consensus.cc:2749] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:01:00.616551  1571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:00.617086  1496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:00.617939  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:00.619120  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:00.625730  2218 raft_consensus.cc:2393] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 11: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:01:00.620100  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:00.549413  6159 raft_consensus.cc:493] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:00.551462  6507 raft_consensus.cc:697] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:00.615403  6334 raft_consensus.cc:2749] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:01:00.635473  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 120520us
I20260709 13:01:00.638065  1497 leader_election.cc:304] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:00.619074  6356 raft_consensus.cc:493] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.619490  6275 leader_election.cc:290] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:00.642494  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:01:00.633054  6500 log.cc:927] Time spent T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
I20260709 13:01:00.683643  1604 raft_consensus.cc:2468] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 13.
I20260709 13:01:00.621802  6244 raft_consensus.cc:3055] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:00.681177  1606 raft_consensus.cc:1275] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:01:00.686829  1524 raft_consensus.cc:1240] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:00.686879  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:00.689141  6466 leader_election.cc:290] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:01:00.689679  6517 log.cc:927] Time spent T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260709 13:01:00.690436  6244 raft_consensus.cc:740] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:00.692008  6324 raft_consensus.cc:493] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.691994  6439 raft_consensus.cc:515] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:00.692802  6324 raft_consensus.cc:515] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:00.694298  6439 leader_election.cc:290] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 17 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:00.634856  6159 raft_consensus.cc:3060] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:00.700937  5747 leader_election.cc:290] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:00.696095  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:00.703341  1604 raft_consensus.cc:3060] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:00.692143  6244 consensus_queue.cc:260] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:00.687526  1531 raft_consensus.cc:1275] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:01:00.710198  6334 raft_consensus.cc:493] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:00.682500  6338 raft_consensus.cc:2804] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:00.719857  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:00.727547  1677 raft_consensus.cc:2468] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 12.
I20260709 13:01:00.721784  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:00.718061  6334 raft_consensus.cc:515] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:00.724937  6088 raft_consensus.cc:493] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.728410  1681 raft_consensus.cc:2393] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 14: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:01:00.729915  1571 leader_election.cc:304] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:00.729827  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:00.734098  1531 raft_consensus.cc:1275] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:01:00.732367  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:00.712055  5747 raft_consensus.cc:493] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.741323  5747 raft_consensus.cc:515] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:00.735649  1524 raft_consensus.cc:2410] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for term 15 because replica has last-logged OpId of term: 14 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 13:01:00.731421  6088 raft_consensus.cc:515] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:00.737638  6334 leader_election.cc:290] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:00.744262  6203 raft_consensus.cc:493] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:00.744771  6203 raft_consensus.cc:3060] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:00.739754  6493 leader_election.cc:290] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:00.740399  6514 raft_consensus.cc:515] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:00.749248  6514 leader_election.cc:290] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:00.756083  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:00.756924  1526 raft_consensus.cc:2393] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 10: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:01:00.757194  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:00.758575  1526 raft_consensus.cc:1240] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:00.760458  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:00.760872  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:00.761814  1523 raft_consensus.cc:1275] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:01:00.762776  6515 log.cc:927] Time spent T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 13:01:00.763186  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:00.761832  1527 raft_consensus.cc:1240] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:00.765698  6487 leader_election.cc:290] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:00.764948  1526 raft_consensus.cc:1275] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:01:00.769387  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:00.770076  1681 raft_consensus.cc:2468] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 13.
I20260709 13:01:00.729406  6273 consensus_queue.cc:237] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:00.773873  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:00.774518  2218 raft_consensus.cc:2468] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 10.
I20260709 13:01:00.775648  1572 leader_election.cc:304] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:01:00.776731  2191 leader_election.cc:304] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:00.777701  6493 raft_consensus.cc:2804] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:00.778095  6493 raft_consensus.cc:493] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:00.778451  6493 raft_consensus.cc:3060] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:00.784475  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:00.785351  1525 raft_consensus.cc:2393] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 13: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:01:00.791221  6176 raft_consensus.cc:493] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.731799  6511 raft_consensus.cc:2804] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:01:00.792088  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:00.791275  6404 raft_consensus.cc:515] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:00.800849  6376 consensus_meta.cc:287] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b: Time spent flushing consensus metadata: real 0.653s	user 0.005s	sys 0.004s
I20260709 13:01:00.801848  6376 raft_consensus.cc:515] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:00.839198  5976 leader_election.cc:290] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:00.839951  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:00.841378  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:00.844918  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:00.845736  2223 raft_consensus.cc:2393] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 11: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:01:00.847755  1604 raft_consensus.cc:2468] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 17.
I20260709 13:01:00.801097  6404 leader_election.cc:290] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:00.801406  2225 raft_consensus.cc:2368] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 10. Current term is 11.
I20260709 13:01:00.802500  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:00.805161  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:00.849304  1526 raft_consensus.cc:2393] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 10: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:01:00.805930  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:00.807229  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:00.850021  6422 leader_election.cc:290] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:00.850557  1523 raft_consensus.cc:2468] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 13.
I20260709 13:01:00.811405  6334 raft_consensus.cc:493] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.851527  6334 raft_consensus.cc:515] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:00.818264  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 348571us
I20260709 13:01:00.845520  6338 raft_consensus.cc:697] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:00.856305  6338 consensus_queue.cc:237] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:00.857962  6088 leader_election.cc:290] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:00.859030  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:00.859478  2221 raft_consensus.cc:1275] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:01:00.859759  1646 leader_election.cc:304] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:00.861227  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:00.862015  2226 raft_consensus.cc:2393] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 12: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:01:00.862639  1529 raft_consensus.cc:2468] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 12.
I20260709 13:01:00.850145  1527 raft_consensus.cc:2468] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 14.
I20260709 13:01:00.791538  6507 consensus_queue.cc:237] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:00.865154  6369 raft_consensus.cc:2804] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:00.822577  6450 raft_consensus.cc:493] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.853595  6334 leader_election.cc:290] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:00.853641  6324 leader_election.cc:290] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:00.824928  6453 raft_consensus.cc:3060] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:00.866742  6324 consensus_queue.cc:1048] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:01:00.867129  2225 raft_consensus.cc:1275] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 12. (term mismatch)
I20260709 13:01:00.873142  2225 pending_rounds.cc:85] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b: Aborting all ops after (but not including) 11
W20260709 13:01:00.828419  6516 log.cc:927] Time spent T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 13:01:00.832310  6465 leader_election.cc:290] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:00.792099  6511 raft_consensus.cc:493] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:00.874291  6511 raft_consensus.cc:3060] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:00.871101  6376 leader_election.cc:290] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 14 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:00.877744  2225 pending_rounds.cc:107] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 13:01:00.881544  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:00.882237  1681 raft_consensus.cc:3060] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:00.837684  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:00.715086  6356 raft_consensus.cc:515] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:01:00.885023  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 109475us
I20260709 13:01:00.862380  6493 raft_consensus.cc:515] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:00.868057  6244 raft_consensus.cc:3060] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:00.868574  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:00.869140  6450 raft_consensus.cc:515] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:00.865599  6369 raft_consensus.cc:493] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:00.913142  2219 raft_consensus.cc:1240] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:00.913934  1674 raft_consensus.cc:2393] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 15: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:01:00.822265  6159 raft_consensus.cc:515] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:00.791842  6176 raft_consensus.cc:515] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:00.826648  6470 raft_consensus.cc:2804] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:00.882982  2218 raft_consensus.cc:2393] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 11: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:01:00.883381  2225 raft_consensus.cc:2889] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:00.883435  1679 raft_consensus.cc:2468] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 11.
I20260709 13:01:00.834988  5747 leader_election.cc:290] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:01:00.883599  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 149747us
W20260709 13:01:00.895596  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:00.902501  2192 leader_election.cc:304] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:01:00.920284  1681 raft_consensus.cc:2468] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 14.
I20260709 13:01:00.923671  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:00.924432  2226 raft_consensus.cc:2468] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 14.
I20260709 13:01:00.926108  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:00.927116  2218 raft_consensus.cc:2393] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 9: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:01:00.929800  1674 raft_consensus.cc:1275] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:01:00.930855  1571 leader_election.cc:304] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:00.931229  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:00.932842  1570 leader_election.cc:304] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:00.921355  2191 leader_election.cc:304] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:00.931998  1605 raft_consensus.cc:2468] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 15.
I20260709 13:01:00.936580  1571 leader_election.cc:304] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:00.938035  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:00.900846  6487 raft_consensus.cc:2804] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:00.943239  1525 raft_consensus.cc:1275] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 7. (term mismatch)
I20260709 13:01:00.948460  1525 pending_rounds.cc:85] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting all ops after (but not including) 6
I20260709 13:01:00.948735  1525 pending_rounds.cc:107] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting uncommitted NO_OP operation due to leader change: 14.7
I20260709 13:01:00.948956  1525 raft_consensus.cc:2889] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:00.944152  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:00.949757  1672 raft_consensus.cc:2468] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 14.
I20260709 13:01:00.949851  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:00.944962  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:00.950811  2221 raft_consensus.cc:2468] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 15.
I20260709 13:01:00.917872  6369 raft_consensus.cc:3060] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:00.956430  1571 leader_election.cc:304] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:00.917270  6470 raft_consensus.cc:493] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:00.952154  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:00.962926  6470 raft_consensus.cc:3060] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:00.948412  6487 raft_consensus.cc:493] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:00.963764  6487 raft_consensus.cc:3060] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:00.927389  6514 raft_consensus.cc:2804] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:00.967098  6514 raft_consensus.cc:697] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 17 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:00.968025  6514 consensus_queue.cc:237] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:00.969269  6460 raft_consensus.cc:2804] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:00.969702  6460 raft_consensus.cc:493] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:00.970023  6460 raft_consensus.cc:3060] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:00.972304  6356 leader_election.cc:290] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:00.974411  6176 leader_election.cc:290] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:00.956342  6450 leader_election.cc:290] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:00.917341  6358 consensus_queue.cc:1048] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.065s
I20260709 13:01:00.982153  1604 raft_consensus.cc:1275] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:01:00.917450  6465 raft_consensus.cc:493] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:00.983592  6511 raft_consensus.cc:515] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:00.952248  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:00.952732  1527 raft_consensus.cc:1240] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:00.990446  1676 raft_consensus.cc:2468] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 13.
I20260709 13:01:00.943228  5732 raft_consensus.cc:493] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.954145  6493 leader_election.cc:290] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 14 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:00.955468  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:00.995239  1672 raft_consensus.cc:3060] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:00.950829  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:00.983764  6465 raft_consensus.cc:515] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:00.945308  6508 raft_consensus.cc:493] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.985648  6369 raft_consensus.cc:515] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:00.949083  6494 raft_consensus.cc:2804] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:00.989334  6487 raft_consensus.cc:515] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:00.949291  1572 leader_election.cc:400] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 election: Vote denied by peer b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373) with higher term. Message: Invalid argument: T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 10. Current term is 11.
I20260709 13:01:00.991868  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:01.007902  2218 raft_consensus.cc:1275] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:01:00.951637  1606 raft_consensus.cc:2468] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 9.
I20260709 13:01:00.899953  6203 raft_consensus.cc:515] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:01.002853  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:01.003949  1646 leader_election.cc:304] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:01.010573  1572 leader_election.cc:403] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:01:00.997804  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:01.015822  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:01.013969  1646 leader_election.cc:304] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:01.018813  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:01.019582  1529 raft_consensus.cc:3060] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:01.001408  6302 raft_consensus.cc:493] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.001751  6466 raft_consensus.cc:2804] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:01:01.048914  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 92602.5us
I20260709 13:01:01.021776  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:01.050828  1526 raft_consensus.cc:3060] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:01.050405  1571 leader_election.cc:304] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:01.056965  1672 raft_consensus.cc:2468] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 14.
I20260709 13:01:01.029175  6369 leader_election.cc:290] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:01.031971  6465 leader_election.cc:290] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:01.066022  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:01.035336  5747 raft_consensus.cc:2749] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:01.011698  6494 raft_consensus.cc:697] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 14 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:01.041213  6460 raft_consensus.cc:515] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:01.044875  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:01.047529  6159 leader_election.cc:290] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:01.019634  2226 raft_consensus.cc:1275] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:01:01.068061  1681 raft_consensus.cc:2468] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 13.
I20260709 13:01:00.994488  5732 raft_consensus.cc:515] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:01.072005  1529 raft_consensus.cc:2468] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 12.
W20260709 13:01:01.072664  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 126595us
I20260709 13:01:01.081305  1646 leader_election.cc:304] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:01.081808  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:01.004806  6508 raft_consensus.cc:515] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:01.083045  6460 leader_election.cc:290] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:01.083751  1527 raft_consensus.cc:2468] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 15.
I20260709 13:01:01.084372  6508 leader_election.cc:290] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:01.086279  5732 leader_election.cc:290] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:01.079051  6462 raft_consensus.cc:3060] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:01.087880  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:01.050390  6088 raft_consensus.cc:2804] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:01.089314  6088 raft_consensus.cc:493] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:01.089720  6088 raft_consensus.cc:3060] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:01.078871  6465 raft_consensus.cc:493] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.091369  6465 raft_consensus.cc:515] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:01.093488  6465 leader_election.cc:290] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:01.094228  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:01.070408  6356 raft_consensus.cc:2804] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:01.094938  6356 raft_consensus.cc:493] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:01.095329  6356 raft_consensus.cc:3060] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:01.066035  6358 raft_consensus.cc:2804] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:01.097303  6358 raft_consensus.cc:493] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:01.097680  6358 raft_consensus.cc:3060] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:01.007200  6324 consensus_queue.cc:1048] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.062s
W20260709 13:01:01.087709  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:01.099081  6494 consensus_queue.cc:237] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:01.100399  6520 raft_consensus.cc:2804] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:01.100821  6520 raft_consensus.cc:493] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:01.101186  6520 raft_consensus.cc:3060] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:01.102384  1604 raft_consensus.cc:1275] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:01:01.104537  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:01.105239  1604 raft_consensus.cc:2368] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for earlier term 13. Current term is 14.
I20260709 13:01:01.106381  1679 raft_consensus.cc:1275] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:01:01.108003  2190 leader_election.cc:304] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:01:01.108759  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:01.117702  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:01.120927  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:01.121829  1672 raft_consensus.cc:2468] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 10.
I20260709 13:01:01.125989  2190 leader_election.cc:304] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:01.129704  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:01.132364  1646 leader_election.cc:400] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 election: Vote denied by peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303) with higher term. Message: Invalid argument: T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for earlier term 13. Current term is 14.
I20260709 13:01:01.132498  1672 raft_consensus.cc:2393] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 10: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:01:01.077888  6466 raft_consensus.cc:697] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 11 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:01.134060  6466 consensus_queue.cc:237] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:01.134539  6267 raft_consensus.cc:493] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.135124  6267 raft_consensus.cc:515] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:01.132759  1646 leader_election.cc:403] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:01:01.138074  6519 raft_consensus.cc:3060] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:01.152266  2190 leader_election.cc:304] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:01.154419  6519 raft_consensus.cc:2749] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303) with higher term. Message: Invalid argument: T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for earlier term 13. Current term is 14.
I20260709 13:01:01.157451  1677 raft_consensus.cc:1240] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:01.103713  1571 leader_election.cc:304] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
W20260709 13:01:01.159446  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 55805.4us
W20260709 13:01:01.160050  1571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:01.163408  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 43491.9us
I20260709 13:01:01.165156  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:01.102613  6453 raft_consensus.cc:2804] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:01.166114  1571 leader_election.cc:304] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:01.178355  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:01.177783  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:01.129235  6460 raft_consensus.cc:493] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.152926  6176 raft_consensus.cc:493] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.069983  5976 consensus_queue.cc:1048] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.096s
I20260709 13:01:01.215266  1530 raft_consensus.cc:1275] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:01:01.216348  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:01.217490  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:01.069114  6302 raft_consensus.cc:515] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:01.131734  6439 raft_consensus.cc:2749] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:01.192176  1525 raft_consensus.cc:1275] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:01:01.165751  5747 raft_consensus.cc:2804] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:01.211125  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:01.211616  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:01.129032  6465 raft_consensus.cc:493] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:01.219828  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:01.211215  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:01.212050  6203 leader_election.cc:290] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:01.212426  6460 raft_consensus.cc:515] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:01:01.213078  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:01.179050  6422 raft_consensus.cc:2804] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:01.230424  1532 raft_consensus.cc:3060] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:01.218530  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:01.231907  1529 raft_consensus.cc:3060] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:01.243273  1530 raft_consensus.cc:2376] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 14. Re-sending same reply.
I20260709 13:01:01.213363  6176 raft_consensus.cc:515] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:01.235191  1526 raft_consensus.cc:2468] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 11.
I20260709 13:01:01.119563  6369 consensus_queue.cc:1048] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.070s
I20260709 13:01:01.234251  1644 leader_election.cc:304] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:01.162994  6391 consensus_queue.cc:1048] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 13:01:01.238647  1497 leader_election.cc:304] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:01.182555  6453 raft_consensus.cc:493] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:01.161073  6334 consensus_queue.cc:1059] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.069s
I20260709 13:01:01.163317  6508 consensus_queue.cc:1048] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.069s
I20260709 13:01:01.229117  5747 raft_consensus.cc:493] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:01.253643  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:01.219698  6487 leader_election.cc:290] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:01.169488  5732 consensus_queue.cc:1048] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.068s
I20260709 13:01:01.252866  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:01.287098  1525 raft_consensus.cc:2468] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 15.
I20260709 13:01:01.287354  1530 raft_consensus.cc:2468] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 11.
I20260709 13:01:01.239909  6501 raft_consensus.cc:2749] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:01.261602  1497 leader_election.cc:304] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:01.232704  6324 consensus_queue.cc:1048] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 13:01:01.274066  1529 raft_consensus.cc:2468] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 16.
I20260709 13:01:01.257017  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:01.234900  6456 raft_consensus.cc:493] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.319960  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:01.251485  6422 raft_consensus.cc:697] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 12 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:01.256084  6453 raft_consensus.cc:3060] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:01.326260  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:01.322930  1526 raft_consensus.cc:3060] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:01.237979  5976 consensus_queue.cc:1048] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 13:01:01.328605  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:01.325636  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:01.279863  5747 raft_consensus.cc:3060] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:01.328100  1678 raft_consensus.cc:1275] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:01:01.332578  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:01.333591  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:01.333746  2191 leader_election.cc:304] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:01.259191  6203 raft_consensus.cc:2749] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:01.332124  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 13:01:01.330566  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 397824us
I20260709 13:01:01.331342  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:01.288686  6342 raft_consensus.cc:2749] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:01:01.355306  1530 raft_consensus.cc:2393] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 13: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:01:01.263213  6521 consensus_queue.cc:1059] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.061s
I20260709 13:01:01.292534  6482 raft_consensus.cc:2804] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:01.339066  2223 raft_consensus.cc:1240] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:01.238552  6465 raft_consensus.cc:515] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:01.359364  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:01.363582  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:01.364256  2222 raft_consensus.cc:3060] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Advancing to term 12
W20260709 13:01:01.364717  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 103149us
I20260709 13:01:01.366466  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:01.371626  1570 leader_election.cc:304] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:01.376719  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:01.377487  1528 raft_consensus.cc:3060] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:01.367198  2225 raft_consensus.cc:2468] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 14.
I20260709 13:01:01.379544  1523 raft_consensus.cc:2393] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 13: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:01:01.381425  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:01.383934  1644 leader_election.cc:304] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:01.389055  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:01.390338  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:01.393707  1526 raft_consensus.cc:2468] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 10.
I20260709 13:01:01.358417  6467 raft_consensus.cc:2749] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:01.362251  6482 raft_consensus.cc:493] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:01.397408  1675 raft_consensus.cc:1275] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:01:01.395514  1530 raft_consensus.cc:2468] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 14.
I20260709 13:01:01.400424  1525 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 15.
I20260709 13:01:01.328653  6456 raft_consensus.cc:515] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:01.407480  1570 leader_election.cc:304] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:01.322042  6470 raft_consensus.cc:515] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:01.400606  2190 leader_election.cc:304] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:01.410131  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:01.428110  1523 raft_consensus.cc:2393] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 13: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:01:01.390120  6358 raft_consensus.cc:515] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:01.419307  2222 raft_consensus.cc:2468] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 12.
I20260709 13:01:01.420953  6465 leader_election.cc:290] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:01.421818  6460 leader_election.cc:290] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:01.423038  6176 leader_election.cc:290] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:01.424203  6302 leader_election.cc:290] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:01.449620  1604 raft_consensus.cc:2393] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 15: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:01:01.424806  6456 leader_election.cc:290] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:01.424970  6450 consensus_queue.cc:1059] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.018s
I20260709 13:01:01.431015  1644 leader_election.cc:304] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:01:01.426431  6203 raft_consensus.cc:2749] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:01.439839  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:01.461333  1644 leader_election.cc:304] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:01.440814  1570 leader_election.cc:304] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:01.445178  1528 raft_consensus.cc:2468] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 14.
I20260709 13:01:01.454098  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:01.405511  6482 raft_consensus.cc:3060] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:01.459226  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:01.485011  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:01.423040  6511 leader_election.cc:290] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:01.436625  6334 raft_consensus.cc:2804] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:01.438773  6461 raft_consensus.cc:2749] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:01:01.493963  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 53254.3us
I20260709 13:01:01.496363  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:01.490127  1675 raft_consensus.cc:2468] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 18.
I20260709 13:01:01.501448  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:01.500094  1570 leader_election.cc:304] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:01.502431  1571 leader_election.cc:304] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
W20260709 13:01:01.510833  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:01.433334  6356 raft_consensus.cc:515] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:01.437511  6143 consensus_queue.cc:1048] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 13:01:01.517818  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:01.497529  6302 raft_consensus.cc:2749] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:01.519106  1528 raft_consensus.cc:2468] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 14.
I20260709 13:01:01.497308  6391 raft_consensus.cc:2804] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:01.491716  5976 raft_consensus.cc:2749] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:01.528035  6244 consensus_queue.cc:1048] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:01.528678  6391 raft_consensus.cc:697] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 14 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:01.435154  6422 consensus_queue.cc:237] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:01.529562  6391 consensus_queue.cc:237] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:01.520126  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:01.512087  6460 raft_consensus.cc:2804] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:01:01.513469  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 179817us
I20260709 13:01:01.510493  6334 raft_consensus.cc:697] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 14 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:01.448009  6466 consensus_queue.cc:1048] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
W20260709 13:01:01.524706  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 124167us
I20260709 13:01:01.527951  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:01.535586  1532 raft_consensus.cc:2468] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 18.
I20260709 13:01:01.518082  6487 raft_consensus.cc:2804] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:01:01.537434  1523 raft_consensus.cc:2393] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 11: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:01:01.547641  6536 consensus_queue.cc:1048] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.162s
W20260709 13:01:01.581563  6542 log.cc:927] Time spent T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.186s	user 0.001s	sys 0.000s
I20260709 13:01:01.548350  6532 raft_consensus.cc:493] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.583051  6532 raft_consensus.cc:515] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:01.584859  6462 raft_consensus.cc:2749] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373) with higher term. Message: Invalid argument: T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 10. Current term is 11.
I20260709 13:01:01.585276  6532 leader_election.cc:290] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:01.556869  6460 raft_consensus.cc:493] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:01.548847  6547 raft_consensus.cc:493] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.585822  6460 raft_consensus.cc:3060] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:01.549307  6538 raft_consensus.cc:2749] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:01.549785  6552 consensus_queue.cc:1048] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
W20260709 13:01:01.550478  6537 log.cc:927] Time spent T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:01:01.550864  6550 raft_consensus.cc:2804] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:01.513857  1570 leader_election.cc:304] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:01.589636  6088 raft_consensus.cc:515] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:01.590929  1674 raft_consensus.cc:2393] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 16: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:01:01.592355  1675 raft_consensus.cc:1275] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:01:01.586040  6547 raft_consensus.cc:515] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:01.594367  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 80677.6us
I20260709 13:01:01.567093  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:01.577816  6487 raft_consensus.cc:493] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:01.595721  1570 leader_election.cc:304] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:01.599112  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:01.599779  1672 raft_consensus.cc:2468] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 12.
I20260709 13:01:01.581681  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:01.601197  1523 raft_consensus.cc:2410] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b for term 12 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:01:01.605175  1571 leader_election.cc:304] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:01.607216  1532 raft_consensus.cc:1275] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:01:01.601094  6487 raft_consensus.cc:3060] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:01.578197  6456 raft_consensus.cc:493] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:01.598415  6538 raft_consensus.cc:2749] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:01.623554  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:01.625391  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:01.626211  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:01.606370  6466 raft_consensus.cc:2804] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:01.718299  6549 raft_consensus.cc:493] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:01.707525  6143 raft_consensus.cc:493] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:01.717649  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:01.721509  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:01.748695  1672 raft_consensus.cc:2393] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 15: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:01:01.614375  6462 raft_consensus.cc:3060] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:01.714748  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:01.749933  1599 raft_consensus.cc:2368] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 8. Current term is 9.
I20260709 13:01:01.690927  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:01.751101  1607 raft_consensus.cc:2393] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 15: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:01:01.691562  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:01:01.731727  6533 log.cc:927] Time spent T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.331s	user 0.010s	sys 0.000s
I20260709 13:01:01.732280  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:01.738808  6553 raft_consensus.cc:493] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.741685  1531 raft_consensus.cc:3055] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:01:01.742065  6358 leader_election.cc:290] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:01.719238  6470 leader_election.cc:290] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:01:01.743120  6539 log.cc:927] Time spent T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.338s	user 0.000s	sys 0.001s
I20260709 13:01:01.604527  6550 raft_consensus.cc:697] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 11 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:01.714869  6334 consensus_queue.cc:237] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:01.606850  6532 consensus_queue.cc:1048] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.102s
I20260709 13:01:01.689834  1528 raft_consensus.cc:1275] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:01:01.744156  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
W20260709 13:01:01.748613  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 209680us
I20260709 13:01:01.761868  6088 leader_election.cc:290] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:01.742619  6356 leader_election.cc:290] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:01.839342  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:01.808327  6538 raft_consensus.cc:493] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.812243  1601 raft_consensus.cc:1240] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 10. Current term is 12. Ops: []
I20260709 13:01:01.814343  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:01.815982  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:01.819705  5732 raft_consensus.cc:493] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.815402  1600 raft_consensus.cc:1240] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:01.747722  6466 raft_consensus.cc:493] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:01.835260  1572 leader_election.cc:304] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:01:01.761178  1531 raft_consensus.cc:740] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
W20260709 13:01:01.841693  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:01.762650  6547 leader_election.cc:290] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:01.765421  6143 raft_consensus.cc:515] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:01.841126  1607 raft_consensus.cc:2468] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 11.
W20260709 13:01:01.821099  6525 log.cc:927] Time spent T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.645s	user 0.000s	sys 0.002s
I20260709 13:01:01.847486  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:01.850854  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:01.851419  1601 raft_consensus.cc:3060] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:01.829734  6470 raft_consensus.cc:493] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.852820  1606 raft_consensus.cc:2468] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 11.
I20260709 13:01:01.853690  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:01.854341  1600 raft_consensus.cc:2468] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 8.
I20260709 13:01:01.842825  1531 consensus_queue.cc:260] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:01.836279  6544 log.cc:927] Time spent T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
I20260709 13:01:01.856305  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:01.752249  6456 raft_consensus.cc:515] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:01.894861  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:01.895035  1572 leader_election.cc:304] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:01.896495  2225 raft_consensus.cc:2468] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 14.
I20260709 13:01:01.903290  6456 leader_election.cc:290] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:01.897221  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:01.905876  1604 raft_consensus.cc:3060] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:01.847802  6302 raft_consensus.cc:2804] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:01.807924  6553 raft_consensus.cc:515] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:01.899956  6088 raft_consensus.cc:493] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.852699  6538 raft_consensus.cc:515] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:01.843405  6404 raft_consensus.cc:493] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.922411  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:01.843502  6466 raft_consensus.cc:3060] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:01.908430  1572 leader_election.cc:304] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:01:01.947359  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:01.949997  1672 raft_consensus.cc:2468] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 13.
I20260709 13:01:01.955868  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:01.761304  6549 raft_consensus.cc:515] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:01.956588  2225 raft_consensus.cc:2468] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 13.
W20260709 13:01:01.911295  6541 log.cc:927] Time spent T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.224s	user 0.000s	sys 0.001s
I20260709 13:01:01.916075  6088 raft_consensus.cc:515] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:01.905678  6356 raft_consensus.cc:2749] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:01.964243  1528 raft_consensus.cc:1240] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:01.959431  1572 leader_election.cc:304] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:01:01.964036  1604 raft_consensus.cc:2468] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 12.
I20260709 13:01:01.906214  6470 raft_consensus.cc:515] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:01.919087  6538 leader_election.cc:290] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:01.911332  6557 raft_consensus.cc:493] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:01.916659  6553 leader_election.cc:290] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:01.913861  6302 raft_consensus.cc:697] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 12 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:01.848191  5732 raft_consensus.cc:515] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:01:01.960817  6453 consensus_meta.cc:287] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.603s	user 0.005s	sys 0.005s
I20260709 13:01:01.980101  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1030) took 1468 ms. Trace:
I20260709 13:01:01.958612  6532 raft_consensus.cc:2804] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:01:01.974185  5747 consensus_meta.cc:287] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.591s	user 0.004s	sys 0.008s
I20260709 13:01:01.980559  1603 rpcz_store.cc:276] 0709 13:01:00.511257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:00.511423 (+   166us) service_pool.cc:224] Handling call
0709 13:01:00.511734 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:00.517953 (+  6219us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:00.517983 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:00.540755 (+ 22772us) log.cc:844] Serialized 26 byte log entry
0709 13:01:00.916647 (+375892us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:00.916691 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:00.916765 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:01.820377 (+903612us) spinlock_profiling.cc:243] Waited 2.06 ms on lock 0x7b4400022b4c. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a153ecc85 00007f6a153ed6a2 00007f6a1815f1db 00007f6a1815aaaf 00007f6a1814e86e 00007f6a1814dbb6 00007f6a1814d7d8 00007f6a18157221 00007f6a181571d9 00007f6a18157169
0709 13:01:01.975926 (+155549us) raft_consensus.cc:1685] finished
0709 13:01:01.975946 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:01.980027 (+  4081us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":91,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":5014,"spinlock_wait_cycles":4734208,"thread_start_us":349423,"threads_started":1,"wal-append.queue_time_us":517660}
I20260709 13:01:01.971741  6456 raft_consensus.cc:2804] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:01.986102  1599 raft_consensus.cc:2410] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:01:01.988559  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:01.959386  6404 raft_consensus.cc:515] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:01.995240  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:01.985519  6532 raft_consensus.cc:493] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:01.914114  6550 consensus_queue.cc:237] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:01.986631  6554 raft_consensus.cc:493] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:01.987324  6538 raft_consensus.cc:493] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.005343  6267 leader_election.cc:290] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
W20260709 13:01:02.029207  6520 consensus_meta.cc:287] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.928s	user 0.002s	sys 0.010s
I20260709 13:01:01.990370  6456 raft_consensus.cc:493] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:02.043437  1603 raft_consensus.cc:2468] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 11.
I20260709 13:01:01.983453  6453 raft_consensus.cc:515] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:02.010411  6532 raft_consensus.cc:3060] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:02.144974  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:01.987236  5747 raft_consensus.cc:515] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:01:02.172060  6546 log.cc:927] Time spent T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.196s	user 0.000s	sys 0.000s
I20260709 13:01:02.183072  6302 consensus_queue.cc:237] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:02.187652  6143 leader_election.cc:290] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:02.192932  6462 raft_consensus.cc:2749] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:01.985970  6557 raft_consensus.cc:515] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:02.195588  6557 leader_election.cc:290] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:01:02.197505  6567 log.cc:927] Time spent T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.201s	user 0.000s	sys 0.000s
W20260709 13:01:02.199185  6571 log.cc:927] Time spent T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.216s	user 0.000s	sys 0.000s
I20260709 13:01:02.044476  6520 raft_consensus.cc:515] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:02.215065  6520 leader_election.cc:290] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:02.216482  1674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49178 (request call id 2163) took 1099 ms. Trace:
I20260709 13:01:02.216903  1674 rpcz_store.cc:276] 0709 13:01:01.117320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.117490 (+   170us) service_pool.cc:224] Handling call
0709 13:01:02.216226 (+1098736us) spinlock_profiling.cc:243] Waited 472 ms on lock 0x7b540024d454. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:01:02.216393 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1086376320}
I20260709 13:01:02.043954  6538 raft_consensus.cc:515] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:02.220005  6527 log.cc:927] Time spent T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 1.043s	user 0.002s	sys 0.000s
I20260709 13:01:02.045068  6456 raft_consensus.cc:3060] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:02.237169  1600 raft_consensus.cc:1240] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:02.261804  1598 raft_consensus.cc:2410] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:01:02.167022  6338 raft_consensus.cc:493] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.266176  1602 raft_consensus.cc:2368] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 13. Current term is 14.
I20260709 13:01:02.255189  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:02.274173  1674 raft_consensus.cc:2468] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 16.
I20260709 13:01:02.203610  6470 leader_election.cc:290] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:02.271951  6549 leader_election.cc:290] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:02.268962  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:02.279855  1529 raft_consensus.cc:2468] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 11.
I20260709 13:01:02.278249  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:02.283272  2218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50326 (request call id 1051) took 1053 ms. Trace:
I20260709 13:01:02.251189  6391 raft_consensus.cc:493] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.265071  6569 raft_consensus.cc:493] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.253995  6501 raft_consensus.cc:493] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.283782  2218 rpcz_store.cc:276] 0709 13:01:01.226202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.226342 (+   140us) service_pool.cc:224] Handling call
0709 13:01:01.226715 (+   373us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:01.227093 (+   378us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:01.227120 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:01.227690 (+   570us) log.cc:844] Serialized 52 byte log entry
0709 13:01:01.370450 (+142760us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:01.379603 (+  9153us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:01.379887 (+   284us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:02.279176 (+899289us) raft_consensus.cc:1685] finished
0709 13:01:02.279201 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:02.279352 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1717,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":5275,"thread_start_us":142376,"threads_started":1,"wal-append.queue_time_us":737622}
I20260709 13:01:02.287483  1528 raft_consensus.cc:1275] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:01:02.149818  6460 raft_consensus.cc:515] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:02.290638  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:02.297851  1674 raft_consensus.cc:2468] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 13.
I20260709 13:01:02.307296  1601 raft_consensus.cc:2468] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 11.
I20260709 13:01:02.310926  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:02.311568  1601 raft_consensus.cc:2468] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 12.
I20260709 13:01:02.046054  6554 raft_consensus.cc:515] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:02.293519  6404 leader_election.cc:290] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:02.281086  6338 raft_consensus.cc:515] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:02.295665  6569 raft_consensus.cc:515] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:02.321293  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:02.322750  1601 raft_consensus.cc:3060] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:01:02.326977  6487 consensus_meta.cc:287] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.620s	user 0.000s	sys 0.010s
W20260709 13:01:02.327886  6561 log.cc:927] Time spent T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.415s	user 0.000s	sys 0.002s
I20260709 13:01:02.327539  6487 raft_consensus.cc:515] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:02.330716  6088 leader_election.cc:290] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
W20260709 13:01:02.332851  6566 log.cc:927] Time spent T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.410s	user 0.000s	sys 0.003s
I20260709 13:01:02.336145  6460 leader_election.cc:290] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:02.337579  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:02.339752  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
W20260709 13:01:02.341346  6572 log.cc:927] Time spent T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:01:02.293111  6391 raft_consensus.cc:515] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:02.349833  2226 raft_consensus.cc:2393] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 13: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:01:02.365962  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:02.367080  1674 raft_consensus.cc:3060] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:02.379418  6538 leader_election.cc:290] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:02.381186  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:02.384253  6338 leader_election.cc:290] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:02.386374  6391 leader_election.cc:290] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:02.390468  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:02.392442  1673 raft_consensus.cc:2468] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 9.
I20260709 13:01:02.396757  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:02.347002  6569 leader_election.cc:290] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:02.301510  6501 raft_consensus.cc:515] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:02.325819  5732 leader_election.cc:290] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:02.353286  6487 leader_election.cc:290] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 19 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:01:02.406418  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 115207us
I20260709 13:01:02.406306  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:02.420363  1674 raft_consensus.cc:2468] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 19.
I20260709 13:01:02.425019  1601 raft_consensus.cc:2468] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 14.
W20260709 13:01:02.432770  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:02.435930  2190 leader_election.cc:304] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:02.519461  1600 raft_consensus.cc:1240] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 10. Current term is 11. Ops: []
W20260709 13:01:02.520109  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 84287.7us
I20260709 13:01:02.522122  6548 consensus_queue.cc:1048] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:02.522763  1601 raft_consensus.cc:1275] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 13:01:02.430426  6482 consensus_meta.cc:287] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.929s	user 0.010s	sys 0.001s
I20260709 13:01:02.454608  1527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49310 (request call id 1226) took 1407 ms. Trace:
I20260709 13:01:02.435308  6453 leader_election.cc:290] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:02.456638  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:02.534816  1527 rpcz_store.cc:276] 0709 13:01:01.043697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.044583 (+   886us) service_pool.cc:224] Handling call
0709 13:01:02.451144 (+1406561us) spinlock_profiling.cc:243] Waited 11.1 ms on lock 0x7b54001b6cd4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:01:02.451252 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":25443584}
I20260709 13:01:02.537004  1680 raft_consensus.cc:1275] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:01:02.456405  6508 raft_consensus.cc:493] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:02.436599  6193 consensus_queue.cc:1059] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 13:01:02.465021  6456 raft_consensus.cc:515] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:02.468039  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
W20260709 13:01:02.470924  6466 consensus_meta.cc:287] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.512s	user 0.000s	sys 0.009s
I20260709 13:01:02.446437  6562 raft_consensus.cc:493] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:02.450013  5747 leader_election.cc:290] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:02.473493  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49170 (request call id 2417) took 1093 ms. Trace:
I20260709 13:01:02.446679  6487 raft_consensus.cc:493] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:02.483853  1604 raft_consensus.cc:1240] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:02.425817   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:02.473328  6554 leader_election.cc:290] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:01:02.489455  6543 log.cc:927] Time spent T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 1.055s	user 0.004s	sys 0.000s
I20260709 13:01:02.491297  1524 raft_consensus.cc:1240] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 LEADER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:02.496084  6514 raft_consensus.cc:3055] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:02.496492  6532 raft_consensus.cc:515] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:02.496994  6531 raft_consensus.cc:3055] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:02.499190  1571 leader_election.cc:304] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:02.505251  6143 raft_consensus.cc:493] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:02.507488  2191 leader_election.cc:304] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:02.511804  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:02.515297  1525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43010 (request call id 2373) took 1323 ms. Trace:
I20260709 13:01:02.516371  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:02.518187  1532 raft_consensus.cc:1275] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:01:02.444612  1681 raft_consensus.cc:2468] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 14.
I20260709 13:01:02.594391  1605 raft_consensus.cc:2468] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 9.
I20260709 13:01:02.586505  1599 raft_consensus.cc:1275] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:01:02.585228  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:02.595811  1679 raft_consensus.cc:2468] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 9.
I20260709 13:01:02.584247  1677 rpcz_store.cc:276] 0709 13:01:01.380521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.380808 (+   287us) service_pool.cc:224] Handling call
0709 13:01:01.381095 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:01.381287 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:01:01.399359 (+ 18072us) log.cc:844] Serialized 14 byte log entry
0709 13:01:02.473067 (+1073708us) spinlock_profiling.cc:243] Waited 4.84 ms on lock 0x7b180030e140. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1e38ede1 00007f6a1e39b5b1 00007f6a1815b4bc 00007f6a154a948b 00007f6a1e303ab9 00007f6a154c569b 00007f6a154c393f 00007f6a154c3455 00007f6a185ab060 00007f6a185bd716 00007f6a185ce287
0709 13:01:02.473166 (+    99us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:02.473213 (+    47us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:02.473260 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:02.473325 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:02.473438 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":52811,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":12082,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":81,"spinlock_wait_cycles":11138432,"thread_start_us":84126,"threads_started":1}
I20260709 13:01:02.584851  2192 leader_election.cc:304] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:02.589654  1524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43010 (request call id 2361) took 1409 ms. Trace:
I20260709 13:01:02.523912  6548 raft_consensus.cc:493] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:02.597477  1524 rpcz_store.cc:276] 0709 13:01:01.175889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.178874 (+  2985us) service_pool.cc:224] Handling call
0709 13:01:01.179315 (+   441us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:02.490803 (+1311488us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b54001b1d20. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a1852adc0 00007f6a185b51c0 00007f6a185b6231 00007f6a185b2d8f 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c
0709 13:01:02.584640 (+ 93837us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:02.584852 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":262983040}
I20260709 13:01:02.590330  1601 raft_consensus.cc:1275] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:01:02.538831  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:01:02.590863  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 91735.3us
I20260709 13:01:02.603216  1571 leader_election.cc:304] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:02.594092  1525 rpcz_store.cc:276] 0709 13:01:01.191945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.360465 (+168520us) service_pool.cc:224] Handling call
0709 13:01:02.515125 (+1154660us) spinlock_profiling.cc:243] Waited 18.3 ms on lock 0x7b54001b71d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:01:02.515240 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":42096512}
I20260709 13:01:02.520309  6547 raft_consensus.cc:2804] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:01:02.598407  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 91037.3us
I20260709 13:01:02.538980  6574 raft_consensus.cc:493] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:02.599951  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:02.587770  6514 raft_consensus.cc:740] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:02.605159  1603 raft_consensus.cc:2393] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 15: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:01:02.612783  2191 leader_election.cc:304] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:02.605855  2192 leader_election.cc:304] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:02.601891  5747 raft_consensus.cc:2804] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:02.604344  6547 raft_consensus.cc:493] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:02.592710  6562 raft_consensus.cc:515] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:02.608134  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
W20260709 13:01:02.609354  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 111274us
I20260709 13:01:02.609267  1571 leader_election.cc:304] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:02.610991  1678 raft_consensus.cc:2468] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 13.
I20260709 13:01:02.536525  6460 raft_consensus.cc:493] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:02.536752  6482 raft_consensus.cc:515] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:02.605135  1600 raft_consensus.cc:2468] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 11.
I20260709 13:01:02.591477  6531 raft_consensus.cc:740] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:02.619989  1605 raft_consensus.cc:2376] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 12. Re-sending same reply.
I20260709 13:01:02.622273  2219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50326 (request call id 1049) took 1615 ms. Trace:
I20260709 13:01:02.622532  1571 leader_election.cc:304] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:02.588300  6487 raft_consensus.cc:515] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:02.596539  6143 raft_consensus.cc:515] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:02.604509  6193 raft_consensus.cc:2749] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:02.611449  6564 raft_consensus.cc:2804] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:02.595362  6508 raft_consensus.cc:515] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:02.612277  6453 raft_consensus.cc:2804] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:02.625046  2219 rpcz_store.cc:276] 0709 13:01:01.007130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.007244 (+   114us) service_pool.cc:224] Handling call
0709 13:01:01.007562 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:01.026111 (+ 18549us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:01.026146 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:01.066737 (+ 40591us) log.cc:844] Serialized 26 byte log entry
0709 13:01:01.306199 (+239462us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:01:01.306248 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:01.306327 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:02.488700 (+1182373us) spinlock_profiling.cc:243] Waited 1.39 ms on lock 0x7b4400022b4c. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a153ecc85 00007f6a153ed6a2 00007f6a1815f1db 00007f6a1815aaaf 00007f6a1814e86e 00007f6a1814dbb6 00007f6a1814d7d8 00007f6a18157221 00007f6a181571d9 00007f6a18157169
0709 13:01:02.621108 (+132408us) raft_consensus.cc:1685] finished
0709 13:01:02.621131 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:02.622206 (+  1075us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2509,"raft.queue_time_us":33368,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":83,"spinlock_wait_cycles":3203456,"thread_start_us":147684,"threads_started":1,"wal-append.queue_time_us":294552}
I20260709 13:01:02.613880  5747 raft_consensus.cc:493] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:02.625456  6244 raft_consensus.cc:2749] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:02.636183  6487 leader_election.cc:290] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:02.636721  6143 leader_election.cc:290] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:02.609872  6548 raft_consensus.cc:515] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:02.625730  6374 consensus_queue.cc:1048] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.012s
I20260709 13:01:02.625795  6460 raft_consensus.cc:515] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:02.647751  6514 consensus_queue.cc:260] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:02.660255  6460 leader_election.cc:290] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:02.628082  6564 raft_consensus.cc:493] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:02.661068  6564 raft_consensus.cc:3060] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:02.641145  6453 raft_consensus.cc:493] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:02.665306  6453 raft_consensus.cc:3060] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:02.665851  6482 leader_election.cc:290] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:02.637969  6456 leader_election.cc:290] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:02.588891  6466 raft_consensus.cc:515] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:02.633003  6302 raft_consensus.cc:2804] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:01:02.667779  6302 raft_consensus.cc:697] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 19 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:02.668740  6466 leader_election.cc:290] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:02.670266  6508 leader_election.cc:290] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:02.672408  6562 leader_election.cc:290] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:02.660280  6514 raft_consensus.cc:3060] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:02.675832  6532 leader_election.cc:290] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:02.613312  6574 raft_consensus.cc:515] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:02.678275  6574 leader_election.cc:290] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:02.645872  5747 raft_consensus.cc:3060] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:02.679368  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:02.638581  6531 consensus_queue.cc:260] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:02.646265  6193 raft_consensus.cc:2804] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:02.683030  6193 raft_consensus.cc:493] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:02.683435  6193 raft_consensus.cc:3060] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:02.621394  6547 raft_consensus.cc:3060] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:02.614172  6501 leader_election.cc:290] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:02.640017  1607 raft_consensus.cc:2368] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 10. Current term is 11.
I20260709 13:01:02.634322  6587 raft_consensus.cc:2804] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:02.628408  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:02.613680  6176 consensus_queue.cc:1048] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 13:01:02.657143  6548 leader_election.cc:290] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:02.697232  6587 raft_consensus.cc:493] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:02.703691  6587 raft_consensus.cc:3060] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:02.704586  1600 raft_consensus.cc:1240] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:02.706065  1600 raft_consensus.cc:1275] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:01:02.668679  6302 consensus_queue.cc:237] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:02.674561  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:02.708705  1603 raft_consensus.cc:2410] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
W20260709 13:01:02.711804  1681 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49170 (request call id 2414) took 1624 ms (client timeout 1504 ms). Trace:
W20260709 13:01:02.712260  1681 rpcz_store.cc:269] 0709 13:01:01.087513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.131603 (+ 44090us) service_pool.cc:224] Handling call
0709 13:01:02.711621 (+1580018us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b540017a554. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:01:02.711724 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2839644416}
I20260709 13:01:02.713590  6453 raft_consensus.cc:515] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:02.715940  6587 raft_consensus.cc:515] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:02.720477  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:02.721128  2218 raft_consensus.cc:3060] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:02.721243  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:02.721391  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:02.721889  2222 raft_consensus.cc:2468] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 13.
I20260709 13:01:02.722700  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:02.723253  2225 raft_consensus.cc:3060] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:01:02.723906  6453 leader_election.cc:290] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:02.724586  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:02.723848  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:02.726361  1604 raft_consensus.cc:2393] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 9: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:01:02.725566  1602 raft_consensus.cc:2468] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 13.
I20260709 13:01:02.728070  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49310 (request call id 1234) took 1335 ms. Trace:
I20260709 13:01:02.735925  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:01:02.752256  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 146480us
I20260709 13:01:02.763288  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:02.763442  2218 raft_consensus.cc:2468] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 16.
I20260709 13:01:02.728428  1532 rpcz_store.cc:276] 0709 13:01:01.393053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.608112 (+215059us) service_pool.cc:224] Handling call
0709 13:01:02.517865 (+909753us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:02.594580 (+ 76715us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:02.727881 (+133301us) spinlock_profiling.cc:243] Waited 895 ms on lock 0x7b54001b71d0. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b28ad 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:01:02.728013 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2059275008}
W20260709 13:01:02.770608  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 125701us
W20260709 13:01:02.771987  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 159277us
I20260709 13:01:02.772090  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:02.772835  2191 leader_election.cc:304] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:02.776238  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:02.776455  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:02.776934  2218 raft_consensus.cc:2468] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 11.
I20260709 13:01:02.777683  2192 leader_election.cc:304] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:02.779095  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:02.779675  1677 raft_consensus.cc:3060] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:02.784294  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:02.785012  1674 raft_consensus.cc:3060] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:01:02.785844  1603 raft_consensus.cc:2468] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 9.
I20260709 13:01:02.787405  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:02.787997  1599 raft_consensus.cc:3060] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:02.790227  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:02.796460  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:02.796752  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:02.797389  1679 raft_consensus.cc:3060] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:02.798349  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:02.801879  1646 leader_election.cc:304] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:02.803166  6143 raft_consensus.cc:2804] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:02.810629  6331 raft_consensus.cc:3060] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:02.811049  6404 raft_consensus.cc:493] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:02.811568  6404 raft_consensus.cc:515] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:02.813755  6404 leader_election.cc:290] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:02.822260  6331 raft_consensus.cc:2749] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:02.822721  1531 raft_consensus.cc:3060] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:02.823616  1679 raft_consensus.cc:2468] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 11.
I20260709 13:01:02.824587  1674 raft_consensus.cc:2468] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 14.
W20260709 13:01:02.825656  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 52912.6us
I20260709 13:01:02.826418  2191 leader_election.cc:304] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:02.827669  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:02.828104  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:02.828836  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:02.829406  1603 raft_consensus.cc:2376] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 11. Re-sending same reply.
I20260709 13:01:02.828724  6143 raft_consensus.cc:697] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 9 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:02.830955  6143 consensus_queue.cc:237] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:02.832355  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:02.832841  6193 raft_consensus.cc:515] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:02.834583  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36194 (request call id 1929) took 1028 ms. Trace:
I20260709 13:01:02.836373  1607 rpcz_store.cc:276] 0709 13:01:01.806446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.893419 (+ 86973us) service_pool.cc:224] Handling call
0709 13:01:02.834407 (+940988us) spinlock_profiling.cc:243] Waited 740 ms on lock 0x7b5400058554. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:01:02.834525 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1702670720}
I20260709 13:01:02.835739  1606 raft_consensus.cc:1275] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 7. (term mismatch)
I20260709 13:01:02.837495  1606 pending_rounds.cc:85] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642: Aborting all ops after (but not including) 6
I20260709 13:01:02.837581  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:02.835290  1598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36194 (request call id 1914) took 1212 ms. Trace:
I20260709 13:01:02.835243  2221 raft_consensus.cc:2368] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for earlier term 9. Current term is 10.
I20260709 13:01:02.840401  1606 pending_rounds.cc:107] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:01:02.840749  1606 raft_consensus.cc:2889] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:02.838153  1598 rpcz_store.cc:276] 0709 13:01:01.622871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.623013 (+   142us) service_pool.cc:224] Handling call
0709 13:01:02.835111 (+1212098us) spinlock_profiling.cc:243] Waited 515 ms on lock 0x7b54000da554. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:01:02.835236 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1184910592}
I20260709 13:01:02.841866  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:02.838238  1531 raft_consensus.cc:1275] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:01:02.832896  1602 raft_consensus.cc:3060] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:02.793946  6592 consensus_queue.cc:1048] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.055s
I20260709 13:01:02.786907  6587 leader_election.cc:290] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 13 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:02.843171  1531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49310 (request call id 1239) took 1114 ms. Trace:
I20260709 13:01:02.830250  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:02.849684  1603 raft_consensus.cc:2468] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 14.
I20260709 13:01:02.838194  1607 raft_consensus.cc:2468] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 15.
I20260709 13:01:02.851784  1607 raft_consensus.cc:1240] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:02.852725  1603 raft_consensus.cc:1275] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:01:02.852865  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:02.853514  1598 raft_consensus.cc:3060] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:02.804304  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 175642us
I20260709 13:01:02.854724  2192 leader_election.cc:304] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:01:02.857978  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:02.854635  1496 leader_election.cc:304] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:02.855633  1602 raft_consensus.cc:2468] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 13.
I20260709 13:01:02.856475  1677 raft_consensus.cc:2468] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 14.
I20260709 13:01:02.777858  6494 consensus_queue.cc:1048] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.075s
I20260709 13:01:02.864993  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:02.870404  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:02.873515  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:02.855233  1531 rpcz_store.cc:276] 0709 13:01:01.728724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.741260 (+ 12536us) service_pool.cc:224] Handling call
0709 13:01:01.741565 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:02.671869 (+930304us) spinlock_profiling.cc:243] Waited 356 ms on lock 0x7b180030b2e0. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185ee646 00007f6a1852858e 00007f6a185a9f9e 00007f6a185ab7de 00007f6a185b5b49 00007f6a185b6416 00007f6a185b2d8f 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4
0709 13:01:02.822447 (+150578us) spinlock_profiling.cc:243] Waited 22.8 ms on lock 0x7b580077e4d0. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a1850f0aa 00007f6a18591447 00007f6a185a9fe7 00007f6a185ab7de 00007f6a185b5b49 00007f6a185b6416 00007f6a185b2d8f 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4
0709 13:01:02.842910 (+ 20463us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:02.843110 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":870727424}
I20260709 13:01:02.771651  6562 consensus_queue.cc:1048] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 13:01:02.875435  1680 raft_consensus.cc:2468] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 13.
I20260709 13:01:02.878054  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:02.881707  1599 raft_consensus.cc:2468] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 16.
I20260709 13:01:02.883298  2226 raft_consensus.cc:1275] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:01:02.884001  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:02.876680  2192 leader_election.cc:304] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:01:02.887171  6587 raft_consensus.cc:2804] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:02.887656  6587 raft_consensus.cc:493] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:02.888026  6587 raft_consensus.cc:3060] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:02.890944  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:02.891566  2222 raft_consensus.cc:3060] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:02.893044  1598 raft_consensus.cc:2468] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 10.
I20260709 13:01:02.894168  2192 leader_election.cc:304] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:01:02.908493  2222 raft_consensus.cc:2468] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 14.
I20260709 13:01:02.868886  6450 raft_consensus.cc:2804] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:02.967260  6450 raft_consensus.cc:493] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:02.967752  6450 raft_consensus.cc:3060] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:02.968019  6573 log.cc:927] Time spent T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:01:02.968649  6511 consensus_queue.cc:1048] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:02.911550  6555 raft_consensus.cc:2804] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:02.969667  6555 raft_consensus.cc:493] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:02.970031  6555 raft_consensus.cc:3060] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:02.868759  6439 raft_consensus.cc:2804] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:02.912449  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:02.913275  1646 leader_election.cc:304] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:01:02.842432  6547 raft_consensus.cc:515] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:02.961709  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 43848us
I20260709 13:01:02.973537  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:02.838204  6564 raft_consensus.cc:515] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:02.989017  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:02.992081  2218 raft_consensus.cc:2468] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 15.
I20260709 13:01:02.971719  6551 raft_consensus.cc:2804] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:02.974057  6439 raft_consensus.cc:493] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:02.997368  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:02.913703  6592 consensus_queue.cc:1059] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.080s
I20260709 13:01:02.968111  6374 consensus_queue.cc:1048] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.029s
W20260709 13:01:02.961024  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 48974.2us
I20260709 13:01:02.978011  6193 leader_election.cc:290] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 10 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:03.006309  6324 raft_consensus.cc:2804] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:01:03.048689  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:03.047214  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:03.014420  2192 leader_election.cc:304] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:01:03.003185  6439 raft_consensus.cc:3060] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:01:03.059546  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 45269.1us
I20260709 13:01:03.059737  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36194 (request call id 1923) took 1254 ms. Trace:
I20260709 13:01:03.060140  1606 rpcz_store.cc:276] 0709 13:01:01.804864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.898942 (+ 94078us) service_pool.cc:224] Handling call
0709 13:01:02.835436 (+936494us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:02.841198 (+  5762us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:03.059538 (+218340us) spinlock_profiling.cc:243] Waited 936 ms on lock 0x7b54000da550. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b28ad 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:01:03.059680 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2152918400}
I20260709 13:01:03.070171  2218 raft_consensus.cc:1275] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:01:03.038576  6584 raft_consensus.cc:2749] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:03.040508  6324 raft_consensus.cc:493] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:03.050041  6551 raft_consensus.cc:697] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 13 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:03.040664  6494 consensus_queue.cc:1048] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 13:01:03.019416  5747 raft_consensus.cc:515] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:03.089639  2225 raft_consensus.cc:2468] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 16.
I20260709 13:01:03.069092  6511 raft_consensus.cc:2804] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:03.075891  6514 raft_consensus.cc:493] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:03.084908  6324 raft_consensus.cc:3060] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:01:03.114462  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 201285us
I20260709 13:01:03.115401  1646 leader_election.cc:304] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:03.094036  6494 consensus_queue.cc:1243] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 log is divergent from this leader: its last log entry 16.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
W20260709 13:01:03.125728  6593 log.cc:927] Time spent T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 13:01:03.108850  6511 raft_consensus.cc:697] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 10 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:03.120429  2225 raft_consensus.cc:1240] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:03.130172  1646 leader_election.cc:304] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642
W20260709 13:01:03.217926  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 203002us
I20260709 13:01:03.128036  6501 raft_consensus.cc:493] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:03.111173  6514 raft_consensus.cc:515] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:03.272010  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 141929us
I20260709 13:01:03.291239  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:03.293432  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:03.293679  2191 leader_election.cc:304] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:03.294317  1679 raft_consensus.cc:1275] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:01:03.284327  1646 leader_election.cc:304] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
W20260709 13:01:03.297756  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 163297us
I20260709 13:01:03.133301  6143 raft_consensus.cc:2804] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:01:03.300307  1497 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.653s	user 0.000s	sys 0.007s
W20260709 13:01:03.302862  1497 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.655s	user 0.000s	sys 0.008s
I20260709 13:01:03.220847  6564 leader_election.cc:290] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:03.305138  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:03.280967  6519 raft_consensus.cc:2804] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:03.354274  6564 raft_consensus.cc:2749] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:03.354682  6531 raft_consensus.cc:3060] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:03.309442  6596 raft_consensus.cc:493] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.355721  6596 raft_consensus.cc:515] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:01:03.358021  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 53977.2us
I20260709 13:01:03.305439  6588 raft_consensus.cc:493] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.359917  6588 raft_consensus.cc:515] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:03.361994  6596 leader_election.cc:290] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:01:03.363286  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 79013.3us
I20260709 13:01:03.363723  6588 leader_election.cc:290] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:03.368182  6584 raft_consensus.cc:493] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.395654  6584 raft_consensus.cc:515] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:03.397957  6584 leader_election.cc:290] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:03.406032  1497 leader_election.cc:400] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 election: Vote denied by peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303) with higher term. Message: Invalid argument: T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 8. Current term is 9.
I20260709 13:01:03.407693  1497 leader_election.cc:304] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
W20260709 13:01:03.395566  1498 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.0.107.254:40423, user_credentials={real_user=slave}} blocked reactor thread for 48281.4us
W20260709 13:01:03.412904  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:03.341601  6602 log.cc:927] Time spent T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.229s	user 0.000s	sys 0.000s
W20260709 13:01:03.342234  6600 log.cc:927] Time spent T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.218s	user 0.000s	sys 0.000s
I20260709 13:01:03.309257  6589 raft_consensus.cc:493] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.342491  5732 raft_consensus.cc:493] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.309042  6507 raft_consensus.cc:493] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:03.371937  6519 raft_consensus.cc:493] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:03.438088  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 79248us
I20260709 13:01:03.438402  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:03.442233  1497 leader_election.cc:304] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:03.422632  6588 raft_consensus.cc:493] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
W20260709 13:01:03.426940  6598 log.cc:927] Time spent T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.292s	user 0.003s	sys 0.000s
I20260709 13:01:03.426681  6595 raft_consensus.cc:2749] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:03.343851  6450 raft_consensus.cc:515] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:03.297082  6501 raft_consensus.cc:515] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:03.425513  6596 raft_consensus.cc:493] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.426141  6464 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:03.283314  6551 consensus_queue.cc:237] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:03.450486  6519 raft_consensus.cc:3060] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:03.580974  1496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:03.589486  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:03.591634  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:03.592361  1531 raft_consensus.cc:3060] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:03.432386  6555 raft_consensus.cc:515] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:03.541458  6534 raft_consensus.cc:493] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:03.567488  6607 raft_consensus.cc:2804] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:03.655531  1532 raft_consensus.cc:1240] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:03.665378  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:03.667068  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:03.670288  1531 raft_consensus.cc:2468] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 12.
I20260709 13:01:03.617473  6273 raft_consensus.cc:493] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.487967  6507 raft_consensus.cc:515] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:03.677939  2221 raft_consensus.cc:1240] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:03.578878  6613 raft_consensus.cc:493] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.666234  1527 raft_consensus.cc:2468] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 15.
I20260709 13:01:03.449568  5732 raft_consensus.cc:515] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:03.580431  6143 raft_consensus.cc:697] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 16 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:03.702721  6273 raft_consensus.cc:515] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:03.757133  6624 log.cc:927] Time spent T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.155s	user 0.000s	sys 0.000s
I20260709 13:01:03.757599  6273 leader_election.cc:290] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:03.689005  6534 raft_consensus.cc:515] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:03.769089  6534 leader_election.cc:290] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:03.758399  6273 raft_consensus.cc:493] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:03.800681  1571 leader_election.cc:304] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:03.802227  1571 leader_election.cc:304] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
W20260709 13:01:03.803840  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:03.572430  6588 raft_consensus.cc:515] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:03.655130  6595 consensus_queue.cc:1059] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.122s
I20260709 13:01:03.600842  6596 raft_consensus.cc:515] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:03.723104  6607 raft_consensus.cc:697] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 16 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:03.722676  6557 raft_consensus.cc:2764] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:01:03.437815  6589 raft_consensus.cc:515] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:01:03.810377  6608 log.cc:927] Time spent T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.248s	user 0.000s	sys 0.002s
I20260709 13:01:03.866636  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:03.773265  6273 raft_consensus.cc:515] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:03.869863  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:03.879220  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:03.872125  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:03.435835  6511 consensus_queue.cc:237] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:03.807468  6534 raft_consensus.cc:2804] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:03.872951  1673 raft_consensus.cc:2468] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 9.
I20260709 13:01:03.824151  6275 raft_consensus.cc:2804] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:03.901705  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:03.897918  6534 raft_consensus.cc:697] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 11 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:03.902452  1673 raft_consensus.cc:2376] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 14. Re-sending same reply.
I20260709 13:01:03.871405  6595 raft_consensus.cc:493] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.913272  2219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50326 (request call id 1052) took 1193 ms. Trace:
I20260709 13:01:03.882786  6514 leader_election.cc:290] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:03.749482  6613 raft_consensus.cc:515] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:03.917426  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 472773us
I20260709 13:01:03.915917  2219 rpcz_store.cc:276] 0709 13:01:02.719516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:02.764050 (+ 44534us) service_pool.cc:224] Handling call
0709 13:01:02.764400 (+   350us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:02.764770 (+   370us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:02.764798 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:02.786893 (+ 22095us) log.cc:844] Serialized 52 byte log entry
0709 13:01:03.019490 (+232597us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:03.019548 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:03.019628 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:03.913008 (+893380us) raft_consensus.cc:1685] finished
0709 13:01:03.913031 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:03.913208 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12896,"raft.queue_time_us":140,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":4881,"thread_start_us":226971,"threads_started":1,"wal-append.queue_time_us":317612}
I20260709 13:01:03.924294  1496 leader_election.cc:304] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
W20260709 13:01:03.932156  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 490046us
W20260709 13:01:03.924890  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:03.935681  1497 leader_election.cc:304] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
W20260709 13:01:03.938630  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 136456us
I20260709 13:01:03.870247  6623 consensus_queue.cc:1048] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.084s
I20260709 13:01:03.947117  1530 raft_consensus.cc:2468] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 11.
I20260709 13:01:03.803133  6464 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:03.915669  6621 raft_consensus.cc:493] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:03.914098  6534 consensus_queue.cc:237] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:01:03.943049  6324 consensus_meta.cc:287] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.824s	user 0.008s	sys 0.003s
I20260709 13:01:03.940282  6555 leader_election.cc:290] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 16 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:03.921394  6595 raft_consensus.cc:515] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:01:03.991518  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 57613us
I20260709 13:01:03.989952  1571 leader_election.cc:304] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:03.994554  1600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36200 (request call id 2589) took 1275 ms. Trace:
I20260709 13:01:03.995124  1600 rpcz_store.cc:276] 0709 13:01:02.719042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:02.725566 (+  6524us) service_pool.cc:224] Handling call
0709 13:01:02.739709 (+ 14143us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:02.740173 (+   464us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:01:02.912533 (+172360us) log.cc:844] Serialized 14 byte log entry
0709 13:01:03.106807 (+194274us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:03.109845 (+  3038us) log.cc:844] Serialized 26 byte log entry
0709 13:01:03.109972 (+   127us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:03.110002 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:03.110061 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:03.994340 (+884279us) raft_consensus.cc:1685] finished
0709 13:01:03.994361 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:03.994491 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6118,"prepare.queue_time_us":39959,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":1773,"raft.run_cpu_time_us":229,"raft.run_wall_time_us":8592,"thread_start_us":238775,"threads_started":2,"wal-append.queue_time_us":366209}
I20260709 13:01:03.975170  6450 leader_election.cc:290] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:03.953286  6619 consensus_queue.cc:1048] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:01:04.005089  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:01:04.016078  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 82022.3us
I20260709 13:01:04.017004  1497 leader_election.cc:304] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:04.018328  1497 leader_election.cc:304] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
W20260709 13:01:04.006670  2191 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.712s	user 0.006s	sys 0.008s
W20260709 13:01:04.007182  1646 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.001s	sys 0.010s
I20260709 13:01:03.967459  6621 raft_consensus.cc:515] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:03.969671  6324 raft_consensus.cc:515] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:03.990571  6629 raft_consensus.cc:2804] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:03.997818  6630 raft_consensus.cc:493] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:03.990348  6501 leader_election.cc:290] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:03.988844  6632 raft_consensus.cc:493] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:04.023082  6507 leader_election.cc:290] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:04.029809  6625 raft_consensus.cc:2804] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:04.035034  6629 raft_consensus.cc:493] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:03.951833  6143 consensus_queue.cc:237] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:04.027637  2191 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.733s	user 0.006s	sys 0.008s
W20260709 13:01:04.026566  1646 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.584s	user 0.001s	sys 0.010s
I20260709 13:01:04.037004  1497 leader_election.cc:400] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303) with higher term. Message: Invalid argument: T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 13. Current term is 14.
I20260709 13:01:04.047263  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:01:04.007030  6302 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.660s	user 0.000s	sys 0.011s
W20260709 13:01:04.074530  1644 leader_election.cc:336] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.503s (SENT)
I20260709 13:01:04.075541  1644 leader_election.cc:304] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:04.028402  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:03.955633  6607 consensus_queue.cc:237] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:04.025398  6450 raft_consensus.cc:2764] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader election decision vote started in defunct term 11: won
I20260709 13:01:04.007426  6634 raft_consensus.cc:2749] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:01:04.028375  6606 log.cc:927] Time spent T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.280s	user 0.001s	sys 0.000s
I20260709 13:01:04.046828  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:01:04.060534  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 766945us
I20260709 13:01:04.067171  5747 leader_election.cc:290] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:04.053714  6642 raft_consensus.cc:2804] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:04.055934  6629 raft_consensus.cc:3060] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:04.085861  6547 leader_election.cc:290] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:04.086412  6554 raft_consensus.cc:2749] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:04.042704  6595 leader_election.cc:290] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:04.051991  6324 leader_election.cc:290] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:04.089833  6465 raft_consensus.cc:493] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:04.085295  6642 raft_consensus.cc:697] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 14 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:04.042130  6273 leader_election.cc:290] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:04.090416  6465 raft_consensus.cc:515] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:04.043498  6613 leader_election.cc:290] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:04.044811  6588 leader_election.cc:290] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:04.055681  6621 leader_election.cc:290] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:04.090999  6642 consensus_queue.cc:237] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:04.091974  6621 raft_consensus.cc:493] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.092602  6465 leader_election.cc:290] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:04.092459  6621 raft_consensus.cc:515] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:01:04.056717  6587 consensus_meta.cc:287] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b: Time spent flushing consensus metadata: real 1.168s	user 0.012s	sys 0.000s
W20260709 13:01:04.072424  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 82545.8us
I20260709 13:01:04.072639  1497 leader_election.cc:304] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:04.079001  1676 raft_consensus.cc:3060] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:04.086023  6519 raft_consensus.cc:515] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:04.046976  6632 raft_consensus.cc:515] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:04.057124  6630 raft_consensus.cc:515] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:04.105938  1497 leader_election.cc:304] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:04.096014  2191 leader_election.cc:304] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:04.099947  1571 leader_election.cc:304] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:04.100399  1598 raft_consensus.cc:1240] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 9. Current term is 10. Ops: []
W20260709 13:01:04.040127  6531 consensus_meta.cc:287] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent flushing consensus metadata: real 0.685s	user 0.008s	sys 0.002s
W20260709 13:01:04.101513  1644 leader_election.cc:336] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.752s (SENT)
W20260709 13:01:04.046624  6439 consensus_meta.cc:287] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b: Time spent flushing consensus metadata: real 0.973s	user 0.010s	sys 0.000s
I20260709 13:01:04.104236  1572 leader_election.cc:304] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
W20260709 13:01:04.073992  6302 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.727s	user 0.000s	sys 0.011s
I20260709 13:01:04.109028  1644 leader_election.cc:304] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:04.112623  1607 raft_consensus.cc:1240] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:04.058326  6625 raft_consensus.cc:697] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:04.114483  1497 leader_election.cc:304] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:04.115839  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:04.116973  1572 leader_election.cc:304] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:01:04.116255  1571 leader_election.cc:304] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
W20260709 13:01:04.123978  1644 leader_election.cc:336] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 2.025s (SENT)
I20260709 13:01:04.140606  1497 leader_election.cc:400] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303) with higher term. Message: Invalid argument: T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 10. Current term is 11.
I20260709 13:01:04.167549  1497 leader_election.cc:403] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:04.115942  6588 raft_consensus.cc:2749] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:04.141184  6619 raft_consensus.cc:493] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:04.110733  6547 raft_consensus.cc:2749] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:04.164363  1676 raft_consensus.cc:2468] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 10.
I20260709 13:01:04.113116  6439 raft_consensus.cc:515] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:04.165751  1496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:04.178133  1496 leader_election.cc:304] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:04.116533  6628 raft_consensus.cc:2749] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:04.115703  6626 raft_consensus.cc:2749] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:04.166000  6595 raft_consensus.cc:2749] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:04.182328  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:04.168044  1644 leader_election.cc:304] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:04.116421  5747 raft_consensus.cc:2804] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:04.171470  6619 raft_consensus.cc:515] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:04.183741  5747 raft_consensus.cc:697] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 13 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:04.171705  6625 consensus_queue.cc:237] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:04.184634  5747 consensus_queue.cc:237] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:04.147696  6621 leader_election.cc:290] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:04.188350  6644 raft_consensus.cc:2749] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:04.161453  6640 raft_consensus.cc:493] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.189373  6640 raft_consensus.cc:515] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:04.191680  2226 raft_consensus.cc:2368] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 13. Current term is 14.
I20260709 13:01:04.172487  6302 raft_consensus.cc:2804] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:04.192508  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1059) took 1131 ms. Trace:
I20260709 13:01:04.192970  1604 rpcz_store.cc:276] 0709 13:01:03.060694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:03.060862 (+   168us) service_pool.cc:224] Handling call
0709 13:01:03.061183 (+   321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:03.066709 (+  5526us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:03.066741 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:03.067241 (+   500us) log.cc:844] Serialized 26 byte log entry
0709 13:01:03.286471 (+219230us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:03.286514 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:03.286591 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:04.192256 (+905665us) raft_consensus.cc:1685] finished
0709 13:01:04.192282 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:04.192447 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4916,"raft.queue_time_us":126,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":4021,"thread_start_us":177057,"threads_started":1,"wal-append.queue_time_us":1015078}
I20260709 13:01:04.192871  6302 raft_consensus.cc:697] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 14 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:04.196583  6302 consensus_queue.cc:237] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:04.165900  6275 raft_consensus.cc:697] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 14 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:04.173249  6641 raft_consensus.cc:3060] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:04.175179  1524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49310 (request call id 1249) took 1275 ms. Trace:
I20260709 13:01:04.201445  1524 rpcz_store.cc:276] 0709 13:01:02.899501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:02.899609 (+   108us) service_pool.cc:224] Handling call
0709 13:01:02.899878 (+   269us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:02.905995 (+  6117us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:02.906030 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:02.915495 (+  9465us) log.cc:844] Serialized 26 byte log entry
0709 13:01:03.297413 (+381918us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:03.297457 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:03.297527 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:04.174967 (+877440us) raft_consensus.cc:1685] finished
0709 13:01:04.174986 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:04.175123 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9591,"raft.queue_time_us":6306,"raft.run_cpu_time_us":8998,"raft.run_wall_time_us":61907,"thread_start_us":326206,"threads_started":1,"wal-append.queue_time_us":590855}
I20260709 13:01:04.182231  6450 raft_consensus.cc:2804] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:04.105691  6587 raft_consensus.cc:515] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:04.203446  6450 raft_consensus.cc:697] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:04.111985  6273 consensus_queue.cc:1059] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 13:01:04.204455  6450 consensus_queue.cc:237] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:04.205725  6273 raft_consensus.cc:3055] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:04.206125  6273 raft_consensus.cc:740] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:04.207142  2227 raft_consensus.cc:1240] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:04.142522  1679 raft_consensus.cc:1240] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:04.118307  6404 consensus_queue.cc:1048] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.059s
I20260709 13:01:04.116104  6465 consensus_queue.cc:1048] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.062s
I20260709 13:01:04.139628  6557 consensus_queue.cc:1048] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:01:04.143560  6613 consensus_queue.cc:1059] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:01:04.172467  6632 leader_election.cc:290] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
W20260709 13:01:04.186548  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 62627.6us
I20260709 13:01:04.119326  6634 consensus_queue.cc:1059] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.061s
I20260709 13:01:04.210928  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:04.253103  2219 raft_consensus.cc:1275] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:01:04.264026  2218 raft_consensus.cc:1240] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 13 LEADER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:04.264663  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:01:04.264149  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 122481us
I20260709 13:01:04.226119  6643 raft_consensus.cc:2749] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:01:04.270120  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 129665us
I20260709 13:01:04.230391  6626 raft_consensus.cc:493] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
W20260709 13:01:04.272807  1644 leader_election.cc:336] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 2.171s (SENT)
I20260709 13:01:04.273404  1644 leader_election.cc:304] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:04.278206  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:04.277377  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:04.281270  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:04.283488  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:04.284097  1524 raft_consensus.cc:2468] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 7.
I20260709 13:01:04.284896  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:04.285887  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:04.269419  6642 raft_consensus.cc:2804] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:04.287712  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:04.342991  1525 raft_consensus.cc:2468] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 16.
I20260709 13:01:04.344131  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:04.345427  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:04.344123  6619 leader_election.cc:290] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:04.347244  6642 raft_consensus.cc:697] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 15 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:04.348524  6642 consensus_queue.cc:237] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:04.322294  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:04.349792  5732 leader_election.cc:290] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:04.350863  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:04.351552  1527 raft_consensus.cc:2468] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 13.
I20260709 13:01:04.229651  6273 consensus_queue.cc:260] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:04.323078  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:04.352813  1529 raft_consensus.cc:3060] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:04.353192  6273 raft_consensus.cc:3060] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:04.354254  6465 raft_consensus.cc:493] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.282326  6324 raft_consensus.cc:2749] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:01:04.272343  6630 leader_election.cc:290] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:04.274791  6632 raft_consensus.cc:493] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:04.354785  6465 raft_consensus.cc:515] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:04.275815  6587 leader_election.cc:290] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:04.332420  2226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50310 (request call id 1015) took 1290 ms. Trace:
I20260709 13:01:04.355916  2226 rpcz_store.cc:276] 0709 13:01:03.046414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:03.046882 (+   468us) service_pool.cc:224] Handling call
0709 13:01:04.332186 (+1285304us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b540050b254. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:01:04.332330 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2617047808}
I20260709 13:01:04.357010  6465 leader_election.cc:290] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:04.357290  6338 raft_consensus.cc:3055] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:04.357713  6338 raft_consensus.cc:740] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:04.358063  2225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 992) took 1225 ms. Trace:
W20260709 13:01:04.335456  6647 log.cc:927] Time spent T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:01:04.358611  6338 consensus_queue.cc:260] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:04.335623  6652 raft_consensus.cc:493] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:04.360184  6652 raft_consensus.cc:515] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:04.360260  6338 raft_consensus.cc:3060] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:04.364856  6641 raft_consensus.cc:2749] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303) with higher term. Message: Invalid argument: T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 10. Current term is 11.
I20260709 13:01:04.269035  6275 consensus_queue.cc:237] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:01:04.280028  1644 leader_election.cc:336] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 2.174s (SENT)
I20260709 13:01:04.362759  6652 leader_election.cc:290] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:04.358525  2225 rpcz_store.cc:276] 0709 13:01:03.132351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:03.132950 (+   599us) service_pool.cc:224] Handling call
0709 13:01:03.133354 (+   404us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:03.308065 (+174711us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:03.308098 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:03.308139 (+    41us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:03.308170 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:04.357826 (+1049656us) spinlock_profiling.cc:243] Waited 174 ms on lock 0x7b5400601b54. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:01:04.357874 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:04.358005 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":401338240}
I20260709 13:01:04.346521  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:04.377395  1531 raft_consensus.cc:2468] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 11.
I20260709 13:01:04.377590  1525 raft_consensus.cc:3060] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:04.366912  1605 raft_consensus.cc:1240] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 12. Current term is 13. Ops: []
W20260709 13:01:04.322633  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:04.371085  6519 leader_election.cc:290] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:04.352432  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:04.373446  1529 raft_consensus.cc:2468] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 14.
I20260709 13:01:04.274631  6626 raft_consensus.cc:515] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:04.378861  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:04.379201  1644 leader_election.cc:304] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:04.286404  1524 raft_consensus.cc:2468] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 18.
I20260709 13:01:04.380913  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:04.381644  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:04.382381  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:04.428174  1529 raft_consensus.cc:3060] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:01:04.350795  6645 log.cc:927] Time spent T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
W20260709 13:01:04.430058  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 313164us
I20260709 13:01:04.433378  1572 leader_election.cc:304] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:04.431146  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:04.431732  1604 raft_consensus.cc:3060] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:04.433979  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
W20260709 13:01:04.431993  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 152030us
W20260709 13:01:04.435878  1644 leader_election.cc:336] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 2.247s (SENT)
I20260709 13:01:04.436270  1644 leader_election.cc:304] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:04.429015  1598 raft_consensus.cc:3060] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:04.282205  6595 consensus_queue.cc:1048] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.100s
I20260709 13:01:04.460109  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:04.383527  6562 raft_consensus.cc:3055] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:01:04.469708  1644 leader_election.cc:336] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 2.316s (SENT)
I20260709 13:01:04.438333  1524 raft_consensus.cc:2410] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
W20260709 13:01:04.466349  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:04.467945  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:04.475356  1529 raft_consensus.cc:2468] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 15.
I20260709 13:01:04.475687  1598 raft_consensus.cc:2468] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 12.
I20260709 13:01:04.476578  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:04.477386  2226 raft_consensus.cc:2393] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 9: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:01:04.382097  6547 raft_consensus.cc:493] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.432685  6143 raft_consensus.cc:2749] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:04.502571  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:04.503358  1524 raft_consensus.cc:2468] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 13.
I20260709 13:01:04.504668  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:04.505666  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:04.508303  1604 raft_consensus.cc:2468] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 16.
I20260709 13:01:04.509727  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:04.464982  6465 raft_consensus.cc:2749] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:04.466722  6519 raft_consensus.cc:2749] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:01:04.510339  1529 raft_consensus.cc:3060] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:01:04.521888  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 84227.2us
I20260709 13:01:04.517135  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:04.523173  1524 raft_consensus.cc:3060] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:04.470075  6562 raft_consensus.cc:740] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:04.525166  6562 consensus_queue.cc:260] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:04.526398  6562 raft_consensus.cc:3060] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:04.355463  6632 raft_consensus.cc:515] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:04.464728  5747 consensus_queue.cc:1059] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.051s
I20260709 13:01:04.532155  1529 raft_consensus.cc:2468] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 14.
I20260709 13:01:04.471923  6574 consensus_queue.cc:1048] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 13:01:04.539443  5747 raft_consensus.cc:3055] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:04.550640  5747 raft_consensus.cc:740] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:04.551594  5747 consensus_queue.cc:260] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:04.552738  6610 raft_consensus.cc:493] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:04.547967  1524 raft_consensus.cc:2468] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 17.
I20260709 13:01:04.552912  5747 raft_consensus.cc:3060] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:04.553431  6610 raft_consensus.cc:515] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:04.555788  6610 leader_election.cc:290] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:01:04.556918  6654 log.cc:927] Time spent T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:01:04.561920  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:04.563182  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:04.517338  6629 raft_consensus.cc:515] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:04.583535  6640 leader_election.cc:290] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:04.586443  2221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50326 (request call id 1065) took 1215 ms. Trace:
I20260709 13:01:04.586891  2221 rpcz_store.cc:276] 0709 13:01:03.371031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:03.384841 (+ 13810us) service_pool.cc:224] Handling call
0709 13:01:03.385241 (+   400us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:03.710997 (+325756us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:04.586210 (+875213us) spinlock_profiling.cc:243] Waited 292 ms on lock 0x7b540045d3d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:01:04.586388 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":672701312}
I20260709 13:01:04.587568  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:04.588358  1678 raft_consensus.cc:2393] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 15: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:01:04.589202  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:04.589871  1680 raft_consensus.cc:3060] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:04.590533  2218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 991) took 1467 ms. Trace:
I20260709 13:01:04.590921  2218 rpcz_store.cc:276] 0709 13:01:03.123213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:03.123360 (+   147us) service_pool.cc:224] Handling call
0709 13:01:03.123695 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:04.266146 (+1142451us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:04.590320 (+324174us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b540059c4d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:01:04.590477 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2622300544}
I20260709 13:01:04.566692  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49310 (request call id 1251) took 1665 ms. Trace:
I20260709 13:01:04.567055  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:04.596014  1529 raft_consensus.cc:2393] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 15: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:01:04.596237  6626 leader_election.cc:290] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:04.596982  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:04.597610  1529 raft_consensus.cc:2376] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 14. Re-sending same reply.
I20260709 13:01:04.595621  1532 rpcz_store.cc:276] 0709 13:01:02.937100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:02.970774 (+ 33674us) service_pool.cc:224] Handling call
0709 13:01:02.971196 (+   422us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:03.656046 (+684850us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:04.566410 (+910364us) spinlock_profiling.cc:243] Waited 684 ms on lock 0x7b540015bb54. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:01:04.566608 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1573483392}
I20260709 13:01:04.599946  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:04.600248  6632 leader_election.cc:290] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:04.600473  1532 raft_consensus.cc:3060] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:04.583566  6629 leader_election.cc:290] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:04.579330  6589 leader_election.cc:290] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:04.528247  6616 raft_consensus.cc:493] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.602275  6616 raft_consensus.cc:515] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:04.598433  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:04.604058  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:04.604372  6616 leader_election.cc:290] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:04.604694  1529 raft_consensus.cc:2368] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for earlier term 16. Current term is 17.
I20260709 13:01:04.605919  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 13:01:04.575856  6627 log.cc:927] Time spent T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.804s	user 0.001s	sys 0.000s
W20260709 13:01:04.577056  6614 log.cc:927] Time spent T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.807s	user 0.001s	sys 0.001s
I20260709 13:01:04.509888  6547 raft_consensus.cc:515] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:04.579437  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:04.609825  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:04.610421  6547 leader_election.cc:290] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:04.581498  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:04.610881  6629 raft_consensus.cc:493] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:04.607066  6613 raft_consensus.cc:3055] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:04.608114  6596 leader_election.cc:290] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:04.611399  1679 raft_consensus.cc:2393] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 19: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:01:04.611441  6629 raft_consensus.cc:515] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:04.612041  6464 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:04.612166  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:04.610905  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:04.612771  1530 raft_consensus.cc:2376] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 18. Re-sending same reply.
I20260709 13:01:04.613444  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:04.613620  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:04.613839  2227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50326 (request call id 1064) took 1724 ms. Trace:
I20260709 13:01:04.614233  2227 rpcz_store.cc:276] 0709 13:01:02.889029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:02.890800 (+  1771us) service_pool.cc:224] Handling call
0709 13:01:02.891129 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:04.226950 (+1335821us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:04.613627 (+386677us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b540045c754. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:01:04.613784 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3026407808}
I20260709 13:01:04.615293  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:04.616070  1672 raft_consensus.cc:2393] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 14: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:01:04.614538  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
W20260709 13:01:04.574908  6651 consensus_queue.cc:1175] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b96ce9cc496c49d7818fa983a17b062b" responder_term: 11 status { last_received { term: 10 index: 10 } last_committed_idx: 10 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:01:04.618036  6613 raft_consensus.cc:740] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:04.619467  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:04.619444  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:04.608748  1529 raft_consensus.cc:2468] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 13.
I20260709 13:01:04.621546  1525 raft_consensus.cc:2468] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 15.
I20260709 13:01:04.622597  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:04.614403  1530 raft_consensus.cc:2393] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 11: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:01:04.624636  1532 raft_consensus.cc:2468] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 16.
I20260709 13:01:04.620201  1678 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 15.
I20260709 13:01:04.635411  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:04.629186  1530 raft_consensus.cc:3060] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:04.638705  1680 raft_consensus.cc:2468] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 10.
I20260709 13:01:04.655814  1496 leader_election.cc:304] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:04.674961  1529 raft_consensus.cc:1240] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:04.677664  1529 raft_consensus.cc:3060] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:04.678449  6273 raft_consensus.cc:2804] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:04.684649  6273 raft_consensus.cc:697] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:04.685588  6273 consensus_queue.cc:237] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:04.687234  6640 raft_consensus.cc:493] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:04.687847  6640 raft_consensus.cc:515] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:04.700286  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:04.700946  1681 raft_consensus.cc:2468] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 9.
I20260709 13:01:04.702116  1496 leader_election.cc:304] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:04.704216  1680 raft_consensus.cc:1240] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:04.706079  6596 raft_consensus.cc:2804] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:04.711661  1530 raft_consensus.cc:1275] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:01:04.712133  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:01:04.714854  1496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:04.708411  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:04.715093  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:04.724303  1680 raft_consensus.cc:3060] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:04.737913  1527 raft_consensus.cc:2468] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 14.
I20260709 13:01:04.740193  1529 raft_consensus.cc:1275] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:01:04.618930  6613 consensus_queue.cc:260] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:04.710822  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:04.746901  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:04.701040  6640 leader_election.cc:290] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:04.750800  1680 raft_consensus.cc:2468] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 17.
I20260709 13:01:04.752056  6275 raft_consensus.cc:493] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:04.766182  6629 leader_election.cc:290] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:04.770594  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 13:01:04.781224  1495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:04.748802  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:04.735577  6596 raft_consensus.cc:493] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
W20260709 13:01:04.800493  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 286056us
I20260709 13:01:04.793057  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:04.807228  1530 raft_consensus.cc:2468] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 8.
I20260709 13:01:04.789781  6613 raft_consensus.cc:3060] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:04.809427  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:04.810922  5747 raft_consensus.cc:493] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:04.809515  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:04.811623  1529 raft_consensus.cc:2393] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 15: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:01:04.811520  5747 raft_consensus.cc:515] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:04.812824  1497 leader_election.cc:304] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:04.790804  6302 consensus_queue.cc:1059] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:01:04.793684  6275 raft_consensus.cc:515] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:04.805377  6596 raft_consensus.cc:3060] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:04.813648  6554 raft_consensus.cc:493] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:04.856742  1572 leader_election.cc:400] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 election: Vote denied by peer b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373) with higher term. Message: Invalid argument: T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 13. Current term is 14.
I20260709 13:01:04.880478  2190 leader_election.cc:304] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:01:04.867450  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:04.870814  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:04.852226  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:04.901808  2227 raft_consensus.cc:2393] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 14: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:01:04.902832  6374 raft_consensus.cc:2749] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:01:04.869674  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 56905.5us
I20260709 13:01:04.851789  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:04.903748  1674 raft_consensus.cc:2393] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 14: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
W20260709 13:01:04.882910  6665 log.cc:927] Time spent T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 13:01:04.874437  2221 raft_consensus.cc:1240] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 10 LEADER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:04.883976  5747 leader_election.cc:290] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:04.820576  1646 leader_election.cc:400] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 election: Vote denied by peer b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373) with higher term. Message: Invalid argument: T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for earlier term 9. Current term is 10.
W20260709 13:01:04.829706  6620 log.cc:927] Time spent T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.832s	user 0.000s	sys 0.004s
I20260709 13:01:04.908538  1528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49310 (request call id 1257) took 1914 ms. Trace:
I20260709 13:01:04.882994  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
W20260709 13:01:04.900336  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 43752.7us
I20260709 13:01:04.908901  1528 rpcz_store.cc:276] 0709 13:01:02.994243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:02.994496 (+   253us) service_pool.cc:224] Handling call
0709 13:01:03.007214 (+ 12718us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:03.021216 (+ 14002us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:03.021249 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:03.351488 (+330239us) spinlock_profiling.cc:243] Waited 19.5 ms on lock 0x7b2c00000658. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a16eaca11 00007f6a16ebc372 00007f6a185eea01 00007f6a185b343a 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2
0709 13:01:03.351881 (+   393us) log.cc:844] Serialized 26 byte log entry
0709 13:01:03.424212 (+ 72331us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:03.424357 (+   145us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:03.424571 (+   214us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:04.829002 (+1404431us) spinlock_profiling.cc:243] Waited 29.9 ms on lock 0x7b4400022b4c. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a153ecc85 00007f6a153ed6a2 00007f6a1815f1db 00007f6a1815aaaf 00007f6a1814e86e 00007f6a1814dbb6 00007f6a1814d7d8 00007f6a18157221 00007f6a181571d9 00007f6a18157169
0709 13:01:04.908337 (+ 79335us) raft_consensus.cc:1685] finished
0709 13:01:04.908358 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:04.908484 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25658,"raft.queue_time_us":14036,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":13334,"spinlock_wait_cycles":113675776,"thread_start_us":71570,"threads_started":1,"wal-append.queue_time_us":595827}
I20260709 13:01:04.900576  6554 raft_consensus.cc:515] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:04.885269  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:04.910943  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:04.911561  1528 raft_consensus.cc:2468] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 8.
I20260709 13:01:04.912420  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:04.913348  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:04.911554  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:04.913705  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:04.914192  2227 raft_consensus.cc:2468] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 14.
I20260709 13:01:04.914356  1528 raft_consensus.cc:2468] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 14.
I20260709 13:01:04.915468  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:04.915848  1572 leader_election.cc:304] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:01:04.914204  1531 raft_consensus.cc:2468] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 15.
I20260709 13:01:04.858492  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:04.916631  6644 raft_consensus.cc:493] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:04.917768  6644 raft_consensus.cc:515] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:04.918177  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:04.907318  2190 leader_election.cc:304] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:04.820811  6607 raft_consensus.cc:493] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:04.918289  6554 leader_election.cc:290] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:04.919287  6607 raft_consensus.cc:515] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:04.919740  6374 raft_consensus.cc:2804] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:04.921198  6374 raft_consensus.cc:697] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 12 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:04.921779  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:04.922183  6374 consensus_queue.cc:237] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:04.925035  6657 log.cc:927] Time spent T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.596s	user 0.001s	sys 0.002s
I20260709 13:01:04.925650  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:04.873955  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:04.927408  2218 raft_consensus.cc:2393] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 11: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:01:04.824268  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:04.929188  1681 raft_consensus.cc:3055] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:04.929584  1681 raft_consensus.cc:740] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:04.916638  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:04.931473  1673 raft_consensus.cc:1240] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 9. Current term is 10. Ops: []
W20260709 13:01:04.907248  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 86834.9us
I20260709 13:01:04.931767  2190 leader_election.cc:304] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:04.934114  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:04.906327  6275 leader_election.cc:290] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:04.889036  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49310 (request call id 1250) took 1988 ms. Trace:
I20260709 13:01:04.935043  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 13:01:04.828547  1644 leader_election.cc:336] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.908s (SENT)
I20260709 13:01:04.935930  1529 raft_consensus.cc:2376] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 14. Re-sending same reply.
I20260709 13:01:04.930285  1681 consensus_queue.cc:260] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:04.917296  6302 raft_consensus.cc:2804] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:01:04.941552  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 113060us
I20260709 13:01:04.942071  1681 raft_consensus.cc:3060] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:04.861817  1571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:04.940501  2191 leader_election.cc:304] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
W20260709 13:01:04.898880  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 86147.5us
I20260709 13:01:04.949223  1531 raft_consensus.cc:1240] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:04.940146  1526 rpcz_store.cc:276] 0709 13:01:02.900474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:02.900589 (+   115us) service_pool.cc:224] Handling call
0709 13:01:02.958892 (+ 58303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:04.162214 (+1203322us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:04.162248 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:04.162298 (+    50us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:01:04.162332 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:04.888789 (+726457us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b54002dafd4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:01:04.888839 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:04.888973 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44420,"raft.queue_time_us":44566,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":4761,"spinlock_wait_cycles":2659393664}
I20260709 13:01:04.953647  6629 consensus_queue.cc:1059] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:04.954497  6629 consensus_queue.cc:1243] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer b96ce9cc496c49d7818fa983a17b062b log is divergent from this leader: its last log entry 13.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:01:04.954931  6275 raft_consensus.cc:493] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.955123  6589 raft_consensus.cc:3055] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:04.955565  6589 raft_consensus.cc:740] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:04.955499  6275 raft_consensus.cc:515] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:04.956502  6589 consensus_queue.cc:260] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:04.815727  6595 consensus_queue.cc:1059] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.142s
I20260709 13:01:04.957711  6589 raft_consensus.cc:3060] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:04.967583  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:04.904387  6641 raft_consensus.cc:2764] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
W20260709 13:01:04.961640  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:04.961417  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:04.962141  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:04.962889  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:04.969795  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:04.969682  1677 raft_consensus.cc:1275] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:01:04.813624  6574 raft_consensus.cc:493] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.972791  1678 raft_consensus.cc:1275] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:01:04.958283  6275 leader_election.cc:290] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:04.978062  2190 leader_election.cc:304] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:01:04.971808  2191 leader_election.cc:304] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:04.981817  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:04.982275  1605 raft_consensus.cc:1240] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:04.982501  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:04.949429  6302 raft_consensus.cc:493] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:05.002777  1530 raft_consensus.cc:2376] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 16. Re-sending same reply.
I20260709 13:01:04.962311  6672 raft_consensus.cc:2764] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:01:04.989368  1681 raft_consensus.cc:1275] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:01:04.850069  6439 leader_election.cc:290] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 14 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:04.980207  1571 leader_election.cc:304] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:04.983201  6626 raft_consensus.cc:493] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.992288  1677 raft_consensus.cc:1275] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:01:04.979496  6569 raft_consensus.cc:2749] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:01:05.018620  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:05.040380  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:05.017859  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:05.018347  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:05.018050  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:05.019243  2190 leader_election.cc:304] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:04.982621  6463 raft_consensus.cc:493] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:04.994967  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:05.042243  2221 raft_consensus.cc:1240] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 17 LEADER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:05.024267  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:05.043185  2218 raft_consensus.cc:2410] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:01:05.043079  1601 raft_consensus.cc:2410] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:01:05.014271  1681 pending_rounds.cc:85] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90: Aborting all ops after (but not including) 8
I20260709 13:01:05.044880  1681 pending_rounds.cc:107] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:01:05.045145  1681 raft_consensus.cc:2889] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:05.055089  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:05.055867  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:05.010150  6302 raft_consensus.cc:3060] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:05.055114  2190 leader_election.cc:304] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:05.041899  6547 raft_consensus.cc:2804] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:05.038887  6652 raft_consensus.cc:2804] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:05.042343  6583 raft_consensus.cc:2749] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:01:05.002815  6664 consensus_queue.cc:1059] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 9.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.055s
I20260709 13:01:05.060928  6616 raft_consensus.cc:2749] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:05.049611  6592 raft_consensus.cc:493] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.065601  6651 raft_consensus.cc:493] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:05.010072  6574 raft_consensus.cc:515] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:05.058888  6562 raft_consensus.cc:493] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:05.067626  6439 raft_consensus.cc:2749] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:05.042727  6626 raft_consensus.cc:515] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:05.069288  6547 raft_consensus.cc:493] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:05.058200  6463 raft_consensus.cc:515] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:05.064870  6275 consensus_queue.cc:1048] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 13:01:05.058029  6658 consensus_queue.cc:1048] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:01:05.096819  1607 raft_consensus.cc:1275] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:01:05.076005  6652 raft_consensus.cc:697] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 17 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:05.093029  6547 raft_consensus.cc:3060] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:05.080681  6651 raft_consensus.cc:515] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:05.076783  6596 raft_consensus.cc:515] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:05.077955  6592 raft_consensus.cc:515] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:05.123569  6651 leader_election.cc:290] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:05.083506  6562 raft_consensus.cc:515] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:05.160504  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 105498us
I20260709 13:01:05.167917  1528 raft_consensus.cc:2393] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 10: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:01:05.105263  6334 consensus_queue.cc:1059] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 9.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
W20260709 13:01:05.197309  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:05.202574  1497 leader_election.cc:304] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:05.205552  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:05.206033  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:05.206301  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:05.208012  1497 leader_election.cc:304] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
W20260709 13:01:05.209679  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 168627us
I20260709 13:01:05.214874  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:05.225171  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:05.223282  1646 leader_election.cc:304] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:05.256908  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:05.257172  2218 raft_consensus.cc:2468] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 10.
I20260709 13:01:05.267380  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:05.212652  6651 raft_consensus.cc:493] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:05.226302  6607 leader_election.cc:290] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:05.214182  6640 raft_consensus.cc:2749] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:05.308425  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:05.223682  6554 consensus_queue.cc:1059] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 13:01:05.280047  6574 leader_election.cc:290] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:01:05.280959  6679 log.cc:927] Time spent T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:01:05.282274  6562 leader_election.cc:290] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:05.283295  6596 leader_election.cc:290] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:05.283432  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:05.284935  6626 leader_election.cc:290] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:05.290825  6514 raft_consensus.cc:3055] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:05.331120  6514 raft_consensus.cc:740] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:05.332147  6514 consensus_queue.cc:260] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:05.333534  6514 raft_consensus.cc:3060] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:05.294762  6681 log.cc:927] Time spent T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 13:01:05.335567  6508 raft_consensus.cc:3055] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:05.336035  6508 raft_consensus.cc:740] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:05.295296  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:05.302122  6592 leader_election.cc:290] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:05.223452  6622 consensus_queue.cc:1059] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.079s
I20260709 13:01:05.302842  6632 raft_consensus.cc:2749] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:01:05.263298  6324 consensus_queue.cc:1059] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.047s
I20260709 13:01:05.307741  2219 raft_consensus.cc:3060] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:05.295256  6674 log.cc:927] Time spent T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 13:01:05.309208  1676 raft_consensus.cc:2393] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 12: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:01:05.273285  1644 leader_election.cc:304] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:01:05.310170  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 102239us
I20260709 13:01:05.343528  1524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43008 (request call id 2282) took 1059 ms. Trace:
I20260709 13:01:05.344381  1497 leader_election.cc:304] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:05.343936  1524 rpcz_store.cc:276] 0709 13:01:04.284364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:04.625287 (+340923us) service_pool.cc:224] Handling call
0709 13:01:04.625575 (+   288us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:04.628344 (+  2769us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:04.628375 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:04.637149 (+  8774us) log.cc:844] Serialized 26 byte log entry
0709 13:01:04.830215 (+193066us) spinlock_profiling.cc:243] Waited 8.9 ms on lock 0x7b4800002dd8. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1d4dcaa1 00007f6a1d4d3b37 00007f6a1d4d39ca 00007f6a1d5cb26f 00007f6a1d5caf37 00007f6a1d5df55c 00007f6a1d5df508 00007f6a1d5df488 00007f6a1d5df443 00007f6a1d5de6ec 00007f6a1c508a96
0709 13:01:05.044987 (+214772us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:05.203573 (+158586us) log.cc:844] Serialized 14 byte log entry
0709 13:01:05.207301 (+  3728us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:05.207373 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:05.343247 (+135874us) raft_consensus.cc:1685] finished
0709 13:01:05.343344 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:05.343469 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5880,"prepare.queue_time_us":170757,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":10283,"raft.run_cpu_time_us":1557,"raft.run_wall_time_us":204322,"spinlock_wait_cycles":20466432,"thread_start_us":492578,"threads_started":2,"wal-append.queue_time_us":425621}
I20260709 13:01:05.310787  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:05.311465  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:05.314435  1674 raft_consensus.cc:1275] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:01:05.218474  6672 consensus_queue.cc:1048] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.093s
I20260709 13:01:05.314502  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:05.320025  2221 raft_consensus.cc:1275] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:01:05.198405  6652 consensus_queue.cc:237] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:05.328639  2225 raft_consensus.cc:1275] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:01:05.328146  6464 raft_consensus.cc:2749] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:05.312405  6651 raft_consensus.cc:515] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:05.348430  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:05.350248  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:05.352105  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
W20260709 13:01:05.357849  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:05.361286  2227 raft_consensus.cc:2468] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 14.
I20260709 13:01:05.339883  6554 consensus_queue.cc:1243] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer 39a92f5a4352465d8af3af5908fe8642 log is divergent from this leader: its last log entry 13.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:01:05.337493  6508 consensus_queue.cc:260] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:05.378780  1646 leader_election.cc:304] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642
W20260709 13:01:05.378917  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 62684.9us
I20260709 13:01:05.380736  6554 raft_consensus.cc:2804] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:05.381228  6554 raft_consensus.cc:493] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:05.381628  6554 raft_consensus.cc:3060] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:05.388165  1646 leader_election.cc:304] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:05.354089  6595 raft_consensus.cc:2749] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:01:05.409905  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:05.411360  6673 log.cc:927] Time spent T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.367s	user 0.002s	sys 0.001s
I20260709 13:01:05.414007  6613 raft_consensus.cc:3055] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:05.415207  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43008 (request call id 2283) took 1130 ms. Trace:
I20260709 13:01:05.415653  1532 rpcz_store.cc:276] 0709 13:01:04.284585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:04.626507 (+341922us) service_pool.cc:224] Handling call
0709 13:01:04.626809 (+   302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:04.628885 (+  2076us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:04.628917 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:04.640104 (+ 11187us) log.cc:844] Serialized 26 byte log entry
0709 13:01:05.043891 (+403787us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:05.216781 (+172890us) log.cc:844] Serialized 14 byte log entry
0709 13:01:05.315349 (+ 98568us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:05.315422 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:05.410640 (+ 95218us) spinlock_profiling.cc:243] Waited 6.17 ms on lock 0x7b4400022b4c. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a153ecc85 00007f6a153ed6a2 00007f6a1815f1db 00007f6a1815aaaf 00007f6a1814e86e 00007f6a1814dbb6 00007f6a1814d7d8 00007f6a18157221 00007f6a181571d9 00007f6a18157169
0709 13:01:05.414844 (+  4204us) raft_consensus.cc:1685] finished
0709 13:01:05.414955 (+   111us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:05.415136 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":100069,"prepare.queue_time_us":115442,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":18896,"raft.queue_time_us":106811,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":22336,"spinlock_wait_cycles":21329152,"thread_start_us":529396,"threads_started":2,"wal-append.queue_time_us":370313}
I20260709 13:01:05.424095  6554 raft_consensus.cc:515] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:05.425766  6644 leader_election.cc:290] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:05.426515  6554 leader_election.cc:290] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:05.427234  6554 consensus_queue.cc:1048] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:01:05.429009  6554 raft_consensus.cc:2804] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:05.429418  6554 raft_consensus.cc:493] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:05.429776  6554 raft_consensus.cc:3060] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:05.414561  6613 raft_consensus.cc:740] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:05.443774  6613 consensus_queue.cc:260] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:05.410049  6676 log.cc:927] Time spent T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.305s	user 0.000s	sys 0.001s
I20260709 13:01:05.448800  6635 raft_consensus.cc:3055] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:05.449344  6635 raft_consensus.cc:740] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:05.450304  6635 consensus_queue.cc:260] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:01:05.452936  6534 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.442s	user 0.007s	sys 0.027s
W20260709 13:01:05.453379  6534 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.443s	user 0.007s	sys 0.027s
I20260709 13:01:05.455109  6626 raft_consensus.cc:3055] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:05.455552  6626 raft_consensus.cc:740] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:05.455680  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:05.456305  2223 raft_consensus.cc:3060] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:05.457012  6607 raft_consensus.cc:3055] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:05.457396  6607 raft_consensus.cc:740] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:05.458214  6607 consensus_queue.cc:260] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:05.459385  6607 raft_consensus.cc:3060] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:05.460558  6554 raft_consensus.cc:515] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:05.465006  2223 raft_consensus.cc:2468] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 11.
I20260709 13:01:05.469815  6622 consensus_queue.cc:1048] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:01:05.469830  6554 leader_election.cc:290] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:05.479626  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:05.481449  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:05.480397  1598 raft_consensus.cc:2468] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 11.
I20260709 13:01:05.486944  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:05.486965  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 13:01:05.491384  6694 log.cc:927] Time spent T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.152s	user 0.000s	sys 0.000s
I20260709 13:01:05.390089  6369 raft_consensus.cc:2749] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:05.494674  2225 raft_consensus.cc:1240] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:05.496969  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:05.499765  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:05.487267  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:05.500572  2221 raft_consensus.cc:3060] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:05.499898  6463 leader_election.cc:290] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:05.356390  6693 consensus_queue.cc:1048] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 13:01:05.494961  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
W20260709 13:01:05.485590  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 85766.9us
I20260709 13:01:05.503461  1571 leader_election.cc:304] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:05.504333  2219 raft_consensus.cc:2468] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 12.
I20260709 13:01:05.506968  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:05.512300  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:05.515779  2222 raft_consensus.cc:1275] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:01:05.400777  6275 raft_consensus.cc:493] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.451719  6635 raft_consensus.cc:3060] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:05.529395  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:05.530280  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:05.533738  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:05.534910  1532 raft_consensus.cc:1275] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 13:01:05.535310  1532 pending_rounds.cc:85] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting all ops after (but not including) 10
I20260709 13:01:05.535454  1528 raft_consensus.cc:1217] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Deduplicated request from leader. Original: 11.10->[14.11-17.13]   Dedup: 14.11->[15.12-17.13]
I20260709 13:01:05.535526  1532 pending_rounds.cc:107] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:01:05.536013  1528 pending_rounds.cc:85] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting all ops after (but not including) 11
I20260709 13:01:05.536031  1532 raft_consensus.cc:2889] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:05.536478  1528 pending_rounds.cc:107] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting uncommitted NO_OP operation due to leader change: 16.12
I20260709 13:01:05.536736  1528 raft_consensus.cc:2889] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:05.516736  6554 raft_consensus.cc:493] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:05.456493  6626 consensus_queue.cc:260] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:05.546445  1606 raft_consensus.cc:1275] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:01:05.548455  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:05.537297  6275 raft_consensus.cc:515] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:05.549389  1606 raft_consensus.cc:2410] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:01:05.398823  6632 consensus_queue.cc:1048] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.133s
I20260709 13:01:05.558115  1527 raft_consensus.cc:1240] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 9. Current term is 10. Ops: []
W20260709 13:01:05.559981  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 55505us
W20260709 13:01:05.560187  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 56829us
I20260709 13:01:05.563025  5747 raft_consensus.cc:2749] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:05.507778  6596 raft_consensus.cc:493] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:05.563684  5747 consensus_queue.cc:1059] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:01:05.556525  2221 raft_consensus.cc:2468] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 15.
I20260709 13:01:05.566226  1606 raft_consensus.cc:1275] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:01:05.564973  2192 leader_election.cc:304] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:05.571913  6569 raft_consensus.cc:2804] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:05.572469  6569 raft_consensus.cc:697] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 16 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:05.573361  6569 consensus_queue.cc:237] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:05.578271  2224 raft_consensus.cc:1240] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:05.606606  1646 leader_election.cc:304] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:01:05.607635  6508 raft_consensus.cc:3060] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:05.607924  1646 leader_election.cc:304] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:01:05.609442  1646 leader_election.cc:304] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:01:05.610494  6705 raft_consensus.cc:2804] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:05.610251  1428 catalog_manager.cc:5697] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 6 to 9, leader changed from ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) to b96ce9cc496c49d7818fa983a17b062b (127.0.107.196). New cstate: current_term: 9 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:05.611071  6705 raft_consensus.cc:697] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 12 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:05.611986  6705 consensus_queue.cc:237] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:05.612365  1428 catalog_manager.cc:5697] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 6 to 7, leader changed from ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) to b96ce9cc496c49d7818fa983a17b062b (127.0.107.196). New cstate: current_term: 7 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:05.614005  6324 raft_consensus.cc:2804] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:05.614614  6324 raft_consensus.cc:697] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 11 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:05.614938  1428 catalog_manager.cc:5697] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:05.615510  6324 consensus_queue.cc:237] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:05.616489  1428 catalog_manager.cc:5697] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:05.618381  6622 raft_consensus.cc:2804] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:05.618927  6622 raft_consensus.cc:697] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 15 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:05.619815  6622 consensus_queue.cc:237] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:05.617918  1428 catalog_manager.cc:5697] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:01:05.631879  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 64134.7us
I20260709 13:01:05.632751  1598 raft_consensus.cc:1275] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:01:05.632999  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:05.544296  6450 raft_consensus.cc:493] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:05.537707  6554 raft_consensus.cc:515] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:01:05.635073  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 74035us
I20260709 13:01:05.641105  1571 leader_election.cc:304] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:05.634621  1496 leader_election.cc:304] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
W20260709 13:01:05.635581  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 74105us
I20260709 13:01:05.645399  2219 raft_consensus.cc:1240] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:05.645535  1681 raft_consensus.cc:1275] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:01:05.654981  2192 leader_election.cc:304] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:05.544198  6630 consensus_queue.cc:1059] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.099s
W20260709 13:01:05.662992  1570 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 2.052s (SENT) [suppressed 42 similar messages]
W20260709 13:01:05.688128  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 47123.4us
W20260709 13:01:05.688253  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 44597.2us
W20260709 13:01:05.642311  6704 log.cc:927] Time spent T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
W20260709 13:01:05.739087  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:05.560205  6547 raft_consensus.cc:515] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:05.793545  1681 raft_consensus.cc:1275] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:01:05.804865  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 13:01:05.812268  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:05.819785  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 164901us
W20260709 13:01:05.821511  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 548326us
I20260709 13:01:05.822795  1644 leader_election.cc:304] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:01:05.702512  6302 consensus_meta.cc:287] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.633s	user 0.005s	sys 0.001s
I20260709 13:01:05.686755  6702 raft_consensus.cc:3055] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:05.827832  6641 raft_consensus.cc:493] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.830394  6463 raft_consensus.cc:493] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.780318  6690 raft_consensus.cc:2749] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:05.704310  6685 raft_consensus.cc:3055] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:05.690266  6589 raft_consensus.cc:2749] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:05.847435  2227 raft_consensus.cc:1240] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:05.698316  6275 leader_election.cc:290] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:05.850082  1644 leader_election.cc:304] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:05.857823  2192 leader_election.cc:304] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:05.686879  6439 consensus_queue.cc:1048] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.139s
I20260709 13:01:05.634474  6596 raft_consensus.cc:515] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:05.815061  6464 raft_consensus.cc:493] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.685604  6697 consensus_queue.cc:1048] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.163s
I20260709 13:01:05.683982  6692 consensus_queue.cc:1048] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.213s
I20260709 13:01:05.649426  6450 raft_consensus.cc:515] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:05.843787  6564 raft_consensus.cc:2804] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:05.690927  6404 consensus_queue.cc:1059] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.182s
I20260709 13:01:05.846238  6702 raft_consensus.cc:740] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
W20260709 13:01:05.866940  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:05.920351  2192 leader_election.cc:304] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
W20260709 13:01:05.940428  1495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:05.816602  6693 consensus_queue.cc:1059] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.093s
I20260709 13:01:05.940241  1428 catalog_manager.cc:5697] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:05.856541  6685 raft_consensus.cc:740] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
W20260709 13:01:05.974226  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 53983.5us
I20260709 13:01:05.909507  6686 raft_consensus.cc:2749] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:05.940193  6514 raft_consensus.cc:493] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.981518  1428 catalog_manager.cc:5697] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 8 to 11, leader changed from ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) to 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194). New cstate: current_term: 11 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:01:05.983268  5747 consensus_queue.cc:1059] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:05.848150  6302 raft_consensus.cc:515] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:05.954301  6564 raft_consensus.cc:493] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:05.941605  6651 leader_election.cc:290] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:05.856240  6463 raft_consensus.cc:515] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:05.950924  6584 consensus_queue.cc:1048] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.050s
W20260709 13:01:06.014923  1497 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.656s	user 0.008s	sys 0.024s
I20260709 13:01:05.941052  6464 raft_consensus.cc:515] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:06.017475  1497 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.008s	sys 0.024s
W20260709 13:01:05.988428  6587 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.004s	sys 0.018s
I20260709 13:01:05.984340  6555 raft_consensus.cc:2749] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:01:06.021692  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:05.863950  6641 raft_consensus.cc:515] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:06.022637  1427 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46274 (request call id 361) took 28338 ms (client timeout 15000 ms). Trace:
I20260709 13:01:05.994323  6632 raft_consensus.cc:493] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.028050  1601 raft_consensus.cc:2393] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 15: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:01:06.028947  1527 raft_consensus.cc:1275] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:01:06.028348  1428 catalog_manager.cc:5697] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 2 to 9. New cstate: current_term: 9 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:06.032827  1428 catalog_manager.cc:5697] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:06.014453  6564 raft_consensus.cc:3060] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:06.015053  6658 raft_consensus.cc:3055] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:06.036332  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:06.048123  1526 raft_consensus.cc:2468] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 9.
W20260709 13:01:06.024115  6587 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.004s	sys 0.018s
W20260709 13:01:06.031085  6652 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.011s	sys 0.016s
W20260709 13:01:06.067934  6706 log.cc:927] Time spent T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 13:01:06.069320  6450 leader_election.cc:290] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:06.074144  6596 leader_election.cc:290] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:06.035245  6589 raft_consensus.cc:493] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:06.047746  6658 raft_consensus.cc:740] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:06.094578  1428 catalog_manager.cc:5697] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 9 to 10, leader changed from ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) to b96ce9cc496c49d7818fa983a17b062b (127.0.107.196). New cstate: current_term: 10 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:01:06.080528  6652 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.716s	user 0.014s	sys 0.017s
W20260709 13:01:06.077829  1525 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.004s	sys 0.035s
I20260709 13:01:06.060027  6554 leader_election.cc:290] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:06.016920  6514 raft_consensus.cc:515] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:06.022389  6369 raft_consensus.cc:3060] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:06.035487  6715 raft_consensus.cc:3060] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:06.025759  1427 rpcz_store.cc:269] 0709 13:00:37.684729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:37.684947 (+   218us) service_pool.cc:224] Handling call
0709 13:01:06.022557 (+28337610us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:59.973842 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:00.041882 (+ 68040us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:00.041929 (+    47us) write_op.cc:435] Acquired schema lock
0709 13:01:00.041947 (+    18us) tablet.cc:662] Decoding operations
0709 13:01:00.042573 (+   626us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:00.042766 (+   193us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:00.042803 (+    37us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:01:00.043372 (+   569us) tablet.cc:701] Row locks acquired
0709 13:01:00.043427 (+    55us) write_op.cc:260] PREPARE: finished
0709 13:01:00.043597 (+   170us) write_op.cc:270] Start()
0709 13:01:00.043752 (+   155us) write_op.cc:276] Timestamp: P: 1783602060043523 usec, L: 0
0709 13:01:00.043774 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:01:00.067046 (+ 23272us) log.cc:844] Serialized 1687 byte log entry
0709 13:01:00.845182 (+778136us) op_driver.cc:464] REPLICATION: finished
0709 13:01:01.231550 (+386368us) write_op.cc:301] APPLY: starting
0709 13:01:01.239692 (+  8142us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:01.976502 (+736810us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:01.985656 (+  9154us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:02.031941 (+ 46285us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:02.032183 (+   242us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=8,mrs_lookups=0
0709 13:01:02.032233 (+    50us) write_op.cc:312] APPLY: finished
0709 13:01:02.256288 (+224055us) log.cc:844] Serialized 49 byte log entry
0709 13:01:02.281660 (+ 25372us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:02.287033 (+  5373us) write_op.cc:454] Released schema lock
0709 13:01:02.292417 (+  5384us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:02.320194 (+ 27777us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:02.320989 (+   795us) write_op.cc:454] Released schema lock
0709 13:01:02.379509 (+ 58520us) spinlock_profiling.cc:243] Waited 3.99 ms on lock 0x7b18000be300. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1e38ede1 00007f6a1e39b5b1 00007f6a154c6522 00007f6a154c87c1 00007f6a154c8779 00007f6a154c8709 00007f6a154c86d1 00007f6a154c79cd 000000000038f354 000000000038f199 00007f6a154a983a
Metrics: {"mutex_wait_us":367594,"reported_tablets":47,"spinlock_wait_cycles":338816,"child_traces":[["op",{"apply.queue_time_us":320526,"apply.run_cpu_time_us":12549,"apply.run_wall_time_us":1119227,"cfile_cache_hit":18,"cfile_cache_hit_bytes":20879,"num_ops":4,"prepare.queue_time_us":415232,"prepare.run_cpu_time_us":25672,"prepare.run_wall_time_us":439433,"raft.queue_time_us":282399,"raft.run_cpu_time_us":20486,"raft.run_wall_time_us":173119,"replication_time_us":801232,"spinlock_wait_cycles":9177344,"thread_start_us":848506,"threads_started":4,"wal-append.queue_time_us":600290,"wal-append.run_cpu_time_us":22797,"wal-append.run_wall_time_us":2162705}]]}
W20260709 13:01:06.099843  1525 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.004s	sys 0.035s
I20260709 13:01:06.079280  6640 raft_consensus.cc:493] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:06.107357  1525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43008 (request call id 2281) took 1823 ms. Trace:
I20260709 13:01:06.081197  6334 raft_consensus.cc:493] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:06.127780  6334 raft_consensus.cc:515] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:06.035995  6632 raft_consensus.cc:515] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:06.112301  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:06.112545  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:06.142115  1527 raft_consensus.cc:2376] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 14. Re-sending same reply.
I20260709 13:01:06.113305  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:06.107793  1525 rpcz_store.cc:276] 0709 13:01:04.284118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:04.623466 (+339348us) service_pool.cc:224] Handling call
0709 13:01:04.623782 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:04.624134 (+   352us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:04.624163 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:04.624611 (+   448us) log.cc:844] Serialized 26 byte log entry
0709 13:01:04.822107 (+197496us) spinlock_profiling.cc:243] Waited 5.48 ms on lock 0x7b18002cd760. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1e38ede1 00007f6a1e39b5b1 00007f6a154a8e07 00007f6a1e303ab9 00007f6a154c569b 00007f6a154c393f 00007f6a154c5c02 00007f6a1814d20b 00007f6a18152d23 00007f6a181530d1 00007f6a1856ea0f
0709 13:01:05.045204 (+223097us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:05.506624 (+461420us) spinlock_profiling.cc:243] Waited 2.18 ms on lock 0x7b18002cd760. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1e38ede1 00007f6a1e39b5b1 00007f6a154a8e07 00007f6a1e303ab9 00007f6a154c569b 00007f6a154c393f 00007f6a154c3455 00007f6a1bfab3c7 00007f6a185bd9a7 00007f6a185cd0bf 00007f6a185cd038
0709 13:01:06.106708 (+600084us) log.cc:844] Serialized 14 byte log entry
0709 13:01:06.107015 (+   307us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:06.107106 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:06.107143 (+    37us) raft_consensus.cc:1685] finished
0709 13:01:06.107153 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:06.107295 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22762,"prepare.queue_time_us":170771,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":34,"raft.queue_time_us":5247,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":14274,"spinlock_wait_cycles":17614592,"thread_start_us":822410,"threads_started":2,"wal-append.queue_time_us":442058}
W20260709 13:01:06.101873  6712 log.cc:927] Time spent T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:01:06.036964  6685 consensus_queue.cc:260] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:06.164434  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:06.164856  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:06.165653  1526 raft_consensus.cc:2410] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:01:06.165868  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:06.198786  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:06.198550  1428 catalog_manager.cc:5697] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 7 to 10, leader changed from 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 10 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:01:06.199425  1527 raft_consensus.cc:2376] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 14. Re-sending same reply.
I20260709 13:01:06.200299  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 13:01:06.200443  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:06.177690  1497 leader_election.cc:304] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:06.202399  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:06.050602  6702 consensus_queue.cc:260] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:06.150512  6569 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.009s	sys 0.030s
I20260709 13:01:06.108443  6547 leader_election.cc:290] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 13 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:06.208868  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:06.224817  1526 raft_consensus.cc:2468] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 19.
I20260709 13:01:06.226015  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:06.206918  6273 raft_consensus.cc:2749] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:06.167318  6275 raft_consensus.cc:3055] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:06.215757  1428 catalog_manager.cc:5697] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:06.201152  6697 raft_consensus.cc:493] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:06.212859  6675 log.cc:927] Time spent T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:01:06.207860  1527 raft_consensus.cc:2410] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:01:06.204293  6334 leader_election.cc:290] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:06.102293  6589 raft_consensus.cc:515] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:06.132117  6640 raft_consensus.cc:515] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:06.235278  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
W20260709 13:01:06.222110  6607 consensus_meta.cc:287] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.762s	user 0.012s	sys 0.000s
W20260709 13:01:06.227283  6569 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.650s	user 0.010s	sys 0.032s
I20260709 13:01:06.194980  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:06.273622  1529 raft_consensus.cc:2376] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 17. Re-sending same reply.
I20260709 13:01:06.203262  6658 consensus_queue.cc:260] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:06.264902  1526 raft_consensus.cc:2376] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 15. Re-sending same reply.
I20260709 13:01:06.264299  1428 catalog_manager.cc:5697] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:06.265370  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:06.285670  1673 raft_consensus.cc:1240] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:06.238606  6275 raft_consensus.cc:740] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:06.292624  1530 raft_consensus.cc:3060] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:06.290405  1527 raft_consensus.cc:2376] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 14. Re-sending same reply.
I20260709 13:01:06.140754  6450 raft_consensus.cc:493] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:06.141739  6596 raft_consensus.cc:493] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:06.295588  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:06.288151  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:06.296108  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:06.166479  1525 raft_consensus.cc:2468] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 11.
I20260709 13:01:06.291859  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:06.294279  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:06.290751  1428 catalog_manager.cc:5697] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 4 to 10. New cstate: current_term: 10 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:06.350843  1530 raft_consensus.cc:2468] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 13.
I20260709 13:01:06.352069  1527 raft_consensus.cc:2410] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:01:06.338893  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:06.297132  1602 raft_consensus.cc:2393] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 14: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:01:06.339470  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:06.296717  1529 raft_consensus.cc:2376] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 14. Re-sending same reply.
W20260709 13:01:06.344026  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:06.348131  1679 raft_consensus.cc:1240] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 11 LEADER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 10. Current term is 11. Ops: []
W20260709 13:01:06.339365  1604 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.008s	sys 0.012s
W20260709 13:01:06.354368  1604 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.008s	sys 0.013s
W20260709 13:01:06.352576  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 55203.5us
I20260709 13:01:06.356755  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:06.266191  6652 consensus_queue.cc:1048] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.075s
I20260709 13:01:06.374554  1428 catalog_manager.cc:5697] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:01:06.375767  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 525769us
I20260709 13:01:06.246268  6697 raft_consensus.cc:515] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:06.341424  6635 consensus_meta.cc:287] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.801s	user 0.008s	sys 0.002s
I20260709 13:01:06.381685  1644 leader_election.cc:304] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:06.388558  1525 raft_consensus.cc:2468] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 12.
I20260709 13:01:06.389439  1526 raft_consensus.cc:2468] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 19.
I20260709 13:01:06.391844  1526 raft_consensus.cc:1275] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 10. (term mismatch)
I20260709 13:01:06.392304  1526 pending_rounds.cc:85] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting all ops after (but not including) 9
I20260709 13:01:06.392585  1526 pending_rounds.cc:107] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting uncommitted NO_OP operation due to leader change: 14.10
I20260709 13:01:06.376274  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:06.392992  1529 raft_consensus.cc:1275] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:01:06.394200  1527 raft_consensus.cc:2410] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for term 14 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:01:06.355643  6629 raft_consensus.cc:493] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:06.352290  6622 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.725s	user 0.030s	sys 0.053s
I20260709 13:01:06.392995  1526 raft_consensus.cc:2889] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:06.395838  1527 raft_consensus.cc:1275] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:01:06.339689  6596 raft_consensus.cc:515] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:06.339077  6450 raft_consensus.cc:515] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:01:06.419054  6718 log.cc:927] Time spent T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.182s	user 0.001s	sys 0.000s
W20260709 13:01:06.420728  6720 log.cc:927] Time spent T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
W20260709 13:01:06.421782  6716 log.cc:927] Time spent T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:01:06.424032  6630 raft_consensus.cc:2749] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:01:06.424790  6724 log.cc:927] Time spent T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:01:06.429613  6511 raft_consensus.cc:3055] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:06.430068  6511 raft_consensus.cc:740] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:06.430902  6511 consensus_queue.cc:260] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:06.431949  6511 raft_consensus.cc:3060] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:06.433076  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:06.400775  6514 leader_election.cc:290] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:06.406282  6632 leader_election.cc:290] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:06.409282  6464 leader_election.cc:290] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:06.414113  6275 consensus_queue.cc:260] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:06.436021  6713 log.cc:927] Time spent T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.239s	user 0.000s	sys 0.001s
I20260709 13:01:06.395848  6635 consensus_queue.cc:1059] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.042s
W20260709 13:01:06.457307  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:06.461134  1678 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.642s	user 0.027s	sys 0.054s
W20260709 13:01:06.461666  1678 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.027s	sys 0.054s
I20260709 13:01:06.436940  6574 raft_consensus.cc:493] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.404587  6629 raft_consensus.cc:515] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:06.384464  6463 leader_election.cc:290] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:01:06.464355  2219 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.014s	sys 0.022s
W20260709 13:01:06.464685  2219 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.516s	user 0.014s	sys 0.022s
I20260709 13:01:06.439319  1529 raft_consensus.cc:1275] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:01:06.462500  1678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50664 (request call id 1199) took 1034 ms. Trace:
W20260709 13:01:06.399189  6622 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.772s	user 0.030s	sys 0.054s
I20260709 13:01:06.404855  6143 raft_consensus.cc:493] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
W20260709 13:01:06.473729  6176 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.762s	user 0.015s	sys 0.023s
W20260709 13:01:06.462842  1570 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.672s	user 0.013s	sys 0.008s
W20260709 13:01:06.492096  1570 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.702s	user 0.014s	sys 0.008s
W20260709 13:01:06.494776  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 831830us
I20260709 13:01:06.497148  1570 leader_election.cc:304] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
W20260709 13:01:06.474939  1496 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.828s	user 0.008s	sys 0.015s
W20260709 13:01:06.497972  1496 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.851s	user 0.008s	sys 0.015s
I20260709 13:01:06.476032  6275 raft_consensus.cc:3060] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:06.491453  1600 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.639s	user 0.011s	sys 0.015s
W20260709 13:01:06.493875  1605 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.003s	sys 0.024s
W20260709 13:01:06.503069  1605 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.554s	user 0.004s	sys 0.025s
W20260709 13:01:06.491643  6176 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.785s	user 0.016s	sys 0.023s
I20260709 13:01:06.502300  1528 raft_consensus.cc:1275] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 13:01:06.489917  6714 log.cc:927] Time spent T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.271s	user 0.001s	sys 0.000s
W20260709 13:01:06.502732  1600 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.012s	sys 0.016s
I20260709 13:01:06.469774  1678 rpcz_store.cc:276] 0709 13:01:05.427758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.440807 (+ 13049us) service_pool.cc:224] Handling call
0709 13:01:05.441169 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:05.441380 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:01:05.441686 (+   306us) log.cc:844] Serialized 14 byte log entry
0709 13:01:06.462094 (+1020408us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:06.462155 (+    61us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:06.462247 (+    92us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:06.462327 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:06.462442 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":869,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":145490,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":12099,"thread_start_us":1019896,"threads_started":2,"wal-append.queue_time_us":852208}
I20260709 13:01:06.507593  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:06.468119  6574 raft_consensus.cc:515] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:06.515774  1529 raft_consensus.cc:3060] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:06.506186  6463 raft_consensus.cc:2804] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:01:06.517050  6721 log.cc:927] Time spent T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
I20260709 13:01:06.509845  1570 leader_election.cc:304] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:06.493324  6589 leader_election.cc:290] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:06.522018  6715 raft_consensus.cc:2749] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:06.534736  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:06.490964  6143 raft_consensus.cc:515] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:06.507272  6640 leader_election.cc:290] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:06.539747  1570 leader_election.cc:304] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:06.549651  6273 raft_consensus.cc:493] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.550932  6652 raft_consensus.cc:2749] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:06.547418  6464 raft_consensus.cc:493] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:06.554852  6463 raft_consensus.cc:697] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 15 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:06.568563  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:06.569305  1673 raft_consensus.cc:2468] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 11.
W20260709 13:01:06.568549  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 191973us
I20260709 13:01:06.570756  1644 leader_election.cc:304] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:06.569398  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1078) took 1166 ms. Trace:
I20260709 13:01:06.571580  1604 rpcz_store.cc:276] 0709 13:01:05.403447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.404087 (+   640us) service_pool.cc:224] Handling call
0709 13:01:05.404400 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:05.404594 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:01:05.707276 (+302682us) log.cc:844] Serialized 14 byte log entry
0709 13:01:06.568813 (+861537us) log.cc:844] Serialized 14 byte log entry
0709 13:01:06.569037 (+   224us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:06.569085 (+    48us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:01:06.569151 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:06.569218 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:06.569334 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1627,"prepare.queue_time_us":417798,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":50369,"raft.run_cpu_time_us":216,"raft.run_wall_time_us":5581,"thread_start_us":1158161,"threads_started":3,"wal-append.queue_time_us":842784}
I20260709 13:01:06.575470  1644 leader_election.cc:304] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:06.576730  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:06.567121  6450 leader_election.cc:290] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:06.579742  1644 leader_election.cc:304] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
W20260709 13:01:06.600000  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:06.570549  6697 leader_election.cc:290] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:06.562871  6692 raft_consensus.cc:2749] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:06.602305  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1076) took 1199 ms. Trace:
I20260709 13:01:06.665773  1603 rpcz_store.cc:276] 0709 13:01:05.402853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.403010 (+   157us) service_pool.cc:224] Handling call
0709 13:01:05.403403 (+   393us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:05.403637 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:05.403658 (+    21us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:05.485200 (+ 81542us) log.cc:844] Serialized 26 byte log entry
0709 13:01:05.823958 (+338758us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:05.824000 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:05.824066 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:06.602056 (+777990us) raft_consensus.cc:1685] finished
0709 13:01:06.602081 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:06.602244 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":322714,"threads_started":1,"wal-append.queue_time_us":605141}
I20260709 13:01:06.611598  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:06.667497  1523 raft_consensus.cc:2468] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 15.
I20260709 13:01:06.613620  6629 leader_election.cc:290] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:06.617434  1524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49310 (request call id 1276) took 1068 ms. Trace:
I20260709 13:01:06.580181  6622 raft_consensus.cc:2749] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:01:06.620136  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:06.620499  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:06.668754  1524 rpcz_store.cc:276] 0709 13:01:05.548529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.548679 (+   150us) service_pool.cc:224] Handling call
0709 13:01:05.548973 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:05.958684 (+409711us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:05.958721 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:05.958764 (+    43us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:05.958796 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:06.617177 (+658381us) spinlock_profiling.cc:243] Waited 409 ms on lock 0x7b54000505d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:01:06.617226 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:06.617368 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":941760384}
I20260709 13:01:06.562512  6273 raft_consensus.cc:515] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:06.671861  6273 leader_election.cc:290] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:01:06.623083  2190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:06.624337  1525 raft_consensus.cc:1240] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:06.675675  6569 consensus_queue.cc:1048] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:06.678861  2190 leader_election.cc:304] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:06.679780  6404 raft_consensus.cc:2804] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:06.680182  6404 raft_consensus.cc:493] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:06.680536  6404 raft_consensus.cc:3060] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:01:06.624727  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 85073.4us
W20260709 13:01:06.625252  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 269515us
I20260709 13:01:06.575381  6596 leader_election.cc:290] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:06.576294  6715 raft_consensus.cc:2749] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:06.569669  6464 raft_consensus.cc:515] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:06.630746  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:06.868957  1673 raft_consensus.cc:2468] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 13.
I20260709 13:01:06.583804  1644 leader_election.cc:304] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:06.869599  1679 raft_consensus.cc:1275] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 13:01:06.839784  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:06.600742  6607 raft_consensus.cc:2804] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:06.862540  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1075) took 1464 ms. Trace:
I20260709 13:01:06.870831  1607 rpcz_store.cc:276] 0709 13:01:05.398528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.398746 (+   218us) service_pool.cc:224] Handling call
0709 13:01:05.399099 (+   353us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:01:05.559325 (+160226us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:05.559354 (+    29us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:01:05.568841 (+  9487us) log.cc:844] Serialized 78 byte log entry
0709 13:01:05.607951 (+ 39110us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b1800499780. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1e38ede1 00007f6a1e39b5b1 00007f6a154a8e07 00007f6a1e303ab9 00007f6a154c569b 00007f6a154c393f 00007f6a154c5c02 00007f6a1814d20b 00007f6a18152d23 00007f6a181530d1 00007f6a1856ea0f
0709 13:01:05.996528 (+388577us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:05.996568 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:05.996635 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:06.630391 (+633756us) raft_consensus.cc:1685] finished
0709 13:01:06.630414 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:06.862461 (+232047us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":208869,"raft.queue_time_us":163488,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":64619,"spinlock_wait_cycles":25834240,"thread_start_us":388363,"threads_started":1,"wal-append.queue_time_us":675204}
I20260709 13:01:06.872349  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:06.873346  1570 leader_election.cc:304] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
W20260709 13:01:06.874073  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 127647us
I20260709 13:01:06.874788  6629 raft_consensus.cc:493] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.875980  6629 raft_consensus.cc:515] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:06.879989  1570 leader_election.cc:304] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:06.883497  6622 raft_consensus.cc:493] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:06.883824  6697 raft_consensus.cc:2804] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:06.890059  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:06.872804  1529 raft_consensus.cc:2468] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 13.
I20260709 13:01:06.868189  6514 raft_consensus.cc:493] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:06.905007  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:06.912181  6592 raft_consensus.cc:493] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:06.912699  6592 raft_consensus.cc:515] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:06.906608  6722 log.cc:927] Time spent T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.183s	user 0.000s	sys 0.001s
I20260709 13:01:06.916311  6622 raft_consensus.cc:515] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:06.918260  6143 leader_election.cc:290] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:06.918769  2223 raft_consensus.cc:1275] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
W20260709 13:01:06.906862  6736 log.cc:927] Time spent T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.164s	user 0.005s	sys 0.000s
W20260709 13:01:06.907675  6735 log.cc:927] Time spent T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.326s	user 0.000s	sys 0.000s
I20260709 13:01:06.920814  2219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50326 (request call id 1083) took 1098 ms. Trace:
W20260709 13:01:06.922107  6369 consensus_meta.cc:287] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.814s	user 0.006s	sys 0.002s
I20260709 13:01:06.878230  6629 leader_election.cc:290] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:06.918419  6622 leader_election.cc:290] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:06.872764  6607 raft_consensus.cc:493] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:06.901057  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
W20260709 13:01:06.895437  6732 log.cc:927] Time spent T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.313s	user 0.001s	sys 0.000s
W20260709 13:01:06.908880  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 325154us
I20260709 13:01:06.992098  1644 leader_election.cc:304] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:01:06.993059  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:06.993851  1529 raft_consensus.cc:2468] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 11.
W20260709 13:01:06.980916  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:06.936908  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:06.921144  2219 rpcz_store.cc:276] 0709 13:01:05.822795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.822933 (+   138us) service_pool.cc:224] Handling call
0709 13:01:05.823276 (+   343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:05.844324 (+ 21048us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:05.844356 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:05.856924 (+ 12568us) log.cc:844] Serialized 26 byte log entry
0709 13:01:06.465018 (+608094us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:01:06.465064 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:06.465146 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:06.920619 (+455473us) raft_consensus.cc:1685] finished
0709 13:01:06.920639 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:06.920759 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20677,"raft.queue_time_us":23953,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":40347,"thread_start_us":516045,"threads_started":1,"wal-append.queue_time_us":599396}
I20260709 13:01:06.964566  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:01:06.977881  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 97971.1us
W20260709 13:01:06.994046  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 102058us
I20260709 13:01:06.895591  6733 raft_consensus.cc:493] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.999614  1644 leader_election.cc:304] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:01:06.906703  6728 log.cc:927] Time spent T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
I20260709 13:01:06.894939  6729 raft_consensus.cc:493] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:07.000160  2190 leader_election.cc:304] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:07.002285  1679 raft_consensus.cc:1240] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 15 LEADER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
W20260709 13:01:06.906469  6743 log.cc:927] Time spent T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.253s	user 0.000s	sys 0.000s
W20260709 13:01:06.906790  6737 log.cc:927] Time spent T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.317s	user 0.001s	sys 0.000s
I20260709 13:01:06.918939  6143 raft_consensus.cc:2749] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:06.922542  6369 raft_consensus.cc:2749] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:01:06.936321  6701 log.cc:927] Time spent T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.939s	user 0.003s	sys 0.009s
I20260709 13:01:07.039809  2190 leader_election.cc:304] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:06.902791  6574 leader_election.cc:290] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:01:06.927929  6564 consensus_meta.cc:287] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b: Time spent flushing consensus metadata: real 0.853s	user 0.006s	sys 0.003s
I20260709 13:01:07.045379  6652 consensus_queue.cc:1048] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:07.030491  6692 raft_consensus.cc:493] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:06.938333  6302 leader_election.cc:290] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:06.906589  6725 consensus_queue.cc:1048] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.493s
I20260709 13:01:06.914642  6592 leader_election.cc:290] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:07.003001  6686 raft_consensus.cc:493] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:07.002874  6547 raft_consensus.cc:493] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:07.047755  1570 leader_election.cc:304] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:07.048014  6745 consensus_queue.cc:1048] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:01:07.048372  6635 consensus_queue.cc:1048] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:07.048724  6739 raft_consensus.cc:2749] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:01:07.049567  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 50050.8us
I20260709 13:01:07.050819  5747 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:07.040145  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:06.906898  6730 raft_consensus.cc:493] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:06.993302  6607 raft_consensus.cc:3060] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:06.991057  6596 raft_consensus.cc:493] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.933717  6613 raft_consensus.cc:3060] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:06.934729  6750 raft_consensus.cc:493] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:06.912113  6514 raft_consensus.cc:515] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:07.136559  6514 leader_election.cc:290] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:07.064747  1674 raft_consensus.cc:1240] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 10. Current term is 11. Ops: []
W20260709 13:01:07.055929  1678 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.070s	sys 0.104s
W20260709 13:01:07.137450  1678 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.584s	user 0.071s	sys 0.104s
W20260709 13:01:07.137655  1571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:07.076285  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:07.138834  1531 raft_consensus.cc:2468] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 11.
I20260709 13:01:07.140671  6464 leader_election.cc:290] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:01:07.088241  1428 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.022s	sys 0.019s
I20260709 13:01:06.885097  6463 consensus_queue.cc:237] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:07.046240  6748 raft_consensus.cc:2749] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:07.091825  6574 raft_consensus.cc:493] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.909333  6697 raft_consensus.cc:493] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
W20260709 13:01:07.064711  6275 consensus_meta.cc:287] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.560s	user 0.009s	sys 0.000s
I20260709 13:01:06.937507  6404 raft_consensus.cc:515] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:07.113492  1644 leader_election.cc:304] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:07.113304  5747 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:07.122227  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 74567.2us
I20260709 13:01:07.053663  6733 raft_consensus.cc:515] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:07.125200  6750 raft_consensus.cc:515] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:07.127022  6334 raft_consensus.cc:2804] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:07.126820  6730 raft_consensus.cc:515] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:07.126050  6596 raft_consensus.cc:515] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:07.073577  6564 raft_consensus.cc:515] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:07.130751  6701 log.cc:927] Time spent T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:01:07.059141  6729 raft_consensus.cc:515] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:07.091820  6692 raft_consensus.cc:515] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:07.118755  6547 raft_consensus.cc:515] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:07.210572  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:07.233395  1672 raft_consensus.cc:2468] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 13.
I20260709 13:01:07.233711  6596 leader_election.cc:290] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:07.234519  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:07.211301  6626 raft_consensus.cc:3060] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:07.237848  2221 raft_consensus.cc:1240] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:07.118637  6686 raft_consensus.cc:515] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:07.118490  6592 raft_consensus.cc:2804] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:07.238857  6592 raft_consensus.cc:697] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [term 13 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:07.215669   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:07.240116  6686 leader_election.cc:290] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:07.239800  6592 consensus_queue.cc:237] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:07.155843  1532 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.013s	sys 0.028s
W20260709 13:01:07.156812  1428 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.023s	sys 0.019s
W20260709 13:01:07.161170  2192 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.010s	sys 0.014s
W20260709 13:01:07.243180  2192 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.010s	sys 0.014s
W20260709 13:01:07.243127  1532 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.734s	user 0.014s	sys 0.028s
W20260709 13:01:07.136708  6711 log.cc:927] Time spent T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 1.070s	user 0.000s	sys 0.011s
W20260709 13:01:07.189765  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 76382.2us
I20260709 13:01:07.191546  1570 leader_election.cc:304] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:07.244247  1644 leader_election.cc:304] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
W20260709 13:01:07.244577  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 53122.1us
I20260709 13:01:07.174018  6697 raft_consensus.cc:3060] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:07.121917  6610 raft_consensus.cc:493] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:07.162395  6737 log.cc:927] Time spent T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:01:07.190590  6707 raft_consensus.cc:2749] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:07.180178  6747 raft_consensus.cc:3060] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:07.216908  1531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49310 (request call id 1270) took 1688 ms. Trace:
I20260709 13:01:07.246531  1570 leader_election.cc:304] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:07.247483  1644 leader_election.cc:304] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:07.265678  1531 rpcz_store.cc:276] 0709 13:01:05.528369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.530038 (+  1669us) service_pool.cc:224] Handling call
0709 13:01:07.216722 (+1686684us) spinlock_profiling.cc:243] Waited 1.61 s on lock 0x7b54001b67d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:01:07.216843 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3695469440}
I20260709 13:01:07.222847  5747 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:07.180409  6574 raft_consensus.cc:515] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:07.250258  1496 leader_election.cc:304] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:07.267478  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:07.267858  1644 leader_election.cc:304] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:01:07.228188  1495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:07.243528  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 596133us
I20260709 13:01:07.263193  2226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50326 (request call id 1081) took 1803 ms. Trace:
I20260709 13:01:07.268693  1676 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 15.
I20260709 13:01:07.268680  2226 rpcz_store.cc:276] 0709 13:01:05.459747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.459910 (+   163us) service_pool.cc:224] Handling call
0709 13:01:05.460277 (+   367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:05.460653 (+   376us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:05.460682 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:05.461177 (+   495us) log.cc:844] Serialized 26 byte log entry
0709 13:01:05.782255 (+321078us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:01:05.782536 (+   281us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:05.789606 (+  7070us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:07.136385 (+1346779us) spinlock_profiling.cc:243] Waited 3.75 ms on lock 0x7b24002fd488. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a1534c9c4 00007f6a1534aacb 00007f6a15505dc9 00007f6a15505a55 00007f6a1550509d 00007f6a1813710e 00007f6a1814e88c 00007f6a1814dbb6 00007f6a1814d7d8 00007f6a18157221
0709 13:01:07.246775 (+110390us) raft_consensus.cc:1685] finished
0709 13:01:07.246796 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:07.263106 (+ 16310us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1501,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":92,"spinlock_wait_cycles":8620800,"thread_start_us":319019,"threads_started":1,"wal-append.queue_time_us":545111}
I20260709 13:01:07.268219  1496 leader_election.cc:304] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:07.273078  1570 leader_election.cc:304] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:01:07.206748  6511 consensus_meta.cc:287] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b: Time spent flushing consensus metadata: real 0.773s	user 0.008s	sys 0.004s
I20260709 13:01:07.226363  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:07.248222  1571 leader_election.cc:304] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:07.281414  1571 leader_election.cc:304] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:07.232327  6547 leader_election.cc:290] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:07.264214  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:07.254220  6690 raft_consensus.cc:2749] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:07.279822  5747 raft_consensus.cc:2749] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:07.315502  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:07.203049  6334 raft_consensus.cc:493] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
W20260709 13:01:07.286384  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:07.218421  6726 log.cc:927] Time spent T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.863s	user 0.006s	sys 0.007s
I20260709 13:01:07.276847  1496 leader_election.cc:304] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:07.276094  6369 raft_consensus.cc:2749] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:07.290011  2221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 1008) took 1260 ms. Trace:
I20260709 13:01:07.320182  2221 rpcz_store.cc:276] 0709 13:01:06.029361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.029477 (+   116us) service_pool.cc:224] Handling call
0709 13:01:06.029745 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:07.238319 (+1208574us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:07.289770 (+ 51451us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b5400680bd4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:01:07.289948 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2778162432}
I20260709 13:01:07.227692  6564 leader_election.cc:290] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:07.263057  6554 raft_consensus.cc:2804] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:07.279182  1570 leader_election.cc:304] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:07.219760  6641 leader_election.cc:290] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:07.226179  6730 leader_election.cc:290] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
W20260709 13:01:07.307945  1530 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43008 (request call id 2308) took 1195 ms (client timeout 1516 ms). Trace:
W20260709 13:01:07.323698  1601 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1074) took 1925 ms (client timeout 2070 ms). Trace:
I20260709 13:01:07.265215  6610 raft_consensus.cc:515] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:07.275986  6725 raft_consensus.cc:2804] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:07.288998  1600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36200 (request call id 2614) took 2074 ms. Trace:
I20260709 13:01:07.281409  6652 raft_consensus.cc:2804] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:07.275846  6629 raft_consensus.cc:2804] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:07.323822  1606 raft_consensus.cc:1240] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:07.280819  6622 raft_consensus.cc:3060] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:07.383420  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:07.384431  5747 consensus_queue.cc:1048] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:07.246459  6729 leader_election.cc:290] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
W20260709 13:01:07.324177  1601 rpcz_store.cc:269] 0709 13:01:05.398245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.399604 (+  1359us) service_pool.cc:224] Handling call
0709 13:01:07.323478 (+1923874us) spinlock_profiling.cc:243] Waited 520 ms on lock 0x7b54000daa54. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:01:07.323636 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1196419328}
W20260709 13:01:07.322525  1530 rpcz_store.cc:269] 0709 13:01:06.112450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.113044 (+   594us) service_pool.cc:224] Handling call
0709 13:01:07.307734 (+1194690us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b540010d454. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:01:07.307873 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":344049408}
I20260709 13:01:07.389161  6514 raft_consensus.cc:493] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:07.389716  6564 raft_consensus.cc:493] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:07.427022  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 387303us
I20260709 13:01:07.391383  6750 leader_election.cc:290] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:01:07.395349  6753 log.cc:927] Time spent T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.148s	user 0.000s	sys 0.000s
I20260709 13:01:07.402642  6629 raft_consensus.cc:493] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:07.404762  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:07.411250  6610 leader_election.cc:290] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:07.411696  6613 raft_consensus.cc:2804] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:07.319993  6584 raft_consensus.cc:493] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:07.313175  6464 raft_consensus.cc:493] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:07.312541  6275 raft_consensus.cc:2749] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:07.432657  6733 leader_election.cc:290] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:07.319368  6334 raft_consensus.cc:3060] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:07.312295  6749 raft_consensus.cc:2749] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:01:07.481643  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:07.429299  6635 raft_consensus.cc:2749] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:01:07.441020  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 409545us
I20260709 13:01:07.424831  6725 raft_consensus.cc:493] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:07.316344  6324 consensus_queue.cc:1048] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.123s
W20260709 13:01:07.491518  6718 log.cc:927] Time spent T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.164s	user 0.000s	sys 0.000s
W20260709 13:01:07.489646  6569 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.812s	user 0.028s	sys 0.023s
I20260709 13:01:07.317762  6302 consensus_queue.cc:1059] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.176s
I20260709 13:01:07.427923  6369 raft_consensus.cc:493] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:07.442283  6652 raft_consensus.cc:697] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 14 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
W20260709 13:01:07.490217  6555 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.815s	user 0.024s	sys 0.031s
I20260709 13:01:07.424957  1600 rpcz_store.cc:276] 0709 13:01:05.214685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.214922 (+   237us) service_pool.cc:224] Handling call
0709 13:01:05.215232 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:05.396035 (+180803us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:01:05.851678 (+455643us) log.cc:844] Serialized 14 byte log entry
0709 13:01:06.514986 (+663308us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:06.515037 (+    51us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:06.515077 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:07.287962 (+772885us) spinlock_profiling.cc:243] Waited 1.62 ms on lock 0x7b18004165c0. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1e38ede1 00007f6a1e39b5b1 00007f6a154942a6 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419
0709 13:01:07.288738 (+   776us) spinlock_profiling.cc:243] Waited 181 ms on lock 0x7b54000dbe54. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:01:07.288785 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:07.288931 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":310778,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":7405,"raft.queue_time_us":101,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":119,"spinlock_wait_cycles":419022336,"thread_start_us":1117490,"threads_started":2,"wal-append.queue_time_us":749745}
I20260709 13:01:07.490012  6613 raft_consensus.cc:493] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:07.443857  6273 raft_consensus.cc:493] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:07.487864  6629 raft_consensus.cc:3060] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:01:07.433902  6705 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.806s	user 0.017s	sys 0.046s
I20260709 13:01:07.327600  6554 raft_consensus.cc:493] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:07.508134  6464 raft_consensus.cc:515] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:07.493439  6607 raft_consensus.cc:515] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:07.523308  6569 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.846s	user 0.028s	sys 0.023s
I20260709 13:01:07.441537  6564 raft_consensus.cc:515] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:07.500681  6584 raft_consensus.cc:515] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:07.580842  1646 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.028s	sys 0.029s
I20260709 13:01:07.520285  6725 raft_consensus.cc:3060] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:07.593631  1678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49178 (request call id 2212) took 1062 ms. Trace:
W20260709 13:01:07.582990  6705 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.956s	user 0.017s	sys 0.046s
W20260709 13:01:07.606316  1675 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.504s	user 0.020s	sys 0.040s
I20260709 13:01:07.538363  6749 raft_consensus.cc:3055] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:07.642261  6749 raft_consensus.cc:740] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:07.643231  6749 consensus_queue.cc:260] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:07.644565  6749 raft_consensus.cc:3060] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:07.561573  6555 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.866s	user 0.024s	sys 0.032s
W20260709 13:01:07.633760  1646 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.028s	sys 0.029s
I20260709 13:01:07.636070  1678 rpcz_store.cc:276] 0709 13:01:06.531402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.531524 (+   122us) service_pool.cc:224] Handling call
0709 13:01:06.531844 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:06.532064 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:06.532093 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:06.547229 (+ 15136us) log.cc:844] Serialized 26 byte log entry
0709 13:01:07.137839 (+590610us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:07.137880 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:07.137944 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:07.593350 (+455406us) raft_consensus.cc:1685] finished
0709 13:01:07.593374 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:07.593543 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":584304,"threads_started":1,"wal-append.queue_time_us":628134}
I20260709 13:01:07.441711  6514 raft_consensus.cc:515] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:07.540089  6613 raft_consensus.cc:3060] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:07.540542  6404 leader_election.cc:290] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 16 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:07.582407  6672 raft_consensus.cc:493] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:07.656553  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:07.594312  6554 raft_consensus.cc:3060] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:01:07.653129  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 376360us
I20260709 13:01:07.654392  1677 raft_consensus.cc:1240] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 8. Current term is 9. Ops: []
W20260709 13:01:07.653936  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 606617us
I20260709 13:01:07.660991  6584 leader_election.cc:290] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:07.667199  1644 leader_election.cc:304] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:07.583060  6273 raft_consensus.cc:515] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:01:07.671478  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 356409us
I20260709 13:01:07.637471  6641 raft_consensus.cc:493] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:07.536886  6369 raft_consensus.cc:515] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:07.695055  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:07.698549  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:07.699198  1527 raft_consensus.cc:2468] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 17.
I20260709 13:01:07.702160  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:07.705495  1531 raft_consensus.cc:2468] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 11.
W20260709 13:01:07.702163  1571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:07.672436  6692 leader_election.cc:290] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:07.723834  6607 leader_election.cc:290] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:07.725869  6464 leader_election.cc:290] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:07.735980  6273 leader_election.cc:290] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:07.736517  6334 raft_consensus.cc:515] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:07.737203  6702 raft_consensus.cc:3060] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:07.737856  6514 leader_election.cc:290] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:07.690712  6574 leader_election.cc:290] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:01:07.738868  6751 log.cc:927] Time spent T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.356s	user 0.000s	sys 0.001s
I20260709 13:01:07.691354  6641 raft_consensus.cc:515] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:07.740088  6658 raft_consensus.cc:3060] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:07.740710  6641 leader_election.cc:290] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:07.741256  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:07.700876  6652 consensus_queue.cc:237] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:01:07.744635  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:07.742477  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:07.747102  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:07.748927  6629 raft_consensus.cc:515] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:07.755456  1679 raft_consensus.cc:2468] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 16.
I20260709 13:01:07.758694  1644 leader_election.cc:304] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
W20260709 13:01:07.754315  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 435509us
W20260709 13:01:07.674050  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 285417us
I20260709 13:01:07.679672  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:01:07.680595  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:07.689062  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:07.769994  1530 raft_consensus.cc:2368] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for earlier term 14. Current term is 15.
I20260709 13:01:07.769866  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:07.690128  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:07.770476  1678 raft_consensus.cc:2468] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 9.
I20260709 13:01:07.693066  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:07.693817  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:07.771524  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:07.767976  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:07.679016  6705 raft_consensus.cc:2804] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:07.771847  1525 raft_consensus.cc:2468] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 14.
I20260709 13:01:07.773144  1644 leader_election.cc:304] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:07.693235  6592 raft_consensus.cc:493] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:07.776440  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:01:07.775774  6693 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.015s	sys 0.018s
I20260709 13:01:07.779911  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:07.781389  2221 raft_consensus.cc:1240] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:01:07.781354  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:07.793190  2226 raft_consensus.cc:3060] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:07.735860  6685 raft_consensus.cc:3060] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:07.785367  1678 raft_consensus.cc:2410] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:01:07.754122  6715 raft_consensus.cc:2804] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:01:07.778900  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 499786us
I20260709 13:01:07.704402  6635 raft_consensus.cc:493] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
W20260709 13:01:07.788061  1680 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.013s	sys 0.048s
I20260709 13:01:07.789534  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:07.793990  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 13:01:07.798883  1680 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.014s	sys 0.049s
I20260709 13:01:07.755055  6562 raft_consensus.cc:493] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:07.756213  6750 raft_consensus.cc:493] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:07.785808  1644 leader_election.cc:400] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 pre-election: Vote denied by peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931) with higher term. Message: Invalid argument: T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for earlier term 14. Current term is 15.
I20260709 13:01:07.803459  1644 leader_election.cc:403] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:07.671895  6672 raft_consensus.cc:515] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:07.723889  6564 leader_election.cc:290] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:07.767376  6707 raft_consensus.cc:493] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
W20260709 13:01:07.797346  1674 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.008s	sys 0.015s
W20260709 13:01:07.811932  1674 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.539s	user 0.008s	sys 0.016s
I20260709 13:01:07.813227  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:07.814199  1496 leader_election.cc:304] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
W20260709 13:01:07.792176  6693 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.015s	sys 0.018s
I20260709 13:01:07.802390  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:07.776986  6622 raft_consensus.cc:2749] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:07.767597  6369 leader_election.cc:290] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:01:07.785634  6752 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.013s	sys 0.021s
I20260709 13:01:07.774282  6705 raft_consensus.cc:493] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:07.816890  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:07.817648  2219 raft_consensus.cc:1275] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 10 index: 12. (index mismatch)
I20260709 13:01:07.818943  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:07.786804  6626 raft_consensus.cc:2804] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:07.876005  6626 raft_consensus.cc:493] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:07.854401  2190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:07.882941  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:07.883623  1525 raft_consensus.cc:3060] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:07.884589  2190 leader_election.cc:304] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:07.799955  1570 leader_election.cc:304] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:07.862820  2226 raft_consensus.cc:2468] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 15.
I20260709 13:01:07.799700  6630 raft_consensus.cc:2804] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:07.825479  2221 raft_consensus.cc:2468] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 12.
I20260709 13:01:07.867930  2218 raft_consensus.cc:1240] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:07.874300  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 13:01:07.956435  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:07.796927  1495 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.005s	sys 0.018s
I20260709 13:01:07.878067  1681 raft_consensus.cc:1240] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 9. Current term is 10. Ops: []
W20260709 13:01:07.957165  1495 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.676s	user 0.006s	sys 0.018s
W20260709 13:01:07.958600  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 74124.2us
I20260709 13:01:07.959831  2190 leader_election.cc:304] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:07.880105  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:07.886384  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:07.787882  6501 consensus_queue.cc:1059] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.077s
I20260709 13:01:07.871057  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:07.966212  2226 raft_consensus.cc:2393] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 16: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:01:07.976126  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:07.981125  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:07.981896  2227 raft_consensus.cc:2468] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 13.
I20260709 13:01:07.982961  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 13:01:07.995020  6768 log.cc:927] Time spent T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 13:01:07.997382  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:07.999754  6781 raft_consensus.cc:2804] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:08.000373  6781 raft_consensus.cc:493] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:08.000756  6781 raft_consensus.cc:3060] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:08.003855  1497 leader_election.cc:304] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
W20260709 13:01:08.004825  6758 log.cc:927] Time spent T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.342s	user 0.002s	sys 0.000s
I20260709 13:01:08.000846  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36200 (request call id 2619) took 2358 ms. Trace:
I20260709 13:01:07.878206  6705 raft_consensus.cc:3060] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:07.788908  6592 raft_consensus.cc:515] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:07.867606  6629 leader_election.cc:290] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 15 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:08.006340  1606 rpcz_store.cc:276] 0709 13:01:05.642882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.644091 (+  1209us) service_pool.cc:224] Handling call
0709 13:01:07.323641 (+1679550us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:07.386567 (+ 62926us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:08.000558 (+613991us) spinlock_profiling.cc:243] Waited 1.68 s on lock 0x7b54000daa50. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b28ad 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:01:08.000726 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3862242176}
W20260709 13:01:08.020709  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 60963us
I20260709 13:01:08.038923  2190 leader_election.cc:304] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:07.809716  6635 raft_consensus.cc:515] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:08.032948  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:08.043987  2223 raft_consensus.cc:2410] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 17 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:01:07.896143  6626 raft_consensus.cc:3060] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:07.810014  6562 raft_consensus.cc:515] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:07.817584  6750 raft_consensus.cc:515] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:07.969980  6775 raft_consensus.cc:493] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
W20260709 13:01:08.072086  1673 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.033s	sys 0.071s
W20260709 13:01:08.072464  1673 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.033s	sys 0.071s
I20260709 13:01:07.962064  6630 raft_consensus.cc:493] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
W20260709 13:01:08.051391  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:08.060106  1525 raft_consensus.cc:2468] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 16.
I20260709 13:01:08.095934  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:08.097745  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 13:01:08.065140  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 265273us
I20260709 13:01:08.099885  1570 leader_election.cc:304] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:07.972615  6622 raft_consensus.cc:3060] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:01:07.859076  6707 raft_consensus.cc:515] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:07.972312  6564 raft_consensus.cc:2804] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:01:08.032305  6697 consensus_meta.cc:287] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.760s	user 0.007s	sys 0.003s
W20260709 13:01:08.040972  1572 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.726s	user 0.011s	sys 0.018s
W20260709 13:01:07.875118  6752 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.013s	sys 0.021s
I20260709 13:01:08.075140  1524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49310 (request call id 1293) took 1390 ms. Trace:
I20260709 13:01:08.097250  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:08.040376  6738 raft_consensus.cc:2749] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:01:08.083539  6747 consensus_meta.cc:287] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.812s	user 0.009s	sys 0.001s
W20260709 13:01:08.113415  2193 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.015s	sys 0.021s
I20260709 13:01:08.109611  2223 raft_consensus.cc:1240] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 14. Current term is 15. Ops: []
W20260709 13:01:08.158214  2193 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.727s	user 0.015s	sys 0.021s
I20260709 13:01:08.107584  6776 consensus_queue.cc:1059] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 13:01:08.111634  6564 raft_consensus.cc:493] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:08.114707  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 336188us
W20260709 13:01:08.115785  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:08.089524  6273 raft_consensus.cc:2749] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:08.072762  6302 raft_consensus.cc:493] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:08.163584  1644 leader_election.cc:304] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:08.038606  6334 leader_election.cc:290] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:08.148166  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 13:01:08.132366  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 358599us
I20260709 13:01:08.154088  1679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49170 (request call id 2494) took 1121 ms. Trace:
W20260709 13:01:08.154558  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 54757us
W20260709 13:01:08.111858  1572 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.797s	user 0.011s	sys 0.019s
I20260709 13:01:08.063694  6763 raft_consensus.cc:493] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:08.080346  6275 raft_consensus.cc:493] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.123764  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:08.169989  2227 raft_consensus.cc:1240] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:08.172923  1570 leader_election.cc:304] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:08.073570  6696 raft_consensus.cc:2749] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:01:08.181596  1572 leader_election.cc:304] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:08.183248  1572 leader_election.cc:304] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:08.174929  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 13:01:08.176923  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:08.109016  6511 raft_consensus.cc:2749] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:08.108044  6630 raft_consensus.cc:3060] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:08.171578  1679 rpcz_store.cc:276] 0709 13:01:07.033040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.039884 (+  6844us) service_pool.cc:224] Handling call
0709 13:01:08.153879 (+1113995us) spinlock_profiling.cc:243] Waited 642 ms on lock 0x7b54002c0454. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:01:08.154025 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1476588928}
W20260709 13:01:08.155843  6176 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.740s	user 0.010s	sys 0.055s
I20260709 13:01:08.182610  5747 consensus_queue.cc:1059] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:08.185249  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:08.089066  6629 consensus_queue.cc:1048] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.098s
W20260709 13:01:08.176674  6718 log.cc:927] Time spent T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:01:08.161566  6778 raft_consensus.cc:2804] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:08.166092  6564 raft_consensus.cc:3060] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:08.165619  6747 raft_consensus.cc:2749] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:08.198277  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:08.152273  6697 raft_consensus.cc:515] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:01:08.190275  6725 consensus_meta.cc:287] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent flushing consensus metadata: real 0.536s	user 0.006s	sys 0.004s
I20260709 13:01:08.216617  5747 raft_consensus.cc:3055] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:08.225255  5747 raft_consensus.cc:740] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
W20260709 13:01:08.193339  6176 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.777s	user 0.010s	sys 0.056s
I20260709 13:01:08.191277  6733 raft_consensus.cc:2804] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:08.199100  6779 raft_consensus.cc:2804] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:08.200019  6739 raft_consensus.cc:493] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
W20260709 13:01:08.234086  6772 log.cc:927] Time spent T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260709 13:01:08.234385  6770 log.cc:927] Time spent T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.229s	user 0.000s	sys 0.001s
I20260709 13:01:08.195247  6749 raft_consensus.cc:2804] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:01:08.216167  6613 consensus_meta.cc:287] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent flushing consensus metadata: real 0.546s	user 0.006s	sys 0.003s
W20260709 13:01:08.235095  6774 log.cc:927] Time spent T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:01:08.194275  6652 raft_consensus.cc:2749] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:08.186954  6763 raft_consensus.cc:515] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:08.189944  6275 raft_consensus.cc:515] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:08.176438  6302 raft_consensus.cc:515] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:08.229468  6725 raft_consensus.cc:515] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:08.242650  6715 raft_consensus.cc:493] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:08.259337  6715 raft_consensus.cc:3060] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:08.242995  6733 raft_consensus.cc:493] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
W20260709 13:01:08.263123  6658 consensus_meta.cc:287] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.523s	user 0.009s	sys 0.000s
I20260709 13:01:08.243115  6779 raft_consensus.cc:493] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:08.263784  6779 raft_consensus.cc:3060] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:08.243405  6739 raft_consensus.cc:515] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:01:08.268376  6702 consensus_meta.cc:287] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.531s	user 0.008s	sys 0.000s
I20260709 13:01:08.268862  6748 raft_consensus.cc:493] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.268955  6739 leader_election.cc:290] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:08.269418  6748 raft_consensus.cc:515] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:08.270280  6700 raft_consensus.cc:493] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.270839  6700 raft_consensus.cc:515] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:08.271860  6622 raft_consensus.cc:2749] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931) with higher term. Message: Invalid argument: T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for earlier term 14. Current term is 15.
I20260709 13:01:08.108419  6775 raft_consensus.cc:515] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:08.240145  6596 raft_consensus.cc:3055] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:08.236212  6750 leader_election.cc:290] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:08.244210  6547 raft_consensus.cc:3055] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:01:08.254360  6554 consensus_meta.cc:287] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.576s	user 0.005s	sys 0.004s
I20260709 13:01:08.250273  6707 leader_election.cc:290] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:08.247074  6749 raft_consensus.cc:697] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 15 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:08.244638  6592 leader_election.cc:290] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:08.275646  6733 raft_consensus.cc:3060] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:08.277884  6596 raft_consensus.cc:740] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:08.247354  6778 raft_consensus.cc:697] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 15 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:08.252830  6763 leader_election.cc:290] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:08.247645  6672 leader_election.cc:290] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:08.284628  6775 leader_election.cc:290] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:08.247814  6613 raft_consensus.cc:515] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:08.144311  1524 rpcz_store.cc:276] 0709 13:01:06.684537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.830924 (+146387us) service_pool.cc:224] Handling call
0709 13:01:06.836313 (+  5389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:06.836626 (+   313us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:01:06.880528 (+ 43902us) log.cc:844] Serialized 14 byte log entry
0709 13:01:06.880828 (+   300us) log.cc:844] Serialized 14 byte log entry
0709 13:01:07.301770 (+420942us) spinlock_profiling.cc:243] Waited 1.7 ms on lock 0x7b180018d780. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1e38ede1 00007f6a1e39b5b1 00007f6a15440c0a 00007f6a1eb80219 00007f6a18169d70 00007f6a1815d293 00007f6a18152cea 00007f6a1815323a 00007f6a185bda2a 00007f6a185cd0bf 00007f6a185cd038
0709 13:01:08.066217 (+764447us) log.cc:844] Serialized 14 byte log entry
0709 13:01:08.074678 (+  8461us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:08.074742 (+    64us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:01:08.074794 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:08.074868 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:08.075074 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14179,"prepare.queue_time_us":95117,"prepare.run_cpu_time_us":116,"prepare.run_wall_time_us":2930,"raft.queue_time_us":83230,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":45039,"spinlock_wait_cycles":3918592,"thread_start_us":736719,"threads_started":2}
I20260709 13:01:08.145495  1525 raft_consensus.cc:2468] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 13.
I20260709 13:01:08.279578  5747 consensus_queue.cc:260] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:08.284929  6547 raft_consensus.cc:740] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:08.291834  6554 raft_consensus.cc:515] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:08.250072  6562 leader_election.cc:290] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:08.439071  1529 raft_consensus.cc:2368] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for earlier term 14. Current term is 15.
I20260709 13:01:08.369040  1681 raft_consensus.cc:2410] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b for term 11 because replica has last-logged OpId of term: 10 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 11.
I20260709 13:01:08.391288  1672 raft_consensus.cc:1240] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 15. Current term is 16. Ops: []
W20260709 13:01:08.336897  1495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:08.379336  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:08.331470  1523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49310 (request call id 1294) took 1646 ms. Trace:
I20260709 13:01:08.368556  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:01:08.364692  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:08.391920  1525 raft_consensus.cc:1275] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:01:08.352166  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:08.380349  6273 raft_consensus.cc:493] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:08.367599  1680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49170 (request call id 2483) took 2081 ms. Trace:
I20260709 13:01:08.413515  1673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49170 (request call id 2489) took 1508 ms. Trace:
I20260709 13:01:08.396955  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:08.349222  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:08.401417  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50664 (request call id 1213) took 1091 ms. Trace:
I20260709 13:01:08.435405  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:08.349798  1571 leader_election.cc:304] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:08.376935  5747 raft_consensus.cc:3060] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:08.355058  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:08.440698  6613 leader_election.cc:290] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 15 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:08.403636  6275 leader_election.cc:290] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:08.390223  6554 leader_election.cc:290] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:08.355717  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:01:08.343542  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 157891us
I20260709 13:01:08.400568  2190 leader_election.cc:304] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:08.382407  6302 leader_election.cc:290] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:01:08.353619  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 158417us
W20260709 13:01:08.345234  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 341358us
I20260709 13:01:08.544109  1646 leader_election.cc:304] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:08.354287  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:08.545499  6607 raft_consensus.cc:2749] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:01:08.551124  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:08.404719  6463 consensus_queue.cc:1048] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.145s
I20260709 13:01:08.559562  6777 raft_consensus.cc:493] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:08.560518  6777 raft_consensus.cc:515] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:08.563283  6273 raft_consensus.cc:515] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:08.563737  6658 raft_consensus.cc:493] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:08.564546  6658 raft_consensus.cc:515] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:08.565970  6273 leader_election.cc:290] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:08.509555  1523 rpcz_store.cc:276] 0709 13:01:06.684835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.684968 (+   133us) service_pool.cc:224] Handling call
0709 13:01:06.685362 (+   394us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:06.685688 (+   326us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:06.685716 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:06.686220 (+   504us) log.cc:844] Serialized 26 byte log entry
0709 13:01:07.114407 (+428187us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:07.114450 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:07.114523 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:08.004175 (+889652us) spinlock_profiling.cc:243] Waited 7.78 ms on lock 0x7b4400022b4c. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a153ecc85 00007f6a153ed6a2 00007f6a1815f1db 00007f6a1815aaaf 00007f6a1814e86e 00007f6a1814dbb6 00007f6a1814d7d8 00007f6a18157221 00007f6a181571d9 00007f6a18157169
0709 13:01:08.160859 (+156684us) raft_consensus.cc:1685] finished
0709 13:01:08.160883 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:08.330989 (+170106us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1363,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":92,"spinlock_wait_cycles":17898752,"thread_start_us":427783,"threads_started":1,"wal-append.queue_time_us":945706}
I20260709 13:01:08.566892  1607 raft_consensus.cc:2468] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 14.
I20260709 13:01:08.571014  1528 raft_consensus.cc:2468] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 16.
I20260709 13:01:08.444154  6630 raft_consensus.cc:515] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:08.581358  6750 raft_consensus.cc:493] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.581558  1674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49178 (request call id 2223) took 1443 ms. Trace:
W20260709 13:01:08.583643  6464 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.016s	sys 0.037s
I20260709 13:01:08.590783  6775 raft_consensus.cc:493] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:08.385303  6547 consensus_queue.cc:260] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:08.595965  6702 raft_consensus.cc:2804] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:08.601333  1674 rpcz_store.cc:276] 0709 13:01:07.138519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.236535 (+ 98016us) service_pool.cc:224] Handling call
0709 13:01:07.236854 (+   319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:07.251453 (+ 14599us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:07.251486 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:07.251946 (+   460us) log.cc:844] Serialized 26 byte log entry
0709 13:01:07.812401 (+560455us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:07.812445 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:07.998934 (+186489us) spinlock_profiling.cc:243] Waited 14.2 ms on lock 0x7b54003f5cd4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:01:07.998988 (+    54us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:08.579103 (+580115us) raft_consensus.cc:1685] finished
0709 13:01:08.579154 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:08.581378 (+  2224us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8132,"raft.queue_time_us":88,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":12729,"spinlock_wait_cycles":32648448,"thread_start_us":538930,"threads_started":1,"wal-append.queue_time_us":945440}
W20260709 13:01:08.603721  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 205067us
I20260709 13:01:08.604127  6788 raft_consensus.cc:2804] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:08.604970  6788 raft_consensus.cc:697] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 16 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:08.530710  1680 rpcz_store.cc:276] 0709 13:01:06.286169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.288721 (+  2552us) service_pool.cc:224] Handling call
0709 13:01:06.289043 (+   322us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:06.289402 (+   359us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:06.289432 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:07.244994 (+955562us) spinlock_profiling.cc:243] Waited 2.53 ms on lock 0x7b2c00129ff8. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a16eaca11 00007f6a16ebc372 00007f6a185eea01 00007f6a185b343a 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2
0709 13:01:07.245500 (+   506us) log.cc:844] Serialized 52 byte log entry
0709 13:01:07.799351 (+553851us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:07.799396 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:07.799468 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:08.366800 (+567332us) raft_consensus.cc:1685] finished
0709 13:01:08.366867 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:08.367369 (+   502us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":134401,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":94,"spinlock_wait_cycles":5815168,"thread_start_us":553488,"threads_started":1,"wal-append.queue_time_us":792575}
W20260709 13:01:08.607883  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:08.608350  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:08.609092  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:08.563896  1675 raft_consensus.cc:2468] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 15.
I20260709 13:01:08.609414  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:08.305114  6778 consensus_queue.cc:237] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:08.610265  6799 consensus_queue.cc:1059] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 13:01:08.301613  6749 consensus_queue.cc:237] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:08.610934  1674 raft_consensus.cc:2468] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 14.
W20260709 13:01:08.601130  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:08.602905  6702 raft_consensus.cc:493] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:08.612203  6702 raft_consensus.cc:3060] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:08.610872  6775 raft_consensus.cc:515] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:08.305012  6781 raft_consensus.cc:515] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:08.610086  1606 raft_consensus.cc:2468] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 10.
I20260709 13:01:08.616266  6658 leader_election.cc:290] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:01:08.599754  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 56191.2us
I20260709 13:01:08.619452  6690 raft_consensus.cc:493] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:08.620321  6690 raft_consensus.cc:515] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:08.558617  6707 raft_consensus.cc:493] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:08.616389  6775 leader_election.cc:290] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
W20260709 13:01:08.623349  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:08.624333  6464 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.017s	sys 0.037s
I20260709 13:01:08.606571  6788 consensus_queue.cc:237] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:08.437609  6596 consensus_queue.cc:260] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:08.625979  6700 leader_election.cc:290] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:08.626405  6777 leader_election.cc:290] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:08.627318  1570 leader_election.cc:304] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:08.627780  6799 raft_consensus.cc:3055] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:01:08.628703  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 46143.1us
I20260709 13:01:08.630900  6750 raft_consensus.cc:515] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:08.631685  1672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50664 (request call id 1212) took 1322 ms. Trace:
I20260709 13:01:08.632170  1672 rpcz_store.cc:276] 0709 13:01:07.309739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.316405 (+  6666us) service_pool.cc:224] Handling call
0709 13:01:07.316688 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:08.507687 (+1190999us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:08.631442 (+123755us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54002fab54. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:01:08.631623 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2470234880}
I20260709 13:01:08.626546  6596 raft_consensus.cc:3060] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:08.617260  6748 leader_election.cc:290] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:08.622910  6707 raft_consensus.cc:515] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:08.628240  6799 raft_consensus.cc:740] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
W20260709 13:01:08.596139  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 246857us
I20260709 13:01:08.616423  6781 leader_election.cc:290] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:08.531947  1676 rpcz_store.cc:276] 0709 13:01:07.309970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.319197 (+  9227us) service_pool.cc:224] Handling call
0709 13:01:08.154465 (+835268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:08.157069 (+  2604us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:08.157100 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:08.157141 (+    41us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:01:08.157173 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:08.157236 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:08.400992 (+243756us) spinlock_profiling.cc:243] Waited 820 ms on lock 0x7b54002c0450. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b28ad 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:01:08.401202 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20576,"raft.queue_time_us":3353,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":6894,"spinlock_wait_cycles":1885703424}
I20260709 13:01:08.610003  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:08.637522  6748 consensus_queue.cc:1048] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:08.653136  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:08.620987  1497 leader_election.cc:304] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:08.654690  1530 raft_consensus.cc:2468] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 10.
I20260709 13:01:08.659560  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:08.672163  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:08.677384  2227 raft_consensus.cc:2468] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 11.
I20260709 13:01:08.677775  1570 leader_election.cc:304] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:08.675633  6275 raft_consensus.cc:2749] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:08.684859  6775 raft_consensus.cc:493] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:08.685784  6775 raft_consensus.cc:515] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:08.687636  6782 consensus_queue.cc:1059] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:01:08.689091  6782 raft_consensus.cc:3055] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:08.689548  6782 raft_consensus.cc:740] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:08.672734  6613 raft_consensus.cc:493] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.532382  1673 rpcz_store.cc:276] 0709 13:01:06.905254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.905417 (+   163us) service_pool.cc:224] Handling call
0709 13:01:06.905704 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:06.934108 (+ 28404us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:01:07.509775 (+575667us) log.cc:844] Serialized 14 byte log entry
0709 13:01:08.080845 (+571070us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:08.080908 (+    63us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:08.080957 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:08.412909 (+331952us) spinlock_profiling.cc:243] Waited 28.1 ms on lock 0x7b5400179154. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:01:08.412988 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:08.413291 (+   303us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":125921,"prepare.queue_time_us":757704,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":8372,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":28031,"spinlock_wait_cycles":64708480,"thread_start_us":982486,"threads_started":2,"wal-append.queue_time_us":773482}
I20260709 13:01:08.661693  2190 leader_election.cc:304] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
W20260709 13:01:08.668689  1527 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.006s	sys 0.013s
W20260709 13:01:08.731334  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 122145us
I20260709 13:01:08.692076  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:01:08.703259  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 96590.9us
I20260709 13:01:08.702523  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:01:08.720857  1527 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.006s	sys 0.013s
I20260709 13:01:08.723398  1603 raft_consensus.cc:1240] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:08.721082  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:08.698783  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
W20260709 13:01:08.707782  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 87007.7us
I20260709 13:01:08.708113  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:08.709501  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:08.692108  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:08.707877  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:08.717547  1496 leader_election.cc:304] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:08.729635  1680 raft_consensus.cc:2468] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 14.
I20260709 13:01:08.744289  1672 raft_consensus.cc:3060] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:01:08.700975  6690 leader_election.cc:290] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:08.745441  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:08.705755  2191 leader_election.cc:304] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:08.717121  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:08.703708  6686 raft_consensus.cc:2804] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:01:08.693467  6685 consensus_meta.cc:287] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.887s	user 0.007s	sys 0.007s
I20260709 13:01:08.815202  1681 raft_consensus.cc:2393] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 9: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:01:08.795511  2226 raft_consensus.cc:2468] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 14.
I20260709 13:01:08.815963  1677 raft_consensus.cc:2468] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 15.
I20260709 13:01:08.818262  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50664 (request call id 1219) took 1488 ms. Trace:
I20260709 13:01:08.819128  6592 raft_consensus.cc:493] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:08.819808  6592 raft_consensus.cc:515] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:08.821951  6730 raft_consensus.cc:493] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.822227  6592 leader_election.cc:290] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:08.728209  6750 leader_election.cc:290] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:08.727502  6707 leader_election.cc:290] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:08.698072  6635 leader_election.cc:290] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:08.823385  6730 raft_consensus.cc:515] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:08.823952  6686 raft_consensus.cc:493] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:08.824353  6686 raft_consensus.cc:3060] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:01:08.815174  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 109662us
I20260709 13:01:08.799002  1571 leader_election.cc:304] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
W20260709 13:01:08.799961  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 54157.3us
I20260709 13:01:08.697273  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:08.800628  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49178 (request call id 2227) took 1033 ms. Trace:
W20260709 13:01:08.801249  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 123617us
I20260709 13:01:08.732519  6700 consensus_queue.cc:1048] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.075s
I20260709 13:01:08.697225  6799 consensus_queue.cc:260] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:08.807654  6622 raft_consensus.cc:493] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:08.711050  6763 consensus_queue.cc:1059] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.097s
I20260709 13:01:08.808173  6554 raft_consensus.cc:493] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:08.695319  6613 raft_consensus.cc:515] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:08.809463  1674 raft_consensus.cc:3060] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:08.720377  6564 raft_consensus.cc:515] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:08.862913  6564 leader_election.cc:290] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:08.810127  1673 raft_consensus.cc:3060] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:08.863873  6799 raft_consensus.cc:3060] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:08.691444  6781 raft_consensus.cc:493] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.716187  6725 leader_election.cc:290] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:08.715857  6733 raft_consensus.cc:515] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:08.810865  1679 raft_consensus.cc:2468] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 10.
I20260709 13:01:08.811772  6334 raft_consensus.cc:2749] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:08.812511  1675 raft_consensus.cc:2468] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 14.
I20260709 13:01:08.800503  6715 raft_consensus.cc:515] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:08.799125  1606 raft_consensus.cc:2410] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for term 15 because replica has last-logged OpId of term: 13 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 12.
I20260709 13:01:08.822499  1677 rpcz_store.cc:276] 0709 13:01:07.329419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.746854 (+417435us) service_pool.cc:224] Handling call
0709 13:01:08.817967 (+1071113us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54000b8bd4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:01:08.818173 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2456503680}
I20260709 13:01:08.798339  6658 raft_consensus.cc:2804] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:08.797395  1497 leader_election.cc:304] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:08.705063  6697 leader_election.cc:290] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:08.829727  1676 rpcz_store.cc:276] 0709 13:01:07.767711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:08.799540 (+1031829us) service_pool.cc:224] Handling call
0709 13:01:08.799983 (+   443us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:08.800291 (+   308us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:08.800323 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:08.800378 (+    55us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:08.800406 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:08.800453 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:08.800552 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:08.690626  6626 consensus_meta.cc:287] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.582s	user 0.006s	sys 0.010s
W20260709 13:01:08.848340  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 49431.1us
I20260709 13:01:08.708617  6273 raft_consensus.cc:2764] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:01:08.727679  6547 raft_consensus.cc:3060] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:08.853781  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 136511us
W20260709 13:01:08.814520  6779 consensus_meta.cc:287] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.550s	user 0.007s	sys 0.006s
I20260709 13:01:08.855405  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:08.855937  6730 leader_election.cc:290] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:08.856539  2219 raft_consensus.cc:2468] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 15.
I20260709 13:01:08.819268  6775 leader_election.cc:290] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:08.691259  6782 consensus_queue.cc:260] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:08.923595  6782 raft_consensus.cc:3060] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:08.869957  1672 raft_consensus.cc:2468] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 15.
I20260709 13:01:08.926883  6626 raft_consensus.cc:515] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:01:08.695920  6705 consensus_meta.cc:287] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.653s	user 0.011s	sys 0.003s
I20260709 13:01:08.930521  1605 raft_consensus.cc:1240] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:08.720135  6630 leader_election.cc:290] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:08.903199  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:08.932044  1601 raft_consensus.cc:2468] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 10.
I20260709 13:01:08.903699  5747 raft_consensus.cc:2804] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:08.929559  1672 raft_consensus.cc:1240] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 17. Current term is 18. Ops: [15.10-17.11]
I20260709 13:01:08.912472  1527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43010 (request call id 2431) took 1151 ms. Trace:
I20260709 13:01:08.934547  1527 rpcz_store.cc:276] 0709 13:01:07.761104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.761217 (+   113us) service_pool.cc:224] Handling call
0709 13:01:07.761552 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:07.761774 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:01:08.069100 (+307326us) log.cc:844] Serialized 14 byte log entry
0709 13:01:08.850365 (+781265us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:08.866917 (+ 16552us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:08.871876 (+  4959us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:08.871962 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:08.912405 (+ 40443us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":804726,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":47,"raft.queue_time_us":116145,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":9293,"thread_start_us":949943,"threads_started":2,"wal-append.queue_time_us":637047}
I20260709 13:01:08.930202  6705 raft_consensus.cc:515] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:08.939038  1678 raft_consensus.cc:1240] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:08.938537  6705 leader_election.cc:290] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:08.943011  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:08.943857  1679 raft_consensus.cc:3060] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:08.950788  6777 raft_consensus.cc:2749] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:08.958829  6629 raft_consensus.cc:2804] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:08.959599  6629 raft_consensus.cc:697] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:08.960640  6629 consensus_queue.cc:237] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:08.965898  6635 raft_consensus.cc:493] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.968166  6733 leader_election.cc:290] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:08.969393  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:08.970124  2227 raft_consensus.cc:2468] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 15.
I20260709 13:01:08.971679  1600 raft_consensus.cc:1275] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
W20260709 13:01:08.983619  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 186343us
I20260709 13:01:08.991112  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:08.992162  1601 raft_consensus.cc:2410] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:01:08.993036  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:08.993604  1601 raft_consensus.cc:2468] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 7.
I20260709 13:01:08.995162  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:08.996416  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:08.997516  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:08.998889  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:09.004078  6750 raft_consensus.cc:493] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.004873  6750 raft_consensus.cc:515] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:09.007107  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:09.007982  1604 raft_consensus.cc:2468] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 10.
I20260709 13:01:09.010146  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:09.011042  1606 raft_consensus.cc:2410] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 18 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260709 13:01:09.019201  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:09.020969  1680 raft_consensus.cc:1240] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:09.022244  1680 raft_consensus.cc:1240] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:09.024029  6715 leader_election.cc:290] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:09.034895  2190 leader_election.cc:304] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:09.037637  2190 leader_election.cc:304] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:09.041056  5747 raft_consensus.cc:493] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:09.041666  5747 raft_consensus.cc:3060] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:08.863790  6554 raft_consensus.cc:515] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:09.043761  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:09.046259  1496 leader_election.cc:304] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:08.994421  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:01:09.067166  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 159572us
I20260709 13:01:09.048568  1674 raft_consensus.cc:2468] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 10.
W20260709 13:01:09.072597  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:09.044261  6658 raft_consensus.cc:697] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 13 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:09.074326  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:09.075248  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:09.063158  6777 raft_consensus.cc:2804] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:09.087711  1678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50664 (request call id 1218) took 1762 ms. Trace:
I20260709 13:01:09.076647  1496 leader_election.cc:304] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:08.907985  6781 raft_consensus.cc:515] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:09.092967  2226 raft_consensus.cc:2393] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 15: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:01:09.093739  1600 raft_consensus.cc:2393] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 14: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:01:09.089069  1678 rpcz_store.cc:276] 0709 13:01:07.325434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.827315 (+501881us) service_pool.cc:224] Handling call
0709 13:01:07.827590 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:08.939548 (+1111958us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:09.056003 (+116455us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b54000b90d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:01:09.087635 (+ 31632us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2555492736}
I20260709 13:01:09.082829  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:09.072228  6626 leader_election.cc:290] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 18 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:08.914011  6622 raft_consensus.cc:515] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:09.073414  6763 raft_consensus.cc:493] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:08.966652  6635 raft_consensus.cc:515] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:09.056628  6592 consensus_queue.cc:1048] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:01:09.118088  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 13:01:09.118448  1495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:09.073096  6782 raft_consensus.cc:2749] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:09.106997  2190 leader_election.cc:304] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:09.088873  6777 raft_consensus.cc:493] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:09.099819  6596 raft_consensus.cc:2804] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:09.055374  6779 raft_consensus.cc:515] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:09.130323  1673 raft_consensus.cc:2468] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 12.
I20260709 13:01:09.132551  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:09.142163  1672 raft_consensus.cc:1240] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:09.137789  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:09.138670  1605 raft_consensus.cc:2468] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 9.
I20260709 13:01:09.144768  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50664 (request call id 1222) took 1156 ms. Trace:
I20260709 13:01:09.133092  6777 raft_consensus.cc:3060] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:09.158496  1601 raft_consensus.cc:2368] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 12. Current term is 13.
I20260709 13:01:09.161615  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:09.166244  1606 raft_consensus.cc:1275] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 11. (term mismatch)
I20260709 13:01:09.166749  1606 pending_rounds.cc:85] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642: Aborting all ops after (but not including) 10
I20260709 13:01:09.145226  1681 rpcz_store.cc:276] 0709 13:01:07.977401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:08.816071 (+838670us) service_pool.cc:224] Handling call
0709 13:01:08.816523 (+   452us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:08.816897 (+   374us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:01:08.817363 (+   466us) log.cc:844] Serialized 14 byte log entry
0709 13:01:09.133474 (+316111us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:09.133536 (+    62us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:09.133580 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:09.133647 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:09.133782 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":5788,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":12947,"thread_start_us":303008,"threads_started":1}
I20260709 13:01:09.170461  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:09.171342  1677 raft_consensus.cc:1240] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:09.175956  6302 consensus_queue.cc:1059] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:09.176568  1674 raft_consensus.cc:1275] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:01:09.179060  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:09.179874  6652 consensus_queue.cc:1059] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:09.180496  6760 raft_consensus.cc:2804] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:09.180931  6760 raft_consensus.cc:493] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:09.181150  6690 raft_consensus.cc:3055] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:01:09.180156  6747 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.036s	sys 0.029s
W20260709 13:01:09.146637  6702 consensus_meta.cc:287] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.534s	user 0.013s	sys 0.000s
I20260709 13:01:09.195083  6702 raft_consensus.cc:515] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:09.180841  6652 consensus_queue.cc:1048] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 13:01:09.197460  6702 leader_election.cc:290] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:09.198352  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:09.199074  1674 raft_consensus.cc:2468] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 10.
I20260709 13:01:09.181607  6690 raft_consensus.cc:740] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:09.200986  1603 raft_consensus.cc:2393] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 17: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:01:09.200685  6690 consensus_queue.cc:260] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:09.201910  6690 raft_consensus.cc:3060] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:09.188923  1598 raft_consensus.cc:1240] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 14. Current term is 16. Ops: [14.10-14.10]
I20260709 13:01:09.202515  6324 consensus_queue.cc:1059] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:01:09.189477  1604 raft_consensus.cc:1240] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 12. Current term is 13. Ops: [10.10-12.11]
I20260709 13:01:09.138351  6750 leader_election.cc:290] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
W20260709 13:01:09.187662  6747 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.637s	user 0.037s	sys 0.029s
I20260709 13:01:09.202032  2226 raft_consensus.cc:2468] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 9.
I20260709 13:01:09.203374  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:09.211369  1607 raft_consensus.cc:1240] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:01:09.181386  6760 raft_consensus.cc:3060] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:09.120877  6697 consensus_queue.cc:1059] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.070s
I20260709 13:01:09.216784  1598 raft_consensus.cc:2393] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 14: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
W20260709 13:01:09.217710  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 58211.8us
I20260709 13:01:09.221434  1679 raft_consensus.cc:2468] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 12.
I20260709 13:01:09.166975  1606 pending_rounds.cc:107] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260709 13:01:09.222931  1606 raft_consensus.cc:2889] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:09.223747  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:09.225835  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:09.210043  5747 raft_consensus.cc:515] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:09.222424  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:09.203950  6763 raft_consensus.cc:515] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:09.225376  1604 raft_consensus.cc:2468] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 9.
I20260709 13:01:09.229664  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:09.231732  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:09.220443  6613 leader_election.cc:290] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:09.235720  1598 raft_consensus.cc:2410] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 18 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260709 13:01:09.235920  6697 raft_consensus.cc:3055] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:01:09.236305  6697 raft_consensus.cc:740] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:09.236431  6763 leader_election.cc:290] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:09.236697  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:09.237319  6697 consensus_queue.cc:260] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:09.238647  6697 raft_consensus.cc:3060] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:09.241973  6672 raft_consensus.cc:2804] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:09.242403  6672 raft_consensus.cc:493] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:09.242842  6672 raft_consensus.cc:3060] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:09.239189  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:09.248173  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:09.248858  1604 raft_consensus.cc:3060] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:09.254526  6778 consensus_queue.cc:1059] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.096s
I20260709 13:01:09.255338  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:09.255559  6652 raft_consensus.cc:3055] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:09.255991  6652 raft_consensus.cc:740] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:09.256049  6176 consensus_queue.cc:1048] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:09.256464  6564 consensus_queue.cc:1048] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:09.257076  6652 consensus_queue.cc:260] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:09.258347  6652 raft_consensus.cc:3060] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:09.261034  1604 raft_consensus.cc:2468] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 15.
I20260709 13:01:09.262145  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:09.263029  1604 raft_consensus.cc:2468] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 7.
I20260709 13:01:09.264480  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:01:09.265070  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:09.268386  1572 leader_election.cc:304] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:09.270085  1572 leader_election.cc:304] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:09.266217  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:09.271641  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:09.272230  1605 raft_consensus.cc:3060] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:09.273372  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 52231.8us
I20260709 13:01:09.259734  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:09.275244  1606 raft_consensus.cc:2410] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:01:09.275563  6554 leader_election.cc:290] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:09.276279  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:09.276448  6700 raft_consensus.cc:2804] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:09.282581  6700 raft_consensus.cc:493] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:09.283047  6700 raft_consensus.cc:3060] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:09.283337  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:09.285197  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:09.285763  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:09.286377  1530 raft_consensus.cc:3060] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:09.276289  6702 raft_consensus.cc:2804] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:09.286971  6702 raft_consensus.cc:493] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:09.287348  6702 raft_consensus.cc:3060] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:09.293762  6779 leader_election.cc:290] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:09.295804  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:09.297124  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:09.298163  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:09.299014  6707 raft_consensus.cc:3055] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:09.299440  6707 raft_consensus.cc:740] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:09.301375  1606 raft_consensus.cc:2468] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 12.
I20260709 13:01:09.278833  6658 consensus_queue.cc:237] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:09.237919  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:09.281901  1605 raft_consensus.cc:2468] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 10.
I20260709 13:01:09.301936  6700 raft_consensus.cc:515] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:09.277549  1572 leader_election.cc:304] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:09.295560  6702 raft_consensus.cc:515] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:09.303857  1672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49170 (request call id 2500) took 1124 ms. Trace:
I20260709 13:01:09.304859  1604 raft_consensus.cc:2468] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 13.
I20260709 13:01:09.237991  6686 raft_consensus.cc:515] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:09.310031  1530 raft_consensus.cc:2468] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 12.
I20260709 13:01:09.311331  1496 leader_election.cc:304] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:09.317216  5747 leader_election.cc:290] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:09.318740  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:09.320159  1607 raft_consensus.cc:2368] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 12. Current term is 13.
I20260709 13:01:09.320660  1672 rpcz_store.cc:276] 0709 13:01:08.179905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:08.933802 (+753897us) service_pool.cc:224] Handling call
0709 13:01:09.141966 (+208164us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:09.142860 (+   894us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:09.303648 (+160788us) spinlock_profiling.cc:243] Waited 208 ms on lock 0x7b54000b95d0. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b28ad 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:01:09.303797 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":477889920}
I20260709 13:01:09.258248  6622 leader_election.cc:290] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:09.323005  1605 raft_consensus.cc:2376] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 15. Re-sending same reply.
I20260709 13:01:09.331089  1496 leader_election.cc:304] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
W20260709 13:01:09.323489  6641 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.046s	sys 0.070s
W20260709 13:01:09.334977  6641 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.046s	sys 0.070s
I20260709 13:01:09.332343  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:09.335490  6613 raft_consensus.cc:2804] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:09.336843  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
W20260709 13:01:09.337369  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 59905.8us
I20260709 13:01:09.340922  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:09.343142  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:09.336124  1600 raft_consensus.cc:2468] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 10.
I20260709 13:01:09.344843  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:09.345425  1600 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 15.
I20260709 13:01:09.346308  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:09.343940  6781 leader_election.cc:290] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:09.347568  5747 raft_consensus.cc:493] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:09.349045  5747 raft_consensus.cc:515] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:09.350165  6641 raft_consensus.cc:2804] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:09.350744  6641 raft_consensus.cc:697] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:09.351914  1496 leader_election.cc:304] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:09.351727  6641 consensus_queue.cc:237] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:09.352845  6273 raft_consensus.cc:2804] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:09.353272  6273 raft_consensus.cc:493] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:09.353641  6273 raft_consensus.cc:3060] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:09.332732  6788 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.640s	user 0.027s	sys 0.077s
I20260709 13:01:09.355185  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:09.350390  1644 leader_election.cc:400] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 pre-election: Vote denied by peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931) with higher term. Message: Invalid argument: T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for earlier term 14. Current term is 15.
I20260709 13:01:09.327675  6778 raft_consensus.cc:2804] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:09.356276  1607 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 15.
I20260709 13:01:09.355466  1600 raft_consensus.cc:2468] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 12.
I20260709 13:01:09.358297  1644 leader_election.cc:403] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:09.359524  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:09.369374  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:09.369524  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 13:01:09.357302  6788 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.669s	user 0.027s	sys 0.077s
I20260709 13:01:09.371376  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:09.372412  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:09.372550  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:09.347110  6613 raft_consensus.cc:697] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:09.378615  1603 raft_consensus.cc:1240] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:09.375003  2227 raft_consensus.cc:2468] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 14.
I20260709 13:01:09.387223  1605 raft_consensus.cc:1240] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 8. Current term is 10. Ops: [8.7-8.7]
W20260709 13:01:09.382737  6748 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.042s	sys 0.081s
W20260709 13:01:09.387967  6748 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.042s	sys 0.081s
I20260709 13:01:09.388659  1599 raft_consensus.cc:1275] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:01:09.359722  6778 raft_consensus.cc:493] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:09.441632  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 355567us
I20260709 13:01:09.446895  1606 raft_consensus.cc:2468] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 10.
I20260709 13:01:09.393148  6778 raft_consensus.cc:3060] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:09.452138  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:09.452946  6700 leader_election.cc:290] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 16 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:09.456641  2223 raft_consensus.cc:1240] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:09.468631  6702 leader_election.cc:290] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:09.471709  6613 consensus_queue.cc:237] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:01:09.474988  1571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:09.481724  5747 leader_election.cc:290] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:01:09.494083  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 219845us
I20260709 13:01:09.446262  6630 raft_consensus.cc:2749] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931) with higher term. Message: Invalid argument: T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for earlier term 14. Current term is 15.
I20260709 13:01:09.497466  6777 raft_consensus.cc:515] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:09.497895  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 378701us
I20260709 13:01:09.525260  2191 leader_election.cc:304] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:09.526312  2191 leader_election.cc:304] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:09.508682  1604 raft_consensus.cc:1275] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:01:09.496435  6707 consensus_queue.cc:260] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:09.529419  6707 raft_consensus.cc:3060] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:01:09.532167  1495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:09.535228  6334 raft_consensus.cc:2804] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:09.535737  6334 raft_consensus.cc:493] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:09.536073  6334 raft_consensus.cc:3060] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:09.539001  6547 raft_consensus.cc:2804] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:09.539512  6547 raft_consensus.cc:493] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:09.539848  6547 raft_consensus.cc:3060] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:09.514828  1646 leader_election.cc:304] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:09.518332  1598 raft_consensus.cc:2410] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:01:09.546026  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:09.551277  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:09.552330  5747 raft_consensus.cc:493] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.552934  5747 raft_consensus.cc:515] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:09.554378  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:09.555581  6176 consensus_queue.cc:1059] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:01:09.547931  6749 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.715s	user 0.031s	sys 0.045s
W20260709 13:01:09.559655  1675 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.003s	sys 0.017s
I20260709 13:01:09.558578  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 13:01:09.560855  1675 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.506s	user 0.003s	sys 0.017s
I20260709 13:01:09.562701  6781 raft_consensus.cc:493] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:09.563437  6781 raft_consensus.cc:515] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:09.564673  6777 leader_election.cc:290] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 15 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:09.565706  6781 leader_election.cc:290] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:09.569430  6635 leader_election.cc:290] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:09.570469  6273 raft_consensus.cc:515] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:09.572919  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:09.574396  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:09.575141  6782 raft_consensus.cc:3055] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:09.575584  6782 raft_consensus.cc:740] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:09.576486  6782 consensus_queue.cc:260] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:09.577132  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:09.575189  1600 raft_consensus.cc:2410] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:01:09.577883  1606 raft_consensus.cc:2468] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 14.
I20260709 13:01:09.575115  6273 leader_election.cc:290] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:09.569621  1675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49178 (request call id 2233) took 1182 ms. Trace:
I20260709 13:01:09.579010  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:09.580686  1680 raft_consensus.cc:3060] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:01:09.579779  1571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:09.580493  1675 rpcz_store.cc:276] 0709 13:01:08.387215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:09.032557 (+645342us) service_pool.cc:224] Handling call
0709 13:01:09.032852 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:09.033107 (+   255us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:01:09.054325 (+ 21218us) log.cc:844] Serialized 14 byte log entry
0709 13:01:09.569287 (+514962us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:09.569339 (+    52us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:01:09.569378 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:09.569439 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:09.569546 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":21593,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":6788,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":93,"thread_start_us":507466,"threads_started":1}
I20260709 13:01:09.586009  5747 leader_election.cc:290] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:01:09.560246  6749 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.907s	user 0.032s	sys 0.045s
I20260709 13:01:09.586123  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:09.559434  6622 raft_consensus.cc:2804] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:09.597561  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:09.601384  1606 raft_consensus.cc:3060] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:09.602712  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 349562us
I20260709 13:01:09.559736  6686 leader_election.cc:290] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 14 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:09.602836  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:09.604411  1604 raft_consensus.cc:1240] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:09.602077  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:09.606560  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:09.607336  1673 raft_consensus.cc:2393] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 12: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:01:09.547129  6672 raft_consensus.cc:515] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:09.610224  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 95605.1us
I20260709 13:01:09.584192  6596 raft_consensus.cc:697] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:09.617872  1527 raft_consensus.cc:1240] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:09.621434  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:09.590200  6782 raft_consensus.cc:3060] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:09.624079  1672 raft_consensus.cc:1240] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:09.625260  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:09.625543  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:09.625173  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:09.600978  6622 raft_consensus.cc:493] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:09.625914  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:09.628986  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:09.623175  5747 consensus_queue.cc:1059] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 13:01:09.570593  6778 raft_consensus.cc:515] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:09.630923  1604 raft_consensus.cc:2468] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 9.
I20260709 13:01:09.629236  1605 raft_consensus.cc:2410] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:01:09.628142  1675 raft_consensus.cc:3060] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:09.635541  1677 raft_consensus.cc:1275] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:01:09.590564  6760 raft_consensus.cc:515] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:09.643635  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:09.646975  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:09.648185  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:09.648959  1603 raft_consensus.cc:2410] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:01:09.650017  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:09.642295  1606 raft_consensus.cc:2468] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 12.
I20260709 13:01:09.634696  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:09.631116  6622 raft_consensus.cc:3060] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:09.653757  1605 raft_consensus.cc:2393] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 16: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:01:09.655303  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:09.656441  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:09.657241  1605 raft_consensus.cc:2410] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:01:09.653038  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:09.658722  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:09.658835  1680 raft_consensus.cc:2468] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 15.
I20260709 13:01:09.660902  1531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49310 (request call id 1313) took 1519 ms. Trace:
I20260709 13:01:09.661355  1531 rpcz_store.cc:276] 0709 13:01:08.111175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:08.165058 (+ 53883us) service_pool.cc:224] Handling call
0709 13:01:08.170648 (+  5590us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:08.170993 (+   345us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:01:08.579932 (+408939us) log.cc:844] Serialized 14 byte log entry
0709 13:01:09.150385 (+570453us) log.cc:844] Serialized 14 byte log entry
0709 13:01:09.599789 (+449404us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:09.605613 (+  5824us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:09.613887 (+  8274us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:09.620870 (+  6983us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:09.630535 (+  9665us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":399819,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":79,"raft.queue_time_us":45777,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":89,"thread_start_us":1017356,"threads_started":3,"wal-append.queue_time_us":702368}
I20260709 13:01:09.665201  6760 leader_election.cc:290] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 17 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:09.665850  6760 raft_consensus.cc:493] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:09.666797  1532 raft_consensus.cc:3060] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:01:09.666924  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 46755.8us
I20260709 13:01:09.667760  1646 leader_election.cc:304] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:09.668292  1681 raft_consensus.cc:1240] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:09.667060  2221 raft_consensus.cc:1240] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:09.670933  6750 consensus_queue.cc:1059] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:09.671562  1607 raft_consensus.cc:2393] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 15: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:01:09.671815  6750 consensus_queue.cc:1048] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:01:09.672636  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:09.673254  6750 raft_consensus.cc:3055] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:09.673623  6750 raft_consensus.cc:740] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:09.676410  2224 raft_consensus.cc:2468] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 16.
I20260709 13:01:09.670686  6596 consensus_queue.cc:237] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:09.653666  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:09.679574  1598 raft_consensus.cc:2468] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 13.
I20260709 13:01:09.683588  1604 raft_consensus.cc:1275] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:01:09.680691  1606 raft_consensus.cc:2376] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 12. Re-sending same reply.
I20260709 13:01:09.670555  1646 leader_election.cc:304] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:09.680599  1675 raft_consensus.cc:2468] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 11.
I20260709 13:01:09.681856  1532 raft_consensus.cc:2468] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 14.
I20260709 13:01:09.666327  6760 raft_consensus.cc:515] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:09.669222  6630 raft_consensus.cc:2804] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:09.669171  6672 leader_election.cc:290] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:09.712268  1571 leader_election.cc:304] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:09.730136  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:09.728319  1496 leader_election.cc:304] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:09.735608  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:09.724975  5747 raft_consensus.cc:3055] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:01:09.787907  1676 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.007s	sys 0.041s
W20260709 13:01:09.788925  1676 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.007s	sys 0.041s
I20260709 13:01:09.789229  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:09.790187  1605 raft_consensus.cc:2410] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for term 18 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:01:09.788446  5747 raft_consensus.cc:740] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:09.792999  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:09.793234  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:09.793365  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:09.688272  6626 raft_consensus.cc:2804] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:09.797017  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:09.794099  1599 raft_consensus.cc:2468] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 14.
W20260709 13:01:09.792363  1498 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.916s	user 0.023s	sys 0.061s
I20260709 13:01:09.654474  6635 consensus_queue.cc:1059] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.084s
W20260709 13:01:09.803359  1498 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.934s	user 0.023s	sys 0.061s
I20260709 13:01:09.804514  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:09.674515  6750 consensus_queue.cc:260] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:01:09.808248  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:09.808418  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:01:09.809964  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:09.742583  6749 raft_consensus.cc:2804] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:01:09.810317  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:09.815150  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:09.711263  6775 consensus_queue.cc:1048] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.097s
I20260709 13:01:09.726788  6630 raft_consensus.cc:493] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:09.743110  6725 raft_consensus.cc:2804] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:09.724795  6273 raft_consensus.cc:493] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.800266  6626 raft_consensus.cc:493] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:09.720624  6607 consensus_queue.cc:1059] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.097s
I20260709 13:01:09.687501  6547 raft_consensus.cc:515] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:09.724597  6747 consensus_queue.cc:1048] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.091s
I20260709 13:01:09.792837  6748 consensus_queue.cc:1059] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:01:09.820048  6799 raft_consensus.cc:493] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.822255  6630 raft_consensus.cc:3060] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:09.846184  6626 raft_consensus.cc:3060] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:09.844060  6725 raft_consensus.cc:697] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:09.863826  6273 raft_consensus.cc:515] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:09.889248  6334 raft_consensus.cc:515] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:09.900986  6334 leader_election.cc:290] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 16 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:09.864284  6747 consensus_queue.cc:1243] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer ddf11fc190dd4b898773379c6b129d90 log is divergent from this leader: its last log entry 14.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:01:09.871575  6750 raft_consensus.cc:3060] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:09.903074  6778 leader_election.cc:290] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 16 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:09.866201  6799 raft_consensus.cc:515] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:09.913439  6799 leader_election.cc:290] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:09.921627  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:09.922427  1673 raft_consensus.cc:2393] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 12: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:01:09.923498  5747 consensus_queue.cc:260] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:09.924824  5747 raft_consensus.cc:3060] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:09.935410  6725 consensus_queue.cc:237] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:09.937367  6622 raft_consensus.cc:515] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:09.943815  6547 leader_election.cc:290] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:01:09.957100  1601 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.784s	user 0.005s	sys 0.035s
W20260709 13:01:09.957573  1601 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.785s	user 0.005s	sys 0.035s
I20260709 13:01:10.016307  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:01:10.025103  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:09.981000  6641 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.017s	sys 0.034s
I20260709 13:01:10.034636  1604 raft_consensus.cc:1240] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 11. Current term is 12. Ops: [11.12-11.12]
W20260709 13:01:10.034616  6641 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.017s	sys 0.035s
I20260709 13:01:09.974226  6273 leader_election.cc:290] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:10.042775  6622 leader_election.cc:290] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:10.043301  6760 leader_election.cc:290] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:01:10.046278  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:10.017943  6629 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.005s	sys 0.051s
W20260709 13:01:10.060002  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 492766us
W20260709 13:01:10.061604  2191 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.000s	sys 0.015s
W20260709 13:01:10.061971  2191 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.518s	user 0.000s	sys 0.015s
W20260709 13:01:10.062250  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 518910us
I20260709 13:01:10.063133  1602 raft_consensus.cc:2468] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 15.
W20260709 13:01:10.068663  1495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:10.061766  6629 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.006s	sys 0.051s
W20260709 13:01:10.049240  6592 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.010s	sys 0.023s
I20260709 13:01:10.079417  6613 raft_consensus.cc:493] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.084610  6613 raft_consensus.cc:515] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:01:10.079139  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 457148us
W20260709 13:01:10.078575  6592 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.635s	user 0.010s	sys 0.023s
W20260709 13:01:10.094298  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 497304us
W20260709 13:01:10.095983  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.090071  2191 leader_election.cc:304] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:10.096534  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49170 (request call id 2513) took 1044 ms. Trace:
I20260709 13:01:10.097434  1676 rpcz_store.cc:276] 0709 13:01:09.052256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:09.174249 (+121993us) service_pool.cc:224] Handling call
0709 13:01:09.174629 (+   380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:09.174975 (+   346us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:01:09.798922 (+623947us) log.cc:844] Serialized 14 byte log entry
0709 13:01:10.096025 (+297103us) log.cc:844] Serialized 14 byte log entry
0709 13:01:10.096217 (+   192us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:10.096261 (+    44us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:10.096302 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:10.096362 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:10.096475 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":2500,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":30,"raft.queue_time_us":5944,"thread_start_us":897119,"threads_started":2}
I20260709 13:01:10.078687  6630 raft_consensus.cc:515] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:10.113587  1572 leader_election.cc:304] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:10.125650  1646 leader_election.cc:304] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:01:10.119395  2219 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.011s	sys 0.028s
W20260709 13:01:10.129493  2219 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.516s	user 0.011s	sys 0.028s
I20260709 13:01:10.129657  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
W20260709 13:01:10.142266  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.153836  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:10.156199  1681 raft_consensus.cc:3060] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:10.155043  1672 raft_consensus.cc:1240] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:10.153167  2219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 1021) took 1059 ms. Trace:
I20260709 13:01:10.160029  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
W20260709 13:01:10.150244  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 337996us
I20260709 13:01:10.155110  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:10.162956  1674 raft_consensus.cc:2393] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 15: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
W20260709 13:01:10.172359  1571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.153879  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:10.215808  1673 raft_consensus.cc:2393] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 11: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
W20260709 13:01:10.215791  1571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:10.216470  1571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.222330  1680 raft_consensus.cc:1275] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260709 13:01:10.223671  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 92354.6us
I20260709 13:01:10.120781  6592 raft_consensus.cc:2804] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:10.159267  2219 rpcz_store.cc:276] 0709 13:01:09.083230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:09.087257 (+  4027us) service_pool.cc:224] Handling call
0709 13:01:09.128723 (+ 41466us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:09.183507 (+ 54784us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:09.183541 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:09.218503 (+ 34962us) log.cc:844] Serialized 26 byte log entry
0709 13:01:09.598493 (+379990us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:01:09.610001 (+ 11508us) log.cc:844] Serialized 14 byte log entry
0709 13:01:10.130107 (+520106us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:10.130254 (+   147us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:10.130329 (+    75us) raft_consensus.cc:1685] finished
0709 13:01:10.130342 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:10.130475 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3326,"prepare.queue_time_us":15373,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":88098,"raft.run_cpu_time_us":243,"raft.run_wall_time_us":11241,"thread_start_us":875891,"threads_started":2,"wal-append.queue_time_us":688017}
I20260709 13:01:10.230916  1680 pending_rounds.cc:85] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90: Aborting all ops after (but not including) 8
W20260709 13:01:10.231060  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 66751.2us
I20260709 13:01:10.231482  1680 pending_rounds.cc:107] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:01:10.231761  1680 raft_consensus.cc:2889] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:10.232157  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:10.151790  6641 raft_consensus.cc:493] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
W20260709 13:01:10.234503  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 108958us
I20260709 13:01:10.234982  6641 raft_consensus.cc:515] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:10.235255  1646 leader_election.cc:304] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:01:10.236721  1646 leader_election.cc:304] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:10.237064  6641 leader_election.cc:290] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:10.238969  2221 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0"
dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
mode: GRACEFUL
new_leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:47682
I20260709 13:01:10.129869  6749 raft_consensus.cc:697] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 15 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:10.153661  6607 consensus_queue.cc:1243] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer 39a92f5a4352465d8af3af5908fe8642 log is divergent from this leader: its last log entry 11.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:01:10.239734  2221 raft_consensus.cc:606] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 16 LEADER]: Received request to transfer leadership to TS e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:10.223373  6690 raft_consensus.cc:493] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.152055  6697 raft_consensus.cc:3060] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:10.129285  6324 raft_consensus.cc:2749] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:10.283103  1646 leader_election.cc:304] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:10.297226  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:10.311422  1598 raft_consensus.cc:3060] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:10.295619  1602 raft_consensus.cc:1240] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:10.296222  1604 raft_consensus.cc:1240] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 13:01:10.296033  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 13:01:10.292950  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 58898.9us
I20260709 13:01:10.318998  1679 raft_consensus.cc:1240] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:10.277339  6707 raft_consensus.cc:2764] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
W20260709 13:01:10.296823  6825 log.cc:927] Time spent T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:01:10.317417  6690 raft_consensus.cc:515] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:10.273674  6778 raft_consensus.cc:493] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:10.333668  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:10.349977  1523 raft_consensus.cc:2468] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 15.
W20260709 13:01:10.355074  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:10.355584  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:10.355867  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.357829  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:10.358683  2224 raft_consensus.cc:2393] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 15: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
W20260709 13:01:10.342115  6860 log.cc:927] Time spent T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.253s	user 0.000s	sys 0.001s
I20260709 13:01:10.321146  6592 raft_consensus.cc:697] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 12 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:10.285009  6607 consensus_queue.cc:1059] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.062s
I20260709 13:01:10.374079  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:10.374300  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:10.367283  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:10.374825  2223 raft_consensus.cc:3060] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:10.376890  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.383345  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
W20260709 13:01:10.381065  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 148813us
I20260709 13:01:10.393811  1598 raft_consensus.cc:2468] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 15.
I20260709 13:01:10.388197  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:10.395503  1523 raft_consensus.cc:2468] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 19.
I20260709 13:01:10.397701  2227 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59"
dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
mode: GRACEFUL
new_leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:47682
I20260709 13:01:10.398420  2227 raft_consensus.cc:606] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Received request to transfer leadership to TS e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:10.398813  2227 raft_consensus.cc:614] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:01:10.401978  6851 log.cc:927] Time spent T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 13:01:10.368695  6324 raft_consensus.cc:3060] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:10.399458  6592 consensus_queue.cc:237] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:10.424108  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 141069us
I20260709 13:01:10.416764  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:10.414825  2223 raft_consensus.cc:2410] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
W20260709 13:01:10.398747  6834 log.cc:927] Time spent T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.320s	user 0.000s	sys 0.001s
I20260709 13:01:10.378439  6564 raft_consensus.cc:493] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:10.365803  6846 consensus_queue.cc:1059] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.078s
I20260709 13:01:10.444199  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:10.445636  1531 raft_consensus.cc:3060] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:10.405551  6635 raft_consensus.cc:493] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.451735  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:10.405725  6747 raft_consensus.cc:493] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:10.458969  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:10.460492  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:10.433547  6700 raft_consensus.cc:3055] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:10.471753  2223 raft_consensus.cc:2393] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 12: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:01:10.405207  6778 raft_consensus.cc:515] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:10.466388  6700 raft_consensus.cc:740] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:10.476894  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
W20260709 13:01:10.478682  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 47307us
I20260709 13:01:10.476147  6747 raft_consensus.cc:515] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:10.479782  6700 consensus_queue.cc:260] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:10.464170  6564 raft_consensus.cc:515] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:10.480872  6700 raft_consensus.cc:3060] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:10.481781  6747 leader_election.cc:290] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:10.483249  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:10.484014  1532 raft_consensus.cc:2393] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 15: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:01:10.492468  2224 raft_consensus.cc:1240] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:10.483740  1646 leader_election.cc:304] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:10.457142  6607 raft_consensus.cc:3055] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:10.460796  6855 raft_consensus.cc:493] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:10.464599  6630 leader_election.cc:290] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:10.497563  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36194 (request call id 1949) took 1317 ms. Trace:
I20260709 13:01:10.482402  6564 leader_election.cc:290] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:10.505900  5747 consensus_queue.cc:1048] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:01:10.509702  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:10.415647  6749 consensus_queue.cc:237] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:10.518644  1572 leader_election.cc:304] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:10.503741  1601 rpcz_store.cc:276] 0709 13:01:09.169691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:09.171253 (+  1562us) service_pool.cc:224] Handling call
0709 13:01:09.171599 (+   346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:09.172047 (+   448us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:09.172074 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:09.172591 (+   517us) log.cc:844] Serialized 26 byte log entry
0709 13:01:09.957961 (+785370us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:09.970894 (+ 12933us) log.cc:844] Serialized 14 byte log entry
0709 13:01:09.971207 (+   313us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:09.971281 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:10.486470 (+515189us) raft_consensus.cc:1685] finished
0709 13:01:10.486492 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:10.486630 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":16594,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":4850,"raft.run_cpu_time_us":257,"raft.run_wall_time_us":40183,"thread_start_us":784925,"threads_started":1,"wal-append.queue_time_us":934479}
I20260709 13:01:10.529352  1572 leader_election.cc:304] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:10.529948  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:10.530553  1523 raft_consensus.cc:3060] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:10.465173  6635 raft_consensus.cc:515] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:10.532657  5747 raft_consensus.cc:2749] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:01:10.538875  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 113711us
W20260709 13:01:10.514860  6750 consensus_meta.cc:287] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.612s	user 0.008s	sys 0.006s
I20260709 13:01:10.503477  6607 raft_consensus.cc:740] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:10.542500  2190 leader_election.cc:304] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:10.509032  6869 consensus_queue.cc:1059] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.048s
W20260709 13:01:10.528476  6836 log.cc:927] Time spent T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.288s	user 0.000s	sys 0.001s
I20260709 13:01:10.923496  6176 raft_consensus.cc:2804] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:01:10.753146  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.572791  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
W20260709 13:01:10.707501  6866 log.cc:927] Time spent T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 13:01:10.867682  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:10.937139  2219 raft_consensus.cc:2393] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 11: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:01:10.775894  1672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49178 (request call id 2250) took 1035 ms. Trace:
I20260709 13:01:10.724747  6778 leader_election.cc:290] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:10.826397  1531 raft_consensus.cc:2468] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 16.
I20260709 13:01:10.791967  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:01:10.664057  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 259162us
W20260709 13:01:10.937944  1497 connection.cc:256] RPC call timeout handler was delayed by -1.6802070999999614s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1532s for a response
I20260709 13:01:10.573163  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:10.572019  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 13:01:10.650249  6626 consensus_meta.cc:287] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.751s	user 0.005s	sys 0.005s
I20260709 13:01:10.572644  6635 leader_election.cc:290] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:01:10.798331  1570 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.523s (SENT) [suppressed 30 similar messages]
W20260709 13:01:10.927350  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:10.947237  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.923978  6870 raft_consensus.cc:3055] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:01:10.615746  1495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.539937  6630 raft_consensus.cc:2804] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:01:10.969892  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 440638us
I20260709 13:01:10.752944  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:10.572419  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:10.932018  6176 raft_consensus.cc:697] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 14 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:10.901530  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
W20260709 13:01:10.923349  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 380942us
I20260709 13:01:10.933099  6607 consensus_queue.cc:260] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:10.525650  6855 raft_consensus.cc:515] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:10.774616  6672 raft_consensus.cc:493] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.707212  6861 raft_consensus.cc:493] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
W20260709 13:01:10.568354  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 64760.9us
W20260709 13:01:10.819798  1681 consensus_meta.cc:287] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.663s	user 0.009s	sys 0.001s
I20260709 13:01:10.982163  1681 raft_consensus.cc:2468] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 16.
I20260709 13:01:10.690110  1523 raft_consensus.cc:2468] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 12.
I20260709 13:01:10.792343  1676 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9"
dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
mode: GRACEFUL
new_leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:33616
I20260709 13:01:10.940366  2192 leader_election.cc:304] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:10.577629  6690 leader_election.cc:290] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:10.942050  1525 raft_consensus.cc:3060] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:10.939263  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 13:01:10.942380  1497 connection.cc:256] RPC call timeout handler was delayed by -1.6523070999999732s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1563s for a response
I20260709 13:01:10.938169  1524 raft_consensus.cc:3060] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:10.985654  1497 connection.cc:256] RPC call timeout handler was delayed by -1.5966281979999621s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1789s for a response
I20260709 13:01:10.985682  1531 raft_consensus.cc:2468] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 15.
W20260709 13:01:10.986440  1497 connection.cc:256] RPC call timeout handler was delayed by -1.5938070999999923s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1628s for a response
I20260709 13:01:10.967520  6870 raft_consensus.cc:740] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
W20260709 13:01:10.623770  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:10.990077  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:10.641773  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:10.835908  6837 log.cc:927] Time spent T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.515s	user 0.001s	sys 0.003s
W20260709 13:01:10.948205  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.946405  1529 raft_consensus.cc:2468] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 15.
I20260709 13:01:10.949218  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:10.569348  6859 consensus_queue.cc:1059] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.428s
I20260709 13:01:10.970904  1600 raft_consensus.cc:2468] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 12.
I20260709 13:01:11.036273  1524 raft_consensus.cc:2468] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 10.
I20260709 13:01:10.972277  2227 raft_consensus.cc:2393] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 11: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:01:10.972579  1572 leader_election.cc:304] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:10.573618  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:10.972448  1672 rpcz_store.cc:276] 0709 13:01:09.740396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:09.787667 (+ 47271us) service_pool.cc:224] Handling call
0709 13:01:09.805249 (+ 17582us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:10.157365 (+352116us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:10.775633 (+618268us) spinlock_profiling.cc:243] Waited 350 ms on lock 0x7b54003f5cd4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:01:10.775826 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":804098816}
I20260709 13:01:10.998476  6607 raft_consensus.cc:3060] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:10.570890  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 13:01:11.045974  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 247680us
I20260709 13:01:10.572876  6747 raft_consensus.cc:2749] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:01:10.983645  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.047431  6842 raft_consensus.cc:2749] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:11.048161  1646 leader_election.cc:304] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:10.983866  1676 raft_consensus.cc:606] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Received request to transfer leadership to TS e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:11.049866  1676 raft_consensus.cc:614] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:01:11.044507  1571 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.011s	sys 0.024s
W20260709 13:01:11.051677  1571 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.520s	user 0.011s	sys 0.024s
I20260709 13:01:10.891903  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:11.050859  6750 raft_consensus.cc:2804] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:11.053233  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:11.054106  6876 consensus_queue.cc:1059] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:01:11.055430  1532 raft_consensus.cc:2468] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 15.
I20260709 13:01:11.056463  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:11.057727  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:11.058320  1532 raft_consensus.cc:2468] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 9.
I20260709 13:01:10.868085  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:10.975857  6596 raft_consensus.cc:493] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:10.977412  6630 raft_consensus.cc:697] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 15 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:11.001397  2191 leader_election.cc:304] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:10.967629  6626 raft_consensus.cc:515] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:11.004436  6324 consensus_meta.cc:287] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.581s	user 0.006s	sys 0.002s
I20260709 13:01:11.005338  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:11.005153  6176 consensus_queue.cc:237] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:10.984637  6707 raft_consensus.cc:2764] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:01:10.683936  6873 raft_consensus.cc:3055] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:11.007104  2219 raft_consensus.cc:1240] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 12. Current term is 13. Ops: []
W20260709 13:01:10.997737  6850 log.cc:927] Time spent T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 13:01:10.570156  6564 consensus_queue.cc:1059] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.425s
W20260709 13:01:11.037496  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 65925us
I20260709 13:01:11.116393  1572 leader_election.cc:304] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:10.981115  1527 raft_consensus.cc:3060] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:11.035260  2220 raft_consensus.cc:2468] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 12.
I20260709 13:01:11.046352  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:11.051859  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
W20260709 13:01:10.975131  6838 log.cc:927] Time spent T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.407s	user 0.001s	sys 0.002s
I20260709 13:01:11.052386  1526 raft_consensus.cc:3060] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:01:11.059955  6852 log.cc:927] Time spent T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.588s	user 0.000s	sys 0.004s
I20260709 13:01:10.984411  6672 raft_consensus.cc:515] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:11.054061  2225 raft_consensus.cc:2393] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 12: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:01:11.121174  1572 leader_election.cc:304] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:10.994484  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 13:01:11.063540  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 532410us
I20260709 13:01:11.009881  6869 raft_consensus.cc:493] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:11.076357  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 136093us
W20260709 13:01:11.080144  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 75655.4us
I20260709 13:01:10.997996  6861 raft_consensus.cc:515] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:11.070415  6622 raft_consensus.cc:3055] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:01:11.087096  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:11.087772  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:11.089419  6613 leader_election.cc:290] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:01:11.089864  6848 log.cc:927] Time spent T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.900s	user 0.007s	sys 0.000s
I20260709 13:01:11.089974  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:11.136854  1530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49310 (request call id 1329) took 1539 ms. Trace:
W20260709 13:01:11.091080  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 92745.1us
W20260709 13:01:11.137023  1497 connection.cc:256] RPC call timeout handler was delayed by -1.5389070999999603s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16890000000000002s for a response
W20260709 13:01:11.138597  1497 connection.cc:256] RPC call timeout handler was delayed by -1.5218070999999895s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1708s for a response
I20260709 13:01:11.130894  6775 consensus_queue.cc:1059] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.008s
I20260709 13:01:11.131639  6622 raft_consensus.cc:740] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:11.140026  6622 consensus_queue.cc:260] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:11.094920  6871 raft_consensus.cc:493] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:11.141258  6622 raft_consensus.cc:3060] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:11.141772  6747 raft_consensus.cc:2749] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:01:11.091964  6864 log.cc:927] Time spent T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
W20260709 13:01:11.139014  1497 connection.cc:256] RPC call timeout handler was delayed by -1.4585506219999615s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16770000000000002s for a response
I20260709 13:01:11.109521  6855 leader_election.cc:290] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:11.118528  6592 raft_consensus.cc:2804] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:11.081229  6324 raft_consensus.cc:2749] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:11.052700  6690 raft_consensus.cc:2749] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:01:11.085744  6873 raft_consensus.cc:740] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:11.130872  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:11.078558  6596 raft_consensus.cc:515] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:11.144672  6873 consensus_queue.cc:260] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:11.106007  6630 consensus_queue.cc:237] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:11.145972  6873 raft_consensus.cc:3060] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:11.148330  6672 leader_election.cc:290] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:11.149276  6690 raft_consensus.cc:493] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:11.149873  6690 raft_consensus.cc:515] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:11.141057  6871 raft_consensus.cc:515] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:11.106946  6870 consensus_queue.cc:260] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:11.131011  6869 raft_consensus.cc:515] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:11.113602  2190 leader_election.cc:304] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:11.143739  6592 raft_consensus.cc:697] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 16 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
W20260709 13:01:11.152421  1497 connection.cc:256] RPC call timeout handler was delayed by -1.3292070999999623s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1922s for a response
W20260709 13:01:11.160295  1497 connection.cc:256] RPC call timeout handler was delayed by -1.2938506219999795s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18600000000000003s for a response
W20260709 13:01:11.160696  1497 connection.cc:256] RPC call timeout handler was delayed by -1.2437070999999946s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2017s for a response
W20260709 13:01:11.161136  1497 connection.cc:256] RPC call timeout handler was delayed by -1.1726070999999934s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2096s for a response
W20260709 13:01:11.161409  1497 connection.cc:256] RPC call timeout handler was delayed by -1.1411070999999993s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21309999999999998s for a response
W20260709 13:01:11.160352  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 46849us
I20260709 13:01:11.133502  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:11.140172  6877 consensus_queue.cc:1059] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:11.141108  6854 raft_consensus.cc:3055] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:01:11.156919  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.171722  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
W20260709 13:01:11.161684  1497 connection.cc:256] RPC call timeout handler was delayed by -1.0085506219999729s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2177s for a response
I20260709 13:01:11.161620  2223 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703"
dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
mode: GRACEFUL
new_leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:47682
I20260709 13:01:11.137270  1530 rpcz_store.cc:276] 0709 13:01:09.597874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:09.599239 (+  1365us) service_pool.cc:224] Handling call
0709 13:01:09.614702 (+ 15463us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:09.644255 (+ 29553us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:09.644284 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:09.644834 (+   550us) log.cc:844] Serialized 52 byte log entry
0709 13:01:09.978120 (+333286us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:09.978168 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:09.978246 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:11.054323 (+1076077us) spinlock_profiling.cc:243] Waited 22.6 ms on lock 0x7b24001458c8. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a1534c9c4 00007f6a1534aacb 00007f6a15505dc9 00007f6a15505a55 00007f6a1550509d 00007f6a1813710e 00007f6a1814e88c 00007f6a1814dbb6 00007f6a1814d7d8 00007f6a18157221
0709 13:01:11.136521 (+ 82198us) raft_consensus.cc:1685] finished
0709 13:01:11.136543 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:11.136791 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17052,"raft.queue_time_us":18245,"raft.run_cpu_time_us":71,"raft.run_wall_time_us":72,"spinlock_wait_cycles":52067072,"thread_start_us":332864,"threads_started":1,"wal-append.queue_time_us":447188}
I20260709 13:01:11.172307  1602 raft_consensus.cc:3060] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:11.163841  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:11.164180  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:11.172852  2220 raft_consensus.cc:2468] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 16.
I20260709 13:01:11.172958  1673 raft_consensus.cc:2468] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 8.
I20260709 13:01:11.166571  2190 leader_election.cc:304] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:11.154731  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:11.174206  1675 raft_consensus.cc:2468] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 10.
I20260709 13:01:11.175650  1526 raft_consensus.cc:2468] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 15.
I20260709 13:01:11.150424  6861 leader_election.cc:290] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:11.134570  6878 raft_consensus.cc:2749] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:11.181314  1497 leader_election.cc:304] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
W20260709 13:01:11.178572  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 55260us
I20260709 13:01:11.186607  1572 leader_election.cc:304] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
W20260709 13:01:11.186957  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 60338.3us
W20260709 13:01:11.188532  1571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:11.189215  1571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:11.189599  1571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.194087  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:11.196576  2226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50326 (request call id 1097) took 1827 ms. Trace:
I20260709 13:01:11.197057  2226 rpcz_store.cc:276] 0709 13:01:09.376023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:09.385318 (+  9295us) service_pool.cc:224] Handling call
0709 13:01:09.419983 (+ 34665us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:09.523502 (+103519us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:09.523543 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:09.560423 (+ 36880us) log.cc:844] Serialized 26 byte log entry
0709 13:01:10.087584 (+527161us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:10.087626 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:10.087697 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:11.195581 (+1107884us) spinlock_profiling.cc:243] Waited 7.49 ms on lock 0x7b24002fd368. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a1534c9c4 00007f6a1534aacb 00007f6a15505dc9 00007f6a15505a55 00007f6a15504fb0 00007f6a1817b488 00007f6a1817bbe8 00007f6a18153398 00007f6a1814e76a 00007f6a1814dbb6
0709 13:01:11.196250 (+   669us) raft_consensus.cc:1685] finished
0709 13:01:11.196272 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:11.196484 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":55540,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":10813,"spinlock_wait_cycles":17217920,"thread_start_us":484736,"threads_started":1,"wal-append.queue_time_us":502010}
I20260709 13:01:11.180302  6855 consensus_queue.cc:1059] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.019s
I20260709 13:01:11.199077  6592 consensus_queue.cc:237] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:11.199875  6775 raft_consensus.cc:3055] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:11.200197  6886 raft_consensus.cc:493] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.200263  6775 raft_consensus.cc:740] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:11.200860  6886 raft_consensus.cc:515] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:11.201366  6775 consensus_queue.cc:260] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:11.202760  6596 leader_election.cc:290] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:11.203181  6886 leader_election.cc:290] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:11.204090  6750 raft_consensus.cc:697] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 16 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:11.202600  6775 raft_consensus.cc:3060] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:11.205086  6750 consensus_queue.cc:237] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:11.210979  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:11.213878  2192 leader_election.cc:304] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:11.173550  6872 raft_consensus.cc:2749] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:11.216023  1646 leader_election.cc:304] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:11.170037  6854 raft_consensus.cc:740] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:11.219501  1525 raft_consensus.cc:2468] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 15.
I20260709 13:01:11.229064  1602 raft_consensus.cc:2468] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 11.
I20260709 13:01:11.233762  6686 raft_consensus.cc:2749] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:01:11.234620  6686 raft_consensus.cc:3060] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:11.236011  6869 leader_election.cc:290] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:11.203435  6596 raft_consensus.cc:2804] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:01:11.238137  6782 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.755s	user 0.001s	sys 0.022s
W20260709 13:01:11.240324  6782 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.758s	user 0.001s	sys 0.022s
W20260709 13:01:11.241420  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 60183.6us
I20260709 13:01:11.244349  1497 leader_election.cc:304] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:11.245124  6886 raft_consensus.cc:2749] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:01:11.246376  1497 leader_election.cc:304] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:11.213340  6877 raft_consensus.cc:2804] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:11.248054  1497 leader_election.cc:304] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:11.223989  6635 raft_consensus.cc:493] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:11.261219  6845 raft_consensus.cc:493] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.266150  6686 raft_consensus.cc:2749] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:01:11.271122  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 104634us
I20260709 13:01:11.246819  6596 raft_consensus.cc:493] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:11.275583  2190 leader_election.cc:304] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:01:11.271160  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 57384.6us
I20260709 13:01:11.253412  6886 raft_consensus.cc:2749] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:11.273432  6890 raft_consensus.cc:2804] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:11.273160  6635 raft_consensus.cc:515] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:11.251173  6877 raft_consensus.cc:493] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:11.256731  6869 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:11.280448  2192 leader_election.cc:304] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:11.282565  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 13:01:11.278245  6697 consensus_meta.cc:287] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.956s	user 0.005s	sys 0.008s
W20260709 13:01:11.288967  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.277886  6596 raft_consensus.cc:3060] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:11.315408  6884 raft_consensus.cc:2804] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:11.317703  6749 raft_consensus.cc:493] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.318244  1497 leader_election.cc:304] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:11.281195  6890 raft_consensus.cc:493] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:11.328534  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:11.336575  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 61101.2us
W20260709 13:01:11.336898  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 56573.4us
I20260709 13:01:11.279899  6626 leader_election.cc:290] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:11.338768  6672 raft_consensus.cc:2749] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:11.283788  6690 leader_election.cc:290] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:11.285681  6877 raft_consensus.cc:3060] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:11.276034  6845 raft_consensus.cc:515] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:11.350682  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:11.322796  6697 raft_consensus.cc:2749] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:11.352994  1525 raft_consensus.cc:2468] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 10.
I20260709 13:01:11.344259  6872 raft_consensus.cc:2749] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:11.345968  6886 raft_consensus.cc:3060] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:11.370744  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:11.345005  6890 raft_consensus.cc:3060] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:11.346557  6884 raft_consensus.cc:697] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 15 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
W20260709 13:01:11.379556  6879 log.cc:927] Time spent T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 13:01:11.380300  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:11.370803  6672 raft_consensus.cc:493] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.383755  6635 leader_election.cc:290] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:11.396140  6845 leader_election.cc:290] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:11.286880  6854 consensus_queue.cc:260] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:11.396979  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:11.489166  6854 raft_consensus.cc:3060] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:11.345192  6749 raft_consensus.cc:515] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:11.414570  1527 raft_consensus.cc:2468] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 18.
W20260709 13:01:11.420665  1495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.328274  6869 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:11.489053  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 109710us
I20260709 13:01:11.426543  6672 raft_consensus.cc:515] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:11.431234  6858 log.cc:927] Time spent T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.955s	user 0.006s	sys 0.000s
I20260709 13:01:11.486924  2227 raft_consensus.cc:2468] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 10.
W20260709 13:01:11.398743  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 80607.3us
I20260709 13:01:11.509122  1497 leader_election.cc:304] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:11.407438  6884 consensus_queue.cc:237] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:11.508570  2223 raft_consensus.cc:606] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Received request to transfer leadership to TS e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:11.510717  2223 raft_consensus.cc:614] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:11.511359  6749 leader_election.cc:290] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:11.494187  2192 leader_election.cc:304] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:11.492170  6613 raft_consensus.cc:493] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.507113  6672 leader_election.cc:290] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:11.547219  6596 raft_consensus.cc:515] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:11.547580  6672 raft_consensus.cc:2749] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:11.547580  6613 raft_consensus.cc:515] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:11.548640  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 54516.5us
I20260709 13:01:11.550036  6613 leader_election.cc:290] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:11.550762  2192 leader_election.cc:304] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:11.551637  6672 raft_consensus.cc:2804] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:11.555335  6845 consensus_queue.cc:1048] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:11.555547  6672 raft_consensus.cc:697] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 12 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:11.557118  6672 consensus_queue.cc:237] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:11.577821  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.560485  6613 raft_consensus.cc:2749] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:11.554327  6877 raft_consensus.cc:515] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:11.596071  1571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.599444  1601 raft_consensus.cc:1240] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:11.592182  6596 leader_election.cc:290] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:11.604985  6788 raft_consensus.cc:3055] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:01:11.605461  6788 raft_consensus.cc:740] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:11.602097  6592 raft_consensus.cc:493] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:11.607787  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 98784.9us
W20260709 13:01:11.611189  1571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.612010  6888 raft_consensus.cc:493] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:11.615816  6888 raft_consensus.cc:515] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:11.617988  6888 leader_election.cc:290] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:11.607568  6592 raft_consensus.cc:515] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:11.623080  1497 leader_election.cc:304] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:11.606475  6788 consensus_queue.cc:260] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:11.633452  6592 leader_election.cc:290] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:11.636252  6788 raft_consensus.cc:3060] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:11.649148  2223 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004"
dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
mode: GRACEFUL
new_leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:47682
I20260709 13:01:11.650053  2223 raft_consensus.cc:606] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 11 LEADER]: Received request to transfer leadership to TS e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:11.653328  6898 raft_consensus.cc:2804] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:11.655004  6898 raft_consensus.cc:493] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:11.655428  6898 raft_consensus.cc:3060] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:11.662232  6658 raft_consensus.cc:3055] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:11.663477  6658 raft_consensus.cc:740] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:11.664307  6658 consensus_queue.cc:260] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:11.665340  6658 raft_consensus.cc:3060] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:11.665694  6833 raft_consensus.cc:493] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:11.669149  2223 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24"
dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
mode: GRACEFUL
new_leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:47682
I20260709 13:01:11.671190  2223 raft_consensus.cc:606] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Received request to transfer leadership to TS e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:11.671576  2223 raft_consensus.cc:614] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:11.679023   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:01:11.666221  6833 raft_consensus.cc:515] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:11.681259  6833 leader_election.cc:290] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:01:11.686249  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.686088  2191 leader_election.cc:304] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:01:11.687109  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.687492  2191 leader_election.cc:304] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:11.688771  1680 raft_consensus.cc:1275] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:01:11.690336   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:11.677598  1646 leader_election.cc:304] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:11.689291  6554 raft_consensus.cc:3055] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:11.693922  6554 raft_consensus.cc:740] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:11.694440  6707 raft_consensus.cc:2804] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:11.694783  6554 consensus_queue.cc:260] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:11.696076  6554 raft_consensus.cc:3060] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:11.660585  6869 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:01:11.699604  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 89459.6us
I20260709 13:01:11.692976  6334 raft_consensus.cc:2804] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:11.701751  6334 raft_consensus.cc:493] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:11.702121  6334 raft_consensus.cc:3060] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:11.703233  6865 log.cc:927] Time spent T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 1.201s	user 0.006s	sys 0.008s
I20260709 13:01:11.701015  6876 raft_consensus.cc:493] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:11.706030  6876 raft_consensus.cc:515] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:11.708148  6876 leader_election.cc:290] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:11.709318  1497 leader_election.cc:304] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:11.700084  6707 raft_consensus.cc:697] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 11 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:11.710839  1497 leader_election.cc:304] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:11.711704  6777 raft_consensus.cc:2749] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:11.692839  6873 raft_consensus.cc:2804] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:11.712445  6873 raft_consensus.cc:493] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:11.712873  6873 raft_consensus.cc:3060] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:11.713768  1497 leader_election.cc:304] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:11.714265  6871 leader_election.cc:290] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:11.711287  6833 raft_consensus.cc:2749] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:11.717149  1497 leader_election.cc:400] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303) with higher term. Message: Invalid argument: T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 12. Current term is 13.
W20260709 13:01:11.718276  6849 log.cc:927] Time spent T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 1.248s	user 0.004s	sys 0.011s
I20260709 13:01:11.715967  6777 raft_consensus.cc:2749] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:11.724804  6890 raft_consensus.cc:515] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:11.726686  1497 leader_election.cc:403] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:11.727537  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:11.728021  1497 leader_election.cc:304] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:11.711133  6707 consensus_queue.cc:237] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:01:11.733011  1571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.735021  6324 raft_consensus.cc:493] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:11.735692  6324 raft_consensus.cc:515] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:11.737584  6596 raft_consensus.cc:2749] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303) with higher term. Message: Invalid argument: T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 12. Current term is 13.
I20260709 13:01:11.738364  6596 raft_consensus.cc:2804] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:11.738782  6596 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:11.739137  6596 raft_consensus.cc:3060] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:11.739691  1497 leader_election.cc:304] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:11.740474  6613 consensus_queue.cc:1059] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:11.741252  6613 raft_consensus.cc:2749] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:11.741863  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:11.742738  1497 leader_election.cc:304] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:11.743141  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:11.743698  1530 raft_consensus.cc:2468] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 16.
I20260709 13:01:11.745677  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:11.746289  1529 raft_consensus.cc:2468] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 9.
W20260709 13:01:11.749290  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.739125  6324 leader_election.cc:290] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:11.750741  6901 raft_consensus.cc:2749] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:11.751034  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:11.751673  1681 raft_consensus.cc:2468] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 12.
I20260709 13:01:11.752183  1497 leader_election.cc:304] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:11.752998  6901 raft_consensus.cc:2749] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:11.753099  6554 raft_consensus.cc:493] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.753715  6554 raft_consensus.cc:515] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:11.755437  1497 leader_election.cc:304] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:11.756263  6630 raft_consensus.cc:493] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.756489  6901 raft_consensus.cc:2749] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:11.756875  6630 raft_consensus.cc:515] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:11.741887  6613 raft_consensus.cc:3055] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:11.759976  6613 raft_consensus.cc:740] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:11.753741  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:11.761191  1673 raft_consensus.cc:2468] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 15.
I20260709 13:01:11.762722  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:11.768334  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:11.769285  2227 raft_consensus.cc:1240] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:11.770490  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
W20260709 13:01:11.775576  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:11.776310  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.777573  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:11.779686  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:11.780296  1602 raft_consensus.cc:3060] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:11.784374  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:11.785189  1681 raft_consensus.cc:2468] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 16.
I20260709 13:01:11.785411  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:11.788890  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:11.790794  1681 raft_consensus.cc:2468] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 12.
I20260709 13:01:11.790884  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:11.791805  1673 raft_consensus.cc:1275] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:01:11.789745  1646 leader_election.cc:304] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:11.792138  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:11.793701  1600 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 15.
I20260709 13:01:11.797688  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:11.798955  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:11.802305  2190 leader_election.cc:304] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:11.807786  1525 raft_consensus.cc:1240] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 17. Current term is 18. Ops: []
I20260709 13:01:11.692770  6760 consensus_queue.cc:1048] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.100s
I20260709 13:01:11.805294  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:11.805310  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:11.814179  2224 raft_consensus.cc:3060] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:11.699396  6877 leader_election.cc:290] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:11.808036  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:11.807845  2223 raft_consensus.cc:1240] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 14 LEADER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:01:11.821195  2190 leader_election.cc:304] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:11.756014  6554 leader_election.cc:290] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:11.812394  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:11.812947  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:11.809768  1646 leader_election.cc:304] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:11.760442  6630 leader_election.cc:290] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:11.824288  1527 raft_consensus.cc:2368] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 11. Current term is 12.
I20260709 13:01:11.816149  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:11.825240  1526 raft_consensus.cc:2468] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 7.
I20260709 13:01:11.822888  1681 raft_consensus.cc:2468] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 9.
I20260709 13:01:11.826849  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:11.838268  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:11.838598  5747 consensus_queue.cc:1059] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:11.839049  1681 raft_consensus.cc:2468] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 10.
I20260709 13:01:11.839425  5747 consensus_queue.cc:1243] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer b96ce9cc496c49d7818fa983a17b062b log is divergent from this leader: its last log entry 14.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:01:11.799644  6886 raft_consensus.cc:2749] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:11.827580  1673 raft_consensus.cc:2468] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 12.
I20260709 13:01:11.841244  1524 raft_consensus.cc:1217] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Deduplicated request from leader. Original: 10.9->[12.10-12.10]   Dedup: 12.10->[]
I20260709 13:01:11.843796  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:11.804852  6324 raft_consensus.cc:2749] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:11.851009  1600 raft_consensus.cc:2468] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 8.
I20260709 13:01:11.846889  1524 raft_consensus.cc:1240] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:01:11.855302  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:11.850474  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:11.792176  6777 consensus_queue.cc:1048] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:01:11.860590  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:11.861284  1600 raft_consensus.cc:2468] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 7.
I20260709 13:01:11.862977  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:11.864791  2224 raft_consensus.cc:2468] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 17.
I20260709 13:01:11.857992  1646 leader_election.cc:304] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:11.869238  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:11.841310  6871 raft_consensus.cc:2804] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:11.872634  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:11.876199  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:11.877740  6857 raft_consensus.cc:493] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.881800  6870 raft_consensus.cc:3060] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:11.887009  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:11.891556  6613 consensus_queue.cc:260] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:11.895803  6898 raft_consensus.cc:515] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:11.895808  2223 raft_consensus.cc:1275] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:01:11.897941  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:11.854821  6622 raft_consensus.cc:2804] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:11.901778  2191 leader_election.cc:304] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:11.929535  2191 leader_election.cc:304] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:11.858114  6564 raft_consensus.cc:2804] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:11.904906  1672 raft_consensus.cc:1240] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 15 LEADER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:11.919649  6871 raft_consensus.cc:493] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:11.910359  6702 raft_consensus.cc:3055] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:11.916031  1532 raft_consensus.cc:1240] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 LEADER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:11.917183  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:11.938086  1679 raft_consensus.cc:2468] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 7.
I20260709 13:01:11.912259  1602 raft_consensus.cc:2468] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 11.
I20260709 13:01:11.918957  2221 raft_consensus.cc:1240] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 16. Current term is 17. Ops: []
W20260709 13:01:11.918792  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 60905.8us
I20260709 13:01:11.938926  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
W20260709 13:01:11.907054  6864 log.cc:927] Time spent T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:01:11.940764  1646 leader_election.cc:304] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:11.943581  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:11.908279  6596 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:11.930089  1572 leader_election.cc:304] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:01:11.947158  1646 leader_election.cc:304] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:11.948276  1677 raft_consensus.cc:1275] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:01:11.934789  6622 raft_consensus.cc:697] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 10 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:11.936944  6672 raft_consensus.cc:2804] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:11.932727  2191 leader_election.cc:304] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:11.937599  6868 raft_consensus.cc:2804] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:11.966997  6868 raft_consensus.cc:493] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:11.967541  6868 raft_consensus.cc:3060] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:11.968750  6859 raft_consensus.cc:2804] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:11.969339  6859 raft_consensus.cc:697] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 11 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:11.970302  6859 consensus_queue.cc:237] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:11.936111  6564 raft_consensus.cc:493] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:11.971434  6564 raft_consensus.cc:3060] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:11.938220  6871 raft_consensus.cc:3060] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:12.019043  2219 raft_consensus.cc:1275] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:01:12.020383  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:12.021610  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:11.955008  1600 raft_consensus.cc:1240] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 11. Current term is 12. Ops: [11.12-11.12]
I20260709 13:01:12.022526  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:11.953804  6672 raft_consensus.cc:493] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:12.023650  6672 raft_consensus.cc:3060] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:11.958869  6830 consensus_queue.cc:1059] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:01:11.956542  6788 raft_consensus.cc:2804] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:12.024302  6830 consensus_queue.cc:1243] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer ddf11fc190dd4b898773379c6b129d90 log is divergent from this leader: its last log entry 15.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:01:12.023365  2226 raft_consensus.cc:2393] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 17: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:01:11.922847  6873 raft_consensus.cc:515] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:12.026257  6788 raft_consensus.cc:493] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:11.924237  6857 raft_consensus.cc:515] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:11.951134  6324 raft_consensus.cc:2804] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:12.026738  6788 raft_consensus.cc:3060] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:12.027007  6324 raft_consensus.cc:493] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:12.027419  6324 raft_consensus.cc:3060] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:11.964196  6898 leader_election.cc:290] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:11.954630  6877 raft_consensus.cc:2804] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:01:11.995173  1571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.999182  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:12.030831  6877 raft_consensus.cc:697] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 17 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:12.031832  6877 consensus_queue.cc:237] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:11.979946  6870 raft_consensus.cc:493] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.035027  6870 raft_consensus.cc:515] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:12.037143  6870 leader_election.cc:290] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:12.038204  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:12.038906  1600 raft_consensus.cc:2468] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 14.
I20260709 13:01:12.039927  1646 leader_election.cc:304] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:12.040916  6870 raft_consensus.cc:2804] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:12.041343  6870 raft_consensus.cc:493] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:12.041745  6870 raft_consensus.cc:3060] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:12.026759  6873 leader_election.cc:290] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:12.002570  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:11.953478  6778 consensus_queue.cc:1048] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.058s
I20260709 13:01:12.045454  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:12.013537  6596 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:12.014364  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:12.046729  1529 raft_consensus.cc:2368] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 12. Current term is 13.
I20260709 13:01:12.047919  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:12.048553  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:12.049389  1528 raft_consensus.cc:1240] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:01:12.049872  1529 raft_consensus.cc:1240] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 LEADER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:12.017823  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:12.050537  6870 raft_consensus.cc:515] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:12.051038  2223 raft_consensus.cc:2468] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 9.
I20260709 13:01:12.023202  6622 consensus_queue.cc:237] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:11.937446  6702 raft_consensus.cc:740] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:12.052652  6702 consensus_queue.cc:260] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:12.053951  6702 raft_consensus.cc:3060] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:01:12.054319  6885 log.cc:927] Time spent T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.831s	user 0.006s	sys 0.014s
I20260709 13:01:12.024827  6830 raft_consensus.cc:3055] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:12.005767  1644 leader_election.cc:304] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:01:12.055449  1528 raft_consensus.cc:1240] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 11. Current term is 12. Ops: [9.7-11.8]
I20260709 13:01:11.975122  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 13:01:12.059285  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 53628.6us
I20260709 13:01:12.059341  1529 raft_consensus.cc:1240] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:01:12.060858  1644 leader_election.cc:304] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:01:12.065987  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:12.066636  1600 raft_consensus.cc:3060] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:01:12.068437  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.069877  1526 raft_consensus.cc:2468] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 14.
I20260709 13:01:12.071309  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:12.073273  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:12.074483  1679 raft_consensus.cc:2393] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 9: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:01:12.057984  6830 raft_consensus.cc:740] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:12.073035  6554 raft_consensus.cc:2804] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:12.075532  6554 raft_consensus.cc:493] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:12.064410  6870 leader_election.cc:290] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:12.075989  1532 raft_consensus.cc:1275] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:01:12.075803  6830 consensus_queue.cc:260] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:12.075937  6554 raft_consensus.cc:3060] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:12.077062  6830 raft_consensus.cc:3060] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:12.078130  6857 leader_election.cc:290] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:12.042550  6324 raft_consensus.cc:515] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:12.080585  6324 leader_election.cc:290] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:12.081676  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:12.082307  1602 raft_consensus.cc:3060] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:12.082800  6334 raft_consensus.cc:515] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:12.085641  6334 leader_election.cc:290] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:12.074249  6672 raft_consensus.cc:515] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:12.087538  1528 raft_consensus.cc:1240] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:12.089432  6672 leader_election.cc:290] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 13 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:12.089164  6554 raft_consensus.cc:515] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:12.095304  1602 raft_consensus.cc:2468] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 9.
I20260709 13:01:12.096400  1646 leader_election.cc:304] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:12.099051  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:12.099735  1679 raft_consensus.cc:2468] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 17.
W20260709 13:01:12.101432  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.105156  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:12.105967  1679 raft_consensus.cc:2468] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 18.
I20260709 13:01:12.101248  1571 leader_election.cc:304] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:12.108171  5747 raft_consensus.cc:2804] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:12.108572  5747 raft_consensus.cc:493] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:12.108862  5747 raft_consensus.cc:3060] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:12.112071  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:12.072180  6707 raft_consensus.cc:2804] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:12.116868  6630 raft_consensus.cc:493] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.117049  6707 raft_consensus.cc:493] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:12.117936  6878 raft_consensus.cc:493] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.118479  6878 raft_consensus.cc:515] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:12.119603  6554 leader_election.cc:290] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:12.120723  6878 leader_election.cc:290] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:12.116532  1644 leader_election.cc:304] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:12.122596  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:12.123461  2222 raft_consensus.cc:2410] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for term 18 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 13:01:12.123597  1644 leader_election.cc:304] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:01:12.124177  6870 raft_consensus.cc:2749] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:12.124720  1644 leader_election.cc:304] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:01:12.125535  6869 raft_consensus.cc:2804] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:01:12.117460  6630 raft_consensus.cc:515] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:12.124852  6870 raft_consensus.cc:2804] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:12.127518  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:12.125578  1571 leader_election.cc:304] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:12.120612  6613 raft_consensus.cc:3060] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:12.137506  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:12.138211  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:12.137241  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:12.141211  1571 leader_election.cc:304] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:12.117492  6707 raft_consensus.cc:3060] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:12.119012  6324 raft_consensus.cc:2804] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:12.156040  1497 leader_election.cc:304] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:12.159032  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:12.161794  1497 leader_election.cc:304] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
W20260709 13:01:12.165382  1571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.168017  6564 raft_consensus.cc:515] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:12.170101  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:12.170799  1525 raft_consensus.cc:3060] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:12.171020  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:12.172196  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:12.173285  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:12.173794  1529 raft_consensus.cc:2468] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 15.
I20260709 13:01:12.175140  2225 raft_consensus.cc:2368] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 9. Current term is 10.
I20260709 13:01:12.175631  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:12.176713  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:12.177817  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 13:01:12.178387  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:12.179066  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.179651  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:12.180464  1531 raft_consensus.cc:2393] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 15: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:01:12.181201  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:12.181706  1531 raft_consensus.cc:2376] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 16. Re-sending same reply.
I20260709 13:01:12.170475  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:12.184571  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:12.182447  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
W20260709 13:01:12.187505  1571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.178332  1532 raft_consensus.cc:2468] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 7.
I20260709 13:01:12.174554  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:12.074294  6788 raft_consensus.cc:515] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:12.212503  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:12.170413  6564 leader_election.cc:290] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 10 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:12.213387  1532 raft_consensus.cc:2468] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 12.
I20260709 13:01:12.187645  1531 raft_consensus.cc:2376] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 12. Re-sending same reply.
I20260709 13:01:12.196188  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:12.219427  1680 raft_consensus.cc:1240] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 11 LEADER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:12.219857  1526 raft_consensus.cc:2376] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 15. Re-sending same reply.
I20260709 13:01:12.189927  5747 raft_consensus.cc:515] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:12.186044  6777 raft_consensus.cc:2749] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:12.214247  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:12.216416  1525 raft_consensus.cc:2468] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 15.
I20260709 13:01:12.189971  1497 leader_election.cc:400] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 election: Vote denied by peer b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373) with higher term. Message: Invalid argument: T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 9. Current term is 10.
I20260709 13:01:12.226181  1497 leader_election.cc:403] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:01:12.152127  6658 raft_consensus.cc:2804] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:12.137055  6554 consensus_queue.cc:1059] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.074s
I20260709 13:01:12.157511  6877 raft_consensus.cc:2804] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:01:12.235992  6630 leader_election.cc:290] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:01:12.239387  6908 log.cc:927] Time spent T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:01:12.247035  6868 raft_consensus.cc:515] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:12.252182  6886 raft_consensus.cc:3060] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:12.284931  6868 leader_election.cc:290] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 16 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:12.287276  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:12.252383  6871 raft_consensus.cc:515] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:12.293660  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:12.294057  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:12.294277  1680 raft_consensus.cc:3060] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:12.294622  1675 raft_consensus.cc:3060] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:12.297842  1672 raft_consensus.cc:1275] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:01:12.229206  6658 raft_consensus.cc:493] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:12.299420  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:12.263938  1600 raft_consensus.cc:2468] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 15.
I20260709 13:01:12.185119  6876 raft_consensus.cc:2749] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:01:12.264739  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.269784  1530 raft_consensus.cc:2410] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:01:12.270864  6854 raft_consensus.cc:3055] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:01:12.272221  6788 leader_election.cc:290] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:12.217340  6901 raft_consensus.cc:2804] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:12.273242  6554 raft_consensus.cc:493] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.273648  6702 raft_consensus.cc:493] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.274847  6898 consensus_queue.cc:1048] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:12.278316  5747 leader_election.cc:290] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:12.279048  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:12.307258  6658 raft_consensus.cc:3060] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:12.305371  1644 leader_election.cc:304] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:12.308631  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:12.190585  6596 consensus_queue.cc:1048] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.100s
I20260709 13:01:12.262288  6877 raft_consensus.cc:493] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:12.326588  6782 consensus_queue.cc:1048] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:01:12.330416  1679 raft_consensus.cc:1275] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:01:12.331847  1681 raft_consensus.cc:1275] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:01:12.332510  1675 raft_consensus.cc:2468] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 13.
W20260709 13:01:12.332947  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 209852us
I20260709 13:01:12.307123  6870 raft_consensus.cc:697] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 15 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:12.367192  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:12.312697  6854 raft_consensus.cc:740] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:12.317405  6901 raft_consensus.cc:493] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:12.367007  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:12.375696  1678 raft_consensus.cc:2410] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for term 18 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 13:01:12.366269  5747 raft_consensus.cc:493] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:12.376176  5747 raft_consensus.cc:515] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:01:12.371611  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 66348us
I20260709 13:01:12.373386  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:12.307044  6564 consensus_queue.cc:1059] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:01:12.377477  1675 raft_consensus.cc:3060] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:12.378208  1644 leader_election.cc:304] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:12.380964  1672 raft_consensus.cc:2468] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 16.
I20260709 13:01:12.326431  6630 raft_consensus.cc:493] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.386209  5747 leader_election.cc:290] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:12.387229  6630 raft_consensus.cc:515] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:01:12.388273  6909 log.cc:927] Time spent T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:01:12.389483  6630 leader_election.cc:290] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:12.390049  6630 raft_consensus.cc:2749] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:01:12.391718  1644 leader_election.cc:304] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:12.392832  1644 leader_election.cc:304] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:12.387094  6707 raft_consensus.cc:515] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:12.396642  6707 leader_election.cc:290] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:12.397166  6707 raft_consensus.cc:2749] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:12.397688  1678 raft_consensus.cc:1240] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:12.398047  1674 raft_consensus.cc:1240] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:12.398839  1571 leader_election.cc:304] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:12.397747  6707 raft_consensus.cc:2749] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:12.400067  5747 raft_consensus.cc:2749] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:12.330472  6702 raft_consensus.cc:515] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:12.402182  6702 leader_election.cc:290] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:12.404130  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:12.405926  1644 leader_election.cc:304] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:01:12.408666  1644 leader_election.cc:304] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:12.409847  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:12.413317  1673 raft_consensus.cc:2468] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 12.
I20260709 13:01:12.410599  6854 consensus_queue.cc:260] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:12.414475  6854 raft_consensus.cc:3060] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:12.415541  1571 leader_election.cc:304] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:12.416396  6749 raft_consensus.cc:2804] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:12.416767  6749 raft_consensus.cc:493] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:12.417115  6749 raft_consensus.cc:3060] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:12.417764  6871 leader_election.cc:290] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 17 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:12.422839  6868 raft_consensus.cc:993] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b: : Instructing follower e46412b3b0b44f01ad5c33d4cfe3d6b1 to start an election
I20260709 13:01:12.423319  1644 leader_election.cc:304] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:12.424592  1644 leader_election.cc:304] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:12.424731  6749 raft_consensus.cc:515] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:12.425745  6707 raft_consensus.cc:2749] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:12.426503  6707 raft_consensus.cc:2749] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:12.427131  6749 leader_election.cc:290] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:12.410813  6870 consensus_queue.cc:237] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:12.411563  6564 consensus_queue.cc:1243] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer ddf11fc190dd4b898773379c6b129d90 log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:01:12.338847  6859 raft_consensus.cc:2749] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:12.382491  6901 raft_consensus.cc:3060] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:12.429172  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:12.429826  1678 raft_consensus.cc:3060] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:12.407272  6702 consensus_queue.cc:1059] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:12.427124  6707 raft_consensus.cc:3060] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:12.433058  2191 leader_election.cc:304] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:12.423369  6868 raft_consensus.cc:1081] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 11 LEADER]: Signalling peer e46412b3b0b44f01ad5c33d4cfe3d6b1 to start an election
I20260709 13:01:12.441076  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:12.436508  1644 leader_election.cc:304] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:12.442215  2191 leader_election.cc:304] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:12.446924  6854 raft_consensus.cc:2804] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:12.447432  6854 raft_consensus.cc:493] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:12.442385  6887 raft_consensus.cc:2804] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:12.448330  6887 raft_consensus.cc:697] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 13 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:12.449235  6887 consensus_queue.cc:237] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:12.450598  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.443637  5747 raft_consensus.cc:3055] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:12.451277  5747 raft_consensus.cc:740] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:12.349474  1680 raft_consensus.cc:2468] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 10.
I20260709 13:01:12.456254  2191 leader_election.cc:304] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:12.446745  1644 leader_election.cc:304] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:12.463390  1644 leader_election.cc:304] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:12.466368  1644 leader_election.cc:304] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:12.313866  6778 raft_consensus.cc:493] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.468783  5747 consensus_queue.cc:260] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:12.470042  1644 leader_election.cc:304] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:01:12.447857  6854 raft_consensus.cc:3060] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:12.482203  5747 raft_consensus.cc:3060] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:12.329195  6554 raft_consensus.cc:515] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:12.488749  1644 leader_election.cc:304] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:12.468434  6859 raft_consensus.cc:2749] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:12.478535  6622 raft_consensus.cc:2749] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:01:12.484948  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 209774us
I20260709 13:01:12.493058  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:12.494405  1675 raft_consensus.cc:2468] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 13.
I20260709 13:01:12.495224  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:12.468318  6847 raft_consensus.cc:2804] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:12.478250  6871 raft_consensus.cc:2804] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:12.450331  6658 raft_consensus.cc:515] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:12.502978  1496 leader_election.cc:304] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:12.477383  6877 raft_consensus.cc:3060] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:12.497613  1678 raft_consensus.cc:2468] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 13.
I20260709 13:01:12.511255  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:12.507536  1677 raft_consensus.cc:1275] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:01:12.509205  1527 raft_consensus.cc:1275] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:01:12.503224  1524 raft_consensus.cc:1275] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:01:12.486574  6324 raft_consensus.cc:697] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 9 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:12.504215  1571 leader_election.cc:304] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:12.489149  6886 raft_consensus.cc:2749] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373) with higher term. Message: Invalid argument: T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 9. Current term is 10.
I20260709 13:01:12.490985  6630 raft_consensus.cc:2804] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:01:12.524435  1570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.527639  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:12.528415  1600 raft_consensus.cc:2368] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 12. Current term is 13.
I20260709 13:01:12.528301  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:12.529366  1602 raft_consensus.cc:2393] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 15: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:01:12.484562  6778 raft_consensus.cc:515] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:12.534482  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:12.536778  1600 raft_consensus.cc:2410] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:01:12.534761  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:12.535044  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:12.535348  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:12.498539  6920 raft_consensus.cc:2804] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:12.538269  1604 raft_consensus.cc:2468] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 7.
I20260709 13:01:12.543581  5747 raft_consensus.cc:2804] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:12.544006  1602 raft_consensus.cc:1240] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:12.544098  5747 raft_consensus.cc:697] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 13 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:12.543246  1601 raft_consensus.cc:1275] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:01:12.545138  5747 consensus_queue.cc:237] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:12.559130  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:12.559446  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:12.559705  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:12.559942  1600 raft_consensus.cc:2368] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 12. Current term is 13.
I20260709 13:01:12.560428  1602 raft_consensus.cc:2368] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 13. Current term is 14.
I20260709 13:01:12.560462  1598 raft_consensus.cc:2410] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:01:12.561904  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:12.562204  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:12.497007  6869 raft_consensus.cc:697] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 18 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:12.562520  1598 raft_consensus.cc:2468] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 12.
I20260709 13:01:12.563056  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:12.563748  1601 raft_consensus.cc:2368] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 15. Current term is 16.
W20260709 13:01:12.565598  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.573880  1605 raft_consensus.cc:1275] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 13:01:12.576237  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 87576.3us
W20260709 13:01:12.577430  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.577972  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:12.543215  6922 raft_consensus.cc:2764] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader election decision vote started in defunct term 12: won
I20260709 13:01:12.544875  6847 raft_consensus.cc:697] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 16 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:12.564759  6833 raft_consensus.cc:2804] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:12.557273  6871 raft_consensus.cc:697] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [term 10 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:12.587090  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:12.588500  1602 raft_consensus.cc:2468] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 12.
I20260709 13:01:12.592365  2225 raft_consensus.cc:1240] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 10. Current term is 11. Ops: []
W20260709 13:01:12.594911  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 90775.7us
W20260709 13:01:12.596285  1571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.597078  2218 raft_consensus.cc:1240] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 16. Current term is 17. Ops: []
W20260709 13:01:12.597566  1571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.599179  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:12.599529  1571 leader_election.cc:304] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:12.599901  1598 raft_consensus.cc:2468] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 9.
I20260709 13:01:12.600421  1673 raft_consensus.cc:1240] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 11 LEADER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:12.601289  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:12.601924  1600 raft_consensus.cc:2468] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 10.
I20260709 13:01:12.602319  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:12.584107  6833 raft_consensus.cc:493] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:12.584764  6926 raft_consensus.cc:2804] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:12.609622  1646 leader_election.cc:304] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:12.605628  1602 raft_consensus.cc:1275] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:01:12.611833  1598 raft_consensus.cc:1275] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:01:12.614403  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:12.620313  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:01:12.625986  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.674908  1644 leader_election.cc:304] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:12.600905  6707 raft_consensus.cc:2749] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:01:12.672660  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 169747us
W20260709 13:01:12.674467  1497 leader_election.cc:336] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Timed out: RequestConsensusVote RPC to 127.0.107.194:40303 timed out after 1.714s (SENT)
I20260709 13:01:12.595283  6868 raft_consensus.cc:493] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:12.674947  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:12.613932  6833 raft_consensus.cc:3060] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:12.615837  6749 raft_consensus.cc:2804] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:12.687362  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:12.687933  1606 raft_consensus.cc:3060] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:12.682184  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:12.689366  1602 raft_consensus.cc:3060] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:12.692664  6749 raft_consensus.cc:697] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 13 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:12.693574  6749 consensus_queue.cc:237] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:12.694495  1606 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 16.
I20260709 13:01:12.695263  1599 raft_consensus.cc:1240] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:12.697539  1602 raft_consensus.cc:2468] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 10.
I20260709 13:01:12.683995  1497 leader_election.cc:304] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:12.684149  1600 raft_consensus.cc:3060] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:12.684813  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.682124  6871 consensus_queue.cc:237] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:12.685236  6928 log.cc:927] Time spent T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:01:12.685896  6925 raft_consensus.cc:493] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.719905  1604 raft_consensus.cc:2410] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:01:12.607064  6777 consensus_queue.cc:1059] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.074s
W20260709 13:01:12.744879  1570 connection.cc:256] RPC call timeout handler was delayed by -1.6362607689999891s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20030000000000003s for a response
I20260709 13:01:12.599588  6324 consensus_queue.cc:237] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:01:12.755508  1570 connection.cc:256] RPC call timeout handler was delayed by -1.5930607690000329s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20510000000000003s for a response
I20260709 13:01:12.680868  6929 raft_consensus.cc:2804] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:12.673659  6564 consensus_queue.cc:1059] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
W20260709 13:01:12.764315  1570 connection.cc:256] RPC call timeout handler was delayed by -1.5921607690000315s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20520000000000002s for a response
I20260709 13:01:12.765146  2221 raft_consensus.cc:1275] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260709 13:01:12.767467  1570 connection.cc:256] RPC call timeout handler was delayed by -1.5597607689999791s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2088s for a response
W20260709 13:01:12.768210  1570 connection.cc:256] RPC call timeout handler was delayed by -1.5453607690000126s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21040000000000003s for a response
I20260709 13:01:12.720301  6846 raft_consensus.cc:493] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.769055  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:12.722442  6868 raft_consensus.cc:515] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:12.811654  6868 leader_election.cc:290] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:12.758773  6898 consensus_queue.cc:1048] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 13:01:12.807236  6890 leader_election.cc:290] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:12.813773  6846 raft_consensus.cc:515] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:12.769519  6929 raft_consensus.cc:493] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:12.815515  6929 raft_consensus.cc:3060] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:12.815989  6846 leader_election.cc:290] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:12.757699  6778 leader_election.cc:290] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:12.786512  6777 raft_consensus.cc:2749] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:01:12.766181  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 69000.2us
I20260709 13:01:12.765897  6925 raft_consensus.cc:515] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:12.819646  6843 raft_consensus.cc:3055] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:12.820072  6843 raft_consensus.cc:740] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:12.820572  6925 leader_election.cc:290] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:01:12.748790  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 72020.6us
I20260709 13:01:12.821766  1496 leader_election.cc:304] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:12.826238  1600 raft_consensus.cc:2468] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 13.
W20260709 13:01:12.759023  6927 log.cc:927] Time spent T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.156s	user 0.000s	sys 0.001s
I20260709 13:01:12.835532  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:12.842199  1677 raft_consensus.cc:2468] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 12.
W20260709 13:01:12.769053  1570 connection.cc:256] RPC call timeout handler was delayed by -1.4508607690000304s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2209s for a response
I20260709 13:01:12.696230  6847 consensus_queue.cc:237] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:12.757988  6932 log.cc:927] Time spent T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
W20260709 13:01:12.846491  1570 connection.cc:256] RPC call timeout handler was delayed by -1.396860769s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22690000000000002s for a response
I20260709 13:01:12.846647  2191 leader_election.cc:304] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:12.849126  1600 raft_consensus.cc:1275] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:01:12.846081  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:12.858409  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:12.859716  1673 raft_consensus.cc:2468] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 15.
I20260709 13:01:12.856338  1602 raft_consensus.cc:1275] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:01:12.860142  1496 leader_election.cc:304] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:12.760453  6658 leader_election.cc:290] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 16 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:12.863059  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:12.868471  1523 raft_consensus.cc:1240] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:12.680486  6869 consensus_queue.cc:237] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:01:12.865813  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 191323us
I20260709 13:01:12.766754  6926 raft_consensus.cc:697] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 15 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:12.769594  6554 leader_election.cc:290] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:12.722615  6901 raft_consensus.cc:515] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:12.721793  6707 consensus_queue.cc:1048] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.137s
I20260709 13:01:12.805176  6938 raft_consensus.cc:2749] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:01:12.878862  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 243746us
I20260709 13:01:12.889922  2224 raft_consensus.cc:1240] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:12.877269  1525 raft_consensus.cc:1240] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:12.882738  2191 leader_election.cc:304] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:12.891870  2222 raft_consensus.cc:1240] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 10. Current term is 11. Ops: []
W20260709 13:01:12.892715  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.853084  6564 consensus_queue.cc:1243] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer ddf11fc190dd4b898773379c6b129d90 log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:01:12.886765  1530 raft_consensus.cc:1275] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:01:12.814549  6833 raft_consensus.cc:515] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:12.883566  1646 leader_election.cc:304] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:12.875592  6898 raft_consensus.cc:2804] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:12.896064  1644 leader_election.cc:304] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:12.888744  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:12.875528  6613 raft_consensus.cc:2749] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:01:12.896909  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:12.853242  6859 consensus_queue.cc:1048] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.038s
I20260709 13:01:12.885082  6846 raft_consensus.cc:2804] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:12.903293  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:12.902776  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:12.904376  1525 raft_consensus.cc:3060] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:12.905009  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:12.905506  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 13:01:12.905694  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.906558  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:12.881990  6924 consensus_queue.cc:1048] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:01:12.864653  6622 consensus_queue.cc:1059] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.032s
I20260709 13:01:12.910620  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:12.908561  1523 raft_consensus.cc:2393] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 10: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:01:12.911551  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:12.909372  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:12.877277  6777 consensus_queue.cc:1048] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:01:12.906100  1531 raft_consensus.cc:2468] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 12.
I20260709 13:01:12.914784  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:12.915503  1523 raft_consensus.cc:2368] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 14. Current term is 15.
I20260709 13:01:12.912494  1530 raft_consensus.cc:3060] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:12.909891  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:12.912132  1524 raft_consensus.cc:2468] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 14.
I20260709 13:01:12.877146  6923 consensus_queue.cc:1048] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:01:12.913189  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:12.924018  1526 raft_consensus.cc:2468] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 18.
I20260709 13:01:12.913791  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:12.896705  6887 raft_consensus.cc:2804] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:12.916921  1528 raft_consensus.cc:2468] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 15.
I20260709 13:01:12.925472  1525 raft_consensus.cc:2468] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 11.
I20260709 13:01:12.898844  6898 raft_consensus.cc:493] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
W20260709 13:01:12.931605  1571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:12.934870  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.936782  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:12.937654  1675 raft_consensus.cc:2410] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:01:12.939760  5747 consensus_queue.cc:1059] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:12.940573  5747 consensus_queue.cc:1048] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:01:12.928274  1644 leader_election.cc:304] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:12.902844  6939 raft_consensus.cc:2749] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:12.903611  6846 raft_consensus.cc:493] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
W20260709 13:01:12.944736  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 44265.8us
I20260709 13:01:12.953678  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:12.955791  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:12.945959  1571 leader_election.cc:304] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:12.951571  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:12.948942  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:12.960175  1677 raft_consensus.cc:3060] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:12.965027  6596 raft_consensus.cc:493] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.965677  6596 raft_consensus.cc:515] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:12.945305  6898 raft_consensus.cc:3060] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:12.907496  6930 consensus_queue.cc:1048] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.046s
I20260709 13:01:12.928102  6887 raft_consensus.cc:493] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:12.754065   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:01:12.966236  6946 log.cc:927] Time spent T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:01:12.977052  6854 raft_consensus.cc:515] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:12.970860  6749 raft_consensus.cc:2749] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:12.962404  6935 raft_consensus.cc:2749] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:01:12.980170  6854 leader_election.cc:290] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:12.981003  6901 leader_election.cc:290] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:12.982142  6887 raft_consensus.cc:3060] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:12.982951  1674 raft_consensus.cc:1240] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:12.982512  6877 raft_consensus.cc:515] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:13.003494  6877 leader_election.cc:290] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 19 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:13.005468  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:12.944301  6926 consensus_queue.cc:237] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:12.984355  6833 leader_election.cc:290] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:12.931030  6876 consensus_queue.cc:1048] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 13:01:12.944893  6707 raft_consensus.cc:2749] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:12.949524  6857 raft_consensus.cc:3055] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:01:13.009279  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 83047.6us
I20260709 13:01:13.016052  1525 raft_consensus.cc:1240] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:13.016250  1497 leader_election.cc:304] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:13.017867  6924 raft_consensus.cc:2749] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:12.959388  6846 raft_consensus.cc:3060] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:13.019100  1497 leader_election.cc:304] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:13.021811  1497 leader_election.cc:304] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:13.023048  6924 raft_consensus.cc:2749] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:13.023980  6924 raft_consensus.cc:2804] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:13.024422  6924 raft_consensus.cc:493] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:13.024824  6924 raft_consensus.cc:3060] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:13.027328  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:13.033648  1497 leader_election.cc:304] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:12.945166  6554 consensus_queue.cc:1048] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.057s
I20260709 13:01:13.048646  1672 raft_consensus.cc:1275] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:01:13.055181  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:13.055989  1525 raft_consensus.cc:3060] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:01:13.056206  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:13.059829  1672 raft_consensus.cc:1240] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:13.013423  6857 raft_consensus.cc:740] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:13.064249  1526 raft_consensus.cc:1275] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:01:12.962287  6937 consensus_queue.cc:1059] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.101s
I20260709 13:01:13.065109  1530 raft_consensus.cc:2468] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 13.
I20260709 13:01:13.069514  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:13.070505  1526 raft_consensus.cc:2468] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 15.
I20260709 13:01:13.069471  1532 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004"
dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:49310
I20260709 13:01:13.072005  1532 raft_consensus.cc:493] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:13.072337  1532 raft_consensus.cc:3060] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:13.077888  1525 raft_consensus.cc:2468] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 17.
I20260709 13:01:13.079952  1673 raft_consensus.cc:1240] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 9 LEADER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:13.061354  6940 raft_consensus.cc:2749] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:13.111912  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:13.049326  6901 consensus_queue.cc:1059] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 13:01:13.118602  1681 raft_consensus.cc:2368] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 12. Current term is 13.
W20260709 13:01:13.124042  1571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:13.059725  6658 consensus_queue.cc:1048] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 13:01:13.116547  1673 raft_consensus.cc:1240] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:01:13.126129  6596 leader_election.cc:290] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:13.133715  1528 raft_consensus.cc:2468] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 10.
I20260709 13:01:13.058925  6833 consensus_queue.cc:1048] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.054s
W20260709 13:01:13.139078  1571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:13.148018  1532 raft_consensus.cc:515] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:13.064672  6925 consensus_queue.cc:1059] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.071s
W20260709 13:01:13.157667  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 124241us
I20260709 13:01:13.162729  1532 leader_election.cc:290] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:13.167191  1497 leader_election.cc:400] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303) with higher term. Message: Invalid argument: T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 12. Current term is 13.
I20260709 13:01:13.142328  6901 consensus_queue.cc:1243] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer 39a92f5a4352465d8af3af5908fe8642 log is divergent from this leader: its last log entry 14.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:01:13.179620  1497 leader_election.cc:400] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303) with higher term. Message: Invalid argument: T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 13. Current term is 14.
I20260709 13:01:13.116488  6867 consensus_queue.cc:1059] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.049s
I20260709 13:01:13.150722  6952 raft_consensus.cc:493] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.138006  6873 consensus_queue.cc:1059] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:01:13.180544  1497 leader_election.cc:304] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
W20260709 13:01:13.184760  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 53543.8us
I20260709 13:01:13.158514  6929 raft_consensus.cc:515] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:01:13.194918  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:13.189265  1497 leader_election.cc:304] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:13.201529  2190 leader_election.cc:304] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:13.207451  1678 raft_consensus.cc:1240] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:01:13.203269  2190 leader_election.cc:304] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:13.187667  6956 raft_consensus.cc:2749] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:13.209687  1497 leader_election.cc:304] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:13.212281  6833 raft_consensus.cc:2749] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:13.212924  1497 leader_election.cc:400] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303) with higher term. Message: Invalid argument: T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 15. Current term is 16.
W20260709 13:01:13.216411  6947 log.cc:927] Time spent T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
I20260709 13:01:13.217815  6959 raft_consensus.cc:2804] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:13.218433  6959 raft_consensus.cc:697] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 11 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:13.217856  6924 raft_consensus.cc:515] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:13.219429  6959 consensus_queue.cc:237] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:13.204161  6564 consensus_queue.cc:1048] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 13:01:13.221107  6924 leader_election.cc:290] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:13.224228  1672 raft_consensus.cc:1275] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:01:13.226370  6878 consensus_queue.cc:1048] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:01:13.203929  6901 raft_consensus.cc:2804] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:13.208657  6867 raft_consensus.cc:2749] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:13.234860  6920 raft_consensus.cc:493] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:13.235514  6920 raft_consensus.cc:3060] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:13.188340  6952 raft_consensus.cc:515] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:13.202836  6873 consensus_queue.cc:1243] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
W20260709 13:01:13.247220  6953 log.cc:927] Time spent T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
W20260709 13:01:13.247714  6945 log.cc:927] Time spent T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 13:01:13.248801  6952 leader_election.cc:290] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:13.243697  6901 raft_consensus.cc:493] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:13.249605  6901 raft_consensus.cc:3060] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:13.257506  1497 leader_election.cc:304] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:13.249905  6929 leader_election.cc:290] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
W20260709 13:01:13.259160  6951 log.cc:927] Time spent T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 13:01:13.255452  6554 raft_consensus.cc:493] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.245944  6630 raft_consensus.cc:493] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:13.261488  6554 raft_consensus.cc:515] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:13.262058  6630 raft_consensus.cc:3060] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:13.263616  6554 leader_election.cc:290] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:01:13.266144  1570 connection.cc:256] RPC call timeout handler was delayed by -1.2735607690000279s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24060000000000004s for a response
I20260709 13:01:13.267107  1570 leader_election.cc:304] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:13.269837  6857 consensus_queue.cc:260] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:13.271196  6857 raft_consensus.cc:3060] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:13.273744  1677 raft_consensus.cc:2468] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 16.
I20260709 13:01:13.274531  1679 raft_consensus.cc:1240] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:01:13.275242  1571 leader_election.cc:304] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:13.276252  6878 raft_consensus.cc:2749] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:13.276978  6878 raft_consensus.cc:2804] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:13.277467  6878 raft_consensus.cc:697] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 16 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:13.278329  6878 consensus_queue.cc:237] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:01:13.290743  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:13.234462  6898 raft_consensus.cc:515] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:13.261662  6874 raft_consensus.cc:3055] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:13.308964  1525 raft_consensus.cc:1275] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:01:13.312023  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:13.314009  1525 raft_consensus.cc:1275] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:01:13.234462  6846 raft_consensus.cc:515] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:13.316105  1532 raft_consensus.cc:1240] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 16. Current term is 17. Ops: [16.14-16.14]
I20260709 13:01:13.316231  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
W20260709 13:01:13.316938  1571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:13.316982  1525 raft_consensus.cc:1240] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:13.319656  1570 leader_election.cc:304] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:13.296104  6934 raft_consensus.cc:2804] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:13.304139  6749 raft_consensus.cc:493] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.305807  6874 raft_consensus.cc:740] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:13.329111  6635 raft_consensus.cc:2749] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:13.322192  6956 raft_consensus.cc:493] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
W20260709 13:01:13.342506  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 45401.1us
I20260709 13:01:13.331781  6854 raft_consensus.cc:493] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.329847  6873 raft_consensus.cc:493] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.330029  6934 raft_consensus.cc:493] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:13.355554  6934 raft_consensus.cc:3060] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:13.329149  6929 consensus_queue.cc:1048] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 13:01:13.323488  6924 consensus_queue.cc:1059] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 13:01:13.337294  6749 raft_consensus.cc:515] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:13.346434  6956 raft_consensus.cc:515] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:13.364276  6854 raft_consensus.cc:515] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:13.348062  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 234449us
I20260709 13:01:13.334978  6869 consensus_queue.cc:1059] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.009s
I20260709 13:01:13.336834  6859 consensus_queue.cc:1059] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 13:01:13.351016  6873 raft_consensus.cc:515] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:13.335000  6930 consensus_queue.cc:1048] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 13:01:13.395259  1570 leader_election.cc:400] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 election: Vote denied by peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931) with higher term. Message: Invalid argument: T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 11. Current term is 12.
I20260709 13:01:13.400569  1679 raft_consensus.cc:1240] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 11 LEADER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:13.435709  6777 raft_consensus.cc:493] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:13.435925  6613 raft_consensus.cc:493] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:13.438113  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:13.441496  2225 raft_consensus.cc:3060] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:13.442078  1678 raft_consensus.cc:1275] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:01:13.444474  6956 leader_election.cc:290] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:13.444789  6950 raft_consensus.cc:3055] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:13.445212  6950 raft_consensus.cc:740] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:13.447036  6324 raft_consensus.cc:3055] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:13.447443  6324 raft_consensus.cc:740] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:13.446012  6950 consensus_queue.cc:260] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:01:13.448274  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 104903us
I20260709 13:01:13.451699  1677 raft_consensus.cc:1275] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:01:13.437252  6961 log.cc:927] Time spent T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.191s	user 0.000s	sys 0.006s
I20260709 13:01:13.453581  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: true dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:13.455515  2221 raft_consensus.cc:3055] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:13.455869  2221 raft_consensus.cc:740] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:13.457032  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:13.460887  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:13.448604  6950 raft_consensus.cc:3060] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:13.438802  6922 raft_consensus.cc:493] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:13.466130  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:13.438732  6968 raft_consensus.cc:493] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:13.467736  6970 raft_consensus.cc:493] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:13.468205  6963 log.cc:927] Time spent T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 13:01:13.458516  6778 consensus_queue.cc:1048] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 13:01:13.470968  6922 raft_consensus.cc:515] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:13.472101  2221 consensus_queue.cc:260] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:13.477118  6934 raft_consensus.cc:515] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:13.481112  2225 raft_consensus.cc:2468] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 10.
I20260709 13:01:13.482234  6749 leader_election.cc:290] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:01:13.483752  2192 leader_election.cc:336] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Timed out: RequestConsensusVote RPC to 127.0.107.194:40303 timed out after 1.832s (SENT)
I20260709 13:01:13.489547  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:13.496933  1677 raft_consensus.cc:2468] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 15.
I20260709 13:01:13.497890  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
W20260709 13:01:13.490031  1496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:13.491470  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:13.494401  2221 raft_consensus.cc:3060] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:13.494961  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:13.501467  2192 leader_election.cc:304] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:13.503466  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:13.505822  6934 leader_election.cc:290] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:13.507447  6854 leader_election.cc:290] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:13.509218  6873 leader_election.cc:290] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:13.511631  6898 leader_election.cc:290] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 17 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:13.512292  6630 raft_consensus.cc:515] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:13.512717  6846 leader_election.cc:290] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:13.514899  6630 leader_election.cc:290] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
W20260709 13:01:13.522737  1571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:13.523142  6887 raft_consensus.cc:515] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:13.524452  2224 raft_consensus.cc:2393] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 16: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:01:13.525404  6887 leader_election.cc:290] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 16 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:13.527558  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:13.529770  6938 raft_consensus.cc:3055] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:01:13.530189  6938 raft_consensus.cc:740] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:13.530999  6938 consensus_queue.cc:260] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:13.532234  6938 raft_consensus.cc:3060] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:13.535305  6873 raft_consensus.cc:2749] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:01:13.536271  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 52558.7us
I20260709 13:01:13.451182  6613 raft_consensus.cc:515] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:13.538606  6613 leader_election.cc:290] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:13.540030  6952 raft_consensus.cc:3055] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:13.540459  6952 raft_consensus.cc:740] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:13.541302  6952 consensus_queue.cc:260] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:13.542032  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:13.542867  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:13.543460  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:13.537060  6843 consensus_queue.cc:260] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:13.548559  6843 raft_consensus.cc:3060] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:13.452732  6777 raft_consensus.cc:515] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:13.552397  6777 leader_election.cc:290] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:13.553220  6922 leader_election.cc:290] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:13.553402  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:13.542488  6952 raft_consensus.cc:3060] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:13.493598  6970 raft_consensus.cc:515] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:13.556911  6970 leader_election.cc:290] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:13.557090  1677 raft_consensus.cc:2468] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 17.
I20260709 13:01:13.559453  1497 leader_election.cc:304] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
W20260709 13:01:13.532320  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 83338us
I20260709 13:01:13.561072  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:13.561846  2225 raft_consensus.cc:2393] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 17: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:01:13.540277  6886 raft_consensus.cc:3055] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:13.567813  2225 raft_consensus.cc:1275] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:01:13.569882  1496 leader_election.cc:400] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 election: Vote denied by peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217) with higher term. Message: Invalid argument: T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 12. Current term is 13.
I20260709 13:01:13.570211  1496 leader_election.cc:403] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:01:13.562420  1570 leader_election.cc:304] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:13.575166  1570 leader_election.cc:304] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:13.575912  6898 consensus_queue.cc:1059] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:13.576637  6857 raft_consensus.cc:2749] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:13.576819  1570 leader_election.cc:304] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:13.577261  6898 raft_consensus.cc:3055] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:13.575804  6878 raft_consensus.cc:2749] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:13.577570  6857 raft_consensus.cc:2749] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:13.579278  2226 raft_consensus.cc:1240] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:13.579591  6613 raft_consensus.cc:2749] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217) with higher term. Message: Invalid argument: T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 12. Current term is 13.
I20260709 13:01:13.492069  6968 raft_consensus.cc:515] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:13.580854  6324 consensus_queue.cc:260] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:13.582038  6324 raft_consensus.cc:3060] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:13.568971  6777 raft_consensus.cc:2804] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:13.583297  6777 raft_consensus.cc:697] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:13.565426  6920 raft_consensus.cc:515] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:13.584203  6956 consensus_queue.cc:1059] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:01:13.585286  6934 consensus_queue.cc:1059] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:01:13.585906  1571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:13.586176  6833 raft_consensus.cc:3055] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:13.586562  6833 raft_consensus.cc:740] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:13.587384  6833 consensus_queue.cc:260] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:13.568318  6886 raft_consensus.cc:740] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:13.588877  6886 consensus_queue.cc:260] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 10.12, Last appended by leader: 12, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:13.589815  2221 raft_consensus.cc:2468] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 12.
I20260709 13:01:13.590373  1496 leader_election.cc:304] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
W20260709 13:01:13.593911  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 384164us
I20260709 13:01:13.578460  1570 leader_election.cc:304] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:13.590955  1497 leader_election.cc:304] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:13.598538  1570 leader_election.cc:400] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 pre-election: Vote denied by peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931) with higher term. Message: Invalid argument: T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 12. Current term is 13.
I20260709 13:01:13.599841  1570 leader_election.cc:403] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:13.583457  6847 raft_consensus.cc:3055] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:13.602921  1570 leader_election.cc:304] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:13.605057  1570 leader_election.cc:304] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:13.585634  6920 leader_election.cc:290] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:13.577744  6898 raft_consensus.cc:740] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:13.609103  1527 raft_consensus.cc:1240] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:13.611968  6878 raft_consensus.cc:2749] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:13.592319  6950 consensus_queue.cc:1059] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:01:13.607975  6749 raft_consensus.cc:2749] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:13.608270  6924 raft_consensus.cc:2804] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:13.606434  6778 raft_consensus.cc:2749] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931) with higher term. Message: Invalid argument: T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 12. Current term is 13.
I20260709 13:01:13.606935  6847 raft_consensus.cc:740] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:13.597330  6857 consensus_queue.cc:1048] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.023s
I20260709 13:01:13.622203  6878 consensus_queue.cc:1048] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 13:01:13.626159  6950 consensus_queue.cc:1243] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer ddf11fc190dd4b898773379c6b129d90 log is divergent from this leader: its last log entry 9.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:01:13.618652  6970 raft_consensus.cc:493] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.618113  6952 raft_consensus.cc:2804] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:13.591017  6777 consensus_queue.cc:237] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:13.624555  6924 raft_consensus.cc:493] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:13.684036  1496 leader_election.cc:304] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:13.685685  1496 leader_election.cc:304] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:13.646138  6886 raft_consensus.cc:3060] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:13.649367  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 212344us
I20260709 13:01:13.650269  6968 leader_election.cc:290] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:13.639561  6970 raft_consensus.cc:515] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:13.708161  6970 leader_election.cc:290] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:13.651841  6901 raft_consensus.cc:515] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:13.652491  2218 raft_consensus.cc:1275] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:01:13.652838  6874 consensus_queue.cc:260] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:13.711966  6874 raft_consensus.cc:3060] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:13.653620  6933 raft_consensus.cc:2749] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:13.654271  6977 consensus_queue.cc:1048] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:13.654310  6965 consensus_queue.cc:1059] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:13.655073  6952 raft_consensus.cc:697] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:13.714840  6952 consensus_queue.cc:237] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:13.655073  6956 raft_consensus.cc:3055] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:13.655663  6847 consensus_queue.cc:260] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:13.658847  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:13.659535  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:13.639838  6898 consensus_queue.cc:260] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:01:13.652487  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:13.723529  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
W20260709 13:01:13.723826  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:13.724177  1526 raft_consensus.cc:3060] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:13.660254  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:13.725289  1672 raft_consensus.cc:3060] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:13.660709  2190 leader_election.cc:304] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:13.660879  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:13.661239  6843 consensus_queue.cc:1059] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:13.669260  1599 raft_consensus.cc:1275] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:01:13.669498  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:13.670135  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:13.671200  1600 raft_consensus.cc:1275] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:01:13.726337  1681 raft_consensus.cc:2468] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 17.
I20260709 13:01:13.672309  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:13.678134  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:13.689252  1676 raft_consensus.cc:1240] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:13.727963  1606 raft_consensus.cc:2468] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 13.
I20260709 13:01:13.690356  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:13.639729  1570 leader_election.cc:304] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:13.728629  1604 raft_consensus.cc:2468] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 16.
I20260709 13:01:13.697355  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:13.695397  1678 raft_consensus.cc:1275] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:01:13.703567  1524 raft_consensus.cc:1275] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
W20260709 13:01:13.713941  1495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:13.716517  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:13.731915  1532 raft_consensus.cc:3060] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:13.720510  1677 raft_consensus.cc:2468] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 16.
I20260709 13:01:13.686717  6924 raft_consensus.cc:3060] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:13.686581  6922 raft_consensus.cc:493] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.686759  6940 raft_consensus.cc:2749] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:13.671849  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:13.738337  1602 raft_consensus.cc:3060] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:13.727120  1605 raft_consensus.cc:3060] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:13.690135  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:13.738190  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:13.734133  1673 raft_consensus.cc:2393] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 10: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
W20260709 13:01:13.742394  2192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:13.736176  2191 leader_election.cc:304] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:13.768360  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:01:13.750542  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 89915.1us
I20260709 13:01:13.778832  1602 raft_consensus.cc:2468] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 11.
W20260709 13:01:13.782959  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 46864us
I20260709 13:01:13.718768  6956 raft_consensus.cc:740] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:13.784934  1672 raft_consensus.cc:2468] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 16.
I20260709 13:01:13.773463  1646 leader_election.cc:304] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
W20260709 13:01:13.786378  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:13.813118  1526 raft_consensus.cc:2468] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 13.
I20260709 13:01:13.814116  1646 leader_election.cc:304] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:13.817170  1675 raft_consensus.cc:2468] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 12.
I20260709 13:01:13.780620  1532 raft_consensus.cc:2468] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 16.
I20260709 13:01:13.822777  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:13.745375  6901 leader_election.cc:290] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:13.783689  6890 raft_consensus.cc:2804] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:01:13.847474  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 223215us
I20260709 13:01:13.848443  1570 leader_election.cc:304] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:13.850246  1570 leader_election.cc:304] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:13.786970  6868 raft_consensus.cc:2749] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:13.749341  6878 consensus_queue.cc:1059] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.079s
I20260709 13:01:13.746539  6922 raft_consensus.cc:515] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:13.831636  6782 raft_consensus.cc:3055] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:13.857966  1570 leader_election.cc:400] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 election: Vote denied by peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931) with higher term. Message: Invalid argument: T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 14. Current term is 15.
I20260709 13:01:13.787024  6869 consensus_queue.cc:1048] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 13:01:13.830809  6968 raft_consensus.cc:2804] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:13.854207  1605 raft_consensus.cc:2468] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 8.
I20260709 13:01:13.829058  6876 raft_consensus.cc:2804] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:13.830479  6977 raft_consensus.cc:493] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:13.863979  1570 leader_election.cc:403] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:01:13.852746  6877 raft_consensus.cc:2749] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:13.787360  6936 consensus_queue.cc:1048] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.073s
I20260709 13:01:13.874068  1570 leader_election.cc:304] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:13.856091  6890 raft_consensus.cc:697] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:13.872865  1676 raft_consensus.cc:2468] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 17.
I20260709 13:01:13.826861  6919 consensus_queue.cc:1048] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.176s
I20260709 13:01:13.863595  6843 raft_consensus.cc:493] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.880548  1674 raft_consensus.cc:1240] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:13.859860  6702 raft_consensus.cc:2749] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:13.863353  6782 raft_consensus.cc:740] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:13.883750  6658 raft_consensus.cc:2804] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:13.869374  6968 raft_consensus.cc:493] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:13.890399  1570 leader_election.cc:304] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:13.876518  6878 raft_consensus.cc:2749] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931) with higher term. Message: Invalid argument: T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 14. Current term is 15.
I20260709 13:01:13.894688  5747 raft_consensus.cc:2804] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:13.895964  5747 raft_consensus.cc:493] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:13.896359  5747 raft_consensus.cc:3060] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:13.897778  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
W20260709 13:01:13.898648  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 213042us
I20260709 13:01:13.899092  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:13.899688  1605 raft_consensus.cc:2468] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 9.
I20260709 13:01:13.891882  6658 raft_consensus.cc:493] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:13.903671  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:01:13.904315  1428 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50074 (request call id 234) took 30414 ms (client timeout 15000 ms). Trace:
I20260709 13:01:13.904439  6658 raft_consensus.cc:3060] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:13.904454  1603 raft_consensus.cc:2393] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 13: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:01:13.905656  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:13.906322  1603 raft_consensus.cc:2393] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 16: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:01:13.873625  6876 raft_consensus.cc:493] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:13.915373  6876 raft_consensus.cc:3060] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:13.917191  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:13.916867  5747 raft_consensus.cc:515] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:13.917845  1606 raft_consensus.cc:3060] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:01:13.918004  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:13.904059  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:13.919744  1604 raft_consensus.cc:2410] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:01:13.892860  6968 raft_consensus.cc:3060] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:13.932327  1604 raft_consensus.cc:1275] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 13:01:13.932835  1604 pending_rounds.cc:85] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642: Aborting all ops after (but not including) 10
I20260709 13:01:13.933061  1604 pending_rounds.cc:107] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 13:01:13.933230  5747 leader_election.cc:290] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 16 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:13.877916  6977 raft_consensus.cc:515] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:13.933307  1604 raft_consensus.cc:2889] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:13.928776  1601 raft_consensus.cc:1240] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:13.941921  1497 leader_election.cc:304] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:13.949462  1606 raft_consensus.cc:2468] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 16.
I20260709 13:01:13.950994  2192 leader_election.cc:304] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
W20260709 13:01:13.935954  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 160161us
I20260709 13:01:13.885598  6843 raft_consensus.cc:515] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:13.972303  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:13.974211  6922 leader_election.cc:290] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:13.871914  6956 consensus_queue.cc:260] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:01:13.978242  2192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:13.979328  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:01:13.948778  6982 log.cc:927] Time spent T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
W20260709 13:01:13.980064  1496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:13.983387  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:13.982039  1604 raft_consensus.cc:2468] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 17.
I20260709 13:01:13.985967  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:13.995854  1604 raft_consensus.cc:2393] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 13: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:01:13.996908  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:13.998330  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:14.001000  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:13.982841  6988 raft_consensus.cc:2804] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:14.003626  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:14.005028  1532 raft_consensus.cc:3060] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:13.994809  6990 raft_consensus.cc:2749] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:01:14.008944  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:14.009608  1523 raft_consensus.cc:1240] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 15. Current term is 16. Ops: [13.9-15.10]
I20260709 13:01:14.010366  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:14.009809  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:14.016641  1524 raft_consensus.cc:3060] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:13.948673  6782 consensus_queue.cc:260] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:14.025765  1532 raft_consensus.cc:2468] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 19.
I20260709 13:01:13.972239  6890 consensus_queue.cc:237] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:14.038973  1604 raft_consensus.cc:2468] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 14.
I20260709 13:01:14.040196  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:14.041126  1604 raft_consensus.cc:2393] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 16: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:01:14.042039  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:14.042737  1604 raft_consensus.cc:2468] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 16.
I20260709 13:01:14.043623  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:14.047092  1604 raft_consensus.cc:2393] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 16: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
W20260709 13:01:14.047462  6989 log.cc:927] Time spent T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:01:14.048230  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:14.049327  1604 raft_consensus.cc:2393] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 12: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:01:14.049810  6986 consensus_queue.cc:1059] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 13:01:14.060410  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:14.061430  1604 raft_consensus.cc:2393] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 12: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:01:14.062548  1604 raft_consensus.cc:1240] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:14.063809  1604 raft_consensus.cc:1240] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:14.068445  6977 leader_election.cc:290] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:14.071777  6843 leader_election.cc:290] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:14.012850  6988 raft_consensus.cc:697] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:14.092147  6782 raft_consensus.cc:3060] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:14.096089  1604 raft_consensus.cc:1240] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:14.050953  6987 consensus_queue.cc:1048] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.048s
W20260709 13:01:13.904706  1428 rpcz_store.cc:269] 0709 13:00:43.450492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:43.450630 (+   138us) service_pool.cc:224] Handling call
0709 13:01:13.860876 (+30410246us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:07.240726 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:07.241256 (+   530us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:07.241291 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:01:07.241308 (+    17us) tablet.cc:662] Decoding operations
0709 13:01:07.242544 (+  1236us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:07.242605 (+    61us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:07.242630 (+    25us) tablet.cc:685] Acquiring locks for 15 operations
0709 13:01:07.243648 (+  1018us) tablet.cc:701] Row locks acquired
0709 13:01:07.243662 (+    14us) write_op.cc:260] PREPARE: finished
0709 13:01:07.243808 (+   146us) write_op.cc:270] Start()
0709 13:01:07.243920 (+   112us) write_op.cc:276] Timestamp: P: 1783602067243753 usec, L: 0
0709 13:01:07.243939 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:01:07.244597 (+   658us) log.cc:844] Serialized 5895 byte log entry
0709 13:01:08.598354 (+1353757us) op_driver.cc:464] REPLICATION: finished
0709 13:01:09.229353 (+630999us) write_op.cc:301] APPLY: starting
0709 13:01:09.250808 (+ 21455us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:09.495755 (+244947us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:09.495880 (+   125us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:10.237981 (+742101us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:10.238405 (+   424us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=30,key_file_lookups=30,delta_file_lookups=30,mrs_lookups=0
0709 13:01:10.238464 (+    59us) write_op.cc:312] APPLY: finished
0709 13:01:10.238974 (+   510us) log.cc:844] Serialized 139 byte log entry
0709 13:01:10.383020 (+144046us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:10.472651 (+ 89631us) write_op.cc:454] Released schema lock
0709 13:01:10.497420 (+ 24769us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:10.710986 (+213566us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:10.711023 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1580670,"reported_tablets":38,"child_traces":[["op",{"apply.queue_time_us":561174,"apply.run_cpu_time_us":44597,"apply.run_wall_time_us":1459022,"cfile_cache_hit":62,"cfile_cache_hit_bytes":66947,"num_ops":15,"prepare.queue_time_us":648774,"prepare.run_cpu_time_us":37598,"prepare.run_wall_time_us":960172,"raft.queue_time_us":359588,"raft.run_cpu_time_us":57577,"raft.run_wall_time_us":279139,"replication_time_us":1353998,"spinlock_wait_cycles":41216,"thread_start_us":2053581,"threads_started":5,"wal-append.queue_time_us":1351013,"wal-append.run_cpu_time_us":17982,"wal-append.run_wall_time_us":2375080}]]}
I20260709 13:01:14.103325  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:14.113107  1524 raft_consensus.cc:1275] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:01:14.007661  6868 consensus_queue.cc:1048] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:01:14.115434  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:14.127048  2191 leader_election.cc:304] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:14.128475  2191 leader_election.cc:304] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:14.161640  6988 consensus_queue.cc:237] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:14.169016  6990 raft_consensus.cc:2804] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:01:14.185379  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:14.176503  6846 raft_consensus.cc:2804] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:14.167191  6977 consensus_queue.cc:1048] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.018s
I20260709 13:01:14.181165  6990 raft_consensus.cc:493] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:14.197181  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 68770.4us
I20260709 13:01:14.199307  6847 raft_consensus.cc:3060] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:14.200896  1606 raft_consensus.cc:1275] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 13:01:14.207849  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:14.202383  6833 raft_consensus.cc:3060] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:14.206524  2191 leader_election.cc:304] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:14.209515  1606 raft_consensus.cc:1240] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:14.177476  6658 raft_consensus.cc:515] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:14.209434  6846 raft_consensus.cc:697] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 16 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:14.212944  6846 consensus_queue.cc:237] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:14.207036  6990 raft_consensus.cc:3060] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:01:14.219085  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 266997us
I20260709 13:01:14.220430  2190 leader_election.cc:304] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:14.221625  1606 raft_consensus.cc:1275] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 13:01:14.221906  1525 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.000s	sys 0.010s
I20260709 13:01:14.194996  6924 raft_consensus.cc:515] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:14.222303  1525 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.504s	user 0.000s	sys 0.010s
W20260709 13:01:14.225001  2191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:14.214162  6968 raft_consensus.cc:515] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:14.249148  1495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:14.298444  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 78085.6us
I20260709 13:01:14.235881  6991 raft_consensus.cc:2804] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:14.338852  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:14.343068  1524 raft_consensus.cc:1275] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:01:14.343034  6991 raft_consensus.cc:697] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 12 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:14.344242  1524 raft_consensus.cc:1240] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:14.341964  1532 raft_consensus.cc:1240] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:01:14.344394  6991 consensus_queue.cc:237] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.12, Last appended by leader: 12, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:14.346241  1532 raft_consensus.cc:1240] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:14.343226  1528 raft_consensus.cc:2393] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 16: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:01:14.340884  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 13:01:14.346776  1495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:14.347864  6658 leader_election.cc:290] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:14.343011  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:14.260843  6782 consensus_queue.cc:1059] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.096s
I20260709 13:01:14.353770  6871 raft_consensus.cc:2804] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:14.405501  6876 raft_consensus.cc:515] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:14.408092  6876 leader_election.cc:290] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:14.416581  6924 leader_election.cc:290] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:01:14.420614  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 598998us
I20260709 13:01:14.422645  1644 leader_election.cc:304] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:14.423698  1644 leader_election.cc:304] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:01:14.393473  6871 raft_consensus.cc:697] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 17 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:14.424301  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:14.424942  6871 consensus_queue.cc:237] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:14.427731  6938 consensus_queue.cc:1048] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:14.428761  6937 raft_consensus.cc:493] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:14.429313  6938 raft_consensus.cc:2804] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:14.429862  6938 raft_consensus.cc:697] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 13 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:14.432369  6926 raft_consensus.cc:2804] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:14.432796  6926 raft_consensus.cc:493] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:14.433138  6926 raft_consensus.cc:3060] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:14.436133  6324 raft_consensus.cc:2804] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:14.436661  6324 raft_consensus.cc:697] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 16 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:14.451220  6324 consensus_queue.cc:237] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:14.455490  2191 leader_election.cc:304] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:14.469139  1523 raft_consensus.cc:1275] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 13:01:14.469539  2190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:14.470441  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:14.470885  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:14.429318  6937 raft_consensus.cc:515] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:14.473516  1524 raft_consensus.cc:1240] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:14.476790  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:14.479082  2224 raft_consensus.cc:1275] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:01:14.463569  7008 log.cc:927] Time spent T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.068s	user 0.002s	sys 0.000s
I20260709 13:01:14.442607  6613 raft_consensus.cc:493] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:14.480388  6613 raft_consensus.cc:515] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:14.487905  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 673894us
I20260709 13:01:14.475270  6887 raft_consensus.cc:2804] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:14.488906  1646 leader_election.cc:304] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:14.482565  6613 leader_election.cc:290] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:14.471257  6922 raft_consensus.cc:493] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:14.509889  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:14.492239  6887 raft_consensus.cc:493] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:14.526952  6887 raft_consensus.cc:3060] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:14.510154  6965 raft_consensus.cc:493] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.520812  6613 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.539572  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:14.511428  7016 raft_consensus.cc:2804] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:14.545102  2223 raft_consensus.cc:1240] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 11 LEADER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260709 13:01:14.477030  6938 consensus_queue.cc:237] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:14.550215  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:14.553972  2226 raft_consensus.cc:2468] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 13.
I20260709 13:01:14.549557  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:14.556233  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:14.534871  6934 raft_consensus.cc:493] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:14.560355  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:14.565232  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:14.520462  6922 raft_consensus.cc:515] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:14.564945  1646 leader_election.cc:304] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:14.570991  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:14.571601  2227 raft_consensus.cc:3060] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:14.572146  6990 raft_consensus.cc:515] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:14.574313  6990 leader_election.cc:290] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 17 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:14.575055  2224 raft_consensus.cc:2393] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 17: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:01:14.547516  6950 raft_consensus.cc:493] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:14.580935  2227 raft_consensus.cc:2468] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 14.
I20260709 13:01:14.540855  6965 raft_consensus.cc:515] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:14.568825  6777 raft_consensus.cc:493] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:14.558759  6613 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:14.567481  6934 raft_consensus.cc:515] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:01:14.627238  7014 log.cc:927] Time spent T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:01:14.635068  2190 leader_election.cc:304] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:14.636202  6564 consensus_queue.cc:1048] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:01:14.639328  7021 log.cc:927] Time spent T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:01:14.698860  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:14.699389  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:14.699998  1681 raft_consensus.cc:3060] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:14.640650  6968 leader_election.cc:290] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 18 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:14.646095  1525 raft_consensus.cc:1240] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 13:01:14.646843  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:14.647336  1530 raft_consensus.cc:1275] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:01:14.649642  6965 leader_election.cc:290] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:14.621179  6920 raft_consensus.cc:2749] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:14.622534  6869 raft_consensus.cc:493] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.601436  6937 leader_election.cc:290] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
W20260709 13:01:14.646255  2192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:14.690925  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 126078us
W20260709 13:01:14.723933  2192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:14.692878  6952 raft_consensus.cc:493] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:14.693667  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 58686.3us
I20260709 13:01:14.702549  2222 raft_consensus.cc:1240] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 17 LEADER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 16. Current term is 17. Ops: [16.14-16.14]
I20260709 13:01:14.705325  1523 raft_consensus.cc:2468] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 15.
I20260709 13:01:14.708774  1678 raft_consensus.cc:1275] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:01:14.624912  7016 raft_consensus.cc:697] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 11 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:14.599949  6950 raft_consensus.cc:515] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:14.701961  7013 log.cc:927] Time spent T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.138s	user 0.012s	sys 0.000s
W20260709 13:01:14.729578  1495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:14.740981  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:14.698879  6959 raft_consensus.cc:2749] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:14.623368  6777 raft_consensus.cc:515] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:14.728365  1676 raft_consensus.cc:1240] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:14.709230  7030 raft_consensus.cc:493] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:14.745939  6952 raft_consensus.cc:515] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:14.694172  6943 consensus_queue.cc:1048] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
W20260709 13:01:14.763092  6847 consensus_meta.cc:287] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b: Time spent flushing consensus metadata: real 0.551s	user 0.005s	sys 0.005s
I20260709 13:01:14.780911  6887 raft_consensus.cc:515] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:14.782294  2219 raft_consensus.cc:2393] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 18: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:01:14.770568  1681 raft_consensus.cc:2468] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 18.
W20260709 13:01:14.774744  7019 log.cc:927] Time spent T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 13:01:14.776023  6920 raft_consensus.cc:493] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:14.725582  6869 raft_consensus.cc:515] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:14.765527  7025 raft_consensus.cc:493] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:14.782437  6613 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:01:14.779222  7023 log.cc:927] Time spent T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:01:14.780357  6777 leader_election.cc:290] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:01:14.776873  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:14.760041  6871 consensus_queue.cc:1059] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 13:01:14.764997  6874 consensus_queue.cc:1048] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 13:01:14.820952  6898 raft_consensus.cc:3060] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:14.769627  6977 consensus_queue.cc:1048] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 13:01:14.786985  6921 raft_consensus.cc:493] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:14.827760  6921 raft_consensus.cc:515] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:14.829779  6991 raft_consensus.cc:3055] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:14.830080  6921 leader_election.cc:290] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:01:14.831780  7022 log.cc:927] Time spent T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:01:14.836207  6869 leader_election.cc:290] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:14.836411  1600 raft_consensus.cc:1240] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:01:14.771344  7030 raft_consensus.cc:515] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:14.839665  7030 leader_election.cc:290] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:14.841917  6952 leader_election.cc:290] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:14.810297  6920 raft_consensus.cc:515] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:14.845257  6920 leader_election.cc:290] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:14.812736  2218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50326 (request call id 1125) took 1965 ms. Trace:
I20260709 13:01:14.847134  2218 rpcz_store.cc:276] 0709 13:01:12.847661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.847808 (+   147us) service_pool.cc:224] Handling call
0709 13:01:12.868661 (+ 20853us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:13.711268 (+842607us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:14.812470 (+1101202us) spinlock_profiling.cc:243] Waited 783 ms on lock 0x7b5400383954. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:01:14.812676 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1801978112}
I20260709 13:01:14.812883  6934 leader_election.cc:290] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:14.810314  7025 raft_consensus.cc:515] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:14.850168  7025 leader_election.cc:290] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:14.850924  7016 consensus_queue.cc:237] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:01:14.852656  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:14.882777  6833 raft_consensus.cc:493] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:14.889330  6833 raft_consensus.cc:515] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:14.892076  6833 leader_election.cc:290] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:14.769335  6978 consensus_queue.cc:1059] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
W20260709 13:01:14.882458  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 186746us
I20260709 13:01:14.855422  6991 raft_consensus.cc:740] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
W20260709 13:01:14.908552  1495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:14.909597  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:14.911666  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: true dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:14.912925  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:14.913784  1600 raft_consensus.cc:2393] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 8: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:01:14.911021  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:14.920636  1604 raft_consensus.cc:3060] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:14.923329  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:14.927600  1600 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 16.
I20260709 13:01:14.928867  1599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1119) took 1031 ms. Trace:
W20260709 13:01:14.928071  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:14.939280  1606 raft_consensus.cc:1240] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 13 LEADER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:01:14.954353  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:14.955681  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:14.956498  1606 raft_consensus.cc:2410] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:01:14.957370  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:14.901430  6554 raft_consensus.cc:493] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:14.963359  5747 raft_consensus.cc:493] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.942487  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:14.963559  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1125) took 1061 ms. Trace:
W20260709 13:01:14.944592  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 183704us
I20260709 13:01:14.964111  1600 raft_consensus.cc:2468] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 14.
I20260709 13:01:14.964543  5747 raft_consensus.cc:515] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:14.965045  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1124) took 1063 ms. Trace:
I20260709 13:01:14.965176  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:01:14.947410  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 186616us
I20260709 13:01:14.965765  1600 raft_consensus.cc:2468] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 15.
W20260709 13:01:14.966754  2191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:14.967497  7029 log.cc:927] Time spent T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:01:14.970548  2218 raft_consensus.cc:1275] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:01:14.929636  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:14.971904  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:14.972411  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:14.960085  1604 raft_consensus.cc:2468] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 10.
I20260709 13:01:14.973145  2221 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 16.
I20260709 13:01:14.973533  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:14.971611  1601 raft_consensus.cc:2376] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 13. Re-sending same reply.
I20260709 13:01:14.971796  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:14.976634  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:14.953238  1599 rpcz_store.cc:276] 0709 13:01:13.897561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:13.897669 (+   108us) service_pool.cc:224] Handling call
0709 13:01:13.915859 (+ 18190us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:13.916092 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:01:13.924850 (+  8758us) log.cc:844] Serialized 14 byte log entry
0709 13:01:14.928464 (+1003614us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:14.928523 (+    59us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:14.928579 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:14.928647 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:14.928793 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":832244,"prepare.queue_time_us":12220,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"thread_start_us":130816,"threads_started":1,"wal-append.queue_time_us":252471}
I20260709 13:01:14.977247  1601 raft_consensus.cc:2468] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 10.
I20260709 13:01:14.928344  6922 leader_election.cc:290] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:14.961859  1644 leader_election.cc:304] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:14.901618  6920 raft_consensus.cc:493] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:14.972761  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:01:14.962594  6926 consensus_meta.cc:287] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.529s	user 0.008s	sys 0.004s
I20260709 13:01:14.976785  2191 leader_election.cc:304] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:14.983175  2224 raft_consensus.cc:1240] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 17. Current term is 18. Ops: []
I20260709 13:01:14.987561  1606 raft_consensus.cc:1275] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:01:14.987676  2227 raft_consensus.cc:1275] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:01:14.988864  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:01:14.960697  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:14.991691  1646 leader_election.cc:304] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:14.989727  1599 raft_consensus.cc:1240] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 10. Current term is 11. Ops: [8.7-10.8]
I20260709 13:01:14.976305  6554 raft_consensus.cc:515] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:14.993649  7035 raft_consensus.cc:493] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:14.994251  7035 raft_consensus.cc:515] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:14.995261  6554 leader_election.cc:290] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:14.971441  7027 consensus_queue.cc:1048] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:01:14.996621  7035 leader_election.cc:290] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:14.998024  5747 leader_election.cc:290] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:14.975754  6995 raft_consensus.cc:493] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.999595  6995 raft_consensus.cc:515] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:15.000082  6857 raft_consensus.cc:3055] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:15.000484  6857 raft_consensus.cc:740] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:15.001296  6857 consensus_queue.cc:260] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:15.001952  6995 leader_election.cc:290] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:14.972448  6658 raft_consensus.cc:493] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.002991  6658 raft_consensus.cc:515] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:01:15.003953  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:15.012368  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:15.015908  1570 leader_election.cc:304] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:14.965435  1603 rpcz_store.cc:276] 0709 13:01:13.901743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:13.907689 (+  5946us) service_pool.cc:224] Handling call
0709 13:01:13.907951 (+   262us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:14.481978 (+574027us) spinlock_profiling.cc:243] Waited 5.33 ms on lock 0x7b180039c400. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1e38ede1 00007f6a1e39b5b1 00007f6a1815b4bc 00007f6a154a948b 00007f6a1e303ab9 00007f6a154c569b 00007f6a154c393f 00007f6a154c3455 00007f6a185ab060 00007f6a185abbfb 00007f6a185b664b
0709 13:01:14.482114 (+   136us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:14.482140 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:14.482681 (+   541us) log.cc:844] Serialized 26 byte log entry
0709 13:01:14.559811 (+ 77130us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:14.602891 (+ 43080us) log.cc:844] Serialized 14 byte log entry
0709 13:01:14.964550 (+361659us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:14.964639 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:14.964686 (+    47us) raft_consensus.cc:1685] finished
0709 13:01:14.964840 (+   154us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:14.964990 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":361401,"prepare.queue_time_us":38610,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":49,"raft.queue_time_us":392744,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":14938,"spinlock_wait_cycles":12261248,"thread_start_us":101400,"threads_started":2,"wal-append.queue_time_us":136219}
I20260709 13:01:15.023134  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:15.023823  1603 raft_consensus.cc:3060] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:15.023878  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:15.024773  1604 raft_consensus.cc:3060] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:15.031445  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:15.034597  1679 raft_consensus.cc:1275] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260709 13:01:15.037125  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 45508.8us
I20260709 13:01:15.038640  1646 leader_election.cc:304] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:15.047232  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:15.050443  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:15.052541  5747 raft_consensus.cc:493] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.053128  5747 raft_consensus.cc:515] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:14.995405  7028 log.cc:927] Time spent T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:01:15.055471  5747 leader_election.cc:290] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:15.056806  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1113) took 1162 ms. Trace:
I20260709 13:01:15.059242  1599 pending_rounds.cc:85] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642: Aborting all ops after (but not including) 9
I20260709 13:01:15.059600  1599 pending_rounds.cc:107] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260709 13:01:15.059868  1599 raft_consensus.cc:2889] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:15.057257  1602 rpcz_store.cc:276] 0709 13:01:13.894170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:13.895206 (+  1036us) service_pool.cc:224] Handling call
0709 13:01:13.898693 (+  3487us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:14.019664 (+120971us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:14.019699 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:14.109052 (+ 89353us) log.cc:844] Serialized 26 byte log entry
0709 13:01:14.218820 (+109768us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:14.229080 (+ 10260us) log.cc:844] Serialized 14 byte log entry
0709 13:01:14.889041 (+659961us) spinlock_profiling.cc:243] Waited 2.9 ms on lock 0x7b18003d7c80. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1e38ede1 00007f6a1e39b5b1 00007f6a15440c0a 00007f6a1eb80219 00007f6a1c48758f 00007f6a154c6571 00007f6a154c87c1 00007f6a154c8779 00007f6a154c8709 00007f6a154c86d1 00007f6a154c79cd
0709 13:01:15.056354 (+167313us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:15.056444 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:15.056491 (+    47us) raft_consensus.cc:1685] finished
0709 13:01:15.056606 (+   115us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:15.056744 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":790236,"prepare.queue_time_us":10678,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":56,"raft.queue_time_us":769383,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":33153,"spinlock_wait_cycles":22072960,"thread_start_us":227080,"threads_started":3,"wal-append.queue_time_us":190265}
W20260709 13:01:15.061968  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 85277.9us
W20260709 13:01:15.063118  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:15.064819  1598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1120) took 1166 ms. Trace:
W20260709 13:01:15.060847  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 45066.9us
I20260709 13:01:14.963253  6939 consensus_queue.cc:1059] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 5, Time since last communication: 0.095s
I20260709 13:01:15.027307  6938 raft_consensus.cc:2804] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:15.070885  1570 leader_election.cc:304] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:15.067813  1602 raft_consensus.cc:1275] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 13. (index mismatch)
I20260709 13:01:15.077483  1570 leader_election.cc:304] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:15.079401  1680 raft_consensus.cc:1275] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 12 index: 13. (index mismatch)
I20260709 13:01:15.079736  1604 raft_consensus.cc:2468] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 17.
I20260709 13:01:15.079887  1570 leader_election.cc:304] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:15.082329  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:15.083532  7027 raft_consensus.cc:493] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:15.083856  2190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:15.072080  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 111476us
I20260709 13:01:15.083312  6554 raft_consensus.cc:493] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.085788  6939 raft_consensus.cc:3055] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:01:15.087534  6939 raft_consensus.cc:740] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:15.088459  6939 consensus_queue.cc:260] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:15.085192  1676 raft_consensus.cc:1240] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 13 LEADER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:15.086447  6554 raft_consensus.cc:515] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:15.083271  1602 raft_consensus.cc:3060] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:15.093331  6554 leader_election.cc:290] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:15.084468  1570 leader_election.cc:304] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:15.087052  7027 raft_consensus.cc:515] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:15.097231  7027 leader_election.cc:290] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:15.089833  6939 raft_consensus.cc:3060] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:15.072232  1598 rpcz_store.cc:276] 0709 13:01:13.897864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:13.898500 (+   636us) service_pool.cc:224] Handling call
0709 13:01:13.924150 (+ 25650us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:13.924352 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:01:14.282928 (+358576us) log.cc:844] Serialized 14 byte log entry
0709 13:01:14.971609 (+688681us) log.cc:844] Serialized 14 byte log entry
0709 13:01:15.055707 (+ 84098us) log.cc:844] Serialized 14 byte log entry
0709 13:01:15.062344 (+  6637us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:15.062466 (+   122us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:01:15.062548 (+    82us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:15.062916 (+   368us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:15.063722 (+   806us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":441453,"prepare.queue_time_us":83372,"prepare.run_cpu_time_us":144,"prepare.run_wall_time_us":3582,"raft.queue_time_us":525052,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":10511,"thread_start_us":543195,"threads_started":3,"wal-append.queue_time_us":241979}
I20260709 13:01:15.052431  6922 raft_consensus.cc:2749] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:15.108018  1529 raft_consensus.cc:1240] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 7. Current term is 8. Ops: []
W20260709 13:01:15.108783  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 70184.1us
I20260709 13:01:15.109613  1523 raft_consensus.cc:1240] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:01:14.985126  6920 raft_consensus.cc:515] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:15.071892  6857 raft_consensus.cc:3060] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:15.116925  1524 raft_consensus.cc:1275] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:01:15.117151  1528 raft_consensus.cc:1240] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:15.069883  6990 raft_consensus.cc:493] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.982761  6991 consensus_queue.cc:260] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:15.069695  6833 raft_consensus.cc:493] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.103693  6950 leader_election.cc:290] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:01:15.124501  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 118352us
I20260709 13:01:15.005352  6926 raft_consensus.cc:515] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:15.070323  6868 raft_consensus.cc:2804] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:01:15.074874  6613 raft_consensus.cc:493] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.075870  6938 raft_consensus.cc:493] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:15.148245  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36200 (request call id 2693) took 1478 ms. Trace:
W20260709 13:01:15.149497  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 285161us
I20260709 13:01:15.150780  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:15.151373  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:15.144436  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:15.169618  1673 raft_consensus.cc:2393] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 16: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:01:15.122332  6936 raft_consensus.cc:2804] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:15.165670  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:15.133450  7036 raft_consensus.cc:493] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.174780  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:15.175987  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:15.136180  6564 raft_consensus.cc:493] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:15.179171  1497 leader_election.cc:304] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:15.148434  6635 raft_consensus.cc:2749] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:15.143386  6925 raft_consensus.cc:2749] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:15.182153  1677 raft_consensus.cc:2393] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 17: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:01:15.183002  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:15.167954  1607 rpcz_store.cc:276] 0709 13:01:13.669739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:13.672717 (+  2978us) service_pool.cc:224] Handling call
0709 13:01:13.693357 (+ 20640us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:13.728847 (+ 35490us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:13.728879 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:13.752721 (+ 23842us) log.cc:844] Serialized 52 byte log entry
0709 13:01:14.222917 (+470196us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:14.325925 (+103008us) log.cc:844] Serialized 14 byte log entry
0709 13:01:15.147834 (+821909us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:15.147942 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:15.147994 (+    52us) raft_consensus.cc:1685] finished
0709 13:01:15.148007 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:15.148162 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":677708,"prepare.queue_time_us":105509,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":34,"raft.queue_time_us":682064,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":12445,"spinlock_wait_cycles":16072576,"thread_start_us":588817,"threads_started":2,"wal-append.queue_time_us":396547}
I20260709 13:01:15.178699  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:15.186789  7045 raft_consensus.cc:493] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:15.187103  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:15.185199  6868 raft_consensus.cc:697] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 18 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:15.187422  7045 raft_consensus.cc:515] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:15.142824  6970 raft_consensus.cc:3055] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:15.188822  6970 raft_consensus.cc:740] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:15.188527  6868 consensus_queue.cc:237] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:15.191516  1607 raft_consensus.cc:2468] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 10.
I20260709 13:01:15.153995  6991 raft_consensus.cc:3060] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:15.192888  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:15.193681  1603 raft_consensus.cc:2468] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 18.
I20260709 13:01:15.190642  6926 leader_election.cc:290] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 17 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:15.173118  6938 raft_consensus.cc:3060] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:15.141013  6990 raft_consensus.cc:515] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:15.139367  7027 consensus_queue.cc:1048] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:01:15.210425  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:01:15.200778  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:15.186869  7052 raft_consensus.cc:2749] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:15.204443  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:15.196427  2221 raft_consensus.cc:2393] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 17: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:01:15.207448  1526 raft_consensus.cc:1275] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260709 13:01:15.200214  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 115860us
I20260709 13:01:15.208273  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:15.150089  6833 raft_consensus.cc:515] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:15.210184  2192 leader_election.cc:304] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:15.182893  6936 raft_consensus.cc:697] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 14 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:15.214265  1673 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 15.
W20260709 13:01:15.224620  1495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:15.171412  6613 raft_consensus.cc:515] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:15.201802  6886 consensus_queue.cc:1059] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.029s
I20260709 13:01:15.223743  6658 leader_election.cc:290] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:01:15.266458  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 45292.2us
I20260709 13:01:15.230734  6936 consensus_queue.cc:237] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:15.233093  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:15.217311  6995 raft_consensus.cc:493] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:15.194509  6952 consensus_queue.cc:1048] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:01:15.185582  6564 raft_consensus.cc:515] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:15.269457  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:15.211184  6987 raft_consensus.cc:2749] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:15.270188  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:15.272024  2224 raft_consensus.cc:2393] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 9: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:01:15.291139  1673 raft_consensus.cc:2393] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 16: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
W20260709 13:01:15.272538  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 49075.6us
I20260709 13:01:15.197485  6934 consensus_queue.cc:1048] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.067s
I20260709 13:01:15.277588  1602 raft_consensus.cc:2468] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 14.
I20260709 13:01:15.208128  6871 consensus_queue.cc:1048] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.062s
I20260709 13:01:15.264269  6847 raft_consensus.cc:2749] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:15.287914  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:15.292907  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:15.295099  1676 raft_consensus.cc:1240] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 17. Current term is 18. Ops: []
I20260709 13:01:15.224128  6919 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:15.295408  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:15.295759  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:15.182031  7036 raft_consensus.cc:515] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:15.309739  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:15.315851  2227 raft_consensus.cc:2410] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:01:15.317703  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:15.318542  1602 raft_consensus.cc:2393] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 17: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:01:15.310971  1646 leader_election.cc:304] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:15.273178  7053 raft_consensus.cc:2749] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:15.283514  6986 raft_consensus.cc:493] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.323722  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:15.327054  1602 raft_consensus.cc:2468] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 16.
I20260709 13:01:15.328203  1602 raft_consensus.cc:1240] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:15.324028  1646 leader_election.cc:304] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:15.332234  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:15.331988  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:15.369225  1676 raft_consensus.cc:2410] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 12 because replica has last-logged OpId of term: 10 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 13:01:15.273554  6925 consensus_queue.cc:1048] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:01:15.304960  7049 raft_consensus.cc:2804] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:01:15.283098  7042 consensus_queue.cc:1059] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
W20260709 13:01:15.367853  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 43918.7us
I20260709 13:01:15.374523  1646 leader_election.cc:304] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:15.285238  6995 raft_consensus.cc:515] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:15.382648  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:15.323251  7052 raft_consensus.cc:493] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.387074  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:15.388568  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:01:15.397475  1495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:15.408128  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:15.405356  1646 leader_election.cc:304] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:15.373788  7035 raft_consensus.cc:2804] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:15.415285  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:15.366962  6890 raft_consensus.cc:493] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.421504  7071 consensus_queue.cc:1059] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:15.384052  7025 raft_consensus.cc:493] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.377193  6922 raft_consensus.cc:2749] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:15.416337  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:01:15.427928  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 48172.7us
I20260709 13:01:15.428515  1672 raft_consensus.cc:2410] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for term 13 because replica has last-logged OpId of term: 11 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 11.
I20260709 13:01:15.413964  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:15.383612  6935 raft_consensus.cc:493] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:15.403173  7049 raft_consensus.cc:697] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 19 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:15.367954  6986 raft_consensus.cc:515] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:15.414763  7035 raft_consensus.cc:493] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:15.447706  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 126010us
I20260709 13:01:15.454154  1674 raft_consensus.cc:1275] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 11. (term mismatch)
I20260709 13:01:15.454579  1674 pending_rounds.cc:85] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90: Aborting all ops after (but not including) 10
I20260709 13:01:15.454823  1674 pending_rounds.cc:107] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90: Aborting uncommitted NO_OP operation due to leader change: 10.11
I20260709 13:01:15.455065  1674 raft_consensus.cc:2889] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:15.455350  1675 raft_consensus.cc:1275] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:01:15.439196  1571 leader_election.cc:304] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:15.441262  5747 raft_consensus.cc:2749] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:15.438555  6749 raft_consensus.cc:493] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
W20260709 13:01:15.426472  2192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:15.320727  6919 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:15.458077  6749 raft_consensus.cc:515] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:15.436620  7025 raft_consensus.cc:515] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:15.467263  7025 leader_election.cc:290] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:15.467912  7025 raft_consensus.cc:2804] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:15.468322  7025 raft_consensus.cc:493] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:15.468676  7025 raft_consensus.cc:3060] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:15.426177  6890 raft_consensus.cc:515] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:15.473834  6890 leader_election.cc:290] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:15.474555  7001 consensus_queue.cc:1048] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.180s
I20260709 13:01:15.474864  7065 raft_consensus.cc:493] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:15.475559  7065 raft_consensus.cc:515] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:15.476482  7048 raft_consensus.cc:493] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.477038  7048 raft_consensus.cc:515] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:15.423527  7039 raft_consensus.cc:493] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:15.477828  7065 leader_election.cc:290] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:15.478394  7065 consensus_queue.cc:1048] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:15.478267  7039 raft_consensus.cc:515] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:15.479524  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:15.478188  1601 raft_consensus.cc:1275] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:01:15.459317  6658 raft_consensus.cc:2749] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:01:15.487385  1676 raft_consensus.cc:1275] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 14. (term mismatch)
I20260709 13:01:15.487865  1676 pending_rounds.cc:85] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90: Aborting all ops after (but not including) 13
I20260709 13:01:15.488184  1676 pending_rounds.cc:107] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90: Aborting uncommitted NO_OP operation due to leader change: 16.14
I20260709 13:01:15.488432  1676 raft_consensus.cc:2889] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:01:15.465577  7043 log.cc:927] Time spent T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.238s	user 0.000s	sys 0.001s
I20260709 13:01:15.492451  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:15.462162  7035 raft_consensus.cc:3060] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:15.490008  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 84722.4us
I20260709 13:01:15.477741  7070 raft_consensus.cc:493] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.413121  7052 raft_consensus.cc:515] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:15.522378  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:15.447324  6935 raft_consensus.cc:515] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:15.478858  7038 raft_consensus.cc:493] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:15.476126  7063 consensus_queue.cc:1048] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.051s
W20260709 13:01:15.491518  7067 log.cc:927] Time spent T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:01:15.487751  7027 raft_consensus.cc:493] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
W20260709 13:01:15.626673  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 152521us
W20260709 13:01:15.600384  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:15.627946  1526 raft_consensus.cc:2468] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 9.
W20260709 13:01:15.485296  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 46166.4us
I20260709 13:01:15.495857  1601 raft_consensus.cc:1240] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 15. Current term is 16. Ops: []
W20260709 13:01:15.526150  1495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:15.631994  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:15.633579  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:15.634796  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:15.636328  1601 raft_consensus.cc:2393] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 16: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:01:15.635655  1526 raft_consensus.cc:2468] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 9.
I20260709 13:01:15.636562  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:01:15.491027  7050 log.cc:927] Time spent T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.216s	user 0.000s	sys 0.001s
I20260709 13:01:15.487272  7040 consensus_queue.cc:1048] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.347s
I20260709 13:01:15.640391  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:15.519191  6833 leader_election.cc:290] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:15.520098  6873 raft_consensus.cc:3055] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:15.490336  7037 raft_consensus.cc:2749] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:01:15.527905  6749 leader_election.cc:290] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:15.528257  7036 leader_election.cc:290] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:15.645399  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:15.634110  6990 leader_election.cc:290] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:15.524618  6995 leader_election.cc:290] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:15.613255  7045 leader_election.cc:290] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:15.647097  1601 raft_consensus.cc:2468] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 17.
I20260709 13:01:15.645223  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:15.659137  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:15.660044  1601 raft_consensus.cc:2393] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 16: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:01:15.660995  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:15.658174  1526 raft_consensus.cc:2468] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 15.
I20260709 13:01:15.640030  7048 leader_election.cc:290] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:15.525947  6986 leader_election.cc:290] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:15.636669  7053 raft_consensus.cc:493] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:15.491073  7058 log.cc:927] Time spent T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 13:01:15.490408  7047 consensus_queue.cc:1048] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.336s
I20260709 13:01:15.664044  1601 raft_consensus.cc:2393] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 12: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
W20260709 13:01:15.652621  6898 consensus_meta.cc:287] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent flushing consensus metadata: real 0.831s	user 0.010s	sys 0.002s
I20260709 13:01:15.636863  6871 consensus_queue.cc:1048] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.021s
I20260709 13:01:15.669910  6324 raft_consensus.cc:493] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:15.775138  1526 raft_consensus.cc:1275] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 13:01:15.775658  1526 pending_rounds.cc:85] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting all ops after (but not including) 7
I20260709 13:01:15.775908  1526 pending_rounds.cc:107] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:01:15.776146  1526 raft_consensus.cc:2889] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:15.672994  7080 raft_consensus.cc:493] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:15.673487  7081 raft_consensus.cc:493] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.676299  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:15.676646  1525 raft_consensus.cc:1275] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:01:15.649464  6873 raft_consensus.cc:740] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:15.678894  7053 raft_consensus.cc:515] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:15.680899  6938 raft_consensus.cc:515] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:15.684379  1496 leader_election.cc:304] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:15.638602  7070 raft_consensus.cc:515] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:15.690192  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:15.639257  7027 raft_consensus.cc:515] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:15.859738  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:15.860284  7027 leader_election.cc:290] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:15.693807  2223 raft_consensus.cc:1275] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:01:15.674381  6887 leader_election.cc:290] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 18 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:15.860879  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:01:15.698997  6939 consensus_meta.cc:287] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.599s	user 0.006s	sys 0.003s
W20260709 13:01:15.702337  7066 log.cc:927] Time spent T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:01:15.641935  7016 consensus_queue.cc:1048] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:01:15.861954  6943 raft_consensus.cc:493] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:15.693243  7035 raft_consensus.cc:515] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:01:15.703830  1497 leader_election.cc:336] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Timed out: RequestConsensusVote RPC to 127.0.107.194:40303 timed out after 1.558s (SENT)
I20260709 13:01:15.862529  6943 raft_consensus.cc:515] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:15.862937  1497 leader_election.cc:304] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
W20260709 13:01:15.863781  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 159989us
W20260709 13:01:15.864329  1497 leader_election.cc:336] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Timed out: RequestConsensusVote RPC to 127.0.107.194:40303 timed out after 1.673s (SENT)
I20260709 13:01:15.705351  6988 raft_consensus.cc:493] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.864694  6943 leader_election.cc:290] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:15.865013  6986 raft_consensus.cc:2749] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:15.709270  6970 consensus_queue.cc:260] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:15.711783  6613 leader_election.cc:290] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:15.653820  6702 raft_consensus.cc:493] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:15.664481  6564 leader_election.cc:290] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:01:15.742415  6857 consensus_meta.cc:287] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.599s	user 0.005s	sys 0.005s
I20260709 13:01:15.644053  7082 consensus_queue.cc:1059] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.105s
I20260709 13:01:15.664589  7037 raft_consensus.cc:493] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.670694  7048 raft_consensus.cc:493] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:15.724231  7047 consensus_queue.cc:1243] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 log is divergent from this leader: its last log entry 15.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
W20260709 13:01:15.817955  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 133660us
I20260709 13:01:15.687681  1524 raft_consensus.cc:1275] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:01:15.819375  7079 raft_consensus.cc:493] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:15.813342  6749 raft_consensus.cc:493] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.963997  1605 rpcz_store.cc:276] 0709 13:01:13.901972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:13.926203 (+ 24231us) service_pool.cc:224] Handling call
0709 13:01:13.972205 (+ 46002us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:13.972437 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:01:14.221464 (+249027us) log.cc:844] Serialized 14 byte log entry
0709 13:01:14.963090 (+741626us) log.cc:844] Serialized 14 byte log entry
0709 13:01:14.963248 (+   158us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:14.963292 (+    44us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:14.963335 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:14.963396 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:14.963506 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":620030,"prepare.queue_time_us":52477,"prepare.run_cpu_time_us":122,"prepare.run_wall_time_us":47192,"raft.queue_time_us":632982,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":153,"spinlock_wait_cycles":1116672,"thread_start_us":353110,"threads_started":2,"wal-append.queue_time_us":185226}
I20260709 13:01:15.820875  7025 raft_consensus.cc:515] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:15.803009  7080 raft_consensus.cc:515] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:15.808594  6324 raft_consensus.cc:515] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:15.827368  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:15.829527  6959 consensus_queue.cc:1048] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:01:15.830021  2222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50326 (request call id 1129) took 1318 ms. Trace:
I20260709 13:01:15.831336  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:15.839313  6658 raft_consensus.cc:493] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.816726  7081 raft_consensus.cc:515] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:15.847383  1495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:15.961463  1495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:15.848006  6874 raft_consensus.cc:3055] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:15.779271  6940 raft_consensus.cc:493] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.637887  7038 raft_consensus.cc:515] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:15.696354  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:15.864722  1497 leader_election.cc:304] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:15.853919  6950 raft_consensus.cc:3055] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:01:15.639484  7049 consensus_queue.cc:237] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:15.908922  1603 raft_consensus.cc:2376] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 16. Re-sending same reply.
I20260709 13:01:15.911358  1673 raft_consensus.cc:1240] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:15.940078  2192 leader_election.cc:304] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
W20260709 13:01:16.002526  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 138217us
I20260709 13:01:15.866166  6898 raft_consensus.cc:2749] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:01:16.002774  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 62793.7us
W20260709 13:01:16.003759  1497 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:40303 timed out after 1.875s (SENT) [suppressed 27 similar messages]
I20260709 13:01:16.003993  2192 leader_election.cc:304] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:15.954651   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:15.959852  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:15.958266  2222 rpcz_store.cc:276] 0709 13:01:14.512015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:14.512149 (+   134us) service_pool.cc:224] Handling call
0709 13:01:14.512798 (+   649us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:14.743257 (+230459us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:15.829776 (+1086519us) spinlock_profiling.cc:243] Waited 189 ms on lock 0x7b54006e0ad4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:01:15.829966 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":435739520}
I20260709 13:01:15.961558  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:15.963274  1496 leader_election.cc:304] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:15.944410  1680 raft_consensus.cc:2393] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 11: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
W20260709 13:01:15.942800  7058 log.cc:927] Time spent T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.077s	user 0.004s	sys 0.001s
I20260709 13:01:16.015604  2219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50326 (request call id 1135) took 1404 ms. Trace:
W20260709 13:01:16.016839  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 53659.5us
I20260709 13:01:16.018299  2219 rpcz_store.cc:276] 0709 13:01:14.559979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:14.560102 (+   123us) service_pool.cc:224] Handling call
0709 13:01:15.964074 (+1403972us) spinlock_profiling.cc:243] Waited 221 ms on lock 0x7b540045d3d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:01:15.964211 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":507411712}
I20260709 13:01:15.939131  6702 raft_consensus.cc:515] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:15.910296  6988 raft_consensus.cc:515] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:16.031214  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:16.027074  1496 leader_election.cc:304] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:16.028702  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:16.034020  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:16.031044  1679 raft_consensus.cc:2468] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 10.
I20260709 13:01:16.033212  1524 raft_consensus.cc:2468] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 9.
I20260709 13:01:16.028744  6970 raft_consensus.cc:3060] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:01:16.039098  7087 log.cc:927] Time spent T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:01:16.040324  6702 leader_election.cc:290] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:16.040822  7070 leader_election.cc:290] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:16.041548  7052 leader_election.cc:290] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:01:16.043671  7077 log.cc:927] Time spent T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:01:16.019255  7075 consensus_queue.cc:1048] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.078s
I20260709 13:01:16.045420  7053 leader_election.cc:290] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:16.046344  7035 leader_election.cc:290] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:16.002712  6658 raft_consensus.cc:515] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:16.048275  7038 leader_election.cc:290] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:16.048566  6658 leader_election.cc:290] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:16.002483  6940 raft_consensus.cc:515] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:16.050364  6324 leader_election.cc:290] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:16.016484  7069 raft_consensus.cc:2749] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:16.016170  6968 raft_consensus.cc:2749] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:15.948204  7048 raft_consensus.cc:515] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:16.031965  1525 raft_consensus.cc:2468] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 15.
I20260709 13:01:16.053385  7048 leader_election.cc:290] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:16.055335  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:16.055881  6988 leader_election.cc:290] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:16.057200  6935 leader_election.cc:290] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:16.057839  7080 leader_election.cc:290] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:16.030607  7036 consensus_queue.cc:1059] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.029s
I20260709 13:01:16.059567  1523 raft_consensus.cc:1275] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:01:15.967007  7039 leader_election.cc:290] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:16.062217  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:16.001618  6950 raft_consensus.cc:740] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:16.062768  6938 leader_election.cc:290] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:16.064486  6950 consensus_queue.cc:260] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:16.065783  6950 raft_consensus.cc:3060] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:16.066092  1497 leader_election.cc:304] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:16.063112  7025 leader_election.cc:290] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 17 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
W20260709 13:01:16.069278  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:16.019253  6901 raft_consensus.cc:2749] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:15.945597  7037 raft_consensus.cc:515] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:16.071509  1497 leader_election.cc:304] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:16.072472  7037 leader_election.cc:290] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
W20260709 13:01:16.072902  1495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:16.073118  1676 raft_consensus.cc:2468] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 16.
I20260709 13:01:16.024344  7045 raft_consensus.cc:493] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:16.073959  7045 raft_consensus.cc:515] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:16.032838  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:16.072395  6986 raft_consensus.cc:2749] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:16.076066  6986 raft_consensus.cc:3060] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:16.076300  6324 raft_consensus.cc:493] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
W20260709 13:01:16.076867  7083 log.cc:927] Time spent T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.265s	user 0.001s	sys 0.000s
I20260709 13:01:16.076889  6324 raft_consensus.cc:515] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:16.078802  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 50284.2us
I20260709 13:01:16.079104  1497 leader_election.cc:304] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:16.059360  6613 raft_consensus.cc:2749] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:16.080461  2192 leader_election.cc:304] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:01:16.080473  1497 leader_election.cc:304] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:16.024180  6890 raft_consensus.cc:2804] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:16.014755  6874 raft_consensus.cc:740] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:16.088578  1497 leader_election.cc:304] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:16.076152  7045 leader_election.cc:290] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:16.086380  7082 consensus_queue.cc:1059] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 13:01:16.081784  6702 raft_consensus.cc:493] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.111043  2192 leader_election.cc:304] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:01:16.085214  6901 raft_consensus.cc:2804] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:15.955973  6873 consensus_queue.cc:260] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:15.961632  6749 raft_consensus.cc:515] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:16.106906  6988 raft_consensus.cc:2804] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:16.091473  1497 leader_election.cc:304] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:16.093137  6890 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:16.089891  6943 raft_consensus.cc:2749] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:16.119004  1599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1142) took 1110 ms. Trace:
I20260709 13:01:15.956362  7079 raft_consensus.cc:515] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:16.123947  1599 rpcz_store.cc:276] 0709 13:01:15.008623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:15.008780 (+   157us) service_pool.cc:224] Handling call
0709 13:01:15.059063 (+ 50283us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:15.069527 (+ 10464us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:15.069558 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:15.069948 (+   390us) log.cc:844] Serialized 26 byte log entry
0709 13:01:15.192402 (+122454us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:15.208236 (+ 15834us) log.cc:844] Serialized 14 byte log entry
0709 13:01:15.224151 (+ 15915us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:15.224225 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:15.698267 (+474042us) spinlock_profiling.cc:243] Waited 28.9 ms on lock 0x7b48001e0258. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1d4dcaa1 00007f6a1d4d3b37 00007f6a1d4d39ca 00007f6a1d5cb26f 00007f6a1d5caf37 00007f6a1d5df55c 00007f6a1d5df508 00007f6a1d5df488 00007f6a1d5df443 00007f6a1d5de6ec 00007f6a1c508a96
0709 13:01:16.116120 (+417853us) raft_consensus.cc:1685] finished
0709 13:01:16.118746 (+  2626us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:16.118931 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15645,"prepare.queue_time_us":15713,"prepare.run_wall_time_us":34,"raft.queue_time_us":15757,"raft.run_cpu_time_us":2064,"raft.run_wall_time_us":463306,"spinlock_wait_cycles":74571904,"thread_start_us":59368,"threads_started":1,"wal-append.queue_time_us":222753}
I20260709 13:01:16.115916  2192 leader_election.cc:304] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:16.115736  7070 raft_consensus.cc:2804] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:16.116554  6901 raft_consensus.cc:493] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:16.089113  7090 consensus_queue.cc:1048] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 13:01:16.118793  7091 raft_consensus.cc:493] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.119704  6968 raft_consensus.cc:2804] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:01:16.123612  6890 raft_consensus.cc:3060] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:16.209132  1602 raft_consensus.cc:1240] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 19 LEADER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 18. Current term is 19. Ops: []
I20260709 13:01:16.124738  6613 raft_consensus.cc:2749] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:16.212621  1605 raft_consensus.cc:3060] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:16.122233  6988 raft_consensus.cc:493] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
W20260709 13:01:16.219257  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 81865.9us
I20260709 13:01:16.116379  6702 raft_consensus.cc:515] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:16.139184  6871 raft_consensus.cc:2749] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:16.142688  6901 raft_consensus.cc:3060] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:16.213356  7070 raft_consensus.cc:697] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 17 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
W20260709 13:01:16.249825  2192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:16.253618  1605 raft_consensus.cc:1275] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 13:01:16.254295  2192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:16.231217  6887 raft_consensus.cc:493] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.243481  6988 raft_consensus.cc:3060] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:16.244318  6968 raft_consensus.cc:697] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 18 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:16.262002  1497 leader_election.cc:304] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:16.212584  6874 consensus_queue.cc:260] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:16.260195  6887 raft_consensus.cc:515] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:16.269871  6956 raft_consensus.cc:3060] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:16.244777  6833 raft_consensus.cc:493] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:16.259686  6943 consensus_queue.cc:1048] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 13:01:16.282958  7070 consensus_queue.cc:237] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:16.287549  6749 leader_election.cc:290] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:16.289355  7081 leader_election.cc:290] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:16.290588  7079 leader_election.cc:290] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:16.271057  6324 leader_election.cc:290] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:16.277835  6833 raft_consensus.cc:515] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:16.304883  6833 leader_election.cc:290] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:16.307137  6968 consensus_queue.cc:237] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:16.311702  6702 leader_election.cc:290] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:16.318435  6986 raft_consensus.cc:2749] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:16.270040  6887 leader_election.cc:290] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:16.230574  7091 raft_consensus.cc:515] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:16.330053  6988 raft_consensus.cc:515] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:16.332217  6988 leader_election.cc:290] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:16.344319  6901 raft_consensus.cc:515] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:01:16.356683  7099 log.cc:927] Time spent T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
W20260709 13:01:16.358291  7104 log.cc:927] Time spent T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.089s	user 0.002s	sys 0.000s
I20260709 13:01:16.360891  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:16.361524  1604 raft_consensus.cc:2468] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 10.
I20260709 13:01:16.364670  1527 raft_consensus.cc:1275] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 13:01:16.365103  7096 log.cc:927] Time spent T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.149s	user 0.002s	sys 0.000s
I20260709 13:01:16.366743  6987 raft_consensus.cc:493] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.367287  6987 raft_consensus.cc:515] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:16.368968  1527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43010 (request call id 2488) took 2672 ms. Trace:
I20260709 13:01:16.369361  1527 rpcz_store.cc:276] 0709 13:01:13.696658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:13.698693 (+  2035us) service_pool.cc:224] Handling call
0709 13:01:13.700748 (+  2055us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:16.365104 (+2664356us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:16.366613 (+  1509us) spinlock_profiling.cc:243] Waited 2.66 s on lock 0x7b54002da5d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:01:16.368886 (+  2273us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6126187904}
I20260709 13:01:16.373255  6890 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:16.375073  6873 raft_consensus.cc:3060] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:16.377393  6890 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 17 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:01:16.379971  7103 log.cc:927] Time spent T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:01:16.384583  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36200 (request call id 2700) took 1314 ms. Trace:
I20260709 13:01:16.385001  1606 rpcz_store.cc:276] 0709 13:01:15.070831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:15.324482 (+253651us) service_pool.cc:224] Handling call
0709 13:01:15.324804 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:15.427121 (+102317us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:15.427155 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:15.427194 (+    39us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:15.427223 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:16.384340 (+957117us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b5400057b54. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:01:16.384390 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:16.384522 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":234861440}
I20260709 13:01:16.387951  7091 leader_election.cc:290] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:16.388818  6920 leader_election.cc:290] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:16.392441  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:16.393059  1672 raft_consensus.cc:3060] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:16.362524  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:16.408946  1672 raft_consensus.cc:2468] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 18.
I20260709 13:01:16.411530  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:16.403390  6867 raft_consensus.cc:493] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:16.412461  7102 log.cc:927] Time spent T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.062s	user 0.002s	sys 0.000s
I20260709 13:01:16.406920  6901 leader_election.cc:290] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:16.417752  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:16.421375  1672 raft_consensus.cc:2393] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 17: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
W20260709 13:01:16.421928  7101 log.cc:927] Time spent T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 13:01:16.425038  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:16.427713  1672 raft_consensus.cc:2468] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 8.
I20260709 13:01:16.433314  2191 leader_election.cc:304] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:16.418612  6867 raft_consensus.cc:515] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:16.453403  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:16.457008  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:16.463125  1672 raft_consensus.cc:2468] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 17.
I20260709 13:01:16.451280  6968 raft_consensus.cc:2804] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:16.465284  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50664 (request call id 1300) took 1767 ms. Trace:
I20260709 13:01:16.455534  6876 raft_consensus.cc:3055] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:16.465708  1677 rpcz_store.cc:276] 0709 13:01:14.698374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:14.698570 (+   196us) service_pool.cc:224] Handling call
0709 13:01:16.465081 (+1766511us) spinlock_profiling.cc:243] Waited 482 ms on lock 0x7b5400304154. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:01:16.465225 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1109502720}
I20260709 13:01:16.451642  6920 raft_consensus.cc:493] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.467657  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:16.465942  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:16.479564  1673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49170 (request call id 2585) took 1097 ms. Trace:
I20260709 13:01:16.470278  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:16.470819  6867 leader_election.cc:290] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:16.466360  6876 raft_consensus.cc:740] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
W20260709 13:01:16.473423  7094 log.cc:927] Time spent T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.352s	user 0.000s	sys 0.001s
I20260709 13:01:16.473762  6920 raft_consensus.cc:515] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:16.474611  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43008 (request call id 2384) took 1270 ms. Trace:
I20260709 13:01:16.483590  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:16.483434  1673 rpcz_store.cc:276] 0709 13:01:15.386252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:15.386369 (+   117us) service_pool.cc:224] Handling call
0709 13:01:15.414948 (+ 28579us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:16.008314 (+593366us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:16.479338 (+471024us) spinlock_profiling.cc:243] Waited 494 ms on lock 0x7b54002fc954. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:01:16.479507 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1135343488}
W20260709 13:01:16.476822  7098 log.cc:927] Time spent T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.247s	user 0.000s	sys 0.000s
I20260709 13:01:16.486922  1526 rpcz_store.cc:276] 0709 13:01:15.203719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:15.662406 (+458687us) service_pool.cc:224] Handling call
0709 13:01:15.665301 (+  2895us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:15.776570 (+111269us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:16.474368 (+697798us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b540002c454. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:01:16.474554 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":251692416}
I20260709 13:01:16.488719  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:16.490068  6876 consensus_queue.cc:260] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:16.491288  6876 raft_consensus.cc:3060] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:01:16.496551  7059 log.cc:927] Time spent T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.855s	user 0.000s	sys 0.006s
I20260709 13:01:16.478930  6987 leader_election.cc:290] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:16.484226  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:16.497731  1677 raft_consensus.cc:2468] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 8.
I20260709 13:01:16.499367  2192 leader_election.cc:304] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:16.500697  7074 raft_consensus.cc:493] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:16.501384  7074 raft_consensus.cc:515] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:16.467324  6968 raft_consensus.cc:493] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:16.475749  1680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49170 (request call id 2586) took 1089 ms. Trace:
I20260709 13:01:16.500319  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36200 (request call id 2706) took 1348 ms. Trace:
I20260709 13:01:16.489295  1673 raft_consensus.cc:3060] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:01:16.504822  1680 rpcz_store.cc:276] 0709 13:01:15.386716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:15.386828 (+   112us) service_pool.cc:224] Handling call
0709 13:01:16.475563 (+1088735us) spinlock_profiling.cc:243] Waited 534 ms on lock 0x7b540010c554. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:01:16.475691 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1229214592}
I20260709 13:01:16.485198  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:16.505553  2192 leader_election.cc:304] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:01:16.508467  7074 leader_election.cc:290] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:16.509863  1680 raft_consensus.cc:1275] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:01:16.510607  1674 raft_consensus.cc:2468] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 15.
W20260709 13:01:16.513204  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:16.504987  1601 rpcz_store.cc:276] 0709 13:01:15.151665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:15.748277 (+596612us) service_pool.cc:224] Handling call
0709 13:01:15.748670 (+   393us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:16.019877 (+271207us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:01:16.034062 (+ 14185us) log.cc:844] Serialized 14 byte log entry
0709 13:01:16.136050 (+101988us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:16.136114 (+    64us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:01:16.136162 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:16.356144 (+219982us) spinlock_profiling.cc:243] Waited 16.1 ms on lock 0x7b4400022b4c. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a153ecc85 00007f6a153ed6a2 00007f6a1815f1db 00007f6a1815aaaf 00007f6a1814e86e 00007f6a1814dbb6 00007f6a1814d7d8 00007f6a18157221 00007f6a181571d9 00007f6a18157169
0709 13:01:16.490504 (+134360us) spinlock_profiling.cc:243] Waited 271 ms on lock 0x7b540039e754. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:01:16.490551 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:16.500265 (+  9714us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":31950,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":44,"raft.queue_time_us":2115,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":68756,"spinlock_wait_cycles":660179584,"thread_start_us":101613,"threads_started":1,"wal-append.queue_time_us":226343}
I20260709 13:01:16.504503  7026 raft_consensus.cc:493] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.519013  7026 raft_consensus.cc:515] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:16.521865  7065 raft_consensus.cc:2804] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:16.522346  7065 raft_consensus.cc:493] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:16.522732  7065 raft_consensus.cc:3060] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:16.504820  7040 raft_consensus.cc:2749] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:16.525849  7040 consensus_queue.cc:1048] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:01:16.527626  7026 leader_election.cc:290] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:16.540534  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:16.543989  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:16.545202  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:16.545729  1604 raft_consensus.cc:3060] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:16.506000  7038 raft_consensus.cc:493] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.511862  6968 raft_consensus.cc:3060] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:16.550334  7092 log.cc:927] Time spent T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.697s	user 0.002s	sys 0.001s
I20260709 13:01:16.554145  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:16.563710  1599 raft_consensus.cc:1275] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:01:16.555482  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:16.560679  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:16.574076  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:16.565501  2225 raft_consensus.cc:2468] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 8.
I20260709 13:01:16.583312  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:16.584234  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:16.586338  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:16.542493  7074 raft_consensus.cc:493] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:16.541895  7026 raft_consensus.cc:493] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:16.588930  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:16.589303  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:16.589237  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:16.590466  2218 raft_consensus.cc:2468] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 15.
I20260709 13:01:16.592338  2219 raft_consensus.cc:2393] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 12: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:01:16.592895  1604 raft_consensus.cc:2468] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 11.
I20260709 13:01:16.592630  2220 raft_consensus.cc:2410] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:01:16.554232  7025 raft_consensus.cc:493] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
W20260709 13:01:16.597491  2191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:16.594429  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:16.599174  1604 raft_consensus.cc:3060] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:16.564381  6939 raft_consensus.cc:493] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:16.599463  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:16.603760  1646 leader_election.cc:304] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:16.598809  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:16.600986  1673 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 17.
I20260709 13:01:16.563344  7038 raft_consensus.cc:515] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:16.611025  2223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50326 (request call id 1144) took 1317 ms. Trace:
I20260709 13:01:16.610975  2220 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0"
dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
mode: GRACEFUL
new_leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:47682
I20260709 13:01:16.612298  2220 raft_consensus.cc:606] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 16 LEADER]: Received request to transfer leadership to TS e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:16.607264  6939 raft_consensus.cc:515] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:16.612826  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36200 (request call id 2696) took 1548 ms. Trace:
I20260709 13:01:16.611552  2223 rpcz_store.cc:276] 0709 13:01:15.293982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:15.294114 (+   132us) service_pool.cc:224] Handling call
0709 13:01:15.295316 (+  1202us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:15.860864 (+565548us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:16.610797 (+749933us) spinlock_profiling.cc:243] Waited 398 ms on lock 0x7b540033e5d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:01:16.610969 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":915727744}
I20260709 13:01:16.613197  1607 rpcz_store.cc:276] 0709 13:01:15.064905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:15.192178 (+127273us) service_pool.cc:224] Handling call
0709 13:01:15.208804 (+ 16626us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:15.283765 (+ 74961us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:15.283796 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:15.289871 (+  6075us) log.cc:844] Serialized 26 byte log entry
0709 13:01:15.632058 (+342187us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:15.632136 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:16.612466 (+980330us) spinlock_profiling.cc:243] Waited 56.7 ms on lock 0x7b54001685d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:01:16.612511 (+    45us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:16.612557 (+    46us) raft_consensus.cc:1685] finished
0709 13:01:16.612570 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:16.612773 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":62321,"raft.queue_time_us":24142,"raft.run_cpu_time_us":221,"raft.run_wall_time_us":22794,"spinlock_wait_cycles":130524544,"thread_start_us":305686,"threads_started":1,"wal-append.queue_time_us":359663}
I20260709 13:01:16.618523  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36194 (request call id 2039) took 1081 ms. Trace:
I20260709 13:01:16.618959  1605 rpcz_store.cc:276] 0709 13:01:15.537048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:16.024076 (+487028us) service_pool.cc:224] Handling call
0709 13:01:16.027996 (+  3920us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:16.254030 (+226034us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:16.618297 (+364267us) spinlock_profiling.cc:243] Waited 184 ms on lock 0x7b540037e1d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:01:16.618464 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":424325376}
I20260709 13:01:16.620790  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:16.621560  1605 raft_consensus.cc:2468] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 8.
I20260709 13:01:16.622377  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:16.606771  7035 consensus_queue.cc:1048] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 13:01:16.625607  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:16.626135  1599 raft_consensus.cc:2468] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 15.
I20260709 13:01:16.593591  7026 raft_consensus.cc:515] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:16.627231  1530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43010 (request call id 2511) took 1421 ms. Trace:
I20260709 13:01:16.629475  1530 rpcz_store.cc:276] 0709 13:01:15.205864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:15.676571 (+470707us) service_pool.cc:224] Handling call
0709 13:01:15.676875 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:15.677223 (+   348us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:15.677252 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:15.677713 (+   461us) log.cc:844] Serialized 26 byte log entry
0709 13:01:15.848565 (+170852us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:15.848606 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:15.848671 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:16.528414 (+679743us) spinlock_profiling.cc:243] Waited 16.4 ms on lock 0x7b4400022b4c. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a153ecc85 00007f6a153ed6a2 00007f6a1815f1db 00007f6a1815aaaf 00007f6a1814e86e 00007f6a1814dbb6 00007f6a1814d7d8 00007f6a18157221 00007f6a181571d9 00007f6a18157169
0709 13:01:16.623368 (+ 94954us) raft_consensus.cc:1685] finished
0709 13:01:16.623393 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:16.627162 (+  3769us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49,"raft.queue_time_us":6784,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":84,"spinlock_wait_cycles":37742848,"thread_start_us":170498,"threads_started":1,"wal-append.queue_time_us":175325}
I20260709 13:01:16.627686  1605 raft_consensus.cc:1240] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:16.613250  6324 raft_consensus.cc:2804] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:16.620849  6922 raft_consensus.cc:493] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:16.632045  6324 raft_consensus.cc:697] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 11 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:16.632239  1604 raft_consensus.cc:2468] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 17.
I20260709 13:01:16.632597  6922 raft_consensus.cc:515] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:16.633128  6324 consensus_queue.cc:237] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:16.593318  7074 raft_consensus.cc:515] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:16.636437  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1152) took 1098 ms. Trace:
I20260709 13:01:16.636827  1603 rpcz_store.cc:276] 0709 13:01:15.537517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:15.676062 (+138545us) service_pool.cc:224] Handling call
0709 13:01:16.636245 (+960183us) spinlock_profiling.cc:243] Waited 99.8 ms on lock 0x7b540041fd54. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:01:16.636371 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":229472640}
I20260709 13:01:16.637655  7074 leader_election.cc:290] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:01:16.639477  7093 log.cc:927] Time spent T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.817s	user 0.001s	sys 0.001s
I20260709 13:01:16.599633  7025 raft_consensus.cc:515] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:16.647832  6874 raft_consensus.cc:3060] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:16.657351  6968 raft_consensus.cc:515] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:16.659876  1599 raft_consensus.cc:1275] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:01:16.662237  7016 raft_consensus.cc:3055] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:16.662705  7016 raft_consensus.cc:740] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:16.663556  7016 consensus_queue.cc:260] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:16.664526  7016 raft_consensus.cc:3060] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:16.668871  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:16.670267  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:01:16.678120  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 416224us
I20260709 13:01:16.679114  7105 raft_consensus.cc:2749] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:01:16.680624  1495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:16.680119  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 79321.3us
I20260709 13:01:16.682549  1679 raft_consensus.cc:2468] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 8.
I20260709 13:01:16.693011  1571 leader_election.cc:304] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
W20260709 13:01:16.689983  2192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:16.695623  1571 leader_election.cc:304] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:16.680147  6939 leader_election.cc:290] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:16.699872  2227 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59"
dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
mode: GRACEFUL
new_leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:47682
I20260709 13:01:16.700999  2227 raft_consensus.cc:606] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 14 LEADER]: Received request to transfer leadership to TS e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:01:16.727810  2191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:16.681609  6846 raft_consensus.cc:493] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.691990  6833 raft_consensus.cc:493] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.737406  6833 raft_consensus.cc:515] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:16.689921  6986 raft_consensus.cc:493] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.739033  6986 raft_consensus.cc:515] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:16.741115  6986 leader_election.cc:290] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:16.697801  7074 raft_consensus.cc:2749] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:16.700234  6658 raft_consensus.cc:2749] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:16.746912  6833 leader_election.cc:290] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:16.761394  6940 leader_election.cc:290] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:16.763931  6922 leader_election.cc:290] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:16.765244  7026 leader_election.cc:290] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:16.694206  6995 raft_consensus.cc:493] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.766165  6995 raft_consensus.cc:515] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:01:16.770359  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:16.770366  6968 leader_election.cc:290] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 10 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:16.770946  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:16.772543  7065 raft_consensus.cc:515] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:16.772656  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:16.774791  6846 raft_consensus.cc:515] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:16.775350  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:01:16.776108  7031 log.cc:927] Time spent T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 1.836s	user 0.010s	sys 0.006s
W20260709 13:01:16.776525  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 93086us
I20260709 13:01:16.777333  1497 leader_election.cc:304] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:16.777645  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:16.778875  6995 leader_election.cc:290] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:16.731676  7089 consensus_queue.cc:1059] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 15.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:01:16.779611  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:01:16.780457  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 46416.3us
I20260709 13:01:16.781330  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:16.781827  6920 leader_election.cc:290] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:16.782744  1497 leader_election.cc:304] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:16.783172  6950 raft_consensus.cc:3060] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:16.783257  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:16.784124  6987 raft_consensus.cc:2804] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:16.784556  6987 raft_consensus.cc:493] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:16.784911  6987 raft_consensus.cc:3060] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:16.785027  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:16.776830  2222 raft_consensus.cc:2393] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 11: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:01:16.786245  1430 catalog_manager.cc:5697] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 11 to 13, pending config changed. New cstate: current_term: 13 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } } pending_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:01:16.788954  6846 leader_election.cc:290] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:16.780406  7089 raft_consensus.cc:3055] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:16.795403  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:16.781433  1496 leader_election.cc:304] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:16.794286  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:16.798831  2219 raft_consensus.cc:2410] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:01:16.800760  1496 leader_election.cc:304] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:16.795548  1644 leader_election.cc:304] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:16.802723  1644 leader_election.cc:304] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:16.799177  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:16.803967  2224 raft_consensus.cc:2393] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 10: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
W20260709 13:01:16.804773  2192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:16.807251  1644 leader_election.cc:304] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:16.808521  1644 leader_election.cc:304] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:16.812397  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:16.813509  1644 leader_election.cc:304] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:16.814683  2218 raft_consensus.cc:2468] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 11.
I20260709 13:01:16.814282  1496 leader_election.cc:304] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:16.800442  1430 catalog_manager.cc:5697] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 9 to 14, leader changed from b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) to e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193). New cstate: current_term: 14 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:16.816102  1496 leader_election.cc:304] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:16.789664  7065 leader_election.cc:290] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:16.816506  6926 raft_consensus.cc:2749] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:16.819051  6939 raft_consensus.cc:2749] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:16.794283  7106 consensus_queue.cc:1048] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:01:16.819797  7105 raft_consensus.cc:2804] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:16.820227  7105 raft_consensus.cc:493] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:16.820554  7105 raft_consensus.cc:3060] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:16.798051  7089 raft_consensus.cc:740] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:16.823173  1644 leader_election.cc:304] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:16.832144  2227 raft_consensus.cc:1240] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 18 LEADER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 13:01:16.836619  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:16.840638  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:16.842492  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:16.812424  6940 raft_consensus.cc:2804] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:16.813614  6876 raft_consensus.cc:2749] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:16.813124  6833 raft_consensus.cc:2804] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:16.813295  6920 raft_consensus.cc:2749] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:16.833424  7036 raft_consensus.cc:2804] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:16.855430  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:16.843487  6939 raft_consensus.cc:2804] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:16.842890  6846 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.853598  1430 catalog_manager.cc:5697] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 11 to 12, leader changed from e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 12 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } }
I20260709 13:01:16.852963  6833 raft_consensus.cc:493] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:16.850467  6940 raft_consensus.cc:493] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:16.865254  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:16.852782  7026 raft_consensus.cc:2749] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:16.866545  1430 catalog_manager.cc:5697] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:01:16.870751  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:16.870957  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:16.867141  6613 raft_consensus.cc:493] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.871922  6922 consensus_queue.cc:1048] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:16.877007  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:16.877592  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:16.856626  7036 raft_consensus.cc:493] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:16.879684  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:16.923933  1526 raft_consensus.cc:3060] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:16.907384  7089 consensus_queue.cc:260] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:16.925513  7089 raft_consensus.cc:3060] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:16.880441  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:16.923482  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:16.928756  2220 raft_consensus.cc:1240] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:01:16.869720  6940 raft_consensus.cc:3060] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:16.881697  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:16.936630  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:16.882769  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:16.937608  1523 raft_consensus.cc:3060] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:16.884114  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:16.888113  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:16.913945  1530 raft_consensus.cc:2468] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 13.
I20260709 13:01:16.878624  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:16.915140  6613 raft_consensus.cc:515] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:16.918395  6919 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:16.918675  1497 leader_election.cc:304] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:16.857275  6939 raft_consensus.cc:493] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:16.863157  6833 raft_consensus.cc:3060] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:16.929931  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:16.880477  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:16.933936  1526 raft_consensus.cc:2468] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 11.
I20260709 13:01:16.856930  6926 consensus_queue.cc:1048] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 13:01:16.939615  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:16.973377  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:17.145308  1530 raft_consensus.cc:2468] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 13.
I20260709 13:01:16.976599  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:16.978273  7038 leader_election.cc:290] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:17.027855  1430 catalog_manager.cc:5697] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 9 to 10, leader changed from ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) to e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193). New cstate: current_term: 10 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:17.148633  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:17.035243  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:16.927193  7036 raft_consensus.cc:3060] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:16.865353  6846 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:16.926862  6950 raft_consensus.cc:2749] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:16.865082  6876 consensus_queue.cc:1048] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.064s
I20260709 13:01:16.938623  1524 raft_consensus.cc:2468] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 11.
I20260709 13:01:17.128031  1572 leader_election.cc:304] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
W20260709 13:01:17.175024  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 47133.1us
I20260709 13:01:17.176287  1572 leader_election.cc:304] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
W20260709 13:01:17.128978  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 373795us
I20260709 13:01:17.175053  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 13:01:17.059165  7042 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.222s	user 0.022s	sys 0.018s
I20260709 13:01:17.146638  1529 raft_consensus.cc:2368] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for earlier term 16. Current term is 17.
W20260709 13:01:17.145002  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 226445us
I20260709 13:01:17.141791  7106 raft_consensus.cc:493] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:17.155510  1523 raft_consensus.cc:2468] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 17.
I20260709 13:01:17.156833  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:17.158264  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:17.159268  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:17.162261  2226 raft_consensus.cc:2468] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 13.
I20260709 13:01:17.168001  7105 raft_consensus.cc:515] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:17.173768  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:17.177213  1524 raft_consensus.cc:2468] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 8.
W20260709 13:01:17.192991  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:17.195849  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:17.197356  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:17.147722  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:17.144480  6939 raft_consensus.cc:3060] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:17.155066  7085 log.cc:927] Time spent T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 1.334s	user 0.000s	sys 0.012s
I20260709 13:01:17.182468  1644 leader_election.cc:304] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:17.206794  1644 leader_election.cc:304] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:01:17.185614  1532 raft_consensus.cc:2393] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 13: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:01:17.147729  6956 raft_consensus.cc:2749] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:17.189775  2225 raft_consensus.cc:3060] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:01:17.179168  7042 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.342s	user 0.023s	sys 0.018s
I20260709 13:01:17.198488  1526 raft_consensus.cc:2468] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 8.
I20260709 13:01:17.204209  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:17.184892  1525 raft_consensus.cc:2468] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 19.
W20260709 13:01:17.211921  2192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:17.213249  1430 catalog_manager.cc:5697] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } }
I20260709 13:01:17.216746  1430 catalog_manager.cc:5697] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 9 to 10, leader changed from 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 10 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } }
I20260709 13:01:17.221184  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:17.221962  1530 raft_consensus.cc:2468] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 16.
I20260709 13:01:17.224136  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:17.225291  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:17.226204  1529 raft_consensus.cc:2410] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for term 14 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:01:17.227316  1527 raft_consensus.cc:2368] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for earlier term 11. Current term is 12.
I20260709 13:01:17.182273  7075 raft_consensus.cc:2749] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:17.227988  1430 catalog_manager.cc:5697] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 9 to 10, leader changed from 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 10 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } }
I20260709 13:01:17.230919  1646 leader_election.cc:304] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:17.240658  2225 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 17.
I20260709 13:01:17.242302  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36200 (request call id 2702) took 2165 ms. Trace:
I20260709 13:01:17.243186  1602 rpcz_store.cc:276] 0709 13:01:15.077031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:15.329051 (+252020us) service_pool.cc:224] Handling call
0709 13:01:15.330728 (+  1677us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:16.229250 (+898522us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:17.237077 (+1007827us) spinlock_profiling.cc:243] Waited 877 ms on lock 0x7b54001a9fd4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:01:17.242228 (+  5151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2016636160}
I20260709 13:01:17.212412  6874 raft_consensus.cc:493] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.304456  6874 raft_consensus.cc:515] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:17.305380  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50664 (request call id 1315) took 1519 ms. Trace:
I20260709 13:01:17.305809  1677 rpcz_store.cc:276] 0709 13:01:15.786160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:16.498374 (+712214us) service_pool.cc:224] Handling call
0709 13:01:16.498691 (+   317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:16.506256 (+  7565us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:01:16.506286 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:16.515039 (+  8753us) log.cc:844] Serialized 26 byte log entry
0709 13:01:16.551155 (+ 36116us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:16.551199 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:17.304908 (+753709us) spinlock_profiling.cc:243] Waited 5.17 ms on lock 0x7b54000a4954. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:01:17.304968 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:17.305018 (+    50us) raft_consensus.cc:1685] finished
0709 13:01:17.305032 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:17.305311 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1993,"raft.queue_time_us":3141,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":76,"spinlock_wait_cycles":11897728,"thread_start_us":23913,"threads_started":1,"wal-append.queue_time_us":85605}
I20260709 13:01:17.195395  7106 raft_consensus.cc:515] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:17.253741  6995 raft_consensus.cc:2749] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:17.258327  6324 raft_consensus.cc:2804] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:17.263697  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:17.318725  2224 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "317204271cc04f68818b36450c9725b1"
dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
mode: GRACEFUL
new_leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:47682
I20260709 13:01:17.268126  7105 leader_election.cc:290] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:17.271382  1430 catalog_manager.cc:5697] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:01:17.288882  6846 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:17.216820  7025 leader_election.cc:290] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:01:17.298827  7056 log.cc:927] Time spent T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 1.973s	user 0.002s	sys 0.010s
I20260709 13:01:17.299371  7035 raft_consensus.cc:2749] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:17.301221  6613 leader_election.cc:290] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:17.303174  6937 raft_consensus.cc:2749] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:01:17.313947  1674 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50664 (request call id 1311) took 1679 ms (client timeout 1557 ms). Trace:
I20260709 13:01:17.249756  6943 raft_consensus.cc:493] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:17.320413  2224 raft_consensus.cc:606] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 10 LEADER]: Received request to transfer leadership to TS e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:17.322757  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:17.321983  1527 raft_consensus.cc:1275] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 14. (term mismatch)
I20260709 13:01:17.332510  1527 pending_rounds.cc:85] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting all ops after (but not including) 13
I20260709 13:01:17.332803  1527 pending_rounds.cc:107] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting uncommitted NO_OP operation due to leader change: 17.14
I20260709 13:01:17.333031  1527 raft_consensus.cc:2889] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:17.326473  1430 catalog_manager.cc:5697] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 8 to 11, leader changed from 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) to e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193). New cstate: current_term: 11 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } }
W20260709 13:01:17.330120  1674 rpcz_store.cc:269] 0709 13:01:15.634193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:15.636335 (+  2142us) service_pool.cc:224] Handling call
0709 13:01:17.313741 (+1677406us) spinlock_profiling.cc:243] Waited 873 ms on lock 0x7b540031d3d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:01:17.313873 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2008663936}
I20260709 13:01:17.334295  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:17.306627  6874 leader_election.cc:290] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:17.319229  6978 raft_consensus.cc:493] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.336365  1527 raft_consensus.cc:2468] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 13.
I20260709 13:01:17.321638  6324 raft_consensus.cc:493] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:17.342013  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
W20260709 13:01:17.330070  6987 consensus_meta.cc:287] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent flushing consensus metadata: real 0.524s	user 0.001s	sys 0.008s
I20260709 13:01:17.344082  1430 catalog_manager.cc:5697] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 6 to 7, leader changed from b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) to e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193). New cstate: current_term: 7 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:17.355121  1527 pending_rounds.cc:85] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting all ops after (but not including) 7
I20260709 13:01:17.356264  1527 pending_rounds.cc:107] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 13:01:17.356570  1527 raft_consensus.cc:2889] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:01:17.356634  2192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:17.357203  2192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:17.387106  1529 raft_consensus.cc:1240] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:17.396281  6613 raft_consensus.cc:493] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.396978  6613 raft_consensus.cc:515] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:17.397855  6833 raft_consensus.cc:515] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:17.399330  6613 leader_election.cc:290] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:17.350735  6324 raft_consensus.cc:3060] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:17.407574  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:17.410277  1676 raft_consensus.cc:2468] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 10.
I20260709 13:01:17.412578  2224 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751"
dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
mode: GRACEFUL
new_leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:47682
I20260709 13:01:17.413178  2224 raft_consensus.cc:606] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Received request to transfer leadership to TS e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:17.413789  2224 raft_consensus.cc:614] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:17.415359  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50664 (request call id 1305) took 2332 ms. Trace:
I20260709 13:01:17.406009  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:17.418111  1677 raft_consensus.cc:3060] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:01:17.413362  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:17.336058  6943 raft_consensus.cc:515] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:17.415776  1681 rpcz_store.cc:276] 0709 13:01:15.077969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:15.080355 (+  2386us) service_pool.cc:224] Handling call
0709 13:01:15.080737 (+   382us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:15.081110 (+   373us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:15.081136 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:15.081655 (+   519us) log.cc:844] Serialized 26 byte log entry
0709 13:01:15.237463 (+155808us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:15.237508 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:15.237593 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:17.214254 (+1976661us) spinlock_profiling.cc:243] Waited 7.26 ms on lock 0x7b4400022b4c. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a153ecc85 00007f6a153ed6a2 00007f6a1815f1db 00007f6a1815aaaf 00007f6a1814e86e 00007f6a1814dbb6 00007f6a1814d7d8 00007f6a18157221 00007f6a181571d9 00007f6a18157169
0709 13:01:17.401417 (+187163us) raft_consensus.cc:1685] finished
0709 13:01:17.401440 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:17.410423 (+  8983us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3001,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":81,"spinlock_wait_cycles":16692480,"thread_start_us":155388,"threads_started":1,"wal-append.queue_time_us":182664}
I20260709 13:01:17.434911  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:17.438225  1673 raft_consensus.cc:2468] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 8.
I20260709 13:01:17.446306  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:17.408442  6965 raft_consensus.cc:493] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.447556  1430 catalog_manager.cc:5697] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } }
I20260709 13:01:17.400557  7106 leader_election.cc:290] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:17.455473  1430 catalog_manager.cc:5697] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 6 to 7, leader changed from e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 7 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } }
I20260709 13:01:17.457589  1677 raft_consensus.cc:2468] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 12.
W20260709 13:01:17.458949  1679 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.013s	sys 0.025s
I20260709 13:01:17.353852  6978 raft_consensus.cc:515] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:17.463109  1523 raft_consensus.cc:2393] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 10: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:01:17.406351  6987 raft_consensus.cc:515] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:17.462028  1679 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.013s	sys 0.025s
I20260709 13:01:17.469079  2224 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02"
dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
mode: GRACEFUL
new_leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:47682
I20260709 13:01:17.469702  2224 raft_consensus.cc:606] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 18 LEADER]: Received request to transfer leadership to TS e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:17.471552  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:17.472404  1530 raft_consensus.cc:2393] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 12: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
W20260709 13:01:17.476425  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 269745us
I20260709 13:01:17.477047  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:17.478503   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:01:17.491092   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:17.480515  1529 raft_consensus.cc:1240] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 17. Current term is 18. Ops: []
I20260709 13:01:17.489362  1496 leader_election.cc:304] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:17.460428  6965 raft_consensus.cc:515] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:17.503044  1675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49170 (request call id 2592) took 1870 ms. Trace:
I20260709 13:01:17.504845  1675 rpcz_store.cc:276] 0709 13:01:15.632253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:16.495195 (+862942us) service_pool.cc:224] Handling call
0709 13:01:17.313876 (+818681us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:17.314082 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:17.314119 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:17.314160 (+    41us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:01:17.314190 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:17.314242 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:17.502863 (+188621us) spinlock_profiling.cc:243] Waited 818 ms on lock 0x7b540031d3d0. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b28ad 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:01:17.502983 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1882211584}
W20260709 13:01:17.506515  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 275703us
I20260709 13:01:17.491019  1644 leader_election.cc:304] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:17.508519  1680 raft_consensus.cc:1275] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:01:17.505314  6613 raft_consensus.cc:2804] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:17.508548  1644 leader_election.cc:304] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:17.510684  6613 raft_consensus.cc:697] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:17.505671  1430 catalog_manager.cc:5697] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
W20260709 13:01:17.517050  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 243628us
I20260709 13:01:17.517976  1497 leader_election.cc:304] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:17.520681  1497 leader_election.cc:304] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:17.521183  1430 catalog_manager.cc:5697] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } }
W20260709 13:01:17.522152  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 345946us
W20260709 13:01:17.522904  1570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:17.517849  1644 leader_election.cc:400] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: Vote denied by peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931) with higher term. Message: Invalid argument: T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for earlier term 16. Current term is 17.
I20260709 13:01:17.512924  7038 raft_consensus.cc:2804] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:17.525519  1644 leader_election.cc:403] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:17.519548  7105 raft_consensus.cc:2749] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:17.519630  7129 raft_consensus.cc:2804] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:17.525110  6988 raft_consensus.cc:2749] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:17.531049  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:17.531719  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:17.538208  1602 raft_consensus.cc:3060] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:17.538821  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:17.539377  1606 raft_consensus.cc:2468] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 13.
I20260709 13:01:17.533548  1430 catalog_manager.cc:5697] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } }
I20260709 13:01:17.535796  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:17.527076  7038 raft_consensus.cc:493] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:17.529512  1644 leader_election.cc:304] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:17.524225  6878 consensus_queue.cc:1048] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 13:01:17.580921  1607 raft_consensus.cc:1275] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:01:17.582098  1430 catalog_manager.cc:5697] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 7 to 8, leader changed from 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 8 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } }
I20260709 13:01:17.555523  1602 raft_consensus.cc:2468] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 11.
I20260709 13:01:17.590284  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:17.591270  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:17.592052  1602 raft_consensus.cc:2410] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
W20260709 13:01:17.587036  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 57608.3us
I20260709 13:01:17.515789  6613 consensus_queue.cc:237] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 10.12, Last appended by leader: 12, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:17.588100  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:17.528095  1572 leader_election.cc:304] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
W20260709 13:01:17.529875  6940 consensus_meta.cc:287] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent flushing consensus metadata: real 0.533s	user 0.010s	sys 0.000s
I20260709 13:01:17.581025  6898 raft_consensus.cc:493] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
W20260709 13:01:17.597728  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 69736.7us
I20260709 13:01:17.599052  6898 raft_consensus.cc:515] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:17.592824  1644 leader_election.cc:400] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 pre-election: Vote denied by peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931) with higher term. Message: Invalid argument: T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for earlier term 11. Current term is 12.
I20260709 13:01:17.581514  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:17.600088  1605 raft_consensus.cc:2468] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 14.
I20260709 13:01:17.527330  7089 raft_consensus.cc:493] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.598124  7016 raft_consensus.cc:2804] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:01:17.598255  6995 raft_consensus.cc:2804] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:17.525331  6890 consensus_queue.cc:1059] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 13:01:17.580696  7129 raft_consensus.cc:697] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 17 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:17.600987  1570 leader_election.cc:304] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:17.601886  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:01:17.535230  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 209507us
I20260709 13:01:17.589859  6956 raft_consensus.cc:493] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:17.530160  7035 raft_consensus.cc:2749] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931) with higher term. Message: Invalid argument: T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for earlier term 16. Current term is 17.
I20260709 13:01:17.604123  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:17.604939  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:17.605253  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: true dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:17.601893  1572 leader_election.cc:304] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:17.542872  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:17.635406  1599 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 16.
I20260709 13:01:17.636418  1572 leader_election.cc:304] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:01:17.637781  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:17.612815  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:17.639245  1599 raft_consensus.cc:2468] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 13.
I20260709 13:01:17.640576  7075 raft_consensus.cc:2804] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:17.641048  7075 raft_consensus.cc:493] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:17.641414  7075 raft_consensus.cc:3060] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:17.641691  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:17.600988  1644 leader_election.cc:403] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:01:17.643296  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 50635.3us
I20260709 13:01:17.644433  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:17.590217  7004 raft_consensus.cc:493] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:17.646515  1606 raft_consensus.cc:2393] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 15: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:01:17.629452  1570 leader_election.cc:304] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:17.615332  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:17.601464  6878 consensus_queue.cc:1243] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer ddf11fc190dd4b898773379c6b129d90 log is divergent from this leader: its last log entry 18.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:01:17.593578  6943 leader_election.cc:290] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:17.647671  1570 leader_election.cc:304] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:17.602444  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:17.649139  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:17.650228  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:17.639454  1598 raft_consensus.cc:2368] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 10. Current term is 11.
I20260709 13:01:17.650607  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:17.650911  1603 raft_consensus.cc:3060] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:17.651552  1602 raft_consensus.cc:2468] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 13.
I20260709 13:01:17.651738  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:17.652942  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:17.653689  1598 raft_consensus.cc:2410] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:01:17.656931  1605 raft_consensus.cc:2468] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 12.
I20260709 13:01:17.659440  6890 raft_consensus.cc:3055] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:17.669497  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:17.671379  1677 raft_consensus.cc:2468] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 15.
I20260709 13:01:17.671474  1605 raft_consensus.cc:1240] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:01:17.682050  7134 raft_consensus.cc:2749] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931) with higher term. Message: Invalid argument: T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for earlier term 11. Current term is 12.
W20260709 13:01:17.683018  7126 log.cc:927] Time spent T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.201s	user 0.001s	sys 0.000s
I20260709 13:01:17.614233  7089 raft_consensus.cc:515] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:17.606207  7016 raft_consensus.cc:493] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:17.684026  1607 raft_consensus.cc:2376] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 10. Re-sending same reply.
I20260709 13:01:17.684303  7016 raft_consensus.cc:3060] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:17.685143  7089 leader_election.cc:290] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:17.687316  6898 leader_election.cc:290] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:17.689863  7132 raft_consensus.cc:2764] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:01:17.690770  7129 consensus_queue.cc:237] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:01:17.691844  7127 log.cc:927] Time spent T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:01:17.663534  6956 raft_consensus.cc:515] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:17.649137  6978 leader_election.cc:290] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:17.695305  6956 leader_election.cc:290] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:17.690770  7004 raft_consensus.cc:515] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:17.537357  7106 raft_consensus.cc:493] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:17.603777  6833 leader_election.cc:290] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:17.701366  1679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49170 (request call id 2606) took 1009 ms. Trace:
I20260709 13:01:17.612178  6995 raft_consensus.cc:493] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:17.702966  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 159370us
I20260709 13:01:17.707158  1600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1163) took 1203 ms. Trace:
I20260709 13:01:17.712679  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:17.717190  1523 raft_consensus.cc:1275] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:01:17.713343  1680 raft_consensus.cc:2393] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 17: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:01:17.714890  1529 raft_consensus.cc:1240] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 15. Current term is 16. Ops: []
W20260709 13:01:17.689785  7036 consensus_meta.cc:287] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent flushing consensus metadata: real 0.516s	user 0.005s	sys 0.002s
I20260709 13:01:17.717319  1602 raft_consensus.cc:3060] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:17.612713  7038 raft_consensus.cc:3060] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:17.705637  1679 rpcz_store.cc:276] 0709 13:01:16.691991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:16.805471 (+113480us) service_pool.cc:224] Handling call
0709 13:01:16.805769 (+   298us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:16.833936 (+ 28167us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:16.833984 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:16.844963 (+ 10979us) log.cc:844] Serialized 52 byte log entry
0709 13:01:17.469256 (+624293us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:17.469298 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:17.469374 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:17.701137 (+231763us) raft_consensus.cc:1685] finished
0709 13:01:17.701160 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:17.701295 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1176,"raft.queue_time_us":1958,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":30650,"thread_start_us":601109,"threads_started":1,"wal-append.queue_time_us":676963}
W20260709 13:01:17.712549  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 202728us
I20260709 13:01:17.639756  6658 raft_consensus.cc:2804] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:17.669028  7072 raft_consensus.cc:2749] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:01:17.672634  7070 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.377s	user 0.018s	sys 0.013s
I20260709 13:01:17.715938  1600 rpcz_store.cc:276] 0709 13:01:16.503444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:16.503586 (+   142us) service_pool.cc:224] Handling call
0709 13:01:16.636389 (+132803us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:16.636732 (+   343us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:16.636760 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:16.637210 (+   450us) log.cc:844] Serialized 26 byte log entry
0709 13:01:16.836891 (+199681us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:01:16.853316 (+ 16425us) log.cc:844] Serialized 14 byte log entry
0709 13:01:16.853607 (+   291us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:16.853688 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:17.285139 (+431451us) raft_consensus.cc:1685] finished
0709 13:01:17.285161 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:17.706982 (+421821us) spinlock_profiling.cc:243] Waited 132 ms on lock 0x7b540041fd50. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b28ad 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:01:17.707095 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":16091,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":1112,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":2208,"spinlock_wait_cycles":304709888,"thread_start_us":199349,"threads_started":1,"wal-append.queue_time_us":562688}
I20260709 13:01:17.727102  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:17.700119  6987 leader_election.cc:290] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 18 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:17.731395  1673 raft_consensus.cc:2393] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 16: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:01:17.609076  6940 raft_consensus.cc:515] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:17.700083  6890 raft_consensus.cc:740] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:17.726145  1496 leader_election.cc:304] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
W20260709 13:01:17.729692  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:17.698267  6939 raft_consensus.cc:515] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:17.719681  6995 raft_consensus.cc:3060] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:17.739696  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:17.721634  1603 raft_consensus.cc:2468] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 16.
I20260709 13:01:17.741291  1598 raft_consensus.cc:1275] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:01:17.733071  7070 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.438s	user 0.019s	sys 0.014s
I20260709 13:01:17.714564  7004 leader_election.cc:290] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:17.645889  1599 raft_consensus.cc:2468] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 11.
I20260709 13:01:17.727128  6658 raft_consensus.cc:493] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:17.719837  7106 raft_consensus.cc:515] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:17.719199  6978 consensus_queue.cc:1048] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:01:17.778439  6939 leader_election.cc:290] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:17.780467  1646 leader_election.cc:304] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:17.786171  1528 raft_consensus.cc:2393] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 18: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:01:17.778992  1678 raft_consensus.cc:3060] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:17.728982  7074 raft_consensus.cc:2764] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:01:17.793102  1602 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 17.
I20260709 13:01:17.732226  7134 consensus_queue.cc:1048] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.065s
I20260709 13:01:17.805092  1646 leader_election.cc:304] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:17.781157  6987 raft_consensus.cc:2804] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:17.793520  6658 raft_consensus.cc:3060] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:17.726459  7036 raft_consensus.cc:515] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:17.747104  6324 raft_consensus.cc:515] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:17.795544  6965 leader_election.cc:290] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:17.805181  6939 raft_consensus.cc:2749] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:01:17.795608  7025 consensus_queue.cc:1059] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 13:01:17.814338  1678 raft_consensus.cc:2468] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 10.
I20260709 13:01:17.815196  6987 raft_consensus.cc:493] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:17.818841  6938 raft_consensus.cc:2749] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:01:17.835582  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 187993us
I20260709 13:01:17.837733  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:17.795672  6937 consensus_queue.cc:1048] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:01:17.842027  1531 raft_consensus.cc:2393] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 17: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:01:17.845170  1525 raft_consensus.cc:2368] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for earlier term 9. Current term is 10.
I20260709 13:01:17.849960  1681 raft_consensus.cc:1240] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:17.855788  1644 leader_election.cc:400] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 election: Vote denied by peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931) with higher term. Message: Invalid argument: T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for earlier term 9. Current term is 10.
I20260709 13:01:17.856155  1644 leader_election.cc:403] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:01:17.861595  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:17.843757  6987 raft_consensus.cc:3060] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:17.864315  1570 leader_election.cc:304] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:01:17.837369  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 189708us
I20260709 13:01:17.938387  1532 raft_consensus.cc:1240] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 17. Current term is 18. Ops: []
I20260709 13:01:17.946880  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:17.947103  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:01:17.952806  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 88601.5us
I20260709 13:01:17.953588  1570 leader_election.cc:304] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:17.954648  1603 raft_consensus.cc:1275] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:01:17.947619  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:17.948688  1601 raft_consensus.cc:1275] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:01:17.949635  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:17.899870  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:17.862917  6938 raft_consensus.cc:2749] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931) with higher term. Message: Invalid argument: T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for earlier term 9. Current term is 10.
I20260709 13:01:17.864852  6878 raft_consensus.cc:493] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.963567  1528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43010 (request call id 2520) took 1073 ms. Trace:
I20260709 13:01:17.964290  1528 rpcz_store.cc:276] 0709 13:01:16.870052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:16.870426 (+   374us) service_pool.cc:224] Handling call
0709 13:01:17.901241 (+1030815us) spinlock_profiling.cc:243] Waited 871 ms on lock 0x7b54001ff9d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:01:17.942442 (+ 41201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2004341504}
I20260709 13:01:17.826452  6890 consensus_queue.cc:260] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:17.973901  1607 raft_consensus.cc:2368] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for earlier term 16. Current term is 17.
W20260709 13:01:18.000553  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 45610.3us
I20260709 13:01:17.963732  6950 raft_consensus.cc:493] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.963335  7089 raft_consensus.cc:2749] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:18.013329  7089 consensus_queue.cc:1048] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:17.963532  7072 raft_consensus.cc:2749] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:01:18.007813  7142 log.cc:927] Time spent T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
I20260709 13:01:18.008041  7106 leader_election.cc:290] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:18.009824  2223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 1070) took 1216 ms. Trace:
I20260709 13:01:18.011539  7130 raft_consensus.cc:493] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.012399  7040 raft_consensus.cc:993] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b: : Instructing follower e46412b3b0b44f01ad5c33d4cfe3d6b1 to start an election
I20260709 13:01:18.022744  7040 raft_consensus.cc:1081] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 16 LEADER]: Signalling peer e46412b3b0b44f01ad5c33d4cfe3d6b1 to start an election
I20260709 13:01:17.993597  7004 raft_consensus.cc:493] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.023839  7004 raft_consensus.cc:515] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:18.019980  2223 rpcz_store.cc:276] 0709 13:01:16.793371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:16.793507 (+   136us) service_pool.cc:224] Handling call
0709 13:01:16.795191 (+  1684us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:16.799337 (+  4146us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:16.799366 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:17.530261 (+730895us) spinlock_profiling.cc:243] Waited 5 ms on lock 0x7b2c00047ae8. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a16eaca11 00007f6a16ebc372 00007f6a185eea01 00007f6a185b343a 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2
0709 13:01:17.530630 (+   369us) log.cc:844] Serialized 26 byte log entry
0709 13:01:17.781467 (+250837us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:17.781711 (+   244us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:17.781968 (+   257us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:18.009498 (+227530us) raft_consensus.cc:1685] finished
0709 13:01:18.009516 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:18.009760 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3746,"raft.queue_time_us":4794,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":12607,"spinlock_wait_cycles":13436032,"thread_start_us":239068,"threads_started":1,"wal-append.queue_time_us":325639}
W20260709 13:01:18.034787  7136 log.cc:927] Time spent T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.237s	user 0.001s	sys 0.001s
W20260709 13:01:18.036051  7137 log.cc:927] Time spent T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.195s	user 0.000s	sys 0.003s
I20260709 13:01:18.040529  2221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 1076) took 1243 ms. Trace:
I20260709 13:01:18.040973  2221 rpcz_store.cc:276] 0709 13:01:16.797065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:16.797221 (+   156us) service_pool.cc:224] Handling call
0709 13:01:16.797579 (+   358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:16.799979 (+  2400us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:16.800007 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:17.301287 (+501280us) spinlock_profiling.cc:243] Waited 5.08 ms on lock 0x7b2c00047ae8. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a16eaca11 00007f6a16ebc372 00007f6a185eea01 00007f6a185b343a 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2
0709 13:01:17.301697 (+   410us) log.cc:844] Serialized 26 byte log entry
0709 13:01:17.524137 (+222440us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:17.524169 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:17.524232 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:18.035469 (+511237us) spinlock_profiling.cc:243] Waited 6.53 ms on lock 0x7b4400022b4c. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a153ecc85 00007f6a153ed6a2 00007f6a1815f1db 00007f6a1815aaaf 00007f6a1814e86e 00007f6a1814dbb6 00007f6a1814d7d8 00007f6a18157221 00007f6a181571d9 00007f6a18157169
0709 13:01:18.040312 (+  4843us) raft_consensus.cc:1685] finished
0709 13:01:18.040336 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:18.040471 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2017,"raft.queue_time_us":2420,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":10329,"spinlock_wait_cycles":27331200,"thread_start_us":222098,"threads_started":1,"wal-append.queue_time_us":494547}
I20260709 13:01:18.015542  6890 raft_consensus.cc:3060] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:17.995626  6878 raft_consensus.cc:515] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:18.016906  6950 raft_consensus.cc:515] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:18.125998  7016 raft_consensus.cc:515] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:01:18.132009  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 415914us
I20260709 13:01:18.134410  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:18.138644  1528 raft_consensus.cc:3060] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:01:18.132392  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 473314us
W20260709 13:01:18.140448  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 335433us
I20260709 13:01:18.081065  6959 raft_consensus.cc:493] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
W20260709 13:01:18.147714  2192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:18.149295  1646 leader_election.cc:304] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:18.155783  1646 leader_election.cc:304] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:01:18.158031  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:18.161710  1528 raft_consensus.cc:2468] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 14.
I20260709 13:01:18.130584  7132 consensus_queue.cc:1059] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:01:18.187911  2190 leader_election.cc:304] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:18.185997  1678 raft_consensus.cc:1240] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 20 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 19. Current term is 20. Ops: [15.10-19.12]
I20260709 13:01:18.136626  7134 raft_consensus.cc:493] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:18.193920  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:18.194641  1681 raft_consensus.cc:3060] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:18.199144  2190 leader_election.cc:304] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:18.201328  2190 leader_election.cc:304] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:18.191963  2191 leader_election.cc:304] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:18.151971  7036 leader_election.cc:290] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 17 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:18.183568  6938 raft_consensus.cc:2804] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:18.244431  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:18.191165  7026 raft_consensus.cc:2804] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:18.183734  6898 raft_consensus.cc:493] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.254308  1681 raft_consensus.cc:2410] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 18 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 13:01:18.184500  7053 raft_consensus.cc:493] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
W20260709 13:01:18.257189  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 65329.1us
I20260709 13:01:18.261729  7053 raft_consensus.cc:515] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:18.262521  2191 leader_election.cc:304] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:18.263432  7148 raft_consensus.cc:3055] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:18.263828  7148 raft_consensus.cc:740] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:18.263932  7053 leader_election.cc:290] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:18.191704  7025 raft_consensus.cc:493] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:18.159471  6959 raft_consensus.cc:515] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:18.261013  7157 consensus_queue.cc:1048] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:01:18.258244  6898 raft_consensus.cc:515] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:18.197196  7035 consensus_queue.cc:1048] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.051s
I20260709 13:01:18.281917  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:18.246337  6938 raft_consensus.cc:493] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:18.259636  6978 raft_consensus.cc:2749] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:18.188549  6324 leader_election.cc:290] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:18.255676  7026 raft_consensus.cc:493] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:18.268353  6943 raft_consensus.cc:493] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:18.278800  6968 raft_consensus.cc:2804] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:18.281561  7035 consensus_queue.cc:1243] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer 39a92f5a4352465d8af3af5908fe8642 log is divergent from this leader: its last log entry 11.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
W20260709 13:01:18.349633  1497 leader_election.cc:336] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Timed out: RequestConsensusVote RPC to 127.0.107.194:40303 timed out after 1.562s (SENT)
I20260709 13:01:18.207491  6846 raft_consensus.cc:2749] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:18.286428  6938 raft_consensus.cc:3060] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:18.211700  6956 raft_consensus.cc:493] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
W20260709 13:01:18.354600  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 353214us
I20260709 13:01:18.213042  7147 consensus_queue.cc:1048] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.093s
I20260709 13:01:18.300304  7026 raft_consensus.cc:3060] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:18.362097  1570 leader_election.cc:304] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:18.279685  7025 raft_consensus.cc:515] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:18.349244  7158 log.cc:927] Time spent T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:01:18.359472  6324 raft_consensus.cc:493] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:18.346356  7065 raft_consensus.cc:2804] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:18.376042  6324 raft_consensus.cc:515] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:18.376307  1570 leader_election.cc:304] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:18.352417  6968 raft_consensus.cc:493] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:18.386082  6968 raft_consensus.cc:3060] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:18.386363  6959 leader_election.cc:290] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:18.386986  6993 raft_consensus.cc:2749] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:18.391016  7016 leader_election.cc:290] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 20 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:18.391245  7155 consensus_queue.cc:1059] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:01:18.365271  6956 raft_consensus.cc:515] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:18.393378  6956 leader_election.cc:290] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:18.384964  6950 leader_election.cc:290] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:18.382778  7053 raft_consensus.cc:2749] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:18.382160  7065 raft_consensus.cc:493] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:18.385473  1570 leader_election.cc:304] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:18.365728  6874 raft_consensus.cc:2804] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:18.400396  6324 leader_election.cc:290] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:18.351267  6943 raft_consensus.cc:515] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:18.208539  7134 raft_consensus.cc:515] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:18.417485  1570 leader_election.cc:304] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:18.021790  7130 raft_consensus.cc:515] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:18.402796  7065 raft_consensus.cc:3060] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:18.432673  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 170235us
I20260709 13:01:18.436789  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:18.437767  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:18.438052  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:18.439265  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:18.438351  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:18.438720  2225 raft_consensus.cc:2410] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:01:18.264756  7148 consensus_queue.cc:260] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:18.440606  1570 leader_election.cc:304] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:18.439421  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:18.422551  6846 raft_consensus.cc:3055] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:01:18.441421  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 87803.2us
W20260709 13:01:18.434585  7075 consensus_meta.cc:287] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.790s	user 0.012s	sys 0.000s
I20260709 13:01:18.443694  2223 raft_consensus.cc:2468] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 8.
I20260709 13:01:18.425029  7132 raft_consensus.cc:2804] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:18.445027  1570 leader_election.cc:304] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:18.446516  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:18.450109  1529 raft_consensus.cc:3060] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:18.448047  1527 raft_consensus.cc:1240] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:18.448684  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 13:01:18.439531  6987 consensus_meta.cc:287] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent flushing consensus metadata: real 0.541s	user 0.007s	sys 0.003s
I20260709 13:01:18.435070  6878 leader_election.cc:290] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:01:18.453398  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 243549us
I20260709 13:01:18.458705  1570 leader_election.cc:304] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:18.462886  1646 leader_election.cc:400] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303) with higher term. Message: Invalid argument: T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for earlier term 16. Current term is 17.
I20260709 13:01:18.464795  6940 leader_election.cc:290] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 18 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:18.466423  7004 leader_election.cc:290] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:18.468832  1529 raft_consensus.cc:2468] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 20.
I20260709 13:01:18.469952  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
W20260709 13:01:18.470682  7151 log.cc:927] Time spent T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.346s	user 0.003s	sys 0.000s
I20260709 13:01:18.471134  1598 raft_consensus.cc:1240] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:18.472249  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:18.474942  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:01:18.475430  7152 log.cc:927] Time spent T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:01:18.443017  6993 raft_consensus.cc:2749] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:18.475651  1600 raft_consensus.cc:2468] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 16.
I20260709 13:01:18.476593  1603 pending_rounds.cc:85] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642: Aborting all ops after (but not including) 10
I20260709 13:01:18.477943  1603 pending_rounds.cc:107] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 13:01:18.478063  7134 leader_election.cc:290] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:18.478597  1603 raft_consensus.cc:2889] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:18.448935  7167 raft_consensus.cc:2749] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:18.449698  7132 raft_consensus.cc:493] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:18.481199  7132 raft_consensus.cc:3060] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:18.483052  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:18.449805  6874 raft_consensus.cc:697] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 10 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:18.487599  6874 consensus_queue.cc:237] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:18.490543  1644 leader_election.cc:304] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:18.442876  6922 raft_consensus.cc:3055] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:18.492678  1570 leader_election.cc:304] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:18.444470  6846 raft_consensus.cc:740] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:18.517679  1524 raft_consensus.cc:1240] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 16. Current term is 17. Ops: [14.8-16.9]
I20260709 13:01:18.511210  1570 leader_election.cc:304] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:18.517030  1531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43010 (request call id 2530) took 1633 ms. Trace:
W20260709 13:01:18.510303  6995 consensus_meta.cc:287] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.730s	user 0.007s	sys 0.004s
I20260709 13:01:18.512483  7134 raft_consensus.cc:2804] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:18.518735  1531 rpcz_store.cc:276] 0709 13:01:16.883753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:16.883884 (+   131us) service_pool.cc:224] Handling call
0709 13:01:18.516834 (+1632950us) spinlock_profiling.cc:243] Waited 902 ms on lock 0x7b54000fe454. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:01:18.516970 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2075087232}
W20260709 13:01:18.521190  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 244414us
W20260709 13:01:18.529767  1497 leader_election.cc:336] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Timed out: RequestConsensusVote RPC to 127.0.107.194:40303 timed out after 1.733s (SENT)
I20260709 13:01:18.529896  1529 raft_consensus.cc:1275] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:01:18.528733  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:18.532936  1531 raft_consensus.cc:2468] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 16.
I20260709 13:01:18.470796  7072 raft_consensus.cc:2749] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:18.475466  7148 raft_consensus.cc:3060] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:18.531190  1644 leader_election.cc:304] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
W20260709 13:01:18.535564  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 259175us
I20260709 13:01:18.508991  6878 raft_consensus.cc:2749] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:18.508589  6922 raft_consensus.cc:740] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:18.532011  1497 leader_election.cc:304] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:18.543123  1605 raft_consensus.cc:1275] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:01:18.543849  2192 leader_election.cc:304] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:01:18.548364  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:18.453800  6987 raft_consensus.cc:515] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:18.549332  1680 raft_consensus.cc:2410] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for term 19 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 13:01:18.451673  7075 raft_consensus.cc:515] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:18.556416  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:18.492524  7035 consensus_queue.cc:1048] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:01:18.533733  7149 raft_consensus.cc:2749] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:18.553046  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:18.505411  6937 consensus_queue.cc:1048] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:01:18.550016  1497 leader_election.cc:304] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:18.524418  7166 raft_consensus.cc:2804] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:18.534715  7074 raft_consensus.cc:493] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:18.557464  1680 raft_consensus.cc:2410] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 19 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 13:01:18.558938  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:18.539140  7134 raft_consensus.cc:697] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 14 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
W20260709 13:01:18.582971  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 55671.8us
W20260709 13:01:18.551694  6658 consensus_meta.cc:287] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.724s	user 0.007s	sys 0.004s
I20260709 13:01:18.588028  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:18.556454  6878 raft_consensus.cc:493] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:18.592967  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 61941us
I20260709 13:01:18.594841  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:18.595597  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:18.590973  1681 raft_consensus.cc:2468] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 11.
W20260709 13:01:18.597558  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 47635.2us
I20260709 13:01:18.601745  1497 leader_election.cc:304] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:18.534186  6995 raft_consensus.cc:515] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:18.598431  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:18.587518  7166 raft_consensus.cc:493] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:18.603618  1644 leader_election.cc:304] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:18.582782  7105 raft_consensus.cc:493] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.605877  2192 leader_election.cc:304] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:01:18.612021  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:18.605913  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:18.606156  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:18.630509  2192 leader_election.cc:304] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:01:18.631294  1497 leader_election.cc:304] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:18.631045  2227 raft_consensus.cc:2468] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 8.
I20260709 13:01:18.553714  7181 raft_consensus.cc:2804] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:18.640100  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:18.640173  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:18.643205  2225 raft_consensus.cc:2468] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 17.
I20260709 13:01:18.596699  7161 raft_consensus.cc:2804] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:01:18.670203  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:18.672633  2225 raft_consensus.cc:2468] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 13.
I20260709 13:01:18.606668  7106 raft_consensus.cc:2749] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:18.674183  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:18.587901  6959 consensus_queue.cc:1059] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.096s
I20260709 13:01:18.684952  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:18.680668  1674 raft_consensus.cc:1240] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 17. Current term is 18. Ops: []
I20260709 13:01:18.605240  7179 raft_consensus.cc:2804] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:18.717993  7179 raft_consensus.cc:493] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:18.718417  7179 raft_consensus.cc:3060] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:01:18.721062  6890 consensus_meta.cc:287] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent flushing consensus metadata: real 0.603s	user 0.008s	sys 0.000s
I20260709 13:01:18.723007  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 13:01:18.723685  7171 log.cc:927] Time spent T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:01:18.724362  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:18.563572  7173 consensus_queue.cc:1059] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.090s
W20260709 13:01:18.653142  7172 log.cc:927] Time spent T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 13:01:18.726588  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:18.717738  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:18.730962  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:18.632120  7153 raft_consensus.cc:2804] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:18.733517  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:18.733498  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:18.737005  2227 raft_consensus.cc:2368] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for earlier term 16. Current term is 17.
I20260709 13:01:18.734938  2220 raft_consensus.cc:2468] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 11.
I20260709 13:01:18.645493  6613 raft_consensus.cc:2749] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:18.652678  7175 raft_consensus.cc:2804] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:18.655236  7025 leader_election.cc:290] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:18.739355  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:18.647485  7174 raft_consensus.cc:493] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.638803  7166 raft_consensus.cc:3060] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:18.739445  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
W20260709 13:01:18.725805  7182 log.cc:927] Time spent T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
I20260709 13:01:18.646311  7181 raft_consensus.cc:493] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:18.583153  6846 consensus_queue.cc:260] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:18.628501  6878 raft_consensus.cc:515] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:18.743594  2222 raft_consensus.cc:2468] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 15.
I20260709 13:01:18.744789  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:18.739549  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:18.597242  7074 raft_consensus.cc:515] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:18.750626  7181 raft_consensus.cc:3060] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:18.757781  7074 leader_election.cc:290] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:18.759258  6987 leader_election.cc:290] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 15 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:18.723023  7146 raft_consensus.cc:3055] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:01:18.760120  7146 raft_consensus.cc:740] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:18.761399  7075 leader_election.cc:290] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:18.669885  6938 raft_consensus.cc:515] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:18.742223  7153 raft_consensus.cc:697] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 11 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:18.605288  6658 raft_consensus.cc:515] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:18.763676  7153 consensus_queue.cc:237] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:18.764134  7181 raft_consensus.cc:515] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:18.743549  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:18.639217  6978 consensus_queue.cc:1048] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.099s
I20260709 13:01:18.645143  7105 raft_consensus.cc:515] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:18.735168  7129 raft_consensus.cc:3060] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:01:18.743031  7163 log.cc:927] Time spent T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.297s	user 0.000s	sys 0.001s
I20260709 13:01:18.733982  7161 raft_consensus.cc:697] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 20 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:18.771118  6846 raft_consensus.cc:3060] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:18.772210  7181 leader_election.cc:290] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:18.773164  6995 leader_election.cc:290] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:18.773023  7179 raft_consensus.cc:515] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:18.744975  7175 raft_consensus.cc:493] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:18.766764  7139 raft_consensus.cc:493] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:18.751416  7174 raft_consensus.cc:515] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:18.788079  7175 raft_consensus.cc:3060] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:18.768319  7134 consensus_queue.cc:237] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:01:18.843469  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 212120us
I20260709 13:01:18.851503  1604 raft_consensus.cc:2368] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 8. Current term is 9.
I20260709 13:01:18.796777  7139 raft_consensus.cc:515] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:18.954818  1497 leader_election.cc:304] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
W20260709 13:01:18.752290  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 120579us
I20260709 13:01:18.956991  6658 leader_election.cc:290] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 16 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:18.812623  7174 leader_election.cc:290] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
W20260709 13:01:18.804255  7186 log.cc:927] Time spent T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:01:18.814203  7179 leader_election.cc:290] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 14 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:18.861193  6878 leader_election.cc:290] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:18.867472  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:18.764269  6938 leader_election.cc:290] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:18.802474  7161 consensus_queue.cc:237] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:18.871549  6987 raft_consensus.cc:493] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:18.962899  2223 raft_consensus.cc:3060] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:18.963523  6987 raft_consensus.cc:515] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:18.872639  7004 raft_consensus.cc:2749] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:01:18.875201  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:18.875950  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:18.876864  7035 raft_consensus.cc:493] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:18.879112  7025 raft_consensus.cc:493] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:18.846163  1605 raft_consensus.cc:2468] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 12.
I20260709 13:01:18.766426  6943 leader_election.cc:290] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:18.900961  7075 raft_consensus.cc:493] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.918270  1599 raft_consensus.cc:1240] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:18.920224  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:18.920403  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:18.921373  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:18.924661  1526 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0"
dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:49310
I20260709 13:01:18.932219  7190 raft_consensus.cc:493] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:18.966284  6987 leader_election.cc:290] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:18.969826  7035 raft_consensus.cc:515] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:18.973863  1526 raft_consensus.cc:493] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:18.972767  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:18.977051  1532 raft_consensus.cc:2393] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 17: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:01:18.977290  1531 raft_consensus.cc:2468] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 13.
I20260709 13:01:18.977780  1527 raft_consensus.cc:2468] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 13.
I20260709 13:01:18.979012  7075 raft_consensus.cc:515] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:18.981894  7075 leader_election.cc:290] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:18.982110  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:18.982820  1603 raft_consensus.cc:2468] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 16.
I20260709 13:01:18.976244  1526 raft_consensus.cc:3060] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:18.972787  7025 raft_consensus.cc:515] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:18.991394  7038 consensus_meta.cc:287] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 1.252s	user 0.011s	sys 0.004s
I20260709 13:01:18.992658  7025 leader_election.cc:290] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:18.997195  7105 leader_election.cc:290] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:19.000166  7175 raft_consensus.cc:515] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:19.005077  7185 raft_consensus.cc:2749] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:01:19.005378  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 50903.2us
I20260709 13:01:19.008692  7035 leader_election.cc:290] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:19.000480  7190 raft_consensus.cc:515] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:19.021035  7190 leader_election.cc:290] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:19.025460  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:01:19.034247  7026 consensus_meta.cc:287] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.651s	user 0.005s	sys 0.016s
I20260709 13:01:19.026396  1607 raft_consensus.cc:2468] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 13.
I20260709 13:01:19.044399  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:01:19.045346  2192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:19.047747  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 13:01:19.048615  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:19.049520  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:19.045388  1601 raft_consensus.cc:2468] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 13.
I20260709 13:01:19.053505  1526 raft_consensus.cc:515] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:19.018532  7065 consensus_meta.cc:287] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b: Time spent flushing consensus metadata: real 0.575s	user 0.006s	sys 0.009s
W20260709 13:01:19.064230  7148 consensus_meta.cc:287] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.521s	user 0.014s	sys 0.004s
I20260709 13:01:19.067606  2226 raft_consensus.cc:1240] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:19.066632  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:18.992072  7038 raft_consensus.cc:515] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:19.071614  1673 raft_consensus.cc:2468] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 15.
I20260709 13:01:19.077571  7175 leader_election.cc:290] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:19.086910  1526 leader_election.cc:290] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 17 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:19.090015  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 13:01:19.094415  6968 consensus_meta.cc:287] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b: Time spent flushing consensus metadata: real 0.602s	user 0.009s	sys 0.005s
I20260709 13:01:19.038031  7026 raft_consensus.cc:515] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:19.095506  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:19.097128  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:19.098076  6968 raft_consensus.cc:515] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:19.104102  6898 leader_election.cc:290] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:19.104987  1674 raft_consensus.cc:1240] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:19.104912  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:19.123673  7160 raft_consensus.cc:993] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b: : Instructing follower e46412b3b0b44f01ad5c33d4cfe3d6b1 to start an election
I20260709 13:01:19.124428  7160 raft_consensus.cc:1081] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 14 LEADER]: Signalling peer e46412b3b0b44f01ad5c33d4cfe3d6b1 to start an election
I20260709 13:01:19.128321  7038 leader_election.cc:290] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:19.128679  2190 leader_election.cc:304] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:19.131445  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:19.131882  1496 leader_election.cc:304] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:19.132800  7105 raft_consensus.cc:493] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.117081  1497 leader_election.cc:304] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:19.133368  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:19.069521  7065 raft_consensus.cc:515] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:19.144850  2223 raft_consensus.cc:2468] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 9.
W20260709 13:01:19.145849  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:19.152544  1677 raft_consensus.cc:1240] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 15. Current term is 16. Ops: []
W20260709 13:01:19.146394  7208 log.cc:927] Time spent T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
I20260709 13:01:19.150112  2191 leader_election.cc:304] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
W20260709 13:01:19.115803  7205 log.cc:927] Time spent T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
W20260709 13:01:19.150861  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 300136us
I20260709 13:01:19.109833  6922 consensus_queue.cc:260] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:01:19.155500  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 70847.5us
I20260709 13:01:19.156844  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:19.160362  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:19.158988  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:19.164054  1605 raft_consensus.cc:3060] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:19.158414  6898 raft_consensus.cc:2804] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:19.165190  1603 raft_consensus.cc:2468] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 14.
I20260709 13:01:19.166150  6898 raft_consensus.cc:493] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:19.170213  6890 raft_consensus.cc:2804] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:19.170892  6890 raft_consensus.cc:493] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:19.171379  6890 raft_consensus.cc:3060] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:19.171130  6922 raft_consensus.cc:3060] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:19.173177  7001 consensus_queue.cc:1059] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:01:19.174603  2224 raft_consensus.cc:1240] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:01:19.170450  7175 raft_consensus.cc:2804] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:19.174607  6898 raft_consensus.cc:3060] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:19.175860  7175 raft_consensus.cc:493] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:19.176307  7175 raft_consensus.cc:3060] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:19.179010  2221 raft_consensus.cc:2393] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 12: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:01:19.180333  1679 raft_consensus.cc:1275] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:01:19.174304  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:19.184237  1496 leader_election.cc:304] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:19.186132  7181 raft_consensus.cc:2804] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:19.186805  7181 raft_consensus.cc:697] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:19.187674  1606 raft_consensus.cc:2468] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 14.
I20260709 13:01:19.189908  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:19.189337  1646 leader_election.cc:304] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
W20260709 13:01:19.166779  7209 log.cc:927] Time spent T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.174s	user 0.004s	sys 0.000s
I20260709 13:01:19.200874  1523 raft_consensus.cc:1240] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 13:01:19.201112  7065 leader_election.cc:290] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:19.219326  7157 raft_consensus.cc:993] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b: : Instructing follower e46412b3b0b44f01ad5c33d4cfe3d6b1 to start an election
I20260709 13:01:19.219962  7157 raft_consensus.cc:1081] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 10 LEADER]: Signalling peer e46412b3b0b44f01ad5c33d4cfe3d6b1 to start an election
I20260709 13:01:19.228988   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:19.230994  1607 raft_consensus.cc:2468] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 16.
W20260709 13:01:19.233282  1604 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36194 (request call id 2043) took 1686 ms (client timeout 1733 ms). Trace:
W20260709 13:01:19.233805  1604 rpcz_store.cc:269] 0709 13:01:17.547176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:17.590902 (+ 43726us) service_pool.cc:224] Handling call
0709 13:01:19.233054 (+1642152us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b54000daf54. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:01:19.233207 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2753802624}
I20260709 13:01:19.236835  7146 consensus_queue.cc:260] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:19.213449  7026 leader_election.cc:290] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:19.240384  7130 leader_election.cc:290] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:19.242288  7129 raft_consensus.cc:2749] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:19.248000  1524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43008 (request call id 2401) took 2348 ms. Trace:
I20260709 13:01:19.248888  1497 leader_election.cc:304] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:19.254648  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
W20260709 13:01:19.255110  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 92071.7us
I20260709 13:01:19.258826  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:19.260113  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:19.261823  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49178 (request call id 2338) took 1015 ms. Trace:
I20260709 13:01:19.263904  2192 leader_election.cc:304] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:19.264245  7026 raft_consensus.cc:2749] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:19.265889  1602 raft_consensus.cc:1275] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:01:19.267225  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:19.267683  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:19.269893  7195 raft_consensus.cc:2749] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:19.272151  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:19.248512  1524 rpcz_store.cc:276] 0709 13:01:16.898951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:17.193095 (+294144us) service_pool.cc:224] Handling call
0709 13:01:18.517412 (+1324317us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:18.520582 (+  3170us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:19.247493 (+726911us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b54000fe450. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b28ad 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:01:19.247757 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3044964736}
I20260709 13:01:19.273341  1672 raft_consensus.cc:2393] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 9: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:01:19.274140  7139 leader_election.cc:290] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:19.238551  7146 raft_consensus.cc:3060] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:19.274315  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:19.277357  1604 raft_consensus.cc:3060] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:19.262298  1677 rpcz_store.cc:276] 0709 13:01:18.246631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:18.246852 (+   221us) service_pool.cc:224] Handling call
0709 13:01:18.247155 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:19.156973 (+909818us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:19.261486 (+104513us) spinlock_profiling.cc:243] Waited 904 ms on lock 0x7b54002553d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:01:19.261758 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2079338368}
I20260709 13:01:19.278930  1599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36200 (request call id 2740) took 1329 ms. Trace:
I20260709 13:01:19.279369  1599 rpcz_store.cc:276] 0709 13:01:17.949579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:17.952591 (+  3012us) service_pool.cc:224] Handling call
0709 13:01:17.997866 (+ 45275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:18.992899 (+995033us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:19.278615 (+285716us) spinlock_profiling.cc:243] Waited 859 ms on lock 0x7b540039e754. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:01:19.278852 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1974636928}
I20260709 13:01:19.280269  1679 raft_consensus.cc:2468] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 16.
I20260709 13:01:19.275321  1675 raft_consensus.cc:1240] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 16. Current term is 17. Ops: []
W20260709 13:01:19.281699  7207 log.cc:927] Time spent T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.381s	user 0.001s	sys 0.000s
I20260709 13:01:19.285519  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:19.286290  1675 raft_consensus.cc:2468] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 16.
W20260709 13:01:19.287941  7213 log.cc:927] Time spent T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.225s	user 0.000s	sys 0.002s
I20260709 13:01:19.288162  7167 consensus_queue.cc:1059] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:19.291549  7167 consensus_queue.cc:1243] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer ddf11fc190dd4b898773379c6b129d90 log is divergent from this leader: its last log entry 18.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:01:19.292164  7167 raft_consensus.cc:3055] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:01:19.292526  7167 raft_consensus.cc:740] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
W20260709 13:01:19.292959  7132 consensus_meta.cc:287] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.811s	user 0.008s	sys 0.008s
I20260709 13:01:19.293438  7132 raft_consensus.cc:515] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:19.293725  7167 consensus_queue.cc:260] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:01:19.294971  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 79027.3us
I20260709 13:01:19.295194  7167 raft_consensus.cc:3060] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:01:19.298856  7211 log.cc:927] Time spent T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.211s	user 0.000s	sys 0.001s
I20260709 13:01:19.299467  7176 raft_consensus.cc:2749] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:19.216917  2190 leader_election.cc:304] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:01:19.302412  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 97186.4us
I20260709 13:01:19.303557  7139 raft_consensus.cc:2749] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:19.305882  6968 leader_election.cc:290] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 14 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:19.168081  7105 raft_consensus.cc:515] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:19.188081  7181 consensus_queue.cc:237] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:01:19.326335  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 123088us
W20260709 13:01:19.328958  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 76117.9us
I20260709 13:01:19.331700  1605 raft_consensus.cc:2468] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 18.
I20260709 13:01:19.263814  1646 leader_election.cc:304] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:01:19.347834  1604 raft_consensus.cc:2468] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 14.
I20260709 13:01:19.346045  7185 raft_consensus.cc:493] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.349941  7129 raft_consensus.cc:2804] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:19.369179  7155 consensus_queue.cc:1048] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:01:19.370808  7149 raft_consensus.cc:493] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:19.371371  7149 raft_consensus.cc:515] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:19.373508  7149 leader_election.cc:290] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:19.374541  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:19.370707  7155 consensus_queue.cc:1059] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:19.364971  1571 leader_election.cc:304] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:19.379140  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:19.365746  7129 raft_consensus.cc:493] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:19.391662  6613 raft_consensus.cc:2749] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:19.383042  7148 raft_consensus.cc:2804] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:19.393661  2192 leader_election.cc:304] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
W20260709 13:01:19.396273  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 132609us
I20260709 13:01:19.397710  6940 consensus_queue.cc:1059] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.011s
I20260709 13:01:19.403249  1571 leader_election.cc:304] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:19.391052  7129 raft_consensus.cc:3060] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:01:19.402405  7217 log.cc:927] Time spent T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
I20260709 13:01:19.398542  7148 raft_consensus.cc:493] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:19.397603  7070 consensus_queue.cc:1048] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.011s
I20260709 13:01:19.414156  6890 raft_consensus.cc:515] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:19.414790  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:19.383913  7166 raft_consensus.cc:515] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:19.421916  1524 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59"
dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:49310
I20260709 13:01:19.423678  1524 raft_consensus.cc:493] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:19.424113  1524 raft_consensus.cc:3060] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:19.407522  7149 consensus_queue.cc:1059] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 13:01:19.414799  7177 raft_consensus.cc:2749] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:01:19.383509  7185 raft_consensus.cc:515] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:19.410542  7132 leader_election.cc:290] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:19.418639  7148 raft_consensus.cc:3060] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:19.427152  6965 raft_consensus.cc:993] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b: : Instructing follower e46412b3b0b44f01ad5c33d4cfe3d6b1 to start an election
I20260709 13:01:19.405992  7175 raft_consensus.cc:515] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:19.437652  6890 leader_election.cc:290] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:19.439855  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:19.444550  2192 leader_election.cc:304] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:01:19.421638  7130 raft_consensus.cc:2804] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:19.449335  1572 leader_election.cc:304] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:19.417891  7105 leader_election.cc:290] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:19.452543  1524 raft_consensus.cc:515] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:19.454210  7185 leader_election.cc:290] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:19.435868  7179 raft_consensus.cc:3055] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:19.458839  1675 raft_consensus.cc:2468] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 16.
I20260709 13:01:19.461380  1497 leader_election.cc:304] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:19.464113  7179 raft_consensus.cc:740] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
W20260709 13:01:19.452492  1416 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 4190d217954f4f798b3a610501115290 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica b96ce9cc496c49d7818fa983a17b062b is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:01:19.472141  7179 consensus_queue.cc:260] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:19.473861  7179 raft_consensus.cc:3060] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:19.468859  1528 raft_consensus.cc:1240] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:19.466341  1524 leader_election.cc:290] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 15 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:19.459744  7130 raft_consensus.cc:493] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:19.475878  7130 raft_consensus.cc:3060] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:19.483685  6878 raft_consensus.cc:3055] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:01:19.484169  6878 raft_consensus.cc:740] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:19.485060  6878 consensus_queue.cc:260] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:19.486366  6878 raft_consensus.cc:3060] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:19.502624  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:19.468206  7177 raft_consensus.cc:1081] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 18 LEADER]: Signalling peer e46412b3b0b44f01ad5c33d4cfe3d6b1 to start an election
I20260709 13:01:19.512503  7166 leader_election.cc:290] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:19.488706  6613 raft_consensus.cc:3055] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:19.513944  6613 raft_consensus.cc:740] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:19.515014  6613 consensus_queue.cc:260] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:19.516865  7035 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.517570  7035 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:19.507423  1681 raft_consensus.cc:1275] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:01:19.520576  7035 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:01:19.491624  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 47228.7us
I20260709 13:01:19.491806  7070 raft_consensus.cc:2804] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:19.494508  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:19.533419  2224 raft_consensus.cc:2393] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 9: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:01:19.495126  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:19.496095  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:19.496863  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:19.501389  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:19.537182  1604 raft_consensus.cc:1275] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:01:19.513245  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:19.542989  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:19.517093  6613 raft_consensus.cc:3060] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:19.550585  1524 raft_consensus.cc:1240] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:19.552392  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:19.554031  1524 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "317204271cc04f68818b36450c9725b1"
dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:49310
I20260709 13:01:19.554625  1524 raft_consensus.cc:493] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:19.555068  1524 raft_consensus.cc:3060] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:19.555373  1601 raft_consensus.cc:1240] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:19.558488  2191 leader_election.cc:304] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:19.561290  7070 raft_consensus.cc:697] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 14 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:19.562441  7070 consensus_queue.cc:237] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:19.464648  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 47914.1us
I20260709 13:01:19.574986  2218 raft_consensus.cc:2468] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 13.
I20260709 13:01:19.487228  6898 raft_consensus.cc:515] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:19.583119  1524 raft_consensus.cc:515] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:19.591559  1524 leader_election.cc:290] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:19.593755  2221 raft_consensus.cc:2368] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 13. Current term is 14.
W20260709 13:01:19.601130  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 178529us
I20260709 13:01:19.601996  1526 raft_consensus.cc:2393] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 14: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:01:19.599154  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
W20260709 13:01:19.608543  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 185227us
I20260709 13:01:19.609443  1497 leader_election.cc:304] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:19.610795  6890 raft_consensus.cc:2804] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:19.611166  1528 raft_consensus.cc:1240] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:19.612848  7148 raft_consensus.cc:515] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:19.613317  6898 leader_election.cc:290] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:19.597133  7130 raft_consensus.cc:515] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:19.598531  7176 raft_consensus.cc:2749] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:19.611228  6890 raft_consensus.cc:493] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:19.622679  6890 raft_consensus.cc:3060] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:19.622936  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:19.623545  1678 raft_consensus.cc:3060] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:19.623776  1524 raft_consensus.cc:1275] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 13:01:19.624140  1524 pending_rounds.cc:85] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting all ops after (but not including) 9
I20260709 13:01:19.624357  1524 pending_rounds.cc:107] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:01:19.624614  1524 raft_consensus.cc:2889] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:19.625046  7150 raft_consensus.cc:493] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.625594  7150 raft_consensus.cc:515] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:19.626703  1497 leader_election.cc:304] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:19.589552  6965 raft_consensus.cc:493] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:19.619243  7105 raft_consensus.cc:2804] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:19.633111  1572 leader_election.cc:304] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:19.618788  7130 leader_election.cc:290] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:19.638649  1572 leader_election.cc:304] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:19.588378  7146 consensus_queue.cc:1048] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 13:01:19.641788  1646 leader_election.cc:304] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:19.642254  1572 leader_election.cc:304] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:19.640508  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:19.644307  7166 raft_consensus.cc:2749] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:19.639832  7132 raft_consensus.cc:2749] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:19.662106  1572 leader_election.cc:304] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:01:19.668058  1678 raft_consensus.cc:2468] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 17.
I20260709 13:01:19.622107  7195 consensus_queue.cc:1048] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 13:01:19.669426  1571 leader_election.cc:304] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:19.644743  7105 raft_consensus.cc:697] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:19.648511  7130 raft_consensus.cc:2749] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:01:19.676486  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:19.684528  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:19.660370  7075 raft_consensus.cc:2749] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:19.644488  7176 consensus_queue.cc:1059] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 13:01:19.672210  7148 leader_election.cc:290] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:19.698213  6943 raft_consensus.cc:2804] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:19.699391  1497 leader_election.cc:304] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:19.683449  7149 raft_consensus.cc:2804] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:19.690994  6878 raft_consensus.cc:2804] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:19.707981  1524 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02"
dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:49310
I20260709 13:01:19.729198  1524 raft_consensus.cc:493] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:19.729605  1524 raft_consensus.cc:3060] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:19.650584  6965 raft_consensus.cc:515] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:19.693323  6922 raft_consensus.cc:2749] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:19.726253  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:19.737313  1681 raft_consensus.cc:3060] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:19.693023  7181 consensus_queue.cc:1048] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 13:01:19.694753  7129 raft_consensus.cc:515] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:19.762125  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:19.763417  1601 raft_consensus.cc:3060] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:01:19.737305  6878 raft_consensus.cc:697] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 17 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:19.737779  6943 raft_consensus.cc:697] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:19.738452  7149 raft_consensus.cc:697] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 13 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
W20260709 13:01:19.775956  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 141284us
I20260709 13:01:19.788468  1676 raft_consensus.cc:1240] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:19.755548  7175 leader_election.cc:290] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 14 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:19.790584  7178 raft_consensus.cc:493] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.795202  7105 consensus_queue.cc:237] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:19.795965  6878 consensus_queue.cc:237] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:19.835831  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
W20260709 13:01:19.840607  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 141327us
I20260709 13:01:19.843303  1496 leader_election.cc:304] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:19.845927  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:19.850682  1526 raft_consensus.cc:3060] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:19.788571  1528 raft_consensus.cc:1275] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:01:19.856166  2190 leader_election.cc:304] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:19.777762  6898 raft_consensus.cc:2804] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:19.857172  6940 raft_consensus.cc:2804] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:19.868316  2190 leader_election.cc:304] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:19.860348  1601 raft_consensus.cc:2468] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 14.
I20260709 13:01:19.880702  1524 raft_consensus.cc:515] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:19.883294  1497 leader_election.cc:304] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
W20260709 13:01:19.885257  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 195985us
I20260709 13:01:19.867053  7175 raft_consensus.cc:2749] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:19.855144  7195 consensus_queue.cc:1059] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 13:01:19.899832  7155 raft_consensus.cc:2749] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:01:19.900861  7141 consensus_queue.cc:1048] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:19.868952  7179 consensus_queue.cc:1059] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 13:01:19.906539  7179 raft_consensus.cc:3055] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:19.906948  7179 raft_consensus.cc:740] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:19.840112  7178 raft_consensus.cc:515] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:19.913518  1524 leader_election.cc:290] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 19 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:19.881523  6940 raft_consensus.cc:493] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:19.920497  1572 leader_election.cc:400] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 pre-election: Vote denied by peer b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373) with higher term. Message: Invalid argument: T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 13. Current term is 14.
I20260709 13:01:19.921900  1572 leader_election.cc:403] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:19.874034  6898 raft_consensus.cc:493] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:19.924098  6846 consensus_queue.cc:1059] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:01:19.907788  7179 consensus_queue.cc:260] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:19.933808  6965 leader_election.cc:290] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:19.920595  6940 raft_consensus.cc:3060] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:01:19.942122  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 48893.7us
I20260709 13:01:19.950150  1526 raft_consensus.cc:2468] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 14.
I20260709 13:01:19.927244  6613 raft_consensus.cc:2804] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:19.915302  7167 consensus_queue.cc:1059] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.022s
W20260709 13:01:19.953227  7229 log.cc:927] Time spent T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:01:19.953512  6613 raft_consensus.cc:493] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:19.953972  6613 raft_consensus.cc:3060] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:19.954972  7177 raft_consensus.cc:3055] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:19.955413  7177 raft_consensus.cc:740] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:19.956308  7177 consensus_queue.cc:260] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:19.922876  6943 consensus_queue.cc:237] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:19.921223  7149 consensus_queue.cc:237] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:19.963409  7179 raft_consensus.cc:3060] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:19.965806  7178 leader_election.cc:290] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:19.928021  6898 raft_consensus.cc:3060] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:19.964205  7129 leader_election.cc:290] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:19.965108  7167 raft_consensus.cc:3055] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:19.952527  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:19.950724  6922 consensus_queue.cc:1059] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 13:01:19.994947  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1181) took 1023 ms. Trace:
W20260709 13:01:19.996676  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 75537.8us
I20260709 13:01:19.993046  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:20.008353  1672 raft_consensus.cc:2468] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 16.
W20260709 13:01:20.017071  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 147703us
I20260709 13:01:20.006539  1607 rpcz_store.cc:276] 0709 13:01:18.987382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:19.234036 (+246654us) service_pool.cc:224] Handling call
0709 13:01:19.234374 (+   338us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:19.341258 (+106884us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:19.341290 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:19.382726 (+ 41436us) log.cc:844] Serialized 52 byte log entry
0709 13:01:19.642849 (+260123us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:01:19.642889 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:19.642954 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:19.994639 (+351685us) raft_consensus.cc:1685] finished
0709 13:01:19.994684 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:19.994878 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":31222,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":3385,"thread_start_us":236327,"threads_started":1,"wal-append.queue_time_us":392834}
W20260709 13:01:20.026343  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 170414us
I20260709 13:01:19.987208  7148 raft_consensus.cc:2749] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373) with higher term. Message: Invalid argument: T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 13. Current term is 14.
I20260709 13:01:20.027559  1601 raft_consensus.cc:2468] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 10.
I20260709 13:01:19.981096  7150 leader_election.cc:290] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:20.005195  7167 raft_consensus.cc:740] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:20.037607  2192 leader_election.cc:304] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:01:20.041183  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:20.042428  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:20.043906  7075 raft_consensus.cc:493] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.044461  7075 raft_consensus.cc:515] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:01:20.045949  7227 log.cc:927] Time spent T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 13:01:20.046029  7166 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.046700  7166 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:20.050192  7132 raft_consensus.cc:493] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:20.052162  7231 raft_consensus.cc:493] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:20.052793  7231 raft_consensus.cc:515] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:20.068532  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:20.069164  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:20.069501  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:20.070264  7243 raft_consensus.cc:493] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:20.070787  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:20.070458  2223 raft_consensus.cc:2368] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for earlier term 16. Current term is 17.
I20260709 13:01:20.007946  6890 raft_consensus.cc:515] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:20.076332  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:20.034305  7177 raft_consensus.cc:3060] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:20.022324  7178 consensus_queue.cc:1059] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 13:01:20.079377  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:01:20.083628  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 46129us
I20260709 13:01:20.079574  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:20.080737  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:20.082509  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:20.089324  1497 leader_election.cc:304] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:20.092603  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:20.093283  2223 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 17.
I20260709 13:01:20.095366  1602 raft_consensus.cc:1240] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:01:20.064006  7150 raft_consensus.cc:493] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:20.077561  7070 raft_consensus.cc:493] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:20.083178  7157 raft_consensus.cc:493] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:20.070941  7243 raft_consensus.cc:515] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:20.094930  6965 raft_consensus.cc:2804] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:20.075867  7132 raft_consensus.cc:515] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:20.122857  1602 raft_consensus.cc:1275] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 11. (term mismatch)
I20260709 13:01:20.126353  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:20.129863  1497 leader_election.cc:304] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:20.127120  1607 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 17.
I20260709 13:01:20.123312  1602 pending_rounds.cc:85] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642: Aborting all ops after (but not including) 10
I20260709 13:01:20.141796  1602 pending_rounds.cc:107] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642: Aborting uncommitted NO_OP operation due to leader change: 17.11
I20260709 13:01:20.142171  1602 raft_consensus.cc:2889] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:20.139456  1646 leader_election.cc:304] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:20.142513  1602 pending_rounds.cc:107] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642: Aborting uncommitted NO_OP operation due to leader change: 19.12
I20260709 13:01:20.143332  1602 raft_consensus.cc:2889] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:20.146968  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:20.159889  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:20.160696  1607 raft_consensus.cc:2468] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 16.
W20260709 13:01:20.162467  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 69777us
I20260709 13:01:20.113734  7070 raft_consensus.cc:515] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:20.131829  7232 raft_consensus.cc:493] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:20.108551  7150 raft_consensus.cc:515] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:20.165442  7178 raft_consensus.cc:2804] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:20.166363  2192 leader_election.cc:304] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
W20260709 13:01:20.171502  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 47830.9us
I20260709 13:01:20.156540  6965 raft_consensus.cc:697] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 14 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:20.156925  7231 leader_election.cc:290] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:20.152588  6940 raft_consensus.cc:515] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:20.177656  7232 raft_consensus.cc:515] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:01:20.178515  7233 log.cc:927] Time spent T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 13:01:20.170938  7178 raft_consensus.cc:493] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:20.183269  6965 consensus_queue.cc:237] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:20.184283  7075 leader_election.cc:290] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:20.187079  6890 leader_election.cc:290] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:20.188884  7132 leader_election.cc:290] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:20.190291  7166 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:20.174039  7175 raft_consensus.cc:2804] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:20.212033  7175 raft_consensus.cc:493] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:20.212437  7175 raft_consensus.cc:3060] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:20.218513  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:20.221149  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:20.221753  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:20.222359  2223 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 17.
I20260709 13:01:20.227356  6968 raft_consensus.cc:3055] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:20.192461  2225 raft_consensus.cc:2468] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 12.
I20260709 13:01:20.192879  7241 raft_consensus.cc:2804] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:20.233517  7241 raft_consensus.cc:493] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:20.233985  7241 raft_consensus.cc:3060] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:01:20.193240  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 55198.6us
I20260709 13:01:20.154388  7157 raft_consensus.cc:515] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:20.236246  7035 raft_consensus.cc:3055] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:20.236678  7035 raft_consensus.cc:740] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:20.237349  7157 leader_election.cc:290] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:01:20.237768  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 209249us
I20260709 13:01:20.237547  7035 consensus_queue.cc:260] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:20.240507  1526 raft_consensus.cc:1240] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 18. Current term is 19. Ops: []
I20260709 13:01:20.118273  7167 consensus_queue.cc:260] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:20.195735  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:20.254626  1600 raft_consensus.cc:3060] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:20.196985  7243 leader_election.cc:290] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:20.199018  7195 raft_consensus.cc:3055] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:01:20.201643  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 79584.2us
I20260709 13:01:20.274968  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: true dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:20.275637  1679 raft_consensus.cc:3060] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:20.204330  1681 raft_consensus.cc:2468] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 17.
I20260709 13:01:20.211315  7070 leader_election.cc:290] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:20.241163  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:20.239861  2221 raft_consensus.cc:2468] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 11.
I20260709 13:01:20.243084  1528 raft_consensus.cc:1240] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:20.245186  7035 raft_consensus.cc:3060] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:20.207912  7178 raft_consensus.cc:3060] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:20.316891  7155 raft_consensus.cc:493] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
W20260709 13:01:20.317767  7239 log.cc:927] Time spent T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.186s	user 0.000s	sys 0.000s
I20260709 13:01:20.317597  7155 raft_consensus.cc:515] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:20.318894  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:20.319408  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:20.319834  7155 leader_election.cc:290] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:20.247822  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:20.327250  1678 raft_consensus.cc:2468] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 11.
I20260709 13:01:20.290381  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:20.329849  6940 leader_election.cc:290] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 17 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:20.227870  6968 raft_consensus.cc:740] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:20.303409  7232 leader_election.cc:290] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:20.304191  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:20.203720  6613 raft_consensus.cc:515] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:20.252594  6943 raft_consensus.cc:2749] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:20.249626  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:20.333853  6613 leader_election.cc:290] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:20.227358  7129 consensus_queue.cc:1048] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.071s
I20260709 13:01:20.335027  6968 consensus_queue.cc:260] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:20.336521  6968 raft_consensus.cc:3060] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:20.246620  7247 log.cc:927] Time spent T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:01:20.342391  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:20.343044  1672 raft_consensus.cc:1275] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:01:20.343247  1680 raft_consensus.cc:2393] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 17: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:01:20.343441  6922 raft_consensus.cc:3055] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:20.343839  6922 raft_consensus.cc:740] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:20.344689  7178 raft_consensus.cc:515] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:20.352276  7178 leader_election.cc:290] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 17 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:20.358922  7001 raft_consensus.cc:493] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:20.361449  7065 raft_consensus.cc:493] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.359325  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:20.360145  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:20.362008  7065 raft_consensus.cc:515] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:20.360987  1528 raft_consensus.cc:1240] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:20.358986  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:20.361945  7001 raft_consensus.cc:515] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:20.358371  1571 leader_election.cc:304] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:20.365927  7001 leader_election.cc:290] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:20.366468  7166 raft_consensus.cc:2804] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:20.366928  7166 raft_consensus.cc:493] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:20.367275  7166 raft_consensus.cc:3060] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:20.366420  7001 raft_consensus.cc:493] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.368554  7001 raft_consensus.cc:515] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:20.370507  7001 leader_election.cc:290] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:20.289480  7195 raft_consensus.cc:740] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:20.364156  7065 leader_election.cc:290] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:20.381377  2190 leader_election.cc:304] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:20.378612  1679 raft_consensus.cc:2468] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 19.
W20260709 13:01:20.379716  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 78446.8us
I20260709 13:01:20.379336  7141 consensus_queue.cc:1059] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.028s
I20260709 13:01:20.407545  6959 consensus_queue.cc:1059] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 13:01:20.408567  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:20.410257  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:20.411801  1600 raft_consensus.cc:2468] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 16.
I20260709 13:01:20.446733  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:20.447454  1672 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 17.
I20260709 13:01:20.451588  1571 leader_election.cc:304] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:20.452653  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:20.456533  1678 raft_consensus.cc:2393] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 16: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:01:20.458335  1496 leader_election.cc:304] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:20.475041  1681 raft_consensus.cc:1275] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 13:01:20.476217  1497 leader_election.cc:304] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
W20260709 13:01:20.476933  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 95639.6us
I20260709 13:01:20.481807  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:20.481743  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:20.482517  1678 raft_consensus.cc:2468] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 15.
I20260709 13:01:20.473733  1571 leader_election.cc:304] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:20.489346  1571 leader_election.cc:304] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:20.488229  1529 raft_consensus.cc:2468] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 18.
I20260709 13:01:20.492525  1528 raft_consensus.cc:1275] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:01:20.382332  7070 consensus_queue.cc:1059] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.088s
I20260709 13:01:20.378808  7157 consensus_queue.cc:1048] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.093s
I20260709 13:01:20.421875  7181 consensus_queue.cc:1048] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 13:01:20.497184  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:20.473202  7167 raft_consensus.cc:3060] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:20.495797  1601 raft_consensus.cc:1275] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:01:20.471201  7150 leader_election.cc:290] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:20.485642  7141 raft_consensus.cc:2749] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:20.344712  6922 consensus_queue.cc:260] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:20.470285  7232 raft_consensus.cc:493] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:20.480243  7242 raft_consensus.cc:2804] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:01:20.475443  7148 raft_consensus.cc:2804] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:20.531893  1524 raft_consensus.cc:2468] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 18.
W20260709 13:01:20.535118  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 310437us
I20260709 13:01:20.536983  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:20.505208  7149 raft_consensus.cc:2749] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:20.470093  7132 raft_consensus.cc:493] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:20.444633  7241 raft_consensus.cc:515] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:20.515859  2190 leader_election.cc:304] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
W20260709 13:01:20.491174  7105 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.003s	sys 0.009s
W20260709 13:01:20.562760  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 356585us
I20260709 13:01:20.507723  7243 raft_consensus.cc:2749] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:01:20.568315  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 52569.3us
I20260709 13:01:20.520823  7150 raft_consensus.cc:2804] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:20.515858  6943 raft_consensus.cc:493] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:20.563866  7105 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.724s	user 0.004s	sys 0.009s
I20260709 13:01:20.536708  7242 raft_consensus.cc:697] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:20.575932  1603 raft_consensus.cc:2468] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 12.
I20260709 13:01:20.538154  7148 raft_consensus.cc:697] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 17 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
W20260709 13:01:20.584784  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 171103us
W20260709 13:01:20.592201  1416 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 4190d217954f4f798b3a610501115290 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica b96ce9cc496c49d7818fa983a17b062b is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:01:20.494048  7195 consensus_queue.cc:260] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:20.534487  6898 raft_consensus.cc:515] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:20.578680  7150 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:20.597138  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:20.534700  7175 raft_consensus.cc:515] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:20.533659  7232 raft_consensus.cc:515] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:20.569151  7177 consensus_queue.cc:1048] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:01:20.590281  6965 raft_consensus.cc:2804] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:01:20.606403  1605 raft_consensus.cc:2468] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 18.
I20260709 13:01:20.595058  6922 raft_consensus.cc:3060] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:20.617813  1646 leader_election.cc:304] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:20.572333  7132 raft_consensus.cc:515] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:20.607163  6988 raft_consensus.cc:493] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:20.769694  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 158367us
I20260709 13:01:20.769876  6988 raft_consensus.cc:515] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:20.772092  6988 leader_election.cc:290] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:20.767743  7129 raft_consensus.cc:493] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.772747  7129 raft_consensus.cc:515] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:20.774184  7132 leader_election.cc:290] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:20.774813  7252 raft_consensus.cc:2764] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:01:20.776556  7252 consensus_queue.cc:1059] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:01:20.605733  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 116497us
I20260709 13:01:20.778872  7035 raft_consensus.cc:3055] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:20.779246  7035 raft_consensus.cc:740] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:20.779999  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:20.780747  1672 raft_consensus.cc:2368] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 16. Current term is 17.
I20260709 13:01:20.781092  1571 leader_election.cc:304] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:20.780061  7035 consensus_queue.cc:260] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:20.782792  7149 consensus_queue.cc:1048] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:20.783880  7245 raft_consensus.cc:3055] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:01:20.784300  7245 raft_consensus.cc:740] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:20.785133  7245 consensus_queue.cc:260] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:20.782825  7035 raft_consensus.cc:3060] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:20.664987  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:20.784523  7129 leader_election.cc:290] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:20.795717  7241 leader_election.cc:290] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:20.796808  1673 raft_consensus.cc:2468] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 16.
W20260709 13:01:20.672683  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 53903.5us
I20260709 13:01:20.675046  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:20.797967  1674 raft_consensus.cc:2468] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 18.
I20260709 13:01:20.799384  2192 leader_election.cc:304] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:01:20.678048  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 62095.6us
I20260709 13:01:20.800416  7179 raft_consensus.cc:2804] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:01:20.800848  1570 leader_election.cc:336] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.836s (SENT)
I20260709 13:01:20.709798  7242 consensus_queue.cc:237] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:20.801337  1570 leader_election.cc:304] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:20.610476  7150 raft_consensus.cc:3060] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:20.617861  2191 leader_election.cc:304] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:01:20.807350  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 189575us
I20260709 13:01:20.683795  7105 raft_consensus.cc:493] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:20.810956  7105 raft_consensus.cc:515] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:20.811852  1674 raft_consensus.cc:1240] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:20.813133  7105 leader_election.cc:290] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:20.813937  7155 raft_consensus.cc:2804] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:01:20.814394  7250 log.cc:927] Time spent T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.130s	user 0.002s	sys 0.000s
I20260709 13:01:20.686260  6959 raft_consensus.cc:3055] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:20.817282  6959 raft_consensus.cc:740] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
W20260709 13:01:20.818737  7259 log.cc:927] Time spent T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
I20260709 13:01:20.818404  6959 consensus_queue.cc:260] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:20.814436  7155 raft_consensus.cc:493] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
W20260709 13:01:20.687112  7258 log.cc:927] Time spent T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
W20260709 13:01:20.687995  7249 log.cc:927] Time spent T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:01:20.620987  7177 consensus_queue.cc:1243] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:01:20.596701  6943 raft_consensus.cc:515] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:20.820425  7155 raft_consensus.cc:3060] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:20.620029  6965 raft_consensus.cc:493] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:20.620357  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:20.727576  6898 leader_election.cc:290] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:20.730223  7153 raft_consensus.cc:3055] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:01:20.734903  7261 raft_consensus.cc:493] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.740422  7232 leader_election.cc:290] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:20.728758  7148 consensus_queue.cc:237] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:20.847081  6965 raft_consensus.cc:3060] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:20.756906  2190 leader_election.cc:304] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:20.785612  7132 raft_consensus.cc:2804] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:20.817279  7175 leader_election.cc:290] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:20.837597  7195 raft_consensus.cc:3060] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:20.828022  7262 consensus_queue.cc:1048] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:20.837795  7075 raft_consensus.cc:493] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
W20260709 13:01:20.840095  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:20.831513  6943 leader_election.cc:290] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:20.836951  7130 raft_consensus.cc:2749] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:01:20.800844  7179 raft_consensus.cc:493] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:20.841187  7231 raft_consensus.cc:493] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:20.840557  6878 raft_consensus.cc:493] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:20.820067  6959 raft_consensus.cc:3060] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:20.844735  1425 catalog_manager.cc:5697] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 5 to 12, leader changed from 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 12 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:01:20.835976  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:20.841374  1672 raft_consensus.cc:1240] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 18. Current term is 19. Ops: []
I20260709 13:01:20.619813  1497 leader_election.cc:304] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:20.872169  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:20.874806  1603 raft_consensus.cc:2393] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 16: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:01:20.878607  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:20.894771  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
W20260709 13:01:20.895411  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:20.936414  1680 raft_consensus.cc:1275] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:01:20.879235  2218 raft_consensus.cc:1275] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:01:20.881449  1496 leader_election.cc:400] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 election: Vote denied by peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217) with higher term. Message: Invalid argument: T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 16. Current term is 17.
I20260709 13:01:20.937299  1496 leader_election.cc:403] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:01:20.749369  7166 raft_consensus.cc:515] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:20.901237  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:20.938807  2225 raft_consensus.cc:2393] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 15: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
W20260709 13:01:20.904387  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 147578us
I20260709 13:01:20.906585  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:20.904865  2191 leader_election.cc:304] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:20.937094  1600 raft_consensus.cc:3060] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:20.913017  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 141077us
I20260709 13:01:20.914736  1606 raft_consensus.cc:1275] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:01:20.904004  7132 raft_consensus.cc:493] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:20.875133  7149 raft_consensus.cc:493] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:20.875685  7153 raft_consensus.cc:740] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
W20260709 13:01:20.945494  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 332666us
I20260709 13:01:20.946370  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 21 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:20.914085  7157 raft_consensus.cc:2804] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:01:20.950021  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 72593.8us
W20260709 13:01:20.953493  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 48715.3us
W20260709 13:01:20.963433  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 46165.8us
I20260709 13:01:20.931049  7179 raft_consensus.cc:3060] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:20.962107  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 86983.8us
I20260709 13:01:20.934398  7075 raft_consensus.cc:515] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:20.944993  6878 raft_consensus.cc:515] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:20.961011  6988 raft_consensus.cc:3060] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:20.950461  7242 raft_consensus.cc:2764] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:01:20.947541  7132 raft_consensus.cc:3060] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:20.951740  7157 raft_consensus.cc:493] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:20.984025  7130 consensus_queue.cc:1048] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:20.964330  7175 raft_consensus.cc:2804] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:20.948884  7231 raft_consensus.cc:515] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:21.018391  7231 leader_election.cc:290] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:21.019201  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:20.988647  7153 consensus_queue.cc:260] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:21.020972  7153 raft_consensus.cc:3060] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:20.996297  7075 leader_election.cc:290] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:20.954092  7149 raft_consensus.cc:515] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:21.042313  7149 leader_election.cc:290] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:20.902097  7261 raft_consensus.cc:515] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:21.010123  1529 pending_rounds.cc:85] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting all ops after (but not including) 9
I20260709 13:01:21.049332  1529 pending_rounds.cc:107] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:01:21.049649  1529 raft_consensus.cc:2889] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:01:21.007560  1644 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 2.112s (SENT) [suppressed 26 similar messages]
W20260709 13:01:20.974072  6968 consensus_meta.cc:287] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b: Time spent flushing consensus metadata: real 0.637s	user 0.009s	sys 0.003s
I20260709 13:01:21.014693  7157 raft_consensus.cc:3060] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:01:21.054811  7273 log.cc:927] Time spent T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:01:21.016482  7175 raft_consensus.cc:493] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:21.022962  1497 leader_election.cc:304] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
W20260709 13:01:21.058048  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 50542.2us
I20260709 13:01:21.024504  1600 raft_consensus.cc:2468] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 11.
I20260709 13:01:21.025784  1646 leader_election.cc:304] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:21.039947  6878 leader_election.cc:290] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:01:21.040287  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 201563us
W20260709 13:01:21.043092  7272 log.cc:927] Time spent T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.058s	user 0.003s	sys 0.000s
W20260709 13:01:21.043406  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:21.044828  1526 raft_consensus.cc:1240] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:20.997597  7263 consensus_queue.cc:1059] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.084s
W20260709 13:01:21.052311  2191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:21.053645  7245 raft_consensus.cc:3060] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:20.972536  7181 consensus_queue.cc:1048] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.075s
W20260709 13:01:21.065018  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 93295.2us
W20260709 13:01:21.088907  7167 consensus_meta.cc:287] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.581s	user 0.002s	sys 0.007s
I20260709 13:01:21.093830  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:21.094521  1524 raft_consensus.cc:3060] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:21.095359  1523 raft_consensus.cc:1240] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 19. Current term is 20. Ops: []
W20260709 13:01:21.086433  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 120823us
I20260709 13:01:21.100646  1604 raft_consensus.cc:2468] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 16.
I20260709 13:01:21.086735  6878 raft_consensus.cc:493] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:21.102777  6878 raft_consensus.cc:515] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:21.104879  6878 leader_election.cc:290] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:21.107026  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:21.108278  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:21.109031  1527 raft_consensus.cc:2393] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 17: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:01:21.109812  6988 raft_consensus.cc:2749] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217) with higher term. Message: Invalid argument: T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 16. Current term is 17.
I20260709 13:01:21.110594  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:21.110983  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:21.082934  7035 consensus_queue.cc:1048] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:01:21.111788  1525 raft_consensus.cc:2368] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 13. Current term is 14.
I20260709 13:01:21.071869  7234 raft_consensus.cc:2804] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:01:21.113322  7234 raft_consensus.cc:697] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
W20260709 13:01:21.113847  1430 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46258 (request call id 344) took 32832 ms (client timeout 15000 ms). Trace:
I20260709 13:01:21.113332  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:21.114694  7035 consensus_queue.cc:1243] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer 39a92f5a4352465d8af3af5908fe8642 log is divergent from this leader: its last log entry 15.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:01:21.112787  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:21.116353  1530 raft_consensus.cc:2368] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 13. Current term is 14.
I20260709 13:01:21.114197  7263 raft_consensus.cc:3055] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:01:21.117311  7263 raft_consensus.cc:740] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:21.116585  1425 catalog_manager.cc:5697] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b reported cstate change: config changed from index 5 to 8, term changed from 13 to 15, leader changed from ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) to <none>, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193), VOTER 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194), VOTER ddf11fc190dd4b898773379c6b129d90 (127.0.107.195), VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196). New cstate: current_term: 15 committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:01:21.114260  7234 consensus_queue.cc:237] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:21.124815  7265 raft_consensus.cc:493] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.125440  7265 raft_consensus.cc:515] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:21.127106  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:21.127810  1531 raft_consensus.cc:2468] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 17.
I20260709 13:01:21.111347  1532 raft_consensus.cc:2393] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 17: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:01:21.070648  7150 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:21.058924  7175 raft_consensus.cc:3060] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:21.132946  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:21.133901  1524 raft_consensus.cc:2468] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 9.
I20260709 13:01:21.134235  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:21.131829  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:21.057695  7178 consensus_queue.cc:1059] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.079s
I20260709 13:01:21.067934  7257 raft_consensus.cc:2804] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:21.148207  1425 catalog_manager.cc:5697] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:01:21.160969  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:21.142311  1523 raft_consensus.cc:2393] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 11: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:01:21.162742  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:21.163208  6898 raft_consensus.cc:493] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.174998  6898 raft_consensus.cc:515] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:21.118194  7263 consensus_queue.cc:260] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:21.180624  7132 raft_consensus.cc:515] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:21.183449  7177 raft_consensus.cc:493] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.165457  1530 raft_consensus.cc:1275] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:01:21.184067  7177 raft_consensus.cc:515] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:21.168229  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:21.170611  2192 leader_election.cc:304] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:21.164842  7070 consensus_queue.cc:1048] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:01:21.189882  7177 leader_election.cc:290] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:21.190325  7070 raft_consensus.cc:2804] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:21.190828  7070 raft_consensus.cc:697] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 11 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:21.077247  7179 raft_consensus.cc:515] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:21.192520  7070 consensus_queue.cc:237] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:21.194865  1425 catalog_manager.cc:5697] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 6 to 8, leader changed from b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) to e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193). New cstate: current_term: 8 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:01:21.195619  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:21.195931  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:21.196946  1425 catalog_manager.cc:5697] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 11 to 15, leader changed from e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) to b96ce9cc496c49d7818fa983a17b062b (127.0.107.196). New cstate: current_term: 15 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:21.164999  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:21.171427  7257 raft_consensus.cc:493] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:21.200709  7271 log.cc:927] Time spent T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:01:21.200827  7257 raft_consensus.cc:3060] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:01:21.166591  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 105852us
I20260709 13:01:21.196385  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:21.187350  7261 leader_election.cc:290] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:21.196401  1527 raft_consensus.cc:2393] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 17: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:01:21.200318  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:21.203596  1425 catalog_manager.cc:5697] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 11 to 15, leader changed from b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 15 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:01:21.206611  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:21.214073  1525 raft_consensus.cc:2376] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 9. Re-sending same reply.
I20260709 13:01:21.211594  1526 raft_consensus.cc:2468] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 17.
I20260709 13:01:21.203104  1646 leader_election.cc:304] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:21.195297  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:21.220397  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 13:01:21.222206  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:21.224007  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:21.224681  1601 raft_consensus.cc:2468] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 9.
I20260709 13:01:21.225116  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:21.224718  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:21.225809  1526 raft_consensus.cc:2468] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 16.
I20260709 13:01:21.227170  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:21.220290  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:21.232249  1527 raft_consensus.cc:2393] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 17: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:01:21.231814  7167 raft_consensus.cc:493] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:21.235419  7167 raft_consensus.cc:515] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:21.238613  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:21.240229  1526 raft_consensus.cc:1275] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 13:01:21.241317  1526 raft_consensus.cc:1240] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:21.238916  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:21.246511  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:21.248476  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:21.203660  7166 leader_election.cc:290] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:21.249547  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:21.246326  1425 catalog_manager.cc:5697] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:01:21.253978  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:21.251883  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 21 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:21.253726  1523 raft_consensus.cc:2468] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 17.
I20260709 13:01:21.257925  1603 raft_consensus.cc:2410] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:01:21.255091  1598 raft_consensus.cc:2468] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 15.
I20260709 13:01:21.259737  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:21.257506  1524 raft_consensus.cc:3060] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:21.263375  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:21.264850  1531 raft_consensus.cc:2368] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 13. Current term is 14.
I20260709 13:01:21.244061  7178 raft_consensus.cc:2804] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:21.266029  1425 catalog_manager.cc:5697] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:01:21.268052  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:21.266155  1525 raft_consensus.cc:2468] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 15.
I20260709 13:01:21.272868  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:21.270011  1528 raft_consensus.cc:2468] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 11.
I20260709 13:01:21.280678  1425 catalog_manager.cc:5697] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 10 to 13, leader changed from b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) to e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193). New cstate: current_term: 13 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
W20260709 13:01:21.284958  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:21.289304  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:21.289999  1531 raft_consensus.cc:2468] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 11.
I20260709 13:01:21.292424  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:21.292605  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:21.286809  1425 catalog_manager.cc:5697] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 8 to 10, leader changed from b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) to 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194). New cstate: current_term: 10 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:01:21.291450  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:21.295115  1525 raft_consensus.cc:2393] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 12: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:01:21.278851  7179 leader_election.cc:290] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 13 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:21.297224  1528 raft_consensus.cc:2393] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 14: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:01:21.279397  7178 raft_consensus.cc:697] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 16 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:21.283619  7132 leader_election.cc:290] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:21.298642  1425 catalog_manager.cc:5697] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 6 to 10, leader changed from ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) to 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194). New cstate: current_term: 10 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
W20260709 13:01:21.114243  1430 rpcz_store.cc:269] 0709 13:00:48.281561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:48.281790 (+   229us) service_pool.cc:224] Handling call
0709 13:01:21.113611 (+32831821us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:18.463071 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:18.463724 (+   653us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:18.463772 (+    48us) write_op.cc:435] Acquired schema lock
0709 13:01:18.463788 (+    16us) tablet.cc:662] Decoding operations
0709 13:01:18.465294 (+  1506us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:18.465399 (+   105us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:18.465429 (+    30us) tablet.cc:685] Acquiring locks for 17 operations
0709 13:01:18.471673 (+  6244us) tablet.cc:701] Row locks acquired
0709 13:01:18.471716 (+    43us) write_op.cc:260] PREPARE: finished
0709 13:01:18.471877 (+   161us) write_op.cc:270] Start()
0709 13:01:18.472038 (+   161us) write_op.cc:276] Timestamp: P: 1783602078471812 usec, L: 0
0709 13:01:18.472054 (+    16us) op_driver.cc:348] REPLICATION: starting
0709 13:01:18.472801 (+   747us) log.cc:844] Serialized 7034 byte log entry
0709 13:01:19.079283 (+606482us) op_driver.cc:464] REPLICATION: finished
0709 13:01:19.170411 (+ 91128us) write_op.cc:301] APPLY: starting
0709 13:01:19.170559 (+   148us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:19.458120 (+287561us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:19.558918 (+100798us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:19.742822 (+183904us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:19.791150 (+ 48328us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=34,key_file_lookups=34,delta_file_lookups=34,mrs_lookups=0
0709 13:01:19.791214 (+    64us) write_op.cc:312] APPLY: finished
0709 13:01:19.791686 (+   472us) log.cc:844] Serialized 156 byte log entry
0709 13:01:19.791897 (+   211us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:19.792218 (+   321us) write_op.cc:454] Released schema lock
0709 13:01:19.792314 (+    96us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:19.792887 (+   573us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:19.792921 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1865,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":89913,"apply.run_cpu_time_us":27709,"apply.run_wall_time_us":622484,"cfile_cache_hit":70,"cfile_cache_hit_bytes":75323,"num_ops":17,"prepare.queue_time_us":435299,"prepare.run_cpu_time_us":18292,"prepare.run_wall_time_us":138969,"raft.queue_time_us":234608,"raft.run_cpu_time_us":14006,"raft.run_wall_time_us":146059,"replication_time_us":539497,"thread_start_us":710021,"threads_started":4,"wal-append.queue_time_us":154877,"wal-append.run_cpu_time_us":19172,"wal-append.run_wall_time_us":2147378}]]}
I20260709 13:01:21.305871  7178 consensus_queue.cc:237] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:21.312206  7150 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 18 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:21.314640  1524 raft_consensus.cc:2410] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for term 17 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 13:01:21.315902  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:21.316825  7157 raft_consensus.cc:515] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:21.279889  7155 raft_consensus.cc:515] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:21.294381  7274 raft_consensus.cc:493] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.284617  7261 raft_consensus.cc:493] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.334499  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36200 (request call id 2763) took 1203 ms. Trace:
I20260709 13:01:21.367362  1604 rpcz_store.cc:276] 0709 13:01:20.131008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:20.131181 (+   173us) service_pool.cc:224] Handling call
0709 13:01:21.334283 (+1203102us) spinlock_profiling.cc:243] Waited 942 ms on lock 0x7b54002675d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:01:21.334428 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2166278912}
I20260709 13:01:21.344247  1425 catalog_manager.cc:5697] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 8 to 10, leader changed from b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) to e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193). New cstate: current_term: 10 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:01:21.345336  1680 raft_consensus.cc:2468] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 9.
I20260709 13:01:21.343364  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:21.378739  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:21.384006  1425 catalog_manager.cc:5697] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:21.385119  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:21.402532  7157 leader_election.cc:290] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 19 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:21.403682  7263 raft_consensus.cc:3060] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:21.369801  7139 raft_consensus.cc:493] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.406351  7139 raft_consensus.cc:515] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:21.408594  7139 leader_election.cc:290] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:21.415386  2192 leader_election.cc:304] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:21.416540  7157 raft_consensus.cc:2804] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:21.416666  2192 leader_election.cc:304] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:21.417052  7157 raft_consensus.cc:493] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:21.420723  7262 raft_consensus.cc:2749] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:21.420652  7157 raft_consensus.cc:3060] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:21.422639  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:21.423897  1604 raft_consensus.cc:3060] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:21.339749  6922 raft_consensus.cc:3055] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:01:21.425117  1528 raft_consensus.cc:2468] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 9.
I20260709 13:01:21.425987  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:21.428643  1601 raft_consensus.cc:3060] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:21.400621  1425 catalog_manager.cc:5697] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 8 to 9, leader changed from 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) to b96ce9cc496c49d7818fa983a17b062b (127.0.107.196). New cstate: current_term: 9 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:21.326354  7175 raft_consensus.cc:515] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:21.443255  1604 raft_consensus.cc:2468] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 13.
I20260709 13:01:21.322628  6965 raft_consensus.cc:515] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:21.454238  1601 raft_consensus.cc:2468] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 19.
I20260709 13:01:21.455138  1646 leader_election.cc:304] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:21.443967  1425 catalog_manager.cc:5697] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 7 to 8, leader changed from b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) to e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193). New cstate: current_term: 8 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:01:21.456704  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:21.457435  1600 raft_consensus.cc:2468] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 14.
I20260709 13:01:21.382942  7261 raft_consensus.cc:515] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:21.427879  6922 raft_consensus.cc:740] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:21.384145  7274 raft_consensus.cc:515] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:21.461138  2223 raft_consensus.cc:1240] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:21.460889  1425 catalog_manager.cc:5697] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 7 to 10, leader changed from b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) to e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193). New cstate: current_term: 10 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:01:21.474385  7261 leader_election.cc:290] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:21.476326  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:21.437922  7232 raft_consensus.cc:493] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.488240  2192 leader_election.cc:304] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:01:21.490252  7291 raft_consensus.cc:2749] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:01:21.493839  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 53447us
I20260709 13:01:21.501000  1646 leader_election.cc:304] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:21.491699  2192 leader_election.cc:304] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:01:21.502573  2192 leader_election.cc:304] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:01:21.511384  7281 raft_consensus.cc:2749] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:21.513203  7265 leader_election.cc:290] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:21.514460  6965 leader_election.cc:290] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 19 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:01:21.492434  7287 log.cc:927] Time spent T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:01:21.518960  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:21.525782  7175 leader_election.cc:290] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 16 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:21.504058  7245 raft_consensus.cc:2804] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:01:21.530050  7245 raft_consensus.cc:697] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 19 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:21.531009  7245 consensus_queue.cc:237] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:21.531531  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:21.533368  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:21.534185  1680 raft_consensus.cc:3060] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:21.533468  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:21.535247  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:21.538153  6898 leader_election.cc:290] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:21.539095  7167 leader_election.cc:290] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:21.543141  6922 consensus_queue.cc:260] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:21.544188  6922 raft_consensus.cc:3060] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:21.546823  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:21.547202  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:21.548041  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:21.548419  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:21.548707  1524 raft_consensus.cc:2468] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 15.
I20260709 13:01:21.549607  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:21.550143  1529 raft_consensus.cc:3060] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:21.551069  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:21.509338  7139 raft_consensus.cc:2804] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:21.555027  7139 raft_consensus.cc:697] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 13 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:21.555984  7139 consensus_queue.cc:237] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:21.556470  1680 raft_consensus.cc:2468] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 12.
I20260709 13:01:21.556996  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:21.557574  1678 raft_consensus.cc:3060] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:21.509166  7146 raft_consensus.cc:2804] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:21.558902  7146 raft_consensus.cc:493] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:21.559250  7146 raft_consensus.cc:3060] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:21.564463  1674 raft_consensus.cc:2468] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 16.
I20260709 13:01:21.566823  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:21.566869  2191 leader_election.cc:304] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:21.570793  7153 consensus_queue.cc:1048] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:21.578397  7257 raft_consensus.cc:515] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:21.580677  1607 raft_consensus.cc:2410] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:01:21.566422  1530 raft_consensus.cc:2468] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 9.
I20260709 13:01:21.586352   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:01:21.589008  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:21.591368  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:21.595716  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:21.596340  2224 raft_consensus.cc:3060] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:21.597111  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
W20260709 13:01:21.542557  7195 consensus_meta.cc:287] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b: Time spent flushing consensus metadata: real 0.625s	user 0.006s	sys 0.003s
I20260709 13:01:21.603111  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:21.601692  1678 raft_consensus.cc:2468] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 19.
I20260709 13:01:21.525782  7155 leader_election.cc:290] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:21.502730  7232 raft_consensus.cc:515] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:21.607760  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:21.608235  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:21.609025  2220 raft_consensus.cc:2393] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 15: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:01:21.609982  2221 raft_consensus.cc:2468] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 11.
I20260709 13:01:21.611479  7270 raft_consensus.cc:493] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.615527  1673 raft_consensus.cc:2393] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 17: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:01:21.615772  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:21.616530  1604 raft_consensus.cc:2393] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 15: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
W20260709 13:01:21.617156  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 116236us
I20260709 13:01:21.618234  1646 leader_election.cc:304] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:21.595091  7070 raft_consensus.cc:2804] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:21.627936  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:21.619350  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:21.631211  1601 raft_consensus.cc:2393] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 16: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:01:21.599645  6968 raft_consensus.cc:493] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:21.536325  7281 consensus_queue.cc:1048] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.081s
I20260709 13:01:21.632432  1646 leader_election.cc:400] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: Vote denied by peer b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373) with higher term. Message: Invalid argument: T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for earlier term 16. Current term is 17.
I20260709 13:01:21.634148  1529 raft_consensus.cc:2468] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 19.
W20260709 13:01:21.637955  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:21.638347  2190 leader_election.cc:304] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:21.629199  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:21.612179  7270 raft_consensus.cc:515] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:21.642030  1599 raft_consensus.cc:2410] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 17 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 13:01:21.648069  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:21.649287  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:21.651093  2226 raft_consensus.cc:1275] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 10 index: 12. Preceding OpId from leader: term: 12 index: 13. (index mismatch)
I20260709 13:01:21.652276  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:21.652756  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:21.653532  2221 raft_consensus.cc:2393] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 14: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:01:21.653374  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:21.639447  7070 raft_consensus.cc:697] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 12 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:21.655107  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:21.655445  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:21.655985  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:21.655622  7070 consensus_queue.cc:237] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:21.657866  7274 leader_election.cc:290] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:21.650395  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: true dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:21.668016  7232 leader_election.cc:290] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:21.644502  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:21.669946  7262 raft_consensus.cc:2804] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:01:21.636322  7291 raft_consensus.cc:2749] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:21.641098  6968 raft_consensus.cc:515] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:21.673061  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:21.675379  2227 raft_consensus.cc:2468] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 12.
I20260709 13:01:21.678261  2224 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 18.
I20260709 13:01:21.654358  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
W20260709 13:01:21.683734  7297 log.cc:927] Time spent T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:01:21.683935  7257 leader_election.cc:290] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 17 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:21.686724  2226 raft_consensus.cc:2468] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 14.
I20260709 13:01:21.687268  1677 raft_consensus.cc:2468] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 15.
I20260709 13:01:21.697814  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:21.706918  1678 raft_consensus.cc:1275] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:01:21.707370  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:21.707952  1601 raft_consensus.cc:3060] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:21.705789  2191 leader_election.cc:304] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:21.714473  1601 raft_consensus.cc:2468] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 17.
W20260709 13:01:21.721374  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 94225.2us
I20260709 13:01:21.725056  1646 leader_election.cc:304] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
W20260709 13:01:21.726374  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 51611.7us
I20260709 13:01:21.726897  1646 leader_election.cc:304] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:21.727734  2225 raft_consensus.cc:2468] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 19.
I20260709 13:01:21.728483  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:21.734041  1525 raft_consensus.cc:3055] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:21.734949  2220 raft_consensus.cc:2468] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 17.
I20260709 13:01:21.734467  1525 raft_consensus.cc:740] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:21.658643  7146 raft_consensus.cc:515] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:21.702943  7262 raft_consensus.cc:697] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 19 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:21.743793  1525 consensus_queue.cc:260] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:21.744201  1646 leader_election.cc:304] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:21.744840  1525 raft_consensus.cc:3060] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:21.745085  1646 leader_election.cc:304] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:21.742007  7291 raft_consensus.cc:2749] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:21.746830  7295 raft_consensus.cc:2804] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:21.747376  7295 raft_consensus.cc:697] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 12 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:21.748234  7295 consensus_queue.cc:237] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:21.749306  7035 raft_consensus.cc:2764] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:01:21.715268  6988 raft_consensus.cc:493] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:21.759272  1525 raft_consensus.cc:1275] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:01:21.761564  7263 raft_consensus.cc:493] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:21.762341  1599 raft_consensus.cc:1275] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:01:21.762163  7263 raft_consensus.cc:515] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:21.764963  7263 leader_election.cc:290] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:21.768189  7270 leader_election.cc:290] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:21.769229  1602 raft_consensus.cc:1217] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Deduplicated request from leader. Original: 12.8->[14.9-20.11]   Dedup: 14.9->[18.10-20.11]
I20260709 13:01:21.769784  1602 pending_rounds.cc:85] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642: Aborting all ops after (but not including) 9
I20260709 13:01:21.770005  1602 pending_rounds.cc:107] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260709 13:01:21.770239  1602 raft_consensus.cc:2889] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:21.771777  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:21.770164  7195 consensus_queue.cc:1048] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 13:01:21.773195  1599 raft_consensus.cc:1240] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:01:21.777789  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:21.778499  1673 raft_consensus.cc:2468] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 16.
I20260709 13:01:21.779332  1646 leader_election.cc:304] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:21.782614  2223 raft_consensus.cc:2368] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 15. Current term is 16.
I20260709 13:01:21.783103  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:21.783730  1677 raft_consensus.cc:2468] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 17.
I20260709 13:01:21.775851  1571 leader_election.cc:304] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:21.785584  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:21.786230  1598 raft_consensus.cc:3060] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:21.785681  1571 leader_election.cc:304] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:21.738767  6922 raft_consensus.cc:2804] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:21.738147  7139 raft_consensus.cc:2804] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:21.795399  2226 raft_consensus.cc:1240] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 17. Current term is 18. Ops: []
I20260709 13:01:21.797043  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:21.810017  1673 raft_consensus.cc:2393] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 16: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:01:21.786377  7232 raft_consensus.cc:2804] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:21.797971  7274 raft_consensus.cc:2804] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:21.799597  7181 consensus_queue.cc:1048] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:01:21.786801  7141 raft_consensus.cc:493] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.783320  6988 raft_consensus.cc:515] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:21.785091  7262 consensus_queue.cc:237] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:21.762279  6968 leader_election.cc:290] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:21.754524  7157 raft_consensus.cc:515] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:21.807838  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:21.809044  2218 raft_consensus.cc:2468] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 17.
I20260709 13:01:21.814502  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:21.818138  1646 leader_election.cc:304] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b
W20260709 13:01:21.787925  1497 connection.cc:256] RPC call timeout handler was delayed by -2.7034751850000021s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15660000000000002s for a response
I20260709 13:01:21.790400  6922 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
W20260709 13:01:21.833384  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:21.819546  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:21.813416  7274 raft_consensus.cc:493] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:21.835937  1607 raft_consensus.cc:3060] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:21.836247  1497 connection.cc:256] RPC call timeout handler was delayed by -2.4091663209999865s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1804s for a response
W20260709 13:01:21.836750  1497 connection.cc:256] RPC call timeout handler was delayed by -2.0738263179999876s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1835s for a response
I20260709 13:01:21.819563  7291 raft_consensus.cc:2804] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:01:21.837428  1497 connection.cc:256] RPC call timeout handler was delayed by -2.0025067369999761s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2257s for a response
I20260709 13:01:21.819693  7265 raft_consensus.cc:493] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:21.842775  1497 connection.cc:256] RPC call timeout handler was delayed by -1.7264263179999944s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22210000000000002s for a response
I20260709 13:01:21.843811  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
W20260709 13:01:21.857529  1497 connection.cc:256] RPC call timeout handler was delayed by -1.7264263179999944s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22210000000000002s for a response
W20260709 13:01:21.857882  1497 connection.cc:256] RPC call timeout handler was delayed by -1.724058935999949s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3249s for a response
I20260709 13:01:21.844205  1598 raft_consensus.cc:2468] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 15.
W20260709 13:01:21.848551  7300 log.cc:927] Time spent T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
I20260709 13:01:21.821416  7232 raft_consensus.cc:697] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 15 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:21.825219  7141 raft_consensus.cc:515] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:21.852108  6988 leader_election.cc:290] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:21.853358  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:21.837451  6922 raft_consensus.cc:3060] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:21.854461  1600 raft_consensus.cc:1240] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 12. Current term is 13. Ops: []
W20260709 13:01:21.858161  1497 connection.cc:256] RPC call timeout handler was delayed by -1.6949263180000003s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2256s for a response
W20260709 13:01:21.884859  1497 connection.cc:256] RPC call timeout handler was delayed by -1.6540751850000106s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.27320000000000005s for a response
W20260709 13:01:21.885270  1497 connection.cc:256] RPC call timeout handler was delayed by -1.3160951919999775s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18100000000000002s for a response
I20260709 13:01:21.842007  7035 raft_consensus.cc:2804] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:21.865911  1571 leader_election.cc:304] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:21.870831  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:21.887524  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:21.877156  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:21.880019  1605 raft_consensus.cc:1275] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:01:21.853659  1607 raft_consensus.cc:2468] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 11.
I20260709 13:01:21.891582  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:21.892637  1607 raft_consensus.cc:2410] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:01:21.840499  7274 raft_consensus.cc:3060] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:01:21.885548  1497 connection.cc:256] RPC call timeout handler was delayed by -1.2062951919999705s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1932s for a response
I20260709 13:01:21.821789  7139 raft_consensus.cc:697] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 16 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
W20260709 13:01:21.893529  1497 connection.cc:256] RPC call timeout handler was delayed by -1.1414951919999794s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20040000000000002s for a response
I20260709 13:01:21.894042  1598 raft_consensus.cc:2393] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 17: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:01:21.899319  1606 raft_consensus.cc:1240] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:01:21.843278  7291 raft_consensus.cc:493] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:21.906806  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:21.894989  7149 raft_consensus.cc:2804] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:21.914026  7149 raft_consensus.cc:493] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:21.917410  7149 raft_consensus.cc:3060] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:21.920439  7232 consensus_queue.cc:237] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:21.923231  7139 consensus_queue.cc:237] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:21.895002  7035 raft_consensus.cc:697] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 16 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:21.927175  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:21.927902  1604 raft_consensus.cc:2468] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 11.
I20260709 13:01:21.931730  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:21.934418  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:21.935089  1598 raft_consensus.cc:2468] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 16.
I20260709 13:01:21.870005  7270 consensus_queue.cc:1048] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 13:01:21.870222  7265 raft_consensus.cc:515] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:21.944041  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:21.912453  7291 raft_consensus.cc:3060] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:21.939409  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 21 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:01:21.932893  7300 log.cc:927] Time spent T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:01:21.946552  7070 raft_consensus.cc:493] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.956489  1680 raft_consensus.cc:1275] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:01:21.956933  7070 raft_consensus.cc:515] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:21.958920  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 170560us
W20260709 13:01:21.961714  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 50182.2us
I20260709 13:01:21.958340  7261 consensus_queue.cc:1048] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 13:01:21.974270  7070 leader_election.cc:290] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:21.927539  7035 consensus_queue.cc:237] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:21.983124  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:21.987730  7149 raft_consensus.cc:515] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:21.989603  1600 raft_consensus.cc:2393] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 18: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:01:21.990229  7149 leader_election.cc:290] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 18 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:21.990651  7141 leader_election.cc:290] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:21.993208  1570 leader_election.cc:304] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:21.994828  7157 leader_election.cc:290] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 10 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:22.000607  7275 raft_consensus.cc:2749] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:21.994980  1497 leader_election.cc:304] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:22.001564  7181 raft_consensus.cc:2749] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:22.001907  7265 leader_election.cc:290] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:22.002889  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 13 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:22.000598  1570 leader_election.cc:304] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:22.004132  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:22.004288  1497 leader_election.cc:304] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:01:22.005026  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:22.005614  1676 raft_consensus.cc:3060] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:22.005841  7146 leader_election.cc:290] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 16 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:22.006996  7261 raft_consensus.cc:2764] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:01:21.996202  1601 raft_consensus.cc:1240] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 16. Current term is 17. Ops: []
W20260709 13:01:22.011158  7301 log.cc:927] Time spent T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 13:01:22.007190  1416 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 4190d217954f4f798b3a610501115290 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica b96ce9cc496c49d7818fa983a17b062b is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:01:22.012836  1572 leader_election.cc:400] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Vote denied by peer b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373) with higher term. Message: Invalid argument: T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 15. Current term is 16.
I20260709 13:01:22.013173  1572 leader_election.cc:403] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:22.015522  7181 raft_consensus.cc:2764] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:01:22.016834  1646 leader_election.cc:304] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:01:22.017467  7150 raft_consensus.cc:3060] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:22.018195  7178 raft_consensus.cc:2804] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:22.018798  7178 raft_consensus.cc:697] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 17 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:21.962816  7295 raft_consensus.cc:493] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.022473  7178 consensus_queue.cc:237] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:22.027833  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:22.028476  1678 raft_consensus.cc:3060] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:22.027740  1602 raft_consensus.cc:1275] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:01:22.018548  1497 leader_election.cc:304] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:22.008731  1570 leader_election.cc:304] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:22.023166  7295 raft_consensus.cc:515] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:22.037261  1676 raft_consensus.cc:2468] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 10.
I20260709 13:01:22.064930  7261 raft_consensus.cc:2749] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:01:22.047909  7305 log.cc:927] Time spent T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:01:22.071249  1673 raft_consensus.cc:2410] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
W20260709 13:01:22.069428  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 60772us
I20260709 13:01:22.072438  1570 leader_election.cc:304] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:22.053371  7308 raft_consensus.cc:2749] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:01:22.073287  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 54844.1us
I20260709 13:01:22.076843  1675 raft_consensus.cc:1240] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:22.087219  1678 raft_consensus.cc:2468] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 18.
I20260709 13:01:22.070376  7132 raft_consensus.cc:493] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
W20260709 13:01:22.113067  1496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:22.085400  7149 raft_consensus.cc:2749] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:22.124258  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:22.125165  1529 raft_consensus.cc:2410] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:01:22.117911  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:22.125711  1532 raft_consensus.cc:3060] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:22.073446  7129 consensus_queue.cc:1048] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 13:01:22.126510  1497 leader_election.cc:304] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:22.129005  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:22.128902  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:22.130029  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:22.128324  1571 leader_election.cc:304] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:22.129580  1529 raft_consensus.cc:3060] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:22.130520  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 13 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 13:01:22.139392  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 67040.1us
I20260709 13:01:22.143100  1525 raft_consensus.cc:2468] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 13.
I20260709 13:01:22.146636  2190 leader_election.cc:304] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:22.153172  2190 leader_election.cc:304] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:22.153419  7232 raft_consensus.cc:2804] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:01:22.154063  7232 raft_consensus.cc:697] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 18 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:22.154251  7070 raft_consensus.cc:2749] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:01:22.155673  7311 log.cc:927] Time spent T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:01:22.128173  7181 raft_consensus.cc:2749] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 LEADER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:22.161682  1497 leader_election.cc:304] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:22.162830  7105 raft_consensus.cc:2749] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:22.146700  7234 consensus_queue.cc:1059] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:01:22.164443  7234 raft_consensus.cc:3055] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:22.164784  7234 raft_consensus.cc:740] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:22.165583  7234 consensus_queue.cc:260] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:22.151609  7149 raft_consensus.cc:493] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:22.167240  7149 raft_consensus.cc:515] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:22.169395  7149 leader_election.cc:290] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:22.173880  7232 consensus_queue.cc:237] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:22.175439  1497 leader_election.cc:304] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:22.176671  7105 raft_consensus.cc:2749] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:22.177747  7318 consensus_queue.cc:1048] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:22.179288  7105 consensus_queue.cc:1048] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:01:22.180692  1497 leader_election.cc:304] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:22.187903  7150 raft_consensus.cc:2749] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373) with higher term. Message: Invalid argument: T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 15. Current term is 16.
I20260709 13:01:22.152312  7291 raft_consensus.cc:515] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:22.183260  2190 leader_election.cc:304] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:22.183403  7070 raft_consensus.cc:2749] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:22.190927  7070 raft_consensus.cc:2804] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:22.191299  7070 raft_consensus.cc:493] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:22.191622  7070 raft_consensus.cc:3060] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:22.183756  7234 raft_consensus.cc:3060] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:22.124259  7132 raft_consensus.cc:515] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:22.195272  1497 leader_election.cc:304] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:22.197065  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:22.187314  1532 raft_consensus.cc:2468] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 16.
I20260709 13:01:22.197674  1602 raft_consensus.cc:3060] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:22.201020  7132 leader_election.cc:290] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:22.198750  1529 raft_consensus.cc:2468] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 10.
I20260709 13:01:22.200233  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:22.204749  2225 raft_consensus.cc:2393] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 14: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:01:22.206913  1497 leader_election.cc:304] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:22.207852  7105 raft_consensus.cc:2804] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:22.208815  7105 raft_consensus.cc:697] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:22.206832  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:22.210460  7105 consensus_queue.cc:237] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:22.211800  7274 raft_consensus.cc:515] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:22.213912  7274 leader_election.cc:290] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:22.214684  7295 leader_election.cc:290] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:22.214910  1497 leader_election.cc:304] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:22.205680  7308 raft_consensus.cc:3060] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:22.199908  2223 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c"
dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
mode: GRACEFUL
new_leader_uuid: "39a92f5a4352465d8af3af5908fe8642"
 from {username='slave'} at 127.0.0.1:47682
I20260709 13:01:22.215756  6898 raft_consensus.cc:2804] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:22.216115  2223 raft_consensus.cc:606] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 18 LEADER]: Received request to transfer leadership to TS 39a92f5a4352465d8af3af5908fe8642
I20260709 13:01:22.216243  6898 raft_consensus.cc:697] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:22.218473  1497 leader_election.cc:304] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:22.191553  7291 leader_election.cc:290] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:22.235226  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:22.236696  2218 raft_consensus.cc:2468] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 14.
I20260709 13:01:22.237831  1646 leader_election.cc:304] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:22.198590  7181 raft_consensus.cc:2764] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:01:22.247810  1679 raft_consensus.cc:1275] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:01:22.248010  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:22.250808  7129 raft_consensus.cc:2804] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:22.253773  7129 raft_consensus.cc:493] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:22.254153  7129 raft_consensus.cc:3060] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:01:22.254503  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 105196us
I20260709 13:01:22.255195  1570 leader_election.cc:304] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
W20260709 13:01:22.249537  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 121291us
I20260709 13:01:22.257665  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:22.177802  7277 consensus_queue.cc:1059] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.073s
I20260709 13:01:22.263612  1570 leader_election.cc:304] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:22.238679  7177 raft_consensus.cc:493] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:22.275318  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:22.276670  1678 raft_consensus.cc:3060] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:22.284583  1678 raft_consensus.cc:2468] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 17.
I20260709 13:01:22.286891  1571 leader_election.cc:304] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:22.217185  6898 consensus_queue.cc:237] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:22.234241  6922 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:22.269551  7275 raft_consensus.cc:2804] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:22.296276  1570 leader_election.cc:304] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:22.259495  7179 consensus_queue.cc:1048] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:01:22.268770  7323 raft_consensus.cc:493] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:22.288913  7132 raft_consensus.cc:3055] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:22.291846  7175 raft_consensus.cc:493] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.331314  2225 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4190d217954f4f798b3a610501115290"
dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
mode: GRACEFUL
new_leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:47682
W20260709 13:01:22.305229  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 86824.3us
I20260709 13:01:22.332423  2225 raft_consensus.cc:606] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Received request to transfer leadership to TS e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:22.332808  2225 raft_consensus.cc:614] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:22.300354  1570 leader_election.cc:304] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:22.297569  7318 raft_consensus.cc:2749] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:22.308341  1674 raft_consensus.cc:1240] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 17. Current term is 18. Ops: []
I20260709 13:01:22.286621  7177 raft_consensus.cc:515] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:22.334812  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:22.336148  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:22.336826  1532 raft_consensus.cc:2368] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for earlier term 9. Current term is 10.
I20260709 13:01:22.337889  1525 raft_consensus.cc:1240] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:22.338075  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:22.338564  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 13:01:22.333562  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:22.295720  7181 raft_consensus.cc:493] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.298899  7275 raft_consensus.cc:493] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:22.342604  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:22.331226  7252 raft_consensus.cc:493] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:22.345975  1530 raft_consensus.cc:1240] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:22.351584  7327 consensus_queue.cc:1059] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:01:22.353017  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:22.354553  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:22.355011  1527 raft_consensus.cc:1240] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:22.356060  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:22.356913  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:22.359577  2220 raft_consensus.cc:1240] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 13 LEADER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:22.362509  2221 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41"
dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
mode: GRACEFUL
new_leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:47682
I20260709 13:01:22.371361  2221 raft_consensus.cc:606] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 16 LEADER]: Received request to transfer leadership to TS e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:22.342540  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:22.363312  2223 raft_consensus.cc:1240] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 19 LEADER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 18. Current term is 19. Ops: []
I20260709 13:01:22.373870  1528 raft_consensus.cc:2393] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 17: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:01:22.374047  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:22.374608  1524 raft_consensus.cc:3060] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:22.375538  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 88747us
I20260709 13:01:22.376320  1571 leader_election.cc:304] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:22.299562  7274 raft_consensus.cc:2749] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:22.379797  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:22.297474  7105 raft_consensus.cc:2804] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:22.382704  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:22.385517  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:22.307888  7132 raft_consensus.cc:740] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
W20260709 13:01:22.409637  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 109368us
I20260709 13:01:22.307559  7323 raft_consensus.cc:515] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:22.411440  1570 leader_election.cc:400] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 election: Vote denied by peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931) with higher term. Message: Invalid argument: T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 13. Current term is 14.
I20260709 13:01:22.412405  1570 leader_election.cc:304] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:22.416831  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:22.418448  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:22.412979  7323 leader_election.cc:290] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:22.413837  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:22.414186  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:22.413705  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:22.367339  7275 raft_consensus.cc:3060] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:22.381807  7277 raft_consensus.cc:2804] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:22.427275  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:22.428289  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:22.440392  1570 leader_election.cc:304] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:22.432832  1526 raft_consensus.cc:2468] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 16.
I20260709 13:01:22.441409  1524 raft_consensus.cc:2468] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 12.
I20260709 13:01:22.442414  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:22.442534  7329 raft_consensus.cc:2804] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:22.437531  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:22.445374  1525 raft_consensus.cc:2393] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 17: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:01:22.367305  7181 raft_consensus.cc:515] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:22.418597  7261 raft_consensus.cc:2804] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:22.452154  1525 raft_consensus.cc:1275] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:01:22.418646  7149 raft_consensus.cc:2804] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:22.461171  7129 raft_consensus.cc:515] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:22.448483  1497 leader_election.cc:304] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:22.448666  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:22.475360  1528 raft_consensus.cc:2368] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for earlier term 9. Current term is 10.
I20260709 13:01:22.372294  7175 raft_consensus.cc:515] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:22.419768  7105 raft_consensus.cc:697] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:22.470048  7308 raft_consensus.cc:2749] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:22.446293  1526 raft_consensus.cc:1275] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:01:22.446164  1570 leader_election.cc:304] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:22.457777  1602 raft_consensus.cc:2468] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 16.
W20260709 13:01:22.461753  7324 log.cc:927] Time spent T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:01:22.439181  7277 raft_consensus.cc:493] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:22.464318  7327 raft_consensus.cc:3055] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:01:22.465034  7149 raft_consensus.cc:697] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 17 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
W20260709 13:01:22.466154  1644 leader_election.cc:336] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.611s (SENT)
I20260709 13:01:22.467814  7181 leader_election.cc:290] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:22.467985  7177 leader_election.cc:290] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:22.468284  1530 raft_consensus.cc:2468] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 17.
I20260709 13:01:22.450429  7274 raft_consensus.cc:493] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:22.450277  7323 raft_consensus.cc:3060] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:22.404685  7281 consensus_queue.cc:1059] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:01:22.445690  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:22.451659  1531 raft_consensus.cc:1275] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:01:22.385797  7252 raft_consensus.cc:515] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:22.480285  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:22.504663  1646 leader_election.cc:304] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:22.447013  7329 raft_consensus.cc:493] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
W20260709 13:01:22.507907  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 61829.7us
I20260709 13:01:22.580804  1570 leader_election.cc:304] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:01:22.515906  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 67504.3us
I20260709 13:01:22.452247  7261 raft_consensus.cc:493] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:22.527266  2218 raft_consensus.cc:1275] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:01:22.524648  1644 leader_election.cc:304] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:22.531771  1529 raft_consensus.cc:2468] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 14.
I20260709 13:01:22.530901  7181 raft_consensus.cc:2749] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:22.514683  7277 raft_consensus.cc:3060] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:22.514622  7327 raft_consensus.cc:740] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:22.534026  7274 raft_consensus.cc:515] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:22.523998  7166 raft_consensus.cc:3060] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:22.458552  7070 raft_consensus.cc:515] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:22.584364  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 79812.3us
I20260709 13:01:22.584918  1570 leader_election.cc:304] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:22.586175  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:22.591302  1497 leader_election.cc:304] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:22.593950  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 13:01:22.594229  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 80674.9us
I20260709 13:01:22.594261  2224 raft_consensus.cc:1275] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:01:22.595369  1678 raft_consensus.cc:1240] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:22.597958  2220 raft_consensus.cc:2393] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 17: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:01:22.600930  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:22.601764  1680 raft_consensus.cc:2393] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 18: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
W20260709 13:01:22.605981  7331 log.cc:927] Time spent T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.073s	user 0.003s	sys 0.000s
I20260709 13:01:22.612046  1673 raft_consensus.cc:1275] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:01:22.585566  7261 raft_consensus.cc:3060] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:22.582737  7329 raft_consensus.cc:3060] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:22.525854  7132 consensus_queue.cc:260] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:22.612609  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 146489us
I20260709 13:01:22.633649  1679 raft_consensus.cc:1240] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:22.612687  7257 raft_consensus.cc:2804] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:22.638530  7175 leader_election.cc:290] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:01:22.650141  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 68370.2us
I20260709 13:01:22.661238  1497 leader_election.cc:304] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:22.698905  2223 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29"
dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
mode: GRACEFUL
new_leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:47682
I20260709 13:01:22.701121  2223 raft_consensus.cc:606] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Received request to transfer leadership to TS e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:22.701488  2223 raft_consensus.cc:614] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:22.633706  7333 raft_consensus.cc:2749] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:22.637720  7274 leader_election.cc:290] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:22.643808  7323 raft_consensus.cc:2749] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:22.638382  7345 raft_consensus.cc:2749] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:01:22.638965  7257 raft_consensus.cc:697] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 16 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
W20260709 13:01:22.705937  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 55428.6us
I20260709 13:01:22.638648  7327 consensus_queue.cc:260] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:22.633719  7336 raft_consensus.cc:2749] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:22.652438  7132 raft_consensus.cc:3060] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:22.611883  7105 consensus_queue.cc:237] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:22.754168  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:22.703308  7330 raft_consensus.cc:2804] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:01:22.758450  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 173629us
I20260709 13:01:22.762108  1598 raft_consensus.cc:1275] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:01:22.762480  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:22.652168  7141 consensus_queue.cc:1059] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.063s
I20260709 13:01:22.705376  7308 raft_consensus.cc:2749] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:22.648114  7275 raft_consensus.cc:515] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:22.763244  1607 raft_consensus.cc:2393] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 16: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:01:22.768029  7070 leader_election.cc:290] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:22.770779  2224 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7352869c54614c80af4953b2ce90cace"
dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
mode: GRACEFUL
new_leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:47682
I20260709 13:01:22.771432  2224 raft_consensus.cc:606] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Received request to transfer leadership to TS e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:22.771771  2224 raft_consensus.cc:614] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:22.772553  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 13:01:22.764551  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 113651us
I20260709 13:01:22.706391  6922 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 18 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:22.627421  7149 consensus_queue.cc:237] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:22.766029  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:22.785205  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:22.786010  1604 raft_consensus.cc:2468] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 14.
I20260709 13:01:22.766183  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:22.780526  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:01:22.782858  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 163813us
I20260709 13:01:22.786777  1598 raft_consensus.cc:3060] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:22.792737  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:22.793385  1602 raft_consensus.cc:3060] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:22.793519  2192 leader_election.cc:304] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:22.763702  7330 raft_consensus.cc:493] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:22.765532  7129 leader_election.cc:290] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:22.807242  1497 leader_election.cc:304] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:22.809186  1605 raft_consensus.cc:2468] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 16.
I20260709 13:01:22.809660  1602 raft_consensus.cc:2468] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 15.
I20260709 13:01:22.818835  7340 consensus_queue.cc:1048] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 13:01:22.823812  7252 leader_election.cc:290] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:22.813993  1602 raft_consensus.cc:1275] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:01:22.802691  7330 raft_consensus.cc:3060] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:22.832007  7335 log.cc:927] Time spent T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.251s	user 0.001s	sys 0.000s
W20260709 13:01:22.835206  7347 log.cc:927] Time spent T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
W20260709 13:01:22.861552  1496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:22.862418  1496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:22.802338  7141 raft_consensus.cc:3060] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:01:22.862980  1496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:22.864426  1532 raft_consensus.cc:3055] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:01:22.864804  1532 raft_consensus.cc:740] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
W20260709 13:01:22.844070  7351 log.cc:927] Time spent T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:01:22.861543  1605 raft_consensus.cc:1275] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:01:22.861330  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 60529.7us
I20260709 13:01:22.867738  1674 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50"
dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
mode: GRACEFUL
new_leader_uuid: "39a92f5a4352465d8af3af5908fe8642"
 from {username='slave'} at 127.0.0.1:33616
I20260709 13:01:22.869936  1674 raft_consensus.cc:606] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Received request to transfer leadership to TS 39a92f5a4352465d8af3af5908fe8642
I20260709 13:01:22.870368  1674 raft_consensus.cc:614] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:22.866536  1532 consensus_queue.cc:260] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:22.874825  1532 raft_consensus.cc:3060] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:22.791333  7350 consensus_queue.cc:1048] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.101s
I20260709 13:01:22.886451  1598 raft_consensus.cc:2468] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 10.
I20260709 13:01:22.895352  1598 raft_consensus.cc:1240] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 18. Current term is 19. Ops: []
W20260709 13:01:22.896198  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 89030.4us
I20260709 13:01:22.897166  1497 leader_election.cc:304] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
W20260709 13:01:22.919708  7339 log.cc:927] Time spent T 00000000000000000000000000000000 P 9f38d0e5c9db43a48554defe1153354e: Append to log took a long time: real 0.212s	user 0.006s	sys 0.000s
I20260709 13:01:22.931803  1532 raft_consensus.cc:1275] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 14. (term mismatch)
I20260709 13:01:22.932302  1532 pending_rounds.cc:85] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting all ops after (but not including) 13
I20260709 13:01:22.932533  1532 pending_rounds.cc:107] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting uncommitted NO_OP operation due to leader change: 18.14
I20260709 13:01:22.932761  1532 raft_consensus.cc:2889] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:22.936587  2190 leader_election.cc:304] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:22.941242  1602 raft_consensus.cc:1240] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 17 LEADER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:22.947168  7141 raft_consensus.cc:2749] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:22.950858  7070 raft_consensus.cc:2804] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:22.951382  7070 raft_consensus.cc:697] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 16 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:22.952241  7070 consensus_queue.cc:237] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:22.960023  7275 leader_election.cc:290] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 18 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:22.961059   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:01:22.963107   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:22.967233  2190 leader_election.cc:304] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
W20260709 13:01:22.968927  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 181175us
I20260709 13:01:22.848120  7257 consensus_queue.cc:237] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:22.974645  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
W20260709 13:01:22.969983  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 80897.8us
I20260709 13:01:22.975446  2224 raft_consensus.cc:2393] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 18: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:01:22.972469  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:22.976187  1598 raft_consensus.cc:2393] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 18: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:01:22.977125  1598 raft_consensus.cc:3060] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:22.975147  2226 raft_consensus.cc:1275] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 13:01:22.982764  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:22.983417  2224 raft_consensus.cc:3060] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:22.985246  2226 raft_consensus.cc:1275] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:01:22.986475  1674 raft_consensus.cc:1275] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:01:22.992293  1572 leader_election.cc:304] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:22.992506  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:22.994362  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:22.995137  1673 raft_consensus.cc:1275] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
W20260709 13:01:22.995959  1644 leader_election.cc:336] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.809s (SENT)
I20260709 13:01:23.000835  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:23.001667  2226 raft_consensus.cc:2393] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 12: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:01:23.002118  1646 leader_election.cc:304] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:23.002930  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:23.003491  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
W20260709 13:01:23.007287  1644 leader_election.cc:336] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.913s (SENT)
I20260709 13:01:23.007853  1644 leader_election.cc:304] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:23.014851  1598 raft_consensus.cc:1275] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:01:23.012715  7149 consensus_queue.cc:1048] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.014s
I20260709 13:01:22.991832  7129 consensus_queue.cc:1048] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 13:01:23.019775  1532 raft_consensus.cc:1275] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:01:22.981459  7245 raft_consensus.cc:2804] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:23.023082  1524 raft_consensus.cc:3055] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:23.022624  2224 raft_consensus.cc:2468] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 15.
I20260709 13:01:22.981699  7234 raft_consensus.cc:2749] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:01:23.042963  7245 raft_consensus.cc:697] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [term 10 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:23.042343  7348 raft_consensus.cc:493] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:23.043707  7348 raft_consensus.cc:515] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:23.028993  1571 leader_election.cc:304] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:23.014370  7035 raft_consensus.cc:2749] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:23.041301  1524 raft_consensus.cc:740] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:23.046873  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:23.040582  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:23.026034  6968 consensus_queue.cc:1048] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.029s
I20260709 13:01:23.054967  1530 raft_consensus.cc:2468] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 12.
I20260709 13:01:23.052969  1524 consensus_queue.cc:260] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:23.029354  7232 raft_consensus.cc:2749] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:23.054827  1532 raft_consensus.cc:3060] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:01:23.044021  7245 consensus_queue.cc:237] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:23.049580  7270 consensus_queue.cc:1048] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:01:23.057078  7329 raft_consensus.cc:515] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:23.049964  7346 consensus_queue.cc:1059] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.177s
I20260709 13:01:23.055894  1524 raft_consensus.cc:3060] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:23.059741  1599 raft_consensus.cc:1240] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:23.058606  1646 leader_election.cc:304] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
W20260709 13:01:23.060552  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 58663.6us
I20260709 13:01:23.064498  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:23.065420  7323 consensus_queue.cc:1048] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:23.065663  7281 raft_consensus.cc:2804] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:23.013393  7295 consensus_queue.cc:1048] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.047s
I20260709 13:01:23.066493  7281 raft_consensus.cc:697] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 15 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:23.030395  7333 raft_consensus.cc:2749] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:01:23.067610  7281 consensus_queue.cc:237] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:23.068670  7346 raft_consensus.cc:3055] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:01:23.069105  7346 raft_consensus.cc:740] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:23.069844  7346 consensus_queue.cc:260] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:23.080411  1530 raft_consensus.cc:1275] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:01:23.088306  1532 raft_consensus.cc:2468] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 15.
I20260709 13:01:23.065292  7146 consensus_queue.cc:1048] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.020s
I20260709 13:01:23.074489  7275 raft_consensus.cc:2749] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:23.093474  2190 leader_election.cc:304] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:23.108556  1607 raft_consensus.cc:1275] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 13:01:23.097433  1524 raft_consensus.cc:1275] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:01:23.119133  2190 leader_election.cc:304] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:23.089440  7346 raft_consensus.cc:3060] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:23.134435  7178 raft_consensus.cc:3055] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:23.135061  7178 raft_consensus.cc:740] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
W20260709 13:01:23.140874  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 53898.8us
I20260709 13:01:23.144040  2190 leader_election.cc:304] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:23.144410  1604 raft_consensus.cc:1240] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 11. Current term is 12. Ops: []
W20260709 13:01:23.145279  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:23.134737  7343 consensus_queue.cc:1048] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.017s
I20260709 13:01:23.122570  7177 raft_consensus.cc:2749] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:23.155874  7141 raft_consensus.cc:993] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b: : Instructing follower e46412b3b0b44f01ad5c33d4cfe3d6b1 to start an election
I20260709 13:01:23.156395  7141 raft_consensus.cc:1081] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 16 LEADER]: Signalling peer e46412b3b0b44f01ad5c33d4cfe3d6b1 to start an election
I20260709 13:01:23.092814  7349 raft_consensus.cc:493] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:23.157730  7349 raft_consensus.cc:515] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:23.148516  6968 consensus_queue.cc:1048] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 13:01:23.162127  7263 raft_consensus.cc:2804] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:23.163501  1604 raft_consensus.cc:1240] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 17. Current term is 18. Ops: []
W20260709 13:01:23.170923  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 160450us
I20260709 13:01:23.171703  1677 raft_consensus.cc:1240] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 16 LEADER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 15. Current term is 16. Ops: []
W20260709 13:01:23.171972  1644 leader_election.cc:336] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 2.122s (SENT)
I20260709 13:01:23.172399  1644 leader_election.cc:304] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:23.173250  7035 raft_consensus.cc:2749] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:01:23.173509  1644 leader_election.cc:336] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.861s (SENT)
W20260709 13:01:23.174345  1644 leader_election.cc:336] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.949s (SENT)
I20260709 13:01:23.175215  1644 leader_election.cc:304] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:23.176107  7257 raft_consensus.cc:2749] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:01:23.180382  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 259298us
W20260709 13:01:23.188550  1570 leader_election.cc:336] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.646s (SENT)
W20260709 13:01:23.189656  1570 leader_election.cc:336] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.678s (SENT)
I20260709 13:01:23.136044  7178 consensus_queue.cc:260] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:23.191839  2192 leader_election.cc:304] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:23.162792  7263 raft_consensus.cc:697] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 15 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:23.190124  1570 leader_election.cc:304] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:01:23.199579  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 302517us
I20260709 13:01:23.193037  7257 raft_consensus.cc:493] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:23.203876  1570 leader_election.cc:336] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.724s (SENT)
W20260709 13:01:23.206722  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:23.206158  1570 leader_election.cc:304] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:01:23.241108  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:23.196199  7141 raft_consensus.cc:2749] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:23.192970  7157 raft_consensus.cc:2804] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:01:23.302933  1496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:23.344332  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 140539us
W20260709 13:01:23.346880  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 144444us
W20260709 13:01:23.355005  1570 leader_election.cc:336] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.540s (SENT)
W20260709 13:01:23.354246  1496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:23.207290  7166 consensus_meta.cc:287] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.614s	user 0.007s	sys 0.003s
I20260709 13:01:23.196609  6968 consensus_queue.cc:1048] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.107s
I20260709 13:01:23.204448  7359 raft_consensus.cc:2749] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:01:23.355703  1496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:23.305114  6898 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.850s	user 0.010s	sys 0.027s
W20260709 13:01:23.361490  1496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:23.346859  7330 consensus_meta.cc:287] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.520s	user 0.012s	sys 0.008s
W20260709 13:01:23.383370  1496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:23.392357  1644 leader_election.cc:336] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 2.112s (SENT)
W20260709 13:01:23.359632  7261 consensus_meta.cc:287] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.721s	user 0.011s	sys 0.009s
I20260709 13:01:23.354542  7275 raft_consensus.cc:2749] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:01:23.396741  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 192194us
W20260709 13:01:23.377602  6898 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.923s	user 0.012s	sys 0.035s
I20260709 13:01:23.398444  1497 leader_election.cc:304] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:23.356624  7153 consensus_queue.cc:1059] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.043s
I20260709 13:01:23.401580  1497 leader_election.cc:304] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:23.394075  7263 consensus_queue.cc:237] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:23.303427  7257 raft_consensus.cc:515] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:23.206427  7341 consensus_queue.cc:1048] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.189s
W20260709 13:01:23.415196  7368 log.cc:927] Time spent T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 13:01:23.393688  7277 consensus_meta.cc:287] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.804s	user 0.008s	sys 0.005s
I20260709 13:01:23.395516  7281 raft_consensus.cc:493] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:23.413628  1497 leader_election.cc:304] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:23.435350  1497 leader_election.cc:304] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:23.362365  7166 raft_consensus.cc:2749] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:23.415877  7277 raft_consensus.cc:515] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:01:23.426057  1496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:23.399855  7329 leader_election.cc:290] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:23.427706  7178 raft_consensus.cc:3060] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:23.412384  7332 raft_consensus.cc:2749] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:23.432319  7153 consensus_queue.cc:1243] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer 39a92f5a4352465d8af3af5908fe8642 log is divergent from this leader: its last log entry 17.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:01:23.432842  7257 leader_election.cc:290] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
W20260709 13:01:23.397944  7132 consensus_meta.cc:287] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.638s	user 0.007s	sys 0.003s
I20260709 13:01:23.434628  6988 raft_consensus.cc:2749] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:01:23.442370  1497 leader_election.cc:304] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:23.397857  7336 raft_consensus.cc:2749] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 LEADER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:23.444758  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:23.416791  7367 raft_consensus.cc:2749] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:23.458941  1605 raft_consensus.cc:1240] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:23.443023  7105 raft_consensus.cc:2764] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader election decision vote started in defunct term 15: won
W20260709 13:01:23.450378  7371 log.cc:927] Time spent T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:01:23.443131  7179 raft_consensus.cc:493] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:23.460934  7277 leader_election.cc:290] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 16 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:23.461414  7179 raft_consensus.cc:515] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:23.463536  7179 leader_election.cc:290] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:23.451891  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43010 (request call id 2588) took 1103 ms. Trace:
I20260709 13:01:23.398514  7261 raft_consensus.cc:515] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:23.470162  1601 raft_consensus.cc:1240] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:23.443508  7348 leader_election.cc:290] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:23.436910  7281 raft_consensus.cc:515] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:23.457171  7376 log.cc:927] Time spent T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.054s	user 0.002s	sys 0.000s
I20260709 13:01:23.459720  7265 raft_consensus.cc:993] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b: : Instructing follower 39a92f5a4352465d8af3af5908fe8642 to start an election
W20260709 13:01:23.464305  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 320352us
I20260709 13:01:23.465211  1598 raft_consensus.cc:2468] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 17.
I20260709 13:01:23.464380  1529 rpcz_store.cc:276] 0709 13:01:22.348385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:22.352774 (+  4389us) service_pool.cc:224] Handling call
0709 13:01:23.451665 (+1098891us) spinlock_profiling.cc:243] Waited 162 ms on lock 0x7b54001b67d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:01:23.451792 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":373007104}
I20260709 13:01:23.471761  1497 leader_election.cc:304] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:23.397521  7330 raft_consensus.cc:515] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:23.476291  6988 raft_consensus.cc:2804] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:23.473786  7367 consensus_queue.cc:1048] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 13:01:23.476997  1607 raft_consensus.cc:1240] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:23.476730  1497 leader_election.cc:304] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:23.477252  7265 raft_consensus.cc:1081] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 18 LEADER]: Signalling peer 39a92f5a4352465d8af3af5908fe8642 to start an election
I20260709 13:01:23.477474  7343 consensus_queue.cc:1048] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 13:01:23.482103  7327 raft_consensus.cc:3060] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:23.476830  6988 raft_consensus.cc:697] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:23.483698  7257 raft_consensus.cc:493] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:23.483491  6988 consensus_queue.cc:237] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:23.478046  1496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:23.484234  7257 raft_consensus.cc:515] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:23.485702  1524 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41"
dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:49310
I20260709 13:01:23.486248  1524 raft_consensus.cc:493] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:23.486354  7257 leader_election.cc:290] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:23.488723  1524 raft_consensus.cc:3060] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:23.491676  7332 raft_consensus.cc:2749] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:23.496383  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:23.497991  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:23.498840  1524 raft_consensus.cc:515] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:23.506103  1497 leader_election.cc:304] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:23.512362  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:23.473353  7105 raft_consensus.cc:2749] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:01:23.520184  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:23.520429  1674 raft_consensus.cc:3060] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:23.521986  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:23.522497  1524 leader_election.cc:290] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 17 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:23.538837  7346 raft_consensus.cc:2749] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:23.540035  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: true dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:23.540711  1678 raft_consensus.cc:3060] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:23.537022  6922 consensus_queue.cc:1059] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 13:01:23.544781  6922 raft_consensus.cc:3055] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:23.545152  6922 raft_consensus.cc:740] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:23.545961  6922 consensus_queue.cc:260] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:23.549722  7330 leader_election.cc:290] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:23.516086  7333 consensus_queue.cc:1048] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.031s
I20260709 13:01:23.550454  6922 raft_consensus.cc:3060] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:23.522913  7295 consensus_queue.cc:1059] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:01:23.541332  7257 consensus_queue.cc:1059] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 13:01:23.515841  7035 consensus_queue.cc:1048] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.037s
I20260709 13:01:23.558113  1676 raft_consensus.cc:1240] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 16. Current term is 17. Ops: [16.14-16.14]
I20260709 13:01:23.563923  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:23.565733  7070 consensus_queue.cc:1059] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:01:23.567410  7295 raft_consensus.cc:3055] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:23.567842  7295 raft_consensus.cc:740] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:23.568638  7295 consensus_queue.cc:260] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:23.570269  7178 raft_consensus.cc:3055] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:01:23.570688  7178 raft_consensus.cc:740] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:23.571521  7178 consensus_queue.cc:260] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:23.569737  7295 raft_consensus.cc:3060] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:23.554406  1497 leader_election.cc:304] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:23.580679  1678 raft_consensus.cc:2468] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 17.
I20260709 13:01:23.582419  1681 raft_consensus.cc:1240] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 16. Current term is 17. Ops: []
W20260709 13:01:23.581789  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:23.578549  1497 leader_election.cc:304] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:23.584673  1497 leader_election.cc:304] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:23.589062  1497 leader_election.cc:304] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
W20260709 13:01:23.589661  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 66056.9us
I20260709 13:01:23.590377  1646 leader_election.cc:304] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:23.531404  7332 consensus_queue.cc:1059] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 13:01:23.594781  1674 raft_consensus.cc:1275] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:01:23.600235  7349 leader_election.cc:290] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:23.584378  7105 raft_consensus.cc:2804] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:23.619714  7105 raft_consensus.cc:493] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:23.620342  7336 raft_consensus.cc:2749] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:01:23.620203  7105 raft_consensus.cc:3060] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:23.606053  7175 raft_consensus.cc:3055] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:01:23.611387  7369 log.cc:927] Time spent T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.208s	user 0.002s	sys 0.000s
I20260709 13:01:23.588052  6922 raft_consensus.cc:493] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:23.615051  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:23.602286  7333 raft_consensus.cc:2804] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:23.590211  7181 raft_consensus.cc:2804] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:23.601603  7281 leader_election.cc:290] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:23.615483  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36200 (request call id 2790) took 1196 ms. Trace:
I20260709 13:01:23.641072  1572 leader_election.cc:304] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:23.603482  7346 raft_consensus.cc:2749] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:01:23.641564  1601 rpcz_store.cc:276] 0709 13:01:22.419545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:22.419702 (+   157us) service_pool.cc:224] Handling call
0709 13:01:22.420032 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:23.472661 (+1052629us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:23.615254 (+142593us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b540039ec54. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:01:23.615424 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2414795136}
I20260709 13:01:23.641165  7333 raft_consensus.cc:493] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:23.634501  7175 raft_consensus.cc:740] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:23.666388  1646 leader_election.cc:304] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:23.640790  7181 raft_consensus.cc:493] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:23.668262  1601 raft_consensus.cc:1275] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 13:01:23.656011  1416 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 4190d217954f4f798b3a610501115290 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:01:23.677814  1602 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c"
dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
 from {username='slave'} at 127.0.0.1:57268
I20260709 13:01:23.678442  1602 raft_consensus.cc:493] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:23.678826  1602 raft_consensus.cc:3060] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:23.677712  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:23.642105  7270 consensus_queue.cc:1059] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 13:01:23.683203  7181 raft_consensus.cc:3060] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:23.640767  6922 raft_consensus.cc:515] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:23.689332  6922 leader_election.cc:290] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:23.671809  2190 leader_election.cc:304] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:23.674209  7333 raft_consensus.cc:3060] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:23.708102  7175 consensus_queue.cc:260] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:23.710294  7270 raft_consensus.cc:3055] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:23.712667  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:23.716893  1605 raft_consensus.cc:1240] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 17 LEADER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 16. Current term is 17. Ops: [16.14-16.14]
I20260709 13:01:23.725615  7157 raft_consensus.cc:493] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
W20260709 13:01:23.735054  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:23.730962  1570 leader_election.cc:336] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.808s (SENT)
I20260709 13:01:23.735857  1570 leader_election.cc:304] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:01:23.733304  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 61584.9us
I20260709 13:01:23.713290  7252 raft_consensus.cc:2749] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:23.738485  1602 raft_consensus.cc:515] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:23.732043  7348 raft_consensus.cc:2749] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:01:23.774705  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:23.951292  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 220383us
W20260709 13:01:23.959208  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 370237us
I20260709 13:01:23.735030  7177 raft_consensus.cc:2749] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:23.733110  7270 raft_consensus.cc:740] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:23.773131  7175 raft_consensus.cc:3060] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:01:23.805408  1496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:23.969413  1496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:23.736009  7157 raft_consensus.cc:3060] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:23.774950  7349 raft_consensus.cc:2749] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:01:23.951161  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 160679us
I20260709 13:01:23.735769  7295 consensus_queue.cc:1059] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.186s
I20260709 13:01:23.772629  7383 consensus_queue.cc:1048] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 13:01:23.770386  6922 consensus_queue.cc:1059] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 13:01:23.952740  1603 raft_consensus.cc:1240] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 18. Current term is 19. Ops: []
I20260709 13:01:23.961158  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:23.961256  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 21 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:23.979967  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:23.980310   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:23.980101  1529 raft_consensus.cc:2368] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 15. Current term is 16.
I20260709 13:01:23.962812  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:23.971465  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:23.980470  1532 raft_consensus.cc:2468] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 20.
I20260709 13:01:23.981994  1528 raft_consensus.cc:2410] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for term 18 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
W20260709 13:01:23.982421  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 240245us
I20260709 13:01:23.972745  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:23.962253  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:23.984086  1602 leader_election.cc:290] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 19 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:23.979615  1672 raft_consensus.cc:1275] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:01:23.992192  1531 raft_consensus.cc:2368] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 14. Current term is 15.
I20260709 13:01:23.983672  1525 raft_consensus.cc:2376] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 17. Re-sending same reply.
I20260709 13:01:23.952453  7153 raft_consensus.cc:493] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:23.952260  7346 raft_consensus.cc:476] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 LEADER]: Not starting pre-election -- already a leader
I20260709 13:01:23.999884  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:24.005538  1525 raft_consensus.cc:2468] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 14.
I20260709 13:01:24.000835  1528 raft_consensus.cc:1275] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:01:23.977031  7332 consensus_queue.cc:1243] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer ddf11fc190dd4b898773379c6b129d90 log is divergent from this leader: its last log entry 16.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:01:23.976291  6968 raft_consensus.cc:493] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:24.016580  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:24.017712  1528 raft_consensus.cc:2410] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for term 17 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 13:01:23.992302  7350 raft_consensus.cc:493] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
W20260709 13:01:24.078989  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:24.080916  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 104761us
W20260709 13:01:24.087167  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 104032us
I20260709 13:01:24.088584  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:24.095690  1525 raft_consensus.cc:2393] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 17: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:01:24.101704  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:24.102368  1531 raft_consensus.cc:3060] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:24.008491  7153 raft_consensus.cc:515] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:24.103071  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:24.098191  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:24.083493  7277 raft_consensus.cc:493] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:24.086514  7384 raft_consensus.cc:3055] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:01:24.138132  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:24.023289  6968 raft_consensus.cc:515] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:24.102048  7139 raft_consensus.cc:493] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:24.174141  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:24.086218  7350 raft_consensus.cc:515] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:24.118221  7336 raft_consensus.cc:493] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:24.122493  7384 raft_consensus.cc:740] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:24.101035  7378 consensus_queue.cc:1048] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.077s
I20260709 13:01:24.080510  7270 consensus_queue.cc:260] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:01:24.206501  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 118641us
I20260709 13:01:24.223400  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:24.224036  1532 raft_consensus.cc:3060] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:24.224927  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:24.225551  1528 raft_consensus.cc:3060] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:01:24.195256  7373 log.cc:927] Time spent T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.742s	user 0.000s	sys 0.004s
I20260709 13:01:24.161262  7277 raft_consensus.cc:515] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:24.250185  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 21 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:24.255108  1529 raft_consensus.cc:2468] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 20.
I20260709 13:01:24.257233  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:24.257934  1529 raft_consensus.cc:2368] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 15. Current term is 16.
I20260709 13:01:24.260202  1532 raft_consensus.cc:2468] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 12.
W20260709 13:01:24.255762  7181 consensus_meta.cc:287] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent flushing consensus metadata: real 0.572s	user 0.016s	sys 0.029s
I20260709 13:01:24.274598  7157 raft_consensus.cc:515] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:24.213207  7336 raft_consensus.cc:515] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:24.279052  7384 consensus_queue.cc:260] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:24.259542  7393 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:24.280704  7153 leader_election.cc:290] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
W20260709 13:01:24.282189  7105 consensus_meta.cc:287] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent flushing consensus metadata: real 0.644s	user 0.008s	sys 0.000s
I20260709 13:01:24.226147  7383 raft_consensus.cc:493] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:24.285187  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:24.308344  1527 raft_consensus.cc:2468] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 14.
I20260709 13:01:24.308810  7105 raft_consensus.cc:515] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:24.309285  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:24.309918  1527 raft_consensus.cc:3060] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:24.285707  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:24.311132  1529 raft_consensus.cc:2393] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 12: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:01:24.249939  7141 raft_consensus.cc:493] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:24.249084  7295 raft_consensus.cc:493] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
W20260709 13:01:24.285722  7397 log.cc:927] Time spent T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
W20260709 13:01:24.274518  7333 consensus_meta.cc:287] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.540s	user 0.006s	sys 0.000s
W20260709 13:01:24.290499  7398 log.cc:927] Time spent T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.208s	user 0.000s	sys 0.001s
W20260709 13:01:24.291855  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 83924.4us
I20260709 13:01:24.292467  1528 raft_consensus.cc:2468] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 18.
I20260709 13:01:24.315834  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:24.293138  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:24.317171  1532 raft_consensus.cc:3060] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:24.183535  7139 raft_consensus.cc:515] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:24.325649  7139 leader_election.cc:290] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:24.301226  7181 raft_consensus.cc:515] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:24.328656  7181 leader_election.cc:290] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 17 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:24.316001  7333 raft_consensus.cc:515] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:24.301036  7327 raft_consensus.cc:493] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:24.331432  7327 raft_consensus.cc:515] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:24.331784  7261 leader_election.cc:290] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:24.333108  7350 leader_election.cc:290] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:24.333544  7327 leader_election.cc:290] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:24.335026  7406 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:24.335242  7336 leader_election.cc:290] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:24.335445  7295 raft_consensus.cc:515] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:24.335599  7406 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:24.313656  7393 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:24.337581  7295 leader_election.cc:290] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:24.338033  7141 raft_consensus.cc:515] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:24.267593  7400 log.cc:927] Time spent T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 13:01:24.292672  7387 log.cc:927] Time spent T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.316s	user 0.000s	sys 0.001s
W20260709 13:01:24.307022  7392 log.cc:927] Time spent T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 13:01:24.307475  7383 raft_consensus.cc:515] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:24.298337  7332 raft_consensus.cc:493] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:24.313956  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 13:01:24.321280  7404 log.cc:927] Time spent T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
W20260709 13:01:24.321766  7391 log.cc:927] Time spent T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.198s	user 0.000s	sys 0.001s
I20260709 13:01:24.323199  7277 leader_election.cc:290] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:24.308563  7157 leader_election.cc:290] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 13 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:24.338601  7406 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:24.339349  2221 raft_consensus.cc:1275] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:01:24.339732  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: true dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
W20260709 13:01:24.259315  7385 log.cc:927] Time spent T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.289s	user 0.002s	sys 0.002s
I20260709 13:01:24.341025  1528 raft_consensus.cc:2410] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for term 18 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:01:24.341949  1527 raft_consensus.cc:2468] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 10.
I20260709 13:01:24.311061  7105 leader_election.cc:290] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:24.343197  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:24.344651  2223 raft_consensus.cc:1275] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:01:24.348059  1531 raft_consensus.cc:2468] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 18.
I20260709 13:01:24.397637  1526 raft_consensus.cc:1275] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:01:24.348196  1532 raft_consensus.cc:2468] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 16.
I20260709 13:01:24.307163  7384 raft_consensus.cc:3060] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:24.352056  1603 raft_consensus.cc:1240] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 11. Current term is 12. Ops: []
W20260709 13:01:24.323195  7396 log.cc:927] Time spent T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:01:24.354760  2225 raft_consensus.cc:1275] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:01:24.360637  2226 raft_consensus.cc:3055] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:01:24.401165  2226 raft_consensus.cc:740] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:24.402088  2226 consensus_queue.cc:260] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:24.403146  2224 raft_consensus.cc:1275] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 14. (term mismatch)
I20260709 13:01:24.403460  2226 raft_consensus.cc:3060] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:24.403568  2224 pending_rounds.cc:85] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b: Aborting all ops after (but not including) 13
I20260709 13:01:24.404033  2224 pending_rounds.cc:107] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b: Aborting uncommitted NO_OP operation due to leader change: 16.14
I20260709 13:01:24.404276  2224 raft_consensus.cc:2889] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:24.400779  7195 raft_consensus.cc:493] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
W20260709 13:01:24.410799  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:24.415021  7333 leader_election.cc:290] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 18 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:24.419482  2226 raft_consensus.cc:2468] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 17.
I20260709 13:01:24.398995  7139 raft_consensus.cc:493] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:24.421171  7139 raft_consensus.cc:515] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:24.356860  7332 raft_consensus.cc:515] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:24.425403  7139 leader_election.cc:290] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:24.426723  7332 leader_election.cc:290] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:24.430475  1600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1248) took 1558 ms. Trace:
I20260709 13:01:24.430953  1600 rpcz_store.cc:276] 0709 13:01:22.871768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:22.894163 (+ 22395us) service_pool.cc:224] Handling call
0709 13:01:22.894508 (+   345us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:22.929014 (+ 34506us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:22.929044 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:22.938555 (+  9511us) log.cc:844] Serialized 52 byte log entry
0709 13:01:23.664408 (+725853us) spinlock_profiling.cc:243] Waited 19.8 ms on lock 0x7b1800364de0. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1e38ede1 00007f6a1e39b5b1 00007f6a154a8e07 00007f6a1e303ab9 00007f6a154c569b 00007f6a154c393f 00007f6a154c5c02 00007f6a1814d20b 00007f6a18152d23 00007f6a181530d1 00007f6a1856ea0f
0709 13:01:23.975953 (+311545us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:24.302270 (+326317us) log.cc:844] Serialized 14 byte log entry
0709 13:01:24.303192 (+   922us) log.cc:844] Serialized 14 byte log entry
0709 13:01:24.304858 (+  1666us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:24.304957 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:24.430277 (+125320us) raft_consensus.cc:1685] finished
0709 13:01:24.430297 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:24.430418 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36606,"prepare.queue_time_us":199654,"prepare.run_cpu_time_us":102,"prepare.run_wall_time_us":3612,"raft.queue_time_us":37948,"raft.run_cpu_time_us":314,"raft.run_wall_time_us":12264,"spinlock_wait_cycles":45644544,"thread_start_us":609059,"threads_started":2,"wal-append.queue_time_us":1160288}
I20260709 13:01:24.433310  7383 leader_election.cc:290] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:24.433817  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:24.409075  7393 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:24.440739  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:24.434451  1601 raft_consensus.cc:3060] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:24.449952  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:24.455209  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:24.456137  7141 leader_election.cc:290] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:24.426807  7195 raft_consensus.cc:515] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:24.463848  7195 leader_election.cc:290] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:24.468969  1524 raft_consensus.cc:1275] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:01:24.470085  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:24.400252  7327 raft_consensus.cc:493] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:24.478533  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:24.479108  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:24.479769  1531 raft_consensus.cc:3060] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:24.487914  1526 raft_consensus.cc:1240] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:24.486940  1531 raft_consensus.cc:2468] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 13.
I20260709 13:01:24.494812  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:24.472973  7232 raft_consensus.cc:493] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:24.494088  1601 raft_consensus.cc:2468] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 18.
I20260709 13:01:24.498584  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:24.499028  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: true dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:24.499990  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:24.500342  1680 raft_consensus.cc:3060] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:24.504384  1496 leader_election.cc:304] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:24.510102  2224 raft_consensus.cc:1240] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:24.510939  1497 leader_election.cc:304] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:24.476508  7327 raft_consensus.cc:515] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:24.516806  2223 raft_consensus.cc:1275] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:01:24.518036  1646 leader_election.cc:304] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:24.518908  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:24.519589  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:24.519842  7333 consensus_queue.cc:1059] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:24.520676  7333 raft_consensus.cc:3055] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:24.521009  7333 raft_consensus.cc:740] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:24.521291  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:24.521745  7333 consensus_queue.cc:260] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:24.524060  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:24.525990  7407 consensus_queue.cc:1048] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:01:24.513367  7232 raft_consensus.cc:515] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:24.528805  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:24.529604  7232 leader_election.cc:290] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:24.527347  2190 leader_election.cc:304] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:24.530421  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:24.531534  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:24.532521  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:24.534036  7412 raft_consensus.cc:2804] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:24.534549  7412 raft_consensus.cc:697] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 13 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:24.519487  7384 raft_consensus.cc:2749] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:24.535449  7412 consensus_queue.cc:237] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:24.522096  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:24.536865  1529 raft_consensus.cc:2393] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 14: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:01:24.537694  6898 raft_consensus.cc:2804] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:01:24.490337  7263 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.034s	user 0.037s	sys 0.020s
I20260709 13:01:24.507393  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:24.543905  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:24.544564  1674 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 18.
I20260709 13:01:24.544701  1680 raft_consensus.cc:2468] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 19.
I20260709 13:01:24.545446  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:24.494413  7322 raft_consensus.cc:493] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:24.552572  1674 raft_consensus.cc:2393] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 18: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:01:24.538300  6898 raft_consensus.cc:697] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:24.473909  7277 consensus_queue.cc:1048] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.065s
W20260709 13:01:24.547043  7263 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.091s	user 0.038s	sys 0.020s
I20260709 13:01:24.512562  7350 raft_consensus.cc:493] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:24.562626  6898 consensus_queue.cc:237] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:24.585915  7350 raft_consensus.cc:515] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:24.547912  7332 raft_consensus.cc:2749] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:24.573385  7326 raft_consensus.cc:3055] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:24.577214  1674 raft_consensus.cc:1240] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 16 LEADER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:24.581480  6968 leader_election.cc:290] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
W20260709 13:01:24.583959  7377 log.cc:927] Time spent T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 1.130s	user 0.004s	sys 0.000s
I20260709 13:01:24.585232  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:24.554085  7333 raft_consensus.cc:3060] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:24.593801  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:24.596618  1677 raft_consensus.cc:2468] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 10.
I20260709 13:01:24.588035  7350 leader_election.cc:290] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:24.600119  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: true dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:24.601034  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:24.621244  2227 raft_consensus.cc:2468] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 17.
I20260709 13:01:24.599412  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:24.621795  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:24.622406  2221 raft_consensus.cc:2468] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 13.
I20260709 13:01:24.596484  1530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49310 (request call id 1515) took 1107 ms. Trace:
W20260709 13:01:24.601589  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 69801.2us
I20260709 13:01:24.546471  7393 consensus_queue.cc:1048] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.050s
I20260709 13:01:24.553792  7384 consensus_queue.cc:1048] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.065s
I20260709 13:01:24.556068  7322 raft_consensus.cc:515] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:24.648705  1646 leader_election.cc:304] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:24.662575  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:24.592216  7389 raft_consensus.cc:3055] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:24.623204  1530 rpcz_store.cc:276] 0709 13:01:23.488584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:23.494897 (+  6313us) service_pool.cc:224] Handling call
0709 13:01:23.495206 (+   309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:23.495576 (+   370us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:23.495603 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:23.496074 (+   471us) log.cc:844] Serialized 26 byte log entry
0709 13:01:23.589438 (+ 93364us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:23.603746 (+ 14308us) log.cc:844] Serialized 14 byte log entry
0709 13:01:23.632139 (+ 28393us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:23.632226 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:24.418225 (+785999us) spinlock_profiling.cc:243] Waited 4.66 ms on lock 0x7b4800002dd8. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1d4dcaa1 00007f6a1d4d3b37 00007f6a1d4d39ca 00007f6a1d5cb26f 00007f6a1d5caf37 00007f6a1d5df55c 00007f6a1d5df508 00007f6a1d5df488 00007f6a1d5df443 00007f6a1d5de6ec 00007f6a1c508a96
0709 13:01:24.564345 (+146120us) spinlock_profiling.cc:243] Waited 2.16 ms on lock 0x7b1800265960. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1e38ede1 00007f6a1e39b5b1 00007f6a154c63f3 00007f6a154c87c1 00007f6a154c8779 00007f6a154c8709 00007f6a154c86d1 00007f6a154c79cd 000000000038f354 000000000038f199 00007f6a154a983a
0709 13:01:24.596232 (+ 31887us) raft_consensus.cc:1685] finished
0709 13:01:24.596264 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:24.596402 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28130,"prepare.queue_time_us":14083,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":30,"raft.queue_time_us":47816,"raft.run_cpu_time_us":15877,"raft.run_wall_time_us":903395,"spinlock_wait_cycles":15674624,"thread_start_us":92965,"threads_started":1,"wal-append.queue_time_us":144444}
I20260709 13:01:24.667465  1646 leader_election.cc:304] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:24.625028  7326 raft_consensus.cc:740] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:24.661993  1572 leader_election.cc:304] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
W20260709 13:01:24.671185  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:24.671164  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 120968us
I20260709 13:01:24.624245  7263 consensus_queue.cc:1059] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.047s
I20260709 13:01:24.667119  7035 consensus_queue.cc:1059] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
W20260709 13:01:24.678609  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 89762.8us
I20260709 13:01:24.618741  7367 consensus_queue.cc:1059] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 13:01:24.679641  1525 raft_consensus.cc:1240] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:24.680730  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:24.680999  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:24.687376  1527 raft_consensus.cc:3060] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:24.664853  7410 raft_consensus.cc:2749] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:24.691639  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:24.692567  1532 raft_consensus.cc:2468] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 17.
I20260709 13:01:24.685386  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:24.695540  1527 raft_consensus.cc:2468] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 15.
I20260709 13:01:24.670523  7389 raft_consensus.cc:740] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:24.675117  7257 raft_consensus.cc:2804] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:01:24.719874  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:24.703884  7277 raft_consensus.cc:2804] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:24.672780  7419 consensus_queue.cc:1048] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
I20260709 13:01:24.705010  7423 raft_consensus.cc:493] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:24.709765  1676 raft_consensus.cc:1275] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:01:24.712023  7178 raft_consensus.cc:3060] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:24.714460  7181 consensus_queue.cc:1048] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:24.715818  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
W20260709 13:01:24.756330  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:24.756682  1525 raft_consensus.cc:2410] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for term 17 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 13:01:24.718410  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:24.720811  1532 raft_consensus.cc:1275] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:01:24.720781  1527 raft_consensus.cc:2393] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 18: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:01:24.725988  7424 raft_consensus.cc:493] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:24.731899  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:24.732740  7257 raft_consensus.cc:697] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 18 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:24.784294  7257 consensus_queue.cc:237] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:24.733669  7389 consensus_queue.cc:260] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:24.718787  7367 consensus_queue.cc:1243] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer ddf11fc190dd4b898773379c6b129d90 log is divergent from this leader: its last log entry 16.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:01:24.700347  7395 consensus_queue.cc:1048] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.039s
W20260709 13:01:24.739812  7417 log.cc:927] Time spent T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 13:01:24.742033  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:24.739670  2223 raft_consensus.cc:3055] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 18 LEADER]: Stepping down as leader of term 18
W20260709 13:01:24.760766  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:24.812356  2223 raft_consensus.cc:740] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:24.767758  1532 raft_consensus.cc:1275] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:01:24.778247  7390 log.cc:927] Time spent T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.696s	user 0.001s	sys 0.000s
I20260709 13:01:24.813174  2221 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 18.
W20260709 13:01:24.783347  7415 log.cc:927] Time spent T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.437s	user 0.003s	sys 0.000s
I20260709 13:01:24.782886  7424 raft_consensus.cc:515] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:24.741725  7277 raft_consensus.cc:493] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:24.821504  7277 raft_consensus.cc:3060] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:24.821802  7424 leader_election.cc:290] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:24.823993  2223 consensus_queue.cc:260] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:24.825188  2223 raft_consensus.cc:3060] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:01:24.826138  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:24.828172  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:24.829493  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:24.830055  1497 leader_election.cc:304] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:24.830710  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:24.828825  1532 raft_consensus.cc:2468] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 14.
I20260709 13:01:24.832644  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36200 (request call id 2808) took 1217 ms. Trace:
I20260709 13:01:24.833036  1604 rpcz_store.cc:276] 0709 13:01:23.624125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:23.624255 (+   130us) service_pool.cc:224] Handling call
0709 13:01:23.624579 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:23.633468 (+  8889us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:23.633497 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:23.634040 (+   543us) log.cc:844] Serialized 26 byte log entry
0709 13:01:23.726857 (+ 92817us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:01:23.726901 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:23.726977 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:24.777474 (+1050497us) spinlock_profiling.cc:243] Waited 4.57 ms on lock 0x7b4400022b4c. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a153ecc85 00007f6a153ed6a2 00007f6a1815f1db 00007f6a1815aaaf 00007f6a1814e86e 00007f6a1814dbb6 00007f6a1814d7d8 00007f6a18157221 00007f6a181571d9 00007f6a18157169
0709 13:01:24.822874 (+ 45400us) raft_consensus.cc:1685] finished
0709 13:01:24.822897 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:24.832586 (+  9689us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8482,"raft.queue_time_us":9357,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":3656,"spinlock_wait_cycles":10504576,"thread_start_us":80326,"threads_started":1,"wal-append.queue_time_us":336995}
W20260709 13:01:24.833564  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 171651us
I20260709 13:01:24.809614  7322 leader_election.cc:290] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:01:24.861163  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 210778us
I20260709 13:01:24.807489  7423 raft_consensus.cc:515] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:24.826030  7179 consensus_queue.cc:1048] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:01:24.878799  2223 raft_consensus.cc:2468] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 19.
W20260709 13:01:24.892046  2190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:24.872884  1571 leader_election.cc:304] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:24.859933  7132 raft_consensus.cc:493] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:24.896453  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:24.997809  1572 leader_election.cc:304] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
W20260709 13:01:25.095414  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 97703.9us
W20260709 13:01:24.904340  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:25.100376  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 235466us
W20260709 13:01:25.108122  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 242774us
W20260709 13:01:25.111068  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:25.132656  7420 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 19 current term: 19 is higher.
W20260709 13:01:24.951073  7432 log.cc:927] Time spent T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:01:25.129727  1571 leader_election.cc:304] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:25.141281  1571 leader_election.cc:304] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:25.141695  7440 raft_consensus.cc:2804] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:25.142335  7440 raft_consensus.cc:697] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 10 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:25.117659  7232 raft_consensus.cc:2804] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:25.143260  7440 consensus_queue.cc:237] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:25.143805  7232 raft_consensus.cc:493] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:25.153410  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:25.153537  7232 raft_consensus.cc:3060] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:25.154762  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:25.155390  1524 raft_consensus.cc:3060] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:25.156502  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:25.157104  1530 raft_consensus.cc:2376] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 15. Re-sending same reply.
I20260709 13:01:25.149816  6988 raft_consensus.cc:493] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:25.150349  7383 raft_consensus.cc:493] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:25.152782  7435 log.cc:927] Time spent T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.153s	user 0.000s	sys 0.000s
I20260709 13:01:25.145042  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50664 (request call id 1432) took 1587 ms. Trace:
I20260709 13:01:25.178910  1681 rpcz_store.cc:276] 0709 13:01:23.557855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:23.557974 (+   119us) service_pool.cc:224] Handling call
0709 13:01:23.582226 (+ 24252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:23.582816 (+   590us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:25.144840 (+1562024us) spinlock_profiling.cc:243] Waited 15.1 ms on lock 0x7b540017a050. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b28ad 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:01:25.144955 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":34618624}
I20260709 13:01:25.161907  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:25.168155  1570 leader_election.cc:304] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:24.873914  7181 raft_consensus.cc:2804] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:01:25.071722  7146 raft_consensus.cc:493] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:25.143594  7323 raft_consensus.cc:2749] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:25.239766  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 13:01:25.279838  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:25.074254  7139 raft_consensus.cc:493] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:24.874925  7322 consensus_queue.cc:1048] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.303s
W20260709 13:01:25.373188  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:25.156203   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:25.382611  2220 raft_consensus.cc:1275] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:01:25.170387  7035 raft_consensus.cc:493] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:25.392247  1524 raft_consensus.cc:2468] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 18.
W20260709 13:01:25.402634  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 246725us
I20260709 13:01:25.238207  7429 raft_consensus.cc:493] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:25.378518  7384 raft_consensus.cc:493] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:25.115329  7132 raft_consensus.cc:515] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:01:25.397305  7291 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.608s	user 0.022s	sys 0.037s
I20260709 13:01:25.376437  7181 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:25.407672  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:25.171458  7261 consensus_queue.cc:1048] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.227s
W20260709 13:01:25.385668  7333 consensus_meta.cc:287] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.758s	user 0.008s	sys 0.002s
W20260709 13:01:25.427667  1644 leader_election.cc:336] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 2.093s (SENT)
I20260709 13:01:25.395687  7348 raft_consensus.cc:493] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:25.431053  7270 raft_consensus.cc:3060] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:01:25.527977  7374 log.cc:927] Time spent T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 2.078s	user 0.000s	sys 0.019s
I20260709 13:01:25.515600  2218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50310 (request call id 1148) took 2021 ms. Trace:
I20260709 13:01:25.428114  6898 raft_consensus.cc:493] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:25.523247  7327 leader_election.cc:290] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:01:25.530398  7441 log.cc:927] Time spent T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.233s	user 0.000s	sys 0.000s
W20260709 13:01:25.526891  7438 log.cc:927] Time spent T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 13:01:25.402279  7139 raft_consensus.cc:515] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:25.482790  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:25.554903  2190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:25.178841  6988 raft_consensus.cc:515] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:25.570071  7348 raft_consensus.cc:515] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:25.486048  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:25.572777  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:25.399277  7146 raft_consensus.cc:515] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:25.481123  7346 consensus_queue.cc:1048] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.083s
W20260709 13:01:25.503603  7178 consensus_meta.cc:287] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.747s	user 0.010s	sys 0.000s
I20260709 13:01:25.428773  7384 raft_consensus.cc:515] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:25.410519  7437 raft_consensus.cc:2804] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:01:25.426707  7291 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.022s	sys 0.037s
I20260709 13:01:25.184216  7383 raft_consensus.cc:515] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:01:25.610086  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 203615us
W20260709 13:01:25.557785  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 130166us
I20260709 13:01:25.410817  7035 raft_consensus.cc:515] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:25.559581  2218 rpcz_store.cc:276] 0709 13:01:23.494137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:23.499304 (+  5167us) service_pool.cc:224] Handling call
0709 13:01:23.499621 (+   317us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:23.511921 (+ 12300us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:01:23.530268 (+ 18347us) log.cc:844] Serialized 14 byte log entry
0709 13:01:24.717443 (+1187175us) spinlock_profiling.cc:243] Waited 2.76 ms on lock 0x7b1800160b40. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1e38ede1 00007f6a1e39b5b1 00007f6a154a8e07 00007f6a1e303ab9 00007f6a154c569b 00007f6a154c393f 00007f6a154c5c02 00007f6a1814d20b 00007f6a18152d23 00007f6a1815323a 00007f6a185bda2a
0709 13:01:24.946835 (+229392us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:24.951571 (+  4736us) log.cc:844] Serialized 52 byte log entry
0709 13:01:24.951747 (+   176us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:24.951784 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:24.951861 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:25.515254 (+563393us) raft_consensus.cc:1685] finished
0709 13:01:25.515350 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:25.515514 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":192013,"prepare.queue_time_us":18315,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":13364,"raft.queue_time_us":89240,"raft.run_cpu_time_us":296,"raft.run_wall_time_us":17763,"spinlock_wait_cycles":6352384,"thread_start_us":154957,"threads_started":1,"wal-append.queue_time_us":1853389}
W20260709 13:01:25.564555  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 396500us
I20260709 13:01:25.415768  7429 raft_consensus.cc:515] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:25.574609  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:25.600906  7178 raft_consensus.cc:493] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:25.605660  7410 raft_consensus.cc:493] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:25.478919  7181 raft_consensus.cc:3060] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:01:25.612161  1644 leader_election.cc:336] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 2.286s (SENT)
I20260709 13:01:25.572167  7423 leader_election.cc:290] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:25.575179  7129 raft_consensus.cc:493] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:25.621869  1678 raft_consensus.cc:2468] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 13.
I20260709 13:01:25.579164  7333 raft_consensus.cc:493] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:25.659557  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:25.661677  1681 raft_consensus.cc:2410] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b for term 19 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:01:25.614878  6988 leader_election.cc:290] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:25.614849  7327 raft_consensus.cc:493] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:25.671835  1523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49310 (request call id 1539) took 1121 ms. Trace:
I20260709 13:01:25.568944  6898 raft_consensus.cc:515] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:25.698150  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:25.700018  7327 raft_consensus.cc:515] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:25.702518  7327 leader_election.cc:290] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:25.703254  7327 raft_consensus.cc:493] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:25.703907  7327 raft_consensus.cc:515] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:25.708061  7035 leader_election.cc:290] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:25.708772  7035 raft_consensus.cc:493] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:25.709250  7035 raft_consensus.cc:515] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:25.713325  7327 leader_election.cc:290] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:25.718158  7327 raft_consensus.cc:493] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:25.689009  1523 rpcz_store.cc:276] 0709 13:01:24.550299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:24.552426 (+  2127us) service_pool.cc:224] Handling call
0709 13:01:24.552733 (+   307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:24.665614 (+112881us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:24.665648 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:24.666123 (+   475us) log.cc:844] Serialized 26 byte log entry
0709 13:01:24.862819 (+196696us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:24.862874 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:24.862940 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:25.671538 (+808598us) raft_consensus.cc:1685] finished
0709 13:01:25.671567 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:25.671758 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":13569,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":23099,"thread_start_us":300316,"threads_started":2,"wal-append.queue_time_us":400517}
I20260709 13:01:25.700234  7456 raft_consensus.cc:493] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:25.748481  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 166308us
W20260709 13:01:25.748487  1416 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 4190d217954f4f798b3a610501115290 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:01:25.622970  7336 raft_consensus.cc:493] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:25.628353  7410 raft_consensus.cc:515] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:25.752781  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:25.626705  7178 raft_consensus.cc:515] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:25.697733  6988 raft_consensus.cc:493] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:25.723912  7295 raft_consensus.cc:493] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
W20260709 13:01:25.747179  7232 consensus_meta.cc:287] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.587s	user 0.010s	sys 0.000s
W20260709 13:01:25.751543  7277 consensus_meta.cc:287] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.915s	user 0.011s	sys 0.000s
I20260709 13:01:25.663350  7129 raft_consensus.cc:515] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:25.754427  7327 raft_consensus.cc:515] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:25.768996  7458 raft_consensus.cc:493] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:25.787151  7458 raft_consensus.cc:515] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:25.789783  7458 leader_election.cc:290] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:25.769178  2225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50326 (request call id 1202) took 1026 ms. Trace:
I20260709 13:01:25.672423  7333 raft_consensus.cc:515] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:25.774933  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 13:01:25.775774  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:25.793977  7291 raft_consensus.cc:493] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
W20260709 13:01:25.793431  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:25.792917  2225 rpcz_store.cc:276] 0709 13:01:24.743136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:24.743667 (+   531us) service_pool.cc:224] Handling call
0709 13:01:24.744041 (+   374us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:24.744458 (+   417us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:24.744486 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:24.823278 (+ 78792us) log.cc:844] Serialized 52 byte log entry
0709 13:01:25.374327 (+551049us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:25.764014 (+389687us) log.cc:844] Serialized 14 byte log entry
0709 13:01:25.768829 (+  4815us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:25.768909 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:25.768957 (+    48us) raft_consensus.cc:1685] finished
0709 13:01:25.768969 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:25.769113 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4080,"raft.queue_time_us":27580,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":8759,"thread_start_us":751449,"threads_started":2,"wal-append.queue_time_us":578100}
I20260709 13:01:25.775862  6988 raft_consensus.cc:515] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:25.784106  7232 raft_consensus.cc:515] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:25.780750  7295 raft_consensus.cc:515] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:25.763857  7456 raft_consensus.cc:515] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:25.784983  7132 leader_election.cc:290] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:25.786052  7453 raft_consensus.cc:493] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:25.786309  7277 raft_consensus.cc:515] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:25.768391  7336 raft_consensus.cc:515] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:25.942435  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:25.825734  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:25.956652  1679 raft_consensus.cc:2468] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 12.
I20260709 13:01:25.833000  2223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50310 (request call id 1154) took 1241 ms. Trace:
I20260709 13:01:25.808668  1644 leader_election.cc:400] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 election: Vote denied by peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931) with higher term. Message: Invalid argument: T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for earlier term 9. Current term is 10.
I20260709 13:01:25.810098  7384 leader_election.cc:290] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:25.815274  7456 leader_election.cc:290] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:25.810822  6988 leader_election.cc:290] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:25.844125  7461 raft_consensus.cc:493] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:25.965255  7461 raft_consensus.cc:515] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:25.967549  7461 leader_election.cc:290] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:01:25.967790  7452 log.cc:927] Time spent T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.307s	user 0.002s	sys 0.000s
I20260709 13:01:25.816311  1674 raft_consensus.cc:1240] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 18. Current term is 19. Ops: []
I20260709 13:01:25.821287  1680 raft_consensus.cc:1275] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 13:01:25.825711  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:25.959410  1644 leader_election.cc:403] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:01:25.958380  2223 rpcz_store.cc:276] 0709 13:01:24.591333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:24.599896 (+  8563us) service_pool.cc:224] Handling call
0709 13:01:25.832753 (+1232857us) spinlock_profiling.cc:243] Waited 119 ms on lock 0x7b540045d3d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:01:25.832892 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":273038592}
I20260709 13:01:25.812332  7327 leader_election.cc:290] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:25.795800  7291 raft_consensus.cc:515] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:25.812526  7232 leader_election.cc:290] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 18 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:25.813351  7348 leader_election.cc:290] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:25.816404  7035 leader_election.cc:290] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:25.809708  7429 leader_election.cc:290] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:25.814627  7295 leader_election.cc:290] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:01:25.999811  7463 log.cc:927] Time spent T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.143s	user 0.000s	sys 0.003s
W20260709 13:01:26.015054  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 218686us
I20260709 13:01:25.974918  7281 raft_consensus.cc:2749] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931) with higher term. Message: Invalid argument: T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for earlier term 9. Current term is 10.
I20260709 13:01:26.021045  7420 raft_consensus.cc:493] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
W20260709 13:01:26.062783  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 287219us
I20260709 13:01:26.066596  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:26.072599  2223 raft_consensus.cc:2468] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 17.
I20260709 13:01:26.017352  7383 leader_election.cc:290] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:26.017575  7139 leader_election.cc:290] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:01:26.077222  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:26.077018  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:26.078773  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:26.082602  1644 leader_election.cc:304] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:25.970979  7453 raft_consensus.cc:515] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:26.086292  1644 leader_election.cc:304] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:26.065055  7429 raft_consensus.cc:493] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:26.074100  7327 raft_consensus.cc:493] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:26.082275  7461 raft_consensus.cc:493] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:26.097265  7327 raft_consensus.cc:515] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:26.097748  7461 raft_consensus.cc:515] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:26.099606  7327 leader_election.cc:290] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:26.100107  7461 leader_election.cc:290] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:26.100878  7429 raft_consensus.cc:515] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:26.095510  1646 leader_election.cc:304] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
W20260709 13:01:26.105764  2190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:25.829084  7181 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:26.078609  7473 raft_consensus.cc:493] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:26.079391  7457 raft_consensus.cc:493] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
W20260709 13:01:26.097184  7466 log.cc:927] Time spent T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:01:26.067304  7295 consensus_queue.cc:1048] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:01:26.091641  6898 leader_election.cc:290] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:26.092002  7383 raft_consensus.cc:2749] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:26.094197  7333 leader_election.cc:290] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:26.094343  7129 leader_election.cc:290] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:26.122293  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:26.092537  7469 raft_consensus.cc:493] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:26.120891  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:26.123961  1644 leader_election.cc:304] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:26.102777  7139 raft_consensus.cc:493] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:26.121963  1680 raft_consensus.cc:1275] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:01:26.108666  7461 raft_consensus.cc:493] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.127017  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:26.085126  7281 consensus_queue.cc:1059] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 13:01:26.129634  1678 raft_consensus.cc:1240] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 16 LEADER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:26.066023  7420 raft_consensus.cc:515] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:26.132526  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:26.128984  7350 raft_consensus.cc:3060] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:26.133181  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:26.140930  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:26.069569  7035 consensus_queue.cc:1048] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:01:26.121460  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:01:26.136059  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 524629us
I20260709 13:01:26.149271  1674 raft_consensus.cc:2468] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 14.
I20260709 13:01:26.119760  7410 leader_election.cc:290] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:26.147361  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:26.122460  7467 raft_consensus.cc:2749] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:01:26.149508  1570 leader_election.cc:304] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:26.130601  7330 raft_consensus.cc:493] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.130900  7353 raft_consensus.cc:493] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:26.141137  7129 raft_consensus.cc:2804] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:26.132426  6898 raft_consensus.cc:493] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.135648  7424 raft_consensus.cc:493] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:26.151346  7383 raft_consensus.cc:2749] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:26.175930  1675 raft_consensus.cc:2468] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 17.
I20260709 13:01:26.138283  7437 raft_consensus.cc:697] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 19 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:26.146585  7327 raft_consensus.cc:476] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 LEADER]: Not starting pre-election -- already a leader
W20260709 13:01:26.165632  7270 consensus_meta.cc:287] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.601s	user 0.013s	sys 0.000s
I20260709 13:01:26.179714  7129 raft_consensus.cc:493] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:26.153825  1524 raft_consensus.cc:1275] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:01:26.136600  7139 raft_consensus.cc:515] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:26.179338  7360 raft_consensus.cc:493] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.136724  7461 raft_consensus.cc:515] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:01:26.197187  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 58184.5us
I20260709 13:01:26.200156  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:26.148797  7474 consensus_queue.cc:1048] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.060s
I20260709 13:01:26.117795  7457 raft_consensus.cc:515] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:26.180595  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 56714.3us
I20260709 13:01:26.117022  7473 raft_consensus.cc:515] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:26.189680  7336 leader_election.cc:290] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:26.210687  7129 raft_consensus.cc:3060] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:26.175932  7132 raft_consensus.cc:493] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:26.183502  7277 leader_election.cc:290] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:01:26.221797  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 73802.1us
W20260709 13:01:26.225366  7472 log.cc:927] Time spent T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
I20260709 13:01:26.224192  1644 leader_election.cc:304] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:26.186780  6898 raft_consensus.cc:515] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:26.212468  1599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36200 (request call id 2825) took 1056 ms. Trace:
I20260709 13:01:26.190852  7181 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 19 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:26.176625  7330 raft_consensus.cc:515] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:26.136092  7469 raft_consensus.cc:515] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:26.231349  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:26.269915  1678 raft_consensus.cc:2468] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 13.
I20260709 13:01:26.227332  7261 raft_consensus.cc:2804] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:01:26.234483  7468 log.cc:927] Time spent T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.190s	user 0.000s	sys 0.001s
I20260709 13:01:26.179646  7353 raft_consensus.cc:515] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:01:26.222105  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 72694.4us
I20260709 13:01:26.301397  1570 leader_election.cc:400] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Vote denied by peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931) with higher term. Message: Invalid argument: T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 15. Current term is 16.
W20260709 13:01:26.239004  7477 log.cc:927] Time spent T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:01:26.249351  1673 raft_consensus.cc:2468] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 16.
I20260709 13:01:26.264273  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:26.239341  7464 raft_consensus.cc:493] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.233961  7460 raft_consensus.cc:493] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:26.229357  7291 leader_election.cc:290] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:26.188560  7424 raft_consensus.cc:515] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:26.296600  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 69315.9us
I20260709 13:01:26.317317  1571 leader_election.cc:304] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:26.230319  7348 raft_consensus.cc:493] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.255436  1599 rpcz_store.cc:276] 0709 13:01:25.156415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:25.156542 (+   127us) service_pool.cc:224] Handling call
0709 13:01:25.156835 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:25.157050 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:01:25.180228 (+ 23178us) log.cc:844] Serialized 14 byte log entry
0709 13:01:26.123660 (+943432us) spinlock_profiling.cc:243] Waited 3.4 ms on lock 0x7b18000403c0. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1e38ede1 00007f6a1e39b5b1 00007f6a15440c0a 00007f6a1eb80219 00007f6a154c8a40 00007f6a154c34e4 00007f6a154c3455 00007f6a185ab060 00007f6a185bd716 00007f6a185ce287 00007f6a185ce208
0709 13:01:26.212082 (+ 88422us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:26.212148 (+    66us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:01:26.212219 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:26.212286 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:26.212407 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":99194,"prepare.queue_time_us":23317,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":762788,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":9065,"spinlock_wait_cycles":7822080,"thread_start_us":88175,"threads_started":1}
W20260709 13:01:26.302879  7480 log.cc:927] Time spent T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 13:01:26.304296  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:26.227902  7327 raft_consensus.cc:493] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.305954  1570 leader_election.cc:304] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:26.225636  7360 raft_consensus.cc:515] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:01:26.306811  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 82703.1us
I20260709 13:01:26.336585  1644 leader_election.cc:304] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:26.293889  7261 raft_consensus.cc:493] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:26.315241  1676 raft_consensus.cc:2410] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 18 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:01:26.308625  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:26.323625  1678 raft_consensus.cc:2468] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 19.
I20260709 13:01:26.346402  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:26.346601  7489 raft_consensus.cc:2804] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:26.347033  1678 raft_consensus.cc:3060] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:26.324522  1570 leader_election.cc:304] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:26.307508  7257 raft_consensus.cc:493] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.322562  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:26.327970  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:26.349678  1602 raft_consensus.cc:2468] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 18.
W20260709 13:01:26.341696  1644 connection.cc:256] RPC call timeout handler was delayed by -1.1163429830000382s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.195s for a response
I20260709 13:01:26.305688  7281 raft_consensus.cc:2749] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:26.254191  7132 raft_consensus.cc:515] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:26.351554  7453 leader_election.cc:290] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:26.342411  7419 consensus_queue.cc:1048] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.013s
I20260709 13:01:26.333256  7348 raft_consensus.cc:515] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:26.342589  7327 raft_consensus.cc:515] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:26.343775  7460 raft_consensus.cc:515] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:26.333418  7437 consensus_queue.cc:237] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:26.356468  1570 leader_election.cc:304] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:26.349023  7261 raft_consensus.cc:3060] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:26.313810  7429 leader_election.cc:290] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:26.362377  1599 raft_consensus.cc:2468] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 14.
I20260709 13:01:26.345125  7291 raft_consensus.cc:2749] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:01:26.378520  1678 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 19.
I20260709 13:01:26.383519  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:26.342790  7332 raft_consensus.cc:493] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:26.386838  7403 consensus_queue.cc:1048] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.068s
I20260709 13:01:26.387645  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:26.388252  1678 raft_consensus.cc:2468] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 12.
I20260709 13:01:26.357652  7157 raft_consensus.cc:493] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:26.393931  1600 raft_consensus.cc:1275] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:01:26.375543  7322 raft_consensus.cc:2804] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:26.321754  7464 raft_consensus.cc:515] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:26.375852  7489 raft_consensus.cc:697] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 12 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:26.375543  7420 leader_election.cc:290] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:01:26.399109  7476 log.cc:927] Time spent T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.219s	user 0.001s	sys 0.000s
I20260709 13:01:26.359856  7257 raft_consensus.cc:515] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:26.424397  7489 consensus_queue.cc:237] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:26.415845  7459 raft_consensus.cc:2804] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:26.427127  7459 raft_consensus.cc:493] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:26.427604  7459 raft_consensus.cc:3060] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:26.394867  7479 consensus_queue.cc:1059] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 10, Time since last communication: 0.069s
I20260709 13:01:26.432796  7479 consensus_queue.cc:1243] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer ddf11fc190dd4b898773379c6b129d90 log is divergent from this leader: its last log entry 16.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:01:26.433391  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:26.436100  7469 leader_election.cc:290] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:26.437119  7473 leader_election.cc:290] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:26.438326  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:26.439114  7360 leader_election.cc:290] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:26.439417  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:26.440088  1672 raft_consensus.cc:2468] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 10.
I20260709 13:01:26.440920  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:26.441560  2218 raft_consensus.cc:2468] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 15.
I20260709 13:01:26.431015  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:01:26.427381  7451 log.cc:927] Time spent T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.763s	user 0.003s	sys 0.000s
I20260709 13:01:26.444483  2224 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 1124) took 1368 ms. Trace:
I20260709 13:01:26.444830  2224 rpcz_store.cc:276] 0709 13:01:25.075907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:25.076143 (+   236us) service_pool.cc:224] Handling call
0709 13:01:25.076528 (+   385us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:25.076974 (+   446us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:25.077003 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:25.108834 (+ 31831us) log.cc:844] Serialized 26 byte log entry
0709 13:01:25.398742 (+289908us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:25.398788 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:25.398863 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:26.426787 (+1027924us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b4400022b4c. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a153ecc85 00007f6a153ed6a2 00007f6a1815f1db 00007f6a1815aaaf 00007f6a1814e86e 00007f6a1814dbb6 00007f6a1814d7d8 00007f6a18157221 00007f6a181571d9 00007f6a18157169
0709 13:01:26.444211 (+ 17424us) raft_consensus.cc:1685] finished
0709 13:01:26.444233 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:26.444424 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":30399,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":26364,"spinlock_wait_cycles":262219008,"thread_start_us":252705,"threads_started":1,"wal-append.queue_time_us":429809}
I20260709 13:01:26.441097  7424 leader_election.cc:290] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:26.448441  7353 leader_election.cc:290] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:26.439051  1602 raft_consensus.cc:2468] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 12.
W20260709 13:01:26.450966  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 94616.4us
I20260709 13:01:26.451786  1570 leader_election.cc:304] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:26.449682  1646 leader_election.cc:304] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:26.406932  7322 raft_consensus.cc:493] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:26.405817  7139 leader_election.cc:290] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:01:26.467700  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 109590us
I20260709 13:01:26.447294  7132 leader_election.cc:290] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:26.473629  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:26.464162  7491 raft_consensus.cc:2749] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:26.471976  1570 leader_election.cc:304] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:26.398594  7332 raft_consensus.cc:515] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:26.440121  7457 leader_election.cc:290] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:26.403451  7157 raft_consensus.cc:515] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:26.472155  1646 leader_election.cc:304] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:26.450030  7348 leader_election.cc:290] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:26.471269  7322 raft_consensus.cc:3060] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:26.481268  7440 raft_consensus.cc:2804] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:01:26.494408  7330 leader_election.cc:290] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:26.489030  1646 leader_election.cc:304] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:26.498288  1570 leader_election.cc:304] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:26.479735  7291 raft_consensus.cc:2749] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:26.499850  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:26.504624  7424 raft_consensus.cc:493] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.505213  7424 raft_consensus.cc:515] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:26.508047  7424 leader_election.cc:290] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:26.510380  1570 leader_election.cc:304] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:26.514323  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:26.486750  7461 leader_election.cc:290] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:26.495687  7252 raft_consensus.cc:2804] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:01:26.522547  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:26.524154  1570 leader_election.cc:304] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:26.527271  7440 raft_consensus.cc:697] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 18 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:26.510723  7132 raft_consensus.cc:2749] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:26.531036  7464 leader_election.cc:290] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:26.521287  7360 raft_consensus.cc:493] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
W20260709 13:01:26.535287  1644 leader_election.cc:336] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.950s (SENT)
I20260709 13:01:26.535169  7360 raft_consensus.cc:515] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:26.537289  7360 leader_election.cc:290] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:26.537804  7332 leader_election.cc:290] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:26.539198  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:26.543840  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:26.547581  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:26.510017  7483 raft_consensus.cc:2804] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:26.551256  7483 raft_consensus.cc:493] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:26.551738  7483 raft_consensus.cc:3060] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:26.553347  7157 leader_election.cc:290] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:26.555909  7440 consensus_queue.cc:237] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:26.548522  1676 raft_consensus.cc:2468] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 14.
I20260709 13:01:26.560025  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:26.561498  1676 raft_consensus.cc:1275] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:01:26.526546  7252 raft_consensus.cc:493] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:26.563131  7252 raft_consensus.cc:3060] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:26.551810  7261 raft_consensus.cc:515] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:26.568041  1606 raft_consensus.cc:1240] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 21 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 20. Current term is 21. Ops: []
I20260709 13:01:26.516281  7348 raft_consensus.cc:2804] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:26.518754  7330 consensus_queue.cc:1048] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 13:01:26.571815  7330 consensus_queue.cc:1243] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 log is divergent from this leader: its last log entry 15.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:01:26.550724  7327 leader_election.cc:290] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:26.576557  7348 raft_consensus.cc:697] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 16 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
W20260709 13:01:26.587538  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:26.628580  7332 consensus_queue.cc:765] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Error trying to read ahead of the log while preparing peer request: Incomplete: Op with index 10 is ahead of the local log (next sequential op: 10). Destination peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 15.9, Next index: 11, Last known committed idx: 10, Time since last communication: 0.281s
I20260709 13:01:26.525720  7424 raft_consensus.cc:2749] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:01:26.640096  7261 leader_election.cc:290] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 21 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:26.578512  7360 raft_consensus.cc:2749] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:26.646968  7348 consensus_queue.cc:237] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:01:26.647605  2190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:26.647960  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:01:26.648406  7450 log.cc:927] Time spent T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.898s	user 0.004s	sys 0.000s
I20260709 13:01:26.649137  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:26.651283  1607 raft_consensus.cc:1240] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 17. Current term is 18. Ops: []
I20260709 13:01:26.652778  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:26.657156  1598 raft_consensus.cc:1240] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 17. Current term is 18. Ops: []
W20260709 13:01:26.667357  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:26.947496  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50664 (request call id 1450) took 1162 ms. Trace:
W20260709 13:01:26.697450  1572 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.196:37373 timed out after 2.112s (SENT) [suppressed 22 similar messages]
I20260709 13:01:26.681347  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:26.954873  1571 leader_election.cc:304] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:26.953341  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:26.958249  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:26.663959  1496 leader_election.cc:304] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:26.953015  1681 rpcz_store.cc:276] 0709 13:01:25.785290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:25.785506 (+   216us) service_pool.cc:224] Handling call
0709 13:01:25.816022 (+ 30516us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:26.063021 (+246999us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:26.063067 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:26.063112 (+    45us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:01:26.063150 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:26.947238 (+884088us) spinlock_profiling.cc:243] Waited 247 ms on lock 0x7b54000a4954. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:01:26.947290 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:26.947432 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":567624064}
I20260709 13:01:26.964251  1605 raft_consensus.cc:2393] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 12: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
W20260709 13:01:26.966387  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 302533us
I20260709 13:01:26.977399  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:01:26.950013  7350 consensus_meta.cc:287] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.809s	user 0.011s	sys 0.000s
I20260709 13:01:26.978230  1598 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 18.
I20260709 13:01:26.730423  7157 raft_consensus.cc:493] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.997421  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:26.935884  7470 raft_consensus.cc:493] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.982363  1496 leader_election.cc:304] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:26.879133  7407 raft_consensus.cc:493] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:26.966686  7440 raft_consensus.cc:2804] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:27.003952  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:26.651994  7129 raft_consensus.cc:515] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:26.974128  6988 raft_consensus.cc:2804] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:27.005805  1496 leader_election.cc:304] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:26.978564  7330 consensus_queue.cc:1048] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:01:27.002285  7157 raft_consensus.cc:515] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:26.978885  7327 raft_consensus.cc:493] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:27.007462  7440 raft_consensus.cc:493] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:27.011035  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:26.867236  7322 raft_consensus.cc:515] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:26.983067  6922 raft_consensus.cc:493] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:27.008790  7407 raft_consensus.cc:515] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:27.014729  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49310 (request call id 1541) took 2421 ms. Trace:
I20260709 13:01:26.999487  7350 raft_consensus.cc:2749] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:27.036734  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:27.037876  1526 rpcz_store.cc:276] 0709 13:01:24.590485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:24.590850 (+   365us) service_pool.cc:224] Handling call
0709 13:01:24.591175 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:24.591401 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:24.591426 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:25.142575 (+551149us) spinlock_profiling.cc:243] Waited 7.26 ms on lock 0x7b2c00000658. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a16eaca11 00007f6a16ebc372 00007f6a185eea01 00007f6a185b343a 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2
0709 13:01:25.143042 (+   467us) log.cc:844] Serialized 26 byte log entry
0709 13:01:25.561725 (+418683us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:25.561768 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:25.561836 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:26.598683 (+1036847us) spinlock_profiling.cc:243] Waited 31.7 ms on lock 0x7b4400022b4c. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a153ecc85 00007f6a153ed6a2 00007f6a1815f1db 00007f6a1815aaaf 00007f6a1814e86e 00007f6a1814dbb6 00007f6a1814d7d8 00007f6a18157221 00007f6a181571d9 00007f6a18157169
0709 13:01:27.011386 (+412703us) raft_consensus.cc:1685] finished
0709 13:01:27.011409 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:27.011548 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":89585664,"thread_start_us":418294,"threads_started":1,"wal-append.queue_time_us":479896}
I20260709 13:01:27.011924  7457 raft_consensus.cc:2804] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:27.033350  7440 raft_consensus.cc:3060] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:27.045976  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:27.052003  1598 raft_consensus.cc:2468] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 17.
I20260709 13:01:27.015905  6988 raft_consensus.cc:493] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:27.025017  7129 leader_election.cc:290] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 18 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:27.055197  1602 raft_consensus.cc:1240] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:27.057075  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:27.061718  1598 raft_consensus.cc:2468] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 19.
I20260709 13:01:27.063478  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:27.039902  6922 raft_consensus.cc:515] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:26.890467  7483 raft_consensus.cc:515] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:27.051546  7332 raft_consensus.cc:2804] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:01:27.058125  6988 raft_consensus.cc:3060] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:27.055616  7457 raft_consensus.cc:493] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:27.012650  7470 raft_consensus.cc:515] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:27.034245  7327 raft_consensus.cc:515] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:27.139174  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:27.233206  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:27.234463  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:27.078836  7332 raft_consensus.cc:493] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:27.082173  7457 raft_consensus.cc:3060] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:27.245723  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:27.246381  1598 raft_consensus.cc:2468] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 13.
I20260709 13:01:27.247407  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:27.248539  1598 raft_consensus.cc:3060] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:27.252732  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:27.254287  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:27.084131  6968 raft_consensus.cc:493] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:27.231377  7129 raft_consensus.cc:493] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:27.263828  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 339049us
W20260709 13:01:27.264470  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:27.246629  7332 raft_consensus.cc:3060] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:27.266170  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:27.271970  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:27.273242  1675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49178 (request call id 2426) took 1146 ms. Trace:
I20260709 13:01:27.273694  1675 rpcz_store.cc:276] 0709 13:01:26.120803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:26.122047 (+  1244us) service_pool.cc:224] Handling call
0709 13:01:27.266795 (+1144748us) spinlock_profiling.cc:243] Waited 50.7 ms on lock 0x7b5400179154. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:01:27.266926 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":116576000}
I20260709 13:01:27.280596  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:27.284725  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:27.286173  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:27.287485  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:27.288126  1528 raft_consensus.cc:2468] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 18.
I20260709 13:01:27.288074  1598 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 19.
I20260709 13:01:27.290599  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:27.291627  1598 raft_consensus.cc:2468] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 14.
I20260709 13:01:27.290498  1675 raft_consensus.cc:2393] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 16: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:01:27.293571  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:27.294471  1528 raft_consensus.cc:2468] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 12.
I20260709 13:01:27.295292  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:27.295899  1598 raft_consensus.cc:2468] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 10.
I20260709 13:01:27.296748  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:27.263935  6968 raft_consensus.cc:515] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:27.302151  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:27.266142  7129 raft_consensus.cc:515] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:27.303005  1598 raft_consensus.cc:2468] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 11.
W20260709 13:01:27.304191  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 298696us
I20260709 13:01:27.308084  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:27.308846  1528 raft_consensus.cc:2468] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 13.
I20260709 13:01:27.310124  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:27.312013  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:27.313097  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:27.310819  1528 raft_consensus.cc:2468] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 12.
I20260709 13:01:27.315277  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:27.316924  1528 raft_consensus.cc:1275] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:01:27.318276  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:01:27.318816  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 621432us
I20260709 13:01:27.320827  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:27.321648  1528 raft_consensus.cc:1240] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 13:01:27.305545  1496 leader_election.cc:304] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:27.321552  1532 raft_consensus.cc:2468] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 17.
I20260709 13:01:27.315443  7322 leader_election.cc:290] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:27.314270  7454 raft_consensus.cc:493] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:27.326977  7454 raft_consensus.cc:515] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:27.327606  7428 raft_consensus.cc:2804] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:27.328241  7428 raft_consensus.cc:493] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:27.328598  7428 raft_consensus.cc:3060] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:27.329169  7454 leader_election.cc:290] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:27.336150  7178 leader_election.cc:290] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:27.341509  7428 raft_consensus.cc:515] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:27.317042  7157 leader_election.cc:290] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:27.348042  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:27.349960  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:27.350551  1532 raft_consensus.cc:2468] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 10.
I20260709 13:01:27.351615  1644 leader_election.cc:304] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:01:27.345665  2192 connection.cc:256] RPC call timeout handler was delayed by -1.0986435770000185s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2178s for a response
I20260709 13:01:27.353200  1644 leader_election.cc:304] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:27.354331  1644 leader_election.cc:304] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
W20260709 13:01:27.358789  2192 connection.cc:256] RPC call timeout handler was delayed by -1.0921879699999977s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18510000000000001s for a response
I20260709 13:01:27.356248  1644 leader_election.cc:304] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
W20260709 13:01:27.359262  2192 connection.cc:256] RPC call timeout handler was delayed by -1.0415081740000005s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2191s for a response
W20260709 13:01:27.363984  2192 connection.cc:256] RPC call timeout handler was delayed by -1.0139191430000096s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2068s for a response
I20260709 13:01:27.348399  6922 leader_election.cc:290] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:27.355078  7178 raft_consensus.cc:2749] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:27.373435  7270 raft_consensus.cc:2804] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:27.359663  7454 raft_consensus.cc:2804] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:27.361459  7157 raft_consensus.cc:493] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
W20260709 13:01:27.414691  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:27.378545  7327 leader_election.cc:290] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:27.389582  6922 raft_consensus.cc:493] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:27.443177  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:27.453099  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:27.455209  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36200 (request call id 2834) took 1136 ms. Trace:
I20260709 13:01:27.459190  1523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49310 (request call id 1548) took 1286 ms. Trace:
I20260709 13:01:27.436776  7454 raft_consensus.cc:493] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:27.468956  7454 raft_consensus.cc:3060] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:27.462644  6922 raft_consensus.cc:515] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:27.463011  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36200 (request call id 2833) took 1155 ms. Trace:
I20260709 13:01:27.471194  1606 rpcz_store.cc:276] 0709 13:01:26.307226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:26.307415 (+   189us) service_pool.cc:224] Handling call
0709 13:01:26.307736 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:26.568518 (+260782us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:27.458580 (+890062us) spinlock_profiling.cc:243] Waited 260 ms on lock 0x7b54001a9fd4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:01:27.462946 (+  4366us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":598231936}
I20260709 13:01:27.472571  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:27.473815  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:27.474752  1532 raft_consensus.cc:2393] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 13: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:01:27.459213  7177 raft_consensus.cc:493] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:27.475558  7177 raft_consensus.cc:515] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:27.476536  7440 raft_consensus.cc:515] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:27.477655  7177 leader_election.cc:290] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:27.467796  1523 rpcz_store.cc:276] 0709 13:01:26.172769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:26.172920 (+   151us) service_pool.cc:224] Handling call
0709 13:01:26.173253 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:26.255057 (+ 81804us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:26.255102 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:26.255143 (+    41us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:26.255174 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:27.458960 (+1203786us) spinlock_profiling.cc:243] Waited 81.6 ms on lock 0x7b540015c554. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:01:27.459008 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:27.459115 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":187664640}
I20260709 13:01:27.479254  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:27.480417  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:27.481326  6968 leader_election.cc:290] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:27.438645  7470 leader_election.cc:290] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:27.437155  7270 raft_consensus.cc:493] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:27.482544  7270 raft_consensus.cc:3060] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:27.483006  6922 leader_election.cc:290] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:27.457953  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:01:27.461294  7459 consensus_meta.cc:287] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 1.033s	user 0.010s	sys 0.000s
I20260709 13:01:27.486722  7459 raft_consensus.cc:515] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:27.467260  1601 rpcz_store.cc:276] 0709 13:01:26.319136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:26.322307 (+  3171us) service_pool.cc:224] Handling call
0709 13:01:27.455025 (+1132718us) spinlock_profiling.cc:243] Waited 153 ms on lock 0x7b54003b1ad4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:01:27.455152 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":352193280}
I20260709 13:01:27.489707  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:27.458232  6898 leader_election.cc:290] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:01:27.491731  2190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:27.453866  7257 leader_election.cc:290] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:27.493173  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:27.493558  1598 raft_consensus.cc:2393] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 13: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:01:27.439450  7157 raft_consensus.cc:515] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:27.495157  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:27.495803  1598 raft_consensus.cc:2468] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 11.
I20260709 13:01:27.496709  7157 leader_election.cc:290] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:27.434587  7483 leader_election.cc:290] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:27.442991  7428 leader_election.cc:290] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:27.502393  1523 raft_consensus.cc:2468] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 11.
I20260709 13:01:27.500996  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:27.499079  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:01:27.441721  7252 consensus_meta.cc:287] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.878s	user 0.007s	sys 0.003s
I20260709 13:01:27.486159  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:27.503360  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:27.482211  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:27.510164  1532 raft_consensus.cc:2376] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 18. Re-sending same reply.
W20260709 13:01:27.510634  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 205161us
I20260709 13:01:27.511051  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:27.503713  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:27.511860  2225 raft_consensus.cc:2468] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 17.
I20260709 13:01:27.509907  2218 raft_consensus.cc:3060] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:27.515139  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:27.516085  1523 raft_consensus.cc:2410] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for term 19 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 13:01:27.451256  7178 raft_consensus.cc:2804] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:27.522544  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:27.447412  7129 leader_election.cc:290] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:27.521194  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:27.526115  2225 raft_consensus.cc:3060] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:27.504611  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:27.522756  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:27.442782  7505 raft_consensus.cc:493] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:27.486112  1531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49310 (request call id 1552) took 1300 ms. Trace:
I20260709 13:01:27.528720  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:27.524549  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:27.530589  1598 raft_consensus.cc:2368] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b for earlier term 14. Current term is 15.
I20260709 13:01:27.531208  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:27.531316  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:27.532262  1598 raft_consensus.cc:2468] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 16.
I20260709 13:01:27.528483  1603 raft_consensus.cc:2393] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 18: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:01:27.525794  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:27.533668  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:27.537177  2218 raft_consensus.cc:2468] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 18.
I20260709 13:01:27.528949  1531 rpcz_store.cc:276] 0709 13:01:26.185418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:26.185549 (+   131us) service_pool.cc:224] Handling call
0709 13:01:26.185859 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:26.301889 (+116030us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:26.301921 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:26.323058 (+ 21137us) log.cc:844] Serialized 26 byte log entry
0709 13:01:26.369159 (+ 46101us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:26.369198 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:27.485759 (+1116561us) spinlock_profiling.cc:243] Waited 116 ms on lock 0x7b54000fd054. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:01:27.485805 (+    46us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:27.485851 (+    46us) raft_consensus.cc:1685] finished
0709 13:01:27.485864 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:27.486057 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3730,"spinlock_wait_cycles":276885248,"thread_start_us":5995,"threads_started":1,"wal-append.queue_time_us":64712,"wal-append.run_cpu_time_us":1775,"wal-append.run_wall_time_us":1024912}
I20260709 13:01:27.540213  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:27.539456  1606 raft_consensus.cc:2393] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 13: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
W20260709 13:01:27.540889  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 184710us
I20260709 13:01:27.541420  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:27.541803  1644 leader_election.cc:304] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:27.542205  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:27.543372  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:27.544942  1532 raft_consensus.cc:3060] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:27.545496  1523 raft_consensus.cc:2393] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 17: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:01:27.544255  1497 leader_election.cc:304] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:27.551169  7470 raft_consensus.cc:2749] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:27.551142  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:27.552615  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:27.553474  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:27.506283  7459 leader_election.cc:290] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:27.554180  1606 raft_consensus.cc:2393] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 19: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:01:27.555658  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:27.556367  2218 raft_consensus.cc:2468] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 19.
I20260709 13:01:27.555764  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:27.554651  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:27.557567  1598 raft_consensus.cc:1275] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:01:27.560257  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:27.552644  1497 leader_election.cc:304] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:27.564213  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:27.511883  1496 leader_election.cc:304] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:27.557333  1606 raft_consensus.cc:2468] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 11.
I20260709 13:01:27.566560  1603 raft_consensus.cc:1275] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:01:27.516866  7483 raft_consensus.cc:493] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
W20260709 13:01:27.569548  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 51594.8us
I20260709 13:01:27.523480  7178 raft_consensus.cc:493] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:27.570453  1644 leader_election.cc:304] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:27.570998  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:27.571660  1603 raft_consensus.cc:1275] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:01:27.523795  7440 leader_election.cc:290] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:27.509848  6898 consensus_queue.cc:1059] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.052s
I20260709 13:01:27.510067  7252 raft_consensus.cc:515] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:27.687235  7423 raft_consensus.cc:493] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
W20260709 13:01:28.166514  2192 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.005s	sys 0.009s
W20260709 13:01:28.169166  1528 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.796s	user 0.030s	sys 0.079s
I20260709 13:01:27.623865  1532 raft_consensus.cc:2468] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 15.
W20260709 13:01:28.176870  1674 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.012s	sys 0.014s
W20260709 13:01:28.408468  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 855915us
I20260709 13:01:28.399084  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 13:01:28.409407  1674 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.844s	user 0.013s	sys 0.020s
W20260709 13:01:28.407198  1528 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.034s	user 0.043s	sys 0.101s
W20260709 13:01:28.400691  1646 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.745s	user 0.007s	sys 0.003s
I20260709 13:01:28.409530  1497 leader_election.cc:304] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
W20260709 13:01:28.410068  1646 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.754s	user 0.007s	sys 0.003s
I20260709 13:01:28.410218  1674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49170 (request call id 2754) took 1049 ms. Trace:
W20260709 13:01:28.406325  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 835956us
I20260709 13:01:28.411660  7257 consensus_queue.cc:1059] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:01:28.412485  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 757111us
I20260709 13:01:28.412920  7252 leader_election.cc:290] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 19 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:28.413360  1644 leader_election.cc:304] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:28.405443  7423 raft_consensus.cc:515] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:28.420380  7257 raft_consensus.cc:493] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:28.421865  1531 raft_consensus.cc:2410] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
W20260709 13:01:28.160128  2191 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.724s	user 0.021s	sys 0.027s
W20260709 13:01:28.363442  7332 consensus_meta.cc:287] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent flushing consensus metadata: real 1.087s	user 0.009s	sys 0.001s
W20260709 13:01:28.067369  1530 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.012s	sys 0.000s
I20260709 13:01:28.441720  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:28.442354  1680 raft_consensus.cc:3060] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:01:28.426456  2192 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.901s	user 0.009s	sys 0.009s
W20260709 13:01:28.404203  2190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:27.824499  2225 raft_consensus.cc:2468] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 16.
I20260709 13:01:28.410621  1674 rpcz_store.cc:276] 0709 13:01:27.361189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:27.477848 (+116659us) service_pool.cc:224] Handling call
0709 13:01:27.478154 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:27.478483 (+   329us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:27.478507 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:27.499205 (+ 20698us) log.cc:844] Serialized 26 byte log entry
0709 13:01:28.409899 (+910694us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:28.409940 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:28.410005 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:28.410047 (+    42us) raft_consensus.cc:1685] finished
0709 13:01:28.410058 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:28.410165 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6365,"raft.run_cpu_time_us":45,"raft.run_wall_time_us":46,"thread_start_us":844105,"threads_started":1,"wal-append.queue_time_us":874538}
I20260709 13:01:28.435614  1532 pending_rounds.cc:85] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting all ops after (but not including) 7
W20260709 13:01:28.443212  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 942003us
I20260709 13:01:28.443588  1532 pending_rounds.cc:107] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting uncommitted NO_OP operation due to leader change: 15.8
W20260709 13:01:28.441278  1530 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.879s	user 0.016s	sys 0.003s
I20260709 13:01:27.574774  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
W20260709 13:01:28.437999  2191 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.002s	user 0.023s	sys 0.029s
I20260709 13:01:28.443905  1532 raft_consensus.cc:2889] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:28.439517  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
W20260709 13:01:28.234851  7454 consensus_meta.cc:287] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.765s	user 0.010s	sys 0.000s
W20260709 13:01:28.080679  7457 consensus_meta.cc:287] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent flushing consensus metadata: real 0.819s	user 0.010s	sys 0.000s
I20260709 13:01:28.448968  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36200 (request call id 2826) took 2204 ms. Trace:
I20260709 13:01:28.440464  1605 raft_consensus.cc:1217] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Deduplicated request from leader. Original: 14.8->[15.9-15.9]   Dedup: 15.9->[]
W20260709 13:01:28.061861  6988 consensus_meta.cc:287] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent flushing consensus metadata: real 0.977s	user 0.010s	sys 0.000s
W20260709 13:01:28.263615  7270 consensus_meta.cc:287] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.781s	user 0.009s	sys 0.000s
I20260709 13:01:28.448402  1603 raft_consensus.cc:2393] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 12: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:01:28.449975  1605 raft_consensus.cc:1240] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:01:28.449393  1604 rpcz_store.cc:276] 0709 13:01:26.236004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:26.236835 (+   831us) service_pool.cc:224] Handling call
0709 13:01:26.237097 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:26.237287 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:01:26.321559 (+ 84272us) log.cc:844] Serialized 14 byte log entry
0709 13:01:28.420371 (+2098812us) spinlock_profiling.cc:243] Waited 14.5 ms on lock 0x7b1800024640. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1e38ede1 00007f6a1e39b5b1 00007f6a1815b4bc 00007f6a154a948b 00007f6a1e303ab9 00007f6a154c569b 00007f6a154c393f 00007f6a154c5c02 00007f6a1814d20b 00007f6a18152d23 00007f6a1815323a
0709 13:01:28.439941 (+ 19570us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:28.440001 (+    60us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:28.440053 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:28.440125 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:28.440269 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15468,"prepare.queue_time_us":175408,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":21879,"spinlock_wait_cycles":33419776,"thread_start_us":214613,"threads_started":2,"wal-append.queue_time_us":152726,"wal-append.run_cpu_time_us":1208,"wal-append.run_wall_time_us":1043472}
W20260709 13:01:28.444569  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 1.00914e+06us
I20260709 13:01:28.468778  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:28.453827  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36194 (request call id 2108) took 1795 ms. Trace:
I20260709 13:01:28.469607  1607 rpcz_store.cc:276] 0709 13:01:26.658605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:26.658719 (+   114us) service_pool.cc:224] Handling call
0709 13:01:26.659013 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:26.663070 (+  4057us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:26.663102 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:26.663154 (+    52us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:26.663197 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:28.453590 (+1790393us) spinlock_profiling.cc:243] Waited 3.83 ms on lock 0x7b54002670d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:01:28.453636 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:28.453758 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8810880}
I20260709 13:01:28.471156  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:27.740957  7146 leader_election.cc:290] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:27.573848  7129 raft_consensus.cc:2749] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:27.570914  7437 raft_consensus.cc:493] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:28.425395  7178 raft_consensus.cc:3060] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:28.434916  7470 raft_consensus.cc:2749] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:28.434718  7515 raft_consensus.cc:2804] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:27.657539  7035 raft_consensus.cc:493] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:28.410877  7483 raft_consensus.cc:515] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:28.493044  7384 raft_consensus.cc:3055] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:01:28.495438  7407 leader_election.cc:290] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:28.498209  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1277) took 1048 ms. Trace:
I20260709 13:01:28.553874  1606 rpcz_store.cc:276] 0709 13:01:27.449940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:27.623351 (+173411us) service_pool.cc:224] Handling call
0709 13:01:28.497473 (+874122us) spinlock_profiling.cc:243] Waited 20.6 ms on lock 0x7b5800017198. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a1548eb71 00007f6a1548ea22 00007f6a1e3a7c09 00007f6a1d501ee0 00007f6a1d5cb0ab 00007f6a1d5cb131 00007f6a1d58cfc0 00007f6a1d577929 00007f6a1d5773d2 00007f6a16aeebd4
0709 13:01:28.497684 (+   211us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:28.497880 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:28.497905 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:28.497945 (+    40us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:28.497983 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:28.498036 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:28.498145 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":47412992}
I20260709 13:01:28.499058  7327 raft_consensus.cc:493] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
W20260709 13:01:28.435364  7507 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.965s	user 0.029s	sys 0.035s
I20260709 13:01:28.510429  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:28.500499  7277 raft_consensus.cc:493] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:28.500139  7428 raft_consensus.cc:2804] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:28.508283  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:28.567384  1603 raft_consensus.cc:3060] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:28.517213  1527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43010 (request call id 2615) took 1204 ms. Trace:
I20260709 13:01:28.440681  7516 raft_consensus.cc:2804] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:27.657037  7506 consensus_queue.cc:1048] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.863s
I20260709 13:01:27.554131  7505 raft_consensus.cc:515] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:28.518900  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 1.0071e+06us
W20260709 13:01:28.441944  7475 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.877s	user 0.016s	sys 0.007s
W20260709 13:01:28.547670  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 339945us
I20260709 13:01:28.517711  7510 raft_consensus.cc:3055] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:01:28.547627  1678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49178 (request call id 2438) took 2198 ms. Trace:
I20260709 13:01:28.511118  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:28.571231  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:01:28.575894  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:28.536304  6898 raft_consensus.cc:2804] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:28.450595  7332 raft_consensus.cc:515] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:28.575814  1604 raft_consensus.cc:2376] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 19. Re-sending same reply.
I20260709 13:01:28.551159  7384 raft_consensus.cc:740] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:28.442723  7257 raft_consensus.cc:515] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:28.577240  1678 rpcz_store.cc:276] 0709 13:01:26.348811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:26.403714 (+ 54903us) service_pool.cc:224] Handling call
0709 13:01:26.404037 (+   323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:26.404409 (+   372us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:26.404440 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:26.451856 (+ 47416us) log.cc:844] Serialized 26 byte log entry
0709 13:01:28.420981 (+1969125us) spinlock_profiling.cc:243] Waited 3.16 ms on lock 0x7b1800460240. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1e38ede1 00007f6a1e39b5b1 00007f6a154a8e07 00007f6a1e303ab9 00007f6a154c569b 00007f6a154c393f 00007f6a154c5c02 00007f6a1814d20b 00007f6a18152d23 00007f6a181530d1 00007f6a1856ea0f
0709 13:01:28.515684 (+ 94703us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:28.515731 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:28.515798 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:28.515842 (+    44us) raft_consensus.cc:1685] finished
0709 13:01:28.515853 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:28.547519 (+ 31666us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18891,"raft.queue_time_us":3197,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":2459,"spinlock_wait_cycles":7277440,"thread_start_us":94521,"threads_started":1,"wal-append.queue_time_us":2028184}
I20260709 13:01:28.502238  7270 raft_consensus.cc:515] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:28.528903  7515 raft_consensus.cc:493] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
W20260709 13:01:28.561383  7522 log.cc:927] Time spent T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:01:28.465646  7457 raft_consensus.cc:515] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:28.581782  1496 leader_election.cc:304] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:28.568236  1527 rpcz_store.cc:276] 0709 13:01:27.312921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:27.313032 (+   111us) service_pool.cc:224] Handling call
0709 13:01:27.313327 (+   295us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:27.555675 (+242348us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:27.555711 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:27.572302 (+ 16591us) log.cc:844] Serialized 52 byte log entry
0709 13:01:28.192071 (+619769us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:28.192418 (+   347us) log.cc:844] Serialized 14 byte log entry
0709 13:01:28.516601 (+324183us) log.cc:844] Serialized 14 byte log entry
0709 13:01:28.516898 (+   297us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:28.516972 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:28.517005 (+    33us) raft_consensus.cc:1685] finished
0709 13:01:28.517016 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:28.517148 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":308082,"prepare.queue_time_us":305245,"prepare.run_cpu_time_us":97,"prepare.run_wall_time_us":5511,"raft.queue_time_us":321044,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":138,"thread_start_us":395697,"threads_started":2,"wal-append.queue_time_us":502963}
I20260709 13:01:28.459484  7454 raft_consensus.cc:515] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:28.484326  6988 raft_consensus.cc:515] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:28.584612  1680 raft_consensus.cc:2468] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 15.
W20260709 13:01:28.564193  7507 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.090s	user 0.029s	sys 0.036s
I20260709 13:01:28.583561  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:28.584267  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:01:28.576306  7475 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.011s	user 0.017s	sys 0.007s
I20260709 13:01:28.567003  7428 raft_consensus.cc:493] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:28.593350  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 183886us
I20260709 13:01:28.572198  7516 raft_consensus.cc:493] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:28.579072  7510 raft_consensus.cc:740] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:28.601495  1526 raft_consensus.cc:2393] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 20: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:01:28.585788  1528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43010 (request call id 2619) took 1265 ms. Trace:
I20260709 13:01:28.586833  7464 raft_consensus.cc:493] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:28.594429  7515 raft_consensus.cc:3060] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:28.618499  1497 leader_election.cc:304] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:28.630897  1528 rpcz_store.cc:276] 0709 13:01:27.320697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:27.349550 (+ 28853us) service_pool.cc:224] Handling call
0709 13:01:27.372110 (+ 22560us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:27.372475 (+   365us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:27.372503 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:27.373022 (+   519us) log.cc:844] Serialized 26 byte log entry
0709 13:01:28.410008 (+1036986us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:01:28.563037 (+153029us) log.cc:844] Serialized 14 byte log entry
0709 13:01:28.585495 (+ 22458us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:28.585567 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:28.585609 (+    42us) raft_consensus.cc:1685] finished
0709 13:01:28.585620 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:28.585735 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36277,"prepare.queue_time_us":77256,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":25,"raft.queue_time_us":117074,"raft.run_cpu_time_us":269,"raft.run_wall_time_us":23738,"thread_start_us":1160281,"threads_started":2,"wal-append.queue_time_us":1023846}
I20260709 13:01:28.585431  6898 raft_consensus.cc:493] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:28.553929  7035 raft_consensus.cc:515] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:28.605095  7471 raft_consensus.cc:493] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:28.537176  7437 raft_consensus.cc:515] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:28.609092  1527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43008 (request call id 2495) took 1104 ms. Trace:
I20260709 13:01:28.616029  1607 raft_consensus.cc:2393] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 15: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:01:28.619685  1531 raft_consensus.cc:1240] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:28.624644  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:28.658653  1678 raft_consensus.cc:2393] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 19: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:01:28.629550  7428 raft_consensus.cc:3060] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:28.631364  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:28.564551  7327 raft_consensus.cc:515] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:28.599453  7252 raft_consensus.cc:493] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:28.639334  1672 raft_consensus.cc:1240] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:28.640044  1524 raft_consensus.cc:2393] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 15: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:01:28.582646  7129 raft_consensus.cc:493] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:28.666335  7129 raft_consensus.cc:515] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:28.667308  7035 leader_election.cc:290] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:28.668440  7129 leader_election.cc:290] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:28.644317  1497 leader_election.cc:304] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:28.644539  1680 raft_consensus.cc:1240] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 17. Current term is 18. Ops: [17.15-17.15]
I20260709 13:01:28.670328  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:28.671072  1680 raft_consensus.cc:2393] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 14: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:01:28.642447  7464 raft_consensus.cc:515] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:28.671895  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:28.673079  7464 leader_election.cc:290] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:28.642834  6898 raft_consensus.cc:3060] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:28.602406  7529 raft_consensus.cc:493] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:28.674472  7529 raft_consensus.cc:515] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:28.656503  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:28.676505  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:28.676751  7529 leader_election.cc:290] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:28.661020  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:28.673050  1680 raft_consensus.cc:2410] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:01:28.677742  1678 raft_consensus.cc:2410] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:01:28.678591  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:28.573386  7277 raft_consensus.cc:515] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:28.680075  7510 consensus_queue.cc:260] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:28.681221  7277 leader_election.cc:290] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:28.681372  7510 raft_consensus.cc:3060] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:28.660027  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:28.658087  1527 rpcz_store.cc:276] 0709 13:01:27.504486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:28.608304 (+1103818us) service_pool.cc:224] Handling call
0709 13:01:28.608613 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:28.608779 (+   166us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:28.608803 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:28.608844 (+    41us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:28.608880 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:28.608932 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:28.609038 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:28.629776  7516 raft_consensus.cc:3060] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:28.678586  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
W20260709 13:01:28.691782  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 171345us
I20260709 13:01:28.692994  1571 leader_election.cc:304] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:28.696305  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:28.699729  1678 raft_consensus.cc:1240] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:28.702232  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:28.703536  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:28.655668  7389 raft_consensus.cc:3060] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:28.707825  1604 raft_consensus.cc:2393] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 13: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:01:28.661671  7512 raft_consensus.cc:2804] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:01:28.709705  1527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43008 (request call id 2496) took 1205 ms. Trace:
I20260709 13:01:28.715472  1527 rpcz_store.cc:276] 0709 13:01:27.504718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:28.708365 (+1203647us) service_pool.cc:224] Handling call
0709 13:01:28.709181 (+   816us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:28.709376 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:28.709400 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:28.709438 (+    38us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:28.709477 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:28.709528 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:28.709642 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:28.713312  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36194 (request call id 2133) took 1023 ms. Trace:
I20260709 13:01:28.727337  1604 rpcz_store.cc:276] 0709 13:01:27.689541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:28.696056 (+1006515us) service_pool.cc:224] Handling call
0709 13:01:28.713249 (+ 17193us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:28.712075  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 243429us
W20260709 13:01:28.740834  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 286944us
I20260709 13:01:28.753402  2191 leader_election.cc:304] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:01:28.764230  1673 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49170 (request call id 2715) took 5240 ms (client timeout 1785 ms). Trace:
W20260709 13:01:28.764721  1673 rpcz_store.cc:269] 0709 13:01:23.517195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:23.517705 (+   510us) service_pool.cc:224] Handling call
0709 13:01:24.585069 (+1067364us) spinlock_profiling.cc:243] Waited 1.25 ms on lock 0x7b5800143798. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a1548eb71 00007f6a1548ea22 00007f6a1e3a7c09 00007f6a1d501ee0 00007f6a1d5cb0ab 00007f6a1d5cb131 00007f6a1d5790a0 00007f6a1d578984 00007f6a16af36d4 00007f6a16af3662
0709 13:01:28.757155 (+4172086us) spinlock_profiling.cc:243] Waited 1.61 s on lock 0x7b540031ced4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:01:28.757265 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3703628032}
W20260709 13:01:28.767144  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 89461.2us
I20260709 13:01:28.645109  7384 consensus_queue.cc:260] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:01:28.769541  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 125326us
I20260709 13:01:28.715255  7512 raft_consensus.cc:493] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:28.740090  7423 leader_election.cc:290] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:28.730952  7539 raft_consensus.cc:2804] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:28.776087  7536 consensus_queue.cc:1048] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:01:28.774852  1497 leader_election.cc:304] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:28.697937  7252 raft_consensus.cc:515] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:28.660888  7471 raft_consensus.cc:515] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:28.784690  7529 raft_consensus.cc:493] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:28.787860  7529 raft_consensus.cc:515] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:28.791046  7529 leader_election.cc:290] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:28.776870  7535 consensus_queue.cc:1059] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.015s
I20260709 13:01:28.781196  7512 raft_consensus.cc:3060] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:28.795228  7505 leader_election.cc:290] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:28.796370  7457 leader_election.cc:290] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:28.799528  7515 raft_consensus.cc:515] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:28.801805  7515 leader_election.cc:290] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 18 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:28.802388  7515 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:28.803115  7407 raft_consensus.cc:2749] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:28.806140  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1271) took 1367 ms. Trace:
I20260709 13:01:28.809603  1601 rpcz_store.cc:276] 0709 13:01:27.438418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:27.573397 (+134979us) service_pool.cc:224] Handling call
0709 13:01:28.424891 (+851494us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:28.805762 (+380871us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:28.805795 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:28.805836 (+    41us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:28.805882 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:28.805959 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:28.806079 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":57897,"raft.queue_time_us":68651,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":102,"spinlock_wait_cycles":124800,"thread_start_us":304166,"threads_started":1}
I20260709 13:01:28.757436  7166 consensus_queue.cc:1059] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.028s
W20260709 13:01:28.830333  2190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:28.833961  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 84697.3us
I20260709 13:01:28.843583  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:28.785167  7336 raft_consensus.cc:2749] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:28.786775  7384 raft_consensus.cc:3060] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:28.846915  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:28.848924  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:28.849381  1601 raft_consensus.cc:2468] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 11.
I20260709 13:01:28.849900  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:28.850829  1607 raft_consensus.cc:2368] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b for earlier term 14. Current term is 15.
I20260709 13:01:28.854532  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:28.856045  2192 leader_election.cc:304] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:28.857069  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:28.857833  1601 raft_consensus.cc:2468] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 14.
W20260709 13:01:28.847173  7543 log.cc:927] Time spent T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:01:28.860066  2192 leader_election.cc:400] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 14 pre-election: Vote denied by peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303) with higher term. Message: Invalid argument: T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b for earlier term 14. Current term is 15.
I20260709 13:01:28.860697  1604 raft_consensus.cc:2393] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 18: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:01:28.866310  2192 leader_election.cc:403] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:28.821189  7483 leader_election.cc:290] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:28.820313  7539 raft_consensus.cc:697] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 15 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:28.876595  1603 raft_consensus.cc:2410] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 17 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:01:28.882918  1603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36194 (request call id 2137) took 1192 ms. Trace:
W20260709 13:01:28.878995  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 105415us
I20260709 13:01:28.883406  1603 rpcz_store.cc:276] 0709 13:01:27.690468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:28.507984 (+817516us) service_pool.cc:224] Handling call
0709 13:01:28.882842 (+374858us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:28.862099  7457 raft_consensus.cc:3055] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:01:28.859803  7470 raft_consensus.cc:2804] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:28.893297  2192 leader_election.cc:304] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:01:28.894366  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 119593us
I20260709 13:01:28.895232  1497 leader_election.cc:304] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:28.862784  7270 leader_election.cc:290] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:28.912639  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36194 (request call id 2115) took 1939 ms. Trace:
I20260709 13:01:28.915853  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:28.916535  1673 raft_consensus.cc:2468] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 16.
I20260709 13:01:28.821465  7515 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:28.896417  7454 leader_election.cc:290] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:28.867825  7326 consensus_queue.cc:260] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:28.910758  7551 raft_consensus.cc:493] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:28.885161  1646 leader_election.cc:304] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
W20260709 13:01:28.973367  1599 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36200 (request call id 2835) took 2589 ms (client timeout 1905 ms). Trace:
I20260709 13:01:28.913107  1605 rpcz_store.cc:276] 0709 13:01:26.973222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:27.010409 (+ 37187us) service_pool.cc:224] Handling call
0709 13:01:28.440356 (+1429947us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:28.467469 (+ 27113us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:28.912431 (+444962us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b54000dbe50. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b28ad 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:01:28.912576 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3287947008}
W20260709 13:01:29.002795  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 117716us
I20260709 13:01:28.938880  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
W20260709 13:01:29.002676  1599 rpcz_store.cc:269] 0709 13:01:26.325735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:26.327668 (+  1933us) service_pool.cc:224] Handling call
0709 13:01:28.915319 (+2587651us) spinlock_profiling.cc:243] Waited 12.8 ms on lock 0x7b5400057b54. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:01:28.915442 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":29554944}
I20260709 13:01:29.003651  1646 leader_election.cc:304] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:29.001930  1606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1280) took 1551 ms. Trace:
I20260709 13:01:29.006829  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:28.886874  6988 leader_election.cc:290] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 15 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:29.018388  7326 raft_consensus.cc:3060] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:29.019321  7546 raft_consensus.cc:2804] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:01:29.019977  7546 raft_consensus.cc:697] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 18 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
W20260709 13:01:29.021315  7543 log.cc:927] Time spent T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 13:01:29.020859  7546 consensus_queue.cc:237] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:29.022226  7539 consensus_queue.cc:237] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:29.007931  1678 raft_consensus.cc:2393] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 15: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:01:28.946544  1497 leader_election.cc:304] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:29.013026  1646 leader_election.cc:304] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
W20260709 13:01:29.028133  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 81712.2us
I20260709 13:01:29.036455  1497 leader_election.cc:304] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:28.897099  7457 raft_consensus.cc:740] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:28.917979  7252 leader_election.cc:290] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:29.005373  7545 raft_consensus.cc:2804] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:29.037765  7464 raft_consensus.cc:493] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:29.042052  1646 leader_election.cc:304] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:29.043227  7529 raft_consensus.cc:2804] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:01:29.037873  6988 raft_consensus.cc:2804] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:29.043817  7552 raft_consensus.cc:3060] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:29.044690  1497 leader_election.cc:304] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:29.014971  7536 raft_consensus.cc:3060] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Advancing to term 15
W20260709 13:01:29.083034  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 329744us
I20260709 13:01:29.050050  7327 leader_election.cc:290] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:29.070432  7340 raft_consensus.cc:2804] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:28.896785  7470 raft_consensus.cc:493] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:28.890555  7547 consensus_queue.cc:1048] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.286s
I20260709 13:01:29.026685  7551 raft_consensus.cc:515] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:29.100095  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:29.272931  1529 raft_consensus.cc:2410] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
W20260709 13:01:29.301249  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 198024us
I20260709 13:01:29.205664  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:29.299736  1604 raft_consensus.cc:2468] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 10.
I20260709 13:01:29.168334  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:29.306231  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:29.074517  7166 raft_consensus.cc:493] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:29.305789  1605 raft_consensus.cc:2468] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 14.
W20260709 13:01:29.110504  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:29.307564  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 139051us
I20260709 13:01:29.101884  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:29.331269  1604 raft_consensus.cc:2468] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 17.
I20260709 13:01:29.167989  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:29.100453  2191 leader_election.cc:304] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:29.317663  1646 leader_election.cc:304] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:29.026546  7550 raft_consensus.cc:2804] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:28.913725  7535 raft_consensus.cc:2804] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:01:29.343995  7550 raft_consensus.cc:493] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:29.344194  7535 raft_consensus.cc:697] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:29.304095  2223 raft_consensus.cc:2468] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 15.
I20260709 13:01:29.344496  7550 raft_consensus.cc:3060] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:29.195592  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:29.345182  7561 raft_consensus.cc:2749] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:01:29.347821  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 13:01:29.220705  7513 log.cc:927] Time spent T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260709 13:01:29.092584  7529 raft_consensus.cc:493] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:29.092406  6988 raft_consensus.cc:493] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
W20260709 13:01:29.216058  6898 consensus_meta.cc:287] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent flushing consensus metadata: real 0.542s	user 0.009s	sys 0.000s
W20260709 13:01:29.230574  7522 log.cc:927] Time spent T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
I20260709 13:01:29.081133  7437 leader_election.cc:290] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:29.076467  7545 raft_consensus.cc:493] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:29.355712  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:29.278563  7454 raft_consensus.cc:493] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
W20260709 13:01:29.375180  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 481947us
I20260709 13:01:29.303938  7461 raft_consensus.cc:493] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:29.229305  7336 raft_consensus.cc:2804] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:29.259752  7471 leader_election.cc:290] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:01:29.347641  7405 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.007s	sys 0.004s
I20260709 13:01:29.099942  7270 raft_consensus.cc:2804] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:29.087536  7464 raft_consensus.cc:515] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:29.350526  7534 raft_consensus.cc:493] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:29.347968  7340 raft_consensus.cc:493] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:29.241195  7457 consensus_queue.cc:260] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:29.361069  7529 raft_consensus.cc:3060] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:29.380162  7461 raft_consensus.cc:515] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:01:29.393944  7428 consensus_meta.cc:287] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent flushing consensus metadata: real 0.722s	user 0.008s	sys 0.000s
I20260709 13:01:29.394402  7428 raft_consensus.cc:515] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:29.396443  7428 leader_election.cc:290] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 18 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:01:29.387686  7548 log.cc:927] Time spent T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.172s	user 0.001s	sys 0.000s
I20260709 13:01:29.397606  7457 raft_consensus.cc:3060] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:01:29.377813  7510 consensus_meta.cc:287] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent flushing consensus metadata: real 0.696s	user 0.006s	sys 0.007s
I20260709 13:01:29.375898  7545 raft_consensus.cc:3060] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:29.400892  7464 leader_election.cc:290] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:29.378425  7454 raft_consensus.cc:515] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:01:29.381678  7405 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.008s	sys 0.004s
I20260709 13:01:29.518998  7454 leader_election.cc:290] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:29.520428  7454 raft_consensus.cc:493] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:29.521678  7454 raft_consensus.cc:515] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:29.466895  1530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43010 (request call id 2614) took 2154 ms. Trace:
I20260709 13:01:29.522872  1530 rpcz_store.cc:276] 0709 13:01:27.311896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:27.312001 (+   105us) service_pool.cc:224] Handling call
0709 13:01:27.312305 (+   304us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:27.319583 (+  7278us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:01:27.503756 (+184173us) log.cc:844] Serialized 14 byte log entry
0709 13:01:28.499789 (+996033us) log.cc:844] Serialized 14 byte log entry
0709 13:01:28.904719 (+404930us) spinlock_profiling.cc:243] Waited 20.5 ms on lock 0x7b1800225880. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1e38ede1 00007f6a1e39b5b1 00007f6a1815b4bc 00007f6a154a948b 00007f6a1e303ab9 00007f6a154c569b 00007f6a154c393f 00007f6a154c3455 00007f6a185ab060 00007f6a185bd716 00007f6a185ce287
0709 13:01:28.904824 (+   105us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:28.905449 (+   625us) log.cc:844] Serialized 52 byte log entry
0709 13:01:28.905619 (+   170us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:28.905854 (+   235us) log.cc:844] Serialized 14 byte log entry
0709 13:01:28.906172 (+   318us) log.cc:844] Serialized 14 byte log entry
0709 13:01:28.906418 (+   246us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:28.908849 (+  2431us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:29.465897 (+557048us) raft_consensus.cc:1685] finished
0709 13:01:29.465971 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:29.466514 (+   543us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58479,"prepare.queue_time_us":382468,"prepare.run_cpu_time_us":153,"prepare.run_wall_time_us":160,"raft.queue_time_us":200124,"raft.run_cpu_time_us":508,"raft.run_wall_time_us":31883,"spinlock_wait_cycles":47079808,"thread_start_us":1109336,"threads_started":3,"wal-append.queue_time_us":872830}
I20260709 13:01:29.474480  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
W20260709 13:01:29.493686  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 148320us
W20260709 13:01:29.495087  2190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:29.387517  7460 leader_election.cc:290] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:29.376107  2192 leader_election.cc:304] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:29.360416  6988 raft_consensus.cc:3060] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:01:29.534474  7384 consensus_meta.cc:287] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.680s	user 0.008s	sys 0.006s
I20260709 13:01:29.173218  7129 consensus_queue.cc:1059] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.192s
W20260709 13:01:29.538978  1495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:29.539876  7129 raft_consensus.cc:3055] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:29.540494  7129 raft_consensus.cc:740] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:29.351543  7166 raft_consensus.cc:515] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:29.547837  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 171660us
I20260709 13:01:29.167790  7252 consensus_queue.cc:1059] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.205s
I20260709 13:01:29.551134  7568 raft_consensus.cc:3060] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:01:29.554183  7178 consensus_meta.cc:287] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.998s	user 0.012s	sys 0.011s
I20260709 13:01:29.370559  6898 raft_consensus.cc:515] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:29.564486  1646 leader_election.cc:304] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:29.513368  7340 raft_consensus.cc:3060] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:29.512161  7270 raft_consensus.cc:697] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 16 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
W20260709 13:01:29.514463  7389 consensus_meta.cc:287] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.802s	user 0.005s	sys 0.005s
I20260709 13:01:29.573953  7270 consensus_queue.cc:237] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:29.551616  7166 leader_election.cc:290] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:29.576813  7252 raft_consensus.cc:2804] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:29.577349  7252 raft_consensus.cc:493] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:29.577821  7252 raft_consensus.cc:3060] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:29.378482  7336 raft_consensus.cc:493] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
W20260709 13:01:29.497599  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 397153us
I20260709 13:01:29.579164  7575 raft_consensus.cc:3055] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:01:29.579764  7575 raft_consensus.cc:740] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:29.580998  2191 leader_election.cc:304] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:29.581362  7575 consensus_queue.cc:260] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:29.583009  1680 raft_consensus.cc:2468] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 12.
W20260709 13:01:29.396528  7512 consensus_meta.cc:287] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent flushing consensus metadata: real 0.602s	user 0.008s	sys 0.000s
I20260709 13:01:29.417157  7515 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:29.583057  7555 raft_consensus.cc:2749] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:29.347471  7470 raft_consensus.cc:3060] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:29.384258  7471 raft_consensus.cc:2804] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:29.584645  7484 raft_consensus.cc:493] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:29.585083  7471 raft_consensus.cc:493] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:29.585593  7471 raft_consensus.cc:3060] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:29.585256  7484 raft_consensus.cc:515] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:29.578938  7336 raft_consensus.cc:3060] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:29.576514  1646 leader_election.cc:304] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:29.423005  7529 raft_consensus.cc:515] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:29.403786  7534 raft_consensus.cc:515] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:29.591161  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:29.592075  2220 raft_consensus.cc:2468] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 12.
I20260709 13:01:29.592985  7534 leader_election.cc:290] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:29.385305  7535 consensus_queue.cc:237] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:29.422778  7536 raft_consensus.cc:2749] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303) with higher term. Message: Invalid argument: T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b for earlier term 14. Current term is 15.
W20260709 13:01:29.436565  7542 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.644s	user 0.004s	sys 0.009s
W20260709 13:01:29.599640  7542 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.808s	user 0.004s	sys 0.009s
I20260709 13:01:29.599105  7512 raft_consensus.cc:515] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:29.600317  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:29.434310  7545 raft_consensus.cc:515] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:29.602514  7512 leader_election.cc:290] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 20 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:29.433734  7552 raft_consensus.cc:2749] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:29.603533  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:29.559095  7129 consensus_queue.cc:260] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:29.565267  6898 leader_election.cc:290] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:01:29.465224  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 420428us
I20260709 13:01:29.593461  7389 raft_consensus.cc:2804] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:29.560412  7454 leader_election.cc:290] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:29.590407  7529 leader_election.cc:290] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 20 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:29.609581  7389 raft_consensus.cc:493] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:29.620265  7389 raft_consensus.cc:3060] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:29.625664  6898 consensus_queue.cc:1048] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:29.627106  7550 raft_consensus.cc:515] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:29.629726  7550 leader_election.cc:290] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 18 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:29.631497  7129 raft_consensus.cc:3060] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:29.603595  7545 leader_election.cc:290] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:29.636693  1497 leader_election.cc:304] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:29.637197  1531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43008 (request call id 2494) took 2134 ms. Trace:
I20260709 13:01:29.637579  1531 rpcz_store.cc:276] 0709 13:01:27.503013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:28.448887 (+945874us) service_pool.cc:224] Handling call
0709 13:01:28.449198 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:28.661960 (+212762us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:29.636612 (+974652us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b540010ccd4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:01:29.636997 (+   385us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":391679744}
I20260709 13:01:29.638324  7512 raft_consensus.cc:2804] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:29.639026  7512 raft_consensus.cc:493] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:29.639474  7575 raft_consensus.cc:3060] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:29.639520  7512 raft_consensus.cc:3060] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:29.644107  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:29.645016  2218 raft_consensus.cc:2468] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 11.
I20260709 13:01:29.647372  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:29.655779  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:29.638458  1497 leader_election.cc:304] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:29.642190  7470 raft_consensus.cc:515] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:29.661243  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:29.666827  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:29.667168  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:29.668030  2227 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 18.
I20260709 13:01:29.669338  7505 raft_consensus.cc:493] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:29.669538  7568 raft_consensus.cc:2749] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:29.670490  6898 raft_consensus.cc:2749] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:29.670181  7505 raft_consensus.cc:515] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:29.677138  1600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36200 (request call id 2832) took 3380 ms. Trace:
I20260709 13:01:29.677726  1600 rpcz_store.cc:276] 0709 13:01:26.296299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:26.297102 (+   803us) service_pool.cc:224] Handling call
0709 13:01:26.297400 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:26.396733 (+ 99333us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:29.676532 (+3279799us) spinlock_profiling.cc:243] Waited 87.7 ms on lock 0x7b54002ace54. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:01:29.676914 (+   382us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":201603328}
W20260709 13:01:29.683514  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 45249us
I20260709 13:01:29.684583  1497 leader_election.cc:304] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:29.685582  6898 raft_consensus.cc:2749] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:29.609634  7178 raft_consensus.cc:515] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:29.687871  1676 raft_consensus.cc:2393] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 13: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:01:29.688958  7178 leader_election.cc:290] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:29.690073  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:29.690332  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49170 (request call id 2759) took 2178 ms. Trace:
I20260709 13:01:29.691078  1601 raft_consensus.cc:2468] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 12.
I20260709 13:01:29.690814  1676 rpcz_store.cc:276] 0709 13:01:27.511520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:27.539329 (+ 27809us) service_pool.cc:224] Handling call
0709 13:01:29.690003 (+2150674us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b5400303c54. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:01:29.690214 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2859190016}
I20260709 13:01:29.692433  1672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49170 (request call id 2751) took 2331 ms. Trace:
W20260709 13:01:29.693225  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:29.693992  1646 leader_election.cc:304] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:01:29.694298  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49170 (request call id 2763) took 1273 ms. Trace:
I20260709 13:01:29.694772  1677 rpcz_store.cc:276] 0709 13:01:28.420475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:28.421708 (+  1233us) service_pool.cc:224] Handling call
0709 13:01:28.421993 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:28.592717 (+170724us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:28.592747 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:28.592789 (+    42us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:01:28.592819 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:29.693846 (+1101027us) spinlock_profiling.cc:243] Waited 171 ms on lock 0x7b54003e6a54. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:01:29.693917 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:29.694100 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":392198016}
I20260709 13:01:29.695506  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49170 (request call id 2762) took 1275 ms. Trace:
I20260709 13:01:29.695912  1681 rpcz_store.cc:276] 0709 13:01:28.420188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:28.421318 (+  1130us) service_pool.cc:224] Handling call
0709 13:01:28.421585 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:28.607753 (+186168us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:01:28.731159 (+123406us) log.cc:844] Serialized 14 byte log entry
0709 13:01:29.000376 (+269217us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:29.000432 (+    56us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:01:29.000482 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:29.695053 (+694571us) spinlock_profiling.cc:243] Waited 186 ms on lock 0x7b54002558d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:01:29.695115 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:29.695342 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7276,"prepare.queue_time_us":123787,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":47,"raft.queue_time_us":102,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":20630,"spinlock_wait_cycles":427674880,"thread_start_us":347646,"threads_started":2,"wal-append.queue_time_us":343768}
I20260709 13:01:29.700773  1527 raft_consensus.cc:1240] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:29.701922  7470 leader_election.cc:290] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:29.657618  7529 raft_consensus.cc:493] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:29.703176  7529 raft_consensus.cc:515] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:29.006278  1606 rpcz_store.cc:276] 0709 13:01:27.450718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:28.683515 (+1232797us) service_pool.cc:224] Handling call
0709 13:01:28.683791 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:28.683981 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:01:28.815505 (+131524us) log.cc:844] Serialized 14 byte log entry
0709 13:01:29.001549 (+186044us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:29.001605 (+    56us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:01:29.001658 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:29.001725 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:29.001870 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":59529,"prepare.queue_time_us":131532,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":44,"raft.queue_time_us":90124,"spinlock_wait_cycles":1920,"thread_start_us":230017,"threads_started":2}
I20260709 13:01:29.686518  1497 leader_election.cc:304] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:29.692848  1672 rpcz_store.cc:276] 0709 13:01:27.360476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:27.461073 (+100597us) service_pool.cc:224] Handling call
0709 13:01:27.461316 (+   243us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:28.684523 (+1223207us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:29.691934 (+1007411us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b540010c554. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:01:29.692243 (+   309us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2708874112}
I20260709 13:01:29.713716  7252 raft_consensus.cc:515] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:01:29.720703  7516 consensus_meta.cc:287] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 1.007s	user 0.008s	sys 0.012s
I20260709 13:01:29.715195  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:29.718792  6988 raft_consensus.cc:515] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:29.692694  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:29.717072  7558 consensus_queue.cc:1048] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.013s
I20260709 13:01:29.722743  1604 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 19.
I20260709 13:01:29.659392  7340 raft_consensus.cc:515] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:29.725445  7332 leader_election.cc:290] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 20 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:29.662925  7550 raft_consensus.cc:493] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:29.727180  7550 raft_consensus.cc:515] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:29.721251  7516 raft_consensus.cc:515] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:29.727165  7505 leader_election.cc:290] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:29.725693  7340 leader_election.cc:290] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:29.721271  7252 leader_election.cc:290] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:29.733230  7257 leader_election.cc:290] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:29.733882  7529 leader_election.cc:290] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:29.733347  6988 leader_election.cc:290] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 15 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:29.738651  7336 raft_consensus.cc:515] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:29.742703  1674 raft_consensus.cc:1240] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:29.743643  1680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49170 (request call id 2770) took 1041 ms. Trace:
I20260709 13:01:29.744441  7336 leader_election.cc:290] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:29.744081  1680 rpcz_store.cc:276] 0709 13:01:28.702271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:28.703308 (+  1037us) service_pool.cc:224] Handling call
0709 13:01:29.743404 (+1040096us) spinlock_profiling.cc:243] Waited 879 ms on lock 0x7b54003f5cd4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:01:29.743563 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2021002624}
W20260709 13:01:29.751641  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 44322.3us
W20260709 13:01:29.753619  7459 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.960s	user 0.003s	sys 0.004s
I20260709 13:01:29.759011  1598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1264) took 2475 ms. Trace:
I20260709 13:01:29.760846  1571 leader_election.cc:304] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:29.747522  7389 raft_consensus.cc:515] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:01:29.764864  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 78536.8us
I20260709 13:01:29.763701  1598 rpcz_store.cc:276] 0709 13:01:27.283282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:27.559157 (+275875us) service_pool.cc:224] Handling call
0709 13:01:27.568568 (+  9411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:27.568686 (+   118us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:27.568699 (+    13us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:27.568724 (+    25us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:27.568747 (+    23us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:27.568775 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:29.758609 (+2189834us) spinlock_profiling.cc:243] Waited 9.22 ms on lock 0x7b54003b06d0. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b28ad 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:01:29.758830 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21198080}
I20260709 13:01:29.769495  7512 raft_consensus.cc:515] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:29.755264  7550 leader_election.cc:290] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:01:29.763595  7459 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.970s	user 0.003s	sys 0.005s
W20260709 13:01:29.770478  1570 leader_election.cc:336] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 2.099s (SENT)
W20260709 13:01:29.779563  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 861812us
I20260709 13:01:29.779824  7440 raft_consensus.cc:2804] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:29.780365  7440 raft_consensus.cc:493] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:29.780881  7440 raft_consensus.cc:3060] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:29.783983  7471 raft_consensus.cc:515] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:29.786571  7471 leader_election.cc:290] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 17 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:01:29.787154  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 93288.7us
W20260709 13:01:29.791157  1524 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43010 (request call id 2612) took 2479 ms (client timeout 1905 ms). Trace:
W20260709 13:01:29.791690  1524 rpcz_store.cc:269] 0709 13:01:27.311339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:27.311464 (+   125us) service_pool.cc:224] Handling call
0709 13:01:29.788111 (+2476647us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b540002b554. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:01:29.790860 (+  2749us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3045006720}
I20260709 13:01:29.792870  7389 leader_election.cc:290] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 18 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
W20260709 13:01:29.793751  1526 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43010 (request call id 2607) took 2507 ms (client timeout 2186 ms). Trace:
I20260709 13:01:29.793956  1528 raft_consensus.cc:1240] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 19. Current term is 20. Ops: []
I20260709 13:01:29.765570  7575 raft_consensus.cc:2804] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:29.802453  7330 raft_consensus.cc:3055] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:29.802968  7330 raft_consensus.cc:740] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:29.803516  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:29.804220  7330 consensus_queue.cc:260] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:29.804512  7440 raft_consensus.cc:515] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:29.805554  7330 raft_consensus.cc:3060] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:29.805682  7555 consensus_queue.cc:1059] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:01:29.794390  7484 leader_election.cc:290] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:29.763756  7336 raft_consensus.cc:2749] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:01:29.794229  1526 rpcz_store.cc:269] 0709 13:01:27.285789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:27.285943 (+   154us) service_pool.cc:224] Handling call
0709 13:01:29.793261 (+2507318us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b54001ff9d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:01:29.793501 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3016350080}
W20260709 13:01:29.799911  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 43642.6us
I20260709 13:01:29.799823  7575 raft_consensus.cc:493] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:29.824304  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:29.825129  2227 raft_consensus.cc:3060] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:29.806922  7245 raft_consensus.cc:3055] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:29.826957  7245 raft_consensus.cc:740] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:29.828096  7245 consensus_queue.cc:260] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:29.829452  7245 raft_consensus.cc:3060] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:29.830591  1497 leader_election.cc:304] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:29.833364  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:29.834244  2225 raft_consensus.cc:3060] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:01:29.836035  1529 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43010 (request call id 2595) took 5121 ms (client timeout 1950 ms). Trace:
W20260709 13:01:29.836565  1529 rpcz_store.cc:269] 0709 13:01:24.715014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:24.718161 (+  3147us) service_pool.cc:224] Handling call
0709 13:01:29.835558 (+5117397us) spinlock_profiling.cc:243] Waited 4.52 s on lock 0x7b540031bd54. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:01:29.835806 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10384539904}
I20260709 13:01:29.838315  1525 raft_consensus.cc:1275] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 13:01:29.839386  1496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:29.839298  7332 raft_consensus.cc:493] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:29.840580  7332 raft_consensus.cc:515] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:29.843253  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:29.844086  1603 raft_consensus.cc:2468] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 17.
I20260709 13:01:29.844476  1529 raft_consensus.cc:1240] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:29.846076  1528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49310 (request call id 1562) took 1219 ms. Trace:
I20260709 13:01:29.846776  1680 raft_consensus.cc:1240] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 18 LEADER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 17. Current term is 18. Ops: [17.15-17.15]
I20260709 13:01:29.847452  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:29.848129  1672 raft_consensus.cc:1240] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:29.849074  1524 raft_consensus.cc:1240] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:29.841167  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43008 (request call id 2493) took 2338 ms. Trace:
I20260709 13:01:29.850742  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:29.843021  6988 raft_consensus.cc:2749] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:29.852566  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:29.854159  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:29.848351  1603 raft_consensus.cc:2393] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 13: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:01:29.852180  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:29.846479  1528 rpcz_store.cc:276] 0709 13:01:28.628092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:28.689301 (+ 61209us) service_pool.cc:224] Handling call
0709 13:01:29.793499 (+1104198us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:29.794442 (+   943us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:29.845877 (+ 51435us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b54001ff9d0. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b28ad 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:01:29.846024 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2538726144}
I20260709 13:01:29.852097  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:29.860643  1600 raft_consensus.cc:3060] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:29.862998  1605 raft_consensus.cc:2393] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 17: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:01:29.833381  1497 leader_election.cc:304] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:29.867386  2227 raft_consensus.cc:2468] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 18.
I20260709 13:01:29.854974  7575 raft_consensus.cc:3060] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:29.870755  1526 raft_consensus.cc:1240] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:29.871237  7332 leader_election.cc:290] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:29.895152  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:29.872988  1525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43010 (request call id 2599) took 5154 ms. Trace:
I20260709 13:01:29.895932  1525 rpcz_store.cc:276] 0709 13:01:24.718088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:24.786743 (+ 68655us) service_pool.cc:224] Handling call
0709 13:01:29.837676 (+5050933us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:29.838788 (+  1112us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:29.872746 (+ 33958us) spinlock_profiling.cc:243] Waited 5.01 s on lock 0x7b540031bd50. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b28ad 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:01:29.872900 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11529788160}
I20260709 13:01:29.873907  2191 leader_election.cc:304] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:29.897502  7245 raft_consensus.cc:2749] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:29.874574  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:29.898232  7505 raft_consensus.cc:493] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:29.874619  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:01:29.899489  1602 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1284) took 2447 ms (client timeout 2135 ms). Trace:
W20260709 13:01:29.899978  1602 rpcz_store.cc:269] 0709 13:01:27.451786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:27.539286 (+ 87500us) service_pool.cc:224] Handling call
0709 13:01:29.679156 (+2139870us) spinlock_profiling.cc:243] Waited 17.5 ms on lock 0x7b5800017198. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a1548ee9c 00007f6a1548ea5b 00007f6a1e3a7c09 00007f6a1d501ee0 00007f6a1d5cb0ab 00007f6a1d5cb131 00007f6a1d5790a0 00007f6a1d578984 00007f6a16af36d4 00007f6a16af3662
0709 13:01:29.874402 (+195246us) spinlock_profiling.cc:243] Waited 26 ms on lock 0x7b5800017198. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a1548eb71 00007f6a1548eeee 0000000000375939 00007f6a1d5021e0 00007f6a1d5cb0c4 00007f6a1d5cb131 00007f6a1d5790a0 00007f6a1d578984 00007f6a16af36d4 00007f6a16af3662
0709 13:01:29.899390 (+ 24988us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":100140672}
I20260709 13:01:29.875126  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:29.850222  1532 rpcz_store.cc:276] 0709 13:01:27.502769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:28.434998 (+932229us) service_pool.cc:224] Handling call
0709 13:01:28.435396 (+   398us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:01:28.500488 (+ 65092us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:28.500520 (+    32us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:01:28.501203 (+   683us) log.cc:844] Serialized 78 byte log entry
0709 13:01:28.739274 (+238071us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:28.753021 (+ 13747us) log.cc:844] Serialized 14 byte log entry
0709 13:01:28.774119 (+ 21098us) log.cc:844] Serialized 14 byte log entry
0709 13:01:29.397208 (+623089us) spinlock_profiling.cc:243] Waited 18.5 ms on lock 0x7b18003fe380. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1e38ede1 00007f6a1e39b5b1 00007f6a154c63f3 00007f6a154c87c1 00007f6a154c8779 00007f6a154c8709 00007f6a154c86d1 00007f6a154c79cd 000000000038f354 000000000038f199 00007f6a154a983a
0709 13:01:29.777861 (+380653us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b18003fe380. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1e38ede1 00007f6a1e39b5b1 00007f6a154c63f3 00007f6a154c87c1 00007f6a154c8779 00007f6a154c8709 00007f6a154c86d1 00007f6a154c79cd 000000000038f354 000000000038f199 00007f6a154a983a
0709 13:01:29.839692 (+ 61831us) spinlock_profiling.cc:243] Waited 2.05 ms on lock 0x7b18003fe380. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1e38ede1 00007f6a1e39b5b1 00007f6a1815b4bc 00007f6a154a948b 00007f6a1e303ab9 00007f6a154c569b 00007f6a154c393f 00007f6a154c3455 00007f6a185ab060 00007f6a185bd716 00007f6a185ce287
0709 13:01:29.840172 (+   480us) log.cc:844] Serialized 14 byte log entry
0709 13:01:29.840564 (+   392us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:29.840698 (+   134us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:29.840773 (+    75us) raft_consensus.cc:1685] finished
0709 13:01:29.840784 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:29.840984 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":84178,"prepare.queue_time_us":49834,"prepare.run_cpu_time_us":161,"prepare.run_wall_time_us":4294,"raft.queue_time_us":187264,"raft.run_cpu_time_us":529,"raft.run_wall_time_us":38645,"spinlock_wait_cycles":71022976,"thread_start_us":218252,"threads_started":2,"wal-append.queue_time_us":186416}
I20260709 13:01:29.878840  7323 raft_consensus.cc:493] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:29.879272  7539 raft_consensus.cc:493] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:29.869592  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:29.902966  7323 raft_consensus.cc:515] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:29.903206  7539 raft_consensus.cc:515] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:29.905328  7323 leader_election.cc:290] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:29.875599  7516 leader_election.cc:290] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:29.885358  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:29.886811  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:29.887550  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:29.889039  2223 raft_consensus.cc:1275] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
W20260709 13:01:29.889839  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:29.890563  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:29.899178  7505 raft_consensus.cc:515] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:29.903326  1603 raft_consensus.cc:2468] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 12.
I20260709 13:01:29.905612  7539 leader_election.cc:290] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:29.928728  7505 leader_election.cc:290] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:29.928983  7551 leader_election.cc:290] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:29.930255  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:29.931031  1603 raft_consensus.cc:3060] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:01:29.933240  1425 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50074 (request call id 235) took 30569 ms (client timeout 15000 ms). Trace:
I20260709 13:01:29.935679  2218 raft_consensus.cc:2468] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 12.
I20260709 13:01:29.884085  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:29.906872  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:29.902187  1598 raft_consensus.cc:2393] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 19: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:01:29.880508  7512 leader_election.cc:290] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:29.898833  1606 raft_consensus.cc:3060] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:29.898237  2191 leader_election.cc:304] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:29.960798  2227 raft_consensus.cc:2468] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 17.
I20260709 13:01:29.970254  1600 raft_consensus.cc:2468] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 15.
I20260709 13:01:29.971557  1600 raft_consensus.cc:1240] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:29.973939  1603 raft_consensus.cc:2468] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 15.
W20260709 13:01:29.988260  1570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:29.993155  7245 raft_consensus.cc:493] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:29.994405  7245 raft_consensus.cc:515] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:29.997270  7245 leader_election.cc:290] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:29.998765  7542 consensus_queue.cc:1059] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:30.000025  7245 raft_consensus.cc:3055] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:30.000428  7245 raft_consensus.cc:740] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:30.001603  7245 consensus_queue.cc:260] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:30.003103  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:30.003494  7245 raft_consensus.cc:3060] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:30.004146  1679 raft_consensus.cc:2393] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 18: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:01:30.008816  1602 raft_consensus.cc:3060] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:29.889773  7461 leader_election.cc:290] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:29.997468  7326 raft_consensus.cc:3060] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:30.016546  1525 raft_consensus.cc:1240] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:30.017309  7406 consensus_queue.cc:1059] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:01:30.015020  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
W20260709 13:01:30.016283  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 118213us
I20260709 13:01:30.020390  2192 leader_election.cc:304] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:30.023633  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:30.024806  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:30.008037  7440 leader_election.cc:290] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:30.018639  7406 consensus_queue.cc:1059] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.003s
I20260709 13:01:30.030287  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:30.036463  2192 leader_election.cc:304] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:01:30.031034  7547 raft_consensus.cc:2749] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:30.031503  2191 leader_election.cc:304] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:30.034637  7558 raft_consensus.cc:2749] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:01:30.036715  1495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:30.029152  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 195940us
I20260709 13:01:30.040640  1606 raft_consensus.cc:2468] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 18.
I20260709 13:01:30.043565  1672 raft_consensus.cc:3060] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:30.044925  1679 raft_consensus.cc:2468] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 16.
I20260709 13:01:30.052222  7564 raft_consensus.cc:3055] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:30.059639  7564 raft_consensus.cc:740] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:30.059091  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:30.062938  1674 raft_consensus.cc:3060] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:30.064913  2226 consensus_queue.cc:237] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:30.028529  7323 consensus_queue.cc:1059] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:01:30.067041  7323 raft_consensus.cc:3055] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:30.067412  7323 raft_consensus.cc:740] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:30.068326  7323 consensus_queue.cc:260] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:01:30.069023  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:30.069792  7323 raft_consensus.cc:3060] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:29.933719  1425 rpcz_store.cc:269] 0709 13:00:59.363861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:59.364147 (+   286us) service_pool.cc:224] Handling call
0709 13:00:59.468423 (+104276us) spinlock_profiling.cc:243] Waited 22.8 ms on lock 0x7b54002e0090. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a1548eb71 00007f6a1548f0b2 00007f6a1e408a89 00007f6a1e3a0da6 00007f6a1e372088 00007f6a1e47037e 00007f6a1c9312a4 00007f6a1c931232 00007f6a1c931161 00007f6a1c9310dc
0709 13:01:29.932964 (+30464541us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:21.980089 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:21.980800 (+   711us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:21.980853 (+    53us) write_op.cc:435] Acquired schema lock
0709 13:01:21.980866 (+    13us) tablet.cc:662] Decoding operations
0709 13:01:21.982227 (+  1361us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:21.982312 (+    85us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:21.982343 (+    31us) tablet.cc:685] Acquiring locks for 16 operations
0709 13:01:22.185849 (+203506us) tablet.cc:701] Row locks acquired
0709 13:01:22.185890 (+    41us) write_op.cc:260] PREPARE: finished
0709 13:01:22.207003 (+ 21113us) write_op.cc:270] Start()
0709 13:01:22.233789 (+ 26786us) write_op.cc:276] Timestamp: P: 1783602082194962 usec, L: 0
0709 13:01:22.238601 (+  4812us) op_driver.cc:348] REPLICATION: starting
0709 13:01:22.375232 (+136631us) log.cc:844] Serialized 6311 byte log entry
0709 13:01:22.917918 (+542686us) spinlock_profiling.cc:243] Waited 3.56 ms on lock 0x7b4400022b4c. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a153ecc85 00007f6a153ed6a2 00007f6a1815f1db 00007f6a1815aaaf 00007f6a1814e86e 00007f6a1814dbb6 00007f6a1814d7d8 00007f6a18157221 00007f6a181571d9 00007f6a18157169
0709 13:01:22.953146 (+ 35228us) spinlock_profiling.cc:243] Waited 2.07 ms on lock 0x7b5400411254. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185aee28 00007f6a1bfe9581 00007f6a1bfe8d58 00007f6a1bfed9f1 00007f6a1bfed9a9 00007f6a1bfed939 00007f6a1bfed901 00007f6a1bfecb2d 000000000038f354 000000000038f199
0709 13:01:23.094853 (+141707us) op_driver.cc:464] REPLICATION: finished
0709 13:01:23.458419 (+363566us) spinlock_profiling.cc:243] Waited 2.88 ms on lock 0x7b4400022b4c. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a153ecc85 00007f6a153ed6a2 00007f6a1815f1db 00007f6a1815aaaf 00007f6a154a90ac 00007f6a1e303ab9 00007f6a154c569b 00007f6a154c393f 00007f6a154c5c02 00007f6a1bfe9ef0
0709 13:01:23.712534 (+254115us) spinlock_profiling.cc:243] Waited 3.23 ms on lock 0x7b1800186a60. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1e38ede1 00007f6a1e39b5b1 00007f6a154c63f3 00007f6a154c87c1 00007f6a154c8779 00007f6a154c8709 00007f6a154c86d1 00007f6a154c79cd 000000000038f354 000000000038f199 00007f6a154a983a
0709 13:01:23.712709 (+   175us) write_op.cc:301] APPLY: starting
0709 13:01:23.712788 (+    79us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:23.783180 (+ 70392us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:23.783203 (+    23us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:24.461639 (+678436us) spinlock_profiling.cc:243] Waited 36.4 ms on lock 0x7b1800186a60. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1e38ede1 00007f6a1e39b5b1 00007f6a154c6522 00007f6a154c87c1 00007f6a154c8779 00007f6a154c8709 00007f6a154c86d1 00007f6a154c79cd 000000000038f354 000000000038f199 00007f6a154a983a
0709 13:01:24.563178 (+101539us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:24.563553 (+   375us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=32,key_file_lookups=32,delta_file_lookups=32,mrs_lookups=0
0709 13:01:24.563605 (+    52us) write_op.cc:312] APPLY: finished
0709 13:01:24.563977 (+   372us) log.cc:844] Serialized 148 byte log entry
0709 13:01:24.564186 (+   209us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:24.564360 (+   174us) write_op.cc:454] Released schema lock
0709 13:01:24.564408 (+    48us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:24.568471 (+  4063us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:24.568503 (+    32us) write_op.cc:454] Released schema lock
0709 13:01:24.724565 (+156062us) spinlock_profiling.cc:243] Waited 9.42 ms on lock 0x7b1800186a60. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1e38ede1 00007f6a1e39b5b1 00007f6a154c6557 00007f6a154c87c1 00007f6a154c8779 00007f6a154c8709 00007f6a154c86d1 00007f6a154c79cd 000000000038f354 000000000038f199 00007f6a154a983a
Metrics: {"mutex_wait_us":277324,"reported_tablets":38,"spinlock_wait_cycles":52514048,"child_traces":[["op",{"apply.queue_time_us":443390,"apply.run_cpu_time_us":52981,"apply.run_wall_time_us":855736,"cfile_cache_hit":66,"cfile_cache_hit_bytes":71135,"num_ops":16,"prepare.queue_time_us":258460,"prepare.run_cpu_time_us":40623,"prepare.run_wall_time_us":989039,"raft.queue_time_us":128862,"raft.run_cpu_time_us":46313,"raft.run_wall_time_us":434671,"replication_time_us":846351,"spinlock_wait_cycles":132320512,"thread_start_us":868054,"threads_started":4,"wal-append.queue_time_us":436228,"wal-append.run_cpu_time_us":43964,"wal-append.run_wall_time_us":2425501}]]}
W20260709 13:01:30.080286  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 45649us
W20260709 13:01:30.080989  2192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:30.083870  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 226287us
W20260709 13:01:30.093847  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:30.074756  7539 consensus_queue.cc:1059] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 13:01:30.097513  1602 raft_consensus.cc:2468] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 12.
I20260709 13:01:30.097534  1672 raft_consensus.cc:2468] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 11.
I20260709 13:01:30.035797  7555 consensus_queue.cc:1059] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.039s
I20260709 13:01:30.090559  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:30.107101  7419 raft_consensus.cc:2749] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:30.113314  7512 raft_consensus.cc:493] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:30.113793  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36200 (request call id 2857) took 1027 ms. Trace:
I20260709 13:01:30.113936  7512 raft_consensus.cc:515] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:30.114212  1607 rpcz_store.cc:276] 0709 13:01:29.086133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:29.087217 (+  1084us) service_pool.cc:224] Handling call
0709 13:01:29.685587 (+598370us) spinlock_profiling.cc:243] Waited 1.97 ms on lock 0x7b5800017198. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a1548eb71 00007f6a1548ea22 00007f6a1e3a7c09 00007f6a1d501ee0 00007f6a1d5cb0ab 00007f6a1d5cb131 00007f6a1d5790a0 00007f6a1d578984 00007f6a16af36d4 00007f6a16af3662
0709 13:01:30.090264 (+404677us) spinlock_profiling.cc:243] Waited 19.9 ms on lock 0x7b5800017198. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a1548ee9c 00007f6a1548ea5b 00007f6a1e3a7c09 00007f6a1d501ee0 00007f6a1d5cb0ab 00007f6a1d5cb131 00007f6a1d5790a0 00007f6a1d578984 00007f6a16af36d4 00007f6a16af3662
0709 13:01:30.113730 (+ 23466us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":50223360}
I20260709 13:01:30.116459  7512 leader_election.cc:290] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:30.116813  7139 raft_consensus.cc:2749] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:30.121448  1646 leader_election.cc:304] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:30.121857  2225 raft_consensus.cc:2468] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 20.
I20260709 13:01:30.122709  7406 raft_consensus.cc:3055] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:01:30.123283  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 94806.4us
I20260709 13:01:30.127959  7575 raft_consensus.cc:515] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:30.129004  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:30.092023  7195 raft_consensus.cc:2804] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:30.130921  1674 raft_consensus.cc:2468] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 20.
I20260709 13:01:30.107908  1571 leader_election.cc:304] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:30.132016  7406 raft_consensus.cc:740] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:30.136201  2191 leader_election.cc:304] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
W20260709 13:01:30.136628  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 57128.9us
I20260709 13:01:30.137732  1497 leader_election.cc:304] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:30.138358  2192 leader_election.cc:304] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:01:30.141659  7539 raft_consensus.cc:2804] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:30.136530  7195 raft_consensus.cc:697] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [term 15 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:30.136807  7406 consensus_queue.cc:260] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:30.143991  7516 raft_consensus.cc:2804] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:30.158905  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:30.151856  7461 raft_consensus.cc:2749] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:30.159665  7405 raft_consensus.cc:2749] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:30.150800  7568 raft_consensus.cc:2804] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:30.167977  1527 raft_consensus.cc:2410] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b for term 19 because replica has last-logged OpId of term: 17 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 14.
I20260709 13:01:30.169464  1672 raft_consensus.cc:1240] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 17. Current term is 18. Ops: []
I20260709 13:01:30.152330  7539 raft_consensus.cc:493] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:30.172555  1679 raft_consensus.cc:1240] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 17. Current term is 18. Ops: []
W20260709 13:01:30.175949  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 54585.7us
I20260709 13:01:30.161789  7516 raft_consensus.cc:493] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:30.178217  7539 raft_consensus.cc:3060] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:30.188450  1679 raft_consensus.cc:1240] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 16 LEADER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 15. Current term is 16. Ops: []
W20260709 13:01:30.188652  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 88764.5us
I20260709 13:01:30.183960  7516 raft_consensus.cc:3060] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:30.180447  7568 raft_consensus.cc:697] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 12 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:30.191506  2225 raft_consensus.cc:1240] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:01:30.183715  7326 raft_consensus.cc:2749] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:30.195132  7505 consensus_queue.cc:1048] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:30.195746  1497 leader_election.cc:304] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:30.198889  7326 raft_consensus.cc:2749] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:01:30.199626  7245 consensus_queue.cc:1059] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:30.200902  7245 consensus_queue.cc:1059] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:01:30.201220  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:30.202582  7547 raft_consensus.cc:3055] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:30.202992  7547 raft_consensus.cc:740] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:30.204439  1523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43008 (request call id 2479) took 2705 ms. Trace:
I20260709 13:01:30.204105  7547 consensus_queue.cc:260] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:30.205675  7558 raft_consensus.cc:3055] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:30.206091  7558 raft_consensus.cc:740] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:30.204825  1523 rpcz_store.cc:276] 0709 13:01:27.499317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:27.572472 (+ 73155us) service_pool.cc:224] Handling call
0709 13:01:27.572725 (+   253us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:28.395439 (+822714us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:28.395468 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:28.410786 (+ 15318us) log.cc:844] Serialized 26 byte log entry
0709 13:01:29.765397 (+1354611us) spinlock_profiling.cc:243] Waited 16.7 ms on lock 0x7b18001468c0. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1e38ede1 00007f6a1e39b5b1 00007f6a154a8e07 00007f6a1e303ab9 00007f6a154c569b 00007f6a154c393f 00007f6a154c5c02 00007f6a1814d20b 00007f6a18152d23 00007f6a181530d1 00007f6a1856ea0f
0709 13:01:30.019479 (+254082us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:30.044283 (+ 24804us) log.cc:844] Serialized 14 byte log entry
0709 13:01:30.095938 (+ 51655us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:30.096025 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:30.204012 (+107987us) raft_consensus.cc:1685] finished
0709 13:01:30.204113 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:30.204271 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":57664,"prepare.queue_time_us":17758,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":849563,"raft.run_cpu_time_us":311,"raft.run_wall_time_us":44965,"spinlock_wait_cycles":38329600,"thread_start_us":202735,"threads_started":1,"wal-append.queue_time_us":1644623}
I20260709 13:01:30.207033  7195 consensus_queue.cc:237] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:30.208825  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:30.209571  1681 raft_consensus.cc:2468] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 17.
W20260709 13:01:30.210556  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:30.209664  1677 raft_consensus.cc:1275] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:01:30.208701  1675 raft_consensus.cc:1275] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 13:01:30.190321  7586 log.cc:927] Time spent T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.063s	user 0.000s	sys 0.005s
I20260709 13:01:30.211547  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:30.220145  1680 raft_consensus.cc:1240] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 18. Current term is 19. Ops: []
I20260709 13:01:30.207077  7558 consensus_queue.cc:260] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:30.222117  7558 raft_consensus.cc:3060] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:30.224191  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:30.226799  2223 raft_consensus.cc:1240] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 17. Current term is 18. Ops: []
I20260709 13:01:30.227015  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:30.203066  7575 leader_election.cc:290] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:30.235800  7547 raft_consensus.cc:3060] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:30.236940  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:30.237715  2224 raft_consensus.cc:2468] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 12.
I20260709 13:01:30.243350  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:30.248138  1646 leader_election.cc:304] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:30.255540  1672 raft_consensus.cc:1240] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 20 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 19. Current term is 20. Ops: []
I20260709 13:01:30.264690  7270 raft_consensus.cc:2804] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:30.265228  7270 raft_consensus.cc:493] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:30.265597  7270 raft_consensus.cc:3060] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:30.271996  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:30.273203  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:30.273772  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:30.274353  2226 raft_consensus.cc:3060] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:30.276782  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:30.277014  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:30.278853  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:30.280160  1605 raft_consensus.cc:1275] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:01:30.283275  7539 raft_consensus.cc:515] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:01:30.279165  7587 log.cc:927] Time spent T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 13:01:30.285471  7564 consensus_queue.cc:260] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:30.289741  7340 raft_consensus.cc:3055] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:01:30.290302  7340 raft_consensus.cc:740] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
W20260709 13:01:30.291127  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 45514.7us
I20260709 13:01:30.291676  1523 raft_consensus.cc:1240] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:30.295508  7512 raft_consensus.cc:493] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:30.222012  7568 consensus_queue.cc:237] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:30.296607  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:30.296882  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:30.298481  2222 raft_consensus.cc:1240] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:30.296218  7512 raft_consensus.cc:515] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:30.296243  7166 raft_consensus.cc:3055] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:30.300580  7166 raft_consensus.cc:740] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:30.301903  7512 leader_election.cc:290] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:30.301590  7166 consensus_queue.cc:260] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:01:30.303246  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:30.302935  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:30.304347  2224 raft_consensus.cc:2468] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 14.
I20260709 13:01:30.294330  1646 leader_election.cc:304] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:30.305967  7575 raft_consensus.cc:2804] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:30.306605  7575 raft_consensus.cc:493] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:30.307032  7575 raft_consensus.cc:3060] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:30.309597  1646 leader_election.cc:304] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:30.312170  1570 leader_election.cc:304] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:30.302940  7166 raft_consensus.cc:3060] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:30.314849  7245 consensus_queue.cc:1048] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:30.315514  7512 raft_consensus.cc:493] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:30.316069  7512 raft_consensus.cc:515] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:30.318193  7512 leader_election.cc:290] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:30.303704  7516 raft_consensus.cc:515] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:30.320943  7340 consensus_queue.cc:260] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:30.322387  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:30.323276  1674 raft_consensus.cc:2393] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 17: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:01:30.323321  7564 raft_consensus.cc:3060] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:30.324182  7505 raft_consensus.cc:2804] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:30.324469  1672 raft_consensus.cc:1240] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 15. Current term is 16. Ops: []
W20260709 13:01:30.329141  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:30.344770  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:30.347090  2227 raft_consensus.cc:1240] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [term 15 LEADER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:30.346174  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:30.322533  7340 raft_consensus.cc:3060] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:30.350904  1646 leader_election.cc:304] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:30.320936  7516 leader_election.cc:290] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:30.376592  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:30.392239  2226 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 19.
I20260709 13:01:30.393579  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:30.375986  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:30.394847  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:30.400357  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:30.404724  1679 raft_consensus.cc:2393] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 20: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:01:30.400024  2221 raft_consensus.cc:2468] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 12.
I20260709 13:01:30.412212  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:30.371075  7323 consensus_queue.cc:1059] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 13:01:30.423295  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:30.425765  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:30.427107  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:30.428174  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:30.429276  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:30.429915  2221 raft_consensus.cc:2468] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 14.
I20260709 13:01:30.432132  7406 raft_consensus.cc:3060] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:30.433336  1606 raft_consensus.cc:1240] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:30.434983  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:30.436259  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:30.437505  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:30.438217  1601 raft_consensus.cc:2393] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 18: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
W20260709 13:01:30.439401  2192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:30.434458  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:30.443354  7539 leader_election.cc:290] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:30.443085  1427 catalog_manager.cc:5697] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: leader changed from <none> to b96ce9cc496c49d7818fa983a17b062b (127.0.107.196). New cstate: current_term: 15 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:01:30.445026  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:30.446238  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:30.446508  7544 raft_consensus.cc:3055] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:01:30.447131  2227 raft_consensus.cc:2468] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 12.
I20260709 13:01:30.438846  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:30.450333  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:30.448514  2221 raft_consensus.cc:2468] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 14.
I20260709 13:01:30.447012  7544 raft_consensus.cc:740] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:30.453832  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:30.455228  1571 leader_election.cc:304] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:30.457386  2220 raft_consensus.cc:2468] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 15.
I20260709 13:01:30.444978  1427 catalog_manager.cc:5697] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 14 to 16, leader changed from e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 16 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:01:30.458434  2222 raft_consensus.cc:2468] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 18.
I20260709 13:01:30.464854  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:30.468180  7330 raft_consensus.cc:2804] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:30.471063  7539 consensus_queue.cc:1048] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:30.471257  7440 consensus_queue.cc:1059] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:30.474105  7323 consensus_queue.cc:1059] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:30.464924  7497 raft_consensus.cc:2749] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:30.471095  7464 consensus_queue.cc:1048] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 13:01:30.414294  7459 consensus_queue.cc:1059] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.039s
I20260709 13:01:30.475335  1602 raft_consensus.cc:1240] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:01:30.475958  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:30.476711  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:30.493530  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:30.493871  1672 raft_consensus.cc:2393] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 18: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:01:30.474591  1607 raft_consensus.cc:1240] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:01:30.477180  1680 raft_consensus.cc:1240] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:30.478883  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:30.478863  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: true dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:30.480020  2224 raft_consensus.cc:2468] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 17.
I20260709 13:01:30.478518  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:30.481568  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:30.484423  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:30.478405  1427 catalog_manager.cc:5697] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 7 to 11, leader changed from b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 11 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:01:30.486445  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
W20260709 13:01:30.488765  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 137942us
I20260709 13:01:30.479255  7516 raft_consensus.cc:2804] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:01:30.510533  2221 raft_consensus.cc:2368] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 19. Current term is 20.
I20260709 13:01:30.513968  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:30.514247  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:30.518496  1496 leader_election.cc:304] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:30.519385  2219 raft_consensus.cc:1240] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 12 LEADER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:30.484145  7330 raft_consensus.cc:493] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:30.523744  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:30.524853  2225 raft_consensus.cc:2376] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 18. Re-sending same reply.
I20260709 13:01:30.524803  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:30.525777  2222 raft_consensus.cc:2468] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 15.
I20260709 13:01:30.526912  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:30.530859  7419 raft_consensus.cc:2804] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:30.530489  7544 consensus_queue.cc:260] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:30.531312  7419 raft_consensus.cc:493] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:30.531698  7419 raft_consensus.cc:3060] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:30.531893  7544 raft_consensus.cc:3060] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:30.532940  1672 raft_consensus.cc:1240] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:30.538360  1680 raft_consensus.cc:1240] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:30.539759  1679 raft_consensus.cc:1240] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 20 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 19. Current term is 20. Ops: []
I20260709 13:01:30.529009  1496 leader_election.cc:304] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:30.541925  1496 leader_election.cc:304] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:30.543512  7166 raft_consensus.cc:3055] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:01:30.543951  7166 raft_consensus.cc:740] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:30.544222  7461 raft_consensus.cc:2804] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:01:30.545189  7326 raft_consensus.cc:2804] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:30.544821  7166 consensus_queue.cc:260] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:30.546108  7166 raft_consensus.cc:3060] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:30.551113  1676 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93"
dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
mode: GRACEFUL
new_leader_uuid: "39a92f5a4352465d8af3af5908fe8642"
 from {username='slave'} at 127.0.0.1:33616
I20260709 13:01:30.551985  1676 raft_consensus.cc:606] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Received request to transfer leadership to TS 39a92f5a4352465d8af3af5908fe8642
I20260709 13:01:30.484282  7512 consensus_queue.cc:1059] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:01:30.552366  1676 raft_consensus.cc:614] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:30.554409  1572 leader_election.cc:304] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:30.555915  1572 leader_election.cc:304] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:01:30.556870  1427 catalog_manager.cc:5697] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 12 to 15, leader changed from ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) to 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194). New cstate: current_term: 15 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } }
I20260709 13:01:30.558621  1427 catalog_manager.cc:5697] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 7 to 9, leader changed from ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) to 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194). New cstate: current_term: 9 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } }
I20260709 13:01:30.560010  1427 catalog_manager.cc:5697] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 6 to 12, leader changed from ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) to e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193). New cstate: current_term: 12 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:30.561519  1427 catalog_manager.cc:5697] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 10 to 14, leader changed from 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 14 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } }
I20260709 13:01:30.563290  7270 raft_consensus.cc:515] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:30.565582  7270 leader_election.cc:290] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 18 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:30.527465  7330 raft_consensus.cc:3060] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:30.522466  7516 raft_consensus.cc:697] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 18 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
W20260709 13:01:30.568441  2192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:30.568109  7516 consensus_queue.cc:237] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:30.583366  7440 raft_consensus.cc:3055] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:30.583982  7440 raft_consensus.cc:740] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:30.585445  2226 raft_consensus.cc:1240] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 17. Current term is 18. Ops: []
I20260709 13:01:30.585928  2222 raft_consensus.cc:1240] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 19. Current term is 20. Ops: []
I20260709 13:01:30.587621  2227 raft_consensus.cc:2468] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 15.
I20260709 13:01:30.589109  1605 raft_consensus.cc:1217] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Deduplicated request from leader. Original: 7.6->[10.7-10.8]   Dedup: 10.7->[10.8-10.8]
I20260709 13:01:30.591043  1427 catalog_manager.cc:5697] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 7 to 15, leader changed from ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) to e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193). New cstate: current_term: 15 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:30.566485  7270 raft_consensus.cc:493] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:30.599973  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:01:30.595052  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 67157.8us
I20260709 13:01:30.596845  2224 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5"
dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
mode: GRACEFUL
new_leader_uuid: "39a92f5a4352465d8af3af5908fe8642"
 from {username='slave'} at 127.0.0.1:47682
I20260709 13:01:30.600988  2224 raft_consensus.cc:606] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 15 LEADER]: Received request to transfer leadership to TS 39a92f5a4352465d8af3af5908fe8642
I20260709 13:01:30.598541  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:30.600055  2191 leader_election.cc:304] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:30.601665  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:30.603598  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:30.606827  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:30.607491  1679 raft_consensus.cc:2468] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 21.
I20260709 13:01:30.608750  1604 raft_consensus.cc:3060] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:30.608529  1676 raft_consensus.cc:2393] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 11: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:01:30.611320  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:30.608278  1427 catalog_manager.cc:5697] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 10 to 13, leader changed from e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 13 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } }
I20260709 13:01:30.588838  7323 raft_consensus.cc:2749] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:30.612188  1603 raft_consensus.cc:2410] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:01:30.612721  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:30.611480  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
W20260709 13:01:30.613515  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:30.615470  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:30.615808  1674 raft_consensus.cc:1240] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:30.617163  7406 raft_consensus.cc:2749] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:30.618307  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:30.613411  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:30.589999  7505 raft_consensus.cc:697] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 15 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:30.620736  1572 leader_election.cc:304] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:01:30.623651  2191 leader_election.cc:304] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:30.625775  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:30.609931  7539 raft_consensus.cc:2804] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:01:30.623168  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 134210us
I20260709 13:01:30.625295  1680 raft_consensus.cc:2393] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 13: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:01:30.623541  1646 leader_election.cc:304] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
W20260709 13:01:30.624130  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 153539us
I20260709 13:01:30.622627  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:30.630482  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:30.631731  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:30.632809  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:30.633821  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:30.635284  7326 raft_consensus.cc:697] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:30.636370  7326 consensus_queue.cc:237] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:30.638839  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 102941us
I20260709 13:01:30.594921  7575 raft_consensus.cc:515] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:30.628527  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:01:30.689960  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 59599.6us
I20260709 13:01:30.690109  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:30.625386  1427 catalog_manager.cc:5697] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 10 to 17, leader changed from e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) to b96ce9cc496c49d7818fa983a17b062b (127.0.107.196). New cstate: current_term: 17 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:01:30.694245  2224 raft_consensus.cc:2468] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 12.
I20260709 13:01:30.698992  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:30.584955  7440 consensus_queue.cc:260] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:01:30.700518  7593 log.cc:927] Time spent T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:01:30.723241  1427 catalog_manager.cc:5697] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 9 to 10, leader changed from b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) to e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193). New cstate: current_term: 10 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:30.699934  1497 connection.cc:256] RPC call timeout handler was delayed by -2.5781081519999702s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1683s for a response
I20260709 13:01:30.628141  7539 raft_consensus.cc:493] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:30.613034  7270 raft_consensus.cc:515] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:30.730394  2226 raft_consensus.cc:2468] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 15.
I20260709 13:01:30.701864  7323 raft_consensus.cc:2804] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:30.740267  2226 raft_consensus.cc:1275] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
W20260709 13:01:30.751734  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 128253us
I20260709 13:01:30.702603  7554 raft_consensus.cc:2749] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:30.756444  2218 raft_consensus.cc:2468] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 11.
W20260709 13:01:30.759342  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:30.762981  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:30.758803  1427 catalog_manager.cc:5697] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:01:30.772732  2227 raft_consensus.cc:2468] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 20.
I20260709 13:01:30.779714  2220 raft_consensus.cc:1275] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:01:30.745822  7539 raft_consensus.cc:3060] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:30.790724  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 79145.5us
I20260709 13:01:30.743253  7323 raft_consensus.cc:493] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:30.744010  7461 raft_consensus.cc:697] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:30.788949  1427 catalog_manager.cc:5697] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 14 to 15, leader changed from ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) to 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194). New cstate: current_term: 15 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } }
I20260709 13:01:30.751988  7606 raft_consensus.cc:493] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:30.795106  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:01:30.797317  1496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:30.804399  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:30.802983  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 196789us
I20260709 13:01:30.757784  7419 raft_consensus.cc:515] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:01:30.809778  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 71905.8us
W20260709 13:01:30.811189  1497 connection.cc:256] RPC call timeout handler was delayed by -2.1842557720000286s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1515s for a response
W20260709 13:01:30.812501  1497 connection.cc:256] RPC call timeout handler was delayed by -2.1371081519999962s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21730000000000002s for a response
W20260709 13:01:30.812848  1497 connection.cc:256] RPC call timeout handler was delayed by -2.0879557720000435s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1622s for a response
I20260709 13:01:30.811947  2220 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004"
dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
mode: GRACEFUL
new_leader_uuid: "39a92f5a4352465d8af3af5908fe8642"
 from {username='slave'} at 127.0.0.1:47682
W20260709 13:01:30.813179  1497 connection.cc:256] RPC call timeout handler was delayed by -2.0474557720000348s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16670000000000001s for a response
W20260709 13:01:30.813539  1497 connection.cc:256] RPC call timeout handler was delayed by -1.9349557720000234s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17920000000000003s for a response
I20260709 13:01:30.793258  7440 raft_consensus.cc:3060] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:01:30.814205  1497 connection.cc:256] RPC call timeout handler was delayed by -1.6154557720000184s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2147s for a response
I20260709 13:01:30.814459  2224 raft_consensus.cc:2468] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 14.
W20260709 13:01:30.814738  1497 connection.cc:256] RPC call timeout handler was delayed by -1.5101557720000187s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2264s for a response
W20260709 13:01:30.815215  1497 connection.cc:256] RPC call timeout handler was delayed by -1.243855568000015s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17520000000000002s for a response
I20260709 13:01:30.815637  2220 raft_consensus.cc:606] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Received request to transfer leadership to TS 39a92f5a4352465d8af3af5908fe8642
I20260709 13:01:30.816083  2220 raft_consensus.cc:614] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:01:30.815622  1497 connection.cc:256] RPC call timeout handler was delayed by -1.2116392479999831s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16920000000000002s for a response
I20260709 13:01:30.818087  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:30.818991  1532 raft_consensus.cc:2393] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 17: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:01:30.820823  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:30.832034  1523 raft_consensus.cc:1240] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 13:01:30.838495  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:30.842051  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:30.842819  1525 raft_consensus.cc:2468] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 15.
W20260709 13:01:30.845409  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 92418.9us
I20260709 13:01:30.845960  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:30.847142  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:30.847851  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:30.848403  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:30.849285  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:30.849771  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:30.848706  1528 raft_consensus.cc:2393] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 15: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:01:30.849918  1529 raft_consensus.cc:3060] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:30.851377  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:30.852061  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:30.852635  1527 raft_consensus.cc:3060] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:30.852905  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:30.852109  1531 raft_consensus.cc:2393] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 18: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:01:30.855044  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:30.855175  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:30.854470  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:30.856593  1526 raft_consensus.cc:2468] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 18.
I20260709 13:01:30.857758  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:30.857765  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:30.858855  1524 raft_consensus.cc:2393] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 13: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:01:30.806551  2191 leader_election.cc:304] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:30.859745  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:30.811856  1496 leader_election.cc:304] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:30.863557  1607 raft_consensus.cc:2410] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:01:30.797148  7323 raft_consensus.cc:3060] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:30.865463  1646 leader_election.cc:304] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:01:30.868501  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:30.871577  1427 catalog_manager.cc:5697] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:01:30.872135  1646 leader_election.cc:304] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:30.878337  1427 catalog_manager.cc:5697] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
W20260709 13:01:30.879438  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 72977.2us
W20260709 13:01:30.890719  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:30.878103  1532 raft_consensus.cc:2468] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 19.
W20260709 13:01:30.868353  7593 log.cc:927] Time spent T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 13:01:30.869324  7516 raft_consensus.cc:2804] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:30.909394  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:30.920832  1607 raft_consensus.cc:2410] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:01:30.920820  1601 raft_consensus.cc:2393] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 21: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
W20260709 13:01:30.901814  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 95351.7us
I20260709 13:01:30.914326  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:30.914178  1427 catalog_manager.cc:5697] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 11 to 14. New cstate: current_term: 14 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:30.914836  7596 raft_consensus.cc:493] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:30.915922  7598 raft_consensus.cc:493] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:30.916412  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:30.916611  7614 raft_consensus.cc:2804] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:01:30.917062  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:30.918565  7610 raft_consensus.cc:2804] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:30.918880  1572 leader_election.cc:304] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:30.807695  7459 consensus_queue.cc:1059] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 19.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.071s
W20260709 13:01:30.923357  1571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:30.946578  2191 leader_election.cc:304] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:01:30.924005  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:30.926306  1530 raft_consensus.cc:1275] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 15. (term mismatch)
I20260709 13:01:30.869083  7512 raft_consensus.cc:493] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:30.950033  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:30.950912  1676 raft_consensus.cc:2393] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 13: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:01:30.940582  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:30.878721  7554 raft_consensus.cc:2749] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:01:30.953845  1530 pending_rounds.cc:85] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting all ops after (but not including) 14
I20260709 13:01:30.928114  1525 raft_consensus.cc:2393] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 18: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:01:30.942157  7614 raft_consensus.cc:493] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:30.803875  7505 consensus_queue.cc:237] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:01:30.954450  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 173649us
I20260709 13:01:30.958189  7614 raft_consensus.cc:3060] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:30.942531  7610 raft_consensus.cc:493] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:30.959422  1532 raft_consensus.cc:2468] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 12.
W20260709 13:01:30.963292  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 50532.1us
I20260709 13:01:30.960041  1427 catalog_manager.cc:5697] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:30.920295  7516 raft_consensus.cc:493] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:30.969554  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:30.968850  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:30.954146  1530 pending_rounds.cc:107] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting uncommitted NO_OP operation due to leader change: 17.15
I20260709 13:01:30.862166  7606 raft_consensus.cc:515] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:30.978166  1530 raft_consensus.cc:2889] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:30.977527  1526 raft_consensus.cc:3060] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:30.950156  6988 raft_consensus.cc:3055] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:30.985318  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:30.987875  1531 raft_consensus.cc:2393] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 14: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:01:30.968156  7610 raft_consensus.cc:3060] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:30.995657  7604 raft_consensus.cc:493] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
W20260709 13:01:30.996639  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 77900.1us
I20260709 13:01:30.953379  7609 raft_consensus.cc:2804] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:01:31.000556  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:30.946930  7598 raft_consensus.cc:515] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:31.005343  7598 leader_election.cc:290] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:30.955771  7461 consensus_queue.cc:237] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:30.969856  7512 raft_consensus.cc:515] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:31.011603  7512 leader_election.cc:290] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:31.012351  7270 leader_election.cc:290] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:31.012665  2219 raft_consensus.cc:2468] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 12.
I20260709 13:01:30.913012  7440 consensus_queue.cc:1059] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.080s
I20260709 13:01:31.014627  7330 raft_consensus.cc:515] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:31.017000  7330 leader_election.cc:290] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 18 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:30.975411  7406 raft_consensus.cc:2749] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:30.999536  7609 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:31.018394  7609 raft_consensus.cc:3060] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:31.014995  7616 raft_consensus.cc:2749] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:31.022279  1526 raft_consensus.cc:2468] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 11.
I20260709 13:01:30.989226  7575 leader_election.cc:290] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:31.027027  1572 leader_election.cc:304] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:31.028784  1572 leader_election.cc:400] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 19 election: Vote denied by peer b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373) with higher term. Message: Invalid argument: T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 19. Current term is 20.
I20260709 13:01:31.030067  1572 leader_election.cc:304] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:30.985921  6988 raft_consensus.cc:740] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:31.031869  6988 consensus_queue.cc:260] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:30.982450  7516 raft_consensus.cc:3060] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:31.002323  1525 raft_consensus.cc:2376] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 19. Re-sending same reply.
I20260709 13:01:31.037511  1527 raft_consensus.cc:2468] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 13.
I20260709 13:01:31.038712  1532 raft_consensus.cc:3055] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:31.049049  1532 raft_consensus.cc:740] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:31.049656  1532 consensus_queue.cc:260] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:31.066334  1427 catalog_manager.cc:5697] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 10 to 12, leader changed from 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) to b96ce9cc496c49d7818fa983a17b062b (127.0.107.196). New cstate: current_term: 12 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:01:31.065652  7166 raft_consensus.cc:2749] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:01:31.073351  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 151236us
I20260709 13:01:31.070863  1572 leader_election.cc:304] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:01:31.076735  1427 catalog_manager.cc:5697] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 10 to 13, leader changed from e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) to b96ce9cc496c49d7818fa983a17b062b (127.0.107.196). New cstate: current_term: 13 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
W20260709 13:01:30.983875  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 111676us
I20260709 13:01:31.090163  1532 raft_consensus.cc:3060] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:31.068337  6988 raft_consensus.cc:3060] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:31.094266  2191 leader_election.cc:304] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:31.092669  1646 leader_election.cc:304] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:01:30.967785  7596 raft_consensus.cc:515] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:31.061995  7575 consensus_queue.cc:1048] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 13:01:31.094130  1427 catalog_manager.cc:5697] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 12 to 15, leader changed from ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) to e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193). New cstate: current_term: 15 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:30.998508  7604 raft_consensus.cc:515] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:31.100304  1681 raft_consensus.cc:1275] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 13:01:31.103968  2221 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.012s	sys 0.011s
W20260709 13:01:31.104770  2221 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.012s	sys 0.012s
I20260709 13:01:31.105633  1646 leader_election.cc:304] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
W20260709 13:01:31.107450  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 128497us
I20260709 13:01:31.110011  1427 catalog_manager.cc:5697] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 7 to 10, leader changed from ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) to e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193). New cstate: current_term: 10 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:31.116986  1524 raft_consensus.cc:2468] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 17.
I20260709 13:01:31.100641  7620 raft_consensus.cc:2804] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:01:31.100409  7459 raft_consensus.cc:2804] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:31.143121  1427 catalog_manager.cc:5697] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 10 to 14, leader changed from ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) to e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193). New cstate: current_term: 14 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:31.116510  7406 raft_consensus.cc:2749] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:01:31.149549  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 73394.2us
I20260709 13:01:31.146906  1532 raft_consensus.cc:1275] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260709 13:01:31.148036  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 49978.3us
I20260709 13:01:31.137322  1646 leader_election.cc:304] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:31.116329  7166 raft_consensus.cc:2804] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:01:31.162599  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:31.164947  1604 consensus_meta.cc:287] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.545s	user 0.008s	sys 0.001s
I20260709 13:01:31.165334  1604 raft_consensus.cc:2468] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 12.
I20260709 13:01:31.165637  1646 leader_election.cc:304] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:01:31.164714  1572 leader_election.cc:304] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:31.164539  2191 leader_election.cc:304] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:31.169149  2191 leader_election.cc:304] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:31.172427  7595 raft_consensus.cc:2749] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:01:31.173360  7602 log.cc:927] Time spent T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:01:31.139281  7459 raft_consensus.cc:493] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:31.167263  7620 raft_consensus.cc:697] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 18 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:31.173440  1678 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50"
dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
mode: GRACEFUL
new_leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:33616
I20260709 13:01:31.177301  1678 raft_consensus.cc:606] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Received request to transfer leadership to TS e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:01:31.177600  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:31.178001  1678 raft_consensus.cc:614] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:01:31.181576  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:31.188282  1646 leader_election.cc:304] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642
W20260709 13:01:31.173360  7608 log.cc:927] Time spent T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.244s	user 0.000s	sys 0.001s
W20260709 13:01:31.177032  7544 consensus_meta.cc:287] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.645s	user 0.007s	sys 0.004s
W20260709 13:01:31.198534  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 165811us
I20260709 13:01:31.194885  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:31.197042  1598 raft_consensus.cc:1275] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:01:31.195197  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:31.197764  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:31.200671  1606 raft_consensus.cc:2468] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 14.
I20260709 13:01:31.195453  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
W20260709 13:01:31.199890  1495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:31.178781  7558 raft_consensus.cc:2749] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:31.180171  7459 raft_consensus.cc:3060] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:31.196424  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
W20260709 13:01:31.203359  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:31.214205  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:31.190004  7166 raft_consensus.cc:697] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 18 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:31.220515  7166 consensus_queue.cc:237] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:31.180941  7406 consensus_queue.cc:1059] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 12.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.030s
I20260709 13:01:31.198287  7620 consensus_queue.cc:237] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:31.198192  7629 raft_consensus.cc:2804] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:31.225304  7629 raft_consensus.cc:493] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:31.217550  7618 raft_consensus.cc:2804] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:01:31.226014  7618 raft_consensus.cc:697] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 20 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:31.219342  7596 leader_election.cc:290] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:31.188381  7568 raft_consensus.cc:2749] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:01:31.216503  1644 leader_election.cc:336] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.905s (SENT)
I20260709 13:01:31.228160  1644 leader_election.cc:304] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:31.228407  7568 raft_consensus.cc:3055] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:31.228832  7568 raft_consensus.cc:740] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:31.226953  7618 consensus_queue.cc:237] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:31.205802  1427 catalog_manager.cc:5697] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 7 to 8, leader changed from 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) to e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193). New cstate: current_term: 8 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:31.179625  7626 raft_consensus.cc:2804] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:31.240614  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:31.241361  1602 raft_consensus.cc:2468] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 15.
I20260709 13:01:31.242307  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:31.238428  1646 leader_election.cc:304] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:31.233604  7596 raft_consensus.cc:2749] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:31.229732  7568 consensus_queue.cc:260] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 12.13, Last appended by leader: 13, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:31.243000  1427 catalog_manager.cc:5697] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 10 to 16. New cstate: current_term: 16 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:01:31.245873  1646 leader_election.cc:304] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:31.198153  7615 raft_consensus.cc:2804] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:31.225718  7629 raft_consensus.cc:3060] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:31.252637  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:31.255329  7596 raft_consensus.cc:2749] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:01:31.253429  7609 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:31.256577  1644 leader_election.cc:336] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 2.186s (SENT)
I20260709 13:01:31.257071  1644 leader_election.cc:304] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:31.192179  7628 consensus_queue.cc:1048] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.060s
I20260709 13:01:31.260170  7628 raft_consensus.cc:2749] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:01:31.255056  1606 raft_consensus.cc:2393] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 13: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
W20260709 13:01:31.263499  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 89769.4us
I20260709 13:01:31.250229  7575 raft_consensus.cc:2804] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:31.264213  1602 raft_consensus.cc:2468] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 17.
I20260709 13:01:31.267046  1427 catalog_manager.cc:5697] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 9 to 11, leader changed from b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) to e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193). New cstate: current_term: 11 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:31.250603  7606 leader_election.cc:290] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:31.275180  1529 raft_consensus.cc:2468] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 18.
W20260709 13:01:31.275445  1570 leader_election.cc:336] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.667s (SENT)
I20260709 13:01:31.276701  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:31.277015  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:31.273399  1427 catalog_manager.cc:5697] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 10 to 13, leader changed from 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 13 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } }
I20260709 13:01:31.277880  1604 raft_consensus.cc:2468] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 11.
I20260709 13:01:31.249969  7626 raft_consensus.cc:697] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 17 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:31.252085  7615 raft_consensus.cc:493] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:31.299393  7497 raft_consensus.cc:3055] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:01:31.299885  7497 raft_consensus.cc:740] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:31.300712  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:31.300877  7497 consensus_queue.cc:260] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:31.302075  7497 raft_consensus.cc:3060] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:31.303167  7610 raft_consensus.cc:515] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:31.305254  7610 leader_election.cc:290] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:31.306844  7614 raft_consensus.cc:515] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:01:31.307617  2190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:31.308974  7614 leader_election.cc:290] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 21 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:31.314304  1674 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457"
dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
mode: GRACEFUL
new_leader_uuid: "39a92f5a4352465d8af3af5908fe8642"
 from {username='slave'} at 127.0.0.1:33616
I20260709 13:01:31.284260  7558 consensus_queue.cc:1059] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:01:31.288200  7604 leader_election.cc:290] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:31.283432  7575 raft_consensus.cc:493] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:31.315837  7575 raft_consensus.cc:3060] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:31.318925  7460 consensus_queue.cc:1059] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:01:31.314996  1674 raft_consensus.cc:606] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Received request to transfer leadership to TS 39a92f5a4352465d8af3af5908fe8642
I20260709 13:01:31.321678  1674 raft_consensus.cc:614] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:31.292579  7615 raft_consensus.cc:3060] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:31.323222   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 13:01:31.323848  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:31.324646  1570 leader_election.cc:336] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.757s (SENT)
I20260709 13:01:31.325109  1570 leader_election.cc:304] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:31.327400  7323 raft_consensus.cc:515] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:31.329751  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 83956.7us
I20260709 13:01:31.330533  1646 leader_election.cc:304] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:31.251590  7595 consensus_queue.cc:1048] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.038s
I20260709 13:01:31.336133  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:31.332921  1646 leader_election.cc:304] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:31.334146   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:01:31.332288  7539 consensus_meta.cc:287] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.527s	user 0.003s	sys 0.007s
I20260709 13:01:31.340093  1646 leader_election.cc:304] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:31.344911  1646 leader_election.cc:304] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:31.346514  2225 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50310 (request call id 1177) took 1016 ms. Trace:
I20260709 13:01:31.333480  7610 raft_consensus.cc:2749] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:01:31.349421  1646 leader_election.cc:304] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:31.347069  2225 rpcz_store.cc:276] 0709 13:01:30.330121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:30.525765 (+195644us) service_pool.cc:224] Handling call
0709 13:01:30.585356 (+ 59591us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:30.605600 (+ 20244us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:01:31.099524 (+493924us) log.cc:844] Serialized 14 byte log entry
0709 13:01:31.189459 (+ 89935us) log.cc:844] Serialized 14 byte log entry
0709 13:01:31.243145 (+ 53686us) spinlock_profiling.cc:243] Waited 18.2 ms on lock 0x7b1800458f20. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1e38ede1 00007f6a1e39b5b1 00007f6a154c6522 00007f6a154c87c1 00007f6a154c8779 00007f6a154c8709 00007f6a154c86d1 00007f6a154c79cd 000000000038f354 000000000038f199 00007f6a154a983a
0709 13:01:31.316837 (+ 73692us) spinlock_profiling.cc:243] Waited 24.7 ms on lock 0x7b1800458f20. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1e38ede1 00007f6a1e39b5b1 00007f6a154c63f3 00007f6a154c87c1 00007f6a154c8779 00007f6a154c8709 00007f6a154c86d1 00007f6a154c79cd 000000000038f354 000000000038f199 00007f6a154a983a
0709 13:01:31.341168 (+ 24331us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:31.341220 (+    52us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:01:31.346277 (+  5057us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:31.346345 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:31.346453 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":315813,"prepare.run_cpu_time_us":99,"prepare.run_wall_time_us":3432,"raft.queue_time_us":17362,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":10888,"spinlock_wait_cycles":98823680,"thread_start_us":713608,"threads_started":3,"wal-append.queue_time_us":178474}
W20260709 13:01:31.351361  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 66217.8us
I20260709 13:01:31.343852  7505 raft_consensus.cc:2749] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:01:31.356712  1570 leader_election.cc:336] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.794s (SENT)
I20260709 13:01:31.357252  1570 leader_election.cc:304] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:31.355245  1529 raft_consensus.cc:3055] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:31.360158  1529 raft_consensus.cc:740] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:31.361220  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:31.348708  7598 raft_consensus.cc:2804] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:31.337347  7340 consensus_queue.cc:1048] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.018s
I20260709 13:01:31.368017  1598 raft_consensus.cc:1275] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:01:31.286916  7626 consensus_queue.cc:237] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:31.368866  7460 raft_consensus.cc:2749] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:01:31.380846  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1313) took 1038 ms. Trace:
I20260709 13:01:31.381650  7629 raft_consensus.cc:515] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:31.369990  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:31.368053  1524 raft_consensus.cc:1240] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:31.371073  1674 raft_consensus.cc:1240] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 17. Current term is 18. Ops: []
I20260709 13:01:31.368688  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:31.389488  7629 leader_election.cc:290] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 18 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:31.369794  1530 raft_consensus.cc:1240] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 18. Current term is 19. Ops: []
I20260709 13:01:31.392038  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:31.384595  2218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 1141) took 1113 ms. Trace:
W20260709 13:01:31.385456  1570 leader_election.cc:336] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.808s (SENT)
I20260709 13:01:31.392746  2218 rpcz_store.cc:276] 0709 13:01:30.271509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:30.271654 (+   145us) service_pool.cc:224] Handling call
0709 13:01:31.384427 (+1112773us) spinlock_profiling.cc:243] Waited 484 ms on lock 0x7b5400601b54. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:01:31.384533 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1112230656}
I20260709 13:01:31.393133  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:31.393328  1570 leader_election.cc:304] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:31.392352  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
W20260709 13:01:31.394522  1570 leader_election.cc:336] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.880s (SENT)
I20260709 13:01:31.397890  7613 raft_consensus.cc:3055] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:31.398334  7613 raft_consensus.cc:740] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:31.399159  7460 raft_consensus.cc:2749] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:01:31.400053  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:31.400952  1677 raft_consensus.cc:2393] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 18: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:01:31.401310  7419 leader_election.cc:290] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 17 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:31.353215  7270 raft_consensus.cc:2804] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:31.402097  7270 raft_consensus.cc:697] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 11 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:31.403051  7270 consensus_queue.cc:237] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:31.404078  1526 raft_consensus.cc:2468] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 15.
I20260709 13:01:31.406999  1527 raft_consensus.cc:1240] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 19. Current term is 20. Ops: []
I20260709 13:01:31.407230  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:31.408779  1672 raft_consensus.cc:1240] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 17. Current term is 18. Ops: []
I20260709 13:01:31.346879  7539 raft_consensus.cc:515] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:31.409916  7568 raft_consensus.cc:3060] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:31.411336  1603 raft_consensus.cc:2393] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 12: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:01:31.369942  7598 raft_consensus.cc:493] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:31.412667  7598 raft_consensus.cc:3060] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:31.415154  7558 raft_consensus.cc:493] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:31.415729  7558 raft_consensus.cc:515] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:31.417877  7558 leader_election.cc:290] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:31.381383  1605 rpcz_store.cc:276] 0709 13:01:30.342028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:30.345386 (+  3358us) service_pool.cc:224] Handling call
0709 13:01:30.586220 (+240834us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:30.589727 (+  3507us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:01:30.604047 (+ 14320us) log.cc:844] Serialized 14 byte log entry
0709 13:01:30.604245 (+   198us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:30.619231 (+ 14986us) log.cc:844] Serialized 501 byte log entry
0709 13:01:30.619405 (+   174us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:30.619441 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:30.619505 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:30.960480 (+340975us) raft_consensus.cc:1685] finished
0709 13:01:30.960501 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:31.380600 (+420099us) spinlock_profiling.cc:243] Waited 234 ms on lock 0x7b54000daf50. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b28ad 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:01:31.380748 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":16985,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":3110,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":86,"spinlock_wait_cycles":542896768}
I20260709 13:01:31.370064  7596 consensus_queue.cc:1048] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.050s
W20260709 13:01:31.420863  1496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:31.421566  7638 consensus_queue.cc:1059] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:01:31.421950  7613 consensus_queue.cc:260] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:31.423003  7146 raft_consensus.cc:3055] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:31.423499  7146 raft_consensus.cc:740] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:31.423882  7638 raft_consensus.cc:3055] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:01:31.424196  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:31.424623  1672 raft_consensus.cc:1240] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:31.424937  1523 raft_consensus.cc:2393] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 15: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:01:31.431126  7330 raft_consensus.cc:3055] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:01:31.431593  7330 raft_consensus.cc:740] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:31.432500  7330 consensus_queue.cc:260] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:31.433588  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:31.434450  1523 raft_consensus.cc:2393] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 13: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:01:31.433526  7638 raft_consensus.cc:740] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:31.436048  1527 raft_consensus.cc:1240] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:31.436326  7638 consensus_queue.cc:260] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:31.437577  7638 raft_consensus.cc:3060] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:31.437829  1572 leader_election.cc:304] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:31.438896  7632 raft_consensus.cc:2749] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:31.362010  7618 raft_consensus.cc:2804] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:31.442672  7618 raft_consensus.cc:493] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:31.443094  7618 raft_consensus.cc:3060] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:31.445281  7539 leader_election.cc:290] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:01:31.449518  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 78562.4us
I20260709 13:01:31.450332  1572 leader_election.cc:304] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:31.423125  7613 raft_consensus.cc:3060] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:01:31.451932  1571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:31.449527  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 55020.6us
I20260709 13:01:31.458760  1672 raft_consensus.cc:1240] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 18 LEADER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 17. Current term is 18. Ops: []
I20260709 13:01:31.460536  7330 raft_consensus.cc:3060] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:31.456689  1529 consensus_queue.cc:260] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:31.467036  1571 leader_election.cc:304] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:31.469440  1529 raft_consensus.cc:3060] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:31.455133  7539 raft_consensus.cc:2749] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:31.473340  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:31.471268  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:31.473953  2225 raft_consensus.cc:3060] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:31.476280  1679 raft_consensus.cc:1240] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:31.476634  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:31.456434  7516 raft_consensus.cc:515] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:31.478643  7340 raft_consensus.cc:2955] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [term 10 LEADER]: Committing config change with OpId 10.8: config changed from index 5 to 8, VOTER e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:01:31.480811  7516 leader_election.cc:290] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:31.484088  1646 leader_election.cc:304] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:31.491715  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
W20260709 13:01:31.475502  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 82151.7us
I20260709 13:01:31.475402  7609 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 20 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:31.495440  7516 raft_consensus.cc:2749] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:31.502468  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:31.516568  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:31.506989  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:31.506145  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 13:01:31.511392  1495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:31.514828  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:31.519984  1532 raft_consensus.cc:2393] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 20: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:01:31.517208  1599 raft_consensus.cc:3060] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:31.521431  1672 raft_consensus.cc:1275] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 20 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:01:31.523999  7459 raft_consensus.cc:515] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:31.524962  1646 leader_election.cc:304] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:31.507669  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:31.495689  7595 consensus_queue.cc:1048] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:01:31.508447  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:31.527401  1524 raft_consensus.cc:2393] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 21: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:01:31.528297  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:31.529415  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:31.510780  1605 raft_consensus.cc:1275] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:01:31.530802  7630 consensus_queue.cc:1059] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:01:31.531800  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:31.533565  1529 raft_consensus.cc:1275] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:01:31.533711  1674 raft_consensus.cc:1240] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:31.535665  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:31.518499  1523 raft_consensus.cc:2468] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 12.
I20260709 13:01:31.541213  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:31.542050  1529 raft_consensus.cc:2393] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 12: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:01:31.530411  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:31.545329  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:31.546824  2221 raft_consensus.cc:2393] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 12: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:01:31.491459  7166 raft_consensus.cc:2749] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:01:31.546635  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:31.549193  2219 raft_consensus.cc:2393] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 14: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:01:31.424398  7146 consensus_queue.cc:260] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:31.561841  1524 raft_consensus.cc:2393] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 17: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:01:31.562465  1678 raft_consensus.cc:2468] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 21.
I20260709 13:01:31.562940  1526 raft_consensus.cc:2376] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 15. Re-sending same reply.
I20260709 13:01:31.561579  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:31.568181  2225 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 20.
I20260709 13:01:31.570439  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:31.544828  1602 raft_consensus.cc:2955] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Committing config change with OpId 10.8: config changed from index 5 to 8, VOTER e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:01:31.571460  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:31.572211  2225 raft_consensus.cc:2393] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 15: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:01:31.572603  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:31.575372  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:31.578100  1532 raft_consensus.cc:2393] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 12: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:01:31.571136  1530 raft_consensus.cc:2376] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 15. Re-sending same reply.
I20260709 13:01:31.576189  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:31.575452  1607 raft_consensus.cc:1240] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 17. Current term is 18. Ops: []
I20260709 13:01:31.573688  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:31.580160  1526 raft_consensus.cc:2393] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 15: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
W20260709 13:01:31.582476  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:31.584862  1523 raft_consensus.cc:2393] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 15: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:01:31.587169  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:31.588487  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:31.589231  1529 raft_consensus.cc:3060] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:31.543661  7595 raft_consensus.cc:2749] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:01:31.526127  7459 leader_election.cc:290] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:31.587913  1528 raft_consensus.cc:2468] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 16.
I20260709 13:01:31.591547  2191 leader_election.cc:304] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:31.593824  1496 leader_election.cc:304] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
W20260709 13:01:31.596141  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:31.596798  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:31.504472  7575 raft_consensus.cc:515] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:31.598800  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:31.603081  7146 raft_consensus.cc:3060] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:31.604379  7326 raft_consensus.cc:2804] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:01:31.604918  7326 raft_consensus.cc:697] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 21 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:31.605836  7326 consensus_queue.cc:237] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:31.607695  7575 leader_election.cc:290] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:31.512032  7615 raft_consensus.cc:515] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:31.608824  1680 raft_consensus.cc:1240] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:31.609869  7615 leader_election.cc:290] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:31.600705  7606 consensus_queue.cc:1059] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.012s
W20260709 13:01:31.610952  1495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:31.612833  1532 raft_consensus.cc:1275] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:01:31.615592  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:31.616039  7606 raft_consensus.cc:3055] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:31.616434  7606 raft_consensus.cc:740] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:31.617290  7606 consensus_queue.cc:260] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:31.573400  7618 raft_consensus.cc:515] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:31.573154  7645 consensus_queue.cc:1048] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.058s
I20260709 13:01:31.618561  7606 raft_consensus.cc:3060] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:31.620872  7618 leader_election.cc:290] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 18 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
W20260709 13:01:31.622838  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:31.573226  7440 raft_consensus.cc:2749] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:31.602449  1524 raft_consensus.cc:2468] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 15.
I20260709 13:01:31.628753  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 13:01:31.629699  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:31.627024  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:31.630924  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:31.639192  1525 raft_consensus.cc:2393] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 14: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:01:31.635727  1599 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 20.
I20260709 13:01:31.598376  7139 raft_consensus.cc:2749] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:31.640370  1646 leader_election.cc:304] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
W20260709 13:01:31.636945  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 106587us
I20260709 13:01:31.641645  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:31.584510  6988 consensus_queue.cc:1048] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.058s
I20260709 13:01:31.590306  7406 consensus_queue.cc:1059] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.046s
I20260709 13:01:31.649333  1529 raft_consensus.cc:2468] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 13.
I20260709 13:01:31.595858  7547 consensus_queue.cc:1048] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:01:31.643723  1530 raft_consensus.cc:2393] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 13: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:01:31.636138  7323 leader_election.cc:290] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:01:31.657821  1495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:31.654610  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:31.658131  1606 raft_consensus.cc:1275] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:01:31.658531  1525 raft_consensus.cc:2393] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 15: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:01:31.654037  7632 consensus_queue.cc:1059] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:01:31.644104  1602 raft_consensus.cc:3060] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:31.661593  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:31.665797  1525 raft_consensus.cc:2393] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 14: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:01:31.657408  7610 raft_consensus.cc:2804] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:01:31.711310  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:31.709717  7610 raft_consensus.cc:697] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 20 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:31.715626  7610 consensus_queue.cc:237] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 20, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:31.727589  1525 raft_consensus.cc:2393] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 12: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:01:31.728750  1601 raft_consensus.cc:2468] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 14.
I20260709 13:01:31.736519  1602 raft_consensus.cc:2468] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 18.
I20260709 13:01:31.756464  1603 raft_consensus.cc:1275] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:01:31.758785  1679 raft_consensus.cc:1240] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 17. Current term is 18. Ops: []
I20260709 13:01:31.760780  7139 raft_consensus.cc:493] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:31.761350  7139 raft_consensus.cc:515] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:31.726980  7340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:47372 (request call id 9) took 1818 ms. Trace:
I20260709 13:01:31.769676  1678 raft_consensus.cc:2955] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Committing config change with OpId 10.8: config changed from index 5 to 8, VOTER e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:01:31.781679  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:31.787180  2221 raft_consensus.cc:2468] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 20.
I20260709 13:01:31.789884  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 13:01:31.791007  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:31.792866  2221 raft_consensus.cc:1275] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:01:31.793479  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:31.794564  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:31.796767  1531 raft_consensus.cc:1240] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:31.776841  6988 raft_consensus.cc:493] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:31.767483  7406 consensus_queue.cc:1059] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.037s
I20260709 13:01:31.806214  1646 leader_election.cc:304] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:31.809808  1646 leader_election.cc:304] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
W20260709 13:01:31.809895  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:31.807394  1570 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.555s (SENT) [suppressed 64 similar messages]
W20260709 13:01:31.811677  1570 leader_election.cc:336] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.926s (SENT)
I20260709 13:01:31.811892  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:31.816342  2226 raft_consensus.cc:1275] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:01:31.818518  1570 leader_election.cc:304] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:31.794850  7645 raft_consensus.cc:493] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:31.818042  7655 raft_consensus.cc:493] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:31.775467  7340 rpcz_store.cc:276] 0709 13:01:29.891320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:29.895321 (+  4001us) service_pool.cc:224] Handling call
0709 13:01:30.122437 (+227116us) log.cc:844] Serialized 501 byte log entry
0709 13:01:30.242067 (+119630us) spinlock_profiling.cc:243] Waited 147 ms on lock 0x7b540002f654. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b9735 00007f6a185b19fa 00007f6a1d5794c9 00007f6a16af5c54 00007f6a16af5be2 00007f6a16af5b11 00007f6a16af5a8c 00007f6a16af4d42 00007f6a168ee48c 00007f6a168ed8c6
0709 13:01:30.299338 (+ 57271us) spinlock_profiling.cc:243] Waited 3.78 ms on lock 0x7b180031db60. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1e38ede1 00007f6a1e39b5b1 00007f6a154c6522 00007f6a154c87c1 00007f6a154c8779 00007f6a154c8709 00007f6a154c86d1 00007f6a154c79cd 000000000038f354 000000000038f199 00007f6a154a983a
0709 13:01:30.307333 (+  7995us) spinlock_profiling.cc:243] Waited 1.38 ms on lock 0x7b5400950720. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a18533b26 00007f6a1852d49a 00007f6a1852c714 00007f6a1850ceaa 00007f6a18513d53 00007f6a18513cd9 00007f6a18513c69 00007f6a18513c31 00007f6a18512dfd 000000000038f354
0709 13:01:31.710052 (+1402719us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":66,"raft.queue_time_us":3120,"raft.run_cpu_time_us":3485,"raft.run_wall_time_us":69142,"spinlock_wait_cycles":354280576}
I20260709 13:01:31.814459  6988 raft_consensus.cc:515] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:01:31.828644  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:31.816671  7615 raft_consensus.cc:2804] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:31.809787  7609 consensus_queue.cc:1048] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.023s
I20260709 13:01:31.829799  7638 consensus_queue.cc:1048] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.018s
W20260709 13:01:31.985277  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 157798us
I20260709 13:01:31.965399  1607 raft_consensus.cc:1275] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
W20260709 13:01:31.981787  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 152838us
W20260709 13:01:31.910954  1496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:31.963364  1678 raft_consensus.cc:1240] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 17. Current term is 18. Ops: []
W20260709 13:01:31.898886  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 87208.8us
I20260709 13:01:31.993824  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:31.993973  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:31.829310  7610 raft_consensus.cc:2804] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:01:31.961023  1598 raft_consensus.cc:1275] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:01:31.995772  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:31.996089  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:31.952255  1680 raft_consensus.cc:1275] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:01:31.995533  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:31.963959  1603 raft_consensus.cc:1275] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:01:31.946015  1644 leader_election.cc:304] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:01:32.018606  7326 consensus_queue.cc:1059] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 12.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:01:32.019740  7326 raft_consensus.cc:3055] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:32.020129  7326 raft_consensus.cc:740] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
W20260709 13:01:31.935971  7654 log.cc:927] Time spent T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:01:31.857173  7554 raft_consensus.cc:993] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b: : Instructing follower 39a92f5a4352465d8af3af5908fe8642 to start an election
I20260709 13:01:32.022053  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:32.022675  1599 raft_consensus.cc:2393] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 21: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:01:32.021416  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:31.856161  7558 raft_consensus.cc:3055] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:01:31.856261  1416 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4190d217954f4f798b3a610501115290 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 10)
I20260709 13:01:31.843544  7568 consensus_queue.cc:1048] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.173s
I20260709 13:01:31.851744  7613 raft_consensus.cc:2749] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:31.850445  6988 leader_election.cc:290] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:31.835104  7146 raft_consensus.cc:493] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:31.934794  7270 raft_consensus.cc:493] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:31.848278  7615 raft_consensus.cc:697] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 14 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:31.832123  7645 raft_consensus.cc:515] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:32.034078  2224 raft_consensus.cc:1275] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
W20260709 13:01:32.035136  1495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:31.851559  7139 leader_election.cc:290] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:32.039819  7595 raft_consensus.cc:2804] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:01:32.047204  7616 raft_consensus.cc:3055] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:01:32.048458  1571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:31.851524  7598 raft_consensus.cc:515] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:32.068295  7598 leader_election.cc:290] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:31.835625  7655 raft_consensus.cc:515] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:31.997044  7632 consensus_queue.cc:1048] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.052s
W20260709 13:01:32.055989  1416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 199883us
I20260709 13:01:32.027154  7558 raft_consensus.cc:740] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:32.064947  7595 raft_consensus.cc:697] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 19 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:32.062309  7616 raft_consensus.cc:740] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:32.065411  7670 raft_consensus.cc:1081] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 15 LEADER]: Signalling peer 39a92f5a4352465d8af3af5908fe8642 to start an election
I20260709 13:01:32.021044  7326 consensus_queue.cc:260] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 12.13, Last appended by leader: 13, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:31.964550  7629 consensus_queue.cc:1048] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.076s
W20260709 13:01:32.074985  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 256103us
W20260709 13:01:32.099850  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 78216.7us
I20260709 13:01:32.056901  7146 raft_consensus.cc:515] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:32.057531  7270 raft_consensus.cc:515] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:32.092900  7610 raft_consensus.cc:697] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 18 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
W20260709 13:01:32.119899  1495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:32.125654  7575 consensus_queue.cc:1048] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:01:32.126566  7326 raft_consensus.cc:3060] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:32.127190  7615 consensus_queue.cc:237] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:32.129971  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:32.131589  1599 raft_consensus.cc:3060] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:32.130090  7516 consensus_queue.cc:1048] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.002s
I20260709 13:01:32.132660  7645 leader_election.cc:290] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:32.132788  7270 leader_election.cc:290] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:32.134299  7558 consensus_queue.cc:260] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:32.135543  7558 raft_consensus.cc:3060] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:32.140815  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:32.144114  1599 raft_consensus.cc:2468] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 16.
I20260709 13:01:32.141568  1674 raft_consensus.cc:2468] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 13.
I20260709 13:01:32.134218  7655 leader_election.cc:290] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:32.103423  7440 consensus_queue.cc:1048] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.027s
I20260709 13:01:32.146324  7610 consensus_queue.cc:237] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:32.147589  7146 leader_election.cc:290] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:32.161430  7440 consensus_queue.cc:1059] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 13:01:32.175369  1570 leader_election.cc:304] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:32.159861  7146 raft_consensus.cc:493] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
W20260709 13:01:32.226398  1495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:32.229923  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 54634.8us
I20260709 13:01:32.231046  1570 leader_election.cc:304] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:32.229718  7440 raft_consensus.cc:493] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:32.233466  7440 raft_consensus.cc:515] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:32.233810  1570 leader_election.cc:304] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:01:32.234186  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:32.240767  7440 leader_election.cc:290] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:32.222103  7323 raft_consensus.cc:3055] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:01:32.242559  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 296620us
W20260709 13:01:32.244145  1495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:32.243876  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:01:32.249989  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:32.244331  7632 raft_consensus.cc:2749] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:32.223352  7146 raft_consensus.cc:515] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:32.256786  7146 leader_election.cc:290] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:32.244755  7323 raft_consensus.cc:740] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:32.242893  7625 raft_consensus.cc:2804] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:32.259333  7625 raft_consensus.cc:697] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 15 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:32.260387  7625 consensus_queue.cc:237] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:32.242851  7461 raft_consensus.cc:493] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:32.263674  7461 raft_consensus.cc:515] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:32.265975  7461 leader_election.cc:290] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:32.268877  7616 consensus_queue.cc:260] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:32.270344  7616 raft_consensus.cc:3060] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:01:32.271008  7460 consensus_queue.cc:1175] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ddf11fc190dd4b898773379c6b129d90" responder_term: 18 status { last_received { term: 17 index: 14 } last_committed_idx: 14 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 17. Current term is 18. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:01:32.276947  1571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:32.232133  7606 raft_consensus.cc:493] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:32.297572  7606 raft_consensus.cc:515] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:32.299664  7606 leader_election.cc:290] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:32.163179  7595 consensus_queue.cc:237] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:32.300473  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:32.301244  1675 raft_consensus.cc:2393] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 13: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:01:32.281849  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:32.303593  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:32.286479  1673 raft_consensus.cc:1240] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 20 LEADER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 19. Current term is 20. Ops: []
I20260709 13:01:32.286831  1497 leader_election.cc:304] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:32.290277  1646 leader_election.cc:304] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:32.291357  7618 consensus_queue.cc:1048] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:32.302976  1679 raft_consensus.cc:2468] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 13.
I20260709 13:01:32.292326  7609 consensus_queue.cc:1048] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:32.239387  7613 raft_consensus.cc:2749] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:32.305155  1571 leader_election.cc:304] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:32.315893  1674 raft_consensus.cc:1240] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:32.319595  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:32.320370  1678 raft_consensus.cc:2393] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 16: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:01:32.320520  1496 leader_election.cc:304] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:32.294874  7326 raft_consensus.cc:493] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:32.295954  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 62271.6us
I20260709 13:01:32.285591  7323 consensus_queue.cc:260] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:32.323206  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:32.311208  2190 leader_election.cc:304] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:32.312073  7682 raft_consensus.cc:2804] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:32.321748  1570 leader_election.cc:304] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:32.326241  7419 raft_consensus.cc:2749] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:01:32.327060  7544 consensus_queue.cc:1059] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:01:32.328521  7626 raft_consensus.cc:2804] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:32.339891  1598 raft_consensus.cc:1275] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:01:32.347826  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:32.356055  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:32.361411  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:32.357677  1530 raft_consensus.cc:2468] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 13.
I20260709 13:01:32.362036  2224 raft_consensus.cc:2468] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 11.
W20260709 13:01:32.360090  2190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:32.363672  2219 raft_consensus.cc:1275] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:01:32.370121  2220 raft_consensus.cc:1275] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:01:32.338879  7568 raft_consensus.cc:2749] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:32.362854  7626 raft_consensus.cc:493] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:32.355538  6988 raft_consensus.cc:2804] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:32.338032  7326 raft_consensus.cc:515] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:32.355466  7682 raft_consensus.cc:697] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 16 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:32.363816  7624 raft_consensus.cc:2764] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader election decision vote started in defunct term 15: won
W20260709 13:01:32.391350  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 69708.5us
W20260709 13:01:32.393313  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 150651us
I20260709 13:01:32.397791   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:01:32.385797  7683 log.cc:927] Time spent T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.144s	user 0.004s	sys 0.000s
I20260709 13:01:32.360966  7606 consensus_queue.cc:1059] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 13:01:32.388446  7626 raft_consensus.cc:3060] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:32.388218  6988 raft_consensus.cc:493] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:32.408649  1497 leader_election.cc:304] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:32.422593  1570 leader_election.cc:304] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:32.431653  7678 consensus_queue.cc:1048] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:01:32.442845  7682 consensus_queue.cc:237] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:32.447712  7323 raft_consensus.cc:3060] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:32.451563  1497 leader_election.cc:304] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:32.454866  7614 raft_consensus.cc:2749] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:01:32.451579  2190 leader_election.cc:304] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:32.457222  2190 leader_election.cc:304] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:32.457700  7632 raft_consensus.cc:2749] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:32.457099  1570 leader_election.cc:304] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:32.415292  7568 raft_consensus.cc:493] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:32.461306  1497 leader_election.cc:304] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:32.416340  6988 raft_consensus.cc:3060] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:32.467061  1497 leader_election.cc:304] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:32.465901  1646 leader_election.cc:304] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:32.436218  7606 consensus_queue.cc:1243] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer ddf11fc190dd4b898773379c6b129d90 log is divergent from this leader: its last log entry 20.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:01:32.462006  7461 raft_consensus.cc:2749] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:01:32.464476  7146 raft_consensus.cc:2749] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:01:32.471704  7564 raft_consensus.cc:2804] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:32.464480  7544 raft_consensus.cc:3055] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:01:32.464515  7614 raft_consensus.cc:2749] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:32.471232  7547 raft_consensus.cc:493] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:32.458392  7632 consensus_queue.cc:1048] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
W20260709 13:01:32.509038  1495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:32.513700  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 56671.5us
I20260709 13:01:32.514732  1570 leader_election.cc:304] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:32.489023  7516 raft_consensus.cc:2804] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:32.495544  7606 raft_consensus.cc:2749] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:32.527544  1570 leader_election.cc:304] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:32.471483  7568 raft_consensus.cc:515] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:32.502971  7564 raft_consensus.cc:493] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:32.504671  7544 raft_consensus.cc:740] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:32.545468  1672 raft_consensus.cc:1275] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
W20260709 13:01:32.548215  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 81265.7us
I20260709 13:01:32.526327  7516 raft_consensus.cc:493] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:32.549125  1497 leader_election.cc:304] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:32.501195  7610 consensus_queue.cc:1048] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 13:01:32.499251  7596 consensus_queue.cc:1048] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.045s
I20260709 13:01:32.532064  7464 raft_consensus.cc:2804] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:01:32.560200  7690 log.cc:927] Time spent T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:01:32.556792  7606 consensus_queue.cc:1048] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.005s
I20260709 13:01:32.559288  1497 leader_election.cc:304] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:32.548113  7564 raft_consensus.cc:3060] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:32.524986  7547 raft_consensus.cc:515] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:32.553027  7516 raft_consensus.cc:3060] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:32.553369  7460 raft_consensus.cc:2749] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:32.573920  7614 raft_consensus.cc:2804] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:32.574535  7614 raft_consensus.cc:697] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:32.575421  7614 consensus_queue.cc:237] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:32.582195  7544 consensus_queue.cc:260] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:32.583498  7544 raft_consensus.cc:3060] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:32.584380  7564 raft_consensus.cc:515] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:32.556748  7461 raft_consensus.cc:2749] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:32.554772  7166 raft_consensus.cc:2764] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:01:32.569872  7326 leader_election.cc:290] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:01:32.593771  7685 log.cc:927] Time spent T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:01:32.595135  7564 leader_election.cc:290] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 13 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:32.600386  7667 raft_consensus.cc:493] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:32.601052  7667 raft_consensus.cc:515] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:32.601197  6988 raft_consensus.cc:515] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:32.606170  1497 leader_election.cc:304] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:32.607213  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:32.608045  1675 raft_consensus.cc:2393] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 13: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
W20260709 13:01:32.609059  7694 log.cc:927] Time spent T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:01:32.607991  7326 raft_consensus.cc:2749] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:01:32.611824  7547 leader_election.cc:290] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:32.567445  7464 raft_consensus.cc:697] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 13 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:32.613518  1497 leader_election.cc:304] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:32.613281  7464 consensus_queue.cc:237] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:32.613835  7667 leader_election.cc:290] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:01:32.614271  7689 log.cc:927] Time spent T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:01:32.622830  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:32.623096  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:32.555240  7146 raft_consensus.cc:493] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:32.628934  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
W20260709 13:01:32.640774  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 52756.9us
I20260709 13:01:32.646867  1601 raft_consensus.cc:1275] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:01:32.655047  1527 raft_consensus.cc:2468] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 13.
I20260709 13:01:32.664878  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 13:01:32.670398  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 56968.8us
I20260709 13:01:32.672119  1497 leader_election.cc:304] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:01:32.672252  2190 leader_election.cc:304] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:32.675028  2190 leader_election.cc:304] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:32.656445  7461 raft_consensus.cc:2749] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:01:32.666821  7558 consensus_meta.cc:287] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b: Time spent flushing consensus metadata: real 0.531s	user 0.009s	sys 0.003s
W20260709 13:01:32.677727  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 100116us
I20260709 13:01:32.643244  7146 raft_consensus.cc:515] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:32.684279  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 156849us
I20260709 13:01:32.667876  7678 consensus_queue.cc:1048] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 13:01:32.678892  7564 raft_consensus.cc:2804] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:32.693161  1497 leader_election.cc:304] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:01:32.680576  7614 raft_consensus.cc:2804] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:32.683270  7645 raft_consensus.cc:2749] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:01:32.714497  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:32.714351  7614 raft_consensus.cc:697] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:32.722263  7614 consensus_queue.cc:237] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:32.710980  7564 raft_consensus.cc:697] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 13 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:32.726107  7564 consensus_queue.cc:237] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:32.730471  7516 raft_consensus.cc:515] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:32.718372  1497 leader_election.cc:304] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:01:32.696906  7326 consensus_queue.cc:1048] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.042s
W20260709 13:01:32.764619  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 84642.4us
I20260709 13:01:32.738914  7461 raft_consensus.cc:2804] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:01:32.766274  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 78212.2us
I20260709 13:01:32.742550  7699 raft_consensus.cc:2804] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:32.768020  1570 leader_election.cc:304] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:32.769096  1570 leader_election.cc:304] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:32.770961  1497 leader_election.cc:304] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:32.768055  7568 leader_election.cc:290] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:32.783589  7616 raft_consensus.cc:493] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:32.773526  7544 raft_consensus.cc:2749] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:32.774111  7440 raft_consensus.cc:2749] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:01:32.798629  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:32.774045  7461 raft_consensus.cc:697] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:32.800909  1599 raft_consensus.cc:2468] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 16.
I20260709 13:01:32.801261  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:01:32.809719  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:32.820850  7516 leader_election.cc:290] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:32.785020  7704 raft_consensus.cc:493] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:32.821762  7704 raft_consensus.cc:515] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:32.822702  7700 log.cc:927] Time spent T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:01:32.824445  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:32.825099  1606 raft_consensus.cc:2468] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 12.
W20260709 13:01:32.826017  7702 log.cc:927] Time spent T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
I20260709 13:01:32.827358  7146 leader_election.cc:290] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:32.829025  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:32.829684  1598 raft_consensus.cc:2468] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 15.
I20260709 13:01:32.800207  7606 raft_consensus.cc:2749] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:32.832809  7461 consensus_queue.cc:237] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:32.800181  7616 raft_consensus.cc:515] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:32.815872  1603 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5"
dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
 from {username='slave'} at 127.0.0.1:57268
I20260709 13:01:32.839392  2192 leader_election.cc:304] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:32.839318  1603 raft_consensus.cc:493] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:32.840337  1603 raft_consensus.cc:3060] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:32.841998  7419 raft_consensus.cc:3055] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:01:32.842463  7419 raft_consensus.cc:740] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:32.843277  7419 consensus_queue.cc:260] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:32.892409  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 47078.6us
W20260709 13:01:32.894410  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 75522.2us
I20260709 13:01:32.826246  7626 raft_consensus.cc:515] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:01:32.908823  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 137939us
I20260709 13:01:32.864008  7146 raft_consensus.cc:2804] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:32.909865  1497 leader_election.cc:304] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:32.911922  1497 leader_election.cc:304] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:32.913982  1599 raft_consensus.cc:1275] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:01:32.893554  7699 raft_consensus.cc:697] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:32.920527  7699 consensus_queue.cc:237] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:32.921346  7604 consensus_queue.cc:1048] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:01:32.919458  7326 raft_consensus.cc:2749] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:32.924010  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:32.924268  2222 raft_consensus.cc:1275] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:01:32.925566  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:32.926029  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:32.926689  1530 raft_consensus.cc:2468] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 15.
I20260709 13:01:32.925397  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:32.908288  1603 raft_consensus.cc:515] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:32.906057  7705 log.cc:927] Time spent T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.199s	user 0.003s	sys 0.000s
W20260709 13:01:32.906529  7698 log.cc:927] Time spent T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:01:32.931842  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:32.932601  1529 raft_consensus.cc:2393] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 18: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:01:32.906819  7419 raft_consensus.cc:3060] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:32.934075  1527 raft_consensus.cc:2393] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 13: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:01:32.925529  7614 raft_consensus.cc:2749] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:32.937956  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:32.938221  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:32.939764  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:32.941136  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:32.941568  1529 raft_consensus.cc:3060] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:32.941805  1526 raft_consensus.cc:2468] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 15.
I20260709 13:01:32.909125  7544 raft_consensus.cc:493] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:32.943463  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:32.943912  1531 raft_consensus.cc:1275] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 11. (term mismatch)
I20260709 13:01:32.944101  1528 raft_consensus.cc:2468] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 10.
I20260709 13:01:32.944348  1531 pending_rounds.cc:85] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting all ops after (but not including) 10
I20260709 13:01:32.945048  1531 pending_rounds.cc:107] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting uncommitted NO_OP operation due to leader change: 16.11
I20260709 13:01:32.945305  1531 raft_consensus.cc:2889] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:32.946463  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:32.947167  1532 raft_consensus.cc:2468] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 17.
I20260709 13:01:32.919217  7146 raft_consensus.cc:493] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:32.953567  1529 raft_consensus.cc:2468] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 14.
I20260709 13:01:32.953138  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:32.965247  1527 raft_consensus.cc:2376] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 13. Re-sending same reply.
I20260709 13:01:32.935447  7625 consensus_queue.cc:1048] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 13:01:32.945598  7613 raft_consensus.cc:493] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:32.958513  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
W20260709 13:01:32.966900  1644 leader_election.cc:336] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.553s (SENT)
I20260709 13:01:32.970497  1673 raft_consensus.cc:3060] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:32.967530  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:32.972914  1529 raft_consensus.cc:2393] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 13: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:01:32.954416  7146 raft_consensus.cc:3060] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:32.975771  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:32.977280  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:32.980491  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:32.981164  1527 raft_consensus.cc:2376] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 18. Re-sending same reply.
W20260709 13:01:32.983853  1644 leader_election.cc:336] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.666s (SENT)
I20260709 13:01:32.988126  7709 consensus_queue.cc:1048] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:01:32.991017  1599 raft_consensus.cc:1275] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 11. (term mismatch)
I20260709 13:01:32.991528  1599 pending_rounds.cc:85] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642: Aborting all ops after (but not including) 10
I20260709 13:01:32.991797  1599 pending_rounds.cc:107] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642: Aborting uncommitted NO_OP operation due to leader change: 18.11
I20260709 13:01:32.992014  1599 raft_consensus.cc:2889] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:32.996856  6988 leader_election.cc:290] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:33.000919  1531 raft_consensus.cc:2393] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 17: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:01:32.956854  7626 leader_election.cc:290] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:33.002141  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:33.002580  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:33.007730  1678 raft_consensus.cc:3060] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:33.007207  1528 raft_consensus.cc:2468] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 13.
I20260709 13:01:33.015784  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:32.957077  7544 raft_consensus.cc:515] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:33.024976  1528 raft_consensus.cc:2368] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for earlier term 13. Current term is 14.
I20260709 13:01:33.023875  1678 raft_consensus.cc:2468] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 14.
I20260709 13:01:33.036337  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:32.980168  7613 raft_consensus.cc:515] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:33.037215  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:33.040563  7626 raft_consensus.cc:493] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:33.041142  7626 raft_consensus.cc:515] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:33.043318  7626 leader_election.cc:290] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:33.043835  7674 raft_consensus.cc:493] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:33.044397  7674 raft_consensus.cc:515] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:33.045921  1528 raft_consensus.cc:2393] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 13: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:01:33.050540  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:33.054497  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:33.055269  1523 raft_consensus.cc:2468] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 18.
I20260709 13:01:33.056177  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:33.056731  1523 raft_consensus.cc:3060] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:33.060060  2192 leader_election.cc:304] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
W20260709 13:01:33.058559  7697 log.cc:927] Time spent T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.379s	user 0.003s	sys 0.000s
I20260709 13:01:33.059645  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:33.059130  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:33.063242  1603 leader_election.cc:290] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 16 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:33.063421  1531 raft_consensus.cc:3060] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:33.059165  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:33.061283  2192 leader_election.cc:304] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:01:33.064797  1528 raft_consensus.cc:2393] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 14: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:01:33.065338  2192 leader_election.cc:304] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:01:33.059933  1532 raft_consensus.cc:1275] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:01:33.066056  1673 raft_consensus.cc:2468] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 14.
I20260709 13:01:33.068127  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:33.068753  1600 raft_consensus.cc:2468] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 13.
W20260709 13:01:33.069837  1570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:33.071624  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:33.072232  2226 raft_consensus.cc:2376] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 14. Re-sending same reply.
I20260709 13:01:33.074291  1600 raft_consensus.cc:1275] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 21 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:01:33.061736  7667 raft_consensus.cc:2749] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:01:33.077807  1644 leader_election.cc:336] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.643s (SENT)
I20260709 13:01:33.078277  1644 leader_election.cc:304] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:33.077972  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:33.037177  7645 raft_consensus.cc:493] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:33.075732  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:33.095829  2222 raft_consensus.cc:1275] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:01:33.065640  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:33.084771  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:33.088709  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:33.089444  7547 raft_consensus.cc:493] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:33.090058  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:33.090500  7568 raft_consensus.cc:2804] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:33.117488  7568 raft_consensus.cc:493] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:33.117928  7568 raft_consensus.cc:3060] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:33.118923  7547 raft_consensus.cc:515] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:33.091482  1607 raft_consensus.cc:1275] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:01:33.095136  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:33.122387  2220 raft_consensus.cc:2468] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 20.
I20260709 13:01:33.124107  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:33.124814  2227 raft_consensus.cc:2468] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 13.
I20260709 13:01:33.098335  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
W20260709 13:01:33.126156  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 48391.2us
I20260709 13:01:33.126226  2226 raft_consensus.cc:3055] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:33.126852  2226 raft_consensus.cc:740] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
W20260709 13:01:33.127094  1644 leader_election.cc:336] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.644s (SENT)
I20260709 13:01:33.127530  1644 leader_election.cc:304] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:33.080387  1600 raft_consensus.cc:2468] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 16.
I20260709 13:01:33.100383  1531 raft_consensus.cc:2468] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 18.
I20260709 13:01:33.131013  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:33.101226  1523 raft_consensus.cc:2468] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 16.
I20260709 13:01:33.046525  7674 leader_election.cc:290] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:33.102007  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:33.133056  1527 raft_consensus.cc:2393] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 14: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:01:33.102646  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:33.134583  2225 raft_consensus.cc:2368] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 19. Current term is 20.
I20260709 13:01:33.129813  1525 raft_consensus.cc:2468] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 13.
I20260709 13:01:33.135535  1571 leader_election.cc:304] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:33.103235  1606 raft_consensus.cc:1240] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 19. Current term is 20. Ops: []
I20260709 13:01:33.104130  7613 leader_election.cc:290] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:33.104590  7679 raft_consensus.cc:2804] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:01:33.105221  7721 log.cc:927] Time spent T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.140s	user 0.001s	sys 0.001s
I20260709 13:01:33.106338  7645 raft_consensus.cc:515] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:33.107335  7146 raft_consensus.cc:515] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:33.108549  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:33.109156  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:33.111099  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:33.153134  1524 raft_consensus.cc:2376] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 18. Re-sending same reply.
I20260709 13:01:33.112040  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:33.112418  7704 leader_election.cc:290] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:33.137717  1600 raft_consensus.cc:1240] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:33.138969  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:33.143002  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:33.141577  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 13:01:33.145159  1644 leader_election.cc:336] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.748s (SENT)
I20260709 13:01:33.145818  1531 raft_consensus.cc:1275] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:01:33.155786  1644 leader_election.cc:304] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:33.149276  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:33.152168  2226 consensus_queue.cc:260] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:33.150499  1572 leader_election.cc:304] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:01:33.159415  1532 raft_consensus.cc:2393] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 13: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:01:33.153438  2218 raft_consensus.cc:2376] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 20. Re-sending same reply.
I20260709 13:01:33.132521  7340 raft_consensus.cc:493] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
W20260709 13:01:33.203184  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 45920.7us
I20260709 13:01:33.168210  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:33.170356  1496 leader_election.cc:304] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:33.205353  2226 raft_consensus.cc:3060] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:33.167737  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:33.206190  1524 raft_consensus.cc:1275] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:01:33.142192  7679 raft_consensus.cc:493] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:33.140938  7464 raft_consensus.cc:2804] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:33.141618  7620 raft_consensus.cc:2749] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:33.221122  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:33.221568  1528 raft_consensus.cc:1275] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:01:33.217878  2218 raft_consensus.cc:2468] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 14.
I20260709 13:01:33.222826  2223 raft_consensus.cc:2468] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 11.
I20260709 13:01:33.224532  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:33.169864  1673 raft_consensus.cc:2468] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 14.
I20260709 13:01:33.227152  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:33.170941  1531 raft_consensus.cc:1275] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:01:33.168619  1526 raft_consensus.cc:1275] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
W20260709 13:01:33.217384  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 47134us
I20260709 13:01:33.179986  1572 leader_election.cc:304] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:01:33.223645  7614 raft_consensus.cc:2804] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:33.232570  7614 raft_consensus.cc:697] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:33.233493  7614 consensus_queue.cc:237] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:33.235013  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:33.235805  7645 leader_election.cc:290] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:33.216830  7340 raft_consensus.cc:515] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:33.167300  7674 raft_consensus.cc:493] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:33.237406  7615 raft_consensus.cc:493] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:33.237213  7674 raft_consensus.cc:515] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:33.237920  7615 raft_consensus.cc:515] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:33.226313  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:33.209643  7626 raft_consensus.cc:2804] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:33.239248  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:33.237263  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:33.239393  1529 raft_consensus.cc:2410] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for term 20 because replica has last-logged OpId of term: 19 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 12.
I20260709 13:01:33.244316  1607 raft_consensus.cc:3060] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:33.239204  1532 raft_consensus.cc:2468] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 14.
W20260709 13:01:33.240073  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 60203us
I20260709 13:01:33.251318  1679 raft_consensus.cc:2393] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 13: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:01:33.222353  7679 raft_consensus.cc:3060] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:33.159130  7613 consensus_queue.cc:1048] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.080s
I20260709 13:01:33.261068  2226 raft_consensus.cc:2468] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 16.
I20260709 13:01:33.266121  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 13:01:33.257817  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 52658.5us
I20260709 13:01:33.266819  2226 raft_consensus.cc:2376] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 12. Re-sending same reply.
I20260709 13:01:33.269564  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:33.283087  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:33.283977  1531 raft_consensus.cc:2468] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 13.
I20260709 13:01:33.285391  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:33.286140  1524 raft_consensus.cc:2468] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 19.
I20260709 13:01:33.290405  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:33.291798  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:33.294385  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:33.296123  1528 raft_consensus.cc:1275] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 11. (term mismatch)
I20260709 13:01:33.241701  7464 raft_consensus.cc:697] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 14 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:33.299583  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 13:01:33.300860  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 155740us
W20260709 13:01:33.301695  1644 leader_election.cc:336] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.755s (SENT)
I20260709 13:01:33.301865  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:33.302484  1644 leader_election.cc:304] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:33.252609  7626 raft_consensus.cc:493] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:33.296581  1528 pending_rounds.cc:85] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting all ops after (but not including) 10
I20260709 13:01:33.312007  1528 pending_rounds.cc:107] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting uncommitted NO_OP operation due to leader change: 17.11
I20260709 13:01:33.312307  1528 raft_consensus.cc:2889] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:33.305692  1532 raft_consensus.cc:1240] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:01:33.304925  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:33.313736  1531 raft_consensus.cc:3060] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:01:33.306234  7724 log.cc:927] Time spent T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:01:33.306612  7706 consensus_queue.cc:1048] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.161s
I20260709 13:01:33.320041  2223 raft_consensus.cc:1240] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 19. Current term is 20. Ops: [17.12-19.13]
I20260709 13:01:33.323119  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:33.325038  1532 raft_consensus.cc:2393] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 20: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:01:33.325945  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:33.307181  1497 leader_election.cc:304] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:33.307380  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:33.257820  6988 raft_consensus.cc:493] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:33.251776  7461 raft_consensus.cc:493] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:33.253165  7459 raft_consensus.cc:2804] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:01:33.157431  7516 raft_consensus.cc:2749] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:33.326571  1532 raft_consensus.cc:3060] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:33.296965  7609 raft_consensus.cc:2749] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:01:33.339345  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:01:33.344646  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 98952.2us
I20260709 13:01:33.344815  1497 leader_election.cc:304] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
W20260709 13:01:33.328029  7722 log.cc:927] Time spent T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.323s	user 0.000s	sys 0.001s
I20260709 13:01:33.367456  1523 raft_consensus.cc:1275] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:01:33.348452  7736 raft_consensus.cc:493] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:33.348932  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 209035us
I20260709 13:01:33.351012  7704 raft_consensus.cc:493] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:33.356345  7740 raft_consensus.cc:493] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:33.368409  7326 raft_consensus.cc:2749] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:33.399261  7740 raft_consensus.cc:515] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:33.370210  7674 leader_election.cc:290] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:33.401448  7740 leader_election.cc:290] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:33.321995  7340 leader_election.cc:290] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:33.361586  7615 leader_election.cc:290] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:33.402194  7715 raft_consensus.cc:2749] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:33.321442  7146 leader_election.cc:290] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 16 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:33.337380  7459 raft_consensus.cc:493] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:33.315794  7626 raft_consensus.cc:3060] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:33.340399  1675 raft_consensus.cc:2468] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 18.
W20260709 13:01:33.347086  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 45437.4us
I20260709 13:01:33.372006  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:33.404160  2219 raft_consensus.cc:2468] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 16.
W20260709 13:01:33.404292  1644 leader_election.cc:336] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.868s (SENT)
I20260709 13:01:33.322472  7547 leader_election.cc:290] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:33.375751  1607 raft_consensus.cc:2468] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 14.
I20260709 13:01:33.412124  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:33.414412  1531 raft_consensus.cc:2468] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 16.
I20260709 13:01:33.376858  1532 raft_consensus.cc:2468] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 14.
W20260709 13:01:33.393397  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 48665.6us
W20260709 13:01:33.396111  1495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:33.369284  7736 raft_consensus.cc:515] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:33.323367  7616 leader_election.cc:290] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:01:33.371860  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 104626us
I20260709 13:01:33.404850  1644 leader_election.cc:304] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:33.405107  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:33.407655  7704 raft_consensus.cc:515] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:33.416038  1497 leader_election.cc:304] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:33.403344  7459 raft_consensus.cc:3060] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:33.419373  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:33.425144  2219 raft_consensus.cc:3060] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:33.392314  7618 raft_consensus.cc:2749] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:33.429615  7731 raft_consensus.cc:493] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:33.430526  7736 leader_election.cc:290] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:33.343448  7461 raft_consensus.cc:515] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:33.342893  6988 raft_consensus.cc:515] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:33.427006  7464 consensus_queue.cc:237] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:33.455528  1646 leader_election.cc:304] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:33.434314  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:33.459510  7575 consensus_queue.cc:1048] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:33.443684  7731 raft_consensus.cc:515] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:33.460781  7459 raft_consensus.cc:515] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:33.462212  7731 leader_election.cc:290] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:33.462924  7459 leader_election.cc:290] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 20 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:33.446156  1571 leader_election.cc:304] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:33.468654  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:33.469273  1679 raft_consensus.cc:2468] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 18.
W20260709 13:01:33.449404  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 45157.3us
I20260709 13:01:33.470448  1571 leader_election.cc:304] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:33.454633  2219 raft_consensus.cc:2468] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 12.
I20260709 13:01:33.463740  1524 raft_consensus.cc:2468] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 18.
I20260709 13:01:33.438776  1602 raft_consensus.cc:2468] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 12.
I20260709 13:01:33.431092  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:33.439548  1497 leader_election.cc:304] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:33.473379  1603 raft_consensus.cc:2468] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 12.
I20260709 13:01:33.477802  1604 raft_consensus.cc:2468] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 16.
I20260709 13:01:33.479156  7613 raft_consensus.cc:2804] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:01:33.479602  7613 raft_consensus.cc:493] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:33.479946  7613 raft_consensus.cc:3060] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:01:33.430614  7723 log.cc:927] Time spent T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
W20260709 13:01:33.481431  1644 leader_election.cc:336] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.883s (SENT)
I20260709 13:01:33.482694  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:33.490571  1570 leader_election.cc:304] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:33.479828  6988 leader_election.cc:290] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:33.498471  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:33.495172  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:33.490335  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:33.504535  1600 raft_consensus.cc:2468] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 18.
I20260709 13:01:33.505141  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:33.498447  1604 raft_consensus.cc:2468] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 14.
I20260709 13:01:33.505264  1646 leader_election.cc:304] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:33.505360  2219 raft_consensus.cc:2468] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 13.
I20260709 13:01:33.502882  1570 leader_election.cc:304] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:33.503871  1603 raft_consensus.cc:1275] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:01:33.506883  1532 raft_consensus.cc:2393] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 13: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:01:33.507720  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:33.497666  7459 raft_consensus.cc:2804] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:01:33.509006  7459 raft_consensus.cc:493] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:33.509406  7459 raft_consensus.cc:3060] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:01:33.512408  1644 leader_election.cc:336] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.918s (SENT)
W20260709 13:01:33.513835  1644 leader_election.cc:336] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.979s (SENT)
I20260709 13:01:33.514284  1644 leader_election.cc:304] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:33.449860  7516 raft_consensus.cc:2749] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:33.440112  7699 raft_consensus.cc:2749] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:33.495957  7270 raft_consensus.cc:2804] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:33.519942  1646 leader_election.cc:304] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:33.522015  1570 leader_election.cc:304] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:33.528257  7680 raft_consensus.cc:493] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:33.528923  7680 raft_consensus.cc:515] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:33.517320  7596 raft_consensus.cc:2804] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:33.498512  7737 consensus_queue.cc:1048] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 13:01:33.536897  7716 raft_consensus.cc:2749] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:01:33.539196  7710 raft_consensus.cc:2749] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:33.540036  7609 raft_consensus.cc:2804] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:33.540473  7609 raft_consensus.cc:493] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:33.540834  7609 raft_consensus.cc:3060] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:33.544603  1644 leader_election.cc:304] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:33.544834  2219 raft_consensus.cc:2468] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 18.
I20260709 13:01:33.546048  1570 leader_election.cc:304] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:33.503738  7618 raft_consensus.cc:493] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:33.549232  7616 raft_consensus.cc:2749] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:33.555989  7596 raft_consensus.cc:697] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 12 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:33.556387  7568 raft_consensus.cc:515] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:33.558635  2224 raft_consensus.cc:2368] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 12. Current term is 13.
I20260709 13:01:33.527204  7270 raft_consensus.cc:493] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:33.524042  7704 leader_election.cc:290] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:33.526281  7632 raft_consensus.cc:2749] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:33.525938  7736 raft_consensus.cc:493] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:33.547665  7625 raft_consensus.cc:2749] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:01:33.569221  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 64632.2us
I20260709 13:01:33.573669  7736 raft_consensus.cc:515] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:33.547516  7731 raft_consensus.cc:493] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:33.575789  1644 leader_election.cc:304] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:01:33.577998  1497 leader_election.cc:304] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:33.584744  1497 leader_election.cc:400] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 19 election: Vote denied by peer b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373) with higher term. Message: Invalid argument: T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 19. Current term is 20.
I20260709 13:01:33.567425  7270 raft_consensus.cc:3060] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:33.593568   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:33.569948  7706 raft_consensus.cc:2804] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:01:33.597760  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 51795.6us
I20260709 13:01:33.558825  7618 raft_consensus.cc:515] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:33.608933  1570 leader_election.cc:304] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:33.585536  7568 leader_election.cc:290] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 13 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:33.586278  7716 raft_consensus.cc:2749] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:33.591266  7323 raft_consensus.cc:2804] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:01:33.612685  1644 leader_election.cc:304] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:01:33.628122  2190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:33.645920  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 61301.6us
I20260709 13:01:33.586836  7620 consensus_queue.cc:1048] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.060s
I20260709 13:01:33.608155  7707 raft_consensus.cc:2804] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:01:33.605464  7706 raft_consensus.cc:493] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:33.591095  7731 raft_consensus.cc:515] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:33.664958  7713 raft_consensus.cc:3060] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:33.614607  7679 raft_consensus.cc:515] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:33.649456  7625 raft_consensus.cc:2749] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:33.668851  1570 leader_election.cc:304] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
W20260709 13:01:33.686386  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 76858.8us
W20260709 13:01:33.687568  7738 log.cc:927] Time spent T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:01:33.691391  7544 leader_election.cc:290] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:33.692451  7618 leader_election.cc:290] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:33.694551  1525 raft_consensus.cc:1275] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 13. (term mismatch)
I20260709 13:01:33.695003  1525 pending_rounds.cc:85] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting all ops after (but not including) 12
I20260709 13:01:33.695118  7731 leader_election.cc:290] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:33.696580  7461 leader_election.cc:290] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:33.698398  1497 leader_election.cc:304] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:33.698814  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:33.669755  7596 consensus_queue.cc:237] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:33.699448  1599 raft_consensus.cc:2468] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 12.
I20260709 13:01:33.696208  1673 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91"
dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
mode: GRACEFUL
new_leader_uuid: "39a92f5a4352465d8af3af5908fe8642"
 from {username='slave'} at 127.0.0.1:33616
I20260709 13:01:33.700558  1673 raft_consensus.cc:606] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 16 LEADER]: Received request to transfer leadership to TS 39a92f5a4352465d8af3af5908fe8642
I20260709 13:01:33.694816  7680 leader_election.cc:290] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:33.703436  7624 consensus_queue.cc:1048] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:33.704948  2221 raft_consensus.cc:2368] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 15. Current term is 16.
I20260709 13:01:33.708531  7616 raft_consensus.cc:2804] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:33.674813  7707 raft_consensus.cc:697] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 18 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:33.711440  1497 leader_election.cc:304] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:33.668480  7706 raft_consensus.cc:3060] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:33.713366  1497 leader_election.cc:304] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:33.714116  7716 raft_consensus.cc:2749] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:33.714807  7716 raft_consensus.cc:2764] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:01:33.715487  7716 raft_consensus.cc:2749] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:33.716406  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:33.711155  7707 consensus_queue.cc:237] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:33.719137  1525 pending_rounds.cc:107] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting uncommitted NO_OP operation due to leader change: 19.13
I20260709 13:01:33.720273  1525 raft_consensus.cc:2889] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:33.721757  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:33.722204  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:33.642246  7626 raft_consensus.cc:515] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:33.722836  1606 raft_consensus.cc:3060] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:33.723568  7270 raft_consensus.cc:515] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:33.724498  7626 leader_election.cc:290] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:33.725104  1602 raft_consensus.cc:2468] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 13.
I20260709 13:01:33.725986  7270 leader_election.cc:290] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 17 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:33.726760  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:33.726976  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:33.727944  1677 raft_consensus.cc:1275] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:01:33.728245  1679 raft_consensus.cc:2368] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b for earlier term 16. Current term is 17.
I20260709 13:01:33.727813  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:33.729275  1603 raft_consensus.cc:3060] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:33.730698  1644 leader_election.cc:304] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:01:33.735312  1606 raft_consensus.cc:2468] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 13.
I20260709 13:01:33.735354  2191 leader_election.cc:304] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:33.736717  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:33.738485  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:33.739257  1606 raft_consensus.cc:2468] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 18.
I20260709 13:01:33.742866  1644 leader_election.cc:304] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:33.746592  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:33.666369  7704 consensus_queue.cc:1048] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.055s
I20260709 13:01:33.751089  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:33.755653  1679 raft_consensus.cc:2393] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 18: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:01:33.757102  1644 leader_election.cc:304] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:33.710274  7736 leader_election.cc:290] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:33.754462  2192 leader_election.cc:304] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:01:33.769673  2192 leader_election.cc:304] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:01:33.770990  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:33.769191  2191 leader_election.cc:304] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:33.772961  7340 raft_consensus.cc:2749] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:33.773777  7713 raft_consensus.cc:2749] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:33.773603  7740 consensus_queue.cc:1048] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:01:33.762154  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:33.767204  1497 leader_election.cc:304] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:33.774673  2227 raft_consensus.cc:2468] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 11.
I20260709 13:01:33.775561  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:33.776077  2227 raft_consensus.cc:3060] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:33.776966  2191 leader_election.cc:400] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 16 election: Vote denied by peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217) with higher term. Message: Invalid argument: T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b for earlier term 16. Current term is 17.
I20260709 13:01:33.777328  2191 leader_election.cc:403] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:01:33.778103  1497 leader_election.cc:304] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:33.782047  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:33.780467  1497 leader_election.cc:304] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:33.783977  1646 leader_election.cc:304] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:33.784000  2192 leader_election.cc:304] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:01:33.782258  7699 raft_consensus.cc:2749] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:33.786415  7667 raft_consensus.cc:2804] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:33.786898  7667 raft_consensus.cc:493] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:33.787249  7667 raft_consensus.cc:3060] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:33.781988  7146 raft_consensus.cc:2804] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:33.788412  7146 raft_consensus.cc:493] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:33.788760  7146 raft_consensus.cc:3060] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:33.710250  7459 raft_consensus.cc:515] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:33.779276  7708 consensus_queue.cc:1048] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 13:01:33.792589  7708 raft_consensus.cc:2804] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:33.793004  7708 raft_consensus.cc:493] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:33.793330  7708 raft_consensus.cc:3060] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:33.778880  7674 raft_consensus.cc:2804] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:01:33.794907  7674 raft_consensus.cc:493] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:33.795284  7674 raft_consensus.cc:3060] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:33.796034  1599 raft_consensus.cc:2368] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b for earlier term 18. Current term is 19.
I20260709 13:01:33.783226  1677 raft_consensus.cc:2468] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 18.
I20260709 13:01:33.796943  7679 leader_election.cc:290] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 16 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:33.797894  7323 raft_consensus.cc:493] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:33.798233  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:33.799410  7618 raft_consensus.cc:2749] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:33.800753  2221 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751"
dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
mode: GRACEFUL
new_leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:47682
I20260709 13:01:33.801421  2221 raft_consensus.cc:606] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Received request to transfer leadership to TS e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:33.801802  2221 raft_consensus.cc:614] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:33.803433  2226 raft_consensus.cc:1240] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:33.748860  7645 raft_consensus.cc:2804] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:33.804137  7645 raft_consensus.cc:493] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:33.804504  7645 raft_consensus.cc:3060] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:33.810796  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:33.782806  7270 raft_consensus.cc:2749] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:33.782562  7716 raft_consensus.cc:2749] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:33.813767  7737 raft_consensus.cc:493] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:33.798357  7323 raft_consensus.cc:3060] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:33.818406  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:33.819166  7609 raft_consensus.cc:515] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:33.820310  1675 raft_consensus.cc:2368] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 13. Current term is 14.
I20260709 13:01:33.823786  7708 raft_consensus.cc:515] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:33.824378  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:33.826800  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:33.827502  2220 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29"
dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
mode: GRACEFUL
new_leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:47682
I20260709 13:01:33.882817  7708 leader_election.cc:290] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:33.882930  2220 raft_consensus.cc:606] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 13 LEADER]: Received request to transfer leadership to TS e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:33.828250  1571 leader_election.cc:400] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 election: Vote denied by peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217) with higher term. Message: Invalid argument: T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 13. Current term is 14.
I20260709 13:01:33.884167  1571 leader_election.cc:403] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
W20260709 13:01:33.884709  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 56604.6us
I20260709 13:01:33.884821  7440 raft_consensus.cc:3060] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:33.829276  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:33.888763  1672 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3"
dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
mode: GRACEFUL
new_leader_uuid: "39a92f5a4352465d8af3af5908fe8642"
 from {username='slave'} at 127.0.0.1:33616
I20260709 13:01:33.889322  1672 raft_consensus.cc:606] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Received request to transfer leadership to TS 39a92f5a4352465d8af3af5908fe8642
I20260709 13:01:33.889614  1672 raft_consensus.cc:614] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:33.892362  7440 raft_consensus.cc:2749] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217) with higher term. Message: Invalid argument: T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 13. Current term is 14.
I20260709 13:01:33.893302  1679 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866"
dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
mode: GRACEFUL
new_leader_uuid: "39a92f5a4352465d8af3af5908fe8642"
 from {username='slave'} at 127.0.0.1:33616
I20260709 13:01:33.829660  1644 leader_election.cc:304] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:33.829433  7706 raft_consensus.cc:515] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:33.896132  7706 leader_election.cc:290] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:33.830040  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 13:01:33.830173  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 44490.5us
I20260709 13:01:33.897413  1674 raft_consensus.cc:1240] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:33.898036  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:33.834566  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:33.835343  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:33.900574  1646 leader_election.cc:304] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:33.824288  7459 leader_election.cc:290] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 19 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:33.814159  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:33.836457  1675 raft_consensus.cc:1275] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:01:33.837164  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:01:33.902335  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 72733us
I20260709 13:01:33.902953  2227 raft_consensus.cc:2468] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 17.
W20260709 13:01:33.843209  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 59299.4us
I20260709 13:01:33.903802  2192 leader_election.cc:304] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:01:33.904402  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:33.904630  2192 leader_election.cc:304] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:01:33.835299  1530 raft_consensus.cc:1275] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:01:33.846439  1603 raft_consensus.cc:2468] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 17.
I20260709 13:01:33.905544  1599 raft_consensus.cc:3060] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:33.849144  2218 raft_consensus.cc:1240] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 12. Current term is 13. Ops: []
W20260709 13:01:33.838587  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 60175.7us
I20260709 13:01:33.850608  7733 raft_consensus.cc:2804] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:33.814249  7737 raft_consensus.cc:515] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:33.851691  7613 raft_consensus.cc:515] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:33.852216  7146 raft_consensus.cc:515] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:33.856000  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
W20260709 13:01:33.859019  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 78635.7us
I20260709 13:01:33.868873  7419 raft_consensus.cc:2749] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:33.857805  7645 raft_consensus.cc:515] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:33.824282  7609 leader_election.cc:290] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:33.877687  7323 raft_consensus.cc:515] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:33.880667  7667 raft_consensus.cc:515] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:33.901578  1678 raft_consensus.cc:3060] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:33.905020  1680 raft_consensus.cc:2368] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b for earlier term 12. Current term is 13.
I20260709 13:01:33.850953  7674 raft_consensus.cc:515] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:33.916880  1602 raft_consensus.cc:2468] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 14.
I20260709 13:01:33.919719  2192 leader_election.cc:304] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
W20260709 13:01:34.061689  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 142079us
I20260709 13:01:34.062578  2192 leader_election.cc:400] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 18 pre-election: Vote denied by peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303) with higher term. Message: Invalid argument: T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b for earlier term 18. Current term is 19.
I20260709 13:01:34.062911  2192 leader_election.cc:403] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:33.926146  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:33.921183  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:34.063810  2218 raft_consensus.cc:3060] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:33.930830  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:33.931988  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:33.932722  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:33.934428  1644 leader_election.cc:304] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:33.934954  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:33.934262  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:33.948549  2190 leader_election.cc:304] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:33.908982  7733 raft_consensus.cc:493] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:33.904119  7616 raft_consensus.cc:697] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 16 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:33.951103  7270 raft_consensus.cc:2804] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:01:34.015951  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 106818us
I20260709 13:01:33.949430  7340 raft_consensus.cc:2804] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:01:34.048039  1599 raft_consensus.cc:2468] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 13.
I20260709 13:01:33.927691  7459 consensus_queue.cc:1048] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.139s
I20260709 13:01:33.907807  7740 raft_consensus.cc:2749] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217) with higher term. Message: Invalid argument: T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b for earlier term 16. Current term is 17.
I20260709 13:01:34.050154  1606 raft_consensus.cc:2393] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 19: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:01:34.050575  7613 leader_election.cc:290] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 19 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:33.933607  7708 raft_consensus.cc:2804] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:01:33.949463  7735 consensus_queue.cc:1059] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:33.949564  7706 consensus_queue.cc:1048] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:34.052202  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:34.052178  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:33.971383  7736 raft_consensus.cc:2804] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:34.141355  7616 consensus_queue.cc:237] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:34.054236  2227 raft_consensus.cc:1240] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:34.065547  2226 raft_consensus.cc:2468] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 17.
W20260709 13:01:34.066004  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 117544us
I20260709 13:01:34.066007  1678 raft_consensus.cc:2468] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 19.
W20260709 13:01:34.068074  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 133730us
I20260709 13:01:34.074779  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:34.149688  2218 raft_consensus.cc:2468] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 14.
I20260709 13:01:34.067584  7564 raft_consensus.cc:2749] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:34.087581  2225 raft_consensus.cc:3060] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:34.090051  1681 raft_consensus.cc:1240] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 18. Current term is 19. Ops: []
I20260709 13:01:34.096171  2224 raft_consensus.cc:2468] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 20.
I20260709 13:01:34.098577  2191 leader_election.cc:400] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 pre-election: Vote denied by peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217) with higher term. Message: Invalid argument: T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b for earlier term 12. Current term is 13.
W20260709 13:01:34.163897  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 65454.2us
I20260709 13:01:34.099050  1679 raft_consensus.cc:606] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 18 LEADER]: Received request to transfer leadership to TS 39a92f5a4352465d8af3af5908fe8642
I20260709 13:01:34.125098  7737 leader_election.cc:290] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:34.126884  7739 raft_consensus.cc:2749] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:34.071810  7733 raft_consensus.cc:3060] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:34.136488  7667 leader_election.cc:290] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:34.138876  7735 raft_consensus.cc:3055] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:34.139367  7674 leader_election.cc:290] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 19 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:34.086089  7340 raft_consensus.cc:493] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:34.086935  7618 raft_consensus.cc:2749] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:34.141867  7736 raft_consensus.cc:697] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 13 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:34.149734  1600 raft_consensus.cc:3060] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:34.086987  1677 raft_consensus.cc:1240] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 12 LEADER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 11. Current term is 12. Ops: []
W20260709 13:01:34.064657  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 122435us
I20260709 13:01:34.160221  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:34.179544  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:34.180483  1572 leader_election.cc:304] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:01:34.211155  1672 raft_consensus.cc:2368] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b for earlier term 12. Current term is 13.
I20260709 13:01:34.097168  7464 raft_consensus.cc:493] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:34.183053  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:34.214115  1530 raft_consensus.cc:3060] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:34.097599  7708 raft_consensus.cc:493] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:34.194468  1571 leader_election.cc:304] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:34.159310  7679 raft_consensus.cc:3060] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Advancing to term 19
W20260709 13:01:34.206543  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 55810.4us
I20260709 13:01:34.194231  7735 raft_consensus.cc:740] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:34.225397  1497 leader_election.cc:304] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:34.238095  1600 raft_consensus.cc:2468] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 16.
I20260709 13:01:34.240000  2225 raft_consensus.cc:2468] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 13.
I20260709 13:01:34.242479  2191 leader_election.cc:400] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 election: Vote denied by peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217) with higher term. Message: Invalid argument: T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b for earlier term 12. Current term is 13.
I20260709 13:01:34.243036  2191 leader_election.cc:403] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:01:34.208375  7340 raft_consensus.cc:3060] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:34.179378  7575 consensus_queue.cc:1048] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 13:01:34.177702  7680 consensus_queue.cc:1048] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.058s
I20260709 13:01:34.253942  1644 leader_election.cc:304] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:34.219069  7460 raft_consensus.cc:2804] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:01:34.222213  7708 raft_consensus.cc:3060] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:34.264454  7146 leader_election.cc:290] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 13 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:34.265218  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:34.280438  1672 raft_consensus.cc:3060] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:34.214702  7707 consensus_queue.cc:1048] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 13:01:34.283217  7736 consensus_queue.cc:237] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:34.265542  7752 log.cc:927] Time spent T 00000000000000000000000000000000 P 9f38d0e5c9db43a48554defe1153354e: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:01:34.266510  7735 consensus_queue.cc:260] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:34.258886  7547 raft_consensus.cc:2749] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217) with higher term. Message: Invalid argument: T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b for earlier term 12. Current term is 13.
I20260709 13:01:34.262715  7618 consensus_queue.cc:1048] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.013s
I20260709 13:01:34.245103  7461 consensus_queue.cc:1048] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 13:01:34.258147  7737 raft_consensus.cc:2749] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:01:34.164113  7596 consensus_queue.cc:1048] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.055s
I20260709 13:01:34.251258  7626 raft_consensus.cc:2804] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:01:34.291720  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:34.295799  7460 raft_consensus.cc:697] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 20 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:34.221822  7464 raft_consensus.cc:515] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:34.308486  7733 raft_consensus.cc:515] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:34.311228  7323 leader_election.cc:290] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 20 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:34.328361  1530 raft_consensus.cc:2468] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 15.
I20260709 13:01:34.296105  1672 raft_consensus.cc:2468] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 15.
W20260709 13:01:34.332563  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 248903us
W20260709 13:01:34.333385  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 243552us
I20260709 13:01:34.335875  2191 leader_election.cc:304] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:34.303578  7626 raft_consensus.cc:697] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 19 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:34.345709  2219 raft_consensus.cc:1240] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 14. Current term is 15. Ops: []
W20260709 13:01:34.371951  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 146659us
I20260709 13:01:34.373952  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:34.347759  7547 raft_consensus.cc:2804] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:34.383430  1646 leader_election.cc:304] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:34.340713  7270 raft_consensus.cc:697] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 13 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:34.386087  1646 leader_election.cc:304] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:34.386472  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:34.389551  2227 raft_consensus.cc:1240] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:34.452731  1524 raft_consensus.cc:2393] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 20: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
W20260709 13:01:34.453150  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 61721.6us
W20260709 13:01:34.452801  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 66793.6us
I20260709 13:01:34.454218  1646 leader_election.cc:304] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:34.472453  1527 raft_consensus.cc:1275] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:01:34.568264  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:34.568991  1523 raft_consensus.cc:3060] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:01:34.577898  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 123742us
I20260709 13:01:34.452512  7706 raft_consensus.cc:2749] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:34.464263  7760 raft_consensus.cc:2804] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:34.455967  7763 raft_consensus.cc:2804] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:34.627161  1646 leader_election.cc:304] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
W20260709 13:01:34.633118  2192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:34.567838  7616 raft_consensus.cc:493] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:34.603421  7595 raft_consensus.cc:2804] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:34.604111  7624 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:34.619900  7699 raft_consensus.cc:493] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:34.567793  7596 consensus_queue.cc:1048] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.067s
I20260709 13:01:34.665277  1523 raft_consensus.cc:2468] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 19.
I20260709 13:01:34.457198  7460 consensus_queue.cc:237] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:34.592479  7626 consensus_queue.cc:237] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:34.656567  7765 raft_consensus.cc:493] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:34.664299  7760 raft_consensus.cc:697] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 14 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:34.674619  7773 raft_consensus.cc:493] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:34.646842  7616 raft_consensus.cc:515] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:34.674515  7707 raft_consensus.cc:2749] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:34.679338  7461 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:34.662500  7772 raft_consensus.cc:493] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:34.693708  6988 raft_consensus.cc:493] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:34.827636  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
W20260709 13:01:34.845166  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 218106us
I20260709 13:01:34.661026  7699 raft_consensus.cc:515] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:34.681658  7419 raft_consensus.cc:493] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:34.660151  7624 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:34.869691  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:34.875892  1603 raft_consensus.cc:1240] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 19. Current term is 20. Ops: []
I20260709 13:01:34.843008  7733 leader_election.cc:290] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:34.671761  7270 consensus_queue.cc:237] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 12.13, Last appended by leader: 13, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:34.883978  7464 leader_election.cc:290] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:01:34.916328  7769 log.cc:927] Time spent T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.265s	user 0.000s	sys 0.001s
I20260709 13:01:34.892587  7419 raft_consensus.cc:515] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:34.920717  7419 leader_election.cc:290] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:34.921329  7419 raft_consensus.cc:493] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:34.921818  7419 raft_consensus.cc:515] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:34.933842  7340 consensus_meta.cc:287] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b: Time spent flushing consensus metadata: real 0.649s	user 0.009s	sys 0.001s
I20260709 13:01:34.934597  7340 raft_consensus.cc:515] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:34.697770  7765 raft_consensus.cc:515] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:34.908655  7755 log.cc:927] Time spent T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.522s	user 0.001s	sys 0.001s
I20260709 13:01:34.955339  1523 raft_consensus.cc:3055] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:34.955884  1523 raft_consensus.cc:740] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:34.875473  6988 raft_consensus.cc:515] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:34.956740  1523 consensus_queue.cc:260] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:34.842417  7773 raft_consensus.cc:515] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:34.968943  1523 raft_consensus.cc:3060] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:34.871649  7461 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:34.915315  7595 raft_consensus.cc:697] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 13 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
W20260709 13:01:34.961623  7770 log.cc:927] Time spent T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.296s	user 0.000s	sys 0.004s
W20260709 13:01:34.961424  7771 log.cc:927] Time spent T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.092s	user 0.003s	sys 0.001s
I20260709 13:01:34.982596  1523 raft_consensus.cc:1275] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 12. (term mismatch)
I20260709 13:01:34.983647  1523 pending_rounds.cc:85] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting all ops after (but not including) 11
I20260709 13:01:34.984038  1523 pending_rounds.cc:107] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting uncommitted NO_OP operation due to leader change: 12.12
I20260709 13:01:34.984390  1523 raft_consensus.cc:2889] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:34.867612  7772 raft_consensus.cc:515] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:34.989109  7340 leader_election.cc:290] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 19 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:01:34.994058  1495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:34.999393  7679 consensus_meta.cc:287] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b: Time spent flushing consensus metadata: real 0.756s	user 0.009s	sys 0.002s
W20260709 13:01:35.008556  7757 log.cc:927] Time spent T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.742s	user 0.014s	sys 0.019s
I20260709 13:01:35.026508  7679 raft_consensus.cc:2749] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303) with higher term. Message: Invalid argument: T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b for earlier term 18. Current term is 19.
I20260709 13:01:34.964885  7760 consensus_queue.cc:237] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 12.13, Last appended by leader: 13, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:35.027671  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36194 (request call id 2173) took 1211 ms. Trace:
I20260709 13:01:35.028036  1607 rpcz_store.cc:276] 0709 13:01:33.816046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.816710 (+   664us) service_pool.cc:224] Handling call
0709 13:01:33.819477 (+  2767us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:33.819825 (+   348us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:33.819852 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:33.820320 (+   468us) log.cc:844] Serialized 26 byte log entry
0709 13:01:34.096853 (+276533us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:34.096898 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:34.096970 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:35.007791 (+910821us) spinlock_profiling.cc:243] Waited 18.1 ms on lock 0x7b4400022b4c. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a153ecc85 00007f6a153ed6a2 00007f6a1815f1db 00007f6a1815aaaf 00007f6a1814e86e 00007f6a1814dbb6 00007f6a1814d7d8 00007f6a18157221 00007f6a181571d9 00007f6a18157169
0709 13:01:35.027352 (+ 19561us) raft_consensus.cc:1685] finished
0709 13:01:35.027374 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:35.027579 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1870,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":81,"spinlock_wait_cycles":41654016,"thread_start_us":276119,"threads_started":1,"wal-append.queue_time_us":403615}
I20260709 13:01:35.010041  1679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:33616 (request call id 36) took 1117 ms. Trace:
I20260709 13:01:35.029930  1679 rpcz_store.cc:276] 0709 13:01:33.892852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.893171 (+   319us) service_pool.cc:224] Handling call
0709 13:01:35.009825 (+1116654us) spinlock_profiling.cc:243] Waited 205 ms on lock 0x7b540017a554. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185ad853 00007f6a1d57b60a 00007f6a16b017d4 00007f6a16b01762 00007f6a16b01691 00007f6a16b0160c 00007f6a16b008c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:01:35.009943 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":471780096}
I20260709 13:01:35.030371  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 13:01:35.012432  7708 consensus_meta.cc:287] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.735s	user 0.010s	sys 0.000s
I20260709 13:01:35.031394  7708 raft_consensus.cc:515] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:35.032474  7461 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:35.033030  7609 raft_consensus.cc:993] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90: : Instructing follower 39a92f5a4352465d8af3af5908fe8642 to start an election
I20260709 13:01:35.015556  7624 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:35.017382  6988 leader_election.cc:290] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:01:35.018674  7754 log.cc:927] Time spent T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.751s	user 0.014s	sys 0.009s
I20260709 13:01:35.018043  7595 consensus_queue.cc:237] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:35.036358  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:01:35.037882  7764 log.cc:927] Time spent T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.348s	user 0.004s	sys 0.000s
W20260709 13:01:35.019469  7762 log.cc:927] Time spent T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.348s	user 0.001s	sys 0.002s
I20260709 13:01:35.038870   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:01:35.040244  1674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50664 (request call id 1512) took 1103 ms. Trace:
I20260709 13:01:35.021108  7773 leader_election.cc:290] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:35.022718  7699 leader_election.cc:290] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:35.023869  7616 leader_election.cc:290] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:35.025187  7765 leader_election.cc:290] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:35.040598  1674 rpcz_store.cc:276] 0709 13:01:33.936735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.937017 (+   282us) service_pool.cc:224] Handling call
0709 13:01:33.937327 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:34.047166 (+109839us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:34.047201 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:34.061960 (+ 14759us) log.cc:844] Serialized 26 byte log entry
0709 13:01:34.393117 (+331157us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:34.393165 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:34.393256 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:34.990260 (+597004us) spinlock_profiling.cc:243] Waited 2.17 ms on lock 0x7b4400022b4c. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a153ecc85 00007f6a153ed6a2 00007f6a1815f1db 00007f6a1815aaaf 00007f6a1814e86e 00007f6a1814dbb6 00007f6a1814d7d8 00007f6a18157221 00007f6a181571d9 00007f6a18157169
0709 13:01:35.039964 (+ 49704us) raft_consensus.cc:1685] finished
0709 13:01:35.039984 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:35.040186 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":109384,"raft.queue_time_us":111958,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":87,"spinlock_wait_cycles":4994944,"thread_start_us":293795,"threads_started":1,"wal-append.queue_time_us":550859}
I20260709 13:01:35.036238  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:35.031333  1523 raft_consensus.cc:2393] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 13: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:01:35.048970  1673 raft_consensus.cc:2393] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 19: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:01:35.052588  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:35.053326  1525 raft_consensus.cc:2376] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 16. Re-sending same reply.
W20260709 13:01:35.017570  7758 log.cc:927] Time spent T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.754s	user 0.012s	sys 0.034s
I20260709 13:01:35.033571  7609 raft_consensus.cc:1081] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 16 LEADER]: Signalling peer 39a92f5a4352465d8af3af5908fe8642 to start an election
I20260709 13:01:35.033595  7708 leader_election.cc:290] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 19 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:35.061858  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:35.047081  7739 raft_consensus.cc:493] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:35.044948  6988 raft_consensus.cc:493] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:35.071806  1526 raft_consensus.cc:3055] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:35.072232  1526 raft_consensus.cc:740] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
W20260709 13:01:35.076213  7781 log.cc:927] Time spent T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 13:01:35.076149  1677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49178 (request call id 2500) took 1253 ms. Trace:
I20260709 13:01:35.080771  1677 rpcz_store.cc:276] 0709 13:01:33.823095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.837411 (+ 14316us) service_pool.cc:224] Handling call
0709 13:01:33.837683 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:34.214969 (+377286us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:35.075897 (+860928us) spinlock_profiling.cc:243] Waited 247 ms on lock 0x7b54003e6554. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:01:35.076089 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":567720320}
I20260709 13:01:35.072922  1526 consensus_queue.cc:260] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:35.082228  1526 raft_consensus.cc:3060] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:35.087507  7767 log.cc:927] Time spent T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.507s	user 0.000s	sys 0.003s
W20260709 13:01:35.092386  7751 log.cc:927] Time spent T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.824s	user 0.014s	sys 0.017s
I20260709 13:01:35.095454  7632 raft_consensus.cc:493] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:35.096154  7632 raft_consensus.cc:515] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:35.101040  7624 raft_consensus.cc:493] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:35.101686  7624 raft_consensus.cc:515] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:35.102574  7464 raft_consensus.cc:493] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:35.103143  7464 raft_consensus.cc:515] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:35.104288  7655 raft_consensus.cc:493] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:35.104815  7655 raft_consensus.cc:515] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:35.105180  7464 leader_election.cc:290] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:35.107036  7655 leader_election.cc:290] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:35.073343  7739 raft_consensus.cc:515] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:35.103955  2219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 1183) took 1171 ms. Trace:
I20260709 13:01:35.107911  2219 rpcz_store.cc:276] 0709 13:01:33.932478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:34.069046 (+136568us) service_pool.cc:224] Handling call
0709 13:01:34.069385 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:34.346296 (+276911us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:35.103687 (+757391us) spinlock_profiling.cc:243] Waited 276 ms on lock 0x7b5400600254. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:01:35.103893 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":635053824}
I20260709 13:01:35.109328  7739 leader_election.cc:290] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:35.103914  7624 leader_election.cc:290] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:35.074016  6988 raft_consensus.cc:515] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:35.111094  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:35.112779  6988 leader_election.cc:290] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:35.113655  7419 leader_election.cc:290] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:35.119481  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:35.120262  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:35.119572  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:35.121778  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:35.128023  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:35.145177  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49170 (request call id 2838) took 1094 ms. Trace:
I20260709 13:01:35.145610  1681 rpcz_store.cc:276] 0709 13:01:34.051147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:34.051552 (+   405us) service_pool.cc:224] Handling call
0709 13:01:34.053460 (+  1908us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:34.162513 (+109053us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:35.144955 (+982442us) spinlock_profiling.cc:243] Waited 36.4 ms on lock 0x7b54000cdfd4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:01:35.145118 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":83740032}
I20260709 13:01:35.106994  7772 leader_election.cc:290] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:35.157660  1497 leader_election.cc:400] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 15 pre-election: Vote denied by peer b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373) with higher term. Message: Invalid argument: T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 15. Current term is 16.
I20260709 13:01:35.158643  1526 raft_consensus.cc:1275] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260709 13:01:35.159186  1526 pending_rounds.cc:85] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting all ops after (but not including) 10
I20260709 13:01:35.159467  1526 pending_rounds.cc:107] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 13:01:35.159755  1526 raft_consensus.cc:2889] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:35.161301  1526 raft_consensus.cc:1240] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 18. Current term is 19. Ops: []
I20260709 13:01:35.132941  7655 raft_consensus.cc:493] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:35.139294  7739 raft_consensus.cc:493] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:35.141776  7547 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.003s	sys 0.019s
I20260709 13:01:35.142110  7624 raft_consensus.cc:493] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:35.175017  7547 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.004s	sys 0.019s
I20260709 13:01:35.183465  7459 raft_consensus.cc:493] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:35.183737  7547 raft_consensus.cc:697] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 15 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:35.184302  7459 raft_consensus.cc:515] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:35.184957  7547 consensus_queue.cc:237] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:35.187553  7667 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:35.188118  7667 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:35.188977  2221 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50310 (request call id 1210) took 1458 ms. Trace:
I20260709 13:01:35.192091  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:35.192750  1531 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 20.
I20260709 13:01:35.193570  7459 leader_election.cc:290] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:35.194142  7667 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:35.195348  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:35.200255  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:35.200377  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:35.201561  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:35.202250  1681 raft_consensus.cc:2468] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 17.
I20260709 13:01:35.199162  7460 consensus_queue.cc:1059] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:35.203605  7625 raft_consensus.cc:3055] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:01:35.204037  7625 raft_consensus.cc:740] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:35.204973  7625 consensus_queue.cc:260] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:35.205988  7625 raft_consensus.cc:3060] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:35.207559  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:35.209031  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:35.209789  2226 raft_consensus.cc:2393] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 19: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:01:35.189342  2221 rpcz_store.cc:276] 0709 13:01:33.730402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.809266 (+ 78864us) service_pool.cc:224] Handling call
0709 13:01:33.809540 (+   274us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:33.810103 (+   563us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:33.810131 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:33.810575 (+   444us) log.cc:844] Serialized 26 byte log entry
0709 13:01:34.098531 (+287956us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:01:34.186058 (+ 87527us) log.cc:844] Serialized 14 byte log entry
0709 13:01:34.211051 (+ 24993us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:34.211121 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:35.022469 (+811348us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b1800206740. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1e38ede1 00007f6a1e39b5b1 00007f6a154c6522 00007f6a154c87c1 00007f6a154c8779 00007f6a154c8709 00007f6a154c86d1 00007f6a154c79cd 000000000038f354 000000000038f199 00007f6a154a983a
0709 13:01:35.186952 (+164483us) spinlock_profiling.cc:243] Waited 2.69 ms on lock 0x7b1800206740. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1e38ede1 00007f6a1e39b5b1 00007f6a154c63f3 00007f6a154c87c1 00007f6a154c8779 00007f6a154c8709 00007f6a154c86d1 00007f6a154c79cd 000000000038f354 000000000038f199 00007f6a154a983a
0709 13:01:35.188775 (+  1823us) raft_consensus.cc:1685] finished
0709 13:01:35.188796 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:35.188921 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24553,"prepare.queue_time_us":105862,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"raft.queue_time_us":32116,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":21517,"spinlock_wait_cycles":31049856,"thread_start_us":284960,"threads_started":1,"wal-append.queue_time_us":441050}
I20260709 13:01:35.213426  1674 raft_consensus.cc:1275] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:01:35.214354   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:35.214986  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:35.203508  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:35.218369  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:35.219318  1600 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91"
dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
 from {username='slave'} at 127.0.0.1:36200
I20260709 13:01:35.219918  1600 raft_consensus.cc:493] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:35.220275  1600 raft_consensus.cc:3060] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:35.228891  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:35.240368  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:35.241290  1681 raft_consensus.cc:2393] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 11: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:01:35.243814  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:35.244535  1604 raft_consensus.cc:3060] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:01:35.249832  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 104554us
I20260709 13:01:35.206027  7632 leader_election.cc:290] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:35.245296  1600 raft_consensus.cc:515] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:35.223341  7763 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.029s	sys 0.014s
I20260709 13:01:35.266254  1602 raft_consensus.cc:1240] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:35.225133  7459 raft_consensus.cc:493] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:35.224496  7784 raft_consensus.cc:493] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:35.270162  1497 leader_election.cc:400] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 pre-election: Vote denied by peer b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373) with higher term. Message: Invalid argument: T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 12. Current term is 13.
I20260709 13:01:35.245301  6988 raft_consensus.cc:493] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:35.279381  1604 raft_consensus.cc:2468] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 19.
I20260709 13:01:35.249519  7460 raft_consensus.cc:493] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
W20260709 13:01:35.270514  7674 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.008s	sys 0.031s
I20260709 13:01:35.174317  7655 raft_consensus.cc:515] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:35.225239  7624 raft_consensus.cc:515] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:35.354866  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 75854.9us
W20260709 13:01:35.355544  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 85541.1us
I20260709 13:01:35.234318  7609 consensus_queue.cc:1059] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 13:01:35.367892  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 21 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:35.217156  7739 raft_consensus.cc:515] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:35.369118  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 13:01:35.347996  7674 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.684s	user 0.008s	sys 0.031s
I20260709 13:01:35.330873  7146 raft_consensus.cc:493] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:35.332862  7783 consensus_queue.cc:1059] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 13:01:35.356941  6988 raft_consensus.cc:515] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:35.299712  7763 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.031s	sys 0.016s
I20260709 13:01:35.335616  7784 raft_consensus.cc:515] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:35.372133  2220 raft_consensus.cc:2468] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 20.
I20260709 13:01:35.354487  7610 raft_consensus.cc:493] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:35.335101  7459 raft_consensus.cc:515] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:35.362056  7460 raft_consensus.cc:515] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:35.465359  7790 raft_consensus.cc:493] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:35.465924  7790 raft_consensus.cc:515] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:35.466691  7460 leader_election.cc:290] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:35.378160  6988 leader_election.cc:290] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:35.382902  7146 raft_consensus.cc:515] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:35.468048  7790 leader_election.cc:290] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:35.468756  7146 leader_election.cc:290] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:01:35.469372  7793 log.cc:927] Time spent T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.090s	user 0.000s	sys 0.005s
I20260709 13:01:35.471061  7459 leader_election.cc:290] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:35.374524  7791 consensus_queue.cc:1059] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 13:01:35.370162  7773 consensus_queue.cc:1059] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
W20260709 13:01:35.354187  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 127566us
I20260709 13:01:35.460035  7626 raft_consensus.cc:493] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:35.461207  7624 leader_election.cc:290] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:35.376724  7783 raft_consensus.cc:3055] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:35.464507  7655 leader_election.cc:290] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:35.470814  7610 raft_consensus.cc:515] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:35.463750  7739 leader_election.cc:290] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:35.475607  7626 raft_consensus.cc:515] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:35.457907  1570 leader_election.cc:304] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:01:35.477569  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 102108us
I20260709 13:01:35.553531  6988 raft_consensus.cc:3055] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:36.233997  6988 raft_consensus.cc:740] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:36.235219  6988 consensus_queue.cc:260] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:36.236486  6988 raft_consensus.cc:3060] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:35.378486  7763 raft_consensus.cc:697] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 17 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:35.577461  7791 raft_consensus.cc:493] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:36.239400  7791 raft_consensus.cc:515] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:36.241739  7791 leader_election.cc:290] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:35.566116  1644 leader_election.cc:304] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:01:36.289899  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 723891us
I20260709 13:01:35.926291  7146 raft_consensus.cc:493] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:36.291138  7146 raft_consensus.cc:515] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:36.293296  7146 leader_election.cc:290] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:01:36.293977  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 836153us
I20260709 13:01:36.242301  7626 leader_election.cc:290] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:35.486696  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:35.482178  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 13:01:35.888433  1525 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.617s	user 0.002s	sys 0.014s
I20260709 13:01:36.239301  7763 consensus_queue.cc:237] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:36.283663  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 45652.4us
I20260709 13:01:36.232729  7783 raft_consensus.cc:740] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
W20260709 13:01:36.296805  1525 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.026s	user 0.004s	sys 0.020s
I20260709 13:01:36.297533  7610 leader_election.cc:290] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:35.485924  7645 leader_election.cc:290] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:35.380442  7784 leader_election.cc:290] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:35.577818  7792 raft_consensus.cc:3055] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:36.309166  6988 raft_consensus.cc:493] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:36.294917  7547 raft_consensus.cc:493] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:36.288662  7460 raft_consensus.cc:493] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:36.309834  6988 raft_consensus.cc:515] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:36.287011  7699 raft_consensus.cc:493] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:36.300490  7620 raft_consensus.cc:2749] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:01:36.328135  6988 leader_election.cc:290] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:36.303921  7791 raft_consensus.cc:493] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:36.310282  7626 raft_consensus.cc:2749] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:01:36.332804  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:36.309480  7792 raft_consensus.cc:740] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:36.331156  7791 raft_consensus.cc:515] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:01:36.336614  1675 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49170 (request call id 2845) took 2017 ms (client timeout 1647 ms). Trace:
W20260709 13:01:36.337020  1675 rpcz_store.cc:269] 0709 13:01:34.316522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:34.316679 (+   157us) service_pool.cc:224] Handling call
0709 13:01:36.332638 (+2015959us) spinlock_profiling.cc:243] Waited 2.62 ms on lock 0x7b5800143798. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a1548eb71 00007f6a1548ea22 00007f6a1e3a7c09 00007f6a1d501ee0 00007f6a1d5cb0ab 00007f6a1d5cb131 00007f6a1d5790a0 00007f6a1d578984 00007f6a16af36d4 00007f6a16af3662
0709 13:01:36.333448 (+   810us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6017792}
I20260709 13:01:36.322371  7547 raft_consensus.cc:515] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:36.326961  7699 raft_consensus.cc:515] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:36.327456  7460 raft_consensus.cc:515] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:36.358083  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 66928.1us
I20260709 13:01:36.366827  7626 raft_consensus.cc:493] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:36.367115  7620 consensus_queue.cc:1048] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:36.349716  7792 consensus_queue.cc:260] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:36.367624  7626 raft_consensus.cc:515] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:36.368888  7792 raft_consensus.cc:3060] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:36.331471  7783 consensus_queue.cc:260] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:36.370528  7626 leader_election.cc:290] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:36.370407  7783 raft_consensus.cc:3060] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:01:36.378465  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 83154.8us
W20260709 13:01:36.380316  7812 log.cc:927] Time spent T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.483s	user 0.000s	sys 0.016s
I20260709 13:01:36.384018  1571 leader_election.cc:304] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
W20260709 13:01:36.385432  7798 log.cc:927] Time spent T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.924s	user 0.000s	sys 0.010s
W20260709 13:01:36.385939  1496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:36.386322  7816 raft_consensus.cc:493] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:36.387466  7791 leader_election.cc:290] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:36.388037  1680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49170 (request call id 2841) took 2243 ms. Trace:
I20260709 13:01:36.389178  1570 leader_election.cc:304] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:36.389663  7699 leader_election.cc:290] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:01:36.390115  7799 log.cc:927] Time spent T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.920s	user 0.013s	sys 0.018s
W20260709 13:01:36.391237  7797 log.cc:927] Time spent T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.928s	user 0.013s	sys 0.013s
I20260709 13:01:36.391425  7547 leader_election.cc:290] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:36.391767  7670 raft_consensus.cc:493] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:36.392045  7645 raft_consensus.cc:493] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:36.393633  7575 raft_consensus.cc:3055] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:01:36.396941  7544 consensus_queue.cc:1048] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 13:01:36.405203  7816 raft_consensus.cc:515] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:36.415468  7620 raft_consensus.cc:493] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:36.398825  1680 rpcz_store.cc:276] 0709 13:01:34.145109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:34.149925 (+  4816us) service_pool.cc:224] Handling call
0709 13:01:34.150280 (+   355us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:34.263176 (+112896us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:34.263207 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:34.263680 (+   473us) log.cc:844] Serialized 26 byte log entry
0709 13:01:34.374002 (+110322us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:34.374041 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:36.387635 (+2013594us) spinlock_profiling.cc:243] Waited 76.3 ms on lock 0x7b54003f5cd4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:01:36.387685 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:36.387731 (+    46us) raft_consensus.cc:1685] finished
0709 13:01:36.387749 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:36.387974 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36143,"raft.queue_time_us":37770,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":81,"spinlock_wait_cycles":175441280,"thread_start_us":73160,"threads_started":1,"wal-append.queue_time_us":287228,"wal-append.run_cpu_time_us":2981,"wal-append.run_wall_time_us":1322966}
I20260709 13:01:36.422811  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:36.425503  1531 raft_consensus.cc:1275] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:01:36.423995  1497 leader_election.cc:304] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
W20260709 13:01:36.429383  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:36.462885  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 102371us
I20260709 13:01:36.467554  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:36.468528  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:36.469074  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:36.469815  1531 raft_consensus.cc:2468] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 17.
W20260709 13:01:36.472429  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 83354.2us
I20260709 13:01:36.471736  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 13:01:36.473587  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 89661.3us
I20260709 13:01:36.475757  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:36.476467  2221 raft_consensus.cc:2468] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 12.
I20260709 13:01:36.476562  1571 leader_election.cc:304] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:36.478927  2221 raft_consensus.cc:1240] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
W20260709 13:01:36.478477  2192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:36.480724  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:36.482084  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:36.482842  2221 raft_consensus.cc:2468] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 18.
I20260709 13:01:36.425681  7791 raft_consensus.cc:493] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:36.486845  2220 raft_consensus.cc:1240] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
W20260709 13:01:36.487463  2192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:36.468230  7812 log.cc:927] Time spent T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:01:36.489665  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:36.500312  2219 raft_consensus.cc:2393] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 15: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:01:36.491644  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:36.494580  2221 raft_consensus.cc:1275] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:01:36.495797  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 13:01:36.467804  7798 log.cc:927] Time spent T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:01:36.487612  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: true dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:36.505332  2227 raft_consensus.cc:3060] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:36.496488  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:36.508926  7780 raft_consensus.cc:493] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:36.509591  7780 raft_consensus.cc:515] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:36.432214  7575 raft_consensus.cc:740] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:36.424723  7614 raft_consensus.cc:493] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:36.527427  7614 raft_consensus.cc:515] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:36.499544  2192 leader_election.cc:304] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:36.554008  7406 raft_consensus.cc:2804] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:36.500851  2225 raft_consensus.cc:2468] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 16.
I20260709 13:01:36.502348  1532 raft_consensus.cc:1275] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:01:36.524019  7575 consensus_queue.cc:260] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:36.554641  7406 raft_consensus.cc:697] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 16 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:36.563899  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:36.577199  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:36.577833  1532 raft_consensus.cc:2468] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 18.
I20260709 13:01:36.564500  7575 raft_consensus.cc:3060] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:36.530490  7614 leader_election.cc:290] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:36.588320  7614 raft_consensus.cc:493] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:36.588955  7614 raft_consensus.cc:515] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:01:36.596550  1496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:36.598882  7780 leader_election.cc:290] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:36.610294  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:36.611207  1532 raft_consensus.cc:2468] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 12.
I20260709 13:01:36.621932  7614 leader_election.cc:290] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:36.622905  7614 raft_consensus.cc:493] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:36.403240  7819 consensus_queue.cc:1059] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.091s
I20260709 13:01:36.467809  7817 raft_consensus.cc:2749] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:36.479028  7699 raft_consensus.cc:493] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:36.657829  1525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43010 (request call id 2709) took 1513 ms. Trace:
I20260709 13:01:36.461989  7645 raft_consensus.cc:515] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:36.498992  7626 raft_consensus.cc:493] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:36.504801  7765 raft_consensus.cc:493] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:36.662405  1525 rpcz_store.cc:276] 0709 13:01:35.145001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:35.172729 (+ 27728us) service_pool.cc:224] Handling call
0709 13:01:35.233761 (+ 61032us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:35.243009 (+  9248us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:01:36.300897 (+1057888us) log.cc:844] Serialized 14 byte log entry
0709 13:01:36.355189 (+ 54292us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:36.355751 (+   562us) log.cc:844] Serialized 26 byte log entry
0709 13:01:36.355968 (+   217us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:01:36.528289 (+172321us) log.cc:844] Serialized 14 byte log entry
0709 13:01:36.657473 (+129184us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:36.657548 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:36.657590 (+    42us) raft_consensus.cc:1685] finished
0709 13:01:36.657602 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:36.657759 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":264576,"prepare.queue_time_us":299860,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":72,"raft.queue_time_us":11337,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":12719,"thread_start_us":1198288,"threads_started":3,"wal-append.queue_time_us":54335}
I20260709 13:01:36.673998  2227 raft_consensus.cc:2468] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 17.
I20260709 13:01:36.473784  7620 raft_consensus.cc:515] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:36.504292  7739 raft_consensus.cc:493] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:36.678736  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:36.681828  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:36.432474  7670 raft_consensus.cc:515] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:36.682121  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:36.654105  7820 raft_consensus.cc:2749] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:01:36.678901  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 21 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:36.689101  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:36.693514  1681 raft_consensus.cc:1275] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:01:36.678406  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:01:36.698649  1496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:36.694947  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:01:36.695623  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 218970us
I20260709 13:01:36.661757  7625 raft_consensus.cc:493] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:36.661147  7632 raft_consensus.cc:2749] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:01:36.505857  7791 raft_consensus.cc:515] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:36.664259  7829 raft_consensus.cc:2804] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:01:36.700685  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:36.624137  7614 raft_consensus.cc:515] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:36.704231  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:36.708104  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:01:36.709548  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 210401us
I20260709 13:01:36.695952  1678 raft_consensus.cc:2468] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 15.
I20260709 13:01:36.713390  1681 raft_consensus.cc:2468] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 17.
I20260709 13:01:36.710870  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:36.691051  7819 raft_consensus.cc:3055] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:01:36.714224  1674 raft_consensus.cc:1813] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Handling vote request from an unknown peer e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:36.676842  7817 raft_consensus.cc:493] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:36.689321  7626 raft_consensus.cc:515] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:36.712859  1676 raft_consensus.cc:2468] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 15.
I20260709 13:01:36.721977  1674 raft_consensus.cc:2393] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 11: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:01:36.687738  7841 raft_consensus.cc:493] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:36.663769  7699 raft_consensus.cc:515] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:36.724732  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:36.732105  1681 raft_consensus.cc:2468] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 14.
I20260709 13:01:36.729411  7817 raft_consensus.cc:515] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:36.753240  7818 raft_consensus.cc:493] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:36.753969  7818 raft_consensus.cc:515] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:36.754503  1603 raft_consensus.cc:1275] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:01:36.756445  1603 raft_consensus.cc:1240] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:36.691581  7765 raft_consensus.cc:515] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:36.759959  1525 raft_consensus.cc:1275] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:01:36.761128  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:36.762575  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:36.783174  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:36.785075  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:36.785952  1603 raft_consensus.cc:2410] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 19 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 13:01:36.774492  1598 raft_consensus.cc:2468] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 16.
I20260709 13:01:36.727022  7821 raft_consensus.cc:493] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:36.697181  7739 raft_consensus.cc:515] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:36.719439  7819 raft_consensus.cc:740] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:36.791497  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:36.729666  7460 leader_election.cc:290] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:36.795046  1606 raft_consensus.cc:1240] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 13:01:36.793253  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:36.793048  1604 raft_consensus.cc:1275] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:01:36.714620  7625 raft_consensus.cc:515] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:36.800917  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 21 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:36.793952  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: true dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:36.795307  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:36.801877  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:36.802335  1681 raft_consensus.cc:3055] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:01:36.802384  1674 raft_consensus.cc:2468] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 14.
I20260709 13:01:36.799623  1605 raft_consensus.cc:2410] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:01:36.803097  1681 raft_consensus.cc:740] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:36.806429  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:36.806787  2227 raft_consensus.cc:1275] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:01:36.704731  7406 consensus_queue.cc:237] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:36.809232  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:01:36.818624  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 199182us
W20260709 13:01:36.822301  1496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:36.797883  7821 raft_consensus.cc:515] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:36.840080  7645 leader_election.cc:290] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:36.840853  7645 raft_consensus.cc:493] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:36.841428  7645 raft_consensus.cc:515] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:36.843080  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:36.739049  7841 raft_consensus.cc:515] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:36.845094  7819 consensus_queue.cc:260] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:36.816720  7460 raft_consensus.cc:493] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:36.847800  7460 raft_consensus.cc:515] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:36.848207  7816 leader_election.cc:290] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:36.849515  7816 raft_consensus.cc:493] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:36.851445  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:36.847801  7670 leader_election.cc:290] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:36.852900  7670 raft_consensus.cc:493] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:36.853360  7670 raft_consensus.cc:515] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:36.854898  7699 leader_election.cc:290] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:36.855453  7670 leader_election.cc:290] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:36.856957  7739 leader_election.cc:290] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:36.857187  7841 leader_election.cc:290] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:36.857563  7620 leader_election.cc:290] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:36.799280  7706 raft_consensus.cc:493] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:36.859217  1607 raft_consensus.cc:1275] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:01:36.792903  7840 raft_consensus.cc:493] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
W20260709 13:01:36.810727  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 105781us
I20260709 13:01:36.849997  7816 raft_consensus.cc:515] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:36.831387  1681 consensus_queue.cc:260] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:36.881178  1571 leader_election.cc:304] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:36.907289  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:01:36.906522  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 105317us
I20260709 13:01:36.909044  1681 raft_consensus.cc:3060] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:36.910219  1676 raft_consensus.cc:1275] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:01:36.912276  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:36.914158  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:36.914778  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 13:01:36.915940  1572 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.196:37373 timed out after 1.523s (SENT) [suppressed 20 similar messages]
I20260709 13:01:36.804234  7780 raft_consensus.cc:493] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:36.919181  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:36.919903  1601 raft_consensus.cc:2368] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b for earlier term 12. Current term is 13.
I20260709 13:01:36.909657  1674 raft_consensus.cc:2468] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 19.
I20260709 13:01:36.914902  1598 raft_consensus.cc:2468] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 14.
I20260709 13:01:36.922139  1604 raft_consensus.cc:2468] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 16.
I20260709 13:01:36.923204  2223 raft_consensus.cc:1275] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:01:36.858385  7706 raft_consensus.cc:515] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:36.923542  1571 leader_election.cc:304] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:36.865873  7819 raft_consensus.cc:3060] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:36.927820  2227 raft_consensus.cc:2468] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 14.
I20260709 13:01:36.858417  7826 raft_consensus.cc:493] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:36.864022  7735 raft_consensus.cc:3060] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:36.915645  7739 raft_consensus.cc:493] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
W20260709 13:01:36.938318  1495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:36.942981  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:36.944022  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:36.923585  7828 raft_consensus.cc:493] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:36.945963  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
W20260709 13:01:36.950258  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 89887.8us
I20260709 13:01:36.950623  1571 leader_election.cc:304] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:36.925143  7836 raft_consensus.cc:493] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:36.949702  1646 leader_election.cc:304] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:36.932593  7835 raft_consensus.cc:493] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:36.958014  1496 leader_election.cc:304] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:36.936561  7829 raft_consensus.cc:697] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 19 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:36.951678  7854 raft_consensus.cc:2749] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:36.916864  7840 raft_consensus.cc:515] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:37.019414  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:01:37.018944  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 64793.4us
I20260709 13:01:36.946144  7739 raft_consensus.cc:515] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:36.951926  7838 raft_consensus.cc:493] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:36.943475  7826 raft_consensus.cc:515] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:37.043773  7826 leader_election.cc:290] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:36.963646  1571 leader_election.cc:304] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:01:37.044828  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 81257.5us
I20260709 13:01:37.045909  1571 leader_election.cc:304] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:36.963855  7848 raft_consensus.cc:2749] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:01:36.967221  7839 log.cc:927] Time spent T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:01:36.952343  7828 raft_consensus.cc:515] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:36.958050  7836 raft_consensus.cc:515] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:01:36.990804  7795 log.cc:927] Time spent T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 1.529s	user 0.010s	sys 0.011s
I20260709 13:01:36.968128  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:01:36.992599  7783 consensus_meta.cc:287] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent flushing consensus metadata: real 0.600s	user 0.009s	sys 0.000s
I20260709 13:01:36.971487  7706 leader_election.cc:290] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:01:36.972203  7796 log.cc:927] Time spent T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 1.510s	user 0.007s	sys 0.004s
I20260709 13:01:36.972237  7791 leader_election.cc:290] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:36.993973  7645 leader_election.cc:290] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:01:36.973392  7802 log.cc:927] Time spent T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 1.512s	user 0.008s	sys 0.022s
I20260709 13:01:36.961931  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
W20260709 13:01:36.969739  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:36.996055  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36200 (request call id 2980) took 1774 ms. Trace:
W20260709 13:01:36.998364  7792 consensus_meta.cc:287] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent flushing consensus metadata: real 0.629s	user 0.008s	sys 0.001s
I20260709 13:01:36.937935  7844 raft_consensus.cc:2804] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:36.998903  7818 leader_election.cc:290] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:37.000654  7816 leader_election.cc:290] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:37.001048  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:37.002033  7817 leader_election.cc:290] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:01:37.002333  7794 log.cc:927] Time spent T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 1.541s	user 0.010s	sys 0.004s
W20260709 13:01:37.002341  7810 log.cc:927] Time spent T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 1.540s	user 0.014s	sys 0.011s
I20260709 13:01:37.002871  7823 raft_consensus.cc:493] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:37.003541  7614 leader_election.cc:290] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:37.003883  7461 consensus_queue.cc:1048] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:37.004218  7835 raft_consensus.cc:515] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:36.959754  7846 consensus_queue.cc:1048] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:01:37.004648  7852 raft_consensus.cc:2804] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:36.959486  7822 raft_consensus.cc:2804] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:01:36.928131  7780 raft_consensus.cc:515] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:37.005610  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
W20260709 13:01:37.014871  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 58981.9us
I20260709 13:01:37.015439  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:37.015673  7850 consensus_queue.cc:1048] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:01:37.106348  1598 raft_consensus.cc:2393] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 19: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:01:37.051813  7838 raft_consensus.cc:515] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:37.017009  1599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36200 (request call id 2966) took 2142 ms. Trace:
I20260709 13:01:37.020275  1601 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 20.
W20260709 13:01:37.047814  7801 log.cc:927] Time spent T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 1.587s	user 0.000s	sys 0.020s
I20260709 13:01:37.046923  7745 raft_consensus.cc:2749] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:01:37.107944  1599 rpcz_store.cc:276] 0709 13:01:34.874339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:34.874957 (+   618us) service_pool.cc:224] Handling call
0709 13:01:34.875259 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:34.908218 (+ 32959us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:01:35.061309 (+153091us) log.cc:844] Serialized 14 byte log entry
0709 13:01:35.332274 (+270965us) log.cc:844] Serialized 14 byte log entry
0709 13:01:35.332422 (+   148us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:35.333072 (+   650us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:01:35.333131 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:36.384852 (+1051721us) spinlock_profiling.cc:243] Waited 66.9 ms on lock 0x7b4400022b4c. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a153ecc85 00007f6a153ed6a2 00007f6a1815f1db 00007f6a1815aaaf 00007f6a1814e86e 00007f6a1814dbb6 00007f6a1814d7d8 00007f6a18157221 00007f6a181571d9 00007f6a18157169
0709 13:01:36.518776 (+133924us) spinlock_profiling.cc:243] Waited 2.52 ms on lock 0x7b1800342e80. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1e38ede1 00007f6a1e39b5b1 00007f6a154c6522 00007f6a154c87c1 00007f6a154c8779 00007f6a154c8709 00007f6a154c86d1 00007f6a154c79cd 000000000038f354 000000000038f199 00007f6a154a983a
0709 13:01:37.016733 (+497957us) spinlock_profiling.cc:243] Waited 32.7 ms on lock 0x7b54003499d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:01:37.016784 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:37.016939 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2755,"prepare.queue_time_us":130782,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":3718,"raft.queue_time_us":46136,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":18745,"spinlock_wait_cycles":240639616,"thread_start_us":396636,"threads_started":2,"wal-append.queue_time_us":399596}
I20260709 13:01:37.056262  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:37.056972  7836 leader_election.cc:290] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:37.065117  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:37.055028  7854 raft_consensus.cc:2804] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:37.070416  1606 raft_consensus.cc:3060] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:01:37.071254  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:37.072220  2218 raft_consensus.cc:2468] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 17.
I20260709 13:01:37.070853  1602 rpcz_store.cc:276] 0709 13:01:35.221480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:35.222482 (+  1002us) service_pool.cc:224] Handling call
0709 13:01:35.222815 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:35.278234 (+ 55419us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:36.995812 (+1717578us) spinlock_profiling.cc:243] Waited 43.2 ms on lock 0x7b54002675d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:01:36.995993 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":99400064}
I20260709 13:01:37.072679  1530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43010 (request call id 2696) took 2029 ms. Trace:
I20260709 13:01:37.114557  1530 rpcz_store.cc:276] 0709 13:01:35.042905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:35.042990 (+    85us) service_pool.cc:224] Handling call
0709 13:01:35.043292 (+   302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:35.045290 (+  1998us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:35.045325 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:35.045825 (+   500us) log.cc:844] Serialized 26 byte log entry
0709 13:01:36.561164 (+1515339us) spinlock_profiling.cc:243] Waited 5.41 ms on lock 0x7b1800424540. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1e38ede1 00007f6a1e39b5b1 00007f6a154a8e07 00007f6a1e303ab9 00007f6a154c569b 00007f6a154c393f 00007f6a154c5c02 00007f6a1814d20b 00007f6a18152d23 00007f6a181530d1 00007f6a1856ea0f
0709 13:01:36.787194 (+226030us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:36.805472 (+ 18278us) log.cc:844] Serialized 14 byte log entry
0709 13:01:37.063698 (+258226us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:37.063819 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:37.063866 (+    47us) raft_consensus.cc:1685] finished
0709 13:01:37.071328 (+  7462us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:37.072602 (+  1274us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":116718,"prepare.queue_time_us":18988,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":28976,"raft.queue_time_us":133687,"raft.run_cpu_time_us":299,"raft.run_wall_time_us":11128,"spinlock_wait_cycles":12433280,"thread_start_us":373699,"threads_started":2,"wal-append.queue_time_us":1888471}
W20260709 13:01:37.073189  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 157291us
I20260709 13:01:37.062166  7544 raft_consensus.cc:493] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:37.118208  1572 leader_election.cc:304] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:37.066756  7819 raft_consensus.cc:493] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:37.087880  7460 leader_election.cc:290] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:01:37.089570  7803 log.cc:927] Time spent T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 1.617s	user 0.009s	sys 0.018s
I20260709 13:01:37.073318  7710 raft_consensus.cc:493] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:37.091403  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:37.093010  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:37.120317  7835 leader_election.cc:290] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:37.071712  7844 raft_consensus.cc:493] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:37.071728  7708 raft_consensus.cc:493] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:37.072134  7706 raft_consensus.cc:493] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:37.095795  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:37.115618  7854 raft_consensus.cc:493] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:37.075362  7825 raft_consensus.cc:493] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:37.098207  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:37.102357  2190 leader_election.cc:304] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:37.076956  7829 consensus_queue.cc:237] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:37.112224  1604 raft_consensus.cc:2468] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 13.
I20260709 13:01:37.116807  1602 raft_consensus.cc:1275] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 13:01:37.120518  7809 log.cc:927] Time spent T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 1.657s	user 0.010s	sys 0.017s
W20260709 13:01:37.121244  7804 log.cc:927] Time spent T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 1.647s	user 0.015s	sys 0.012s
I20260709 13:01:37.061755  7849 consensus_queue.cc:1048] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.017s
I20260709 13:01:37.136231  7745 raft_consensus.cc:2804] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:37.094797  7852 raft_consensus.cc:493] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:37.180043  1680 raft_consensus.cc:1275] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:01:37.195022  7852 raft_consensus.cc:3060] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:37.196285  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:37.198041  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:37.126282  1527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43010 (request call id 2697) took 2083 ms. Trace:
I20260709 13:01:37.070096  7826 raft_consensus.cc:493] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:37.134686  1572 leader_election.cc:304] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:01:37.198841  7739 leader_election.cc:290] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:37.199031  7826 raft_consensus.cc:515] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:37.199285  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 64744.4us
I20260709 13:01:37.200100  7838 leader_election.cc:290] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:37.198796  1527 rpcz_store.cc:276] 0709 13:01:35.043184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:35.043308 (+   124us) service_pool.cc:224] Handling call
0709 13:01:35.044079 (+   771us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:35.057047 (+ 12968us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:35.057084 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:35.061742 (+  4658us) log.cc:844] Serialized 52 byte log entry
0709 13:01:35.265751 (+204009us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:35.455434 (+189683us) log.cc:844] Serialized 14 byte log entry
0709 13:01:36.526484 (+1071050us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b180047caa0. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1e38ede1 00007f6a1e39b5b1 00007f6a15440c0a 00007f6a1eb80219 00007f6a154c8a40 00007f6a154c34e4 00007f6a154c3455 00007f6a1bfab3c7 00007f6a185bd9a7 00007f6a185cd0bf 00007f6a185cd038
0709 13:01:36.526741 (+   257us) log.cc:844] Serialized 14 byte log entry
0709 13:01:36.697692 (+170951us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:36.697811 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:36.994492 (+296681us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b180047caa0. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1e38ede1 00007f6a1e39b5b1 00007f6a154c63f3 00007f6a154c87c1 00007f6a154c8779 00007f6a154c8709 00007f6a154c86d1 00007f6a154c79cd 000000000038f354 000000000038f199 00007f6a154a983a
0709 13:01:37.047003 (+ 52511us) spinlock_profiling.cc:243] Waited 64.1 ms on lock 0x7b4400022b4c. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a153ecc85 00007f6a153ed6a2 00007f6a1815f1db 00007f6a1815aaaf 00007f6a1814e86e 00007f6a1814dbb6 00007f6a1814d7d8 00007f6a18157221 00007f6a181571d9 00007f6a18157169
0709 13:01:37.126021 (+ 79018us) raft_consensus.cc:1685] finished
0709 13:01:37.126045 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:37.126217 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":131238,"prepare.queue_time_us":1186560,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":66,"raft.queue_time_us":251408,"raft.run_cpu_time_us":408,"raft.run_wall_time_us":16983,"spinlock_wait_cycles":196595072,"thread_start_us":449390,"threads_started":3,"wal-append.queue_time_us":388845}
I20260709 13:01:37.201382  7826 leader_election.cc:290] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:37.202889  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:37.203341  1646 leader_election.cc:304] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:37.134519  1529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43010 (request call id 2702) took 2006 ms. Trace:
I20260709 13:01:37.205535  7625 leader_election.cc:290] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:37.199501  7613 raft_consensus.cc:2804] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:37.205933  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:37.138588  1497 leader_election.cc:304] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:37.203365  1602 raft_consensus.cc:1240] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 19. Current term is 20. Ops: []
W20260709 13:01:37.139694  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 69956.4us
I20260709 13:01:37.110440  7822 raft_consensus.cc:697] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 19 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:37.208525  1602 raft_consensus.cc:1275] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 12 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 13:01:37.127219  7614 raft_consensus.cc:493] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:37.213709  7838 raft_consensus.cc:2749] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:01:37.214524  7625 raft_consensus.cc:493] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:37.215406  1598 raft_consensus.cc:1275] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:01:37.141521  1606 raft_consensus.cc:2468] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 15.
I20260709 13:01:37.209787  7745 raft_consensus.cc:493] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:37.216137  7745 raft_consensus.cc:3060] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:37.218813  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:37.219403  7821 leader_election.cc:290] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:37.220570  7846 consensus_queue.cc:1048] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:01:37.072242  7791 raft_consensus.cc:493] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
W20260709 13:01:37.150553  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 48309.4us
I20260709 13:01:37.223987  2190 leader_election.cc:304] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:37.225939  2190 leader_election.cc:304] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:37.053691  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:01:37.151310  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 193338us
I20260709 13:01:37.227481  1496 leader_election.cc:304] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:37.127000  7836 raft_consensus.cc:493] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:37.154762  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:37.083799  7823 raft_consensus.cc:515] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:37.133893  7544 raft_consensus.cc:515] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:37.246214  7544 leader_election.cc:290] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:37.228658  1496 leader_election.cc:304] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:37.250196  7837 raft_consensus.cc:2804] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:37.250705  7837 raft_consensus.cc:493] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:37.251159  7837 raft_consensus.cc:3060] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:37.253937  7780 leader_election.cc:290] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:37.254627  7836 raft_consensus.cc:515] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:37.256161  7790 raft_consensus.cc:2749] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:01:37.256750  7836 leader_election.cc:290] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:37.257397  7146 raft_consensus.cc:2804] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:01:37.257807  7146 raft_consensus.cc:493] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:37.258188  7146 raft_consensus.cc:3060] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:37.258813  7823 leader_election.cc:290] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:37.209050  7822 consensus_queue.cc:237] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:37.263306  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:37.264001  1607 raft_consensus.cc:2468] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 21.
I20260709 13:01:37.140995  7844 raft_consensus.cc:3060] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:01:37.215299  7805 log.cc:927] Time spent T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 1.754s	user 0.009s	sys 0.008s
I20260709 13:01:37.175549  7626 leader_election.cc:290] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:37.153848  7708 raft_consensus.cc:515] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:37.152156  7854 raft_consensus.cc:3060] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:37.154348  7855 raft_consensus.cc:3060] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:37.133816  7632 consensus_queue.cc:1048] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.013s
I20260709 13:01:37.121119  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:37.136685  7819 raft_consensus.cc:515] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:37.281738  7708 leader_election.cc:290] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:37.152001  7706 raft_consensus.cc:515] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:37.190558  1528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43010 (request call id 2705) took 2050 ms. Trace:
I20260709 13:01:37.206431  7613 raft_consensus.cc:697] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 17 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:37.207024  7763 raft_consensus.cc:2804] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:37.282843  7819 leader_election.cc:290] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:37.283306  7763 raft_consensus.cc:493] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:37.283819  7763 raft_consensus.cc:3060] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:37.173003  1526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43010 (request call id 2708) took 2031 ms. Trace:
I20260709 13:01:37.284705  1526 rpcz_store.cc:276] 0709 13:01:35.141142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:35.162123 (+ 20981us) service_pool.cc:224] Handling call
0709 13:01:35.162451 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:35.217430 (+ 54979us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:01:35.242029 (+ 24599us) log.cc:844] Serialized 14 byte log entry
0709 13:01:36.549542 (+1307513us) spinlock_profiling.cc:243] Waited 2.01 ms on lock 0x7b18004482a0. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1e38ede1 00007f6a1e39b5b1 00007f6a154a8e07 00007f6a1e303ab9 00007f6a154c569b 00007f6a154c393f 00007f6a154c5c02 00007f6a1814d20b 00007f6a18152d23 00007f6a1815323a 00007f6a185bda2a
0709 13:01:36.583786 (+ 34244us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:36.584386 (+   600us) log.cc:844] Serialized 26 byte log entry
0709 13:01:36.584542 (+   156us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:36.585019 (+   477us) log.cc:844] Serialized 14 byte log entry
0709 13:01:36.602641 (+ 17622us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:36.602741 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:36.999832 (+397091us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x7b18004482a0. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1e38ede1 00007f6a1e39b5b1 00007f6a154c6522 00007f6a154c87c1 00007f6a154c8779 00007f6a154c8709 00007f6a154c86d1 00007f6a154c79cd 000000000038f354 000000000038f199 00007f6a154a983a
0709 13:01:37.172738 (+172906us) raft_consensus.cc:1685] finished
0709 13:01:37.172766 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:37.172930 (+   164us) inbound_call.cc:177] Queueing success response
0709 13:01:37.178077 (+  5147us) spinlock_profiling.cc:243] Waited 6.95 ms on lock 0x7b18004482a0. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1e38ede1 00007f6a1e39b5b1 00007f6a154c63f3 00007f6a154c87c1 00007f6a154c8779 00007f6a154c8709 00007f6a154c86d1 00007f6a154c79cd 000000000038f354 000000000038f199 00007f6a154a983a
Metrics: {"mutex_wait_us":25893,"prepare.queue_time_us":31363,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":79,"raft.queue_time_us":413400,"raft.run_cpu_time_us":362,"raft.run_wall_time_us":18698,"spinlock_wait_cycles":50521984,"thread_start_us":51210,"threads_started":3,"wal-append.queue_time_us":1593197}
I20260709 13:01:37.187285  1523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43010 (request call id 2704) took 2057 ms. Trace:
I20260709 13:01:37.283746  7613 consensus_queue.cc:237] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:37.185235  7840 leader_election.cc:290] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:37.286867  1523 rpcz_store.cc:276] 0709 13:01:35.129409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:35.129526 (+   117us) service_pool.cc:224] Handling call
0709 13:01:35.129888 (+   362us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:35.130310 (+   422us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:35.130344 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:35.138844 (+  8500us) log.cc:844] Serialized 26 byte log entry
0709 13:01:35.505162 (+366318us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:35.505212 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:35.505294 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:37.088717 (+1583423us) spinlock_profiling.cc:243] Waited 54.8 ms on lock 0x7b4400022b4c. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a153ecc85 00007f6a153ed6a2 00007f6a1815f1db 00007f6a1815aaaf 00007f6a1814e86e 00007f6a1814dbb6 00007f6a1814d7d8 00007f6a18157221 00007f6a181571d9 00007f6a18157169
0709 13:01:37.186970 (+ 98253us) raft_consensus.cc:1685] finished
0709 13:01:37.186991 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:37.187222 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21873,"raft.queue_time_us":1408,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":2370,"spinlock_wait_cycles":126134528,"thread_start_us":337940,"threads_started":1,"wal-append.queue_time_us":329665}
W20260709 13:01:37.207023  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 68553.1us
I20260709 13:01:37.288862  1497 leader_election.cc:304] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:37.181411  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:37.290266  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:37.177870  1524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43010 (request call id 2700) took 2113 ms. Trace:
I20260709 13:01:37.204382  1529 rpcz_store.cc:276] 0709 13:01:35.128341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:35.128494 (+   153us) service_pool.cc:224] Handling call
0709 13:01:35.131998 (+  3504us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:35.140525 (+  8527us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:35.140555 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:35.148265 (+  7710us) log.cc:844] Serialized 26 byte log entry
0709 13:01:35.355380 (+207115us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:35.536749 (+181369us) log.cc:844] Serialized 14 byte log entry
0709 13:01:35.563956 (+ 27207us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:35.564038 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:37.001814 (+1437776us) spinlock_profiling.cc:243] Waited 16.9 ms on lock 0x7b4400022b4c. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a153ecc85 00007f6a153ed6a2 00007f6a1815f1db 00007f6a1815aaaf 00007f6a1814e86e 00007f6a1814dbb6 00007f6a1814d7d8 00007f6a18157221 00007f6a181571d9 00007f6a18157169
0709 13:01:37.127308 (+125494us) raft_consensus.cc:1685] finished
0709 13:01:37.134324 (+  7016us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:37.134460 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":142660,"prepare.queue_time_us":107281,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":26,"raft.queue_time_us":34344,"raft.run_cpu_time_us":234,"raft.run_wall_time_us":7615,"spinlock_wait_cycles":38973312,"thread_start_us":194003,"threads_started":2,"wal-append.queue_time_us":286442}
W20260709 13:01:37.174414  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:37.170684  1600 leader_election.cc:290] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:37.215129  7625 raft_consensus.cc:515] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:37.213734  7614 raft_consensus.cc:515] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:37.142073  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:37.177384  7765 leader_election.cc:290] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:37.140223  7710 raft_consensus.cc:515] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:36.215647   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:37.229724  2190 leader_election.cc:304] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:37.231541  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:01:37.298911  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 170865us
I20260709 13:01:37.238838  7791 raft_consensus.cc:515] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:37.241573  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:37.242293  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:01:37.300204  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 70557.3us
I20260709 13:01:37.301765  1646 leader_election.cc:304] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:37.302939  2227 raft_consensus.cc:1275] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:01:37.243420  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:37.243579  1598 raft_consensus.cc:1275] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:01:37.243997  7838 raft_consensus.cc:2804] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:37.263091  7837 raft_consensus.cc:515] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:37.153884  7825 raft_consensus.cc:515] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:37.250567  1496 leader_election.cc:304] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
W20260709 13:01:37.315986  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 65485.9us
I20260709 13:01:37.316769  1496 leader_election.cc:304] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:37.316936  1605 raft_consensus.cc:1240] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 19 LEADER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 18. Current term is 19. Ops: []
I20260709 13:01:37.270946  1681 raft_consensus.cc:2468] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 17.
I20260709 13:01:37.296271  1497 leader_election.cc:304] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:37.296438  1600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:36200 (request call id 2979) took 2073 ms. Trace:
I20260709 13:01:37.317799  1600 rpcz_store.cc:276] 0709 13:01:35.218088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:35.219199 (+  1111us) service_pool.cc:224] Handling call
0709 13:01:37.159948 (+1940749us) spinlock_profiling.cc:243] Waited 1.57 ms on lock 0x7b4c003124c0. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1687fa20 00007f6a16890a29 00007f6a1689113f 00007f6a168552ab 00007f6a16882f3c 00007f6a168833fe 00007f6a16b1088b 00007f6a1850f495 00007f6a1856030f 00007f6a185aaa55 00007f6a1d57acd0
0709 13:01:37.291450 (+131502us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3614080}
I20260709 13:01:37.299871  1572 leader_election.cc:304] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:37.319388  7323 raft_consensus.cc:2804] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:37.319849  7323 raft_consensus.cc:493] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:37.320209  7323 raft_consensus.cc:3060] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:37.320978  1572 leader_election.cc:304] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:37.304325  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:37.283059  1528 rpcz_store.cc:276] 0709 13:01:35.140270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:35.140399 (+   129us) service_pool.cc:224] Handling call
0709 13:01:35.140744 (+   345us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:35.141117 (+   373us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:35.141145 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:35.157193 (+ 16048us) log.cc:844] Serialized 52 byte log entry
0709 13:01:35.382272 (+225079us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:01:35.546897 (+164625us) log.cc:844] Serialized 14 byte log entry
0709 13:01:36.526805 (+979908us) log.cc:844] Serialized 14 byte log entry
0709 13:01:36.656605 (+129800us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:36.656685 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:37.119962 (+463277us) spinlock_profiling.cc:243] Waited 15.2 ms on lock 0x7b4400022b4c. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a153ecc85 00007f6a153ed6a2 00007f6a1815f1db 00007f6a1815aaaf 00007f6a1814e86e 00007f6a1814dbb6 00007f6a1814d7d8 00007f6a18157221 00007f6a181571d9 00007f6a18157169
0709 13:01:37.190318 (+ 70356us) raft_consensus.cc:1685] finished
0709 13:01:37.190339 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:37.190492 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1115455,"prepare.queue_time_us":1030913,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":49,"raft.queue_time_us":210754,"raft.run_cpu_time_us":399,"raft.run_wall_time_us":32282,"spinlock_wait_cycles":35019520,"thread_start_us":360040,"threads_started":3,"wal-append.queue_time_us":290412}
I20260709 13:01:37.305680  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:37.323428  2222 raft_consensus.cc:2393] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 13: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:01:37.291167  1524 rpcz_store.cc:276] 0709 13:01:35.064287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:35.067259 (+  2972us) service_pool.cc:224] Handling call
0709 13:01:35.067654 (+   395us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:35.068073 (+   419us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:35.068104 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:35.068592 (+   488us) log.cc:844] Serialized 26 byte log entry
0709 13:01:35.334841 (+266249us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:35.445331 (+110490us) log.cc:844] Serialized 14 byte log entry
0709 13:01:35.554002 (+108671us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:35.554083 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:37.120732 (+1566649us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b4400022b4c. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a153ecc85 00007f6a153ed6a2 00007f6a1815f1db 00007f6a1815aaaf 00007f6a1814e86e 00007f6a1814dbb6 00007f6a1814d7d8 00007f6a18157221 00007f6a181571d9 00007f6a18157169
0709 13:01:37.177568 (+ 56836us) raft_consensus.cc:1685] finished
0709 13:01:37.177677 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:37.177808 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":106455,"prepare.queue_time_us":107080,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":94178,"raft.run_cpu_time_us":239,"raft.run_wall_time_us":6722,"spinlock_wait_cycles":27730176,"thread_start_us":216603,"threads_started":1,"wal-append.queue_time_us":386026}
I20260709 13:01:37.308440  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:37.306910  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:37.323161  7406 consensus_queue.cc:1048] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:37.322721  7846 raft_consensus.cc:2804] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:37.325112  7846 raft_consensus.cc:493] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:37.325490  7846 raft_consensus.cc:3060] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:37.325426  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:37.327217  1600 raft_consensus.cc:2468] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 14.
I20260709 13:01:37.328533  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:37.334329  1572 leader_election.cc:304] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:37.342392  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:01:37.342911  1496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:37.342981  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:37.331593  2220 raft_consensus.cc:1275] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 12 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
W20260709 13:01:37.343534  1496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:37.344022  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 47839us
I20260709 13:01:37.346321  1497 leader_election.cc:304] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:37.299860  7840 raft_consensus.cc:2804] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:01:37.352021  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:37.353047  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:37.357610  1676 raft_consensus.cc:2468] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 15.
I20260709 13:01:37.354298  1572 leader_election.cc:304] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:37.360734  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:37.361354  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:37.361532  1674 raft_consensus.cc:2468] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 20.
W20260709 13:01:37.363399  1495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:37.314560  7680 raft_consensus.cc:2804] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:37.365543  1497 leader_election.cc:304] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:37.368459  2191 leader_election.cc:304] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:37.311053  7838 raft_consensus.cc:493] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:37.365363  1646 leader_election.cc:304] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:37.368563  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:37.296121  7778 consensus_queue.cc:1048] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.056s
I20260709 13:01:37.371446  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:37.371673  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:37.376085  1529 raft_consensus.cc:2468] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 16.
I20260709 13:01:37.351342  7620 raft_consensus.cc:2804] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:01:37.340914  7835 raft_consensus.cc:2804] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:37.351236  7772 raft_consensus.cc:2804] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:01:37.351326  7823 raft_consensus.cc:2749] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:37.354916  7840 raft_consensus.cc:493] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:37.382136  1496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:37.376168  1497 leader_election.cc:304] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:37.401418  1570 leader_election.cc:304] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:37.310719  7610 consensus_queue.cc:1048] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.063s
I20260709 13:01:37.367125  7849 raft_consensus.cc:3060] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:37.370893  7680 raft_consensus.cc:493] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:37.367136  7461 raft_consensus.cc:493] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:37.351465  7829 consensus_queue.cc:1048] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.038s
I20260709 13:01:37.410110  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:37.371858  7838 raft_consensus.cc:3060] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:37.371126  7773 raft_consensus.cc:2749] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:37.407760  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:37.408527  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:37.408566  1496 leader_election.cc:304] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:37.383293  7620 raft_consensus.cc:493] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:37.421187  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:37.418383  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:37.391264  7835 raft_consensus.cc:493] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:37.424257  1496 leader_election.cc:304] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:37.417629  1528 raft_consensus.cc:2468] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 15.
I20260709 13:01:37.391063  7772 raft_consensus.cc:493] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:37.420699  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:37.427978  1602 raft_consensus.cc:2393] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 20: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:01:37.425760  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:37.429579  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:37.426997  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:37.405215  7840 raft_consensus.cc:3060] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:37.432826  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:37.435513  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:37.415714  7680 raft_consensus.cc:3060] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:37.445662  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:37.432969  1497 leader_election.cc:304] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
W20260709 13:01:37.447243  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 81952.8us
I20260709 13:01:37.448563  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:37.414783  7655 raft_consensus.cc:2749] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:37.449471  1524 raft_consensus.cc:2468] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 18.
I20260709 13:01:37.453532  1497 leader_election.cc:304] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:37.454161  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:37.454945  1600 raft_consensus.cc:2468] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 13.
I20260709 13:01:37.427769  7620 raft_consensus.cc:3060] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:01:37.418428  7826 raft_consensus.cc:493] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:37.460027  1497 leader_election.cc:304] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:37.461454  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:37.427659  7835 raft_consensus.cc:3060] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:37.431042  7772 raft_consensus.cc:3060] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:37.465694  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:37.434785  7841 raft_consensus.cc:2804] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:01:37.466562  2220 raft_consensus.cc:1275] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 13:01:37.471572  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 836469us
I20260709 13:01:37.431280  7823 raft_consensus.cc:2804] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:37.469002  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:37.470193  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:37.475975  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:37.444705  7817 raft_consensus.cc:493] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:37.421855  7461 raft_consensus.cc:515] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:37.423089  7616 consensus_queue.cc:1048] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.039s
I20260709 13:01:37.507583  7614 leader_election.cc:290] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:37.479254  1497 leader_election.cc:304] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:37.502471  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:37.511343  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:37.512120  1678 raft_consensus.cc:2393] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 19: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:01:37.457803  7818 raft_consensus.cc:2749] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:37.504952  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:37.513136  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:37.505736  7710 leader_election.cc:290] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:37.505966  7625 leader_election.cc:290] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:37.476928  7841 raft_consensus.cc:493] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:37.506974  7831 consensus_queue.cc:1048] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.143s
I20260709 13:01:37.468184  7699 raft_consensus.cc:2749] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:01:37.512678  2192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:37.515851  1497 leader_election.cc:304] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:37.445017  7857 consensus_queue.cc:1048] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.150s
I20260709 13:01:37.519119  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:37.477046  7823 raft_consensus.cc:493] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:37.477833  7773 raft_consensus.cc:2804] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:37.506435  7708 raft_consensus.cc:493] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:37.544003  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:37.555388  1527 raft_consensus.cc:1275] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 12. (term mismatch)
I20260709 13:01:37.555809  1527 pending_rounds.cc:85] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting all ops after (but not including) 11
I20260709 13:01:37.556025  1527 pending_rounds.cc:107] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting uncommitted NO_OP operation due to leader change: 15.12
I20260709 13:01:37.556280  1527 raft_consensus.cc:2889] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:37.506492  7761 raft_consensus.cc:2749] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:01:37.545854  7818 raft_consensus.cc:2804] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:01:37.547291  7871 log.cc:927] Time spent T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
W20260709 13:01:37.548159  7868 log.cc:927] Time spent T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:01:37.548454  7864 raft_consensus.cc:493] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:37.575085  7864 raft_consensus.cc:515] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:37.577414  7864 leader_election.cc:290] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:37.548779  7862 raft_consensus.cc:2804] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:37.578069  7862 raft_consensus.cc:493] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:37.578454  7862 raft_consensus.cc:3060] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:37.549180  7861 raft_consensus.cc:493] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:37.549513  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:37.550238  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:37.581278  7861 raft_consensus.cc:515] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:37.551143  7833 raft_consensus.cc:2804] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:01:37.582513  7833 raft_consensus.cc:493] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:37.583001  7833 raft_consensus.cc:3060] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:37.583850  7861 leader_election.cc:290] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:01:37.551544  7867 log.cc:927] Time spent T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:01:37.502509  7783 consensus_queue.cc:1048] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:01:37.517086  7780 raft_consensus.cc:2804] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:37.516412  7863 raft_consensus.cc:2749] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:37.520205  7716 raft_consensus.cc:2749] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:37.548797  7823 raft_consensus.cc:3060] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:37.593760  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:37.601944  1531 raft_consensus.cc:2468] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 11.
I20260709 13:01:37.597441  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:37.477021  7826 raft_consensus.cc:515] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:37.540853  7841 raft_consensus.cc:3060] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:37.543723  7706 leader_election.cc:290] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:37.620689  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 13:01:37.593482  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 48917.3us
I20260709 13:01:37.622802  2192 leader_election.cc:304] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:37.508508  7817 raft_consensus.cc:515] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:37.627184  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:37.552800  7773 raft_consensus.cc:493] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:37.625191  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:37.632755  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:37.585497  7818 raft_consensus.cc:493] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:37.462270  7745 raft_consensus.cc:515] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:37.594056  7791 leader_election.cc:290] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:37.633400  2227 raft_consensus.cc:2468] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 13.
I20260709 13:01:37.627650  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:37.633044  1527 raft_consensus.cc:2410] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:01:37.635396  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:37.548772  7146 raft_consensus.cc:515] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:37.642645  1497 leader_election.cc:304] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:37.601073  7837 leader_election.cc:290] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:37.659132  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:37.587356  7708 raft_consensus.cc:515] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:37.662516  1532 raft_consensus.cc:2410] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:01:37.663328  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:37.667215  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:37.668747  1603 raft_consensus.cc:1240] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:37.661414  1497 leader_election.cc:304] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:37.634557  7773 raft_consensus.cc:3060] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:01:37.670254  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 117540us
I20260709 13:01:37.672981  2226 raft_consensus.cc:1240] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 18. Current term is 19. Ops: []
I20260709 13:01:37.676327  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:37.675165  1497 leader_election.cc:304] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:37.636823  7818 raft_consensus.cc:3060] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:37.679471  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:37.685856  1497 leader_election.cc:304] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:37.686627  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 13:01:37.668148  7876 log.cc:927] Time spent T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
I20260709 13:01:37.688525  1570 leader_election.cc:304] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:37.661113  7645 raft_consensus.cc:2804] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:01:37.687748  2190 leader_election.cc:304] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:37.687541  1532 raft_consensus.cc:2468] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 13.
I20260709 13:01:37.628537  7323 raft_consensus.cc:515] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:37.630301  7845 consensus_queue.cc:1048] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.254s
I20260709 13:01:37.699295  1570 leader_election.cc:304] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:37.700090  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:37.700750  1532 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 20.
I20260709 13:01:37.695179  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:37.668287  7699 raft_consensus.cc:3060] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:37.638206  7739 consensus_queue.cc:1048] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 13:01:37.680279  7837 raft_consensus.cc:2749] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:37.712812  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:37.713649  1527 raft_consensus.cc:2468] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 17.
I20260709 13:01:37.713937  1677 raft_consensus.cc:1275] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 11. (term mismatch)
I20260709 13:01:37.714318  1677 pending_rounds.cc:85] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90: Aborting all ops after (but not including) 10
I20260709 13:01:37.714273  7613 raft_consensus.cc:2749] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:37.714864  1677 pending_rounds.cc:107] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90: Aborting uncommitted NO_OP operation due to leader change: 18.11
I20260709 13:01:37.715160  1677 raft_consensus.cc:2889] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:37.716470  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:37.717099  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:37.717109  1601 raft_consensus.cc:2468] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 19.
I20260709 13:01:37.718343  7613 consensus_queue.cc:1048] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:37.689325  7716 raft_consensus.cc:2749] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:37.722275  7816 consensus_queue.cc:1048] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:01:37.688516  7852 raft_consensus.cc:515] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:37.761570  7852 leader_election.cc:290] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:37.698482  7645 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:37.738250  7763 raft_consensus.cc:515] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:37.774981  7645 raft_consensus.cc:3060] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:37.765025  7846 raft_consensus.cc:515] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:37.761237  7855 raft_consensus.cc:2749] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:01:37.768283  7844 consensus_meta.cc:287] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.503s	user 0.009s	sys 0.000s
I20260709 13:01:37.777571  7844 raft_consensus.cc:515] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:37.761467  7708 leader_election.cc:290] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:37.779718  7844 leader_election.cc:290] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 18 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:01:37.781356  7878 log.cc:927] Time spent T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 13:01:37.723306  7817 leader_election.cc:290] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:01:37.783495  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 353098us
I20260709 13:01:37.784413  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:37.784703  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:37.786172  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:37.786772  1678 raft_consensus.cc:3060] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:37.723774  7761 raft_consensus.cc:493] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:37.690408  7861 raft_consensus.cc:2804] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:37.728662  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:37.734540  7323 leader_election.cc:290] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 18 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:37.736600  7461 leader_election.cc:290] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:37.741780  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:37.744390  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 13:01:37.751261  7879 log.cc:927] Time spent T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
W20260709 13:01:37.752055  7874 log.cc:927] Time spent T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
I20260709 13:01:37.752934  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:37.693161  7875 raft_consensus.cc:493] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:37.805337  1572 leader_election.cc:304] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:37.805786  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:01:37.757555  7735 consensus_meta.cc:287] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b: Time spent flushing consensus metadata: real 0.812s	user 0.004s	sys 0.004s
I20260709 13:01:37.724557  7850 raft_consensus.cc:2804] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:37.723596  7146 leader_election.cc:290] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 19 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:37.787421  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:37.790083  2218 raft_consensus.cc:1275] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 12 index: 13. Preceding OpId from leader: term: 13 index: 14. (index mismatch)
I20260709 13:01:37.823559  1678 raft_consensus.cc:2468] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 18.
I20260709 13:01:37.790577  7861 raft_consensus.cc:493] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:37.789742  7852 raft_consensus.cc:493] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:37.791531  2225 raft_consensus.cc:3060] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:37.793586  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:37.795320  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:37.706507  7829 raft_consensus.cc:2804] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:37.787956  1532 raft_consensus.cc:2468] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 12.
I20260709 13:01:37.806536  1599 raft_consensus.cc:2468] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 12.
I20260709 13:01:37.807085  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:37.807767  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:37.811913  1676 raft_consensus.cc:1240] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:37.835283  1527 raft_consensus.cc:2468] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 18.
I20260709 13:01:37.820020  2224 raft_consensus.cc:2468] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 11.
I20260709 13:01:37.762580  7745 leader_election.cc:290] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:37.823779  1644 leader_election.cc:304] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:01:37.831866  1571 leader_election.cc:304] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:37.811417  7850 raft_consensus.cc:493] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:37.811357  7875 raft_consensus.cc:515] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:37.837778  7740 raft_consensus.cc:493] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:37.841027  7850 raft_consensus.cc:3060] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:37.841375  7740 raft_consensus.cc:515] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:37.791891  7854 raft_consensus.cc:515] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:37.846022  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:37.847481  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:01:37.791568  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 60328.8us
I20260709 13:01:37.844295  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:37.850082  2219 raft_consensus.cc:3060] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:37.828702  7861 raft_consensus.cc:3060] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:37.808832  7835 raft_consensus.cc:515] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:01:37.861234  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 238517us
I20260709 13:01:37.834174  7829 raft_consensus.cc:493] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:37.794963  7761 raft_consensus.cc:515] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:37.825469  7880 raft_consensus.cc:2749] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:01:37.868578  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:37.870819  2219 raft_consensus.cc:2468] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 15.
I20260709 13:01:37.851540  7706 raft_consensus.cc:2804] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:37.873176  1572 leader_election.cc:304] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:37.836654  7852 raft_consensus.cc:515] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:37.879182  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:01:37.889405  1523 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.009s	sys 0.011s
I20260709 13:01:37.884872  2225 raft_consensus.cc:2468] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 18.
I20260709 13:01:37.890606  1529 raft_consensus.cc:2393] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 15: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:01:37.891611  1572 leader_election.cc:304] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90
W20260709 13:01:37.889771  1523 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.009s	sys 0.011s
I20260709 13:01:37.862162  2192 leader_election.cc:304] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:37.888113  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:37.857416  7844 raft_consensus.cc:2804] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:01:37.849056  7846 leader_election.cc:290] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:37.869880  7829 raft_consensus.cc:3060] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:37.896095  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:37.898120  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:37.898320  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:37.899497  1497 leader_election.cc:304] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:37.900465  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:37.902096  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:37.902212  1570 leader_election.cc:304] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:37.896999  7625 raft_consensus.cc:2804] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:01:37.904458  7625 raft_consensus.cc:697] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 18 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:37.905315  7625 consensus_queue.cc:237] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:37.906370  7761 leader_election.cc:290] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:37.905943  7828 leader_election.cc:290] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:37.906399  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:37.909035  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:37.909617  1526 raft_consensus.cc:2468] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 13.
I20260709 13:01:37.897377  7765 raft_consensus.cc:493] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:37.910818  1680 raft_consensus.cc:1275] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 17 index: 16. (index mismatch)
I20260709 13:01:37.911164  7765 raft_consensus.cc:515] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:37.913290  1570 leader_election.cc:304] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:37.868229  7680 raft_consensus.cc:515] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:37.917842  1570 leader_election.cc:304] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:37.957173  1570 leader_election.cc:304] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:01:37.957409  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 58002.3us
I20260709 13:01:37.958132  1497 leader_election.cc:304] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:37.929354  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:37.959117  1532 raft_consensus.cc:2468] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 17.
I20260709 13:01:37.959079  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:37.961768  7852 leader_election.cc:290] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:37.962129  7835 leader_election.cc:290] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 15 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:37.914525  7880 consensus_queue.cc:1048] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.054s
I20260709 13:01:37.924911  7883 consensus_queue.cc:1048] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.044s
I20260709 13:01:37.888793  7745 raft_consensus.cc:2804] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:37.969532  1527 raft_consensus.cc:1240] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:37.970935  7616 raft_consensus.cc:3060] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:37.920675  7146 raft_consensus.cc:2749] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:01:37.962958  7838 consensus_meta.cc:287] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent flushing consensus metadata: real 0.536s	user 0.009s	sys 0.000s
I20260709 13:01:37.968062  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36200 (request call id 2982) took 1055 ms. Trace:
I20260709 13:01:38.009972  1605 rpcz_store.cc:276] 0709 13:01:36.912497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.919617 (+  7120us) service_pool.cc:224] Handling call
0709 13:01:36.920454 (+   837us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:37.317356 (+396902us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:37.967794 (+650438us) spinlock_profiling.cc:243] Waited 396 ms on lock 0x7b54003903d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:01:37.967994 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":911496576}
I20260709 13:01:38.010478  2225 raft_consensus.cc:1240] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 17. Current term is 18. Ops: []
I20260709 13:01:37.962724  1646 leader_election.cc:304] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
W20260709 13:01:38.011709  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 49086.2us
I20260709 13:01:38.012588  1646 leader_election.cc:304] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:37.975488  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:37.916363  7873 consensus_queue.cc:1048] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.060s
I20260709 13:01:37.985767  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:37.982861  1497 leader_election.cc:304] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
W20260709 13:01:37.985486  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 90249.9us
I20260709 13:01:37.926234  7844 raft_consensus.cc:697] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 18 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:37.991266  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:37.992636  1570 leader_election.cc:304] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:37.894238  7818 raft_consensus.cc:515] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:37.989465  7716 raft_consensus.cc:2749] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:38.033593  7836 raft_consensus.cc:2749] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:37.914562  7765 leader_election.cc:290] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:37.966269  7773 raft_consensus.cc:515] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:01:37.964459  7849 consensus_meta.cc:287] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.545s	user 0.007s	sys 0.000s
I20260709 13:01:38.034422  7846 raft_consensus.cc:2749] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:38.034806  7849 raft_consensus.cc:2749] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:37.919024  7763 leader_election.cc:290] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:38.040539  7818 leader_election.cc:290] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 17 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:38.041438  1530 raft_consensus.cc:1240] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:38.015784  2192 leader_election.cc:304] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:37.996527  1603 raft_consensus.cc:1275] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:01:37.962522  7461 raft_consensus.cc:2749] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:37.915854  7863 raft_consensus.cc:2749] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:37.973241  7645 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 21 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:37.914824  7613 raft_consensus.cc:2749] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:37.964255  7854 leader_election.cc:290] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:37.973984  7780 raft_consensus.cc:493] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:38.075130  7780 raft_consensus.cc:3060] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:37.874431  7706 raft_consensus.cc:493] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:38.079872  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:38.081107  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:38.081300  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:38.079900  7706 raft_consensus.cc:3060] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:38.082348  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:38.084270  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:38.086092  2190 leader_election.cc:304] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:38.087252  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:38.088011  7790 raft_consensus.cc:2804] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:38.088449  7790 raft_consensus.cc:493] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:38.088790  7790 raft_consensus.cc:3060] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:37.993858  7820 raft_consensus.cc:2749] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:38.025753  1497 leader_election.cc:304] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:38.091310  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
W20260709 13:01:38.092077  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 66405.1us
W20260709 13:01:38.092502  7620 consensus_meta.cc:287] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.615s	user 0.009s	sys 0.000s
W20260709 13:01:38.092844  7888 log.cc:927] Time spent T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.376s	user 0.002s	sys 0.000s
I20260709 13:01:38.092947  7620 raft_consensus.cc:515] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:38.093981  1497 leader_election.cc:304] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:38.030835  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:38.096033  7850 raft_consensus.cc:515] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:38.031618  1570 leader_election.cc:304] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:01:38.099220  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 67710.7us
I20260709 13:01:38.101568  2190 leader_election.cc:304] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:38.070406  7773 leader_election.cc:290] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 17 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:38.102720  7735 raft_consensus.cc:2804] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:01:38.103106  7735 raft_consensus.cc:493] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:38.103469  7735 raft_consensus.cc:3060] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:38.104492  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:38.106379  7616 raft_consensus.cc:2749] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:38.107131  7616 raft_consensus.cc:2749] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:38.107995  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:38.029265  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:01:38.025861  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:37.926360  7862 raft_consensus.cc:515] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:37.921677  7772 raft_consensus.cc:515] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:37.918287  7841 raft_consensus.cc:515] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:37.920461  7823 raft_consensus.cc:515] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:38.014531  7884 raft_consensus.cc:2749] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:38.120173  2220 raft_consensus.cc:1240] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 14. Current term is 15. Ops: [14.14-14.14]
I20260709 13:01:38.052718  2219 raft_consensus.cc:1275] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:01:37.918318  7840 raft_consensus.cc:515] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:38.052997  2192 leader_election.cc:304] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:38.057544  7761 raft_consensus.cc:2804] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:38.058007  7887 consensus_queue.cc:1048] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:01:38.025075  7838 raft_consensus.cc:515] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:38.028401  7745 raft_consensus.cc:697] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 15 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:38.028033  7819 raft_consensus.cc:2749] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:38.067898  7645 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 21 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:38.051208  7699 raft_consensus.cc:2749] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:38.071111  7844 consensus_queue.cc:237] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:37.931830  7833 raft_consensus.cc:515] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:38.100926  1570 leader_election.cc:304] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:38.113303  1497 leader_election.cc:304] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:38.065994  7861 raft_consensus.cc:515] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:38.127871  7761 raft_consensus.cc:493] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:38.131139  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 78226.9us
I20260709 13:01:38.142647  1525 raft_consensus.cc:2393] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 16: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:01:38.162873  2192 leader_election.cc:304] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:38.129824  1523 raft_consensus.cc:1240] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:38.164083  2192 leader_election.cc:304] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:38.149955  1531 raft_consensus.cc:1240] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 21 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 20. Current term is 21. Ops: []
I20260709 13:01:38.119525  7773 raft_consensus.cc:2749] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:01:38.158740  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 57898us
I20260709 13:01:38.168929  2192 leader_election.cc:304] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:38.170626  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:01:38.159504  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 46294.7us
I20260709 13:01:38.160928  1532 raft_consensus.cc:1240] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 17. Current term is 18. Ops: []
I20260709 13:01:38.156777  1496 leader_election.cc:304] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:38.171705  1497 leader_election.cc:304] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:38.115373  7817 raft_consensus.cc:2749] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:38.173058  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:38.173728  2192 leader_election.cc:304] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:38.183293  2192 leader_election.cc:304] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:38.186254  1496 leader_election.cc:304] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:38.163275  7632 raft_consensus.cc:2804] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:01:38.162981  7852 raft_consensus.cc:2804] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:38.165292  7761 raft_consensus.cc:3060] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:38.193041  1497 leader_election.cc:304] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:38.167339  7645 raft_consensus.cc:2749] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:38.158550  7716 consensus_queue.cc:1059] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:01:38.178864  7885 raft_consensus.cc:2749] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:38.185146  7406 raft_consensus.cc:2749] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:38.191331  7837 raft_consensus.cc:2749] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:38.189015  7827 raft_consensus.cc:493] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.246430  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
W20260709 13:01:38.247171  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 54205.7us
I20260709 13:01:38.247943  1497 leader_election.cc:304] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:38.225690  7817 raft_consensus.cc:2749] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:38.184294  7739 raft_consensus.cc:2749] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:38.231137  7791 raft_consensus.cc:2749] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:38.196205  7852 raft_consensus.cc:493] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:38.196319  7632 raft_consensus.cc:493] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:38.212654  7850 leader_election.cc:290] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 17 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:38.262873  7881 consensus_queue.cc:1048] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.140s
I20260709 13:01:38.263360  7772 leader_election.cc:290] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 20 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:38.265769  1599 raft_consensus.cc:1240] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 18 LEADER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 13:01:38.285118  1497 leader_election.cc:304] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:38.246222  7680 leader_election.cc:290] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 13 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:38.321658  1497 leader_election.cc:304] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:38.266892  7835 raft_consensus.cc:2749] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:38.329357  1497 leader_election.cc:304] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:38.267156  7146 raft_consensus.cc:2749] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:01:38.326109  7899 log.cc:927] Time spent T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:01:38.356174  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:38.286214  7632 raft_consensus.cc:3060] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:38.255590  7827 raft_consensus.cc:515] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:38.358383  7886 raft_consensus.cc:2804] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:38.359086  7886 raft_consensus.cc:697] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 15 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:38.298373  7706 raft_consensus.cc:515] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:38.359961  7886 consensus_queue.cc:237] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:38.361270  7706 leader_election.cc:290] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:38.302758  7716 raft_consensus.cc:2804] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:01:38.286010  7852 raft_consensus.cc:3060] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:01:38.331221  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 123838us
I20260709 13:01:38.362347  7716 raft_consensus.cc:493] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:38.362910  7716 raft_consensus.cc:3060] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:38.363315  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
W20260709 13:01:38.323635  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 140434us
W20260709 13:01:38.296316  7805 log.cc:927] Time spent T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:01:38.364099  7845 consensus_queue.cc:1059] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:38.365211  7845 raft_consensus.cc:3055] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:38.365585  7845 raft_consensus.cc:740] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:38.366767  7773 raft_consensus.cc:2749] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:38.368155  1529 raft_consensus.cc:1275] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:01:38.368091  7632 raft_consensus.cc:515] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:38.369369  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:38.248026  7745 consensus_queue.cc:237] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 12.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:38.358640  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:38.364639  2192 leader_election.cc:304] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:38.368119  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:38.378643  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:38.358418  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:38.349107  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:38.379922  1605 raft_consensus.cc:2468] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 15.
I20260709 13:01:38.348189  1526 raft_consensus.cc:1240] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 18. Current term is 19. Ops: []
I20260709 13:01:38.381565  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:38.382937  2220 raft_consensus.cc:1240] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:38.362848  1680 raft_consensus.cc:1240] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:38.388120  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:38.390894  2222 raft_consensus.cc:1275] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 17 index: 16. (index mismatch)
I20260709 13:01:38.393010  1570 leader_election.cc:304] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:38.394924  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:38.395570  1524 raft_consensus.cc:3060] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:38.393787  1497 leader_election.cc:304] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:38.396561  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:38.382290  1526 raft_consensus.cc:2393] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 19: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
W20260709 13:01:38.374289  7892 log.cc:927] Time spent T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.341s	user 0.000s	sys 0.001s
I20260709 13:01:38.408107  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:38.409816  1570 leader_election.cc:304] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:38.394270  7632 leader_election.cc:290] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 19 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:38.329862  7772 raft_consensus.cc:2749] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:01:38.362195  7875 leader_election.cc:290] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:38.335304  7620 leader_election.cc:290] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 22 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:38.359288  7827 leader_election.cc:290] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:38.346688  7791 raft_consensus.cc:2749] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:01:38.299625  7851 consensus_queue.cc:1059] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.289s
I20260709 13:01:38.421537  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:38.477509  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:38.412624  7625 raft_consensus.cc:2749] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:01:38.431000  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:38.395228  7680 raft_consensus.cc:2749] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:38.494894  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:38.481809  1526 raft_consensus.cc:3060] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:38.395802  7837 raft_consensus.cc:493] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.394476  7817 raft_consensus.cc:493] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:38.488705  1605 raft_consensus.cc:1240] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:38.419668  1497 leader_election.cc:304] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
W20260709 13:01:38.496153  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 80299.5us
W20260709 13:01:38.408783  7902 log.cc:927] Time spent T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:01:38.416973  7856 raft_consensus.cc:2749] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:38.416805  7840 leader_election.cc:290] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 21 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:01:38.490192  7829 consensus_meta.cc:287] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.507s	user 0.010s	sys 0.000s
I20260709 13:01:38.488683  7835 raft_consensus.cc:2749] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:01:38.330842  7895 consensus_queue.cc:1059] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.355s
I20260709 13:01:38.416971  7823 leader_election.cc:290] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:38.475258  7831 consensus_queue.cc:1059] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.043s
I20260709 13:01:38.499018  7833 leader_election.cc:290] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 19 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:38.366401  7845 consensus_queue.cc:260] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:38.413772  7862 leader_election.cc:290] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:38.374300  7780 raft_consensus.cc:515] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:38.479846  7875 raft_consensus.cc:493] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:38.533401  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:38.534535  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:38.535995  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 13:01:38.537218  2224 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50310 (request call id 1220) took 3419 ms (client timeout 1523 ms). Trace:
I20260709 13:01:38.415786  7880 consensus_queue.cc:1048] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.101s
I20260709 13:01:38.499351  7838 leader_election.cc:290] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 18 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:38.416534  7820 consensus_queue.cc:1059] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.110s
I20260709 13:01:38.410601  7841 leader_election.cc:290] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 20 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:01:38.519200  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 100010us
W20260709 13:01:38.571620  7894 log.cc:927] Time spent T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:01:38.574162  7819 raft_consensus.cc:493] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.574739  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:38.570962  7823 raft_consensus.cc:493] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:38.581709  1526 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 21.
I20260709 13:01:38.596446  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:38.583007  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
W20260709 13:01:38.583778  7905 log.cc:927] Time spent T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:01:38.524703  7836 raft_consensus.cc:2804] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:38.525064  7861 leader_election.cc:290] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:01:38.587811  2224 rpcz_store.cc:269] 0709 13:01:35.117649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:35.119376 (+  1727us) service_pool.cc:224] Handling call
0709 13:01:38.537041 (+3417665us) spinlock_profiling.cc:243] Waited 2.7 s on lock 0x7b540002f654. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:01:38.537146 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6206863104}
I20260709 13:01:38.570706  7706 consensus_queue.cc:1048] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.003s
I20260709 13:01:38.593353  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:38.594563  2190 leader_election.cc:304] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:38.518741  7837 raft_consensus.cc:515] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:38.612591  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:38.615854  2219 raft_consensus.cc:3060] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:38.623353  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:38.624310  2226 raft_consensus.cc:2393] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 19: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:01:38.600770  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:38.616676  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:38.618798  1526 raft_consensus.cc:1240] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 19. Current term is 20. Ops: []
I20260709 13:01:38.518944  7817 raft_consensus.cc:515] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:38.620962  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 82867us
I20260709 13:01:38.633248  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:38.633934  2224 raft_consensus.cc:3060] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:38.638447  2219 raft_consensus.cc:2468] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 14.
I20260709 13:01:38.649345  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:38.534432  7829 raft_consensus.cc:515] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:38.619369  7900 raft_consensus.cc:3055] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:01:38.664330  1525 raft_consensus.cc:1240] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 13:01:38.614508  7836 raft_consensus.cc:493] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:38.662802  1530 raft_consensus.cc:2468] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 16.
I20260709 13:01:38.614078  7838 raft_consensus.cc:493] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:38.664937  1531 raft_consensus.cc:3060] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:38.687497  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:38.669606  1644 leader_election.cc:304] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:38.671741  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:38.688513  2219 raft_consensus.cc:2393] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 13: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:01:38.688825  1525 raft_consensus.cc:2393] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 20: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:01:38.672837  7740 leader_election.cc:290] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:38.673296  7873 consensus_queue.cc:1048] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:01:38.673678  2224 raft_consensus.cc:2468] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 14.
I20260709 13:01:38.674695  7825 leader_election.cc:290] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:01:38.675483  7911 log.cc:927] Time spent T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260709 13:01:38.712656  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:38.713907  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:38.630550  7884 raft_consensus.cc:3055] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:38.715056  7884 raft_consensus.cc:740] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:38.715267  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:38.715993  7884 consensus_queue.cc:260] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.14, Last appended by leader: 14, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:38.717077  7884 raft_consensus.cc:3060] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:38.644485  7886 raft_consensus.cc:2749] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:38.675904  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:38.630122  7819 raft_consensus.cc:515] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:38.720079  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:38.629719  7823 raft_consensus.cc:515] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:38.619561  7680 consensus_queue.cc:1059] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.058s
I20260709 13:01:38.722097  7680 raft_consensus.cc:3055] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:01:38.722465  7680 raft_consensus.cc:740] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:38.722896  7823 leader_election.cc:290] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:38.684425  7817 leader_election.cc:290] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:38.686116  7780 leader_election.cc:290] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:38.686825  1607 raft_consensus.cc:2468] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 13.
I20260709 13:01:38.660899  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:38.723373  7680 consensus_queue.cc:260] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:38.724329  1598 raft_consensus.cc:2393] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 20: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:01:38.593811  7875 raft_consensus.cc:515] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:38.724270  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:38.663969  7900 raft_consensus.cc:740] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:38.726581  7875 leader_election.cc:290] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:38.727473  7900 consensus_queue.cc:260] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:38.728331  7912 log.cc:927] Time spent T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 13:01:38.728844  7900 raft_consensus.cc:3060] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:38.699467  7873 raft_consensus.cc:2804] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:38.730075  7873 raft_consensus.cc:493] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:38.730480  7873 raft_consensus.cc:3060] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:38.693130  1601 raft_consensus.cc:1240] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:38.702952  7761 raft_consensus.cc:515] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:38.687227  7836 raft_consensus.cc:3060] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:01:38.705061  7790 consensus_meta.cc:287] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b: Time spent flushing consensus metadata: real 0.616s	user 0.010s	sys 0.000s
I20260709 13:01:38.743544  7790 raft_consensus.cc:515] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:38.700453  1644 leader_election.cc:304] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:38.700358  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:38.738930  7920 consensus_queue.cc:1059] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:01:38.793594  1524 raft_consensus.cc:2468] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 18.
I20260709 13:01:38.762378  2227 raft_consensus.cc:1275] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
W20260709 13:01:38.804703  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 104335us
I20260709 13:01:38.750715  1497 leader_election.cc:304] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:38.805511  1644 leader_election.cc:304] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
W20260709 13:01:38.805873  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 55262.7us
I20260709 13:01:38.764086  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:38.792162  1531 raft_consensus.cc:2410] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:01:38.753005  2192 leader_election.cc:304] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:38.748785  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43008 (request call id 2575) took 1148 ms. Trace:
I20260709 13:01:38.808699  1532 rpcz_store.cc:276] 0709 13:01:37.600283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:37.987934 (+387651us) service_pool.cc:224] Handling call
0709 13:01:38.008712 (+ 20778us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:38.172863 (+164151us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:38.748565 (+575702us) spinlock_profiling.cc:243] Waited 152 ms on lock 0x7b540015ca54. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:01:38.748729 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":349667200}
I20260709 13:01:38.716398  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:38.745601  1530 raft_consensus.cc:1240] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 21 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 20. Current term is 21. Ops: []
I20260709 13:01:38.801980  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:38.804037  1524 raft_consensus.cc:1240] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:38.801564  1526 raft_consensus.cc:1240] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 14. Current term is 15. Ops: [12.9-14.10]
I20260709 13:01:38.816525  1644 leader_election.cc:304] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:01:38.750914  7790 leader_election.cc:290] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 16 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:38.724681  7680 raft_consensus.cc:3060] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:38.762688  7818 raft_consensus.cc:3055] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:38.693811  7838 raft_consensus.cc:515] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:38.748571  7829 leader_election.cc:290] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:38.703725  7716 raft_consensus.cc:515] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:38.820570  7708 raft_consensus.cc:2749] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:38.827653  7716 leader_election.cc:290] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 19 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:38.821656  7831 raft_consensus.cc:2804] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:38.828394  7831 raft_consensus.cc:493] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:38.764325  1429 catalog_manager.cc:5697] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 10 to 12, leader changed from ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) to 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194). New cstate: current_term: 12 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:38.828778  7831 raft_consensus.cc:3060] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:38.828918  7848 consensus_queue.cc:1059] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:01:38.742368  7852 raft_consensus.cc:515] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:38.831014  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 78112.9us
I20260709 13:01:38.838551  1604 raft_consensus.cc:1275] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 13:01:38.700472  7735 consensus_meta.cc:287] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b: Time spent flushing consensus metadata: real 0.597s	user 0.008s	sys 0.001s
I20260709 13:01:38.721192  7819 leader_election.cc:290] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:38.829875  7848 raft_consensus.cc:3055] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:01:38.779157  7851 raft_consensus.cc:3055] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:01:38.848032  2218 raft_consensus.cc:1240] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:01:38.850376  1644 leader_election.cc:304] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:38.851279  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:38.852432  2192 leader_election.cc:304] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:38.852555  1523 raft_consensus.cc:1275] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:01:38.819541  7699 raft_consensus.cc:2749] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:01:38.855813  1530 raft_consensus.cc:1240] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:38.834728  7825 raft_consensus.cc:2764] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:01:38.843232  7909 raft_consensus.cc:2749] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:01:38.826776  7920 consensus_queue.cc:1243] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer 39a92f5a4352465d8af3af5908fe8642 log is divergent from this leader: its last log entry 18.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:01:38.854278  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:38.857054  1644 leader_election.cc:304] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:38.855211  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:38.871407  1598 raft_consensus.cc:2468] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 11.
I20260709 13:01:38.866236  2192 leader_election.cc:304] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:38.823037  7818 raft_consensus.cc:740] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:38.873167  1644 leader_election.cc:304] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:38.867269  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:38.759847  7778 consensus_queue.cc:1059] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.094s
I20260709 13:01:38.871536  1603 raft_consensus.cc:3060] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:38.825069  7838 leader_election.cc:290] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:38.873283  2192 leader_election.cc:304] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:38.865749  7819 raft_consensus.cc:3060] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:38.876673  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:38.884159  1523 raft_consensus.cc:2468] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 19.
I20260709 13:01:38.825203  7873 raft_consensus.cc:515] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:38.886620  7873 leader_election.cc:290] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:38.868880  7855 raft_consensus.cc:2749] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:01:38.887589  7855 raft_consensus.cc:2749] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:01:38.889838  7852 leader_election.cc:290] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:38.890215  7761 leader_election.cc:290] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 14 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:38.890921  7919 raft_consensus.cc:3060] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:38.851841  7735 raft_consensus.cc:515] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:38.892246  1603 raft_consensus.cc:2468] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 14.
I20260709 13:01:38.852335  7851 raft_consensus.cc:740] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:38.895772  7851 consensus_queue.cc:260] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:38.897084  7851 raft_consensus.cc:3060] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:38.898804  2219 raft_consensus.cc:1275] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 12 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:01:38.899948  7778 raft_consensus.cc:3055] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:38.900393  7778 raft_consensus.cc:740] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:38.843603  7886 consensus_queue.cc:1059] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 13:01:38.901394  7886 raft_consensus.cc:3055] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:38.901183  7778 consensus_queue.cc:260] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:38.901811  7886 raft_consensus.cc:740] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:38.902731  7920 raft_consensus.cc:3060] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:01:38.880471  7897 log.cc:927] Time spent T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.840s	user 0.001s	sys 0.006s
I20260709 13:01:38.844985  7829 consensus_queue.cc:1059] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 13:01:38.880990  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:38.870431  7898 consensus_queue.cc:1059] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.012s
I20260709 13:01:38.851601  7848 raft_consensus.cc:740] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:38.851586  7773 consensus_queue.cc:1059] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 13:01:38.904189  7906 raft_consensus.cc:2749] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:01:38.911270  7848 consensus_queue.cc:260] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:38.912616  7848 raft_consensus.cc:3060] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:38.908806  7836 raft_consensus.cc:515] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:38.913460  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:38.917281  7845 raft_consensus.cc:3060] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:38.919595  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:38.920310  1681 raft_consensus.cc:2468] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 11.
I20260709 13:01:38.923113  1572 leader_election.cc:304] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:38.919754  7829 raft_consensus.cc:3055] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:01:38.925057  7829 raft_consensus.cc:740] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:38.907363  1570 leader_election.cc:304] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:38.902547  7778 raft_consensus.cc:3060] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:38.928624  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:38.929296  2222 raft_consensus.cc:2468] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 11.
I20260709 13:01:38.929718  2225 raft_consensus.cc:1240] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 14. Current term is 15. Ops: [14.14-14.14]
I20260709 13:01:38.930210  2219 raft_consensus.cc:1240] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 21 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 20. Current term is 21. Ops: []
I20260709 13:01:38.928519  2220 raft_consensus.cc:1240] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 13. Current term is 14. Ops: [13.14-13.14]
I20260709 13:01:38.932895  2221 raft_consensus.cc:1240] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:38.935400  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:38.938700  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:38.941896  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:38.942243  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:38.943814  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:38.947460  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:38.948738  1646 leader_election.cc:304] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:01:38.951968  2227 raft_consensus.cc:1240] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 18. Current term is 19. Ops: []
I20260709 13:01:38.955503  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:38.958194  1673 raft_consensus.cc:1240] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:38.912774  7735 leader_election.cc:290] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 19 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:38.968634  2191 leader_election.cc:304] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:38.968724  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:38.967335  1528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43008 (request call id 2574) took 1371 ms. Trace:
I20260709 13:01:38.970598  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:38.971966  2191 leader_election.cc:304] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:38.971560  1528 rpcz_store.cc:276] 0709 13:01:37.595995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:37.807079 (+211084us) service_pool.cc:224] Handling call
0709 13:01:37.807407 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:37.822202 (+ 14795us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:37.822230 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:37.827809 (+  5579us) log.cc:844] Serialized 26 byte log entry
0709 13:01:37.887752 (+ 59943us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:37.887881 (+   129us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:37.887948 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:38.879889 (+991941us) spinlock_profiling.cc:243] Waited 2.45 ms on lock 0x7b4400022b4c. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a153ecc85 00007f6a153ed6a2 00007f6a1815f1db 00007f6a1815aaaf 00007f6a1814e86e 00007f6a1814dbb6 00007f6a1814d7d8 00007f6a18157221 00007f6a181571d9 00007f6a18157169
0709 13:01:38.952766 (+ 72877us) raft_consensus.cc:1685] finished
0709 13:01:38.952785 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:38.967261 (+ 14476us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9315,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":9289,"spinlock_wait_cycles":5636864,"thread_start_us":23302,"threads_started":1,"wal-append.queue_time_us":187031}
I20260709 13:01:38.965372  1497 leader_election.cc:304] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:38.973927  7852 raft_consensus.cc:2804] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:38.971113  1644 leader_election.cc:304] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:38.971009  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:38.975376  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:38.930728  7826 leader_election.cc:290] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:38.979610  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:38.945590  7820 raft_consensus.cc:2749] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:01:38.976584  1677 raft_consensus.cc:1240] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:38.968693  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:38.976389  1497 leader_election.cc:304] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:38.978518  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:38.948496  7784 raft_consensus.cc:2804] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:38.982143  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:38.979529  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:38.974442  7852 raft_consensus.cc:697] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:38.977228  1674 raft_consensus.cc:1240] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 22 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 21. Current term is 22. Ops: []
W20260709 13:01:38.996273  2193 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:39.010294  2191 leader_election.cc:304] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:39.014350  1604 raft_consensus.cc:1240] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:39.012789  1644 leader_election.cc:304] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:39.011899  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:38.959098  7827 raft_consensus.cc:493] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:39.015753  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:39.013449  7838 raft_consensus.cc:2749] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:01:39.012825  7857 consensus_queue.cc:1059] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.009s
I20260709 13:01:39.018299  7900 raft_consensus.cc:493] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:38.948979  7440 consensus_queue.cc:1048] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.057s
I20260709 13:01:39.018898  7900 raft_consensus.cc:515] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:01:39.019644  7910 log.cc:927] Time spent T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.503s	user 0.004s	sys 0.000s
I20260709 13:01:39.021055  7900 leader_election.cc:290] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:39.021667  1497 leader_election.cc:304] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:39.022112  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:39.022563  7838 raft_consensus.cc:2749] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:01:39.022738  7836 leader_election.cc:290] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:39.024178  1497 leader_election.cc:304] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:39.024976  7836 raft_consensus.cc:2749] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:01:39.025719  7837 leader_election.cc:290] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:39.026948  1497 leader_election.cc:304] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:38.979218  7844 consensus_queue.cc:1048] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.048s
I20260709 13:01:39.027658  7827 raft_consensus.cc:515] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:38.944762  7750 consensus_queue.cc:1059] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.039s
I20260709 13:01:38.976794  7884 raft_consensus.cc:2804] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:39.031512  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:39.067689  7884 raft_consensus.cc:493] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:39.043596  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:39.068136  7884 raft_consensus.cc:3060] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:39.068552  1605 raft_consensus.cc:2468] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 19.
I20260709 13:01:39.044727  7909 consensus_queue.cc:1059] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:01:39.046933  7844 raft_consensus.cc:3055] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:01:39.069413  7844 raft_consensus.cc:740] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:38.970016  7863 consensus_queue.cc:1048] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.101s
I20260709 13:01:39.030925  7620 consensus_queue.cc:1059] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 13:01:38.952518  7616 consensus_queue.cc:1059] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 17.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 13:01:38.957741  7632 consensus_queue.cc:1059] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 13:01:39.012436  7825 raft_consensus.cc:2749] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:01:39.051568  7817 raft_consensus.cc:2804] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:39.073067  7817 raft_consensus.cc:697] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:39.073922  7881 raft_consensus.cc:3055] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:01:39.074368  7881 raft_consensus.cc:740] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:39.075162  7881 consensus_queue.cc:260] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:39.076392  7881 raft_consensus.cc:3060] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:39.013767  7826 consensus_queue.cc:1059] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.038s
I20260709 13:01:39.077570  7826 raft_consensus.cc:3055] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:01:39.077922  7826 raft_consensus.cc:740] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:39.053763  7857 raft_consensus.cc:2749] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:01:39.051234  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:39.079493  1675 raft_consensus.cc:2393] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 19: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:01:38.905655  7886 consensus_queue.cc:260] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:39.055285  2227 raft_consensus.cc:1240] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:01:39.080377  7575 raft_consensus.cc:3055] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:39.011516  7784 raft_consensus.cc:493] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:39.054819  1644 leader_election.cc:304] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:39.057618  7852 consensus_queue.cc:237] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:39.041745  7885 raft_consensus.cc:2749] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:01:38.983654  7829 consensus_queue.cc:260] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:39.062759  1602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36200 (request call id 3008) took 1161 ms. Trace:
I20260709 13:01:38.983659  7906 raft_consensus.cc:2804] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:38.985775  7708 consensus_queue.cc:1059] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.081s
I20260709 13:01:38.976055  7898 consensus_queue.cc:1059] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.091s
I20260709 13:01:39.070245  7844 consensus_queue.cc:260] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:39.081650  1526 raft_consensus.cc:1240] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:39.059793  7831 raft_consensus.cc:515] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:39.081527  1602 rpcz_store.cc:276] 0709 13:01:37.900883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:37.901298 (+   415us) service_pool.cc:224] Handling call
0709 13:01:37.901588 (+   290us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:37.901945 (+   357us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:37.901973 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:38.538513 (+636540us) spinlock_profiling.cc:243] Waited 43.8 ms on lock 0x7b2c0012a788. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a16eaca11 00007f6a16ebc372 00007f6a185eea01 00007f6a185b343a 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2
0709 13:01:38.565720 (+ 27207us) log.cc:844] Serialized 26 byte log entry
0709 13:01:38.854082 (+288362us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:38.854117 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:38.854176 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:39.062444 (+208268us) raft_consensus.cc:1685] finished
0709 13:01:39.062464 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:39.062696 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10,"raft.queue_time_us":498,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":85,"spinlock_wait_cycles":100840320,"thread_start_us":225049,"threads_started":1,"wal-append.queue_time_us":387081}
I20260709 13:01:39.072350  7922 raft_consensus.cc:3055] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:01:39.086835  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 71681.2us
I20260709 13:01:39.088634  1644 leader_election.cc:304] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:38.985061  7735 raft_consensus.cc:2749] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:01:39.080288  7886 raft_consensus.cc:3060] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:39.094696  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:39.054483  7919 raft_consensus.cc:2749] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:01:39.096529  2190 leader_election.cc:304] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:38.984092  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:39.080773  7575 raft_consensus.cc:740] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:39.088199  7906 raft_consensus.cc:493] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:39.100915  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 227698us
I20260709 13:01:39.137333  2192 leader_election.cc:304] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:39.102792  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:39.138235  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:39.081000  7784 raft_consensus.cc:3060] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:39.115710  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:39.140563  1646 leader_election.cc:304] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:39.092792  7883 raft_consensus.cc:2804] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:01:39.098035  2224 raft_consensus.cc:1240] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 13:01:39.148972  1678 raft_consensus.cc:2468] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 20.
I20260709 13:01:39.095916  7440 raft_consensus.cc:493] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.106128  1602 raft_consensus.cc:1240] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 18. Current term is 19. Ops: []
I20260709 13:01:39.164361  1600 raft_consensus.cc:1240] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 15 LEADER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 14. Current term is 15. Ops: [14.14-14.14]
I20260709 13:01:39.145212  1680 raft_consensus.cc:1240] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:39.131721  7819 raft_consensus.cc:2749] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:01:39.162065  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:39.164654  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 48127.4us
I20260709 13:01:39.168474  1678 raft_consensus.cc:1275] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:01:39.170349  7827 leader_election.cc:290] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:01:39.170783  1606 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57268 (request call id 1373) took 1270 ms (client timeout 1561 ms). Trace:
W20260709 13:01:39.171233  1606 rpcz_store.cc:269] 0709 13:01:37.893452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:37.894244 (+   792us) service_pool.cc:224] Handling call
0709 13:01:39.163814 (+1269570us) spinlock_profiling.cc:243] Waited 513 ms on lock 0x7b5400364a54. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:01:39.163948 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1179015936}
I20260709 13:01:39.095799  7710 consensus_queue.cc:1059] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.071s
I20260709 13:01:39.168035  7790 raft_consensus.cc:2764] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader election decision vote started in defunct term 13: won
I20260709 13:01:39.177861  1496 leader_election.cc:304] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:39.144117  7680 raft_consensus.cc:2749] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:39.179302  1496 leader_election.cc:304] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:39.096063  7763 consensus_queue.cc:1059] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.070s
I20260709 13:01:39.180107  7823 raft_consensus.cc:2749] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:01:39.180395  7763 raft_consensus.cc:3055] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:39.180833  7823 raft_consensus.cc:2749] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:01:39.182305  1496 leader_election.cc:304] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:39.182531  7831 leader_election.cc:290] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:39.090763  7146 consensus_queue.cc:1059] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.092s
I20260709 13:01:39.142001  7920 raft_consensus.cc:2749] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:39.183612  1646 leader_election.cc:304] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:39.184090  7625 consensus_queue.cc:1059] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:39.184542  1676 raft_consensus.cc:1275] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 15 index: 14. (term mismatch)
I20260709 13:01:39.158407  7873 consensus_queue.cc:1059] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.027s
I20260709 13:01:39.184873  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:39.210870  1676 pending_rounds.cc:85] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90: Aborting all ops after (but not including) 13
I20260709 13:01:39.160951  7632 raft_consensus.cc:3055] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:39.211184  1676 pending_rounds.cc:107] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90: Aborting uncommitted NO_OP operation due to leader change: 14.14
I20260709 13:01:39.090440  7826 consensus_queue.cc:260] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:39.211467  1676 raft_consensus.cc:2889] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:39.187872  1675 raft_consensus.cc:1240] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:39.145716  7906 raft_consensus.cc:3060] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:39.145263  7706 raft_consensus.cc:2749] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:39.193930  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:39.194753  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:39.194682  1571 leader_election.cc:304] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:39.180791  7763 raft_consensus.cc:740] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:39.200649  1570 leader_election.cc:304] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:39.200649  1496 leader_election.cc:304] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:39.183672  7708 raft_consensus.cc:2749] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:01:39.157387  7735 raft_consensus.cc:493] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
W20260709 13:01:39.227111  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 43581.5us
I20260709 13:01:39.228927  1646 leader_election.cc:304] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:39.102483  7922 raft_consensus.cc:740] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:39.073951  7817 consensus_queue.cc:237] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 12.13, Last appended by leader: 13, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:39.216779  1681 raft_consensus.cc:1240] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:39.203253  7823 consensus_queue.cc:1059] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.020s
I20260709 13:01:39.223189  1496 leader_election.cc:304] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:01:39.146570  7844 raft_consensus.cc:3060] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:39.216436  1673 raft_consensus.cc:2468] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 12.
I20260709 13:01:39.203043  7699 raft_consensus.cc:2749] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:39.161342  7883 raft_consensus.cc:493] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:39.239259  1607 raft_consensus.cc:1240] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:39.243106  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:39.239611  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:39.241842  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:39.244401  1599 raft_consensus.cc:3060] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:39.215703  7632 raft_consensus.cc:740] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:39.193341  7440 raft_consensus.cc:515] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:39.246904  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:39.247637  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:39.221441  7821 raft_consensus.cc:3055] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:39.245910  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:39.255131  1523 raft_consensus.cc:2393] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 17: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:01:39.204530  7645 consensus_queue.cc:1048] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 13:01:39.250403  2192 leader_election.cc:304] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:39.244478  1497 leader_election.cc:304] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:39.233271  7919 raft_consensus.cc:2749] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:01:39.290321  1599 raft_consensus.cc:2468] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 16.
I20260709 13:01:39.300565  1602 raft_consensus.cc:1240] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:39.233091  7716 consensus_queue.cc:1059] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:01:39.280311  1497 leader_election.cc:304] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:39.226475  7838 raft_consensus.cc:2749] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:01:39.232595  7880 raft_consensus.cc:2749] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:39.278515  1606 raft_consensus.cc:2468] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 19.
I20260709 13:01:39.290993  2192 leader_election.cc:304] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:39.224961  7625 raft_consensus.cc:2749] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:01:39.280661  7916 log.cc:927] Time spent T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:01:39.258351  7821 raft_consensus.cc:740] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:39.248682  7836 raft_consensus.cc:2804] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:01:39.251848  7819 raft_consensus.cc:2749] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:01:39.329362  7440 leader_election.cc:290] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:39.329861  7716 raft_consensus.cc:2749] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:39.330545  7837 raft_consensus.cc:3055] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:39.302075  7925 raft_consensus.cc:2749] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:39.309607  7778 consensus_queue.cc:1059] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.022s
I20260709 13:01:39.325227  7680 raft_consensus.cc:2749] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:01:39.339298  7857 raft_consensus.cc:3055] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:39.251391  7883 raft_consensus.cc:3060] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:39.340837  7784 raft_consensus.cc:515] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:39.237123  7735 raft_consensus.cc:515] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:39.243912  7863 consensus_queue.cc:1048] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.082s
I20260709 13:01:39.330793  7632 consensus_queue.cc:260] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:39.325435  7922 consensus_queue.cc:260] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:39.357342  7884 raft_consensus.cc:515] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:39.384234  1570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:39.350556  7837 raft_consensus.cc:740] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:39.392107  1677 raft_consensus.cc:1275] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 14. (term mismatch)
I20260709 13:01:39.394860  1677 pending_rounds.cc:85] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90: Aborting all ops after (but not including) 13
I20260709 13:01:39.395119  1677 pending_rounds.cc:107] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90: Aborting uncommitted NO_OP operation due to leader change: 17.14
I20260709 13:01:39.395370  1677 raft_consensus.cc:2889] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:39.392781  1603 raft_consensus.cc:2393] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 17: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:01:39.359758  7836 raft_consensus.cc:697] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:39.361159  7773 raft_consensus.cc:2749] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:39.308492  7763 consensus_queue.cc:260] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:39.361234  7857 raft_consensus.cc:740] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:39.372776  7765 raft_consensus.cc:493] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.408614  7818 consensus_queue.cc:260] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:39.415683  1600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36200 (request call id 3006) took 1522 ms. Trace:
I20260709 13:01:39.416189  1600 rpcz_store.cc:276] 0709 13:01:37.893693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:37.894084 (+   391us) service_pool.cc:224] Handling call
0709 13:01:39.164096 (+1270012us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:39.164793 (+   697us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:39.415443 (+250650us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b5400364a50. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b28ad 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:01:39.415612 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2863948672}
W20260709 13:01:39.452414  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 219409us
W20260709 13:01:39.457295  7907 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.025s	sys 0.040s
W20260709 13:01:39.457744  7907 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.723s	user 0.025s	sys 0.040s
I20260709 13:01:39.405817  7632 raft_consensus.cc:3060] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:39.398196  7845 consensus_queue.cc:1048] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.056s
I20260709 13:01:39.404874  7848 raft_consensus.cc:493] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
W20260709 13:01:39.465482  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:39.463474  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 183263us
I20260709 13:01:39.468407  7848 raft_consensus.cc:515] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:39.484158  7784 leader_election.cc:290] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:39.459792  7837 consensus_queue.cc:260] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:39.485826  7848 leader_election.cc:290] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:39.486307  7837 raft_consensus.cc:3060] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:39.467901  7857 consensus_queue.cc:260] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:39.490100  7857 raft_consensus.cc:3060] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:39.490337  7823 raft_consensus.cc:493] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:39.491014  7823 raft_consensus.cc:515] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:39.493451  7823 leader_election.cc:290] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:39.468809  7907 raft_consensus.cc:3055] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:39.495010  7907 raft_consensus.cc:740] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:39.496232  7884 leader_election.cc:290] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:39.496059  7907 consensus_queue.cc:260] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:39.497222  7907 raft_consensus.cc:3060] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:39.439786  7765 raft_consensus.cc:515] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:39.499485  7765 leader_election.cc:290] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:01:39.503655  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 249683us
I20260709 13:01:39.506831  7837 consensus_queue.cc:1059] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:39.506563  1497 leader_election.cc:304] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:39.508643  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:39.512039  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:39.514431  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:39.515120  1607 raft_consensus.cc:3060] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:39.517642  1601 raft_consensus.cc:1240] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 13:01:39.508639  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:39.459065  7763 raft_consensus.cc:3060] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:39.521107  7941 raft_consensus.cc:493] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:39.521699  7941 raft_consensus.cc:515] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:39.523072  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:39.523910  7941 leader_election.cc:290] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:39.405656  7821 consensus_queue.cc:260] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:39.525413  7575 consensus_queue.cc:260] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.14, Last appended by leader: 14, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:39.526291  7821 raft_consensus.cc:3060] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:39.526582  7823 raft_consensus.cc:2749] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:01:39.527791  1497 leader_election.cc:304] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:39.528724  1497 leader_election.cc:304] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
W20260709 13:01:39.530577  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:39.509584  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:39.512802  2222 raft_consensus.cc:2393] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 14: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:01:39.533658  7836 consensus_queue.cc:237] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:39.536808  7823 raft_consensus.cc:2804] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:39.491531  7735 leader_election.cc:290] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:39.537423  7823 raft_consensus.cc:697] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:39.538323  7823 consensus_queue.cc:237] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:39.544247  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 76442.4us
I20260709 13:01:39.545409  1571 leader_election.cc:304] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:39.545527  1570 leader_election.cc:304] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:39.545847  1607 raft_consensus.cc:2468] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 12.
I20260709 13:01:39.547184  2191 leader_election.cc:304] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:39.549291  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:39.551337  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:39.552044  1673 raft_consensus.cc:2468] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 20.
I20260709 13:01:39.555294  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:39.556181  2222 raft_consensus.cc:2393] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 16: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
W20260709 13:01:39.560662  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 47164.8us
I20260709 13:01:39.559475  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:39.567660  2221 raft_consensus.cc:2393] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 19: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:01:39.572021  1571 leader_election.cc:304] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:39.559554  7941 raft_consensus.cc:2804] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:01:39.587042  7941 raft_consensus.cc:697] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:39.588034  7941 consensus_queue.cc:237] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:39.577736  1570 leader_election.cc:304] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:39.574673  1572 leader_election.cc:304] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:39.563072  7784 raft_consensus.cc:2804] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:39.578910  7625 raft_consensus.cc:2749] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:39.583048  1673 raft_consensus.cc:1240] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:39.584581  7906 raft_consensus.cc:515] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:39.558992  7886 consensus_queue.cc:1059] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 13:01:39.560714  1497 leader_election.cc:304] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
W20260709 13:01:39.617132  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 56623.9us
I20260709 13:01:39.558691  7928 consensus_queue.cc:1048] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.039s
I20260709 13:01:39.625718  1646 leader_election.cc:304] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:39.631194  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:39.633317  1523 raft_consensus.cc:1240] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:39.646342  1570 leader_election.cc:304] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:39.647485  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:39.624946  7820 raft_consensus.cc:3060] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:39.622797  7784 raft_consensus.cc:697] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 12 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:39.629065  7740 raft_consensus.cc:3055] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:39.598992  7940 raft_consensus.cc:2804] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:01:39.624176  7886 raft_consensus.cc:3055] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:39.623207  7773 raft_consensus.cc:3060] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:39.624569  7616 raft_consensus.cc:3060] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:39.642840  7710 raft_consensus.cc:2804] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:39.667341  7735 raft_consensus.cc:2749] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:01:39.670501  2192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:39.623484  7816 consensus_queue.cc:1059] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 13:01:39.648617  7880 raft_consensus.cc:493] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.690076  1601 raft_consensus.cc:1240] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 18. Current term is 19. Ops: []
I20260709 13:01:39.670106  7848 raft_consensus.cc:2749] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:01:39.680488  7940 raft_consensus.cc:493] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:39.682317  7625 raft_consensus.cc:493] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.680783  7740 raft_consensus.cc:740] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
W20260709 13:01:39.742370  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:39.682170  7886 raft_consensus.cc:740] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
W20260709 13:01:39.751927  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 97697us
I20260709 13:01:39.669891  7745 consensus_queue.cc:1059] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.063s
W20260709 13:01:39.768378  7936 log.cc:927] Time spent T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.170s	user 0.001s	sys 0.000s
I20260709 13:01:39.756690  7625 raft_consensus.cc:515] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:39.771621  7625 leader_election.cc:290] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:39.748405  7940 raft_consensus.cc:3060] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:39.774926  7831 consensus_queue.cc:1059] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:01:39.775714  7886 consensus_queue.cc:260] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:39.776995  7886 raft_consensus.cc:3060] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:39.779356  7906 leader_election.cc:290] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:39.733460  7710 raft_consensus.cc:697] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 12 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
W20260709 13:01:39.766472  7932 log.cc:927] Time spent T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:01:39.791664  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 13:01:39.782815  7943 log.cc:927] Time spent T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
W20260709 13:01:39.793912  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:39.792371  2221 raft_consensus.cc:2468] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 16.
W20260709 13:01:39.796947  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:39.783638  7784 consensus_queue.cc:237] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:39.804957  7710 consensus_queue.cc:237] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:39.744073  7880 raft_consensus.cc:515] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:39.816735  7820 raft_consensus.cc:2749] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:39.824363  7940 raft_consensus.cc:515] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:39.820179  7740 consensus_queue.cc:260] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:39.829697  7883 raft_consensus.cc:515] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:39.846437  7740 raft_consensus.cc:3060] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:39.848750  7826 raft_consensus.cc:3060] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:39.851176  7699 raft_consensus.cc:3055] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:01:39.849807  7880 leader_election.cc:290] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:39.849406  7883 leader_election.cc:290] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 20 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:39.850399  7773 raft_consensus.cc:2749] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:39.850044  7922 raft_consensus.cc:3060] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:39.849072  7940 leader_election.cc:290] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 21 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:39.848347  7616 raft_consensus.cc:2749] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:39.923050  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:39.924937  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:39.926579  1604 raft_consensus.cc:1240] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:39.927897  1601 raft_consensus.cc:1275] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:01:39.936476  1572 leader_election.cc:304] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:01:39.942682  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
W20260709 13:01:39.959519  2191 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:40.068100  7887 consensus_queue.cc:1059] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:01:39.982973  1495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:40.075304  7940 raft_consensus.cc:493] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:40.076177  7940 raft_consensus.cc:515] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:40.078401  1598 raft_consensus.cc:1275] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:01:40.078648  7955 raft_consensus.cc:493] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:40.079523  7955 raft_consensus.cc:515] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:39.984215  1429 catalog_manager.cc:5697] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:39.990717  1531 raft_consensus.cc:1240] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:39.994251  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:39.995222  2218 raft_consensus.cc:1240] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 13. Current term is 14. Ops: [13.14-13.14]
I20260709 13:01:39.995669  1528 raft_consensus.cc:1240] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 LEADER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:40.083704  1646 leader_election.cc:304] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:40.084560  7818 raft_consensus.cc:3060] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:40.087229  7825 raft_consensus.cc:3055] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:40.087793  7825 raft_consensus.cc:740] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:40.088531  7829 raft_consensus.cc:3060] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:40.089217  7825 consensus_queue.cc:260] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:39.999301  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:40.000540  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:40.091619  1677 raft_consensus.cc:2468] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 16.
I20260709 13:01:40.001519  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:40.006058  1678 raft_consensus.cc:1240] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:40.006942  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:40.009382  2220 raft_consensus.cc:1240] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:01:40.071732  2219 raft_consensus.cc:1275] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:01:40.017290  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:40.018237  1527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49310 (request call id 1666) took 1654 ms. Trace:
I20260709 13:01:39.880038  7625 raft_consensus.cc:3055] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:40.103641  7625 raft_consensus.cc:740] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:40.105005  7625 consensus_queue.cc:260] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:40.112284  1523 raft_consensus.cc:2468] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 16.
I20260709 13:01:40.114941  7598 raft_consensus.cc:2749] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:01:40.115219  7875 raft_consensus.cc:3055] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:01:40.115779  7875 raft_consensus.cc:740] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:39.861531  7699 raft_consensus.cc:740] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:39.850739  7819 raft_consensus.cc:3055] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:01:40.117388  7699 consensus_queue.cc:260] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:40.118369  7819 raft_consensus.cc:740] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:40.119619  1680 raft_consensus.cc:2468] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 19.
I20260709 13:01:40.064781  7886 raft_consensus.cc:493] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:40.122216  7886 raft_consensus.cc:515] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:40.015410  2227 raft_consensus.cc:1240] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 21 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 20. Current term is 21. Ops: []
I20260709 13:01:40.093626  1527 rpcz_store.cc:276] 0709 13:01:38.363994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.720933 (+356939us) service_pool.cc:224] Handling call
0709 13:01:38.746102 (+ 25169us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:38.746430 (+   328us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:38.746459 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:38.746931 (+   472us) log.cc:844] Serialized 26 byte log entry
0709 13:01:38.972367 (+225436us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:38.972413 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:38.972486 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:39.177930 (+205444us) raft_consensus.cc:1685] finished
0709 13:01:39.177951 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:40.017717 (+839766us) spinlock_profiling.cc:243] Waited 24.8 ms on lock 0x7b54002ed6d0. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b28ad 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:01:40.018038 (+   321us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5626,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":3801,"spinlock_wait_cycles":57111424,"thread_start_us":225089,"threads_started":1,"wal-append.queue_time_us":428736}
I20260709 13:01:39.961876  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:40.069554  7750 consensus_queue.cc:1048] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.026s
I20260709 13:01:40.126120  2222 raft_consensus.cc:2393] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 12: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:01:40.089331  7620 raft_consensus.cc:3055] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:01:40.129556  7620 raft_consensus.cc:740] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:40.131624  1599 raft_consensus.cc:2393] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 12: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:01:40.131280  7620 consensus_queue.cc:260] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:40.132977  7939 log.cc:927] Time spent T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.464s	user 0.004s	sys 0.000s
I20260709 13:01:40.135736  7750 raft_consensus.cc:2804] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:40.136443  7750 raft_consensus.cc:493] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:40.136914  7750 raft_consensus.cc:3060] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:40.069455  7906 consensus_queue.cc:1059] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.069s
W20260709 13:01:40.130581  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 194572us
I20260709 13:01:40.148523  1496 leader_election.cc:304] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
W20260709 13:01:40.132896  7706 consensus_queue.cc:1175] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b96ce9cc496c49d7818fa983a17b062b" responder_term: 21 status { last_received { term: 20 index: 13 } last_committed_idx: 13 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 20. Current term is 21. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:01:40.125615  7825 raft_consensus.cc:3060] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:01:40.151044  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 47947us
I20260709 13:01:40.150051  7823 raft_consensus.cc:2804] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:40.094168  7955 leader_election.cc:290] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:40.167119  7906 raft_consensus.cc:3055] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:40.150548  1496 leader_election.cc:304] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:40.167580  7906 raft_consensus.cc:740] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:40.158241  7625 raft_consensus.cc:3060] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:40.153151  7958 raft_consensus.cc:493] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:40.174569  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:40.176259  2227 raft_consensus.cc:1275] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:01:40.178445  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:40.150040  7875 consensus_queue.cc:260] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 8, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:40.184082  1680 raft_consensus.cc:3060] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:40.168708  7823 raft_consensus.cc:493] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
W20260709 13:01:40.184871  2192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:40.187085  7836 raft_consensus.cc:2804] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:01:40.187489  7716 raft_consensus.cc:493] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:40.190887  7699 raft_consensus.cc:3060] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:01:40.197419  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 71007us
W20260709 13:01:40.203914  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:40.210412  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:40.215430  7716 raft_consensus.cc:515] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:40.215991  1678 raft_consensus.cc:2468] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 17.
I20260709 13:01:40.218151  7716 leader_election.cc:290] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:40.193718  7836 raft_consensus.cc:493] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:40.219796  7836 raft_consensus.cc:3060] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:40.180904  7886 leader_election.cc:290] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:40.193840  7823 raft_consensus.cc:3060] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:40.224615  7819 consensus_queue.cc:260] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:40.228579  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:40.229451  1601 raft_consensus.cc:3060] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:40.237021  1429 catalog_manager.cc:5697] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 10 to 12, leader changed from ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) to 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194). New cstate: current_term: 12 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:40.238992  1429 catalog_manager.cc:5697] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 11 to 12, leader changed from b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 12 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:01:40.242877  7575 raft_consensus.cc:3060] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:40.245472  7765 raft_consensus.cc:3055] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:01:40.252182  7765 raft_consensus.cc:740] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:40.223781  7906 consensus_queue.cc:260] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:40.253407  7765 consensus_queue.cc:260] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:40.271772  7765 raft_consensus.cc:3060] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:40.277448  1529 raft_consensus.cc:1240] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 21 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 20. Current term is 21. Ops: []
I20260709 13:01:40.272188  7620 raft_consensus.cc:3060] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:40.279982  7875 raft_consensus.cc:3060] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:40.283215  7906 raft_consensus.cc:3060] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:01:40.256880  7817 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.707s	user 0.008s	sys 0.012s
I20260709 13:01:40.192269  7958 raft_consensus.cc:515] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:40.264350  7935 raft_consensus.cc:493] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:40.265143  7856 raft_consensus.cc:493] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:40.266163  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:01:40.270292  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 119951us
I20260709 13:01:40.286736  1680 raft_consensus.cc:2468] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 21.
I20260709 13:01:40.296247  7935 raft_consensus.cc:515] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:40.298053  7645 raft_consensus.cc:493] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:40.298694  7645 raft_consensus.cc:515] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:40.299023  7856 raft_consensus.cc:515] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:40.299769  7819 raft_consensus.cc:3060] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:40.301007  7645 leader_election.cc:290] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:40.301347  7856 leader_election.cc:290] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:01:40.290580  7817 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.832s	user 0.008s	sys 0.012s
I20260709 13:01:40.312295  7958 leader_election.cc:290] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:40.314553  2190 leader_election.cc:304] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:40.312357  7817 raft_consensus.cc:493] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:40.315526  7817 raft_consensus.cc:515] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:40.316752  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:40.317391  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:40.317831  7817 leader_election.cc:290] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:40.319619  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:40.320374  1532 raft_consensus.cc:2468] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 17.
I20260709 13:01:40.322285  7935 leader_election.cc:290] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:40.304546  7940 leader_election.cc:290] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:40.326836  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:40.327499  1678 raft_consensus.cc:2468] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 15.
W20260709 13:01:40.329231  1646 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:40.330159  1601 raft_consensus.cc:2468] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 20.
I20260709 13:01:40.331118  7940 raft_consensus.cc:493] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:40.331717  7940 raft_consensus.cc:515] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:40.333949  7940 leader_election.cc:290] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:40.334551  7461 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:40.335208  7461 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:40.338038  1570 leader_election.cc:304] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:40.339740  1532 raft_consensus.cc:1240] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 LEADER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 13. Current term is 14. Ops: [13.14-13.14]
I20260709 13:01:40.357142  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:01:40.359366  7963 log.cc:927] Time spent T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:01:40.338099  7461 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:40.355609  7817 consensus_queue.cc:1048] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 13:01:40.325819  7645 raft_consensus.cc:2749] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:01:40.309576  7829 raft_consensus.cc:493] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
W20260709 13:01:40.373217  1495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:40.374545  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 66496.5us
I20260709 13:01:40.376994  2191 leader_election.cc:304] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:40.386996  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:40.380330  7940 raft_consensus.cc:2804] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:40.389379  7940 raft_consensus.cc:493] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:40.389796  7940 raft_consensus.cc:3060] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:01:40.392246  7962 log.cc:927] Time spent T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.102s	user 0.004s	sys 0.000s
W20260709 13:01:40.394070  1427 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46258 (request call id 345) took 29130 ms (client timeout 15000 ms). Trace:
I20260709 13:01:40.395164  7680 raft_consensus.cc:2749] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:40.356145  7716 consensus_queue.cc:1048] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 13:01:40.400199  2190 leader_election.cc:304] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:40.397910  2191 leader_election.cc:304] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:40.404166  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:40.412568  1678 raft_consensus.cc:2468] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 20.
I20260709 13:01:40.416746  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 13:01:40.417028  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:40.417637  7773 consensus_queue.cc:1048] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 13:01:40.415447  7887 raft_consensus.cc:2804] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:40.420698  7887 raft_consensus.cc:493] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:40.420866  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:40.415246  7886 raft_consensus.cc:2749] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:01:40.420387  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:40.423887  1527 raft_consensus.cc:1240] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:40.424376  1523 raft_consensus.cc:1240] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 17. Current term is 18. Ops: []
I20260709 13:01:40.423173  1429 catalog_manager.cc:5697] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 5 to 13. New cstate: current_term: 13 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:01:40.428360  7887 raft_consensus.cc:3060] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:40.432514  1528 raft_consensus.cc:2393] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 17: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:01:40.388088  7829 raft_consensus.cc:515] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:40.436520  7829 leader_election.cc:290] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:40.439844  1571 leader_election.cc:304] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:40.441136  7935 raft_consensus.cc:2804] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:40.441608  7935 raft_consensus.cc:493] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:40.441974  7935 raft_consensus.cc:3060] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:40.447103  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:40.447009  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:40.448729  1674 raft_consensus.cc:1240] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 20 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 19. Current term is 20. Ops: []
I20260709 13:01:40.452378  1532 raft_consensus.cc:2468] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 15.
I20260709 13:01:40.445201  1571 leader_election.cc:304] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:40.447842  1523 raft_consensus.cc:2468] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 20.
I20260709 13:01:40.454483  7925 raft_consensus.cc:493] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:40.457311  7925 raft_consensus.cc:515] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:40.394523  1427 rpcz_store.cc:269] 0709 13:01:11.263553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:11.263837 (+   284us) service_pool.cc:224] Handling call
0709 13:01:40.393788 (+29129951us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:31.621080 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:31.621712 (+   632us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:31.621766 (+    54us) write_op.cc:435] Acquired schema lock
0709 13:01:31.621784 (+    18us) tablet.cc:662] Decoding operations
0709 13:01:31.623616 (+  1832us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:31.623732 (+   116us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:31.623759 (+    27us) tablet.cc:685] Acquiring locks for 26 operations
0709 13:01:31.720101 (+ 96342us) tablet.cc:701] Row locks acquired
0709 13:01:31.720152 (+    51us) write_op.cc:260] PREPARE: finished
0709 13:01:31.720331 (+   179us) write_op.cc:270] Start()
0709 13:01:31.720496 (+   165us) write_op.cc:276] Timestamp: P: 1783602091720263 usec, L: 0
0709 13:01:31.720521 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:01:31.752828 (+ 32307us) log.cc:844] Serialized 10237 byte log entry
0709 13:01:32.019298 (+266470us) op_driver.cc:464] REPLICATION: finished
0709 13:01:32.020919 (+  1621us) write_op.cc:301] APPLY: starting
0709 13:01:32.029595 (+  8676us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:32.837251 (+807656us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:32.837388 (+   137us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:33.715782 (+878394us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:33.716221 (+   439us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=52,key_file_lookups=52,delta_file_lookups=52,mrs_lookups=0
0709 13:01:33.716268 (+    47us) write_op.cc:312] APPLY: finished
0709 13:01:33.716783 (+   515us) log.cc:844] Serialized 228 byte log entry
0709 13:01:33.949179 (+232396us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:34.057550 (+108371us) write_op.cc:454] Released schema lock
0709 13:01:34.083842 (+ 26292us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:34.137593 (+ 53751us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:34.137634 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":395071,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":1317,"apply.run_cpu_time_us":90499,"apply.run_wall_time_us":2116669,"cfile_cache_hit":106,"cfile_cache_hit_bytes":113015,"num_ops":26,"prepare.queue_time_us":87028,"prepare.run_cpu_time_us":18250,"prepare.run_wall_time_us":220088,"raft.queue_time_us":114936,"raft.run_cpu_time_us":1266,"raft.run_wall_time_us":10814,"replication_time_us":298615,"thread_start_us":431211,"threads_started":5,"wal-append.queue_time_us":464351,"wal-append.run_cpu_time_us":43884,"wal-append.run_wall_time_us":2396127}]]}
I20260709 13:01:40.459792  7925 leader_election.cc:290] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:40.466744  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:40.467276  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:40.469252  1605 raft_consensus.cc:1240] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 18. Current term is 19. Ops: []
I20260709 13:01:40.469429  1601 raft_consensus.cc:1275] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:01:40.447510  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:40.474236  1681 raft_consensus.cc:2393] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 12: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:01:40.475401  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:40.476436  1528 raft_consensus.cc:2468] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 16.
I20260709 13:01:40.476845  7645 raft_consensus.cc:493] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:40.477447  7645 raft_consensus.cc:515] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:40.415773  7716 consensus_queue.cc:1243] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer b96ce9cc496c49d7818fa983a17b062b log is divergent from this leader: its last log entry 15.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:01:40.480921  7817 consensus_queue.cc:1048] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:01:40.481319  7645 leader_election.cc:290] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:40.486233  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:40.487111  1532 raft_consensus.cc:2468] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 19.
I20260709 13:01:40.489100  1571 leader_election.cc:304] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:40.490123  7625 raft_consensus.cc:2804] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:01:40.490950  7955 raft_consensus.cc:2804] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:01:40.491411  7955 raft_consensus.cc:493] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:40.491742  7955 raft_consensus.cc:3060] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:01:40.494830  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 69578.4us
I20260709 13:01:40.499011  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:40.500036  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:40.500164  1646 leader_election.cc:304] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:40.500830  2222 raft_consensus.cc:2468] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 19.
I20260709 13:01:40.504197  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:40.504904  1681 raft_consensus.cc:2468] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 16.
I20260709 13:01:40.506605  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:40.509002  7778 raft_consensus.cc:2804] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:01:40.508770  7955 raft_consensus.cc:515] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:40.509567  7778 raft_consensus.cc:697] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 20 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:40.509788  1676 raft_consensus.cc:1240] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 20. Current term is 21. Ops: []
I20260709 13:01:40.490772  7625 raft_consensus.cc:697] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 21 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:40.511780  7625 consensus_queue.cc:237] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:40.512765  7790 raft_consensus.cc:493] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:40.513407  7790 raft_consensus.cc:515] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:40.515729  7790 leader_election.cc:290] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:40.519012  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:40.539322  1532 raft_consensus.cc:2468] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 19.
I20260709 13:01:40.540834  7935 raft_consensus.cc:515] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:40.541499  1678 raft_consensus.cc:1275] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:01:40.542344  7887 raft_consensus.cc:515] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:40.543511  2227 raft_consensus.cc:2368] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 17. Current term is 18.
I20260709 13:01:40.547197  7900 raft_consensus.cc:493] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:40.547847  7900 raft_consensus.cc:515] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:40.548978  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:40.549443  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:40.549620  1607 raft_consensus.cc:2468] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 16.
I20260709 13:01:40.550005  7900 leader_election.cc:290] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:40.550966  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:40.550899  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:40.551668  1605 raft_consensus.cc:2468] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 19.
I20260709 13:01:40.551764  1598 raft_consensus.cc:2468] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 17.
I20260709 13:01:40.552652  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:40.554296  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:40.554808  7955 leader_election.cc:290] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 21 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:40.555043  1604 raft_consensus.cc:2468] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 16.
I20260709 13:01:40.524712  7817 raft_consensus.cc:493] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:40.555887  7817 raft_consensus.cc:515] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:40.557320  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:40.557888  7817 leader_election.cc:290] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:40.525759  7818 consensus_queue.cc:1059] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:40.510646  7778 consensus_queue.cc:237] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:40.559630  7699 raft_consensus.cc:3055] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 LEADER]: Stepping down as leader of term 19
W20260709 13:01:40.530830  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 62167.6us
I20260709 13:01:40.560055  7699 raft_consensus.cc:740] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:40.561200  7699 consensus_queue.cc:260] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:40.535451  1674 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 21.
I20260709 13:01:40.562718  7699 raft_consensus.cc:3060] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:40.555327  1602 raft_consensus.cc:1240] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 19. Current term is 20. Ops: []
I20260709 13:01:40.557863  1678 raft_consensus.cc:3060] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:40.569749  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:40.519218  2190 leader_election.cc:304] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
W20260709 13:01:40.570729  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 51613.1us
I20260709 13:01:40.570622  2227 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 21.
I20260709 13:01:40.571753  2190 leader_election.cc:304] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:40.587018  1646 leader_election.cc:304] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:40.592423  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:40.592649  7823 raft_consensus.cc:515] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:40.593359  1532 raft_consensus.cc:2468] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 16.
I20260709 13:01:40.595865  7887 leader_election.cc:290] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 18 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:40.602391  2219 pending_rounds.cc:85] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b: Aborting all ops after (but not including) 11
I20260709 13:01:40.602888  2219 pending_rounds.cc:107] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b: Aborting uncommitted NO_OP operation due to leader change: 15.12
I20260709 13:01:40.603183  2219 raft_consensus.cc:2889] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:40.602350  1678 raft_consensus.cc:2468] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 21.
I20260709 13:01:40.611083  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:40.618307  2224 raft_consensus.cc:2393] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 17: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:01:40.583014  7765 raft_consensus.cc:2804] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:40.621341  1572 leader_election.cc:304] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:01:40.622375  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:40.630756  1532 raft_consensus.cc:3060] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:40.623427  7935 leader_election.cc:290] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 16 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:40.614748  7780 raft_consensus.cc:2749] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:40.626065  2226 raft_consensus.cc:1275] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:01:40.627115  7836 raft_consensus.cc:515] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:40.629166  7750 raft_consensus.cc:515] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:40.605558  7790 raft_consensus.cc:2804] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:01:40.632489  2190 leader_election.cc:304] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:40.559870  7940 raft_consensus.cc:515] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:40.640923  7838 raft_consensus.cc:493] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:40.576844  7773 consensus_queue.cc:1059] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.061s
I20260709 13:01:40.649735  1496 leader_election.cc:304] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:40.652334  1572 leader_election.cc:304] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:40.635560  7765 raft_consensus.cc:493] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:40.715958  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:40.653950  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
W20260709 13:01:40.722503  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 70258.3us
W20260709 13:01:40.713598  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 81298.7us
I20260709 13:01:40.727172  2226 raft_consensus.cc:2393] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 16: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:01:40.728017  1599 raft_consensus.cc:1240] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 21 LEADER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 20. Current term is 21. Ops: []
I20260709 13:01:40.715046  7900 raft_consensus.cc:2804] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:01:40.735119  1572 leader_election.cc:400] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 pre-election: Vote denied by peer b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373) with higher term. Message: Invalid argument: T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 17. Current term is 18.
I20260709 13:01:40.720101  7765 raft_consensus.cc:3060] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:40.734230  1571 leader_election.cc:304] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:40.654134  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 13:01:40.738926  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 89292.8us
I20260709 13:01:40.739686  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:40.750063  1601 raft_consensus.cc:2468] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 17.
I20260709 13:01:40.741379  1572 leader_election.cc:403] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:40.654135  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:40.723424  7680 raft_consensus.cc:2804] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:40.654778  7790 raft_consensus.cc:493] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:40.727162  7955 raft_consensus.cc:2749] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:01:40.653626  7838 raft_consensus.cc:515] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:40.778501  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:40.741271  7900 raft_consensus.cc:493] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:40.777212  1674 pending_rounds.cc:85] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90: Aborting all ops after (but not including) 13
I20260709 13:01:40.856918  1674 pending_rounds.cc:107] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90: Aborting uncommitted NO_OP operation due to leader change: 13.14
I20260709 13:01:40.857666  1674 raft_consensus.cc:2889] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:40.849449  1532 raft_consensus.cc:2468] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 18.
W20260709 13:01:40.859913  7973 log.cc:927] Time spent T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:01:40.759081  7935 raft_consensus.cc:2804] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:01:40.653154  7823 leader_election.cc:290] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:40.758359  7710 raft_consensus.cc:493] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:40.773408  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:40.873500  1675 raft_consensus.cc:3060] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:40.654695  7575 consensus_queue.cc:1048] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.120s
I20260709 13:01:40.801656  7928 raft_consensus.cc:3060] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:01:40.847756  7825 raft_consensus.cc:493] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:40.827992  7773 raft_consensus.cc:493] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:40.883638  7773 raft_consensus.cc:515] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:40.778733  7953 raft_consensus.cc:2804] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:01:40.884727  7953 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:40.885341  7953 raft_consensus.cc:3060] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:01:40.886142  7773 leader_election.cc:290] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:40.823109  7778 raft_consensus.cc:493] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:40.754837  7680 raft_consensus.cc:493] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:40.739115  7716 raft_consensus.cc:493] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:40.857931  7900 raft_consensus.cc:3060] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:40.850117  7790 raft_consensus.cc:3060] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:40.777426  7632 consensus_queue.cc:1048] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.179s
I20260709 13:01:40.887604  7645 raft_consensus.cc:493] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:40.890584  7935 raft_consensus.cc:697] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 21 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:40.898253  7680 raft_consensus.cc:3060] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:40.929122  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:40.929632  1681 raft_consensus.cc:3060] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:40.890352  7706 consensus_queue.cc:1048] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:01:40.890875  7825 raft_consensus.cc:515] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:40.939325  1678 raft_consensus.cc:2468] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 16.
I20260709 13:01:40.880820  7710 raft_consensus.cc:515] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:01:40.944911  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 74230.9us
I20260709 13:01:40.898627  7778 raft_consensus.cc:515] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:40.932885  7906 raft_consensus.cc:493] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:40.964447  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:40.951282  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:40.935571  7750 leader_election.cc:290] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 18 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:40.969969  2226 raft_consensus.cc:3060] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Advancing to term 18
W20260709 13:01:40.972146  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 118155us
I20260709 13:01:40.973589  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:40.924578  7716 raft_consensus.cc:515] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:40.975063  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:40.981220  1523 raft_consensus.cc:3060] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:40.978991  7745 raft_consensus.cc:493] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:40.979683  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:40.926857  7645 raft_consensus.cc:515] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:40.983238  1529 raft_consensus.cc:3060] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:40.979208  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:40.983759  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:40.988379  1527 raft_consensus.cc:3060] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:40.946033  7940 leader_election.cc:290] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:40.951233  7884 raft_consensus.cc:493] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:40.947279  7856 raft_consensus.cc:493] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:40.987787  1531 raft_consensus.cc:2468] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 16.
I20260709 13:01:40.979076  7880 raft_consensus.cc:493] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
W20260709 13:01:41.009287  1496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:41.003883  1528 raft_consensus.cc:3060] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:41.031107  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:40.982822  7632 raft_consensus.cc:493] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:41.006680  7887 raft_consensus.cc:493] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.045969  7883 raft_consensus.cc:493] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.046568  7883 raft_consensus.cc:515] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:41.046713  7745 raft_consensus.cc:515] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:41.047573   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:41.049006  7883 leader_election.cc:290] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:41.051785  7778 leader_election.cc:290] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:41.053136  7825 leader_election.cc:290] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:41.054898  7632 raft_consensus.cc:515] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:41.057217  7632 leader_election.cc:290] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:41.060048  7716 leader_election.cc:290] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:41.061741  7887 raft_consensus.cc:515] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:41.025485  7880 raft_consensus.cc:515] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:41.064136  7887 leader_election.cc:290] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:41.069000  2226 raft_consensus.cc:2468] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 18.
I20260709 13:01:41.069919  1681 raft_consensus.cc:2468] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 18.
I20260709 13:01:41.068890  1523 raft_consensus.cc:2468] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 21.
I20260709 13:01:41.003005  7906 raft_consensus.cc:515] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:41.099998  7645 leader_election.cc:290] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:41.101488  7710 leader_election.cc:290] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
W20260709 13:01:41.107980  7970 log.cc:927] Time spent T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.308s	user 0.003s	sys 0.000s
I20260709 13:01:41.112795  1572 leader_election.cc:304] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:41.113670  1527 raft_consensus.cc:2468] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 16.
I20260709 13:01:41.000694  7884 raft_consensus.cc:515] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:41.119782  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 138413us
I20260709 13:01:41.049072  7745 leader_election.cc:290] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:41.040402  7856 raft_consensus.cc:515] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:41.128141  1572 leader_election.cc:304] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:01:41.123276  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:41.116036  7838 leader_election.cc:290] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:41.064592  7935 consensus_queue.cc:237] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:41.126593  7983 raft_consensus.cc:493] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.143944  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:41.146942  2226 raft_consensus.cc:2468] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 14.
I20260709 13:01:41.129284  7958 raft_consensus.cc:493] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.151017  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:41.131580  7773 raft_consensus.cc:493] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.153533  1527 raft_consensus.cc:2468] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 19.
I20260709 13:01:41.134928  7716 raft_consensus.cc:493] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.153611  2190 leader_election.cc:304] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:41.140662  7875 raft_consensus.cc:2804] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:01:41.230067  1529 raft_consensus.cc:2468] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 17.
I20260709 13:01:41.138403  7625 raft_consensus.cc:2749] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:41.145740  7980 raft_consensus.cc:493] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.151585  7461 raft_consensus.cc:493] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:41.151845  7887 raft_consensus.cc:493] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:41.240238  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 86731.4us
I20260709 13:01:41.246222  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:41.247546  1523 raft_consensus.cc:2468] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 16.
I20260709 13:01:41.236299  7838 raft_consensus.cc:493] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.247972  7773 raft_consensus.cc:515] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:41.244879  7875 raft_consensus.cc:697] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 18 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:41.262511  7942 raft_consensus.cc:3055] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:01:41.229940  7958 raft_consensus.cc:515] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:41.271943  7884 leader_election.cc:290] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:41.272881  7740 raft_consensus.cc:493] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:41.273308  1497 leader_election.cc:304] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:41.265048  7961 raft_consensus.cc:493] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.290849  1675 raft_consensus.cc:2468] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 16.
I20260709 13:01:41.278766  7982 raft_consensus.cc:493] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.259544  7716 raft_consensus.cc:515] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:41.279805  7990 raft_consensus.cc:493] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.279881  7836 leader_election.cc:290] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 19 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:41.283155  7856 leader_election.cc:290] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:41.265518  7461 raft_consensus.cc:515] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:41.284459  7928 raft_consensus.cc:2749] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373) with higher term. Message: Invalid argument: T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 17. Current term is 18.
I20260709 13:01:41.287523  1679 raft_consensus.cc:2468] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 19.
I20260709 13:01:41.275941  7989 raft_consensus.cc:2804] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:01:41.269326  7699 consensus_meta.cc:287] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent flushing consensus metadata: real 0.706s	user 0.008s	sys 0.004s
I20260709 13:01:41.255088  7980 raft_consensus.cc:515] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:41.295245  1496 leader_election.cc:304] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:41.296435  1497 leader_election.cc:304] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:41.319785  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:41.320420  1675 raft_consensus.cc:2468] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 17.
I20260709 13:01:41.292897  7982 raft_consensus.cc:515] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:41.256450  7887 raft_consensus.cc:515] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:41.270061  7942 raft_consensus.cc:740] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:41.238806  7983 raft_consensus.cc:515] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:41.327418  1497 leader_election.cc:304] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:41.328294  1675 raft_consensus.cc:1240] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 13:01:41.321945  7818 raft_consensus.cc:2804] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:41.300345  7817 raft_consensus.cc:2804] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:41.332839  7817 raft_consensus.cc:493] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:41.333252  7817 raft_consensus.cc:3060] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:41.298803  7961 raft_consensus.cc:515] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:41.335839  7961 leader_election.cc:290] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:41.295939  7740 raft_consensus.cc:515] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:41.342936  7875 consensus_queue.cc:237] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:41.344321  7740 leader_election.cc:290] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:41.346730  7699 raft_consensus.cc:2804] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:41.324788  7989 raft_consensus.cc:697] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 18 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:41.286353  7838 raft_consensus.cc:515] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:41.351483  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:01:41.346731  7977 log.cc:927] Time spent T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 13:01:41.344226  7880 leader_election.cc:290] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:41.355863  1602 raft_consensus.cc:2468] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 21.
I20260709 13:01:41.346429  7461 leader_election.cc:290] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:41.372030  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:41.352818  7740 raft_consensus.cc:493] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:41.357699  7765 consensus_meta.cc:287] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b: Time spent flushing consensus metadata: real 0.571s	user 0.007s	sys 0.004s
I20260709 13:01:41.402125  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:41.404745  2226 raft_consensus.cc:2468] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 20.
I20260709 13:01:41.377172  1675 raft_consensus.cc:2468] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 19.
I20260709 13:01:41.352705  7699 raft_consensus.cc:493] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:41.348919  7625 raft_consensus.cc:493] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.322024  7990 raft_consensus.cc:515] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:41.406358  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:41.410522  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:41.417529  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:41.375171  7906 leader_election.cc:290] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:01:41.560714  7900 consensus_meta.cc:287] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.638s	user 0.010s	sys 0.001s
I20260709 13:01:41.457600  7625 raft_consensus.cc:515] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:41.452857  1599 raft_consensus.cc:1275] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:01:41.427809  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:41.736943  1675 raft_consensus.cc:2393] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 14: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:01:41.737903  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:41.544904  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:41.574301  8005 raft_consensus.cc:493] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:41.410836  7680 raft_consensus.cc:515] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:41.740484  8005 raft_consensus.cc:515] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:41.740986  2223 raft_consensus.cc:2393] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 18: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:01:41.742115  1677 raft_consensus.cc:2468] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 14.
I20260709 13:01:41.742647  7680 leader_election.cc:290] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 18 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:41.743484  1679 raft_consensus.cc:2468] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 16.
I20260709 13:01:41.743917  7625 leader_election.cc:290] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:41.420235  1674 raft_consensus.cc:2468] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 13.
I20260709 13:01:41.743136  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:41.412256  7740 raft_consensus.cc:515] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:41.442319  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:41.738544  1675 raft_consensus.cc:2468] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 15.
I20260709 13:01:41.498034  1601 raft_consensus.cc:2468] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 18.
W20260709 13:01:41.549906  1528 consensus_meta.cc:287] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent flushing consensus metadata: real 0.524s	user 0.000s	sys 0.009s
I20260709 13:01:41.440771  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:01:41.420333  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 92972.1us
I20260709 13:01:41.561928  1672 raft_consensus.cc:1275] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:01:41.761394  1605 raft_consensus.cc:2468] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 14.
I20260709 13:01:41.442464  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:41.752156  2223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50310 (request call id 1277) took 1137 ms. Trace:
I20260709 13:01:41.531697  1572 leader_election.cc:304] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:01:41.455144  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:41.704357  1571 leader_election.cc:304] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:41.564751  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:41.763347  1528 raft_consensus.cc:1275] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:01:41.467036  2191 leader_election.cc:304] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:41.459172  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:41.413463  7699 raft_consensus.cc:3060] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:41.763767  1602 raft_consensus.cc:2468] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 14.
I20260709 13:01:41.736295  7900 raft_consensus.cc:515] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:41.758131  8002 raft_consensus.cc:493] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.530524  7958 leader_election.cc:290] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:41.475780  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:01:41.492864  7953 consensus_meta.cc:287] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent flushing consensus metadata: real 0.607s	user 0.008s	sys 0.003s
I20260709 13:01:41.509210  7716 leader_election.cc:290] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:41.751348  1677 raft_consensus.cc:2393] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 15: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:01:41.500046  7818 raft_consensus.cc:697] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:41.543867  7887 leader_election.cc:290] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:41.648361  7982 leader_election.cc:290] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:41.596953  7838 leader_election.cc:290] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:41.586427  7983 leader_election.cc:290] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:41.643930  7823 raft_consensus.cc:493] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.752851  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:41.833069  1679 raft_consensus.cc:2468] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 17.
I20260709 13:01:41.713011  1496 leader_election.cc:304] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:41.825570  7953 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:41.834245  7706 raft_consensus.cc:493] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:41.827291  7875 raft_consensus.cc:493] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:41.655154  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:01:41.592440  7999 log.cc:927] Time spent T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
W20260709 13:01:41.838390  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 125477us
I20260709 13:01:41.839200  1496 leader_election.cc:304] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:41.516759  7980 leader_election.cc:290] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:41.841593  7982 raft_consensus.cc:2804] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:01:41.834761  7706 raft_consensus.cc:515] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:41.523440  8000 raft_consensus.cc:493] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.842864  8000 raft_consensus.cc:515] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:41.844172  7706 leader_election.cc:290] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:41.844964  8000 leader_election.cc:290] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:41.561287  7773 leader_election.cc:290] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:41.845875  7773 raft_consensus.cc:2804] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:41.846266  7773 raft_consensus.cc:493] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:41.846599  7773 raft_consensus.cc:3060] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:41.457835  7942 consensus_queue.cc:260] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:41.849094  8010 consensus_queue.cc:1059] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:41.849879  8010 consensus_queue.cc:1243] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Peer 39a92f5a4352465d8af3af5908fe8642 log is divergent from this leader: its last log entry 21.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:01:41.493489  7989 consensus_queue.cc:237] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:41.853328  7875 raft_consensus.cc:515] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:41.851666  8010 consensus_queue.cc:1059] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.003s
I20260709 13:01:41.855623  7875 leader_election.cc:290] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:41.825775  7825 raft_consensus.cc:493] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:41.856567  7825 raft_consensus.cc:515] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:41.824710  8011 raft_consensus.cc:493] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:41.763659  1681 raft_consensus.cc:2468] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 13.
I20260709 13:01:41.775111  7817 raft_consensus.cc:515] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:41.764256  1678 raft_consensus.cc:3060] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:01:41.859783  7817 leader_election.cc:290] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 17 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:01:41.764299  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 297376us
I20260709 13:01:41.861074  2191 leader_election.cc:304] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:41.862870  7645 raft_consensus.cc:2804] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:41.863260  7645 raft_consensus.cc:493] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:41.863595  7645 raft_consensus.cc:3060] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:41.864117  7987 raft_consensus.cc:493] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.864629  7987 raft_consensus.cc:515] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:41.767606  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 63355.4us
I20260709 13:01:41.866955  8006 raft_consensus.cc:493] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:41.867520  8006 raft_consensus.cc:515] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:41.868692  1571 leader_election.cc:304] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
W20260709 13:01:41.762339  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 474410us
I20260709 13:01:41.833009  7823 raft_consensus.cc:515] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:41.871606  7935 raft_consensus.cc:2804] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:41.872066  7935 raft_consensus.cc:493] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:41.822474  7680 raft_consensus.cc:493] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:41.872424  7935 raft_consensus.cc:3060] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:01:41.763006  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 231395us
W20260709 13:01:41.596659  7790 consensus_meta.cc:287] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b: Time spent flushing consensus metadata: real 0.673s	user 0.010s	sys 0.000s
I20260709 13:01:41.874379  1572 leader_election.cc:304] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:01:41.771742  1607 raft_consensus.cc:2368] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for earlier term 16. Current term is 17.
I20260709 13:01:41.762676  2223 rpcz_store.cc:276] 0709 13:01:40.614450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:40.653618 (+ 39168us) service_pool.cc:224] Handling call
0709 13:01:41.751888 (+1098270us) spinlock_profiling.cc:243] Waited 994 ms on lock 0x7b540059c4d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:01:41.752063 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2285419392}
I20260709 13:01:41.773881  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:41.700134  7990 leader_election.cc:290] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:41.743355  8005 leader_election.cc:290] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:01:41.815855  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 54241.1us
I20260709 13:01:41.822962  1676 raft_consensus.cc:2410] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:01:41.690897  7940 raft_consensus.cc:493] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.822515  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:41.822155  8002 raft_consensus.cc:515] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:41.897908  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:41.762092  7778 raft_consensus.cc:493] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.899173  8002 leader_election.cc:290] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:41.899438  7778 raft_consensus.cc:515] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:41.899185  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:41.901078  1672 raft_consensus.cc:2393] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 22: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:01:41.764791  7836 raft_consensus.cc:2749] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:41.832020  7710 raft_consensus.cc:493] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.619690  2192 leader_election.cc:304] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:01:41.775282  7625 raft_consensus.cc:2804] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:41.775122  7906 raft_consensus.cc:2804] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:01:41.910400  7906 raft_consensus.cc:493] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:41.910900  7906 raft_consensus.cc:3060] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:41.915165  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:41.915966  1532 raft_consensus.cc:2468] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 15.
I20260709 13:01:41.856995  1680 raft_consensus.cc:1275] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:01:41.446601  7750 raft_consensus.cc:493] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.857483  8011 raft_consensus.cc:515] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:41.869748  8006 leader_election.cc:290] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:41.775350  7829 raft_consensus.cc:2804] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:41.412786  7765 raft_consensus.cc:515] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:41.869900  1429 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46260 (request call id 367) took 47805 ms (client timeout 15000 ms). Trace:
I20260709 13:01:41.880293  2191 leader_election.cc:304] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:41.882368  1678 raft_consensus.cc:2468] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 17.
I20260709 13:01:41.891912  1675 raft_consensus.cc:2468] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 15.
I20260709 13:01:41.869848  1571 leader_election.cc:304] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:41.872229  7823 leader_election.cc:290] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:41.871652  7900 leader_election.cc:290] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 20 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:41.919663  1606 raft_consensus.cc:2468] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 13.
I20260709 13:01:41.887544  7817 raft_consensus.cc:493] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.945479  7740 leader_election.cc:290] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:41.946327  7740 raft_consensus.cc:2804] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:01:41.946708  7740 raft_consensus.cc:493] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
W20260709 13:01:41.918252  1429 rpcz_store.cc:269] 0709 13:00:54.068334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.081826 (+ 13492us) service_pool.cc:224] Handling call
0709 13:01:41.869800 (+47787974us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:40.778220 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:40.778913 (+   693us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:40.778968 (+    55us) write_op.cc:435] Acquired schema lock
0709 13:01:40.778989 (+    21us) tablet.cc:662] Decoding operations
0709 13:01:40.779693 (+   704us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:40.779761 (+    68us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:40.779790 (+    29us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:01:40.780425 (+   635us) tablet.cc:701] Row locks acquired
0709 13:01:40.780473 (+    48us) write_op.cc:260] PREPARE: finished
0709 13:01:40.780641 (+   168us) write_op.cc:270] Start()
0709 13:01:40.780789 (+   148us) write_op.cc:276] Timestamp: P: 1783602100780573 usec, L: 0
0709 13:01:40.780811 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:01:40.781489 (+   678us) log.cc:844] Serialized 2079 byte log entry
0709 13:01:41.298116 (+516627us) op_driver.cc:464] REPLICATION: finished
0709 13:01:41.668593 (+370477us) spinlock_profiling.cc:243] Waited 173 ms on lock 0x7b18002b9960. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1e38ede1 00007f6a1e39b5b1 00007f6a154c63f3 00007f6a154c87c1 00007f6a154c8779 00007f6a154c8709 00007f6a154c86d1 00007f6a154c79cd 000000000038f354 000000000038f199 00007f6a154a983a
0709 13:01:41.668762 (+   169us) write_op.cc:301] APPLY: starting
0709 13:01:41.668859 (+    97us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:41.672929 (+  4070us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:41.672964 (+    35us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:41.675931 (+  2967us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:41.676221 (+   290us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=10,mrs_lookups=0
0709 13:01:41.676268 (+    47us) write_op.cc:312] APPLY: finished
0709 13:01:41.676588 (+   320us) log.cc:844] Serialized 57 byte log entry
0709 13:01:41.677486 (+   898us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:41.677602 (+   116us) write_op.cc:454] Released schema lock
0709 13:01:41.677663 (+    61us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:41.678092 (+   429us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:41.678122 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3197516,"reported_tablets":45,"child_traces":[["op",{"apply.queue_time_us":193248,"apply.run_cpu_time_us":8347,"apply.run_wall_time_us":9291,"cfile_cache_hit":22,"cfile_cache_hit_bytes":25067,"num_ops":5,"prepare.queue_time_us":245076,"prepare.run_cpu_time_us":39480,"prepare.run_wall_time_us":172477,"raft.queue_time_us":219321,"raft.run_cpu_time_us":10490,"raft.run_wall_time_us":159498,"replication_time_us":517115,"spinlock_wait_cycles":397191936,"thread_start_us":563784,"threads_started":4,"wal-append.queue_time_us":282437}]]}
I20260709 13:01:41.935429  7829 raft_consensus.cc:493] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:41.947474  7829 raft_consensus.cc:3060] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:41.951004  1423 catalog_manager.cc:5697] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } }
I20260709 13:01:41.953009  1423 catalog_manager.cc:5697] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 8 to 18, leader changed from 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 18 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } }
I20260709 13:01:41.909869  7940 raft_consensus.cc:515] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:41.957036  7818 consensus_queue.cc:237] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:41.958922  7940 leader_election.cc:290] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:41.960538  7953 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 22 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:41.917660  7979 raft_consensus.cc:493] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.961683  7778 leader_election.cc:290] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:41.921904  7710 raft_consensus.cc:515] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:41.964455  7710 leader_election.cc:290] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:41.905213  7987 leader_election.cc:290] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:41.952936  7699 raft_consensus.cc:515] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:41.974226  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:41.968796  8002 raft_consensus.cc:493] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:41.974972  1531 raft_consensus.cc:2368] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for earlier term 16. Current term is 17.
I20260709 13:01:41.934391  8006 raft_consensus.cc:493] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.974996  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:41.975886  1528 raft_consensus.cc:2468] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 13.
I20260709 13:01:41.927167  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:41.922827  1646 leader_election.cc:304] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:41.930917  7996 raft_consensus.cc:2804] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:01:41.895463  7680 raft_consensus.cc:515] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:41.978164  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 57984.4us
I20260709 13:01:41.900636  7790 raft_consensus.cc:515] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:41.976940  1532 raft_consensus.cc:2468] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 12.
I20260709 13:01:42.044651  1646 leader_election.cc:304] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:41.942245  7823 raft_consensus.cc:493] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:41.977910  7996 raft_consensus.cc:493] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:41.975651  7900 raft_consensus.cc:2804] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:41.968310  7942 raft_consensus.cc:3060] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:42.051587  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:42.061049  1523 raft_consensus.cc:2468] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 13.
I20260709 13:01:41.947052  7740 raft_consensus.cc:3060] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:41.966972  7765 leader_election.cc:290] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 17 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:41.973387  7987 raft_consensus.cc:2804] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:41.961614  7979 raft_consensus.cc:515] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:42.043953  8011 leader_election.cc:290] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:42.045297  8000 raft_consensus.cc:2804] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:42.059554  7996 raft_consensus.cc:3060] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:01:41.935926  7958 consensus_queue.cc:1048] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.129s
I20260709 13:01:41.967252  7817 raft_consensus.cc:515] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:42.060153  7990 raft_consensus.cc:2804] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:42.073553  7884 raft_consensus.cc:493] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.064476  7900 raft_consensus.cc:493] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.087632  7699 leader_election.cc:290] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 17 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:42.115779  7699 raft_consensus.cc:493] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:42.116364  7699 raft_consensus.cc:515] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:42.069020  1423 catalog_manager.cc:5697] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 12 to 18, leader changed from 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 18 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } }
I20260709 13:01:42.045109  8006 raft_consensus.cc:515] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:42.123667  1423 catalog_manager.cc:5697] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 15 to 20, leader changed from b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 20 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:01:42.124919  8006 leader_election.cc:290] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:41.977658  8002 raft_consensus.cc:515] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:42.127199  8002 leader_election.cc:290] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:41.944011  7750 raft_consensus.cc:515] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:42.129272  7750 leader_election.cc:290] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:41.966943  7825 leader_election.cc:290] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:42.047281  7982 raft_consensus.cc:697] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:42.132668  7982 consensus_queue.cc:237] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:42.133456  7790 leader_election.cc:290] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 20 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:42.073769  7710 raft_consensus.cc:493] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.134858  7710 raft_consensus.cc:515] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:42.135565  7979 leader_election.cc:290] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:42.137274  7710 leader_election.cc:290] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:42.138248  7900 raft_consensus.cc:3060] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:42.076138  7980 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:42.143442  7980 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:42.060482  7823 raft_consensus.cc:515] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:42.157028  7823 leader_election.cc:290] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:42.158560  7980 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:42.091952  7990 raft_consensus.cc:493] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.107046  7884 raft_consensus.cc:515] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:42.089006  8000 raft_consensus.cc:493] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.202570  1528 raft_consensus.cc:1275] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 11. (term mismatch)
I20260709 13:01:42.214298  1528 pending_rounds.cc:85] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting all ops after (but not including) 10
I20260709 13:01:42.214756  1528 pending_rounds.cc:107] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting uncommitted NO_OP operation due to leader change: 19.11
I20260709 13:01:42.215528  1528 raft_consensus.cc:2889] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:42.125669  1423 catalog_manager.cc:5697] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 13 to 16, leader changed from b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) to 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194). New cstate: current_term: 16 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:42.118466  7699 leader_election.cc:290] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:42.080480  7645 raft_consensus.cc:515] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:42.185812  7990 raft_consensus.cc:3060] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:42.137292  7680 leader_election.cc:290] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:42.237442  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:42.213316  8000 raft_consensus.cc:3060] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:42.096325  7987 raft_consensus.cc:493] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:42.239846  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 398920us
I20260709 13:01:42.241590  1496 leader_election.cc:304] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:42.239336  1531 raft_consensus.cc:2468] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 12.
I20260709 13:01:42.102494  7773 raft_consensus.cc:515] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:42.216240  7906 raft_consensus.cc:515] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:42.239085  7980 raft_consensus.cc:493] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:42.278160  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:42.282527  1529 raft_consensus.cc:2393] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 18: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:01:42.243644  7987 raft_consensus.cc:3060] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:01:42.273842  1570 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:43931 timed out after 1.513s (SENT) [suppressed 5 similar messages]
I20260709 13:01:42.284354  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:42.284970  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:42.287019  1532 raft_consensus.cc:2468] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 16.
I20260709 13:01:42.274255  7699 raft_consensus.cc:2804] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:42.294014  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:42.286166  1524 raft_consensus.cc:2468] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 15.
I20260709 13:01:42.295270  1497 leader_election.cc:304] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:42.297801  1531 raft_consensus.cc:2468] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 22.
W20260709 13:01:42.306849  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 687270us
I20260709 13:01:42.280344  8002 raft_consensus.cc:493] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
W20260709 13:01:42.307425  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 427233us
I20260709 13:01:42.312882  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:42.313862  1681 raft_consensus.cc:2410] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 13:01:42.308564  1496 leader_election.cc:304] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:42.316417  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:42.311496  2192 leader_election.cc:304] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:01:42.303273  7699 raft_consensus.cc:493] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.321581  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:42.322451  1681 raft_consensus.cc:2468] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 14.
I20260709 13:01:42.323340  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:42.323926  1679 raft_consensus.cc:3060] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:42.305291  7953 raft_consensus.cc:493] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:42.310521  7823 raft_consensus.cc:2749] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:42.287946  7980 raft_consensus.cc:515] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:42.326999  1496 leader_election.cc:304] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:42.375552  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:42.376801  1605 raft_consensus.cc:2468] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 21.
I20260709 13:01:42.324975  7699 raft_consensus.cc:3060] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:42.378536  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:42.382483  1532 raft_consensus.cc:2393] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 21: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:01:42.322307  7461 raft_consensus.cc:2804] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:01:42.380527  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 510749us
I20260709 13:01:42.386039  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:42.395712  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:42.394649  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:42.399430  1601 raft_consensus.cc:2468] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 19.
I20260709 13:01:42.396596  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:42.400254  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:42.400758  2222 raft_consensus.cc:2468] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 13.
I20260709 13:01:42.327364  7625 raft_consensus.cc:697] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 16 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:42.394548  1530 raft_consensus.cc:2468] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 14.
I20260709 13:01:42.394397  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:42.405068  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:42.408110  1532 raft_consensus.cc:3060] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:42.405377  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:42.407675  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:42.411608  1602 raft_consensus.cc:2468] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 14.
I20260709 13:01:42.412622  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:01:42.406594  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 132805us
I20260709 13:01:42.400815  1524 raft_consensus.cc:2468] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 12.
I20260709 13:01:42.413633  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:42.417903  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:42.420188  1675 raft_consensus.cc:2393] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 14: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:01:42.410899  1606 raft_consensus.cc:2468] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 18.
I20260709 13:01:42.399371  1644 leader_election.cc:304] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:01:42.334432  8006 raft_consensus.cc:493] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:42.376261  7887 raft_consensus.cc:493] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:42.375998  8013 raft_consensus.cc:2804] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:42.436851  2219 raft_consensus.cc:2368] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 19. Current term is 20.
I20260709 13:01:42.324445  8002 raft_consensus.cc:515] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:42.397117  7817 leader_election.cc:290] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:42.422782  1644 leader_election.cc:304] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:42.389467  7461 raft_consensus.cc:493] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.435941  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:42.428081  1571 leader_election.cc:304] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:42.396534  7710 raft_consensus.cc:493] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.459944  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:42.460649  1527 raft_consensus.cc:2468] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 18.
I20260709 13:01:42.461647  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:42.440272  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:42.462627  1598 raft_consensus.cc:2393] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 20: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:01:42.462889  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:42.463338  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:42.463567  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:42.335191  7953 raft_consensus.cc:515] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:42.442188  1679 raft_consensus.cc:2468] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 17.
I20260709 13:01:42.426009  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:42.444761  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:42.463361  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:42.471040  1676 raft_consensus.cc:3060] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:01:42.445150  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:42.445314  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:42.444622  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:42.471482  2221 raft_consensus.cc:2468] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 13.
I20260709 13:01:42.471833  1673 raft_consensus.cc:3060] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:01:42.472721  1601 raft_consensus.cc:2468] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 16.
I20260709 13:01:42.446061  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:42.337421  7765 raft_consensus.cc:2804] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:42.449146  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:42.439239  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:42.466257  1527 raft_consensus.cc:2468] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 21.
I20260709 13:01:42.474700  1604 raft_consensus.cc:2468] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 17.
I20260709 13:01:42.453485  1644 leader_election.cc:400] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: Vote denied by peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931) with higher term. Message: Invalid argument: T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for earlier term 16. Current term is 17.
I20260709 13:01:42.451210  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:01:42.470626  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 46010.6us
I20260709 13:01:42.476393  1602 raft_consensus.cc:2410] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 13:01:42.475170  1644 leader_election.cc:403] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:42.466696  1532 raft_consensus.cc:2468] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 18.
I20260709 13:01:42.457855  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:42.480219  1523 raft_consensus.cc:2368] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for earlier term 16. Current term is 17.
I20260709 13:01:42.380287  7989 raft_consensus.cc:493] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:42.443115  7778 raft_consensus.cc:2804] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:42.481539  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:42.481827  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:42.464876  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:42.484458  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:42.396286  7750 consensus_queue.cc:1048] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.064s
I20260709 13:01:42.459548  7461 raft_consensus.cc:3060] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:42.453491  7887 raft_consensus.cc:515] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:42.446173  7880 raft_consensus.cc:493] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.475370  7817 raft_consensus.cc:493] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:42.486021  7790 raft_consensus.cc:493] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:42.487120  7989 raft_consensus.cc:515] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:42.470165  7710 raft_consensus.cc:515] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:42.513638  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:42.489409  7986 raft_consensus.cc:493] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:42.486418  1529 raft_consensus.cc:2468] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 13.
I20260709 13:01:42.514330  7986 raft_consensus.cc:515] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:42.485881  1606 raft_consensus.cc:3060] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:42.515542  7710 leader_election.cc:290] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:42.443854  7993 consensus_queue.cc:1048] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.056s
I20260709 13:01:42.512758  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:42.516599  7986 leader_election.cc:290] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:42.485610  1679 raft_consensus.cc:2468] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 19.
I20260709 13:01:42.326447  1423 catalog_manager.cc:5697] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:01:42.486027  2223 raft_consensus.cc:2468] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 14.
I20260709 13:01:42.469798  7706 raft_consensus.cc:2804] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:42.489516  7884 leader_election.cc:290] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:42.513489  7790 raft_consensus.cc:515] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:42.545812  7790 leader_election.cc:290] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:42.485351  7778 raft_consensus.cc:493] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:42.512542  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:42.511871  1678 raft_consensus.cc:1275] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
W20260709 13:01:42.497869  7935 consensus_meta.cc:287] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.625s	user 0.005s	sys 0.003s
I20260709 13:01:42.547047  7935 raft_consensus.cc:515] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:42.547677  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:42.490532  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:42.548802  1524 raft_consensus.cc:2468] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 22.
I20260709 13:01:42.549072  7935 leader_election.cc:290] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:42.549669  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:42.550246  1524 raft_consensus.cc:3060] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:42.550851  1674 raft_consensus.cc:2468] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 14.
I20260709 13:01:42.541494  7990 raft_consensus.cc:515] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:01:42.519529  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 66204.3us
I20260709 13:01:42.489856  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:42.520589  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:42.476006  7765 raft_consensus.cc:493] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.522543  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:42.450378  8013 raft_consensus.cc:493] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.524403  7825 raft_consensus.cc:2749] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931) with higher term. Message: Invalid argument: T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for earlier term 16. Current term is 17.
I20260709 13:01:42.513226  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:42.523533  1571 leader_election.cc:304] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:42.526901  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:42.556784  1673 raft_consensus.cc:2468] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 17.
I20260709 13:01:42.557994  1606 raft_consensus.cc:2468] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 18.
I20260709 13:01:42.508745  7906 leader_election.cc:290] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 20 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:42.525272  7817 raft_consensus.cc:515] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:42.557027  8013 raft_consensus.cc:3060] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:42.526186  7880 raft_consensus.cc:515] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:42.564731  7990 leader_election.cc:290] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:42.507090  7961 raft_consensus.cc:493] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:42.556150  7765 raft_consensus.cc:3060] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:42.566959  7961 raft_consensus.cc:515] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:42.485333  8019 raft_consensus.cc:493] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:42.537446  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:42.482372  7645 leader_election.cc:290] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 17 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:42.539340  1423 catalog_manager.cc:5697] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 16 to 19, leader changed from ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) to 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194). New cstate: current_term: 19 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:42.573123  7461 raft_consensus.cc:515] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:42.540781  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:42.526420  7706 raft_consensus.cc:493] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.540287  7887 leader_election.cc:290] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:42.574836  7935 raft_consensus.cc:2804] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:01:42.542233  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:42.553531  1527 raft_consensus.cc:2468] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 15.
I20260709 13:01:42.575268  7706 raft_consensus.cc:3060] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:42.574386  1423 catalog_manager.cc:5697] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 12 to 17, leader changed from 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 17 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:01:42.576486  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:42.576946  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:42.577136  1423 catalog_manager.cc:5697] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:01:42.575270  1529 raft_consensus.cc:2410] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for term 18 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 13:01:42.578357  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:42.580072  1529 raft_consensus.cc:1275] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 21 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:01:42.580447  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:42.581269  2226 raft_consensus.cc:2410] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for term 18 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 13:01:42.582056  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:42.575305  7935 raft_consensus.cc:493] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.506920  7773 leader_election.cc:290] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 18 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:42.556319  2221 raft_consensus.cc:2393] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 17: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:01:42.445636  8006 raft_consensus.cc:515] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:42.588732  1527 raft_consensus.cc:2468] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 18.
I20260709 13:01:42.589939  8006 leader_election.cc:290] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:42.528183  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:42.556691  1644 leader_election.cc:304] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:42.590843  1523 raft_consensus.cc:2368] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 21. Current term is 22.
I20260709 13:01:42.556794  7778 raft_consensus.cc:3060] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:42.591864  1644 leader_election.cc:304] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:42.592753  1644 leader_election.cc:304] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:42.560127  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:42.583460  7940 consensus_queue.cc:1048] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.013s
I20260709 13:01:42.598155  1644 leader_election.cc:304] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:42.546415  2191 leader_election.cc:304] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:42.558949  1528 raft_consensus.cc:2393] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 14: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:01:42.558456  1496 leader_election.cc:304] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:42.564878  1603 raft_consensus.cc:2468] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 17.
I20260709 13:01:42.567574  7880 leader_election.cc:290] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:42.565834  8002 leader_election.cc:290] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:42.572172  7961 leader_election.cc:290] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:42.572746  8019 raft_consensus.cc:515] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:42.504470  7953 leader_election.cc:290] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:42.483300  8023 raft_consensus.cc:2804] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:42.629810  8023 raft_consensus.cc:697] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 17 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:42.582571  2226 raft_consensus.cc:2468] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 14.
I20260709 13:01:42.630954  8006 raft_consensus.cc:2804] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:42.630765  8023 consensus_queue.cc:237] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:42.631386  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:42.632149  2226 raft_consensus.cc:2368] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 17. Current term is 18.
I20260709 13:01:42.632618  8006 raft_consensus.cc:493] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.598779  7986 raft_consensus.cc:2804] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:42.622792  7990 raft_consensus.cc:2804] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:01:42.633419  7990 raft_consensus.cc:493] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.633761  7990 raft_consensus.cc:3060] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:01:42.584299  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:42.635064  1604 raft_consensus.cc:2468] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 14.
I20260709 13:01:42.575634  2223 raft_consensus.cc:3060] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:01:42.633069  8006 raft_consensus.cc:3060] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:42.559625  7625 consensus_queue.cc:237] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:42.587955  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:42.641731  2221 raft_consensus.cc:2393] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 20: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:01:42.463696  8022 raft_consensus.cc:493] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:42.593293  7884 raft_consensus.cc:2804] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:01:42.575243  7942 consensus_meta.cc:287] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent flushing consensus metadata: real 0.504s	user 0.009s	sys 0.000s
I20260709 13:01:42.586125  7935 raft_consensus.cc:3060] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:42.594892  8024 raft_consensus.cc:2764] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:01:42.598606  7980 leader_election.cc:290] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:42.561161  1676 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 22.
W20260709 13:01:42.602878  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 56456.2us
I20260709 13:01:42.601020  1571 leader_election.cc:304] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:42.678126  2191 leader_election.cc:304] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
W20260709 13:01:42.678153  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 77228.6us
I20260709 13:01:42.617321  7989 leader_election.cc:290] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:42.617658  7958 consensus_queue.cc:1048] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:42.617070  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:01:42.618955  7829 consensus_meta.cc:287] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.671s	user 0.001s	sys 0.009s
W20260709 13:01:42.619571  7740 consensus_meta.cc:287] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b: Time spent flushing consensus metadata: real 0.540s	user 0.009s	sys 0.000s
I20260709 13:01:42.621188  7817 leader_election.cc:290] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:42.622171  1570 leader_election.cc:304] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:42.609258  1644 leader_election.cc:304] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:42.511834  7900 raft_consensus.cc:515] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:42.646303  7986 raft_consensus.cc:493] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.607797  7773 raft_consensus.cc:2804] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:42.626180  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:42.626026  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:42.626026  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:42.627665  1600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36200 (request call id 3085) took 1095 ms. Trace:
I20260709 13:01:42.676685  7884 raft_consensus.cc:493] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.629021  8019 leader_election.cc:290] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:42.644030  1681 raft_consensus.cc:1275] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:01:42.710026  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:42.710559  1681 raft_consensus.cc:3060] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:42.644577  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:42.645872  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:42.647101  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:42.711163  1675 raft_consensus.cc:3060] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:42.711553  1602 raft_consensus.cc:2468] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 17.
I20260709 13:01:42.647799  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:42.651751  7961 raft_consensus.cc:493] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:42.652222  8032 raft_consensus.cc:493] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:42.653366  1524 raft_consensus.cc:2468] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 20.
I20260709 13:01:42.635989  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:42.672684  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:42.632851  2226 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac"
dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
mode: GRACEFUL
new_leader_uuid: "39a92f5a4352465d8af3af5908fe8642"
 from {username='slave'} at 127.0.0.1:47682
I20260709 13:01:42.672075  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:42.617018  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:42.681033  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:42.681937  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:42.717734  1527 raft_consensus.cc:2468] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 13.
W20260709 13:01:42.699180  7996 consensus_meta.cc:287] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.607s	user 0.006s	sys 0.003s
I20260709 13:01:42.689188  2190 leader_election.cc:304] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:42.628208  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:42.718797  1603 raft_consensus.cc:2468] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 18.
I20260709 13:01:42.723929  1601 raft_consensus.cc:2368] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 14. Current term is 15.
I20260709 13:01:42.700085  1607 raft_consensus.cc:3060] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:42.701305  1530 raft_consensus.cc:1275] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 21 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 12. (term mismatch)
I20260709 13:01:42.699978  2219 raft_consensus.cc:2468] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 17.
I20260709 13:01:42.622982  8000 raft_consensus.cc:515] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:42.706115  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:42.708472  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:01:42.703078  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 61310.5us
I20260709 13:01:42.727092  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:42.715041  1497 leader_election.cc:400] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 19 election: Vote denied by peer b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373) with higher term. Message: Invalid argument: T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 19. Current term is 20.
I20260709 13:01:42.728502  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:42.729422  1497 leader_election.cc:304] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:42.730309  2223 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 22.
I20260709 13:01:42.719251  1523 raft_consensus.cc:2468] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 17.
I20260709 13:01:42.731258  2226 raft_consensus.cc:606] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 22 FOLLOWER]: Received request to transfer leadership to TS 39a92f5a4352465d8af3af5908fe8642
I20260709 13:01:42.731665  2226 raft_consensus.cc:614] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 22 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:01:42.690125  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 68068.9us
I20260709 13:01:42.717123  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:42.718106  1529 raft_consensus.cc:2393] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 20: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:01:42.718338  1672 raft_consensus.cc:2468] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 19.
I20260709 13:01:42.599738  7699 raft_consensus.cc:515] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:42.724720  1530 pending_rounds.cc:85] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting all ops after (but not including) 11
I20260709 13:01:42.725188  1599 raft_consensus.cc:2393] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 16: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:01:42.700305  7940 raft_consensus.cc:2764] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:01:42.728040  1646 leader_election.cc:304] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:42.712292  7884 raft_consensus.cc:3060] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:42.684857  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:42.734863  1530 pending_rounds.cc:107] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting uncommitted NO_OP operation due to leader change: 20.12
I20260709 13:01:42.700027  1600 rpcz_store.cc:276] 0709 13:01:41.528364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:41.529168 (+   804us) service_pool.cc:224] Handling call
0709 13:01:41.544277 (+ 15109us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:42.130395 (+586118us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:42.130430 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:42.131004 (+   574us) log.cc:844] Serialized 26 byte log entry
0709 13:01:42.395527 (+264523us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:42.395568 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:42.603866 (+208298us) spinlock_profiling.cc:243] Waited 586 ms on lock 0x7b54000daf54. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:01:42.603917 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:42.603965 (+    48us) raft_consensus.cc:1685] finished
0709 13:01:42.603980 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:42.624026 (+ 20046us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5915,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":87,"spinlock_wait_cycles":1347076992,"thread_start_us":264053,"threads_started":1,"wal-append.queue_time_us":374698}
I20260709 13:01:42.700860  7986 raft_consensus.cc:3060] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:42.688969  7880 raft_consensus.cc:2804] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:42.739198  1531 raft_consensus.cc:2393] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 14: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
W20260709 13:01:42.748301  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 139134us
I20260709 13:01:42.750219  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:42.741561  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:42.752162  1601 raft_consensus.cc:3060] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Advancing to term 22
I20260709 13:01:42.741488  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:42.675848  8022 raft_consensus.cc:515] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:42.743371  1530 raft_consensus.cc:2889] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:42.743391  1528 raft_consensus.cc:3060] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:42.714329  7773 raft_consensus.cc:697] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:42.749070  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:42.742012  1570 leader_election.cc:304] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:42.754212  1602 raft_consensus.cc:3060] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:42.716962  7887 raft_consensus.cc:2804] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:42.754220  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:42.749251  1496 leader_election.cc:304] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:42.756080  1680 raft_consensus.cc:2393] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 15: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:01:42.757558  1644 leader_election.cc:400] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: Vote denied by peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931) with higher term. Message: Invalid argument: T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for earlier term 16. Current term is 17.
I20260709 13:01:42.691746  7829 raft_consensus.cc:515] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:42.758704  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:42.689915  7740 raft_consensus.cc:515] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:42.759838  1497 leader_election.cc:304] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:42.722810  7461 leader_election.cc:290] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 19 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:42.761127  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:42.761575  1675 raft_consensus.cc:2468] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 18.
I20260709 13:01:42.779513  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:42.763811  1570 leader_election.cc:304] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:42.737707  7710 raft_consensus.cc:2804] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:01:42.769999  1681 raft_consensus.cc:2468] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 17.
I20260709 13:01:42.770973  1644 leader_election.cc:403] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:42.747591  7880 raft_consensus.cc:493] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.783401  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:42.784607  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:42.809823  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:42.785352  1497 leader_election.cc:400] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 17 election: Vote denied by peer b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373) with higher term. Message: Invalid argument: T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 17. Current term is 18.
I20260709 13:01:42.812741  1497 leader_election.cc:403] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:01:42.811851  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:42.759516  7817 raft_consensus.cc:493] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:42.723169  7961 raft_consensus.cc:515] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:42.821410  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 78894.4us
I20260709 13:01:42.822523  1604 raft_consensus.cc:2368] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 17. Current term is 18.
I20260709 13:01:42.767393  7680 raft_consensus.cc:493] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:42.767668  7906 raft_consensus.cc:2804] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:01:42.816337  8005 raft_consensus.cc:2749] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373) with higher term. Message: Invalid argument: T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 17. Current term is 18.
I20260709 13:01:42.784122  8040 raft_consensus.cc:2804] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:42.775079  7836 raft_consensus.cc:2749] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:42.809870  7880 raft_consensus.cc:3060] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:42.767874  7980 raft_consensus.cc:2804] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:01:42.735009  7996 raft_consensus.cc:515] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:42.818595  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:42.818761  8020 raft_consensus.cc:2749] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:42.755637  7875 consensus_queue.cc:1048] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.063s
I20260709 13:01:42.819593  1598 raft_consensus.cc:2468] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 14.
W20260709 13:01:42.819743  8035 log.cc:927] Time spent T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:01:42.816705  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:42.817883  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:42.825858  2222 raft_consensus.cc:2410] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 22 because replica has last-logged OpId of term: 20 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 14.
I20260709 13:01:42.635984  1423 catalog_manager.cc:5697] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 12 to 17. New cstate: current_term: 17 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:42.813218  1601 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 22.
I20260709 13:01:42.828269  1646 leader_election.cc:400] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303) with higher term. Message: Invalid argument: T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for earlier term 16. Current term is 17.
W20260709 13:01:42.826983  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 77705.3us
I20260709 13:01:42.850534  1528 raft_consensus.cc:2468] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 17.
I20260709 13:01:42.851513  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:42.776834  7942 raft_consensus.cc:493] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.828383  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
W20260709 13:01:42.816053  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 126929us
I20260709 13:01:42.854153  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:42.855333  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:42.852962  1601 raft_consensus.cc:3060] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:01:42.856509  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:42.816015  1605 raft_consensus.cc:2468] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 20.
I20260709 13:01:42.811910  1496 leader_election.cc:304] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
W20260709 13:01:42.857903  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 46069.6us
I20260709 13:01:42.855934  2190 leader_election.cc:304] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:42.859644  1604 raft_consensus.cc:2393] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 15: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:01:42.784838  7989 raft_consensus.cc:493] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.815465  8010 raft_consensus.cc:2804] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:01:42.726307  8032 raft_consensus.cc:515] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:42.765362  8011 consensus_queue.cc:1048] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.059s
I20260709 13:01:42.815042  7823 raft_consensus.cc:2804] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:42.872262  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:42.887591  1524 raft_consensus.cc:3060] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Advancing to term 15
W20260709 13:01:42.843411  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 61759.2us
I20260709 13:01:42.818133  8000 leader_election.cc:290] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:42.813819  7887 raft_consensus.cc:697] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 17 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:42.848634  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:42.849872  1600 raft_consensus.cc:3060] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:42.829548  8040 raft_consensus.cc:493] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:42.845217  8038 log.cc:927] Time spent T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:01:42.837425  7980 raft_consensus.cc:493] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 21 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:42.822276  8023 consensus_queue.cc:1048] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 13:01:42.864148  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:42.917290  1681 raft_consensus.cc:3060] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:42.864814  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:42.918303  1675 raft_consensus.cc:3060] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:01:42.867306  7710 raft_consensus.cc:493] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.922991  7710 raft_consensus.cc:3060] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:42.863601  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:42.869999  1423 catalog_manager.cc:5697] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 8 to 11, leader changed from 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 11 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:01:42.928218  1423 catalog_manager.cc:5697] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 10 to 13, leader changed from e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) to 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194). New cstate: current_term: 13 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:42.870168  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:42.930296  1423 catalog_manager.cc:5697] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 16 to 18, leader changed from b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) to 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194). New cstate: current_term: 18 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:42.931699  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:42.932336  2225 raft_consensus.cc:2468] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 14.
I20260709 13:01:42.933274  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:42.932758  1423 catalog_manager.cc:5697] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:42.934001  2225 raft_consensus.cc:2368] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 21. Current term is 22.
I20260709 13:01:42.871927  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:42.871907  1607 raft_consensus.cc:2468] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 17.
W20260709 13:01:42.857331  7987 consensus_meta.cc:287] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b: Time spent flushing consensus metadata: real 0.554s	user 0.009s	sys 0.000s
I20260709 13:01:42.935114  1606 raft_consensus.cc:2393] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 22: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:01:42.935530  7987 raft_consensus.cc:515] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:42.838634  8042 raft_consensus.cc:2749] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931) with higher term. Message: Invalid argument: T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for earlier term 16. Current term is 17.
I20260709 13:01:42.934648  1675 raft_consensus.cc:2468] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 19.
I20260709 13:01:42.937840  7987 leader_election.cc:290] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 14 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:42.938964  2220 raft_consensus.cc:2393] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 14: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:01:42.937858  8042 raft_consensus.cc:493] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:42.937983  7710 raft_consensus.cc:515] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:42.943493  8042 raft_consensus.cc:515] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:42.944990  7710 leader_election.cc:290] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 20 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:42.945510  8042 leader_election.cc:290] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:42.896101  1523 raft_consensus.cc:1275] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:01:42.897493  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:42.898913  1497 leader_election.cc:304] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:42.827432  7817 raft_consensus.cc:515] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:42.947584  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 48765.8us
I20260709 13:01:42.948688  8005 raft_consensus.cc:2804] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:42.949116  8005 raft_consensus.cc:493] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.949184  7817 leader_election.cc:290] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:42.849385  7906 raft_consensus.cc:697] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 18 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:42.949515  8005 raft_consensus.cc:3060] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:42.950400  7906 consensus_queue.cc:237] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:42.900409  2190 leader_election.cc:304] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:42.908594  1570 leader_election.cc:400] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 21 pre-election: Vote denied by peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931) with higher term. Message: Invalid argument: T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 21. Current term is 22.
I20260709 13:01:42.914616  1601 raft_consensus.cc:2468] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 16.
I20260709 13:01:42.908125  2226 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923"
dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
mode: GRACEFUL
new_leader_uuid: "39a92f5a4352465d8af3af5908fe8642"
 from {username='slave'} at 127.0.0.1:47682
I20260709 13:01:42.954952  1570 leader_election.cc:403] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 21 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:42.831393  7680 raft_consensus.cc:515] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:42.955240  2226 raft_consensus.cc:606] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 14 LEADER]: Received request to transfer leadership to TS 39a92f5a4352465d8af3af5908fe8642
I20260709 13:01:42.939086  1423 catalog_manager.cc:5697] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
W20260709 13:01:42.955535  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 48753.5us
I20260709 13:01:42.957043  1570 leader_election.cc:304] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:42.957803  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:42.958442  2219 raft_consensus.cc:2468] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 16.
I20260709 13:01:42.959425  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:42.959587  7750 raft_consensus.cc:2804] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:01:42.960134  7750 raft_consensus.cc:697] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 20 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:42.960858  2219 raft_consensus.cc:1240] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:42.948374  1497 leader_election.cc:304] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:42.961037  7750 consensus_queue.cc:237] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:42.962270  7817 raft_consensus.cc:2804] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:01:42.956537  1423 catalog_manager.cc:5697] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 15 to 20. New cstate: current_term: 20 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:01:42.962798  7817 raft_consensus.cc:697] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 22 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:42.958696  7625 raft_consensus.cc:2749] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: Vote denied by peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931) with higher term. Message: Invalid argument: T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 21. Current term is 22.
W20260709 13:01:42.965368  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 88267.3us
I20260709 13:01:42.875083  7461 raft_consensus.cc:2804] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:01:42.886584  7823 raft_consensus.cc:493] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:42.973783  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:42.875846  8010 raft_consensus.cc:493] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:42.996783  2191 leader_election.cc:304] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:42.986899  1681 raft_consensus.cc:2468] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 20.
I20260709 13:01:42.988860  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:42.998723  1523 raft_consensus.cc:2376] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 16. Re-sending same reply.
I20260709 13:01:42.989248  7958 raft_consensus.cc:493] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:42.989639  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:42.993239  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
W20260709 13:01:43.000288  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 99965.1us
I20260709 13:01:42.967427  1646 leader_election.cc:304] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:42.875509  8045 raft_consensus.cc:2804] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:43.004293  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:43.004854  1532 raft_consensus.cc:3060] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:01:42.902669  8040 raft_consensus.cc:3060] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:42.919127  7980 raft_consensus.cc:3060] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:01:42.863649  8006 raft_consensus.cc:515] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:43.002117  1527 raft_consensus.cc:2376] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 21. Re-sending same reply.
I20260709 13:01:42.994913  1497 leader_election.cc:304] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:43.009069  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:43.011934  1526 raft_consensus.cc:2468] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 13.
I20260709 13:01:43.001369  2192 leader_election.cc:304] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:43.014199  2191 leader_election.cc:304] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:42.863495  7942 raft_consensus.cc:515] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:42.906340  7765 raft_consensus.cc:515] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:43.017795  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 50433.9us
I20260709 13:01:42.895468  7989 raft_consensus.cc:515] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:43.034312  2192 leader_election.cc:304] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:43.021220  1524 raft_consensus.cc:2468] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 15.
I20260709 13:01:43.022554  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:42.998620  7823 raft_consensus.cc:3060] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:43.000281  8010 raft_consensus.cc:3060] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:42.963819  7817 consensus_queue.cc:237] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:42.892961  7773 consensus_queue.cc:237] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:43.044324  1646 leader_election.cc:304] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:43.036659  1497 leader_election.cc:304] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:43.036803  1532 raft_consensus.cc:2468] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 14.
I20260709 13:01:43.032554  7790 raft_consensus.cc:2749] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:01:43.038743  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:43.006024  8045 raft_consensus.cc:493] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:43.000285  7461 raft_consensus.cc:697] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:43.039599  2221 raft_consensus.cc:2393] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 15: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:01:43.040028  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:43.061966  1529 raft_consensus.cc:2393] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 15: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:01:43.051375  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:43.057350  8005 raft_consensus.cc:515] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:43.058970  7740 leader_election.cc:290] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 21 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
W20260709 13:01:43.059368  8057 log.cc:927] Time spent T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 13:01:43.017658  8029 raft_consensus.cc:3060] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:43.061563  2227 raft_consensus.cc:2393] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 15: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:01:43.062110  1497 leader_election.cc:400] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303) with higher term. Message: Invalid argument: T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 14. Current term is 15.
I20260709 13:01:43.067973  1497 leader_election.cc:403] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:43.066696  2224 raft_consensus.cc:1275] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:01:43.049165  1644 leader_election.cc:304] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:43.073236  8061 raft_consensus.cc:2749] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:01:43.074028  8061 raft_consensus.cc:2804] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:43.074529  8061 raft_consensus.cc:697] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 17 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:43.075534  8061 consensus_queue.cc:237] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:43.077950  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 63839.1us
I20260709 13:01:43.035272  8024 raft_consensus.cc:2764] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:01:43.033610  7625 raft_consensus.cc:493] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:43.068095  7990 raft_consensus.cc:515] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:43.114019  1600 raft_consensus.cc:2468] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 19.
I20260709 13:01:43.060002  8011 raft_consensus.cc:2749] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:43.089471  8005 leader_election.cc:290] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 18 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:01:43.089840  8041 log.cc:927] Time spent T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.186s	user 0.000s	sys 0.000s
W20260709 13:01:43.090197  8036 log.cc:927] Time spent T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.205s	user 0.000s	sys 0.001s
I20260709 13:01:43.090595  8043 raft_consensus.cc:493] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:43.064743  8045 raft_consensus.cc:3060] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:01:43.091351  8034 log.cc:927] Time spent T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:01:43.091787  8022 leader_election.cc:290] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:01:43.096191  8047 log.cc:927] Time spent T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:01:43.097301  8032 leader_election.cc:290] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:42.964033  1423 catalog_manager.cc:5697] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 13 to 18. New cstate: current_term: 18 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
W20260709 13:01:43.132368  8013 consensus_meta.cc:287] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent flushing consensus metadata: real 0.567s	user 0.005s	sys 0.004s
I20260709 13:01:43.100666  7961 leader_election.cc:290] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:43.103083  7818 raft_consensus.cc:2749] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303) with higher term. Message: Invalid argument: T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 14. Current term is 15.
I20260709 13:01:43.065912  7983 raft_consensus.cc:2749] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:01:43.064874  7706 raft_consensus.cc:515] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:43.011230  7958 raft_consensus.cc:515] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:43.107226  7996 leader_election.cc:290] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 22 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:01:43.111903  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 62852.2us
I20260709 13:01:43.113219  1572 leader_election.cc:400] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 21 pre-election: Vote denied by peer b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373) with higher term. Message: Invalid argument: T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 21. Current term is 22.
I20260709 13:01:43.113497  1602 raft_consensus.cc:2468] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 18.
W20260709 13:01:43.081463  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 74000.6us
W20260709 13:01:43.088590  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 54369.5us
I20260709 13:01:43.138876  8023 raft_consensus.cc:493] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
W20260709 13:01:43.115381  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 53405.1us
I20260709 13:01:43.233698  1497 leader_election.cc:304] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:43.118692  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:43.110591  7790 raft_consensus.cc:2749] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:43.137867  1532 raft_consensus.cc:3060] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:43.043322  8049 consensus_queue.cc:1048] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.090s
I20260709 13:01:43.158593  7765 leader_election.cc:290] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:43.060896  7778 raft_consensus.cc:515] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:01:43.186205  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 104874us
I20260709 13:01:43.118777  8000 raft_consensus.cc:2804] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:43.107267  7461 consensus_queue.cc:237] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:43.060427  7887 consensus_queue.cc:237] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:43.202034  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:43.114496  7625 raft_consensus.cc:515] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:43.232002  1496 leader_election.cc:304] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
W20260709 13:01:43.321882  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 89990.5us
I20260709 13:01:43.232837  2192 leader_election.cc:304] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
W20260709 13:01:43.233506  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 120432us
I20260709 13:01:43.117895  8046 raft_consensus.cc:2749] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:01:43.330057  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 97305.7us
I20260709 13:01:43.289624  1678 raft_consensus.cc:1240] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:43.184310  8011 raft_consensus.cc:493] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:43.290735  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 57128.3us
I20260709 13:01:43.332223  8011 raft_consensus.cc:515] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:43.332556  1497 leader_election.cc:304] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:43.127323  7884 raft_consensus.cc:515] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:43.237993  8034 log.cc:927] Time spent T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 13:01:43.227630  7773 raft_consensus.cc:493] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:43.325476  7778 leader_election.cc:290] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:43.326555  7625 leader_election.cc:290] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:43.328539  8012 raft_consensus.cc:2804] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:01:43.323206  1572 leader_election.cc:304] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
W20260709 13:01:43.449635  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 126517us
I20260709 13:01:43.450495  1572 leader_election.cc:304] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:43.334610  2192 leader_election.cc:304] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
W20260709 13:01:43.451777  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 117258us
I20260709 13:01:43.335057  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:43.337550  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:43.322741  1646 leader_election.cc:304] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:43.340186  1675 raft_consensus.cc:1240] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 13:01:43.340966  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:43.455564  1681 raft_consensus.cc:2468] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 10.
I20260709 13:01:43.340806  7790 raft_consensus.cc:2749] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:43.352986  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:43.353339  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:43.353703  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:43.354214  7983 raft_consensus.cc:2749] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:43.355988  7990 leader_election.cc:290] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 23 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:43.305989  8000 raft_consensus.cc:493] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:43.362823  8060 raft_consensus.cc:2749] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:43.364398  8011 leader_election.cc:290] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:43.321521  8024 raft_consensus.cc:493] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:43.367695  1423 catalog_manager.cc:5697] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: config changed from index 5 to 8, term changed from 7 to 10, VOTER e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) evicted. New cstate: current_term: 10 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:01:43.369117  8040 raft_consensus.cc:515] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:43.508639  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 186031us
I20260709 13:01:43.375648  8045 raft_consensus.cc:515] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:43.421193  1532 raft_consensus.cc:2468] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 16.
I20260709 13:01:43.135596  8043 raft_consensus.cc:515] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:43.223791  8013 raft_consensus.cc:515] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:43.236754  7880 raft_consensus.cc:515] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:43.457913  1679 raft_consensus.cc:2393] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 14: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
W20260709 13:01:43.476127  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 143667us
I20260709 13:01:43.474548  8006 leader_election.cc:290] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:43.308322  8023 raft_consensus.cc:515] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:43.373690  7935 consensus_meta.cc:287] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.671s	user 0.010s	sys 0.000s
W20260709 13:01:43.519387  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 68607.2us
W20260709 13:01:43.476305  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 465226us
I20260709 13:01:43.522835  1497 leader_election.cc:400] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 17 election: Vote denied by peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303) with higher term. Message: Invalid argument: T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 17. Current term is 18.
I20260709 13:01:43.533092  1497 leader_election.cc:304] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:43.533545  2192 leader_election.cc:304] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:43.535566  1525 raft_consensus.cc:2368] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 15. Current term is 16.
I20260709 13:01:43.536720  1525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43008 (request call id 2627) took 1078 ms. Trace:
I20260709 13:01:43.537226  8018 consensus_queue.cc:1048] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:01:43.502188  8000 raft_consensus.cc:3060] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:43.540722  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:43.540941  7680 leader_election.cc:290] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:43.541568  1523 raft_consensus.cc:2393] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 21: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:01:43.488265  7625 raft_consensus.cc:2804] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:43.537596  8077 raft_consensus.cc:2749] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:43.544008  1530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43008 (request call id 2628) took 1085 ms. Trace:
I20260709 13:01:43.542357  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:43.447971  7773 raft_consensus.cc:515] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:43.513437  7989 leader_election.cc:290] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:43.545392  1530 rpcz_store.cc:276] 0709 13:01:42.458174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.462447 (+  4273us) service_pool.cc:224] Handling call
0709 13:01:42.462727 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:42.774338 (+311611us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:43.543777 (+769439us) spinlock_profiling.cc:243] Waited 226 ms on lock 0x7b540031b354. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:01:43.543953 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":519684864}
I20260709 13:01:43.516116  7778 raft_consensus.cc:2804] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:43.542433  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:43.514143  7829 leader_election.cc:290] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:01:43.548507  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 73078.6us
I20260709 13:01:43.537065  1525 rpcz_store.cc:276] 0709 13:01:42.457875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.458905 (+  1030us) service_pool.cc:224] Handling call
0709 13:01:43.536507 (+1077602us) spinlock_profiling.cc:243] Waited 958 ms on lock 0x7b540022a954. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:01:43.536637 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2202988288}
I20260709 13:01:43.560689  1523 raft_consensus.cc:1275] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:01:43.561625  2226 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2"
dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
mode: GRACEFUL
new_leader_uuid: "ddf11fc190dd4b898773379c6b129d90"
 from {username='slave'} at 127.0.0.1:47682
I20260709 13:01:43.562255  2226 raft_consensus.cc:606] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Received request to transfer leadership to TS ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:43.548974  8063 raft_consensus.cc:2749] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:43.549710  8075 raft_consensus.cc:2749] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:43.473062  7823 raft_consensus.cc:515] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:43.553813  1532 raft_consensus.cc:3060] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:43.544037  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:43.555850  1497 leader_election.cc:304] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:43.474926  8010 raft_consensus.cc:515] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:43.543473  7625 raft_consensus.cc:493] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:43.562597  2226 raft_consensus.cc:614] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:43.517020  1646 leader_election.cc:304] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:43.576345  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:43.575572  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 13:01:43.579380  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 62465.3us
I20260709 13:01:43.576418  1497 leader_election.cc:304] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:43.582700  1644 leader_election.cc:304] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:01:43.585212  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:43.585417  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:43.585934  1523 raft_consensus.cc:3060] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:43.586472  1530 raft_consensus.cc:3060] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:01:43.551069  1423 catalog_manager.cc:5697] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 12 to 15, leader changed from b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) to 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194). New cstate: current_term: 15 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:43.521072  7980 raft_consensus.cc:515] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:43.579502  2190 leader_election.cc:304] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:43.563690  7989 raft_consensus.cc:2749] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:43.598734  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:43.594218  1528 raft_consensus.cc:2468] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 14.
I20260709 13:01:43.509133  8024 raft_consensus.cc:515] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:43.596925  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:43.564570  7778 raft_consensus.cc:697] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 16 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:43.586441  1497 leader_election.cc:304] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:43.612378  1532 raft_consensus.cc:2468] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 15.
I20260709 13:01:43.614849  1526 raft_consensus.cc:2393] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 14: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:01:43.597081  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:43.547581  7935 raft_consensus.cc:515] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:43.616061  1531 raft_consensus.cc:3060] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:43.590828  7625 raft_consensus.cc:3060] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:43.626972  1602 raft_consensus.cc:3060] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:01:43.595854  7710 raft_consensus.cc:2804] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:43.600215  7823 leader_election.cc:290] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:43.621134  1497 leader_election.cc:304] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:43.659078  7823 consensus_queue.cc:1059] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:01:43.659976  7823 raft_consensus.cc:2749] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:43.661186  7823 raft_consensus.cc:3055] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:01:43.661520  8040 leader_election.cc:290] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:43.663089  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:43.663746  1532 raft_consensus.cc:3060] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:01:43.664093  7773 leader_election.cc:290] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:43.665897  8024 leader_election.cc:290] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:43.602003  7953 raft_consensus.cc:493] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:43.667235  7953 raft_consensus.cc:515] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:43.668129  8023 leader_election.cc:290] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:43.638096  1523 raft_consensus.cc:2468] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 13.
I20260709 13:01:43.669304  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:43.590808  8011 raft_consensus.cc:2804] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:01:43.670176  8011 raft_consensus.cc:493] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:43.670596  8011 raft_consensus.cc:3060] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:43.603855  8043 leader_election.cc:290] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:43.638306  7645 consensus_queue.cc:1048] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.008s
I20260709 13:01:43.663091  7778 consensus_queue.cc:237] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:43.679113  1526 raft_consensus.cc:1240] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:01:43.683538  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:43.684999  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:43.685708  1600 raft_consensus.cc:2368] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b for earlier term 21. Current term is 22.
I20260709 13:01:43.686127  7773 raft_consensus.cc:493] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:43.644692  1570 leader_election.cc:304] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:43.648720  7706 leader_election.cc:290] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:43.651265  1423 catalog_manager.cc:5697] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 13 to 15, leader changed from ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) to 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194). New cstate: current_term: 15 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:43.687609  1570 leader_election.cc:304] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:43.645705  8017 raft_consensus.cc:2804] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:43.693159  1606 raft_consensus.cc:2368] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 19. Current term is 20.
I20260709 13:01:43.653098  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:43.693902  1601 raft_consensus.cc:3060] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:43.653652  8045 leader_election.cc:290] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 18 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:43.623396  8077 raft_consensus.cc:2764] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:01:43.656154  7982 raft_consensus.cc:2749] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:43.669379  7953 leader_election.cc:290] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:01:43.652632  8073 log.cc:927] Time spent T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:01:43.686461  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:43.711758  1532 raft_consensus.cc:2468] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 22.
I20260709 13:01:43.712926  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 13:01:43.713810  8029 consensus_meta.cc:287] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b: Time spent flushing consensus metadata: real 0.633s	user 0.007s	sys 0.001s
I20260709 13:01:43.714010  1532 raft_consensus.cc:2368] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 15. Current term is 16.
I20260709 13:01:43.714495  8079 raft_consensus.cc:2749] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:01:43.703567  8017 raft_consensus.cc:697] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 14 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:43.715651  8017 consensus_queue.cc:237] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:43.716878  8067 raft_consensus.cc:493] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:43.717465  8067 raft_consensus.cc:515] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:43.718451  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:43.719627  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:43.719903  7935 leader_election.cc:290] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 20 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:43.720774  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:43.721911  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:43.722227  8000 raft_consensus.cc:515] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:43.723397  1523 raft_consensus.cc:2368] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 14. Current term is 15.
I20260709 13:01:43.726467  2222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 1249) took 1255 ms. Trace:
I20260709 13:01:43.696125  1530 raft_consensus.cc:2468] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 23.
I20260709 13:01:43.726874  2222 rpcz_store.cc:276] 0709 13:01:42.470921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.488024 (+ 17103us) service_pool.cc:224] Handling call
0709 13:01:43.724501 (+1236477us) spinlock_profiling.cc:243] Waited 257 ms on lock 0x7b5400133654. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:01:43.726398 (+  1897us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":591126400}
W20260709 13:01:43.689224  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 47091.6us
I20260709 13:01:43.734799  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:43.704428  1570 leader_election.cc:304] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:43.709710  8052 raft_consensus.cc:2749] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:43.687808  1423 catalog_manager.cc:5697] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 8 to 14. New cstate: current_term: 14 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } }
I20260709 13:01:43.703197  7773 raft_consensus.cc:515] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:01:43.711024  7986 consensus_meta.cc:287] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.950s	user 0.007s	sys 0.004s
I20260709 13:01:43.661540  7823 raft_consensus.cc:740] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:43.698112  1531 raft_consensus.cc:2468] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 20.
I20260709 13:01:43.755367  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 13:01:43.756342  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 51996.6us
I20260709 13:01:43.702036  7710 raft_consensus.cc:697] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 15 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:43.714260  8029 raft_consensus.cc:2749] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:43.740669  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:43.757551  1570 leader_election.cc:304] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:43.761916  2225 raft_consensus.cc:3060] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:43.753796  1601 raft_consensus.cc:2468] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 15.
I20260709 13:01:43.762418  1570 leader_election.cc:400] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Vote denied by peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931) with higher term. Message: Invalid argument: T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 15. Current term is 16.
I20260709 13:01:43.762789  1570 leader_election.cc:403] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:43.763654  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:43.770612  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:43.771660  1601 raft_consensus.cc:2393] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 15: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:01:43.747809  1602 raft_consensus.cc:2468] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 23.
I20260709 13:01:43.779058  2192 leader_election.cc:400] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 21 election: Vote denied by peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303) with higher term. Message: Invalid argument: T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b for earlier term 21. Current term is 22.
I20260709 13:01:43.779525  2192 leader_election.cc:403] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
I20260709 13:01:43.783625  1530 raft_consensus.cc:1275] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:01:43.784092  1599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36200 (request call id 3094) took 1400 ms. Trace:
I20260709 13:01:43.761140  7935 raft_consensus.cc:2804] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:43.787508  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:43.784510  1599 rpcz_store.cc:276] 0709 13:01:42.375813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.376496 (+   683us) service_pool.cc:224] Handling call
0709 13:01:43.775559 (+1399063us) spinlock_profiling.cc:243] Waited 317 ms on lock 0x7b54003b1ad4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:01:43.775682 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":729103616}
I20260709 13:01:43.792119  2192 leader_election.cc:304] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:01:43.795585  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:43.772215  8079 raft_consensus.cc:2804] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:01:43.770511  8013 leader_election.cc:290] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:43.770352  8048 raft_consensus.cc:2749] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931) with higher term. Message: Invalid argument: T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 15. Current term is 16.
I20260709 13:01:43.759693  7986 raft_consensus.cc:515] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:43.771708  8012 raft_consensus.cc:697] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:43.810803  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:43.819572  1675 raft_consensus.cc:2393] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 14: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:01:43.819393  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:43.812367  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:43.820389  1530 raft_consensus.cc:2368] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 22. Current term is 23.
I20260709 13:01:43.798874  1532 raft_consensus.cc:1275] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
W20260709 13:01:43.815653  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 72408.9us
I20260709 13:01:43.793673  8045 raft_consensus.cc:3060] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:01:43.754063  7823 consensus_queue.cc:260] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:43.803668  8029 raft_consensus.cc:2804] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:43.770998  8082 consensus_queue.cc:1048] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.054s
I20260709 13:01:43.799450  7875 raft_consensus.cc:2749] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:01:43.833204  1646 leader_election.cc:304] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:43.803090  7935 raft_consensus.cc:697] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 16 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:43.835093  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:43.834916  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:43.838400  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:43.844151  7996 raft_consensus.cc:493] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:43.844803  7996 raft_consensus.cc:515] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:43.845356  7935 consensus_queue.cc:237] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:43.814208  8079 raft_consensus.cc:697] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 22 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
W20260709 13:01:43.899045  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 65924.7us
I20260709 13:01:43.839143  8010 leader_election.cc:290] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 19 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:43.916896  1644 leader_election.cc:304] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:01:43.917392  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 109445us
I20260709 13:01:43.833294  8075 consensus_queue.cc:1048] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.091s
I20260709 13:01:43.847942  8029 raft_consensus.cc:697] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 15 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:43.946911  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:43.947604  1600 raft_consensus.cc:3060] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:43.893697  8067 leader_election.cc:290] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:43.931010  8052 raft_consensus.cc:2749] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:43.950683  1644 leader_election.cc:304] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:01:43.962517  1497 leader_election.cc:400] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 19 pre-election: Vote denied by peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303) with higher term. Message: Invalid argument: T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 19. Current term is 20.
I20260709 13:01:43.954185  7773 leader_election.cc:290] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:43.848909  7710 consensus_queue.cc:237] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:43.948565  1423 catalog_manager.cc:5697] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 15 to 18, leader changed from e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 18 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } }
I20260709 13:01:43.937392  7980 leader_election.cc:290] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 22 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:43.962373  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:43.937312  7982 raft_consensus.cc:493] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:43.981838  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:43.963855  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:43.972921  7778 raft_consensus.cc:493] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:43.973519  8029 consensus_queue.cc:237] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:43.956185  8012 consensus_queue.cc:237] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 8, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:43.983896  7778 raft_consensus.cc:515] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:43.986003  7778 leader_election.cc:290] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:43.966835  8079 consensus_queue.cc:237] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:43.981659  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:43.988847  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:43.977048  1644 leader_election.cc:304] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:43.966552  8072 raft_consensus.cc:493] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:43.954541  8024 raft_consensus.cc:2749] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:01:43.965758  8087 log.cc:927] Time spent T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:01:43.949162  8010 raft_consensus.cc:493] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:43.979141  7706 raft_consensus.cc:2804] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:44.021636  1601 raft_consensus.cc:2393] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 16: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:01:44.024412  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:44.025132  1525 raft_consensus.cc:3060] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:44.027922  7706 raft_consensus.cc:697] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 13 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:44.028976  7706 consensus_queue.cc:237] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:44.021649  8010 raft_consensus.cc:515] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:43.990010  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:44.040030  1606 raft_consensus.cc:1275] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:01:44.040020  7880 leader_election.cc:290] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:43.977825  1600 raft_consensus.cc:2468] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 18.
I20260709 13:01:44.044135  8051 raft_consensus.cc:493] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:44.044787  8051 raft_consensus.cc:515] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:43.989764  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:44.004585  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:43.983456  7982 raft_consensus.cc:515] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:43.982312  8011 raft_consensus.cc:515] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:43.972028  8000 leader_election.cc:290] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:44.068111  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:44.002616  7778 raft_consensus.cc:2804] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:01:44.012691  7980 raft_consensus.cc:493] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:44.013376  8072 raft_consensus.cc:515] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:43.968428  1423 catalog_manager.cc:5697] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 14 to 15, leader changed from e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 15 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } }
I20260709 13:01:44.071494  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:44.017234  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36200 (request call id 3100) took 1387 ms. Trace:
I20260709 13:01:44.019840  7625 raft_consensus.cc:515] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:44.041587  1603 raft_consensus.cc:1275] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:01:44.052204  1526 raft_consensus.cc:2393] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 16: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:01:44.054037  2218 raft_consensus.cc:2468] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 14.
I20260709 13:01:44.057150  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:44.067627  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:44.067951  2225 raft_consensus.cc:2468] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 15.
I20260709 13:01:44.075153  1607 raft_consensus.cc:2368] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 19. Current term is 20.
I20260709 13:01:44.069957  1527 raft_consensus.cc:2393] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 14: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:01:44.075266  1529 raft_consensus.cc:1240] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 21 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 20. Current term is 21. Ops: []
I20260709 13:01:44.075604  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:44.078601  1674 raft_consensus.cc:1275] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:01:44.072175  1604 rpcz_store.cc:276] 0709 13:01:42.629893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.904635 (+274742us) service_pool.cc:224] Handling call
0709 13:01:42.980905 (+ 76270us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:43.505357 (+524452us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:43.505407 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:43.516338 (+ 10931us) log.cc:844] Serialized 26 byte log entry
0709 13:01:43.793360 (+277022us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:43.793396 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:43.793464 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:44.017007 (+223543us) raft_consensus.cc:1685] finished
0709 13:01:44.017028 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:44.017172 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5111,"raft.run_cpu_time_us":48,"raft.run_wall_time_us":48,"thread_start_us":736956,"threads_started":2,"wal-append.queue_time_us":307897}
I20260709 13:01:44.088330  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:44.067468  7880 raft_consensus.cc:493] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:44.089316  1526 raft_consensus.cc:2468] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 10.
I20260709 13:01:44.089351  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:44.094833  1673 raft_consensus.cc:2393] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 16: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:01:44.094743  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:44.092530  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:44.095455  1527 raft_consensus.cc:2468] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 16.
I20260709 13:01:44.097172  1497 leader_election.cc:400] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 19 election: Vote denied by peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303) with higher term. Message: Invalid argument: T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 19. Current term is 20.
I20260709 13:01:44.097559  1497 leader_election.cc:403] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 13:01:44.098086  1600 raft_consensus.cc:1240] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:44.100158  1674 raft_consensus.cc:2393] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 15: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:01:44.076665  8000 raft_consensus.cc:493] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:44.107194  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:44.075759  7778 raft_consensus.cc:697] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 23 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:44.077208  7884 leader_election.cc:290] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:44.111876  1672 raft_consensus.cc:2393] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 20: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:01:44.112103  1674 raft_consensus.cc:1275] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:01:44.109177  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:44.081763  8005 raft_consensus.cc:493] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:44.118009  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:44.120393  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:44.122745  1674 raft_consensus.cc:2468] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 16.
I20260709 13:01:44.127842  7625 leader_election.cc:290] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:44.124307  8005 raft_consensus.cc:515] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:44.130743  8010 leader_election.cc:290] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:44.079300  7980 raft_consensus.cc:515] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:44.131619  8005 leader_election.cc:290] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:44.132871  7980 leader_election.cc:290] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:44.136006  8056 raft_consensus.cc:493] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:44.106351  8012 raft_consensus.cc:2749] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303) with higher term. Message: Invalid argument: T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 19. Current term is 20.
I20260709 13:01:44.114257  7958 leader_election.cc:290] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:44.107827  7773 consensus_queue.cc:1048] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:01:44.146243  1423 catalog_manager.cc:5697] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:01:44.117624  8000 raft_consensus.cc:515] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:44.151647  2223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 1255) took 1264 ms. Trace:
I20260709 13:01:44.152872  2223 rpcz_store.cc:276] 0709 13:01:42.887549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.904127 (+ 16578us) service_pool.cc:224] Handling call
0709 13:01:42.904474 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:42.918411 (+ 13937us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:42.918442 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:42.918490 (+    48us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:42.918527 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:44.151382 (+1232855us) spinlock_profiling.cc:243] Waited 13.7 ms on lock 0x7b54006f13d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:01:44.151427 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:44.151557 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":31589248}
W20260709 13:01:44.152181  2220 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50326 (request call id 1363) took 1750 ms (client timeout 1686 ms). Trace:
I20260709 13:01:44.156850  1678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49170 (request call id 2961) took 1624 ms. Trace:
W20260709 13:01:44.155733  2220 rpcz_store.cc:269] 0709 13:01:42.401308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.401453 (+   145us) service_pool.cc:224] Handling call
0709 13:01:44.151985 (+1750532us) spinlock_profiling.cc:243] Waited 487 ms on lock 0x7b540051a754. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:01:44.152113 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1120057600}
I20260709 13:01:44.136759  8072 leader_election.cc:290] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:44.110831  7880 raft_consensus.cc:515] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:44.166918  1525 raft_consensus.cc:2468] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 14.
I20260709 13:01:44.141180  7980 raft_consensus.cc:493] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.168725  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:44.136729  8056 raft_consensus.cc:515] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:44.157343  1678 rpcz_store.cc:276] 0709 13:01:42.524108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.550338 (+ 26230us) service_pool.cc:224] Handling call
0709 13:01:42.550592 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:43.331362 (+780770us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:44.148084 (+816722us) spinlock_profiling.cc:243] Waited 739 ms on lock 0x7b54000b86d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:01:44.148311 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1699349248}
I20260709 13:01:44.171465  8011 leader_election.cc:290] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 21 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:44.174754  2219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50310 (request call id 1297) took 1276 ms. Trace:
I20260709 13:01:44.177227  2219 rpcz_store.cc:276] 0709 13:01:42.898468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.997437 (+ 98969us) service_pool.cc:224] Handling call
0709 13:01:42.997861 (+   424us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:43.546703 (+548842us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:43.546734 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:43.546774 (+    40us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:01:43.546804 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:44.174472 (+627668us) spinlock_profiling.cc:243] Waited 549 ms on lock 0x7b540069fd54. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:01:44.174523 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:44.174681 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1261851904}
I20260709 13:01:44.171712  7906 raft_consensus.cc:493] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:44.161931  1423 catalog_manager.cc:5697] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:01:44.177294  8051 leader_election.cc:290] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:44.180995  7980 raft_consensus.cc:515] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:44.219178  8045 raft_consensus.cc:2749] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303) with higher term. Message: Invalid argument: T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b for earlier term 21. Current term is 22.
I20260709 13:01:44.221351  7982 leader_election.cc:290] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:44.185235  7778 consensus_queue.cc:237] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:44.212869  7906 raft_consensus.cc:515] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:44.260170  7906 leader_election.cc:290] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:44.250155  1423 catalog_manager.cc:5697] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 8 to 11, leader changed from e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 11 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } }
I20260709 13:01:44.265077  7980 leader_election.cc:290] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:01:44.266135  8104 log.cc:927] Time spent T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:01:44.265903  1423 catalog_manager.cc:5697] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 9 to 21. New cstate: current_term: 21 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } }
I20260709 13:01:44.267656  8056 leader_election.cc:290] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:44.268046  7880 leader_election.cc:290] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:44.270319  7942 leader_election.cc:290] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:44.269371  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 13:01:44.272023  2227 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 1247) took 1846 ms (client timeout 2433 ms). Trace:
W20260709 13:01:44.272442  2227 rpcz_store.cc:269] 0709 13:01:42.425774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.425902 (+   128us) service_pool.cc:224] Handling call
0709 13:01:44.271830 (+1845928us) spinlock_profiling.cc:243] Waited 583 ms on lock 0x7b54001306d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:01:44.271963 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1341934464}
I20260709 13:01:44.272796  8000 leader_election.cc:290] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:44.271377  7699 leader_election.cc:290] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:44.278265  1531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43010 (request call id 2788) took 1289 ms. Trace:
I20260709 13:01:44.278746  1531 rpcz_store.cc:276] 0709 13:01:42.988489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.989363 (+   874us) service_pool.cc:224] Handling call
0709 13:01:44.278095 (+1288732us) spinlock_profiling.cc:243] Waited 615 ms on lock 0x7b54000618d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:01:44.278201 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1415232384}
I20260709 13:01:44.281800  2218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 1261) took 1165 ms. Trace:
I20260709 13:01:44.267446  1423 catalog_manager.cc:5697] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 10 to 16. New cstate: current_term: 16 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:01:44.283593  1423 catalog_manager.cc:5697] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 12 to 16, leader changed from e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 16 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } }
I20260709 13:01:44.285115  1423 catalog_manager.cc:5697] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 9 to 14. New cstate: current_term: 14 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:44.287700  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:44.288349  1525 raft_consensus.cc:2468] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 18.
I20260709 13:01:44.288714  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:44.273144  1524 raft_consensus.cc:1275] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:01:44.296978  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:44.301210  1602 raft_consensus.cc:1275] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:01:44.302464  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:44.282338  2218 rpcz_store.cc:276] 0709 13:01:43.116609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:43.201732 (+ 85123us) service_pool.cc:224] Handling call
0709 13:01:44.281616 (+1079884us) spinlock_profiling.cc:243] Waited 477 ms on lock 0x7b5400601b54. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:01:44.281737 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1097815424}
I20260709 13:01:44.301534  1605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36194 (request call id 2256) took 1682 ms. Trace:
I20260709 13:01:44.306996  1646 leader_election.cc:304] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:01:44.308454  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:44.309085  2223 raft_consensus.cc:2468] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 20.
I20260709 13:01:44.310004  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:44.316033  1524 raft_consensus.cc:1275] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:01:44.316758  2192 leader_election.cc:304] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:01:44.316689  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:44.305276  1605 rpcz_store.cc:276] 0709 13:01:42.619556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.882766 (+263210us) service_pool.cc:224] Handling call
0709 13:01:42.903546 (+ 20780us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:42.903751 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:01:43.131084 (+227333us) log.cc:844] Serialized 14 byte log entry
0709 13:01:44.300694 (+1169610us) spinlock_profiling.cc:243] Waited 4.63 ms on lock 0x7b18004e3e20. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1e38ede1 00007f6a1e39b5b1 00007f6a1815b4bc 00007f6a154a948b 00007f6a1e303ab9 00007f6a154c569b 00007f6a154c393f 00007f6a154c3455 00007f6a185ab060 00007f6a185bd716 00007f6a185ce287
0709 13:01:44.301030 (+   336us) log.cc:844] Serialized 14 byte log entry
0709 13:01:44.301203 (+   173us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:44.301247 (+    44us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:01:44.301301 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:44.301368 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:44.301478 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6067,"prepare.queue_time_us":110946,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":45658,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":7213,"spinlock_wait_cycles":10651520,"thread_start_us":566989,"threads_started":3,"wal-append.queue_time_us":416695}
I20260709 13:01:44.316248  7906 raft_consensus.cc:493] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:44.322727  7906 raft_consensus.cc:515] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:44.315623  8051 raft_consensus.cc:2804] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:44.329856  7900 leader_election.cc:290] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 16 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:44.333524  7996 leader_election.cc:290] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:44.339627  8045 raft_consensus.cc:993] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b: : Instructing follower 39a92f5a4352465d8af3af5908fe8642 to start an election
I20260709 13:01:44.340288  8045 raft_consensus.cc:1081] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 14 LEADER]: Signalling peer 39a92f5a4352465d8af3af5908fe8642 to start an election
I20260709 13:01:44.341199  1607 raft_consensus.cc:1275] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:01:44.319407  7765 consensus_queue.cc:1048] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.022s
I20260709 13:01:44.323069  8029 raft_consensus.cc:2804] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:01:44.346410  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:44.347703  2227 raft_consensus.cc:2468] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 19.
I20260709 13:01:44.325212  8061 consensus_queue.cc:1048] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.024s
W20260709 13:01:44.353845  8058 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.826s	user 0.004s	sys 0.022s
W20260709 13:01:44.355396  8058 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.833s	user 0.004s	sys 0.023s
I20260709 13:01:44.357189  8029 raft_consensus.cc:697] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 18 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:44.348366  8051 raft_consensus.cc:697] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 15 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:44.367693  1644 leader_election.cc:304] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:44.369623  1644 leader_election.cc:304] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:44.372251  8046 raft_consensus.cc:2804] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:44.372772  8046 raft_consensus.cc:697] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 14 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:44.373706  8046 consensus_queue.cc:237] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:44.374755  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:44.370527  8062 raft_consensus.cc:2804] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:44.375592  8062 raft_consensus.cc:493] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:44.375996  8062 raft_consensus.cc:3060] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:44.376463  7906 leader_election.cc:290] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:44.358217  8029 consensus_queue.cc:237] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:44.378527  8091 log.cc:927] Time spent T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.371s	user 0.001s	sys 0.003s
I20260709 13:01:44.379877  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:44.381247  8051 consensus_queue.cc:237] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:44.382405  1681 raft_consensus.cc:1275] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:01:44.383579  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:44.384363  1678 raft_consensus.cc:2393] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 14: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:01:44.386492  7906 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.387095  7906 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:44.388751  7986 leader_election.cc:290] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:44.389928  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:44.390744  7906 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:44.391855  1570 leader_election.cc:400] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 22 election: Vote denied by peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931) with higher term. Message: Invalid argument: T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 22. Current term is 23.
I20260709 13:01:44.392177  1570 leader_election.cc:403] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 22 election: Cancelling election due to peer responding with higher term
I20260709 13:01:44.381160  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:44.394488  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:44.394958  2191 leader_election.cc:304] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:44.396276  2191 leader_election.cc:304] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:44.396967  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:44.397380  2191 leader_election.cc:304] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:44.398448  1672 raft_consensus.cc:1275] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:01:44.396278  1528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43010 (request call id 2782) took 1542 ms. Trace:
I20260709 13:01:44.400761  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:44.402207  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:44.404305  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:44.404891  1644 leader_election.cc:304] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:01:44.408915  2191 leader_election.cc:304] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:44.409521  8059 consensus_queue.cc:1048] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:44.410255  8019 raft_consensus.cc:2749] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:01:44.400039  1528 rpcz_store.cc:276] 0709 13:01:42.853469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.855061 (+  1592us) service_pool.cc:224] Handling call
0709 13:01:44.396122 (+1541061us) spinlock_profiling.cc:243] Waited 738 ms on lock 0x7b540002bf54. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:01:44.396223 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1697985152}
I20260709 13:01:44.411674  7765 raft_consensus.cc:2749] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:01:44.412592  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:44.413906  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:44.415040  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:44.417157  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:44.417858  2227 raft_consensus.cc:2468] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 17.
I20260709 13:01:44.412467  7961 raft_consensus.cc:2749] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:44.422446  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:44.418215  2191 leader_election.cc:304] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:44.424139  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:44.424391  1646 leader_election.cc:304] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:44.425899  1678 raft_consensus.cc:3060] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:44.426004  1646 leader_election.cc:304] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:44.433379  2191 leader_election.cc:304] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:44.433292  1497 leader_election.cc:304] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:44.440773  2191 leader_election.cc:304] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:44.437677  1497 leader_election.cc:304] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:44.441593  1600 raft_consensus.cc:1275] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 13:01:44.450781  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 45990.1us
I20260709 13:01:44.454041  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:44.455758  2191 leader_election.cc:304] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:01:44.466831  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 75127.3us
I20260709 13:01:44.454403  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:44.454880  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:44.457440  7778 raft_consensus.cc:2804] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:01:44.457557  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:44.457988  8000 consensus_queue.cc:1048] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:44.459184  8102 consensus_queue.cc:1059] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:44.459762  1677 raft_consensus.cc:1275] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:01:44.460240  8022 raft_consensus.cc:2749] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:01:44.462821  8056 raft_consensus.cc:2749] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:01:44.469331  1678 raft_consensus.cc:2468] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 15.
I20260709 13:01:44.470147  1644 leader_election.cc:304] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:44.425570  8061 raft_consensus.cc:2749] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:01:44.472728  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:44.474020  1681 raft_consensus.cc:1275] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 22 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:01:44.418992  7986 raft_consensus.cc:493] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:44.478992  1646 leader_election.cc:304] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:44.486157  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:44.451134  7817 raft_consensus.cc:2749] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:01:44.491469  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:44.456422  7906 raft_consensus.cc:2749] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:44.488921  7706 raft_consensus.cc:2764] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:01:44.456003  7765 raft_consensus.cc:2804] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:01:44.450336  8067 raft_consensus.cc:2749] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:44.492132  1681 raft_consensus.cc:2468] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 17.
I20260709 13:01:44.487615  1680 raft_consensus.cc:1240] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 20 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 19. Current term is 20. Ops: []
I20260709 13:01:44.488771  7958 raft_consensus.cc:3055] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:01:44.455099  7836 raft_consensus.cc:2804] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:44.496721  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:44.505657  7706 raft_consensus.cc:2749] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:44.506477  7817 raft_consensus.cc:493] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.507032  7817 raft_consensus.cc:515] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:44.509172  7817 leader_election.cc:290] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:44.509824  7836 raft_consensus.cc:697] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
W20260709 13:01:44.510748  8119 log.cc:927] Time spent T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:01:44.513310  7823 raft_consensus.cc:3060] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:44.484704  7961 raft_consensus.cc:2749] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:44.519573  8062 raft_consensus.cc:515] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:44.510758  7836 consensus_queue.cc:237] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:44.490541  7778 raft_consensus.cc:697] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 20 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:44.496222  7986 raft_consensus.cc:515] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:44.483754  8084 consensus_queue.cc:1059] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.050s
I20260709 13:01:44.498315  1570 leader_election.cc:304] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
W20260709 13:01:44.499538  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 57481.5us
I20260709 13:01:44.501178  7765 raft_consensus.cc:697] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 20 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:44.502987  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:44.477257  7996 raft_consensus.cc:2749] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 23 FOLLOWER]: Leader election lost for term 22. Reason: Vote denied by peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931) with higher term. Message: Invalid argument: T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 22. Current term is 23.
I20260709 13:01:44.535989  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:44.531069  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:44.481127  2191 leader_election.cc:304] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:44.540757  1527 raft_consensus.cc:3060] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:44.543797  1528 raft_consensus.cc:1275] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:01:44.527405  8084 raft_consensus.cc:3055] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:01:44.544566  8084 raft_consensus.cc:740] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:44.545382  8084 consensus_queue.cc:260] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:44.524451  7778 consensus_queue.cc:237] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:44.545159  8059 raft_consensus.cc:2804] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:44.542263  1496 leader_election.cc:304] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
W20260709 13:01:44.547401  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 66379.5us
I20260709 13:01:44.548626  1570 leader_election.cc:400] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 election: Vote denied by peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931) with higher term. Message: Invalid argument: T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 14. Current term is 15.
I20260709 13:01:44.552419  1570 leader_election.cc:403] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:01:44.553296  2191 leader_election.cc:304] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:44.554131  8061 raft_consensus.cc:2749] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:44.555794  8061 consensus_queue.cc:1048] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:01:44.557749  2191 leader_election.cc:304] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:44.485639  7750 consensus_queue.cc:1059] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 13:01:44.504608  7958 raft_consensus.cc:740] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:44.521879  8062 leader_election.cc:290] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:44.560820  1571 leader_election.cc:304] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:44.526645  7986 leader_election.cc:290] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:44.562300  1496 leader_election.cc:304] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:01:44.583427  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:44.584973  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:44.585342  1570 leader_election.cc:304] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:44.623092  2222 raft_consensus.cc:2468] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 19.
W20260709 13:01:44.624888  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 64158.4us
W20260709 13:01:44.625056  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 62848.3us
I20260709 13:01:44.551025  8045 raft_consensus.cc:2749] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:44.631078  1496 leader_election.cc:304] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:44.587355  2191 leader_election.cc:304] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:44.640033  1527 raft_consensus.cc:2468] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 11.
I20260709 13:01:44.641741  1644 leader_election.cc:304] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
W20260709 13:01:44.644351  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 59121.9us
W20260709 13:01:44.617424  8017 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.824s	user 0.008s	sys 0.022s
I20260709 13:01:44.559520  8059 raft_consensus.cc:493] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:44.648366  1646 leader_election.cc:304] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:01:44.648322  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 61071.4us
I20260709 13:01:44.586815  7906 raft_consensus.cc:2749] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:44.657217  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:44.659629  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:44.662525  1496 leader_election.cc:304] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:44.663931  1496 leader_election.cc:304] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:44.620464  8058 raft_consensus.cc:3055] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:44.586773  8018 raft_consensus.cc:2749] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931) with higher term. Message: Invalid argument: T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 14. Current term is 15.
W20260709 13:01:44.649780  8017 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.871s	user 0.008s	sys 0.023s
I20260709 13:01:44.620807  8084 raft_consensus.cc:3060] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:44.626722  7706 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.559388  8082 consensus_queue.cc:1048] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.091s
I20260709 13:01:44.630131  8077 raft_consensus.cc:2804] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:44.676710  1496 leader_election.cc:304] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:01:44.695283  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:44.670205  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:44.629940  7875 raft_consensus.cc:2749] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:01:44.626190  7884 consensus_queue.cc:1048] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.055s
I20260709 13:01:44.586521  8040 consensus_queue.cc:1048] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.075s
I20260709 13:01:44.649586  7699 consensus_queue.cc:1048] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 13:01:44.643036  7817 raft_consensus.cc:2764] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:01:44.666677  7750 consensus_queue.cc:1048] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:01:44.661819  8022 raft_consensus.cc:2804] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:44.698365  7706 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:44.697422  1598 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 22.
I20260709 13:01:44.682157  8045 raft_consensus.cc:493] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:44.661304  8059 raft_consensus.cc:3060] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:44.692777  7710 raft_consensus.cc:493] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:44.701952  8077 raft_consensus.cc:493] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:44.693158  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:44.675159  8052 raft_consensus.cc:2804] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:44.702692  8064 raft_consensus.cc:493] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.675072  7982 raft_consensus.cc:2749] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:01:44.706387  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 58101.4us
I20260709 13:01:44.743402  1646 leader_election.cc:304] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:44.707427  1497 leader_election.cc:304] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:44.709291  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 18 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:44.710464  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:44.710848  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:44.666455  7980 raft_consensus.cc:2804] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:01:44.713255  1571 leader_election.cc:304] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:44.667274  8058 raft_consensus.cc:740] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:44.675256  8012 raft_consensus.cc:2749] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:01:44.706305  1607 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923"
dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
 from {username='slave'} at 127.0.0.1:57268
I20260709 13:01:44.619191  8061 consensus_queue.cc:1048] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.056s
I20260709 13:01:44.782624  1607 raft_consensus.cc:493] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:44.783500  1607 raft_consensus.cc:3060] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:44.709050  7773 raft_consensus.cc:2804] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:44.741039  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:44.712388  8056 raft_consensus.cc:2804] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:01:44.748234  8046 raft_consensus.cc:493] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.691562  8011 consensus_queue.cc:1048] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.038s
I20260709 13:01:44.699400  8072 consensus_queue.cc:1059] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:01:44.764560  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "822e65124bb44159b257fd219d28d93c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:44.741588  7942 raft_consensus.cc:2749] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:01:44.734679  1598 raft_consensus.cc:1275] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 22 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:01:44.737375  8077 raft_consensus.cc:3060] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:44.815356  2226 raft_consensus.cc:2393] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 15: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:01:44.816452  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:44.817638  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:44.730888  8022 raft_consensus.cc:697] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 15 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:44.819361  8022 consensus_queue.cc:237] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:44.822561  8077 raft_consensus.cc:515] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:44.824119  7706 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:01:44.775159  1495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.778883  1605 raft_consensus.cc:1275] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:01:44.660626  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:44.826324  7961 consensus_queue.cc:1048] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:01:44.731283  7875 raft_consensus.cc:493] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:44.828361  7875 raft_consensus.cc:515] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:44.715415  7818 consensus_queue.cc:1059] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.048s
I20260709 13:01:44.691277  7958 consensus_queue.cc:260] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:44.694844  8114 consensus_queue.cc:1048] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 13:01:44.749486  7884 raft_consensus.cc:2749] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:01:44.766234  7980 raft_consensus.cc:493] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:44.700109  7765 consensus_queue.cc:237] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:44.791169  8046 raft_consensus.cc:515] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:44.748216  8064 raft_consensus.cc:515] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:44.791908  8018 raft_consensus.cc:2749] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:44.793466  8056 raft_consensus.cc:493] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 20 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:44.861732  8056 raft_consensus.cc:3060] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:44.798555  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:44.805071  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:44.806134  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:44.734320  8045 raft_consensus.cc:515] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:44.766252  8060 raft_consensus.cc:2749] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:44.810884  1646 leader_election.cc:304] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:01:44.826735  2227 raft_consensus.cc:1275] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 22 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:01:44.769272  8052 raft_consensus.cc:697] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 11 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:44.741653  7710 raft_consensus.cc:515] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:01:44.842370  8122 log.cc:927] Time spent T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 13:01:44.849936  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 148473us
I20260709 13:01:44.948040  1496 leader_election.cc:304] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:44.949399  1496 leader_election.cc:304] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:44.788789  7773 raft_consensus.cc:493] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:44.774248  7983 consensus_queue.cc:1048] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.066s
I20260709 13:01:44.858418  1607 raft_consensus.cc:515] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:44.851446  7980 raft_consensus.cc:3060] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:01:44.884698  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 73895.2us
W20260709 13:01:44.941879  1644 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.860301  7818 raft_consensus.cc:3055] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:01:44.983058  2220 raft_consensus.cc:2468] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 15.
I20260709 13:01:44.984436  1526 raft_consensus.cc:1240] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:44.871718  8077 leader_election.cc:290] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 17 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:44.993827  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:44.998329  1607 leader_election.cc:290] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:45.004834  8062 raft_consensus.cc:493] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.005486  8062 raft_consensus.cc:515] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:45.007918  1528 raft_consensus.cc:1240] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:45.009137  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:45.010008  1530 raft_consensus.cc:2393] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 18: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:01:45.009299  2222 raft_consensus.cc:2468] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 22.
I20260709 13:01:45.012897  2226 raft_consensus.cc:1275] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 22 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:01:45.015120  1646 leader_election.cc:304] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:01:44.952853  7773 raft_consensus.cc:3060] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:44.954147  8040 raft_consensus.cc:2804] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:01:45.017710  1646 leader_election.cc:304] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:45.018978  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:44.984970  7818 raft_consensus.cc:740] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:44.987703  7982 raft_consensus.cc:2749] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:01:45.032855  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 319683us
I20260709 13:01:45.034884  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:45.037987  1679 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 22.
I20260709 13:01:45.042483  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:45.043232  2222 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 22.
I20260709 13:01:44.985144  7823 raft_consensus.cc:2749] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:01:45.027833  8096 raft_consensus.cc:2804] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:45.020076  8040 raft_consensus.cc:493] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:45.071722  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:45.073426  2227 raft_consensus.cc:3055] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:45.073767  2227 raft_consensus.cc:740] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:45.081816  1601 raft_consensus.cc:1275] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 23 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:01:45.085719  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:45.086541  1604 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 22.
I20260709 13:01:45.093367  1572 leader_election.cc:304] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:45.067044  7778 raft_consensus.cc:2804] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:01:45.054838  8062 leader_election.cc:290] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:45.097617  1572 leader_election.cc:304] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:45.095906  2227 consensus_queue.cc:260] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:45.102483  2227 raft_consensus.cc:3060] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:45.069689  8096 raft_consensus.cc:493] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:45.068214  7699 raft_consensus.cc:493] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:45.075600  8040 raft_consensus.cc:3060] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:45.094754  8082 raft_consensus.cc:2749] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:45.101531  7778 raft_consensus.cc:493] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:45.076316  8042 raft_consensus.cc:493] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:45.072940  8064 leader_election.cc:290] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:45.134903  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:45.109671  1528 raft_consensus.cc:1275] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:01:45.112792  1572 leader_election.cc:304] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:45.099010  8054 raft_consensus.cc:493] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:45.107532  8096 raft_consensus.cc:3060] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:45.144212  1572 leader_election.cc:304] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:45.154783  2191 leader_election.cc:304] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:45.098886  7818 consensus_queue.cc:260] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:45.133908  7778 raft_consensus.cc:3060] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:45.140202  7699 raft_consensus.cc:515] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:45.167668  7818 raft_consensus.cc:3060] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:45.169045  2191 leader_election.cc:304] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:45.169662  8061 raft_consensus.cc:2804] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:01:45.170840  1528 raft_consensus.cc:1275] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:01:45.176373  7710 leader_election.cc:290] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:45.184705  1572 leader_election.cc:304] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:45.192387  2223 raft_consensus.cc:1240] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 20 LEADER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 19. Current term is 20. Ops: []
I20260709 13:01:45.193383  1679 raft_consensus.cc:1275] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:01:45.138335  8132 raft_consensus.cc:2749] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:01:45.150246  8082 raft_consensus.cc:2749] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:45.099431  8052 consensus_queue.cc:237] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:45.182960  8061 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:45.182809  8022 raft_consensus.cc:2749] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:45.224957  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 18 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:45.188251  7900 raft_consensus.cc:2749] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:45.144655  8042 raft_consensus.cc:515] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:45.252262  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:45.253940  1680 raft_consensus.cc:1275] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 19 index: 9. (index mismatch)
I20260709 13:01:45.248795  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:45.256528  1528 raft_consensus.cc:2468] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 15.
I20260709 13:01:45.231215  2190 leader_election.cc:304] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:45.259584  7906 raft_consensus.cc:2749] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:45.260391  8019 consensus_queue.cc:1059] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:01:45.227380  8132 raft_consensus.cc:2749] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:01:45.225644  8061 raft_consensus.cc:3060] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:01:45.225170  8046 leader_election.cc:290] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:45.228436  7699 leader_election.cc:290] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:45.179932  8059 raft_consensus.cc:515] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:45.229071  8045 leader_election.cc:290] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:45.248014  7982 raft_consensus.cc:493] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.178993  8054 raft_consensus.cc:515] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:45.267685  7823 consensus_queue.cc:1048] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 13:01:45.264645  8082 consensus_queue.cc:1048] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 13:01:45.280402  8059 leader_election.cc:290] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:01:45.280758  8136 log.cc:927] Time spent T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:01:45.281570  7982 raft_consensus.cc:515] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:45.283340  8042 leader_election.cc:290] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:45.248390  8017 consensus_queue.cc:1059] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:01:45.288033  8061 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 23 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:45.332083  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 72517.6us
W20260709 13:01:45.320156  8126 log.cc:927] Time spent T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.287s	user 0.000s	sys 0.001s
W20260709 13:01:45.337980  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 153362us
W20260709 13:01:45.334532  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 121675us
I20260709 13:01:45.339912  1572 leader_election.cc:304] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:45.354740  2190 leader_election.cc:304] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:45.358902  1528 pending_rounds.cc:85] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting all ops after (but not including) 12
I20260709 13:01:45.359256  1528 pending_rounds.cc:107] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260709 13:01:45.359498  1528 raft_consensus.cc:2889] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:01:45.363374  8141 log.cc:927] Time spent T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:01:45.369123  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
W20260709 13:01:45.378067  8127 log.cc:927] Time spent T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.638s	user 0.005s	sys 0.000s
I20260709 13:01:45.385243  7982 leader_election.cc:290] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:01:45.389855  8056 consensus_meta.cc:287] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.528s	user 0.007s	sys 0.000s
W20260709 13:01:45.393280  8084 consensus_meta.cc:287] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent flushing consensus metadata: real 0.703s	user 0.008s	sys 0.000s
I20260709 13:01:45.397423  8017 consensus_queue.cc:1048] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:01:45.397878  8096 raft_consensus.cc:515] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:45.347090  8154 raft_consensus.cc:2749] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:45.357934  7940 raft_consensus.cc:493] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:45.427531  1495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:45.429955  8156 raft_consensus.cc:2804] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:45.430541  8156 raft_consensus.cc:493] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:45.430984  8156 raft_consensus.cc:3060] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:45.433653  7980 raft_consensus.cc:515] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:45.434875  1602 raft_consensus.cc:1240] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 18. Current term is 19. Ops: [18.13-18.13]
I20260709 13:01:45.344427  8022 consensus_queue.cc:1048] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.073s
I20260709 13:01:45.415683  8084 raft_consensus.cc:493] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.390447  8056 raft_consensus.cc:515] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:45.374503  7778 raft_consensus.cc:515] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:45.460678  2227 raft_consensus.cc:2468] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 15.
I20260709 13:01:45.463402  1678 raft_consensus.cc:1240] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 20. Current term is 21. Ops: []
I20260709 13:01:45.428411  7940 raft_consensus.cc:515] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:01:45.479295  1497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:45.446372  8084 raft_consensus.cc:515] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:45.486871  7996 raft_consensus.cc:493] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.489982  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 13:01:45.490790  8157 log.cc:927] Time spent T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:01:45.496492  1526 raft_consensus.cc:1275] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 23 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:01:45.511399  7778 leader_election.cc:290] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 20 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:45.519601  1523 raft_consensus.cc:1275] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:01:45.513567  7940 leader_election.cc:290] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:45.502266  7942 raft_consensus.cc:493] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:45.535221  8161 log.cc:927] Time spent T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:01:45.536789  7875 leader_election.cc:290] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:45.537097  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 20 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:45.537801  1680 raft_consensus.cc:2468] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 19.
W20260709 13:01:45.544576  8145 log.cc:927] Time spent T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.262s	user 0.000s	sys 0.001s
I20260709 13:01:45.551245  1676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49178 (request call id 2622) took 1097 ms. Trace:
I20260709 13:01:45.551843  1676 rpcz_store.cc:276] 0709 13:01:44.454003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:44.456538 (+  2535us) service_pool.cc:224] Handling call
0709 13:01:45.550947 (+1094409us) spinlock_profiling.cc:243] Waited 548 ms on lock 0x7b54003f61d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b72fa 00007f6a1d578b17 00007f6a16af36d4 00007f6a16af3662 00007f6a16af3591 00007f6a16af350c 00007f6a16af27c2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:01:45.551137 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1260916608}
I20260709 13:01:45.554064  7980 leader_election.cc:290] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 19 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:45.515148  8054 leader_election.cc:290] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:45.503835  7996 raft_consensus.cc:515] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:45.554615  7765 raft_consensus.cc:3055] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:45.579582  7765 raft_consensus.cc:740] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:45.580387  7765 consensus_queue.cc:260] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:45.581151  8146 log.cc:927] Time spent T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.306s	user 0.003s	sys 0.000s
I20260709 13:01:45.581624  7765 raft_consensus.cc:3060] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:45.551084  7942 raft_consensus.cc:515] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:45.583101  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:45.583870  1672 raft_consensus.cc:2468] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 18.
I20260709 13:01:45.584319  7942 leader_election.cc:290] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:45.557096  7996 leader_election.cc:290] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:45.585398  1672 raft_consensus.cc:1240] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 20 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 19. Current term is 20. Ops: []
I20260709 13:01:45.593328  7958 raft_consensus.cc:3060] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:45.603704  8029 raft_consensus.cc:493] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:45.604355  8029 raft_consensus.cc:515] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:45.567404  8061 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 23 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:01:45.601118  8142 log.cc:927] Time spent T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.320s	user 0.000s	sys 0.001s
W20260709 13:01:45.602458  8153 log.cc:927] Time spent T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.321s	user 0.001s	sys 0.000s
I20260709 13:01:45.570566  1673 raft_consensus.cc:1240] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 13 LEADER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 12. Current term is 13. Ops: []
W20260709 13:01:45.603868  8151 log.cc:927] Time spent T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.329s	user 0.000s	sys 0.002s
W20260709 13:01:45.565373  8138 log.cc:927] Time spent T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.278s	user 0.003s	sys 0.000s
I20260709 13:01:45.528923  1497 leader_election.cc:304] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:45.606591  8029 leader_election.cc:290] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:45.576485  1571 leader_election.cc:304] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:45.576632  8054 raft_consensus.cc:493] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:45.624898  7983 raft_consensus.cc:2749] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:01:45.680876  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 309703us
I20260709 13:01:45.737795  1572 leader_election.cc:304] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:01:45.695550  1674 raft_consensus.cc:1240] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 11 LEADER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:45.739904  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:45.740463  8131 consensus_queue.cc:1048] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:01:45.700488  8082 raft_consensus.cc:493] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:45.698819  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
W20260709 13:01:45.704704  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 128312us
W20260709 13:01:45.619496  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 90675.6us
I20260709 13:01:45.746356  1571 leader_election.cc:304] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:45.746587  1497 leader_election.cc:304] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
W20260709 13:01:45.617203  2190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:45.748026  1497 leader_election.cc:304] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:45.567982  1680 raft_consensus.cc:1275] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:01:45.749871  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:45.752777  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:45.571728  1528 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24"
dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
mode: GRACEFUL
new_leader_uuid: "ddf11fc190dd4b898773379c6b129d90"
 from {username='slave'} at 127.0.0.1:40594
I20260709 13:01:45.748335  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:45.750710  2226 raft_consensus.cc:1275] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:01:45.753844  2227 raft_consensus.cc:1275] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:01:45.754380  1528 raft_consensus.cc:606] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 LEADER]: Received request to transfer leadership to TS ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:45.755191  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:45.759531  1681 raft_consensus.cc:1240] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 14 LEADER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:45.763701  1497 leader_election.cc:304] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:45.764592  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:01:45.640870  8148 log.cc:927] Time spent T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.359s	user 0.004s	sys 0.000s
I20260709 13:01:45.738631  7996 raft_consensus.cc:2804] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:45.618621  8096 leader_election.cc:290] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 18 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:45.782112  7699 consensus_queue.cc:1059] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.006s
I20260709 13:01:45.756110  7817 raft_consensus.cc:493] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:45.788098  7817 raft_consensus.cc:515] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:45.790215  7817 leader_election.cc:290] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:45.782330  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:45.787142  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:45.793469  1599 raft_consensus.cc:1275] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:01:45.630918  7982 raft_consensus.cc:493] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.766582  1676 raft_consensus.cc:1275] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 13:01:45.621486  7773 consensus_meta.cc:287] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent flushing consensus metadata: real 0.591s	user 0.009s	sys 0.001s
W20260709 13:01:45.773562  8019 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.011s	sys 0.003s
I20260709 13:01:45.774586  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:45.775800  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:45.807519  1601 raft_consensus.cc:3060] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:01:45.753242  8040 consensus_meta.cc:287] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.611s	user 0.008s	sys 0.003s
I20260709 13:01:45.704977  7625 raft_consensus.cc:2804] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:01:45.613526  8084 leader_election.cc:290] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:45.703929  8160 raft_consensus.cc:493] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.767261  1497 leader_election.cc:304] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:01:45.620546  8056 leader_election.cc:290] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 21 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:45.768821  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:45.743180  8082 raft_consensus.cc:515] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:45.758231  8156 raft_consensus.cc:515] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:45.747357  7942 raft_consensus.cc:2749] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:01:45.756176  8131 raft_consensus.cc:2804] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:01:45.805675  7699 consensus_queue.cc:1048] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:01:45.819537  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 61382.3us
I20260709 13:01:45.807544  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:45.625263  8054 raft_consensus.cc:515] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:45.791975  7818 consensus_queue.cc:1059] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:01:45.768996  8012 raft_consensus.cc:2749] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:01:45.871883  8054 leader_election.cc:290] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
W20260709 13:01:45.815158  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 48686.9us
I20260709 13:01:45.816177  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:45.874102  1681 raft_consensus.cc:2468] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 18.
I20260709 13:01:45.765522  8046 consensus_queue.cc:1048] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.046s
I20260709 13:01:45.779834  8139 consensus_queue.cc:1048] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.036s
I20260709 13:01:45.892970  2218 raft_consensus.cc:1240] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:45.813714  7625 raft_consensus.cc:493] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:45.856173  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 88999.2us
I20260709 13:01:45.626789  8058 consensus_queue.cc:260] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:45.812184  7996 raft_consensus.cc:697] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 15 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:45.861253  2220 raft_consensus.cc:2393] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 15: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:01:45.808832  7982 raft_consensus.cc:515] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:01:45.870240  8171 log.cc:927] Time spent T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:01:45.840350  8045 raft_consensus.cc:493] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.878450  1529 raft_consensus.cc:1275] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:01:45.923094  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:45.923815  2222 raft_consensus.cc:2468] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 9.
I20260709 13:01:45.925995  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:45.928371  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:45.811691  7773 raft_consensus.cc:515] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:01:45.808557  8019 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.011s	sys 0.003s
I20260709 13:01:45.816119  8040 raft_consensus.cc:515] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:45.912112  1525 raft_consensus.cc:1240] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:45.867545  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:45.940142  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:45.912830  1526 raft_consensus.cc:1275] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 22 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:01:45.858227  8181 raft_consensus.cc:493] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.942932  8181 raft_consensus.cc:515] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:45.945374  8181 leader_election.cc:290] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:45.910209  8130 raft_consensus.cc:493] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:45.914777  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 134433us
I20260709 13:01:45.919535  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:45.873291  8072 raft_consensus.cc:493] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:45.931555  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 13:01:45.933036  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:45.934281  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:45.953001  1524 raft_consensus.cc:3060] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:45.937959   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:01:45.906477  8084 raft_consensus.cc:2804] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:45.910883  7942 raft_consensus.cc:3055] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:01:45.911497  7625 raft_consensus.cc:3060] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:45.971493  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:45.951700  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:45.902493  1601 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 23.
I20260709 13:01:45.953631  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:45.954923   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:01:45.965843  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 87076.2us
I20260709 13:01:45.968729  1527 raft_consensus.cc:1240] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 13:01:45.969043  1675 raft_consensus.cc:1240] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 17. Current term is 18. Ops: []
I20260709 13:01:45.866602  8160 raft_consensus.cc:515] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:45.905452  7875 consensus_queue.cc:1048] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
W20260709 13:01:45.919287  7940 consensus_queue.cc:1175] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ddf11fc190dd4b898773379c6b129d90" responder_term: 13 status { last_received { term: 13 index: 11 } last_committed_idx: 9 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 12. Current term is 13. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:01:46.027948  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:46.006078  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:45.973886  1531 raft_consensus.cc:1275] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:01:46.063031  1679 raft_consensus.cc:1275] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 20 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:01:46.042397  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:45.975478  1673 raft_consensus.cc:1240] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 20 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 19. Current term is 20. Ops: []
I20260709 13:01:46.000265  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:46.007004  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:46.061069  1674 raft_consensus.cc:1275] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:01:46.051265  1524 raft_consensus.cc:2468] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 15.
I20260709 13:01:46.074476  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:45.936447  8045 raft_consensus.cc:515] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:46.081657  1570 leader_election.cc:304] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:46.085738  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:46.095089  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:46.087105  2222 raft_consensus.cc:1275] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:01:46.089089  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:46.097754  1601 raft_consensus.cc:1275] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:01:46.099291  8045 leader_election.cc:290] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:46.101007  7699 consensus_queue.cc:1048] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:01:46.102797  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:46.103917  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:46.104920  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 20 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:46.063506  8139 raft_consensus.cc:493] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:46.107084  8139 raft_consensus.cc:515] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:46.107426  1570 leader_election.cc:304] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:46.108155  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:46.108759  1599 raft_consensus.cc:2468] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 15.
I20260709 13:01:46.105942  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:45.971800  8077 raft_consensus.cc:2749] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:01:46.030887  8129 log.cc:927] Time spent T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
W20260709 13:01:46.027706  8167 log.cc:927] Time spent T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
I20260709 13:01:46.093155  2190 leader_election.cc:304] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:45.967128  7942 raft_consensus.cc:740] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:45.957793  8084 raft_consensus.cc:493] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:46.147401  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:46.131142  1497 leader_election.cc:304] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
W20260709 13:01:46.140029  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 46969.5us
I20260709 13:01:45.936875  8012 consensus_queue.cc:1048] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.148s
I20260709 13:01:46.126124  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:46.127444  1601 raft_consensus.cc:1275] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:01:46.063620  8061 raft_consensus.cc:493] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:46.089612  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:46.162647  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:46.094794  8131 raft_consensus.cc:493] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
W20260709 13:01:46.127406  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 178374us
I20260709 13:01:46.128821  2223 raft_consensus.cc:1240] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 23 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 22. Current term is 23. Ops: [22.14-22.14]
I20260709 13:01:46.027397  8186 raft_consensus.cc:493] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.153756  1497 leader_election.cc:304] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:45.967537  8072 raft_consensus.cc:515] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:46.107728  7982 leader_election.cc:290] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:46.029295  8170 consensus_queue.cc:1059] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.099s
I20260709 13:01:46.161167  1525 raft_consensus.cc:1275] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 13:01:46.158746  1606 raft_consensus.cc:2468] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 23.
I20260709 13:01:46.153473  8084 raft_consensus.cc:3060] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:46.166739  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:45.957715  8130 raft_consensus.cc:515] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:46.125507  8155 raft_consensus.cc:2749] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:46.162729  1602 raft_consensus.cc:2468] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 20.
I20260709 13:01:46.140132  7880 raft_consensus.cc:2749] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:01:46.161938  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:46.128408  8045 consensus_queue.cc:1048] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.044s
I20260709 13:01:46.129597  7750 consensus_queue.cc:1059] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:01:46.062480  7996 consensus_queue.cc:237] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:46.128616  8185 consensus_queue.cc:1059] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.093s
I20260709 13:01:46.189209  7982 consensus_queue.cc:1048] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 13:01:46.191423  1531 raft_consensus.cc:1275] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:01:46.226282  8130 leader_election.cc:290] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:46.174283  8190 consensus_queue.cc:1048] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.056s
I20260709 13:01:46.168964  8131 raft_consensus.cc:3060] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:46.167239  7817 raft_consensus.cc:3055] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:01:46.158833  8189 raft_consensus.cc:2749] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:01:46.228392  1599 raft_consensus.cc:1275] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:01:46.224323  1524 raft_consensus.cc:2410] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for term 21 because replica has last-logged OpId of term: 19 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 15.
I20260709 13:01:46.172917  8186 raft_consensus.cc:515] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:46.169646  8061 raft_consensus.cc:515] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:46.167527  8139 leader_election.cc:290] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:46.173411  8022 raft_consensus.cc:2749] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:01:46.242156  7699 raft_consensus.cc:2749] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:01:46.238412  8170 consensus_queue.cc:1243] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer ddf11fc190dd4b898773379c6b129d90 log is divergent from this leader: its last log entry 14.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:01:46.238808  8082 leader_election.cc:290] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:46.238267  8156 leader_election.cc:290] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 16 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
W20260709 13:01:46.250631  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 96976us
I20260709 13:01:46.146945  7900 consensus_queue.cc:1048] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.029s
I20260709 13:01:46.248867  7942 consensus_queue.cc:260] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:46.250770  7817 raft_consensus.cc:740] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
W20260709 13:01:46.284997  7958 consensus_meta.cc:287] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.682s	user 0.003s	sys 0.006s
I20260709 13:01:46.267532  7773 leader_election.cc:290] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 18 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:46.315327  7817 consensus_queue.cc:260] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:46.316227  8173 log.cc:927] Time spent T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.424s	user 0.002s	sys 0.000s
I20260709 13:01:46.300832  8061 leader_election.cc:290] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:46.316824  7817 raft_consensus.cc:3060] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:46.277266  8194 raft_consensus.cc:493] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:46.319581  8072 leader_election.cc:290] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:46.277907  8040 leader_election.cc:290] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 20 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:46.320012  8194 raft_consensus.cc:515] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:46.322257  8194 leader_election.cc:290] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:46.324026  1646 leader_election.cc:304] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:46.325546  1646 leader_election.cc:304] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
W20260709 13:01:46.326030  8179 log.cc:927] Time spent T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.386s	user 0.000s	sys 0.003s
W20260709 13:01:46.303120  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 138614us
I20260709 13:01:46.286088  7942 raft_consensus.cc:3060] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:46.300633  8022 raft_consensus.cc:493] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:46.330859  8176 raft_consensus.cc:2804] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:01:46.331374  8176 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 22 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:46.331727  8176 raft_consensus.cc:3060] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:01:46.311550  8182 log.cc:927] Time spent T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:01:46.283121  8139 raft_consensus.cc:493] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:46.335774  8139 raft_consensus.cc:515] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:46.336563  8175 raft_consensus.cc:2804] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:46.336997  8175 raft_consensus.cc:493] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:46.337353  8175 raft_consensus.cc:3060] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:46.337935  8139 leader_election.cc:290] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:46.288290  8186 leader_election.cc:290] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:46.342008  8101 raft_consensus.cc:493] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
W20260709 13:01:46.355490  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 246612us
I20260709 13:01:46.357069  1570 leader_election.cc:304] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:46.351176  2192 leader_election.cc:304] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:46.289309  8084 raft_consensus.cc:515] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:46.372176  8059 raft_consensus.cc:2749] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:01:46.395057  8191 raft_consensus.cc:2749] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:46.319518  8160 leader_election.cc:290] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:46.350354  8163 raft_consensus.cc:3055] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:01:46.418514  1600 raft_consensus.cc:1240] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 23 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 22. Current term is 23. Ops: [22.14-22.14]
I20260709 13:01:46.419245  1530 raft_consensus.cc:1240] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:46.419365  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 19 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:46.419654  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:46.420394  1531 raft_consensus.cc:2410] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for term 19 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 13:01:46.420691  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 17 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:46.369194  8190 raft_consensus.cc:493] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:46.421983  1523 raft_consensus.cc:1275] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:01:46.423759  1497 leader_election.cc:304] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:46.422897  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:46.423620  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:46.424604  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:46.426756  1525 raft_consensus.cc:2468] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 15.
I20260709 13:01:46.426913  1602 raft_consensus.cc:2468] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 17.
I20260709 13:01:46.342597  8101 raft_consensus.cc:515] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:46.409624  7986 consensus_queue.cc:1048] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:01:46.363533  8114 consensus_queue.cc:1048] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.059s
I20260709 13:01:46.438580  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:46.330892  8022 raft_consensus.cc:515] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:46.371421  8052 consensus_queue.cc:1048] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.058s
I20260709 13:01:46.424796  8155 raft_consensus.cc:493] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:46.439788  1497 leader_election.cc:304] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:46.439632  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:46.444854  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:46.396191  8194 consensus_queue.cc:1048] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 13:01:46.443506  8139 raft_consensus.cc:2804] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:46.459007  1497 leader_election.cc:304] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:46.451149  2226 raft_consensus.cc:3055] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:46.459698  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:46.413508  8163 raft_consensus.cc:740] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:46.460031  2226 raft_consensus.cc:740] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
W20260709 13:01:46.460286  1572 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:46.460490  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:01:46.456311  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 130005us
I20260709 13:01:46.447722  8022 leader_election.cc:290] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:46.450506  8101 leader_election.cc:290] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:46.441241  8160 raft_consensus.cc:493] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:46.464447  1497 leader_election.cc:304] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:46.458463  7983 raft_consensus.cc:2804] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:01:46.469871  1646 leader_election.cc:304] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:46.471318  1646 leader_election.cc:304] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:46.473544  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:46.441102  8190 raft_consensus.cc:515] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:46.462368  8186 raft_consensus.cc:2804] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:01:46.478968  8186 raft_consensus.cc:493] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:46.479393  8186 raft_consensus.cc:3060] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:46.460958  8139 raft_consensus.cc:493] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:46.472736  7773 raft_consensus.cc:2804] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:46.466568  7699 consensus_queue.cc:1059] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.023s
I20260709 13:01:46.464819  7986 consensus_queue.cc:1048] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.012s
I20260709 13:01:46.470249  8191 raft_consensus.cc:493] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:46.483155  7983 raft_consensus.cc:493] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:46.491029  7983 raft_consensus.cc:3060] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:01:46.489812  8181 raft_consensus.cc:3055] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:01:46.492523  8181 raft_consensus.cc:740] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:46.493381  8181 consensus_queue.cc:260] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:46.478879  8172 log.cc:927] Time spent T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.543s	user 0.003s	sys 0.000s
I20260709 13:01:46.455029  8155 raft_consensus.cc:515] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:46.489388  7773 raft_consensus.cc:493] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:46.497874  8210 raft_consensus.cc:493] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:46.469204  8144 consensus_queue.cc:1048] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 13:01:46.497629  1646 leader_election.cc:304] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:46.495967  1570 leader_election.cc:304] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:46.502781  7773 raft_consensus.cc:3060] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:46.507165  8181 raft_consensus.cc:3060] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:01:46.498332  8042 raft_consensus.cc:2749] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:46.508787  8190 leader_election.cc:290] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:46.515271  1646 leader_election.cc:304] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:46.490512  8191 raft_consensus.cc:515] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:46.536993  8191 leader_election.cc:290] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:46.483721  8096 raft_consensus.cc:2749] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:01:46.538347  8131 raft_consensus.cc:515] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:46.469357  8160 raft_consensus.cc:515] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:46.541184  8160 leader_election.cc:290] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:46.542332  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:46.543529  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:46.544543  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:01:46.545547  8204 log.cc:927] Time spent T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
I20260709 13:01:46.498803  7778 consensus_queue.cc:1048] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.048s
I20260709 13:01:46.487445  8139 raft_consensus.cc:3060] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:46.547787  2218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50310 (request call id 1304) took 1758 ms. Trace:
I20260709 13:01:46.548198  2218 rpcz_store.cc:276] 0709 13:01:44.789675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:44.789807 (+   132us) service_pool.cc:224] Handling call
0709 13:01:45.618827 (+829020us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x7b5800015c98. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a1548eb71 00007f6a1548ea22 00007f6a1e3a7c09 00007f6a1d501ee0 00007f6a1d5cb0ab 00007f6a1d5cb131 00007f6a1d58cfc0 00007f6a1d577929 00007f6a1d5773d2 00007f6a16aeebd4
0709 13:01:45.619055 (+   228us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:45.893529 (+274474us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:46.547562 (+654033us) spinlock_profiling.cc:243] Waited 274 ms on lock 0x7b54005618d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:01:46.547730 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":656443648}
I20260709 13:01:46.554994  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:46.556403  1606 raft_consensus.cc:2468] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 15.
I20260709 13:01:46.568367  1524 raft_consensus.cc:1240] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:46.569300  8114 raft_consensus.cc:2804] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:46.569768  8114 raft_consensus.cc:493] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:46.570159  8114 raft_consensus.cc:3060] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:46.555858  8084 leader_election.cc:290] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:46.520684  8210 raft_consensus.cc:515] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:46.558167  8077 raft_consensus.cc:493] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.588160  8077 raft_consensus.cc:515] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:46.589013  8175 raft_consensus.cc:515] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:46.568856  8176 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:46.563601  8000 raft_consensus.cc:2749] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:01:46.591517  8155 leader_election.cc:290] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:01:46.585832  7625 consensus_meta.cc:287] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.571s	user 0.009s	sys 0.001s
I20260709 13:01:46.592363  7625 raft_consensus.cc:515] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:46.593393  8176 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 23 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:46.594839  1598 raft_consensus.cc:1240] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 19. Current term is 20. Ops: []
I20260709 13:01:46.595719  8160 raft_consensus.cc:493] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:46.596235  8160 raft_consensus.cc:515] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:46.596617  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:46.597807  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:46.598239  8160 leader_election.cc:290] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:46.600930  7773 raft_consensus.cc:515] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:46.519397  8101 raft_consensus.cc:2749] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:01:46.602427  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:46.618549  1646 leader_election.cc:304] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:46.594444  7625 leader_election.cc:290] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 20 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:46.563416  8056 raft_consensus.cc:493] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.604475  2226 consensus_queue.cc:260] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:46.629029  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:46.629492  2226 raft_consensus.cc:3060] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:46.632472  1646 leader_election.cc:304] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:46.632865  1528 raft_consensus.cc:2393] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 21: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:01:46.633364  1497 leader_election.cc:304] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:46.634619  8132 raft_consensus.cc:3055] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:01:46.495111  8163 consensus_queue.cc:260] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:46.640697  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:46.564901  8046 consensus_queue.cc:1048] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.067s
I20260709 13:01:46.644613  1646 leader_election.cc:304] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:46.626642  8077 leader_election.cc:290] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:46.639006  8101 raft_consensus.cc:2749] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:01:46.649768  1646 leader_election.cc:304] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:46.628352  8079 raft_consensus.cc:493] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:46.651479  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 20 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:46.652637  1528 raft_consensus.cc:1217] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Deduplicated request from leader. Original: 11.9->[12.10-12.10]   Dedup: 12.10->[]
I20260709 13:01:46.654109  1528 raft_consensus.cc:1240] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:01:46.652679  2226 raft_consensus.cc:1275] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 13:01:46.655221  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:46.656399  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:46.641312  8132 raft_consensus.cc:740] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:46.661307  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:46.646600  8160 raft_consensus.cc:493] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:46.635561  8056 raft_consensus.cc:515] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:46.648486  7942 raft_consensus.cc:2749] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:46.674543  8114 raft_consensus.cc:515] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:46.650353  8210 leader_election.cc:290] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:46.677671  7983 raft_consensus.cc:515] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:46.661875  8176 raft_consensus.cc:2749] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:01:46.682196  8175 leader_election.cc:290] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:46.684756  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:46.650761  8155 consensus_queue.cc:1059] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:01:46.658253  8040 raft_consensus.cc:2749] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:46.694844  2226 raft_consensus.cc:2393] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 23: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:01:46.686142  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:46.696141  2218 raft_consensus.cc:1275] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:01:46.697070  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:46.707438  8102 consensus_queue.cc:1048] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:01:46.659870  8077 consensus_queue.cc:1059] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:01:46.723754  1526 raft_consensus.cc:1240] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 24 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 23. Current term is 24. Ops: [23.13-23.13]
I20260709 13:01:46.710778  8114 leader_election.cc:290] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 16 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:46.715482  7773 leader_election.cc:290] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 18 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:46.720407  1607 raft_consensus.cc:2393] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 23: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:01:46.690502  8042 raft_consensus.cc:493] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.662186  8186 raft_consensus.cc:515] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:46.692466  8218 raft_consensus.cc:2749] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:46.673714  8101 consensus_queue.cc:1048] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:01:46.669978  8079 raft_consensus.cc:515] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:46.690640  8144 consensus_queue.cc:1048] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.033s
I20260709 13:01:46.687963  8160 raft_consensus.cc:515] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:46.732620  7940 consensus_queue.cc:1059] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.007s
I20260709 13:01:46.740509  7983 leader_election.cc:290] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 24 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:46.744763  1531 raft_consensus.cc:1240] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 21 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 20. Current term is 21. Ops: [20.13-20.13]
I20260709 13:01:46.748353  8186 leader_election.cc:290] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 21 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:46.749569  8056 leader_election.cc:290] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:46.750206  8079 leader_election.cc:290] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:46.768532  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:46.772109  2223 raft_consensus.cc:2468] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 16.
I20260709 13:01:46.769378  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:46.773504  2224 raft_consensus.cc:2393] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 16: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:01:46.783061  1528 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 23.
I20260709 13:01:46.785897  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:46.793726  8216 consensus_queue.cc:1059] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 17.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:01:46.794076  7900 consensus_queue.cc:1059] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:01:46.732510  8042 raft_consensus.cc:515] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:46.829085  8139 raft_consensus.cc:515] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:46.829710  8046 raft_consensus.cc:493] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:46.830242  8046 raft_consensus.cc:515] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:46.831416  8139 leader_election.cc:290] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:46.832309  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 19 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:46.833462  1525 raft_consensus.cc:1240] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:01:46.833449  8046 leader_election.cc:290] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:46.839466  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:46.841028  7875 raft_consensus.cc:3055] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:01:46.841440  7875 raft_consensus.cc:740] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:46.775302  8210 raft_consensus.cc:493] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:46.759677  8040 consensus_queue.cc:1048] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 13:01:46.845597  8042 leader_election.cc:290] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:01:46.850415  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:46.849042  1572 leader_election.cc:304] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:46.842247  7875 consensus_queue.cc:260] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 17.16, Last appended by leader: 16, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:46.851544  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:46.855355  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:46.857280  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:46.859493  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:46.854205  7875 raft_consensus.cc:3060] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:46.855829  8154 raft_consensus.cc:2749] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:46.843047  8210 raft_consensus.cc:515] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:46.872247  8210 leader_election.cc:290] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
W20260709 13:01:46.873010  1496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:46.873991  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:46.874823  1598 raft_consensus.cc:2393] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 17: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:01:46.879004  8132 consensus_queue.cc:260] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:46.880293  8132 raft_consensus.cc:3060] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:46.857095  8046 raft_consensus.cc:493] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:46.883311  7906 raft_consensus.cc:493] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.883838  7906 raft_consensus.cc:515] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:46.886086  7906 leader_election.cc:290] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:46.887009  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:46.887472  7942 raft_consensus.cc:3055] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:01:46.887866  7942 raft_consensus.cc:740] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
W20260709 13:01:46.883369  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:46.888711  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:46.889740  1675 raft_consensus.cc:2393] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 20: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:01:46.893501  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:46.894222  1673 raft_consensus.cc:2468] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 21.
I20260709 13:01:46.886620  7906 consensus_queue.cc:1048] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.009s
I20260709 13:01:46.897732  1646 leader_election.cc:304] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:46.882859  8046 raft_consensus.cc:515] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:46.899405  8042 raft_consensus.cc:2749] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:46.901801  1599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36200 (request call id 3148) took 1038 ms. Trace:
I20260709 13:01:46.902216  1599 rpcz_store.cc:276] 0709 13:01:45.863544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.152765 (+289221us) service_pool.cc:224] Handling call
0709 13:01:46.228060 (+ 75295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:46.251101 (+ 23041us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:46.901604 (+650503us) spinlock_profiling.cc:243] Waited 55.6 ms on lock 0x7b54002ace50. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b28ad 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:01:46.901743 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":127868800}
I20260709 13:01:46.897765  8131 leader_election.cc:290] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 19 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:46.903661  8046 leader_election.cc:290] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:46.904759  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:01:46.893532  7961 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 14 current term: 14 is higher.
I20260709 13:01:46.905476  2191 leader_election.cc:304] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:46.905892  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:01:46.855962  7996 consensus_queue.cc:1175] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b96ce9cc496c49d7818fa983a17b062b" responder_term: 17 status { last_received { term: 17 index: 16 } last_committed_idx: 16 last_received_current_leader { term: 17 index: 16 } }
I20260709 13:01:46.906364  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:46.955463  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:46.958492  8058 raft_consensus.cc:3060] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:46.966789  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:46.967078  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:46.968035  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:46.968246  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:46.970790  8160 leader_election.cc:290] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:46.971951  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 20 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:46.973152  1675 raft_consensus.cc:3060] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:01:46.974107  2190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:46.977553  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 72165.1us
I20260709 13:01:46.980413  2191 leader_election.cc:304] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
W20260709 13:01:46.987140  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:46.978766  1496 leader_election.cc:304] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:01:46.907526  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:46.982513  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:46.984211  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:47.007403  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:47.008684  1680 raft_consensus.cc:2393] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 18: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:01:47.013228  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:46.907445  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:47.015110  2191 leader_election.cc:304] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:47.008994  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 17 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:46.972283  1571 leader_election.cc:304] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:47.012168  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:47.017717  1678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49170 (request call id 2996) took 1513 ms. Trace:
I20260709 13:01:47.018152  1678 rpcz_store.cc:276] 0709 13:01:45.504454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:45.590834 (+ 86380us) service_pool.cc:224] Handling call
0709 13:01:45.591084 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:45.873111 (+282027us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:45.873145 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:45.873214 (+    69us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:45.873254 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:47.017479 (+1144225us) spinlock_profiling.cc:243] Waited 282 ms on lock 0x7b540017a554. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:01:47.017531 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:47.017658 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":648153472}
I20260709 13:01:47.020727  1672 raft_consensus.cc:1240] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 20 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 19. Current term is 20. Ops: []
W20260709 13:01:47.022746  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 50554.3us
W20260709 13:01:47.023761  1571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:47.024654  1571 leader_election.cc:304] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:47.027729  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:47.028484  1606 raft_consensus.cc:2468] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 20.
I20260709 13:01:47.030982  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:47.035035  1675 raft_consensus.cc:2468] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 19.
I20260709 13:01:47.035884  1678 raft_consensus.cc:1240] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 13:01:47.037508   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:47.039525  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:47.040408  1528 raft_consensus.cc:2393] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 16: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:01:47.051421  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:47.052067  1607 raft_consensus.cc:1240] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:01:47.052094  1531 raft_consensus.cc:2468] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 20.
I20260709 13:01:47.055662  1526 raft_consensus.cc:1275] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 16. (term mismatch)
I20260709 13:01:47.056078  1526 pending_rounds.cc:85] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting all ops after (but not including) 15
I20260709 13:01:47.056293  1526 pending_rounds.cc:107] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting uncommitted NO_OP operation due to leader change: 19.16
I20260709 13:01:47.056527  1526 raft_consensus.cc:2889] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:47.057840  1530 raft_consensus.cc:3060] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:47.059468  1527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43008 (request call id 2665) took 2291 ms. Trace:
I20260709 13:01:47.059911  1527 rpcz_store.cc:276] 0709 13:01:44.746037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:44.746162 (+   125us) service_pool.cc:224] Handling call
0709 13:01:44.746477 (+   315us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:46.060843 (+1314366us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:47.036903 (+976060us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b54001b62d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:01:47.037079 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2810512128}
I20260709 13:01:47.010551  8209 raft_consensus.cc:2749] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:01:47.009714  7983 raft_consensus.cc:493] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:47.074375  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:47.053069  1571 leader_election.cc:304] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:47.013486  8186 raft_consensus.cc:2804] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:01:46.984297  8139 raft_consensus.cc:493] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:47.016300  8079 raft_consensus.cc:3055] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:47.054324  8132 raft_consensus.cc:2749] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:47.024027  8061 raft_consensus.cc:2749] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:47.093753  7983 raft_consensus.cc:515] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:47.050473  7980 raft_consensus.cc:2749] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:47.054559  8181 raft_consensus.cc:493] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:47.099875  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:46.888664  7942 consensus_queue.cc:260] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 19.9, Last appended by leader: 9, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:47.106078  1677 raft_consensus.cc:1240] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 20 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 19. Current term is 20. Ops: []
I20260709 13:01:47.107321  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:47.158806  1523 raft_consensus.cc:2368] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b for earlier term 17. Current term is 18.
I20260709 13:01:47.112115  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:47.159457  1598 raft_consensus.cc:2468] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 17.
I20260709 13:01:47.115196  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:47.095371  8209 raft_consensus.cc:2749] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:01:47.075063  8171 log.cc:927] Time spent T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:01:47.076615  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:47.123937  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:47.137511  1530 raft_consensus.cc:1275] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:01:47.139007  2190 leader_election.cc:304] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:47.140105  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:47.143175  1599 raft_consensus.cc:1240] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:47.142357  1496 leader_election.cc:304] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
W20260709 13:01:47.087095  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 72054.6us
I20260709 13:01:47.176640  2191 leader_election.cc:304] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:47.155121  1646 leader_election.cc:304] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:47.137779  8186 raft_consensus.cc:493] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:47.181746  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:47.140193  8079 raft_consensus.cc:740] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:47.178612  1646 leader_election.cc:304] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:47.175407  1496 leader_election.cc:304] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:47.180070  2190 leader_election.cc:304] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:47.183490  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:47.185771  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 13:01:47.264627  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 84644.6us
I20260709 13:01:47.269989  2190 leader_election.cc:304] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:47.143641  8139 raft_consensus.cc:515] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:47.280424  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 101880us
I20260709 13:01:47.265080  8049 raft_consensus.cc:3060] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:47.283121  1646 leader_election.cc:304] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:47.190454  8143 raft_consensus.cc:2749] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:01:47.264117  8077 consensus_queue.cc:1175] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ddf11fc190dd4b898773379c6b129d90" responder_term: 19 status { last_received { term: 19 index: 9 } last_committed_idx: 8 last_received_current_leader { term: 19 index: 9 } }
I20260709 13:01:47.188457  8186 raft_consensus.cc:3060] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:47.177680  7773 raft_consensus.cc:2749] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:01:47.275931  8212 raft_consensus.cc:2804] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:01:47.268460  7961 raft_consensus.cc:2749] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:01:47.310621  8102 raft_consensus.cc:2749] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:01:47.315593  1526 raft_consensus.cc:1240] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 13. Current term is 14. Ops: []
W20260709 13:01:47.317631  8229 log.cc:927] Time spent T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.220s	user 0.000s	sys 0.001s
I20260709 13:01:47.178056  8181 raft_consensus.cc:515] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:47.181234  8061 raft_consensus.cc:2749] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:01:47.285146  8176 raft_consensus.cc:2749] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:01:47.264120  2221 raft_consensus.cc:1275] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:01:47.276692  2190 leader_election.cc:304] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:47.307180  7818 raft_consensus.cc:2749] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:47.309881  8212 raft_consensus.cc:493] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:47.340159  1646 leader_election.cc:304] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
W20260709 13:01:47.339038  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 62447.5us
W20260709 13:01:47.355755  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 180442us
I20260709 13:01:47.356659  1496 leader_election.cc:304] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:47.345571  8177 raft_consensus.cc:2749] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:47.345504  8212 raft_consensus.cc:3060] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:47.408917  2190 leader_election.cc:400] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 17 pre-election: Vote denied by peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931) with higher term. Message: Invalid argument: T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b for earlier term 17. Current term is 18.
I20260709 13:01:47.409329  2190 leader_election.cc:403] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:47.353440  8176 raft_consensus.cc:2749] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:01:47.416982  2190 leader_election.cc:304] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:47.323800  8079 consensus_queue.cc:260] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:47.369030  7773 raft_consensus.cc:2749] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:01:47.421674  1498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:47.413447  7765 raft_consensus.cc:3060] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Advancing to term 18
W20260709 13:01:47.430892  1496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:47.357621  8061 consensus_queue.cc:1048] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.064s
I20260709 13:01:47.416749  8185 consensus_queue.cc:1048] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.020s
W20260709 13:01:47.442183  8232 log.cc:927] Time spent T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
W20260709 13:01:47.443058  8235 log.cc:927] Time spent T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
W20260709 13:01:47.445343  8239 log.cc:927] Time spent T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:01:47.445972  7982 raft_consensus.cc:993] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1: : Instructing follower ddf11fc190dd4b898773379c6b129d90 to start an election
I20260709 13:01:47.446552  7982 raft_consensus.cc:1081] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 LEADER]: Signalling peer ddf11fc190dd4b898773379c6b129d90 to start an election
W20260709 13:01:47.455535  2190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:47.458518  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:47.425768  7906 raft_consensus.cc:2749] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:47.432121  7983 leader_election.cc:290] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:47.470708  1677 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24"
dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
 from {username='slave'} at 127.0.0.1:49178
W20260709 13:01:47.462129  7875 consensus_meta.cc:287] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.592s	user 0.010s	sys 0.000s
I20260709 13:01:47.434862  7817 raft_consensus.cc:493] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:47.477341  1679 raft_consensus.cc:1240] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 9. Current term is 10. Ops: []
W20260709 13:01:47.493386  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 153328us
I20260709 13:01:47.495873  1646 leader_election.cc:304] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:47.497990  1677 raft_consensus.cc:493] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:47.498521  1677 raft_consensus.cc:3060] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:47.474875  8079 raft_consensus.cc:3060] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:47.502416  8042 raft_consensus.cc:2804] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:01:47.510273  8241 log.cc:927] Time spent T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
W20260709 13:01:47.517078  8240 log.cc:927] Time spent T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 13:01:47.504030  8052 consensus_queue.cc:1059] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 13:01:47.528286  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:47.501245  8051 consensus_queue.cc:1048] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.019s
I20260709 13:01:47.504472  7817 raft_consensus.cc:515] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:47.517359  8139 leader_election.cc:290] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:47.519804  8042 raft_consensus.cc:493] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:47.537178  2192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:47.513983  8244 consensus_queue.cc:1059] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 13:01:47.558796  8181 leader_election.cc:290] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:47.561585  7817 leader_election.cc:290] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:01:47.562369  8058 consensus_meta.cc:287] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.603s	user 0.009s	sys 0.002s
I20260709 13:01:47.563163  8177 raft_consensus.cc:493] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:47.563678  8177 raft_consensus.cc:515] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:47.565804  8049 raft_consensus.cc:2749] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:47.566210  8177 leader_election.cc:290] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:47.544535  8042 raft_consensus.cc:3060] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:01:47.567991  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:47.568648  1530 raft_consensus.cc:2468] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 15.
I20260709 13:01:47.571915  2190 leader_election.cc:304] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:47.572777  8061 raft_consensus.cc:2804] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:47.573172  8061 raft_consensus.cc:493] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:47.573508  8061 raft_consensus.cc:3060] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:47.580003  8186 raft_consensus.cc:515] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:01:47.581283  8214 log.cc:927] Time spent T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 1.087s	user 0.000s	sys 0.007s
I20260709 13:01:47.583498  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:47.581537  8061 raft_consensus.cc:515] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:47.584118  1676 raft_consensus.cc:3060] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:47.587149  8061 leader_election.cc:290] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 16 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:47.593950  7765 raft_consensus.cc:2749] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931) with higher term. Message: Invalid argument: T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b for earlier term 17. Current term is 18.
I20260709 13:01:47.590369  1677 raft_consensus.cc:515] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:47.563747  1601 raft_consensus.cc:1275] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:01:47.600695  1601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36200 (request call id 3150) took 1735 ms. Trace:
I20260709 13:01:47.601058  1601 rpcz_store.cc:276] 0709 13:01:45.865150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.159895 (+294745us) service_pool.cc:224] Handling call
0709 13:01:46.160208 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:47.599697 (+1439489us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:47.600481 (+   784us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b5400168ad4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:01:47.600638 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3227421568}
I20260709 13:01:47.601939  7880 raft_consensus.cc:493] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:47.602481  7880 raft_consensus.cc:515] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:47.583302  8186 leader_election.cc:290] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 19 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:47.607812  8051 consensus_queue.cc:1059] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:01:47.608098  8143 consensus_queue.cc:1059] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:01:47.611117  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:47.612406  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:47.622313  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:47.567912  1525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43010 (request call id 2836) took 1095 ms. Trace:
I20260709 13:01:47.623065  1525 rpcz_store.cc:276] 0709 13:01:46.472693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.472805 (+   112us) service_pool.cc:224] Handling call
0709 13:01:46.473121 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:46.833902 (+360781us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:47.567657 (+733755us) spinlock_profiling.cc:243] Waited 360 ms on lock 0x7b54000c21d4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:01:47.567855 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":828203392}
I20260709 13:01:47.622428  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:47.623159  1676 raft_consensus.cc:2468] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 19.
I20260709 13:01:47.626353  1496 leader_election.cc:304] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:47.610496  8143 raft_consensus.cc:3055] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:01:47.636006  1497 leader_election.cc:304] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:47.641813  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:47.643280  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:47.644739  1523 raft_consensus.cc:2393] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 16: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:01:47.645306  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:47.637404  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:47.646317  1526 raft_consensus.cc:3060] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:47.635416  8077 raft_consensus.cc:493] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:47.651073  2226 raft_consensus.cc:2468] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 18.
I20260709 13:01:47.651522  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:47.635095  8012 raft_consensus.cc:2804] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:01:47.655612  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:47.632561  7765 raft_consensus.cc:493] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:47.678237  1524 raft_consensus.cc:2393] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 17: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:01:47.680962  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 13:01:47.648160  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 142818us
I20260709 13:01:47.672920  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:47.678530  8012 raft_consensus.cc:697] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:47.634950  8143 raft_consensus.cc:740] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:47.648051  7983 raft_consensus.cc:2804] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:47.592043  8042 raft_consensus.cc:515] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:47.674714  8210 raft_consensus.cc:493] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:47.633344  8186 consensus_queue.cc:1059] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:01:47.683034  1523 raft_consensus.cc:2393] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 18: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:01:47.683071  1646 leader_election.cc:304] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:47.592077  8212 raft_consensus.cc:515] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:47.664650  8077 raft_consensus.cc:515] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:47.707890  1532 raft_consensus.cc:2468] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 21.
I20260709 13:01:47.710264  1600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36200 (request call id 3153) took 1168 ms. Trace:
I20260709 13:01:47.691107  7983 raft_consensus.cc:493] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:47.710775  1600 rpcz_store.cc:276] 0709 13:01:46.541880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.546747 (+  4867us) service_pool.cc:224] Handling call
0709 13:01:46.971092 (+424345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:46.971281 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:46.971305 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:46.971344 (+    39us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:46.971381 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:46.971433 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:47.710081 (+738648us) spinlock_profiling.cc:243] Waited 424 ms on lock 0x7b54000da550. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b28ad 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6 00007f6a168ed26f
0709 13:01:47.710200 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":975340288}
I20260709 13:01:47.697687  8262 raft_consensus.cc:2804] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:47.681823  7765 raft_consensus.cc:515] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:47.709370  8052 raft_consensus.cc:493] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:47.716789  7983 raft_consensus.cc:3060] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:47.754726  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:01:47.756844  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:47.758138  1497 leader_election.cc:304] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:47.733733  7625 raft_consensus.cc:3055] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:01:47.758975  7625 raft_consensus.cc:740] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:47.759660  8042 leader_election.cc:290] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 22 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:47.759843  7625 consensus_queue.cc:260] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:47.741976  7942 raft_consensus.cc:3060] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:47.761137  7625 raft_consensus.cc:3060] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:01:47.739809  8255 log.cc:927] Time spent T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:01:47.765240  1678 raft_consensus.cc:2368] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b for earlier term 10. Current term is 11.
I20260709 13:01:47.710857  8051 consensus_queue.cc:1059] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 13:01:47.764806  1497 leader_election.cc:304] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:47.767777  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:47.768074  2191 leader_election.cc:400] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 10 pre-election: Vote denied by peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217) with higher term. Message: Invalid argument: T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b for earlier term 10. Current term is 11.
I20260709 13:01:47.768467  2191 leader_election.cc:403] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:47.745447  8186 raft_consensus.cc:3055] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:01:47.747884  8212 leader_election.cc:290] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 20 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:47.745467  1677 leader_election.cc:290] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:47.748329  8012 consensus_queue.cc:237] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:47.773313  7980 consensus_queue.cc:1059] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:47.773676  7961 raft_consensus.cc:3060] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:01:47.774077  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:47.774643  1606 raft_consensus.cc:3060] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:47.775734  7980 raft_consensus.cc:3055] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:01:47.723096  8143 consensus_queue.cc:260] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:47.750245  7765 leader_election.cc:290] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:47.776568  7773 raft_consensus.cc:2749] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:01:47.749325  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 696356us
I20260709 13:01:47.750053  8072 raft_consensus.cc:2804] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:01:47.777496  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:47.722440  8262 raft_consensus.cc:493] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
W20260709 13:01:47.750685  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 562242us
I20260709 13:01:47.696967  8210 raft_consensus.cc:515] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:47.778156  8262 raft_consensus.cc:3060] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:47.779794  1571 leader_election.cc:304] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:47.781344  1677 raft_consensus.cc:1240] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 18. Current term is 19. Ops: []
I20260709 13:01:47.783138  8018 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:47.783727  8018 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:47.784881  8160 raft_consensus.cc:2749] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:01:47.778177  1598 raft_consensus.cc:3060] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:47.786803  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:47.756722  8176 raft_consensus.cc:493] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:47.788146  1571 leader_election.cc:304] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:47.788697  8176 raft_consensus.cc:515] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:47.783901  8164 raft_consensus.cc:493] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:47.769737  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:47.751515  8259 raft_consensus.cc:3055] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:01:47.766131  7823 raft_consensus.cc:2749] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:01:47.788991  8131 raft_consensus.cc:2749] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:47.790232  8164 raft_consensus.cc:515] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:47.799445  8163 raft_consensus.cc:3060] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:47.800494  8164 leader_election.cc:290] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:47.777655  8072 raft_consensus.cc:493] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:47.766158  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:47.806035  1676 raft_consensus.cc:2393] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 20: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:01:47.791083  1571 leader_election.cc:304] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:47.793485  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:47.793478  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:47.794929  1572 leader_election.cc:304] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:47.793681  8259 raft_consensus.cc:740] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:47.788031  8210 leader_election.cc:290] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:47.807861  1677 raft_consensus.cc:2393] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 21: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:01:47.746102  1526 raft_consensus.cc:2468] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 16.
I20260709 13:01:47.813895  1524 raft_consensus.cc:1240] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:47.813091  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:47.806506  1497 leader_election.cc:304] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:47.816489  1572 leader_election.cc:304] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:47.816670  1598 raft_consensus.cc:2468] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 18.
I20260709 13:01:47.818100  1600 raft_consensus.cc:2393] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 16: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:01:47.771622  8186 raft_consensus.cc:740] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:47.788319  8051 raft_consensus.cc:3055] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:01:47.828356  1605 raft_consensus.cc:2393] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 17: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:01:47.776166  7980 raft_consensus.cc:740] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:47.837803  1497 leader_election.cc:304] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:47.838105  1606 raft_consensus.cc:2468] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 21.
I20260709 13:01:47.841486  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 24 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:47.843367  1678 raft_consensus.cc:2410] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for term 24 because replica has last-logged OpId of term: 22 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 13.
I20260709 13:01:47.791883  8018 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:47.845643  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:47.839846  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:47.847767  1603 raft_consensus.cc:1240] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 21 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 20. Current term is 21. Ops: [20.13-20.13]
I20260709 13:01:47.755784  8052 raft_consensus.cc:515] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:47.850538  1527 raft_consensus.cc:1240] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 24 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 23. Current term is 24. Ops: [23.13-23.13]
I20260709 13:01:47.850986  1605 raft_consensus.cc:2393] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 19: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:01:47.815659  8072 raft_consensus.cc:3060] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:47.829913  8131 raft_consensus.cc:2804] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:01:47.853096  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 24 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:47.854880  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: true dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:47.859503  1526 raft_consensus.cc:3055] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:47.859849  1526 raft_consensus.cc:740] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:47.849666  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:47.861313  1532 raft_consensus.cc:3060] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:01:47.859195  2219 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 23.
I20260709 13:01:47.831108  7875 raft_consensus.cc:2749] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:01:47.831835  8058 raft_consensus.cc:2749] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:01:47.846433  7823 raft_consensus.cc:2749] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:47.871063  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:47.884748  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:47.836462  8051 raft_consensus.cc:740] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:47.895308  7880 leader_election.cc:290] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:47.896273  8051 consensus_queue.cc:260] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:47.836195  8176 leader_election.cc:290] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:47.900852  2190 leader_election.cc:304] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:47.901871  8190 raft_consensus.cc:2804] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:47.902367  8190 raft_consensus.cc:697] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 16 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:47.903257  8190 consensus_queue.cc:237] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:47.905809  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:47.906904  1497 leader_election.cc:304] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:47.860558  1526 consensus_queue.cc:260] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:47.907971  8046 consensus_queue.cc:1059] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:47.908568  1526 raft_consensus.cc:3060] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:01:47.888494  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:47.917688  1532 raft_consensus.cc:2468] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 22.
I20260709 13:01:47.926775  8077 leader_election.cc:290] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:47.929829  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:47.937101  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:47.937716  1524 raft_consensus.cc:2468] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 21.
I20260709 13:01:47.941010  2190 leader_election.cc:304] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:47.932415  1526 raft_consensus.cc:2468] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 11.
I20260709 13:01:47.933324  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:47.856141  8084 raft_consensus.cc:2804] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:01:47.935379  1570 leader_election.cc:304] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:47.836944  8216 consensus_queue.cc:1048] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
W20260709 13:01:47.951637  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 44851.1us
I20260709 13:01:47.843031  8160 consensus_queue.cc:1059] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.085s
I20260709 13:01:47.961151  1570 leader_election.cc:304] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:47.957121  7823 raft_consensus.cc:2749] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:01:47.967077  1497 leader_election.cc:304] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:47.968294  1497 leader_election.cc:304] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:47.969435  1497 leader_election.cc:304] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:47.970145  7818 raft_consensus.cc:2749] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:01:47.970719  8244 raft_consensus.cc:3060] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:47.967077  8143 raft_consensus.cc:3060] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:47.976181  1497 leader_election.cc:304] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:47.885524  8131 raft_consensus.cc:697] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 19 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:47.970845  8248 raft_consensus.cc:2804] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:01:47.976640  8139 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 11 is higher.
I20260709 13:01:47.958947  8210 raft_consensus.cc:2804] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:01:47.970366  8084 raft_consensus.cc:697] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:47.999979  1527 raft_consensus.cc:2468] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 20.
I20260709 13:01:48.003743  2190 leader_election.cc:304] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:48.005698  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:47.978915  8058 raft_consensus.cc:2749] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:01:47.981155  7818 raft_consensus.cc:2749] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:48.015479  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 24 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:48.018251  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:48.018966  1527 raft_consensus.cc:2410] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for term 24 because replica has last-logged OpId of term: 22 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 13.
I20260709 13:01:48.002247  8210 raft_consensus.cc:493] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:47.985890  8262 raft_consensus.cc:515] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:48.023118  8210 raft_consensus.cc:3060] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:47.986931  8059 raft_consensus.cc:2749] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:01:48.024330  8267 log.cc:927] Time spent T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
I20260709 13:01:47.941076  8186 consensus_queue.cc:260] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:47.934170  8259 consensus_queue.cc:260] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:01:48.041003  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 195203us
I20260709 13:01:48.009536  8248 raft_consensus.cc:697] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 21 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:48.025332  8177 raft_consensus.cc:2804] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:01:48.045869  8259 raft_consensus.cc:3060] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:01:48.005896  8164 consensus_queue.cc:1059] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:01:48.048368  7983 raft_consensus.cc:515] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:01:48.063726  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 233688us
I20260709 13:01:48.067744  7996 raft_consensus.cc:493] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:48.071254  1529 raft_consensus.cc:1240] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:48.075739  1530 raft_consensus.cc:1240] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 LEADER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 18. Current term is 19. Ops: []
W20260709 13:01:48.077031  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 233499us
W20260709 13:01:48.083933  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:48.079991  1644 leader_election.cc:304] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:01:48.085925  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:48.063350  8177 raft_consensus.cc:697] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 20 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:48.086706  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:48.066059  7880 raft_consensus.cc:493] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:48.073752  7996 raft_consensus.cc:515] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:48.090973  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:48.095139  1678 raft_consensus.cc:2393] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 22: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:01:48.092923  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:48.093107  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:48.098387  1571 leader_election.cc:304] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:48.089329  8144 raft_consensus.cc:2749] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:48.104048  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 13:01:48.086004  8079 consensus_meta.cc:287] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.580s	user 0.007s	sys 0.004s
I20260709 13:01:48.060209  8131 consensus_queue.cc:237] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:01:48.129571  1496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:48.135614  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: true dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:48.068722  8084 consensus_queue.cc:237] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:48.129982  7875 raft_consensus.cc:2749] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:48.129761  8262 leader_election.cc:290] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 17 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:48.161295  1532 raft_consensus.cc:1240] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 13:01:48.096858  7880 raft_consensus.cc:515] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:48.174645  1646 leader_election.cc:304] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:01:48.182394  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 88619.3us
I20260709 13:01:48.198253  7880 leader_election.cc:290] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:48.210423  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:48.144982  8248 consensus_queue.cc:237] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:48.207911  7880 raft_consensus.cc:493] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:48.231026  7880 raft_consensus.cc:515] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:48.233644  7880 leader_election.cc:290] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:48.234582  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 13:01:48.239571  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:48.223187  8286 raft_consensus.cc:3060] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:48.227035  8247 raft_consensus.cc:493] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:48.227553  7996 leader_election.cc:290] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:48.227062  7961 raft_consensus.cc:2749] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217) with higher term. Message: Invalid argument: T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b for earlier term 10. Current term is 11.
I20260709 13:01:48.243000  8247 raft_consensus.cc:515] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:48.211148  7983 leader_election.cc:290] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:48.245896  8244 raft_consensus.cc:2749] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:48.252537  2226 raft_consensus.cc:2468] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 11.
I20260709 13:01:48.187055  8177 consensus_queue.cc:237] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:48.257392  8247 leader_election.cc:290] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:01:48.271265  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 58533.8us
W20260709 13:01:48.278009  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 65698.3us
I20260709 13:01:48.283281  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:48.284029  1678 raft_consensus.cc:2468] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 19.
I20260709 13:01:48.288722  8283 raft_consensus.cc:493] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:48.289340  8283 raft_consensus.cc:515] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:48.291040  8261 log.cc:927] Time spent T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.600s	user 0.003s	sys 0.005s
I20260709 13:01:48.291646  8283 leader_election.cc:290] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
W20260709 13:01:48.277726  8284 log.cc:927] Time spent T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 13:01:48.294824  1674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50664 (request call id 1615) took 1408 ms. Trace:
I20260709 13:01:48.295222  1674 rpcz_store.cc:276] 0709 13:01:46.885908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.887991 (+  2083us) service_pool.cc:224] Handling call
0709 13:01:46.888294 (+   303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:47.733011 (+844717us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:47.733045 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:47.754160 (+ 21115us) log.cc:844] Serialized 26 byte log entry
0709 13:01:48.063402 (+309242us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:01:48.063442 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:48.277077 (+213635us) spinlock_profiling.cc:243] Waited 833 ms on lock 0x7b540017a054. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:01:48.277127 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:48.294518 (+ 17391us) raft_consensus.cc:1685] finished
0709 13:01:48.294538 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:48.294763 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37282,"raft.queue_time_us":14154,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":27186,"spinlock_wait_cycles":1915639680,"thread_start_us":272379,"threads_started":1,"wal-append.queue_time_us":418451}
I20260709 13:01:48.296586  2227 raft_consensus.cc:2468] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 19.
I20260709 13:01:48.297349  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:48.298098  8017 raft_consensus.cc:493] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:48.298584  8017 raft_consensus.cc:515] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:48.300323  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:48.296515  1570 leader_election.cc:304] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:48.302227  8154 raft_consensus.cc:2749] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:48.303328  1646 leader_election.cc:304] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:48.302343  1570 leader_election.cc:304] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:01:48.272433  8271 log.cc:927] Time spent T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.064s	user 0.001s	sys 0.001s
I20260709 13:01:48.304167  8268 raft_consensus.cc:2804] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:48.305171  8268 raft_consensus.cc:697] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [term 11 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:48.274798  8252 raft_consensus.cc:3055] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:48.305732  8252 raft_consensus.cc:740] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:48.300638  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:48.306527  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:48.307268  1599 raft_consensus.cc:2393] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 20: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:01:48.307093  8072 raft_consensus.cc:515] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:48.307329  7880 raft_consensus.cc:2749] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:01:48.306089  8268 consensus_queue.cc:237] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:48.307684  7625 consensus_queue.cc:1059] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 13:01:48.311498  1603 raft_consensus.cc:1240] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:01:48.313973  2192 leader_election.cc:304] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:01:48.285475  8270 log.cc:927] Time spent T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
I20260709 13:01:48.314801  1497 leader_election.cc:304] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:48.315145  8283 raft_consensus.cc:2749] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:48.283051  8144 consensus_queue.cc:1048] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:01:48.316664  1600 raft_consensus.cc:3055] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:01:48.317025  1600 raft_consensus.cc:740] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:48.318758  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:48.319396  1603 raft_consensus.cc:2468] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 20.
I20260709 13:01:48.303879  1644 leader_election.cc:304] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:48.320588  1497 leader_election.cc:304] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:48.321120  8143 raft_consensus.cc:2804] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:01:48.321358  8139 raft_consensus.cc:2804] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:01:48.321771  8139 raft_consensus.cc:493] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:48.322098  8139 raft_consensus.cc:3060] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:48.322883  8143 raft_consensus.cc:697] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 22 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:48.323712  1531 raft_consensus.cc:1275] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:01:48.325178  8163 consensus_queue.cc:1048] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:48.323743  8143 consensus_queue.cc:237] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:48.329862  1674 raft_consensus.cc:1275] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:01:48.332267  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:48.333037  1526 raft_consensus.cc:2393] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 17: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:01:48.335265  1605 raft_consensus.cc:2468] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 21.
I20260709 13:01:48.336314  8072 leader_election.cc:290] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 21 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:48.339727  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:48.342136  8163 raft_consensus.cc:493] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:48.317665  1600 consensus_queue.cc:260] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:48.347255  1600 raft_consensus.cc:3060] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:48.350492  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:48.351315  1526 raft_consensus.cc:2368] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 21. Current term is 22.
I20260709 13:01:48.356731  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:48.358022  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:48.359412  1677 raft_consensus.cc:1240] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 18. Current term is 19. Ops: []
I20260709 13:01:48.337683  8244 raft_consensus.cc:2749] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:01:48.364887  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:48.369462  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:48.377359  1600 raft_consensus.cc:1275] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:01:48.342823  8163 raft_consensus.cc:515] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:48.394435  8163 leader_election.cc:290] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:48.364428  8279 raft_consensus.cc:493] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:48.396093  8279 raft_consensus.cc:515] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:48.380985  8280 log.cc:927] Time spent T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.177s	user 0.000s	sys 0.003s
I20260709 13:01:48.400440  8052 leader_election.cc:290] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:48.386512  8286 raft_consensus.cc:2749] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:48.415097  8017 leader_election.cc:290] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:48.416396  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:48.418464  8262 raft_consensus.cc:493] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:48.419098  8262 raft_consensus.cc:515] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:48.420542  8257 log.cc:927] Time spent T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.738s	user 0.003s	sys 0.000s
I20260709 13:01:48.421312  8262 leader_election.cc:290] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:48.424268  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:48.425400  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:48.426110  1600 raft_consensus.cc:2468] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 20.
I20260709 13:01:48.426777  8139 raft_consensus.cc:515] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:48.427130  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:48.427947  1525 raft_consensus.cc:2368] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for earlier term 20. Current term is 21.
I20260709 13:01:48.427873  1603 raft_consensus.cc:2468] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 19.
I20260709 13:01:48.431535  8210 raft_consensus.cc:515] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:48.433202  2192 leader_election.cc:304] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:01:48.438588  2192 leader_election.cc:304] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:48.398582  8279 leader_election.cc:290] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:48.460729  1607 raft_consensus.cc:2468] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 17.
I20260709 13:01:48.464650  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:48.466154  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:48.466836  1600 raft_consensus.cc:2468] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 18.
I20260709 13:01:48.468405  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:48.469120  2222 raft_consensus.cc:2468] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 18.
I20260709 13:01:48.458796  8163 raft_consensus.cc:2804] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:01:48.456300  8177 raft_consensus.cc:2804] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:01:48.494309  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:48.473609  8163 raft_consensus.cc:493] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:48.501050  1680 raft_consensus.cc:2393] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 20: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:01:48.475735  8177 raft_consensus.cc:493] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:48.505155  8177 raft_consensus.cc:3060] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:48.511312  8163 raft_consensus.cc:3060] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:48.520876  7980 consensus_queue.cc:260] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:48.522467  7980 raft_consensus.cc:3060] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:48.532711  8139 leader_election.cc:290] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 21 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:48.535413  8210 leader_election.cc:290] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 21 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:48.536985  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:48.537689  1679 raft_consensus.cc:3060] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:01:48.544600  2222 raft_consensus.cc:1240] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 16 LEADER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 13:01:48.548887  1497 leader_election.cc:304] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:01:48.549539  8084 raft_consensus.cc:493] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:48.550956  8084 raft_consensus.cc:515] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:48.551816  8244 raft_consensus.cc:2804] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:01:48.552317  8244 raft_consensus.cc:493] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:48.552695  8244 raft_consensus.cc:3060] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:48.553095  8084 leader_election.cc:290] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:48.555254  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:48.556010  1678 raft_consensus.cc:2468] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 17.
I20260709 13:01:48.556384  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:48.556924  1604 raft_consensus.cc:3060] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:48.563591  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:48.567091  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 13:01:48.569176  8132 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 19 current term: 19 is higher.
I20260709 13:01:48.571470  8058 raft_consensus.cc:3055] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:48.571983  8058 raft_consensus.cc:740] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:48.572896  8058 consensus_queue.cc:260] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:48.573964  8058 raft_consensus.cc:3060] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:48.580403  8177 raft_consensus.cc:515] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:48.585179  8181 consensus_queue.cc:1048] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:01:48.586841  1529 raft_consensus.cc:1240] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:01:48.587826  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:48.651907  1528 raft_consensus.cc:2468] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 20.
I20260709 13:01:48.592024  7961 raft_consensus.cc:493] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:48.595638  8051 raft_consensus.cc:3060] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:48.597877  8186 raft_consensus.cc:3060] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:48.659245  8177 leader_election.cc:290] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 20 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:48.555939  1570 leader_election.cc:400] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 21 election: Vote denied by peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931) with higher term. Message: Invalid argument: T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 21. Current term is 22.
I20260709 13:01:48.607128  1604 raft_consensus.cc:2468] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 21.
I20260709 13:01:48.611609  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:48.664064  1570 leader_election.cc:403] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
I20260709 13:01:48.664693  1674 raft_consensus.cc:2393] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 21: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:01:48.614554  8289 raft_consensus.cc:493] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:48.616070  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:48.622972  1496 leader_election.cc:304] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
W20260709 13:01:48.666807  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 43925.9us
I20260709 13:01:48.622970  8252 consensus_queue.cc:260] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:48.632830  8163 raft_consensus.cc:515] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:48.630407  1605 raft_consensus.cc:1240] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 16. Current term is 17. Ops: []
W20260709 13:01:48.569089  8295 log.cc:927] Time spent T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.072s	user 0.004s	sys 0.000s
I20260709 13:01:48.643767  1679 raft_consensus.cc:2468] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 21.
I20260709 13:01:48.654297  8248 consensus_queue.cc:1048] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.004s
I20260709 13:01:48.676529  8163 leader_election.cc:290] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 20 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:48.354976   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:48.659624  7961 raft_consensus.cc:515] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:48.660784  2222 raft_consensus.cc:1275] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:01:48.676249  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:48.679652  1678 raft_consensus.cc:2393] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 20: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:01:48.681269  1526 raft_consensus.cc:1240] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 13:01:48.682646  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:48.684136  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:01:48.682683  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 126882us
I20260709 13:01:48.687775  1527 raft_consensus.cc:2468] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 21.
I20260709 13:01:48.689163  2190 leader_election.cc:304] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:48.680668  7961 leader_election.cc:290] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:01:48.698179  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 84542.5us
W20260709 13:01:48.698890  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:48.699750  1644 leader_election.cc:400] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 20 pre-election: Vote denied by peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931) with higher term. Message: Invalid argument: T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for earlier term 20. Current term is 21.
I20260709 13:01:48.700105  1644 leader_election.cc:403] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:48.700630  1496 leader_election.cc:304] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:48.671944  7983 raft_consensus.cc:2804] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:48.691149  8291 raft_consensus.cc:3060] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:01:48.708247  1646 leader_election.cc:304] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:48.710278  1644 leader_election.cc:304] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:48.712987  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:48.714491  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:48.715123  1600 raft_consensus.cc:3060] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:48.691928  8252 raft_consensus.cc:3060] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:48.724117  1497 leader_election.cc:304] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:48.716918  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:48.701357  7765 raft_consensus.cc:2804] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:01:48.746196  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:48.752707  1599 raft_consensus.cc:2468] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 17.
I20260709 13:01:48.748999  1600 raft_consensus.cc:2468] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 20.
I20260709 13:01:48.672251  8289 raft_consensus.cc:515] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:48.755590  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 44534us
I20260709 13:01:48.757335  1600 raft_consensus.cc:1275] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:01:48.706341  7983 raft_consensus.cc:493] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:48.705550  7817 raft_consensus.cc:2804] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:01:48.691061  8181 consensus_queue.cc:1048] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.054s
I20260709 13:01:48.718918  8276 raft_consensus.cc:2749] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:48.771275  8248 raft_consensus.cc:2764] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
I20260709 13:01:48.749929  8040 raft_consensus.cc:2749] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931) with higher term. Message: Invalid argument: T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for earlier term 20. Current term is 21.
I20260709 13:01:48.762822  8176 raft_consensus.cc:2804] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:01:48.786516  2192 leader_election.cc:304] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:48.783592  1646 leader_election.cc:304] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:48.705122  8096 consensus_queue.cc:1059] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 13:01:48.797739  2192 leader_election.cc:304] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
W20260709 13:01:48.796269  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 173534us
I20260709 13:01:48.804674  1571 leader_election.cc:304] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:48.780005  7983 raft_consensus.cc:3060] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:48.814100  1571 leader_election.cc:304] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:48.709167  8244 raft_consensus.cc:515] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:48.795159  8176 raft_consensus.cc:493] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:48.794086  7817 raft_consensus.cc:697] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 21 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:48.791666  7765 raft_consensus.cc:697] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 21 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:48.793509  8131 raft_consensus.cc:493] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:48.806413  7961 raft_consensus.cc:2804] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:01:48.828615  1646 leader_election.cc:304] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:48.813387  8017 raft_consensus.cc:2749] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:01:48.810632  8276 raft_consensus.cc:2804] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:48.819967  8176 raft_consensus.cc:3060] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:48.818010  8154 raft_consensus.cc:2749] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:48.821563  7980 raft_consensus.cc:2749] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:48.818565  8247 consensus_queue.cc:1048] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.024s
I20260709 13:01:48.827520  8131 raft_consensus.cc:515] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:48.836982  8296 raft_consensus.cc:2804] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:01:48.838321  7961 raft_consensus.cc:697] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 20 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:48.901625  8286 raft_consensus.cc:493] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:48.906279  8286 raft_consensus.cc:515] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:48.908895  8286 leader_election.cc:290] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:48.920666  8131 leader_election.cc:290] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:48.925292  7961 consensus_queue.cc:237] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:48.930936  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:48.931700  2222 raft_consensus.cc:2468] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 16.
I20260709 13:01:48.933156  1572 leader_election.cc:304] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:01:48.934173  8114 raft_consensus.cc:2804] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:48.934630  8114 raft_consensus.cc:493] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:48.935003  8114 raft_consensus.cc:3060] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:48.935362  7765 consensus_queue.cc:237] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:48.945526  8289 leader_election.cc:290] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:48.873466  8276 raft_consensus.cc:697] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 17 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:48.884086  8296 raft_consensus.cc:493] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:48.951558  8244 leader_election.cc:290] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 19 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:48.978322  1676 raft_consensus.cc:2468] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 17.
I20260709 13:01:48.980400  8276 consensus_queue.cc:237] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:01:48.954618  8257 log.cc:927] Time spent T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:01:48.964773  8296 raft_consensus.cc:3060] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:48.984421  8040 raft_consensus.cc:3055] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:48.984912  8040 raft_consensus.cc:740] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:48.900620  7817 consensus_queue.cc:237] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 19.9, Last appended by leader: 9, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:48.988363  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:48.985839  8040 consensus_queue.cc:260] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:49.007009  8040 raft_consensus.cc:3060] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:49.008249  8297 raft_consensus.cc:493] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.005065  8291 raft_consensus.cc:2749] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931) with higher term. Message: Invalid argument: T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 21. Current term is 22.
I20260709 13:01:49.016024  2226 raft_consensus.cc:1275] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:01:49.023227  1603 raft_consensus.cc:2468] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 20.
I20260709 13:01:49.028221  1679 raft_consensus.cc:1275] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:01:49.026747  2192 leader_election.cc:304] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90
W20260709 13:01:49.036258  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 239833us
I20260709 13:01:49.035868  1571 leader_election.cc:304] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:49.041276  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:49.044662  1600 raft_consensus.cc:1275] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 21 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:01:49.051788  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:49.052657  1603 raft_consensus.cc:2368] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 19. Current term is 20.
I20260709 13:01:49.056304  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:49.056993  1527 raft_consensus.cc:2468] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 21.
I20260709 13:01:49.043540  8177 raft_consensus.cc:2804] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:01:49.027469  8297 raft_consensus.cc:515] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:49.055956  8244 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.055054  8072 raft_consensus.cc:2804] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:49.062229  8277 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.093397  1526 raft_consensus.cc:1275] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:01:49.049294  8096 consensus_queue.cc:1048] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:01:49.117370  1528 raft_consensus.cc:1275] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:01:49.118093  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:49.171321  1529 raft_consensus.cc:2468] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 16.
I20260709 13:01:49.123445  1526 raft_consensus.cc:1275] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 22 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:01:49.165190  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:49.175715  1497 leader_election.cc:400] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 19 election: Vote denied by peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303) with higher term. Message: Invalid argument: T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 19. Current term is 20.
I20260709 13:01:49.176124  1497 leader_election.cc:403] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 13:01:49.091058  8072 raft_consensus.cc:493] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:49.087740  8177 raft_consensus.cc:697] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 20 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:49.099514  7880 consensus_queue.cc:1048] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.119s
I20260709 13:01:49.194907  8248 raft_consensus.cc:3060] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:49.212654  8072 raft_consensus.cc:3060] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:01:49.195370  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 76379.5us
I20260709 13:01:49.251330  1644 leader_election.cc:304] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:49.127710  8277 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:49.094331  8244 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:49.176546  8139 consensus_queue.cc:1048] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.071s
W20260709 13:01:49.253007  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 71563us
I20260709 13:01:49.293166  8290 consensus_queue.cc:1048] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 13:01:49.303026  8262 consensus_queue.cc:1048] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:49.306830  8299 consensus_queue.cc:1048] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:49.310251  8277 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:49.313251  8297 leader_election.cc:290] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:49.297355  8177 consensus_queue.cc:237] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:49.291077  8266 raft_consensus.cc:2804] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:01:49.338995  8266 raft_consensus.cc:493] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:49.339604  8266 raft_consensus.cc:3060] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:01:49.343446  8252 consensus_meta.cc:287] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.591s	user 0.007s	sys 0.003s
W20260709 13:01:49.346107  8058 consensus_meta.cc:287] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642: Time spent flushing consensus metadata: real 0.772s	user 0.010s	sys 0.002s
I20260709 13:01:49.337044  8279 raft_consensus.cc:493] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:49.312330  8114 raft_consensus.cc:515] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:49.351823  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:49.353169  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 13:01:49.336933  7983 consensus_meta.cc:287] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent flushing consensus metadata: real 0.519s	user 0.010s	sys 0.000s
I20260709 13:01:49.385159  1532 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 23.
W20260709 13:01:49.385569  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 327687us
I20260709 13:01:49.386317  1604 raft_consensus.cc:1275] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 11. (term mismatch)
I20260709 13:01:49.359256  7625 raft_consensus.cc:493] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.388511  1604 pending_rounds.cc:85] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642: Aborting all ops after (but not including) 10
I20260709 13:01:49.390566  1604 pending_rounds.cc:107] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642: Aborting uncommitted NO_OP operation due to leader change: 15.11
I20260709 13:01:49.390861  1604 raft_consensus.cc:2889] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:49.326434  8296 raft_consensus.cc:515] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:49.384780  8143 raft_consensus.cc:493] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:49.405850  1496 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.087s	sys 0.148s
W20260709 13:01:49.406728  1496 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.088s	sys 0.148s
W20260709 13:01:49.407235  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 601936us
I20260709 13:01:49.409809  1679 raft_consensus.cc:1275] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 13. (term mismatch)
I20260709 13:01:49.410188  1679 pending_rounds.cc:85] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90: Aborting all ops after (but not including) 12
I20260709 13:01:49.410421  1679 pending_rounds.cc:107] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90: Aborting uncommitted NO_OP operation due to leader change: 20.13
I20260709 13:01:49.410645  1679 raft_consensus.cc:2889] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:01:49.457199  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 237113us
I20260709 13:01:49.386791  8072 raft_consensus.cc:515] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:01:49.465111  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 61638.9us
I20260709 13:01:49.470920  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:49.470927  1532 raft_consensus.cc:1275] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:01:49.404932  8058 raft_consensus.cc:493] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:49.392277  7983 raft_consensus.cc:515] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:49.395262  7625 raft_consensus.cc:515] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:49.390401  8279 raft_consensus.cc:515] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:49.451444  8139 raft_consensus.cc:493] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:49.484321  8176 consensus_meta.cc:287] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90: Time spent flushing consensus metadata: real 0.626s	user 0.008s	sys 0.003s
I20260709 13:01:49.559108  8279 leader_election.cc:290] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:49.559530  8139 raft_consensus.cc:515] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:49.579680  8176 raft_consensus.cc:515] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:49.580870  1680 raft_consensus.cc:1240] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 20. Current term is 21. Ops: []
I20260709 13:01:49.581558  8139 leader_election.cc:290] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:49.563894  8114 leader_election.cc:290] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:01:49.579384  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 85546.8us
I20260709 13:01:49.565140  8296 leader_election.cc:290] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 19 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:49.567225  8248 raft_consensus.cc:2749] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303) with higher term. Message: Invalid argument: T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 19. Current term is 20.
I20260709 13:01:49.408895  8143 raft_consensus.cc:515] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:49.570007  1679 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "112134ca2a6243c98c85c27d41496747"
dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
mode: GRACEFUL
new_leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:33616
I20260709 13:01:49.595618  1679 raft_consensus.cc:606] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Received request to transfer leadership to TS e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:49.596028  1679 raft_consensus.cc:614] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:49.571949  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:49.596693  1532 raft_consensus.cc:3060] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:49.573335  8072 leader_election.cc:290] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 18 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:01:49.573477  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 104700us
I20260709 13:01:49.574183  7983 leader_election.cc:290] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 18 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:49.577206  8244 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:49.487701  8058 raft_consensus.cc:515] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:49.593142  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:49.582051  8176 leader_election.cc:290] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 21 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:49.607710  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:49.609856  1676 raft_consensus.cc:3060] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:49.607996  1525 raft_consensus.cc:3060] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:49.616470  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:49.617431  1529 raft_consensus.cc:2393] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 24: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:01:49.618738  1532 raft_consensus.cc:2468] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 17.
I20260709 13:01:49.620414  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:49.621126  1523 raft_consensus.cc:3060] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:49.633600  1676 raft_consensus.cc:2468] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 18.
I20260709 13:01:49.611546  8058 leader_election.cc:290] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:49.637343  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:49.637990  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:49.648214  1679 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 23.
I20260709 13:01:49.639528  1525 raft_consensus.cc:2468] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 18.
I20260709 13:01:49.639505  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:49.650593  1678 raft_consensus.cc:2410] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 19 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:01:49.650909  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:49.644289  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:49.651995  2227 raft_consensus.cc:3060] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:49.651525  1600 raft_consensus.cc:2468] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 21.
I20260709 13:01:49.652637  1599 raft_consensus.cc:1275] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 22 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:01:49.652086  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:49.653388  1603 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 23.
I20260709 13:01:49.660002  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:49.660637  1602 raft_consensus.cc:3060] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:49.662145  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:49.662745  8279 raft_consensus.cc:493] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.663230  8279 raft_consensus.cc:515] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:49.664264  8143 leader_election.cc:290] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:49.665246  8279 leader_election.cc:290] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:01:49.647452  7961 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.718s	user 0.023s	sys 0.028s
I20260709 13:01:49.669688  1523 raft_consensus.cc:2468] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 21.
I20260709 13:01:49.670202  2227 raft_consensus.cc:2468] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 17.
I20260709 13:01:49.680873  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:49.672847  8307 raft_consensus.cc:493] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.686235  8307 raft_consensus.cc:515] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:49.671489  8266 raft_consensus.cc:515] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:49.689035  1602 raft_consensus.cc:2468] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 19.
I20260709 13:01:49.666235  8291 raft_consensus.cc:493] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:49.690708  8266 leader_election.cc:290] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 22 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:49.690524  8291 raft_consensus.cc:515] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:49.692909  8291 leader_election.cc:290] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:49.694839  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:49.695529  1526 raft_consensus.cc:3060] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:01:49.620405  8248 consensus_queue.cc:1048] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.051s
W20260709 13:01:49.673478  7961 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.744s	user 0.023s	sys 0.029s
I20260709 13:01:49.654203  8194 raft_consensus.cc:493] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:49.706888  1525 raft_consensus.cc:2468] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 24.
I20260709 13:01:49.712354  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:49.718889  1572 leader_election.cc:304] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:01:49.683640  1646 leader_election.cc:304] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:49.738121  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:49.740841  1676 raft_consensus.cc:2468] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 24.
W20260709 13:01:49.741550  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 58030.2us
I20260709 13:01:49.740500  1674 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c"
dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
mode: GRACEFUL
new_leader_uuid: "39a92f5a4352465d8af3af5908fe8642"
 from {username='slave'} at 127.0.0.1:33616
I20260709 13:01:49.710989  1571 leader_election.cc:304] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:49.753525  7625 leader_election.cc:290] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:49.743911  8194 raft_consensus.cc:515] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:49.765090  7625 raft_consensus.cc:2804] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:01:49.765594  7625 raft_consensus.cc:697] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 18 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:49.766408  7625 consensus_queue.cc:237] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:49.767896  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:49.746148  8291 raft_consensus.cc:2804] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:49.756771  8307 leader_election.cc:290] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:49.760401  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:49.770190  8291 raft_consensus.cc:697] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 17 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:49.770520  1529 raft_consensus.cc:2468] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 18.
I20260709 13:01:49.766301  8194 leader_election.cc:290] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:49.762989  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:49.743978  1674 raft_consensus.cc:606] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 20 LEADER]: Received request to transfer leadership to TS 39a92f5a4352465d8af3af5908fe8642
I20260709 13:01:49.771926  8291 consensus_queue.cc:237] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:49.773204  8298 raft_consensus.cc:2804] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:01:49.773691  8298 raft_consensus.cc:493] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:49.774083  8298 raft_consensus.cc:3060] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:01:49.774887  1674 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf"
dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
mode: GRACEFUL
new_leader_uuid: "39a92f5a4352465d8af3af5908fe8642"
 from {username='slave'} at 127.0.0.1:33616
I20260709 13:01:49.775554  1674 raft_consensus.cc:606] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 19 LEADER]: Received request to transfer leadership to TS 39a92f5a4352465d8af3af5908fe8642
I20260709 13:01:49.778456  1676 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5"
dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
mode: GRACEFUL
new_leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:33616
I20260709 13:01:49.780211  1526 raft_consensus.cc:2468] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 22.
W20260709 13:01:49.784190  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 73289.4us
W20260709 13:01:49.800940  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 54857.2us
I20260709 13:01:49.798153  1571 leader_election.cc:304] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:49.926288  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:49.926880  1677 raft_consensus.cc:2468] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 18.
I20260709 13:01:49.927789  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 25 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:49.928412  1674 raft_consensus.cc:2410] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 for term 25 because replica has last-logged OpId of term: 23 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 12.
I20260709 13:01:49.930791  1672 raft_consensus.cc:1275] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 19 index: 9. Preceding OpId from leader: term: 21 index: 10. (index mismatch)
I20260709 13:01:49.938505  1646 leader_election.cc:304] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:49.939193  8040 consensus_queue.cc:1048] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:01:49.940688  8040 raft_consensus.cc:2804] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:01:49.941206  8040 raft_consensus.cc:697] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 19 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:49.942248  8297 raft_consensus.cc:493] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:49.943066  8297 raft_consensus.cc:515] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:49.945451  8297 leader_election.cc:290] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:49.942077  8040 consensus_queue.cc:237] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 17.16, Last appended by leader: 16, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:49.975561  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:49.975343  7625 raft_consensus.cc:2804] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:01:49.977049  7625 raft_consensus.cc:493] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 23 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:49.977542  7625 raft_consensus.cc:3060] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:01:49.953619  8309 consensus_queue.cc:1048] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:01:49.989704  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:49.994768  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:49.997200  8277 raft_consensus.cc:993] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90: : Instructing follower 39a92f5a4352465d8af3af5908fe8642 to start an election
W20260709 13:01:49.998113  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 200039us
I20260709 13:01:49.997694  8277 raft_consensus.cc:1081] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 19 LEADER]: Signalling peer 39a92f5a4352465d8af3af5908fe8642 to start an election
I20260709 13:01:50.004460  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:50.005285  1598 raft_consensus.cc:2468] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 20.
I20260709 13:01:50.015763  1646 leader_election.cc:304] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:50.017146  8277 raft_consensus.cc:2804] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:01:50.017552  8277 raft_consensus.cc:493] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:50.017872  8277 raft_consensus.cc:3060] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:50.027706  1598 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf"
dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
 from {username='slave'} at 127.0.0.1:36200
I20260709 13:01:50.028523  1598 raft_consensus.cc:493] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:50.028942  1598 raft_consensus.cc:3060] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:50.030762  8247 raft_consensus.cc:493] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.032786  8247 raft_consensus.cc:515] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:50.035334  8247 leader_election.cc:290] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:50.038049  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:50.038925  1672 raft_consensus.cc:2468] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 16.
I20260709 13:01:50.040225  1496 leader_election.cc:304] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:50.056816  1571 leader_election.cc:304] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:50.059075  8334 raft_consensus.cc:493] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:50.059727  8334 raft_consensus.cc:515] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:50.062186  8131 raft_consensus.cc:2804] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:01:50.061947  8298 raft_consensus.cc:515] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:50.063109  1676 raft_consensus.cc:606] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 22 FOLLOWER]: Received request to transfer leadership to TS e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:50.063470  1676 raft_consensus.cc:614] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 22 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:50.065176  8316 raft_consensus.cc:493] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:50.065351  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 22 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:50.065761  1678 raft_consensus.cc:1240] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 22 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 21. Current term is 22. Ops: [21.13-21.13]
I20260709 13:01:50.065760  8316 raft_consensus.cc:515] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:50.062706  8131 raft_consensus.cc:493] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:50.067566  8131 raft_consensus.cc:3060] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:50.068051  8316 leader_election.cc:290] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:50.068604  8316 raft_consensus.cc:493] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:50.069067  8316 raft_consensus.cc:515] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:50.071058  8277 raft_consensus.cc:515] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:50.071959  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:50.053910  7625 raft_consensus.cc:515] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:50.065423  8216 raft_consensus.cc:493] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.076608  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:50.077098  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:50.083930  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:50.077101  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:50.079624  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 22 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:50.086287  1602 raft_consensus.cc:3060] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:01:50.080264  1523 raft_consensus.cc:1240] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 22 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 21. Current term is 22. Ops: []
I20260709 13:01:50.096365  1599 raft_consensus.cc:2468] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 24.
I20260709 13:01:50.096506  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:50.083789  2224 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 23.
I20260709 13:01:50.073594  8316 leader_election.cc:290] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:50.101284  1602 raft_consensus.cc:2468] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 22.
I20260709 13:01:50.090153  1598 raft_consensus.cc:515] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:50.098950  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:50.103868  2224 raft_consensus.cc:3060] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:50.061991  8334 leader_election.cc:290] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:50.078006  8247 raft_consensus.cc:2804] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:50.064934  8298 leader_election.cc:290] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 22 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:50.083099  8279 raft_consensus.cc:493] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:50.095602  8291 raft_consensus.cc:493] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.111879  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:50.096339  8139 raft_consensus.cc:493] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:50.112565  2220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:50.096500  8248 raft_consensus.cc:493] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:50.117522  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: true dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:50.118455  1677 raft_consensus.cc:3055] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:01:50.118814  1677 raft_consensus.cc:740] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:50.120050  8307 raft_consensus.cc:493] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:50.120599  7625 leader_election.cc:290] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 24 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:50.121006  8268 raft_consensus.cc:993] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90: : Instructing follower 39a92f5a4352465d8af3af5908fe8642 to start an election
I20260709 13:01:50.121485  8268 raft_consensus.cc:1081] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 20 LEADER]: Signalling peer 39a92f5a4352465d8af3af5908fe8642 to start an election
I20260709 13:01:50.122375  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:50.109351  8247 raft_consensus.cc:493] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:50.125344  8247 raft_consensus.cc:3060] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:01:50.125712  8326 log.cc:927] Time spent T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.438s	user 0.000s	sys 0.006s
I20260709 13:01:50.114967  2223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:50.119813  8139 raft_consensus.cc:515] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:50.128363  8139 leader_election.cc:290] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:01:50.128664  8321 log.cc:927] Time spent T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.463s	user 0.002s	sys 0.004s
I20260709 13:01:50.131897  2190 leader_election.cc:304] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:50.113915  1598 leader_election.cc:290] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 20 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:50.132864  8139 raft_consensus.cc:493] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:50.133423  8139 raft_consensus.cc:515] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:50.115723  8279 raft_consensus.cc:515] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:50.135545  8139 leader_election.cc:290] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:50.135877  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:50.133739  8277 leader_election.cc:290] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 21 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:50.137543  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:50.140923  2224 raft_consensus.cc:2468] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 19.
I20260709 13:01:50.141635  1600 raft_consensus.cc:1240] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 22 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 21. Current term is 22. Ops: [21.13-21.13]
I20260709 13:01:50.141892  1644 leader_election.cc:304] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:50.136267  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:50.096706  8216 raft_consensus.cc:515] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:50.151161  1570 leader_election.cc:304] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:50.149070  1677 consensus_queue.cc:260] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:50.136260  8248 raft_consensus.cc:515] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:50.153441  1677 raft_consensus.cc:3060] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:50.120612  8307 raft_consensus.cc:515] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:50.169543  1672 raft_consensus.cc:2468] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 24.
I20260709 13:01:50.171375  1644 leader_election.cc:304] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:50.183116  8266 raft_consensus.cc:493] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.183925  8102 raft_consensus.cc:2804] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:01:50.183703  8266 raft_consensus.cc:515] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:50.184444  8216 leader_election.cc:290] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:50.185899  8266 leader_election.cc:290] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:50.117733  8291 raft_consensus.cc:515] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:50.189285  8291 leader_election.cc:290] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:50.191188  8248 leader_election.cc:290] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:50.151865  8210 raft_consensus.cc:2749] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:50.154914  8163 consensus_queue.cc:1048] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.042s
I20260709 13:01:50.172873  8040 raft_consensus.cc:2804] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:01:50.197870  8307 leader_election.cc:290] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:50.153724  8338 raft_consensus.cc:493] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
W20260709 13:01:50.201508  8327 log.cc:927] Time spent T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.515s	user 0.005s	sys 0.012s
W20260709 13:01:50.199647  8323 log.cc:927] Time spent T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.508s	user 0.000s	sys 0.002s
I20260709 13:01:50.206255  8338 raft_consensus.cc:515] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:50.197914  8247 raft_consensus.cc:515] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:50.198047  8040 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:50.184458  8102 raft_consensus.cc:697] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 21 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:50.203543  8131 raft_consensus.cc:515] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:50.210573  8040 raft_consensus.cc:3060] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:01:50.212951  8131 leader_election.cc:290] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 19 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:50.213228  8247 leader_election.cc:290] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 17 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:50.211761  8102 consensus_queue.cc:237] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:50.215284  8338 leader_election.cc:290] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:50.220216  8040 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:50.221437  8320 log.cc:927] Time spent T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.535s	user 0.002s	sys 0.004s
I20260709 13:01:50.229919  8040 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 24 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:50.232240  8279 leader_election.cc:290] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
W20260709 13:01:50.238922  8311 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.004s	sys 0.013s
W20260709 13:01:50.239434  8311 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.004s	sys 0.013s
W20260709 13:01:50.277611  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 126315us
W20260709 13:01:50.279595  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 100125us
I20260709 13:01:50.290134  1644 leader_election.cc:304] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
W20260709 13:01:50.177762  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 94384.6us
W20260709 13:01:50.292287  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:50.280752  1604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57268 (request call id 1480) took 1570 ms. Trace:
I20260709 13:01:50.294881  1604 rpcz_store.cc:276] 0709 13:01:48.710084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:48.710760 (+   676us) service_pool.cc:224] Handling call
0709 13:01:48.711029 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:49.391296 (+680267us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:50.280060 (+888764us) spinlock_profiling.cc:243] Waited 675 ms on lock 0x7b5400267ad4. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:01:50.280460 (+   400us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1552321280}
I20260709 13:01:50.300029  1644 leader_election.cc:304] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:50.300953  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:01:50.311081  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:50.302486  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:50.303685  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:50.322050  1674 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf"
dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
mode: GRACEFUL
new_leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:33616
I20260709 13:01:50.322885  1674 raft_consensus.cc:606] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Received request to transfer leadership to TS e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:50.323441  1674 raft_consensus.cc:614] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:50.325323   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:01:50.303984  1646 leader_election.cc:304] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:50.305557  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:50.308787  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:50.302212  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:50.313803  1571 leader_election.cc:304] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:50.314996  1604 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c"
dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
 from {username='slave'} at 127.0.0.1:36200
I20260709 13:01:50.316154  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:50.316974  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:50.317929  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:50.340078  1599 raft_consensus.cc:3060] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:01:50.347164  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 187124us
I20260709 13:01:50.350208  2226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 1296) took 1302 ms. Trace:
I20260709 13:01:50.350824  2226 rpcz_store.cc:276] 0709 13:01:49.047219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:49.047376 (+   157us) service_pool.cc:224] Handling call
0709 13:01:49.047713 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:49.048070 (+   357us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:49.048099 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:49.048566 (+   467us) log.cc:844] Serialized 26 byte log entry
0709 13:01:49.220565 (+171999us) spinlock_profiling.cc:243] Waited 2.21 ms on lock 0x7b18001449a0. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1e38ede1 00007f6a1e39b5b1 00007f6a154a8e07 00007f6a1e303ab9 00007f6a154c569b 00007f6a154c393f 00007f6a154c5c02 00007f6a1814d20b 00007f6a18152d23 00007f6a181530d1 00007f6a1856ea0f
0709 13:01:49.483347 (+262782us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:01:49.483385 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:49.483449 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:50.220894 (+737445us) spinlock_profiling.cc:243] Waited 9.59 ms on lock 0x7b4400022b4c. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a153ecc85 00007f6a153ed6a2 00007f6a1815f1db 00007f6a1815aaaf 00007f6a1814e86e 00007f6a1814dbb6 00007f6a1814d7d8 00007f6a18157221 00007f6a181571d9 00007f6a18157169
0709 13:01:50.349491 (+128597us) raft_consensus.cc:1685] finished
0709 13:01:50.349548 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:50.349897 (+   349us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7746,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":9826,"spinlock_wait_cycles":27155072,"thread_start_us":262583,"threads_started":1,"wal-append.queue_time_us":585390}
I20260709 13:01:50.353253  8059 raft_consensus.cc:493] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:50.354259  8059 raft_consensus.cc:515] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:50.338703  1604 raft_consensus.cc:493] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:50.355464  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:50.356060  1601 raft_consensus.cc:2468] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 16.
I20260709 13:01:50.356673  1607 raft_consensus.cc:2393] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 19: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:01:50.356978  1604 raft_consensus.cc:3060] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:50.347165  7880 raft_consensus.cc:2749] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:50.361801  8170 raft_consensus.cc:493] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:50.366027  8102 raft_consensus.cc:2804] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:01:50.367950  8096 raft_consensus.cc:493] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:50.353150  8058 raft_consensus.cc:493] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:50.368973  8096 raft_consensus.cc:515] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:50.369983  8176 raft_consensus.cc:493] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:50.370626  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:50.370939  8176 raft_consensus.cc:515] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:50.371971  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:50.369100  8058 raft_consensus.cc:515] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:50.372869  1600 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 23.
I20260709 13:01:50.373087  1680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50664 (request call id 1646) took 1218 ms. Trace:
I20260709 13:01:50.373715  8176 leader_election.cc:290] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:50.375049  1606 raft_consensus.cc:1275] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 21 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 21 index: 10. (index mismatch)
W20260709 13:01:50.375662  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 62232.9us
I20260709 13:01:50.378717  8058 leader_election.cc:290] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:50.379031  1672 raft_consensus.cc:3060] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:50.384008  8096 leader_election.cc:290] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:50.351186   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:50.391319  1676 raft_consensus.cc:3060] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:50.397535  8139 consensus_queue.cc:1059] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:01:50.390934  1603 raft_consensus.cc:3060] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:01:50.384785  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:50.374409  8176 raft_consensus.cc:2749] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:01:50.383188  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 25 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:50.373458  1680 rpcz_store.cc:276] 0709 13:01:49.154516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:49.157962 (+  3446us) service_pool.cc:224] Handling call
0709 13:01:49.196054 (+ 38092us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:49.581249 (+385195us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:50.370570 (+789321us) spinlock_profiling.cc:243] Waited 385 ms on lock 0x7b540024d454. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b3e01 00007f6a185b283e 00007f6a1d577419 00007f6a16aeebd4 00007f6a16aeeb62 00007f6a16aeea91 00007f6a16aeea0c 00007f6a16aedcc2 00007f6a168ee48c 00007f6a168ed8c6
0709 13:01:50.372914 (+  2344us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":884644736}
I20260709 13:01:50.379058  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:50.381747  8018 raft_consensus.cc:2804] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:01:50.384349  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:50.407349  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:50.350478  2190 leader_election.cc:304] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:50.412832  1604 raft_consensus.cc:515] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:50.385164  8102 raft_consensus.cc:697] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 22 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:50.400245  8139 raft_consensus.cc:3055] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:01:50.385056  8051 raft_consensus.cc:2804] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:01:50.390847  8170 raft_consensus.cc:515] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:50.422777  1678 raft_consensus.cc:1240] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 20. Current term is 21. Ops: []
I20260709 13:01:50.423172  8059 leader_election.cc:290] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:50.424427  1680 raft_consensus.cc:1275] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:01:50.425012  8170 leader_election.cc:290] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:50.420218  8139 raft_consensus.cc:740] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:50.426849  8139 consensus_queue.cc:260] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:50.427525  8102 consensus_queue.cc:237] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:50.439617  1599 raft_consensus.cc:2468] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 21.
I20260709 13:01:50.442775  8051 raft_consensus.cc:697] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 22 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:50.444169  8051 consensus_queue.cc:237] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:50.431638  8170 raft_consensus.cc:2749] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:50.451380  8331 consensus_queue.cc:1048] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:50.449924  8018 raft_consensus.cc:697] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 24 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:50.456769  8018 consensus_queue.cc:237] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:50.458997  8058 raft_consensus.cc:493] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:50.459767  8058 raft_consensus.cc:515] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:50.462944  8309 consensus_queue.cc:1059] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:01:50.462009  8170 consensus_queue.cc:1048] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:50.463824  1497 leader_election.cc:304] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:50.464359  1604 leader_election.cc:290] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 21 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:50.465811  1497 leader_election.cc:304] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:50.467062  8307 raft_consensus.cc:3060] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:50.468479  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:50.469223  2226 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 23.
I20260709 13:01:50.470351  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:50.470763  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:50.471272  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:50.472329  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 13:01:50.441000  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 90765.6us
I20260709 13:01:50.472267  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:50.478466  8170 consensus_queue.cc:1059] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:01:50.479736  8170 raft_consensus.cc:3055] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:01:50.480150  8170 raft_consensus.cc:740] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 21 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:50.481511  8170 consensus_queue.cc:260] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.17, Last appended by leader: 17, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:50.459210  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RunLeaderElection -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 56141us
I20260709 13:01:50.484090  1646 leader_election.cc:304] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:50.485441  8262 raft_consensus.cc:2804] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:01:50.485944  8262 raft_consensus.cc:493] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:50.486389  8262 raft_consensus.cc:3060] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:01:50.490027  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:50.475338  8248 raft_consensus.cc:2749] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:01:50.492165  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:50.493218  1425 catalog_manager.cc:5697] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 16 to 19, leader changed from ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) to e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193). New cstate: current_term: 19 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:50.495198  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:50.496701  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:50.499547  1603 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 24.
I20260709 13:01:50.500095  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:50.500993  1646 leader_election.cc:304] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:50.503156  1425 catalog_manager.cc:5697] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 11 to 13, leader changed from ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) to b96ce9cc496c49d7818fa983a17b062b (127.0.107.196). New cstate: current_term: 13 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:01:50.505501  1676 raft_consensus.cc:2468] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 17.
I20260709 13:01:50.462442  8058 leader_election.cc:290] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:50.512111  8040 raft_consensus.cc:2804] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:50.512768  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: true dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:50.514603  2222 raft_consensus.cc:3060] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:50.512755  1531 raft_consensus.cc:1275] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:01:50.513362  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: true dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:50.515885  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:50.519599  1672 raft_consensus.cc:2468] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 19.
I20260709 13:01:50.521127  1675 raft_consensus.cc:2368] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 16. Current term is 17.
I20260709 13:01:50.522264  1674 raft_consensus.cc:3055] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:01:50.522730  1674 raft_consensus.cc:740] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:50.513418  8139 raft_consensus.cc:3060] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:01:50.515820  8040 raft_consensus.cc:493] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:50.524590  8040 raft_consensus.cc:3060] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:50.523931  1674 consensus_queue.cc:260] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:50.528519  1674 raft_consensus.cc:3060] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:50.531404  8316 raft_consensus.cc:493] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:50.532131  8316 raft_consensus.cc:515] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:50.538720  1599 raft_consensus.cc:1275] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
W20260709 13:01:50.538771  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 219734us
I20260709 13:01:50.540073  1425 catalog_manager.cc:5697] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:50.536587  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:50.561792  8170 raft_consensus.cc:3060] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:01:50.541446  8291 raft_consensus.cc:493] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:50.563450  1425 catalog_manager.cc:5697] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 15 to 18, leader changed from e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) to 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194). New cstate: current_term: 18 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } }
I20260709 13:01:50.565181  1425 catalog_manager.cc:5697] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 10 to 15, leader changed from e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 15 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:01:50.563952  8291 raft_consensus.cc:515] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:50.567169  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:50.538192  7980 raft_consensus.cc:493] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.568851  8291 leader_election.cc:290] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:50.568712  7980 raft_consensus.cc:515] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:50.534624  8316 leader_election.cc:290] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:50.537968  8290 raft_consensus.cc:493] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:50.573805  1646 leader_election.cc:304] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:50.558908  8307 raft_consensus.cc:2749] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:50.600062  7980 leader_election.cc:290] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:50.600920  8290 raft_consensus.cc:515] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:50.603569  8290 leader_election.cc:290] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:50.605307  1425 catalog_manager.cc:5697] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
W20260709 13:01:50.608865  1423 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46260 (request call id 369) took 12640 ms (client timeout 15000 ms). Trace:
I20260709 13:01:50.612883  1674 raft_consensus.cc:2468] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 21.
I20260709 13:01:50.613960  1678 raft_consensus.cc:1240] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 22 LEADER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 21. Current term is 22. Ops: []
I20260709 13:01:50.615504  2222 raft_consensus.cc:2468] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 20.
I20260709 13:01:50.599964  1677 raft_consensus.cc:2468] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 20.
W20260709 13:01:50.618853  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 102305us
I20260709 13:01:50.626864  8096 raft_consensus.cc:2804] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:01:50.630959  8262 raft_consensus.cc:515] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:50.631827  1497 leader_election.cc:304] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:50.633714  1497 leader_election.cc:304] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:50.635226  8248 raft_consensus.cc:2804] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:01:50.635746  8248 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:50.636109  8248 raft_consensus.cc:3060] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:01:50.638968  8084 consensus_queue.cc:1048] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:50.640699  8084 raft_consensus.cc:2749] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:50.646615  1497 leader_election.cc:304] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:50.655169  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:50.651562  1570 leader_election.cc:304] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:50.645874  8248 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:50.647483  8040 raft_consensus.cc:515] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:50.663738  1571 leader_election.cc:304] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:50.665805  8040 leader_election.cc:290] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 17 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:50.665719  8018 raft_consensus.cc:2804] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:01:50.668109  8018 raft_consensus.cc:697] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 19 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:50.665203  8262 leader_election.cc:290] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 25 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:50.669112  8018 consensus_queue.cc:237] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:50.659886  8084 raft_consensus.cc:2749] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:01:50.665944  1571 leader_election.cc:400] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 16 pre-election: Vote denied by peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217) with higher term. Message: Invalid argument: T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 16. Current term is 17.
I20260709 13:01:50.649098  8096 raft_consensus.cc:697] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 21 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:50.673945  1571 leader_election.cc:403] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:50.650851  1425 catalog_manager.cc:5697] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:01:50.671295  1525 raft_consensus.cc:2468] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 19.
I20260709 13:01:50.677553  8331 raft_consensus.cc:2749] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:50.678488  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:50.679455  2224 raft_consensus.cc:3060] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:01:50.609521  1423 rpcz_store.cc:269] 0709 13:01:37.968394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:37.968904 (+   510us) service_pool.cc:224] Handling call
0709 13:01:50.608591 (+12639687us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:44.814331 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:44.848114 (+ 33783us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:44.848152 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:01:44.848177 (+    25us) tablet.cc:662] Decoding operations
0709 13:01:44.872955 (+ 24778us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:44.959223 (+ 86268us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:44.976711 (+ 17488us) tablet.cc:685] Acquiring locks for 30 operations
0709 13:01:45.492464 (+515753us) tablet.cc:701] Row locks acquired
0709 13:01:45.492490 (+    26us) write_op.cc:260] PREPARE: finished
0709 13:01:45.492649 (+   159us) write_op.cc:270] Start()
0709 13:01:45.492835 (+   186us) write_op.cc:276] Timestamp: P: 1783602105492596 usec, L: 0
0709 13:01:45.492861 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:01:45.552871 (+ 60010us) log.cc:844] Serialized 11773 byte log entry
0709 13:01:46.268313 (+715442us) op_driver.cc:464] REPLICATION: finished
0709 13:01:46.470588 (+202275us) write_op.cc:301] APPLY: starting
0709 13:01:46.487325 (+ 16737us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:46.857049 (+369724us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:46.860977 (+  3928us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:47.774848 (+913871us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:47.775209 (+   361us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=60,key_file_lookups=60,delta_file_lookups=60,mrs_lookups=0
0709 13:01:47.775252 (+    43us) write_op.cc:312] APPLY: finished
0709 13:01:47.775726 (+   474us) log.cc:844] Serialized 260 byte log entry
0709 13:01:48.015202 (+239476us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:48.044733 (+ 29531us) write_op.cc:454] Released schema lock
0709 13:01:48.058334 (+ 13601us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:48.081619 (+ 23285us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:48.086975 (+  5356us) write_op.cc:454] Released schema lock
0709 13:01:48.292185 (+205210us) spinlock_profiling.cc:243] Waited 6.6 ms on lock 0x7b1800406c00. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1e38ede1 00007f6a1e39b5b1 00007f6a154c63f3 00007f6a154c87c1 00007f6a154c8779 00007f6a154c8709 00007f6a154c86d1 00007f6a154c79cd 000000000038f354 000000000038f199 00007f6a154a983a
Metrics: {"mutex_wait_us":476203,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":187520,"apply.run_cpu_time_us":69223,"apply.run_wall_time_us":1607456,"cfile_cache_hit":122,"cfile_cache_hit_bytes":129767,"num_ops":30,"prepare.queue_time_us":255958,"prepare.run_cpu_time_us":20659,"prepare.run_wall_time_us":998482,"raft.queue_time_us":409496,"raft.run_cpu_time_us":15879,"raft.run_wall_time_us":218851,"replication_time_us":753120,"spinlock_wait_cycles":15174016,"thread_start_us":913155,"threads_started":5,"wal-append.queue_time_us":520917,"wal-append.run_cpu_time_us":15882,"wal-append.run_wall_time_us":2191585}]]}
I20260709 13:01:50.691890  8096 consensus_queue.cc:237] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:50.693624  1571 leader_election.cc:304] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:50.699223  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:50.703611  1531 raft_consensus.cc:1240] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 17. Current term is 18. Ops: []
I20260709 13:01:50.702385  1425 catalog_manager.cc:5697] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 15 to 20, leader changed from b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) to e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193). New cstate: current_term: 20 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:50.706041  1523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:50.696614  8331 raft_consensus.cc:3060] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:01:50.710355  8131 raft_consensus.cc:2804] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:01:50.711136  8131 raft_consensus.cc:697] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 21 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:50.712278  8131 consensus_queue.cc:237] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:50.712970  2226 raft_consensus.cc:1275] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:01:50.710776  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:50.731174  1525 raft_consensus.cc:1240] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 21 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 20. Current term is 21. Ops: [20.16-20.16]
I20260709 13:01:50.735404  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:50.735595  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 13:01:50.737025  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 85554.7us
I20260709 13:01:50.737848  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
W20260709 13:01:50.766436  1647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:50.785010  2192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:50.786567  8139 raft_consensus.cc:493] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:50.868114  1531 raft_consensus.cc:2393] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 24: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:01:50.741091  8266 raft_consensus.cc:493] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
W20260709 13:01:50.870553  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 132956us
I20260709 13:01:50.869992  1527 raft_consensus.cc:2468] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 16.
I20260709 13:01:50.873961  2224 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 24.
I20260709 13:01:50.875610  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:50.876371  8266 raft_consensus.cc:515] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:50.879875  8266 leader_election.cc:290] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:50.873435  1425 catalog_manager.cc:5697] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 11 to 12, leader changed from e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) to b96ce9cc496c49d7818fa983a17b062b (127.0.107.196). New cstate: current_term: 12 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:01:50.881808  8316 consensus_queue.cc:1048] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:01:50.875555  2226 raft_consensus.cc:1275] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 17 index: 16. Preceding OpId from leader: term: 19 index: 17. (index mismatch)
I20260709 13:01:50.887351  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:50.888803  1571 leader_election.cc:304] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:50.890400  8058 raft_consensus.cc:2804] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:01:50.891120  8058 raft_consensus.cc:697] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 20 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:50.881702  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 22 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:50.902468  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:50.890036  8331 raft_consensus.cc:2749] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217) with higher term. Message: Invalid argument: T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 16. Current term is 17.
I20260709 13:01:50.913024  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:50.915449  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:50.922302  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:50.927300  8345 consensus_queue.cc:1048] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:01:50.930830  1528 raft_consensus.cc:2468] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 15.
I20260709 13:01:50.931524  1598 raft_consensus.cc:1275] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 17 index: 16. Preceding OpId from leader: term: 19 index: 17. (index mismatch)
I20260709 13:01:50.935348  1677 raft_consensus.cc:1240] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 25 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 24. Current term is 25. Ops: []
I20260709 13:01:50.939889  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: true dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:50.948885  1604 raft_consensus.cc:1240] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 21 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 20. Current term is 21. Ops: []
I20260709 13:01:50.892145  8058 consensus_queue.cc:237] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:50.958897  2224 raft_consensus.cc:3060] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:50.967027  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:50.967723  1601 raft_consensus.cc:3060] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:50.949486  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:50.978314  2224 raft_consensus.cc:2468] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 21.
I20260709 13:01:50.999313  8283 consensus_queue.cc:1059] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.016s
I20260709 13:01:50.999891  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:51.000432  8348 raft_consensus.cc:3055] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:01:51.000598  1527 raft_consensus.cc:3060] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:01:51.000886  8348 raft_consensus.cc:740] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:51.001940  8348 consensus_queue.cc:260] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:50.944024  8139 raft_consensus.cc:515] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:51.012925  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:51.013015  8307 raft_consensus.cc:493] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:50.995923  8084 raft_consensus.cc:493] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:51.023012  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:51.023448  8084 raft_consensus.cc:515] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:51.033308  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:51.034124  1531 raft_consensus.cc:3060] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:51.041232  7880 consensus_queue.cc:1059] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.021s
I20260709 13:01:51.063474  8316 raft_consensus.cc:3055] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:01:51.063941  8316 raft_consensus.cc:740] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:51.064945  8316 consensus_queue.cc:260] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.14, Last appended by leader: 14, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:51.066242  8316 raft_consensus.cc:3060] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:01:51.031057  8084 leader_election.cc:290] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:51.076916  8194 consensus_queue.cc:1059] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:01:51.077921  8170 raft_consensus.cc:3055] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:01:51.078354  8170 raft_consensus.cc:740] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:51.079387  8170 consensus_queue.cc:260] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:51.080768  8170 raft_consensus.cc:3060] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:51.082222  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:51.085289  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:51.086499  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:51.087635  1530 raft_consensus.cc:1275] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 22 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 13. (term mismatch)
I20260709 13:01:51.088047  1530 pending_rounds.cc:85] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting all ops after (but not including) 12
I20260709 13:01:51.088285  1530 pending_rounds.cc:107] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting uncommitted NO_OP operation due to leader change: 21.13
I20260709 13:01:51.088564  1530 raft_consensus.cc:2889] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:51.088843  8348 raft_consensus.cc:3060] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:51.089771  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:51.092332  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 22 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:51.095578  1524 raft_consensus.cc:1275] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 21 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
W20260709 13:01:51.099221  8364 log.cc:927] Time spent T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.224s	user 0.001s	sys 0.000s
I20260709 13:01:51.088277  1529 raft_consensus.cc:2368] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 16. Current term is 17.
W20260709 13:01:51.103806  1645 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:51.092072  8084 raft_consensus.cc:493] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:51.107018  8084 raft_consensus.cc:515] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:51.115197  8362 log.cc:927] Time spent T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
W20260709 13:01:51.118510  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 71289.7us
I20260709 13:01:51.133340  1601 raft_consensus.cc:2468] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 17.
I20260709 13:01:51.134402  1527 raft_consensus.cc:2468] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 25.
I20260709 13:01:51.139499  1530 raft_consensus.cc:1275] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:01:51.144948  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:51.147887  1531 raft_consensus.cc:2468] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 17.
I20260709 13:01:51.151993  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:51.155848  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:51.023068  8307 raft_consensus.cc:515] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:51.101918  8139 leader_election.cc:290] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:51.179596  1527 raft_consensus.cc:2468] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 12.
I20260709 13:01:51.196506  8084 leader_election.cc:290] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:51.197186  1572 leader_election.cc:304] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:01:51.198256  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 44816.1us
I20260709 13:01:51.214821  8248 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 24 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:51.190757  8309 raft_consensus.cc:493] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:51.198371  8316 raft_consensus.cc:2749] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:51.227413  1572 leader_election.cc:304] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:51.229159  8307 leader_election.cc:290] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:51.224859  8309 raft_consensus.cc:515] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:51.230906  1646 leader_election.cc:304] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:51.234987  8252 raft_consensus.cc:2749] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:51.244026  8316 raft_consensus.cc:2749] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:51.267695  1523 raft_consensus.cc:1240] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 25 FOLLOWER]: Rejecting Update request from peer 39a92f5a4352465d8af3af5908fe8642 for earlier term 24. Current term is 25. Ops: []
W20260709 13:01:51.268893  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 126563us
W20260709 13:01:51.272274  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 152180us
I20260709 13:01:51.278980  1496 leader_election.cc:304] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
W20260709 13:01:51.283402  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 58871.3us
I20260709 13:01:51.283632  1644 leader_election.cc:304] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:51.293447  2191 leader_election.cc:304] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:51.294636  8170 raft_consensus.cc:2749] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:51.298344  2227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:51.298293  1646 leader_election.cc:304] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:51.299544  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:51.299548  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:51.301499  1570 leader_election.cc:304] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:51.301450  1572 leader_election.cc:304] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:51.302706  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:51.303778  2219 raft_consensus.cc:2393] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 24: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:01:51.305377  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ed1c1e27234d98ba5eeb14457a4ee2" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:51.306743  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:51.307824  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:51.308573  1605 raft_consensus.cc:2393] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 24: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:01:51.309845  8018 raft_consensus.cc:493] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:51.310220  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:51.310436  8018 raft_consensus.cc:515] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:51.291043  8307 raft_consensus.cc:2804] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:51.295282  8040 raft_consensus.cc:2749] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:01:51.317402  7980 raft_consensus.cc:2749] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:01:51.317953  8331 raft_consensus.cc:2749] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:51.317477  8248 raft_consensus.cc:493] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:51.330801  8248 raft_consensus.cc:515] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:51.333231  8248 leader_election.cc:290] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:51.283356  8266 consensus_queue.cc:1059] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 13:01:51.334363  8266 raft_consensus.cc:3055] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:01:51.320081  1570 leader_election.cc:400] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 16 pre-election: Vote denied by peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931) with higher term. Message: Invalid argument: T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 16. Current term is 17.
I20260709 13:01:51.320713  1497 leader_election.cc:304] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:51.320858  1644 leader_election.cc:304] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:51.321900  1572 leader_election.cc:304] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:51.322381  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:51.323967  8252 consensus_queue.cc:1048] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:01:51.319150  8307 raft_consensus.cc:697] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:51.339891  1497 leader_election.cc:304] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:51.339705  8307 consensus_queue.cc:237] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:51.341619  1497 leader_election.cc:304] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:51.334411  1680 raft_consensus.cc:2393] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 24: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:01:51.343393  8377 raft_consensus.cc:2749] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:01:51.343532  8143 raft_consensus.cc:2804] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:01:51.344010  8018 leader_election.cc:290] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:51.344156  8377 raft_consensus.cc:2749] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:51.335714  8266 raft_consensus.cc:740] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:51.344933  8377 raft_consensus.cc:2749] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:01:51.345475  8266 consensus_queue.cc:260] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:51.346777  8266 raft_consensus.cc:3060] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:51.338455  1644 leader_election.cc:304] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:51.340050  2222 raft_consensus.cc:1275] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 22 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 22 index: 17. (term mismatch)
I20260709 13:01:51.348410  2222 pending_rounds.cc:85] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b: Aborting all ops after (but not including) 16
I20260709 13:01:51.348659  2222 pending_rounds.cc:107] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b: Aborting uncommitted NO_OP operation due to leader change: 21.17
I20260709 13:01:51.348878  2222 raft_consensus.cc:2889] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:51.349291  1572 leader_election.cc:304] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:51.350351  7980 consensus_queue.cc:1048] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:01:51.351974  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:51.352141  8040 raft_consensus.cc:2804] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:51.355827  1570 leader_election.cc:304] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:51.357651  8216 consensus_queue.cc:1048] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:51.358009  8291 raft_consensus.cc:2804] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:51.358397  8291 raft_consensus.cc:493] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:51.358765  8291 raft_consensus.cc:3060] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:51.358924  8051 raft_consensus.cc:2749] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:51.359088  8018 raft_consensus.cc:2749] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:51.360416  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:51.361027  2223 raft_consensus.cc:1275] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 21 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 16. (term mismatch)
I20260709 13:01:51.361399  2223 pending_rounds.cc:85] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b: Aborting all ops after (but not including) 15
I20260709 13:01:51.361603  2223 pending_rounds.cc:107] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b: Aborting uncommitted NO_OP operation due to leader change: 20.16
I20260709 13:01:51.361802  2223 raft_consensus.cc:2889] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:51.354871  8143 raft_consensus.cc:697] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 24 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:51.367523  1497 leader_election.cc:304] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:51.347541  8331 raft_consensus.cc:2749] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:51.354341  8040 raft_consensus.cc:493] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:51.373345  8040 raft_consensus.cc:3060] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:51.373802  8248 raft_consensus.cc:2749] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:01:51.376049  8363 log.cc:927] Time spent T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
I20260709 13:01:51.379596  1644 leader_election.cc:304] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
W20260709 13:01:51.380190  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 46284.1us
W20260709 13:01:51.374565  8365 log.cc:927] Time spent T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.138s	user 0.000s	sys 0.003s
I20260709 13:01:51.383384  1644 leader_election.cc:304] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:51.391832  8259 raft_consensus.cc:2804] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:51.392342  8259 raft_consensus.cc:697] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 17 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:51.386082  8299 consensus_queue.cc:1048] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.005s
I20260709 13:01:51.386703  8176 raft_consensus.cc:2804] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:01:51.398959  8259 consensus_queue.cc:237] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:01:51.402038  8373 log.cc:927] Time spent T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.175s	user 0.004s	sys 0.005s
W20260709 13:01:51.409245  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 60040.3us
I20260709 13:01:51.368638  8252 consensus_queue.cc:1048] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.040s
W20260709 13:01:51.489773  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 78812.9us
I20260709 13:01:51.490497  1572 leader_election.cc:304] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:51.404886  8176 raft_consensus.cc:697] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 25 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
W20260709 13:01:51.491886  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 107318us
I20260709 13:01:51.495626  1572 leader_election.cc:304] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:51.374961  8143 consensus_queue.cc:237] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.14, Last appended by leader: 14, Current term: 24, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:51.500190  1572 leader_election.cc:304] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:51.513164  1525 raft_consensus.cc:1275] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 22 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:01:51.502489  7880 raft_consensus.cc:2749] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:51.496613  8299 consensus_queue.cc:1048] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.014s
I20260709 13:01:51.515357  8040 raft_consensus.cc:515] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:51.517655  8040 leader_election.cc:290] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:51.510821  8058 raft_consensus.cc:2749] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:51.527525  8176 consensus_queue.cc:237] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:51.525801  8335 raft_consensus.cc:2749] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:51.547510  8291 raft_consensus.cc:515] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:51.550120  8291 leader_election.cc:290] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:01:51.571784  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 71691.3us
I20260709 13:01:51.596943  1572 leader_election.cc:304] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:51.598868  7980 raft_consensus.cc:2749] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:51.605773  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:51.608117  8376 raft_consensus.cc:493] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:51.608857  8376 raft_consensus.cc:515] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:51.611088  8345 raft_consensus.cc:493] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:51.611752  8345 raft_consensus.cc:515] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:51.614117  8345 leader_election.cc:290] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:51.600925  8194 raft_consensus.cc:493] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:51.623118  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:51.624462  1606 raft_consensus.cc:2468] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 12.
W20260709 13:01:51.629609  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 134339us
W20260709 13:01:51.633667  8386 log.cc:927] Time spent T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 13:01:51.637217  1607 raft_consensus.cc:1275] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 21 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:01:51.628046  8194 raft_consensus.cc:515] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:51.632535  8248 raft_consensus.cc:493] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:51.642277  1602 raft_consensus.cc:1275] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 22 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:01:51.643538  8194 leader_election.cc:290] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:51.644933  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:51.644824  1603 raft_consensus.cc:1240] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:51.642699  8248 raft_consensus.cc:515] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:51.642817  8259 consensus_queue.cc:1048] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:01:51.645586  1646 leader_election.cc:304] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:51.647374  8259 raft_consensus.cc:2749] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:01:51.647413  8248 leader_election.cc:290] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:51.649055  8259 consensus_queue.cc:1048] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:01:51.650311  8299 consensus_queue.cc:1048] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:01:51.652102  8299 consensus_queue.cc:1048] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:01:51.669921  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:51.675602  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:51.662853  8376 leader_election.cc:290] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:51.710718  2226 raft_consensus.cc:1275] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 21 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 16. (term mismatch)
I20260709 13:01:51.711109  2226 pending_rounds.cc:85] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b: Aborting all ops after (but not including) 15
I20260709 13:01:51.711321  2226 pending_rounds.cc:107] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b: Aborting uncommitted NO_OP operation due to leader change: 20.16
I20260709 13:01:51.711550  2226 raft_consensus.cc:2889] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:51.740108  8309 leader_election.cc:290] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:51.744191  8400 consensus_queue.cc:1048] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:01:51.747262  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 20 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:51.753229  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:51.747913  2192 leader_election.cc:304] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:01:51.757882  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:51.748975  8194 raft_consensus.cc:493] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
W20260709 13:01:51.767931  8404 log.cc:927] Time spent T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:01:51.764528  8376 raft_consensus.cc:2804] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:51.765102  8248 raft_consensus.cc:493] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:51.784739  8402 consensus_queue.cc:1059] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:01:51.769471  8194 raft_consensus.cc:515] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:51.782512  8248 raft_consensus.cc:515] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:51.789021  8248 leader_election.cc:290] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:51.808507  1497 leader_election.cc:304] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:51.809888  1497 leader_election.cc:304] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:51.811036  8309 raft_consensus.cc:2749] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:51.811862  8309 raft_consensus.cc:2749] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:01:51.816375  1497 leader_election.cc:304] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:51.818836  8309 raft_consensus.cc:2749] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
W20260709 13:01:51.826427  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 47211.1us
I20260709 13:01:51.832003  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:51.781669  8376 raft_consensus.cc:493] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:51.825861  8345 raft_consensus.cc:3055] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:51.835732  8376 raft_consensus.cc:3060] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:51.841207  8408 log.cc:927] Time spent T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:01:51.837488  8345 raft_consensus.cc:740] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:51.849545  8345 consensus_queue.cc:260] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:51.850636  8345 raft_consensus.cc:3060] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:51.895836  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:51.899072  1496 leader_election.cc:304] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:51.900334  8248 raft_consensus.cc:2749] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:01:51.898738  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:51.908999  1496 leader_election.cc:304] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:51.910496  8139 raft_consensus.cc:2749] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:01:51.926896  8376 raft_consensus.cc:515] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:51.929883  8139 raft_consensus.cc:493] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:51.933537  8139 raft_consensus.cc:515] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:51.936378  8139 leader_election.cc:290] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:51.950637  8194 leader_election.cc:290] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:01:51.954912  8393 log.cc:927] Time spent T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.356s	user 0.000s	sys 0.003s
I20260709 13:01:51.957129  8376 leader_election.cc:290] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 13 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:51.958302  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:51.967830  1677 raft_consensus.cc:1275] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:01:51.970343  1676 raft_consensus.cc:1275] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 20 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:01:51.970182  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4549f0dba6504cfda954259e71ec4c91" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 20 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:51.987540  8399 consensus_queue.cc:1048] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:51.988970  8399 consensus_queue.cc:1048] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:01:51.990698  1571 leader_election.cc:304] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:51.991791  8290 raft_consensus.cc:2749] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:01:51.991963  1529 raft_consensus.cc:1275] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:01:52.000176  2221 raft_consensus.cc:1275] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 21 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 21 index: 18. (index mismatch)
I20260709 13:01:51.998932  8283 raft_consensus.cc:493] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:52.004349  8259 raft_consensus.cc:493] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:52.009997  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 23 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:52.011270  1517 tablet_service.cc:1558] Processing DeleteTablet for tablet 4190d217954f4f798b3a610501115290 with delete_type TABLET_DATA_TOMBSTONED (TS e46412b3b0b44f01ad5c33d4cfe3d6b1 not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:40604
I20260709 13:01:52.019999  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:52.026952  1672 raft_consensus.cc:1275] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 21 index: 18. (index mismatch)
W20260709 13:01:52.027067  1478 auto_rebalancer.cc:629] Failed to schedule move for tablet 8e096d30f7404398b10b9cd77da3c04c: Illegal state: Replica e46412b3b0b44f01ad5c33d4cfe3d6b1 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 18 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } }
I20260709 13:01:52.030864  8375 raft_consensus.cc:493] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:52.028028  8259 raft_consensus.cc:515] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:52.031491  8375 raft_consensus.cc:515] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:52.033675  8375 leader_election.cc:290] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:52.043118  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:52.041522  8338 consensus_queue.cc:1048] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.009s
I20260709 13:01:52.051357  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:52.052804  2224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:52.055128  1644 leader_election.cc:304] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:52.022095  8283 raft_consensus.cc:515] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:52.055931  8395 consensus_queue.cc:1048] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:01:52.057281  8283 leader_election.cc:290] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:52.057777  8291 consensus_queue.cc:1048] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:01:52.065548  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:52.067885  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:52.069343  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:52.070927  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:52.071199  8259 leader_election.cc:290] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:52.071645  2222 raft_consensus.cc:2468] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 13.
I20260709 13:01:52.075078  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:52.077040  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:52.078154  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 23 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:52.080945  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:52.082227  1570 leader_election.cc:304] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:52.057329  8395 raft_consensus.cc:2749] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:01:52.113090  8316 consensus_queue.cc:1048] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:52.115907  1497 leader_election.cc:304] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:52.117923  8139 raft_consensus.cc:2749] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:01:52.124830  8424 log.cc:927] Time spent T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
W20260709 13:01:52.126870  8367 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.793s	user 0.000s	sys 0.016s
W20260709 13:01:52.127293  8367 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.896s	user 0.000s	sys 0.016s
I20260709 13:01:52.098757  8331 raft_consensus.cc:2749] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:52.141219  2192 leader_election.cc:304] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:52.146756  8403 raft_consensus.cc:2749] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:52.167011  1496 leader_election.cc:304] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
W20260709 13:01:52.167034  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 108927us
I20260709 13:01:52.171387  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:52.169335  8084 raft_consensus.cc:2749] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:52.173064  1531 raft_consensus.cc:1275] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:01:52.175678  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:52.173754  1672 raft_consensus.cc:1275] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:01:52.175266  1528 raft_consensus.cc:1275] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 25 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 13:01:52.181232  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:52.199949  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:52.231321  1680 raft_consensus.cc:1240] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Rejecting Update request from peer b96ce9cc496c49d7818fa983a17b062b for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:52.233541  2222 raft_consensus.cc:1240] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:52.235704  1603 raft_consensus.cc:1275] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 25 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 25 index: 14. (term mismatch)
I20260709 13:01:52.236299  1603 pending_rounds.cc:85] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642: Aborting all ops after (but not including) 13
I20260709 13:01:52.236619  1603 pending_rounds.cc:107] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642: Aborting uncommitted NO_OP operation due to leader change: 24.14
I20260709 13:01:52.236855  1603 raft_consensus.cc:2889] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:01:52.237576  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 52955.3us
I20260709 13:01:52.256949  8400 consensus_queue.cc:1059] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:52.257396  8259 consensus_queue.cc:1048] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:01:52.258239  8426 raft_consensus.cc:493] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.258332  8143 raft_consensus.cc:3055] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:52.258793  8426 raft_consensus.cc:515] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:52.258817  8143 raft_consensus.cc:740] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:52.263974   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:52.242973  8430 raft_consensus.cc:493] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.267462  8430 raft_consensus.cc:515] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:52.269827  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:52.273542  2191 leader_election.cc:304] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:52.241715  8290 raft_consensus.cc:493] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.277127  8290 raft_consensus.cc:515] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:52.274287  8432 consensus_queue.cc:1048] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 13:01:52.279445  8290 leader_election.cc:290] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:52.279440  8379 raft_consensus.cc:2749] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:52.282349  2191 leader_election.cc:304] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:52.286239  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 26 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:52.287436  8402 raft_consensus.cc:2749] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:52.291626  2191 leader_election.cc:304] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:52.282274  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:52.301517  1605 raft_consensus.cc:1275] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:01:52.304170  2191 leader_election.cc:304] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:52.301076  1497 leader_election.cc:304] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:52.316361  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:52.319797  8411 raft_consensus.cc:2749] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:52.288260  8402 consensus_queue.cc:1059] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.034s
I20260709 13:01:52.322467  8411 raft_consensus.cc:3055] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:52.322857  8411 raft_consensus.cc:740] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:52.296123  8379 raft_consensus.cc:2749] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:52.327099  8428 tablet_replica.cc:333] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1: stopping tablet replica
I20260709 13:01:52.327308  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:52.327718  8143 consensus_queue.cc:260] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:52.328357  8428 raft_consensus.cc:2243] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:52.329072  8143 raft_consensus.cc:3060] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:52.330442  1601 raft_consensus.cc:1275] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 24 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:01:52.329310  1600 raft_consensus.cc:1275] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:01:52.334020  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:52.338480  1497 leader_election.cc:304] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:01:52.334725  1603 raft_consensus.cc:2468] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 17.
I20260709 13:01:52.340516  2222 raft_consensus.cc:1275] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:01:52.329265  8428 pending_rounds.cc:70] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Trying to abort 1 pending ops.
I20260709 13:01:52.359081  8428 pending_rounds.cc:77] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Aborting op as it isn't in flight: id { term: 10 index: 7 } timestamp: 7305634132269023232 op_type: NO_OP noop_request { }
I20260709 13:01:52.359668  8428 raft_consensus.cc:2889] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:01:52.359758  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 26 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:52.360116  8428 raft_consensus.cc:2272] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:52.360424  1526 raft_consensus.cc:2468] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 25.
I20260709 13:01:52.362902  2221 raft_consensus.cc:1275] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 24 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:01:52.379875  8309 consensus_queue.cc:1048] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:52.380944  8433 raft_consensus.cc:2804] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:52.381497  8433 raft_consensus.cc:493] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:52.381877  8433 raft_consensus.cc:3060] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:52.382536  7980 consensus_queue.cc:1048] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.009s
I20260709 13:01:52.384560  1570 leader_election.cc:304] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:52.387748  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:52.388051  8426 leader_election.cc:290] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:52.411506  8432 raft_consensus.cc:2749] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:01:52.424316  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 57014us
I20260709 13:01:52.426429  1644 leader_election.cc:304] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:52.400446  8059 raft_consensus.cc:493] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:52.430529  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:52.431867  1646 leader_election.cc:304] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:52.390478  8299 consensus_queue.cc:1048] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.038s
I20260709 13:01:52.430331  8395 raft_consensus.cc:2749] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:52.430130  8040 consensus_queue.cc:1048] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 13:01:52.435436  8059 raft_consensus.cc:515] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:52.435106  8391 consensus_queue.cc:1048] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.032s
I20260709 13:01:52.514925  8176 consensus_queue.cc:1048] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 13:01:52.528620  8446 raft_consensus.cc:2804] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:52.529160  8446 raft_consensus.cc:493] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:52.529573  8446 raft_consensus.cc:3060] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:01:52.537029  8434 log.cc:927] Time spent T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 13:01:52.539469  8394 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.540102  8394 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:52.468428  8426 consensus_queue.cc:1048] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.046s
W20260709 13:01:52.528512  8442 log.cc:927] Time spent T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:01:52.596060  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:52.568286  8059 leader_election.cc:290] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:52.571327  8428 ts_tablet_manager.cc:1916] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:52.572449  8411 consensus_queue.cc:260] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:52.578770  8393 log.cc:927] Time spent T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:01:52.579646  8430 leader_election.cc:290] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
W20260709 13:01:52.529356  8439 log.cc:927] Time spent T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
W20260709 13:01:52.588908  8441 log.cc:927] Time spent T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.155s	user 0.000s	sys 0.001s
I20260709 13:01:52.596803  1680 raft_consensus.cc:2468] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 18.
W20260709 13:01:52.611418  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 145143us
I20260709 13:01:52.615538  8411 raft_consensus.cc:3060] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:52.619977  1571 leader_election.cc:304] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:52.631035  2191 leader_election.cc:304] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:52.638484  8131 raft_consensus.cc:2804] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:52.639218  8403 raft_consensus.cc:2749] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:52.669598  8131 raft_consensus.cc:493] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
W20260709 13:01:52.690923  8440 log.cc:927] Time spent T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
I20260709 13:01:52.706194  8131 raft_consensus.cc:3060] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:01:52.714784  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 65288.8us
I20260709 13:01:52.772358  1646 leader_election.cc:304] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:52.803097  8430 raft_consensus.cc:2749] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:01:52.807022  8450 log.cc:927] Time spent T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.147s	user 0.001s	sys 0.003s
I20260709 13:01:52.787633  8446 raft_consensus.cc:515] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:52.826860  8317 raft_consensus.cc:2804] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:01:52.853024  8446 leader_election.cc:290] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 18 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:52.866508  8131 raft_consensus.cc:515] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:52.869213  8131 leader_election.cc:290] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 18 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:01:52.901789  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 91412.6us
W20260709 13:01:52.905557  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 98487.6us
W20260709 13:01:52.907881  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 65596.2us
W20260709 13:01:52.903342  8433 consensus_meta.cc:287] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Time spent flushing consensus metadata: real 0.521s	user 0.012s	sys 0.001s
I20260709 13:01:52.932472  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:52.954154  8433 raft_consensus.cc:515] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:52.956230  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:52.956297  8433 leader_election.cc:290] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:52.965554  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 25 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:01:52.977155  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 68304.1us
I20260709 13:01:52.987802  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 25 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:52.988852  1525 raft_consensus.cc:2410] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for term 25 because replica has last-logged OpId of term: 22 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 13.
I20260709 13:01:52.992043  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 13:01:52.983340  8423 log.cc:927] Time spent T 00000000000000000000000000000000 P 9f38d0e5c9db43a48554defe1153354e: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:01:53.001191  1528 raft_consensus.cc:1275] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 24 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:01:53.003145  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:53.015774  1676 raft_consensus.cc:2468] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 18.
I20260709 13:01:53.016722  1525 raft_consensus.cc:2393] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 18: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:01:53.026191  1680 consensus_queue.cc:237] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 13:01:53.053799  8400 consensus_queue.cc:1048] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:01:53.049847  1644 leader_election.cc:304] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:53.057693  8430 raft_consensus.cc:2749] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:01:53.064682  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:53.128682  8428 ts_tablet_manager.cc:1929] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 10.7
I20260709 13:01:53.129324  8428 log.cc:1199] T 4190d217954f4f798b3a610501115290 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Deleting WAL directory at /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601891739070-431-0/minicluster-data/ts-0-root/wals/4190d217954f4f798b3a610501115290
I20260709 13:01:53.134574  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:53.142527  1570 leader_election.cc:304] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:53.144248  1525 raft_consensus.cc:2393] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 18: Already voted for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in this term.
I20260709 13:01:53.145625  7980 raft_consensus.cc:2749] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:01:53.165341  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:53.166152  1603 raft_consensus.cc:2393] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 13: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:01:53.173667  1673 raft_consensus.cc:1240] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 17. Current term is 18. Ops: []
I20260709 13:01:53.182837  2218 raft_consensus.cc:2468] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 13.
I20260709 13:01:53.189191  8432 consensus_queue.cc:1059] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:53.190276  8432 raft_consensus.cc:3055] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:01:53.190651  8432 raft_consensus.cc:740] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:53.191597  8432 consensus_queue.cc:260] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:53.192876  8432 raft_consensus.cc:3060] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:01:53.205374  1646 consensus_peers.cc:597] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 -> Peer b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373): Couldn't send request to peer b96ce9cc496c49d7818fa983a17b062b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7b4d826f7c344b45b7de4b9f69ea958b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:53.207881  8428 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40604 (request call id 0) took 1197 ms. Trace:
I20260709 13:01:53.208413  8428 rpcz_store.cc:276] 0709 13:01:52.010099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:52.010946 (+   847us) service_pool.cc:224] Handling call
0709 13:01:52.326565 (+315619us) ts_tablet_manager.cc:1151] Deleting tablet 4190d217954f4f798b3a610501115290
0709 13:01:52.326682 (+   117us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:01:52.953030 (+626348us) tablet_metadata.cc:665] Metadata flushed
0709 13:01:53.128531 (+175501us) tablet_metadata.cc:665] Metadata flushed
0709 13:01:53.207786 (+ 79255us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25558,"tablet-delete.queue_time_us":266238,"thread_start_us":136733,"threads_started":1}
W20260709 13:01:53.211301  8472 log.cc:927] Time spent T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 13:01:53.213218  8469 log.cc:927] Time spent T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:01:53.220348  1571 leader_election.cc:304] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:53.221740  8317 raft_consensus.cc:493] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 25 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:53.222317  8317 raft_consensus.cc:3060] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:01:53.223148  8399 raft_consensus.cc:2804] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:01:53.229969  8399 raft_consensus.cc:697] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 18 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:53.230893  8399 consensus_queue.cc:237] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:53.245105  1600 raft_consensus.cc:1275] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:01:53.252833  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 25 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:53.260180  1497 leader_election.cc:304] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:01:53.261206  8394 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:53.261270  8443 raft_consensus.cc:2804] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:53.262306  8443 raft_consensus.cc:697] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:53.263839  1526 raft_consensus.cc:1275] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:01:53.271803  8443 consensus_queue.cc:237] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:53.277240  8096 consensus_queue.cc:1048] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:01:53.223269  1414 catalog_manager.cc:5028] TS e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): tablet 4190d217954f4f798b3a610501115290 (table test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]) successfully deleted
I20260709 13:01:53.293814  8102 consensus_queue.cc:1048] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:01:53.332713  1414 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 117637us
I20260709 13:01:53.292287  8317 raft_consensus.cc:515] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:53.352602  1517 tablet_service.cc:1558] Processing DeleteTablet for tablet 4190d217954f4f798b3a610501115290 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 5 (current committed config index is 8)) from {username='slave'} at 127.0.0.1:40604
I20260709 13:01:53.354630  1598 raft_consensus.cc:1240] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 26 FOLLOWER]: Rejecting Update request from peer ddf11fc190dd4b898773379c6b129d90 for earlier term 25. Current term is 26. Ops: []
I20260709 13:01:53.376919  1414 catalog_manager.cc:5028] TS e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): tablet 4190d217954f4f798b3a610501115290 (table test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]) successfully deleted
W20260709 13:01:53.387359  1425 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46258 (request call id 346) took 20951 ms (client timeout 15000 ms). Trace:
I20260709 13:01:53.389541  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:53.388343  8430 consensus_queue.cc:1059] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: INVALID_TERM, Last received: 25.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.007s
I20260709 13:01:53.401012  8430 raft_consensus.cc:3055] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:01:53.401413  8430 raft_consensus.cc:740] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:53.402217  8430 consensus_queue.cc:260] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.14, Last appended by leader: 14, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:53.407759  8430 raft_consensus.cc:3060] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:01:53.387815  1425 rpcz_store.cc:269] 0709 13:01:32.431796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:32.442520 (+ 10724us) service_pool.cc:224] Handling call
0709 13:01:53.382849 (+20940329us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:51.203065 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:51.203828 (+   763us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:51.203878 (+    50us) write_op.cc:435] Acquired schema lock
0709 13:01:51.203897 (+    19us) tablet.cc:662] Decoding operations
0709 13:01:51.204939 (+  1042us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:51.205038 (+    99us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:51.205065 (+    27us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:01:51.205894 (+   829us) tablet.cc:701] Row locks acquired
0709 13:01:51.205945 (+    51us) write_op.cc:260] PREPARE: finished
0709 13:01:51.206115 (+   170us) write_op.cc:270] Start()
0709 13:01:51.206258 (+   143us) write_op.cc:276] Timestamp: P: 1783602111206047 usec, L: 0
0709 13:01:51.206289 (+    31us) op_driver.cc:348] REPLICATION: starting
0709 13:01:51.231268 (+ 24979us) log.cc:844] Serialized 3602 byte log entry
0709 13:01:52.001043 (+769775us) spinlock_profiling.cc:243] Waited 7.88 ms on lock 0x7b4400022b4c. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1534edb1 00007f6a153ecc85 00007f6a153ed6a2 00007f6a1815f1db 00007f6a1815aaaf 00007f6a154a90ac 00007f6a1e303ab9 00007f6a154c569b 00007f6a154c393f 00007f6a154c5c02 00007f6a1814d20b
0709 13:01:52.245747 (+244704us) op_driver.cc:464] REPLICATION: finished
0709 13:01:52.379426 (+133679us) write_op.cc:301] APPLY: starting
0709 13:01:52.379520 (+    94us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:52.699983 (+320463us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:52.700029 (+    46us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:52.852904 (+152875us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:52.853249 (+   345us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=18,key_file_lookups=18,delta_file_lookups=18,mrs_lookups=0
0709 13:01:52.853294 (+    45us) write_op.cc:312] APPLY: finished
0709 13:01:52.853642 (+   348us) log.cc:844] Serialized 89 byte log entry
0709 13:01:52.903183 (+ 49541us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:52.907947 (+  4764us) write_op.cc:454] Released schema lock
0709 13:01:52.910203 (+  2256us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:52.992352 (+ 82149us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:52.992380 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1796058,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":133362,"apply.run_cpu_time_us":18150,"apply.run_wall_time_us":604396,"cfile_cache_hit":38,"cfile_cache_hit_bytes":41819,"num_ops":9,"prepare.queue_time_us":312861,"prepare.run_cpu_time_us":20636,"prepare.run_wall_time_us":924774,"raft.queue_time_us":114673,"raft.run_cpu_time_us":12516,"raft.run_wall_time_us":127545,"replication_time_us":1038516,"spinlock_wait_cycles":18120576,"thread_start_us":1230525,"threads_started":4,"wal-append.queue_time_us":877445}]]}
I20260709 13:01:53.413394  1680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:53.415495  8317 leader_election.cc:290] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 26 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:53.420714  8096 raft_consensus.cc:2955] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 18 LEADER]: Committing config change with OpId 18.12: config changed from index -1 to 12, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 13:01:53.457530  1598 raft_consensus.cc:2955] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index -1 to 12, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 13:01:53.460496  1529 raft_consensus.cc:2955] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index -1 to 12, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 13:01:53.493059  1680 raft_consensus.cc:2468] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 26.
I20260709 13:01:53.500214  1571 leader_election.cc:304] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:53.502686  8018 raft_consensus.cc:2804] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:01:53.507215  8018 raft_consensus.cc:697] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 26 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:53.506683  1427 catalog_manager.cc:5697] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 17 to 20, leader changed from b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) to 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194). New cstate: current_term: 20 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:01:53.509330  1427 catalog_manager.cc:5697] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 16 to 17, leader changed from ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) to 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194). New cstate: current_term: 17 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:01:53.508102  8018 consensus_queue.cc:237] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.14, Last appended by leader: 14, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:53.512287  1427 catalog_manager.cc:5697] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 10 to 18, leader changed from ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) to 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194). New cstate: current_term: 18 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:01:53.516407  1427 catalog_manager.cc:5697] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 11 to 19. New cstate: current_term: 19 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:01:53.524246  1427 catalog_manager.cc:5697] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 10 to 15. New cstate: current_term: 15 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
W20260709 13:01:53.525602  1426 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46274 (request call id 362) took 53222 ms (client timeout 15000 ms). Trace:
W20260709 13:01:53.526295  1426 rpcz_store.cc:269] 0709 13:01:00.303084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:00.304040 (+   956us) service_pool.cc:224] Handling call
0709 13:01:53.524954 (+53220914us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":47,"spinlock_wait_cycles":13056}
I20260709 13:01:53.530334  1427 catalog_manager.cc:5697] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 13 to 19. New cstate: current_term: 19 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:01:53.531889  1427 catalog_manager.cc:5697] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 10 to 16. New cstate: current_term: 16 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:53.533339  1427 catalog_manager.cc:5697] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:53.639061  8487 ts_tablet_manager.cc:933] T 7b4d826f7c344b45b7de4b9f69ea958b P b96ce9cc496c49d7818fa983a17b062b: Initiating tablet copy from peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:01:53.689747  1478 auto_rebalancer.cc:629] Failed to schedule move for tablet bf3b3cd19c1e496fa7fdb5550772123b: Illegal state: Replica 39a92f5a4352465d8af3af5908fe8642 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 21 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } }
I20260709 13:01:53.692288  8487 tablet_copy_client.cc:323] T 7b4d826f7c344b45b7de4b9f69ea958b P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:44217
I20260709 13:01:53.695030  1680 consensus_queue.cc:237] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 13:01:53.700340  8443 raft_consensus.cc:493] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.700938  8443 raft_consensus.cc:515] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:53.701731  1681 raft_consensus.cc:1275] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:01:53.700937  1690 tablet_copy_service.cc:140] P ddf11fc190dd4b898773379c6b129d90: Received BeginTabletCopySession request for tablet 7b4d826f7c344b45b7de4b9f69ea958b from peer b96ce9cc496c49d7818fa983a17b062b ({username='slave'} at 127.0.0.1:50664)
I20260709 13:01:53.703171  1690 tablet_copy_service.cc:161] P ddf11fc190dd4b898773379c6b129d90: Beginning new tablet copy session on tablet 7b4d826f7c344b45b7de4b9f69ea958b from peer b96ce9cc496c49d7818fa983a17b062b at {username='slave'} at 127.0.0.1:50664: session id = b96ce9cc496c49d7818fa983a17b062b-7b4d826f7c344b45b7de4b9f69ea958b
I20260709 13:01:53.704335  8443 leader_election.cc:290] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:53.706465  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:53.708777  8317 consensus_queue.cc:1048] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:53.718346  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:53.737192  1496 leader_election.cc:304] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:53.739500  8084 raft_consensus.cc:2749] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:53.754598  1529 raft_consensus.cc:1275] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 22 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:01:53.756083  1598 raft_consensus.cc:1275] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 22 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:01:53.748822  8465 raft_consensus.cc:493] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:53.760248  8465 raft_consensus.cc:515] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:53.761888  1646 consensus_peers.cc:597] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 -> Peer b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373): Couldn't send request to peer b96ce9cc496c49d7818fa983a17b062b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8ea5da45c6d2479383e6af85e0a394b5. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:53.763496  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:53.764142  2226 raft_consensus.cc:2468] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 16.
I20260709 13:01:53.765499  1529 raft_consensus.cc:1275] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:01:53.766314  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:53.767179  1681 raft_consensus.cc:2393] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 16: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:01:53.763914  8430 consensus_queue.cc:1048] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.004s
I20260709 13:01:53.765475  1497 leader_election.cc:304] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:53.762485  8465 leader_election.cc:290] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:53.771255  8084 raft_consensus.cc:2804] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:53.771879  8388 consensus_queue.cc:1048] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.008s
I20260709 13:01:53.771946  8018 consensus_queue.cc:1048] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 13:01:53.777829  8084 raft_consensus.cc:493] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting leader election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:01:53.792176  8084 raft_consensus.cc:3060] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:53.804970  8426 raft_consensus.cc:493] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.811702  8426 raft_consensus.cc:515] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:53.816476  8316 raft_consensus.cc:493] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.817071  8316 raft_consensus.cc:515] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:53.831056  8018 raft_consensus.cc:493] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:53.831863  8018 raft_consensus.cc:515] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:53.834975  2218 raft_consensus.cc:1275] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:01:53.837455  1605 raft_consensus.cc:1275] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:01:53.838941  8432 consensus_queue.cc:1048] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:01:53.849188  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:53.849335  8018 leader_election.cc:290] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:53.849699  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:53.849905  1673 raft_consensus.cc:2468] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 13.
I20260709 13:01:53.850492  2226 raft_consensus.cc:2393] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 13: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:01:53.851540  1571 leader_election.cc:304] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:53.852409  8018 raft_consensus.cc:2804] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:53.852957  8018 raft_consensus.cc:493] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:53.853432  8018 raft_consensus.cc:3060] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:53.838560  1690 tablet_copy_source_session.cc:215] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:53.859169  8487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b4d826f7c344b45b7de4b9f69ea958b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:53.834510  8084 raft_consensus.cc:515] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:53.873304  8084 leader_election.cc:290] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:53.870862   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:53.881922  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:53.880570  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:53.888355  1673 raft_consensus.cc:2393] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in current term 16: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:01:53.891057  2226 raft_consensus.cc:2468] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 16.
I20260709 13:01:53.892554  1497 leader_election.cc:304] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:53.905342  8465 raft_consensus.cc:2804] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:53.929491  8465 raft_consensus.cc:697] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
W20260709 13:01:53.933777  1427 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50074 (request call id 237) took 12933 ms (client timeout 15000 ms). Trace:
I20260709 13:01:53.930557  8465 consensus_queue.cc:237] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:53.934298  1427 rpcz_store.cc:269] 0709 13:01:41.063402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:41.064326 (+   924us) service_pool.cc:224] Handling call
0709 13:01:53.933704 (+12869378us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:53.576595 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:53.577794 (+  1199us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:53.577832 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:01:53.577848 (+    16us) tablet.cc:662] Decoding operations
0709 13:01:53.578716 (+   868us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:53.578791 (+    75us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:53.578831 (+    40us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:01:53.579468 (+   637us) tablet.cc:701] Row locks acquired
0709 13:01:53.579487 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:01:53.579676 (+   189us) write_op.cc:270] Start()
0709 13:01:53.579826 (+   150us) write_op.cc:276] Timestamp: P: 1783602113579608 usec, L: 0
0709 13:01:53.579849 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:01:53.582752 (+  2903us) log.cc:844] Serialized 3218 byte log entry
0709 13:01:53.639298 (+ 56546us) op_driver.cc:464] REPLICATION: finished
0709 13:01:53.673474 (+ 34176us) write_op.cc:301] APPLY: starting
0709 13:01:53.673571 (+    97us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:53.678931 (+  5360us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:53.679034 (+   103us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:53.742387 (+ 63353us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:53.747085 (+  4698us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=16,key_file_lookups=16,delta_file_lookups=16,mrs_lookups=0
0709 13:01:53.747150 (+    65us) write_op.cc:312] APPLY: finished
0709 13:01:53.747518 (+   368us) log.cc:844] Serialized 81 byte log entry
0709 13:01:53.749956 (+  2438us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:53.751126 (+  1170us) write_op.cc:454] Released schema lock
0709 13:01:53.751181 (+    55us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:53.770153 (+ 18972us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:53.770385 (+   232us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":75,"reported_tablets":38,"child_traces":[["op",{"apply.queue_time_us":33907,"apply.run_cpu_time_us":12479,"apply.run_wall_time_us":84973,"cfile_cache_hit":34,"cfile_cache_hit_bytes":37631,"num_ops":8,"prepare.queue_time_us":38730,"prepare.run_cpu_time_us":3885,"prepare.run_wall_time_us":6484,"replication_time_us":59282,"thread_start_us":65697,"threads_started":2}]]}
I20260709 13:01:53.961771  8426 leader_election.cc:290] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:53.943439  8018 raft_consensus.cc:515] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:53.967085  8018 leader_election.cc:290] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:53.967435  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:53.968118  2219 raft_consensus.cc:2468] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 13.
I20260709 13:01:53.973404  1646 leader_election.cc:304] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:53.976217  8084 consensus_queue.cc:1048] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.011s
I20260709 13:01:53.988446  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:53.991915  1680 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac"
dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
mode: GRACEFUL
new_leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:33616
I20260709 13:01:53.992533  1680 raft_consensus.cc:606] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 24 LEADER]: Received request to transfer leadership to TS e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:53.972550  8316 leader_election.cc:290] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:53.998740  8426 raft_consensus.cc:2804] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:53.999256  8426 raft_consensus.cc:493] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:53.999636  8426 raft_consensus.cc:3060] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:54.003358  8487 tablet_copy_client.cc:806] T 7b4d826f7c344b45b7de4b9f69ea958b P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:54.004099  8487 tablet_copy_client.cc:670] T 7b4d826f7c344b45b7de4b9f69ea958b P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Starting download of 1 WAL segments...
W20260709 13:01:54.008176  8494 log.cc:927] Time spent T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.056s	user 0.002s	sys 0.000s
I20260709 13:01:54.016520  1680 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311"
dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
mode: GRACEFUL
new_leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:33616
I20260709 13:01:54.017175  1680 raft_consensus.cc:606] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 14 LEADER]: Received request to transfer leadership to TS e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:54.019223  1430 catalog_manager.cc:5697] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 11 to 12, leader changed from b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) to e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193). New cstate: current_term: 12 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:01:54.023027  1673 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251"
dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
mode: GRACEFUL
new_leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:33616
I20260709 13:01:54.038273  1673 raft_consensus.cc:606] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 13 LEADER]: Received request to transfer leadership to TS e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:54.039872  8487 tablet_copy_client.cc:538] T 7b4d826f7c344b45b7de4b9f69ea958b P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:54.036748  8426 raft_consensus.cc:515] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:54.058315  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:54.059073  1605 raft_consensus.cc:2468] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 13.
W20260709 13:01:54.075274  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 102460us
I20260709 13:01:54.076504  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:54.085160  1681 raft_consensus.cc:2368] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 13. Current term is 14.
I20260709 13:01:54.083498  1430 catalog_manager.cc:5697] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 13 to 16, leader changed from e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) to b96ce9cc496c49d7818fa983a17b062b (127.0.107.196). New cstate: current_term: 16 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:54.089804  1526 raft_consensus.cc:3060] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:01:54.100150  1430 catalog_manager.cc:5697] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 10 to 11, leader changed from ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) to 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194). New cstate: current_term: 11 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:01:54.104353  8430 raft_consensus.cc:2955] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 22 LEADER]: Committing config change with OpId 22.14: config changed from index -1 to 14, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 13:01:54.107888  1571 leader_election.cc:400] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 election: Vote denied by peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217) with higher term. Message: Invalid argument: T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 13. Current term is 14.
I20260709 13:01:54.108273  1571 leader_election.cc:403] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:01:54.109369  7980 raft_consensus.cc:3060] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:54.115675  1529 raft_consensus.cc:2955] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 22 FOLLOWER]: Committing config change with OpId 22.14: config changed from index -1 to 14, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 13:01:54.118011  7980 raft_consensus.cc:2749] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217) with higher term. Message: Invalid argument: T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 13. Current term is 14.
I20260709 13:01:54.119365  1430 catalog_manager.cc:5697] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:54.120617  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:54.121846  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:54.121399  2226 raft_consensus.cc:2393] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 13: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:01:54.129257  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:54.129890  2219 raft_consensus.cc:3060] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:54.138247  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:54.138609  2219 raft_consensus.cc:2468] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 14.
I20260709 13:01:54.149720  1526 raft_consensus.cc:1275] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 26 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 25 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 13:01:54.148733  1572 leader_election.cc:304] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:54.154162  1600 raft_consensus.cc:2468] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 14.
I20260709 13:01:54.117908  8426 leader_election.cc:290] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:54.157267  8498 consensus_queue.cc:1048] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:01:54.217439  1673 raft_consensus.cc:1275] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 26 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 25 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 13:01:54.218046  8487 tablet_bootstrap.cc:492] T 7b4d826f7c344b45b7de4b9f69ea958b P b96ce9cc496c49d7818fa983a17b062b: Bootstrap starting.
I20260709 13:01:54.231547  8497 consensus_queue.cc:1048] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 13:01:54.246892  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 52545.8us
W20260709 13:01:54.250525  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 94032.5us
I20260709 13:01:54.250824  8316 raft_consensus.cc:2749] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:54.249334  8096 raft_consensus.cc:493] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:54.264143  8096 raft_consensus.cc:515] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:54.266327  8096 leader_election.cc:290] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:54.268097  1598 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c0e4d309cca4449096f65b38755e557e"
dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
mode: GRACEFUL
new_leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:47814
I20260709 13:01:54.276329  8262 raft_consensus.cc:993] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90: : Instructing follower e46412b3b0b44f01ad5c33d4cfe3d6b1 to start an election
I20260709 13:01:54.269372  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:54.276809  8262 raft_consensus.cc:1081] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 13 LEADER]: Signalling peer e46412b3b0b44f01ad5c33d4cfe3d6b1 to start an election
I20260709 13:01:54.276484  1598 raft_consensus.cc:606] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Received request to transfer leadership to TS e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:54.277506  1598 raft_consensus.cc:614] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:54.280738  1529 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251"
dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:43010
I20260709 13:01:54.281311  1529 raft_consensus.cc:493] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:54.281649  1529 raft_consensus.cc:3060] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:54.283136  1646 leader_election.cc:304] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:54.283788  1598 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50"
dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
mode: GRACEFUL
new_leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:47814
I20260709 13:01:54.284394  1598 raft_consensus.cc:606] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 22 FOLLOWER]: Received request to transfer leadership to TS e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:54.284754  1598 raft_consensus.cc:614] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 22 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:54.296118  1529 raft_consensus.cc:515] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:54.296868  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:54.297525  2218 raft_consensus.cc:2468] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 16.
I20260709 13:01:54.290460  8430 raft_consensus.cc:2804] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:54.306187  1646 leader_election.cc:304] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:54.306828  1529 leader_election.cc:290] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:54.307015  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: true dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:54.309090  1673 raft_consensus.cc:3055] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:54.310021  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: true dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:54.310698  1598 raft_consensus.cc:3060] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:54.309393  1673 raft_consensus.cc:740] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:54.314043   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:01:54.316170   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:54.312126  8430 raft_consensus.cc:697] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 14 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:54.320147  8430 consensus_queue.cc:237] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:54.321828  1673 consensus_queue.cc:260] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:54.323016  1673 raft_consensus.cc:3060] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:54.332480  1598 raft_consensus.cc:2468] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 14.
I20260709 13:01:54.330433  1605 raft_consensus.cc:2955] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 22 FOLLOWER]: Committing config change with OpId 22.14: config changed from index -1 to 14, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 13:01:54.333735  1497 leader_election.cc:304] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:54.334347  1673 raft_consensus.cc:2468] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 14.
I20260709 13:01:54.349061  8509 raft_consensus.cc:2804] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:54.349648  8509 raft_consensus.cc:697] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:54.350514  8509 consensus_queue.cc:237] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:54.335978  8051 raft_consensus.cc:2804] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:54.377694  8051 raft_consensus.cc:493] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:54.380088  8456 raft_consensus.cc:993] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90: : Instructing follower e46412b3b0b44f01ad5c33d4cfe3d6b1 to start an election
I20260709 13:01:54.380625  8456 raft_consensus.cc:1081] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 14 LEADER]: Signalling peer e46412b3b0b44f01ad5c33d4cfe3d6b1 to start an election
I20260709 13:01:54.380069  8051 raft_consensus.cc:3060] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:54.392391  1529 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311"
dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:43010
I20260709 13:01:54.392993  1529 raft_consensus.cc:493] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:54.393364  1529 raft_consensus.cc:3060] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:54.415407  1529 raft_consensus.cc:515] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:54.450259  8430 raft_consensus.cc:993] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90: : Instructing follower e46412b3b0b44f01ad5c33d4cfe3d6b1 to start an election
I20260709 13:01:54.450847  8430 raft_consensus.cc:1081] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 24 LEADER]: Signalling peer e46412b3b0b44f01ad5c33d4cfe3d6b1 to start an election
I20260709 13:01:54.446811  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:54.452263  1673 raft_consensus.cc:3055] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:54.452551  1526 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac"
dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:43010
I20260709 13:01:54.452626  1673 raft_consensus.cc:740] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:54.453284  1526 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 24 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:54.453682  1526 raft_consensus.cc:3060] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:01:54.456278  1673 consensus_queue.cc:260] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:54.457749  1673 raft_consensus.cc:3060] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:54.460827  1526 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 25 FOLLOWER]: Starting forced leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:54.463069  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:54.463778  1605 raft_consensus.cc:3060] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:54.465204  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: true dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:54.465816  1602 raft_consensus.cc:3060] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:01:54.467311  2218 raft_consensus.cc:1275] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:01:54.462011  8051 raft_consensus.cc:515] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:54.468464  1681 raft_consensus.cc:1240] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Rejecting Update request from peer e46412b3b0b44f01ad5c33d4cfe3d6b1 for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:54.468734  8501 consensus_queue.cc:1048] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:01:54.444638  1529 leader_election.cc:290] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 15 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:54.470046  8465 consensus_queue.cc:1059] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:01:54.470935  8465 raft_consensus.cc:3055] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:01:54.471277  8465 raft_consensus.cc:740] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:54.472100  8465 consensus_queue.cc:260] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:54.474586  8465 raft_consensus.cc:3060] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:54.475478  1602 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 25.
I20260709 13:01:54.478442  8516 ts_tablet_manager.cc:933] T 8ea5da45c6d2479383e6af85e0a394b5 P b96ce9cc496c49d7818fa983a17b062b: Initiating tablet copy from peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:54.484679  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:54.487481  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: true dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:54.488166  1681 raft_consensus.cc:3055] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:01:54.488461  1681 raft_consensus.cc:740] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:54.488588  1673 raft_consensus.cc:2468] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 15.
I20260709 13:01:54.490337  1526 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 25 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:54.492003  2218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: true dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:54.492604  2218 raft_consensus.cc:3060] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:01:54.492686  1605 raft_consensus.cc:2468] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 15.
I20260709 13:01:54.492231  1496 leader_election.cc:304] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:54.489262  1681 consensus_queue.cc:260] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:54.496831  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:54.497767  1681 raft_consensus.cc:3060] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:01:54.499253  8501 raft_consensus.cc:2804] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:54.493893  8051 leader_election.cc:290] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 17 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:54.509794  2218 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 25.
I20260709 13:01:54.513115  1497 leader_election.cc:304] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:54.514765  8084 raft_consensus.cc:2804] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:01:54.515354  8084 raft_consensus.cc:697] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 25 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:54.516362  8084 consensus_queue.cc:237] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 25, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:54.521495  8516 tablet_copy_client.cc:323] T 8ea5da45c6d2479383e6af85e0a394b5 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:44217
I20260709 13:01:54.523233  1690 tablet_copy_service.cc:140] P ddf11fc190dd4b898773379c6b129d90: Received BeginTabletCopySession request for tablet 8ea5da45c6d2479383e6af85e0a394b5 from peer b96ce9cc496c49d7818fa983a17b062b ({username='slave'} at 127.0.0.1:50664)
I20260709 13:01:54.523784  1690 tablet_copy_service.cc:161] P ddf11fc190dd4b898773379c6b129d90: Beginning new tablet copy session on tablet 8ea5da45c6d2479383e6af85e0a394b5 from peer b96ce9cc496c49d7818fa983a17b062b at {username='slave'} at 127.0.0.1:50664: session id = b96ce9cc496c49d7818fa983a17b062b-8ea5da45c6d2479383e6af85e0a394b5
I20260709 13:01:54.510222  8501 raft_consensus.cc:697] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:54.528885  8501 consensus_queue.cc:237] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:54.535393  1528 raft_consensus.cc:2410] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 for term 17 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 13:01:54.548826  1644 leader_election.cc:304] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:54.554849  8456 raft_consensus.cc:2749] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:01:54.556774  1681 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 25.
I20260709 13:01:54.558688  1690 tablet_copy_source_session.cc:215] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:54.573549  8516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ea5da45c6d2479383e6af85e0a394b5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:01:54.576953  1430 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50074 (request call id 236) took 32455 ms (client timeout 15000 ms). Trace:
W20260709 13:01:54.577433  1430 rpcz_store.cc:269] 0709 13:01:22.121231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:22.126281 (+  5050us) service_pool.cc:224] Handling call
0709 13:01:54.576859 (+32450578us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:54.274489 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:54.275068 (+   579us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:54.275101 (+    33us) write_op.cc:435] Acquired schema lock
0709 13:01:54.275120 (+    19us) tablet.cc:662] Decoding operations
0709 13:01:54.279586 (+  4466us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:54.279637 (+    51us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:54.279663 (+    26us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:01:54.280036 (+   373us) tablet.cc:701] Row locks acquired
0709 13:01:54.280061 (+    25us) write_op.cc:260] PREPARE: finished
0709 13:01:54.280215 (+   154us) write_op.cc:270] Start()
0709 13:01:54.280322 (+   107us) write_op.cc:276] Timestamp: P: 1783602114280161 usec, L: 0
0709 13:01:54.280348 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:01:54.281003 (+   655us) log.cc:844] Serialized 1686 byte log entry
0709 13:01:54.360115 (+ 79112us) op_driver.cc:464] REPLICATION: finished
0709 13:01:54.482947 (+122832us) write_op.cc:301] APPLY: starting
0709 13:01:54.483032 (+    85us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:54.522842 (+ 39810us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:54.522959 (+   117us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:54.526130 (+  3171us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:54.526369 (+   239us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=8,mrs_lookups=0
0709 13:01:54.526420 (+    51us) write_op.cc:312] APPLY: finished
0709 13:01:54.526710 (+   290us) log.cc:844] Serialized 49 byte log entry
0709 13:01:54.526947 (+   237us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:54.527064 (+   117us) write_op.cc:454] Released schema lock
0709 13:01:54.527111 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:54.527569 (+   458us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:54.527598 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":38,"child_traces":[["op",{"apply.queue_time_us":122562,"apply.run_cpu_time_us":7820,"apply.run_wall_time_us":44573,"cfile_cache_hit":18,"cfile_cache_hit_bytes":20879,"num_ops":4,"prepare.queue_time_us":83056,"prepare.run_cpu_time_us":3050,"prepare.run_wall_time_us":13547,"replication_time_us":79610,"thread_start_us":112978,"threads_started":2}]]}
I20260709 13:01:54.623544  8456 raft_consensus.cc:493] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:54.624197  8456 raft_consensus.cc:515] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:54.626439  8456 leader_election.cc:290] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:54.629437  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:54.632297  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:54.632973  1526 raft_consensus.cc:2468] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 18.
I20260709 13:01:54.636333  1644 leader_election.cc:304] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:01:54.639989  8456 raft_consensus.cc:2804] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:01:54.640446  8456 raft_consensus.cc:493] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:54.640829  8456 raft_consensus.cc:3060] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:54.654579  8456 raft_consensus.cc:515] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:54.657866  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:01:54.658490  1529 raft_consensus.cc:3060] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:54.663425  8495 raft_consensus.cc:493] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:54.664019  8495 raft_consensus.cc:515] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:54.664425  1529 raft_consensus.cc:2468] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 19.
I20260709 13:01:54.666179  1644 leader_election.cc:304] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:54.666934  8495 leader_election.cc:290] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:54.667707  8262 raft_consensus.cc:2804] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:01:54.668327  8262 raft_consensus.cc:697] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 19 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:54.668494  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:54.668892  8456 leader_election.cc:290] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 19 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:54.669474  1529 raft_consensus.cc:2368] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 18. Current term is 19.
I20260709 13:01:54.669263  8262 consensus_queue.cc:237] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:54.670989  1570 leader_election.cc:400] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 18 pre-election: Vote denied by peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931) with higher term. Message: Invalid argument: T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 18. Current term is 19.
I20260709 13:01:54.671391  1570 leader_election.cc:403] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:54.672030  8495 raft_consensus.cc:3060] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:01:54.672039  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:54.673657  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:54.734779  8495 raft_consensus.cc:2749] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931) with higher term. Message: Invalid argument: T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 for earlier term 18. Current term is 19.
I20260709 13:01:54.782428  1598 raft_consensus.cc:2468] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 19.
I20260709 13:01:54.802525  1422 catalog_manager.cc:5697] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:01:54.832760  1422 catalog_manager.cc:5697] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 reported cstate change: term changed from 10 to 12, leader changed from b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 12 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:54.846155  1673 raft_consensus.cc:1275] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:01:54.848111  8084 consensus_queue.cc:1048] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:01:54.895584  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 95402.2us
I20260709 13:01:54.900862  1422 catalog_manager.cc:5697] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 reported cstate change: term changed from 12 to 19. New cstate: current_term: 19 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } }
I20260709 13:01:54.908897  1602 raft_consensus.cc:1275] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:01:54.913995  1602 raft_consensus.cc:1275] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:01:54.916709  8456 consensus_queue.cc:1048] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:54.916724  8501 consensus_queue.cc:1048] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:01:54.959110  8516 tablet_copy_client.cc:806] T 8ea5da45c6d2479383e6af85e0a394b5 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:54.960119  8516 tablet_copy_client.cc:670] T 8ea5da45c6d2479383e6af85e0a394b5 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:54.969178  2218 raft_consensus.cc:1275] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:01:54.972146  2219 raft_consensus.cc:1275] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 25 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 13:01:55.074205  8487 tablet_bootstrap.cc:492] T 7b4d826f7c344b45b7de4b9f69ea958b P b96ce9cc496c49d7818fa983a17b062b: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=1 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:55.075567  8487 tablet_bootstrap.cc:492] T 7b4d826f7c344b45b7de4b9f69ea958b P b96ce9cc496c49d7818fa983a17b062b: Bootstrap complete.
I20260709 13:01:55.088335  8487 ts_tablet_manager.cc:1403] T 7b4d826f7c344b45b7de4b9f69ea958b P b96ce9cc496c49d7818fa983a17b062b: Time spent bootstrapping tablet: real 0.871s	user 0.050s	sys 0.031s
I20260709 13:01:55.091923  8487 raft_consensus.cc:359] T 7b4d826f7c344b45b7de4b9f69ea958b P b96ce9cc496c49d7818fa983a17b062b [term 18 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 13:01:55.092818  8487 raft_consensus.cc:740] T 7b4d826f7c344b45b7de4b9f69ea958b P b96ce9cc496c49d7818fa983a17b062b [term 18 LEARNER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Initialized, Role: LEARNER
I20260709 13:01:55.093525  8487 consensus_queue.cc:260] T 7b4d826f7c344b45b7de4b9f69ea958b P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 13:01:55.095633  8487 ts_tablet_manager.cc:1434] T 7b4d826f7c344b45b7de4b9f69ea958b P b96ce9cc496c49d7818fa983a17b062b: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260709 13:01:55.623724  1422 catalog_manager.cc:5697] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 reported cstate change: term changed from 11 to 13, leader changed from 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 13 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:55.626297  1598 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.686s	user 0.006s	sys 0.031s
W20260709 13:01:55.626739  1598 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.686s	user 0.007s	sys 0.031s
I20260709 13:01:55.680150   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:01:55.687621  1680 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.740s	user 0.007s	sys 0.008s
W20260709 13:01:55.689239  1680 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.742s	user 0.008s	sys 0.009s
W20260709 13:01:55.852792  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 884190us
I20260709 13:01:55.912050  1598 raft_consensus.cc:1275] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:01:55.923120  8545 consensus_queue.cc:1048] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:55.924674  1602 raft_consensus.cc:1275] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 25 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 13:01:55.927573  8556 raft_consensus.cc:493] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:55.928259  8556 raft_consensus.cc:515] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:55.956377  1680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49178 (request call id 2754) took 1010 ms. Trace:
I20260709 13:01:55.971361  8556 leader_election.cc:290] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:55.948247  8551 consensus_queue.cc:1048] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.029s
I20260709 13:01:55.977977  1690 tablet_copy_service.cc:342] P ddf11fc190dd4b898773379c6b129d90: Request end of tablet copy session b96ce9cc496c49d7818fa983a17b062b-7b4d826f7c344b45b7de4b9f69ea958b received from {username='slave'} at 127.0.0.1:50664
I20260709 13:01:55.978580  1690 tablet_copy_service.cc:434] P ddf11fc190dd4b898773379c6b129d90: ending tablet copy session b96ce9cc496c49d7818fa983a17b062b-7b4d826f7c344b45b7de4b9f69ea958b on tablet 7b4d826f7c344b45b7de4b9f69ea958b with peer b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:55.980911  8516 tablet_copy_client.cc:538] T 8ea5da45c6d2479383e6af85e0a394b5 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:55.988655  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:55.990396  1681 raft_consensus.cc:1275] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 25 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 13:01:55.992653  1681 raft_consensus.cc:1275] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:01:55.956931  1680 rpcz_store.cc:276] 0709 13:01:54.946378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:54.946534 (+   156us) service_pool.cc:224] Handling call
0709 13:01:54.946832 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:54.947021 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:01:55.689690 (+742669us) log.cc:844] Serialized 14 byte log entry
0709 13:01:55.955652 (+265962us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:55.955707 (+    55us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:01:55.956124 (+   417us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:55.956201 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:55.956319 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":190946,"prepare.queue_time_us":116481,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":224607,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":89,"thread_start_us":816970,"threads_started":2}
I20260709 13:01:55.997556  1603 raft_consensus.cc:1275] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:01:56.003249  1526 raft_consensus.cc:1275] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:01:56.075762  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ea41c88222b469fb11229faef735050" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:55.997720  8541 consensus_queue.cc:1048] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.084s
I20260709 13:01:56.097483  8388 raft_consensus.cc:493] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.068269  8096 raft_consensus.cc:493] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:56.016881  8561 consensus_queue.cc:1048] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.091s
I20260709 13:01:56.113071  2222 raft_consensus.cc:1217] T 7b4d826f7c344b45b7de4b9f69ea958b P b96ce9cc496c49d7818fa983a17b062b [term 18 LEARNER]: Deduplicated request from leader. Original: 18.11->[18.12-18.12]   Dedup: 18.12->[]
W20260709 13:01:56.115449  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 49536.1us
I20260709 13:01:56.113309  8555 raft_consensus.cc:493] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:56.104907  8388 raft_consensus.cc:515] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:56.119411  8555 raft_consensus.cc:515] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:56.121404  8388 leader_election.cc:290] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:56.121591  8555 leader_election.cc:290] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:56.111685  8564 raft_consensus.cc:493] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:56.125000  8564 raft_consensus.cc:515] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:56.112659  8556 raft_consensus.cc:493] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:56.127241  8564 leader_election.cc:290] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:56.127583  8556 raft_consensus.cc:515] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:01:56.133162  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 138385us
I20260709 13:01:56.094137  8456 consensus_queue.cc:1048] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 13:01:56.143342  8541 raft_consensus.cc:493] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.143926  8541 raft_consensus.cc:515] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:56.111663  8563 raft_consensus.cc:493] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:01:56.145144  8563 raft_consensus.cc:515] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:56.147274  8563 leader_election.cc:290] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:56.147720  8541 leader_election.cc:290] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:56.148638  8516 tablet_bootstrap.cc:492] T 8ea5da45c6d2479383e6af85e0a394b5 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap starting.
I20260709 13:01:56.112850  8096 raft_consensus.cc:515] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:56.166153  8096 leader_election.cc:290] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:56.166877  8556 leader_election.cc:290] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:56.185696  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:56.186439  1681 raft_consensus.cc:2468] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 17.
I20260709 13:01:56.194566  1496 leader_election.cc:304] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:56.210590  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:56.211424  2221 raft_consensus.cc:2468] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 16.
I20260709 13:01:56.218493  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:01:56.234916  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 226880us
I20260709 13:01:56.167035  8560 consensus_queue.cc:1048] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.055s
I20260709 13:01:56.237881  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:56.239013  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:56.180706  8541 consensus_queue.cc:1048] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.045s
I20260709 13:01:56.243673  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:56.260061  1673 raft_consensus.cc:2393] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 17: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:01:56.180922  8539 consensus_queue.cc:1048] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 13:01:56.245317  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:56.224120  8544 raft_consensus.cc:493] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:56.287359  8544 raft_consensus.cc:515] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:56.240733  8549 raft_consensus.cc:2804] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:56.310132  8559 raft_consensus.cc:493] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:56.310804  8559 raft_consensus.cc:515] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:56.313051  8559 leader_election.cc:290] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:56.318960  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:01:56.323474  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 153473us
I20260709 13:01:56.327963  2192 leader_election.cc:304] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:56.336984  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0590ffd096d4e378ab66c1795ff5cce" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:56.301553  8549 raft_consensus.cc:493] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:56.339820  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:56.340898  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53340cc35954204b06e3743bec8adbf" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:56.341979  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:01:56.340478  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 146631us
I20260709 13:01:56.346347  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:56.345216  1646 leader_election.cc:304] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:56.335523  8524 raft_consensus.cc:2749] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:01:56.352385  2192 leader_election.cc:304] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:56.344159  8549 raft_consensus.cc:3060] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:01:56.353298  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 90147.2us
I20260709 13:01:56.360114  8575 raft_consensus.cc:2749] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:01:56.373980  1706 heartbeater.cc:646] Failed to heartbeat to 127.0.107.254:40423 (5 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.0.107.254:40423 timed out after 15.000s (SENT)
I20260709 13:01:56.350977  8096 raft_consensus.cc:2749] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:56.384575  1644 leader_election.cc:304] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:56.388863  1644 leader_election.cc:304] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:56.393682  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:56.397221  8508 raft_consensus.cc:2749] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:01:56.419695  8544 leader_election.cc:290] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:56.424000  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:56.425441  8559 raft_consensus.cc:493] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
W20260709 13:01:56.411718  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 54627.7us
I20260709 13:01:56.426069  8559 raft_consensus.cc:515] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:56.435290  1497 leader_election.cc:304] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:56.447088  8544 raft_consensus.cc:2749] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:56.475943  8559 leader_election.cc:290] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:56.477562  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:56.464658  8569 raft_consensus.cc:493] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:56.470245  8549 raft_consensus.cc:515] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:56.479584  8569 raft_consensus.cc:515] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:56.481685  8569 leader_election.cc:290] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:01:56.482106  8549 leader_election.cc:290] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 18 election: Requested vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:56.487094  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:56.489933  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:56.490720  1672 raft_consensus.cc:3060] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:56.493516  8262 raft_consensus.cc:2749] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:56.491717  8559 raft_consensus.cc:493] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.521518  8559 raft_consensus.cc:515] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:56.523819  8559 leader_election.cc:290] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:56.531888  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:56.544822  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:56.545435  2219 raft_consensus.cc:3060] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:01:56.571410  1672 raft_consensus.cc:2468] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 18.
I20260709 13:01:56.560424  2219 raft_consensus.cc:2468] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 18.
W20260709 13:01:56.578853  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 226555us
W20260709 13:01:56.583439  2248 debug-util.cc:398] Leaking SignalData structure 0x7b0800305aa0 after lost signal to thread 434
W20260709 13:01:56.584630  2248 debug-util.cc:398] Leaking SignalData structure 0x7b08003058a0 after lost signal to thread 1464
W20260709 13:01:56.585963  2248 debug-util.cc:398] Leaking SignalData structure 0x7b0800301cc0 after lost signal to thread 1556
W20260709 13:01:56.586325  2248 debug-util.cc:398] Leaking SignalData structure 0x7b0800301ca0 after lost signal to thread 1557
W20260709 13:01:56.587432  2248 debug-util.cc:398] Leaking SignalData structure 0x7b0800301320 after lost signal to thread 1631
W20260709 13:01:56.587708  2248 debug-util.cc:398] Leaking SignalData structure 0x7b08003012e0 after lost signal to thread 1632
W20260709 13:01:56.588781  2248 debug-util.cc:398] Leaking SignalData structure 0x7b08003f9260 after lost signal to thread 1705
W20260709 13:01:56.589998  2248 debug-util.cc:398] Leaking SignalData structure 0x7b080035f7e0 after lost signal to thread 2251
W20260709 13:01:56.590267  2248 debug-util.cc:398] Leaking SignalData structure 0x7b08001cf7a0 after lost signal to thread 2252
I20260709 13:01:56.585773  1496 leader_election.cc:304] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:56.595293  8543 raft_consensus.cc:2804] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:01:56.596043  8543 raft_consensus.cc:697] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:56.596872  8543 consensus_queue.cc:237] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:56.598484  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819fbeffe41b4610a05fcaac38e161b6" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:56.602524  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4190d217954f4f798b3a610501115290" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:01:56.605466  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 242046us
I20260709 13:01:56.616855  8544 raft_consensus.cc:493] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.617449  8544 raft_consensus.cc:515] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:01:56.619663  8544 leader_election.cc:290] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:56.613083  8535 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:01:56.620990  8535 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:56.622692  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:56.608033  8584 raft_consensus.cc:493] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:01:56.624284  8584 raft_consensus.cc:515] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:56.626554  8584 leader_election.cc:290] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:56.633992  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:56.634912  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:56.640766  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cff69bd4394da195321efd78d5a703" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:56.641878  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
W20260709 13:01:56.635550  1422 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46274 (request call id 364) took 15301 ms (client timeout 15000 ms). Trace:
W20260709 13:01:56.647387  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 59304us
I20260709 13:01:56.666750  2192 leader_election.cc:304] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:56.668028  2192 leader_election.cc:304] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:56.678838  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:56.681556  2190 leader_election.cc:304] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:56.681779  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:56.695348  8535 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:56.702596  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:01:56.677134  8555 raft_consensus.cc:2749] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:56.709671  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:01:56.716476  8550 raft_consensus.cc:2749] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:56.716830  2190 leader_election.cc:304] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:01:56.645057  1422 rpcz_store.cc:269] 0709 13:01:41.334078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:41.337525 (+  3447us) service_pool.cc:224] Handling call
0709 13:01:56.632148 (+15294623us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:55.743272 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:55.743850 (+   578us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:55.743894 (+    44us) write_op.cc:435] Acquired schema lock
0709 13:01:55.743908 (+    14us) tablet.cc:662] Decoding operations
0709 13:01:55.744538 (+   630us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:55.744591 (+    53us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:55.744634 (+    43us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:01:55.744998 (+   364us) tablet.cc:701] Row locks acquired
0709 13:01:55.745012 (+    14us) write_op.cc:260] PREPARE: finished
0709 13:01:55.745163 (+   151us) write_op.cc:270] Start()
0709 13:01:55.745281 (+   118us) write_op.cc:276] Timestamp: P: 1783602115745112 usec, L: 0
0709 13:01:55.745299 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 13:01:55.758292 (+ 12993us) log.cc:844] Serialized 1691 byte log entry
0709 13:01:55.926252 (+167960us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b5400411254. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185aee28 00007f6a1bfe9581 00007f6a1bfe8d58 00007f6a1bfed9f1 00007f6a1bfed9a9 00007f6a1bfed939 00007f6a1bfed901 00007f6a1bfecb2d 000000000038f354 000000000038f199
0709 13:01:55.972719 (+ 46467us) op_driver.cc:464] REPLICATION: finished
0709 13:01:56.148174 (+175455us) spinlock_profiling.cc:243] Waited 1.48 ms on lock 0x7b5400411254. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851c571 00007f6a185b032a 00007f6a18535f14 00007f6a18535ec3 00007f6a18535e38 00007f6a18535df3 00007f6a185350dc 00007f6a1855ee16 00007f6a18546cbb 00007f6a1853139d 00007f6a18534d75
0709 13:01:56.162727 (+ 14553us) write_op.cc:301] APPLY: starting
0709 13:01:56.162856 (+   129us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:56.165860 (+  3004us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:56.165889 (+    29us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:56.415491 (+249602us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:56.415711 (+   220us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=8,mrs_lookups=0
0709 13:01:56.415767 (+    56us) write_op.cc:312] APPLY: finished
0709 13:01:56.418696 (+  2929us) log.cc:844] Serialized 49 byte log entry
0709 13:01:56.418875 (+   179us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:56.418973 (+    98us) write_op.cc:454] Released schema lock
0709 13:01:56.419019 (+    46us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:56.419466 (+   447us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:56.419499 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":16350,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":162161,"apply.run_cpu_time_us":9082,"apply.run_wall_time_us":282939,"cfile_cache_hit":18,"cfile_cache_hit_bytes":20879,"num_ops":4,"prepare.queue_time_us":113195,"prepare.run_cpu_time_us":14932,"prepare.run_wall_time_us":183169,"raft.queue_time_us":201545,"raft.run_cpu_time_us":8658,"raft.run_wall_time_us":177329,"replication_time_us":227240,"spinlock_wait_cycles":31734912,"thread_start_us":191800,"threads_started":4,"wal-append.queue_time_us":8979}]]}
I20260709 13:01:56.749249  2190 leader_election.cc:304] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:56.760051  8559 raft_consensus.cc:2749] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:56.772208  1644 leader_election.cc:304] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:56.775041  1572 leader_election.cc:304] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:56.777592  8534 raft_consensus.cc:2749] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:01:56.779639  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:01:56.785802  1497 leader_election.cc:304] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:01:56.787321  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" is_pre_election: true
I20260709 13:01:56.750909  8556 raft_consensus.cc:2749] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:01:56.808636  8598 log.cc:927] Time spent T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:01:56.823164  8096 raft_consensus.cc:2749] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:01:56.826782  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 64654.8us
I20260709 13:01:56.827575  1646 leader_election.cc:304] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:56.828295  8563 raft_consensus.cc:2749] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:01:56.851770  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 47594.4us
W20260709 13:01:56.846936  8587 log.cc:927] Time spent T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:01:56.854893  8537 raft_consensus.cc:2749] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:01:56.918408  8600 log.cc:927] Time spent T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:01:56.998413  8456 raft_consensus.cc:1064] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90: attempting to promote NON_VOTER b96ce9cc496c49d7818fa983a17b062b to VOTER
I20260709 13:01:57.000581  8456 consensus_queue.cc:237] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 10, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:57.009423  8552 raft_consensus.cc:2749] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:01:57.017428  1428 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46260 (request call id 368) took 40591 ms (client timeout 15000 ms). Trace:
W20260709 13:01:57.017874  1428 rpcz_store.cc:269] 0709 13:01:16.426044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:16.428296 (+  2252us) service_pool.cc:224] Handling call
0709 13:01:57.017228 (+40588932us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6,"reported_tablets":46,"spinlock_wait_cycles":2304}
I20260709 13:01:57.025929   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:57.029865  1672 raft_consensus.cc:1275] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
W20260709 13:01:57.031057  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 61431.1us
W20260709 13:01:57.031191  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 54600.2us
I20260709 13:01:57.040786  8551 consensus_queue.cc:1048] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:01:57.050047  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 78004.6us
I20260709 13:01:57.084956  2219 raft_consensus.cc:1275] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:01:57.089407  8551 consensus_queue.cc:1048] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:01:57.112516  2218 raft_consensus.cc:1275] T 7b4d826f7c344b45b7de4b9f69ea958b P b96ce9cc496c49d7818fa983a17b062b [term 18 LEARNER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:01:57.119206  8096 consensus_queue.cc:1048] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:01:57.124236  1605 raft_consensus.cc:1275] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:01:57.124044  1532 raft_consensus.cc:1275] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:01:57.132361  1429 catalog_manager.cc:5697] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 13 to 17. New cstate: current_term: 17 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:01:57.126698  8460 consensus_queue.cc:1048] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.011s
I20260709 13:01:57.138006  8562 consensus_queue.cc:1048] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:01:57.133879  1429 catalog_manager.cc:5697] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 11 to 14. New cstate: current_term: 14 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:57.143693  1429 catalog_manager.cc:5697] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 17 to 21, leader changed from 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) to e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193). New cstate: current_term: 21 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:57.145259  1429 catalog_manager.cc:5697] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 11 to 14, leader changed from b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) to e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193). New cstate: current_term: 14 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:57.155874  8516 tablet_bootstrap.cc:492] T 8ea5da45c6d2479383e6af85e0a394b5 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap replayed 1/1 log segments. Stats: ops{read=16 overwritten=2 applied=14 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:57.156903  8516 tablet_bootstrap.cc:492] T 8ea5da45c6d2479383e6af85e0a394b5 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap complete.
I20260709 13:01:57.158208  8516 ts_tablet_manager.cc:1403] T 8ea5da45c6d2479383e6af85e0a394b5 P b96ce9cc496c49d7818fa983a17b062b: Time spent bootstrapping tablet: real 1.010s	user 0.036s	sys 0.028s
I20260709 13:01:57.161720  8516 raft_consensus.cc:359] T 8ea5da45c6d2479383e6af85e0a394b5 P b96ce9cc496c49d7818fa983a17b062b [term 22 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 13:01:57.162725  8516 raft_consensus.cc:740] T 8ea5da45c6d2479383e6af85e0a394b5 P b96ce9cc496c49d7818fa983a17b062b [term 22 LEARNER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Initialized, Role: LEARNER
I20260709 13:01:57.163527  8516 consensus_queue.cc:260] T 8ea5da45c6d2479383e6af85e0a394b5 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 13:01:57.147930  1429 catalog_manager.cc:5697] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } }
I20260709 13:01:57.194243  1429 catalog_manager.cc:5697] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 16 to 19, leader changed from ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) to 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194). New cstate: current_term: 19 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } }
I20260709 13:01:57.195734  1429 catalog_manager.cc:5697] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 18 to 22, leader changed from 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 22 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } }
I20260709 13:01:57.203014  1429 catalog_manager.cc:5697] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 15 to 17, leader changed from ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) to b96ce9cc496c49d7818fa983a17b062b (127.0.107.196). New cstate: current_term: 17 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:01:57.205034  1429 catalog_manager.cc:5697] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 13 to 19, leader changed from ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) to e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193). New cstate: current_term: 19 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:57.207930  1429 catalog_manager.cc:5697] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 13 to 14, leader changed from b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 14 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:01:57.209365  1429 catalog_manager.cc:5697] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:01:57.211074  1429 catalog_manager.cc:5697] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 12 to 18. New cstate: current_term: 18 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:57.213341  1429 catalog_manager.cc:5697] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 10 to 11, leader changed from b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 11 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:01:57.214888  1429 catalog_manager.cc:5697] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 18 to 21, leader changed from ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) to e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193). New cstate: current_term: 21 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:57.216770  1429 catalog_manager.cc:5697] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:01:57.237707  8516 ts_tablet_manager.cc:1434] T 8ea5da45c6d2479383e6af85e0a394b5 P b96ce9cc496c49d7818fa983a17b062b: Time spent starting tablet: real 0.079s	user 0.007s	sys 0.000s
I20260709 13:01:57.246272  1690 tablet_copy_service.cc:342] P ddf11fc190dd4b898773379c6b129d90: Request end of tablet copy session b96ce9cc496c49d7818fa983a17b062b-8ea5da45c6d2479383e6af85e0a394b5 received from {username='slave'} at 127.0.0.1:50664
I20260709 13:01:57.246826  1690 tablet_copy_service.cc:434] P ddf11fc190dd4b898773379c6b129d90: ending tablet copy session b96ce9cc496c49d7818fa983a17b062b-8ea5da45c6d2479383e6af85e0a394b5 on tablet 8ea5da45c6d2479383e6af85e0a394b5 with peer b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:57.257264  1532 raft_consensus.cc:2955] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 12 to 13, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:01:57.245757  8562 raft_consensus.cc:2955] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 18 LEADER]: Committing config change with OpId 18.13: config changed from index 12 to 13, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:01:57.218318  1429 catalog_manager.cc:5697] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 16 to 18, leader changed from 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) to b96ce9cc496c49d7818fa983a17b062b (127.0.107.196). New cstate: current_term: 18 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:01:57.264700  1429 catalog_manager.cc:5697] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 16 to 20. New cstate: current_term: 20 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:01:57.266492  1429 catalog_manager.cc:5697] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 9 to 11, leader changed from e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 11 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:01:57.268455  1429 catalog_manager.cc:5697] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 10 to 16, leader changed from e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 16 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } }
I20260709 13:01:57.270112  1429 catalog_manager.cc:5697] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 8 to 15, leader changed from e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) to b96ce9cc496c49d7818fa983a17b062b (127.0.107.196). New cstate: current_term: 15 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:01:57.279297  1429 catalog_manager.cc:5697] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 16 to 20. New cstate: current_term: 20 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:01:57.280666  1429 catalog_manager.cc:5697] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } }
I20260709 13:01:57.281864  1429 catalog_manager.cc:5697] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:01:57.283285  1429 catalog_manager.cc:5697] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 13 to 21, leader changed from ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) to 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194). New cstate: current_term: 21 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } }
I20260709 13:01:57.284647  1429 catalog_manager.cc:5697] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:01:57.286073  1429 catalog_manager.cc:5697] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:01:57.287578  1429 catalog_manager.cc:5697] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } }
I20260709 13:01:57.288910  1429 catalog_manager.cc:5697] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 15 to 17, leader changed from 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) to e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193). New cstate: current_term: 17 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:57.290428  1429 catalog_manager.cc:5697] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:01:57.293573  1605 raft_consensus.cc:2955] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 12 to 13, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:01:57.324434  1672 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac"
dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
mode: GRACEFUL
new_leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:33616
I20260709 13:01:57.325083  1672 raft_consensus.cc:606] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 25 FOLLOWER]: Received request to transfer leadership to TS e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:57.325446  1672 raft_consensus.cc:614] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 25 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:57.328279  2219 raft_consensus.cc:2955] T 7b4d826f7c344b45b7de4b9f69ea958b P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 12 to 13, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:01:57.337500  1672 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0b050d298db6466f856d263a342e3c51"
dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
mode: GRACEFUL
new_leader_uuid: "b96ce9cc496c49d7818fa983a17b062b"
 from {username='slave'} at 127.0.0.1:33616
I20260709 13:01:57.338148  1672 raft_consensus.cc:606] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 17 LEADER]: Received request to transfer leadership to TS b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:57.341176  1603 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0"
dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
mode: GRACEFUL
new_leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:47814
I20260709 13:01:57.341758  1603 raft_consensus.cc:606] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 20 LEADER]: Received request to transfer leadership to TS e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:57.345654  1672 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b"
dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
mode: GRACEFUL
new_leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:33616
I20260709 13:01:57.346256  1672 raft_consensus.cc:606] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 18 LEADER]: Received request to transfer leadership to TS e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:57.355311  1603 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e"
dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
mode: GRACEFUL
new_leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:47814
I20260709 13:01:57.356024  1603 raft_consensus.cc:606] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Received request to transfer leadership to TS e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:57.356444  1603 raft_consensus.cc:614] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:57.372761   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:01:57.373980   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:57.453648  8562 raft_consensus.cc:993] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90: : Instructing follower b96ce9cc496c49d7818fa983a17b062b to start an election
I20260709 13:01:57.454216  8562 raft_consensus.cc:1081] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 17 LEADER]: Signalling peer b96ce9cc496c49d7818fa983a17b062b to start an election
I20260709 13:01:57.466125  2219 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0b050d298db6466f856d263a342e3c51"
dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
 from {username='slave'} at 127.0.0.1:50326
I20260709 13:01:57.466786  2219 raft_consensus.cc:493] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:57.467180  2219 raft_consensus.cc:3060] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:57.480312  2219 raft_consensus.cc:515] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:57.498165  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: true dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:57.498842  1602 raft_consensus.cc:3060] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:57.498301  2219 leader_election.cc:290] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 18 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:01:57.499869  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b050d298db6466f856d263a342e3c51" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: true dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:57.501744  1672 raft_consensus.cc:3055] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:01:57.501979  1672 raft_consensus.cc:740] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:57.502637  1672 consensus_queue.cc:260] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:57.508121  1672 raft_consensus.cc:3060] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:57.521870  1672 raft_consensus.cc:2468] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 18.
I20260709 13:01:57.522933  2191 leader_election.cc:304] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:01:57.526996  1602 raft_consensus.cc:2468] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 18.
I20260709 13:01:57.528879  8552 raft_consensus.cc:2804] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:01:57.540283  8552 raft_consensus.cc:697] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 18 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:01:57.541215  8552 consensus_queue.cc:237] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:57.548520  2221 raft_consensus.cc:1217] T 8ea5da45c6d2479383e6af85e0a394b5 P b96ce9cc496c49d7818fa983a17b062b [term 22 LEARNER]: Deduplicated request from leader. Original: 22.13->[22.14-22.14]   Dedup: 22.14->[]
I20260709 13:01:57.607033  8580 raft_consensus.cc:993] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642: : Instructing follower e46412b3b0b44f01ad5c33d4cfe3d6b1 to start an election
I20260709 13:01:57.607533  8580 raft_consensus.cc:1081] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 20 LEADER]: Signalling peer e46412b3b0b44f01ad5c33d4cfe3d6b1 to start an election
I20260709 13:01:57.613564  1532 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0"
dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:43008
I20260709 13:01:57.614156  1532 raft_consensus.cc:493] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:57.614518  1532 raft_consensus.cc:3060] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:57.627213  1532 raft_consensus.cc:515] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:57.656082  1532 leader_election.cc:290] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 21 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:57.661128  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: true dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:57.661778  2219 raft_consensus.cc:3060] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:57.660451  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: true dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:57.663719  1603 raft_consensus.cc:3055] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:01:57.664037  1603 raft_consensus.cc:740] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:01:57.664867  1603 consensus_queue.cc:260] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:57.666183  1603 raft_consensus.cc:3060] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:57.668666  2219 raft_consensus.cc:2468] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 21.
I20260709 13:01:57.669989  1497 leader_election.cc:304] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:57.670761  8612 raft_consensus.cc:2804] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:01:57.671267  8612 raft_consensus.cc:697] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 21 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:57.672149  8612 consensus_queue.cc:237] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:57.697777  8460 raft_consensus.cc:993] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90: : Instructing follower e46412b3b0b44f01ad5c33d4cfe3d6b1 to start an election
I20260709 13:01:57.698262  8460 raft_consensus.cc:1081] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 18 LEADER]: Signalling peer e46412b3b0b44f01ad5c33d4cfe3d6b1 to start an election
I20260709 13:01:57.700101  1529 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b"
dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:43010
I20260709 13:01:57.700692  1529 raft_consensus.cc:493] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:57.701061  1529 raft_consensus.cc:3060] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:57.711007  1529 raft_consensus.cc:515] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:57.713798  1603 raft_consensus.cc:2468] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 21.
I20260709 13:01:57.742938  1529 leader_election.cc:290] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 19 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:01:57.743098  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: true dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:01:57.755124  1673 raft_consensus.cc:3055] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:01:57.755493  1673 raft_consensus.cc:740] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:01:57.744221  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: true dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:01:57.756356  1603 raft_consensus.cc:3060] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:57.745548  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: true dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:01:57.758880  2221 raft_consensus.cc:3060] T 7b4d826f7c344b45b7de4b9f69ea958b P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:57.759801  1673 consensus_queue.cc:260] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:57.774549  1673 raft_consensus.cc:3060] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:57.779860  1603 raft_consensus.cc:2468] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 19.
I20260709 13:01:57.783638  1517 tablet_service.cc:1558] Processing DeleteTablet for tablet 4190d217954f4f798b3a610501115290 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 5 (current committed config index is 8)) from {username='slave'} at 127.0.0.1:40604
I20260709 13:01:57.789793  2221 raft_consensus.cc:2468] T 7b4d826f7c344b45b7de4b9f69ea958b P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 19.
I20260709 13:01:57.791198  1497 leader_election.cc:304] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:01:57.793504  1429 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46258 (request call id 347) took 7161 ms. Trace:
I20260709 13:01:57.795799  1673 raft_consensus.cc:2468] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 19.
I20260709 13:01:57.793953  1429 rpcz_store.cc:276] 0709 13:01:50.630447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:50.630733 (+   286us) service_pool.cc:224] Handling call
0709 13:01:57.791627 (+7160894us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:57.409522 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:57.410081 (+   559us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:57.410116 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:01:57.410135 (+    19us) tablet.cc:662] Decoding operations
0709 13:01:57.412136 (+  2001us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:57.412221 (+    85us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:57.412249 (+    28us) tablet.cc:685] Acquiring locks for 29 operations
0709 13:01:57.437676 (+ 25427us) tablet.cc:701] Row locks acquired
0709 13:01:57.437698 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:01:57.437846 (+   148us) write_op.cc:270] Start()
0709 13:01:57.437967 (+   121us) write_op.cc:276] Timestamp: P: 1783602117437798 usec, L: 0
0709 13:01:57.437989 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:01:57.438791 (+   802us) log.cc:844] Serialized 11308 byte log entry
0709 13:01:57.605795 (+167004us) op_driver.cc:464] REPLICATION: finished
0709 13:01:57.610703 (+  4908us) write_op.cc:301] APPLY: starting
0709 13:01:57.614854 (+  4151us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:57.632778 (+ 17924us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:57.632876 (+    98us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:57.651391 (+ 18515us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:57.651755 (+   364us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=58,key_file_lookups=58,delta_file_lookups=58,mrs_lookups=0
0709 13:01:57.651800 (+    45us) write_op.cc:312] APPLY: finished
0709 13:01:57.652305 (+   505us) log.cc:844] Serialized 252 byte log entry
0709 13:01:57.653111 (+   806us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:57.653333 (+   222us) write_op.cc:454] Released schema lock
0709 13:01:57.653398 (+    65us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:57.694105 (+ 40707us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:57.694137 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5641,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":4644,"apply.run_cpu_time_us":33674,"apply.run_wall_time_us":83403,"cfile_cache_hit":118,"cfile_cache_hit_bytes":125579,"num_ops":29,"prepare.queue_time_us":22781,"prepare.run_cpu_time_us":31807,"prepare.run_wall_time_us":113698,"raft.queue_time_us":39559,"raft.run_cpu_time_us":3853,"raft.run_wall_time_us":5371,"replication_time_us":167668,"spinlock_wait_cycles":1792,"thread_start_us":150130,"threads_started":4,"wal-append.queue_time_us":107172}]]}
I20260709 13:01:57.796075  8612 raft_consensus.cc:2804] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:01:57.813896  8612 raft_consensus.cc:697] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:01:57.814868  8612 consensus_queue.cc:237] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:57.848120  1414 catalog_manager.cc:5028] TS e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): tablet 4190d217954f4f798b3a610501115290 (table test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]) successfully deleted
I20260709 13:01:57.903198  1423 catalog_manager.cc:5697] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 19 to 20, leader changed from ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) to 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194). New cstate: current_term: 20 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:57.908213  1423 catalog_manager.cc:5697] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 15 to 19. New cstate: current_term: 19 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:57.932374  1423 catalog_manager.cc:5697] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 16 to 18, leader changed from ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) to 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194). New cstate: current_term: 18 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:57.934135  1423 catalog_manager.cc:5697] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 19 to 21, leader changed from 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 21 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:01:57.935581  1423 catalog_manager.cc:5697] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 14 to 17, leader changed from e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 17 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } }
I20260709 13:01:57.952051  1423 catalog_manager.cc:5697] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:57.954785  1423 catalog_manager.cc:5697] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:01:57.978935  1423 catalog_manager.cc:5697] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 17 to 19, leader changed from 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 19 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:01:57.980448  1423 catalog_manager.cc:5697] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 20 to 21, leader changed from ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) to 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194). New cstate: current_term: 21 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:57.990785  1672 raft_consensus.cc:1275] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:01:57.982401  1423 catalog_manager.cc:5697] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 16 to 18, leader changed from ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) to 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194). New cstate: current_term: 18 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:57.996999  1423 catalog_manager.cc:5697] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 21 to 22, leader changed from e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 22 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } }
I20260709 13:01:57.995090  8615 consensus_queue.cc:1048] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.003s
I20260709 13:01:58.026744  1602 raft_consensus.cc:1275] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:01:58.034044  8552 consensus_queue.cc:1048] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:01:58.038370  8564 raft_consensus.cc:1064] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90: attempting to promote NON_VOTER b96ce9cc496c49d7818fa983a17b062b to VOTER
W20260709 13:01:58.060648  1424 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46274 (request call id 363) took 36885 ms (client timeout 15000 ms). Trace:
W20260709 13:01:58.061579  1424 rpcz_store.cc:269] 0709 13:01:21.175043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:21.186326 (+ 11283us) service_pool.cc:224] Handling call
0709 13:01:58.057608 (+36871282us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23881,"reported_tablets":47,"spinlock_wait_cycles":25856}
I20260709 13:01:58.100474  8564 consensus_queue.cc:237] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 13, Current term: 22, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:58.180152  1605 raft_consensus.cc:1275] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 21 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
W20260709 13:01:58.217500  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 108188us
I20260709 13:01:58.257666  1602 raft_consensus.cc:1275] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 22 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:01:58.260700  8460 consensus_queue.cc:1048] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.002s
W20260709 13:01:58.277940  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 57457.9us
I20260709 13:01:58.287735  1603 raft_consensus.cc:1275] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:01:58.290329  1524 raft_consensus.cc:1275] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 22 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:01:58.297359  2219 raft_consensus.cc:1275] T 8ea5da45c6d2479383e6af85e0a394b5 P b96ce9cc496c49d7818fa983a17b062b [term 22 LEARNER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:01:58.301443  1427 catalog_manager.cc:5697] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 19 to 21, leader changed from e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 21 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
W20260709 13:01:58.303259  2191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 110910us
I20260709 13:01:58.312995  8558 consensus_queue.cc:1048] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:01:58.303525  1427 catalog_manager.cc:5697] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 20 to 24. New cstate: current_term: 24 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:01:58.316377  8460 consensus_queue.cc:1048] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:01:58.302126  8612 consensus_queue.cc:1048] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.029s
I20260709 13:01:58.332293  8564 consensus_queue.cc:1048] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:01:58.347608  2219 raft_consensus.cc:1275] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 21 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:01:58.349831  2219 raft_consensus.cc:1275] T 7b4d826f7c344b45b7de4b9f69ea958b P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:01:58.353808  1427 catalog_manager.cc:5697] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 20 to 22, leader changed from e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 22 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:01:58.362133  8539 consensus_queue.cc:1048] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:01:58.363382  8629 consensus_queue.cc:1048] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:01:58.374945   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:58.443135  1672 raft_consensus.cc:1275] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:01:58.446310  8539 consensus_queue.cc:1048] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:01:58.357762  1423 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46260 (request call id 370) took 6072 ms. Trace:
I20260709 13:01:58.465276  8051 raft_consensus.cc:2955] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 22 LEADER]: Committing config change with OpId 22.15: config changed from index 14 to 15, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:01:58.469408  2221 raft_consensus.cc:2955] T 8ea5da45c6d2479383e6af85e0a394b5 P b96ce9cc496c49d7818fa983a17b062b [term 22 FOLLOWER]: Committing config change with OpId 22.15: config changed from index 14 to 15, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:01:58.356559  1427 catalog_manager.cc:5697] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 12 to 13, leader changed from b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) to e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193). New cstate: current_term: 13 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:01:58.534091  1606 raft_consensus.cc:2955] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 22 FOLLOWER]: Committing config change with OpId 22.15: config changed from index 14 to 15, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:01:58.458837  1423 rpcz_store.cc:276] 0709 13:01:52.284895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:52.285525 (+   630us) service_pool.cc:224] Handling call
0709 13:01:52.574443 (+288918us) spinlock_profiling.cc:243] Waited 54 ms on lock 0x7b5400411254. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851d090 00007f6a185bbf3a 00007f6a1e3721cc 00007f6a1e47037e 00007f6a1c9312a4 00007f6a1c931232 00007f6a1c931161 00007f6a1c9310dc 00007f6a1c930392 00007f6a168ee48c 00007f6a168ed8c6
0709 13:01:58.357694 (+5783251us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:58.020676 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:58.021200 (+   524us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:58.021238 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:01:58.021251 (+    13us) tablet.cc:662] Decoding operations
0709 13:01:58.022204 (+   953us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:58.022257 (+    53us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:58.022282 (+    25us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:01:58.023209 (+   927us) tablet.cc:701] Row locks acquired
0709 13:01:58.023223 (+    14us) write_op.cc:260] PREPARE: finished
0709 13:01:58.023365 (+   142us) write_op.cc:270] Start()
0709 13:01:58.023501 (+   136us) write_op.cc:276] Timestamp: P: 1783602118023322 usec, L: 0
0709 13:01:58.023518 (+    17us) op_driver.cc:348] REPLICATION: starting
0709 13:01:58.024157 (+   639us) log.cc:844] Serialized 4387 byte log entry
0709 13:01:58.027850 (+  3693us) op_driver.cc:464] REPLICATION: finished
0709 13:01:58.028316 (+   466us) write_op.cc:301] APPLY: starting
0709 13:01:58.028393 (+    77us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:58.087872 (+ 59479us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:58.089472 (+  1600us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:58.188824 (+ 99352us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:58.189060 (+   236us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=22,key_file_lookups=22,delta_file_lookups=22,mrs_lookups=0
0709 13:01:58.189111 (+    51us) write_op.cc:312] APPLY: finished
0709 13:01:58.189411 (+   300us) log.cc:844] Serialized 105 byte log entry
0709 13:01:58.189600 (+   189us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:58.189729 (+   129us) write_op.cc:454] Released schema lock
0709 13:01:58.189777 (+    48us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:58.217303 (+ 27526us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:58.219153 (+  1850us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":69671,"reported_tablets":41,"spinlock_wait_cycles":124181376,"child_traces":[["op",{"apply.queue_time_us":235,"apply.run_cpu_time_us":14723,"apply.run_wall_time_us":161765,"cfile_cache_hit":44,"cfile_cache_hit_bytes":46068,"num_ops":11,"prepare.queue_time_us":7048,"prepare.run_cpu_time_us":3762,"prepare.run_wall_time_us":3762,"replication_time_us":4193}]]}
I20260709 13:01:58.623445  1528 raft_consensus.cc:2955] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 22 FOLLOWER]: Committing config change with OpId 22.15: config changed from index 14 to 15, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
W20260709 13:01:58.813418  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 105850us
I20260709 13:01:58.935070  1423 catalog_manager.cc:5697] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 20 to 21, leader changed from 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) to e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193). New cstate: current_term: 21 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:01:58.936998  1423 catalog_manager.cc:5697] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 13 to 17, leader changed from 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 17 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } }
I20260709 13:01:58.938477  1423 catalog_manager.cc:5697] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 21 to 26, leader changed from e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) to 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194). New cstate: current_term: 26 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:58.940594  1423 catalog_manager.cc:5697] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:01:58.965008  1423 catalog_manager.cc:5697] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 14 to 15, leader changed from ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) to e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193). New cstate: current_term: 15 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } }
I20260709 13:01:58.966894  1423 catalog_manager.cc:5697] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: config changed from index -1 to 13, term changed from 18 to 19, leader changed from ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) to e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193), VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New cstate: current_term: 19 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:01:58.983943  1423 catalog_manager.cc:5697] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 13 to 14, leader changed from ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) to e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193). New cstate: current_term: 14 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } }
I20260709 13:01:58.988106  1423 catalog_manager.cc:5697] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 17 to 18, leader changed from ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) to b96ce9cc496c49d7818fa983a17b062b (127.0.107.196). New cstate: current_term: 18 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:01:58.989495  1423 catalog_manager.cc:5697] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 15 to 19. New cstate: current_term: 19 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } }
I20260709 13:01:58.991653  1427 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50074 (request call id 238) took 4806 ms. Trace:
I20260709 13:01:58.992095  1427 rpcz_store.cc:276] 0709 13:01:54.185583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:54.185757 (+   174us) service_pool.cc:224] Handling call
0709 13:01:58.991589 (+4805832us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:58.711989 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:58.712506 (+   517us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:58.712542 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:01:58.712560 (+    18us) tablet.cc:662] Decoding operations
0709 13:01:58.713137 (+   577us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:58.713210 (+    73us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:58.713237 (+    27us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:01:58.713633 (+   396us) tablet.cc:701] Row locks acquired
0709 13:01:58.713651 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:01:58.713779 (+   128us) write_op.cc:270] Start()
0709 13:01:58.713892 (+   113us) write_op.cc:276] Timestamp: P: 1783602118713738 usec, L: 0
0709 13:01:58.713914 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:01:58.714573 (+   659us) log.cc:844] Serialized 1749 byte log entry
0709 13:01:58.821196 (+106623us) op_driver.cc:464] REPLICATION: finished
0709 13:01:58.855529 (+ 34333us) write_op.cc:301] APPLY: starting
0709 13:01:58.855614 (+    85us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:58.858243 (+  2629us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:58.858409 (+   166us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:58.868471 (+ 10062us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:58.868677 (+   206us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=8,mrs_lookups=0
0709 13:01:58.868720 (+    43us) write_op.cc:312] APPLY: finished
0709 13:01:58.868951 (+   231us) log.cc:844] Serialized 49 byte log entry
0709 13:01:58.869128 (+   177us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:58.869225 (+    97us) write_op.cc:454] Released schema lock
0709 13:01:58.869268 (+    43us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:58.884197 (+ 14929us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:58.884228 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":43908,"reported_tablets":33,"child_traces":[["op",{"apply.queue_time_us":34086,"apply.run_cpu_time_us":6565,"apply.run_wall_time_us":14134,"cfile_cache_hit":18,"cfile_cache_hit_bytes":20879,"num_ops":4,"prepare.queue_time_us":162709,"prepare.run_cpu_time_us":2955,"prepare.run_wall_time_us":4976,"replication_time_us":107126,"thread_start_us":131037,"threads_started":2}]]}
I20260709 13:01:59.017885  1423 catalog_manager.cc:5697] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 17 to 18, leader changed from ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) to 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194). New cstate: current_term: 18 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:59.061622  1423 catalog_manager.cc:5697] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 24 to 25, leader changed from ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) to e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193). New cstate: current_term: 25 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:01:59.063301  1423 catalog_manager.cc:5697] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: config changed from index -1 to 15, VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New cstate: current_term: 22 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:01:59.219028  1427 catalog_manager.cc:5697] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 15 to 18, leader changed from b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) to e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193). New cstate: current_term: 18 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:01:59.301213  1529 consensus_queue.cc:237] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.16, Last appended by leader: 15, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:59.303682  1429 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46258 (request call id 348) took 1402 ms. Trace:
I20260709 13:01:59.304200  1429 rpcz_store.cc:276] 0709 13:01:57.901670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:57.902821 (+  1151us) service_pool.cc:224] Handling call
0709 13:01:59.303584 (+1400763us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26144,"reported_tablets":25}
I20260709 13:01:59.392444  1602 raft_consensus.cc:1275] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 25 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 13:01:59.396709  1529 consensus_queue.cc:237] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:59.397552  8629 consensus_queue.cc:1048] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:01:59.409366  2222 raft_consensus.cc:1275] T 7b4d826f7c344b45b7de4b9f69ea958b P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:01:59.411603  8628 consensus_queue.cc:1048] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:01:59.412250  1678 raft_consensus.cc:1275] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:01:59.416064  2225 raft_consensus.cc:1275] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 25 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 13:01:59.424839  8629 consensus_queue.cc:1048] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:01:59.425868  8628 consensus_queue.cc:1048] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:01:59.433743  8628 raft_consensus.cc:2955] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 LEADER]: Committing config change with OpId 19.15: config changed from index 13 to 15, VOTER 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:01:59.438796  1672 raft_consensus.cc:2955] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Committing config change with OpId 19.15: config changed from index 13 to 15, VOTER 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:01:59.448660  1422 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46274 (request call id 365) took 2535 ms. Trace:
I20260709 13:01:59.465364  1422 rpcz_store.cc:276] 0709 13:01:56.912797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:56.913175 (+   378us) service_pool.cc:224] Handling call
0709 13:01:57.022934 (+109759us) spinlock_profiling.cc:243] Waited 15.2 ms on lock 0x7b5400411254. stack: 00007f6a15494343 00007f6a15494240 00007f6a14e231d4 00007f6a1eb61304 00007f6a1eb61299 00007f6a1851d090 00007f6a185bbf3a 00007f6a1e3721cc 00007f6a1e47037e 00007f6a1c9312a4 00007f6a1c931232 00007f6a1c931161 00007f6a1c9310dc 00007f6a1c930392 00007f6a168ee48c 00007f6a168ed8c6
0709 13:01:59.448579 (+2425645us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12275,"reported_tablets":47,"spinlock_wait_cycles":34876288}
I20260709 13:01:59.468920  8649 raft_consensus.cc:2955] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 25 LEADER]: Committing config change with OpId 25.17: config changed from index 8 to 17, VOTER ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:01:59.465440  2225 raft_consensus.cc:2955] T 7b4d826f7c344b45b7de4b9f69ea958b P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Committing config change with OpId 19.15: config changed from index 13 to 15, VOTER 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:01:59.476555  1606 raft_consensus.cc:2955] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 25 FOLLOWER]: Committing config change with OpId 25.17: config changed from index 8 to 17, VOTER ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:01:59.489609  1414 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 04fed4c219e14efb9f9a8eb0d336ceac with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:59.500331   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:59.503008  1423 catalog_manager.cc:5697] T 7b4d826f7c344b45b7de4b9f69ea958b P b96ce9cc496c49d7818fa983a17b062b reported cstate change: config changed from index 13 to 15, VOTER 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) evicted. New cstate: current_term: 19 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:01:59.518728  1422 catalog_manager.cc:5697] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: config changed from index 8 to 17, VOTER ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) evicted. New cstate: current_term: 25 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:59.522809  1414 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7b4d826f7c344b45b7de4b9f69ea958b with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:59.528247  2222 raft_consensus.cc:2955] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 25 FOLLOWER]: Committing config change with OpId 25.17: config changed from index 8 to 17, VOTER ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:01:59.687487  1594 tablet_service.cc:1558] Processing DeleteTablet for tablet 7b4d826f7c344b45b7de4b9f69ea958b with delete_type TABLET_DATA_TOMBSTONED (TS 39a92f5a4352465d8af3af5908fe8642 not found in new config with opid_index 15) from {username='slave'} at 127.0.0.1:47826
I20260709 13:01:59.824815  1664 tablet_service.cc:1558] Processing DeleteTablet for tablet 04fed4c219e14efb9f9a8eb0d336ceac with delete_type TABLET_DATA_TOMBSTONED (TS ddf11fc190dd4b898773379c6b129d90 not found in new config with opid_index 17) from {username='slave'} at 127.0.0.1:51000
I20260709 13:01:59.828513  1673 consensus_queue.cc:237] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:01:59.839303  8663 tablet_replica.cc:333] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90: stopping tablet replica
I20260709 13:01:59.859759  1606 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf"
dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
mode: GRACEFUL
new_leader_uuid: "b96ce9cc496c49d7818fa983a17b062b"
 from {username='slave'} at 127.0.0.1:47814
W20260709 13:01:59.857859  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 130472us
I20260709 13:01:59.868005  1606 raft_consensus.cc:606] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 20 LEADER]: Received request to transfer leadership to TS b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:59.872391  8656 tablet_replica.cc:333] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642: stopping tablet replica
I20260709 13:01:59.874158  1672 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9"
dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
mode: GRACEFUL
new_leader_uuid: "39a92f5a4352465d8af3af5908fe8642"
 from {username='slave'} at 127.0.0.1:33616
I20260709 13:01:59.874922  1672 raft_consensus.cc:606] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 18 LEADER]: Received request to transfer leadership to TS 39a92f5a4352465d8af3af5908fe8642
W20260709 13:01:59.867754  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 145421us
I20260709 13:01:59.877821  8656 raft_consensus.cc:2243] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:59.877956  8663 raft_consensus.cc:2243] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 25 FOLLOWER]: Raft consensus shutting down.
W20260709 13:01:59.878882  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 47775us
I20260709 13:01:59.930332  8656 raft_consensus.cc:2272] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:59.933043  1602 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866"
dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
mode: GRACEFUL
new_leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:47814
I20260709 13:01:59.933714  1602 raft_consensus.cc:606] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 19 LEADER]: Received request to transfer leadership to TS e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:01:59.936534  8663 raft_consensus.cc:2272] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:59.939651  8663 ts_tablet_manager.cc:1916] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:59.945530  1673 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02"
dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
mode: GRACEFUL
new_leader_uuid: "b96ce9cc496c49d7818fa983a17b062b"
 from {username='slave'} at 127.0.0.1:33616
I20260709 13:01:59.953558  1673 raft_consensus.cc:606] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 21 LEADER]: Received request to transfer leadership to TS b96ce9cc496c49d7818fa983a17b062b
I20260709 13:01:59.946813  2225 raft_consensus.cc:1275] T 8ea5da45c6d2479383e6af85e0a394b5 P b96ce9cc496c49d7818fa983a17b062b [term 22 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:01:59.954133  1531 raft_consensus.cc:1275] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 22 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:01:59.955660   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:01:59.957412   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:59.983455  8656 ts_tablet_manager.cc:1916] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:59.983687  8657 consensus_queue.cc:1048] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 13:01:59.986361  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 45785.4us
I20260709 13:01:59.986984  8579 raft_consensus.cc:993] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642: : Instructing follower b96ce9cc496c49d7818fa983a17b062b to start an election
I20260709 13:01:59.987462  8579 raft_consensus.cc:1081] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 20 LEADER]: Signalling peer b96ce9cc496c49d7818fa983a17b062b to start an election
I20260709 13:01:59.989553  2225 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf"
dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
 from {username='slave'} at 127.0.0.1:50310
I20260709 13:01:59.990106  2225 raft_consensus.cc:493] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:59.990423  2225 raft_consensus.cc:3060] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:00.002194  8655 raft_consensus.cc:993] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90: : Instructing follower b96ce9cc496c49d7818fa983a17b062b to start an election
I20260709 13:02:00.002801  8655 raft_consensus.cc:1081] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 21 LEADER]: Signalling peer b96ce9cc496c49d7818fa983a17b062b to start an election
I20260709 13:02:00.004757  2225 raft_consensus.cc:515] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:00.006690  2222 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02"
dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
 from {username='slave'} at 127.0.0.1:50326
I20260709 13:02:00.011063  2222 raft_consensus.cc:493] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 21 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:00.011670  2222 raft_consensus.cc:3060] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:00.013309  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: true dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:02:00.014052  1602 raft_consensus.cc:3055] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:02:00.014364  1602 raft_consensus.cc:740] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:02:00.015213  1602 consensus_queue.cc:260] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:00.016378  1602 raft_consensus.cc:3060] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:02:00.018710  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 89816.6us
I20260709 13:02:00.028837  1602 raft_consensus.cc:2468] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 21.
I20260709 13:02:00.028607  8460 raft_consensus.cc:2955] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 22 LEADER]: Committing config change with OpId 22.16: config changed from index 15 to 16, VOTER 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:02:00.035609  2221 raft_consensus.cc:2955] T 8ea5da45c6d2479383e6af85e0a394b5 P b96ce9cc496c49d7818fa983a17b062b [term 22 FOLLOWER]: Committing config change with OpId 22.16: config changed from index 15 to 16, VOTER 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:02:00.040191  2225 leader_election.cc:290] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 21 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:02:00.039592  2222 raft_consensus.cc:515] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 22 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:00.038986  2192 leader_election.cc:304] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:02:00.044572  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1804adcd3844f5837dfc27d40e4cdf" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: true dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:02:00.045200  1673 raft_consensus.cc:3060] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:00.046479  8659 raft_consensus.cc:2804] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:02:00.047097  8659 raft_consensus.cc:697] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 21 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:02:00.047945  8659 consensus_queue.cc:237] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:00.046836  8562 consensus_queue.cc:1048] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.006s
I20260709 13:02:00.058108  1673 raft_consensus.cc:2468] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 21.
I20260709 13:02:00.085371  1415 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8ea5da45c6d2479383e6af85e0a394b5 with cas_config_opid_index 15: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:02:00.098452  1531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: true dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:02:00.099488  1531 raft_consensus.cc:3060] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:00.104313  1427 catalog_manager.cc:5697] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 reported cstate change: config changed from index 15 to 16, VOTER 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) evicted. New cstate: current_term: 22 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:00.107961  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78618eba8b74effa4a90f2c8e34cc02" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: true dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:02:00.108592  1678 raft_consensus.cc:3055] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:02:00.106909  2222 leader_election.cc:290] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 22 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:02:00.108884  1678 raft_consensus.cc:740] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:02:00.110978  8655 raft_consensus.cc:993] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90: : Instructing follower 39a92f5a4352465d8af3af5908fe8642 to start an election
I20260709 13:02:00.111492  8460 raft_consensus.cc:1081] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 18 LEADER]: Signalling peer 39a92f5a4352465d8af3af5908fe8642 to start an election
I20260709 13:02:00.113379  1606 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9"
dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
 from {username='slave'} at 127.0.0.1:36200
I20260709 13:02:00.113920  1606 raft_consensus.cc:493] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:00.114728  1606 raft_consensus.cc:3060] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:00.121778  1606 raft_consensus.cc:515] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:02:00.126646  1606 leader_election.cc:290] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 19 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:02:00.127233  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: true dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:02:00.127807  1673 raft_consensus.cc:3055] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:02:00.128106  1673 raft_consensus.cc:740] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:02:00.129546  1531 raft_consensus.cc:2468] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 22.
I20260709 13:02:00.128825  1673 consensus_queue.cc:260] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:02:00.131705  1673 raft_consensus.cc:3060] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:00.130831  2190 leader_election.cc:304] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:02:00.137194  1673 raft_consensus.cc:2468] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 19.
I20260709 13:02:00.125355  1678 consensus_queue.cc:260] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:00.141120  1678 raft_consensus.cc:3060] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:00.141649  1429 catalog_manager.cc:5697] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 20 to 21, leader changed from 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) to b96ce9cc496c49d7818fa983a17b062b (127.0.107.196). New cstate: current_term: 21 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:00.150213  1678 raft_consensus.cc:2468] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 22.
I20260709 13:02:00.139695  1571 leader_election.cc:304] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:02:00.152978  8579 raft_consensus.cc:2804] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:02:00.153517  8579 raft_consensus.cc:697] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 19 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:02:00.154433  8579 consensus_queue.cc:237] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:02:00.161221  8663 ts_tablet_manager.cc:1929] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 25.16
I20260709 13:02:00.174708  8663 log.cc:1199] T 04fed4c219e14efb9f9a8eb0d336ceac P ddf11fc190dd4b898773379c6b129d90: Deleting WAL directory at /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601891739070-431-0/minicluster-data/ts-2-root/wals/04fed4c219e14efb9f9a8eb0d336ceac
I20260709 13:02:00.176678  1415 catalog_manager.cc:5028] TS ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217): tablet 04fed4c219e14efb9f9a8eb0d336ceac (table test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]) successfully deleted
I20260709 13:02:00.173537  8656 ts_tablet_manager.cc:1929] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 19.14
I20260709 13:02:00.183539  8656 log.cc:1199] T 7b4d826f7c344b45b7de4b9f69ea958b P 39a92f5a4352465d8af3af5908fe8642: Deleting WAL directory at /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601891739070-431-0/minicluster-data/ts-1-root/wals/7b4d826f7c344b45b7de4b9f69ea958b
I20260709 13:02:00.138723  8627 raft_consensus.cc:2804] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 22 FOLLOWER]: Leader election won for term 22
W20260709 13:02:00.185770  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 59661.4us
I20260709 13:02:00.187821  8627 raft_consensus.cc:697] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 22 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:02:00.188755  8627 consensus_queue.cc:237] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:00.192057  1416 catalog_manager.cc:5028] TS 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): tablet 7b4d826f7c344b45b7de4b9f69ea958b (table test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]) successfully deleted
I20260709 13:02:00.210811  1524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: true dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
I20260709 13:02:00.211467  1524 raft_consensus.cc:3060] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:00.241640  1524 raft_consensus.cc:2468] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 19.
I20260709 13:02:00.239900  1531 raft_consensus.cc:2955] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 22 FOLLOWER]: Committing config change with OpId 22.16: config changed from index 15 to 16, VOTER 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:02:00.260145  8580 raft_consensus.cc:993] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642: : Instructing follower e46412b3b0b44f01ad5c33d4cfe3d6b1 to start an election
I20260709 13:02:00.260651  8664 raft_consensus.cc:1081] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 19 LEADER]: Signalling peer e46412b3b0b44f01ad5c33d4cfe3d6b1 to start an election
I20260709 13:02:00.269549  1531 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866"
dest_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1"
 from {username='slave'} at 127.0.0.1:43008
I20260709 13:02:00.270258  1531 raft_consensus.cc:493] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:00.270728  1531 raft_consensus.cc:3060] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:00.282327  1594 tablet_service.cc:1558] Processing DeleteTablet for tablet 8ea5da45c6d2479383e6af85e0a394b5 with delete_type TABLET_DATA_TOMBSTONED (TS 39a92f5a4352465d8af3af5908fe8642 not found in new config with opid_index 16) from {username='slave'} at 127.0.0.1:47826
I20260709 13:02:00.283466  8656 tablet_replica.cc:333] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642: stopping tablet replica
I20260709 13:02:00.284461  8656 raft_consensus.cc:2243] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:00.284571  1531 raft_consensus.cc:515] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:02:00.287696  1531 leader_election.cc:290] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 20 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:02:00.291014  8656 raft_consensus.cc:2272] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:00.292889  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: true dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:02:00.293514  1673 raft_consensus.cc:3060] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:00.293923  8656 ts_tablet_manager.cc:1916] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:02:00.298890  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: true dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:02:00.299535  1606 raft_consensus.cc:3055] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:02:00.299844  1606 raft_consensus.cc:740] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:02:00.300599  1606 consensus_queue.cc:260] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:02:00.301689  1606 raft_consensus.cc:3060] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:00.313333  8656 ts_tablet_manager.cc:1929] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 22.15
I20260709 13:02:00.326387  8656 log.cc:1199] T 8ea5da45c6d2479383e6af85e0a394b5 P 39a92f5a4352465d8af3af5908fe8642: Deleting WAL directory at /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601891739070-431-0/minicluster-data/ts-1-root/wals/8ea5da45c6d2479383e6af85e0a394b5
I20260709 13:02:00.331483  1673 raft_consensus.cc:2468] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 20.
I20260709 13:02:00.332696  1496 leader_election.cc:304] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 
I20260709 13:02:00.333225  1416 catalog_manager.cc:5028] TS 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): tablet 8ea5da45c6d2479383e6af85e0a394b5 (table test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]) successfully deleted
I20260709 13:02:00.334347  8672 raft_consensus.cc:2804] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:02:00.334910  8672 raft_consensus.cc:697] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 LEADER]: Becoming Leader. State: Replica: e46412b3b0b44f01ad5c33d4cfe3d6b1, State: Running, Role: LEADER
I20260709 13:02:00.335778  8672 consensus_queue.cc:237] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:02:00.319931  1606 raft_consensus.cc:2468] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e46412b3b0b44f01ad5c33d4cfe3d6b1 in term 20.
I20260709 13:02:00.356743  1429 catalog_manager.cc:5697] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 21 to 22, leader changed from ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) to b96ce9cc496c49d7818fa983a17b062b (127.0.107.196). New cstate: current_term: 22 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:00.359989  1422 catalog_manager.cc:5697] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 18 to 19, leader changed from ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) to 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194). New cstate: current_term: 19 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:00.408859  1429 catalog_manager.cc:5697] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 reported cstate change: term changed from 19 to 20, leader changed from 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) to e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193). New cstate: current_term: 20 leader_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:00.583734  1524 raft_consensus.cc:1275] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 22 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:02:00.589159  8631 consensus_queue.cc:1048] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:02:00.615825  1673 raft_consensus.cc:1275] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 13:02:00.635305  1529 raft_consensus.cc:1275] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:02:00.644829  8627 consensus_queue.cc:1048] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:02:00.659790  1672 raft_consensus.cc:1275] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:02:00.661837  8579 consensus_queue.cc:1048] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:02:00.690850  1606 raft_consensus.cc:1275] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 21 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 13:02:00.711810  8661 consensus_queue.cc:1048] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:02:00.684696  8579 consensus_queue.cc:1048] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.031s
I20260709 13:02:00.730490  1674 raft_consensus.cc:1275] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 22 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:02:00.752206  8631 consensus_queue.cc:1048] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.002s
I20260709 13:02:00.763867  1606 raft_consensus.cc:1275] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:02:00.786849  8629 consensus_queue.cc:1048] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.017s
I20260709 13:02:00.897231  1673 raft_consensus.cc:1275] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 20 FOLLOWER]: Refusing update from remote peer e46412b3b0b44f01ad5c33d4cfe3d6b1: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
W20260709 13:02:00.900993  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 52420.2us
I20260709 13:02:00.927378  8628 consensus_queue.cc:1048] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.010s
I20260709 13:02:00.958678   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:01.595081  1606 consensus_queue.cc:237] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 13:02:01.659370  1672 raft_consensus.cc:1275] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:02:01.667018  8579 consensus_queue.cc:1048] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:02:01.668901  1529 raft_consensus.cc:1275] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:02:01.676316  8699 consensus_queue.cc:1048] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:02:01.686877  1572 consensus_peers.cc:597] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 -> Peer b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373): Couldn't send request to peer b96ce9cc496c49d7818fa983a17b062b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d53340cc35954204b06e3743bec8adbf. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:01.731594  8666 raft_consensus.cc:2955] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 18 LEADER]: Committing config change with OpId 18.12: config changed from index -1 to 12, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 13:02:01.741384  1681 raft_consensus.cc:2955] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index -1 to 12, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 13:02:01.769316  1606 consensus_queue.cc:237] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 13:02:01.785625  1423 catalog_manager.cc:5697] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: config changed from index -1 to 12, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New cstate: current_term: 18 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:01.787137  1529 raft_consensus.cc:2955] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index -1 to 12, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
W20260709 13:02:01.794708  1572 consensus_peers.cc:597] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 -> Peer b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373): Couldn't send request to peer b96ce9cc496c49d7818fa983a17b062b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9a873ede2f0f418cbcab98586dba9b1e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:01.803313  1672 raft_consensus.cc:1275] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:02:01.812207  8699 consensus_queue.cc:1048] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:02:01.816872  1528 raft_consensus.cc:1275] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 21 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:02:01.821758  8666 consensus_queue.cc:1048] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:02:01.878615  8666 raft_consensus.cc:2955] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 21 LEADER]: Committing config change with OpId 21.13: config changed from index -1 to 13, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 13:02:01.889658  1681 raft_consensus.cc:2955] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Committing config change with OpId 21.13: config changed from index -1 to 13, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 13:02:01.932251  1605 consensus_queue.cc:237] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 13:02:01.939814  1529 raft_consensus.cc:2955] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 21 FOLLOWER]: Committing config change with OpId 21.13: config changed from index -1 to 13, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 13:02:01.989466  1681 raft_consensus.cc:1275] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 13:02:01.989758  1572 consensus_peers.cc:597] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 -> Peer b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373): Couldn't send request to peer b96ce9cc496c49d7818fa983a17b062b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3406989a2b754fe7804c691a11bba6d0. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:01.997408  8699 consensus_queue.cc:1048] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:02.022511  8666 raft_consensus.cc:2955] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 16 LEADER]: Committing config change with OpId 16.12: config changed from index -1 to 12, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 13:02:02.037729  1528 raft_consensus.cc:1275] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:02:02.051533  8579 consensus_queue.cc:1048] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:02:02.066975  1681 consensus_queue.cc:237] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 13:02:02.076331  1672 raft_consensus.cc:2955] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index -1 to 12, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
W20260709 13:02:02.109942  1646 consensus_peers.cc:597] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 -> Peer b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373): Couldn't send request to peer b96ce9cc496c49d7818fa983a17b062b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7d60bdd9b7f543e180698438c413d061. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:02.125074  8709 log.cc:927] Time spent T 00000000000000000000000000000000 P 9f38d0e5c9db43a48554defe1153354e: Append to log took a long time: real 0.063s	user 0.000s	sys 0.002s
I20260709 13:02:02.128075  1528 raft_consensus.cc:2955] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index -1 to 12, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 13:02:02.129105  1422 catalog_manager.cc:5697] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: config changed from index -1 to 13, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New cstate: current_term: 21 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:02.139719  1422 catalog_manager.cc:5697] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: config changed from index -1 to 12, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New cstate: current_term: 16 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:02.146131   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:02.152344  1531 raft_consensus.cc:1275] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:02:02.159343  1605 raft_consensus.cc:1275] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:02:02.161824  8657 consensus_queue.cc:1048] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:02.183233  8697 consensus_queue.cc:1048] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:02.184268  8717 ts_tablet_manager.cc:933] T d53340cc35954204b06e3743bec8adbf P b96ce9cc496c49d7818fa983a17b062b: Initiating tablet copy from peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:02:02.204238  8717 tablet_copy_client.cc:323] T d53340cc35954204b06e3743bec8adbf P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:40303
I20260709 13:02:02.236442  1616 tablet_copy_service.cc:140] P 39a92f5a4352465d8af3af5908fe8642: Received BeginTabletCopySession request for tablet d53340cc35954204b06e3743bec8adbf from peer b96ce9cc496c49d7818fa983a17b062b ({username='slave'} at 127.0.0.1:57268)
I20260709 13:02:02.237275  1616 tablet_copy_service.cc:161] P 39a92f5a4352465d8af3af5908fe8642: Beginning new tablet copy session on tablet d53340cc35954204b06e3743bec8adbf from peer b96ce9cc496c49d7818fa983a17b062b at {username='slave'} at 127.0.0.1:57268: session id = b96ce9cc496c49d7818fa983a17b062b-d53340cc35954204b06e3743bec8adbf
I20260709 13:02:02.288404  8722 ts_tablet_manager.cc:933] T 9a873ede2f0f418cbcab98586dba9b1e P b96ce9cc496c49d7818fa983a17b062b: Initiating tablet copy from peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:02:02.293915  8702 raft_consensus.cc:2955] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 19 LEADER]: Committing config change with OpId 19.11: config changed from index -1 to 11, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 13:02:02.307490  1616 tablet_copy_source_session.cc:215] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:02.322477  8717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d53340cc35954204b06e3743bec8adbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.372001  8722 tablet_copy_client.cc:323] T 9a873ede2f0f418cbcab98586dba9b1e P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:40303
W20260709 13:02:02.379987  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 101294us
I20260709 13:02:02.400326  8717 tablet_copy_client.cc:806] T d53340cc35954204b06e3743bec8adbf P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:02.401086  8717 tablet_copy_client.cc:670] T d53340cc35954204b06e3743bec8adbf P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:02.864128  1529 raft_consensus.cc:2955] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Committing config change with OpId 19.11: config changed from index -1 to 11, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
W20260709 13:02:02.925750  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 60341.3us
I20260709 13:02:02.999004  1605 raft_consensus.cc:2955] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Committing config change with OpId 19.11: config changed from index -1 to 11, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } } }
I20260709 13:02:03.145274  1616 tablet_copy_service.cc:140] P 39a92f5a4352465d8af3af5908fe8642: Received BeginTabletCopySession request for tablet 9a873ede2f0f418cbcab98586dba9b1e from peer b96ce9cc496c49d7818fa983a17b062b ({username='slave'} at 127.0.0.1:57268)
I20260709 13:02:03.145910  1616 tablet_copy_service.cc:161] P 39a92f5a4352465d8af3af5908fe8642: Beginning new tablet copy session on tablet 9a873ede2f0f418cbcab98586dba9b1e from peer b96ce9cc496c49d7818fa983a17b062b at {username='slave'} at 127.0.0.1:57268: session id = b96ce9cc496c49d7818fa983a17b062b-9a873ede2f0f418cbcab98586dba9b1e
I20260709 13:02:03.161963  1422 catalog_manager.cc:5697] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 reported cstate change: config changed from index -1 to 11, NON_VOTER b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) added. New cstate: current_term: 19 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:03.207008  1616 tablet_copy_source_session.cc:215] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:03.218806  8717 tablet_copy_client.cc:538] T d53340cc35954204b06e3743bec8adbf P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:03.224048  8722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a873ede2f0f418cbcab98586dba9b1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.278328  8717 tablet_bootstrap.cc:492] T d53340cc35954204b06e3743bec8adbf P b96ce9cc496c49d7818fa983a17b062b: Bootstrap starting.
I20260709 13:02:03.235857  1605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c"
dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
mode: GRACEFUL
new_leader_uuid: "b96ce9cc496c49d7818fa983a17b062b"
 from {username='slave'} at 127.0.0.1:47814
I20260709 13:02:03.286476  1605 raft_consensus.cc:606] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 21 LEADER]: Received request to transfer leadership to TS b96ce9cc496c49d7818fa983a17b062b
I20260709 13:02:03.291709  8741 ts_tablet_manager.cc:933] T 7d60bdd9b7f543e180698438c413d061 P b96ce9cc496c49d7818fa983a17b062b: Initiating tablet copy from peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:02:03.311337   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:02:03.313417   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:03.323328  8742 ts_tablet_manager.cc:933] T 3406989a2b754fe7804c691a11bba6d0 P b96ce9cc496c49d7818fa983a17b062b: Initiating tablet copy from peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:02:03.353312  8741 tablet_copy_client.cc:323] T 7d60bdd9b7f543e180698438c413d061 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:44217
I20260709 13:02:03.365738  8742 tablet_copy_client.cc:323] T 3406989a2b754fe7804c691a11bba6d0 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:40303
I20260709 13:02:03.364511  1690 tablet_copy_service.cc:140] P ddf11fc190dd4b898773379c6b129d90: Received BeginTabletCopySession request for tablet 7d60bdd9b7f543e180698438c413d061 from peer b96ce9cc496c49d7818fa983a17b062b ({username='slave'} at 127.0.0.1:50664)
I20260709 13:02:03.369135  1690 tablet_copy_service.cc:161] P ddf11fc190dd4b898773379c6b129d90: Beginning new tablet copy session on tablet 7d60bdd9b7f543e180698438c413d061 from peer b96ce9cc496c49d7818fa983a17b062b at {username='slave'} at 127.0.0.1:50664: session id = b96ce9cc496c49d7818fa983a17b062b-7d60bdd9b7f543e180698438c413d061
I20260709 13:02:03.370904  1616 tablet_copy_service.cc:140] P 39a92f5a4352465d8af3af5908fe8642: Received BeginTabletCopySession request for tablet 3406989a2b754fe7804c691a11bba6d0 from peer b96ce9cc496c49d7818fa983a17b062b ({username='slave'} at 127.0.0.1:57268)
I20260709 13:02:03.371733  1616 tablet_copy_service.cc:161] P 39a92f5a4352465d8af3af5908fe8642: Beginning new tablet copy session on tablet 3406989a2b754fe7804c691a11bba6d0 from peer b96ce9cc496c49d7818fa983a17b062b at {username='slave'} at 127.0.0.1:57268: session id = b96ce9cc496c49d7818fa983a17b062b-3406989a2b754fe7804c691a11bba6d0
I20260709 13:02:03.396255  8730 raft_consensus.cc:993] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642: : Instructing follower b96ce9cc496c49d7818fa983a17b062b to start an election
I20260709 13:02:03.408563  8579 raft_consensus.cc:1081] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 21 LEADER]: Signalling peer b96ce9cc496c49d7818fa983a17b062b to start an election
I20260709 13:02:03.421806  2221 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c"
dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
 from {username='slave'} at 127.0.0.1:50310
I20260709 13:02:03.422483  2221 raft_consensus.cc:493] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 21 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:03.430413  2221 raft_consensus.cc:3060] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:02:03.457445  1461 debug-util.cc:398] Leaking SignalData structure 0x7b08002c7140 after lost signal to thread 434
W20260709 13:02:03.458686  1461 debug-util.cc:398] Leaking SignalData structure 0x7b08002167c0 after lost signal to thread 1464
W20260709 13:02:03.460059  1461 debug-util.cc:398] Leaking SignalData structure 0x7b0800348920 after lost signal to thread 1556
W20260709 13:02:03.468014  1461 debug-util.cc:398] Leaking SignalData structure 0x7b08001917e0 after lost signal to thread 1631
W20260709 13:02:03.474128  1461 debug-util.cc:398] Leaking SignalData structure 0x7b08003b4aa0 after lost signal to thread 1705
I20260709 13:02:03.460538  8722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:50310 (request call id 1566) took 1241 ms. Trace:
I20260709 13:02:03.482291  1616 tablet_copy_source_session.cc:215] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:03.478088  2221 raft_consensus.cc:515] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 22 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:02:03.484498  1461 debug-util.cc:398] Leaking SignalData structure 0x7b08003fe180 after lost signal to thread 2251
I20260709 13:02:03.477145  1690 tablet_copy_source_session.cc:215] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:03.492398  8742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3406989a2b754fe7804c691a11bba6d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.511524  2221 leader_election.cc:290] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 22 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:02:03.481678  8722 rpcz_store.cc:276] 0709 13:02:02.219131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.222287 (+  3156us) service_pool.cc:224] Handling call
0709 13:02:02.288884 (+ 66597us) ts_tablet_manager.cc:934] T 9a873ede2f0f418cbcab98586dba9b1e P b96ce9cc496c49d7818fa983a17b062b: Initiating tablet copy from peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
0709 13:02:03.218557 (+929673us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:02:03.321821 (+103264us) tablet_metadata.cc:665] Metadata flushed
0709 13:02:03.321952 (+   131us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:02:03.447046 (+125094us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:02:03.459998 (+ 12952us) tablet_replica.cc:206] Creating consensus instance
0709 13:02:03.460351 (+   353us) ts_tablet_manager.cc:989] Replica registered.
0709 13:02:03.460429 (+    78us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":577,"tablet-copy.queue_time_us":65393,"thread_start_us":131799,"threads_started":2}
I20260709 13:02:03.512873  8722 tablet_copy_client.cc:806] T 9a873ede2f0f418cbcab98586dba9b1e P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:03.513538  8722 tablet_copy_client.cc:670] T 9a873ede2f0f418cbcab98586dba9b1e P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:03.513384  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: true dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:02:03.514989  1673 raft_consensus.cc:3060] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:03.519951  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1359810508724a7a8749ce09a6654a9c" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: true dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:02:03.520680  1603 raft_consensus.cc:3055] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:02:03.521044  1603 raft_consensus.cc:740] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:02:03.521904  1603 consensus_queue.cc:260] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 21.18, Last appended by leader: 18, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:03.523206  1603 raft_consensus.cc:3060] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:03.536625  8722 tablet_copy_client.cc:538] T 9a873ede2f0f418cbcab98586dba9b1e P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:03.558435  1673 raft_consensus.cc:2468] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 22.
I20260709 13:02:03.575906  8741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d60bdd9b7f543e180698438c413d061. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.582703  2191 leader_election.cc:304] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:02:03.598858  8739 raft_consensus.cc:2804] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:02:03.599444  8739 raft_consensus.cc:697] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 22 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:02:03.600301  8739 consensus_queue.cc:237] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 21.18, Last appended by leader: 18, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:03.608712  1603 raft_consensus.cc:2468] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 22.
I20260709 13:02:03.650060  8722 tablet_bootstrap.cc:492] T 9a873ede2f0f418cbcab98586dba9b1e P b96ce9cc496c49d7818fa983a17b062b: Bootstrap starting.
I20260709 13:02:03.651068  8717 tablet_bootstrap.cc:492] T d53340cc35954204b06e3743bec8adbf P b96ce9cc496c49d7818fa983a17b062b: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=0 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:03.652179  8717 tablet_bootstrap.cc:492] T d53340cc35954204b06e3743bec8adbf P b96ce9cc496c49d7818fa983a17b062b: Bootstrap complete.
I20260709 13:02:03.653023  8717 ts_tablet_manager.cc:1403] T d53340cc35954204b06e3743bec8adbf P b96ce9cc496c49d7818fa983a17b062b: Time spent bootstrapping tablet: real 0.398s	user 0.039s	sys 0.020s
I20260709 13:02:03.668550  8717 raft_consensus.cc:359] T d53340cc35954204b06e3743bec8adbf P b96ce9cc496c49d7818fa983a17b062b [term 18 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 13:02:03.672921  8717 raft_consensus.cc:740] T d53340cc35954204b06e3743bec8adbf P b96ce9cc496c49d7818fa983a17b062b [term 18 LEARNER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Initialized, Role: LEARNER
I20260709 13:02:03.673728  8717 consensus_queue.cc:260] T d53340cc35954204b06e3743bec8adbf P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 13:02:03.675809  1429 catalog_manager.cc:5697] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 21 to 22, leader changed from 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) to b96ce9cc496c49d7818fa983a17b062b (127.0.107.196). New cstate: current_term: 22 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:03.676883  8717 ts_tablet_manager.cc:1434] T d53340cc35954204b06e3743bec8adbf P b96ce9cc496c49d7818fa983a17b062b: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.002s
I20260709 13:02:03.683506  1616 tablet_copy_service.cc:342] P 39a92f5a4352465d8af3af5908fe8642: Request end of tablet copy session b96ce9cc496c49d7818fa983a17b062b-d53340cc35954204b06e3743bec8adbf received from {username='slave'} at 127.0.0.1:57268
I20260709 13:02:03.684051  1616 tablet_copy_service.cc:434] P 39a92f5a4352465d8af3af5908fe8642: ending tablet copy session b96ce9cc496c49d7818fa983a17b062b-d53340cc35954204b06e3743bec8adbf on tablet d53340cc35954204b06e3743bec8adbf with peer b96ce9cc496c49d7818fa983a17b062b
I20260709 13:02:03.684965  2218 raft_consensus.cc:1217] T d53340cc35954204b06e3743bec8adbf P b96ce9cc496c49d7818fa983a17b062b [term 18 LEARNER]: Deduplicated request from leader. Original: 18.11->[18.12-18.12]   Dedup: 18.12->[]
I20260709 13:02:03.724517  8742 tablet_copy_client.cc:806] T 3406989a2b754fe7804c691a11bba6d0 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:03.725152  8742 tablet_copy_client.cc:670] T 3406989a2b754fe7804c691a11bba6d0 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:03.732167  8742 tablet_copy_client.cc:538] T 3406989a2b754fe7804c691a11bba6d0 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:03.763374  8741 tablet_copy_client.cc:806] T 7d60bdd9b7f543e180698438c413d061 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:03.764777  8741 tablet_copy_client.cc:670] T 7d60bdd9b7f543e180698438c413d061 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:03.774518  8742 tablet_bootstrap.cc:492] T 3406989a2b754fe7804c691a11bba6d0 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap starting.
I20260709 13:02:03.776928  8741 tablet_copy_client.cc:538] T 7d60bdd9b7f543e180698438c413d061 P b96ce9cc496c49d7818fa983a17b062b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:03.800673  8741 tablet_bootstrap.cc:492] T 7d60bdd9b7f543e180698438c413d061 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap starting.
I20260709 13:02:03.962364  8722 tablet_bootstrap.cc:492] T 9a873ede2f0f418cbcab98586dba9b1e P b96ce9cc496c49d7818fa983a17b062b: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=0 applied=13 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:03.984231  8722 tablet_bootstrap.cc:492] T 9a873ede2f0f418cbcab98586dba9b1e P b96ce9cc496c49d7818fa983a17b062b: Bootstrap complete.
I20260709 13:02:03.985021  8722 ts_tablet_manager.cc:1403] T 9a873ede2f0f418cbcab98586dba9b1e P b96ce9cc496c49d7818fa983a17b062b: Time spent bootstrapping tablet: real 0.380s	user 0.045s	sys 0.008s
I20260709 13:02:04.029206  8722 raft_consensus.cc:359] T 9a873ede2f0f418cbcab98586dba9b1e P b96ce9cc496c49d7818fa983a17b062b [term 21 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 13:02:04.030117  8722 raft_consensus.cc:740] T 9a873ede2f0f418cbcab98586dba9b1e P b96ce9cc496c49d7818fa983a17b062b [term 21 LEARNER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Initialized, Role: LEARNER
I20260709 13:02:04.039565  8722 consensus_queue.cc:260] T 9a873ede2f0f418cbcab98586dba9b1e P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 13:02:04.080921  8722 ts_tablet_manager.cc:1434] T 9a873ede2f0f418cbcab98586dba9b1e P b96ce9cc496c49d7818fa983a17b062b: Time spent starting tablet: real 0.096s	user 0.002s	sys 0.006s
I20260709 13:02:04.100819  1616 tablet_copy_service.cc:342] P 39a92f5a4352465d8af3af5908fe8642: Request end of tablet copy session b96ce9cc496c49d7818fa983a17b062b-9a873ede2f0f418cbcab98586dba9b1e received from {username='slave'} at 127.0.0.1:57268
I20260709 13:02:04.101282  1616 tablet_copy_service.cc:434] P 39a92f5a4352465d8af3af5908fe8642: ending tablet copy session b96ce9cc496c49d7818fa983a17b062b-9a873ede2f0f418cbcab98586dba9b1e on tablet 9a873ede2f0f418cbcab98586dba9b1e with peer b96ce9cc496c49d7818fa983a17b062b
I20260709 13:02:04.101718  8666 raft_consensus.cc:1064] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642: attempting to promote NON_VOTER b96ce9cc496c49d7818fa983a17b062b to VOTER
I20260709 13:02:04.104327  8666 consensus_queue.cc:237] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 10, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:04.140692  1603 raft_consensus.cc:1275] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 22 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 21 index: 18. Preceding OpId from leader: term: 22 index: 19. (index mismatch)
I20260709 13:02:04.145707  1673 raft_consensus.cc:1275] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 22 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 21 index: 18. Preceding OpId from leader: term: 22 index: 19. (index mismatch)
I20260709 13:02:04.145808  8698 consensus_queue.cc:1048] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 13:02:04.154398  8738 consensus_queue.cc:1048] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 13:02:04.176062  2218 raft_consensus.cc:1217] T 9a873ede2f0f418cbcab98586dba9b1e P b96ce9cc496c49d7818fa983a17b062b [term 21 LEARNER]: Deduplicated request from leader. Original: 21.12->[21.13-21.13]   Dedup: 21.13->[]
I20260709 13:02:04.199292  1531 raft_consensus.cc:1275] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:02:04.213342  8579 consensus_queue.cc:1048] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:02:04.228664  2222 raft_consensus.cc:1275] T d53340cc35954204b06e3743bec8adbf P b96ce9cc496c49d7818fa983a17b062b [term 18 LEARNER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:02:04.238907  8666 consensus_queue.cc:1048] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:02:04.317924   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:04.344022  8730 raft_consensus.cc:2955] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 18 LEADER]: Committing config change with OpId 18.13: config changed from index 12 to 13, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:02:04.349678  2222 raft_consensus.cc:2955] T d53340cc35954204b06e3743bec8adbf P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 12 to 13, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:02:04.389176  8742 tablet_bootstrap.cc:492] T 3406989a2b754fe7804c691a11bba6d0 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=0 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:04.391523  1423 catalog_manager.cc:5697] T d53340cc35954204b06e3743bec8adbf P b96ce9cc496c49d7818fa983a17b062b reported cstate change: config changed from index 12 to 13, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 18 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:02:04.404579  8742 tablet_bootstrap.cc:492] T 3406989a2b754fe7804c691a11bba6d0 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap complete.
I20260709 13:02:04.405782  8742 ts_tablet_manager.cc:1403] T 3406989a2b754fe7804c691a11bba6d0 P b96ce9cc496c49d7818fa983a17b062b: Time spent bootstrapping tablet: real 0.632s	user 0.068s	sys 0.057s
I20260709 13:02:04.408948  8741 tablet_bootstrap.cc:492] T 7d60bdd9b7f543e180698438c413d061 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:04.416553  8741 tablet_bootstrap.cc:492] T 7d60bdd9b7f543e180698438c413d061 P b96ce9cc496c49d7818fa983a17b062b: Bootstrap complete.
I20260709 13:02:04.417443  8741 ts_tablet_manager.cc:1403] T 7d60bdd9b7f543e180698438c413d061 P b96ce9cc496c49d7818fa983a17b062b: Time spent bootstrapping tablet: real 0.617s	user 0.049s	sys 0.028s
I20260709 13:02:04.443867  1675 raft_consensus.cc:2955] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 12 to 13, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:02:04.461894  8741 raft_consensus.cc:359] T 7d60bdd9b7f543e180698438c413d061 P b96ce9cc496c49d7818fa983a17b062b [term 19 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 13:02:04.462914  8741 raft_consensus.cc:740] T 7d60bdd9b7f543e180698438c413d061 P b96ce9cc496c49d7818fa983a17b062b [term 19 LEARNER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Initialized, Role: LEARNER
I20260709 13:02:04.463649  8741 consensus_queue.cc:260] T 7d60bdd9b7f543e180698438c413d061 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 13:02:04.469841  8741 ts_tablet_manager.cc:1434] T 7d60bdd9b7f543e180698438c413d061 P b96ce9cc496c49d7818fa983a17b062b: Time spent starting tablet: real 0.052s	user 0.006s	sys 0.000s
I20260709 13:02:04.479336  1690 tablet_copy_service.cc:342] P ddf11fc190dd4b898773379c6b129d90: Request end of tablet copy session b96ce9cc496c49d7818fa983a17b062b-7d60bdd9b7f543e180698438c413d061 received from {username='slave'} at 127.0.0.1:50664
I20260709 13:02:04.479846  1690 tablet_copy_service.cc:434] P ddf11fc190dd4b898773379c6b129d90: ending tablet copy session b96ce9cc496c49d7818fa983a17b062b-7d60bdd9b7f543e180698438c413d061 on tablet 7d60bdd9b7f543e180698438c413d061 with peer b96ce9cc496c49d7818fa983a17b062b
I20260709 13:02:04.490584  8742 raft_consensus.cc:359] T 3406989a2b754fe7804c691a11bba6d0 P b96ce9cc496c49d7818fa983a17b062b [term 16 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 13:02:04.499925  1531 raft_consensus.cc:2955] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 12 to 13, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:02:04.525398  2222 raft_consensus.cc:1217] T 7d60bdd9b7f543e180698438c413d061 P b96ce9cc496c49d7818fa983a17b062b [term 19 LEARNER]: Deduplicated request from leader. Original: 19.10->[19.11-19.11]   Dedup: 19.11->[]
I20260709 13:02:04.491570  8742 raft_consensus.cc:740] T 3406989a2b754fe7804c691a11bba6d0 P b96ce9cc496c49d7818fa983a17b062b [term 16 LEARNER]: Becoming Follower/Learner. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Initialized, Role: LEARNER
I20260709 13:02:04.530352  8742 consensus_queue.cc:260] T 3406989a2b754fe7804c691a11bba6d0 P b96ce9cc496c49d7818fa983a17b062b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 13:02:04.564473  8742 ts_tablet_manager.cc:1434] T 3406989a2b754fe7804c691a11bba6d0 P b96ce9cc496c49d7818fa983a17b062b: Time spent starting tablet: real 0.142s	user 0.008s	sys 0.000s
I20260709 13:02:04.568969  1616 tablet_copy_service.cc:342] P 39a92f5a4352465d8af3af5908fe8642: Request end of tablet copy session b96ce9cc496c49d7818fa983a17b062b-3406989a2b754fe7804c691a11bba6d0 received from {username='slave'} at 127.0.0.1:57268
I20260709 13:02:04.569442  1616 tablet_copy_service.cc:434] P 39a92f5a4352465d8af3af5908fe8642: ending tablet copy session b96ce9cc496c49d7818fa983a17b062b-3406989a2b754fe7804c691a11bba6d0 on tablet 3406989a2b754fe7804c691a11bba6d0 with peer b96ce9cc496c49d7818fa983a17b062b
I20260709 13:02:04.569756   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
W20260709 13:02:04.626331  2190 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 3 similar messages]
W20260709 13:02:04.714012  1570 consensus_peers.cc:597] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:04.725139  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 100894us
W20260709 13:02:04.748402  1570 consensus_peers.cc:597] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:04.750371  1570 consensus_peers.cc:597] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:04.754103  1570 consensus_peers.cc:597] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:04.754743  2190 consensus_peers.cc:597] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:04.760986  2190 consensus_peers.cc:597] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:04.761744  2190 consensus_peers.cc:597] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:04.762706  2190 consensus_peers.cc:597] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:04.764312  2190 consensus_peers.cc:597] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:04.760362  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 65427us
I20260709 13:02:04.869863  8734 raft_consensus.cc:1064] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642: attempting to promote NON_VOTER b96ce9cc496c49d7818fa983a17b062b to VOTER
W20260709 13:02:04.879305  1644 consensus_peers.cc:597] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:04.942327  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 84883.6us
W20260709 13:02:04.955678  1644 consensus_peers.cc:597] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:04.962064  1570 consensus_peers.cc:597] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:04.964218  1644 consensus_peers.cc:597] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:04.969398  1644 consensus_peers.cc:597] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:04.970126  1644 consensus_peers.cc:597] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:04.918454  8734 consensus_queue.cc:237] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 11, Current term: 21, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:02:04.975039  1644 consensus_peers.cc:597] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:04.986086  1570 consensus_peers.cc:597] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:04.999192  1570 consensus_peers.cc:597] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:05.008492  1570 consensus_peers.cc:597] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:05.056658  1602 consensus_queue.cc:237] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:05.088789  2222 raft_consensus.cc:1217] T 3406989a2b754fe7804c691a11bba6d0 P b96ce9cc496c49d7818fa983a17b062b [term 16 LEARNER]: Deduplicated request from leader. Original: 16.11->[16.12-16.12]   Dedup: 16.12->[]
I20260709 13:02:05.097481  2218 raft_consensus.cc:1275] T d53340cc35954204b06e3743bec8adbf P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:02:05.118476  8777 raft_consensus.cc:1064] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90: attempting to promote NON_VOTER b96ce9cc496c49d7818fa983a17b062b to VOTER
I20260709 13:02:05.121407  8777 consensus_queue.cc:237] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 9, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:02:05.130501  1644 consensus_peers.cc:597] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:05.106258  8699 consensus_queue.cc:1048] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.030s
W20260709 13:02:05.131934  1570 consensus_peers.cc:597] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:05.144922  1570 consensus_peers.cc:597] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:05.158272  2190 consensus_peers.cc:597] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:05.166626  2222 raft_consensus.cc:1275] T 9a873ede2f0f418cbcab98586dba9b1e P b96ce9cc496c49d7818fa983a17b062b [term 21 LEARNER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
W20260709 13:02:05.169343  2190 consensus_peers.cc:597] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:05.184800  1644 consensus_peers.cc:597] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:05.192248  1673 raft_consensus.cc:1275] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:02:05.205783   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:02:05.250816  2225 raft_consensus.cc:1275] T 7d60bdd9b7f543e180698438c413d061 P b96ce9cc496c49d7818fa983a17b062b [term 19 LEARNER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
W20260709 13:02:05.252918  2190 consensus_peers.cc:597] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:05.254010  2190 consensus_peers.cc:597] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:05.254670  2190 consensus_peers.cc:597] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:05.269526  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 83899us
I20260709 13:02:05.265374   431 tablet_replica.cc:333] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1: stopping tablet replica
I20260709 13:02:05.253400  8734 raft_consensus.cc:2955] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 18 LEADER]: Committing config change with OpId 18.14: config changed from index 13 to 14, VOTER ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:02:05.240626  8699 consensus_queue.cc:1048] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.028s
W20260709 13:02:05.285713  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 61058.4us
I20260709 13:02:05.293510   431 raft_consensus.cc:2243] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:05.294515   431 raft_consensus.cc:2272] T 83ed1c1e27234d98ba5eeb14457a4ee2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.297860   431 tablet_replica.cc:333] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1: stopping tablet replica
I20260709 13:02:05.303175  1602 raft_consensus.cc:1275] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:02:05.323212   431 raft_consensus.cc:2243] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:05.305603  2225 raft_consensus.cc:2955] T d53340cc35954204b06e3743bec8adbf P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Committing config change with OpId 18.14: config changed from index 13 to 14, VOTER ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:02:05.280480  8777 consensus_queue.cc:1048] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.047s
W20260709 13:02:05.331869  2190 consensus_peers.cc:597] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:05.382043  8788 consensus_queue.cc:1048] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.082s
W20260709 13:02:05.384096  1644 consensus_peers.cc:597] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:05.386300  8789 log.cc:927] Time spent T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:02:05.375748  8697 consensus_queue.cc:1048] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.044s
W20260709 13:02:05.442624  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 70206.4us
I20260709 13:02:05.444469   431 raft_consensus.cc:2272] T c0e4d309cca4449096f65b38755e557e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.475582  8700 raft_consensus.cc:493] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:02:05.478771  8700 raft_consensus.cc:515] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:02:05.480917  8700 leader_election.cc:290] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:02:05.520920  1571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 76243us
W20260709 13:02:05.526559  1497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 142987us
W20260709 13:02:05.552706  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 85385.4us
I20260709 13:02:05.561280   431 tablet_replica.cc:333] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1: stopping tablet replica
I20260709 13:02:05.579903  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:02:05.597529  1572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 59869.1us
W20260709 13:02:05.613196  1570 consensus_peers.cc:597] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:05.618427  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4faabc98f1164ba881cfb477657da505" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:02:05.585513   431 raft_consensus.cc:2243] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:02:05.621497   431 raft_consensus.cc:2272] T 04fed4c219e14efb9f9a8eb0d336ceac P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.624727   431 tablet_replica.cc:333] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1: stopping tablet replica
I20260709 13:02:05.637392  8799 raft_consensus.cc:1064] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642: attempting to promote NON_VOTER b96ce9cc496c49d7818fa983a17b062b to VOTER
I20260709 13:02:05.657609  8799 consensus_queue.cc:237] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 10, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:05.659544  8804 raft_consensus.cc:493] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:02:05.660224  8804 raft_consensus.cc:515] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:05.663264  8804 leader_election.cc:290] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:02:05.664062  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:02:05.665551  1416 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d53340cc35954204b06e3743bec8adbf with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:02:05.669698  8733 raft_consensus.cc:493] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:02:05.670360  8733 raft_consensus.cc:515] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:05.671777  1497 leader_election.cc:304] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:02:05.673252  8733 leader_election.cc:290] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:02:05.674768  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea5da45c6d2479383e6af85e0a394b5" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:02:05.674050  8796 raft_consensus.cc:2749] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:05.677836   431 raft_consensus.cc:2243] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:02:05.681622  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:02:05.696520  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eadc97fd6dd494596f9ea9242d9db59" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:02:05.705539  1497 leader_election.cc:304] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
W20260709 13:02:05.707851  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 137273us
I20260709 13:02:05.712512   431 raft_consensus.cc:2272] T 0ff83996d65d44e1925b89ba8eacd311 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.711915  8796 raft_consensus.cc:493] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:02:05.716060  8796 raft_consensus.cc:515] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:05.718221  8796 leader_election.cc:290] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:02:05.719038  8757 raft_consensus.cc:493] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:02:05.719655  8757 raft_consensus.cc:515] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:02:05.721817  8757 leader_election.cc:290] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:02:05.722357  8757 raft_consensus.cc:2749] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:05.727736  8786 raft_consensus.cc:493] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:02:05.728403  8786 raft_consensus.cc:515] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:02:05.730094  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:02:05.732151  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:02:05.739974  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94d0d4cbe71742a39337e80ad5770e28" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:02:05.730572  8786 leader_election.cc:290] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:02:05.715332  1496 leader_election.cc:304] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:02:05.742153  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:02:05.761482  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 81893.6us
I20260709 13:02:05.762445  8784 raft_consensus.cc:2749] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:02:05.768527  8734 raft_consensus.cc:2955] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 21 LEADER]: Committing config change with OpId 21.14: config changed from index 13 to 14, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:02:05.771241  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bffb0971b74366af514d43d81b1d50" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:02:05.771955  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a7da8b76b845d39257f80dcbdf6b9a" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:02:05.773744   431 tablet_replica.cc:333] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1: stopping tablet replica
I20260709 13:02:05.774960   431 raft_consensus.cc:2243] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:05.775637   431 raft_consensus.cc:2272] T e78618eba8b74effa4a90f2c8e34cc02 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.777933  1673 raft_consensus.cc:2955] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Committing config change with OpId 21.14: config changed from index 13 to 14, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:02:05.778545   431 tablet_replica.cc:333] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1: stopping tablet replica
I20260709 13:02:05.781787  2222 raft_consensus.cc:2955] T 9a873ede2f0f418cbcab98586dba9b1e P b96ce9cc496c49d7818fa983a17b062b [term 21 FOLLOWER]: Committing config change with OpId 21.14: config changed from index 13 to 14, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:02:05.783996   431 raft_consensus.cc:2243] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 22 FOLLOWER]: Raft consensus shutting down.
W20260709 13:02:05.789937  1644 consensus_peers.cc:597] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:05.802153  8784 raft_consensus.cc:493] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:02:05.802809  8784 raft_consensus.cc:515] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:05.804958  8784 leader_election.cc:290] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:02:05.734762  1427 catalog_manager.cc:5697] T d53340cc35954204b06e3743bec8adbf P b96ce9cc496c49d7818fa983a17b062b reported cstate change: config changed from index 13 to 14, VOTER ddf11fc190dd4b898773379c6b129d90 (127.0.107.195) evicted. New cstate: current_term: 18 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:02:05.832314  8784 raft_consensus.cc:493] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:02:05.832908  8784 raft_consensus.cc:515] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:05.835156  8784 leader_election.cc:290] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:02:05.836047   431 raft_consensus.cc:2272] T 8ea5da45c6d2479383e6af85e0a394b5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.837108  8784 raft_consensus.cc:493] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:02:05.837625  8784 raft_consensus.cc:515] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:02:05.839516   431 tablet_replica.cc:333] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1: stopping tablet replica
I20260709 13:02:05.839807  8784 leader_election.cc:290] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:02:05.847915  1496 leader_election.cc:304] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:02:05.848613   431 raft_consensus.cc:2243] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:05.850651   431 raft_consensus.cc:2272] T a7cff69bd4394da195321efd78d5a703 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.853946   431 tablet_replica.cc:333] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1: stopping tablet replica
I20260709 13:02:05.854612  8786 raft_consensus.cc:2749] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:02:05.858109  1497 leader_election.cc:304] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:02:05.864375  8784 raft_consensus.cc:2749] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:05.880905  1496 leader_election.cc:304] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:02:05.886504  8784 raft_consensus.cc:2749] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:02:05.886590  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:02:05.882311   431 raft_consensus.cc:2243] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:05.891374  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:02:05.894205   431 raft_consensus.cc:2272] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.895677  8784 raft_consensus.cc:493] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:02:05.898072  8784 raft_consensus.cc:515] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:02:05.898350  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:37373, user_credentials={real_user=slave}} blocked reactor thread for 50551.4us
I20260709 13:02:05.903077  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad30336a5440bca17cda2724035211" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:02:05.904300  8784 leader_election.cc:290] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:02:05.906852  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:02:05.908993  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7352869c54614c80af4953b2ce90cace" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:02:05.910327  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93811be2a8094a489bcf8091e503f2c9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:02:05.917860   431 tablet_replica.cc:333] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1: stopping tablet replica
I20260709 13:02:05.918833   431 raft_consensus.cc:2243] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:02:05.926077  8784 raft_consensus.cc:493] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:02:05.927924  8784 raft_consensus.cc:515] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:02:05.930003  8784 leader_election.cc:290] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:02:05.932838  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:02:05.932870  8786 raft_consensus.cc:493] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:02:05.933728  8786 raft_consensus.cc:515] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:02:05.936111  8786 leader_election.cc:290] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:02:05.937568  8784 raft_consensus.cc:493] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:02:05.938359  8784 raft_consensus.cc:515] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 13:02:05.940855  8784 leader_election.cc:290] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:02:05.943099  8786 raft_consensus.cc:493] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:02:05.943638  2221 raft_consensus.cc:1275] T 3406989a2b754fe7804c691a11bba6d0 P b96ce9cc496c49d7818fa983a17b062b [term 16 LEARNER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:02:05.943778  8757 raft_consensus.cc:493] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:02:05.961526  8786 raft_consensus.cc:515] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:05.961920  8757 raft_consensus.cc:515] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:02:05.963733  8786 leader_election.cc:290] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:02:05.963845  8757 leader_election.cc:290] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:02:05.945075  8796 raft_consensus.cc:493] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:02:05.964776  8796 raft_consensus.cc:515] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:05.965237  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:02:05.965972  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:02:05.968112  8796 leader_election.cc:290] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:02:05.947288  1424 catalog_manager.cc:5697] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 reported cstate change: config changed from index 13 to 14, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 21 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:02:05.969535  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:02:05.950582  1673 raft_consensus.cc:1275] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:02:05.953668  8700 raft_consensus.cc:493] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:02:05.970278  8700 raft_consensus.cc:515] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:05.972322  8700 leader_election.cc:290] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:02:05.955893  8804 raft_consensus.cc:493] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:02:05.972965  8804 raft_consensus.cc:515] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:05.975003  8804 leader_election.cc:290] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:02:05.975458  8804 raft_consensus.cc:493] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:02:05.975968  8804 raft_consensus.cc:515] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:05.976965  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:02:05.977871  8804 leader_election.cc:290] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:02:05.956820  8809 raft_consensus.cc:2955] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 19 LEADER]: Committing config change with OpId 19.12: config changed from index 11 to 12, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:02:05.958302  8733 raft_consensus.cc:493] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:02:05.979130  8733 raft_consensus.cc:515] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:02:05.960937   431 raft_consensus.cc:2272] T bf3b3cd19c1e496fa7fdb5550772123b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.983680  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b906ca026f44e76913719f278eed7d3" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:02:05.984747  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 80114.5us
I20260709 13:02:05.985909  8733 leader_election.cc:290] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:02:05.986581  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e83a626139459097bb40dc22d9bd93" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:02:05.987506  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b325904f4646bca264eeeea15dfeb0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:02:05.988516  8799 consensus_queue.cc:1048] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.013s
I20260709 13:02:06.006922  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:02:06.007517  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:02:06.009006  8734 consensus_queue.cc:1048] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:02:06.015882  8733 raft_consensus.cc:493] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:02:06.016603  8733 raft_consensus.cc:515] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:06.015854  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:02:06.017709  1602 raft_consensus.cc:2955] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Committing config change with OpId 19.12: config changed from index 11 to 12, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:02:06.021729  8733 leader_election.cc:290] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:02:06.022009  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:02:06.029363  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:02:05.988273   431 tablet_replica.cc:333] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1: stopping tablet replica
I20260709 13:02:06.042115  8784 raft_consensus.cc:493] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:02:06.044727  8796 raft_consensus.cc:493] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:02:06.045384  8796 raft_consensus.cc:515] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:06.047677  8796 leader_election.cc:290] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:02:06.042832  8784 raft_consensus.cc:515] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:06.049911  8784 leader_election.cc:290] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:02:06.053962   431 raft_consensus.cc:2243] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:06.056641   431 raft_consensus.cc:2272] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:06.059170  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:02:06.060163  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:02:06.063314  1497 leader_election.cc:304] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:02:06.067625  2222 raft_consensus.cc:2955] T 7d60bdd9b7f543e180698438c413d061 P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Committing config change with OpId 19.12: config changed from index 11 to 12, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
W20260709 13:02:06.070355  1497 raft_consensus.cc:2686] T 7352869c54614c80af4953b2ce90cace P e46412b3b0b44f01ad5c33d4cfe3d6b1: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:02:06.071615   431 tablet_replica.cc:333] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1: stopping tablet replica
I20260709 13:02:06.073154   431 raft_consensus.cc:2243] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:06.078557   431 raft_consensus.cc:2272] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:06.082104  1497 leader_election.cc:304] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:02:06.085005   431 tablet_replica.cc:333] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1: stopping tablet replica
I20260709 13:02:06.085925   431 raft_consensus.cc:2243] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:06.086866   431 raft_consensus.cc:2272] T d53340cc35954204b06e3743bec8adbf P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:06.088718  8733 raft_consensus.cc:2749] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:06.090032  1497 leader_election.cc:304] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
W20260709 13:02:06.090771  1497 raft_consensus.cc:2686] T 93811be2a8094a489bcf8091e503f2c9 P e46412b3b0b44f01ad5c33d4cfe3d6b1: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:02:06.093071  1497 leader_election.cc:304] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:02:06.093801  8733 raft_consensus.cc:2749] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:06.095103  1497 leader_election.cc:304] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:02:06.095863  8733 raft_consensus.cc:2749] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:06.095520  8666 raft_consensus.cc:2955] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 16 LEADER]: Committing config change with OpId 16.13: config changed from index 12 to 13, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:02:06.097456  1497 leader_election.cc:304] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:02:06.100396  8733 raft_consensus.cc:2749] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:06.108913  2221 raft_consensus.cc:2955] T 3406989a2b754fe7804c691a11bba6d0 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 12 to 13, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:02:06.111443  1497 leader_election.cc:304] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:02:06.112772   431 tablet_replica.cc:333] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1: stopping tablet replica
I20260709 13:02:06.113658   431 raft_consensus.cc:2243] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:02:06.116067  8733 raft_consensus.cc:2749] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:06.118207  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:02:06.118871  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "112134ca2a6243c98c85c27d41496747" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:02:06.123202  1674 raft_consensus.cc:2955] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 12 to 13, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:02:06.137655  1664 tablet_service.cc:1558] Processing DeleteTablet for tablet d53340cc35954204b06e3743bec8adbf with delete_type TABLET_DATA_TOMBSTONED (TS ddf11fc190dd4b898773379c6b129d90 not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:51000
I20260709 13:02:06.151304  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5802fa5e328499da4525506ccdf4dc9" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:02:06.152865   431 raft_consensus.cc:2272] T c1d40b53631d4998a9a462e3c91a3004 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:06.167443  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb48619ad4f74c71a726835ef5a8b4c2" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:02:06.152225  2222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "429fe651e8bc487eb6f07e38a7c3cb41" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:02:06.179224  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b7b5b00d91c4b488d16174662489496" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:02:06.180896  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:02:06.182108  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e096d30f7404398b10b9cd77da3c04c" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:02:06.184170   431 tablet_replica.cc:333] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1: stopping tablet replica
I20260709 13:02:06.185034   431 raft_consensus.cc:2243] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:06.186033  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:02:06.188687  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a031a0ef86384487bd1f89ead66f851b" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:02:06.189493  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4adfe2190c4487ab72be02d6cfa923" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:02:06.190349  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3dd6988dfbe43e0ac446b79d37d9c24" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:02:06.191462  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72071486140c4d6c919b25e882a8f5e5" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:02:06.189510  8817 tablet_replica.cc:333] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90: stopping tablet replica
I20260709 13:02:06.193121  8817 raft_consensus.cc:2243] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:06.194048  8817 raft_consensus.cc:2272] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:06.197372  8817 ts_tablet_manager.cc:1916] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:02:06.205281  1496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44217, user_credentials={real_user=slave}} blocked reactor thread for 50374.4us
I20260709 13:02:06.207023  8700 raft_consensus.cc:493] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:02:06.207628  8700 raft_consensus.cc:515] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 13:02:06.209766  8700 leader_election.cc:290] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:02:06.215277  8733 raft_consensus.cc:493] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:02:06.215718  8804 raft_consensus.cc:493] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b96ce9cc496c49d7818fa983a17b062b)
I20260709 13:02:06.224839  1427 catalog_manager.cc:5697] T 7d60bdd9b7f543e180698438c413d061 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: config changed from index 11 to 12, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 19 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:02:06.223160   431 raft_consensus.cc:2272] T 94d0d4cbe71742a39337e80ad5770e28 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:06.216609  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:02:06.225965  8804 raft_consensus.cc:515] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:06.229907  8804 leader_election.cc:290] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:02:06.230486  8733 raft_consensus.cc:515] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } attrs { replace: true } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: true } }
I20260709 13:02:06.231357   431 tablet_replica.cc:333] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1: stopping tablet replica
I20260709 13:02:06.232734  8733 leader_election.cc:290] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:02:06.236474  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60bdd9b7f543e180698438c413d061" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:02:06.239532  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:02:06.240144  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:02:06.240417   431 raft_consensus.cc:2243] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:06.243410  1497 leader_election.cc:304] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:02:06.244331  1497 leader_election.cc:304] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:02:06.244848  1427 catalog_manager.cc:5697] T 3406989a2b754fe7804c691a11bba6d0 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: config changed from index 12 to 13, b96ce9cc496c49d7818fa983a17b062b (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 16 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:02:06.245476  8804 raft_consensus.cc:2749] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:06.248337  1497 leader_election.cc:304] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:02:06.250236  8700 raft_consensus.cc:2749] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:06.249816   431 raft_consensus.cc:2272] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:06.250860  1497 leader_election.cc:304] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
W20260709 13:02:06.251906  1570 consensus_peers.cc:597] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:06.252553  1497 leader_election.cc:304] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
I20260709 13:02:06.246150  8733 raft_consensus.cc:2749] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:02:06.253180  8700 raft_consensus.cc:2749] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:02:06.255462  1497 raft_consensus.cc:2686] T f3dd6988dfbe43e0ac446b79d37d9c24 P e46412b3b0b44f01ad5c33d4cfe3d6b1: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:02:06.255446   431 tablet_replica.cc:333] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1: stopping tablet replica
I20260709 13:02:06.259305  1497 leader_election.cc:304] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:02:06.259642   431 raft_consensus.cc:2243] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:02:06.262141  8817 ts_tablet_manager.cc:1929] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 18.13
I20260709 13:02:06.262686  8817 log.cc:1199] T d53340cc35954204b06e3743bec8adbf P ddf11fc190dd4b898773379c6b129d90: Deleting WAL directory at /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601891739070-431-0/minicluster-data/ts-2-root/wals/d53340cc35954204b06e3743bec8adbf
I20260709 13:02:06.269200  8700 raft_consensus.cc:2749] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:06.269315   431 raft_consensus.cc:2272] T ad4dae0957134e9aba74a14dc8984866 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:06.270340  1497 leader_election.cc:304] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:02:06.271891  8700 raft_consensus.cc:2749] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:02:06.273209  1497 leader_election.cc:304] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:02:06.273861   431 tablet_replica.cc:333] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1: stopping tablet replica
I20260709 13:02:06.273921  8700 raft_consensus.cc:2749] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:06.274909   431 raft_consensus.cc:2243] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:06.275530   431 raft_consensus.cc:2272] T 21e83a626139459097bb40dc22d9bd93 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:06.277670  1415 catalog_manager.cc:5028] TS ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217): tablet d53340cc35954204b06e3743bec8adbf (table test-workload [id=6fe25a76c53245aa8917d711cfb17d8f]) successfully deleted
I20260709 13:02:06.278282   431 tablet_replica.cc:333] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1: stopping tablet replica
I20260709 13:02:06.278498  1497 leader_election.cc:304] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:02:06.279284  8700 raft_consensus.cc:2749] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:06.279275   431 raft_consensus.cc:2243] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:06.282514   431 raft_consensus.cc:2272] T 43a7da8b76b845d39257f80dcbdf6b9a P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:06.285367   431 tablet_replica.cc:333] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1: stopping tablet replica
I20260709 13:02:06.286258   431 raft_consensus.cc:2243] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:02:06.283062  1497 leader_election.cc:304] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:02:06.290940  8700 raft_consensus.cc:2749] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:06.292970   431 raft_consensus.cc:2272] T 1975e24877834ab7ae6da515a5cf6251 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:06.295915   431 tablet_replica.cc:333] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1: stopping tablet replica
I20260709 13:02:06.299119   431 raft_consensus.cc:2243] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:02:06.300263   431 raft_consensus.cc:2272] T cbe75e7a89594d3f81b1b8935b43b2ed P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:06.303613  1497 leader_election.cc:304] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:02:06.305313  8700 raft_consensus.cc:2749] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:06.307514  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2228d923442c4e439f7f227db910dad8" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 13:02:06.313894  1571 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:06.314232  1603 consensus_queue.cc:237] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:06.319859   431 tablet_replica.cc:333] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1: stopping tablet replica
I20260709 13:02:06.322453  1606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:02:06.328492   431 raft_consensus.cc:2243] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:02:06.330037  2221 raft_consensus.cc:1275] T 9a873ede2f0f418cbcab98586dba9b1e P b96ce9cc496c49d7818fa983a17b062b [term 21 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:02:06.333335  8791 consensus_queue.cc:1048] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:02:06.333811  1674 raft_consensus.cc:1275] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:02:06.337553  8791 consensus_queue.cc:1048] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:02:06.333843   431 raft_consensus.cc:2272] T 770925e70faa4a16a275abd5282f5284 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:06.342885  1497 leader_election.cc:304] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:02:06.347594  8734 raft_consensus.cc:2955] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 21 LEADER]: Committing config change with OpId 21.15: config changed from index 14 to 15, VOTER e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:02:06.349488  8700 raft_consensus.cc:2749] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:02:06.356011  1497 leader_election.cc:304] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e46412b3b0b44f01ad5c33d4cfe3d6b1; no voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90
W20260709 13:02:06.356771  1497 raft_consensus.cc:2686] T 2228d923442c4e439f7f227db910dad8 P e46412b3b0b44f01ad5c33d4cfe3d6b1: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:02:06.359761   431 tablet_replica.cc:333] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1: stopping tablet replica
I20260709 13:02:06.360642   431 raft_consensus.cc:2243] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:06.364073   431 raft_consensus.cc:2272] T d0b325904f4646bca264eeeea15dfeb0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:06.363801  2219 raft_consensus.cc:2955] T 9a873ede2f0f418cbcab98586dba9b1e P b96ce9cc496c49d7818fa983a17b062b [term 21 FOLLOWER]: Committing config change with OpId 21.15: config changed from index 14 to 15, VOTER e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:02:06.380616   431 tablet_replica.cc:333] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1: stopping tablet replica
I20260709 13:02:06.379932  1674 raft_consensus.cc:2955] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Committing config change with OpId 21.15: config changed from index 14 to 15, VOTER e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } } }
I20260709 13:02:06.395354   431 raft_consensus.cc:2243] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:06.396797  1416 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9a873ede2f0f418cbcab98586dba9b1e with cas_config_opid_index 14: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:02:06.396550   431 raft_consensus.cc:2272] T 72071486140c4d6c919b25e882a8f5e5 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:06.411867  1424 catalog_manager.cc:5697] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: config changed from index 14 to 15, VOTER e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) evicted. New cstate: current_term: 21 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:06.426287   431 tablet_replica.cc:333] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1: stopping tablet replica
I20260709 13:02:06.427223   431 raft_consensus.cc:2243] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:06.427999   431 raft_consensus.cc:2272] T 9a873ede2f0f418cbcab98586dba9b1e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:06.441190   431 tablet_replica.cc:333] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1: stopping tablet replica
I20260709 13:02:06.444798   431 raft_consensus.cc:2243] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:02:06.454471   431 raft_consensus.cc:2272] T 9f373c2c361f4fafa5411e39387ef06e P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:06.459477   431 tablet_replica.cc:333] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1: stopping tablet replica
I20260709 13:02:06.460404   431 raft_consensus.cc:2243] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:02:06.461535   431 raft_consensus.cc:2272] T 64842f503da44f59896ed29b9edd3b29 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:06.464170   431 tablet_replica.cc:333] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1: stopping tablet replica
I20260709 13:02:06.464936   431 raft_consensus.cc:2243] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:06.465581   431 raft_consensus.cc:2272] T bb48619ad4f74c71a726835ef5a8b4c2 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:06.475243   431 tablet_replica.cc:333] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1: stopping tablet replica
I20260709 13:02:06.476073   431 raft_consensus.cc:2243] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:06.476856   431 raft_consensus.cc:2272] T 112134ca2a6243c98c85c27d41496747 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:06.492349   431 tablet_replica.cc:333] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1: stopping tablet replica
I20260709 13:02:06.495795   431 raft_consensus.cc:2243] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:02:06.496914   431 raft_consensus.cc:2272] T 2abb9a42c35f4b6386342bccdff6fbf0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:06.501636  1414 catalog_manager.cc:4755] TS e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 9a873ede2f0f418cbcab98586dba9b1e: Remote error: Service unavailable: service kudu.tserver.TabletServerAdminService not registered on TabletServer
I20260709 13:02:06.512072   431 tablet_replica.cc:333] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1: stopping tablet replica
I20260709 13:02:06.514501   431 raft_consensus.cc:2243] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:02:06.515700   431 raft_consensus.cc:2272] T fbb85f388454464192e052f706a78e65 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:06.535789   431 tablet_replica.cc:333] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1: stopping tablet replica
I20260709 13:02:06.537899   431 raft_consensus.cc:2243] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:06.538514   431 raft_consensus.cc:2272] T 9b906ca026f44e76913719f278eed7d3 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:06.548300   431 tablet_replica.cc:333] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1: stopping tablet replica
I20260709 13:02:06.549026   431 raft_consensus.cc:2243] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:06.549612   431 raft_consensus.cc:2272] T 8e096d30f7404398b10b9cd77da3c04c P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:06.568742   431 tablet_replica.cc:333] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1: stopping tablet replica
I20260709 13:02:06.584141  8800 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 25 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:02:06.584781  8800 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:06.586906  8800 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:02:06.588346  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:02:06.591359  2190 leader_election.cc:336] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:06.591892  2190 leader_election.cc:304] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:02:06.592998  8800 raft_consensus.cc:2749] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:02:06.591411   431 raft_consensus.cc:2243] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:06.599175   431 raft_consensus.cc:2272] T dcad30336a5440bca17cda2724035211 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:06.601939   431 tablet_replica.cc:333] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1: stopping tablet replica
I20260709 13:02:06.602789   431 raft_consensus.cc:2243] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:02:06.603979   431 raft_consensus.cc:2272] T 53176f970a394c5cb2c76bd88f09c751 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:06.630800   431 tablet_replica.cc:333] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1: stopping tablet replica
I20260709 13:02:06.631569   431 raft_consensus.cc:2243] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:06.632308   431 raft_consensus.cc:2272] T a5802fa5e328499da4525506ccdf4dc9 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:06.648223   431 tablet_replica.cc:333] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1: stopping tablet replica
I20260709 13:02:06.648979   431 raft_consensus.cc:2243] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:06.649680   431 raft_consensus.cc:2272] T 2eadc97fd6dd494596f9ea9242d9db59 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:06.652328   431 tablet_replica.cc:333] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1: stopping tablet replica
I20260709 13:02:06.653059   431 raft_consensus.cc:2243] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:06.653703   431 raft_consensus.cc:2272] T 9b7b5b00d91c4b488d16174662489496 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:06.669348   431 tablet_replica.cc:333] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1: stopping tablet replica
I20260709 13:02:06.670105   431 raft_consensus.cc:2243] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:06.670816   431 raft_consensus.cc:2272] T 3406989a2b754fe7804c691a11bba6d0 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:06.673237  8734 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:02:06.673856  8734 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:06.676162  8734 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:02:06.677632  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:02:06.678303  2226 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 25.
I20260709 13:02:06.679550  1572 leader_election.cc:304] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:02:06.680373  8734 raft_consensus.cc:2804] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:02:06.680747  8734 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 25 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:02:06.681123  8734 raft_consensus.cc:3060] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:02:06.686261  1570 leader_election.cc:336] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:06.692785  8734 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:02:06.700153  1570 leader_election.cc:336] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:06.702718  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fed4c219e14efb9f9a8eb0d336ceac" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:02:06.703393  2226 raft_consensus.cc:3060] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:02:06.710877  2226 raft_consensus.cc:2468] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 26.
I20260709 13:02:06.712319  1572 leader_election.cc:304] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:02:06.712777  8734 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 26 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:02:06.713351  8666 raft_consensus.cc:2804] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:02:06.715880  8666 raft_consensus.cc:697] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 26 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:02:06.716796  8666 consensus_queue.cc:237] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.17, Last appended by leader: 17, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:06.673233   431 tablet_replica.cc:333] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1: stopping tablet replica
I20260709 13:02:06.721853   431 raft_consensus.cc:2243] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:02:06.723220   431 raft_consensus.cc:2272] T 7b4d826f7c344b45b7de4b9f69ea958b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:06.761230  8809 raft_consensus.cc:493] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:02:06.761780  8809 raft_consensus.cc:515] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:02:06.763016   431 tablet_replica.cc:333] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1: stopping tablet replica
I20260709 13:02:06.763960   431 raft_consensus.cc:2243] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Raft consensus shutting down.
W20260709 13:02:06.766934  1644 leader_election.cc:336] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:06.769214   431 raft_consensus.cc:2272] T 4faabc98f1164ba881cfb477657da505 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:06.774288   431 tablet_replica.cc:333] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1: stopping tablet replica
I20260709 13:02:06.777287   431 raft_consensus.cc:2243] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:06.781142  8809 leader_election.cc:290] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:02:06.781332  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:02:06.785748   431 raft_consensus.cc:2272] T 1e4adfe2190c4487ab72be02d6cfa923 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:06.786765  1646 leader_election.cc:304] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:02:06.788321  1424 catalog_manager.cc:5697] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 25 to 26, leader changed from e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) to 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194). New cstate: current_term: 26 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:06.792819  8809 raft_consensus.cc:2749] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:06.829878   431 tablet_replica.cc:333] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1: stopping tablet replica
I20260709 13:02:06.830708   431 raft_consensus.cc:2243] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:06.831422   431 raft_consensus.cc:2272] T 7d60bdd9b7f543e180698438c413d061 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:06.834808   431 tablet_replica.cc:333] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1: stopping tablet replica
I20260709 13:02:06.835515   431 raft_consensus.cc:2243] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:02:06.836658   431 raft_consensus.cc:2272] T 317204271cc04f68818b36450c9725b1 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:06.843190   431 tablet_replica.cc:333] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1: stopping tablet replica
I20260709 13:02:06.844229   431 raft_consensus.cc:2243] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:06.845335   431 raft_consensus.cc:2272] T 429fe651e8bc487eb6f07e38a7c3cb41 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:06.873068   431 tablet_replica.cc:333] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1: stopping tablet replica
I20260709 13:02:06.873800   431 raft_consensus.cc:2243] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:06.874441   431 raft_consensus.cc:2272] T c6bffb0971b74366af514d43d81b1d50 P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:06.907665  8666 raft_consensus.cc:493] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:02:06.908226  8666 raft_consensus.cc:515] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:02:06.931011  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:02:06.931689  1674 raft_consensus.cc:2468] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 15.
I20260709 13:02:06.934969  1571 leader_election.cc:304] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:02:06.940678  8791 raft_consensus.cc:2804] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:06.941335  8791 raft_consensus.cc:493] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:02:06.942595  8791 raft_consensus.cc:3060] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:02:06.945420  2190 consensus_peers.cc:597] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:06.952055  8791 raft_consensus.cc:515] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:02:06.961086  8666 leader_election.cc:290] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:02:06.962150  8791 leader_election.cc:290] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 16 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:02:06.964975  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff83996d65d44e1925b89ba8eacd311" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:02:06.969164  1674 raft_consensus.cc:3060] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:06.981834  1674 raft_consensus.cc:2468] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 16.
W20260709 13:02:06.998030  1570 leader_election.cc:336] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:06.999831   431 tablet_replica.cc:333] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1: stopping tablet replica
W20260709 13:02:07.003067  2190 consensus_peers.cc:597] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:07.005487  1570 leader_election.cc:336] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:07.007660   431 raft_consensus.cc:2243] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:07.009318   431 raft_consensus.cc:2272] T a031a0ef86384487bd1f89ead66f851b P e46412b3b0b44f01ad5c33d4cfe3d6b1 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:07.018313  1571 leader_election.cc:304] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:02:07.019671  8791 raft_consensus.cc:2804] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:07.020237  8791 raft_consensus.cc:697] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 16 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:02:07.021123  8791 consensus_queue.cc:237] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:02:07.077877  1424 catalog_manager.cc:5697] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 15 to 16, leader changed from e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) to 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194). New cstate: current_term: 16 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:07.108389  2190 consensus_peers.cc:597] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:07.135999  1570 consensus_peers.cc:597] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:07.178074  8822 raft_consensus.cc:493] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:02:07.178753  8822 raft_consensus.cc:515] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:02:07.180935  8822 leader_election.cc:290] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:02:07.184455  8791 raft_consensus.cc:493] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:02:07.185060  8791 raft_consensus.cc:515] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:02:07.187083  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:02:07.187731  1603 raft_consensus.cc:2468] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 21.
I20260709 13:02:07.191931  1646 leader_election.cc:304] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
W20260709 13:02:07.197368  1644 leader_election.cc:336] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:07.200060  8809 raft_consensus.cc:2804] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:02:07.200584  8809 raft_consensus.cc:493] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:02:07.200970  8809 raft_consensus.cc:3060] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:07.208743  8809 raft_consensus.cc:515] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:02:07.221207  1570 consensus_peers.cc:597] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:07.224663  8791 leader_election.cc:290] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:02:07.225543  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:02:07.226649  1681 raft_consensus.cc:2393] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 22: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:02:07.227248  8809 leader_election.cc:290] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 22 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:02:07.229449  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf3b3cd19c1e496fa7fdb5550772123b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:02:07.230065  1603 raft_consensus.cc:3060] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:02:07.238917  1644 leader_election.cc:336] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:02:07.261910  2190 consensus_peers.cc:597] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:07.272075  1570 leader_election.cc:336] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:07.272696  1570 leader_election.cc:304] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:02:07.284559  2190 consensus_peers.cc:597] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:07.317209  2219 raft_consensus.cc:1275] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 26 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 25 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260709 13:02:07.319514  8791 consensus_queue.cc:1048] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
W20260709 13:02:07.333746  1644 connection.cc:573] client connection to 127.0.107.193:43931 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260709 13:02:07.355250  1603 raft_consensus.cc:2468] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 22.
I20260709 13:02:07.355993  8666 raft_consensus.cc:2749] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:02:07.369761  1646 leader_election.cc:304] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:02:07.370697  8801 raft_consensus.cc:2804] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:02:07.371258  8801 raft_consensus.cc:697] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 22 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:02:07.373009  8801 consensus_queue.cc:237] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.10, Last appended by leader: 10, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:02:07.386782  8799 raft_consensus.cc:493] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
W20260709 13:02:07.386991  2190 consensus_peers.cc:597] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:07.390061  8799 raft_consensus.cc:515] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:07.396322  8799 leader_election.cc:290] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:02:07.399046  2226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:02:07.443269  8666 raft_consensus.cc:493] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:02:07.443807  8666 raft_consensus.cc:515] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:02:07.461428  8666 leader_election.cc:290] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:02:07.466549  1570 consensus_peers.cc:597] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:07.468385  1570 consensus_peers.cc:597] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:07.472087  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:02:07.481375  1681 raft_consensus.cc:1275] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:02:07.482923  8666 consensus_queue.cc:1048] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:02:07.485702  1424 catalog_manager.cc:5697] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 reported cstate change: term changed from 21 to 22, leader changed from e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 22 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } }
W20260709 13:02:07.491263  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 44518.1us
W20260709 13:02:07.522919  2190 consensus_peers.cc:597] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:07.540884  2190 consensus_peers.cc:597] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:07.548194  8828 raft_consensus.cc:493] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:02:07.548827  8828 raft_consensus.cc:515] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:02:07.550863  8828 leader_election.cc:290] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
W20260709 13:02:07.550925  1570 consensus_peers.cc:597] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:07.553773  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:02:07.574745  1570 leader_election.cc:336] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111)
I20260709 13:02:07.574862  1605 raft_consensus.cc:2468] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 20.
I20260709 13:02:07.576031  1570 leader_election.cc:304] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:02:07.578184  1570 leader_election.cc:336] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111)
I20260709 13:02:07.579487  1570 leader_election.cc:304] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:02:07.560242  8828 raft_consensus.cc:493] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:02:07.582504  1646 leader_election.cc:304] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:02:07.583670  8809 raft_consensus.cc:2804] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:02:07.584043  8809 raft_consensus.cc:493] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 20 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:02:07.584375  8809 raft_consensus.cc:3060] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:07.586777  8734 raft_consensus.cc:2749] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:07.577615  8835 raft_consensus.cc:2749] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:07.586923  8828 raft_consensus.cc:515] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:02:07.596194  8828 leader_election.cc:290] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:02:07.597133  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:02:07.591986  8809 raft_consensus.cc:515] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:02:07.609833  1570 consensus_peers.cc:597] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:07.611475  1570 consensus_peers.cc:597] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:07.622926  1644 leader_election.cc:336] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111)
I20260709 13:02:07.627290  8809 leader_election.cc:290] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 21 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
W20260709 13:02:07.623859  1644 leader_election.cc:336] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111)
I20260709 13:02:07.628069  1644 leader_election.cc:304] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:02:07.628397  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad4dae0957134e9aba74a14dc8984866" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:02:07.629133  1605 raft_consensus.cc:3060] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:07.630848  8809 raft_consensus.cc:2749] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:02:07.611934  1570 consensus_peers.cc:597] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:07.636000  1605 raft_consensus.cc:2468] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 21.
I20260709 13:02:07.637516  1646 leader_election.cc:304] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
W20260709 13:02:07.629076  1644 consensus_peers.cc:597] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:07.654345  1644 consensus_peers.cc:597] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:07.654722  8836 raft_consensus.cc:2804] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:02:07.655293  8836 raft_consensus.cc:697] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 21 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:02:07.656288  8836 consensus_queue.cc:237] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:02:07.657145  1644 leader_election.cc:336] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111)
I20260709 13:02:07.658272  8829 raft_consensus.cc:493] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:02:07.658975  8829 raft_consensus.cc:515] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:07.661067  8829 leader_election.cc:290] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:02:07.663564  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 13:02:07.658437  1570 consensus_peers.cc:597] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:07.675752  8838 raft_consensus.cc:493] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:02:07.676321  8838 raft_consensus.cc:515] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:07.680233  8818 raft_consensus.cc:493] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:02:07.680819  8818 raft_consensus.cc:515] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:07.681764  8829 raft_consensus.cc:493] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:02:07.683615  8818 leader_election.cc:290] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:02:07.685385  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:02:07.686105  1674 raft_consensus.cc:2468] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 14.
I20260709 13:02:07.687340  2191 leader_election.cc:304] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:02:07.689074  8818 raft_consensus.cc:2804] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:07.689549  8818 raft_consensus.cc:493] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:02:07.679080  8838 leader_election.cc:290] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:02:07.689973  8818 raft_consensus.cc:3060] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:07.690925  8791 raft_consensus.cc:493] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:02:07.691421  8791 raft_consensus.cc:515] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:07.682333  8829 raft_consensus.cc:515] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:07.695135  8829 leader_election.cc:290] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:02:07.695502  8791 leader_election.cc:290] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:02:07.697366  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:02:07.698120  2221 raft_consensus.cc:2468] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 14.
I20260709 13:02:07.700007  1572 leader_election.cc:304] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:02:07.700910  8838 raft_consensus.cc:493] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:02:07.701864  8734 raft_consensus.cc:2804] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:07.702280  8734 raft_consensus.cc:493] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:02:07.702626  8734 raft_consensus.cc:3060] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:07.703735  8838 raft_consensus.cc:515] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:07.706370  8838 leader_election.cc:290] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
W20260709 13:02:07.690582  2190 leader_election.cc:336] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111)
W20260709 13:02:07.707376  2190 leader_election.cc:336] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111)
I20260709 13:02:07.714321  8829 raft_consensus.cc:493] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:02:07.715916  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:02:07.715010  8829 raft_consensus.cc:515] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:02:07.719543  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
W20260709 13:02:07.721026  2190 consensus_peers.cc:597] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:07.722795  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:02:07.724831  8829 leader_election.cc:290] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:02:07.732338  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:02:07.733047  1601 raft_consensus.cc:2468] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 18.
I20260709 13:02:07.734923  8818 raft_consensus.cc:515] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:07.736622  8734 raft_consensus.cc:515] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:07.737705  1603 raft_consensus.cc:2393] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b96ce9cc496c49d7818fa983a17b062b in current term 15: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:02:07.736431  1424 catalog_manager.cc:5697] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 reported cstate change: term changed from 20 to 21, leader changed from e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 21 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:07.745333  8799 raft_consensus.cc:493] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:02:07.745950  8799 raft_consensus.cc:515] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:02:07.747663  8835 raft_consensus.cc:493] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:02:07.747993  8799 leader_election.cc:290] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:02:07.749950  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe75e7a89594d3f81b1b8935b43b2ed" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:02:07.750164  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:02:07.750605  2219 raft_consensus.cc:3060] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:07.750818  1673 raft_consensus.cc:2468] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 19.
W20260709 13:02:07.754818  1414 catalog_manager.cc:4755] TS e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 9a873ede2f0f418cbcab98586dba9b1e: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111)
I20260709 13:02:07.756223  1571 leader_election.cc:304] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:02:07.757477  8666 raft_consensus.cc:2804] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:07.757817  8666 raft_consensus.cc:493] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:02:07.758121  8666 raft_consensus.cc:3060] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:07.759344  2219 raft_consensus.cc:2468] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 15.
I20260709 13:02:07.761040  1572 leader_election.cc:304] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:02:07.763221  8835 raft_consensus.cc:515] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:07.764374  8799 raft_consensus.cc:2804] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:07.764904  8799 raft_consensus.cc:697] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 15 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:02:07.765372  8835 leader_election.cc:290] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:02:07.766054  8734 leader_election.cc:290] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:02:07.765745  8799 consensus_queue.cc:237] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:07.768796  8666 raft_consensus.cc:515] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:02:07.769295  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770925e70faa4a16a275abd5282f5284" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:02:07.769850  1674 raft_consensus.cc:3060] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:07.777482  8666 leader_election.cc:290] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 20 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:02:07.778880  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 57903us
I20260709 13:02:07.779096  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb85f388454464192e052f706a78e65" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:02:07.779843  1673 raft_consensus.cc:3060] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:07.780225  1674 raft_consensus.cc:2468] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 15.
I20260709 13:02:07.781355  2191 leader_election.cc:304] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:02:07.782835  8832 raft_consensus.cc:2804] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:07.783377  8832 raft_consensus.cc:697] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 15 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:02:07.784236  8832 consensus_queue.cc:237] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:02:07.789016  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 58580.5us
W20260709 13:02:07.790143  1644 leader_election.cc:336] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111)
I20260709 13:02:07.790593  2192 leader_election.cc:304] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: 
I20260709 13:02:07.790766  1644 leader_election.cc:304] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:02:07.791170  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:02:07.793776  1673 raft_consensus.cc:2468] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 20.
I20260709 13:02:07.794471  8800 raft_consensus.cc:2804] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:02:07.795594  1644 leader_election.cc:336] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111)
I20260709 13:02:07.796629  8800 raft_consensus.cc:493] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:02:07.797181  8800 raft_consensus.cc:3060] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:07.798489  8809 raft_consensus.cc:493] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:02:07.799059  8809 raft_consensus.cc:515] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:02:07.799702  2190 leader_election.cc:336] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111)
I20260709 13:02:07.796715  8836 raft_consensus.cc:2749] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:07.803668  8809 leader_election.cc:290] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:02:07.805805  8800 raft_consensus.cc:515] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:07.807508  1571 leader_election.cc:304] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:02:07.810175  8799 raft_consensus.cc:2804] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:02:07.809700  8800 leader_election.cc:290] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 19 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:02:07.811329  8832 raft_consensus.cc:493] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:02:07.811882  8832 raft_consensus.cc:515] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:07.814045  8832 leader_election.cc:290] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:02:07.819993  1570 consensus_peers.cc:597] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:07.819041  1424 catalog_manager.cc:5697] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 14 to 15, leader changed from e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) to 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194). New cstate: current_term: 15 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:07.819741  1422 catalog_manager.cc:5697] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 14 to 15, leader changed from e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) to b96ce9cc496c49d7818fa983a17b062b (127.0.107.196). New cstate: current_term: 15 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:07.819052  8843 raft_consensus.cc:493] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:02:07.821162  8843 raft_consensus.cc:515] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:02:07.824422  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:02:07.824615  2190 consensus_peers.cc:597] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:07.825066  1674 raft_consensus.cc:2468] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 14.
W20260709 13:02:07.820505  1570 leader_election.cc:336] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111)
I20260709 13:02:07.827298  1571 leader_election.cc:304] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:02:07.828058  8666 raft_consensus.cc:2804] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:07.828442  8666 raft_consensus.cc:493] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:02:07.828744  8666 raft_consensus.cc:3060] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:07.815224  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:02:07.825306  2190 leader_election.cc:336] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111)
I20260709 13:02:07.837144  8666 raft_consensus.cc:515] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:02:07.837373  8843 leader_election.cc:290] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:02:07.837690  8832 raft_consensus.cc:493] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:02:07.838276  8832 raft_consensus.cc:515] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:07.841241  8832 leader_election.cc:290] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:02:07.841475  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:02:07.841917  2190 leader_election.cc:336] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111)
I20260709 13:02:07.842374  1673 raft_consensus.cc:2468] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 18.
W20260709 13:02:07.842439  2190 leader_election.cc:336] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111)
I20260709 13:02:07.842953  2190 leader_election.cc:304] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:02:07.843636  2191 leader_election.cc:304] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:02:07.843694  8832 raft_consensus.cc:2749] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:07.844720  8838 raft_consensus.cc:2804] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:07.845124  8838 raft_consensus.cc:493] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:02:07.845491  8838 raft_consensus.cc:3060] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:07.850257  1644 leader_election.cc:304] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:02:07.851902  8799 raft_consensus.cc:697] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 20 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:02:07.852077  8809 raft_consensus.cc:2749] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:02:07.854070  1570 leader_election.cc:336] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111)
I20260709 13:02:07.854265  8799 consensus_queue.cc:237] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:02:07.855612  8666 leader_election.cc:290] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:02:07.859136  1570 leader_election.cc:336] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111)
W20260709 13:02:07.859858  1570 leader_election.cc:336] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111)
W20260709 13:02:07.860236  2190 leader_election.cc:336] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111)
I20260709 13:02:07.861085  8838 raft_consensus.cc:515] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:07.862910  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1975e24877834ab7ae6da515a5cf6251" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:02:07.863525  1673 raft_consensus.cc:3060] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:07.794093  8818 leader_election.cc:290] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:02:07.864719  1572 leader_election.cc:304] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:02:07.866192  8791 raft_consensus.cc:2749] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:02:07.872640  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:02:07.873271  1603 raft_consensus.cc:2468] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 17.
W20260709 13:02:07.875109  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 79549.2us
W20260709 13:02:07.875748  1644 consensus_peers.cc:597] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:07.880168  1644 leader_election.cc:336] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111)
I20260709 13:02:07.881597  8791 raft_consensus.cc:493] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:02:07.874601  1646 leader_election.cc:304] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:02:07.896258  8791 raft_consensus.cc:515] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:02:07.890309  1673 raft_consensus.cc:2468] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 15.
I20260709 13:02:07.908540  1571 leader_election.cc:304] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
W20260709 13:02:07.860317  1570 consensus_peers.cc:597] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:07.909758  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:02:07.886443  1644 leader_election.cc:304] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:02:07.910454  1673 raft_consensus.cc:2468] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 17.
I20260709 13:02:07.914603  8666 raft_consensus.cc:2804] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:02:07.910089  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 49814.1us
W20260709 13:02:07.915763  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 125245us
W20260709 13:02:07.915766  1570 leader_election.cc:336] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111)
I20260709 13:02:07.898476  8791 leader_election.cc:290] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:02:07.911672  1571 leader_election.cc:304] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:02:07.921732  8838 leader_election.cc:290] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 19 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:02:07.917270  8829 raft_consensus.cc:2804] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:07.922513  8829 raft_consensus.cc:493] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:02:07.922935  8829 raft_consensus.cc:3060] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:07.930724  8829 raft_consensus.cc:515] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:02:07.933143  8829 leader_election.cc:290] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 18 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
W20260709 13:02:07.933271  2190 leader_election.cc:336] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111)
I20260709 13:02:07.916712  2192 leader_election.cc:304] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:02:07.934301  8818 raft_consensus.cc:2749] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:07.935561  8818 raft_consensus.cc:493] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:02:07.936060  8818 raft_consensus.cc:515] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:07.938153  8818 leader_election.cc:290] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:02:07.920691  8791 raft_consensus.cc:2804] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:07.946358  8791 raft_consensus.cc:493] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:02:07.946818  8791 raft_consensus.cc:3060] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:07.951460  1422 catalog_manager.cc:5697] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 19 to 20, leader changed from e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) to 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194). New cstate: current_term: 20 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:07.954818  2190 leader_election.cc:336] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111)
W20260709 13:02:07.969571  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 89431.9us
I20260709 13:02:07.970206  8829 raft_consensus.cc:2749] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:02:07.970737  1644 consensus_peers.cc:597] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:07.978646  8666 raft_consensus.cc:697] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 15 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:02:07.978706  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d40b53631d4998a9a462e3c91a3004" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:02:07.980690  1603 raft_consensus.cc:3060] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:07.979844  8666 consensus_queue.cc:237] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:02:07.989140  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64842f503da44f59896ed29b9edd3b29" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:02:07.998709  8836 raft_consensus.cc:493] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
W20260709 13:02:07.993173  2190 consensus_peers.cc:597] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:07.995033  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:02:07.999760  1601 raft_consensus.cc:2468] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 21.
I20260709 13:02:07.999336  1673 raft_consensus.cc:3060] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:07.999368  8836 raft_consensus.cc:515] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:02:08.002400  1644 leader_election.cc:336] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111)
I20260709 13:02:08.003177  8818 raft_consensus.cc:493] T 7b4d826f7c344b45b7de4b9f69ea958b P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:02:08.006960  8818 raft_consensus.cc:515] T 7b4d826f7c344b45b7de4b9f69ea958b P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:08.006989  8791 raft_consensus.cc:515] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:02:08.009162  8818 leader_election.cc:290] T 7b4d826f7c344b45b7de4b9f69ea958b P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:02:08.010004  8791 leader_election.cc:290] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 18 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:02:08.004770  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:02:08.006178  1603 raft_consensus.cc:2468] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 19.
I20260709 13:02:08.010645  1606 raft_consensus.cc:1275] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 22 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 21 index: 10. Preceding OpId from leader: term: 22 index: 11. (index mismatch)
I20260709 13:02:08.008040  8836 leader_election.cc:290] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:02:08.010887  1601 raft_consensus.cc:2393] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 18: Already voted for candidate 39a92f5a4352465d8af3af5908fe8642 in this term.
I20260709 13:02:08.011940  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:02:08.020166  1570 leader_election.cc:336] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111)
W20260709 13:02:08.020859  1644 consensus_peers.cc:597] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:08.029100  1644 consensus_peers.cc:597] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:08.030906  8831 consensus_queue.cc:1048] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:02:08.021131  1570 leader_election.cc:336] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111)
I20260709 13:02:08.035776  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
W20260709 13:02:08.037745  1570 leader_election.cc:336] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111)
I20260709 13:02:08.037945  1681 raft_consensus.cc:2393] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 39a92f5a4352465d8af3af5908fe8642 in current term 18: Already voted for candidate ddf11fc190dd4b898773379c6b129d90 in this term.
I20260709 13:02:08.039652  2192 leader_election.cc:304] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:02:08.041119  2192 leader_election.cc:304] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:02:08.041960  8800 raft_consensus.cc:2804] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:02:08.042359  8800 raft_consensus.cc:493] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 21 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:02:08.042764  8800 raft_consensus.cc:3060] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:08.042944  8832 raft_consensus.cc:2804] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:02:08.043466  8832 raft_consensus.cc:697] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 19 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:02:08.044329  8832 consensus_queue.cc:237] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:08.046808  1673 raft_consensus.cc:2468] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 19.
W20260709 13:02:08.048067  1644 leader_election.cc:336] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111)
I20260709 13:02:08.056073  1644 leader_election.cc:304] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:02:08.051956  2191 leader_election.cc:304] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:02:08.054395  8843 raft_consensus.cc:493] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
W20260709 13:02:08.050558  2190 leader_election.cc:336] T 7b4d826f7c344b45b7de4b9f69ea958b P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111)
I20260709 13:02:08.062273  2190 leader_election.cc:304] T 7b4d826f7c344b45b7de4b9f69ea958b P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:02:08.063455  1644 consensus_peers.cc:597] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:08.072824  8818 raft_consensus.cc:2804] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:02:08.074946  1644 consensus_peers.cc:597] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:08.067051  8843 raft_consensus.cc:515] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:08.080394  8843 leader_election.cc:290] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:02:08.067008  8809 raft_consensus.cc:2749] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:02:08.080588  1644 leader_election.cc:336] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111)
I20260709 13:02:08.082425  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
W20260709 13:02:08.083599  1644 consensus_peers.cc:597] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:08.083295  1422 catalog_manager.cc:5697] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 18 to 19, leader changed from e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) to b96ce9cc496c49d7818fa983a17b062b (127.0.107.196). New cstate: current_term: 19 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:08.073222  8838 raft_consensus.cc:2749] T 7b4d826f7c344b45b7de4b9f69ea958b P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:08.094292  8800 raft_consensus.cc:515] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:08.096598  8800 leader_election.cc:290] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 22 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:02:08.100406  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:02:08.101061  2219 raft_consensus.cc:2468] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 14.
I20260709 13:02:08.105072  1424 catalog_manager.cc:5697] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 14 to 15, leader changed from e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) to 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194). New cstate: current_term: 15 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:08.110051  1644 consensus_peers.cc:597] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:08.111321  1646 leader_election.cc:304] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:02:08.112269  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2abb9a42c35f4b6386342bccdff6fbf0" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:02:08.112958  1603 raft_consensus.cc:3060] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:08.113449  8809 raft_consensus.cc:2804] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:08.113870  8809 raft_consensus.cc:493] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:02:08.114220  8809 raft_consensus.cc:3060] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:08.127914  1603 raft_consensus.cc:2468] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 22.
I20260709 13:02:08.134851  8818 raft_consensus.cc:697] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 19 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:02:08.136160  8818 consensus_queue.cc:237] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:08.147049  1603 raft_consensus.cc:1275] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 21 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:02:08.148598  8831 consensus_queue.cc:1048] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:02:08.148766  8828 raft_consensus.cc:493] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:02:08.150239  8828 raft_consensus.cc:515] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:08.151556  8852 raft_consensus.cc:493] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:02:08.152241  8852 raft_consensus.cc:515] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:08.153590  8828 leader_election.cc:290] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:02:08.165071  8852 leader_election.cc:290] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:02:08.171044  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:02:08.171753  2221 raft_consensus.cc:2468] T 7b4d826f7c344b45b7de4b9f69ea958b P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 19.
W20260709 13:02:08.173171  2190 leader_election.cc:336] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111)
W20260709 13:02:08.180292  1570 leader_election.cc:336] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111)
I20260709 13:02:08.178870  1646 leader_election.cc:304] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:02:08.157400  8809 raft_consensus.cc:515] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:08.182883  8828 raft_consensus.cc:2804] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:02:08.184775  2190 leader_election.cc:336] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111)
I20260709 13:02:08.188834  8828 raft_consensus.cc:493] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
W20260709 13:02:08.189051  2190 consensus_peers.cc:597] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:08.189283  8828 raft_consensus.cc:3060] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:02:08.186425  1644 leader_election.cc:336] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111)
I20260709 13:02:08.180843  1570 leader_election.cc:304] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:02:08.196370  8666 raft_consensus.cc:2749] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:02:08.210140  2192 leader_election.cc:304] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:02:08.211721  8852 raft_consensus.cc:2804] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:02:08.212253  8852 raft_consensus.cc:697] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 22 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:02:08.212538  8828 raft_consensus.cc:515] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:08.213146  8852 consensus_queue.cc:237] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:08.228848  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b4d826f7c344b45b7de4b9f69ea958b" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:02:08.229532  2219 raft_consensus.cc:3060] T 7b4d826f7c344b45b7de4b9f69ea958b P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:02:08.232908  1570 leader_election.cc:336] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111)
I20260709 13:02:08.233565  1570 leader_election.cc:304] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642; no voters: b96ce9cc496c49d7818fa983a17b062b, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:02:08.230621  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642" is_pre_election: true
I20260709 13:02:08.234916  1603 raft_consensus.cc:2468] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 13.
I20260709 13:02:08.239096  8666 raft_consensus.cc:2749] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:08.229563  8828 leader_election.cc:290] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 20 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:02:08.248131  2192 leader_election.cc:304] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:02:08.254629  2219 raft_consensus.cc:2468] T 7b4d826f7c344b45b7de4b9f69ea958b P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 20.
I20260709 13:02:08.260481  1646 leader_election.cc:304] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:02:08.259771  8800 raft_consensus.cc:2804] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:08.269397  1422 catalog_manager.cc:5697] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 18 to 19, leader changed from e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) to b96ce9cc496c49d7818fa983a17b062b (127.0.107.196). New cstate: current_term: 19 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:02:08.280376  1570 consensus_peers.cc:597] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:08.280685  8800 raft_consensus.cc:493] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Starting leader election (detected failure of leader e46412b3b0b44f01ad5c33d4cfe3d6b1)
I20260709 13:02:08.284556  8800 raft_consensus.cc:3060] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:08.286859  8809 leader_election.cc:290] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:02:08.287817  1644 leader_election.cc:336] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111)
W20260709 13:02:08.292670  1644 leader_election.cc:336] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111)
I20260709 13:02:08.298959  8860 raft_consensus.cc:2804] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:02:08.299563  8860 raft_consensus.cc:697] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 20 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:02:08.300459  8860 consensus_queue.cc:237] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:08.304190  2221 raft_consensus.cc:1275] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260709 13:02:08.305631  1644 consensus_peers.cc:597] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:08.306375  8666 consensus_queue.cc:1048] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:02:08.322095  2219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53176f970a394c5cb2c76bd88f09c751" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:02:08.322803  2219 raft_consensus.cc:3060] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:08.338212  8800 raft_consensus.cc:515] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:08.348316  1673 raft_consensus.cc:1275] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260709 13:02:08.350255  2190 leader_election.cc:336] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111)
I20260709 13:02:08.355831  2219 raft_consensus.cc:2468] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 15.
I20260709 13:02:08.369313  8851 consensus_queue.cc:1048] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.002s
I20260709 13:02:08.373198  8800 leader_election.cc:290] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 14 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:02:08.374397  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317204271cc04f68818b36450c9725b1" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "39a92f5a4352465d8af3af5908fe8642"
I20260709 13:02:08.375032  1603 raft_consensus.cc:3060] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:02:08.381987   431 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 1553)
W20260709 13:02:08.385591  1570 consensus_peers.cc:597] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:08.387055  1646 leader_election.cc:304] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:02:08.387916  8861 raft_consensus.cc:2804] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:08.388443  8861 raft_consensus.cc:697] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 15 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:02:08.389245  8861 consensus_queue.cc:237] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:08.394304  1422 catalog_manager.cc:5697] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 21 to 22, leader changed from e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) to b96ce9cc496c49d7818fa983a17b062b (127.0.107.196). New cstate: current_term: 22 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:08.399216  1603 raft_consensus.cc:2468] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 14.
I20260709 13:02:08.400305  2192 leader_election.cc:304] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b; no voters: e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:02:08.402364  8845 raft_consensus.cc:2804] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:08.402897  8845 raft_consensus.cc:697] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 14 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
W20260709 13:02:08.403012  1570 consensus_peers.cc:597] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:08.404783  8845 consensus_queue.cc:237] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:08.428468  1681 raft_consensus.cc:1275] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 20 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:02:08.455304  8666 consensus_queue.cc:1048] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:02:08.453271  1422 catalog_manager.cc:5697] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 reported cstate change: term changed from 19 to 20, leader changed from e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 20 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:08.473104  1677 raft_consensus.cc:1275] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:02:08.491331  8666 consensus_queue.cc:1048] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:02:08.524555  1424 catalog_manager.cc:5697] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 reported cstate change: term changed from 14 to 15, leader changed from e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 15 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:08.548172  1601 raft_consensus.cc:1275] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:02:08.548978  1422 catalog_manager.cc:5697] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 13 to 14, leader changed from e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) to b96ce9cc496c49d7818fa983a17b062b (127.0.107.196). New cstate: current_term: 14 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:08.550168  8845 consensus_queue.cc:1048] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:02:08.572659  8871 log.cc:927] Time spent T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
W20260709 13:02:08.629365  2190 consensus_peers.cc:597] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:08.654769  2190 consensus_peers.cc:597] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:08.735469  1673 raft_consensus.cc:1275] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:02:08.737706  8818 consensus_queue.cc:1048] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 13:02:08.740991  2190 consensus_peers.cc:597] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:08.778950  2221 raft_consensus.cc:1275] T 7b4d826f7c344b45b7de4b9f69ea958b P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:02:08.780776  8809 consensus_queue.cc:1048] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:02:08.842433  1606 raft_consensus.cc:1275] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 22 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:02:08.845345  8838 consensus_queue.cc:1048] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:02:08.875854  1644 consensus_peers.cc:597] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:08.878176  2221 raft_consensus.cc:1275] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Refusing update from remote peer ddf11fc190dd4b898773379c6b129d90: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 15 index: 15. (index mismatch)
W20260709 13:02:08.883517  1570 consensus_peers.cc:597] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:08.896678  8831 consensus_queue.cc:1048] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:02:08.951918  1644 consensus_peers.cc:597] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:08.972173  1601 raft_consensus.cc:1275] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Refusing update from remote peer b96ce9cc496c49d7818fa983a17b062b: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
W20260709 13:02:08.977105  1414 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 72023.7us
I20260709 13:02:08.985888  8832 consensus_queue.cc:1048] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:02:08.995293  1414 catalog_manager.cc:4755] TS e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 9a873ede2f0f418cbcab98586dba9b1e: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111)
W20260709 13:02:09.000085  2190 consensus_peers.cc:597] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:09.382525   431 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 1553)
W20260709 13:02:09.624595  2190 consensus_peers.cc:597] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:09.635421  2190 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111) [suppressed 383 similar messages]
W20260709 13:02:09.638720  2190 consensus_peers.cc:597] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:09.649711  1570 consensus_peers.cc:597] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:09.728911  1570 consensus_peers.cc:597] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:09.793339  1570 consensus_peers.cc:597] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:09.820788  2190 consensus_peers.cc:597] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:09.821606  2190 consensus_peers.cc:597] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:09.832805  1570 consensus_peers.cc:597] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:09.913851  1570 consensus_peers.cc:597] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:10.000648  1644 consensus_peers.cc:597] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:02:10.014492  8799 raft_consensus.cc:493] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.015233  8799 raft_consensus.cc:515] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:02:10.021675  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:02:10.022348  1673 raft_consensus.cc:2468] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 18.
I20260709 13:02:10.023797  1571 leader_election.cc:304] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:02:10.024758  8666 raft_consensus.cc:2804] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:10.025125  8666 raft_consensus.cc:493] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:10.025468  8666 raft_consensus.cc:3060] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:10.033828  8666 raft_consensus.cc:515] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:02:10.058730  8799 leader_election.cc:290] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:02:10.067680  1570 consensus_peers.cc:597] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:10.091890  1570 consensus_peers.cc:597] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:02:10.107892  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f373c2c361f4fafa5411e39387ef06e" candidate_uuid: "39a92f5a4352465d8af3af5908fe8642" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:02:10.108734  1673 raft_consensus.cc:3060] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:10.131929  8666 leader_election.cc:290] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 19 election: Requested vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:02:10.156314  1570 consensus_peers.cc:597] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:02:10.160269  1673 raft_consensus.cc:2468] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39a92f5a4352465d8af3af5908fe8642 in term 19.
I20260709 13:02:10.169070  1571 leader_election.cc:304] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:02:10.170077  8799 raft_consensus.cc:2804] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:02:10.170738  8799 raft_consensus.cc:697] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 19 LEADER]: Becoming Leader. State: Replica: 39a92f5a4352465d8af3af5908fe8642, State: Running, Role: LEADER
I20260709 13:02:10.172560  8799 consensus_queue.cc:237] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:02:10.167181  2190 consensus_peers.cc:597] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:10.164422  1570 leader_election.cc:336] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111)
W20260709 13:02:10.229749  2190 consensus_peers.cc:597] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:10.236627  2190 consensus_peers.cc:597] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:10.237222  2190 consensus_peers.cc:597] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:10.255585  1570 leader_election.cc:336] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111)
W20260709 13:02:10.280881  1644 consensus_peers.cc:597] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:10.286870  1644 consensus_peers.cc:597] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:02:10.298619  1422 catalog_manager.cc:5697] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 reported cstate change: term changed from 17 to 19, leader changed from e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193) to 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194). New cstate: current_term: 19 leader_uuid: "39a92f5a4352465d8af3af5908fe8642" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:10.331506  1570 consensus_peers.cc:597] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:10.333135  1570 consensus_peers.cc:597] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:10.334761  2190 consensus_peers.cc:597] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:10.341723  1644 consensus_peers.cc:597] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:10.361565  2190 consensus_peers.cc:597] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:10.383152   431 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 1553)
W20260709 13:02:10.388012  1570 consensus_peers.cc:597] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:10.522862  1644 consensus_peers.cc:597] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:10.523393  1644 consensus_peers.cc:597] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:10.532418  1644 consensus_peers.cc:597] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:10.581499  1644 consensus_peers.cc:597] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:10.601287  1644 consensus_peers.cc:597] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:10.627322  1570 consensus_peers.cc:597] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:10.657924  2190 consensus_peers.cc:597] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:02:10.693753  1673 raft_consensus.cc:1275] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Refusing update from remote peer 39a92f5a4352465d8af3af5908fe8642: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:02:10.695914  8666 consensus_queue.cc:1048] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:02:10.757586  1570 consensus_peers.cc:597] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:10.810957  1570 consensus_peers.cc:597] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:10.905189  1644 consensus_peers.cc:597] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:10.934631  1644 consensus_peers.cc:597] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:10.955081  2190 consensus_peers.cc:597] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:10.998580  1570 consensus_peers.cc:597] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:11.015556  1570 consensus_peers.cc:597] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:11.104099  1414 catalog_manager.cc:4755] TS e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 9a873ede2f0f418cbcab98586dba9b1e: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111)
W20260709 13:02:11.211279  2190 consensus_peers.cc:597] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:11.288848  1644 consensus_peers.cc:597] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:11.326464  2190 consensus_peers.cc:597] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:11.332026  2190 consensus_peers.cc:597] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:11.339861  2190 consensus_peers.cc:597] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:11.383837   431 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 1553)
W20260709 13:02:11.550736  1644 consensus_peers.cc:597] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:11.934410  2190 consensus_peers.cc:597] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:12.287313  2190 consensus_peers.cc:597] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:12.297989  1570 consensus_peers.cc:597] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:12.325114  1570 consensus_peers.cc:597] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:12.335781  1570 consensus_peers.cc:597] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:12.385265   431 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 1553)
W20260709 13:02:12.412385  1570 consensus_peers.cc:597] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:12.532079  1570 consensus_peers.cc:597] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:12.557006  1644 consensus_peers.cc:597] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:12.565619  2190 consensus_peers.cc:597] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:12.590862  1570 consensus_peers.cc:597] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:12.597223  2190 consensus_peers.cc:597] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:12.622822  1570 consensus_peers.cc:597] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:12.644562  2190 consensus_peers.cc:597] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:12.668263  1644 consensus_peers.cc:597] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:12.674352  2190 consensus_peers.cc:597] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:12.697207  2190 consensus_peers.cc:597] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:12.699971  2190 consensus_peers.cc:597] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:12.704643  1570 consensus_peers.cc:597] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:12.707193  1644 consensus_peers.cc:597] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:12.751601  1570 consensus_peers.cc:597] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:12.814731  1644 consensus_peers.cc:597] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:12.816246  2190 consensus_peers.cc:597] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:12.817620  1570 consensus_peers.cc:597] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:12.820950  1570 consensus_peers.cc:597] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:12.874192  2190 consensus_peers.cc:597] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:12.941407  1644 consensus_peers.cc:597] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:12.973595  1570 consensus_peers.cc:597] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:13.034313  1644 consensus_peers.cc:597] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:13.073755  1644 consensus_peers.cc:597] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:13.110302  1644 consensus_peers.cc:597] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:13.189666  1644 consensus_peers.cc:597] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:13.210368  1644 consensus_peers.cc:597] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:13.326609  2190 consensus_peers.cc:597] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:13.346238  1570 consensus_peers.cc:597] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:13.386291   431 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 1553)
W20260709 13:02:13.497493  1644 consensus_peers.cc:597] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:13.562517  1570 consensus_peers.cc:597] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:13.606221  2190 consensus_peers.cc:597] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:13.616750  1570 consensus_peers.cc:597] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:13.629259  1570 consensus_peers.cc:597] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:13.634618  1646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 64891.8us
W20260709 13:02:13.701368  2190 consensus_peers.cc:597] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:13.714872  1644 consensus_peers.cc:597] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:13.930563  2190 consensus_peers.cc:597] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:13.978250  1644 consensus_peers.cc:597] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:14.041652  1570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 51962.3us
W20260709 13:02:14.054605  2190 consensus_peers.cc:597] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:14.129925  2190 consensus_peers.cc:597] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:14.130492  2190 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 74164.9us
W20260709 13:02:14.387022   431 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 1553)
W20260709 13:02:14.526638  2190 consensus_peers.cc:597] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:14.737594  1570 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111) [suppressed 441 similar messages]
W20260709 13:02:14.795958  2190 consensus_peers.cc:597] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:14.879117  1570 consensus_peers.cc:597] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:14.925211  1570 consensus_peers.cc:597] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:14.956007  1570 consensus_peers.cc:597] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:14.990078  2190 consensus_peers.cc:597] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:15.004681  1570 consensus_peers.cc:597] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:15.015010  1570 consensus_peers.cc:597] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:15.066751  2190 consensus_peers.cc:597] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:15.080389  1570 consensus_peers.cc:597] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:15.149235  1570 consensus_peers.cc:597] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:15.228421  1570 consensus_peers.cc:597] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:15.238201  2190 consensus_peers.cc:597] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:15.289286  1644 consensus_peers.cc:597] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:15.298259  1570 consensus_peers.cc:597] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:15.315328  1644 consensus_peers.cc:597] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:15.316473  1570 consensus_peers.cc:597] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:15.329917  2190 consensus_peers.cc:597] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:15.340651  2190 consensus_peers.cc:597] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:15.345552  1570 consensus_peers.cc:597] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:15.346160  2190 consensus_peers.cc:597] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:15.364995  1644 consensus_peers.cc:597] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:15.387992   431 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 1553)
W20260709 13:02:15.404517  1644 consensus_peers.cc:597] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:15.425004  1414 catalog_manager.cc:4755] TS e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 9a873ede2f0f418cbcab98586dba9b1e: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111)
W20260709 13:02:15.490255  1644 consensus_peers.cc:597] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:15.538123  1644 consensus_peers.cc:597] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:15.543242  1644 consensus_peers.cc:597] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:15.544265  1570 consensus_peers.cc:597] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:15.546397  2190 consensus_peers.cc:597] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:15.585390  1644 consensus_peers.cc:597] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:15.641371  2190 consensus_peers.cc:597] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:15.669361  1644 consensus_peers.cc:597] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:15.716248  2190 consensus_peers.cc:597] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:15.724525  1644 consensus_peers.cc:597] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:15.882730  1570 consensus_peers.cc:597] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:15.957274  1570 consensus_peers.cc:597] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:15.995731  1570 consensus_peers.cc:597] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:16.026741  1644 consensus_peers.cc:597] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:16.032797  1570 consensus_peers.cc:597] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:16.045162  2190 consensus_peers.cc:597] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:16.048132  2190 consensus_peers.cc:597] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:16.159963  2190 consensus_peers.cc:597] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:16.210328  1644 consensus_peers.cc:597] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:16.215553  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 84654.2us
W20260709 13:02:16.317296  2190 consensus_peers.cc:597] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:16.388478   431 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 1553)
W20260709 13:02:16.393075  1644 consensus_peers.cc:597] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:16.530727  2190 consensus_peers.cc:597] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:17.229135  2190 consensus_peers.cc:597] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:17.330076  1570 consensus_peers.cc:597] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:17.331148  1570 consensus_peers.cc:597] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:17.388948   431 thread.cc:527] Waited for 10000ms trying to join with diag-logger (tid 1553)
W20260709 13:02:17.439142  1570 consensus_peers.cc:597] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:17.462122  1570 consensus_peers.cc:597] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:17.462707  1570 consensus_peers.cc:597] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:17.476310  1570 consensus_peers.cc:597] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:17.532861  1570 consensus_peers.cc:597] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:17.540820  1570 consensus_peers.cc:597] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:17.587705  2190 consensus_peers.cc:597] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:17.603422  1644 consensus_peers.cc:597] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:17.633179  2190 consensus_peers.cc:597] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:17.664849  1570 consensus_peers.cc:597] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:17.667255  1644 consensus_peers.cc:597] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:17.687282  2190 consensus_peers.cc:597] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:17.695461  1570 consensus_peers.cc:597] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:17.825975  1644 consensus_peers.cc:597] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:17.844885  1644 consensus_peers.cc:597] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:17.851253  2190 consensus_peers.cc:597] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:17.867064  1570 consensus_peers.cc:597] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:17.905249  1644 consensus_peers.cc:597] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:17.907281  2190 consensus_peers.cc:597] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:17.926939  2190 consensus_peers.cc:597] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:17.988183  2190 consensus_peers.cc:597] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:18.033792  1644 consensus_peers.cc:597] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:18.182926  1644 consensus_peers.cc:597] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:18.186266  1570 consensus_peers.cc:597] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:18.241966  2190 consensus_peers.cc:597] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:18.292101  1570 consensus_peers.cc:597] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:18.304740  2190 consensus_peers.cc:597] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:18.312254  2190 consensus_peers.cc:597] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:18.343175  1644 consensus_peers.cc:597] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:18.343890  1644 consensus_peers.cc:597] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:18.351946  1644 consensus_peers.cc:597] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:18.389434   431 thread.cc:527] Waited for 11000ms trying to join with diag-logger (tid 1553)
W20260709 13:02:18.447110  1570 consensus_peers.cc:597] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:18.570142  1570 consensus_peers.cc:597] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:18.613463  2190 consensus_peers.cc:597] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:18.677863  2190 consensus_peers.cc:597] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:18.682864  2190 consensus_peers.cc:597] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:18.719252  1570 consensus_peers.cc:597] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:18.783489  1644 consensus_peers.cc:597] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:19.006186  1644 consensus_peers.cc:597] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:19.074120  2190 consensus_peers.cc:597] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:19.093650  1644 consensus_peers.cc:597] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:19.133066  2190 consensus_peers.cc:597] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:19.391809   431 thread.cc:527] Waited for 12000ms trying to join with diag-logger (tid 1553)
W20260709 13:02:19.593194  1570 consensus_peers.cc:597] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:19.597958  2190 consensus_peers.cc:597] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:02:19.743768  1570 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111) [suppressed 451 similar messages]
W20260709 13:02:19.757071  1570 consensus_peers.cc:597] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:02:19.858958  1570 consensus_peers.cc:597] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:02:19.860250  1644 consensus_peers.cc:597] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:02:19.874384  1570 consensus_peers.cc:597] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:19.928121  1570 consensus_peers.cc:597] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:02:20.096458  2190 consensus_peers.cc:597] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:02:20.133853  1570 consensus_peers.cc:597] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:02:20.180754  1570 consensus_peers.cc:597] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:02:20.191617  2190 consensus_peers.cc:597] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:02:20.197531  1570 consensus_peers.cc:597] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:02:20.232041  2190 consensus_peers.cc:597] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:02:20.245859  2190 consensus_peers.cc:597] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:02:20.253921  1570 consensus_peers.cc:597] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:02:20.385893  1570 consensus_peers.cc:597] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:20.399852  1570 consensus_peers.cc:597] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:02:20.401762  2190 consensus_peers.cc:597] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:02:20.426589  1644 consensus_peers.cc:597] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:02:20.427495  1644 consensus_peers.cc:597] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:02:20.428005  1644 consensus_peers.cc:597] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:02:20.461742   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
W20260709 13:02:20.550982  1644 consensus_peers.cc:597] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:02:20.616648   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
W20260709 13:02:20.616513  2190 consensus_peers.cc:597] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:02:20.621562  2190 consensus_peers.cc:597] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:02:20.629745  1644 consensus_peers.cc:597] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:02:20.632650  2190 consensus_peers.cc:597] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:02:20.650876  1644 consensus_peers.cc:597] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:02:20.652319  2190 consensus_peers.cc:597] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:02:20.660933  1570 consensus_peers.cc:597] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:02:20.666157  1646 consensus_peers.cc:597] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 -> Peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Couldn't send request to peer 39a92f5a4352465d8af3af5908fe8642. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:20.666851  1646 consensus_peers.cc:597] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 -> Peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Couldn't send request to peer 39a92f5a4352465d8af3af5908fe8642. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:20.671054  1646 consensus_peers.cc:597] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 -> Peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Couldn't send request to peer 39a92f5a4352465d8af3af5908fe8642. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:20.671730  1646 consensus_peers.cc:597] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 -> Peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Couldn't send request to peer 39a92f5a4352465d8af3af5908fe8642. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:20.681214  2192 consensus_peers.cc:597] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b -> Peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Couldn't send request to peer 39a92f5a4352465d8af3af5908fe8642. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:20.713536  1646 consensus_peers.cc:597] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 -> Peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Couldn't send request to peer 39a92f5a4352465d8af3af5908fe8642. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:20.722448  2192 consensus_peers.cc:597] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b -> Peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Couldn't send request to peer 39a92f5a4352465d8af3af5908fe8642. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:20.724706  2190 consensus_peers.cc:597] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:02:20.728652   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:02:20.731012   431 tablet_replica.cc:333] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642: stopping tablet replica
I20260709 13:02:20.732008   431 raft_consensus.cc:2243] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:20.732980   431 raft_consensus.cc:2272] T c0e4d309cca4449096f65b38755e557e P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:20.735904   431 tablet_replica.cc:333] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642: stopping tablet replica
I20260709 13:02:20.736743   431 raft_consensus.cc:2243] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:02:20.737980   431 raft_consensus.cc:2272] T 83ed1c1e27234d98ba5eeb14457a4ee2 P 39a92f5a4352465d8af3af5908fe8642 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:20.740820   431 tablet_replica.cc:333] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642: stopping tablet replica
I20260709 13:02:20.742044   431 raft_consensus.cc:2243] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:02:20.743251   431 raft_consensus.cc:2272] T 0ff83996d65d44e1925b89ba8eacd311 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:20.746153   431 tablet_replica.cc:333] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642: stopping tablet replica
I20260709 13:02:20.747274   431 raft_consensus.cc:2243] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:02:20.749293   431 raft_consensus.cc:2272] T 04fed4c219e14efb9f9a8eb0d336ceac P 39a92f5a4352465d8af3af5908fe8642 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:20.751874   431 tablet_replica.cc:333] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642: stopping tablet replica
I20260709 13:02:20.752827   431 raft_consensus.cc:2243] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:20.753438   431 raft_consensus.cc:2272] T 4ea41c88222b469fb11229faef735050 P 39a92f5a4352465d8af3af5908fe8642 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:20.756325   431 tablet_replica.cc:333] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642: stopping tablet replica
I20260709 13:02:20.757207   431 raft_consensus.cc:2243] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:20.757810   431 raft_consensus.cc:2272] T 8a1804adcd3844f5837dfc27d40e4cdf P 39a92f5a4352465d8af3af5908fe8642 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:20.761590   431 tablet_replica.cc:333] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642: stopping tablet replica
I20260709 13:02:20.763263   431 raft_consensus.cc:2243] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:02:20.765010   431 raft_consensus.cc:2272] T 93811be2a8094a489bcf8091e503f2c9 P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:20.770290   431 tablet_replica.cc:333] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642: stopping tablet replica
I20260709 13:02:20.771948   431 raft_consensus.cc:2243] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:20.772670   431 raft_consensus.cc:2272] T 822e65124bb44159b257fd219d28d93c P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:20.775596   431 tablet_replica.cc:333] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642: stopping tablet replica
I20260709 13:02:20.776530   431 raft_consensus.cc:2243] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 15 LEADER]: Raft consensus shutting down.
W20260709 13:02:20.777086  1646 consensus_peers.cc:597] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 -> Peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Couldn't send request to peer 39a92f5a4352465d8af3af5908fe8642. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:20.777617   431 raft_consensus.cc:2272] T 073cc710cf6642bb940606f8df5c2331 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:20.781776   431 tablet_replica.cc:333] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642: stopping tablet replica
I20260709 13:02:20.782580   431 raft_consensus.cc:2243] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:20.783233   431 raft_consensus.cc:2272] T bf3b3cd19c1e496fa7fdb5550772123b P 39a92f5a4352465d8af3af5908fe8642 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:20.786139   431 tablet_replica.cc:333] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642: stopping tablet replica
I20260709 13:02:20.786975   431 raft_consensus.cc:2243] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:02:20.788172   431 raft_consensus.cc:2272] T d53340cc35954204b06e3743bec8adbf P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:20.792488   431 tablet_replica.cc:333] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642: stopping tablet replica
I20260709 13:02:20.793268   431 raft_consensus.cc:2243] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:20.793897   431 raft_consensus.cc:2272] T c1d40b53631d4998a9a462e3c91a3004 P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:20.796923   431 tablet_replica.cc:333] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642: stopping tablet replica
I20260709 13:02:20.797943   431 raft_consensus.cc:2243] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:20.798739   431 raft_consensus.cc:2272] T 4549f0dba6504cfda954259e71ec4c91 P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:20.801565   431 tablet_replica.cc:333] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642: stopping tablet replica
I20260709 13:02:20.802408   431 raft_consensus.cc:2243] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:02:20.805166   431 raft_consensus.cc:2272] T e4b8c02fb560459fbbb59424361a5457 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:20.806510  1570 consensus_peers.cc:597] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:02:20.808508   431 tablet_replica.cc:333] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642: stopping tablet replica
I20260709 13:02:20.813483   431 raft_consensus.cc:2243] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:20.814616   431 raft_consensus.cc:2272] T 94d0d4cbe71742a39337e80ad5770e28 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:20.817416   431 tablet_replica.cc:333] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642: stopping tablet replica
I20260709 13:02:20.818249   431 raft_consensus.cc:2243] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:20.818912   431 raft_consensus.cc:2272] T ad4dae0957134e9aba74a14dc8984866 P 39a92f5a4352465d8af3af5908fe8642 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:20.821393   431 tablet_replica.cc:333] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642: stopping tablet replica
W20260709 13:02:20.772838  2192 consensus_peers.cc:597] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b -> Peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Couldn't send request to peer 39a92f5a4352465d8af3af5908fe8642. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:20.823436  2192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:40303, user_credentials={real_user=slave}} blocked reactor thread for 50640.3us
W20260709 13:02:20.824963  1646 consensus_peers.cc:597] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 -> Peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Couldn't send request to peer 39a92f5a4352465d8af3af5908fe8642. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:20.827692   431 raft_consensus.cc:2243] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:20.829275   431 raft_consensus.cc:2272] T e0590ffd096d4e378ab66c1795ff5cce P 39a92f5a4352465d8af3af5908fe8642 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:20.832861   431 tablet_replica.cc:333] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642: stopping tablet replica
I20260709 13:02:20.837765   431 raft_consensus.cc:2243] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 19 LEADER]: Raft consensus shutting down.
W20260709 13:02:20.838467  1646 consensus_peers.cc:597] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 -> Peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Couldn't send request to peer 39a92f5a4352465d8af3af5908fe8642. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:20.839598   431 raft_consensus.cc:2272] T 21e83a626139459097bb40dc22d9bd93 P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:20.843827  1646 consensus_peers.cc:597] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 -> Peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Couldn't send request to peer 39a92f5a4352465d8af3af5908fe8642. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:20.846290   431 tablet_replica.cc:333] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642: stopping tablet replica
I20260709 13:02:20.850446   431 raft_consensus.cc:2243] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:20.851169   431 raft_consensus.cc:2272] T 819fbeffe41b4610a05fcaac38e161b6 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:20.853873   431 tablet_replica.cc:333] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642: stopping tablet replica
I20260709 13:02:20.856221   431 raft_consensus.cc:2243] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 26 LEADER]: Raft consensus shutting down.
W20260709 13:02:20.836658  2190 consensus_peers.cc:597] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:02:20.876812   431 raft_consensus.cc:2272] T 43a7da8b76b845d39257f80dcbdf6b9a P 39a92f5a4352465d8af3af5908fe8642 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:20.879783   431 tablet_replica.cc:333] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642: stopping tablet replica
I20260709 13:02:20.882678   431 raft_consensus.cc:2243] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:02:20.884059   431 raft_consensus.cc:2272] T d0b325904f4646bca264eeeea15dfeb0 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:20.886974   431 tablet_replica.cc:333] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642: stopping tablet replica
I20260709 13:02:20.887985   431 raft_consensus.cc:2243] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:20.888615   431 raft_consensus.cc:2272] T 4190d217954f4f798b3a610501115290 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:20.891400   431 tablet_replica.cc:333] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642: stopping tablet replica
I20260709 13:02:20.892664   431 raft_consensus.cc:2243] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:20.893783   431 raft_consensus.cc:2272] T 1359810508724a7a8749ce09a6654a9c P 39a92f5a4352465d8af3af5908fe8642 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:20.898336  2192 consensus_peers.cc:597] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b -> Peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Couldn't send request to peer 39a92f5a4352465d8af3af5908fe8642. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:20.896737   431 tablet_replica.cc:333] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642: stopping tablet replica
I20260709 13:02:20.899921   431 raft_consensus.cc:2243] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:02:20.901783   431 raft_consensus.cc:2272] T 1975e24877834ab7ae6da515a5cf6251 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:20.896557  1646 consensus_peers.cc:597] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 -> Peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Couldn't send request to peer 39a92f5a4352465d8af3af5908fe8642. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:20.904516   431 tablet_replica.cc:333] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642: stopping tablet replica
W20260709 13:02:20.893904  1644 consensus_peers.cc:597] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:02:20.907083   431 raft_consensus.cc:2243] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:20.916574   431 raft_consensus.cc:2272] T 0b050d298db6466f856d263a342e3c51 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:20.920042   431 tablet_replica.cc:333] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642: stopping tablet replica
W20260709 13:02:20.920320  2192 consensus_peers.cc:597] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b -> Peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Couldn't send request to peer 39a92f5a4352465d8af3af5908fe8642. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:20.920900   431 raft_consensus.cc:2243] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:20.922338   431 raft_consensus.cc:2272] T 72071486140c4d6c919b25e882a8f5e5 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:20.926280   431 tablet_replica.cc:333] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642: stopping tablet replica
I20260709 13:02:20.928542   431 raft_consensus.cc:2243] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:02:20.930292   431 raft_consensus.cc:2272] T 9a873ede2f0f418cbcab98586dba9b1e P 39a92f5a4352465d8af3af5908fe8642 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:20.930964  2192 consensus_peers.cc:597] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b -> Peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Couldn't send request to peer 39a92f5a4352465d8af3af5908fe8642. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:20.922569  1646 consensus_peers.cc:597] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 -> Peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Couldn't send request to peer 39a92f5a4352465d8af3af5908fe8642. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:20.935071   431 tablet_replica.cc:333] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642: stopping tablet replica
W20260709 13:02:20.935957  2192 consensus_peers.cc:597] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b -> Peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Couldn't send request to peer 39a92f5a4352465d8af3af5908fe8642. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:20.939172   431 raft_consensus.cc:2243] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 19 LEADER]: Raft consensus shutting down.
W20260709 13:02:20.939280  2192 consensus_peers.cc:597] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b -> Peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Couldn't send request to peer 39a92f5a4352465d8af3af5908fe8642. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:20.941920   431 raft_consensus.cc:2272] T 9f373c2c361f4fafa5411e39387ef06e P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:20.945835   431 tablet_replica.cc:333] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642: stopping tablet replica
I20260709 13:02:20.949307   431 raft_consensus.cc:2243] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:02:20.951414   431 raft_consensus.cc:2272] T cbe75e7a89594d3f81b1b8935b43b2ed P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:20.982872   431 tablet_replica.cc:333] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642: stopping tablet replica
I20260709 13:02:20.986017   431 raft_consensus.cc:2243] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:20.988700   431 raft_consensus.cc:2272] T a5802fa5e328499da4525506ccdf4dc9 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:20.993623   431 tablet_replica.cc:333] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642: stopping tablet replica
I20260709 13:02:20.995110   431 raft_consensus.cc:2243] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 21 LEADER]: Raft consensus shutting down.
W20260709 13:02:20.997429  1573 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:20.997880   431 raft_consensus.cc:2272] T 112134ca2a6243c98c85c27d41496747 P 39a92f5a4352465d8af3af5908fe8642 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:21.006896  2192 consensus_peers.cc:597] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b -> Peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Couldn't send request to peer 39a92f5a4352465d8af3af5908fe8642. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:21.033497  1644 consensus_peers.cc:597] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:02:21.045214  2192 consensus_peers.cc:597] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b -> Peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Couldn't send request to peer 39a92f5a4352465d8af3af5908fe8642. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:21.045586   431 tablet_replica.cc:333] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642: stopping tablet replica
I20260709 13:02:21.046947   431 raft_consensus.cc:2243] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:21.057406   431 raft_consensus.cc:2272] T 2abb9a42c35f4b6386342bccdff6fbf0 P 39a92f5a4352465d8af3af5908fe8642 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:21.063230   431 tablet_replica.cc:333] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642: stopping tablet replica
I20260709 13:02:21.064869   431 raft_consensus.cc:2243] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:02:21.067430   431 raft_consensus.cc:2272] T fbb85f388454464192e052f706a78e65 P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:21.071167   431 tablet_replica.cc:333] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642: stopping tablet replica
I20260709 13:02:21.072402   431 raft_consensus.cc:2243] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:02:21.075382   431 raft_consensus.cc:2272] T 7ba438a35d164c02a9840bbedeac6097 P 39a92f5a4352465d8af3af5908fe8642 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:21.079639   431 tablet_replica.cc:333] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642: stopping tablet replica
I20260709 13:02:21.080988   431 raft_consensus.cc:2243] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:21.083596   431 raft_consensus.cc:2272] T 7d60bdd9b7f543e180698438c413d061 P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:21.084969  2190 consensus_peers.cc:597] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:02:21.087612   431 tablet_replica.cc:333] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642: stopping tablet replica
I20260709 13:02:21.088591   431 raft_consensus.cc:2243] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:02:21.091107   431 raft_consensus.cc:2272] T fb3a9a4620ef4fcd86eb78530746a583 P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:21.092312  1644 consensus_peers.cc:597] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:02:21.095024   431 tablet_replica.cc:333] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642: stopping tablet replica
I20260709 13:02:21.096356   431 raft_consensus.cc:2243] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:02:21.098541   431 raft_consensus.cc:2272] T 4faabc98f1164ba881cfb477657da505 P 39a92f5a4352465d8af3af5908fe8642 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:21.102922   431 tablet_replica.cc:333] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642: stopping tablet replica
I20260709 13:02:21.103942   431 raft_consensus.cc:2243] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:21.105438   431 raft_consensus.cc:2272] T 1e4adfe2190c4487ab72be02d6cfa923 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:21.109596   431 tablet_replica.cc:333] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642: stopping tablet replica
I20260709 13:02:21.112557   431 raft_consensus.cc:2243] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:21.120083   431 raft_consensus.cc:2272] T dcad30336a5440bca17cda2724035211 P 39a92f5a4352465d8af3af5908fe8642 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:21.125257   431 tablet_replica.cc:333] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642: stopping tablet replica
I20260709 13:02:21.126190   431 raft_consensus.cc:2243] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Raft consensus shutting down.
W20260709 13:02:21.127195  1646 consensus_peers.cc:597] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 -> Peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Couldn't send request to peer 39a92f5a4352465d8af3af5908fe8642. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:21.127704   431 raft_consensus.cc:2272] T 317204271cc04f68818b36450c9725b1 P 39a92f5a4352465d8af3af5908fe8642 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:21.131445   431 tablet_replica.cc:333] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642: stopping tablet replica
I20260709 13:02:21.132337   431 raft_consensus.cc:2243] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 22 FOLLOWER]: Raft consensus shutting down.
W20260709 13:02:21.132694  2192 consensus_peers.cc:597] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b -> Peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Couldn't send request to peer 39a92f5a4352465d8af3af5908fe8642. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:21.133414   431 raft_consensus.cc:2272] T c6bffb0971b74366af514d43d81b1d50 P 39a92f5a4352465d8af3af5908fe8642 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:21.137506  2192 consensus_peers.cc:597] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b -> Peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Couldn't send request to peer 39a92f5a4352465d8af3af5908fe8642. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:21.144524   431 tablet_replica.cc:333] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642: stopping tablet replica
I20260709 13:02:21.145602   431 raft_consensus.cc:2243] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 16 LEADER]: Raft consensus shutting down.
W20260709 13:02:21.154682  1570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:21.157719   431 raft_consensus.cc:2272] T 3406989a2b754fe7804c691a11bba6d0 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:21.161474   431 tablet_replica.cc:333] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642: stopping tablet replica
I20260709 13:02:21.162289   431 raft_consensus.cc:2243] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:21.164345   431 raft_consensus.cc:2272] T 2eadc97fd6dd494596f9ea9242d9db59 P 39a92f5a4352465d8af3af5908fe8642 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:21.167819   431 tablet_replica.cc:333] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642: stopping tablet replica
I20260709 13:02:21.168671   431 raft_consensus.cc:2243] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:02:21.170447   431 raft_consensus.cc:2272] T 8e096d30f7404398b10b9cd77da3c04c P 39a92f5a4352465d8af3af5908fe8642 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:21.175655   431 tablet_replica.cc:333] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642: stopping tablet replica
I20260709 13:02:21.177373   431 raft_consensus.cc:2243] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:21.178756   431 raft_consensus.cc:2272] T 9b906ca026f44e76913719f278eed7d3 P 39a92f5a4352465d8af3af5908fe8642 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:21.314365  1644 consensus_peers.cc:597] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:02:21.497781  2190 consensus_peers.cc:597] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:21.549724  2190 consensus_peers.cc:597] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:21.599840  1644 consensus_peers.cc:597] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:21.683072  2190 consensus_peers.cc:597] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:02:21.799202  8933 raft_consensus.cc:493] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:02:21.799897  8933 raft_consensus.cc:515] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:21.810654  8927 raft_consensus.cc:493] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:02:21.811326  8927 raft_consensus.cc:515] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:21.813946  8927 leader_election.cc:290] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:02:21.820654  8933 leader_election.cc:290] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:02:21.822314  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
W20260709 13:02:21.826864  2192 leader_election.cc:336] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Network error: Client connection negotiation failed: client connection to 127.0.107.194:40303: connect: Connection refused (error 111)
I20260709 13:02:21.827469  2192 leader_election.cc:304] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
W20260709 13:02:21.831360  2192 leader_election.cc:336] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Network error: Client connection negotiation failed: client connection to 127.0.107.194:40303: connect: Connection refused (error 111)
I20260709 13:02:21.831933  8933 raft_consensus.cc:2749] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:21.842767  8939 raft_consensus.cc:493] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:02:21.843477  8939 raft_consensus.cc:515] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:02:21.845767  8939 leader_election.cc:290] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
W20260709 13:02:21.859633  1646 leader_election.cc:336] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Network error: Client connection negotiation failed: client connection to 127.0.107.194:40303: connect: Connection refused (error 111)
W20260709 13:02:21.891295  1644 consensus_peers.cc:597] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:21.893869  1644 leader_election.cc:336] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111)
I20260709 13:02:21.896036  1644 leader_election.cc:304] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:02:21.892503  2190 leader_election.cc:336] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111)
I20260709 13:02:21.897652  2190 leader_election.cc:304] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:02:21.898849  8933 raft_consensus.cc:2749] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:02:21.900406  8939 raft_consensus.cc:2749] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:21.911681  8939 raft_consensus.cc:493] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:02:21.914541  8939 raft_consensus.cc:515] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:02:21.922089  8939 leader_election.cc:290] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:02:21.944911  8927 raft_consensus.cc:493] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:02:21.945811  8927 raft_consensus.cc:515] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:21.952728  8927 leader_election.cc:290] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
W20260709 13:02:21.961156  2192 leader_election.cc:336] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Network error: Client connection negotiation failed: client connection to 127.0.107.194:40303: connect: Connection refused (error 111)
W20260709 13:02:21.962127  2190 leader_election.cc:336] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111)
I20260709 13:02:21.962566  2190 leader_election.cc:304] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:02:21.963557  8942 raft_consensus.cc:2749] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:22.072551  8927 raft_consensus.cc:493] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:02:22.073244  8927 raft_consensus.cc:515] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:22.075764  8927 leader_election.cc:290] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:02:22.077118  8927 raft_consensus.cc:493] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:02:22.077692  8927 raft_consensus.cc:515] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:22.079849  8927 leader_election.cc:290] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
W20260709 13:02:22.086625  2192 leader_election.cc:336] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Network error: Client connection negotiation failed: client connection to 127.0.107.194:40303: connect: Connection refused (error 111)
W20260709 13:02:22.087198  2192 leader_election.cc:336] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Network error: Client connection negotiation failed: client connection to 127.0.107.194:40303: connect: Connection refused (error 111)
W20260709 13:02:22.090178  2190 consensus_peers.cc:597] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:02:22.093163  2190 leader_election.cc:336] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111)
W20260709 13:02:22.093410  1646 leader_election.cc:336] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Network error: Client connection negotiation failed: client connection to 127.0.107.194:40303: connect: Connection refused (error 111)
I20260709 13:02:22.093621  2190 leader_election.cc:304] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:02:22.096195  8931 raft_consensus.cc:493] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:02:22.096822  8931 raft_consensus.cc:515] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:22.097258  8927 raft_consensus.cc:2749] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:22.104642  8931 leader_election.cc:290] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:02:22.106377  2225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:02:22.107158  2225 raft_consensus.cc:2468] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 15.
I20260709 13:02:22.294196  8944 raft_consensus.cc:493] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:02:22.302192  8944 raft_consensus.cc:515] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:02:22.334043  8944 leader_election.cc:290] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:02:22.451330  8944 raft_consensus.cc:493] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:02:22.452090  8944 raft_consensus.cc:515] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:02:22.454813  8944 leader_election.cc:290] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:02:22.467163  8939 raft_consensus.cc:493] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:02:22.467935  8939 raft_consensus.cc:515] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
W20260709 13:02:22.471829  1646 leader_election.cc:336] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Network error: Client connection negotiation failed: client connection to 127.0.107.194:40303: connect: Connection refused (error 111)
I20260709 13:02:22.481885  8944 raft_consensus.cc:493] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:02:22.520766  8944 raft_consensus.cc:515] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:02:22.528714  8944 leader_election.cc:290] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:02:22.534592  8944 raft_consensus.cc:493] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:02:22.539191  8944 raft_consensus.cc:515] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:02:22.545378  8944 leader_election.cc:290] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:02:22.547278  8939 leader_election.cc:290] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
W20260709 13:02:22.554951  1646 leader_election.cc:336] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Network error: Client connection negotiation failed: client connection to 127.0.107.194:40303: connect: Connection refused (error 111)
W20260709 13:02:22.567385  1646 leader_election.cc:336] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Network error: Client connection negotiation failed: client connection to 127.0.107.194:40303: connect: Connection refused (error 111)
W20260709 13:02:22.568231  1646 leader_election.cc:336] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Network error: Client connection negotiation failed: client connection to 127.0.107.194:40303: connect: Connection refused (error 111)
I20260709 13:02:22.559103  8942 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:02:22.570148  8942 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:22.572676  8942 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:02:22.585027  8946 raft_consensus.cc:493] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:02:22.608640  8946 raft_consensus.cc:515] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:22.610963  8946 leader_election.cc:290] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:02:22.586974  8939 raft_consensus.cc:493] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:02:22.612432  8939 raft_consensus.cc:515] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:02:22.614444  2192 leader_election.cc:336] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Network error: Client connection negotiation failed: client connection to 127.0.107.194:40303: connect: Connection refused (error 111)
I20260709 13:02:22.588564  8947 raft_consensus.cc:493] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:02:22.615264  8947 raft_consensus.cc:515] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:22.617400  8947 leader_election.cc:290] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:02:22.595170  8953 raft_consensus.cc:493] T d53340cc35954204b06e3743bec8adbf P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:02:22.618528  8953 raft_consensus.cc:515] T d53340cc35954204b06e3743bec8adbf P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:22.620716  8953 leader_election.cc:290] T d53340cc35954204b06e3743bec8adbf P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:02:22.596215  8931 raft_consensus.cc:493] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:02:22.621716  8931 raft_consensus.cc:515] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:02:22.623646  8931 leader_election.cc:290] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:02:22.596451  8952 raft_consensus.cc:493] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
W20260709 13:02:22.624912  2192 leader_election.cc:336] T d53340cc35954204b06e3743bec8adbf P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Network error: Client connection negotiation failed: client connection to 127.0.107.194:40303: connect: Connection refused (error 111)
I20260709 13:02:22.624598  8952 raft_consensus.cc:515] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:22.627552  8952 leader_election.cc:290] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:02:22.597558  8945 raft_consensus.cc:493] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:02:22.628777  8945 raft_consensus.cc:515] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:22.631067  8945 leader_election.cc:290] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:02:22.589390  8955 raft_consensus.cc:493] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:02:22.634013  8955 raft_consensus.cc:515] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:02:22.636312  8955 leader_election.cc:290] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:02:22.598735  8950 raft_consensus.cc:493] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:02:22.656136  8950 raft_consensus.cc:515] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:22.658541  8950 leader_election.cc:290] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:02:22.614687  8939 leader_election.cc:290] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
W20260709 13:02:22.605247  1644 leader_election.cc:336] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111)
I20260709 13:02:22.659838  1644 leader_election.cc:304] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:02:22.660704  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 55465us
I20260709 13:02:22.597589  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:02:22.598459  8949 raft_consensus.cc:493] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
W20260709 13:02:22.662685  2192 leader_election.cc:336] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Network error: Client connection negotiation failed: client connection to 127.0.107.194:40303: connect: Connection refused (error 111)
I20260709 13:02:22.663115  8949 raft_consensus.cc:515] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:22.665622  8949 leader_election.cc:290] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:02:22.600071  8954 raft_consensus.cc:493] T 9a873ede2f0f418cbcab98586dba9b1e P b96ce9cc496c49d7818fa983a17b062b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:02:22.666405  8954 raft_consensus.cc:515] T 9a873ede2f0f418cbcab98586dba9b1e P b96ce9cc496c49d7818fa983a17b062b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:22.668018  1674 raft_consensus.cc:2468] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 15.
I20260709 13:02:22.668745  8954 leader_election.cc:290] T 9a873ede2f0f418cbcab98586dba9b1e P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:02:22.653841  8936 raft_consensus.cc:493] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:02:22.671485  8936 raft_consensus.cc:515] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } }
I20260709 13:02:22.673727  8936 leader_election.cc:290] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:02:22.674299  8936 raft_consensus.cc:2749] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:22.578575  8951 raft_consensus.cc:493] T 3406989a2b754fe7804c691a11bba6d0 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:02:22.675475  8951 raft_consensus.cc:515] T 3406989a2b754fe7804c691a11bba6d0 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:02:22.680936  2192 leader_election.cc:336] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Network error: Client connection negotiation failed: client connection to 127.0.107.194:40303: connect: Connection refused (error 111)
W20260709 13:02:22.681432  2192 leader_election.cc:336] T 9a873ede2f0f418cbcab98586dba9b1e P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Network error: Client connection negotiation failed: client connection to 127.0.107.194:40303: connect: Connection refused (error 111)
W20260709 13:02:22.686678  1644 leader_election.cc:336] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111)
I20260709 13:02:22.687268  1644 leader_election.cc:304] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:02:22.688275  2192 leader_election.cc:336] T 3406989a2b754fe7804c691a11bba6d0 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Network error: Client connection negotiation failed: client connection to 127.0.107.194:40303: connect: Connection refused (error 111)
W20260709 13:02:22.688551  1644 leader_election.cc:336] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111)
I20260709 13:02:22.693933  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:02:22.695111  1681 raft_consensus.cc:2468] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 18.
I20260709 13:02:22.695829  1644 leader_election.cc:304] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:02:22.696579  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:02:22.699638  1674 raft_consensus.cc:2468] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 17.
W20260709 13:02:22.696651  2190 leader_election.cc:336] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111)
I20260709 13:02:22.698764  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:02:22.698920  2191 leader_election.cc:304] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:02:22.700681  1681 raft_consensus.cc:2468] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 21.
I20260709 13:02:22.701260  8954 raft_consensus.cc:2804] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:22.701339  2190 leader_election.cc:304] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:02:22.701817  8954 raft_consensus.cc:493] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:02:22.702242  8954 raft_consensus.cc:3060] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:02:22.702515  2190 consensus_peers.cc:597] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:02:22.703594  2190 leader_election.cc:336] T d53340cc35954204b06e3743bec8adbf P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111)
I20260709 13:02:22.704041  2190 leader_election.cc:304] T d53340cc35954204b06e3743bec8adbf P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:02:22.706893  8950 raft_consensus.cc:2749] T d53340cc35954204b06e3743bec8adbf P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:22.702190  8949 raft_consensus.cc:2749] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:02:22.712553  8954 raft_consensus.cc:515] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:22.718019  8944 raft_consensus.cc:2749] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:02:22.719892  2192 leader_election.cc:336] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Network error: Client connection negotiation failed: client connection to 127.0.107.194:40303: connect: Connection refused (error 111)
I20260709 13:02:22.688823  8955 raft_consensus.cc:2749] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:02:22.730533  2190 leader_election.cc:336] T 3406989a2b754fe7804c691a11bba6d0 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111)
I20260709 13:02:22.731195  2190 leader_election.cc:304] T 3406989a2b754fe7804c691a11bba6d0 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:02:22.732813  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:02:22.733296  2191 leader_election.cc:304] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:02:22.733471  2221 raft_consensus.cc:2468] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 18.
I20260709 13:02:22.734119  8933 raft_consensus.cc:2749] T 3406989a2b754fe7804c691a11bba6d0 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:22.734866  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:02:22.735553  2221 raft_consensus.cc:2468] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 18.
I20260709 13:02:22.736279  8933 raft_consensus.cc:2804] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:22.734460  2191 leader_election.cc:304] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:02:22.736799  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:02:22.737524  2221 raft_consensus.cc:2468] T 9a873ede2f0f418cbcab98586dba9b1e P b96ce9cc496c49d7818fa983a17b062b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 21.
I20260709 13:02:22.736730  8933 raft_consensus.cc:493] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:02:22.737706  2191 leader_election.cc:304] T 9a873ede2f0f418cbcab98586dba9b1e P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:02:22.738093  8933 raft_consensus.cc:3060] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:22.738567  8940 raft_consensus.cc:2804] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:22.738981  8940 raft_consensus.cc:493] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:02:22.739336  8940 raft_consensus.cc:3060] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:22.741398  8942 raft_consensus.cc:2804] T 9a873ede2f0f418cbcab98586dba9b1e P b96ce9cc496c49d7818fa983a17b062b [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:02:22.741772  8942 raft_consensus.cc:493] T 9a873ede2f0f418cbcab98586dba9b1e P b96ce9cc496c49d7818fa983a17b062b [term 21 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:02:22.742128  8942 raft_consensus.cc:3060] T 9a873ede2f0f418cbcab98586dba9b1e P b96ce9cc496c49d7818fa983a17b062b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:22.746927  8933 raft_consensus.cc:515] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:22.750952  8933 leader_election.cc:290] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 19 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:02:22.753306  8940 raft_consensus.cc:515] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:02:22.754287  2192 leader_election.cc:336] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Network error: Client connection negotiation failed: client connection to 127.0.107.194:40303: connect: Connection refused (error 111)
I20260709 13:02:22.756546  8954 leader_election.cc:290] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 16 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:02:22.700148  1644 leader_election.cc:336] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111)
I20260709 13:02:22.757956  1644 leader_election.cc:304] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:02:22.759397  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43931, user_credentials={real_user=slave}} blocked reactor thread for 59235.5us
I20260709 13:02:22.759949  8955 raft_consensus.cc:2749] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:02:22.760115  2192 leader_election.cc:336] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Network error: Client connection negotiation failed: client connection to 127.0.107.194:40303: connect: Connection refused (error 111)
I20260709 13:02:22.761972  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:02:22.762391  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3406989a2b754fe7804c691a11bba6d0" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90" is_pre_election: true
I20260709 13:02:22.762702  2221 raft_consensus.cc:2468] T 3406989a2b754fe7804c691a11bba6d0 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 16.
I20260709 13:02:22.763063  1681 raft_consensus.cc:2468] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 16.
I20260709 13:02:22.750771  8951 leader_election.cc:290] T 3406989a2b754fe7804c691a11bba6d0 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:02:22.764351  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b" is_pre_election: true
I20260709 13:02:22.765053  2221 raft_consensus.cc:2393] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddf11fc190dd4b898773379c6b129d90 in current term 18: Already voted for candidate b96ce9cc496c49d7818fa983a17b062b in this term.
I20260709 13:02:22.764958  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb3a9a4620ef4fcd86eb78530746a583" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:02:22.765668  1681 raft_consensus.cc:3060] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:02:22.767318  1644 leader_election.cc:336] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111)
I20260709 13:02:22.772913  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073cc710cf6642bb940606f8df5c2331" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:02:22.771716  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba438a35d164c02a9840bbedeac6097" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:02:22.773725  1674 raft_consensus.cc:3060] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:22.762037  1646 leader_election.cc:304] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:02:22.777254  8940 leader_election.cc:290] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 18 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:02:22.770705  8942 raft_consensus.cc:515] T 9a873ede2f0f418cbcab98586dba9b1e P b96ce9cc496c49d7818fa983a17b062b [term 22 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:22.773754  1673 raft_consensus.cc:3060] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:02:22.786963  2192 leader_election.cc:336] T 9a873ede2f0f418cbcab98586dba9b1e P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Network error: Client connection negotiation failed: client connection to 127.0.107.194:40303: connect: Connection refused (error 111)
W20260709 13:02:22.773434  1644 leader_election.cc:336] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111)
I20260709 13:02:22.790964  8942 leader_election.cc:290] T 9a873ede2f0f418cbcab98586dba9b1e P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 22 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:02:22.792570  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a873ede2f0f418cbcab98586dba9b1e" candidate_uuid: "b96ce9cc496c49d7818fa983a17b062b" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ddf11fc190dd4b898773379c6b129d90"
I20260709 13:02:22.793226  1677 raft_consensus.cc:3060] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:22.795902  1673 raft_consensus.cc:2468] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 16.
I20260709 13:02:22.796452  8952 raft_consensus.cc:2764] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
W20260709 13:02:22.798800  1644 leader_election.cc:336] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111)
W20260709 13:02:22.799444  1644 leader_election.cc:336] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111)
W20260709 13:02:22.799942  1644 leader_election.cc:336] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111)
W20260709 13:02:22.800683  1644 leader_election.cc:336] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111)
I20260709 13:02:22.793731  1674 raft_consensus.cc:2468] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 18.
I20260709 13:02:22.773046  1681 raft_consensus.cc:2468] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 19.
I20260709 13:02:22.801864  2191 leader_election.cc:304] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:02:22.804005  2191 leader_election.cc:304] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:02:22.805063  2191 leader_election.cc:304] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:02:22.805070  1646 leader_election.cc:304] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:02:22.805704  8940 raft_consensus.cc:2804] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:22.801244  1677 raft_consensus.cc:2468] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b96ce9cc496c49d7818fa983a17b062b in term 22.
I20260709 13:02:22.807178  8940 raft_consensus.cc:697] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 16 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:02:22.807993  2191 leader_election.cc:304] T 9a873ede2f0f418cbcab98586dba9b1e P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642
I20260709 13:02:22.808804  8954 raft_consensus.cc:2804] T 9a873ede2f0f418cbcab98586dba9b1e P b96ce9cc496c49d7818fa983a17b062b [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:02:22.809036  8940 consensus_queue.cc:237] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:22.806074  8942 raft_consensus.cc:2804] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:22.809540  8954 raft_consensus.cc:697] T 9a873ede2f0f418cbcab98586dba9b1e P b96ce9cc496c49d7818fa983a17b062b [term 22 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:02:22.812734  8942 raft_consensus.cc:697] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 18 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:02:22.813231  8954 consensus_queue.cc:237] T 9a873ede2f0f418cbcab98586dba9b1e P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:22.813828  8942 consensus_queue.cc:237] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:22.815912  8952 raft_consensus.cc:2764] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 13:02:22.816836  1646 leader_election.cc:304] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:02:22.806648  8951 raft_consensus.cc:2804] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:02:22.817606  8952 raft_consensus.cc:2804] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:22.817971  8952 raft_consensus.cc:493] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:02:22.818377  8952 raft_consensus.cc:3060] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:22.818310  1646 leader_election.cc:304] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:02:22.821240  8955 raft_consensus.cc:2764] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
I20260709 13:02:22.817940  8951 raft_consensus.cc:697] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 19 LEADER]: Becoming Leader. State: Replica: b96ce9cc496c49d7818fa983a17b062b, State: Running, Role: LEADER
I20260709 13:02:22.826814  8951 consensus_queue.cc:237] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:02:22.831547  1646 leader_election.cc:336] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Network error: Client connection negotiation failed: client connection to 127.0.107.194:40303: connect: Connection refused (error 111)
I20260709 13:02:22.832507  1646 leader_election.cc:304] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:02:22.832724  8952 raft_consensus.cc:515] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:22.840981  8952 leader_election.cc:290] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 19 election: Requested vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), b96ce9cc496c49d7818fa983a17b062b (127.0.107.196:37373)
I20260709 13:02:22.846725  1422 catalog_manager.cc:5697] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 15 to 16, leader changed from 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) to b96ce9cc496c49d7818fa983a17b062b (127.0.107.196). New cstate: current_term: 16 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:02:22.851684  1646 leader_election.cc:336] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Network error: Client connection negotiation failed: client connection to 127.0.107.194:40303: connect: Connection refused (error 111)
I20260709 13:02:22.852113  1646 leader_election.cc:304] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:02:22.853484  8955 raft_consensus.cc:2749] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:22.854159  8955 raft_consensus.cc:2749] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:22.862361  2221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4b8c02fb560459fbbb59424361a5457" candidate_uuid: "ddf11fc190dd4b898773379c6b129d90" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b96ce9cc496c49d7818fa983a17b062b"
I20260709 13:02:22.863041  2221 raft_consensus.cc:3060] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:02:22.875003  1644 consensus_peers.cc:597] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:02:22.881508  1646 leader_election.cc:336] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Network error: Client connection negotiation failed: client connection to 127.0.107.194:40303: connect: Connection refused (error 111)
W20260709 13:02:22.882401  1646 leader_election.cc:336] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Network error: Client connection negotiation failed: client connection to 127.0.107.194:40303: connect: Connection refused (error 111)
W20260709 13:02:22.883266  1646 leader_election.cc:336] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Network error: Client connection negotiation failed: client connection to 127.0.107.194:40303: connect: Connection refused (error 111)
W20260709 13:02:22.884007  1646 leader_election.cc:336] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Network error: Client connection negotiation failed: client connection to 127.0.107.194:40303: connect: Connection refused (error 111)
I20260709 13:02:22.884433  1646 leader_election.cc:304] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:02:22.884639  2221 raft_consensus.cc:2468] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddf11fc190dd4b898773379c6b129d90 in term 19.
W20260709 13:02:22.885865  1646 leader_election.cc:336] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Network error: Client connection negotiation failed: client connection to 127.0.107.194:40303: connect: Connection refused (error 111)
I20260709 13:02:22.886200  8952 raft_consensus.cc:2749] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:22.886927  1646 leader_election.cc:304] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:02:22.887809  8952 raft_consensus.cc:2749] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:02:22.888083  1646 leader_election.cc:336] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Network error: Client connection negotiation failed: client connection to 127.0.107.194:40303: connect: Connection refused (error 111)
I20260709 13:02:22.888645  1646 leader_election.cc:304] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, b96ce9cc496c49d7818fa983a17b062b
I20260709 13:02:22.891361  8952 raft_consensus.cc:2749] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:02:22.891587  1646 leader_election.cc:336] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Network error: Client connection negotiation failed: client connection to 127.0.107.194:40303: connect: Connection refused (error 111)
I20260709 13:02:22.892009  1646 leader_election.cc:304] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:02:22.892654  8944 raft_consensus.cc:2749] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:02:22.893515  1646 leader_election.cc:336] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Network error: Client connection negotiation failed: client connection to 127.0.107.194:40303: connect: Connection refused (error 111)
I20260709 13:02:22.893900  1646 leader_election.cc:304] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddf11fc190dd4b898773379c6b129d90; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:02:22.894531  8944 raft_consensus.cc:2749] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:22.900029  1646 leader_election.cc:304] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b, ddf11fc190dd4b898773379c6b129d90; no voters: 
I20260709 13:02:22.900838  8944 raft_consensus.cc:2804] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:02:22.900908  1646 leader_election.cc:336] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Network error: Client connection negotiation failed: client connection to 127.0.107.194:40303: connect: Connection refused (error 111)
I20260709 13:02:22.901393  8944 raft_consensus.cc:697] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 19 LEADER]: Becoming Leader. State: Replica: ddf11fc190dd4b898773379c6b129d90, State: Running, Role: LEADER
I20260709 13:02:22.902267  8944 consensus_queue.cc:237] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:22.928342  1422 catalog_manager.cc:5697] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 reported cstate change: term changed from 18 to 19, leader changed from 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) to ddf11fc190dd4b898773379c6b129d90 (127.0.107.195). New cstate: current_term: 19 leader_uuid: "ddf11fc190dd4b898773379c6b129d90" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:22.935387  1427 catalog_manager.cc:5697] T 9a873ede2f0f418cbcab98586dba9b1e P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 21 to 22, leader changed from 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) to b96ce9cc496c49d7818fa983a17b062b (127.0.107.196). New cstate: current_term: 22 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:22.937304  1427 catalog_manager.cc:5697] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 17 to 18, leader changed from 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) to b96ce9cc496c49d7818fa983a17b062b (127.0.107.196). New cstate: current_term: 18 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:22.938947  1427 catalog_manager.cc:5697] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b reported cstate change: term changed from 18 to 19, leader changed from 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194) to b96ce9cc496c49d7818fa983a17b062b (127.0.107.196). New cstate: current_term: 19 leader_uuid: "b96ce9cc496c49d7818fa983a17b062b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:02:23.006628  2190 consensus_peers.cc:597] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:02:23.022352  2190 consensus_peers.cc:597] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:02:23.023550  2190 consensus_peers.cc:597] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:02:23.032756   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
W20260709 13:02:23.101855  1646 consensus_peers.cc:597] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 -> Peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Couldn't send request to peer 39a92f5a4352465d8af3af5908fe8642. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:40303: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:23.105031  1646 consensus_peers.cc:597] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 -> Peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Couldn't send request to peer 39a92f5a4352465d8af3af5908fe8642. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:40303: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:23.113667  1702 debug-util.cc:398] Leaking SignalData structure 0x7b08003ea760 after lost signal to thread 434
W20260709 13:02:23.114931  1702 debug-util.cc:398] Leaking SignalData structure 0x7b08003121e0 after lost signal to thread 1464
W20260709 13:02:23.116459  1702 debug-util.cc:398] Leaking SignalData structure 0x7b080031c0c0 after lost signal to thread 1705
W20260709 13:02:23.117808  1702 debug-util.cc:398] Leaking SignalData structure 0x7b0800308fe0 after lost signal to thread 2251
W20260709 13:02:23.135675  1644 consensus_peers.cc:597] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:02:23.201380   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
W20260709 13:02:23.212158  2190 consensus_peers.cc:597] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:02:23.215230  2190 consensus_peers.cc:597] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:02:23.261761  2191 consensus_peers.cc:597] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b -> Peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217): Couldn't send request to peer ddf11fc190dd4b898773379c6b129d90. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:23.287439  2192 consensus_peers.cc:597] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b -> Peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Couldn't send request to peer 39a92f5a4352465d8af3af5908fe8642. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:40303: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:23.290237  2191 consensus_peers.cc:597] T 9a873ede2f0f418cbcab98586dba9b1e P b96ce9cc496c49d7818fa983a17b062b -> Peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217): Couldn't send request to peer ddf11fc190dd4b898773379c6b129d90. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:23.295996  2192 consensus_peers.cc:597] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b -> Peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Couldn't send request to peer 39a92f5a4352465d8af3af5908fe8642. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:40303: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:23.301296  2192 consensus_peers.cc:597] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b -> Peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Couldn't send request to peer 39a92f5a4352465d8af3af5908fe8642. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:40303: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:23.313673   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:02:23.313901  2192 consensus_peers.cc:597] T 9a873ede2f0f418cbcab98586dba9b1e P b96ce9cc496c49d7818fa983a17b062b -> Peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Couldn't send request to peer 39a92f5a4352465d8af3af5908fe8642. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:40303: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:23.315054   431 tablet_replica.cc:333] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90: stopping tablet replica
I20260709 13:02:23.316059   431 raft_consensus.cc:2243] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:02:23.317159   431 raft_consensus.cc:2272] T c0e4d309cca4449096f65b38755e557e P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.322377   431 tablet_replica.cc:333] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90: stopping tablet replica
I20260709 13:02:23.323197   431 raft_consensus.cc:2243] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:02:23.324345   431 raft_consensus.cc:2272] T 822e65124bb44159b257fd219d28d93c P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.327301   431 tablet_replica.cc:333] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90: stopping tablet replica
I20260709 13:02:23.329258   431 raft_consensus.cc:2243] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:02:23.330711   431 raft_consensus.cc:2272] T 4ea41c88222b469fb11229faef735050 P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.333261   431 tablet_replica.cc:333] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90: stopping tablet replica
I20260709 13:02:23.334092   431 raft_consensus.cc:2243] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:02:23.336035   431 raft_consensus.cc:2272] T 8ea5da45c6d2479383e6af85e0a394b5 P ddf11fc190dd4b898773379c6b129d90 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:23.338547  1646 consensus_peers.cc:597] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 -> Peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Couldn't send request to peer 39a92f5a4352465d8af3af5908fe8642. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:40303: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:23.339048   431 tablet_replica.cc:333] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90: stopping tablet replica
I20260709 13:02:23.340032   431 raft_consensus.cc:2243] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.340674   431 raft_consensus.cc:2272] T 0ff83996d65d44e1925b89ba8eacd311 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.343343   431 tablet_replica.cc:333] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90: stopping tablet replica
I20260709 13:02:23.344122   431 raft_consensus.cc:2243] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.344982   431 raft_consensus.cc:2272] T 073cc710cf6642bb940606f8df5c2331 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.347654   431 tablet_replica.cc:333] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90: stopping tablet replica
I20260709 13:02:23.348440   431 raft_consensus.cc:2243] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:02:23.349543   431 raft_consensus.cc:2272] T 4549f0dba6504cfda954259e71ec4c91 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.353245   431 tablet_replica.cc:333] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90: stopping tablet replica
I20260709 13:02:23.354087   431 raft_consensus.cc:2243] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:02:23.355129   431 raft_consensus.cc:2272] T a7cff69bd4394da195321efd78d5a703 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.358347   431 tablet_replica.cc:333] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90: stopping tablet replica
W20260709 13:02:23.358700  2191 consensus_peers.cc:597] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b -> Peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217): Couldn't send request to peer ddf11fc190dd4b898773379c6b129d90. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:23.359117   431 raft_consensus.cc:2243] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.359824   431 raft_consensus.cc:2272] T 93811be2a8094a489bcf8091e503f2c9 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:23.363914  1646 consensus_peers.cc:597] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 -> Peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Couldn't send request to peer 39a92f5a4352465d8af3af5908fe8642. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:40303: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:23.364931   431 tablet_replica.cc:333] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90: stopping tablet replica
I20260709 13:02:23.365789   431 raft_consensus.cc:2243] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:02:23.366971   431 raft_consensus.cc:2272] T f3dd6988dfbe43e0ac446b79d37d9c24 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.369728   431 tablet_replica.cc:333] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90: stopping tablet replica
I20260709 13:02:23.370452   431 raft_consensus.cc:2243] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:02:23.371498   431 pending_rounds.cc:70] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90: Trying to abort 1 pending ops.
I20260709 13:02:23.371747   431 pending_rounds.cc:77] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90: Aborting op as it isn't in flight: id { term: 19 index: 15 } timestamp: 7305634377339453440 op_type: NO_OP noop_request { }
I20260709 13:02:23.372170   431 raft_consensus.cc:2889] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 19 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:02:23.372499   431 raft_consensus.cc:2272] T e4b8c02fb560459fbbb59424361a5457 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.375281   431 tablet_replica.cc:333] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90: stopping tablet replica
I20260709 13:02:23.376062   431 raft_consensus.cc:2243] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:02:23.377318   431 raft_consensus.cc:2272] T bf3b3cd19c1e496fa7fdb5550772123b P ddf11fc190dd4b898773379c6b129d90 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.379835   431 tablet_replica.cc:333] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90: stopping tablet replica
I20260709 13:02:23.380563   431 raft_consensus.cc:2243] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.381111   431 raft_consensus.cc:2272] T 7352869c54614c80af4953b2ce90cace P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.383670   431 tablet_replica.cc:333] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90: stopping tablet replica
I20260709 13:02:23.384445   431 raft_consensus.cc:2243] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.385057   431 raft_consensus.cc:2272] T 2228d923442c4e439f7f227db910dad8 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.390183   431 tablet_replica.cc:333] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90: stopping tablet replica
I20260709 13:02:23.391019   431 raft_consensus.cc:2243] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:02:23.392228   431 raft_consensus.cc:2272] T ad4dae0957134e9aba74a14dc8984866 P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.395160   431 tablet_replica.cc:333] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90: stopping tablet replica
I20260709 13:02:23.395932   431 raft_consensus.cc:2243] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:02:23.397073   431 raft_consensus.cc:2272] T e0590ffd096d4e378ab66c1795ff5cce P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:23.398161  2191 consensus_peers.cc:597] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b -> Peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217): Couldn't send request to peer ddf11fc190dd4b898773379c6b129d90. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:23.399809   431 tablet_replica.cc:333] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90: stopping tablet replica
I20260709 13:02:23.400664   431 raft_consensus.cc:2243] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.401332   431 raft_consensus.cc:2272] T 21e83a626139459097bb40dc22d9bd93 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.404398   431 tablet_replica.cc:333] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90: stopping tablet replica
I20260709 13:02:23.405149   431 raft_consensus.cc:2243] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:02:23.406219   431 raft_consensus.cc:2272] T 819fbeffe41b4610a05fcaac38e161b6 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:23.413786  1646 consensus_peers.cc:597] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 -> Peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Couldn't send request to peer 39a92f5a4352465d8af3af5908fe8642. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:40303: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:23.414881   431 tablet_replica.cc:333] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90: stopping tablet replica
I20260709 13:02:23.416042   431 raft_consensus.cc:2243] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:02:23.418968   431 raft_consensus.cc:2272] T 7d60bdd9b7f543e180698438c413d061 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.421830   431 tablet_replica.cc:333] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90: stopping tablet replica
I20260709 13:02:23.422964   431 raft_consensus.cc:2243] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.423707   431 raft_consensus.cc:2272] T fb3a9a4620ef4fcd86eb78530746a583 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:23.424957  2192 consensus_peers.cc:597] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b -> Peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Couldn't send request to peer 39a92f5a4352465d8af3af5908fe8642. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:40303: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:23.426568   431 tablet_replica.cc:333] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90: stopping tablet replica
I20260709 13:02:23.427457   431 raft_consensus.cc:2243] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.428105   431 raft_consensus.cc:2272] T 1359810508724a7a8749ce09a6654a9c P ddf11fc190dd4b898773379c6b129d90 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.431880   431 tablet_replica.cc:333] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90: stopping tablet replica
I20260709 13:02:23.432723   431 raft_consensus.cc:2243] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.433248   431 raft_consensus.cc:2272] T 1975e24877834ab7ae6da515a5cf6251 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.435825   431 tablet_replica.cc:333] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90: stopping tablet replica
W20260709 13:02:23.435881  2192 consensus_peers.cc:597] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b -> Peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Couldn't send request to peer 39a92f5a4352465d8af3af5908fe8642. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:40303: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:23.437707   431 raft_consensus.cc:2243] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.438328   431 raft_consensus.cc:2272] T 43a7da8b76b845d39257f80dcbdf6b9a P ddf11fc190dd4b898773379c6b129d90 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.441093   431 tablet_replica.cc:333] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90: stopping tablet replica
I20260709 13:02:23.441890   431 raft_consensus.cc:2243] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.442498   431 raft_consensus.cc:2272] T 0b050d298db6466f856d263a342e3c51 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:23.444378  2192 consensus_peers.cc:597] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b -> Peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Couldn't send request to peer 39a92f5a4352465d8af3af5908fe8642. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:40303: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:23.445578   431 tablet_replica.cc:333] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90: stopping tablet replica
I20260709 13:02:23.446406   431 raft_consensus.cc:2243] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 22 FOLLOWER]: Raft consensus shutting down.
W20260709 13:02:23.447038  2192 consensus_peers.cc:597] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b -> Peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Couldn't send request to peer 39a92f5a4352465d8af3af5908fe8642. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:40303: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:23.447566   431 raft_consensus.cc:2272] T 9a873ede2f0f418cbcab98586dba9b1e P ddf11fc190dd4b898773379c6b129d90 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.450173   431 tablet_replica.cc:333] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90: stopping tablet replica
I20260709 13:02:23.452636   431 raft_consensus.cc:2243] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.453219   431 raft_consensus.cc:2272] T 9f373c2c361f4fafa5411e39387ef06e P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.456187   431 tablet_replica.cc:333] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90: stopping tablet replica
I20260709 13:02:23.456998   431 raft_consensus.cc:2243] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.458387   431 raft_consensus.cc:2272] T 770925e70faa4a16a275abd5282f5284 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.461079   431 tablet_replica.cc:333] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90: stopping tablet replica
W20260709 13:02:23.461582  1644 consensus_peers.cc:597] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:02:23.461800   431 raft_consensus.cc:2243] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:02:23.463071   431 raft_consensus.cc:2272] T 4190d217954f4f798b3a610501115290 P ddf11fc190dd4b898773379c6b129d90 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:23.465833  2192 consensus_peers.cc:597] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b -> Peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Couldn't send request to peer 39a92f5a4352465d8af3af5908fe8642. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:40303: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:23.465999   431 tablet_replica.cc:333] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90: stopping tablet replica
I20260709 13:02:23.466970   431 raft_consensus.cc:2243] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.467636   431 raft_consensus.cc:2272] T 4faabc98f1164ba881cfb477657da505 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.470371   431 tablet_replica.cc:333] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90: stopping tablet replica
I20260709 13:02:23.471148   431 raft_consensus.cc:2243] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:02:23.472496   431 raft_consensus.cc:2272] T 53176f970a394c5cb2c76bd88f09c751 P ddf11fc190dd4b898773379c6b129d90 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.476759   431 tablet_replica.cc:333] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90: stopping tablet replica
I20260709 13:02:23.477487   431 raft_consensus.cc:2243] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.478034   431 raft_consensus.cc:2272] T e78618eba8b74effa4a90f2c8e34cc02 P ddf11fc190dd4b898773379c6b129d90 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.483704   431 tablet_replica.cc:333] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90: stopping tablet replica
I20260709 13:02:23.484478   431 raft_consensus.cc:2243] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 22 LEADER]: Raft consensus shutting down.
W20260709 13:02:23.484601  2190 consensus_peers.cc:597] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:02:23.490475  1646 consensus_peers.cc:597] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 -> Peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Couldn't send request to peer 39a92f5a4352465d8af3af5908fe8642. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:40303: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:23.491881   431 raft_consensus.cc:2272] T c6bffb0971b74366af514d43d81b1d50 P ddf11fc190dd4b898773379c6b129d90 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:23.493445  2191 consensus_peers.cc:597] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b -> Peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217): Couldn't send request to peer ddf11fc190dd4b898773379c6b129d90. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:23.494802   431 tablet_replica.cc:333] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90: stopping tablet replica
I20260709 13:02:23.495613   431 raft_consensus.cc:2243] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.496264   431 raft_consensus.cc:2272] T a031a0ef86384487bd1f89ead66f851b P ddf11fc190dd4b898773379c6b129d90 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.498811   431 tablet_replica.cc:333] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90: stopping tablet replica
I20260709 13:02:23.499583   431 raft_consensus.cc:2243] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.500186   431 raft_consensus.cc:2272] T 429fe651e8bc487eb6f07e38a7c3cb41 P ddf11fc190dd4b898773379c6b129d90 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.503937   431 tablet_replica.cc:333] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90: stopping tablet replica
I20260709 13:02:23.504671   431 raft_consensus.cc:2243] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Raft consensus shutting down.
W20260709 13:02:23.504895  2192 consensus_peers.cc:597] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b -> Peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Couldn't send request to peer 39a92f5a4352465d8af3af5908fe8642. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:40303: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:23.505539   431 raft_consensus.cc:2272] T 7ba438a35d164c02a9840bbedeac6097 P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:23.505820  2191 consensus_peers.cc:597] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b -> Peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217): Couldn't send request to peer ddf11fc190dd4b898773379c6b129d90. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:23.508328   431 tablet_replica.cc:333] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90: stopping tablet replica
I20260709 13:02:23.509181   431 raft_consensus.cc:2243] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:02:23.510406   431 raft_consensus.cc:2272] T 9b906ca026f44e76913719f278eed7d3 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.513574   431 tablet_replica.cc:333] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90: stopping tablet replica
I20260709 13:02:23.514312   431 raft_consensus.cc:2243] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.515077   431 raft_consensus.cc:2272] T 8e096d30f7404398b10b9cd77da3c04c P ddf11fc190dd4b898773379c6b129d90 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.517608   431 tablet_replica.cc:333] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90: stopping tablet replica
I20260709 13:02:23.518316   431 raft_consensus.cc:2243] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.518951   431 raft_consensus.cc:2272] T 8a1804adcd3844f5837dfc27d40e4cdf P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.521809   431 tablet_replica.cc:333] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90: stopping tablet replica
W20260709 13:02:23.522274  2191 consensus_peers.cc:597] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b -> Peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217): Couldn't send request to peer ddf11fc190dd4b898773379c6b129d90. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:23.522642   431 raft_consensus.cc:2243] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.523762   431 raft_consensus.cc:2272] T 3406989a2b754fe7804c691a11bba6d0 P ddf11fc190dd4b898773379c6b129d90 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:23.525516  2192 consensus_peers.cc:597] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b -> Peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Couldn't send request to peer 39a92f5a4352465d8af3af5908fe8642. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:40303: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:23.526510   431 tablet_replica.cc:333] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90: stopping tablet replica
I20260709 13:02:23.527281   431 raft_consensus.cc:2243] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:02:23.528554   431 raft_consensus.cc:2272] T 7b4d826f7c344b45b7de4b9f69ea958b P ddf11fc190dd4b898773379c6b129d90 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.531126   431 tablet_replica.cc:333] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90: stopping tablet replica
I20260709 13:02:23.531791   431 raft_consensus.cc:2243] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:02:23.532892   431 raft_consensus.cc:2272] T 9b7b5b00d91c4b488d16174662489496 P ddf11fc190dd4b898773379c6b129d90 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.535624   431 tablet_replica.cc:333] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90: stopping tablet replica
I20260709 13:02:23.536484   431 raft_consensus.cc:2243] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.537174   431 raft_consensus.cc:2272] T fbb85f388454464192e052f706a78e65 P ddf11fc190dd4b898773379c6b129d90 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.539896   431 tablet_replica.cc:333] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90: stopping tablet replica
I20260709 13:02:23.540550   431 raft_consensus.cc:2243] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.541515   431 raft_consensus.cc:2272] T 64842f503da44f59896ed29b9edd3b29 P ddf11fc190dd4b898773379c6b129d90 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.544031   431 tablet_replica.cc:333] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90: stopping tablet replica
I20260709 13:02:23.544652   431 raft_consensus.cc:2243] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:02:23.545810   431 raft_consensus.cc:2272] T bb48619ad4f74c71a726835ef5a8b4c2 P ddf11fc190dd4b898773379c6b129d90 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.548699   431 tablet_replica.cc:333] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90: stopping tablet replica
I20260709 13:02:23.549340   431 raft_consensus.cc:2243] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Raft consensus shutting down.
W20260709 13:02:23.549904  2190 consensus_peers.cc:597] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:02:23.550050   431 raft_consensus.cc:2272] T 112134ca2a6243c98c85c27d41496747 P ddf11fc190dd4b898773379c6b129d90 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:23.558568  2190 consensus_peers.cc:597] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:02:23.573629  2191 consensus_peers.cc:597] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b -> Peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217): Couldn't send request to peer ddf11fc190dd4b898773379c6b129d90. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:23.600000  2190 consensus_peers.cc:597] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:02:23.654241  2190 consensus_peers.cc:597] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:02:23.677657  2191 consensus_peers.cc:597] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b -> Peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217): Couldn't send request to peer ddf11fc190dd4b898773379c6b129d90. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:23.680594  2192 consensus_peers.cc:597] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b -> Peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Couldn't send request to peer 39a92f5a4352465d8af3af5908fe8642. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:40303: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:23.681802  2191 consensus_peers.cc:597] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b -> Peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217): Couldn't send request to peer ddf11fc190dd4b898773379c6b129d90. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:23.682437  2191 consensus_peers.cc:597] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b -> Peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217): Couldn't send request to peer ddf11fc190dd4b898773379c6b129d90. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:23.684161  1414 catalog_manager.cc:4755] TS e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 9a873ede2f0f418cbcab98586dba9b1e: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111)
W20260709 13:02:23.719610  2191 consensus_peers.cc:597] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b -> Peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217): Couldn't send request to peer ddf11fc190dd4b898773379c6b129d90. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:44217: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:23.739967  2192 consensus_peers.cc:597] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b -> Peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Couldn't send request to peer 39a92f5a4352465d8af3af5908fe8642. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:40303: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:23.754709  2191 consensus_peers.cc:597] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b -> Peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217): Couldn't send request to peer ddf11fc190dd4b898773379c6b129d90. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:44217: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:23.782706  2190 consensus_peers.cc:597] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:02:23.788640  2192 consensus_peers.cc:597] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b -> Peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Couldn't send request to peer 39a92f5a4352465d8af3af5908fe8642. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:40303: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:23.789446  2191 consensus_peers.cc:597] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b -> Peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217): Couldn't send request to peer ddf11fc190dd4b898773379c6b129d90. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:44217: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:23.919241  8968 raft_consensus.cc:493] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:02:23.919836  8968 raft_consensus.cc:515] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:23.923071  8968 leader_election.cc:290] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
W20260709 13:02:23.931623  2190 leader_election.cc:336] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111)
W20260709 13:02:23.936800  2192 leader_election.cc:336] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Network error: Client connection negotiation failed: client connection to 127.0.107.194:40303: connect: Connection refused (error 111)
I20260709 13:02:23.937261  2192 leader_election.cc:304] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:02:23.937999  8968 raft_consensus.cc:2749] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:02:23.941953  8968 raft_consensus.cc:493] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:02:23.942555  8968 raft_consensus.cc:515] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:23.944721  8968 leader_election.cc:290] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
W20260709 13:02:23.949863  2190 leader_election.cc:336] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111)
W20260709 13:02:24.023186  2192 leader_election.cc:336] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Network error: Client connection negotiation failed: client connection to 127.0.107.194:40303: connect: Connection refused (error 111)
I20260709 13:02:24.023685  2192 leader_election.cc:304] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:02:24.026885  8968 raft_consensus.cc:2749] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:02:24.123704  2190 consensus_peers.cc:597] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:02:24.173950  2192 consensus_peers.cc:597] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b -> Peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Couldn't send request to peer 39a92f5a4352465d8af3af5908fe8642. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:40303: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:24.175341  2190 consensus_peers.cc:597] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:02:24.268466  8968 raft_consensus.cc:493] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:02:24.269119  8968 raft_consensus.cc:515] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:24.271468  8968 leader_election.cc:290] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
W20260709 13:02:24.275648  2192 consensus_peers.cc:597] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b -> Peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Couldn't send request to peer 39a92f5a4352465d8af3af5908fe8642. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:40303: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:24.281013  2190 leader_election.cc:336] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111)
W20260709 13:02:24.284971  2192 leader_election.cc:336] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Network error: Client connection negotiation failed: client connection to 127.0.107.194:40303: connect: Connection refused (error 111)
I20260709 13:02:24.285405  2192 leader_election.cc:304] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:02:24.286580  8968 raft_consensus.cc:2749] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:24.334993  8968 raft_consensus.cc:493] T d53340cc35954204b06e3743bec8adbf P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:02:24.335587  8968 raft_consensus.cc:515] T d53340cc35954204b06e3743bec8adbf P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:24.338148  8968 leader_election.cc:290] T d53340cc35954204b06e3743bec8adbf P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
W20260709 13:02:24.354007  2190 leader_election.cc:336] T d53340cc35954204b06e3743bec8adbf P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111)
I20260709 13:02:24.357909  8968 raft_consensus.cc:493] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:02:24.358515  8968 raft_consensus.cc:515] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:02:24.366896  2192 leader_election.cc:336] T d53340cc35954204b06e3743bec8adbf P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Network error: Client connection negotiation failed: client connection to 127.0.107.194:40303: connect: Connection refused (error 111)
I20260709 13:02:24.367455  2192 leader_election.cc:304] T d53340cc35954204b06e3743bec8adbf P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:02:24.368696  8968 leader_election.cc:290] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303)
I20260709 13:02:24.376169  8954 raft_consensus.cc:2749] T d53340cc35954204b06e3743bec8adbf P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:02:24.378767  2190 leader_election.cc:336] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111)
W20260709 13:02:24.390525  2192 leader_election.cc:336] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Network error: Client connection negotiation failed: client connection to 127.0.107.194:40303: connect: Connection refused (error 111)
I20260709 13:02:24.391040  2192 leader_election.cc:304] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:02:24.391809  8968 raft_consensus.cc:2749] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:02:24.467571  8968 raft_consensus.cc:493] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:02:24.468168  8968 raft_consensus.cc:515] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:24.470299  8968 leader_election.cc:290] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:02:24.471897  8968 raft_consensus.cc:493] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:02:24.472401  8968 raft_consensus.cc:515] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
W20260709 13:02:24.487432  2191 leader_election.cc:336] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217): Network error: Client connection negotiation failed: client connection to 127.0.107.195:44217: connect: Connection refused (error 111)
W20260709 13:02:24.487994  2191 leader_election.cc:336] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217): Network error: Client connection negotiation failed: client connection to 127.0.107.195:44217: connect: Connection refused (error 111)
I20260709 13:02:24.489570  8954 raft_consensus.cc:493] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:02:24.490062  8954 raft_consensus.cc:515] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:24.492218  8954 leader_election.cc:290] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:02:24.498350  2190 leader_election.cc:336] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111)
I20260709 13:02:24.507526  8968 leader_election.cc:290] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:02:24.513196  2191 leader_election.cc:336] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217): Network error: Client connection negotiation failed: client connection to 127.0.107.195:44217: connect: Connection refused (error 111)
I20260709 13:02:24.513728  2191 leader_election.cc:304] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:02:24.514583  8968 raft_consensus.cc:2749] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:02:24.525576  2190 consensus_peers.cc:597] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:02:24.526391  2192 leader_election.cc:336] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Network error: Client connection negotiation failed: client connection to 127.0.107.194:40303: connect: Connection refused (error 111)
I20260709 13:02:24.526914  2192 leader_election.cc:304] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:02:24.527633  8968 raft_consensus.cc:2749] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:02:24.527799  2192 leader_election.cc:336] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Network error: Client connection negotiation failed: client connection to 127.0.107.194:40303: connect: Connection refused (error 111)
I20260709 13:02:24.528299  2192 leader_election.cc:304] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:02:24.529027  8968 raft_consensus.cc:2749] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:24.536304  8968 raft_consensus.cc:493] T 8ea5da45c6d2479383e6af85e0a394b5 P b96ce9cc496c49d7818fa983a17b062b [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:02:24.536947  8968 raft_consensus.cc:515] T 8ea5da45c6d2479383e6af85e0a394b5 P b96ce9cc496c49d7818fa983a17b062b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:24.545657  8968 leader_election.cc:290] T 8ea5da45c6d2479383e6af85e0a394b5 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:02:24.556576  2191 leader_election.cc:336] T 8ea5da45c6d2479383e6af85e0a394b5 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217): Network error: Client connection negotiation failed: client connection to 127.0.107.195:44217: connect: Connection refused (error 111)
W20260709 13:02:24.557353  2190 leader_election.cc:336] T 8ea5da45c6d2479383e6af85e0a394b5 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111)
I20260709 13:02:24.557775  2190 leader_election.cc:304] T 8ea5da45c6d2479383e6af85e0a394b5 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:02:24.559279  8968 raft_consensus.cc:2749] T 8ea5da45c6d2479383e6af85e0a394b5 P b96ce9cc496c49d7818fa983a17b062b [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:02:24.576177  2190 consensus_peers.cc:597] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:02:24.587299  8968 raft_consensus.cc:493] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:02:24.587895  8954 raft_consensus.cc:493] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:02:24.587816  8968 raft_consensus.cc:515] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:24.588617  8954 raft_consensus.cc:515] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:24.589972  8968 leader_election.cc:290] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
I20260709 13:02:24.590878  8954 leader_election.cc:290] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:02:24.596256  2192 leader_election.cc:336] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Network error: Client connection negotiation failed: client connection to 127.0.107.194:40303: connect: Connection refused (error 111)
W20260709 13:02:24.596763  2192 leader_election.cc:336] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Network error: Client connection negotiation failed: client connection to 127.0.107.194:40303: connect: Connection refused (error 111)
W20260709 13:02:24.600160  2191 leader_election.cc:336] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217): Network error: Client connection negotiation failed: client connection to 127.0.107.195:44217: connect: Connection refused (error 111)
I20260709 13:02:24.600584  2191 leader_election.cc:304] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:02:24.601269  8954 raft_consensus.cc:2749] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:02:24.603071  2191 leader_election.cc:336] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217): Network error: Client connection negotiation failed: client connection to 127.0.107.195:44217: connect: Connection refused (error 111)
I20260709 13:02:24.603509  2191 leader_election.cc:304] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:02:24.604171  8954 raft_consensus.cc:2749] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:02:24.640815  8968 raft_consensus.cc:493] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:02:24.641369  8968 raft_consensus.cc:515] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:24.643409  8968 leader_election.cc:290] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:02:24.649611  2190 leader_election.cc:336] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111)
W20260709 13:02:24.658792  2191 leader_election.cc:336] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217): Network error: Client connection negotiation failed: client connection to 127.0.107.195:44217: connect: Connection refused (error 111)
I20260709 13:02:24.659262  2191 leader_election.cc:304] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:02:24.659958  8968 raft_consensus.cc:2749] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:24.682452  8968 raft_consensus.cc:493] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:02:24.683008  8968 raft_consensus.cc:515] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:24.685009  8968 leader_election.cc:290] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:02:24.688673  2192 leader_election.cc:336] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Network error: Client connection negotiation failed: client connection to 127.0.107.194:40303: connect: Connection refused (error 111)
W20260709 13:02:24.690436  2191 leader_election.cc:336] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217): Network error: Client connection negotiation failed: client connection to 127.0.107.195:44217: connect: Connection refused (error 111)
I20260709 13:02:24.690876  2191 leader_election.cc:304] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:02:24.691756  8968 raft_consensus.cc:2749] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:24.700492  8968 raft_consensus.cc:493] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:02:24.701030  8968 raft_consensus.cc:515] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:24.703274  8968 leader_election.cc:290] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:02:24.708751  2190 leader_election.cc:336] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111)
W20260709 13:02:24.712095  2191 leader_election.cc:336] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217): Network error: Client connection negotiation failed: client connection to 127.0.107.195:44217: connect: Connection refused (error 111)
I20260709 13:02:24.712587  2191 leader_election.cc:304] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:02:24.713371  8954 raft_consensus.cc:2749] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:24.709785  8968 raft_consensus.cc:493] T 7d60bdd9b7f543e180698438c413d061 P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:02:24.713977  8968 raft_consensus.cc:515] T 7d60bdd9b7f543e180698438c413d061 P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } attrs { replace: true } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:24.717351  8968 leader_election.cc:290] T 7d60bdd9b7f543e180698438c413d061 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:02:24.723068  2191 leader_election.cc:336] T 7d60bdd9b7f543e180698438c413d061 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217): Network error: Client connection negotiation failed: client connection to 127.0.107.195:44217: connect: Connection refused (error 111)
W20260709 13:02:24.724802  2190 leader_election.cc:336] T 7d60bdd9b7f543e180698438c413d061 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111)
I20260709 13:02:24.725325  2190 leader_election.cc:304] T 7d60bdd9b7f543e180698438c413d061 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
W20260709 13:02:24.726275  2192 leader_election.cc:336] T 7d60bdd9b7f543e180698438c413d061 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Network error: Client connection negotiation failed: client connection to 127.0.107.194:40303: connect: Connection refused (error 111)
I20260709 13:02:24.726356  8968 raft_consensus.cc:2749] T 7d60bdd9b7f543e180698438c413d061 P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:02:24.745890  2192 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.194:40303: connect: Connection refused (error 111) [suppressed 571 similar messages]
I20260709 13:02:24.788933  8968 raft_consensus.cc:493] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:02:24.789510  8968 raft_consensus.cc:515] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:24.791643  8968 leader_election.cc:290] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:02:24.801877  2192 leader_election.cc:336] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Network error: Client connection negotiation failed: client connection to 127.0.107.194:40303: connect: Connection refused (error 111)
W20260709 13:02:24.802414  2191 leader_election.cc:336] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217): Network error: Client connection negotiation failed: client connection to 127.0.107.195:44217: connect: Connection refused (error 111)
I20260709 13:02:24.802918  2191 leader_election.cc:304] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:02:24.805105  8968 raft_consensus.cc:2749] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:24.853487  8954 raft_consensus.cc:493] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:02:24.854111  8954 raft_consensus.cc:515] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:24.856418  8954 leader_election.cc:290] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:02:24.861304  2190 leader_election.cc:336] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111)
W20260709 13:02:24.863445  2191 leader_election.cc:336] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217): Network error: Client connection negotiation failed: client connection to 127.0.107.195:44217: connect: Connection refused (error 111)
I20260709 13:02:24.863930  2191 leader_election.cc:304] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:02:24.864645  8954 raft_consensus.cc:2749] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:24.888693  8954 raft_consensus.cc:493] T 7b4d826f7c344b45b7de4b9f69ea958b P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:02:24.889250  8954 raft_consensus.cc:515] T 7b4d826f7c344b45b7de4b9f69ea958b P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:24.891505  8954 leader_election.cc:290] T 7b4d826f7c344b45b7de4b9f69ea958b P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:02:24.895490  2190 leader_election.cc:336] T 7b4d826f7c344b45b7de4b9f69ea958b P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111)
W20260709 13:02:24.897356  2191 leader_election.cc:336] T 7b4d826f7c344b45b7de4b9f69ea958b P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217): Network error: Client connection negotiation failed: client connection to 127.0.107.195:44217: connect: Connection refused (error 111)
I20260709 13:02:24.897850  2191 leader_election.cc:304] T 7b4d826f7c344b45b7de4b9f69ea958b P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:02:24.898595  8954 raft_consensus.cc:2749] T 7b4d826f7c344b45b7de4b9f69ea958b P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:24.946897  8954 raft_consensus.cc:493] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.947459  8954 raft_consensus.cc:515] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:24.949625  8954 leader_election.cc:290] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:02:24.953884  2192 leader_election.cc:336] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Network error: Client connection negotiation failed: client connection to 127.0.107.194:40303: connect: Connection refused (error 111)
W20260709 13:02:24.954653  2191 leader_election.cc:336] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217): Network error: Client connection negotiation failed: client connection to 127.0.107.195:44217: connect: Connection refused (error 111)
I20260709 13:02:24.955152  2191 leader_election.cc:304] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:02:24.955842  8954 raft_consensus.cc:2749] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:25.002024   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 13:02:25.002951  8968 raft_consensus.cc:493] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ddf11fc190dd4b898773379c6b129d90)
I20260709 13:02:25.003531  8968 raft_consensus.cc:515] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:25.005638  8968 leader_election.cc:290] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:02:25.010280  2190 leader_election.cc:336] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111)
W20260709 13:02:25.010803  2191 leader_election.cc:336] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217): Network error: Client connection negotiation failed: client connection to 127.0.107.195:44217: connect: Connection refused (error 111)
I20260709 13:02:25.011217  2191 leader_election.cc:304] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: ddf11fc190dd4b898773379c6b129d90, e46412b3b0b44f01ad5c33d4cfe3d6b1
I20260709 13:02:25.011802  8968 raft_consensus.cc:2749] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:02:25.099277  8968 raft_consensus.cc:493] T 3406989a2b754fe7804c691a11bba6d0 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 39a92f5a4352465d8af3af5908fe8642)
I20260709 13:02:25.100608  8968 raft_consensus.cc:515] T 3406989a2b754fe7804c691a11bba6d0 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e46412b3b0b44f01ad5c33d4cfe3d6b1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43931 } } peers { permanent_uuid: "39a92f5a4352465d8af3af5908fe8642" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 40303 } } peers { permanent_uuid: "ddf11fc190dd4b898773379c6b129d90" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44217 } attrs { replace: true } } peers { permanent_uuid: "b96ce9cc496c49d7818fa983a17b062b" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 37373 } attrs { promote: false } }
I20260709 13:02:25.104014  8968 leader_election.cc:290] T 3406989a2b754fe7804c691a11bba6d0 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931), 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303), ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217)
W20260709 13:02:25.111975  2192 leader_election.cc:336] T 3406989a2b754fe7804c691a11bba6d0 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 39a92f5a4352465d8af3af5908fe8642 (127.0.107.194:40303): Network error: Client connection negotiation failed: client connection to 127.0.107.194:40303: connect: Connection refused (error 111)
W20260709 13:02:25.112689  2191 leader_election.cc:336] T 3406989a2b754fe7804c691a11bba6d0 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer ddf11fc190dd4b898773379c6b129d90 (127.0.107.195:44217): Network error: Client connection negotiation failed: client connection to 127.0.107.195:44217: connect: Connection refused (error 111)
I20260709 13:02:25.113090  2191 leader_election.cc:304] T 3406989a2b754fe7804c691a11bba6d0 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b96ce9cc496c49d7818fa983a17b062b; no voters: 39a92f5a4352465d8af3af5908fe8642, ddf11fc190dd4b898773379c6b129d90
I20260709 13:02:25.113934  8968 raft_consensus.cc:2749] T 3406989a2b754fe7804c691a11bba6d0 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:02:25.113926  2190 leader_election.cc:336] T 3406989a2b754fe7804c691a11bba6d0 P b96ce9cc496c49d7818fa983a17b062b [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111)
W20260709 13:02:25.117034  2190 consensus_peers.cc:597] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b -> Peer e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): Couldn't send request to peer e46412b3b0b44f01ad5c33d4cfe3d6b1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:02:25.136790   431 tablet_server.cc:179] TabletServer@127.0.107.196:0 shutting down...
I20260709 13:02:25.178200   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:02:25.180490   431 tablet_replica.cc:333] T 3406989a2b754fe7804c691a11bba6d0 P b96ce9cc496c49d7818fa983a17b062b: stopping tablet replica
I20260709 13:02:25.181448   431 raft_consensus.cc:2243] T 3406989a2b754fe7804c691a11bba6d0 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:25.182158   431 raft_consensus.cc:2272] T 3406989a2b754fe7804c691a11bba6d0 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:25.185148   431 tablet_replica.cc:333] T d53340cc35954204b06e3743bec8adbf P b96ce9cc496c49d7818fa983a17b062b: stopping tablet replica
I20260709 13:02:25.185773   431 raft_consensus.cc:2243] T d53340cc35954204b06e3743bec8adbf P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:25.186334   431 raft_consensus.cc:2272] T d53340cc35954204b06e3743bec8adbf P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:25.188617   431 tablet_replica.cc:333] T 8ea5da45c6d2479383e6af85e0a394b5 P b96ce9cc496c49d7818fa983a17b062b: stopping tablet replica
I20260709 13:02:25.189359   431 raft_consensus.cc:2243] T 8ea5da45c6d2479383e6af85e0a394b5 P b96ce9cc496c49d7818fa983a17b062b [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:25.190026   431 raft_consensus.cc:2272] T 8ea5da45c6d2479383e6af85e0a394b5 P b96ce9cc496c49d7818fa983a17b062b [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:25.192195   431 tablet_replica.cc:333] T 7b4d826f7c344b45b7de4b9f69ea958b P b96ce9cc496c49d7818fa983a17b062b: stopping tablet replica
I20260709 13:02:25.192885   431 raft_consensus.cc:2243] T 7b4d826f7c344b45b7de4b9f69ea958b P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:25.193457   431 raft_consensus.cc:2272] T 7b4d826f7c344b45b7de4b9f69ea958b P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:25.195680   431 tablet_replica.cc:333] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b: stopping tablet replica
I20260709 13:02:25.196226   431 raft_consensus.cc:2243] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:25.196681   431 raft_consensus.cc:2272] T 9b7b5b00d91c4b488d16174662489496 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:25.198881   431 tablet_replica.cc:333] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b: stopping tablet replica
I20260709 13:02:25.199476   431 raft_consensus.cc:2243] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:25.200017   431 raft_consensus.cc:2272] T a7cff69bd4394da195321efd78d5a703 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:25.202718   431 tablet_replica.cc:333] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b: stopping tablet replica
I20260709 13:02:25.203392   431 raft_consensus.cc:2243] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:02:25.204299   431 raft_consensus.cc:2272] T 1359810508724a7a8749ce09a6654a9c P b96ce9cc496c49d7818fa983a17b062b [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:25.206396   431 tablet_replica.cc:333] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b: stopping tablet replica
I20260709 13:02:25.206995   431 raft_consensus.cc:2243] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:02:25.207834   431 raft_consensus.cc:2272] T a5802fa5e328499da4525506ccdf4dc9 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:25.209805   431 tablet_replica.cc:333] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b: stopping tablet replica
I20260709 13:02:25.210338   431 raft_consensus.cc:2243] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:02:25.211202   431 raft_consensus.cc:2272] T 94d0d4cbe71742a39337e80ad5770e28 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:25.213361   431 tablet_replica.cc:333] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b: stopping tablet replica
I20260709 13:02:25.213940   431 raft_consensus.cc:2243] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:25.214816   431 raft_consensus.cc:2272] T e4b8c02fb560459fbbb59424361a5457 P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:25.217207   431 tablet_replica.cc:333] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b: stopping tablet replica
I20260709 13:02:25.217866   431 raft_consensus.cc:2243] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:25.218379   431 raft_consensus.cc:2272] T 819fbeffe41b4610a05fcaac38e161b6 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:25.220840   431 tablet_replica.cc:333] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b: stopping tablet replica
I20260709 13:02:25.221583   431 raft_consensus.cc:2243] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:02:25.222438   431 raft_consensus.cc:2272] T 7352869c54614c80af4953b2ce90cace P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:25.224556   431 tablet_replica.cc:333] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b: stopping tablet replica
I20260709 13:02:25.225087   431 raft_consensus.cc:2243] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:25.225833   431 raft_consensus.cc:2272] T 4549f0dba6504cfda954259e71ec4c91 P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:25.228255   431 tablet_replica.cc:333] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b: stopping tablet replica
I20260709 13:02:25.228977   431 raft_consensus.cc:2243] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:25.229620   431 raft_consensus.cc:2272] T 822e65124bb44159b257fd219d28d93c P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:25.231598   431 tablet_replica.cc:333] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b: stopping tablet replica
I20260709 13:02:25.232174   431 raft_consensus.cc:2243] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:02:25.232903   431 pending_rounds.cc:70] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b: Trying to abort 1 pending ops.
I20260709 13:02:25.233072   431 pending_rounds.cc:77] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b: Aborting op as it isn't in flight: id { term: 16 index: 15 } timestamp: 7305634376955371520 op_type: NO_OP noop_request { }
I20260709 13:02:25.233325   431 raft_consensus.cc:2889] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 16 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:02:25.233575   431 raft_consensus.cc:2272] T 073cc710cf6642bb940606f8df5c2331 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:25.235558   431 tablet_replica.cc:333] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b: stopping tablet replica
I20260709 13:02:25.236097   431 raft_consensus.cc:2243] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:25.236637   431 raft_consensus.cc:2272] T 04fed4c219e14efb9f9a8eb0d336ceac P b96ce9cc496c49d7818fa983a17b062b [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:25.238845   431 tablet_replica.cc:333] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b: stopping tablet replica
I20260709 13:02:25.239425   431 raft_consensus.cc:2243] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:02:25.240456   431 raft_consensus.cc:2272] T e78618eba8b74effa4a90f2c8e34cc02 P b96ce9cc496c49d7818fa983a17b062b [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:25.242916   431 tablet_replica.cc:333] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b: stopping tablet replica
I20260709 13:02:25.243570   431 raft_consensus.cc:2243] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:02:25.244338   431 raft_consensus.cc:2272] T a031a0ef86384487bd1f89ead66f851b P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:25.246328   431 tablet_replica.cc:333] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b: stopping tablet replica
I20260709 13:02:25.246910   431 raft_consensus.cc:2243] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:25.247372   431 raft_consensus.cc:2272] T 83ed1c1e27234d98ba5eeb14457a4ee2 P b96ce9cc496c49d7818fa983a17b062b [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:25.249307   431 tablet_replica.cc:333] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b: stopping tablet replica
I20260709 13:02:25.249846   431 raft_consensus.cc:2243] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:02:25.250586   431 pending_rounds.cc:70] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b: Trying to abort 1 pending ops.
I20260709 13:02:25.250818   431 pending_rounds.cc:77] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b: Aborting op as it isn't in flight: id { term: 19 index: 16 } timestamp: 7305634377030172672 op_type: NO_OP noop_request { }
I20260709 13:02:25.251062   431 raft_consensus.cc:2889] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 19 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:02:25.251307   431 raft_consensus.cc:2272] T fb3a9a4620ef4fcd86eb78530746a583 P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:25.253196   431 tablet_replica.cc:333] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b: stopping tablet replica
I20260709 13:02:25.253682   431 raft_consensus.cc:2243] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:25.254181   431 raft_consensus.cc:2272] T 4ea41c88222b469fb11229faef735050 P b96ce9cc496c49d7818fa983a17b062b [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:25.256101   431 tablet_replica.cc:333] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b: stopping tablet replica
I20260709 13:02:25.256603   431 raft_consensus.cc:2243] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:25.257035   431 raft_consensus.cc:2272] T 4190d217954f4f798b3a610501115290 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:25.258987   431 tablet_replica.cc:333] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b: stopping tablet replica
I20260709 13:02:25.259522   431 raft_consensus.cc:2243] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:25.260036   431 raft_consensus.cc:2272] T d0b325904f4646bca264eeeea15dfeb0 P b96ce9cc496c49d7818fa983a17b062b [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:25.262005   431 tablet_replica.cc:333] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b: stopping tablet replica
I20260709 13:02:25.262526   431 raft_consensus.cc:2243] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:25.263103   431 raft_consensus.cc:2272] T cbe75e7a89594d3f81b1b8935b43b2ed P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:25.265100   431 tablet_replica.cc:333] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b: stopping tablet replica
I20260709 13:02:25.265599   431 raft_consensus.cc:2243] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:02:25.266459   431 raft_consensus.cc:2272] T 770925e70faa4a16a275abd5282f5284 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:25.268831   431 tablet_replica.cc:333] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b: stopping tablet replica
I20260709 13:02:25.269388   431 raft_consensus.cc:2243] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:02:25.270418   431 raft_consensus.cc:2272] T dcad30336a5440bca17cda2724035211 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:25.272821   431 tablet_replica.cc:333] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b: stopping tablet replica
I20260709 13:02:25.273329   431 raft_consensus.cc:2243] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:02:25.274116   431 raft_consensus.cc:2272] T 8a1804adcd3844f5837dfc27d40e4cdf P b96ce9cc496c49d7818fa983a17b062b [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:25.276386   431 tablet_replica.cc:333] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b: stopping tablet replica
I20260709 13:02:25.277199   431 raft_consensus.cc:2243] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:02:25.278025   431 raft_consensus.cc:2272] T 64842f503da44f59896ed29b9edd3b29 P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:25.280722   431 tablet_replica.cc:333] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b: stopping tablet replica
I20260709 13:02:25.281268   431 raft_consensus.cc:2243] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:25.281733   431 raft_consensus.cc:2272] T bb48619ad4f74c71a726835ef5a8b4c2 P b96ce9cc496c49d7818fa983a17b062b [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:25.283803   431 tablet_replica.cc:333] T 9a873ede2f0f418cbcab98586dba9b1e P b96ce9cc496c49d7818fa983a17b062b: stopping tablet replica
I20260709 13:02:25.284319   431 raft_consensus.cc:2243] T 9a873ede2f0f418cbcab98586dba9b1e P b96ce9cc496c49d7818fa983a17b062b [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:02:25.285193   431 pending_rounds.cc:70] T 9a873ede2f0f418cbcab98586dba9b1e P b96ce9cc496c49d7818fa983a17b062b: Trying to abort 1 pending ops.
I20260709 13:02:25.285382   431 pending_rounds.cc:77] T 9a873ede2f0f418cbcab98586dba9b1e P b96ce9cc496c49d7818fa983a17b062b: Aborting op as it isn't in flight: id { term: 22 index: 16 } timestamp: 7305634376974786560 op_type: NO_OP noop_request { }
I20260709 13:02:25.285621   431 raft_consensus.cc:2889] T 9a873ede2f0f418cbcab98586dba9b1e P b96ce9cc496c49d7818fa983a17b062b [term 22 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:02:25.285872   431 raft_consensus.cc:2272] T 9a873ede2f0f418cbcab98586dba9b1e P b96ce9cc496c49d7818fa983a17b062b [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:25.288015   431 tablet_replica.cc:333] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b: stopping tablet replica
I20260709 13:02:25.288555   431 raft_consensus.cc:2243] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:02:25.289319   431 raft_consensus.cc:2272] T 0b050d298db6466f856d263a342e3c51 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:25.291366   431 tablet_replica.cc:333] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b: stopping tablet replica
I20260709 13:02:25.291934   431 raft_consensus.cc:2243] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:02:25.292677   431 raft_consensus.cc:2272] T 2228d923442c4e439f7f227db910dad8 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:25.294766   431 tablet_replica.cc:333] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b: stopping tablet replica
I20260709 13:02:25.295267   431 raft_consensus.cc:2243] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:02:25.296166   431 raft_consensus.cc:2272] T 2abb9a42c35f4b6386342bccdff6fbf0 P b96ce9cc496c49d7818fa983a17b062b [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:25.298203   431 tablet_replica.cc:333] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b: stopping tablet replica
I20260709 13:02:25.298751   431 raft_consensus.cc:2243] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:02:25.299535   431 raft_consensus.cc:2272] T 72071486140c4d6c919b25e882a8f5e5 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:25.302320   431 tablet_replica.cc:333] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b: stopping tablet replica
I20260709 13:02:25.302889   431 raft_consensus.cc:2243] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:02:25.303668   431 raft_consensus.cc:2272] T 1e4adfe2190c4487ab72be02d6cfa923 P b96ce9cc496c49d7818fa983a17b062b [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:25.305600   431 tablet_replica.cc:333] T 7d60bdd9b7f543e180698438c413d061 P b96ce9cc496c49d7818fa983a17b062b: stopping tablet replica
I20260709 13:02:25.306188   431 raft_consensus.cc:2243] T 7d60bdd9b7f543e180698438c413d061 P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:25.306736   431 raft_consensus.cc:2272] T 7d60bdd9b7f543e180698438c413d061 P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:25.308856   431 tablet_replica.cc:333] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b: stopping tablet replica
I20260709 13:02:25.309337   431 raft_consensus.cc:2243] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:02:25.310148   431 raft_consensus.cc:2272] T 317204271cc04f68818b36450c9725b1 P b96ce9cc496c49d7818fa983a17b062b [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:25.312273   431 tablet_replica.cc:333] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b: stopping tablet replica
I20260709 13:02:25.312747   431 raft_consensus.cc:2243] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:02:25.313510   431 raft_consensus.cc:2272] T 429fe651e8bc487eb6f07e38a7c3cb41 P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:25.315428   431 tablet_replica.cc:333] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b: stopping tablet replica
I20260709 13:02:25.315912   431 raft_consensus.cc:2243] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:25.316404   431 raft_consensus.cc:2272] T 53176f970a394c5cb2c76bd88f09c751 P b96ce9cc496c49d7818fa983a17b062b [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:25.318437   431 tablet_replica.cc:333] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b: stopping tablet replica
I20260709 13:02:25.318982   431 raft_consensus.cc:2243] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:02:25.319918   431 raft_consensus.cc:2272] T c1d40b53631d4998a9a462e3c91a3004 P b96ce9cc496c49d7818fa983a17b062b [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:25.321964   431 tablet_replica.cc:333] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b: stopping tablet replica
I20260709 13:02:25.322459   431 raft_consensus.cc:2243] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:02:25.323290   431 raft_consensus.cc:2272] T 2eadc97fd6dd494596f9ea9242d9db59 P b96ce9cc496c49d7818fa983a17b062b [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:25.325198   431 tablet_replica.cc:333] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b: stopping tablet replica
I20260709 13:02:25.325677   431 raft_consensus.cc:2243] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:25.326179   431 raft_consensus.cc:2272] T e0590ffd096d4e378ab66c1795ff5cce P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:25.328289   431 tablet_replica.cc:333] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b: stopping tablet replica
I20260709 13:02:25.328734   431 raft_consensus.cc:2243] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:25.329205   431 raft_consensus.cc:2272] T f3dd6988dfbe43e0ac446b79d37d9c24 P b96ce9cc496c49d7818fa983a17b062b [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:25.331099   431 tablet_replica.cc:333] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b: stopping tablet replica
I20260709 13:02:25.331516   431 raft_consensus.cc:2243] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:02:25.332288   431 pending_rounds.cc:70] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b: Trying to abort 1 pending ops.
I20260709 13:02:25.332461   431 pending_rounds.cc:77] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b: Aborting op as it isn't in flight: id { term: 18 index: 14 } timestamp: 7305634376988434432 op_type: NO_OP noop_request { }
I20260709 13:02:25.332716   431 raft_consensus.cc:2889] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 18 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:02:25.332971   431 raft_consensus.cc:2272] T 7ba438a35d164c02a9840bbedeac6097 P b96ce9cc496c49d7818fa983a17b062b [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:25.893163   431 tablet_server.cc:196] TabletServer@127.0.107.196:0 shutdown complete.
I20260709 13:02:25.971266   431 master.cc:562] Master@127.0.107.254:40423 shutting down...
W20260709 13:02:26.001348  1478 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 13:02:26.001605  1478 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:02:26.001804  1478 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:02:40.121533  1414 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111) [suppressed 58 similar messages]
W20260709 13:02:40.125169  1414 catalog_manager.cc:4755] TS e46412b3b0b44f01ad5c33d4cfe3d6b1 (127.0.107.193:43931): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 9a873ede2f0f418cbcab98586dba9b1e: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43931: connect: Connection refused (error 111)
I20260709 13:02:43.011926   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 9f38d0e5c9db43a48554defe1153354e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:43.013089   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 9f38d0e5c9db43a48554defe1153354e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:43.013469   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P 9f38d0e5c9db43a48554defe1153354e: stopping tablet replica
I20260709 13:02:43.144141   431 master.cc:584] Master@127.0.107.254:40423 shutdown complete.
[       OK ] LeaderRebalancerTest.AddTserver (248136 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 13:02:43.251329   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:45205
I20260709 13:02:43.252411   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:43.258131  8975 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:43.258553  8977 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:43.258121  8974 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:43.260710   431 server_base.cc:1061] running on GCE node
I20260709 13:02:43.264084   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:43.264294   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:43.264442   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602163264424 us; error 0 us; skew 500 ppm
I20260709 13:02:43.264940   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:43.267396   431 webserver.cc:533] Webserver started at http://127.0.107.254:37975/ using document root <none> and password file <none>
I20260709 13:02:43.267854   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:43.268020   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:43.268282   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:43.269480   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601891739070-431-0/minicluster-data/master-0-root/instance:
uuid: "c4e14f7d7b4843cd93fd255fcd379522"
format_stamp: "Formatted at 2026-07-09 13:02:43 on dist-test-slave-qzg2"
I20260709 13:02:43.273986   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:02:43.277448  8982 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:43.278159   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:02:43.278432   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601891739070-431-0/minicluster-data/master-0-root
uuid: "c4e14f7d7b4843cd93fd255fcd379522"
format_stamp: "Formatted at 2026-07-09 13:02:43 on dist-test-slave-qzg2"
I20260709 13:02:43.278729   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601891739070-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601891739070-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601891739070-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:43.296545   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:43.297783   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:43.335860   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:45205
I20260709 13:02:43.335968  9033 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:45205 every 8 connection(s)
I20260709 13:02:43.339979  9034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:43.351624  9034 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c4e14f7d7b4843cd93fd255fcd379522: Bootstrap starting.
I20260709 13:02:43.356865  9034 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c4e14f7d7b4843cd93fd255fcd379522: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:43.361109  9034 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c4e14f7d7b4843cd93fd255fcd379522: No bootstrap required, opened a new log
I20260709 13:02:43.363376  9034 raft_consensus.cc:359] T 00000000000000000000000000000000 P c4e14f7d7b4843cd93fd255fcd379522 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c4e14f7d7b4843cd93fd255fcd379522" member_type: VOTER }
I20260709 13:02:43.363883  9034 raft_consensus.cc:385] T 00000000000000000000000000000000 P c4e14f7d7b4843cd93fd255fcd379522 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:43.364073  9034 raft_consensus.cc:740] T 00000000000000000000000000000000 P c4e14f7d7b4843cd93fd255fcd379522 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4e14f7d7b4843cd93fd255fcd379522, State: Initialized, Role: FOLLOWER
I20260709 13:02:43.364595  9034 consensus_queue.cc:260] T 00000000000000000000000000000000 P c4e14f7d7b4843cd93fd255fcd379522 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c4e14f7d7b4843cd93fd255fcd379522" member_type: VOTER }
I20260709 13:02:43.365022  9034 raft_consensus.cc:399] T 00000000000000000000000000000000 P c4e14f7d7b4843cd93fd255fcd379522 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:02:43.365218  9034 raft_consensus.cc:493] T 00000000000000000000000000000000 P c4e14f7d7b4843cd93fd255fcd379522 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:02:43.365442  9034 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c4e14f7d7b4843cd93fd255fcd379522 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:43.369946  9034 raft_consensus.cc:515] T 00000000000000000000000000000000 P c4e14f7d7b4843cd93fd255fcd379522 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c4e14f7d7b4843cd93fd255fcd379522" member_type: VOTER }
I20260709 13:02:43.370471  9034 leader_election.cc:304] T 00000000000000000000000000000000 P c4e14f7d7b4843cd93fd255fcd379522 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c4e14f7d7b4843cd93fd255fcd379522; no voters: 
I20260709 13:02:43.371670  9034 leader_election.cc:290] T 00000000000000000000000000000000 P c4e14f7d7b4843cd93fd255fcd379522 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:02:43.372001  9037 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c4e14f7d7b4843cd93fd255fcd379522 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:43.373384  9037 raft_consensus.cc:697] T 00000000000000000000000000000000 P c4e14f7d7b4843cd93fd255fcd379522 [term 1 LEADER]: Becoming Leader. State: Replica: c4e14f7d7b4843cd93fd255fcd379522, State: Running, Role: LEADER
I20260709 13:02:43.374125  9037 consensus_queue.cc:237] T 00000000000000000000000000000000 P c4e14f7d7b4843cd93fd255fcd379522 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c4e14f7d7b4843cd93fd255fcd379522" member_type: VOTER }
I20260709 13:02:43.374596  9034 sys_catalog.cc:565] T 00000000000000000000000000000000 P c4e14f7d7b4843cd93fd255fcd379522 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:02:43.380362  9039 sys_catalog.cc:455] T 00000000000000000000000000000000 P c4e14f7d7b4843cd93fd255fcd379522 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c4e14f7d7b4843cd93fd255fcd379522. Latest consensus state: current_term: 1 leader_uuid: "c4e14f7d7b4843cd93fd255fcd379522" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c4e14f7d7b4843cd93fd255fcd379522" member_type: VOTER } }
I20260709 13:02:43.381014  9039 sys_catalog.cc:458] T 00000000000000000000000000000000 P c4e14f7d7b4843cd93fd255fcd379522 [sys.catalog]: This master's current role is: LEADER
I20260709 13:02:43.381023  9038 sys_catalog.cc:455] T 00000000000000000000000000000000 P c4e14f7d7b4843cd93fd255fcd379522 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c4e14f7d7b4843cd93fd255fcd379522" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c4e14f7d7b4843cd93fd255fcd379522" member_type: VOTER } }
I20260709 13:02:43.383038  9046 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:02:43.383102  9038 sys_catalog.cc:458] T 00000000000000000000000000000000 P c4e14f7d7b4843cd93fd255fcd379522 [sys.catalog]: This master's current role is: LEADER
I20260709 13:02:43.390522  9046 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:02:43.391602   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:02:43.400292  9046 catalog_manager.cc:1383] Generated new cluster ID: 1b6a3373b2d449bd9b8339013359a915
I20260709 13:02:43.400633  9046 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:02:43.428959  9046 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:02:43.430253  9046 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:02:43.455932  9046 catalog_manager.cc:6070] T 00000000000000000000000000000000 P c4e14f7d7b4843cd93fd255fcd379522: Generated new TSK 0
I20260709 13:02:43.456738  9046 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:02:43.522779   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:43.528963  9055 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:43.530036  9056 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:43.532482   431 server_base.cc:1061] running on GCE node
W20260709 13:02:43.532994  9058 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:43.534900   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:43.535112   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:43.535271   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602163535257 us; error 0 us; skew 500 ppm
I20260709 13:02:43.535840   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:43.538180   431 webserver.cc:533] Webserver started at http://127.0.107.193:46691/ using document root <none> and password file <none>
I20260709 13:02:43.538689   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:43.538883   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:43.539141   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:43.540333   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601891739070-431-0/minicluster-data/ts-0-root/instance:
uuid: "65ed95869fbb4b69b5d6eb99c51adf85"
format_stamp: "Formatted at 2026-07-09 13:02:43 on dist-test-slave-qzg2"
I20260709 13:02:43.545008   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:02:43.548604  9063 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:43.549365   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:02:43.549659   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601891739070-431-0/minicluster-data/ts-0-root
uuid: "65ed95869fbb4b69b5d6eb99c51adf85"
format_stamp: "Formatted at 2026-07-09 13:02:43 on dist-test-slave-qzg2"
I20260709 13:02:43.549935   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601891739070-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601891739070-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601891739070-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:43.570960   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:43.572144   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:43.573684   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:02:43.576129   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:02:43.576357   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:43.576618   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:02:43.576774   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:43.619254   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:33979
I20260709 13:02:43.619382  9125 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:33979 every 8 connection(s)
I20260709 13:02:43.624704   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:43.632010  9130 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:43.633222  9131 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:43.637159  9133 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:43.637643   431 server_base.cc:1061] running on GCE node
I20260709 13:02:43.640139   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:43.640455   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:43.640641   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602163640623 us; error 0 us; skew 500 ppm
I20260709 13:02:43.641367   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:43.641340  9126 heartbeater.cc:344] Connected to a master server at 127.0.107.254:45205
I20260709 13:02:43.641984  9126 heartbeater.cc:461] Registering TS with master...
I20260709 13:02:43.643127  9126 heartbeater.cc:507] Master 127.0.107.254:45205 requested a full tablet report, sending...
I20260709 13:02:43.644714   431 webserver.cc:533] Webserver started at http://127.0.107.194:34535/ using document root <none> and password file <none>
I20260709 13:02:43.645367   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:43.645548   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:43.645833   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:43.645789  8999 ts_manager.cc:194] Registered new tserver with Master: 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979)
I20260709 13:02:43.647385   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601891739070-431-0/minicluster-data/ts-1-root/instance:
uuid: "c694531b0e1d47988b291f1214efc4cb"
format_stamp: "Formatted at 2026-07-09 13:02:43 on dist-test-slave-qzg2"
I20260709 13:02:43.647879  8999 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39566
I20260709 13:02:43.652757   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:02:43.656641  9138 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:43.657507   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:02:43.657845   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601891739070-431-0/minicluster-data/ts-1-root
uuid: "c694531b0e1d47988b291f1214efc4cb"
format_stamp: "Formatted at 2026-07-09 13:02:43 on dist-test-slave-qzg2"
I20260709 13:02:43.658128   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601891739070-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601891739070-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601891739070-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:43.692811   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:43.694067   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:43.695663   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:02:43.698129   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:02:43.698360   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:43.698593   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:02:43.698776   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:02:43.742048   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:33455
I20260709 13:02:43.742157  9200 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:33455 every 8 connection(s)
I20260709 13:02:43.746812   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:43.754848  9204 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:43.754861  9205 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:43.758104  9201 heartbeater.cc:344] Connected to a master server at 127.0.107.254:45205
I20260709 13:02:43.758669  9201 heartbeater.cc:461] Registering TS with master...
W20260709 13:02:43.758826  9207 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:43.758951   431 server_base.cc:1061] running on GCE node
I20260709 13:02:43.759735  9201 heartbeater.cc:507] Master 127.0.107.254:45205 requested a full tablet report, sending...
I20260709 13:02:43.760089   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:43.760387   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:43.760555   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602163760538 us; error 0 us; skew 500 ppm
I20260709 13:02:43.761160   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:43.761768  8999 ts_manager.cc:194] Registered new tserver with Master: c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455)
I20260709 13:02:43.763401  8999 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39568
I20260709 13:02:43.763727   431 webserver.cc:533] Webserver started at http://127.0.107.195:43257/ using document root <none> and password file <none>
I20260709 13:02:43.764245   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:43.764438   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:43.764691   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:43.765870   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601891739070-431-0/minicluster-data/ts-2-root/instance:
uuid: "8846d581359a4b7ea6d4c33424ea825d"
format_stamp: "Formatted at 2026-07-09 13:02:43 on dist-test-slave-qzg2"
I20260709 13:02:43.770350   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:02:43.773823  9212 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:43.774641   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:02:43.774991   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601891739070-431-0/minicluster-data/ts-2-root
uuid: "8846d581359a4b7ea6d4c33424ea825d"
format_stamp: "Formatted at 2026-07-09 13:02:43 on dist-test-slave-qzg2"
I20260709 13:02:43.775275   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601891739070-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601891739070-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601891739070-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:43.790951   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:43.792169   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:43.793690   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:02:43.796032   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:02:43.796241   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:43.796460   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:02:43.796604   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:43.837495   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:45311
I20260709 13:02:43.837632  9274 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:45311 every 8 connection(s)
I20260709 13:02:43.842236   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:43.849490  9278 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:43.851629  9279 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:43.852535  9281 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:43.853492   431 server_base.cc:1061] running on GCE node
I20260709 13:02:43.854522   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:43.854851   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:43.854948  9275 heartbeater.cc:344] Connected to a master server at 127.0.107.254:45205
I20260709 13:02:43.855083   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602163855062 us; error 0 us; skew 500 ppm
I20260709 13:02:43.855499  9275 heartbeater.cc:461] Registering TS with master...
I20260709 13:02:43.855930   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:43.856268  9275 heartbeater.cc:507] Master 127.0.107.254:45205 requested a full tablet report, sending...
I20260709 13:02:43.858819  8999 ts_manager.cc:194] Registered new tserver with Master: 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311)
I20260709 13:02:43.858867   431 webserver.cc:533] Webserver started at http://127.0.107.196:37149/ using document root <none> and password file <none>
I20260709 13:02:43.859596   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:43.859824   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:43.860145   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:43.860452  8999 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39578
I20260709 13:02:43.861328   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601891739070-431-0/minicluster-data/ts-3-root/instance:
uuid: "74ac2cf163ee475e8a280cb3aa738f57"
format_stamp: "Formatted at 2026-07-09 13:02:43 on dist-test-slave-qzg2"
I20260709 13:02:43.866009   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:02:43.869457  9286 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:43.870321   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:02:43.870615   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601891739070-431-0/minicluster-data/ts-3-root
uuid: "74ac2cf163ee475e8a280cb3aa738f57"
format_stamp: "Formatted at 2026-07-09 13:02:43 on dist-test-slave-qzg2"
I20260709 13:02:43.870990   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601891739070-431-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601891739070-431-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601891739070-431-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:43.903824   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:43.905035   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:43.906239   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:02:43.908254   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:02:43.908437   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:43.908676   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:02:43.908816   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:43.949191   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.196:44351
I20260709 13:02:43.949301  9348 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.196:44351 every 8 connection(s)
I20260709 13:02:43.963438  9349 heartbeater.cc:344] Connected to a master server at 127.0.107.254:45205
I20260709 13:02:43.963910  9349 heartbeater.cc:461] Registering TS with master...
I20260709 13:02:43.964668  9349 heartbeater.cc:507] Master 127.0.107.254:45205 requested a full tablet report, sending...
I20260709 13:02:43.966830  8999 ts_manager.cc:194] Registered new tserver with Master: 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351)
I20260709 13:02:43.967828   431 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.015387201s
I20260709 13:02:43.968215  8999 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39582
I20260709 13:02:43.996106  8999 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39598:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 13:02:44.259480  9314 tablet_service.cc:1511] Processing CreateTablet for tablet 6cb786213d5d48779533059bc333ac6f (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:02:44.261013  9314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cb786213d5d48779533059bc333ac6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.262847  9313 tablet_service.cc:1511] Processing CreateTablet for tablet 5cea8a8078e8456186d4d1a184d3f157 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:02:44.264670  9312 tablet_service.cc:1511] Processing CreateTablet for tablet a731a965126b406988eecb7829bc9981 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:02:44.265865  9309 tablet_service.cc:1511] Processing CreateTablet for tablet 5f076a85481e43d7a969bf5d8bb589dd (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:02:44.264643  9307 tablet_service.cc:1511] Processing CreateTablet for tablet b3f19df7d93748a1802678c56b5e2208 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:02:44.264653  9313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cea8a8078e8456186d4d1a184d3f157. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.268447  9310 tablet_service.cc:1511] Processing CreateTablet for tablet 51a2ca964a8f4fb89b26d77b1b334f30 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:02:44.270237  9310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51a2ca964a8f4fb89b26d77b1b334f30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.272743  9307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3f19df7d93748a1802678c56b5e2208. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.273589  9308 tablet_service.cc:1511] Processing CreateTablet for tablet 8bfbc32cc1ba4ecc8fddc7e7f4711778 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:02:44.274876  9311 tablet_service.cc:1511] Processing CreateTablet for tablet eb666e221e5f4e4fbaba194838a28448 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:02:44.275426  9312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a731a965126b406988eecb7829bc9981. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.276408  9311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb666e221e5f4e4fbaba194838a28448. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.279126  9308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bfbc32cc1ba4ecc8fddc7e7f4711778. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.284066  9240 tablet_service.cc:1511] Processing CreateTablet for tablet 6cb786213d5d48779533059bc333ac6f (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:02:44.285666  9240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cb786213d5d48779533059bc333ac6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.285451  9237 tablet_service.cc:1511] Processing CreateTablet for tablet e6ee00de30e149f58789799810d595a4 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:02:44.288022  9231 tablet_service.cc:1511] Processing CreateTablet for tablet e6797c587fdc4754b091a2be102e5927 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:02:44.289263  9235 tablet_service.cc:1511] Processing CreateTablet for tablet 5f076a85481e43d7a969bf5d8bb589dd (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:02:44.289372  9232 tablet_service.cc:1511] Processing CreateTablet for tablet 3ac2da3cd17d470495fd5fbb986e4936 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:02:44.290516  9239 tablet_service.cc:1511] Processing CreateTablet for tablet 6f8b7d72409f45eebf4208f98310f378 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:02:44.291472  9238 tablet_service.cc:1511] Processing CreateTablet for tablet a731a965126b406988eecb7829bc9981 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:02:44.291829  9234 tablet_service.cc:1511] Processing CreateTablet for tablet ea3bb46b177b4bbdaa60f464370aa9a0 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:02:44.288093  9236 tablet_service.cc:1511] Processing CreateTablet for tablet 51a2ca964a8f4fb89b26d77b1b334f30 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:02:44.294184  9233 tablet_service.cc:1511] Processing CreateTablet for tablet b3f19df7d93748a1802678c56b5e2208 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:02:44.296114  9237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6ee00de30e149f58789799810d595a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.297365  9239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f8b7d72409f45eebf4208f98310f378. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.284185  9309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f076a85481e43d7a969bf5d8bb589dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.298053  9236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51a2ca964a8f4fb89b26d77b1b334f30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.302026  9233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3f19df7d93748a1802678c56b5e2208. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.302801  9231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6797c587fdc4754b091a2be102e5927. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.307590  9306 tablet_service.cc:1511] Processing CreateTablet for tablet 3ac2da3cd17d470495fd5fbb986e4936 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:02:44.307902  9305 tablet_service.cc:1511] Processing CreateTablet for tablet dbdc8579cca94ef7ab4babd287837e8c (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:02:44.309109  9238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a731a965126b406988eecb7829bc9981. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.311973  9234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea3bb46b177b4bbdaa60f464370aa9a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.309175  9306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ac2da3cd17d470495fd5fbb986e4936. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.319113  9305 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbdc8579cca94ef7ab4babd287837e8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.323124  9232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ac2da3cd17d470495fd5fbb986e4936. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.338948  9235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f076a85481e43d7a969bf5d8bb589dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.351402  9166 tablet_service.cc:1511] Processing CreateTablet for tablet 6cb786213d5d48779533059bc333ac6f (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:02:44.352982  9166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cb786213d5d48779533059bc333ac6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.359035  9165 tablet_service.cc:1511] Processing CreateTablet for tablet 6f8b7d72409f45eebf4208f98310f378 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:02:44.360795  9165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f8b7d72409f45eebf4208f98310f378. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.369153  9164 tablet_service.cc:1511] Processing CreateTablet for tablet 5cea8a8078e8456186d4d1a184d3f157 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:02:44.369482  9239 tablet_service.cc:1511] Processing CreateTablet for tablet 5ce2a33a3b914f6297946ded34c256bf (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:02:44.370630  9164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cea8a8078e8456186d4d1a184d3f157. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.374445  9163 tablet_service.cc:1511] Processing CreateTablet for tablet e6ee00de30e149f58789799810d595a4 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:02:44.379962  9162 tablet_service.cc:1511] Processing CreateTablet for tablet eb666e221e5f4e4fbaba194838a28448 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:02:44.383837  9159 tablet_service.cc:1511] Processing CreateTablet for tablet 8bfbc32cc1ba4ecc8fddc7e7f4711778 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:02:44.384920  9161 tablet_service.cc:1511] Processing CreateTablet for tablet 5f076a85481e43d7a969bf5d8bb589dd (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
W20260709 13:02:44.385805  9047 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:44.386335  9158 tablet_service.cc:1511] Processing CreateTablet for tablet 3ac2da3cd17d470495fd5fbb986e4936 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:02:44.387322  9160 tablet_service.cc:1511] Processing CreateTablet for tablet ea3bb46b177b4bbdaa60f464370aa9a0 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:02:44.388670  9157 tablet_service.cc:1511] Processing CreateTablet for tablet e6797c587fdc4754b091a2be102e5927 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:02:44.390398  9233 tablet_service.cc:1511] Processing CreateTablet for tablet 69a5fd219b1a4d4c94b346f38909f024 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:02:44.394114  9160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea3bb46b177b4bbdaa60f464370aa9a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.398886  9163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6ee00de30e149f58789799810d595a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.401669  9162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb666e221e5f4e4fbaba194838a28448. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.403002  9157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6797c587fdc4754b091a2be102e5927. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.407119  9158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ac2da3cd17d470495fd5fbb986e4936. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.411149  9159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bfbc32cc1ba4ecc8fddc7e7f4711778. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.419078  9161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f076a85481e43d7a969bf5d8bb589dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.429240  9232 tablet_service.cc:1511] Processing CreateTablet for tablet 0effc3d52a6d43ef8aa59821958f4e52 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:02:44.370630  9239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ce2a33a3b914f6297946ded34c256bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.439337  9233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69a5fd219b1a4d4c94b346f38909f024. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.443073  9232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0effc3d52a6d43ef8aa59821958f4e52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.467331  9240 tablet_service.cc:1511] Processing CreateTablet for tablet eab411e3927a434ab647aa9b31fcf60d (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:02:44.468868  9240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eab411e3927a434ab647aa9b31fcf60d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.472560  9307 tablet_service.cc:1511] Processing CreateTablet for tablet 5ce2a33a3b914f6297946ded34c256bf (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:02:44.473997  9307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ce2a33a3b914f6297946ded34c256bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.476817  9089 tablet_service.cc:1511] Processing CreateTablet for tablet a731a965126b406988eecb7829bc9981 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:02:44.478240  9089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a731a965126b406988eecb7829bc9981. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.479893  9088 tablet_service.cc:1511] Processing CreateTablet for tablet e6ee00de30e149f58789799810d595a4 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:02:44.481395  9088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6ee00de30e149f58789799810d595a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.481564  9314 tablet_service.cc:1511] Processing CreateTablet for tablet d2ef0242573643178d56d10a6c26ae8e (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:02:44.482928  9087 tablet_service.cc:1511] Processing CreateTablet for tablet eb666e221e5f4e4fbaba194838a28448 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:02:44.485153  9157 tablet_service.cc:1511] Processing CreateTablet for tablet dbdc8579cca94ef7ab4babd287837e8c (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:02:44.486581  9085 tablet_service.cc:1511] Processing CreateTablet for tablet ea3bb46b177b4bbdaa60f464370aa9a0 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:02:44.486636  9157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbdc8579cca94ef7ab4babd287837e8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.489533  9090 tablet_service.cc:1511] Processing CreateTablet for tablet 5cea8a8078e8456186d4d1a184d3f157 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:02:44.492075  9084 tablet_service.cc:1511] Processing CreateTablet for tablet 8bfbc32cc1ba4ecc8fddc7e7f4711778 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:02:44.485258  9086 tablet_service.cc:1511] Processing CreateTablet for tablet 51a2ca964a8f4fb89b26d77b1b334f30 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:02:44.475263  9091 tablet_service.cc:1511] Processing CreateTablet for tablet 6f8b7d72409f45eebf4208f98310f378 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:02:44.501320  9090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cea8a8078e8456186d4d1a184d3f157. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.506637  9084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bfbc32cc1ba4ecc8fddc7e7f4711778. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.514570  9085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea3bb46b177b4bbdaa60f464370aa9a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.510370  9083 tablet_service.cc:1511] Processing CreateTablet for tablet b3f19df7d93748a1802678c56b5e2208 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:02:44.515797  9087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb666e221e5f4e4fbaba194838a28448. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.516484  9086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51a2ca964a8f4fb89b26d77b1b334f30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.517818  9083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3f19df7d93748a1802678c56b5e2208. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.519745  9091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f8b7d72409f45eebf4208f98310f378. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.504369  9311 tablet_service.cc:1511] Processing CreateTablet for tablet 69a5fd219b1a4d4c94b346f38909f024 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:02:44.545845  9159 tablet_service.cc:1511] Processing CreateTablet for tablet 69a5fd219b1a4d4c94b346f38909f024 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:02:44.547278  9159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69a5fd219b1a4d4c94b346f38909f024. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.547974  9237 tablet_service.cc:1511] Processing CreateTablet for tablet 53bdda361da242a1b37aa013fad1ee60 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:02:44.549306  9237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53bdda361da242a1b37aa013fad1ee60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.559417  9369 tablet_bootstrap.cc:492] T 6f8b7d72409f45eebf4208f98310f378 P 8846d581359a4b7ea6d4c33424ea825d: Bootstrap starting.
I20260709 13:02:44.561342  9166 tablet_service.cc:1511] Processing CreateTablet for tablet 0effc3d52a6d43ef8aa59821958f4e52 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:02:44.565631  9370 tablet_bootstrap.cc:492] T eb666e221e5f4e4fbaba194838a28448 P 74ac2cf163ee475e8a280cb3aa738f57: Bootstrap starting.
I20260709 13:02:44.482952  9314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2ef0242573643178d56d10a6c26ae8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.569865  9238 tablet_service.cc:1511] Processing CreateTablet for tablet 389a20133d8b4ebfaab346741dff367f (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:02:44.571338  9238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 389a20133d8b4ebfaab346741dff367f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.574239  9308 tablet_service.cc:1511] Processing CreateTablet for tablet eab411e3927a434ab647aa9b31fcf60d (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:02:44.578313  9311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69a5fd219b1a4d4c94b346f38909f024. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.604617  9082 tablet_service.cc:1511] Processing CreateTablet for tablet e6797c587fdc4754b091a2be102e5927 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
W20260709 13:02:44.602825  8984 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.0.107.194:33455, user_credentials={real_user=slave}} blocked reactor thread for 51318.3us
I20260709 13:02:44.605990  9082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6797c587fdc4754b091a2be102e5927. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.604310  9240 tablet_service.cc:1511] Processing CreateTablet for tablet 059a6a9a07d74be4a9f3854317b870ab (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:02:44.605873  9308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eab411e3927a434ab647aa9b31fcf60d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.594234  9310 tablet_service.cc:1511] Processing CreateTablet for tablet 53bdda361da242a1b37aa013fad1ee60 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:02:44.566218  9165 tablet_service.cc:1511] Processing CreateTablet for tablet d2ef0242573643178d56d10a6c26ae8e (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:02:44.625072  9371 tablet_bootstrap.cc:492] T ea3bb46b177b4bbdaa60f464370aa9a0 P c694531b0e1d47988b291f1214efc4cb: Bootstrap starting.
I20260709 13:02:44.627977  9240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 059a6a9a07d74be4a9f3854317b870ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.641075  9372 tablet_bootstrap.cc:492] T 6f8b7d72409f45eebf4208f98310f378 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap starting.
I20260709 13:02:44.590276  9162 tablet_service.cc:1511] Processing CreateTablet for tablet 53bdda361da242a1b37aa013fad1ee60 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:02:44.644057  9231 tablet_service.cc:1511] Processing CreateTablet for tablet 989e9796152e4796a3408e00419403fa (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:02:44.582068  9234 tablet_service.cc:1511] Processing CreateTablet for tablet 0a377c4fc6c04b0aa8f74f64f4f59409 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:02:44.604790  9313 tablet_service.cc:1511] Processing CreateTablet for tablet 3899ef948b2e405baaccb81544b7f58b (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:02:44.645387  9231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 989e9796152e4796a3408e00419403fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.615280  9166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0effc3d52a6d43ef8aa59821958f4e52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.647398  9309 tablet_service.cc:1511] Processing CreateTablet for tablet 0a377c4fc6c04b0aa8f74f64f4f59409 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:02:44.648221  9312 tablet_service.cc:1511] Processing CreateTablet for tablet 989e9796152e4796a3408e00419403fa (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:02:44.648885  9309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a377c4fc6c04b0aa8f74f64f4f59409. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.649555  9312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 989e9796152e4796a3408e00419403fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.651115  9126 heartbeater.cc:499] Master 127.0.107.254:45205 was elected leader, sending a full tablet report...
I20260709 13:02:44.652738  9313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3899ef948b2e405baaccb81544b7f58b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.648015  9162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53bdda361da242a1b37aa013fad1ee60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.655000  9310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53bdda361da242a1b37aa013fad1ee60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.655000  9165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2ef0242573643178d56d10a6c26ae8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.661918  9233 tablet_service.cc:1511] Processing CreateTablet for tablet 48e91509dfc74d53a930cdc636976db6 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:02:44.667414  9091 tablet_service.cc:1511] Processing CreateTablet for tablet dbdc8579cca94ef7ab4babd287837e8c (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:02:44.669016  9091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbdc8579cca94ef7ab4babd287837e8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.687870  9305 tablet_service.cc:1511] Processing CreateTablet for tablet f2229e498f7f472f97c088fddb802939 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:02:44.689265  9370 tablet_bootstrap.cc:654] T eb666e221e5f4e4fbaba194838a28448 P 74ac2cf163ee475e8a280cb3aa738f57: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:44.671797  9164 tablet_service.cc:1511] Processing CreateTablet for tablet 3899ef948b2e405baaccb81544b7f58b (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:02:44.692237  9164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3899ef948b2e405baaccb81544b7f58b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.692833  9235 tablet_service.cc:1511] Processing CreateTablet for tablet d3044a44ee984c489779dc339d162407 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:02:44.673909  9369 tablet_bootstrap.cc:654] T 6f8b7d72409f45eebf4208f98310f378 P 8846d581359a4b7ea6d4c33424ea825d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:44.699112  9234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a377c4fc6c04b0aa8f74f64f4f59409. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.674938  9160 tablet_service.cc:1511] Processing CreateTablet for tablet 389a20133d8b4ebfaab346741dff367f (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:02:44.702550  9160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 389a20133d8b4ebfaab346741dff367f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.689415  9305 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2229e498f7f472f97c088fddb802939. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.709542  9236 tablet_service.cc:1511] Processing CreateTablet for tablet 50f8080d64c04e738a6a36d748c8ee1e (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:02:44.723716  9161 tablet_service.cc:1511] Processing CreateTablet for tablet 989e9796152e4796a3408e00419403fa (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:02:44.725189  9161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 989e9796152e4796a3408e00419403fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.719707  9233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48e91509dfc74d53a930cdc636976db6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.765964  9201 heartbeater.cc:499] Master 127.0.107.254:45205 was elected leader, sending a full tablet report...
I20260709 13:02:44.768111  9089 tablet_service.cc:1511] Processing CreateTablet for tablet d3044a44ee984c489779dc339d162407 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:02:44.769663  9089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3044a44ee984c489779dc339d162407. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.771898  9239 tablet_service.cc:1511] Processing CreateTablet for tablet 5b6b34440fd14f3ea66bd5de7a2a8260 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:02:44.726650  9084 tablet_service.cc:1511] Processing CreateTablet for tablet 5ce2a33a3b914f6297946ded34c256bf (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:02:44.788275  9084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ce2a33a3b914f6297946ded34c256bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.787992  9232 tablet_service.cc:1511] Processing CreateTablet for tablet cb7f6aeb8116423481ea2b2dca5a06d4 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:02:44.742811  9161 tablet_service.cc:1511] Processing CreateTablet for tablet f2229e498f7f472f97c088fddb802939 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:02:44.792071  9161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2229e498f7f472f97c088fddb802939. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.799273  9306 tablet_service.cc:1511] Processing CreateTablet for tablet 48e91509dfc74d53a930cdc636976db6 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:02:44.800662  9306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48e91509dfc74d53a930cdc636976db6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.735561  9158 tablet_service.cc:1511] Processing CreateTablet for tablet 059a6a9a07d74be4a9f3854317b870ab (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:02:44.807327  9314 tablet_service.cc:1511] Processing CreateTablet for tablet 50f8080d64c04e738a6a36d748c8ee1e (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:02:44.808082  9158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 059a6a9a07d74be4a9f3854317b870ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.811985  9088 tablet_service.cc:1511] Processing CreateTablet for tablet 0effc3d52a6d43ef8aa59821958f4e52 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:02:44.818981  9086 tablet_service.cc:1511] Processing CreateTablet for tablet d2ef0242573643178d56d10a6c26ae8e (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:02:44.736869  9371 tablet_bootstrap.cc:654] T ea3bb46b177b4bbdaa60f464370aa9a0 P c694531b0e1d47988b291f1214efc4cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:44.829084  9235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3044a44ee984c489779dc339d162407. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.835158  9372 tablet_bootstrap.cc:654] T 6f8b7d72409f45eebf4208f98310f378 P 65ed95869fbb4b69b5d6eb99c51adf85: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:44.837113  9159 tablet_service.cc:1511] Processing CreateTablet for tablet 5b6b34440fd14f3ea66bd5de7a2a8260 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:02:44.837296  9083 tablet_service.cc:1511] Processing CreateTablet for tablet eab411e3927a434ab647aa9b31fcf60d (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:02:44.837296  9311 tablet_service.cc:1511] Processing CreateTablet for tablet df7e9031dde347b5b9da753cc817ce17 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:02:44.838474  9159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b6b34440fd14f3ea66bd5de7a2a8260. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.840601  9314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50f8080d64c04e738a6a36d748c8ee1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.848874  9232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb7f6aeb8116423481ea2b2dca5a06d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.849226  9087 tablet_service.cc:1511] Processing CreateTablet for tablet 389a20133d8b4ebfaab346741dff367f (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:02:44.851015  9239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b6b34440fd14f3ea66bd5de7a2a8260. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.855057  9311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df7e9031dde347b5b9da753cc817ce17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.856320  9085 tablet_service.cc:1511] Processing CreateTablet for tablet 3899ef948b2e405baaccb81544b7f58b (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:02:44.858942  9236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50f8080d64c04e738a6a36d748c8ee1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.862962  9275 heartbeater.cc:499] Master 127.0.107.254:45205 was elected leader, sending a full tablet report...
I20260709 13:02:44.880576  9082 tablet_service.cc:1511] Processing CreateTablet for tablet 0a377c4fc6c04b0aa8f74f64f4f59409 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:02:44.889943  9091 tablet_service.cc:1511] Processing CreateTablet for tablet 059a6a9a07d74be4a9f3854317b870ab (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:02:44.901585  9090 tablet_service.cc:1511] Processing CreateTablet for tablet f2229e498f7f472f97c088fddb802939 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:02:44.862533  9163 tablet_service.cc:1511] Processing CreateTablet for tablet df7e9031dde347b5b9da753cc817ce17 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:02:44.928252  9163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df7e9031dde347b5b9da753cc817ce17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.929628  9237 tablet_service.cc:1511] Processing CreateTablet for tablet 604bd81da85244b6bd6d8bd6ac674f2c (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:02:44.868412  9088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0effc3d52a6d43ef8aa59821958f4e52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.949441  9082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a377c4fc6c04b0aa8f74f64f4f59409. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.951318  9085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3899ef948b2e405baaccb81544b7f58b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.951933  9086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2ef0242573643178d56d10a6c26ae8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.953187  9087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 389a20133d8b4ebfaab346741dff367f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.954095  9237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 604bd81da85244b6bd6d8bd6ac674f2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.961369  9369 tablet_bootstrap.cc:492] T 6f8b7d72409f45eebf4208f98310f378 P 8846d581359a4b7ea6d4c33424ea825d: No bootstrap required, opened a new log
I20260709 13:02:44.961946  9369 ts_tablet_manager.cc:1403] T 6f8b7d72409f45eebf4208f98310f378 P 8846d581359a4b7ea6d4c33424ea825d: Time spent bootstrapping tablet: real 0.403s	user 0.064s	sys 0.063s
I20260709 13:02:44.959024  9090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2229e498f7f472f97c088fddb802939. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.965060  9369 raft_consensus.cc:359] T 6f8b7d72409f45eebf4208f98310f378 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:44.965884  9369 raft_consensus.cc:385] T 6f8b7d72409f45eebf4208f98310f378 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:44.966173  9369 raft_consensus.cc:740] T 6f8b7d72409f45eebf4208f98310f378 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8846d581359a4b7ea6d4c33424ea825d, State: Initialized, Role: FOLLOWER
I20260709 13:02:44.966807  9083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eab411e3927a434ab647aa9b31fcf60d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.969532  9238 tablet_service.cc:1511] Processing CreateTablet for tablet 93ba4182a04b450ca3fc7a15896f889e (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:02:44.970976  9349 heartbeater.cc:499] Master 127.0.107.254:45205 was elected leader, sending a full tablet report...
I20260709 13:02:44.970989  9238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93ba4182a04b450ca3fc7a15896f889e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.985164  9157 tablet_service.cc:1511] Processing CreateTablet for tablet cb7f6aeb8116423481ea2b2dca5a06d4 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:02:44.992043  9157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb7f6aeb8116423481ea2b2dca5a06d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:44.993072  9165 tablet_service.cc:1511] Processing CreateTablet for tablet 604bd81da85244b6bd6d8bd6ac674f2c (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:02:44.987030  9162 tablet_service.cc:1511] Processing CreateTablet for tablet 50f8080d64c04e738a6a36d748c8ee1e (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:02:44.998131  9310 tablet_service.cc:1511] Processing CreateTablet for tablet d3044a44ee984c489779dc339d162407 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:02:44.975193  9091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 059a6a9a07d74be4a9f3854317b870ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.010880  9369 consensus_queue.cc:260] T 6f8b7d72409f45eebf4208f98310f378 P 8846d581359a4b7ea6d4c33424ea825d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:45.013947  9313 tablet_service.cc:1511] Processing CreateTablet for tablet cb7f6aeb8116423481ea2b2dca5a06d4 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:02:45.014953  9370 tablet_bootstrap.cc:492] T eb666e221e5f4e4fbaba194838a28448 P 74ac2cf163ee475e8a280cb3aa738f57: No bootstrap required, opened a new log
I20260709 13:02:45.015522  9370 ts_tablet_manager.cc:1403] T eb666e221e5f4e4fbaba194838a28448 P 74ac2cf163ee475e8a280cb3aa738f57: Time spent bootstrapping tablet: real 0.451s	user 0.014s	sys 0.018s
I20260709 13:02:45.020121  9161 tablet_service.cc:1511] Processing CreateTablet for tablet 8f67cb568c0745e792c17959b07c5da1 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:02:45.020790  9372 tablet_bootstrap.cc:492] T 6f8b7d72409f45eebf4208f98310f378 P 65ed95869fbb4b69b5d6eb99c51adf85: No bootstrap required, opened a new log
I20260709 13:02:45.021339  9372 ts_tablet_manager.cc:1403] T 6f8b7d72409f45eebf4208f98310f378 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent bootstrapping tablet: real 0.381s	user 0.069s	sys 0.041s
I20260709 13:02:45.021924  9309 tablet_service.cc:1511] Processing CreateTablet for tablet 8f67cb568c0745e792c17959b07c5da1 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:02:45.024294  9164 tablet_service.cc:1511] Processing CreateTablet for tablet 902451f24024496b83b9a05dfe359a22 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:02:45.025331  9307 tablet_service.cc:1511] Processing CreateTablet for tablet 93ba4182a04b450ca3fc7a15896f889e (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:02:45.029544  9371 tablet_bootstrap.cc:492] T ea3bb46b177b4bbdaa60f464370aa9a0 P c694531b0e1d47988b291f1214efc4cb: No bootstrap required, opened a new log
I20260709 13:02:45.030119  9371 ts_tablet_manager.cc:1403] T ea3bb46b177b4bbdaa60f464370aa9a0 P c694531b0e1d47988b291f1214efc4cb: Time spent bootstrapping tablet: real 0.405s	user 0.034s	sys 0.048s
I20260709 13:02:44.994508  9165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 604bd81da85244b6bd6d8bd6ac674f2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.031152  9162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50f8080d64c04e738a6a36d748c8ee1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.033878  9372 raft_consensus.cc:359] T 6f8b7d72409f45eebf4208f98310f378 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:45.038852  9372 raft_consensus.cc:385] T 6f8b7d72409f45eebf4208f98310f378 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:45.047076  9372 raft_consensus.cc:740] T 6f8b7d72409f45eebf4208f98310f378 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Initialized, Role: FOLLOWER
I20260709 13:02:45.047999  9372 consensus_queue.cc:260] T 6f8b7d72409f45eebf4208f98310f378 P 65ed95869fbb4b69b5d6eb99c51adf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:45.051069  9313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb7f6aeb8116423481ea2b2dca5a06d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.049786  9308 tablet_service.cc:1511] Processing CreateTablet for tablet 902451f24024496b83b9a05dfe359a22 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:02:45.052184  9310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3044a44ee984c489779dc339d162407. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.055042  9309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f67cb568c0745e792c17959b07c5da1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.034037  9164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 902451f24024496b83b9a05dfe359a22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.057096  9084 tablet_service.cc:1511] Processing CreateTablet for tablet 48e91509dfc74d53a930cdc636976db6 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:02:45.057749  9308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 902451f24024496b83b9a05dfe359a22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.052098  9370 raft_consensus.cc:359] T eb666e221e5f4e4fbaba194838a28448 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:45.059763  9370 raft_consensus.cc:385] T eb666e221e5f4e4fbaba194838a28448 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:45.060163  9370 raft_consensus.cc:740] T eb666e221e5f4e4fbaba194838a28448 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74ac2cf163ee475e8a280cb3aa738f57, State: Initialized, Role: FOLLOWER
I20260709 13:02:45.060503  9232 tablet_service.cc:1511] Processing CreateTablet for tablet 902451f24024496b83b9a05dfe359a22 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:02:45.061463  9307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93ba4182a04b450ca3fc7a15896f889e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.065254  9370 consensus_queue.cc:260] T eb666e221e5f4e4fbaba194838a28448 P 74ac2cf163ee475e8a280cb3aa738f57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:45.059036  9161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f67cb568c0745e792c17959b07c5da1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.065255  9371 raft_consensus.cc:359] T ea3bb46b177b4bbdaa60f464370aa9a0 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:45.069620  9157 tablet_service.cc:1511] Processing CreateTablet for tablet a1ab6d75958044aeac9e1d43da9dc4b9 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:02:45.079237  9371 raft_consensus.cc:385] T ea3bb46b177b4bbdaa60f464370aa9a0 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:45.079993  9157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1ab6d75958044aeac9e1d43da9dc4b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.080456  9371 raft_consensus.cc:740] T ea3bb46b177b4bbdaa60f464370aa9a0 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c694531b0e1d47988b291f1214efc4cb, State: Initialized, Role: FOLLOWER
I20260709 13:02:45.083427  9371 consensus_queue.cc:260] T ea3bb46b177b4bbdaa60f464370aa9a0 P c694531b0e1d47988b291f1214efc4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:45.072079  9239 tablet_service.cc:1511] Processing CreateTablet for tablet a1ab6d75958044aeac9e1d43da9dc4b9 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:02:45.097429  9369 ts_tablet_manager.cc:1434] T 6f8b7d72409f45eebf4208f98310f378 P 8846d581359a4b7ea6d4c33424ea825d: Time spent starting tablet: real 0.135s	user 0.014s	sys 0.000s
I20260709 13:02:45.058494  9084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48e91509dfc74d53a930cdc636976db6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.061892  9232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 902451f24024496b83b9a05dfe359a22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.112517  9372 ts_tablet_manager.cc:1434] T 6f8b7d72409f45eebf4208f98310f378 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent starting tablet: real 0.091s	user 0.011s	sys 0.011s
I20260709 13:02:45.119676  9372 tablet_bootstrap.cc:492] T 8bfbc32cc1ba4ecc8fddc7e7f4711778 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap starting.
W20260709 13:02:45.127460  9127 tablet.cc:2406] T 6f8b7d72409f45eebf4208f98310f378 P 65ed95869fbb4b69b5d6eb99c51adf85: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:02:45.144336  9088 tablet_service.cc:1511] Processing CreateTablet for tablet 604bd81da85244b6bd6d8bd6ac674f2c (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:02:45.145730  9088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 604bd81da85244b6bd6d8bd6ac674f2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.132632  9372 tablet_bootstrap.cc:654] T 8bfbc32cc1ba4ecc8fddc7e7f4711778 P 65ed95869fbb4b69b5d6eb99c51adf85: Neither blocks nor log segments found. Creating new log.
W20260709 13:02:45.154918  8983 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.0.107.195:45311, user_credentials={real_user=slave}} blocked reactor thread for 76012.2us
I20260709 13:02:45.139684  9086 tablet_service.cc:1511] Processing CreateTablet for tablet df7e9031dde347b5b9da753cc817ce17 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:02:45.168021  9370 ts_tablet_manager.cc:1434] T eb666e221e5f4e4fbaba194838a28448 P 74ac2cf163ee475e8a280cb3aa738f57: Time spent starting tablet: real 0.152s	user 0.013s	sys 0.009s
I20260709 13:02:45.174217  9239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1ab6d75958044aeac9e1d43da9dc4b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.178634  9371 ts_tablet_manager.cc:1434] T ea3bb46b177b4bbdaa60f464370aa9a0 P c694531b0e1d47988b291f1214efc4cb: Time spent starting tablet: real 0.148s	user 0.010s	sys 0.013s
I20260709 13:02:45.179847  9371 tablet_bootstrap.cc:492] T e6797c587fdc4754b091a2be102e5927 P c694531b0e1d47988b291f1214efc4cb: Bootstrap starting.
W20260709 13:02:45.183204  8985 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.0.107.196:44351, user_credentials={real_user=slave}} blocked reactor thread for 71237.8us
I20260709 13:02:45.183261  9370 tablet_bootstrap.cc:492] T b3f19df7d93748a1802678c56b5e2208 P 74ac2cf163ee475e8a280cb3aa738f57: Bootstrap starting.
I20260709 13:02:45.195218  9082 tablet_service.cc:1511] Processing CreateTablet for tablet 8f67cb568c0745e792c17959b07c5da1 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:02:45.206990  9162 tablet_service.cc:1511] Processing CreateTablet for tablet bfb390576f2e4f508caa2d234ed5d425 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:02:45.207772  9082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f67cb568c0745e792c17959b07c5da1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.211563  9308 tablet_service.cc:1511] Processing CreateTablet for tablet bfb390576f2e4f508caa2d234ed5d425 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:02:45.176421  9369 tablet_bootstrap.cc:492] T b3f19df7d93748a1802678c56b5e2208 P 8846d581359a4b7ea6d4c33424ea825d: Bootstrap starting.
I20260709 13:02:45.126650  9089 tablet_service.cc:1511] Processing CreateTablet for tablet 5b6b34440fd14f3ea66bd5de7a2a8260 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:02:45.218317  9163 tablet_service.cc:1511] Processing CreateTablet for tablet d755a5211e5c4133bead5603a424005e (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:02:45.220396  9162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfb390576f2e4f508caa2d234ed5d425. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.221486  9163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d755a5211e5c4133bead5603a424005e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.223428  9086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df7e9031dde347b5b9da753cc817ce17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.224583  9087 tablet_service.cc:1511] Processing CreateTablet for tablet bfb390576f2e4f508caa2d234ed5d425 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:02:45.226091  9087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfb390576f2e4f508caa2d234ed5d425. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.227008  9089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b6b34440fd14f3ea66bd5de7a2a8260. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.221494  9091 tablet_service.cc:1511] Processing CreateTablet for tablet 93ba4182a04b450ca3fc7a15896f889e (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:02:45.231357  9307 tablet_service.cc:1511] Processing CreateTablet for tablet a971867a8d494757a297936fad4bd464 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:02:45.245223  9091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93ba4182a04b450ca3fc7a15896f889e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.216987  9370 tablet_bootstrap.cc:654] T b3f19df7d93748a1802678c56b5e2208 P 74ac2cf163ee475e8a280cb3aa738f57: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:45.247264  9090 tablet_service.cc:1511] Processing CreateTablet for tablet a971867a8d494757a297936fad4bd464 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:02:45.248735  9090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a971867a8d494757a297936fad4bd464. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.259588  9307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a971867a8d494757a297936fad4bd464. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.262955  9380 raft_consensus.cc:493] T ea3bb46b177b4bbdaa60f464370aa9a0 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.263659  9380 raft_consensus.cc:515] T ea3bb46b177b4bbdaa60f464370aa9a0 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:45.266479  9380 leader_election.cc:290] T ea3bb46b177b4bbdaa60f464370aa9a0 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979), 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311)
I20260709 13:02:45.258237  9238 tablet_service.cc:1511] Processing CreateTablet for tablet d755a5211e5c4133bead5603a424005e (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:02:45.280128  9308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfb390576f2e4f508caa2d234ed5d425. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.262995  9239 tablet_service.cc:1511] Processing CreateTablet for tablet a971867a8d494757a297936fad4bd464 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:02:45.268571  9085 tablet_service.cc:1511] Processing CreateTablet for tablet a1ab6d75958044aeac9e1d43da9dc4b9 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:02:45.286540  9238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d755a5211e5c4133bead5603a424005e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.286942  9372 tablet_bootstrap.cc:492] T 8bfbc32cc1ba4ecc8fddc7e7f4711778 P 65ed95869fbb4b69b5d6eb99c51adf85: No bootstrap required, opened a new log
I20260709 13:02:45.287494  9372 ts_tablet_manager.cc:1403] T 8bfbc32cc1ba4ecc8fddc7e7f4711778 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent bootstrapping tablet: real 0.168s	user 0.005s	sys 0.019s
I20260709 13:02:45.278638  9369 tablet_bootstrap.cc:654] T b3f19df7d93748a1802678c56b5e2208 P 8846d581359a4b7ea6d4c33424ea825d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:45.286549  9085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1ab6d75958044aeac9e1d43da9dc4b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.290596  9372 raft_consensus.cc:359] T 8bfbc32cc1ba4ecc8fddc7e7f4711778 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:45.301645  9372 raft_consensus.cc:385] T 8bfbc32cc1ba4ecc8fddc7e7f4711778 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:45.301972  9372 raft_consensus.cc:740] T 8bfbc32cc1ba4ecc8fddc7e7f4711778 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Initialized, Role: FOLLOWER
I20260709 13:02:45.306020  9371 tablet_bootstrap.cc:654] T e6797c587fdc4754b091a2be102e5927 P c694531b0e1d47988b291f1214efc4cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:45.319768  9236 tablet_service.cc:1511] Processing CreateTablet for tablet 9d21e8696b0340bea31002b775af50ee (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:02:45.322789  9236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d21e8696b0340bea31002b775af50ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.323185  9313 tablet_service.cc:1511] Processing CreateTablet for tablet d26bd321e5604f8aa61723f418be35a9 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:02:45.326423  9309 tablet_service.cc:1511] Processing CreateTablet for tablet d755a5211e5c4133bead5603a424005e (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:02:45.333998  9235 tablet_service.cc:1511] Processing CreateTablet for tablet 87959c0c174141f0958bbba169370488 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:02:45.335486  9235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87959c0c174141f0958bbba169370488. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.335632  9305 tablet_service.cc:1511] Processing CreateTablet for tablet 9d21e8696b0340bea31002b775af50ee (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:02:45.339979  9239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a971867a8d494757a297936fad4bd464. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.343039  9379 raft_consensus.cc:493] T eb666e221e5f4e4fbaba194838a28448 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.343636  9379 raft_consensus.cc:515] T eb666e221e5f4e4fbaba194838a28448 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:45.357931  9157 tablet_service.cc:1511] Processing CreateTablet for tablet 87959c0c174141f0958bbba169370488 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:02:45.358035  9161 tablet_service.cc:1511] Processing CreateTablet for tablet 9dea45dda5454393bdfaed3f233a30a5 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:02:45.359099  9157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87959c0c174141f0958bbba169370488. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.348423  9379 leader_election.cc:290] T eb666e221e5f4e4fbaba194838a28448 P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979), c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455)
I20260709 13:02:45.356359  9313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d26bd321e5604f8aa61723f418be35a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.309660  9372 consensus_queue.cc:260] T 8bfbc32cc1ba4ecc8fddc7e7f4711778 P 65ed95869fbb4b69b5d6eb99c51adf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:45.376230  9372 ts_tablet_manager.cc:1434] T 8bfbc32cc1ba4ecc8fddc7e7f4711778 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent starting tablet: real 0.088s	user 0.007s	sys 0.000s
I20260709 13:02:45.377388  9372 tablet_bootstrap.cc:492] T a731a965126b406988eecb7829bc9981 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap starting.
I20260709 13:02:45.374420  9091 tablet_service.cc:1511] Processing CreateTablet for tablet 9dea45dda5454393bdfaed3f233a30a5 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:02:45.381191  9091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dea45dda5454393bdfaed3f233a30a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.353775  9159 tablet_service.cc:1511] Processing CreateTablet for tablet d26bd321e5604f8aa61723f418be35a9 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:02:45.386845  9087 tablet_service.cc:1511] Processing CreateTablet for tablet 9d21e8696b0340bea31002b775af50ee (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:02:45.388501  9087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d21e8696b0340bea31002b775af50ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.391559  9161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dea45dda5454393bdfaed3f233a30a5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:02:45.392738  9047 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:45.395095  9159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d26bd321e5604f8aa61723f418be35a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.396293  9088 tablet_service.cc:1511] Processing CreateTablet for tablet d26bd321e5604f8aa61723f418be35a9 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:02:45.397941  9088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d26bd321e5604f8aa61723f418be35a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.312896  9237 tablet_service.cc:1511] Processing CreateTablet for tablet 9dea45dda5454393bdfaed3f233a30a5 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:02:45.399132  9309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d755a5211e5c4133bead5603a424005e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.399593  9237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dea45dda5454393bdfaed3f233a30a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.401150  9305 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d21e8696b0340bea31002b775af50ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.443013  9370 tablet_bootstrap.cc:492] T b3f19df7d93748a1802678c56b5e2208 P 74ac2cf163ee475e8a280cb3aa738f57: No bootstrap required, opened a new log
I20260709 13:02:45.443905  9377 raft_consensus.cc:493] T 6f8b7d72409f45eebf4208f98310f378 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.444447  9377 raft_consensus.cc:515] T 6f8b7d72409f45eebf4208f98310f378 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:45.443626  9370 ts_tablet_manager.cc:1403] T b3f19df7d93748a1802678c56b5e2208 P 74ac2cf163ee475e8a280cb3aa738f57: Time spent bootstrapping tablet: real 0.261s	user 0.029s	sys 0.021s
I20260709 13:02:45.461331  9377 leader_election.cc:290] T 6f8b7d72409f45eebf4208f98310f378 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979), c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455)
I20260709 13:02:45.462383  9369 tablet_bootstrap.cc:492] T b3f19df7d93748a1802678c56b5e2208 P 8846d581359a4b7ea6d4c33424ea825d: No bootstrap required, opened a new log
I20260709 13:02:45.462996  9369 ts_tablet_manager.cc:1403] T b3f19df7d93748a1802678c56b5e2208 P 8846d581359a4b7ea6d4c33424ea825d: Time spent bootstrapping tablet: real 0.289s	user 0.035s	sys 0.008s
I20260709 13:02:45.465370  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea3bb46b177b4bbdaa60f464370aa9a0" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" is_pre_election: true
I20260709 13:02:45.483346  9378 raft_consensus.cc:493] T 6f8b7d72409f45eebf4208f98310f378 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:45.487406  9141 leader_election.cc:343] T ea3bb46b177b4bbdaa60f464370aa9a0 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:45.497237  9085 tablet_service.cc:1511] Processing CreateTablet for tablet d75fae153be542ccbf70c92676ffd30d (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:02:45.499106  9085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d75fae153be542ccbf70c92676ffd30d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.500061  9083 tablet_service.cc:1511] Processing CreateTablet for tablet 76b3d3cd810b46dbac2b534c0be568d2 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:02:45.501541  9083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76b3d3cd810b46dbac2b534c0be568d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.483909  9378 raft_consensus.cc:515] T 6f8b7d72409f45eebf4208f98310f378 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:45.524415  9164 tablet_service.cc:1511] Processing CreateTablet for tablet c7c964979a0443f68e90c8678d083c96 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:02:45.524610  9160 tablet_service.cc:1511] Processing CreateTablet for tablet 02048c7b44ac4e8a984dfa44a3b3b3e5 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:02:45.525902  9164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7c964979a0443f68e90c8678d083c96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.527218  9158 tablet_service.cc:1511] Processing CreateTablet for tablet 6007c141b1134cb18ab1200556127236 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:02:45.527660  9165 tablet_service.cc:1511] Processing CreateTablet for tablet d75fae153be542ccbf70c92676ffd30d (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:02:45.528820  9158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6007c141b1134cb18ab1200556127236. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.535476  9084 tablet_service.cc:1511] Processing CreateTablet for tablet 6007c141b1134cb18ab1200556127236 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:02:45.536888  9084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6007c141b1134cb18ab1200556127236. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.536654  9238 tablet_service.cc:1511] Processing CreateTablet for tablet c7c964979a0443f68e90c8678d083c96 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:02:45.537957  9238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7c964979a0443f68e90c8678d083c96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.542223  9250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea3bb46b177b4bbdaa60f464370aa9a0" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d" is_pre_election: true
W20260709 13:02:45.544165  9139 leader_election.cc:343] T ea3bb46b177b4bbdaa60f464370aa9a0 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:45.544741  9139 leader_election.cc:304] T ea3bb46b177b4bbdaa60f464370aa9a0 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c694531b0e1d47988b291f1214efc4cb; no voters: 65ed95869fbb4b69b5d6eb99c51adf85, 8846d581359a4b7ea6d4c33424ea825d
I20260709 13:02:45.545557  9380 raft_consensus.cc:2749] T ea3bb46b177b4bbdaa60f464370aa9a0 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:45.548036  9239 tablet_service.cc:1511] Processing CreateTablet for tablet 02048c7b44ac4e8a984dfa44a3b3b3e5 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:02:45.549402  9239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02048c7b44ac4e8a984dfa44a3b3b3e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.553833  9086 tablet_service.cc:1511] Processing CreateTablet for tablet c7c964979a0443f68e90c8678d083c96 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:02:45.555202  9232 tablet_service.cc:1511] Processing CreateTablet for tablet 6007c141b1134cb18ab1200556127236 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:02:45.556627  9232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6007c141b1134cb18ab1200556127236. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.556540  9369 raft_consensus.cc:359] T b3f19df7d93748a1802678c56b5e2208 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:45.557453  9369 raft_consensus.cc:385] T b3f19df7d93748a1802678c56b5e2208 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:45.557735  9369 raft_consensus.cc:740] T b3f19df7d93748a1802678c56b5e2208 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8846d581359a4b7ea6d4c33424ea825d, State: Initialized, Role: FOLLOWER
I20260709 13:02:45.532065  9371 tablet_bootstrap.cc:492] T e6797c587fdc4754b091a2be102e5927 P c694531b0e1d47988b291f1214efc4cb: No bootstrap required, opened a new log
I20260709 13:02:45.562705  9371 ts_tablet_manager.cc:1403] T e6797c587fdc4754b091a2be102e5927 P c694531b0e1d47988b291f1214efc4cb: Time spent bootstrapping tablet: real 0.383s	user 0.034s	sys 0.048s
I20260709 13:02:45.550608  9236 tablet_service.cc:1511] Processing CreateTablet for tablet 76b3d3cd810b46dbac2b534c0be568d2 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:02:45.569689  9308 tablet_service.cc:1511] Processing CreateTablet for tablet 87959c0c174141f0958bbba169370488 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:02:45.571341  9308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87959c0c174141f0958bbba169370488. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.573032  9307 tablet_service.cc:1511] Processing CreateTablet for tablet d75fae153be542ccbf70c92676ffd30d (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:02:45.574631  9307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d75fae153be542ccbf70c92676ffd30d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.555299  9086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7c964979a0443f68e90c8678d083c96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.580371  9090 tablet_service.cc:1511] Processing CreateTablet for tablet 7f278d22c55747ee8ee613bfa5c59391 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:02:45.581754  9090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f278d22c55747ee8ee613bfa5c59391. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.581367  9370 raft_consensus.cc:359] T b3f19df7d93748a1802678c56b5e2208 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:45.582144  9370 raft_consensus.cc:385] T b3f19df7d93748a1802678c56b5e2208 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:45.582437  9370 raft_consensus.cc:740] T b3f19df7d93748a1802678c56b5e2208 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74ac2cf163ee475e8a280cb3aa738f57, State: Initialized, Role: FOLLOWER
I20260709 13:02:45.590806  9378 leader_election.cc:290] T 6f8b7d72409f45eebf4208f98310f378 P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455), 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311)
I20260709 13:02:45.593901  9306 tablet_service.cc:1511] Processing CreateTablet for tablet 02048c7b44ac4e8a984dfa44a3b3b3e5 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:02:45.594470  9310 tablet_service.cc:1511] Processing CreateTablet for tablet 7f278d22c55747ee8ee613bfa5c59391 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:02:45.595360  9306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02048c7b44ac4e8a984dfa44a3b3b3e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.594988  9313 tablet_service.cc:1511] Processing CreateTablet for tablet 76b3d3cd810b46dbac2b534c0be568d2 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:02:45.596091  9310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f278d22c55747ee8ee613bfa5c59391. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.598938  9313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76b3d3cd810b46dbac2b534c0be568d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.588985  9160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02048c7b44ac4e8a984dfa44a3b3b3e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.609140  9165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d75fae153be542ccbf70c92676ffd30d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.613740  9371 raft_consensus.cc:359] T e6797c587fdc4754b091a2be102e5927 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:45.614777  9369 consensus_queue.cc:260] T b3f19df7d93748a1802678c56b5e2208 P 8846d581359a4b7ea6d4c33424ea825d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:45.617208  9369 ts_tablet_manager.cc:1434] T b3f19df7d93748a1802678c56b5e2208 P 8846d581359a4b7ea6d4c33424ea825d: Time spent starting tablet: real 0.154s	user 0.006s	sys 0.000s
I20260709 13:02:45.636766  9157 tablet_service.cc:1511] Processing CreateTablet for tablet 7f278d22c55747ee8ee613bfa5c59391 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:02:45.637427  9372 tablet_bootstrap.cc:654] T a731a965126b406988eecb7829bc9981 P 65ed95869fbb4b69b5d6eb99c51adf85: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:45.638269  9157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f278d22c55747ee8ee613bfa5c59391. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.639060  9370 consensus_queue.cc:260] T b3f19df7d93748a1802678c56b5e2208 P 74ac2cf163ee475e8a280cb3aa738f57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:45.641319  9370 ts_tablet_manager.cc:1434] T b3f19df7d93748a1802678c56b5e2208 P 74ac2cf163ee475e8a280cb3aa738f57: Time spent starting tablet: real 0.170s	user 0.005s	sys 0.000s
I20260709 13:02:45.642261  9377 raft_consensus.cc:493] T b3f19df7d93748a1802678c56b5e2208 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.642792  9377 raft_consensus.cc:515] T b3f19df7d93748a1802678c56b5e2208 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:45.614579  9371 raft_consensus.cc:385] T e6797c587fdc4754b091a2be102e5927 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:45.644392  9371 raft_consensus.cc:740] T e6797c587fdc4754b091a2be102e5927 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c694531b0e1d47988b291f1214efc4cb, State: Initialized, Role: FOLLOWER
I20260709 13:02:45.645143  9377 leader_election.cc:290] T b3f19df7d93748a1802678c56b5e2208 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351), 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979)
I20260709 13:02:45.647258  9176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8b7d72409f45eebf4208f98310f378" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694531b0e1d47988b291f1214efc4cb" is_pre_election: true
I20260709 13:02:45.653694  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8b7d72409f45eebf4208f98310f378" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" is_pre_election: true
I20260709 13:02:45.654456  9101 raft_consensus.cc:2468] T 6f8b7d72409f45eebf4208f98310f378 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8846d581359a4b7ea6d4c33424ea825d in term 0.
I20260709 13:02:45.656744  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb666e221e5f4e4fbaba194838a28448" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" is_pre_election: true
I20260709 13:02:45.666844  9378 raft_consensus.cc:493] T 8bfbc32cc1ba4ecc8fddc7e7f4711778 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.667436  9378 raft_consensus.cc:515] T 8bfbc32cc1ba4ecc8fddc7e7f4711778 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
W20260709 13:02:45.658438  9214 leader_election.cc:343] T 6f8b7d72409f45eebf4208f98310f378 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:45.669721  9378 leader_election.cc:290] T 8bfbc32cc1ba4ecc8fddc7e7f4711778 P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351), c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455)
W20260709 13:02:45.683808  9289 leader_election.cc:343] T eb666e221e5f4e4fbaba194838a28448 P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:45.691468  9215 leader_election.cc:304] T 6f8b7d72409f45eebf4208f98310f378 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65ed95869fbb4b69b5d6eb99c51adf85, 8846d581359a4b7ea6d4c33424ea825d; no voters: c694531b0e1d47988b291f1214efc4cb
I20260709 13:02:45.692876  9377 raft_consensus.cc:2804] T 6f8b7d72409f45eebf4208f98310f378 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:45.693285  9377 raft_consensus.cc:493] T 6f8b7d72409f45eebf4208f98310f378 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:45.693612  9377 raft_consensus.cc:3060] T 6f8b7d72409f45eebf4208f98310f378 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:45.689404  9236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76b3d3cd810b46dbac2b534c0be568d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.677094  9370 tablet_bootstrap.cc:492] T 6cb786213d5d48779533059bc333ac6f P 74ac2cf163ee475e8a280cb3aa738f57: Bootstrap starting.
I20260709 13:02:45.670936  9233 tablet_service.cc:1511] Processing CreateTablet for tablet 534ae119bf014235a99dfbbfcff690e1 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:02:45.707691  9233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 534ae119bf014235a99dfbbfcff690e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.712100  9369 tablet_bootstrap.cc:492] T 3ac2da3cd17d470495fd5fbb986e4936 P 8846d581359a4b7ea6d4c33424ea825d: Bootstrap starting.
I20260709 13:02:45.645360  9371 consensus_queue.cc:260] T e6797c587fdc4754b091a2be102e5927 P c694531b0e1d47988b291f1214efc4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:45.737478  9371 ts_tablet_manager.cc:1434] T e6797c587fdc4754b091a2be102e5927 P c694531b0e1d47988b291f1214efc4cb: Time spent starting tablet: real 0.174s	user 0.009s	sys 0.000s
I20260709 13:02:45.753306  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f19df7d93748a1802678c56b5e2208" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" is_pre_election: true
W20260709 13:02:45.755123  9215 leader_election.cc:343] T b3f19df7d93748a1802678c56b5e2208 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:45.759999  9369 tablet_bootstrap.cc:654] T 3ac2da3cd17d470495fd5fbb986e4936 P 8846d581359a4b7ea6d4c33424ea825d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:45.762192  9159 tablet_service.cc:1511] Processing CreateTablet for tablet a581cc3c19254d4ca39e1f7328268a93 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:02:45.763841  9370 tablet_bootstrap.cc:654] T 6cb786213d5d48779533059bc333ac6f P 74ac2cf163ee475e8a280cb3aa738f57: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:45.774540  9083 tablet_service.cc:1511] Processing CreateTablet for tablet 534ae119bf014235a99dfbbfcff690e1 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:02:45.776111  9083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 534ae119bf014235a99dfbbfcff690e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.776170  9176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb666e221e5f4e4fbaba194838a28448" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694531b0e1d47988b291f1214efc4cb" is_pre_election: true
I20260709 13:02:45.777432  9238 tablet_service.cc:1511] Processing CreateTablet for tablet a581cc3c19254d4ca39e1f7328268a93 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:02:45.778865  9238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a581cc3c19254d4ca39e1f7328268a93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.785887  9159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a581cc3c19254d4ca39e1f7328268a93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.787132  9377 raft_consensus.cc:515] T 6f8b7d72409f45eebf4208f98310f378 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:45.808111  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8b7d72409f45eebf4208f98310f378" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85"
I20260709 13:02:45.813205  9100 raft_consensus.cc:3060] T 6f8b7d72409f45eebf4208f98310f378 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:45.818055  9176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8b7d72409f45eebf4208f98310f378" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694531b0e1d47988b291f1214efc4cb"
W20260709 13:02:45.819900  9214 leader_election.cc:343] T 6f8b7d72409f45eebf4208f98310f378 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:45.821451  9372 tablet_bootstrap.cc:492] T a731a965126b406988eecb7829bc9981 P 65ed95869fbb4b69b5d6eb99c51adf85: No bootstrap required, opened a new log
I20260709 13:02:45.822134  9372 ts_tablet_manager.cc:1403] T a731a965126b406988eecb7829bc9981 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent bootstrapping tablet: real 0.445s	user 0.018s	sys 0.026s
I20260709 13:02:45.822031  9250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8b7d72409f45eebf4208f98310f378" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d" is_pre_election: true
I20260709 13:02:45.811272  9377 leader_election.cc:290] T 6f8b7d72409f45eebf4208f98310f378 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 election: Requested vote from peers 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979), c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455)
I20260709 13:02:45.824059  9250 raft_consensus.cc:2393] T 6f8b7d72409f45eebf4208f98310f378 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65ed95869fbb4b69b5d6eb99c51adf85 in current term 1: Already voted for candidate 8846d581359a4b7ea6d4c33424ea825d in this term.
I20260709 13:02:45.829689  9086 tablet_service.cc:1511] Processing CreateTablet for tablet 070a6f2020a1483381e2baa75e5c0cbf (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:02:45.830214  9379 raft_consensus.cc:493] T b3f19df7d93748a1802678c56b5e2208 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.833771  9175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bfbc32cc1ba4ecc8fddc7e7f4711778" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694531b0e1d47988b291f1214efc4cb" is_pre_election: true
I20260709 13:02:45.847723  9086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 070a6f2020a1483381e2baa75e5c0cbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.838255  9176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8b7d72409f45eebf4208f98310f378" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694531b0e1d47988b291f1214efc4cb" is_pre_election: true
I20260709 13:02:45.839145  9371 tablet_bootstrap.cc:492] T 8bfbc32cc1ba4ecc8fddc7e7f4711778 P c694531b0e1d47988b291f1214efc4cb: Bootstrap starting.
I20260709 13:02:45.839931  9324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f19df7d93748a1802678c56b5e2208" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57" is_pre_election: true
I20260709 13:02:45.857278  9085 tablet_service.cc:1511] Processing CreateTablet for tablet e2fbc9c2c0a947f1b4a078db7c8402d0 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:02:45.858345  9090 tablet_service.cc:1511] Processing CreateTablet for tablet 4d2b02247c21448ea824065ad29304e7 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:02:45.855708  9165 tablet_service.cc:1511] Processing CreateTablet for tablet e2fbc9c2c0a947f1b4a078db7c8402d0 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:02:45.859551  9236 tablet_service.cc:1511] Processing CreateTablet for tablet 070a6f2020a1483381e2baa75e5c0cbf (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:02:45.847391  9379 raft_consensus.cc:515] T b3f19df7d93748a1802678c56b5e2208 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
W20260709 13:02:45.849020  9065 leader_election.cc:343] T 8bfbc32cc1ba4ecc8fddc7e7f4711778 P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:45.860970  9065 leader_election.cc:343] T 6f8b7d72409f45eebf4208f98310f378 P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:45.861414  9065 leader_election.cc:304] T 6f8b7d72409f45eebf4208f98310f378 P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65ed95869fbb4b69b5d6eb99c51adf85; no voters: 8846d581359a4b7ea6d4c33424ea825d, c694531b0e1d47988b291f1214efc4cb
I20260709 13:02:45.848802  9233 tablet_service.cc:1511] Processing CreateTablet for tablet 4d2b02247c21448ea824065ad29304e7 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:02:45.862917  9324 raft_consensus.cc:2468] T b3f19df7d93748a1802678c56b5e2208 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8846d581359a4b7ea6d4c33424ea825d in term 0.
I20260709 13:02:45.863361  9233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d2b02247c21448ea824065ad29304e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.866413  9236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 070a6f2020a1483381e2baa75e5c0cbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.827613  9161 tablet_service.cc:1511] Processing CreateTablet for tablet 070a6f2020a1483381e2baa75e5c0cbf (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:02:45.859980  9165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2fbc9c2c0a947f1b4a078db7c8402d0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:02:45.840243  9288 leader_election.cc:343] T eb666e221e5f4e4fbaba194838a28448 P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:45.866801  9215 leader_election.cc:304] T b3f19df7d93748a1802678c56b5e2208 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57, 8846d581359a4b7ea6d4c33424ea825d; no voters: 65ed95869fbb4b69b5d6eb99c51adf85
I20260709 13:02:45.868696  9377 raft_consensus.cc:2804] T b3f19df7d93748a1802678c56b5e2208 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:45.869616  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f19df7d93748a1802678c56b5e2208" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" is_pre_election: true
I20260709 13:02:45.870970  9161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 070a6f2020a1483381e2baa75e5c0cbf. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:02:45.871261  9289 leader_election.cc:343] T b3f19df7d93748a1802678c56b5e2208 P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:45.862498  9379 leader_election.cc:290] T b3f19df7d93748a1802678c56b5e2208 P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311), 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979)
I20260709 13:02:45.869562  9377 raft_consensus.cc:493] T b3f19df7d93748a1802678c56b5e2208 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:45.878196  9090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d2b02247c21448ea824065ad29304e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.876092  9377 raft_consensus.cc:3060] T b3f19df7d93748a1802678c56b5e2208 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:45.880780  9250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f19df7d93748a1802678c56b5e2208" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d" is_pre_election: true
I20260709 13:02:45.881863  9085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2fbc9c2c0a947f1b4a078db7c8402d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.887926  9164 tablet_service.cc:1511] Processing CreateTablet for tablet c500a4c76ad3464aaa2f8985f7d3a53d (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:02:45.889165  9164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c500a4c76ad3464aaa2f8985f7d3a53d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.890152  9371 tablet_bootstrap.cc:654] T 8bfbc32cc1ba4ecc8fddc7e7f4711778 P c694531b0e1d47988b291f1214efc4cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:45.903406  9380 raft_consensus.cc:493] T e6797c587fdc4754b091a2be102e5927 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.904100  9380 raft_consensus.cc:515] T e6797c587fdc4754b091a2be102e5927 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:45.891252  9288 leader_election.cc:304] T eb666e221e5f4e4fbaba194838a28448 P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57; no voters: 65ed95869fbb4b69b5d6eb99c51adf85, c694531b0e1d47988b291f1214efc4cb
I20260709 13:02:45.908700  9379 raft_consensus.cc:2749] T eb666e221e5f4e4fbaba194838a28448 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:45.932760  9369 tablet_bootstrap.cc:492] T 3ac2da3cd17d470495fd5fbb986e4936 P 8846d581359a4b7ea6d4c33424ea825d: No bootstrap required, opened a new log
I20260709 13:02:45.933480  9369 ts_tablet_manager.cc:1403] T 3ac2da3cd17d470495fd5fbb986e4936 P 8846d581359a4b7ea6d4c33424ea825d: Time spent bootstrapping tablet: real 0.244s	user 0.016s	sys 0.022s
I20260709 13:02:45.933887  9100 raft_consensus.cc:2468] T 6f8b7d72409f45eebf4208f98310f378 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8846d581359a4b7ea6d4c33424ea825d in term 1.
I20260709 13:02:45.934562  9378 raft_consensus.cc:2749] T 6f8b7d72409f45eebf4208f98310f378 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:45.935568  9215 leader_election.cc:304] T 6f8b7d72409f45eebf4208f98310f378 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65ed95869fbb4b69b5d6eb99c51adf85, 8846d581359a4b7ea6d4c33424ea825d; no voters: c694531b0e1d47988b291f1214efc4cb
I20260709 13:02:45.937464  9369 raft_consensus.cc:359] T 3ac2da3cd17d470495fd5fbb986e4936 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:45.941884  9233 tablet_service.cc:1511] Processing CreateTablet for tablet c500a4c76ad3464aaa2f8985f7d3a53d (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:02:45.904847  9372 raft_consensus.cc:359] T a731a965126b406988eecb7829bc9981 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:45.942943  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6797c587fdc4754b091a2be102e5927" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" is_pre_election: true
I20260709 13:02:45.950299  9372 raft_consensus.cc:385] T a731a965126b406988eecb7829bc9981 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:45.950824  9233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c500a4c76ad3464aaa2f8985f7d3a53d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.950369  9249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6797c587fdc4754b091a2be102e5927" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d" is_pre_election: true
W20260709 13:02:45.950743  9288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33455, user_credentials={real_user=slave}} blocked reactor thread for 110623us
W20260709 13:02:45.952620  9139 leader_election.cc:343] T e6797c587fdc4754b091a2be102e5927 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:45.953543  9307 tablet_service.cc:1511] Processing CreateTablet for tablet 534ae119bf014235a99dfbbfcff690e1 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
W20260709 13:02:45.953814  9141 leader_election.cc:343] T e6797c587fdc4754b091a2be102e5927 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:45.954483  9141 leader_election.cc:304] T e6797c587fdc4754b091a2be102e5927 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c694531b0e1d47988b291f1214efc4cb; no voters: 65ed95869fbb4b69b5d6eb99c51adf85, 8846d581359a4b7ea6d4c33424ea825d
I20260709 13:02:45.955058  9307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 534ae119bf014235a99dfbbfcff690e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.953785  9305 tablet_service.cc:1511] Processing CreateTablet for tablet a581cc3c19254d4ca39e1f7328268a93 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:02:45.956923  9305 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a581cc3c19254d4ca39e1f7328268a93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.953902  9380 leader_election.cc:290] T e6797c587fdc4754b091a2be102e5927 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979), 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311)
I20260709 13:02:45.959230  9380 raft_consensus.cc:2749] T e6797c587fdc4754b091a2be102e5927 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:45.959880  9369 raft_consensus.cc:385] T 3ac2da3cd17d470495fd5fbb986e4936 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:45.960219  9369 raft_consensus.cc:740] T 3ac2da3cd17d470495fd5fbb986e4936 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8846d581359a4b7ea6d4c33424ea825d, State: Initialized, Role: FOLLOWER
I20260709 13:02:45.961027  9369 consensus_queue.cc:260] T 3ac2da3cd17d470495fd5fbb986e4936 P 8846d581359a4b7ea6d4c33424ea825d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:45.950793  9372 raft_consensus.cc:740] T a731a965126b406988eecb7829bc9981 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Initialized, Role: FOLLOWER
I20260709 13:02:45.963831  9372 consensus_queue.cc:260] T a731a965126b406988eecb7829bc9981 P 65ed95869fbb4b69b5d6eb99c51adf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:45.965903  9160 tablet_service.cc:1511] Processing CreateTablet for tablet c12e80bb348c4ba385ee6ebc8e55d71b (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:02:45.966703  9372 ts_tablet_manager.cc:1434] T a731a965126b406988eecb7829bc9981 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent starting tablet: real 0.144s	user 0.004s	sys 0.008s
I20260709 13:02:45.967273  9160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c12e80bb348c4ba385ee6ebc8e55d71b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.967969  9372 tablet_bootstrap.cc:492] T e6ee00de30e149f58789799810d595a4 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap starting.
I20260709 13:02:45.977515  9313 tablet_service.cc:1511] Processing CreateTablet for tablet e2fbc9c2c0a947f1b4a078db7c8402d0 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:02:45.978894  9313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2fbc9c2c0a947f1b4a078db7c8402d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.946381  9406 raft_consensus.cc:2804] T 6f8b7d72409f45eebf4208f98310f378 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:45.946213  9370 tablet_bootstrap.cc:492] T 6cb786213d5d48779533059bc333ac6f P 74ac2cf163ee475e8a280cb3aa738f57: No bootstrap required, opened a new log
I20260709 13:02:45.949329  9084 tablet_service.cc:1511] Processing CreateTablet for tablet c12e80bb348c4ba385ee6ebc8e55d71b (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:02:45.981562  9084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c12e80bb348c4ba385ee6ebc8e55d71b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.950340  9377 raft_consensus.cc:515] T b3f19df7d93748a1802678c56b5e2208 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:45.985251  9306 tablet_service.cc:1511] Processing CreateTablet for tablet 4d2b02247c21448ea824065ad29304e7 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:02:45.991583  9306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d2b02247c21448ea824065ad29304e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.991931  9233 tablet_service.cc:1511] Processing CreateTablet for tablet c12e80bb348c4ba385ee6ebc8e55d71b (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:02:45.993263  9233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c12e80bb348c4ba385ee6ebc8e55d71b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.989903  9370 ts_tablet_manager.cc:1403] T 6cb786213d5d48779533059bc333ac6f P 74ac2cf163ee475e8a280cb3aa738f57: Time spent bootstrapping tablet: real 0.340s	user 0.011s	sys 0.010s
I20260709 13:02:45.994758  9406 raft_consensus.cc:697] T 6f8b7d72409f45eebf4208f98310f378 P 8846d581359a4b7ea6d4c33424ea825d [term 1 LEADER]: Becoming Leader. State: Replica: 8846d581359a4b7ea6d4c33424ea825d, State: Running, Role: LEADER
I20260709 13:02:45.995714  9406 consensus_queue.cc:237] T 6f8b7d72409f45eebf4208f98310f378 P 8846d581359a4b7ea6d4c33424ea825d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:45.998142  9370 raft_consensus.cc:359] T 6cb786213d5d48779533059bc333ac6f P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:46.001534  9370 raft_consensus.cc:385] T 6cb786213d5d48779533059bc333ac6f P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:46.001855  9370 raft_consensus.cc:740] T 6cb786213d5d48779533059bc333ac6f P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74ac2cf163ee475e8a280cb3aa738f57, State: Initialized, Role: FOLLOWER
I20260709 13:02:46.002434  9250 raft_consensus.cc:2393] T b3f19df7d93748a1802678c56b5e2208 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74ac2cf163ee475e8a280cb3aa738f57 in current term 1: Already voted for candidate 8846d581359a4b7ea6d4c33424ea825d in this term.
I20260709 13:02:46.003871  9370 consensus_queue.cc:260] T 6cb786213d5d48779533059bc333ac6f P 74ac2cf163ee475e8a280cb3aa738f57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:46.004667  9287 leader_election.cc:304] T b3f19df7d93748a1802678c56b5e2208 P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57; no voters: 65ed95869fbb4b69b5d6eb99c51adf85, 8846d581359a4b7ea6d4c33424ea825d
I20260709 13:02:46.005985  9379 raft_consensus.cc:3060] T b3f19df7d93748a1802678c56b5e2208 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:46.006187  9370 ts_tablet_manager.cc:1434] T 6cb786213d5d48779533059bc333ac6f P 74ac2cf163ee475e8a280cb3aa738f57: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:02:46.008452  9082 tablet_service.cc:1511] Processing CreateTablet for tablet 18df0aeb35ec4bb095806227d9bb97a8 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:02:46.009804  9082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18df0aeb35ec4bb095806227d9bb97a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:46.009555  9157 tablet_service.cc:1511] Processing CreateTablet for tablet 18df0aeb35ec4bb095806227d9bb97a8 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:02:46.010998  9157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18df0aeb35ec4bb095806227d9bb97a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:46.013438  9371 tablet_bootstrap.cc:492] T 8bfbc32cc1ba4ecc8fddc7e7f4711778 P c694531b0e1d47988b291f1214efc4cb: No bootstrap required, opened a new log
I20260709 13:02:46.013990  9371 ts_tablet_manager.cc:1403] T 8bfbc32cc1ba4ecc8fddc7e7f4711778 P c694531b0e1d47988b291f1214efc4cb: Time spent bootstrapping tablet: real 0.191s	user 0.012s	sys 0.000s
I20260709 13:02:46.017323  9371 raft_consensus.cc:359] T 8bfbc32cc1ba4ecc8fddc7e7f4711778 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:46.018096  9371 raft_consensus.cc:385] T 8bfbc32cc1ba4ecc8fddc7e7f4711778 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:46.018386  9371 raft_consensus.cc:740] T 8bfbc32cc1ba4ecc8fddc7e7f4711778 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c694531b0e1d47988b291f1214efc4cb, State: Initialized, Role: FOLLOWER
I20260709 13:02:46.020159  9369 ts_tablet_manager.cc:1434] T 3ac2da3cd17d470495fd5fbb986e4936 P 8846d581359a4b7ea6d4c33424ea825d: Time spent starting tablet: real 0.086s	user 0.006s	sys 0.001s
I20260709 13:02:46.025624  9379 raft_consensus.cc:2749] T b3f19df7d93748a1802678c56b5e2208 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:46.035257  9308 tablet_service.cc:1511] Processing CreateTablet for tablet c500a4c76ad3464aaa2f8985f7d3a53d (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:02:46.040040  9369 tablet_bootstrap.cc:492] T 6cb786213d5d48779533059bc333ac6f P 8846d581359a4b7ea6d4c33424ea825d: Bootstrap starting.
I20260709 13:02:46.040748  9308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c500a4c76ad3464aaa2f8985f7d3a53d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:46.051748  9083 tablet_service.cc:1511] Processing CreateTablet for tablet ac928b0582c745b4804afcd30e861439 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:02:46.052964  9238 tablet_service.cc:1511] Processing CreateTablet for tablet ac928b0582c745b4804afcd30e861439 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:02:46.053912  9377 leader_election.cc:290] T b3f19df7d93748a1802678c56b5e2208 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 election: Requested vote from peers 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351), 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979)
I20260709 13:02:46.054251  9238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac928b0582c745b4804afcd30e861439. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:46.053316  9083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac928b0582c745b4804afcd30e861439. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:46.055085  9370 tablet_bootstrap.cc:492] T 8bfbc32cc1ba4ecc8fddc7e7f4711778 P 74ac2cf163ee475e8a280cb3aa738f57: Bootstrap starting.
I20260709 13:02:46.057862  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f19df7d93748a1802678c56b5e2208" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85"
W20260709 13:02:46.059571  9215 leader_election.cc:343] T b3f19df7d93748a1802678c56b5e2208 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:46.060928  9379 raft_consensus.cc:493] T 6cb786213d5d48779533059bc333ac6f P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.061473  9379 raft_consensus.cc:515] T 6cb786213d5d48779533059bc333ac6f P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:46.063752  9379 leader_election.cc:290] T 6cb786213d5d48779533059bc333ac6f P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455), 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311)
I20260709 13:02:46.047219  9371 consensus_queue.cc:260] T 8bfbc32cc1ba4ecc8fddc7e7f4711778 P c694531b0e1d47988b291f1214efc4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:46.068813  9313 tablet_service.cc:1511] Processing CreateTablet for tablet 18df0aeb35ec4bb095806227d9bb97a8 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:02:46.069272  9324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bfbc32cc1ba4ecc8fddc7e7f4711778" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57" is_pre_election: true
I20260709 13:02:46.046475  9369 tablet_bootstrap.cc:654] T 6cb786213d5d48779533059bc333ac6f P 8846d581359a4b7ea6d4c33424ea825d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:46.070192  9313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18df0aeb35ec4bb095806227d9bb97a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:46.069417  9310 tablet_service.cc:1511] Processing CreateTablet for tablet ac928b0582c745b4804afcd30e861439 (DEFAULT_TABLE table=test-workload [id=16e5588165804f6d906cbf1c0ad52a0b]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:02:46.080346  9310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac928b0582c745b4804afcd30e861439. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:46.083806  9176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb786213d5d48779533059bc333ac6f" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694531b0e1d47988b291f1214efc4cb" is_pre_election: true
W20260709 13:02:46.091104  9066 leader_election.cc:343] T 8bfbc32cc1ba4ecc8fddc7e7f4711778 P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:46.091741  9066 leader_election.cc:304] T 8bfbc32cc1ba4ecc8fddc7e7f4711778 P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65ed95869fbb4b69b5d6eb99c51adf85; no voters: 74ac2cf163ee475e8a280cb3aa738f57, c694531b0e1d47988b291f1214efc4cb
I20260709 13:02:46.092612  9378 raft_consensus.cc:2749] T 8bfbc32cc1ba4ecc8fddc7e7f4711778 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:46.098001  8999 catalog_manager.cc:5697] T 6f8b7d72409f45eebf4208f98310f378 P 8846d581359a4b7ea6d4c33424ea825d reported cstate change: term changed from 0 to 1, leader changed from <none> to 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195). New cstate: current_term: 1 leader_uuid: "8846d581359a4b7ea6d4c33424ea825d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:46.099838  9372 tablet_bootstrap.cc:654] T e6ee00de30e149f58789799810d595a4 P 65ed95869fbb4b69b5d6eb99c51adf85: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:46.071655  9377 raft_consensus.cc:493] T 3ac2da3cd17d470495fd5fbb986e4936 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.110756  9377 raft_consensus.cc:515] T 3ac2da3cd17d470495fd5fbb986e4936 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:46.113636  9377 leader_election.cc:290] T 3ac2da3cd17d470495fd5fbb986e4936 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455), 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351)
I20260709 13:02:46.114106  9176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac2da3cd17d470495fd5fbb986e4936" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694531b0e1d47988b291f1214efc4cb" is_pre_election: true
I20260709 13:02:46.115227  9371 ts_tablet_manager.cc:1434] T 8bfbc32cc1ba4ecc8fddc7e7f4711778 P c694531b0e1d47988b291f1214efc4cb: Time spent starting tablet: real 0.101s	user 0.006s	sys 0.003s
W20260709 13:02:46.115823  9214 leader_election.cc:343] T 3ac2da3cd17d470495fd5fbb986e4936 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:46.123138  9371 tablet_bootstrap.cc:492] T 6cb786213d5d48779533059bc333ac6f P c694531b0e1d47988b291f1214efc4cb: Bootstrap starting.
I20260709 13:02:46.137498  9370 tablet_bootstrap.cc:654] T 8bfbc32cc1ba4ecc8fddc7e7f4711778 P 74ac2cf163ee475e8a280cb3aa738f57: Neither blocks nor log segments found. Creating new log.
W20260709 13:02:46.140290  9288 leader_election.cc:343] T 6cb786213d5d48779533059bc333ac6f P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:46.141966  9378 raft_consensus.cc:493] T a731a965126b406988eecb7829bc9981 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.142510  9378 raft_consensus.cc:515] T a731a965126b406988eecb7829bc9981 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:46.146798  9371 tablet_bootstrap.cc:654] T 6cb786213d5d48779533059bc333ac6f P c694531b0e1d47988b291f1214efc4cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:46.144824  9378 leader_election.cc:290] T a731a965126b406988eecb7829bc9981 P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311), 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351)
I20260709 13:02:46.149398  9250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a731a965126b406988eecb7829bc9981" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d" is_pre_election: true
I20260709 13:02:46.150007  9324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a731a965126b406988eecb7829bc9981" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57" is_pre_election: true
W20260709 13:02:46.151252  9064 leader_election.cc:343] T a731a965126b406988eecb7829bc9981 P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:46.151461  9141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33979, user_credentials={real_user=slave}} blocked reactor thread for 197595us
I20260709 13:02:46.151937  9372 tablet_bootstrap.cc:492] T e6ee00de30e149f58789799810d595a4 P 65ed95869fbb4b69b5d6eb99c51adf85: No bootstrap required, opened a new log
W20260709 13:02:46.151889  9066 leader_election.cc:343] T a731a965126b406988eecb7829bc9981 P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:46.152645  9372 ts_tablet_manager.cc:1403] T e6ee00de30e149f58789799810d595a4 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent bootstrapping tablet: real 0.185s	user 0.014s	sys 0.010s
I20260709 13:02:46.152554  9066 leader_election.cc:304] T a731a965126b406988eecb7829bc9981 P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65ed95869fbb4b69b5d6eb99c51adf85; no voters: 74ac2cf163ee475e8a280cb3aa738f57, 8846d581359a4b7ea6d4c33424ea825d
I20260709 13:02:46.153252  9369 tablet_bootstrap.cc:492] T 6cb786213d5d48779533059bc333ac6f P 8846d581359a4b7ea6d4c33424ea825d: No bootstrap required, opened a new log
W20260709 13:02:46.153362  9287 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45311, user_credentials={real_user=slave}} blocked reactor thread for 148846us
I20260709 13:02:46.153851  9369 ts_tablet_manager.cc:1403] T 6cb786213d5d48779533059bc333ac6f P 8846d581359a4b7ea6d4c33424ea825d: Time spent bootstrapping tablet: real 0.114s	user 0.017s	sys 0.014s
I20260709 13:02:46.155344  9250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb786213d5d48779533059bc333ac6f" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d" is_pre_election: true
I20260709 13:02:46.155273  9370 tablet_bootstrap.cc:492] T 8bfbc32cc1ba4ecc8fddc7e7f4711778 P 74ac2cf163ee475e8a280cb3aa738f57: No bootstrap required, opened a new log
I20260709 13:02:46.155809  9372 raft_consensus.cc:359] T e6ee00de30e149f58789799810d595a4 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:46.156394  9370 ts_tablet_manager.cc:1403] T 8bfbc32cc1ba4ecc8fddc7e7f4711778 P 74ac2cf163ee475e8a280cb3aa738f57: Time spent bootstrapping tablet: real 0.102s	user 0.013s	sys 0.000s
I20260709 13:02:46.156739  9372 raft_consensus.cc:385] T e6ee00de30e149f58789799810d595a4 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:46.157074  9372 raft_consensus.cc:740] T e6ee00de30e149f58789799810d595a4 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Initialized, Role: FOLLOWER
I20260709 13:02:46.157009  9369 raft_consensus.cc:359] T 6cb786213d5d48779533059bc333ac6f P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:46.155592  9378 raft_consensus.cc:2749] T a731a965126b406988eecb7829bc9981 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:46.158107  9369 raft_consensus.cc:385] T 6cb786213d5d48779533059bc333ac6f P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:46.158527  9369 raft_consensus.cc:740] T 6cb786213d5d48779533059bc333ac6f P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8846d581359a4b7ea6d4c33424ea825d, State: Initialized, Role: FOLLOWER
W20260709 13:02:46.159439  9287 leader_election.cc:343] T 6cb786213d5d48779533059bc333ac6f P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:46.159680  9323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac2da3cd17d470495fd5fbb986e4936" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57" is_pre_election: true
I20260709 13:02:46.158115  9372 consensus_queue.cc:260] T e6ee00de30e149f58789799810d595a4 P 65ed95869fbb4b69b5d6eb99c51adf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:46.159842  9324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f19df7d93748a1802678c56b5e2208" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57"
I20260709 13:02:46.159466  9370 raft_consensus.cc:359] T 8bfbc32cc1ba4ecc8fddc7e7f4711778 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:46.163025  9370 raft_consensus.cc:385] T 8bfbc32cc1ba4ecc8fddc7e7f4711778 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:46.165468  9370 raft_consensus.cc:740] T 8bfbc32cc1ba4ecc8fddc7e7f4711778 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74ac2cf163ee475e8a280cb3aa738f57, State: Initialized, Role: FOLLOWER
I20260709 13:02:46.166327  9370 consensus_queue.cc:260] T 8bfbc32cc1ba4ecc8fddc7e7f4711778 P 74ac2cf163ee475e8a280cb3aa738f57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:46.168802  9370 ts_tablet_manager.cc:1434] T 8bfbc32cc1ba4ecc8fddc7e7f4711778 P 74ac2cf163ee475e8a280cb3aa738f57: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:02:46.169983  9370 tablet_bootstrap.cc:492] T 51a2ca964a8f4fb89b26d77b1b334f30 P 74ac2cf163ee475e8a280cb3aa738f57: Bootstrap starting.
I20260709 13:02:46.170295  9324 raft_consensus.cc:2468] T b3f19df7d93748a1802678c56b5e2208 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8846d581359a4b7ea6d4c33424ea825d in term 1.
I20260709 13:02:46.165153  9371 tablet_bootstrap.cc:492] T 6cb786213d5d48779533059bc333ac6f P c694531b0e1d47988b291f1214efc4cb: No bootstrap required, opened a new log
I20260709 13:02:46.160378  9369 consensus_queue.cc:260] T 6cb786213d5d48779533059bc333ac6f P 8846d581359a4b7ea6d4c33424ea825d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:46.171247  9371 ts_tablet_manager.cc:1403] T 6cb786213d5d48779533059bc333ac6f P c694531b0e1d47988b291f1214efc4cb: Time spent bootstrapping tablet: real 0.048s	user 0.013s	sys 0.000s
I20260709 13:02:46.161907  9287 leader_election.cc:304] T 6cb786213d5d48779533059bc333ac6f P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57; no voters: 8846d581359a4b7ea6d4c33424ea825d, c694531b0e1d47988b291f1214efc4cb
I20260709 13:02:46.163542  9372 ts_tablet_manager.cc:1434] T e6ee00de30e149f58789799810d595a4 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.001s
I20260709 13:02:46.173153  9412 raft_consensus.cc:2749] T 6cb786213d5d48779533059bc333ac6f P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:46.173696  9369 ts_tablet_manager.cc:1434] T 6cb786213d5d48779533059bc333ac6f P 8846d581359a4b7ea6d4c33424ea825d: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 13:02:46.175117  9408 raft_consensus.cc:493] T 8bfbc32cc1ba4ecc8fddc7e7f4711778 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.175642  9408 raft_consensus.cc:515] T 8bfbc32cc1ba4ecc8fddc7e7f4711778 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:46.173614  9372 tablet_bootstrap.cc:492] T 51a2ca964a8f4fb89b26d77b1b334f30 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap starting.
W20260709 13:02:46.176481  9215 leader_election.cc:343] T 3ac2da3cd17d470495fd5fbb986e4936 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:46.176676  9371 raft_consensus.cc:359] T 6cb786213d5d48779533059bc333ac6f P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:46.177461  9371 raft_consensus.cc:385] T 6cb786213d5d48779533059bc333ac6f P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:46.177747  9371 raft_consensus.cc:740] T 6cb786213d5d48779533059bc333ac6f P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c694531b0e1d47988b291f1214efc4cb, State: Initialized, Role: FOLLOWER
I20260709 13:02:46.177872  9215 leader_election.cc:304] T 3ac2da3cd17d470495fd5fbb986e4936 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8846d581359a4b7ea6d4c33424ea825d; no voters: 74ac2cf163ee475e8a280cb3aa738f57, c694531b0e1d47988b291f1214efc4cb
I20260709 13:02:46.178598  9371 consensus_queue.cc:260] T 6cb786213d5d48779533059bc333ac6f P c694531b0e1d47988b291f1214efc4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:46.179179  9377 raft_consensus.cc:2749] T 3ac2da3cd17d470495fd5fbb986e4936 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:46.178164  9408 leader_election.cc:290] T 8bfbc32cc1ba4ecc8fddc7e7f4711778 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351), 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979)
I20260709 13:02:46.181015  9371 ts_tablet_manager.cc:1434] T 6cb786213d5d48779533059bc333ac6f P c694531b0e1d47988b291f1214efc4cb: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:02:46.181824  9215 leader_election.cc:304] T b3f19df7d93748a1802678c56b5e2208 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57, 8846d581359a4b7ea6d4c33424ea825d; no voters: 65ed95869fbb4b69b5d6eb99c51adf85
I20260709 13:02:46.182415  9371 tablet_bootstrap.cc:492] T 6f8b7d72409f45eebf4208f98310f378 P c694531b0e1d47988b291f1214efc4cb: Bootstrap starting.
I20260709 13:02:46.183120  9377 raft_consensus.cc:2804] T b3f19df7d93748a1802678c56b5e2208 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:46.183640  9377 raft_consensus.cc:697] T b3f19df7d93748a1802678c56b5e2208 P 8846d581359a4b7ea6d4c33424ea825d [term 1 LEADER]: Becoming Leader. State: Replica: 8846d581359a4b7ea6d4c33424ea825d, State: Running, Role: LEADER
I20260709 13:02:46.174760  9369 tablet_bootstrap.cc:492] T e6ee00de30e149f58789799810d595a4 P 8846d581359a4b7ea6d4c33424ea825d: Bootstrap starting.
I20260709 13:02:46.184512  9377 consensus_queue.cc:237] T b3f19df7d93748a1802678c56b5e2208 P 8846d581359a4b7ea6d4c33424ea825d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:46.190011  9372 tablet_bootstrap.cc:654] T 51a2ca964a8f4fb89b26d77b1b334f30 P 65ed95869fbb4b69b5d6eb99c51adf85: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:46.190316  9371 tablet_bootstrap.cc:654] T 6f8b7d72409f45eebf4208f98310f378 P c694531b0e1d47988b291f1214efc4cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:46.192550  9370 tablet_bootstrap.cc:654] T 51a2ca964a8f4fb89b26d77b1b334f30 P 74ac2cf163ee475e8a280cb3aa738f57: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:46.195701  9406 raft_consensus.cc:493] T 6cb786213d5d48779533059bc333ac6f P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.196285  9406 raft_consensus.cc:515] T 6cb786213d5d48779533059bc333ac6f P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:46.199631  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bfbc32cc1ba4ecc8fddc7e7f4711778" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" is_pre_election: true
I20260709 13:02:46.200471  9100 raft_consensus.cc:2468] T 8bfbc32cc1ba4ecc8fddc7e7f4711778 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c694531b0e1d47988b291f1214efc4cb in term 0.
I20260709 13:02:46.201725  9406 leader_election.cc:290] T 6cb786213d5d48779533059bc333ac6f P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455), 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351)
I20260709 13:02:46.202031  9141 leader_election.cc:304] T 8bfbc32cc1ba4ecc8fddc7e7f4711778 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65ed95869fbb4b69b5d6eb99c51adf85, c694531b0e1d47988b291f1214efc4cb; no voters: 
I20260709 13:02:46.203109  9408 raft_consensus.cc:2804] T 8bfbc32cc1ba4ecc8fddc7e7f4711778 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:46.203577  9408 raft_consensus.cc:493] T 8bfbc32cc1ba4ecc8fddc7e7f4711778 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:46.204144  9408 raft_consensus.cc:3060] T 8bfbc32cc1ba4ecc8fddc7e7f4711778 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:46.203897  9176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb786213d5d48779533059bc333ac6f" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694531b0e1d47988b291f1214efc4cb" is_pre_election: true
I20260709 13:02:46.205156  9176 raft_consensus.cc:2468] T 6cb786213d5d48779533059bc333ac6f P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8846d581359a4b7ea6d4c33424ea825d in term 0.
I20260709 13:02:46.208225  9214 leader_election.cc:304] T 6cb786213d5d48779533059bc333ac6f P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8846d581359a4b7ea6d4c33424ea825d, c694531b0e1d47988b291f1214efc4cb; no voters: 
I20260709 13:02:46.209471  9324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb786213d5d48779533059bc333ac6f" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57" is_pre_election: true
I20260709 13:02:46.210187  9324 raft_consensus.cc:2468] T 6cb786213d5d48779533059bc333ac6f P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8846d581359a4b7ea6d4c33424ea825d in term 0.
I20260709 13:02:46.213243  9406 raft_consensus.cc:2804] T 6cb786213d5d48779533059bc333ac6f P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:46.216946  9406 raft_consensus.cc:493] T 6cb786213d5d48779533059bc333ac6f P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:46.217555  9406 raft_consensus.cc:3060] T 6cb786213d5d48779533059bc333ac6f P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:46.220676  9372 tablet_bootstrap.cc:492] T 51a2ca964a8f4fb89b26d77b1b334f30 P 65ed95869fbb4b69b5d6eb99c51adf85: No bootstrap required, opened a new log
I20260709 13:02:46.221292  9372 ts_tablet_manager.cc:1403] T 51a2ca964a8f4fb89b26d77b1b334f30 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent bootstrapping tablet: real 0.048s	user 0.010s	sys 0.001s
I20260709 13:02:46.220698  9369 tablet_bootstrap.cc:654] T e6ee00de30e149f58789799810d595a4 P 8846d581359a4b7ea6d4c33424ea825d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:46.213827  9408 raft_consensus.cc:515] T 8bfbc32cc1ba4ecc8fddc7e7f4711778 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:46.226634  9372 raft_consensus.cc:359] T 51a2ca964a8f4fb89b26d77b1b334f30 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:46.227460  9372 raft_consensus.cc:385] T 51a2ca964a8f4fb89b26d77b1b334f30 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:46.227766  9372 raft_consensus.cc:740] T 51a2ca964a8f4fb89b26d77b1b334f30 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Initialized, Role: FOLLOWER
I20260709 13:02:46.228586  9372 consensus_queue.cc:260] T 51a2ca964a8f4fb89b26d77b1b334f30 P 65ed95869fbb4b69b5d6eb99c51adf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:46.231842  9408 leader_election.cc:290] T 8bfbc32cc1ba4ecc8fddc7e7f4711778 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 election: Requested vote from peers 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351), 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979)
I20260709 13:02:46.233189  9412 raft_consensus.cc:493] T 8bfbc32cc1ba4ecc8fddc7e7f4711778 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.233372  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bfbc32cc1ba4ecc8fddc7e7f4711778" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85"
I20260709 13:02:46.234025  9100 raft_consensus.cc:3060] T 8bfbc32cc1ba4ecc8fddc7e7f4711778 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:46.233807  9412 raft_consensus.cc:515] T 8bfbc32cc1ba4ecc8fddc7e7f4711778 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:46.236630  9412 leader_election.cc:290] T 8bfbc32cc1ba4ecc8fddc7e7f4711778 P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979), c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455)
I20260709 13:02:46.237115  9406 raft_consensus.cc:515] T 6cb786213d5d48779533059bc333ac6f P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:46.238284  9176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bfbc32cc1ba4ecc8fddc7e7f4711778" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694531b0e1d47988b291f1214efc4cb" is_pre_election: true
I20260709 13:02:46.239151  9176 raft_consensus.cc:2393] T 8bfbc32cc1ba4ecc8fddc7e7f4711778 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74ac2cf163ee475e8a280cb3aa738f57 in current term 1: Already voted for candidate c694531b0e1d47988b291f1214efc4cb in this term.
I20260709 13:02:46.239753  9371 tablet_bootstrap.cc:492] T 6f8b7d72409f45eebf4208f98310f378 P c694531b0e1d47988b291f1214efc4cb: No bootstrap required, opened a new log
I20260709 13:02:46.239919  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bfbc32cc1ba4ecc8fddc7e7f4711778" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" is_pre_election: true
I20260709 13:02:46.240425  9371 ts_tablet_manager.cc:1403] T 6f8b7d72409f45eebf4208f98310f378 P c694531b0e1d47988b291f1214efc4cb: Time spent bootstrapping tablet: real 0.058s	user 0.014s	sys 0.008s
I20260709 13:02:46.241662  9289 leader_election.cc:304] T 8bfbc32cc1ba4ecc8fddc7e7f4711778 P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57; no voters: 65ed95869fbb4b69b5d6eb99c51adf85, c694531b0e1d47988b291f1214efc4cb
I20260709 13:02:46.242601  9370 tablet_bootstrap.cc:492] T 51a2ca964a8f4fb89b26d77b1b334f30 P 74ac2cf163ee475e8a280cb3aa738f57: No bootstrap required, opened a new log
I20260709 13:02:46.242972  9412 raft_consensus.cc:3060] T 8bfbc32cc1ba4ecc8fddc7e7f4711778 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:46.243160  9370 ts_tablet_manager.cc:1403] T 51a2ca964a8f4fb89b26d77b1b334f30 P 74ac2cf163ee475e8a280cb3aa738f57: Time spent bootstrapping tablet: real 0.073s	user 0.010s	sys 0.007s
I20260709 13:02:46.243525  9371 raft_consensus.cc:359] T 6f8b7d72409f45eebf4208f98310f378 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:46.244289  9371 raft_consensus.cc:385] T 6f8b7d72409f45eebf4208f98310f378 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:46.244597  9371 raft_consensus.cc:740] T 6f8b7d72409f45eebf4208f98310f378 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c694531b0e1d47988b291f1214efc4cb, State: Initialized, Role: FOLLOWER
I20260709 13:02:46.245533  9371 consensus_queue.cc:260] T 6f8b7d72409f45eebf4208f98310f378 P c694531b0e1d47988b291f1214efc4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:46.246335  9370 raft_consensus.cc:359] T 51a2ca964a8f4fb89b26d77b1b334f30 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:46.247108  9370 raft_consensus.cc:385] T 51a2ca964a8f4fb89b26d77b1b334f30 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:46.247407  9370 raft_consensus.cc:740] T 51a2ca964a8f4fb89b26d77b1b334f30 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74ac2cf163ee475e8a280cb3aa738f57, State: Initialized, Role: FOLLOWER
I20260709 13:02:46.248176  9370 consensus_queue.cc:260] T 51a2ca964a8f4fb89b26d77b1b334f30 P 74ac2cf163ee475e8a280cb3aa738f57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:46.251049  9371 ts_tablet_manager.cc:1434] T 6f8b7d72409f45eebf4208f98310f378 P c694531b0e1d47988b291f1214efc4cb: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:02:46.252182  9371 tablet_bootstrap.cc:492] T eb666e221e5f4e4fbaba194838a28448 P c694531b0e1d47988b291f1214efc4cb: Bootstrap starting.
I20260709 13:02:46.252795  9100 raft_consensus.cc:2468] T 8bfbc32cc1ba4ecc8fddc7e7f4711778 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c694531b0e1d47988b291f1214efc4cb in term 1.
I20260709 13:02:46.255728  9141 leader_election.cc:304] T 8bfbc32cc1ba4ecc8fddc7e7f4711778 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65ed95869fbb4b69b5d6eb99c51adf85, c694531b0e1d47988b291f1214efc4cb; no voters: 
I20260709 13:02:46.256819  9408 raft_consensus.cc:2804] T 8bfbc32cc1ba4ecc8fddc7e7f4711778 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:46.257457  9408 raft_consensus.cc:697] T 8bfbc32cc1ba4ecc8fddc7e7f4711778 P c694531b0e1d47988b291f1214efc4cb [term 1 LEADER]: Becoming Leader. State: Replica: c694531b0e1d47988b291f1214efc4cb, State: Running, Role: LEADER
I20260709 13:02:46.257987  9372 ts_tablet_manager.cc:1434] T 51a2ca964a8f4fb89b26d77b1b334f30 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent starting tablet: real 0.036s	user 0.009s	sys 0.001s
I20260709 13:02:46.259215  9372 tablet_bootstrap.cc:492] T eb666e221e5f4e4fbaba194838a28448 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap starting.
I20260709 13:02:46.258311  9408 consensus_queue.cc:237] T 8bfbc32cc1ba4ecc8fddc7e7f4711778 P c694531b0e1d47988b291f1214efc4cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:46.256703  9370 ts_tablet_manager.cc:1434] T 51a2ca964a8f4fb89b26d77b1b334f30 P 74ac2cf163ee475e8a280cb3aa738f57: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 13:02:46.261677  9370 tablet_bootstrap.cc:492] T 5cea8a8078e8456186d4d1a184d3f157 P 74ac2cf163ee475e8a280cb3aa738f57: Bootstrap starting.
I20260709 13:02:46.265515  9323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bfbc32cc1ba4ecc8fddc7e7f4711778" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57"
I20260709 13:02:46.266342  9372 tablet_bootstrap.cc:654] T eb666e221e5f4e4fbaba194838a28448 P 65ed95869fbb4b69b5d6eb99c51adf85: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:46.266597  9324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bfbc32cc1ba4ecc8fddc7e7f4711778" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57" is_pre_election: true
I20260709 13:02:46.268496  9370 tablet_bootstrap.cc:654] T 5cea8a8078e8456186d4d1a184d3f157 P 74ac2cf163ee475e8a280cb3aa738f57: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:46.270572  9371 tablet_bootstrap.cc:654] T eb666e221e5f4e4fbaba194838a28448 P c694531b0e1d47988b291f1214efc4cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:46.272327  8997 catalog_manager.cc:5697] T b3f19df7d93748a1802678c56b5e2208 P 8846d581359a4b7ea6d4c33424ea825d reported cstate change: term changed from 0 to 1, leader changed from <none> to 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195). New cstate: current_term: 1 leader_uuid: "8846d581359a4b7ea6d4c33424ea825d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:46.275123  9406 leader_election.cc:290] T 6cb786213d5d48779533059bc333ac6f P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 election: Requested vote from peers c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455), 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351)
I20260709 13:02:46.275261  9412 raft_consensus.cc:2749] T 8bfbc32cc1ba4ecc8fddc7e7f4711778 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:46.276068  9176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb786213d5d48779533059bc333ac6f" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694531b0e1d47988b291f1214efc4cb"
I20260709 13:02:46.279789  9176 raft_consensus.cc:3060] T 6cb786213d5d48779533059bc333ac6f P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:46.283032  9370 tablet_bootstrap.cc:492] T 5cea8a8078e8456186d4d1a184d3f157 P 74ac2cf163ee475e8a280cb3aa738f57: No bootstrap required, opened a new log
I20260709 13:02:46.283653  9370 ts_tablet_manager.cc:1403] T 5cea8a8078e8456186d4d1a184d3f157 P 74ac2cf163ee475e8a280cb3aa738f57: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.000s
I20260709 13:02:46.276804  9324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb786213d5d48779533059bc333ac6f" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57"
I20260709 13:02:46.285471  9324 raft_consensus.cc:3060] T 6cb786213d5d48779533059bc333ac6f P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:46.278137  9372 tablet_bootstrap.cc:492] T eb666e221e5f4e4fbaba194838a28448 P 65ed95869fbb4b69b5d6eb99c51adf85: No bootstrap required, opened a new log
I20260709 13:02:46.287066  9372 ts_tablet_manager.cc:1403] T eb666e221e5f4e4fbaba194838a28448 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent bootstrapping tablet: real 0.028s	user 0.012s	sys 0.001s
I20260709 13:02:46.287217  9323 raft_consensus.cc:2468] T 8bfbc32cc1ba4ecc8fddc7e7f4711778 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c694531b0e1d47988b291f1214efc4cb in term 1.
I20260709 13:02:46.286695  9370 raft_consensus.cc:359] T 5cea8a8078e8456186d4d1a184d3f157 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:46.291474  9370 raft_consensus.cc:385] T 5cea8a8078e8456186d4d1a184d3f157 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:46.291833  9370 raft_consensus.cc:740] T 5cea8a8078e8456186d4d1a184d3f157 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74ac2cf163ee475e8a280cb3aa738f57, State: Initialized, Role: FOLLOWER
I20260709 13:02:46.292729  9324 raft_consensus.cc:2468] T 6cb786213d5d48779533059bc333ac6f P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8846d581359a4b7ea6d4c33424ea825d in term 1.
I20260709 13:02:46.294143  9215 leader_election.cc:304] T 6cb786213d5d48779533059bc333ac6f P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57, 8846d581359a4b7ea6d4c33424ea825d; no voters: 
I20260709 13:02:46.294023  9370 consensus_queue.cc:260] T 5cea8a8078e8456186d4d1a184d3f157 P 74ac2cf163ee475e8a280cb3aa738f57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:46.295765  9406 raft_consensus.cc:2804] T 6cb786213d5d48779533059bc333ac6f P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:46.296656  9406 raft_consensus.cc:697] T 6cb786213d5d48779533059bc333ac6f P 8846d581359a4b7ea6d4c33424ea825d [term 1 LEADER]: Becoming Leader. State: Replica: 8846d581359a4b7ea6d4c33424ea825d, State: Running, Role: LEADER
I20260709 13:02:46.290361  9372 raft_consensus.cc:359] T eb666e221e5f4e4fbaba194838a28448 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:46.297534  9406 consensus_queue.cc:237] T 6cb786213d5d48779533059bc333ac6f P 8846d581359a4b7ea6d4c33424ea825d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:46.299119  9372 raft_consensus.cc:385] T eb666e221e5f4e4fbaba194838a28448 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:46.299630  9372 raft_consensus.cc:740] T eb666e221e5f4e4fbaba194838a28448 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Initialized, Role: FOLLOWER
I20260709 13:02:46.300057  9176 raft_consensus.cc:2468] T 6cb786213d5d48779533059bc333ac6f P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8846d581359a4b7ea6d4c33424ea825d in term 1.
I20260709 13:02:46.300657  9372 consensus_queue.cc:260] T eb666e221e5f4e4fbaba194838a28448 P 65ed95869fbb4b69b5d6eb99c51adf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:46.301687  9369 tablet_bootstrap.cc:492] T e6ee00de30e149f58789799810d595a4 P 8846d581359a4b7ea6d4c33424ea825d: No bootstrap required, opened a new log
I20260709 13:02:46.302287  9369 ts_tablet_manager.cc:1403] T e6ee00de30e149f58789799810d595a4 P 8846d581359a4b7ea6d4c33424ea825d: Time spent bootstrapping tablet: real 0.128s	user 0.021s	sys 0.007s
I20260709 13:02:46.303718  9372 ts_tablet_manager.cc:1434] T eb666e221e5f4e4fbaba194838a28448 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:02:46.304883  9372 tablet_bootstrap.cc:492] T b3f19df7d93748a1802678c56b5e2208 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap starting.
I20260709 13:02:46.297765  9370 ts_tablet_manager.cc:1434] T 5cea8a8078e8456186d4d1a184d3f157 P 74ac2cf163ee475e8a280cb3aa738f57: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:02:46.305581  9369 raft_consensus.cc:359] T e6ee00de30e149f58789799810d595a4 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:46.306871  9369 raft_consensus.cc:385] T e6ee00de30e149f58789799810d595a4 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:46.307149  9370 tablet_bootstrap.cc:492] T 5f076a85481e43d7a969bf5d8bb589dd P 74ac2cf163ee475e8a280cb3aa738f57: Bootstrap starting.
I20260709 13:02:46.307195  9369 raft_consensus.cc:740] T e6ee00de30e149f58789799810d595a4 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8846d581359a4b7ea6d4c33424ea825d, State: Initialized, Role: FOLLOWER
I20260709 13:02:46.309206  9369 consensus_queue.cc:260] T e6ee00de30e149f58789799810d595a4 P 8846d581359a4b7ea6d4c33424ea825d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:46.312647  9372 tablet_bootstrap.cc:654] T b3f19df7d93748a1802678c56b5e2208 P 65ed95869fbb4b69b5d6eb99c51adf85: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:46.312738  9369 ts_tablet_manager.cc:1434] T e6ee00de30e149f58789799810d595a4 P 8846d581359a4b7ea6d4c33424ea825d: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.002s
I20260709 13:02:46.312975  8998 catalog_manager.cc:5697] T 8bfbc32cc1ba4ecc8fddc7e7f4711778 P c694531b0e1d47988b291f1214efc4cb reported cstate change: term changed from 0 to 1, leader changed from <none> to c694531b0e1d47988b291f1214efc4cb (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c694531b0e1d47988b291f1214efc4cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:46.314076  9369 tablet_bootstrap.cc:492] T a731a965126b406988eecb7829bc9981 P 8846d581359a4b7ea6d4c33424ea825d: Bootstrap starting.
I20260709 13:02:46.324394  9370 tablet_bootstrap.cc:654] T 5f076a85481e43d7a969bf5d8bb589dd P 74ac2cf163ee475e8a280cb3aa738f57: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:46.330394  9369 tablet_bootstrap.cc:654] T a731a965126b406988eecb7829bc9981 P 8846d581359a4b7ea6d4c33424ea825d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:46.332623  9371 tablet_bootstrap.cc:492] T eb666e221e5f4e4fbaba194838a28448 P c694531b0e1d47988b291f1214efc4cb: No bootstrap required, opened a new log
I20260709 13:02:46.338343  9371 ts_tablet_manager.cc:1403] T eb666e221e5f4e4fbaba194838a28448 P c694531b0e1d47988b291f1214efc4cb: Time spent bootstrapping tablet: real 0.086s	user 0.006s	sys 0.008s
I20260709 13:02:46.339207  9412 raft_consensus.cc:493] T 5cea8a8078e8456186d4d1a184d3f157 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.339864  9372 tablet_bootstrap.cc:492] T b3f19df7d93748a1802678c56b5e2208 P 65ed95869fbb4b69b5d6eb99c51adf85: No bootstrap required, opened a new log
I20260709 13:02:46.339843  9412 raft_consensus.cc:515] T 5cea8a8078e8456186d4d1a184d3f157 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:46.340673  9372 ts_tablet_manager.cc:1403] T b3f19df7d93748a1802678c56b5e2208 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent bootstrapping tablet: real 0.036s	user 0.018s	sys 0.017s
I20260709 13:02:46.343091  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cea8a8078e8456186d4d1a184d3f157" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" is_pre_election: true
I20260709 13:02:46.344161  9176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cea8a8078e8456186d4d1a184d3f157" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694531b0e1d47988b291f1214efc4cb" is_pre_election: true
I20260709 13:02:46.335968  9370 tablet_bootstrap.cc:492] T 5f076a85481e43d7a969bf5d8bb589dd P 74ac2cf163ee475e8a280cb3aa738f57: No bootstrap required, opened a new log
W20260709 13:02:46.344712  9289 leader_election.cc:343] T 5cea8a8078e8456186d4d1a184d3f157 P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:46.345216  9370 ts_tablet_manager.cc:1403] T 5f076a85481e43d7a969bf5d8bb589dd P 74ac2cf163ee475e8a280cb3aa738f57: Time spent bootstrapping tablet: real 0.038s	user 0.012s	sys 0.007s
W20260709 13:02:46.345955  9288 leader_election.cc:343] T 5cea8a8078e8456186d4d1a184d3f157 P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:46.346501  9288 leader_election.cc:304] T 5cea8a8078e8456186d4d1a184d3f157 P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57; no voters: 65ed95869fbb4b69b5d6eb99c51adf85, c694531b0e1d47988b291f1214efc4cb
I20260709 13:02:46.344030  9372 raft_consensus.cc:359] T b3f19df7d93748a1802678c56b5e2208 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:46.347483  9379 raft_consensus.cc:2749] T 5cea8a8078e8456186d4d1a184d3f157 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:46.347538  9372 raft_consensus.cc:385] T b3f19df7d93748a1802678c56b5e2208 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:46.348277  9372 raft_consensus.cc:740] T b3f19df7d93748a1802678c56b5e2208 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Initialized, Role: FOLLOWER
I20260709 13:02:46.348584  9412 leader_election.cc:290] T 5cea8a8078e8456186d4d1a184d3f157 P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979), c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455)
I20260709 13:02:46.348417  9370 raft_consensus.cc:359] T 5f076a85481e43d7a969bf5d8bb589dd P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:46.349215  9370 raft_consensus.cc:385] T 5f076a85481e43d7a969bf5d8bb589dd P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:46.329946  8997 catalog_manager.cc:5697] T 6cb786213d5d48779533059bc333ac6f P 8846d581359a4b7ea6d4c33424ea825d reported cstate change: term changed from 0 to 1, leader changed from <none> to 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195). New cstate: current_term: 1 leader_uuid: "8846d581359a4b7ea6d4c33424ea825d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:46.349571  9370 raft_consensus.cc:740] T 5f076a85481e43d7a969bf5d8bb589dd P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74ac2cf163ee475e8a280cb3aa738f57, State: Initialized, Role: FOLLOWER
I20260709 13:02:46.349395  9372 consensus_queue.cc:260] T b3f19df7d93748a1802678c56b5e2208 P 65ed95869fbb4b69b5d6eb99c51adf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:46.350581  9370 consensus_queue.cc:260] T 5f076a85481e43d7a969bf5d8bb589dd P 74ac2cf163ee475e8a280cb3aa738f57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:46.353260  9370 ts_tablet_manager.cc:1434] T 5f076a85481e43d7a969bf5d8bb589dd P 74ac2cf163ee475e8a280cb3aa738f57: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:02:46.354583  9370 tablet_bootstrap.cc:492] T a731a965126b406988eecb7829bc9981 P 74ac2cf163ee475e8a280cb3aa738f57: Bootstrap starting.
I20260709 13:02:46.360304  9372 ts_tablet_manager.cc:1434] T b3f19df7d93748a1802678c56b5e2208 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.001s
I20260709 13:02:46.361608  9372 tablet_bootstrap.cc:492] T e6797c587fdc4754b091a2be102e5927 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap starting.
I20260709 13:02:46.365720  9412 raft_consensus.cc:493] T 5f076a85481e43d7a969bf5d8bb589dd P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.366312  9412 raft_consensus.cc:515] T 5f076a85481e43d7a969bf5d8bb589dd P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:46.350793  9371 raft_consensus.cc:359] T eb666e221e5f4e4fbaba194838a28448 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:46.370009  9371 raft_consensus.cc:385] T eb666e221e5f4e4fbaba194838a28448 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:46.370513  9371 raft_consensus.cc:740] T eb666e221e5f4e4fbaba194838a28448 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c694531b0e1d47988b291f1214efc4cb, State: Initialized, Role: FOLLOWER
I20260709 13:02:46.371833  9176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f076a85481e43d7a969bf5d8bb589dd" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694531b0e1d47988b291f1214efc4cb" is_pre_election: true
W20260709 13:02:46.373374  9288 leader_election.cc:343] T 5f076a85481e43d7a969bf5d8bb589dd P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:46.374507  9371 consensus_queue.cc:260] T eb666e221e5f4e4fbaba194838a28448 P c694531b0e1d47988b291f1214efc4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:46.375669  9250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f076a85481e43d7a969bf5d8bb589dd" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d" is_pre_election: true
I20260709 13:02:46.378335  9370 tablet_bootstrap.cc:654] T a731a965126b406988eecb7829bc9981 P 74ac2cf163ee475e8a280cb3aa738f57: Neither blocks nor log segments found. Creating new log.
W20260709 13:02:46.380401  9287 leader_election.cc:343] T 5f076a85481e43d7a969bf5d8bb589dd P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:46.380565  9371 ts_tablet_manager.cc:1434] T eb666e221e5f4e4fbaba194838a28448 P c694531b0e1d47988b291f1214efc4cb: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.000s
I20260709 13:02:46.380960  9287 leader_election.cc:304] T 5f076a85481e43d7a969bf5d8bb589dd P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57; no voters: 8846d581359a4b7ea6d4c33424ea825d, c694531b0e1d47988b291f1214efc4cb
I20260709 13:02:46.382031  9379 raft_consensus.cc:2749] T 5f076a85481e43d7a969bf5d8bb589dd P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:46.383376  9412 leader_election.cc:290] T 5f076a85481e43d7a969bf5d8bb589dd P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455), 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311)
I20260709 13:02:46.381909  9371 tablet_bootstrap.cc:492] T 5cea8a8078e8456186d4d1a184d3f157 P c694531b0e1d47988b291f1214efc4cb: Bootstrap starting.
I20260709 13:02:46.385459  9370 tablet_bootstrap.cc:492] T a731a965126b406988eecb7829bc9981 P 74ac2cf163ee475e8a280cb3aa738f57: No bootstrap required, opened a new log
I20260709 13:02:46.386061  9370 ts_tablet_manager.cc:1403] T a731a965126b406988eecb7829bc9981 P 74ac2cf163ee475e8a280cb3aa738f57: Time spent bootstrapping tablet: real 0.032s	user 0.013s	sys 0.000s
I20260709 13:02:46.387043  9372 tablet_bootstrap.cc:654] T e6797c587fdc4754b091a2be102e5927 P 65ed95869fbb4b69b5d6eb99c51adf85: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:46.389125  9370 raft_consensus.cc:359] T a731a965126b406988eecb7829bc9981 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:46.389962  9370 raft_consensus.cc:385] T a731a965126b406988eecb7829bc9981 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:46.390306  9370 raft_consensus.cc:740] T a731a965126b406988eecb7829bc9981 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74ac2cf163ee475e8a280cb3aa738f57, State: Initialized, Role: FOLLOWER
I20260709 13:02:46.391280  9370 consensus_queue.cc:260] T a731a965126b406988eecb7829bc9981 P 74ac2cf163ee475e8a280cb3aa738f57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:46.393782  9370 ts_tablet_manager.cc:1434] T a731a965126b406988eecb7829bc9981 P 74ac2cf163ee475e8a280cb3aa738f57: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 13:02:46.395498  9369 tablet_bootstrap.cc:492] T a731a965126b406988eecb7829bc9981 P 8846d581359a4b7ea6d4c33424ea825d: No bootstrap required, opened a new log
I20260709 13:02:46.396354  9369 ts_tablet_manager.cc:1403] T a731a965126b406988eecb7829bc9981 P 8846d581359a4b7ea6d4c33424ea825d: Time spent bootstrapping tablet: real 0.083s	user 0.026s	sys 0.030s
W20260709 13:02:46.397704  9047 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:46.391198  9371 tablet_bootstrap.cc:654] T 5cea8a8078e8456186d4d1a184d3f157 P c694531b0e1d47988b291f1214efc4cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:46.398532  9372 tablet_bootstrap.cc:492] T e6797c587fdc4754b091a2be102e5927 P 65ed95869fbb4b69b5d6eb99c51adf85: No bootstrap required, opened a new log
I20260709 13:02:46.399065  9372 ts_tablet_manager.cc:1403] T e6797c587fdc4754b091a2be102e5927 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent bootstrapping tablet: real 0.038s	user 0.013s	sys 0.004s
I20260709 13:02:46.399737  9369 raft_consensus.cc:359] T a731a965126b406988eecb7829bc9981 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:46.400538  9369 raft_consensus.cc:385] T a731a965126b406988eecb7829bc9981 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:46.400866  9369 raft_consensus.cc:740] T a731a965126b406988eecb7829bc9981 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8846d581359a4b7ea6d4c33424ea825d, State: Initialized, Role: FOLLOWER
I20260709 13:02:46.401659  9369 consensus_queue.cc:260] T a731a965126b406988eecb7829bc9981 P 8846d581359a4b7ea6d4c33424ea825d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:46.402065  9370 tablet_bootstrap.cc:492] T dbdc8579cca94ef7ab4babd287837e8c P 74ac2cf163ee475e8a280cb3aa738f57: Bootstrap starting.
I20260709 13:02:46.402091  9372 raft_consensus.cc:359] T e6797c587fdc4754b091a2be102e5927 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:46.403139  9372 raft_consensus.cc:385] T e6797c587fdc4754b091a2be102e5927 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:46.403415  9372 raft_consensus.cc:740] T e6797c587fdc4754b091a2be102e5927 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Initialized, Role: FOLLOWER
I20260709 13:02:46.404215  9372 consensus_queue.cc:260] T e6797c587fdc4754b091a2be102e5927 P 65ed95869fbb4b69b5d6eb99c51adf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:46.406630  9372 ts_tablet_manager.cc:1434] T e6797c587fdc4754b091a2be102e5927 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:02:46.407253  9369 ts_tablet_manager.cc:1434] T a731a965126b406988eecb7829bc9981 P 8846d581359a4b7ea6d4c33424ea825d: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.002s
I20260709 13:02:46.408411  9369 tablet_bootstrap.cc:492] T ea3bb46b177b4bbdaa60f464370aa9a0 P 8846d581359a4b7ea6d4c33424ea825d: Bootstrap starting.
I20260709 13:02:46.408671  9372 tablet_bootstrap.cc:492] T ea3bb46b177b4bbdaa60f464370aa9a0 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap starting.
I20260709 13:02:46.409633  9371 tablet_bootstrap.cc:492] T 5cea8a8078e8456186d4d1a184d3f157 P c694531b0e1d47988b291f1214efc4cb: No bootstrap required, opened a new log
I20260709 13:02:46.410220  9371 ts_tablet_manager.cc:1403] T 5cea8a8078e8456186d4d1a184d3f157 P c694531b0e1d47988b291f1214efc4cb: Time spent bootstrapping tablet: real 0.029s	user 0.009s	sys 0.004s
I20260709 13:02:46.415652  9176 raft_consensus.cc:3060] T 6f8b7d72409f45eebf4208f98310f378 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:46.416850  9370 tablet_bootstrap.cc:654] T dbdc8579cca94ef7ab4babd287837e8c P 74ac2cf163ee475e8a280cb3aa738f57: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:46.413409  9371 raft_consensus.cc:359] T 5cea8a8078e8456186d4d1a184d3f157 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:46.420121  9371 raft_consensus.cc:385] T 5cea8a8078e8456186d4d1a184d3f157 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:46.420544  9371 raft_consensus.cc:740] T 5cea8a8078e8456186d4d1a184d3f157 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c694531b0e1d47988b291f1214efc4cb, State: Initialized, Role: FOLLOWER
I20260709 13:02:46.421131  9369 tablet_bootstrap.cc:654] T ea3bb46b177b4bbdaa60f464370aa9a0 P 8846d581359a4b7ea6d4c33424ea825d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:46.421627  9371 consensus_queue.cc:260] T 5cea8a8078e8456186d4d1a184d3f157 P c694531b0e1d47988b291f1214efc4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:46.426497  9406 consensus_queue.cc:1048] T 6f8b7d72409f45eebf4208f98310f378 P 8846d581359a4b7ea6d4c33424ea825d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:46.427817  9371 ts_tablet_manager.cc:1434] T 5cea8a8078e8456186d4d1a184d3f157 P c694531b0e1d47988b291f1214efc4cb: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:02:46.429253  9371 tablet_bootstrap.cc:492] T 3ac2da3cd17d470495fd5fbb986e4936 P c694531b0e1d47988b291f1214efc4cb: Bootstrap starting.
I20260709 13:02:46.435093  9406 consensus_queue.cc:1048] T 6f8b7d72409f45eebf4208f98310f378 P 8846d581359a4b7ea6d4c33424ea825d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:46.437573  9372 tablet_bootstrap.cc:654] T ea3bb46b177b4bbdaa60f464370aa9a0 P 65ed95869fbb4b69b5d6eb99c51adf85: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:46.442788  9371 tablet_bootstrap.cc:654] T 3ac2da3cd17d470495fd5fbb986e4936 P c694531b0e1d47988b291f1214efc4cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:46.457921  9371 tablet_bootstrap.cc:492] T 3ac2da3cd17d470495fd5fbb986e4936 P c694531b0e1d47988b291f1214efc4cb: No bootstrap required, opened a new log
I20260709 13:02:46.459075  9371 ts_tablet_manager.cc:1403] T 3ac2da3cd17d470495fd5fbb986e4936 P c694531b0e1d47988b291f1214efc4cb: Time spent bootstrapping tablet: real 0.030s	user 0.008s	sys 0.005s
I20260709 13:02:46.461028  9369 tablet_bootstrap.cc:492] T ea3bb46b177b4bbdaa60f464370aa9a0 P 8846d581359a4b7ea6d4c33424ea825d: No bootstrap required, opened a new log
I20260709 13:02:46.461603  9369 ts_tablet_manager.cc:1403] T ea3bb46b177b4bbdaa60f464370aa9a0 P 8846d581359a4b7ea6d4c33424ea825d: Time spent bootstrapping tablet: real 0.053s	user 0.026s	sys 0.017s
I20260709 13:02:46.462006  9371 raft_consensus.cc:359] T 3ac2da3cd17d470495fd5fbb986e4936 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:46.462864  9371 raft_consensus.cc:385] T 3ac2da3cd17d470495fd5fbb986e4936 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:46.463156  9371 raft_consensus.cc:740] T 3ac2da3cd17d470495fd5fbb986e4936 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c694531b0e1d47988b291f1214efc4cb, State: Initialized, Role: FOLLOWER
I20260709 13:02:46.458305  9372 tablet_bootstrap.cc:492] T ea3bb46b177b4bbdaa60f464370aa9a0 P 65ed95869fbb4b69b5d6eb99c51adf85: No bootstrap required, opened a new log
I20260709 13:02:46.464347  9372 ts_tablet_manager.cc:1403] T ea3bb46b177b4bbdaa60f464370aa9a0 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent bootstrapping tablet: real 0.056s	user 0.010s	sys 0.003s
I20260709 13:02:46.464830  9369 raft_consensus.cc:359] T ea3bb46b177b4bbdaa60f464370aa9a0 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:46.465648  9369 raft_consensus.cc:385] T ea3bb46b177b4bbdaa60f464370aa9a0 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:46.465970  9369 raft_consensus.cc:740] T ea3bb46b177b4bbdaa60f464370aa9a0 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8846d581359a4b7ea6d4c33424ea825d, State: Initialized, Role: FOLLOWER
I20260709 13:02:46.466786  9369 consensus_queue.cc:260] T ea3bb46b177b4bbdaa60f464370aa9a0 P 8846d581359a4b7ea6d4c33424ea825d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:46.467584  9372 raft_consensus.cc:359] T ea3bb46b177b4bbdaa60f464370aa9a0 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:46.468309  9372 raft_consensus.cc:385] T ea3bb46b177b4bbdaa60f464370aa9a0 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:46.468566  9372 raft_consensus.cc:740] T ea3bb46b177b4bbdaa60f464370aa9a0 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Initialized, Role: FOLLOWER
I20260709 13:02:46.469247  9369 ts_tablet_manager.cc:1434] T ea3bb46b177b4bbdaa60f464370aa9a0 P 8846d581359a4b7ea6d4c33424ea825d: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:02:46.469413  9372 consensus_queue.cc:260] T ea3bb46b177b4bbdaa60f464370aa9a0 P 65ed95869fbb4b69b5d6eb99c51adf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:46.470633  9371 consensus_queue.cc:260] T 3ac2da3cd17d470495fd5fbb986e4936 P c694531b0e1d47988b291f1214efc4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:46.472179  9369 tablet_bootstrap.cc:492] T e6797c587fdc4754b091a2be102e5927 P 8846d581359a4b7ea6d4c33424ea825d: Bootstrap starting.
I20260709 13:02:46.473481  9372 ts_tablet_manager.cc:1434] T ea3bb46b177b4bbdaa60f464370aa9a0 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 13:02:46.474628  9372 tablet_bootstrap.cc:492] T dbdc8579cca94ef7ab4babd287837e8c P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap starting.
I20260709 13:02:46.479915  9370 tablet_bootstrap.cc:492] T dbdc8579cca94ef7ab4babd287837e8c P 74ac2cf163ee475e8a280cb3aa738f57: No bootstrap required, opened a new log
I20260709 13:02:46.480249  9371 ts_tablet_manager.cc:1434] T 3ac2da3cd17d470495fd5fbb986e4936 P c694531b0e1d47988b291f1214efc4cb: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:02:46.480664  9370 ts_tablet_manager.cc:1403] T dbdc8579cca94ef7ab4babd287837e8c P 74ac2cf163ee475e8a280cb3aa738f57: Time spent bootstrapping tablet: real 0.080s	user 0.018s	sys 0.021s
I20260709 13:02:46.481344  9371 tablet_bootstrap.cc:492] T 5f076a85481e43d7a969bf5d8bb589dd P c694531b0e1d47988b291f1214efc4cb: Bootstrap starting.
I20260709 13:02:46.483721  9370 raft_consensus.cc:359] T dbdc8579cca94ef7ab4babd287837e8c P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:46.495235  9370 raft_consensus.cc:385] T dbdc8579cca94ef7ab4babd287837e8c P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:46.484750  9377 raft_consensus.cc:493] T e6ee00de30e149f58789799810d595a4 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.485852  9410 raft_consensus.cc:493] T a731a965126b406988eecb7829bc9981 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.496305  9370 raft_consensus.cc:740] T dbdc8579cca94ef7ab4babd287837e8c P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74ac2cf163ee475e8a280cb3aa738f57, State: Initialized, Role: FOLLOWER
I20260709 13:02:46.496448  9377 raft_consensus.cc:515] T e6ee00de30e149f58789799810d595a4 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:46.497257  9370 consensus_queue.cc:260] T dbdc8579cca94ef7ab4babd287837e8c P 74ac2cf163ee475e8a280cb3aa738f57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:46.489005  9372 tablet_bootstrap.cc:654] T dbdc8579cca94ef7ab4babd287837e8c P 65ed95869fbb4b69b5d6eb99c51adf85: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:46.500412  9377 leader_election.cc:290] T e6ee00de30e149f58789799810d595a4 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979), c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455)
I20260709 13:02:46.500828  9370 ts_tablet_manager.cc:1434] T dbdc8579cca94ef7ab4babd287837e8c P 74ac2cf163ee475e8a280cb3aa738f57: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:02:46.501899  9370 tablet_bootstrap.cc:492] T 3ac2da3cd17d470495fd5fbb986e4936 P 74ac2cf163ee475e8a280cb3aa738f57: Bootstrap starting.
I20260709 13:02:46.502024  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ee00de30e149f58789799810d595a4" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" is_pre_election: true
I20260709 13:02:46.502758  9100 raft_consensus.cc:2468] T e6ee00de30e149f58789799810d595a4 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8846d581359a4b7ea6d4c33424ea825d in term 0.
I20260709 13:02:46.502904  9176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ee00de30e149f58789799810d595a4" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694531b0e1d47988b291f1214efc4cb" is_pre_election: true
I20260709 13:02:46.496600  9410 raft_consensus.cc:515] T a731a965126b406988eecb7829bc9981 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:46.504065  9215 leader_election.cc:304] T e6ee00de30e149f58789799810d595a4 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65ed95869fbb4b69b5d6eb99c51adf85, 8846d581359a4b7ea6d4c33424ea825d; no voters: 
I20260709 13:02:46.504972  9377 raft_consensus.cc:2804] T e6ee00de30e149f58789799810d595a4 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:46.505354  9377 raft_consensus.cc:493] T e6ee00de30e149f58789799810d595a4 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:46.505699  9377 raft_consensus.cc:3060] T e6ee00de30e149f58789799810d595a4 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:46.507057  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a731a965126b406988eecb7829bc9981" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" is_pre_election: true
I20260709 13:02:46.507833  9101 raft_consensus.cc:2468] T a731a965126b406988eecb7829bc9981 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8846d581359a4b7ea6d4c33424ea825d in term 0.
I20260709 13:02:46.508881  9324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a731a965126b406988eecb7829bc9981" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57" is_pre_election: true
I20260709 13:02:46.510154  9370 tablet_bootstrap.cc:654] T 3ac2da3cd17d470495fd5fbb986e4936 P 74ac2cf163ee475e8a280cb3aa738f57: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:46.510281  9324 raft_consensus.cc:2468] T a731a965126b406988eecb7829bc9981 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8846d581359a4b7ea6d4c33424ea825d in term 0.
W20260709 13:02:46.507848  9214 leader_election.cc:343] T e6ee00de30e149f58789799810d595a4 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:46.509590  9215 leader_election.cc:304] T a731a965126b406988eecb7829bc9981 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65ed95869fbb4b69b5d6eb99c51adf85, 8846d581359a4b7ea6d4c33424ea825d; no voters: 
I20260709 13:02:46.513687  9409 raft_consensus.cc:2804] T a731a965126b406988eecb7829bc9981 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:46.514071  9409 raft_consensus.cc:493] T a731a965126b406988eecb7829bc9981 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:46.514407  9409 raft_consensus.cc:3060] T a731a965126b406988eecb7829bc9981 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:46.498703  9371 tablet_bootstrap.cc:654] T 5f076a85481e43d7a969bf5d8bb589dd P c694531b0e1d47988b291f1214efc4cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:46.507136  9410 leader_election.cc:290] T a731a965126b406988eecb7829bc9981 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979), 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351)
I20260709 13:02:46.522413  9377 raft_consensus.cc:515] T e6ee00de30e149f58789799810d595a4 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:46.484647  9369 tablet_bootstrap.cc:654] T e6797c587fdc4754b091a2be102e5927 P 8846d581359a4b7ea6d4c33424ea825d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:46.530411  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ee00de30e149f58789799810d595a4" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85"
I20260709 13:02:46.531149  9100 raft_consensus.cc:3060] T e6ee00de30e149f58789799810d595a4 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:46.531358  9409 raft_consensus.cc:515] T a731a965126b406988eecb7829bc9981 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:46.533442  9409 leader_election.cc:290] T a731a965126b406988eecb7829bc9981 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 election: Requested vote from peers 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979), 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351)
I20260709 13:02:46.535131  9369 tablet_bootstrap.cc:492] T e6797c587fdc4754b091a2be102e5927 P 8846d581359a4b7ea6d4c33424ea825d: No bootstrap required, opened a new log
I20260709 13:02:46.535701  9369 ts_tablet_manager.cc:1403] T e6797c587fdc4754b091a2be102e5927 P 8846d581359a4b7ea6d4c33424ea825d: Time spent bootstrapping tablet: real 0.064s	user 0.008s	sys 0.004s
I20260709 13:02:46.536201  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a731a965126b406988eecb7829bc9981" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85"
I20260709 13:02:46.536907  9101 raft_consensus.cc:3060] T a731a965126b406988eecb7829bc9981 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:46.537817  9370 tablet_bootstrap.cc:492] T 3ac2da3cd17d470495fd5fbb986e4936 P 74ac2cf163ee475e8a280cb3aa738f57: No bootstrap required, opened a new log
I20260709 13:02:46.538305  9370 ts_tablet_manager.cc:1403] T 3ac2da3cd17d470495fd5fbb986e4936 P 74ac2cf163ee475e8a280cb3aa738f57: Time spent bootstrapping tablet: real 0.037s	user 0.012s	sys 0.018s
I20260709 13:02:46.538537  9369 raft_consensus.cc:359] T e6797c587fdc4754b091a2be102e5927 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:46.539278  9369 raft_consensus.cc:385] T e6797c587fdc4754b091a2be102e5927 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:46.539549  9369 raft_consensus.cc:740] T e6797c587fdc4754b091a2be102e5927 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8846d581359a4b7ea6d4c33424ea825d, State: Initialized, Role: FOLLOWER
I20260709 13:02:46.540234  9369 consensus_queue.cc:260] T e6797c587fdc4754b091a2be102e5927 P 8846d581359a4b7ea6d4c33424ea825d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:46.543017  9176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ee00de30e149f58789799810d595a4" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694531b0e1d47988b291f1214efc4cb"
I20260709 13:02:46.544168  9324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a731a965126b406988eecb7829bc9981" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57"
W20260709 13:02:46.544737  9214 leader_election.cc:343] T e6ee00de30e149f58789799810d595a4 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:46.544904  9324 raft_consensus.cc:3060] T a731a965126b406988eecb7829bc9981 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:46.547019  9371 tablet_bootstrap.cc:492] T 5f076a85481e43d7a969bf5d8bb589dd P c694531b0e1d47988b291f1214efc4cb: No bootstrap required, opened a new log
I20260709 13:02:46.547644  9371 ts_tablet_manager.cc:1403] T 5f076a85481e43d7a969bf5d8bb589dd P c694531b0e1d47988b291f1214efc4cb: Time spent bootstrapping tablet: real 0.066s	user 0.013s	sys 0.000s
I20260709 13:02:46.548081  9370 raft_consensus.cc:359] T 3ac2da3cd17d470495fd5fbb986e4936 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:46.548859  9370 raft_consensus.cc:385] T 3ac2da3cd17d470495fd5fbb986e4936 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:46.549160  9370 raft_consensus.cc:740] T 3ac2da3cd17d470495fd5fbb986e4936 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74ac2cf163ee475e8a280cb3aa738f57, State: Initialized, Role: FOLLOWER
I20260709 13:02:46.549335  9372 tablet_bootstrap.cc:492] T dbdc8579cca94ef7ab4babd287837e8c P 65ed95869fbb4b69b5d6eb99c51adf85: No bootstrap required, opened a new log
I20260709 13:02:46.549889  9372 ts_tablet_manager.cc:1403] T dbdc8579cca94ef7ab4babd287837e8c P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent bootstrapping tablet: real 0.075s	user 0.004s	sys 0.008s
I20260709 13:02:46.550500  9371 raft_consensus.cc:359] T 5f076a85481e43d7a969bf5d8bb589dd P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:46.551221  9371 raft_consensus.cc:385] T 5f076a85481e43d7a969bf5d8bb589dd P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:46.551548  9371 raft_consensus.cc:740] T 5f076a85481e43d7a969bf5d8bb589dd P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c694531b0e1d47988b291f1214efc4cb, State: Initialized, Role: FOLLOWER
I20260709 13:02:46.548137  9369 ts_tablet_manager.cc:1434] T e6797c587fdc4754b091a2be102e5927 P 8846d581359a4b7ea6d4c33424ea825d: Time spent starting tablet: real 0.012s	user 0.010s	sys 0.003s
I20260709 13:02:46.552346  9371 consensus_queue.cc:260] T 5f076a85481e43d7a969bf5d8bb589dd P c694531b0e1d47988b291f1214efc4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:46.552840  9369 tablet_bootstrap.cc:492] T eab411e3927a434ab647aa9b31fcf60d P 8846d581359a4b7ea6d4c33424ea825d: Bootstrap starting.
I20260709 13:02:46.549911  9370 consensus_queue.cc:260] T 3ac2da3cd17d470495fd5fbb986e4936 P 74ac2cf163ee475e8a280cb3aa738f57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:46.555300  9370 ts_tablet_manager.cc:1434] T 3ac2da3cd17d470495fd5fbb986e4936 P 74ac2cf163ee475e8a280cb3aa738f57: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.001s
I20260709 13:02:46.551335  9377 leader_election.cc:290] T e6ee00de30e149f58789799810d595a4 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 election: Requested vote from peers 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979), c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455)
I20260709 13:02:46.540328  9100 raft_consensus.cc:2468] T e6ee00de30e149f58789799810d595a4 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8846d581359a4b7ea6d4c33424ea825d in term 1.
I20260709 13:02:46.556896  9408 raft_consensus.cc:493] T eb666e221e5f4e4fbaba194838a28448 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.557474  9215 leader_election.cc:304] T e6ee00de30e149f58789799810d595a4 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65ed95869fbb4b69b5d6eb99c51adf85, 8846d581359a4b7ea6d4c33424ea825d; no voters: c694531b0e1d47988b291f1214efc4cb
I20260709 13:02:46.557402  9408 raft_consensus.cc:515] T eb666e221e5f4e4fbaba194838a28448 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:46.559415  9101 raft_consensus.cc:2468] T a731a965126b406988eecb7829bc9981 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8846d581359a4b7ea6d4c33424ea825d in term 1.
I20260709 13:02:46.560760  9408 leader_election.cc:290] T eb666e221e5f4e4fbaba194838a28448 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351), 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979)
I20260709 13:02:46.558715  9377 raft_consensus.cc:2804] T e6ee00de30e149f58789799810d595a4 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:46.562973  9323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb666e221e5f4e4fbaba194838a28448" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57" is_pre_election: true
I20260709 13:02:46.563606  9377 raft_consensus.cc:697] T e6ee00de30e149f58789799810d595a4 P 8846d581359a4b7ea6d4c33424ea825d [term 1 LEADER]: Becoming Leader. State: Replica: 8846d581359a4b7ea6d4c33424ea825d, State: Running, Role: LEADER
I20260709 13:02:46.563706  9323 raft_consensus.cc:2468] T eb666e221e5f4e4fbaba194838a28448 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c694531b0e1d47988b291f1214efc4cb in term 0.
I20260709 13:02:46.564069  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb666e221e5f4e4fbaba194838a28448" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" is_pre_election: true
I20260709 13:02:46.564845  9100 raft_consensus.cc:2468] T eb666e221e5f4e4fbaba194838a28448 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c694531b0e1d47988b291f1214efc4cb in term 0.
I20260709 13:02:46.562645  9378 raft_consensus.cc:493] T e6797c587fdc4754b091a2be102e5927 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.565155  9141 leader_election.cc:304] T eb666e221e5f4e4fbaba194838a28448 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57, c694531b0e1d47988b291f1214efc4cb; no voters: 
I20260709 13:02:46.565448  9409 raft_consensus.cc:493] T ea3bb46b177b4bbdaa60f464370aa9a0 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.565683  9378 raft_consensus.cc:515] T e6797c587fdc4754b091a2be102e5927 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:46.566088  9408 raft_consensus.cc:2804] T eb666e221e5f4e4fbaba194838a28448 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:46.565963  9409 raft_consensus.cc:515] T ea3bb46b177b4bbdaa60f464370aa9a0 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:46.566555  9408 raft_consensus.cc:493] T eb666e221e5f4e4fbaba194838a28448 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:46.566995  9408 raft_consensus.cc:3060] T eb666e221e5f4e4fbaba194838a28448 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:46.567939  9378 leader_election.cc:290] T e6797c587fdc4754b091a2be102e5927 P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455), 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311)
I20260709 13:02:46.564558  9377 consensus_queue.cc:237] T e6ee00de30e149f58789799810d595a4 P 8846d581359a4b7ea6d4c33424ea825d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:46.568001  9409 leader_election.cc:290] T ea3bb46b177b4bbdaa60f464370aa9a0 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979), c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455)
I20260709 13:02:46.568640  9176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6797c587fdc4754b091a2be102e5927" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694531b0e1d47988b291f1214efc4cb" is_pre_election: true
I20260709 13:02:46.569357  9176 raft_consensus.cc:2468] T e6797c587fdc4754b091a2be102e5927 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65ed95869fbb4b69b5d6eb99c51adf85 in term 0.
I20260709 13:02:46.569947  9371 ts_tablet_manager.cc:1434] T 5f076a85481e43d7a969bf5d8bb589dd P c694531b0e1d47988b291f1214efc4cb: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 13:02:46.570451  9250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6797c587fdc4754b091a2be102e5927" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d" is_pre_election: true
I20260709 13:02:46.571187  9250 raft_consensus.cc:2468] T e6797c587fdc4754b091a2be102e5927 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65ed95869fbb4b69b5d6eb99c51adf85 in term 0.
I20260709 13:02:46.572566  9064 leader_election.cc:304] T e6797c587fdc4754b091a2be102e5927 P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65ed95869fbb4b69b5d6eb99c51adf85, 8846d581359a4b7ea6d4c33424ea825d; no voters: 
I20260709 13:02:46.562487  9370 tablet_bootstrap.cc:492] T d2ef0242573643178d56d10a6c26ae8e P 74ac2cf163ee475e8a280cb3aa738f57: Bootstrap starting.
I20260709 13:02:46.575824  9369 tablet_bootstrap.cc:654] T eab411e3927a434ab647aa9b31fcf60d P 8846d581359a4b7ea6d4c33424ea825d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:46.575588  9175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea3bb46b177b4bbdaa60f464370aa9a0" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694531b0e1d47988b291f1214efc4cb" is_pre_election: true
I20260709 13:02:46.576427  9175 raft_consensus.cc:2468] T ea3bb46b177b4bbdaa60f464370aa9a0 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8846d581359a4b7ea6d4c33424ea825d in term 0.
I20260709 13:02:46.577075  9371 tablet_bootstrap.cc:492] T 989e9796152e4796a3408e00419403fa P c694531b0e1d47988b291f1214efc4cb: Bootstrap starting.
I20260709 13:02:46.576668  9324 raft_consensus.cc:2468] T a731a965126b406988eecb7829bc9981 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8846d581359a4b7ea6d4c33424ea825d in term 1.
I20260709 13:02:46.577205  9380 raft_consensus.cc:493] T 5f076a85481e43d7a969bf5d8bb589dd P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.577916  9380 raft_consensus.cc:515] T 5f076a85481e43d7a969bf5d8bb589dd P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:46.579185  9214 leader_election.cc:304] T ea3bb46b177b4bbdaa60f464370aa9a0 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8846d581359a4b7ea6d4c33424ea825d, c694531b0e1d47988b291f1214efc4cb; no voters: 
I20260709 13:02:46.580148  9409 raft_consensus.cc:2804] T ea3bb46b177b4bbdaa60f464370aa9a0 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:46.580523  9409 raft_consensus.cc:493] T ea3bb46b177b4bbdaa60f464370aa9a0 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:46.580868  9409 raft_consensus.cc:3060] T ea3bb46b177b4bbdaa60f464370aa9a0 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:46.581142  9370 tablet_bootstrap.cc:654] T d2ef0242573643178d56d10a6c26ae8e P 74ac2cf163ee475e8a280cb3aa738f57: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:46.577447  9378 raft_consensus.cc:2804] T e6797c587fdc4754b091a2be102e5927 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:46.583235  9378 raft_consensus.cc:493] T e6797c587fdc4754b091a2be102e5927 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:46.586930  9371 tablet_bootstrap.cc:654] T 989e9796152e4796a3408e00419403fa P c694531b0e1d47988b291f1214efc4cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:46.585327  9215 leader_election.cc:304] T a731a965126b406988eecb7829bc9981 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57, 8846d581359a4b7ea6d4c33424ea825d; no voters: 
I20260709 13:02:46.592743  9410 raft_consensus.cc:2804] T a731a965126b406988eecb7829bc9981 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:46.583576  9378 raft_consensus.cc:3060] T e6797c587fdc4754b091a2be102e5927 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:46.593277  9410 raft_consensus.cc:697] T a731a965126b406988eecb7829bc9981 P 8846d581359a4b7ea6d4c33424ea825d [term 1 LEADER]: Becoming Leader. State: Replica: 8846d581359a4b7ea6d4c33424ea825d, State: Running, Role: LEADER
I20260709 13:02:46.589306  9250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f076a85481e43d7a969bf5d8bb589dd" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d" is_pre_election: true
I20260709 13:02:46.588656  9324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f076a85481e43d7a969bf5d8bb589dd" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57" is_pre_election: true
I20260709 13:02:46.594252  9410 consensus_queue.cc:237] T a731a965126b406988eecb7829bc9981 P 8846d581359a4b7ea6d4c33424ea825d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:46.595255  9324 raft_consensus.cc:2468] T 5f076a85481e43d7a969bf5d8bb589dd P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c694531b0e1d47988b291f1214efc4cb in term 0.
W20260709 13:02:46.595181  9139 leader_election.cc:343] T 5f076a85481e43d7a969bf5d8bb589dd P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:46.600818  9369 tablet_bootstrap.cc:492] T eab411e3927a434ab647aa9b31fcf60d P 8846d581359a4b7ea6d4c33424ea825d: No bootstrap required, opened a new log
I20260709 13:02:46.586252  9380 leader_election.cc:290] T 5f076a85481e43d7a969bf5d8bb589dd P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311), 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351)
I20260709 13:02:46.600970  9141 leader_election.cc:304] T 5f076a85481e43d7a969bf5d8bb589dd P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57, c694531b0e1d47988b291f1214efc4cb; no voters: 8846d581359a4b7ea6d4c33424ea825d
I20260709 13:02:46.602902  9380 raft_consensus.cc:2804] T 5f076a85481e43d7a969bf5d8bb589dd P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:46.604736  9380 raft_consensus.cc:493] T 5f076a85481e43d7a969bf5d8bb589dd P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:46.603685  9371 tablet_bootstrap.cc:492] T 989e9796152e4796a3408e00419403fa P c694531b0e1d47988b291f1214efc4cb: No bootstrap required, opened a new log
I20260709 13:02:46.605233  9380 raft_consensus.cc:3060] T 5f076a85481e43d7a969bf5d8bb589dd P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:46.605481  9371 ts_tablet_manager.cc:1403] T 989e9796152e4796a3408e00419403fa P c694531b0e1d47988b291f1214efc4cb: Time spent bootstrapping tablet: real 0.035s	user 0.010s	sys 0.003s
I20260709 13:02:46.606364  9370 tablet_bootstrap.cc:492] T d2ef0242573643178d56d10a6c26ae8e P 74ac2cf163ee475e8a280cb3aa738f57: No bootstrap required, opened a new log
I20260709 13:02:46.601408  9369 ts_tablet_manager.cc:1403] T eab411e3927a434ab647aa9b31fcf60d P 8846d581359a4b7ea6d4c33424ea825d: Time spent bootstrapping tablet: real 0.049s	user 0.011s	sys 0.001s
I20260709 13:02:46.607806  9370 ts_tablet_manager.cc:1403] T d2ef0242573643178d56d10a6c26ae8e P 74ac2cf163ee475e8a280cb3aa738f57: Time spent bootstrapping tablet: real 0.046s	user 0.019s	sys 0.000s
I20260709 13:02:46.612833  9371 raft_consensus.cc:359] T 989e9796152e4796a3408e00419403fa P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:46.613636  9371 raft_consensus.cc:385] T 989e9796152e4796a3408e00419403fa P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:46.613917  9371 raft_consensus.cc:740] T 989e9796152e4796a3408e00419403fa P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c694531b0e1d47988b291f1214efc4cb, State: Initialized, Role: FOLLOWER
I20260709 13:02:46.616180  9369 raft_consensus.cc:359] T eab411e3927a434ab647aa9b31fcf60d P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:46.617019  9369 raft_consensus.cc:385] T eab411e3927a434ab647aa9b31fcf60d P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:46.617350  9369 raft_consensus.cc:740] T eab411e3927a434ab647aa9b31fcf60d P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8846d581359a4b7ea6d4c33424ea825d, State: Initialized, Role: FOLLOWER
I20260709 13:02:46.560678  9372 raft_consensus.cc:359] T dbdc8579cca94ef7ab4babd287837e8c P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:46.619254  9371 consensus_queue.cc:260] T 989e9796152e4796a3408e00419403fa P c694531b0e1d47988b291f1214efc4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:46.617050  9370 raft_consensus.cc:359] T d2ef0242573643178d56d10a6c26ae8e P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:46.620360  9370 raft_consensus.cc:385] T d2ef0242573643178d56d10a6c26ae8e P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:46.617031  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea3bb46b177b4bbdaa60f464370aa9a0" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" is_pre_election: true
I20260709 13:02:46.620793  9370 raft_consensus.cc:740] T d2ef0242573643178d56d10a6c26ae8e P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74ac2cf163ee475e8a280cb3aa738f57, State: Initialized, Role: FOLLOWER
I20260709 13:02:46.621165  9101 raft_consensus.cc:2468] T ea3bb46b177b4bbdaa60f464370aa9a0 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8846d581359a4b7ea6d4c33424ea825d in term 0.
I20260709 13:02:46.621841  9371 ts_tablet_manager.cc:1434] T 989e9796152e4796a3408e00419403fa P c694531b0e1d47988b291f1214efc4cb: Time spent starting tablet: real 0.016s	user 0.002s	sys 0.004s
I20260709 13:02:46.618256  9369 consensus_queue.cc:260] T eab411e3927a434ab647aa9b31fcf60d P 8846d581359a4b7ea6d4c33424ea825d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:46.622429  9370 consensus_queue.cc:260] T d2ef0242573643178d56d10a6c26ae8e P 74ac2cf163ee475e8a280cb3aa738f57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:46.623178  9409 raft_consensus.cc:515] T ea3bb46b177b4bbdaa60f464370aa9a0 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:46.624440  9369 ts_tablet_manager.cc:1434] T eab411e3927a434ab647aa9b31fcf60d P 8846d581359a4b7ea6d4c33424ea825d: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 13:02:46.625447  9369 tablet_bootstrap.cc:492] T 69a5fd219b1a4d4c94b346f38909f024 P 8846d581359a4b7ea6d4c33424ea825d: Bootstrap starting.
I20260709 13:02:46.625597  9100 raft_consensus.cc:3060] T b3f19df7d93748a1802678c56b5e2208 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:46.626029  9370 ts_tablet_manager.cc:1434] T d2ef0242573643178d56d10a6c26ae8e P 74ac2cf163ee475e8a280cb3aa738f57: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:02:46.626470  9175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea3bb46b177b4bbdaa60f464370aa9a0" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694531b0e1d47988b291f1214efc4cb"
I20260709 13:02:46.627115  9175 raft_consensus.cc:3060] T ea3bb46b177b4bbdaa60f464370aa9a0 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:46.631001  9371 tablet_bootstrap.cc:492] T 53bdda361da242a1b37aa013fad1ee60 P c694531b0e1d47988b291f1214efc4cb: Bootstrap starting.
I20260709 13:02:46.635893  9175 raft_consensus.cc:2468] T ea3bb46b177b4bbdaa60f464370aa9a0 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8846d581359a4b7ea6d4c33424ea825d in term 1.
I20260709 13:02:46.636152  9412 raft_consensus.cc:493] T 51a2ca964a8f4fb89b26d77b1b334f30 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.636651  9412 raft_consensus.cc:515] T 51a2ca964a8f4fb89b26d77b1b334f30 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:46.637594  9371 tablet_bootstrap.cc:654] T 53bdda361da242a1b37aa013fad1ee60 P c694531b0e1d47988b291f1214efc4cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:46.637914  9214 leader_election.cc:304] T ea3bb46b177b4bbdaa60f464370aa9a0 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8846d581359a4b7ea6d4c33424ea825d, c694531b0e1d47988b291f1214efc4cb; no voters: 
I20260709 13:02:46.638151  9408 raft_consensus.cc:515] T eb666e221e5f4e4fbaba194838a28448 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:46.639381  9406 raft_consensus.cc:2804] T ea3bb46b177b4bbdaa60f464370aa9a0 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:46.627030  9370 tablet_bootstrap.cc:492] T 69a5fd219b1a4d4c94b346f38909f024 P 74ac2cf163ee475e8a280cb3aa738f57: Bootstrap starting.
I20260709 13:02:46.640650  9412 leader_election.cc:290] T 51a2ca964a8f4fb89b26d77b1b334f30 P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311), 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979)
I20260709 13:02:46.642585  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51a2ca964a8f4fb89b26d77b1b334f30" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" is_pre_election: true
I20260709 13:02:46.643368  9099 raft_consensus.cc:2468] T 51a2ca964a8f4fb89b26d77b1b334f30 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74ac2cf163ee475e8a280cb3aa738f57 in term 0.
I20260709 13:02:46.644698  9289 leader_election.cc:304] T 51a2ca964a8f4fb89b26d77b1b334f30 P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65ed95869fbb4b69b5d6eb99c51adf85, 74ac2cf163ee475e8a280cb3aa738f57; no voters: 
I20260709 13:02:46.645440  9369 tablet_bootstrap.cc:654] T 69a5fd219b1a4d4c94b346f38909f024 P 8846d581359a4b7ea6d4c33424ea825d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:46.645665  9412 raft_consensus.cc:2804] T 51a2ca964a8f4fb89b26d77b1b334f30 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:46.646099  9379 raft_consensus.cc:493] T d2ef0242573643178d56d10a6c26ae8e P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.646121  9412 raft_consensus.cc:493] T 51a2ca964a8f4fb89b26d77b1b334f30 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:46.646741  9412 raft_consensus.cc:3060] T 51a2ca964a8f4fb89b26d77b1b334f30 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:46.646721  9379 raft_consensus.cc:515] T d2ef0242573643178d56d10a6c26ae8e P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:46.649008  9379 leader_election.cc:290] T d2ef0242573643178d56d10a6c26ae8e P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979), c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455)
I20260709 13:02:46.650606  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2ef0242573643178d56d10a6c26ae8e" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" is_pre_election: true
I20260709 13:02:46.651572  9370 tablet_bootstrap.cc:654] T 69a5fd219b1a4d4c94b346f38909f024 P 74ac2cf163ee475e8a280cb3aa738f57: Neither blocks nor log segments found. Creating new log.
W20260709 13:02:46.652271  9289 leader_election.cc:343] T d2ef0242573643178d56d10a6c26ae8e P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:46.653302  9379 raft_consensus.cc:493] T 3ac2da3cd17d470495fd5fbb986e4936 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.653798  9379 raft_consensus.cc:515] T 3ac2da3cd17d470495fd5fbb986e4936 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:46.655882  9409 leader_election.cc:290] T ea3bb46b177b4bbdaa60f464370aa9a0 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 election: Requested vote from peers 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979), c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455)
I20260709 13:02:46.656782  9176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac2da3cd17d470495fd5fbb986e4936" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694531b0e1d47988b291f1214efc4cb" is_pre_election: true
I20260709 13:02:46.657506  9176 raft_consensus.cc:2468] T 3ac2da3cd17d470495fd5fbb986e4936 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74ac2cf163ee475e8a280cb3aa738f57 in term 0.
I20260709 13:02:46.659072  9369 tablet_bootstrap.cc:492] T 69a5fd219b1a4d4c94b346f38909f024 P 8846d581359a4b7ea6d4c33424ea825d: No bootstrap required, opened a new log
I20260709 13:02:46.659015  9288 leader_election.cc:304] T 3ac2da3cd17d470495fd5fbb986e4936 P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57, c694531b0e1d47988b291f1214efc4cb; no voters: 
I20260709 13:02:46.659734  9369 ts_tablet_manager.cc:1403] T 69a5fd219b1a4d4c94b346f38909f024 P 8846d581359a4b7ea6d4c33424ea825d: Time spent bootstrapping tablet: real 0.034s	user 0.014s	sys 0.001s
I20260709 13:02:46.662849  9369 raft_consensus.cc:359] T 69a5fd219b1a4d4c94b346f38909f024 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:46.663245  9379 leader_election.cc:290] T 3ac2da3cd17d470495fd5fbb986e4936 P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455), 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311)
I20260709 13:02:46.664958  9379 raft_consensus.cc:2804] T 3ac2da3cd17d470495fd5fbb986e4936 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:46.665143  9409 raft_consensus.cc:493] T eab411e3927a434ab647aa9b31fcf60d P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.665755  9409 raft_consensus.cc:515] T eab411e3927a434ab647aa9b31fcf60d P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:46.665037  9378 raft_consensus.cc:515] T e6797c587fdc4754b091a2be102e5927 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:46.674168  9370 tablet_bootstrap.cc:492] T 69a5fd219b1a4d4c94b346f38909f024 P 74ac2cf163ee475e8a280cb3aa738f57: No bootstrap required, opened a new log
I20260709 13:02:46.667893  9409 leader_election.cc:290] T eab411e3927a434ab647aa9b31fcf60d P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351), 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979)
I20260709 13:02:46.668457  9379 raft_consensus.cc:493] T 3ac2da3cd17d470495fd5fbb986e4936 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:46.663633  9369 raft_consensus.cc:385] T 69a5fd219b1a4d4c94b346f38909f024 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:46.640501  9408 leader_election.cc:290] T eb666e221e5f4e4fbaba194838a28448 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 election: Requested vote from peers 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351), 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979)
I20260709 13:02:46.680282  9249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac2da3cd17d470495fd5fbb986e4936" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d" is_pre_election: true
I20260709 13:02:46.680783  9248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6797c587fdc4754b091a2be102e5927" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d"
I20260709 13:02:46.681123  9249 raft_consensus.cc:2468] T 3ac2da3cd17d470495fd5fbb986e4936 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74ac2cf163ee475e8a280cb3aa738f57 in term 0.
I20260709 13:02:46.681600  9248 raft_consensus.cc:3060] T e6797c587fdc4754b091a2be102e5927 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:46.682963  9409 consensus_queue.cc:1048] T b3f19df7d93748a1802678c56b5e2208 P 8846d581359a4b7ea6d4c33424ea825d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:46.676254  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea3bb46b177b4bbdaa60f464370aa9a0" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85"
I20260709 13:02:46.685067  9100 raft_consensus.cc:3060] T ea3bb46b177b4bbdaa60f464370aa9a0 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:46.688390  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eab411e3927a434ab647aa9b31fcf60d" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" is_pre_election: true
I20260709 13:02:46.676049  8998 catalog_manager.cc:5697] T e6ee00de30e149f58789799810d595a4 P 8846d581359a4b7ea6d4c33424ea825d reported cstate change: term changed from 0 to 1, leader changed from <none> to 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195). New cstate: current_term: 1 leader_uuid: "8846d581359a4b7ea6d4c33424ea825d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:46.677639  9452 raft_consensus.cc:493] T b3f19df7d93748a1802678c56b5e2208 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.619192  9372 raft_consensus.cc:385] T dbdc8579cca94ef7ab4babd287837e8c P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:46.694211  9452 raft_consensus.cc:515] T b3f19df7d93748a1802678c56b5e2208 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:46.677524  9369 raft_consensus.cc:740] T 69a5fd219b1a4d4c94b346f38909f024 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8846d581359a4b7ea6d4c33424ea825d, State: Initialized, Role: FOLLOWER
I20260709 13:02:46.693344  9248 raft_consensus.cc:2468] T e6797c587fdc4754b091a2be102e5927 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65ed95869fbb4b69b5d6eb99c51adf85 in term 1.
I20260709 13:02:46.695729  9369 consensus_queue.cc:260] T 69a5fd219b1a4d4c94b346f38909f024 P 8846d581359a4b7ea6d4c33424ea825d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:46.697014  9064 leader_election.cc:304] T e6797c587fdc4754b091a2be102e5927 P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65ed95869fbb4b69b5d6eb99c51adf85, 8846d581359a4b7ea6d4c33424ea825d; no voters: 
I20260709 13:02:46.678310  9378 leader_election.cc:290] T e6797c587fdc4754b091a2be102e5927 P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 1 election: Requested vote from peers c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455), 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311)
I20260709 13:02:46.679059  9324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eab411e3927a434ab647aa9b31fcf60d" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57" is_pre_election: true
I20260709 13:02:46.698089  9369 ts_tablet_manager.cc:1434] T 69a5fd219b1a4d4c94b346f38909f024 P 8846d581359a4b7ea6d4c33424ea825d: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.000s
I20260709 13:02:46.679900  9250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51a2ca964a8f4fb89b26d77b1b334f30" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d" is_pre_election: true
I20260709 13:02:46.699151  9369 tablet_bootstrap.cc:492] T 51a2ca964a8f4fb89b26d77b1b334f30 P 8846d581359a4b7ea6d4c33424ea825d: Bootstrap starting.
I20260709 13:02:46.699363  9378 raft_consensus.cc:2804] T e6797c587fdc4754b091a2be102e5927 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:46.699931  9378 raft_consensus.cc:697] T e6797c587fdc4754b091a2be102e5927 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 LEADER]: Becoming Leader. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Running, Role: LEADER
I20260709 13:02:46.700917  9324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f19df7d93748a1802678c56b5e2208" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57" is_pre_election: true
I20260709 13:02:46.700810  9378 consensus_queue.cc:237] T e6797c587fdc4754b091a2be102e5927 P 65ed95869fbb4b69b5d6eb99c51adf85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:46.701622  9324 raft_consensus.cc:2468] T b3f19df7d93748a1802678c56b5e2208 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65ed95869fbb4b69b5d6eb99c51adf85 in term 1.
I20260709 13:02:46.702881  9066 leader_election.cc:304] T b3f19df7d93748a1802678c56b5e2208 P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65ed95869fbb4b69b5d6eb99c51adf85, 74ac2cf163ee475e8a280cb3aa738f57; no voters: 
I20260709 13:02:46.705871  9369 tablet_bootstrap.cc:654] T 51a2ca964a8f4fb89b26d77b1b334f30 P 8846d581359a4b7ea6d4c33424ea825d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:46.694844  9372 raft_consensus.cc:740] T dbdc8579cca94ef7ab4babd287837e8c P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Initialized, Role: FOLLOWER
I20260709 13:02:46.706909  9372 consensus_queue.cc:260] T dbdc8579cca94ef7ab4babd287837e8c P 65ed95869fbb4b69b5d6eb99c51adf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:46.677459  9379 raft_consensus.cc:3060] T 3ac2da3cd17d470495fd5fbb986e4936 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:46.674899  9370 ts_tablet_manager.cc:1403] T 69a5fd219b1a4d4c94b346f38909f024 P 74ac2cf163ee475e8a280cb3aa738f57: Time spent bootstrapping tablet: real 0.048s	user 0.013s	sys 0.002s
I20260709 13:02:46.702849  9452 leader_election.cc:290] T b3f19df7d93748a1802678c56b5e2208 P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311), 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351)
I20260709 13:02:46.710112  9452 raft_consensus.cc:2804] T b3f19df7d93748a1802678c56b5e2208 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:46.710547  9452 raft_consensus.cc:493] T b3f19df7d93748a1802678c56b5e2208 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:46.711441  9371 tablet_bootstrap.cc:492] T 53bdda361da242a1b37aa013fad1ee60 P c694531b0e1d47988b291f1214efc4cb: No bootstrap required, opened a new log
I20260709 13:02:46.711360  9370 raft_consensus.cc:359] T 69a5fd219b1a4d4c94b346f38909f024 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:46.714021  9370 raft_consensus.cc:385] T 69a5fd219b1a4d4c94b346f38909f024 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:46.714178  9371 ts_tablet_manager.cc:1403] T 53bdda361da242a1b37aa013fad1ee60 P c694531b0e1d47988b291f1214efc4cb: Time spent bootstrapping tablet: real 0.083s	user 0.013s	sys 0.028s
I20260709 13:02:46.714341  9370 raft_consensus.cc:740] T 69a5fd219b1a4d4c94b346f38909f024 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74ac2cf163ee475e8a280cb3aa738f57, State: Initialized, Role: FOLLOWER
I20260709 13:02:46.715346  9370 consensus_queue.cc:260] T 69a5fd219b1a4d4c94b346f38909f024 P 74ac2cf163ee475e8a280cb3aa738f57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:46.717753  9371 raft_consensus.cc:359] T 53bdda361da242a1b37aa013fad1ee60 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:46.718676  9371 raft_consensus.cc:385] T 53bdda361da242a1b37aa013fad1ee60 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:46.719204  9371 raft_consensus.cc:740] T 53bdda361da242a1b37aa013fad1ee60 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c694531b0e1d47988b291f1214efc4cb, State: Initialized, Role: FOLLOWER
I20260709 13:02:46.720178  9371 consensus_queue.cc:260] T 53bdda361da242a1b37aa013fad1ee60 P c694531b0e1d47988b291f1214efc4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:46.722297  9371 ts_tablet_manager.cc:1434] T 53bdda361da242a1b37aa013fad1ee60 P c694531b0e1d47988b291f1214efc4cb: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:02:46.726611  9371 tablet_bootstrap.cc:492] T 69a5fd219b1a4d4c94b346f38909f024 P c694531b0e1d47988b291f1214efc4cb: Bootstrap starting.
I20260709 13:02:46.725170  9100 raft_consensus.cc:2468] T ea3bb46b177b4bbdaa60f464370aa9a0 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8846d581359a4b7ea6d4c33424ea825d in term 1.
I20260709 13:02:46.722826  9452 raft_consensus.cc:3060] T b3f19df7d93748a1802678c56b5e2208 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:46.733341  9462 raft_consensus.cc:493] T dbdc8579cca94ef7ab4babd287837e8c P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.733968  9462 raft_consensus.cc:515] T dbdc8579cca94ef7ab4babd287837e8c P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:46.736316  9462 leader_election.cc:290] T dbdc8579cca94ef7ab4babd287837e8c P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979), c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455)
I20260709 13:02:46.736716  9370 ts_tablet_manager.cc:1434] T 69a5fd219b1a4d4c94b346f38909f024 P 74ac2cf163ee475e8a280cb3aa738f57: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 13:02:46.739542  9370 tablet_bootstrap.cc:492] T 53bdda361da242a1b37aa013fad1ee60 P 74ac2cf163ee475e8a280cb3aa738f57: Bootstrap starting.
I20260709 13:02:46.740530  9176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdc8579cca94ef7ab4babd287837e8c" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694531b0e1d47988b291f1214efc4cb" is_pre_election: true
W20260709 13:02:46.742858  9288 leader_election.cc:343] T dbdc8579cca94ef7ab4babd287837e8c P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:46.744380  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdc8579cca94ef7ab4babd287837e8c" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" is_pre_election: true
I20260709 13:02:46.745937  9100 raft_consensus.cc:2468] T dbdc8579cca94ef7ab4babd287837e8c P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74ac2cf163ee475e8a280cb3aa738f57 in term 0.
I20260709 13:02:46.746584  9370 tablet_bootstrap.cc:654] T 53bdda361da242a1b37aa013fad1ee60 P 74ac2cf163ee475e8a280cb3aa738f57: Neither blocks nor log segments found. Creating new log.
W20260709 13:02:46.760205  9287 leader_election.cc:343] T 51a2ca964a8f4fb89b26d77b1b334f30 P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:46.764762  9289 leader_election.cc:304] T dbdc8579cca94ef7ab4babd287837e8c P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65ed95869fbb4b69b5d6eb99c51adf85, 74ac2cf163ee475e8a280cb3aa738f57; no voters: c694531b0e1d47988b291f1214efc4cb
I20260709 13:02:46.756999  9371 tablet_bootstrap.cc:654] T 69a5fd219b1a4d4c94b346f38909f024 P c694531b0e1d47988b291f1214efc4cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:46.760586  9452 raft_consensus.cc:515] T b3f19df7d93748a1802678c56b5e2208 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:46.766837  9462 raft_consensus.cc:2804] T dbdc8579cca94ef7ab4babd287837e8c P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:46.765156  9458 consensus_queue.cc:1048] T 6cb786213d5d48779533059bc333ac6f P 8846d581359a4b7ea6d4c33424ea825d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:02:46.761976  9369 tablet_bootstrap.cc:492] T 51a2ca964a8f4fb89b26d77b1b334f30 P 8846d581359a4b7ea6d4c33424ea825d: No bootstrap required, opened a new log
I20260709 13:02:46.762202  8997 catalog_manager.cc:5697] T e6797c587fdc4754b091a2be102e5927 P 65ed95869fbb4b69b5d6eb99c51adf85 reported cstate change: term changed from 0 to 1, leader changed from <none> to 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:46.762555  9457 raft_consensus.cc:493] T 53bdda361da242a1b37aa013fad1ee60 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:46.751251  9141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:44351, user_credentials={real_user=slave}} blocked reactor thread for 154547us
I20260709 13:02:46.767275  9462 raft_consensus.cc:493] T dbdc8579cca94ef7ab4babd287837e8c P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:46.749862  9175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2ef0242573643178d56d10a6c26ae8e" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694531b0e1d47988b291f1214efc4cb" is_pre_election: true
I20260709 13:02:46.768879  9462 raft_consensus.cc:3060] T dbdc8579cca94ef7ab4babd287837e8c P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:46.768379  9457 raft_consensus.cc:515] T 53bdda361da242a1b37aa013fad1ee60 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:46.771854  9248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53bdda361da242a1b37aa013fad1ee60" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d" is_pre_election: true
W20260709 13:02:46.751768  9064 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45311, user_credentials={real_user=slave}} blocked reactor thread for 54837.8us
W20260709 13:02:46.773514  9288 leader_election.cc:343] T d2ef0242573643178d56d10a6c26ae8e P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:46.774003  9288 leader_election.cc:304] T d2ef0242573643178d56d10a6c26ae8e P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57; no voters: 65ed95869fbb4b69b5d6eb99c51adf85, c694531b0e1d47988b291f1214efc4cb
I20260709 13:02:46.775223  9101 raft_consensus.cc:1240] T b3f19df7d93748a1802678c56b5e2208 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 2 FOLLOWER]: Rejecting Update request from peer 8846d581359a4b7ea6d4c33424ea825d for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:02:46.775913  9250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f19df7d93748a1802678c56b5e2208" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d" is_pre_election: true
I20260709 13:02:46.750758  9406 raft_consensus.cc:697] T ea3bb46b177b4bbdaa60f464370aa9a0 P 8846d581359a4b7ea6d4c33424ea825d [term 1 LEADER]: Becoming Leader. State: Replica: 8846d581359a4b7ea6d4c33424ea825d, State: Running, Role: LEADER
I20260709 13:02:46.767942  9369 ts_tablet_manager.cc:1403] T 51a2ca964a8f4fb89b26d77b1b334f30 P 8846d581359a4b7ea6d4c33424ea825d: Time spent bootstrapping tablet: real 0.069s	user 0.019s	sys 0.034s
I20260709 13:02:46.776352  9249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f19df7d93748a1802678c56b5e2208" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d"
I20260709 13:02:46.750795  9412 raft_consensus.cc:515] T 51a2ca964a8f4fb89b26d77b1b334f30 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:46.780253  9406 consensus_queue.cc:237] T ea3bb46b177b4bbdaa60f464370aa9a0 P 8846d581359a4b7ea6d4c33424ea825d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:46.786494  9324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb666e221e5f4e4fbaba194838a28448" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57"
I20260709 13:02:46.787377  9324 raft_consensus.cc:3060] T eb666e221e5f4e4fbaba194838a28448 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:46.783653  9369 raft_consensus.cc:359] T 51a2ca964a8f4fb89b26d77b1b334f30 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:46.790109  9369 raft_consensus.cc:385] T 51a2ca964a8f4fb89b26d77b1b334f30 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:46.790369  9369 raft_consensus.cc:740] T 51a2ca964a8f4fb89b26d77b1b334f30 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8846d581359a4b7ea6d4c33424ea825d, State: Initialized, Role: FOLLOWER
I20260709 13:02:46.791097  9369 consensus_queue.cc:260] T 51a2ca964a8f4fb89b26d77b1b334f30 P 8846d581359a4b7ea6d4c33424ea825d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:46.793174  9369 ts_tablet_manager.cc:1434] T 51a2ca964a8f4fb89b26d77b1b334f30 P 8846d581359a4b7ea6d4c33424ea825d: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.000s
I20260709 13:02:46.794147  9369 tablet_bootstrap.cc:492] T 5ce2a33a3b914f6297946ded34c256bf P 8846d581359a4b7ea6d4c33424ea825d: Bootstrap starting.
I20260709 13:02:46.784073  9372 ts_tablet_manager.cc:1434] T dbdc8579cca94ef7ab4babd287837e8c P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent starting tablet: real 0.234s	user 0.010s	sys 0.000s
I20260709 13:02:46.794806  9175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6797c587fdc4754b091a2be102e5927" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694531b0e1d47988b291f1214efc4cb"
W20260709 13:02:46.798803  9066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:44351, user_credentials={real_user=slave}} blocked reactor thread for 95984us
I20260709 13:02:46.799817  9471 raft_consensus.cc:2749] T d2ef0242573643178d56d10a6c26ae8e P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:46.798888  9412 leader_election.cc:290] T 51a2ca964a8f4fb89b26d77b1b334f30 P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 election: Requested vote from peers 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311), 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979)
I20260709 13:02:46.800622  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb666e221e5f4e4fbaba194838a28448" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85"
I20260709 13:02:46.801333  9099 raft_consensus.cc:3060] T eb666e221e5f4e4fbaba194838a28448 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:46.801838  9323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f19df7d93748a1802678c56b5e2208" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57"
I20260709 13:02:46.802456  9323 raft_consensus.cc:3060] T b3f19df7d93748a1802678c56b5e2208 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:46.808884  9099 raft_consensus.cc:2468] T eb666e221e5f4e4fbaba194838a28448 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c694531b0e1d47988b291f1214efc4cb in term 1.
I20260709 13:02:46.809566  9323 raft_consensus.cc:2468] T b3f19df7d93748a1802678c56b5e2208 P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65ed95869fbb4b69b5d6eb99c51adf85 in term 2.
I20260709 13:02:46.810505  9141 leader_election.cc:304] T eb666e221e5f4e4fbaba194838a28448 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65ed95869fbb4b69b5d6eb99c51adf85, c694531b0e1d47988b291f1214efc4cb; no voters: 
I20260709 13:02:46.800472  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51a2ca964a8f4fb89b26d77b1b334f30" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85"
I20260709 13:02:46.811367  9408 raft_consensus.cc:2804] T eb666e221e5f4e4fbaba194838a28448 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:46.811478  9101 raft_consensus.cc:3060] T 51a2ca964a8f4fb89b26d77b1b334f30 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:46.811892  9369 tablet_bootstrap.cc:654] T 5ce2a33a3b914f6297946ded34c256bf P 8846d581359a4b7ea6d4c33424ea825d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:46.817911  9066 leader_election.cc:304] T b3f19df7d93748a1802678c56b5e2208 P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65ed95869fbb4b69b5d6eb99c51adf85, 74ac2cf163ee475e8a280cb3aa738f57; no voters: 8846d581359a4b7ea6d4c33424ea825d
I20260709 13:02:46.820825  9464 raft_consensus.cc:2804] T b3f19df7d93748a1802678c56b5e2208 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:46.754328  9380 raft_consensus.cc:515] T 5f076a85481e43d7a969bf5d8bb589dd P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:46.821537  9464 raft_consensus.cc:697] T b3f19df7d93748a1802678c56b5e2208 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 2 LEADER]: Becoming Leader. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Running, Role: LEADER
W20260709 13:02:46.761161  9215 leader_election.cc:343] T eab411e3927a434ab647aa9b31fcf60d P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:46.822201  9215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:44351, user_credentials={real_user=slave}} blocked reactor thread for 61053.7us
I20260709 13:02:46.822490  9464 consensus_queue.cc:237] T b3f19df7d93748a1802678c56b5e2208 P 65ed95869fbb4b69b5d6eb99c51adf85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:46.798730  9175 raft_consensus.cc:3060] T e6797c587fdc4754b091a2be102e5927 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:46.767938  9452 leader_election.cc:290] T b3f19df7d93748a1802678c56b5e2208 P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 2 election: Requested vote from peers 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311), 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351)
I20260709 13:02:46.784899  9462 raft_consensus.cc:515] T dbdc8579cca94ef7ab4babd287837e8c P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
W20260709 13:02:46.796423  9139 leader_election.cc:343] T 53bdda361da242a1b37aa013fad1ee60 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:46.798214  9370 tablet_bootstrap.cc:492] T 53bdda361da242a1b37aa013fad1ee60 P 74ac2cf163ee475e8a280cb3aa738f57: No bootstrap required, opened a new log
I20260709 13:02:46.829398  9462 leader_election.cc:290] T dbdc8579cca94ef7ab4babd287837e8c P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 election: Requested vote from peers 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979), c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455)
I20260709 13:02:46.829349  9370 ts_tablet_manager.cc:1403] T 53bdda361da242a1b37aa013fad1ee60 P 74ac2cf163ee475e8a280cb3aa738f57: Time spent bootstrapping tablet: real 0.090s	user 0.011s	sys 0.005s
I20260709 13:02:46.832147  9174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdc8579cca94ef7ab4babd287837e8c" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694531b0e1d47988b291f1214efc4cb"
W20260709 13:02:46.834076  9288 leader_election.cc:343] T dbdc8579cca94ef7ab4babd287837e8c P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:46.835992  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdc8579cca94ef7ab4babd287837e8c" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85"
I20260709 13:02:46.837143  9100 raft_consensus.cc:3060] T dbdc8579cca94ef7ab4babd287837e8c P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:46.833904  9248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f076a85481e43d7a969bf5d8bb589dd" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d"
I20260709 13:02:46.797940  9324 raft_consensus.cc:2468] T eb666e221e5f4e4fbaba194838a28448 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c694531b0e1d47988b291f1214efc4cb in term 1.
W20260709 13:02:46.839025  9139 leader_election.cc:343] T 5f076a85481e43d7a969bf5d8bb589dd P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:46.837211  9323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53bdda361da242a1b37aa013fad1ee60" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57" is_pre_election: true
I20260709 13:02:46.841126  9370 raft_consensus.cc:359] T 53bdda361da242a1b37aa013fad1ee60 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:46.841877  9370 raft_consensus.cc:385] T 53bdda361da242a1b37aa013fad1ee60 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:46.842150  9370 raft_consensus.cc:740] T 53bdda361da242a1b37aa013fad1ee60 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74ac2cf163ee475e8a280cb3aa738f57, State: Initialized, Role: FOLLOWER
I20260709 13:02:46.842931  9370 consensus_queue.cc:260] T 53bdda361da242a1b37aa013fad1ee60 P 74ac2cf163ee475e8a280cb3aa738f57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
W20260709 13:02:46.822938  9215 leader_election.cc:343] T eab411e3927a434ab647aa9b31fcf60d P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:46.844173  9215 leader_election.cc:304] T eab411e3927a434ab647aa9b31fcf60d P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8846d581359a4b7ea6d4c33424ea825d; no voters: 65ed95869fbb4b69b5d6eb99c51adf85, 74ac2cf163ee475e8a280cb3aa738f57
I20260709 13:02:46.845098  9458 raft_consensus.cc:2749] T eab411e3927a434ab647aa9b31fcf60d P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:46.795732  9372 tablet_bootstrap.cc:492] T 5cea8a8078e8456186d4d1a184d3f157 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap starting.
I20260709 13:02:46.856765  9408 raft_consensus.cc:697] T eb666e221e5f4e4fbaba194838a28448 P c694531b0e1d47988b291f1214efc4cb [term 1 LEADER]: Becoming Leader. State: Replica: c694531b0e1d47988b291f1214efc4cb, State: Running, Role: LEADER
I20260709 13:02:46.857810  9408 consensus_queue.cc:237] T eb666e221e5f4e4fbaba194838a28448 P c694531b0e1d47988b291f1214efc4cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:46.858968  9323 raft_consensus.cc:2468] T 53bdda361da242a1b37aa013fad1ee60 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c694531b0e1d47988b291f1214efc4cb in term 0.
I20260709 13:02:46.868378  9100 raft_consensus.cc:2468] T dbdc8579cca94ef7ab4babd287837e8c P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74ac2cf163ee475e8a280cb3aa738f57 in term 1.
I20260709 13:02:46.869100  8997 catalog_manager.cc:5697] T b3f19df7d93748a1802678c56b5e2208 P 65ed95869fbb4b69b5d6eb99c51adf85 reported cstate change: term changed from 1 to 2, leader changed from 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195) to 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:46.870260  9141 leader_election.cc:304] T 53bdda361da242a1b37aa013fad1ee60 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57, c694531b0e1d47988b291f1214efc4cb; no voters: 8846d581359a4b7ea6d4c33424ea825d
I20260709 13:02:46.871146  9289 leader_election.cc:304] T dbdc8579cca94ef7ab4babd287837e8c P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65ed95869fbb4b69b5d6eb99c51adf85, 74ac2cf163ee475e8a280cb3aa738f57; no voters: c694531b0e1d47988b291f1214efc4cb
I20260709 13:02:46.783979  9379 raft_consensus.cc:515] T 3ac2da3cd17d470495fd5fbb986e4936 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:46.873136  9479 raft_consensus.cc:2804] T 53bdda361da242a1b37aa013fad1ee60 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:46.883850  9370 ts_tablet_manager.cc:1434] T 53bdda361da242a1b37aa013fad1ee60 P 74ac2cf163ee475e8a280cb3aa738f57: Time spent starting tablet: real 0.054s	user 0.003s	sys 0.004s
I20260709 13:02:46.883924  9479 raft_consensus.cc:493] T 53bdda361da242a1b37aa013fad1ee60 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:46.884956  9479 raft_consensus.cc:3060] T 53bdda361da242a1b37aa013fad1ee60 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:46.860988  9324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f076a85481e43d7a969bf5d8bb589dd" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57"
I20260709 13:02:46.885828  9324 raft_consensus.cc:3060] T 5f076a85481e43d7a969bf5d8bb589dd P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:46.887449  9175 raft_consensus.cc:2468] T e6797c587fdc4754b091a2be102e5927 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65ed95869fbb4b69b5d6eb99c51adf85 in term 1.
I20260709 13:02:46.861486  9457 leader_election.cc:290] T 53bdda361da242a1b37aa013fad1ee60 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311), 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351)
I20260709 13:02:46.884999  9370 tablet_bootstrap.cc:492] T 3899ef948b2e405baaccb81544b7f58b P 74ac2cf163ee475e8a280cb3aa738f57: Bootstrap starting.
I20260709 13:02:46.892889  9479 raft_consensus.cc:515] T 53bdda361da242a1b37aa013fad1ee60 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:46.867386  9369 tablet_bootstrap.cc:492] T 5ce2a33a3b914f6297946ded34c256bf P 8846d581359a4b7ea6d4c33424ea825d: No bootstrap required, opened a new log
I20260709 13:02:46.894515  9369 ts_tablet_manager.cc:1403] T 5ce2a33a3b914f6297946ded34c256bf P 8846d581359a4b7ea6d4c33424ea825d: Time spent bootstrapping tablet: real 0.101s	user 0.030s	sys 0.001s
I20260709 13:02:46.895287  9479 leader_election.cc:290] T 53bdda361da242a1b37aa013fad1ee60 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 election: Requested vote from peers 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311), 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351)
I20260709 13:02:46.890225  8997 catalog_manager.cc:5697] T eb666e221e5f4e4fbaba194838a28448 P c694531b0e1d47988b291f1214efc4cb reported cstate change: term changed from 0 to 1, leader changed from <none> to c694531b0e1d47988b291f1214efc4cb (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c694531b0e1d47988b291f1214efc4cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:46.897398  9369 raft_consensus.cc:359] T 5ce2a33a3b914f6297946ded34c256bf P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:46.898162  9369 raft_consensus.cc:385] T 5ce2a33a3b914f6297946ded34c256bf P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:46.867830  9371 tablet_bootstrap.cc:492] T 69a5fd219b1a4d4c94b346f38909f024 P c694531b0e1d47988b291f1214efc4cb: No bootstrap required, opened a new log
I20260709 13:02:46.899032  9371 ts_tablet_manager.cc:1403] T 69a5fd219b1a4d4c94b346f38909f024 P c694531b0e1d47988b291f1214efc4cb: Time spent bootstrapping tablet: real 0.173s	user 0.020s	sys 0.018s
I20260709 13:02:46.901908  9371 raft_consensus.cc:359] T 69a5fd219b1a4d4c94b346f38909f024 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:46.868221  9380 leader_election.cc:290] T 5f076a85481e43d7a969bf5d8bb589dd P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 election: Requested vote from peers 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311), 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351)
I20260709 13:02:46.902637  9371 raft_consensus.cc:385] T 69a5fd219b1a4d4c94b346f38909f024 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:46.904170  9371 raft_consensus.cc:740] T 69a5fd219b1a4d4c94b346f38909f024 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c694531b0e1d47988b291f1214efc4cb, State: Initialized, Role: FOLLOWER
I20260709 13:02:46.874354  9379 leader_election.cc:290] T 3ac2da3cd17d470495fd5fbb986e4936 P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 election: Requested vote from peers c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455), 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311)
I20260709 13:02:46.850435  9474 raft_consensus.cc:493] T 5cea8a8078e8456186d4d1a184d3f157 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.877360  9458 consensus_queue.cc:1059] T b3f19df7d93748a1802678c56b5e2208 P 8846d581359a4b7ea6d4c33424ea825d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:46.877640  9462 raft_consensus.cc:2804] T dbdc8579cca94ef7ab4babd287837e8c P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:46.905177  9474 raft_consensus.cc:515] T 5cea8a8078e8456186d4d1a184d3f157 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:46.905776  9462 raft_consensus.cc:697] T dbdc8579cca94ef7ab4babd287837e8c P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 LEADER]: Becoming Leader. State: Replica: 74ac2cf163ee475e8a280cb3aa738f57, State: Running, Role: LEADER
I20260709 13:02:46.906728  9462 consensus_queue.cc:237] T dbdc8579cca94ef7ab4babd287837e8c P 74ac2cf163ee475e8a280cb3aa738f57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:46.907333  9323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53bdda361da242a1b37aa013fad1ee60" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57"
I20260709 13:02:46.907429  9474 leader_election.cc:290] T 5cea8a8078e8456186d4d1a184d3f157 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979), 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351)
I20260709 13:02:46.898461  9369 raft_consensus.cc:740] T 5ce2a33a3b914f6297946ded34c256bf P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8846d581359a4b7ea6d4c33424ea825d, State: Initialized, Role: FOLLOWER
I20260709 13:02:46.880162  9249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac2da3cd17d470495fd5fbb986e4936" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d"
I20260709 13:02:46.908777  9249 raft_consensus.cc:3060] T 3ac2da3cd17d470495fd5fbb986e4936 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:46.881938  9409 consensus_queue.cc:1048] T 6cb786213d5d48779533059bc333ac6f P 8846d581359a4b7ea6d4c33424ea825d [LEADER]: Connected to new peer: Peer: permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:46.909003  9369 consensus_queue.cc:260] T 5ce2a33a3b914f6297946ded34c256bf P 8846d581359a4b7ea6d4c33424ea825d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:46.882560  9176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac2da3cd17d470495fd5fbb986e4936" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694531b0e1d47988b291f1214efc4cb"
I20260709 13:02:46.883322  9408 raft_consensus.cc:493] T 989e9796152e4796a3408e00419403fa P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.911550  9324 raft_consensus.cc:2468] T 5f076a85481e43d7a969bf5d8bb589dd P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c694531b0e1d47988b291f1214efc4cb in term 1.
I20260709 13:02:46.911885  9408 raft_consensus.cc:515] T 989e9796152e4796a3408e00419403fa P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:46.914242  9408 leader_election.cc:290] T 989e9796152e4796a3408e00419403fa P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311), 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351)
I20260709 13:02:46.911492  9176 raft_consensus.cc:3060] T 3ac2da3cd17d470495fd5fbb986e4936 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:46.860855  9473 consensus_queue.cc:1048] T 8bfbc32cc1ba4ecc8fddc7e7f4711778 P c694531b0e1d47988b291f1214efc4cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:46.889349  9101 raft_consensus.cc:2468] T 51a2ca964a8f4fb89b26d77b1b334f30 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74ac2cf163ee475e8a280cb3aa738f57 in term 1.
I20260709 13:02:46.892073  9372 tablet_bootstrap.cc:654] T 5cea8a8078e8456186d4d1a184d3f157 P 65ed95869fbb4b69b5d6eb99c51adf85: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:46.924714  9377 consensus_queue.cc:1048] T b3f19df7d93748a1802678c56b5e2208 P 8846d581359a4b7ea6d4c33424ea825d [LEADER]: Connected to new peer: Peer: permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:46.925659  9250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53bdda361da242a1b37aa013fad1ee60" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d"
I20260709 13:02:46.908206  9323 raft_consensus.cc:3060] T 53bdda361da242a1b37aa013fad1ee60 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:46.927162  9289 leader_election.cc:304] T 51a2ca964a8f4fb89b26d77b1b334f30 P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65ed95869fbb4b69b5d6eb99c51adf85, 74ac2cf163ee475e8a280cb3aa738f57; no voters: 
I20260709 13:02:46.928164  9412 raft_consensus.cc:2804] T 51a2ca964a8f4fb89b26d77b1b334f30 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:46.928709  9412 raft_consensus.cc:697] T 51a2ca964a8f4fb89b26d77b1b334f30 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 LEADER]: Becoming Leader. State: Replica: 74ac2cf163ee475e8a280cb3aa738f57, State: Running, Role: LEADER
I20260709 13:02:46.929304  9141 leader_election.cc:304] T 5f076a85481e43d7a969bf5d8bb589dd P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57, c694531b0e1d47988b291f1214efc4cb; no voters: 8846d581359a4b7ea6d4c33424ea825d
I20260709 13:02:46.929610  9412 consensus_queue.cc:237] T 51a2ca964a8f4fb89b26d77b1b334f30 P 74ac2cf163ee475e8a280cb3aa738f57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:46.932188  9322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "989e9796152e4796a3408e00419403fa" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57" is_pre_election: true
I20260709 13:02:46.936015  9409 raft_consensus.cc:3055] T b3f19df7d93748a1802678c56b5e2208 P 8846d581359a4b7ea6d4c33424ea825d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:46.936476  9409 raft_consensus.cc:740] T b3f19df7d93748a1802678c56b5e2208 P 8846d581359a4b7ea6d4c33424ea825d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8846d581359a4b7ea6d4c33424ea825d, State: Running, Role: LEADER
I20260709 13:02:46.936584  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cea8a8078e8456186d4d1a184d3f157" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" is_pre_election: true
I20260709 13:02:46.937165  9250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "989e9796152e4796a3408e00419403fa" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d" is_pre_election: true
I20260709 13:02:46.937424  9409 consensus_queue.cc:260] T b3f19df7d93748a1802678c56b5e2208 P 8846d581359a4b7ea6d4c33424ea825d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:46.878983  9248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51a2ca964a8f4fb89b26d77b1b334f30" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d"
I20260709 13:02:46.938966  9248 raft_consensus.cc:3060] T 51a2ca964a8f4fb89b26d77b1b334f30 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:46.939198  9139 leader_election.cc:343] T 53bdda361da242a1b37aa013fad1ee60 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:46.941352  9139 leader_election.cc:343] T 989e9796152e4796a3408e00419403fa P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:46.942780  9324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cea8a8078e8456186d4d1a184d3f157" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57" is_pre_election: true
I20260709 13:02:46.943578  9324 raft_consensus.cc:2468] T 5cea8a8078e8456186d4d1a184d3f157 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c694531b0e1d47988b291f1214efc4cb in term 0.
I20260709 13:02:46.950138  9409 raft_consensus.cc:3060] T b3f19df7d93748a1802678c56b5e2208 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:46.951514  9473 raft_consensus.cc:2804] T 5f076a85481e43d7a969bf5d8bb589dd P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:46.952060  9473 raft_consensus.cc:697] T 5f076a85481e43d7a969bf5d8bb589dd P c694531b0e1d47988b291f1214efc4cb [term 1 LEADER]: Becoming Leader. State: Replica: c694531b0e1d47988b291f1214efc4cb, State: Running, Role: LEADER
W20260709 13:02:46.952533  9141 leader_election.cc:343] T 5cea8a8078e8456186d4d1a184d3f157 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:46.953051  9369 ts_tablet_manager.cc:1434] T 5ce2a33a3b914f6297946ded34c256bf P 8846d581359a4b7ea6d4c33424ea825d: Time spent starting tablet: real 0.058s	user 0.008s	sys 0.005s
I20260709 13:02:46.904829  9371 consensus_queue.cc:260] T 69a5fd219b1a4d4c94b346f38909f024 P c694531b0e1d47988b291f1214efc4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:46.952914  9473 consensus_queue.cc:237] T 5f076a85481e43d7a969bf5d8bb589dd P c694531b0e1d47988b291f1214efc4cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:46.954105  9369 tablet_bootstrap.cc:492] T 5f076a85481e43d7a969bf5d8bb589dd P 8846d581359a4b7ea6d4c33424ea825d: Bootstrap starting.
I20260709 13:02:46.904837  9370 tablet_bootstrap.cc:654] T 3899ef948b2e405baaccb81544b7f58b P 74ac2cf163ee475e8a280cb3aa738f57: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:46.960649  9371 ts_tablet_manager.cc:1434] T 69a5fd219b1a4d4c94b346f38909f024 P c694531b0e1d47988b291f1214efc4cb: Time spent starting tablet: real 0.061s	user 0.001s	sys 0.006s
I20260709 13:02:46.961670  9371 tablet_bootstrap.cc:492] T e6ee00de30e149f58789799810d595a4 P c694531b0e1d47988b291f1214efc4cb: Bootstrap starting.
I20260709 13:02:46.961954  9323 raft_consensus.cc:2468] T 53bdda361da242a1b37aa013fad1ee60 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c694531b0e1d47988b291f1214efc4cb in term 1.
W20260709 13:02:46.958467  9141 leader_election.cc:343] T 989e9796152e4796a3408e00419403fa P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:46.963272  9141 leader_election.cc:304] T 989e9796152e4796a3408e00419403fa P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c694531b0e1d47988b291f1214efc4cb; no voters: 74ac2cf163ee475e8a280cb3aa738f57, 8846d581359a4b7ea6d4c33424ea825d
I20260709 13:02:46.962270  9176 raft_consensus.cc:2468] T 3ac2da3cd17d470495fd5fbb986e4936 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74ac2cf163ee475e8a280cb3aa738f57 in term 1.
I20260709 13:02:46.965735  9141 leader_election.cc:304] T 5cea8a8078e8456186d4d1a184d3f157 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57, c694531b0e1d47988b291f1214efc4cb; no voters: 65ed95869fbb4b69b5d6eb99c51adf85
I20260709 13:02:46.966316  9249 raft_consensus.cc:2468] T 3ac2da3cd17d470495fd5fbb986e4936 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74ac2cf163ee475e8a280cb3aa738f57 in term 1.
I20260709 13:02:46.967484  8998 catalog_manager.cc:5697] T a731a965126b406988eecb7829bc9981 P 8846d581359a4b7ea6d4c33424ea825d reported cstate change: term changed from 0 to 1, leader changed from <none> to 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195). New cstate: current_term: 1 leader_uuid: "8846d581359a4b7ea6d4c33424ea825d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:46.968930  9288 leader_election.cc:304] T 3ac2da3cd17d470495fd5fbb986e4936 P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57, c694531b0e1d47988b291f1214efc4cb; no voters: 
I20260709 13:02:46.972164  9476 raft_consensus.cc:2749] T 989e9796152e4796a3408e00419403fa P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:46.972553  9462 raft_consensus.cc:2804] T 3ac2da3cd17d470495fd5fbb986e4936 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:46.973078  9462 raft_consensus.cc:697] T 3ac2da3cd17d470495fd5fbb986e4936 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 LEADER]: Becoming Leader. State: Replica: 74ac2cf163ee475e8a280cb3aa738f57, State: Running, Role: LEADER
I20260709 13:02:46.973946  9462 consensus_queue.cc:237] T 3ac2da3cd17d470495fd5fbb986e4936 P 74ac2cf163ee475e8a280cb3aa738f57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:46.970118  8999 catalog_manager.cc:5697] T dbdc8579cca94ef7ab4babd287837e8c P 74ac2cf163ee475e8a280cb3aa738f57 reported cstate change: term changed from 0 to 1, leader changed from <none> to 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "74ac2cf163ee475e8a280cb3aa738f57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:46.973140  8998 catalog_manager.cc:5697] T ea3bb46b177b4bbdaa60f464370aa9a0 P 8846d581359a4b7ea6d4c33424ea825d reported cstate change: term changed from 0 to 1, leader changed from <none> to 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195). New cstate: current_term: 1 leader_uuid: "8846d581359a4b7ea6d4c33424ea825d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:46.970129  9480 raft_consensus.cc:2804] T 5cea8a8078e8456186d4d1a184d3f157 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:46.977965  9371 tablet_bootstrap.cc:654] T e6ee00de30e149f58789799810d595a4 P c694531b0e1d47988b291f1214efc4cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:46.970358  9141 leader_election.cc:304] T 53bdda361da242a1b37aa013fad1ee60 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57, c694531b0e1d47988b291f1214efc4cb; no voters: 8846d581359a4b7ea6d4c33424ea825d
I20260709 13:02:46.980463  9323 raft_consensus.cc:1240] T b3f19df7d93748a1802678c56b5e2208 P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Rejecting Update request from peer 8846d581359a4b7ea6d4c33424ea825d for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:02:46.982710  9408 raft_consensus.cc:2804] T 53bdda361da242a1b37aa013fad1ee60 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:46.976889  9480 raft_consensus.cc:493] T 5cea8a8078e8456186d4d1a184d3f157 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:46.983294  9408 raft_consensus.cc:697] T 53bdda361da242a1b37aa013fad1ee60 P c694531b0e1d47988b291f1214efc4cb [term 1 LEADER]: Becoming Leader. State: Replica: c694531b0e1d47988b291f1214efc4cb, State: Running, Role: LEADER
I20260709 13:02:46.984475  9408 consensus_queue.cc:237] T 53bdda361da242a1b37aa013fad1ee60 P c694531b0e1d47988b291f1214efc4cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:46.983534  9480 raft_consensus.cc:3060] T 5cea8a8078e8456186d4d1a184d3f157 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:46.982723  9476 consensus_queue.cc:1048] T 8bfbc32cc1ba4ecc8fddc7e7f4711778 P c694531b0e1d47988b291f1214efc4cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:02:46.990824  9377 raft_consensus.cc:493] T 5ce2a33a3b914f6297946ded34c256bf P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.994989  9377 raft_consensus.cc:515] T 5ce2a33a3b914f6297946ded34c256bf P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:46.996696  9372 tablet_bootstrap.cc:492] T 5cea8a8078e8456186d4d1a184d3f157 P 65ed95869fbb4b69b5d6eb99c51adf85: No bootstrap required, opened a new log
I20260709 13:02:46.997063  9377 leader_election.cc:290] T 5ce2a33a3b914f6297946ded34c256bf P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351), 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979)
I20260709 13:02:46.997248  9372 ts_tablet_manager.cc:1403] T 5cea8a8078e8456186d4d1a184d3f157 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent bootstrapping tablet: real 0.202s	user 0.008s	sys 0.007s
I20260709 13:02:47.000383  9248 raft_consensus.cc:2468] T 51a2ca964a8f4fb89b26d77b1b334f30 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74ac2cf163ee475e8a280cb3aa738f57 in term 1.
I20260709 13:02:47.000619  9372 raft_consensus.cc:359] T 5cea8a8078e8456186d4d1a184d3f157 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:47.005090  9372 raft_consensus.cc:385] T 5cea8a8078e8456186d4d1a184d3f157 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:47.005501  9372 raft_consensus.cc:740] T 5cea8a8078e8456186d4d1a184d3f157 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Initialized, Role: FOLLOWER
I20260709 13:02:47.007552  9372 consensus_queue.cc:260] T 5cea8a8078e8456186d4d1a184d3f157 P 65ed95869fbb4b69b5d6eb99c51adf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:47.013202  9369 tablet_bootstrap.cc:654] T 5f076a85481e43d7a969bf5d8bb589dd P 8846d581359a4b7ea6d4c33424ea825d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:47.017585  9323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce2a33a3b914f6297946ded34c256bf" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57" is_pre_election: true
I20260709 13:02:47.018561  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce2a33a3b914f6297946ded34c256bf" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" is_pre_election: true
W20260709 13:02:47.022253  9215 leader_election.cc:343] T 5ce2a33a3b914f6297946ded34c256bf P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:47.024233  9372 ts_tablet_manager.cc:1434] T 5cea8a8078e8456186d4d1a184d3f157 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.001s
I20260709 13:02:47.026808  9372 tablet_bootstrap.cc:492] T 5ce2a33a3b914f6297946ded34c256bf P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap starting.
W20260709 13:02:47.030555  9214 consensus_peers.cc:597] T e6ee00de30e149f58789799810d595a4 P 8846d581359a4b7ea6d4c33424ea825d -> Peer c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455): Couldn't send request to peer c694531b0e1d47988b291f1214efc4cb. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:47.034085  9480 raft_consensus.cc:515] T 5cea8a8078e8456186d4d1a184d3f157 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:47.039018  8999 catalog_manager.cc:5697] T 5f076a85481e43d7a969bf5d8bb589dd P c694531b0e1d47988b291f1214efc4cb reported cstate change: term changed from 0 to 1, leader changed from <none> to c694531b0e1d47988b291f1214efc4cb (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c694531b0e1d47988b291f1214efc4cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:47.050143  9372 tablet_bootstrap.cc:654] T 5ce2a33a3b914f6297946ded34c256bf P 65ed95869fbb4b69b5d6eb99c51adf85: Neither blocks nor log segments found. Creating new log.
W20260709 13:02:47.036645  9215 leader_election.cc:343] T 5ce2a33a3b914f6297946ded34c256bf P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:47.055047  9215 leader_election.cc:304] T 5ce2a33a3b914f6297946ded34c256bf P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8846d581359a4b7ea6d4c33424ea825d; no voters: 65ed95869fbb4b69b5d6eb99c51adf85, 74ac2cf163ee475e8a280cb3aa738f57
I20260709 13:02:47.055976  9377 raft_consensus.cc:2749] T 5ce2a33a3b914f6297946ded34c256bf P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:47.062578  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cea8a8078e8456186d4d1a184d3f157" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85"
I20260709 13:02:47.063366  9100 raft_consensus.cc:3060] T 5cea8a8078e8456186d4d1a184d3f157 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:47.065287  9480 leader_election.cc:290] T 5cea8a8078e8456186d4d1a184d3f157 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 election: Requested vote from peers 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979), 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351)
I20260709 13:02:47.065922  9480 raft_consensus.cc:493] T 69a5fd219b1a4d4c94b346f38909f024 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:47.066375  9480 raft_consensus.cc:515] T 69a5fd219b1a4d4c94b346f38909f024 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:47.066694  9323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cea8a8078e8456186d4d1a184d3f157" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57"
I20260709 13:02:47.067378  9323 raft_consensus.cc:3060] T 5cea8a8078e8456186d4d1a184d3f157 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:47.069852  9321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69a5fd219b1a4d4c94b346f38909f024" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57" is_pre_election: true
I20260709 13:02:47.070576  9321 raft_consensus.cc:2468] T 69a5fd219b1a4d4c94b346f38909f024 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c694531b0e1d47988b291f1214efc4cb in term 0.
I20260709 13:02:47.072387  9141 leader_election.cc:304] T 69a5fd219b1a4d4c94b346f38909f024 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57, c694531b0e1d47988b291f1214efc4cb; no voters: 
I20260709 13:02:47.072515  9248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69a5fd219b1a4d4c94b346f38909f024" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d" is_pre_election: true
I20260709 13:02:47.074489  9480 leader_election.cc:290] T 69a5fd219b1a4d4c94b346f38909f024 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311), 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351)
I20260709 13:02:47.073237  9408 raft_consensus.cc:2804] T 69a5fd219b1a4d4c94b346f38909f024 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:47.075057  9408 raft_consensus.cc:493] T 69a5fd219b1a4d4c94b346f38909f024 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:47.075404  9408 raft_consensus.cc:3060] T 69a5fd219b1a4d4c94b346f38909f024 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:47.075582  9100 raft_consensus.cc:2468] T 5cea8a8078e8456186d4d1a184d3f157 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c694531b0e1d47988b291f1214efc4cb in term 1.
I20260709 13:02:47.077311  9141 leader_election.cc:304] T 5cea8a8078e8456186d4d1a184d3f157 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65ed95869fbb4b69b5d6eb99c51adf85, c694531b0e1d47988b291f1214efc4cb; no voters: 
I20260709 13:02:47.078397  9473 raft_consensus.cc:2804] T 5cea8a8078e8456186d4d1a184d3f157 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:47.078922  9473 raft_consensus.cc:697] T 5cea8a8078e8456186d4d1a184d3f157 P c694531b0e1d47988b291f1214efc4cb [term 1 LEADER]: Becoming Leader. State: Replica: c694531b0e1d47988b291f1214efc4cb, State: Running, Role: LEADER
I20260709 13:02:47.079742  9473 consensus_queue.cc:237] T 5cea8a8078e8456186d4d1a184d3f157 P c694531b0e1d47988b291f1214efc4cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:47.073251  9248 raft_consensus.cc:2468] T 69a5fd219b1a4d4c94b346f38909f024 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c694531b0e1d47988b291f1214efc4cb in term 0.
I20260709 13:02:47.083599  9408 raft_consensus.cc:515] T 69a5fd219b1a4d4c94b346f38909f024 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:47.086275  9323 raft_consensus.cc:2468] T 5cea8a8078e8456186d4d1a184d3f157 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c694531b0e1d47988b291f1214efc4cb in term 1.
I20260709 13:02:47.087069  9248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69a5fd219b1a4d4c94b346f38909f024" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d"
I20260709 13:02:47.087800  9248 raft_consensus.cc:3060] T 69a5fd219b1a4d4c94b346f38909f024 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:47.088840  9369 tablet_bootstrap.cc:492] T 5f076a85481e43d7a969bf5d8bb589dd P 8846d581359a4b7ea6d4c33424ea825d: No bootstrap required, opened a new log
I20260709 13:02:47.089401  9369 ts_tablet_manager.cc:1403] T 5f076a85481e43d7a969bf5d8bb589dd P 8846d581359a4b7ea6d4c33424ea825d: Time spent bootstrapping tablet: real 0.136s	user 0.013s	sys 0.002s
I20260709 13:02:47.093454  9372 tablet_bootstrap.cc:492] T 5ce2a33a3b914f6297946ded34c256bf P 65ed95869fbb4b69b5d6eb99c51adf85: No bootstrap required, opened a new log
I20260709 13:02:47.094043  9372 ts_tablet_manager.cc:1403] T 5ce2a33a3b914f6297946ded34c256bf P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent bootstrapping tablet: real 0.067s	user 0.006s	sys 0.006s
I20260709 13:02:47.095852  9248 raft_consensus.cc:2468] T 69a5fd219b1a4d4c94b346f38909f024 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c694531b0e1d47988b291f1214efc4cb in term 1.
I20260709 13:02:47.095623  8997 catalog_manager.cc:5697] T 53bdda361da242a1b37aa013fad1ee60 P c694531b0e1d47988b291f1214efc4cb reported cstate change: term changed from 0 to 1, leader changed from <none> to c694531b0e1d47988b291f1214efc4cb (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c694531b0e1d47988b291f1214efc4cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:47.097010  9372 raft_consensus.cc:359] T 5ce2a33a3b914f6297946ded34c256bf P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:47.097419  9139 leader_election.cc:304] T 69a5fd219b1a4d4c94b346f38909f024 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8846d581359a4b7ea6d4c33424ea825d, c694531b0e1d47988b291f1214efc4cb; no voters: 
I20260709 13:02:47.098420  9476 raft_consensus.cc:2804] T 69a5fd219b1a4d4c94b346f38909f024 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:47.098915  9476 raft_consensus.cc:697] T 69a5fd219b1a4d4c94b346f38909f024 P c694531b0e1d47988b291f1214efc4cb [term 1 LEADER]: Becoming Leader. State: Replica: c694531b0e1d47988b291f1214efc4cb, State: Running, Role: LEADER
I20260709 13:02:47.099014  9408 leader_election.cc:290] T 69a5fd219b1a4d4c94b346f38909f024 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 election: Requested vote from peers 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311), 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351)
I20260709 13:02:47.099748  9476 consensus_queue.cc:237] T 69a5fd219b1a4d4c94b346f38909f024 P c694531b0e1d47988b291f1214efc4cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:47.093739  8998 catalog_manager.cc:5697] T 51a2ca964a8f4fb89b26d77b1b334f30 P 74ac2cf163ee475e8a280cb3aa738f57 reported cstate change: term changed from 0 to 1, leader changed from <none> to 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "74ac2cf163ee475e8a280cb3aa738f57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:47.102819  9372 raft_consensus.cc:385] T 5ce2a33a3b914f6297946ded34c256bf P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:47.100521  9369 raft_consensus.cc:359] T 5f076a85481e43d7a969bf5d8bb589dd P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:47.104952  9372 raft_consensus.cc:740] T 5ce2a33a3b914f6297946ded34c256bf P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Initialized, Role: FOLLOWER
I20260709 13:02:47.105059  9369 raft_consensus.cc:385] T 5f076a85481e43d7a969bf5d8bb589dd P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:47.103677  9371 tablet_bootstrap.cc:492] T e6ee00de30e149f58789799810d595a4 P c694531b0e1d47988b291f1214efc4cb: No bootstrap required, opened a new log
I20260709 13:02:47.105504  9369 raft_consensus.cc:740] T 5f076a85481e43d7a969bf5d8bb589dd P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8846d581359a4b7ea6d4c33424ea825d, State: Initialized, Role: FOLLOWER
I20260709 13:02:47.105990  9371 ts_tablet_manager.cc:1403] T e6ee00de30e149f58789799810d595a4 P c694531b0e1d47988b291f1214efc4cb: Time spent bootstrapping tablet: real 0.145s	user 0.013s	sys 0.000s
I20260709 13:02:47.105804  9372 consensus_queue.cc:260] T 5ce2a33a3b914f6297946ded34c256bf P 65ed95869fbb4b69b5d6eb99c51adf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:47.106280  9369 consensus_queue.cc:260] T 5f076a85481e43d7a969bf5d8bb589dd P 8846d581359a4b7ea6d4c33424ea825d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:47.108278  9372 ts_tablet_manager.cc:1434] T 5ce2a33a3b914f6297946ded34c256bf P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:02:47.108349  9369 ts_tablet_manager.cc:1434] T 5f076a85481e43d7a969bf5d8bb589dd P 8846d581359a4b7ea6d4c33424ea825d: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:02:47.109215  9369 tablet_bootstrap.cc:492] T 0effc3d52a6d43ef8aa59821958f4e52 P 8846d581359a4b7ea6d4c33424ea825d: Bootstrap starting.
I20260709 13:02:47.109661  9372 tablet_bootstrap.cc:492] T d3044a44ee984c489779dc339d162407 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap starting.
I20260709 13:02:47.104045  9370 tablet_bootstrap.cc:492] T 3899ef948b2e405baaccb81544b7f58b P 74ac2cf163ee475e8a280cb3aa738f57: No bootstrap required, opened a new log
I20260709 13:02:47.110587  9370 ts_tablet_manager.cc:1403] T 3899ef948b2e405baaccb81544b7f58b P 74ac2cf163ee475e8a280cb3aa738f57: Time spent bootstrapping tablet: real 0.226s	user 0.013s	sys 0.001s
I20260709 13:02:47.105017  9322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69a5fd219b1a4d4c94b346f38909f024" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57"
I20260709 13:02:47.114444  9322 raft_consensus.cc:3060] T 69a5fd219b1a4d4c94b346f38909f024 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:47.116142  9372 tablet_bootstrap.cc:654] T d3044a44ee984c489779dc339d162407 P 65ed95869fbb4b69b5d6eb99c51adf85: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:47.118180  9369 tablet_bootstrap.cc:654] T 0effc3d52a6d43ef8aa59821958f4e52 P 8846d581359a4b7ea6d4c33424ea825d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:47.127511  9372 tablet_bootstrap.cc:492] T d3044a44ee984c489779dc339d162407 P 65ed95869fbb4b69b5d6eb99c51adf85: No bootstrap required, opened a new log
I20260709 13:02:47.128088  9372 ts_tablet_manager.cc:1403] T d3044a44ee984c489779dc339d162407 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.004s
I20260709 13:02:47.125312  9322 raft_consensus.cc:2468] T 69a5fd219b1a4d4c94b346f38909f024 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c694531b0e1d47988b291f1214efc4cb in term 1.
I20260709 13:02:47.120635  8998 catalog_manager.cc:5697] T 3ac2da3cd17d470495fd5fbb986e4936 P 74ac2cf163ee475e8a280cb3aa738f57 reported cstate change: term changed from 0 to 1, leader changed from <none> to 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "74ac2cf163ee475e8a280cb3aa738f57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:47.131201  9372 raft_consensus.cc:359] T d3044a44ee984c489779dc339d162407 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:47.131995  9372 raft_consensus.cc:385] T d3044a44ee984c489779dc339d162407 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:47.132282  9372 raft_consensus.cc:740] T d3044a44ee984c489779dc339d162407 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Initialized, Role: FOLLOWER
I20260709 13:02:47.133175  9372 consensus_queue.cc:260] T d3044a44ee984c489779dc339d162407 P 65ed95869fbb4b69b5d6eb99c51adf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:47.133693  9371 raft_consensus.cc:359] T e6ee00de30e149f58789799810d595a4 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:47.134497  9371 raft_consensus.cc:385] T e6ee00de30e149f58789799810d595a4 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:47.134817  9371 raft_consensus.cc:740] T e6ee00de30e149f58789799810d595a4 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c694531b0e1d47988b291f1214efc4cb, State: Initialized, Role: FOLLOWER
I20260709 13:02:47.135561  9371 consensus_queue.cc:260] T e6ee00de30e149f58789799810d595a4 P c694531b0e1d47988b291f1214efc4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:47.136559  9369 tablet_bootstrap.cc:492] T 0effc3d52a6d43ef8aa59821958f4e52 P 8846d581359a4b7ea6d4c33424ea825d: No bootstrap required, opened a new log
I20260709 13:02:47.136896  9372 ts_tablet_manager.cc:1434] T d3044a44ee984c489779dc339d162407 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:02:47.137249  9369 ts_tablet_manager.cc:1403] T 0effc3d52a6d43ef8aa59821958f4e52 P 8846d581359a4b7ea6d4c33424ea825d: Time spent bootstrapping tablet: real 0.028s	user 0.007s	sys 0.010s
I20260709 13:02:47.137735  9371 ts_tablet_manager.cc:1434] T e6ee00de30e149f58789799810d595a4 P c694531b0e1d47988b291f1214efc4cb: Time spent starting tablet: real 0.031s	user 0.004s	sys 0.000s
I20260709 13:02:47.137949  9372 tablet_bootstrap.cc:492] T d2ef0242573643178d56d10a6c26ae8e P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap starting.
I20260709 13:02:47.138710  9371 tablet_bootstrap.cc:492] T 0effc3d52a6d43ef8aa59821958f4e52 P c694531b0e1d47988b291f1214efc4cb: Bootstrap starting.
I20260709 13:02:47.140422  9369 raft_consensus.cc:359] T 0effc3d52a6d43ef8aa59821958f4e52 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:47.141201  9369 raft_consensus.cc:385] T 0effc3d52a6d43ef8aa59821958f4e52 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:47.141561  9369 raft_consensus.cc:740] T 0effc3d52a6d43ef8aa59821958f4e52 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8846d581359a4b7ea6d4c33424ea825d, State: Initialized, Role: FOLLOWER
I20260709 13:02:47.142442  9369 consensus_queue.cc:260] T 0effc3d52a6d43ef8aa59821958f4e52 P 8846d581359a4b7ea6d4c33424ea825d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:47.113567  9370 raft_consensus.cc:359] T 3899ef948b2e405baaccb81544b7f58b P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:47.143415  9370 raft_consensus.cc:385] T 3899ef948b2e405baaccb81544b7f58b P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:47.143713  9370 raft_consensus.cc:740] T 3899ef948b2e405baaccb81544b7f58b P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74ac2cf163ee475e8a280cb3aa738f57, State: Initialized, Role: FOLLOWER
I20260709 13:02:47.144423  9370 consensus_queue.cc:260] T 3899ef948b2e405baaccb81544b7f58b P 74ac2cf163ee475e8a280cb3aa738f57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:47.144886  9369 ts_tablet_manager.cc:1434] T 0effc3d52a6d43ef8aa59821958f4e52 P 8846d581359a4b7ea6d4c33424ea825d: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:02:47.144937  9372 tablet_bootstrap.cc:654] T d2ef0242573643178d56d10a6c26ae8e P 65ed95869fbb4b69b5d6eb99c51adf85: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:47.146283  9369 tablet_bootstrap.cc:492] T 389a20133d8b4ebfaab346741dff367f P 8846d581359a4b7ea6d4c33424ea825d: Bootstrap starting.
I20260709 13:02:47.146522  9370 ts_tablet_manager.cc:1434] T 3899ef948b2e405baaccb81544b7f58b P 74ac2cf163ee475e8a280cb3aa738f57: Time spent starting tablet: real 0.036s	user 0.005s	sys 0.001s
I20260709 13:02:47.153843  9369 tablet_bootstrap.cc:654] T 389a20133d8b4ebfaab346741dff367f P 8846d581359a4b7ea6d4c33424ea825d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:47.157099  9370 tablet_bootstrap.cc:492] T 0a377c4fc6c04b0aa8f74f64f4f59409 P 74ac2cf163ee475e8a280cb3aa738f57: Bootstrap starting.
I20260709 13:02:47.157737  9372 tablet_bootstrap.cc:492] T d2ef0242573643178d56d10a6c26ae8e P 65ed95869fbb4b69b5d6eb99c51adf85: No bootstrap required, opened a new log
I20260709 13:02:47.158358  9372 ts_tablet_manager.cc:1403] T d2ef0242573643178d56d10a6c26ae8e P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent bootstrapping tablet: real 0.021s	user 0.019s	sys 0.000s
I20260709 13:02:47.161208  9372 raft_consensus.cc:359] T d2ef0242573643178d56d10a6c26ae8e P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:47.161664  9377 consensus_queue.cc:1048] T a731a965126b406988eecb7829bc9981 P 8846d581359a4b7ea6d4c33424ea825d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:47.162096  9372 raft_consensus.cc:385] T d2ef0242573643178d56d10a6c26ae8e P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:47.162446  9369 tablet_bootstrap.cc:492] T 389a20133d8b4ebfaab346741dff367f P 8846d581359a4b7ea6d4c33424ea825d: No bootstrap required, opened a new log
I20260709 13:02:47.162444  9372 raft_consensus.cc:740] T d2ef0242573643178d56d10a6c26ae8e P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Initialized, Role: FOLLOWER
I20260709 13:02:47.163113  9369 ts_tablet_manager.cc:1403] T 389a20133d8b4ebfaab346741dff367f P 8846d581359a4b7ea6d4c33424ea825d: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.000s
I20260709 13:02:47.163486  9372 consensus_queue.cc:260] T d2ef0242573643178d56d10a6c26ae8e P 65ed95869fbb4b69b5d6eb99c51adf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:47.166009  9372 ts_tablet_manager.cc:1434] T d2ef0242573643178d56d10a6c26ae8e P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:02:47.166289  9369 raft_consensus.cc:359] T 389a20133d8b4ebfaab346741dff367f P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:47.166785  9371 tablet_bootstrap.cc:654] T 0effc3d52a6d43ef8aa59821958f4e52 P c694531b0e1d47988b291f1214efc4cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:47.166998  9372 tablet_bootstrap.cc:492] T 0effc3d52a6d43ef8aa59821958f4e52 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap starting.
I20260709 13:02:47.167008  9369 raft_consensus.cc:385] T 389a20133d8b4ebfaab346741dff367f P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:47.167536  9369 raft_consensus.cc:740] T 389a20133d8b4ebfaab346741dff367f P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8846d581359a4b7ea6d4c33424ea825d, State: Initialized, Role: FOLLOWER
I20260709 13:02:47.168236  9370 tablet_bootstrap.cc:654] T 0a377c4fc6c04b0aa8f74f64f4f59409 P 74ac2cf163ee475e8a280cb3aa738f57: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:47.168394  9369 consensus_queue.cc:260] T 389a20133d8b4ebfaab346741dff367f P 8846d581359a4b7ea6d4c33424ea825d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:47.170734  9369 ts_tablet_manager.cc:1434] T 389a20133d8b4ebfaab346741dff367f P 8846d581359a4b7ea6d4c33424ea825d: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:02:47.171764  9369 tablet_bootstrap.cc:492] T 53bdda361da242a1b37aa013fad1ee60 P 8846d581359a4b7ea6d4c33424ea825d: Bootstrap starting.
I20260709 13:02:47.173540  9483 consensus_queue.cc:1048] T e6ee00de30e149f58789799810d595a4 P 8846d581359a4b7ea6d4c33424ea825d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:47.177415  9377 raft_consensus.cc:493] T 389a20133d8b4ebfaab346741dff367f P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:47.178215  9369 tablet_bootstrap.cc:654] T 53bdda361da242a1b37aa013fad1ee60 P 8846d581359a4b7ea6d4c33424ea825d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:47.177964  9377 raft_consensus.cc:515] T 389a20133d8b4ebfaab346741dff367f P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:47.180565  9377 leader_election.cc:290] T 389a20133d8b4ebfaab346741dff367f P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979), c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455)
I20260709 13:02:47.181543  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389a20133d8b4ebfaab346741dff367f" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" is_pre_election: true
I20260709 13:02:47.183055  9176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389a20133d8b4ebfaab346741dff367f" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694531b0e1d47988b291f1214efc4cb" is_pre_election: true
W20260709 13:02:47.183534  9215 leader_election.cc:343] T 389a20133d8b4ebfaab346741dff367f P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:47.184953  9214 leader_election.cc:343] T 389a20133d8b4ebfaab346741dff367f P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:47.185408  9214 leader_election.cc:304] T 389a20133d8b4ebfaab346741dff367f P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8846d581359a4b7ea6d4c33424ea825d; no voters: 65ed95869fbb4b69b5d6eb99c51adf85, c694531b0e1d47988b291f1214efc4cb
I20260709 13:02:47.189855  9369 tablet_bootstrap.cc:492] T 53bdda361da242a1b37aa013fad1ee60 P 8846d581359a4b7ea6d4c33424ea825d: No bootstrap required, opened a new log
I20260709 13:02:47.190395  9369 ts_tablet_manager.cc:1403] T 53bdda361da242a1b37aa013fad1ee60 P 8846d581359a4b7ea6d4c33424ea825d: Time spent bootstrapping tablet: real 0.019s	user 0.005s	sys 0.011s
I20260709 13:02:47.190780  9377 raft_consensus.cc:2749] T 389a20133d8b4ebfaab346741dff367f P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:47.193408  9369 raft_consensus.cc:359] T 53bdda361da242a1b37aa013fad1ee60 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:47.194501  9369 raft_consensus.cc:385] T 53bdda361da242a1b37aa013fad1ee60 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:47.194991  9369 raft_consensus.cc:740] T 53bdda361da242a1b37aa013fad1ee60 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8846d581359a4b7ea6d4c33424ea825d, State: Initialized, Role: FOLLOWER
I20260709 13:02:47.195910  9369 consensus_queue.cc:260] T 53bdda361da242a1b37aa013fad1ee60 P 8846d581359a4b7ea6d4c33424ea825d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:47.197933  9369 ts_tablet_manager.cc:1434] T 53bdda361da242a1b37aa013fad1ee60 P 8846d581359a4b7ea6d4c33424ea825d: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:02:47.198390  9372 tablet_bootstrap.cc:654] T 0effc3d52a6d43ef8aa59821958f4e52 P 65ed95869fbb4b69b5d6eb99c51adf85: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:47.172187  8997 catalog_manager.cc:5697] T 5cea8a8078e8456186d4d1a184d3f157 P c694531b0e1d47988b291f1214efc4cb reported cstate change: term changed from 0 to 1, leader changed from <none> to c694531b0e1d47988b291f1214efc4cb (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c694531b0e1d47988b291f1214efc4cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:47.199097  9369 tablet_bootstrap.cc:492] T 0a377c4fc6c04b0aa8f74f64f4f59409 P 8846d581359a4b7ea6d4c33424ea825d: Bootstrap starting.
I20260709 13:02:47.200433  8997 catalog_manager.cc:5697] T 69a5fd219b1a4d4c94b346f38909f024 P c694531b0e1d47988b291f1214efc4cb reported cstate change: term changed from 0 to 1, leader changed from <none> to c694531b0e1d47988b291f1214efc4cb (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c694531b0e1d47988b291f1214efc4cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:47.205236  9369 tablet_bootstrap.cc:654] T 0a377c4fc6c04b0aa8f74f64f4f59409 P 8846d581359a4b7ea6d4c33424ea825d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:47.214740  9372 tablet_bootstrap.cc:492] T 0effc3d52a6d43ef8aa59821958f4e52 P 65ed95869fbb4b69b5d6eb99c51adf85: No bootstrap required, opened a new log
I20260709 13:02:47.219446  9372 ts_tablet_manager.cc:1403] T 0effc3d52a6d43ef8aa59821958f4e52 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent bootstrapping tablet: real 0.053s	user 0.013s	sys 0.004s
I20260709 13:02:47.221701  9464 raft_consensus.cc:493] T d2ef0242573643178d56d10a6c26ae8e P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:47.222306  9372 raft_consensus.cc:359] T 0effc3d52a6d43ef8aa59821958f4e52 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:47.223069  9372 raft_consensus.cc:385] T 0effc3d52a6d43ef8aa59821958f4e52 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:47.223328  9372 raft_consensus.cc:740] T 0effc3d52a6d43ef8aa59821958f4e52 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Initialized, Role: FOLLOWER
I20260709 13:02:47.221062  9371 tablet_bootstrap.cc:492] T 0effc3d52a6d43ef8aa59821958f4e52 P c694531b0e1d47988b291f1214efc4cb: No bootstrap required, opened a new log
I20260709 13:02:47.223968  9372 consensus_queue.cc:260] T 0effc3d52a6d43ef8aa59821958f4e52 P 65ed95869fbb4b69b5d6eb99c51adf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:47.225116  9483 consensus_queue.cc:1048] T a731a965126b406988eecb7829bc9981 P 8846d581359a4b7ea6d4c33424ea825d [LEADER]: Connected to new peer: Peer: permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:47.226096  9372 ts_tablet_manager.cc:1434] T 0effc3d52a6d43ef8aa59821958f4e52 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:02:47.224606  9371 ts_tablet_manager.cc:1403] T 0effc3d52a6d43ef8aa59821958f4e52 P c694531b0e1d47988b291f1214efc4cb: Time spent bootstrapping tablet: real 0.086s	user 0.009s	sys 0.002s
I20260709 13:02:47.229014  9371 raft_consensus.cc:359] T 0effc3d52a6d43ef8aa59821958f4e52 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:47.229691  9371 raft_consensus.cc:385] T 0effc3d52a6d43ef8aa59821958f4e52 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:47.229966  9371 raft_consensus.cc:740] T 0effc3d52a6d43ef8aa59821958f4e52 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c694531b0e1d47988b291f1214efc4cb, State: Initialized, Role: FOLLOWER
I20260709 13:02:47.230083  9372 tablet_bootstrap.cc:492] T 059a6a9a07d74be4a9f3854317b870ab P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap starting.
I20260709 13:02:47.222203  9464 raft_consensus.cc:515] T d2ef0242573643178d56d10a6c26ae8e P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:47.230648  9371 consensus_queue.cc:260] T 0effc3d52a6d43ef8aa59821958f4e52 P c694531b0e1d47988b291f1214efc4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:47.235090  9371 ts_tablet_manager.cc:1434] T 0effc3d52a6d43ef8aa59821958f4e52 P c694531b0e1d47988b291f1214efc4cb: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:02:47.234400  9323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2ef0242573643178d56d10a6c26ae8e" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57" is_pre_election: true
I20260709 13:02:47.235761  9323 raft_consensus.cc:2468] T d2ef0242573643178d56d10a6c26ae8e P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65ed95869fbb4b69b5d6eb99c51adf85 in term 0.
I20260709 13:02:47.236267  9371 tablet_bootstrap.cc:492] T d2ef0242573643178d56d10a6c26ae8e P c694531b0e1d47988b291f1214efc4cb: Bootstrap starting.
I20260709 13:02:47.237501  9372 tablet_bootstrap.cc:654] T 059a6a9a07d74be4a9f3854317b870ab P 65ed95869fbb4b69b5d6eb99c51adf85: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:47.237255  9066 leader_election.cc:304] T d2ef0242573643178d56d10a6c26ae8e P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65ed95869fbb4b69b5d6eb99c51adf85, 74ac2cf163ee475e8a280cb3aa738f57; no voters: 
I20260709 13:02:47.232946  9464 leader_election.cc:290] T d2ef0242573643178d56d10a6c26ae8e P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351), c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455)
I20260709 13:02:47.238813  9464 raft_consensus.cc:2804] T d2ef0242573643178d56d10a6c26ae8e P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:47.239405  9464 raft_consensus.cc:493] T d2ef0242573643178d56d10a6c26ae8e P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:47.239820  9464 raft_consensus.cc:3060] T d2ef0242573643178d56d10a6c26ae8e P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:47.237717  9176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2ef0242573643178d56d10a6c26ae8e" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694531b0e1d47988b291f1214efc4cb" is_pre_election: true
W20260709 13:02:47.244361  9065 leader_election.cc:343] T d2ef0242573643178d56d10a6c26ae8e P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:47.245215  9369 tablet_bootstrap.cc:492] T 0a377c4fc6c04b0aa8f74f64f4f59409 P 8846d581359a4b7ea6d4c33424ea825d: No bootstrap required, opened a new log
I20260709 13:02:47.245713  9369 ts_tablet_manager.cc:1403] T 0a377c4fc6c04b0aa8f74f64f4f59409 P 8846d581359a4b7ea6d4c33424ea825d: Time spent bootstrapping tablet: real 0.047s	user 0.009s	sys 0.003s
I20260709 13:02:47.248371  9369 raft_consensus.cc:359] T 0a377c4fc6c04b0aa8f74f64f4f59409 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:47.249061  9369 raft_consensus.cc:385] T 0a377c4fc6c04b0aa8f74f64f4f59409 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:47.249336  9369 raft_consensus.cc:740] T 0a377c4fc6c04b0aa8f74f64f4f59409 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8846d581359a4b7ea6d4c33424ea825d, State: Initialized, Role: FOLLOWER
I20260709 13:02:47.250057  9369 consensus_queue.cc:260] T 0a377c4fc6c04b0aa8f74f64f4f59409 P 8846d581359a4b7ea6d4c33424ea825d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:47.251010  9370 tablet_bootstrap.cc:492] T 0a377c4fc6c04b0aa8f74f64f4f59409 P 74ac2cf163ee475e8a280cb3aa738f57: No bootstrap required, opened a new log
I20260709 13:02:47.251533  9370 ts_tablet_manager.cc:1403] T 0a377c4fc6c04b0aa8f74f64f4f59409 P 74ac2cf163ee475e8a280cb3aa738f57: Time spent bootstrapping tablet: real 0.104s	user 0.012s	sys 0.000s
I20260709 13:02:47.252233  9369 ts_tablet_manager.cc:1434] T 0a377c4fc6c04b0aa8f74f64f4f59409 P 8846d581359a4b7ea6d4c33424ea825d: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:02:47.254302  9370 raft_consensus.cc:359] T 0a377c4fc6c04b0aa8f74f64f4f59409 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:47.255378  9370 raft_consensus.cc:385] T 0a377c4fc6c04b0aa8f74f64f4f59409 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:47.255702  9370 raft_consensus.cc:740] T 0a377c4fc6c04b0aa8f74f64f4f59409 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74ac2cf163ee475e8a280cb3aa738f57, State: Initialized, Role: FOLLOWER
I20260709 13:02:47.256446  9370 consensus_queue.cc:260] T 0a377c4fc6c04b0aa8f74f64f4f59409 P 74ac2cf163ee475e8a280cb3aa738f57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:47.257284  9371 tablet_bootstrap.cc:654] T d2ef0242573643178d56d10a6c26ae8e P c694531b0e1d47988b291f1214efc4cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:47.262432  9483 consensus_queue.cc:1048] T ea3bb46b177b4bbdaa60f464370aa9a0 P 8846d581359a4b7ea6d4c33424ea825d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:47.264076  9483 consensus_queue.cc:1048] T ea3bb46b177b4bbdaa60f464370aa9a0 P 8846d581359a4b7ea6d4c33424ea825d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:47.266444  9370 ts_tablet_manager.cc:1434] T 0a377c4fc6c04b0aa8f74f64f4f59409 P 74ac2cf163ee475e8a280cb3aa738f57: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:02:47.268107  9369 tablet_bootstrap.cc:492] T 989e9796152e4796a3408e00419403fa P 8846d581359a4b7ea6d4c33424ea825d: Bootstrap starting.
I20260709 13:02:47.267997  9452 consensus_queue.cc:1048] T e6797c587fdc4754b091a2be102e5927 P 65ed95869fbb4b69b5d6eb99c51adf85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:47.269937  9370 tablet_bootstrap.cc:492] T 5ce2a33a3b914f6297946ded34c256bf P 74ac2cf163ee475e8a280cb3aa738f57: Bootstrap starting.
I20260709 13:02:47.275352  9369 tablet_bootstrap.cc:654] T 989e9796152e4796a3408e00419403fa P 8846d581359a4b7ea6d4c33424ea825d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:47.286244  9409 raft_consensus.cc:493] T 0effc3d52a6d43ef8aa59821958f4e52 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:47.287256  9409 raft_consensus.cc:515] T 0effc3d52a6d43ef8aa59821958f4e52 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:47.291282  9175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0effc3d52a6d43ef8aa59821958f4e52" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694531b0e1d47988b291f1214efc4cb" is_pre_election: true
I20260709 13:02:47.292095  9175 raft_consensus.cc:2468] T 0effc3d52a6d43ef8aa59821958f4e52 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8846d581359a4b7ea6d4c33424ea825d in term 0.
I20260709 13:02:47.294286  9370 tablet_bootstrap.cc:654] T 5ce2a33a3b914f6297946ded34c256bf P 74ac2cf163ee475e8a280cb3aa738f57: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:47.297775  9462 raft_consensus.cc:493] T 3899ef948b2e405baaccb81544b7f58b P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:47.298923  9462 raft_consensus.cc:515] T 3899ef948b2e405baaccb81544b7f58b P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:47.299871  9214 leader_election.cc:304] T 0effc3d52a6d43ef8aa59821958f4e52 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8846d581359a4b7ea6d4c33424ea825d, c694531b0e1d47988b291f1214efc4cb; no voters: 
I20260709 13:02:47.302208  9377 raft_consensus.cc:2804] T 0effc3d52a6d43ef8aa59821958f4e52 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:47.304421  9377 raft_consensus.cc:493] T 0effc3d52a6d43ef8aa59821958f4e52 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:47.304715  9377 raft_consensus.cc:3060] T 0effc3d52a6d43ef8aa59821958f4e52 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:47.304833  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3899ef948b2e405baaccb81544b7f58b" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" is_pre_election: true
W20260709 13:02:47.306558  9289 leader_election.cc:343] T 3899ef948b2e405baaccb81544b7f58b P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:47.307979  9462 leader_election.cc:290] T 3899ef948b2e405baaccb81544b7f58b P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979), c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455)
W20260709 13:02:47.308802  9288 consensus_peers.cc:597] T dbdc8579cca94ef7ab4babd287837e8c P 74ac2cf163ee475e8a280cb3aa738f57 -> Peer c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455): Couldn't send request to peer c694531b0e1d47988b291f1214efc4cb. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:47.310519  9175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3899ef948b2e405baaccb81544b7f58b" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694531b0e1d47988b291f1214efc4cb" is_pre_election: true
I20260709 13:02:47.312809  9377 raft_consensus.cc:515] T 0effc3d52a6d43ef8aa59821958f4e52 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:47.313894  9369 tablet_bootstrap.cc:492] T 989e9796152e4796a3408e00419403fa P 8846d581359a4b7ea6d4c33424ea825d: No bootstrap required, opened a new log
I20260709 13:02:47.313948  9372 tablet_bootstrap.cc:492] T 059a6a9a07d74be4a9f3854317b870ab P 65ed95869fbb4b69b5d6eb99c51adf85: No bootstrap required, opened a new log
I20260709 13:02:47.314630  9372 ts_tablet_manager.cc:1403] T 059a6a9a07d74be4a9f3854317b870ab P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent bootstrapping tablet: real 0.085s	user 0.035s	sys 0.048s
I20260709 13:02:47.314512  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0effc3d52a6d43ef8aa59821958f4e52" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" is_pre_election: true
I20260709 13:02:47.315379  9100 raft_consensus.cc:2468] T 0effc3d52a6d43ef8aa59821958f4e52 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8846d581359a4b7ea6d4c33424ea825d in term 0.
I20260709 13:02:47.315800  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0effc3d52a6d43ef8aa59821958f4e52" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85"
I20260709 13:02:47.316393  9099 raft_consensus.cc:3060] T 0effc3d52a6d43ef8aa59821958f4e52 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:47.317144  9371 tablet_bootstrap.cc:492] T d2ef0242573643178d56d10a6c26ae8e P c694531b0e1d47988b291f1214efc4cb: No bootstrap required, opened a new log
I20260709 13:02:47.317808  9371 ts_tablet_manager.cc:1403] T d2ef0242573643178d56d10a6c26ae8e P c694531b0e1d47988b291f1214efc4cb: Time spent bootstrapping tablet: real 0.082s	user 0.020s	sys 0.012s
I20260709 13:02:47.317457  9372 raft_consensus.cc:359] T 059a6a9a07d74be4a9f3854317b870ab P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:47.318182  9372 raft_consensus.cc:385] T 059a6a9a07d74be4a9f3854317b870ab P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:47.318464  9372 raft_consensus.cc:740] T 059a6a9a07d74be4a9f3854317b870ab P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Initialized, Role: FOLLOWER
I20260709 13:02:47.318516  9452 consensus_queue.cc:1048] T e6797c587fdc4754b091a2be102e5927 P 65ed95869fbb4b69b5d6eb99c51adf85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:47.319182  9372 consensus_queue.cc:260] T 059a6a9a07d74be4a9f3854317b870ab P 65ed95869fbb4b69b5d6eb99c51adf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:47.320932  9483 raft_consensus.cc:493] T 53bdda361da242a1b37aa013fad1ee60 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:47.321571  9372 ts_tablet_manager.cc:1434] T 059a6a9a07d74be4a9f3854317b870ab P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:02:47.314541  9369 ts_tablet_manager.cc:1403] T 989e9796152e4796a3408e00419403fa P 8846d581359a4b7ea6d4c33424ea825d: Time spent bootstrapping tablet: real 0.047s	user 0.009s	sys 0.011s
I20260709 13:02:47.322640  9372 tablet_bootstrap.cc:492] T 0a377c4fc6c04b0aa8f74f64f4f59409 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap starting.
I20260709 13:02:47.320655  9371 raft_consensus.cc:359] T d2ef0242573643178d56d10a6c26ae8e P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:47.323323  9371 raft_consensus.cc:385] T d2ef0242573643178d56d10a6c26ae8e P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:47.323622  9371 raft_consensus.cc:740] T d2ef0242573643178d56d10a6c26ae8e P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c694531b0e1d47988b291f1214efc4cb, State: Initialized, Role: FOLLOWER
I20260709 13:02:47.325188  9369 raft_consensus.cc:359] T 989e9796152e4796a3408e00419403fa P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:47.329185  9372 tablet_bootstrap.cc:654] T 0a377c4fc6c04b0aa8f74f64f4f59409 P 65ed95869fbb4b69b5d6eb99c51adf85: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:47.329686  9174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0effc3d52a6d43ef8aa59821958f4e52" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694531b0e1d47988b291f1214efc4cb"
W20260709 13:02:47.316408  9288 leader_election.cc:343] T 3899ef948b2e405baaccb81544b7f58b P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:47.325924  9249 raft_consensus.cc:1275] T b3f19df7d93748a1802678c56b5e2208 P 8846d581359a4b7ea6d4c33424ea825d [term 2 FOLLOWER]: Refusing update from remote peer 65ed95869fbb4b69b5d6eb99c51adf85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260709 13:02:47.330802  9249 pending_rounds.cc:85] T b3f19df7d93748a1802678c56b5e2208 P 8846d581359a4b7ea6d4c33424ea825d: Aborting all ops after (but not including) 0
I20260709 13:02:47.330770  9288 leader_election.cc:304] T 3899ef948b2e405baaccb81544b7f58b P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57; no voters: 65ed95869fbb4b69b5d6eb99c51adf85, c694531b0e1d47988b291f1214efc4cb
I20260709 13:02:47.331218  9249 pending_rounds.cc:107] T b3f19df7d93748a1802678c56b5e2208 P 8846d581359a4b7ea6d4c33424ea825d: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:02:47.331511  9249 raft_consensus.cc:2889] T b3f19df7d93748a1802678c56b5e2208 P 8846d581359a4b7ea6d4c33424ea825d [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:47.321511  9483 raft_consensus.cc:515] T 53bdda361da242a1b37aa013fad1ee60 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:47.329185  9369 raft_consensus.cc:385] T 989e9796152e4796a3408e00419403fa P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:47.330322  9174 raft_consensus.cc:3060] T 0effc3d52a6d43ef8aa59821958f4e52 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:47.327229  9371 consensus_queue.cc:260] T d2ef0242573643178d56d10a6c26ae8e P c694531b0e1d47988b291f1214efc4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:47.332569  9369 raft_consensus.cc:740] T 989e9796152e4796a3408e00419403fa P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8846d581359a4b7ea6d4c33424ea825d, State: Initialized, Role: FOLLOWER
I20260709 13:02:47.333323  9369 consensus_queue.cc:260] T 989e9796152e4796a3408e00419403fa P 8846d581359a4b7ea6d4c33424ea825d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:47.335048  9173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53bdda361da242a1b37aa013fad1ee60" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694531b0e1d47988b291f1214efc4cb" is_pre_election: true
I20260709 13:02:47.334887  9371 ts_tablet_manager.cc:1434] T d2ef0242573643178d56d10a6c26ae8e P c694531b0e1d47988b291f1214efc4cb: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.001s
I20260709 13:02:47.337574  9371 tablet_bootstrap.cc:492] T 3899ef948b2e405baaccb81544b7f58b P c694531b0e1d47988b291f1214efc4cb: Bootstrap starting.
I20260709 13:02:47.338145  9483 leader_election.cc:290] T 53bdda361da242a1b37aa013fad1ee60 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455), 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351)
I20260709 13:02:47.339444  9452 consensus_queue.cc:1048] T b3f19df7d93748a1802678c56b5e2208 P 65ed95869fbb4b69b5d6eb99c51adf85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:47.341212  9323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53bdda361da242a1b37aa013fad1ee60" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57" is_pre_election: true
I20260709 13:02:47.351965  9370 tablet_bootstrap.cc:492] T 5ce2a33a3b914f6297946ded34c256bf P 74ac2cf163ee475e8a280cb3aa738f57: No bootstrap required, opened a new log
I20260709 13:02:47.352397  9323 raft_consensus.cc:2393] T 53bdda361da242a1b37aa013fad1ee60 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8846d581359a4b7ea6d4c33424ea825d in current term 1: Already voted for candidate c694531b0e1d47988b291f1214efc4cb in this term.
I20260709 13:02:47.332078  9462 raft_consensus.cc:2749] T 3899ef948b2e405baaccb81544b7f58b P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:47.335342  9369 ts_tablet_manager.cc:1434] T 989e9796152e4796a3408e00419403fa P 8846d581359a4b7ea6d4c33424ea825d: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:02:47.344427  9174 raft_consensus.cc:2468] T 0effc3d52a6d43ef8aa59821958f4e52 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8846d581359a4b7ea6d4c33424ea825d in term 1.
I20260709 13:02:47.355253  9369 tablet_bootstrap.cc:492] T 059a6a9a07d74be4a9f3854317b870ab P 8846d581359a4b7ea6d4c33424ea825d: Bootstrap starting.
I20260709 13:02:47.355422  9215 leader_election.cc:304] T 53bdda361da242a1b37aa013fad1ee60 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8846d581359a4b7ea6d4c33424ea825d; no voters: 74ac2cf163ee475e8a280cb3aa738f57, c694531b0e1d47988b291f1214efc4cb
I20260709 13:02:47.327550  9099 raft_consensus.cc:2468] T 0effc3d52a6d43ef8aa59821958f4e52 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8846d581359a4b7ea6d4c33424ea825d in term 1.
I20260709 13:02:47.347568  9409 leader_election.cc:290] T 0effc3d52a6d43ef8aa59821958f4e52 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979), c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455)
I20260709 13:02:47.357352  9409 raft_consensus.cc:3060] T 53bdda361da242a1b37aa013fad1ee60 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:47.344866  9377 leader_election.cc:290] T 0effc3d52a6d43ef8aa59821958f4e52 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 election: Requested vote from peers 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979), c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455)
I20260709 13:02:47.360225  9215 leader_election.cc:304] T 0effc3d52a6d43ef8aa59821958f4e52 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65ed95869fbb4b69b5d6eb99c51adf85, 8846d581359a4b7ea6d4c33424ea825d; no voters: 
I20260709 13:02:47.361147  9377 raft_consensus.cc:2804] T 0effc3d52a6d43ef8aa59821958f4e52 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:47.361709  9377 raft_consensus.cc:697] T 0effc3d52a6d43ef8aa59821958f4e52 P 8846d581359a4b7ea6d4c33424ea825d [term 1 LEADER]: Becoming Leader. State: Replica: 8846d581359a4b7ea6d4c33424ea825d, State: Running, Role: LEADER
I20260709 13:02:47.362610  9377 consensus_queue.cc:237] T 0effc3d52a6d43ef8aa59821958f4e52 P 8846d581359a4b7ea6d4c33424ea825d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:47.363128  9473 consensus_queue.cc:1048] T eb666e221e5f4e4fbaba194838a28448 P c694531b0e1d47988b291f1214efc4cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:47.352458  9370 ts_tablet_manager.cc:1403] T 5ce2a33a3b914f6297946ded34c256bf P 74ac2cf163ee475e8a280cb3aa738f57: Time spent bootstrapping tablet: real 0.083s	user 0.016s	sys 0.004s
I20260709 13:02:47.370611  9462 consensus_queue.cc:1048] T 3ac2da3cd17d470495fd5fbb986e4936 P 74ac2cf163ee475e8a280cb3aa738f57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:47.373126  9452 raft_consensus.cc:493] T d3044a44ee984c489779dc339d162407 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:47.373631  9370 raft_consensus.cc:359] T 5ce2a33a3b914f6297946ded34c256bf P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:47.374351  9370 raft_consensus.cc:385] T 5ce2a33a3b914f6297946ded34c256bf P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:47.374594  9370 raft_consensus.cc:740] T 5ce2a33a3b914f6297946ded34c256bf P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74ac2cf163ee475e8a280cb3aa738f57, State: Initialized, Role: FOLLOWER
I20260709 13:02:47.373687  9452 raft_consensus.cc:515] T d3044a44ee984c489779dc339d162407 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:47.378284  9452 leader_election.cc:290] T d3044a44ee984c489779dc339d162407 P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311), 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351)
I20260709 13:02:47.379108  9458 raft_consensus.cc:493] T 989e9796152e4796a3408e00419403fa P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:47.379683  9458 raft_consensus.cc:515] T 989e9796152e4796a3408e00419403fa P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:47.375277  9370 consensus_queue.cc:260] T 5ce2a33a3b914f6297946ded34c256bf P 74ac2cf163ee475e8a280cb3aa738f57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:47.382007  9458 leader_election.cc:290] T 989e9796152e4796a3408e00419403fa P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455), 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351)
I20260709 13:02:47.383885  9250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3044a44ee984c489779dc339d162407" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d" is_pre_election: true
I20260709 13:02:47.385275  9323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "989e9796152e4796a3408e00419403fa" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57" is_pre_election: true
W20260709 13:02:47.385504  9064 leader_election.cc:343] T d3044a44ee984c489779dc339d162407 P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:47.386899  9215 leader_election.cc:343] T 989e9796152e4796a3408e00419403fa P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:47.386835  9323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3044a44ee984c489779dc339d162407" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57" is_pre_election: true
I20260709 13:02:47.385275  9370 ts_tablet_manager.cc:1434] T 5ce2a33a3b914f6297946ded34c256bf P 74ac2cf163ee475e8a280cb3aa738f57: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:02:47.389964  9370 tablet_bootstrap.cc:492] T eab411e3927a434ab647aa9b31fcf60d P 74ac2cf163ee475e8a280cb3aa738f57: Bootstrap starting.
I20260709 13:02:47.394381  9473 consensus_queue.cc:1048] T 53bdda361da242a1b37aa013fad1ee60 P c694531b0e1d47988b291f1214efc4cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:47.400055  9457 raft_consensus.cc:493] T d2ef0242573643178d56d10a6c26ae8e P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:47.400565  9457 raft_consensus.cc:515] T d2ef0242573643178d56d10a6c26ae8e P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:47.402559  9457 leader_election.cc:290] T d2ef0242573643178d56d10a6c26ae8e P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351), 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979)
I20260709 13:02:47.410509  9321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2ef0242573643178d56d10a6c26ae8e" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57" is_pre_election: true
I20260709 13:02:47.411193  9321 raft_consensus.cc:2468] T d2ef0242573643178d56d10a6c26ae8e P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c694531b0e1d47988b291f1214efc4cb in term 0.
W20260709 13:02:47.410349  9066 leader_election.cc:343] T d3044a44ee984c489779dc339d162407 P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:47.416951  9066 leader_election.cc:304] T d3044a44ee984c489779dc339d162407 P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65ed95869fbb4b69b5d6eb99c51adf85; no voters: 74ac2cf163ee475e8a280cb3aa738f57, 8846d581359a4b7ea6d4c33424ea825d
I20260709 13:02:47.419754  9465 raft_consensus.cc:493] T 059a6a9a07d74be4a9f3854317b870ab P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:47.379098  9371 tablet_bootstrap.cc:654] T 3899ef948b2e405baaccb81544b7f58b P c694531b0e1d47988b291f1214efc4cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:47.431949  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2ef0242573643178d56d10a6c26ae8e" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" is_pre_election: true
I20260709 13:02:47.435217  9452 raft_consensus.cc:2749] T d3044a44ee984c489779dc339d162407 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:47.407817  9464 raft_consensus.cc:515] T d2ef0242573643178d56d10a6c26ae8e P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:47.420244  9465 raft_consensus.cc:515] T 059a6a9a07d74be4a9f3854317b870ab P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:47.437585  9175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "989e9796152e4796a3408e00419403fa" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694531b0e1d47988b291f1214efc4cb" is_pre_election: true
I20260709 13:02:47.446293  9175 raft_consensus.cc:2468] T 989e9796152e4796a3408e00419403fa P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8846d581359a4b7ea6d4c33424ea825d in term 0.
I20260709 13:02:47.447520  9465 leader_election.cc:290] T 059a6a9a07d74be4a9f3854317b870ab P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455), 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311)
I20260709 13:02:47.449265  9214 leader_election.cc:304] T 989e9796152e4796a3408e00419403fa P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8846d581359a4b7ea6d4c33424ea825d, c694531b0e1d47988b291f1214efc4cb; no voters: 74ac2cf163ee475e8a280cb3aa738f57
I20260709 13:02:47.449542  9462 consensus_queue.cc:1048] T 3ac2da3cd17d470495fd5fbb986e4936 P 74ac2cf163ee475e8a280cb3aa738f57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:47.450618  9481 raft_consensus.cc:2804] T 989e9796152e4796a3408e00419403fa P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:47.451004  9481 raft_consensus.cc:493] T 989e9796152e4796a3408e00419403fa P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:47.451313  9481 raft_consensus.cc:3060] T 989e9796152e4796a3408e00419403fa P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:47.451967  9248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "059a6a9a07d74be4a9f3854317b870ab" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d" is_pre_election: true
I20260709 13:02:47.455217  9412 consensus_queue.cc:1048] T dbdc8579cca94ef7ab4babd287837e8c P 74ac2cf163ee475e8a280cb3aa738f57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:02:47.460701  9064 leader_election.cc:343] T 059a6a9a07d74be4a9f3854317b870ab P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:47.461084  9370 tablet_bootstrap.cc:654] T eab411e3927a434ab647aa9b31fcf60d P 74ac2cf163ee475e8a280cb3aa738f57: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:47.440789  9483 raft_consensus.cc:493] T 0a377c4fc6c04b0aa8f74f64f4f59409 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:47.468616  9483 raft_consensus.cc:515] T 0a377c4fc6c04b0aa8f74f64f4f59409 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:47.445397  9369 tablet_bootstrap.cc:654] T 059a6a9a07d74be4a9f3854317b870ab P 8846d581359a4b7ea6d4c33424ea825d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:47.491303  9372 tablet_bootstrap.cc:492] T 0a377c4fc6c04b0aa8f74f64f4f59409 P 65ed95869fbb4b69b5d6eb99c51adf85: No bootstrap required, opened a new log
I20260709 13:02:47.493397  9098 raft_consensus.cc:2393] T d2ef0242573643178d56d10a6c26ae8e P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c694531b0e1d47988b291f1214efc4cb in current term 1: Already voted for candidate 65ed95869fbb4b69b5d6eb99c51adf85 in this term.
I20260709 13:02:47.447434  9141 leader_election.cc:304] T d2ef0242573643178d56d10a6c26ae8e P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57, c694531b0e1d47988b291f1214efc4cb; no voters: 
W20260709 13:02:47.441689  9047 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:47.498410  9372 ts_tablet_manager.cc:1403] T 0a377c4fc6c04b0aa8f74f64f4f59409 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent bootstrapping tablet: real 0.176s	user 0.043s	sys 0.041s
I20260709 13:02:47.494216  9409 raft_consensus.cc:2749] T 53bdda361da242a1b37aa013fad1ee60 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:47.515770  9457 raft_consensus.cc:2804] T d2ef0242573643178d56d10a6c26ae8e P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:47.535748  9457 raft_consensus.cc:493] T d2ef0242573643178d56d10a6c26ae8e P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:47.536186  9457 raft_consensus.cc:3060] T d2ef0242573643178d56d10a6c26ae8e P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:47.512079  9141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:44351, user_credentials={real_user=slave}} blocked reactor thread for 64705.1us
I20260709 13:02:47.540115  9480 consensus_queue.cc:1048] T eb666e221e5f4e4fbaba194838a28448 P c694531b0e1d47988b291f1214efc4cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:47.541200  9371 tablet_bootstrap.cc:492] T 3899ef948b2e405baaccb81544b7f58b P c694531b0e1d47988b291f1214efc4cb: No bootstrap required, opened a new log
I20260709 13:02:47.541821  9371 ts_tablet_manager.cc:1403] T 3899ef948b2e405baaccb81544b7f58b P c694531b0e1d47988b291f1214efc4cb: Time spent bootstrapping tablet: real 0.204s	user 0.014s	sys 0.009s
I20260709 13:02:47.543198  9175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "059a6a9a07d74be4a9f3854317b870ab" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694531b0e1d47988b291f1214efc4cb" is_pre_election: true
I20260709 13:02:47.543990  9483 leader_election.cc:290] T 0a377c4fc6c04b0aa8f74f64f4f59409 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351), 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979)
I20260709 13:02:47.546761  9323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a377c4fc6c04b0aa8f74f64f4f59409" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57" is_pre_election: true
I20260709 13:02:47.547504  9323 raft_consensus.cc:2468] T 0a377c4fc6c04b0aa8f74f64f4f59409 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8846d581359a4b7ea6d4c33424ea825d in term 0.
I20260709 13:02:47.516474  9409 raft_consensus.cc:493] T 5f076a85481e43d7a969bf5d8bb589dd P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:47.549667  9174 raft_consensus.cc:3060] T e6ee00de30e149f58789799810d595a4 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:47.550093  9409 raft_consensus.cc:515] T 5f076a85481e43d7a969bf5d8bb589dd P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:47.551700  9462 consensus_queue.cc:1048] T 51a2ca964a8f4fb89b26d77b1b334f30 P 74ac2cf163ee475e8a280cb3aa738f57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:47.552338  9409 leader_election.cc:290] T 5f076a85481e43d7a969bf5d8bb589dd P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455), 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351)
I20260709 13:02:47.555444  9412 consensus_queue.cc:1048] T 51a2ca964a8f4fb89b26d77b1b334f30 P 74ac2cf163ee475e8a280cb3aa738f57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:47.556012  9172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f076a85481e43d7a969bf5d8bb589dd" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694531b0e1d47988b291f1214efc4cb" is_pre_election: true
I20260709 13:02:47.560606  9322 raft_consensus.cc:1275] T b3f19df7d93748a1802678c56b5e2208 P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Refusing update from remote peer 65ed95869fbb4b69b5d6eb99c51adf85: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:02:47.562882  9529 raft_consensus.cc:493] T 5ce2a33a3b914f6297946ded34c256bf P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:47.563434  9529 raft_consensus.cc:515] T 5ce2a33a3b914f6297946ded34c256bf P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:47.563956  9465 consensus_queue.cc:1048] T b3f19df7d93748a1802678c56b5e2208 P 65ed95869fbb4b69b5d6eb99c51adf85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:47.565851  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a377c4fc6c04b0aa8f74f64f4f59409" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" is_pre_election: true
I20260709 13:02:47.563969  9473 consensus_queue.cc:1048] T 53bdda361da242a1b37aa013fad1ee60 P c694531b0e1d47988b291f1214efc4cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:02:47.566900  9250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce2a33a3b914f6297946ded34c256bf" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d" is_pre_election: true
I20260709 13:02:47.527747  9372 raft_consensus.cc:359] T 0a377c4fc6c04b0aa8f74f64f4f59409 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:47.567495  9372 raft_consensus.cc:385] T 0a377c4fc6c04b0aa8f74f64f4f59409 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:47.567571  9250 raft_consensus.cc:2468] T 5ce2a33a3b914f6297946ded34c256bf P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65ed95869fbb4b69b5d6eb99c51adf85 in term 0.
I20260709 13:02:47.567826  9372 raft_consensus.cc:740] T 0a377c4fc6c04b0aa8f74f64f4f59409 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Initialized, Role: FOLLOWER
I20260709 13:02:47.534514  9464 leader_election.cc:290] T d2ef0242573643178d56d10a6c26ae8e P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 1 election: Requested vote from peers 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351), c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455)
I20260709 13:02:47.513445  9481 raft_consensus.cc:515] T 989e9796152e4796a3408e00419403fa P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:47.569981  9215 leader_election.cc:304] T 0a377c4fc6c04b0aa8f74f64f4f59409 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57, 8846d581359a4b7ea6d4c33424ea825d; no voters: 
I20260709 13:02:47.570303  9481 leader_election.cc:290] T 989e9796152e4796a3408e00419403fa P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 election: Requested vote from peers c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455), 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351)
I20260709 13:02:47.570765  9480 consensus_queue.cc:1048] T 69a5fd219b1a4d4c94b346f38909f024 P c694531b0e1d47988b291f1214efc4cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:47.571866  9372 consensus_queue.cc:260] T 0a377c4fc6c04b0aa8f74f64f4f59409 P 65ed95869fbb4b69b5d6eb99c51adf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:47.543116  9173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2ef0242573643178d56d10a6c26ae8e" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694531b0e1d47988b291f1214efc4cb"
I20260709 13:02:47.563949  9323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2ef0242573643178d56d10a6c26ae8e" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57"
I20260709 13:02:47.584482  9372 ts_tablet_manager.cc:1434] T 0a377c4fc6c04b0aa8f74f64f4f59409 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent starting tablet: real 0.084s	user 0.006s	sys 0.001s
I20260709 13:02:47.587283  9372 tablet_bootstrap.cc:492] T 389a20133d8b4ebfaab346741dff367f P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap starting.
I20260709 13:02:47.589378  9324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f076a85481e43d7a969bf5d8bb589dd" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57" is_pre_election: true
I20260709 13:02:47.590206  9324 raft_consensus.cc:2393] T 5f076a85481e43d7a969bf5d8bb589dd P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8846d581359a4b7ea6d4c33424ea825d in current term 1: Already voted for candidate c694531b0e1d47988b291f1214efc4cb in this term.
W20260709 13:02:47.595472  9065 leader_election.cc:343] T 059a6a9a07d74be4a9f3854317b870ab P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:47.596065  9065 leader_election.cc:304] T 059a6a9a07d74be4a9f3854317b870ab P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65ed95869fbb4b69b5d6eb99c51adf85; no voters: 8846d581359a4b7ea6d4c33424ea825d, c694531b0e1d47988b291f1214efc4cb
I20260709 13:02:47.582494  9098 raft_consensus.cc:2468] T 0a377c4fc6c04b0aa8f74f64f4f59409 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8846d581359a4b7ea6d4c33424ea825d in term 0.
I20260709 13:02:47.596463  9175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "989e9796152e4796a3408e00419403fa" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694531b0e1d47988b291f1214efc4cb"
I20260709 13:02:47.597121  9175 raft_consensus.cc:3060] T 989e9796152e4796a3408e00419403fa P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:47.588788  9248 raft_consensus.cc:3060] T 5f076a85481e43d7a969bf5d8bb589dd P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:47.604327  9531 raft_consensus.cc:2749] T 059a6a9a07d74be4a9f3854317b870ab P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:47.586824  9481 raft_consensus.cc:2804] T 0a377c4fc6c04b0aa8f74f64f4f59409 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:47.605448  9481 raft_consensus.cc:493] T 0a377c4fc6c04b0aa8f74f64f4f59409 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:47.605791  9481 raft_consensus.cc:3060] T 0a377c4fc6c04b0aa8f74f64f4f59409 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:47.606189  9324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce2a33a3b914f6297946ded34c256bf" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57" is_pre_election: true
I20260709 13:02:47.607023  9324 raft_consensus.cc:2468] T 5ce2a33a3b914f6297946ded34c256bf P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65ed95869fbb4b69b5d6eb99c51adf85 in term 0.
I20260709 13:02:47.610937  9215 leader_election.cc:304] T 5f076a85481e43d7a969bf5d8bb589dd P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8846d581359a4b7ea6d4c33424ea825d; no voters: 74ac2cf163ee475e8a280cb3aa738f57, c694531b0e1d47988b291f1214efc4cb
I20260709 13:02:47.588411  9323 raft_consensus.cc:3060] T d2ef0242573643178d56d10a6c26ae8e P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:47.612813  9529 leader_election.cc:290] T 5ce2a33a3b914f6297946ded34c256bf P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311), 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351)
I20260709 13:02:47.613078  9324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "989e9796152e4796a3408e00419403fa" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57"
I20260709 13:02:47.601776  9064 leader_election.cc:304] T 5ce2a33a3b914f6297946ded34c256bf P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65ed95869fbb4b69b5d6eb99c51adf85, 8846d581359a4b7ea6d4c33424ea825d; no voters: 
W20260709 13:02:47.619133  9215 leader_election.cc:343] T 989e9796152e4796a3408e00419403fa P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:47.620002  9529 raft_consensus.cc:2804] T 5ce2a33a3b914f6297946ded34c256bf P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:47.620501  9529 raft_consensus.cc:493] T 5ce2a33a3b914f6297946ded34c256bf P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:47.620833  9529 raft_consensus.cc:3060] T 5ce2a33a3b914f6297946ded34c256bf P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:47.631711  9371 raft_consensus.cc:359] T 3899ef948b2e405baaccb81544b7f58b P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:47.632490  9371 raft_consensus.cc:385] T 3899ef948b2e405baaccb81544b7f58b P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:47.632771  9371 raft_consensus.cc:740] T 3899ef948b2e405baaccb81544b7f58b P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c694531b0e1d47988b291f1214efc4cb, State: Initialized, Role: FOLLOWER
I20260709 13:02:47.633486  9371 consensus_queue.cc:260] T 3899ef948b2e405baaccb81544b7f58b P c694531b0e1d47988b291f1214efc4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:47.638960  9474 consensus_queue.cc:1048] T 5f076a85481e43d7a969bf5d8bb589dd P c694531b0e1d47988b291f1214efc4cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:47.642164  9474 consensus_queue.cc:1048] T 5cea8a8078e8456186d4d1a184d3f157 P c694531b0e1d47988b291f1214efc4cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:47.643307  9483 raft_consensus.cc:2749] T 5f076a85481e43d7a969bf5d8bb589dd P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:47.643257  9457 raft_consensus.cc:515] T d2ef0242573643178d56d10a6c26ae8e P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:47.646209  9371 ts_tablet_manager.cc:1434] T 3899ef948b2e405baaccb81544b7f58b P c694531b0e1d47988b291f1214efc4cb: Time spent starting tablet: real 0.104s	user 0.005s	sys 0.003s
I20260709 13:02:47.646330  9408 consensus_queue.cc:1048] T 5f076a85481e43d7a969bf5d8bb589dd P c694531b0e1d47988b291f1214efc4cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:47.649245  9371 tablet_bootstrap.cc:492] T dbdc8579cca94ef7ab4babd287837e8c P c694531b0e1d47988b291f1214efc4cb: Bootstrap starting.
I20260709 13:02:47.651292  9370 tablet_bootstrap.cc:492] T eab411e3927a434ab647aa9b31fcf60d P 74ac2cf163ee475e8a280cb3aa738f57: No bootstrap required, opened a new log
I20260709 13:02:47.651942  9370 ts_tablet_manager.cc:1403] T eab411e3927a434ab647aa9b31fcf60d P 74ac2cf163ee475e8a280cb3aa738f57: Time spent bootstrapping tablet: real 0.262s	user 0.033s	sys 0.024s
I20260709 13:02:47.654903  9370 raft_consensus.cc:359] T eab411e3927a434ab647aa9b31fcf60d P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:47.658455  9370 raft_consensus.cc:385] T eab411e3927a434ab647aa9b31fcf60d P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:47.659449  9173 raft_consensus.cc:2393] T d2ef0242573643178d56d10a6c26ae8e P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 65ed95869fbb4b69b5d6eb99c51adf85 in current term 1: Already voted for candidate c694531b0e1d47988b291f1214efc4cb in this term.
I20260709 13:02:47.659312  9529 raft_consensus.cc:515] T 5ce2a33a3b914f6297946ded34c256bf P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:47.664278  9371 tablet_bootstrap.cc:654] T dbdc8579cca94ef7ab4babd287837e8c P c694531b0e1d47988b291f1214efc4cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:47.700299  9370 raft_consensus.cc:740] T eab411e3927a434ab647aa9b31fcf60d P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74ac2cf163ee475e8a280cb3aa738f57, State: Initialized, Role: FOLLOWER
I20260709 13:02:47.667821  9481 raft_consensus.cc:515] T 0a377c4fc6c04b0aa8f74f64f4f59409 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:47.664575  9175 raft_consensus.cc:2468] T 989e9796152e4796a3408e00419403fa P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8846d581359a4b7ea6d4c33424ea825d in term 1.
I20260709 13:02:47.709303  9372 tablet_bootstrap.cc:654] T 389a20133d8b4ebfaab346741dff367f P 65ed95869fbb4b69b5d6eb99c51adf85: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:47.711000  9369 tablet_bootstrap.cc:492] T 059a6a9a07d74be4a9f3854317b870ab P 8846d581359a4b7ea6d4c33424ea825d: No bootstrap required, opened a new log
I20260709 13:02:47.711659  9369 ts_tablet_manager.cc:1403] T 059a6a9a07d74be4a9f3854317b870ab P 8846d581359a4b7ea6d4c33424ea825d: Time spent bootstrapping tablet: real 0.357s	user 0.035s	sys 0.042s
I20260709 13:02:47.710987  9370 consensus_queue.cc:260] T eab411e3927a434ab647aa9b31fcf60d P 74ac2cf163ee475e8a280cb3aa738f57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:47.714564  9369 raft_consensus.cc:359] T 059a6a9a07d74be4a9f3854317b870ab P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:47.715417  9369 raft_consensus.cc:385] T 059a6a9a07d74be4a9f3854317b870ab P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:47.715734  9369 raft_consensus.cc:740] T 059a6a9a07d74be4a9f3854317b870ab P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8846d581359a4b7ea6d4c33424ea825d, State: Initialized, Role: FOLLOWER
I20260709 13:02:47.716516  9369 consensus_queue.cc:260] T 059a6a9a07d74be4a9f3854317b870ab P 8846d581359a4b7ea6d4c33424ea825d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:47.720541  9369 ts_tablet_manager.cc:1434] T 059a6a9a07d74be4a9f3854317b870ab P 8846d581359a4b7ea6d4c33424ea825d: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:02:47.734377  9529 leader_election.cc:290] T 5ce2a33a3b914f6297946ded34c256bf P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 1 election: Requested vote from peers 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311), 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351)
I20260709 13:02:47.735813  9369 tablet_bootstrap.cc:492] T cb7f6aeb8116423481ea2b2dca5a06d4 P 8846d581359a4b7ea6d4c33424ea825d: Bootstrap starting.
I20260709 13:02:47.736483  9457 leader_election.cc:290] T d2ef0242573643178d56d10a6c26ae8e P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 election: Requested vote from peers 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351), 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979)
I20260709 13:02:47.737123  9250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce2a33a3b914f6297946ded34c256bf" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d"
I20260709 13:02:47.737772  9250 raft_consensus.cc:3060] T 5ce2a33a3b914f6297946ded34c256bf P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:47.738674  9474 consensus_queue.cc:1048] T 5cea8a8078e8456186d4d1a184d3f157 P c694531b0e1d47988b291f1214efc4cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:47.738750  9457 consensus_queue.cc:1048] T 69a5fd219b1a4d4c94b346f38909f024 P c694531b0e1d47988b291f1214efc4cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:47.740767  9319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2ef0242573643178d56d10a6c26ae8e" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57"
I20260709 13:02:47.747365  9320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce2a33a3b914f6297946ded34c256bf" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57"
I20260709 13:02:47.747951  9214 leader_election.cc:304] T 989e9796152e4796a3408e00419403fa P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8846d581359a4b7ea6d4c33424ea825d, c694531b0e1d47988b291f1214efc4cb; no voters: 74ac2cf163ee475e8a280cb3aa738f57
I20260709 13:02:47.748651  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2ef0242573643178d56d10a6c26ae8e" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85"
I20260709 13:02:47.749019  9377 raft_consensus.cc:2804] T 989e9796152e4796a3408e00419403fa P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:47.749562  9377 raft_consensus.cc:697] T 989e9796152e4796a3408e00419403fa P 8846d581359a4b7ea6d4c33424ea825d [term 1 LEADER]: Becoming Leader. State: Replica: 8846d581359a4b7ea6d4c33424ea825d, State: Running, Role: LEADER
I20260709 13:02:47.750463  9377 consensus_queue.cc:237] T 989e9796152e4796a3408e00419403fa P 8846d581359a4b7ea6d4c33424ea825d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:47.752468  9370 ts_tablet_manager.cc:1434] T eab411e3927a434ab647aa9b31fcf60d P 74ac2cf163ee475e8a280cb3aa738f57: Time spent starting tablet: real 0.100s	user 0.008s	sys 0.000s
I20260709 13:02:47.753471  9370 tablet_bootstrap.cc:492] T 989e9796152e4796a3408e00419403fa P 74ac2cf163ee475e8a280cb3aa738f57: Bootstrap starting.
I20260709 13:02:47.749464  9101 raft_consensus.cc:2393] T d2ef0242573643178d56d10a6c26ae8e P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c694531b0e1d47988b291f1214efc4cb in current term 1: Already voted for candidate 65ed95869fbb4b69b5d6eb99c51adf85 in this term.
I20260709 13:02:47.768544  9371 tablet_bootstrap.cc:492] T dbdc8579cca94ef7ab4babd287837e8c P c694531b0e1d47988b291f1214efc4cb: No bootstrap required, opened a new log
W20260709 13:02:47.774061  9535 log.cc:927] Time spent T 51a2ca964a8f4fb89b26d77b1b334f30 P 65ed95869fbb4b69b5d6eb99c51adf85: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:02:47.748070  9320 raft_consensus.cc:3060] T 5ce2a33a3b914f6297946ded34c256bf P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:47.784734  9141 leader_election.cc:304] T d2ef0242573643178d56d10a6c26ae8e P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c694531b0e1d47988b291f1214efc4cb; no voters: 65ed95869fbb4b69b5d6eb99c51adf85, 74ac2cf163ee475e8a280cb3aa738f57
I20260709 13:02:47.785820  9474 raft_consensus.cc:2749] T d2ef0242573643178d56d10a6c26ae8e P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:02:47.793944  9371 ts_tablet_manager.cc:1403] T dbdc8579cca94ef7ab4babd287837e8c P c694531b0e1d47988b291f1214efc4cb: Time spent bootstrapping tablet: real 0.145s	user 0.012s	sys 0.006s
I20260709 13:02:47.796793  8997 catalog_manager.cc:5697] T 0effc3d52a6d43ef8aa59821958f4e52 P 8846d581359a4b7ea6d4c33424ea825d reported cstate change: term changed from 0 to 1, leader changed from <none> to 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195). New cstate: current_term: 1 leader_uuid: "8846d581359a4b7ea6d4c33424ea825d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:47.728123  9323 raft_consensus.cc:2468] T d2ef0242573643178d56d10a6c26ae8e P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65ed95869fbb4b69b5d6eb99c51adf85 in term 1.
I20260709 13:02:47.800902  9370 tablet_bootstrap.cc:654] T 989e9796152e4796a3408e00419403fa P 74ac2cf163ee475e8a280cb3aa738f57: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:47.802068  9250 raft_consensus.cc:2468] T 5ce2a33a3b914f6297946ded34c256bf P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65ed95869fbb4b69b5d6eb99c51adf85 in term 1.
I20260709 13:02:47.803481  9064 leader_election.cc:304] T 5ce2a33a3b914f6297946ded34c256bf P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65ed95869fbb4b69b5d6eb99c51adf85, 8846d581359a4b7ea6d4c33424ea825d; no voters: 
I20260709 13:02:47.804890  9324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a377c4fc6c04b0aa8f74f64f4f59409" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57"
I20260709 13:02:47.805608  9529 raft_consensus.cc:2804] T 5ce2a33a3b914f6297946ded34c256bf P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:47.806182  9529 raft_consensus.cc:697] T 5ce2a33a3b914f6297946ded34c256bf P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 LEADER]: Becoming Leader. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Running, Role: LEADER
I20260709 13:02:47.805547  9324 raft_consensus.cc:3060] T 0a377c4fc6c04b0aa8f74f64f4f59409 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:47.807128  9529 consensus_queue.cc:237] T 5ce2a33a3b914f6297946ded34c256bf P 65ed95869fbb4b69b5d6eb99c51adf85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:47.809929  9369 tablet_bootstrap.cc:654] T cb7f6aeb8116423481ea2b2dca5a06d4 P 8846d581359a4b7ea6d4c33424ea825d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:47.824280  9066 leader_election.cc:304] T d2ef0242573643178d56d10a6c26ae8e P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65ed95869fbb4b69b5d6eb99c51adf85, 74ac2cf163ee475e8a280cb3aa738f57; no voters: c694531b0e1d47988b291f1214efc4cb
I20260709 13:02:47.806067  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a377c4fc6c04b0aa8f74f64f4f59409" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85"
I20260709 13:02:47.810714  9481 leader_election.cc:290] T 0a377c4fc6c04b0aa8f74f64f4f59409 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 election: Requested vote from peers 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351), 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979)
I20260709 13:02:47.827523  9531 raft_consensus.cc:2804] T d2ef0242573643178d56d10a6c26ae8e P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:02:47.846928  9539 log.cc:927] Time spent T 51a2ca964a8f4fb89b26d77b1b334f30 P 8846d581359a4b7ea6d4c33424ea825d: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
I20260709 13:02:47.850687  9531 raft_consensus.cc:697] T d2ef0242573643178d56d10a6c26ae8e P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 LEADER]: Becoming Leader. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Running, Role: LEADER
I20260709 13:02:47.832617  9101 raft_consensus.cc:3060] T 0a377c4fc6c04b0aa8f74f64f4f59409 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:47.870976  9370 tablet_bootstrap.cc:492] T 989e9796152e4796a3408e00419403fa P 74ac2cf163ee475e8a280cb3aa738f57: No bootstrap required, opened a new log
I20260709 13:02:47.871838  9370 ts_tablet_manager.cc:1403] T 989e9796152e4796a3408e00419403fa P 74ac2cf163ee475e8a280cb3aa738f57: Time spent bootstrapping tablet: real 0.119s	user 0.016s	sys 0.003s
I20260709 13:02:47.873708  9372 tablet_bootstrap.cc:492] T 389a20133d8b4ebfaab346741dff367f P 65ed95869fbb4b69b5d6eb99c51adf85: No bootstrap required, opened a new log
I20260709 13:02:47.874354  9372 ts_tablet_manager.cc:1403] T 389a20133d8b4ebfaab346741dff367f P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent bootstrapping tablet: real 0.288s	user 0.006s	sys 0.018s
I20260709 13:02:47.877496  9377 consensus_queue.cc:1048] T 0effc3d52a6d43ef8aa59821958f4e52 P 8846d581359a4b7ea6d4c33424ea825d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:47.873615  9371 raft_consensus.cc:359] T dbdc8579cca94ef7ab4babd287837e8c P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:47.883644  9371 raft_consensus.cc:385] T dbdc8579cca94ef7ab4babd287837e8c P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:47.883909  9371 raft_consensus.cc:740] T dbdc8579cca94ef7ab4babd287837e8c P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c694531b0e1d47988b291f1214efc4cb, State: Initialized, Role: FOLLOWER
I20260709 13:02:47.884461  9371 consensus_queue.cc:260] T dbdc8579cca94ef7ab4babd287837e8c P c694531b0e1d47988b291f1214efc4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:47.888190  9320 raft_consensus.cc:2468] T 5ce2a33a3b914f6297946ded34c256bf P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65ed95869fbb4b69b5d6eb99c51adf85 in term 1.
I20260709 13:02:47.890612  9370 raft_consensus.cc:359] T 989e9796152e4796a3408e00419403fa P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:47.891554  9370 raft_consensus.cc:385] T 989e9796152e4796a3408e00419403fa P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:47.891830  9370 raft_consensus.cc:740] T 989e9796152e4796a3408e00419403fa P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74ac2cf163ee475e8a280cb3aa738f57, State: Initialized, Role: FOLLOWER
I20260709 13:02:47.851680  9531 consensus_queue.cc:237] T d2ef0242573643178d56d10a6c26ae8e P 65ed95869fbb4b69b5d6eb99c51adf85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:47.892447  9370 consensus_queue.cc:260] T 989e9796152e4796a3408e00419403fa P 74ac2cf163ee475e8a280cb3aa738f57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:47.890744  9473 raft_consensus.cc:493] T e6ee00de30e149f58789799810d595a4 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8846d581359a4b7ea6d4c33424ea825d)
I20260709 13:02:47.898797  9473 raft_consensus.cc:515] T e6ee00de30e149f58789799810d595a4 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:47.901268  9372 raft_consensus.cc:359] T 389a20133d8b4ebfaab346741dff367f P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:47.902108  9372 raft_consensus.cc:385] T 389a20133d8b4ebfaab346741dff367f P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:47.902449  9372 raft_consensus.cc:740] T 389a20133d8b4ebfaab346741dff367f P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Initialized, Role: FOLLOWER
I20260709 13:02:47.903349  9372 consensus_queue.cc:260] T 389a20133d8b4ebfaab346741dff367f P 65ed95869fbb4b69b5d6eb99c51adf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:47.904100  9370 ts_tablet_manager.cc:1434] T 989e9796152e4796a3408e00419403fa P 74ac2cf163ee475e8a280cb3aa738f57: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.000s
I20260709 13:02:47.905813  9372 ts_tablet_manager.cc:1434] T 389a20133d8b4ebfaab346741dff367f P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.000s
I20260709 13:02:47.907970  9370 tablet_bootstrap.cc:492] T 50f8080d64c04e738a6a36d748c8ee1e P 74ac2cf163ee475e8a280cb3aa738f57: Bootstrap starting.
I20260709 13:02:47.910866  9371 ts_tablet_manager.cc:1434] T dbdc8579cca94ef7ab4babd287837e8c P c694531b0e1d47988b291f1214efc4cb: Time spent starting tablet: real 0.116s	user 0.007s	sys 0.000s
I20260709 13:02:47.917716  9473 leader_election.cc:290] T e6ee00de30e149f58789799810d595a4 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979), 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311)
I20260709 13:02:47.919094  9246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ee00de30e149f58789799810d595a4" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d" is_pre_election: true
I20260709 13:02:47.920836  9324 raft_consensus.cc:2468] T 0a377c4fc6c04b0aa8f74f64f4f59409 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8846d581359a4b7ea6d4c33424ea825d in term 1.
I20260709 13:02:47.921669  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6ee00de30e149f58789799810d595a4" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" is_pre_election: true
I20260709 13:02:47.923807  9372 tablet_bootstrap.cc:492] T 3899ef948b2e405baaccb81544b7f58b P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap starting.
I20260709 13:02:47.925140  9141 leader_election.cc:304] T e6ee00de30e149f58789799810d595a4 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c694531b0e1d47988b291f1214efc4cb; no voters: 65ed95869fbb4b69b5d6eb99c51adf85, 8846d581359a4b7ea6d4c33424ea825d
I20260709 13:02:47.923993  9377 consensus_queue.cc:1048] T 0effc3d52a6d43ef8aa59821958f4e52 P 8846d581359a4b7ea6d4c33424ea825d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:02:47.926960  9474 raft_consensus.cc:2749] T e6ee00de30e149f58789799810d595a4 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:47.928942  9371 tablet_bootstrap.cc:492] T f2229e498f7f472f97c088fddb802939 P c694531b0e1d47988b291f1214efc4cb: Bootstrap starting.
I20260709 13:02:47.924126  9215 leader_election.cc:304] T 0a377c4fc6c04b0aa8f74f64f4f59409 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57, 8846d581359a4b7ea6d4c33424ea825d; no voters: 
I20260709 13:02:47.930896  9483 raft_consensus.cc:2804] T 0a377c4fc6c04b0aa8f74f64f4f59409 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:47.931393  9483 raft_consensus.cc:697] T 0a377c4fc6c04b0aa8f74f64f4f59409 P 8846d581359a4b7ea6d4c33424ea825d [term 1 LEADER]: Becoming Leader. State: Replica: 8846d581359a4b7ea6d4c33424ea825d, State: Running, Role: LEADER
I20260709 13:02:47.932240  9483 consensus_queue.cc:237] T 0a377c4fc6c04b0aa8f74f64f4f59409 P 8846d581359a4b7ea6d4c33424ea825d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:47.935642  9369 tablet_bootstrap.cc:492] T cb7f6aeb8116423481ea2b2dca5a06d4 P 8846d581359a4b7ea6d4c33424ea825d: No bootstrap required, opened a new log
I20260709 13:02:47.936283  9369 ts_tablet_manager.cc:1403] T cb7f6aeb8116423481ea2b2dca5a06d4 P 8846d581359a4b7ea6d4c33424ea825d: Time spent bootstrapping tablet: real 0.201s	user 0.022s	sys 0.020s
I20260709 13:02:47.940444  9372 tablet_bootstrap.cc:654] T 3899ef948b2e405baaccb81544b7f58b P 65ed95869fbb4b69b5d6eb99c51adf85: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:47.931113  9101 raft_consensus.cc:2468] T 0a377c4fc6c04b0aa8f74f64f4f59409 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8846d581359a4b7ea6d4c33424ea825d in term 1.
I20260709 13:02:47.949486  9371 tablet_bootstrap.cc:654] T f2229e498f7f472f97c088fddb802939 P c694531b0e1d47988b291f1214efc4cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:47.950356  9369 raft_consensus.cc:359] T cb7f6aeb8116423481ea2b2dca5a06d4 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:47.951275  9369 raft_consensus.cc:385] T cb7f6aeb8116423481ea2b2dca5a06d4 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:47.951568  9369 raft_consensus.cc:740] T cb7f6aeb8116423481ea2b2dca5a06d4 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8846d581359a4b7ea6d4c33424ea825d, State: Initialized, Role: FOLLOWER
I20260709 13:02:47.952270  9369 consensus_queue.cc:260] T cb7f6aeb8116423481ea2b2dca5a06d4 P 8846d581359a4b7ea6d4c33424ea825d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:47.957111  9369 ts_tablet_manager.cc:1434] T cb7f6aeb8116423481ea2b2dca5a06d4 P 8846d581359a4b7ea6d4c33424ea825d: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:02:47.961036  9369 tablet_bootstrap.cc:492] T 5b6b34440fd14f3ea66bd5de7a2a8260 P 8846d581359a4b7ea6d4c33424ea825d: Bootstrap starting.
I20260709 13:02:47.966764  9412 raft_consensus.cc:493] T 989e9796152e4796a3408e00419403fa P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:47.967352  9412 raft_consensus.cc:515] T 989e9796152e4796a3408e00419403fa P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:47.970419  9371 tablet_bootstrap.cc:492] T f2229e498f7f472f97c088fddb802939 P c694531b0e1d47988b291f1214efc4cb: No bootstrap required, opened a new log
I20260709 13:02:47.972515  9173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "989e9796152e4796a3408e00419403fa" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694531b0e1d47988b291f1214efc4cb" is_pre_election: true
I20260709 13:02:47.971019  9371 ts_tablet_manager.cc:1403] T f2229e498f7f472f97c088fddb802939 P c694531b0e1d47988b291f1214efc4cb: Time spent bootstrapping tablet: real 0.059s	user 0.013s	sys 0.006s
I20260709 13:02:47.973492  9173 raft_consensus.cc:2393] T 989e9796152e4796a3408e00419403fa P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74ac2cf163ee475e8a280cb3aa738f57 in current term 1: Already voted for candidate 8846d581359a4b7ea6d4c33424ea825d in this term.
I20260709 13:02:47.974431  9369 tablet_bootstrap.cc:654] T 5b6b34440fd14f3ea66bd5de7a2a8260 P 8846d581359a4b7ea6d4c33424ea825d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:47.975116  9370 tablet_bootstrap.cc:654] T 50f8080d64c04e738a6a36d748c8ee1e P 74ac2cf163ee475e8a280cb3aa738f57: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:47.975533  9246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "989e9796152e4796a3408e00419403fa" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d" is_pre_election: true
I20260709 13:02:47.978056  9412 leader_election.cc:290] T 989e9796152e4796a3408e00419403fa P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455), 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311)
I20260709 13:02:47.979058  9287 leader_election.cc:304] T 989e9796152e4796a3408e00419403fa P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57; no voters: 8846d581359a4b7ea6d4c33424ea825d, c694531b0e1d47988b291f1214efc4cb
I20260709 13:02:47.981149  9371 raft_consensus.cc:359] T f2229e498f7f472f97c088fddb802939 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:47.982174  9371 raft_consensus.cc:385] T f2229e498f7f472f97c088fddb802939 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:47.982474  9371 raft_consensus.cc:740] T f2229e498f7f472f97c088fddb802939 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c694531b0e1d47988b291f1214efc4cb, State: Initialized, Role: FOLLOWER
I20260709 13:02:47.981817  9412 raft_consensus.cc:3060] T 989e9796152e4796a3408e00419403fa P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:47.985028  9371 consensus_queue.cc:260] T f2229e498f7f472f97c088fddb802939 P c694531b0e1d47988b291f1214efc4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:47.988001  9371 ts_tablet_manager.cc:1434] T f2229e498f7f472f97c088fddb802939 P c694531b0e1d47988b291f1214efc4cb: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:02:47.988930  9371 tablet_bootstrap.cc:492] T 059a6a9a07d74be4a9f3854317b870ab P c694531b0e1d47988b291f1214efc4cb: Bootstrap starting.
I20260709 13:02:47.995507  9371 tablet_bootstrap.cc:654] T 059a6a9a07d74be4a9f3854317b870ab P c694531b0e1d47988b291f1214efc4cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:47.998417  9372 tablet_bootstrap.cc:492] T 3899ef948b2e405baaccb81544b7f58b P 65ed95869fbb4b69b5d6eb99c51adf85: No bootstrap required, opened a new log
I20260709 13:02:47.999046  9372 ts_tablet_manager.cc:1403] T 3899ef948b2e405baaccb81544b7f58b P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent bootstrapping tablet: real 0.075s	user 0.013s	sys 0.006s
I20260709 13:02:48.002053  9372 raft_consensus.cc:359] T 3899ef948b2e405baaccb81544b7f58b P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:48.002907  9372 raft_consensus.cc:385] T 3899ef948b2e405baaccb81544b7f58b P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:48.003198  9372 raft_consensus.cc:740] T 3899ef948b2e405baaccb81544b7f58b P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Initialized, Role: FOLLOWER
I20260709 13:02:48.003947  9372 consensus_queue.cc:260] T 3899ef948b2e405baaccb81544b7f58b P 65ed95869fbb4b69b5d6eb99c51adf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:48.002197  8999 catalog_manager.cc:5697] T d2ef0242573643178d56d10a6c26ae8e P 65ed95869fbb4b69b5d6eb99c51adf85 reported cstate change: term changed from 0 to 1, leader changed from <none> to 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:48.006733  9371 tablet_bootstrap.cc:492] T 059a6a9a07d74be4a9f3854317b870ab P c694531b0e1d47988b291f1214efc4cb: No bootstrap required, opened a new log
I20260709 13:02:48.007284  9371 ts_tablet_manager.cc:1403] T 059a6a9a07d74be4a9f3854317b870ab P c694531b0e1d47988b291f1214efc4cb: Time spent bootstrapping tablet: real 0.019s	user 0.017s	sys 0.000s
I20260709 13:02:48.008037  9412 raft_consensus.cc:2749] T 989e9796152e4796a3408e00419403fa P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:48.009122  8999 catalog_manager.cc:5697] T 5ce2a33a3b914f6297946ded34c256bf P 65ed95869fbb4b69b5d6eb99c51adf85 reported cstate change: term changed from 0 to 1, leader changed from <none> to 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:48.010160  9371 raft_consensus.cc:359] T 059a6a9a07d74be4a9f3854317b870ab P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:48.010906  9371 raft_consensus.cc:385] T 059a6a9a07d74be4a9f3854317b870ab P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:48.011188  9371 raft_consensus.cc:740] T 059a6a9a07d74be4a9f3854317b870ab P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c694531b0e1d47988b291f1214efc4cb, State: Initialized, Role: FOLLOWER
I20260709 13:02:48.011821  9371 consensus_queue.cc:260] T 059a6a9a07d74be4a9f3854317b870ab P c694531b0e1d47988b291f1214efc4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:48.013824  9369 tablet_bootstrap.cc:492] T 5b6b34440fd14f3ea66bd5de7a2a8260 P 8846d581359a4b7ea6d4c33424ea825d: No bootstrap required, opened a new log
I20260709 13:02:48.014747  9371 ts_tablet_manager.cc:1434] T 059a6a9a07d74be4a9f3854317b870ab P c694531b0e1d47988b291f1214efc4cb: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:02:48.019742  9369 ts_tablet_manager.cc:1403] T 5b6b34440fd14f3ea66bd5de7a2a8260 P 8846d581359a4b7ea6d4c33424ea825d: Time spent bootstrapping tablet: real 0.059s	user 0.011s	sys 0.010s
I20260709 13:02:48.020360  9371 tablet_bootstrap.cc:492] T 389a20133d8b4ebfaab346741dff367f P c694531b0e1d47988b291f1214efc4cb: Bootstrap starting.
I20260709 13:02:48.012437  9372 ts_tablet_manager.cc:1434] T 3899ef948b2e405baaccb81544b7f58b P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:02:48.028724  9372 tablet_bootstrap.cc:492] T 48e91509dfc74d53a930cdc636976db6 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap starting.
I20260709 13:02:48.028970  9408 raft_consensus.cc:493] T dbdc8579cca94ef7ab4babd287837e8c P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.029546  9408 raft_consensus.cc:515] T dbdc8579cca94ef7ab4babd287837e8c P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:48.030478  9370 tablet_bootstrap.cc:492] T 50f8080d64c04e738a6a36d748c8ee1e P 74ac2cf163ee475e8a280cb3aa738f57: No bootstrap required, opened a new log
I20260709 13:02:48.030442  9377 raft_consensus.cc:493] T 059a6a9a07d74be4a9f3854317b870ab P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.031340  9370 ts_tablet_manager.cc:1403] T 50f8080d64c04e738a6a36d748c8ee1e P 74ac2cf163ee475e8a280cb3aa738f57: Time spent bootstrapping tablet: real 0.124s	user 0.016s	sys 0.000s
I20260709 13:02:48.031287  9377 raft_consensus.cc:515] T 059a6a9a07d74be4a9f3854317b870ab P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:48.031778  9408 leader_election.cc:290] T dbdc8579cca94ef7ab4babd287837e8c P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351), 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979)
I20260709 13:02:48.034792  9324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdc8579cca94ef7ab4babd287837e8c" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57" is_pre_election: true
I20260709 13:02:48.035233  9372 tablet_bootstrap.cc:654] T 48e91509dfc74d53a930cdc636976db6 P 65ed95869fbb4b69b5d6eb99c51adf85: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:48.035256  9175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "059a6a9a07d74be4a9f3854317b870ab" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694531b0e1d47988b291f1214efc4cb" is_pre_election: true
I20260709 13:02:48.036720  9175 raft_consensus.cc:2468] T 059a6a9a07d74be4a9f3854317b870ab P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8846d581359a4b7ea6d4c33424ea825d in term 0.
I20260709 13:02:48.036868  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdc8579cca94ef7ab4babd287837e8c" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" is_pre_election: true
I20260709 13:02:48.027249  9371 tablet_bootstrap.cc:654] T 389a20133d8b4ebfaab346741dff367f P c694531b0e1d47988b291f1214efc4cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:48.038435  9214 leader_election.cc:304] T 059a6a9a07d74be4a9f3854317b870ab P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8846d581359a4b7ea6d4c33424ea825d, c694531b0e1d47988b291f1214efc4cb; no voters: 
I20260709 13:02:48.038763  9483 raft_consensus.cc:493] T cb7f6aeb8116423481ea2b2dca5a06d4 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.039338  9483 raft_consensus.cc:515] T cb7f6aeb8116423481ea2b2dca5a06d4 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:48.022709  9369 raft_consensus.cc:359] T 5b6b34440fd14f3ea66bd5de7a2a8260 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:48.041582  9483 leader_election.cc:290] T cb7f6aeb8116423481ea2b2dca5a06d4 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455), 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351)
I20260709 13:02:48.041925  9369 raft_consensus.cc:385] T 5b6b34440fd14f3ea66bd5de7a2a8260 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:48.042129  9483 raft_consensus.cc:2804] T 059a6a9a07d74be4a9f3854317b870ab P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:48.042253  9369 raft_consensus.cc:740] T 5b6b34440fd14f3ea66bd5de7a2a8260 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8846d581359a4b7ea6d4c33424ea825d, State: Initialized, Role: FOLLOWER
I20260709 13:02:48.043246  9369 consensus_queue.cc:260] T 5b6b34440fd14f3ea66bd5de7a2a8260 P 8846d581359a4b7ea6d4c33424ea825d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:48.044955  9369 ts_tablet_manager.cc:1434] T 5b6b34440fd14f3ea66bd5de7a2a8260 P 8846d581359a4b7ea6d4c33424ea825d: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.000s
I20260709 13:02:48.045990  9369 tablet_bootstrap.cc:492] T 48e91509dfc74d53a930cdc636976db6 P 8846d581359a4b7ea6d4c33424ea825d: Bootstrap starting.
I20260709 13:02:48.045882  9175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7f6aeb8116423481ea2b2dca5a06d4" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694531b0e1d47988b291f1214efc4cb" is_pre_election: true
I20260709 13:02:48.048010  9141 leader_election.cc:304] T dbdc8579cca94ef7ab4babd287837e8c P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c694531b0e1d47988b291f1214efc4cb; no voters: 65ed95869fbb4b69b5d6eb99c51adf85, 74ac2cf163ee475e8a280cb3aa738f57
I20260709 13:02:48.049620  9474 raft_consensus.cc:2749] T dbdc8579cca94ef7ab4babd287837e8c P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:48.050037  9324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7f6aeb8116423481ea2b2dca5a06d4" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57" is_pre_election: true
W20260709 13:02:48.051319  9214 leader_election.cc:343] T cb7f6aeb8116423481ea2b2dca5a06d4 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:48.042598  9483 raft_consensus.cc:493] T 059a6a9a07d74be4a9f3854317b870ab P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:48.053112  9483 raft_consensus.cc:3060] T 059a6a9a07d74be4a9f3854317b870ab P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:48.053664  9370 raft_consensus.cc:359] T 50f8080d64c04e738a6a36d748c8ee1e P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:48.054417  9370 raft_consensus.cc:385] T 50f8080d64c04e738a6a36d748c8ee1e P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:48.054723  9370 raft_consensus.cc:740] T 50f8080d64c04e738a6a36d748c8ee1e P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74ac2cf163ee475e8a280cb3aa738f57, State: Initialized, Role: FOLLOWER
I20260709 13:02:48.055457  9370 consensus_queue.cc:260] T 50f8080d64c04e738a6a36d748c8ee1e P 74ac2cf163ee475e8a280cb3aa738f57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:48.039870  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "059a6a9a07d74be4a9f3854317b870ab" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" is_pre_election: true
I20260709 13:02:48.056851  9099 raft_consensus.cc:2468] T 059a6a9a07d74be4a9f3854317b870ab P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8846d581359a4b7ea6d4c33424ea825d in term 0.
W20260709 13:02:48.055974  9215 leader_election.cc:343] T cb7f6aeb8116423481ea2b2dca5a06d4 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:48.059648  9377 leader_election.cc:290] T 059a6a9a07d74be4a9f3854317b870ab P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979), c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455)
I20260709 13:02:48.061460  9215 leader_election.cc:304] T cb7f6aeb8116423481ea2b2dca5a06d4 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8846d581359a4b7ea6d4c33424ea825d; no voters: 74ac2cf163ee475e8a280cb3aa738f57, c694531b0e1d47988b291f1214efc4cb
I20260709 13:02:48.067660  9377 raft_consensus.cc:2749] T cb7f6aeb8116423481ea2b2dca5a06d4 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:48.059463  9370 ts_tablet_manager.cc:1434] T 50f8080d64c04e738a6a36d748c8ee1e P 74ac2cf163ee475e8a280cb3aa738f57: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.001s
I20260709 13:02:48.065555  9372 tablet_bootstrap.cc:492] T 48e91509dfc74d53a930cdc636976db6 P 65ed95869fbb4b69b5d6eb99c51adf85: No bootstrap required, opened a new log
I20260709 13:02:48.069433  9372 ts_tablet_manager.cc:1403] T 48e91509dfc74d53a930cdc636976db6 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent bootstrapping tablet: real 0.041s	user 0.007s	sys 0.010s
I20260709 13:02:48.069943  9370 tablet_bootstrap.cc:492] T df7e9031dde347b5b9da753cc817ce17 P 74ac2cf163ee475e8a280cb3aa738f57: Bootstrap starting.
I20260709 13:02:48.066895  9483 raft_consensus.cc:515] T 059a6a9a07d74be4a9f3854317b870ab P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:48.072281  9372 raft_consensus.cc:359] T 48e91509dfc74d53a930cdc636976db6 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:48.073073  9372 raft_consensus.cc:385] T 48e91509dfc74d53a930cdc636976db6 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:48.073362  9372 raft_consensus.cc:740] T 48e91509dfc74d53a930cdc636976db6 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Initialized, Role: FOLLOWER
I20260709 13:02:48.072908  8998 catalog_manager.cc:5697] T 989e9796152e4796a3408e00419403fa P 8846d581359a4b7ea6d4c33424ea825d reported cstate change: term changed from 0 to 1, leader changed from <none> to 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195). New cstate: current_term: 1 leader_uuid: "8846d581359a4b7ea6d4c33424ea825d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:48.073962  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "059a6a9a07d74be4a9f3854317b870ab" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85"
I20260709 13:02:48.074131  9372 consensus_queue.cc:260] T 48e91509dfc74d53a930cdc636976db6 P 65ed95869fbb4b69b5d6eb99c51adf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:48.074560  9099 raft_consensus.cc:3060] T 059a6a9a07d74be4a9f3854317b870ab P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:48.064020  9371 tablet_bootstrap.cc:492] T 389a20133d8b4ebfaab346741dff367f P c694531b0e1d47988b291f1214efc4cb: No bootstrap required, opened a new log
I20260709 13:02:48.076649  9372 ts_tablet_manager.cc:1434] T 48e91509dfc74d53a930cdc636976db6 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:02:48.076022  8998 catalog_manager.cc:5697] T 0a377c4fc6c04b0aa8f74f64f4f59409 P 8846d581359a4b7ea6d4c33424ea825d reported cstate change: term changed from 0 to 1, leader changed from <none> to 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195). New cstate: current_term: 1 leader_uuid: "8846d581359a4b7ea6d4c33424ea825d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:48.077638  9372 tablet_bootstrap.cc:492] T eab411e3927a434ab647aa9b31fcf60d P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap starting.
I20260709 13:02:48.082248  9369 tablet_bootstrap.cc:654] T 48e91509dfc74d53a930cdc636976db6 P 8846d581359a4b7ea6d4c33424ea825d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:48.083101  9099 raft_consensus.cc:2468] T 059a6a9a07d74be4a9f3854317b870ab P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8846d581359a4b7ea6d4c33424ea825d in term 1.
I20260709 13:02:48.084103  9371 ts_tablet_manager.cc:1403] T 389a20133d8b4ebfaab346741dff367f P c694531b0e1d47988b291f1214efc4cb: Time spent bootstrapping tablet: real 0.064s	user 0.020s	sys 0.000s
I20260709 13:02:48.085515  9175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "059a6a9a07d74be4a9f3854317b870ab" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694531b0e1d47988b291f1214efc4cb"
I20260709 13:02:48.089489  9175 raft_consensus.cc:3060] T 059a6a9a07d74be4a9f3854317b870ab P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:48.091836  9371 raft_consensus.cc:359] T 389a20133d8b4ebfaab346741dff367f P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:48.092554  9371 raft_consensus.cc:385] T 389a20133d8b4ebfaab346741dff367f P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:48.092823  9371 raft_consensus.cc:740] T 389a20133d8b4ebfaab346741dff367f P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c694531b0e1d47988b291f1214efc4cb, State: Initialized, Role: FOLLOWER
I20260709 13:02:48.085815  9372 tablet_bootstrap.cc:654] T eab411e3927a434ab647aa9b31fcf60d P 65ed95869fbb4b69b5d6eb99c51adf85: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:48.085717  9370 tablet_bootstrap.cc:654] T df7e9031dde347b5b9da753cc817ce17 P 74ac2cf163ee475e8a280cb3aa738f57: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:48.098301  9175 raft_consensus.cc:2468] T 059a6a9a07d74be4a9f3854317b870ab P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8846d581359a4b7ea6d4c33424ea825d in term 1.
I20260709 13:02:48.100775  9369 tablet_bootstrap.cc:492] T 48e91509dfc74d53a930cdc636976db6 P 8846d581359a4b7ea6d4c33424ea825d: No bootstrap required, opened a new log
I20260709 13:02:48.100508  9215 leader_election.cc:304] T 059a6a9a07d74be4a9f3854317b870ab P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65ed95869fbb4b69b5d6eb99c51adf85, 8846d581359a4b7ea6d4c33424ea825d; no voters: 
I20260709 13:02:48.103228  9377 raft_consensus.cc:2804] T 059a6a9a07d74be4a9f3854317b870ab P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:48.103724  9377 raft_consensus.cc:697] T 059a6a9a07d74be4a9f3854317b870ab P 8846d581359a4b7ea6d4c33424ea825d [term 1 LEADER]: Becoming Leader. State: Replica: 8846d581359a4b7ea6d4c33424ea825d, State: Running, Role: LEADER
I20260709 13:02:48.104532  9377 consensus_queue.cc:237] T 059a6a9a07d74be4a9f3854317b870ab P 8846d581359a4b7ea6d4c33424ea825d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:48.101086  9483 leader_election.cc:290] T 059a6a9a07d74be4a9f3854317b870ab P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 election: Requested vote from peers 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979), c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455)
I20260709 13:02:48.108883  9369 ts_tablet_manager.cc:1403] T 48e91509dfc74d53a930cdc636976db6 P 8846d581359a4b7ea6d4c33424ea825d: Time spent bootstrapping tablet: real 0.063s	user 0.015s	sys 0.005s
I20260709 13:02:48.111901  9369 raft_consensus.cc:359] T 48e91509dfc74d53a930cdc636976db6 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:48.112643  9369 raft_consensus.cc:385] T 48e91509dfc74d53a930cdc636976db6 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:48.112916  9369 raft_consensus.cc:740] T 48e91509dfc74d53a930cdc636976db6 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8846d581359a4b7ea6d4c33424ea825d, State: Initialized, Role: FOLLOWER
I20260709 13:02:48.113780  9369 consensus_queue.cc:260] T 48e91509dfc74d53a930cdc636976db6 P 8846d581359a4b7ea6d4c33424ea825d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:48.116333  9369 ts_tablet_manager.cc:1434] T 48e91509dfc74d53a930cdc636976db6 P 8846d581359a4b7ea6d4c33424ea825d: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 13:02:48.116694  9408 raft_consensus.cc:493] T 3899ef948b2e405baaccb81544b7f58b P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.117338  9369 tablet_bootstrap.cc:492] T d3044a44ee984c489779dc339d162407 P 8846d581359a4b7ea6d4c33424ea825d: Bootstrap starting.
I20260709 13:02:48.117808  9370 tablet_bootstrap.cc:492] T df7e9031dde347b5b9da753cc817ce17 P 74ac2cf163ee475e8a280cb3aa738f57: No bootstrap required, opened a new log
I20260709 13:02:48.118270  9370 ts_tablet_manager.cc:1403] T df7e9031dde347b5b9da753cc817ce17 P 74ac2cf163ee475e8a280cb3aa738f57: Time spent bootstrapping tablet: real 0.049s	user 0.012s	sys 0.006s
I20260709 13:02:48.120911  9370 raft_consensus.cc:359] T df7e9031dde347b5b9da753cc817ce17 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:48.121609  9370 raft_consensus.cc:385] T df7e9031dde347b5b9da753cc817ce17 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:48.121873  9370 raft_consensus.cc:740] T df7e9031dde347b5b9da753cc817ce17 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74ac2cf163ee475e8a280cb3aa738f57, State: Initialized, Role: FOLLOWER
I20260709 13:02:48.117347  9408 raft_consensus.cc:515] T 3899ef948b2e405baaccb81544b7f58b P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:48.124184  9369 tablet_bootstrap.cc:654] T d3044a44ee984c489779dc339d162407 P 8846d581359a4b7ea6d4c33424ea825d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:48.123879  9370 consensus_queue.cc:260] T df7e9031dde347b5b9da753cc817ce17 P 74ac2cf163ee475e8a280cb3aa738f57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:48.126048  9370 ts_tablet_manager.cc:1434] T df7e9031dde347b5b9da753cc817ce17 P 74ac2cf163ee475e8a280cb3aa738f57: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:02:48.126411  9324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3899ef948b2e405baaccb81544b7f58b" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57" is_pre_election: true
I20260709 13:02:48.127791  9324 raft_consensus.cc:2468] T 3899ef948b2e405baaccb81544b7f58b P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c694531b0e1d47988b291f1214efc4cb in term 0.
I20260709 13:02:48.129218  9141 leader_election.cc:304] T 3899ef948b2e405baaccb81544b7f58b P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57, c694531b0e1d47988b291f1214efc4cb; no voters: 
I20260709 13:02:48.131024  9473 raft_consensus.cc:2804] T 3899ef948b2e405baaccb81544b7f58b P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:48.131392  9473 raft_consensus.cc:493] T 3899ef948b2e405baaccb81544b7f58b P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:48.131717  9473 raft_consensus.cc:3060] T 3899ef948b2e405baaccb81544b7f58b P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:48.132140  9370 tablet_bootstrap.cc:492] T d3044a44ee984c489779dc339d162407 P 74ac2cf163ee475e8a280cb3aa738f57: Bootstrap starting.
I20260709 13:02:48.126072  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3899ef948b2e405baaccb81544b7f58b" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" is_pre_election: true
I20260709 13:02:48.124475  9408 leader_election.cc:290] T 3899ef948b2e405baaccb81544b7f58b P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351), 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979)
I20260709 13:02:48.138559  9099 raft_consensus.cc:2468] T 3899ef948b2e405baaccb81544b7f58b P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c694531b0e1d47988b291f1214efc4cb in term 0.
I20260709 13:02:48.139523  9370 tablet_bootstrap.cc:654] T d3044a44ee984c489779dc339d162407 P 74ac2cf163ee475e8a280cb3aa738f57: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:48.145423  9369 tablet_bootstrap.cc:492] T d3044a44ee984c489779dc339d162407 P 8846d581359a4b7ea6d4c33424ea825d: No bootstrap required, opened a new log
I20260709 13:02:48.125141  9372 tablet_bootstrap.cc:492] T eab411e3927a434ab647aa9b31fcf60d P 65ed95869fbb4b69b5d6eb99c51adf85: No bootstrap required, opened a new log
I20260709 13:02:48.146122  9369 ts_tablet_manager.cc:1403] T d3044a44ee984c489779dc339d162407 P 8846d581359a4b7ea6d4c33424ea825d: Time spent bootstrapping tablet: real 0.029s	user 0.019s	sys 0.008s
I20260709 13:02:48.146274  9372 ts_tablet_manager.cc:1403] T eab411e3927a434ab647aa9b31fcf60d P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent bootstrapping tablet: real 0.069s	user 0.024s	sys 0.015s
I20260709 13:02:48.147197  9370 tablet_bootstrap.cc:492] T d3044a44ee984c489779dc339d162407 P 74ac2cf163ee475e8a280cb3aa738f57: No bootstrap required, opened a new log
I20260709 13:02:48.147706  9370 ts_tablet_manager.cc:1403] T d3044a44ee984c489779dc339d162407 P 74ac2cf163ee475e8a280cb3aa738f57: Time spent bootstrapping tablet: real 0.016s	user 0.005s	sys 0.008s
I20260709 13:02:48.145500  9473 raft_consensus.cc:515] T 3899ef948b2e405baaccb81544b7f58b P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:48.149190  9369 raft_consensus.cc:359] T d3044a44ee984c489779dc339d162407 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:48.152268  9369 raft_consensus.cc:385] T d3044a44ee984c489779dc339d162407 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:48.152577  9369 raft_consensus.cc:740] T d3044a44ee984c489779dc339d162407 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8846d581359a4b7ea6d4c33424ea825d, State: Initialized, Role: FOLLOWER
I20260709 13:02:48.153374  9369 consensus_queue.cc:260] T d3044a44ee984c489779dc339d162407 P 8846d581359a4b7ea6d4c33424ea825d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:48.155891  9324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3899ef948b2e405baaccb81544b7f58b" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57"
I20260709 13:02:48.156579  9324 raft_consensus.cc:3060] T 3899ef948b2e405baaccb81544b7f58b P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:48.156266  9369 ts_tablet_manager.cc:1434] T d3044a44ee984c489779dc339d162407 P 8846d581359a4b7ea6d4c33424ea825d: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 13:02:48.160264  9369 tablet_bootstrap.cc:492] T 604bd81da85244b6bd6d8bd6ac674f2c P 8846d581359a4b7ea6d4c33424ea825d: Bootstrap starting.
I20260709 13:02:48.160766  9370 raft_consensus.cc:359] T d3044a44ee984c489779dc339d162407 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:48.161492  9370 raft_consensus.cc:385] T d3044a44ee984c489779dc339d162407 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:48.161765  9370 raft_consensus.cc:740] T d3044a44ee984c489779dc339d162407 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74ac2cf163ee475e8a280cb3aa738f57, State: Initialized, Role: FOLLOWER
I20260709 13:02:48.150987  9371 consensus_queue.cc:260] T 389a20133d8b4ebfaab346741dff367f P c694531b0e1d47988b291f1214efc4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:48.163568  9474 raft_consensus.cc:493] T 389a20133d8b4ebfaab346741dff367f P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.164052  9474 raft_consensus.cc:515] T 389a20133d8b4ebfaab346741dff367f P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:48.164884  9371 ts_tablet_manager.cc:1434] T 389a20133d8b4ebfaab346741dff367f P c694531b0e1d47988b291f1214efc4cb: Time spent starting tablet: real 0.076s	user 0.006s	sys 0.000s
I20260709 13:02:48.165946  9371 tablet_bootstrap.cc:492] T cb7f6aeb8116423481ea2b2dca5a06d4 P c694531b0e1d47988b291f1214efc4cb: Bootstrap starting.
I20260709 13:02:48.166771  9474 leader_election.cc:290] T 389a20133d8b4ebfaab346741dff367f P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979), 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311)
I20260709 13:02:48.167212  9473 leader_election.cc:290] T 3899ef948b2e405baaccb81544b7f58b P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 election: Requested vote from peers 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351), 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979)
I20260709 13:02:48.167376  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389a20133d8b4ebfaab346741dff367f" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" is_pre_election: true
I20260709 13:02:48.168025  9099 raft_consensus.cc:2468] T 389a20133d8b4ebfaab346741dff367f P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c694531b0e1d47988b291f1214efc4cb in term 0.
I20260709 13:02:48.168481  9246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389a20133d8b4ebfaab346741dff367f" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d" is_pre_election: true
I20260709 13:02:48.169157  9246 raft_consensus.cc:2468] T 389a20133d8b4ebfaab346741dff367f P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c694531b0e1d47988b291f1214efc4cb in term 0.
I20260709 13:02:48.169703  9141 leader_election.cc:304] T 389a20133d8b4ebfaab346741dff367f P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65ed95869fbb4b69b5d6eb99c51adf85, c694531b0e1d47988b291f1214efc4cb; no voters: 
I20260709 13:02:48.171445  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3899ef948b2e405baaccb81544b7f58b" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85"
I20260709 13:02:48.171280  9370 consensus_queue.cc:260] T d3044a44ee984c489779dc339d162407 P 74ac2cf163ee475e8a280cb3aa738f57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:48.171993  9369 tablet_bootstrap.cc:654] T 604bd81da85244b6bd6d8bd6ac674f2c P 8846d581359a4b7ea6d4c33424ea825d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:48.172088  9099 raft_consensus.cc:3060] T 3899ef948b2e405baaccb81544b7f58b P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:48.150225  9372 raft_consensus.cc:359] T eab411e3927a434ab647aa9b31fcf60d P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:48.172952  9370 ts_tablet_manager.cc:1434] T d3044a44ee984c489779dc339d162407 P 74ac2cf163ee475e8a280cb3aa738f57: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.001s
I20260709 13:02:48.174114  9370 tablet_bootstrap.cc:492] T 48e91509dfc74d53a930cdc636976db6 P 74ac2cf163ee475e8a280cb3aa738f57: Bootstrap starting.
I20260709 13:02:48.181529  9370 tablet_bootstrap.cc:654] T 48e91509dfc74d53a930cdc636976db6 P 74ac2cf163ee475e8a280cb3aa738f57: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:48.181396  9412 raft_consensus.cc:493] T eab411e3927a434ab647aa9b31fcf60d P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.182052  9412 raft_consensus.cc:515] T eab411e3927a434ab647aa9b31fcf60d P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:48.182379  9324 raft_consensus.cc:2468] T 3899ef948b2e405baaccb81544b7f58b P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c694531b0e1d47988b291f1214efc4cb in term 1.
I20260709 13:02:48.172937  9372 raft_consensus.cc:385] T eab411e3927a434ab647aa9b31fcf60d P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:48.183089  9371 tablet_bootstrap.cc:654] T cb7f6aeb8116423481ea2b2dca5a06d4 P c694531b0e1d47988b291f1214efc4cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:48.183070  9372 raft_consensus.cc:740] T eab411e3927a434ab647aa9b31fcf60d P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Initialized, Role: FOLLOWER
I20260709 13:02:48.183969  9372 consensus_queue.cc:260] T eab411e3927a434ab647aa9b31fcf60d P 65ed95869fbb4b69b5d6eb99c51adf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:48.184675  9412 leader_election.cc:290] T eab411e3927a434ab647aa9b31fcf60d P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311), 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979)
I20260709 13:02:48.188210  9099 raft_consensus.cc:2468] T 3899ef948b2e405baaccb81544b7f58b P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c694531b0e1d47988b291f1214efc4cb in term 1.
I20260709 13:02:48.188862  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eab411e3927a434ab647aa9b31fcf60d" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" is_pre_election: true
I20260709 13:02:48.189318  9473 raft_consensus.cc:2804] T 389a20133d8b4ebfaab346741dff367f P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:48.189597  9100 raft_consensus.cc:2468] T eab411e3927a434ab647aa9b31fcf60d P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74ac2cf163ee475e8a280cb3aa738f57 in term 0.
I20260709 13:02:48.189925  9473 raft_consensus.cc:493] T 389a20133d8b4ebfaab346741dff367f P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:48.190366  9473 raft_consensus.cc:3060] T 389a20133d8b4ebfaab346741dff367f P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:48.186744  9246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eab411e3927a434ab647aa9b31fcf60d" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d" is_pre_election: true
I20260709 13:02:48.192149  9246 raft_consensus.cc:2468] T eab411e3927a434ab647aa9b31fcf60d P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74ac2cf163ee475e8a280cb3aa738f57 in term 0.
I20260709 13:02:48.193471  9287 leader_election.cc:304] T eab411e3927a434ab647aa9b31fcf60d P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57, 8846d581359a4b7ea6d4c33424ea825d; no voters: 
I20260709 13:02:48.193310  8997 catalog_manager.cc:5697] T 059a6a9a07d74be4a9f3854317b870ab P 8846d581359a4b7ea6d4c33424ea825d reported cstate change: term changed from 0 to 1, leader changed from <none> to 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195). New cstate: current_term: 1 leader_uuid: "8846d581359a4b7ea6d4c33424ea825d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:48.194794  9141 leader_election.cc:304] T 3899ef948b2e405baaccb81544b7f58b P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65ed95869fbb4b69b5d6eb99c51adf85, c694531b0e1d47988b291f1214efc4cb; no voters: 
I20260709 13:02:48.195974  9412 raft_consensus.cc:2804] T eab411e3927a434ab647aa9b31fcf60d P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:48.196550  9474 raft_consensus.cc:2804] T 3899ef948b2e405baaccb81544b7f58b P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:48.197893  9474 raft_consensus.cc:697] T 3899ef948b2e405baaccb81544b7f58b P c694531b0e1d47988b291f1214efc4cb [term 1 LEADER]: Becoming Leader. State: Replica: c694531b0e1d47988b291f1214efc4cb, State: Running, Role: LEADER
I20260709 13:02:48.200146  9474 consensus_queue.cc:237] T 3899ef948b2e405baaccb81544b7f58b P c694531b0e1d47988b291f1214efc4cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:48.203894  9371 tablet_bootstrap.cc:492] T cb7f6aeb8116423481ea2b2dca5a06d4 P c694531b0e1d47988b291f1214efc4cb: No bootstrap required, opened a new log
I20260709 13:02:48.204437  9371 ts_tablet_manager.cc:1403] T cb7f6aeb8116423481ea2b2dca5a06d4 P c694531b0e1d47988b291f1214efc4cb: Time spent bootstrapping tablet: real 0.039s	user 0.009s	sys 0.002s
I20260709 13:02:48.207266  9371 raft_consensus.cc:359] T cb7f6aeb8116423481ea2b2dca5a06d4 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:48.207918  9371 raft_consensus.cc:385] T cb7f6aeb8116423481ea2b2dca5a06d4 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:48.208161  9371 raft_consensus.cc:740] T cb7f6aeb8116423481ea2b2dca5a06d4 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c694531b0e1d47988b291f1214efc4cb, State: Initialized, Role: FOLLOWER
I20260709 13:02:48.209967  9371 consensus_queue.cc:260] T cb7f6aeb8116423481ea2b2dca5a06d4 P c694531b0e1d47988b291f1214efc4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:48.212330  9412 raft_consensus.cc:493] T eab411e3927a434ab647aa9b31fcf60d P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:48.212849  9412 raft_consensus.cc:3060] T eab411e3927a434ab647aa9b31fcf60d P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:48.214550  9370 tablet_bootstrap.cc:492] T 48e91509dfc74d53a930cdc636976db6 P 74ac2cf163ee475e8a280cb3aa738f57: No bootstrap required, opened a new log
I20260709 13:02:48.212639  9371 ts_tablet_manager.cc:1434] T cb7f6aeb8116423481ea2b2dca5a06d4 P c694531b0e1d47988b291f1214efc4cb: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:02:48.216022  9371 tablet_bootstrap.cc:492] T 5b6b34440fd14f3ea66bd5de7a2a8260 P c694531b0e1d47988b291f1214efc4cb: Bootstrap starting.
I20260709 13:02:48.217303  9473 raft_consensus.cc:515] T 389a20133d8b4ebfaab346741dff367f P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:48.218015  9369 tablet_bootstrap.cc:492] T 604bd81da85244b6bd6d8bd6ac674f2c P 8846d581359a4b7ea6d4c33424ea825d: No bootstrap required, opened a new log
I20260709 13:02:48.218523  9369 ts_tablet_manager.cc:1403] T 604bd81da85244b6bd6d8bd6ac674f2c P 8846d581359a4b7ea6d4c33424ea825d: Time spent bootstrapping tablet: real 0.058s	user 0.008s	sys 0.019s
I20260709 13:02:48.221854  9371 tablet_bootstrap.cc:654] T 5b6b34440fd14f3ea66bd5de7a2a8260 P c694531b0e1d47988b291f1214efc4cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:48.221549  9369 raft_consensus.cc:359] T 604bd81da85244b6bd6d8bd6ac674f2c P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:48.222308  9369 raft_consensus.cc:385] T 604bd81da85244b6bd6d8bd6ac674f2c P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:48.222590  9369 raft_consensus.cc:740] T 604bd81da85244b6bd6d8bd6ac674f2c P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8846d581359a4b7ea6d4c33424ea825d, State: Initialized, Role: FOLLOWER
I20260709 13:02:48.223280  9369 consensus_queue.cc:260] T 604bd81da85244b6bd6d8bd6ac674f2c P 8846d581359a4b7ea6d4c33424ea825d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:48.225298  9369 ts_tablet_manager.cc:1434] T 604bd81da85244b6bd6d8bd6ac674f2c P 8846d581359a4b7ea6d4c33424ea825d: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:02:48.226218  9369 tablet_bootstrap.cc:492] T 50f8080d64c04e738a6a36d748c8ee1e P 8846d581359a4b7ea6d4c33424ea825d: Bootstrap starting.
I20260709 13:02:48.229928  9370 ts_tablet_manager.cc:1403] T 48e91509dfc74d53a930cdc636976db6 P 74ac2cf163ee475e8a280cb3aa738f57: Time spent bootstrapping tablet: real 0.056s	user 0.005s	sys 0.013s
I20260709 13:02:48.231732  9369 tablet_bootstrap.cc:654] T 50f8080d64c04e738a6a36d748c8ee1e P 8846d581359a4b7ea6d4c33424ea825d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:48.233573  9370 raft_consensus.cc:359] T 48e91509dfc74d53a930cdc636976db6 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:48.234288  9370 raft_consensus.cc:385] T 48e91509dfc74d53a930cdc636976db6 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:48.234537  9370 raft_consensus.cc:740] T 48e91509dfc74d53a930cdc636976db6 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74ac2cf163ee475e8a280cb3aa738f57, State: Initialized, Role: FOLLOWER
I20260709 13:02:48.235292  9370 consensus_queue.cc:260] T 48e91509dfc74d53a930cdc636976db6 P 74ac2cf163ee475e8a280cb3aa738f57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:48.236850  9464 consensus_queue.cc:1048] T 5ce2a33a3b914f6297946ded34c256bf P 65ed95869fbb4b69b5d6eb99c51adf85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:48.237592  9370 ts_tablet_manager.cc:1434] T 48e91509dfc74d53a930cdc636976db6 P 74ac2cf163ee475e8a280cb3aa738f57: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:02:48.238574  9370 tablet_bootstrap.cc:492] T f2229e498f7f472f97c088fddb802939 P 74ac2cf163ee475e8a280cb3aa738f57: Bootstrap starting.
I20260709 13:02:48.242818  9369 tablet_bootstrap.cc:492] T 50f8080d64c04e738a6a36d748c8ee1e P 8846d581359a4b7ea6d4c33424ea825d: No bootstrap required, opened a new log
I20260709 13:02:48.243350  9369 ts_tablet_manager.cc:1403] T 50f8080d64c04e738a6a36d748c8ee1e P 8846d581359a4b7ea6d4c33424ea825d: Time spent bootstrapping tablet: real 0.017s	user 0.010s	sys 0.000s
I20260709 13:02:48.244465  9370 tablet_bootstrap.cc:654] T f2229e498f7f472f97c088fddb802939 P 74ac2cf163ee475e8a280cb3aa738f57: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:48.247830  9473 leader_election.cc:290] T 389a20133d8b4ebfaab346741dff367f P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 election: Requested vote from peers 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979), 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311)
I20260709 13:02:48.246161  9369 raft_consensus.cc:359] T 50f8080d64c04e738a6a36d748c8ee1e P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:48.248768  9369 raft_consensus.cc:385] T 50f8080d64c04e738a6a36d748c8ee1e P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:48.249064  9369 raft_consensus.cc:740] T 50f8080d64c04e738a6a36d748c8ee1e P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8846d581359a4b7ea6d4c33424ea825d, State: Initialized, Role: FOLLOWER
I20260709 13:02:48.249116  9247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389a20133d8b4ebfaab346741dff367f" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d"
I20260709 13:02:48.249920  9247 raft_consensus.cc:3060] T 389a20133d8b4ebfaab346741dff367f P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:48.249830  9369 consensus_queue.cc:260] T 50f8080d64c04e738a6a36d748c8ee1e P 8846d581359a4b7ea6d4c33424ea825d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:48.251984  9369 ts_tablet_manager.cc:1434] T 50f8080d64c04e738a6a36d748c8ee1e P 8846d581359a4b7ea6d4c33424ea825d: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:02:48.253028  9369 tablet_bootstrap.cc:492] T 93ba4182a04b450ca3fc7a15896f889e P 8846d581359a4b7ea6d4c33424ea825d: Bootstrap starting.
I20260709 13:02:48.259112  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "389a20133d8b4ebfaab346741dff367f" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85"
I20260709 13:02:48.259631  9371 tablet_bootstrap.cc:492] T 5b6b34440fd14f3ea66bd5de7a2a8260 P c694531b0e1d47988b291f1214efc4cb: No bootstrap required, opened a new log
I20260709 13:02:48.259939  9100 raft_consensus.cc:3060] T 389a20133d8b4ebfaab346741dff367f P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:48.186744  9372 ts_tablet_manager.cc:1434] T eab411e3927a434ab647aa9b31fcf60d P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.000s
I20260709 13:02:48.263829  9372 tablet_bootstrap.cc:492] T f2229e498f7f472f97c088fddb802939 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap starting.
I20260709 13:02:48.260226  9369 tablet_bootstrap.cc:654] T 93ba4182a04b450ca3fc7a15896f889e P 8846d581359a4b7ea6d4c33424ea825d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:48.260208  9371 ts_tablet_manager.cc:1403] T 5b6b34440fd14f3ea66bd5de7a2a8260 P c694531b0e1d47988b291f1214efc4cb: Time spent bootstrapping tablet: real 0.044s	user 0.011s	sys 0.012s
I20260709 13:02:48.272446  9247 raft_consensus.cc:2468] T 389a20133d8b4ebfaab346741dff367f P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c694531b0e1d47988b291f1214efc4cb in term 1.
I20260709 13:02:48.275444  9139 leader_election.cc:304] T 389a20133d8b4ebfaab346741dff367f P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8846d581359a4b7ea6d4c33424ea825d, c694531b0e1d47988b291f1214efc4cb; no voters: 
I20260709 13:02:48.276554  9474 raft_consensus.cc:2804] T 389a20133d8b4ebfaab346741dff367f P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:48.277282  9474 raft_consensus.cc:697] T 389a20133d8b4ebfaab346741dff367f P c694531b0e1d47988b291f1214efc4cb [term 1 LEADER]: Becoming Leader. State: Replica: c694531b0e1d47988b291f1214efc4cb, State: Running, Role: LEADER
I20260709 13:02:48.278298  9474 consensus_queue.cc:237] T 389a20133d8b4ebfaab346741dff367f P c694531b0e1d47988b291f1214efc4cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:48.276152  9412 raft_consensus.cc:515] T eab411e3927a434ab647aa9b31fcf60d P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:48.281149  8997 catalog_manager.cc:5697] T 3899ef948b2e405baaccb81544b7f58b P c694531b0e1d47988b291f1214efc4cb reported cstate change: term changed from 0 to 1, leader changed from <none> to c694531b0e1d47988b291f1214efc4cb (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c694531b0e1d47988b291f1214efc4cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:48.285729  9372 tablet_bootstrap.cc:654] T f2229e498f7f472f97c088fddb802939 P 65ed95869fbb4b69b5d6eb99c51adf85: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:48.268493  9371 raft_consensus.cc:359] T 5b6b34440fd14f3ea66bd5de7a2a8260 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:48.286474  9371 raft_consensus.cc:385] T 5b6b34440fd14f3ea66bd5de7a2a8260 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:48.286842  9371 raft_consensus.cc:740] T 5b6b34440fd14f3ea66bd5de7a2a8260 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c694531b0e1d47988b291f1214efc4cb, State: Initialized, Role: FOLLOWER
I20260709 13:02:48.287608  9371 consensus_queue.cc:260] T 5b6b34440fd14f3ea66bd5de7a2a8260 P c694531b0e1d47988b291f1214efc4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:48.288316  9412 leader_election.cc:290] T eab411e3927a434ab647aa9b31fcf60d P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 election: Requested vote from peers 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311), 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979)
I20260709 13:02:48.296797  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eab411e3927a434ab647aa9b31fcf60d" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85"
I20260709 13:02:48.297508  9099 raft_consensus.cc:3060] T eab411e3927a434ab647aa9b31fcf60d P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:48.298072  9406 consensus_queue.cc:1048] T 989e9796152e4796a3408e00419403fa P 8846d581359a4b7ea6d4c33424ea825d [LEADER]: Connected to new peer: Peer: permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:48.301079  9377 consensus_queue.cc:1048] T 989e9796152e4796a3408e00419403fa P 8846d581359a4b7ea6d4c33424ea825d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:48.304601  9099 raft_consensus.cc:2468] T eab411e3927a434ab647aa9b31fcf60d P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74ac2cf163ee475e8a280cb3aa738f57 in term 1.
I20260709 13:02:48.305912  9289 leader_election.cc:304] T eab411e3927a434ab647aa9b31fcf60d P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65ed95869fbb4b69b5d6eb99c51adf85, 74ac2cf163ee475e8a280cb3aa738f57; no voters: 
I20260709 13:02:48.306478  9377 raft_consensus.cc:493] T 5b6b34440fd14f3ea66bd5de7a2a8260 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.308364  9412 raft_consensus.cc:2804] T eab411e3927a434ab647aa9b31fcf60d P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:48.309378  9247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eab411e3927a434ab647aa9b31fcf60d" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d"
I20260709 13:02:48.310099  9247 raft_consensus.cc:3060] T eab411e3927a434ab647aa9b31fcf60d P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:48.315021  9412 raft_consensus.cc:697] T eab411e3927a434ab647aa9b31fcf60d P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 LEADER]: Becoming Leader. State: Replica: 74ac2cf163ee475e8a280cb3aa738f57, State: Running, Role: LEADER
I20260709 13:02:48.316008  9412 consensus_queue.cc:237] T eab411e3927a434ab647aa9b31fcf60d P 74ac2cf163ee475e8a280cb3aa738f57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:48.317112  9531 consensus_queue.cc:1048] T 5ce2a33a3b914f6297946ded34c256bf P 65ed95869fbb4b69b5d6eb99c51adf85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:48.307068  9377 raft_consensus.cc:515] T 5b6b34440fd14f3ea66bd5de7a2a8260 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:48.319638  9100 raft_consensus.cc:2468] T 389a20133d8b4ebfaab346741dff367f P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c694531b0e1d47988b291f1214efc4cb in term 1.
I20260709 13:02:48.321946  9173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6b34440fd14f3ea66bd5de7a2a8260" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694531b0e1d47988b291f1214efc4cb" is_pre_election: true
I20260709 13:02:48.322728  9173 raft_consensus.cc:2468] T 5b6b34440fd14f3ea66bd5de7a2a8260 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8846d581359a4b7ea6d4c33424ea825d in term 0.
I20260709 13:02:48.323856  9371 ts_tablet_manager.cc:1434] T 5b6b34440fd14f3ea66bd5de7a2a8260 P c694531b0e1d47988b291f1214efc4cb: Time spent starting tablet: real 0.058s	user 0.003s	sys 0.003s
I20260709 13:02:48.324926  9371 tablet_bootstrap.cc:492] T a1ab6d75958044aeac9e1d43da9dc4b9 P c694531b0e1d47988b291f1214efc4cb: Bootstrap starting.
I20260709 13:02:48.325345  9531 consensus_queue.cc:1048] T d2ef0242573643178d56d10a6c26ae8e P 65ed95869fbb4b69b5d6eb99c51adf85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:48.326570  9214 leader_election.cc:304] T 5b6b34440fd14f3ea66bd5de7a2a8260 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8846d581359a4b7ea6d4c33424ea825d, c694531b0e1d47988b291f1214efc4cb; no voters: 
I20260709 13:02:48.327493  9406 raft_consensus.cc:2804] T 5b6b34440fd14f3ea66bd5de7a2a8260 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:48.327857  9406 raft_consensus.cc:493] T 5b6b34440fd14f3ea66bd5de7a2a8260 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:48.328208  9406 raft_consensus.cc:3060] T 5b6b34440fd14f3ea66bd5de7a2a8260 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:48.333694  9247 raft_consensus.cc:2468] T eab411e3927a434ab647aa9b31fcf60d P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74ac2cf163ee475e8a280cb3aa738f57 in term 1.
I20260709 13:02:48.339820  9371 tablet_bootstrap.cc:654] T a1ab6d75958044aeac9e1d43da9dc4b9 P c694531b0e1d47988b291f1214efc4cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:48.341536  9406 raft_consensus.cc:515] T 5b6b34440fd14f3ea66bd5de7a2a8260 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:48.345716  9173 raft_consensus.cc:3060] T dbdc8579cca94ef7ab4babd287837e8c P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:48.342233  9370 tablet_bootstrap.cc:492] T f2229e498f7f472f97c088fddb802939 P 74ac2cf163ee475e8a280cb3aa738f57: No bootstrap required, opened a new log
I20260709 13:02:48.352630  9370 ts_tablet_manager.cc:1403] T f2229e498f7f472f97c088fddb802939 P 74ac2cf163ee475e8a280cb3aa738f57: Time spent bootstrapping tablet: real 0.114s	user 0.033s	sys 0.024s
I20260709 13:02:48.342967  9377 leader_election.cc:290] T 5b6b34440fd14f3ea66bd5de7a2a8260 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979), c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455)
I20260709 13:02:48.352747  9412 raft_consensus.cc:493] T d3044a44ee984c489779dc339d162407 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.353978  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6b34440fd14f3ea66bd5de7a2a8260" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" is_pre_election: true
I20260709 13:02:48.353451  8996 catalog_manager.cc:5697] T eab411e3927a434ab647aa9b31fcf60d P 74ac2cf163ee475e8a280cb3aa738f57 reported cstate change: term changed from 0 to 1, leader changed from <none> to 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "74ac2cf163ee475e8a280cb3aa738f57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:48.354890  9412 raft_consensus.cc:515] T d3044a44ee984c489779dc339d162407 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:48.362129  9406 leader_election.cc:290] T 5b6b34440fd14f3ea66bd5de7a2a8260 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 election: Requested vote from peers 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979), c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455)
I20260709 13:02:48.366586  9372 tablet_bootstrap.cc:492] T f2229e498f7f472f97c088fddb802939 P 65ed95869fbb4b69b5d6eb99c51adf85: No bootstrap required, opened a new log
I20260709 13:02:48.367228  9372 ts_tablet_manager.cc:1403] T f2229e498f7f472f97c088fddb802939 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent bootstrapping tablet: real 0.104s	user 0.010s	sys 0.000s
I20260709 13:02:48.367439  9176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6b34440fd14f3ea66bd5de7a2a8260" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694531b0e1d47988b291f1214efc4cb"
I20260709 13:02:48.368093  9176 raft_consensus.cc:3060] T 5b6b34440fd14f3ea66bd5de7a2a8260 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:48.374791  9529 consensus_queue.cc:1048] T d2ef0242573643178d56d10a6c26ae8e P 65ed95869fbb4b69b5d6eb99c51adf85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:48.375345  9369 tablet_bootstrap.cc:492] T 93ba4182a04b450ca3fc7a15896f889e P 8846d581359a4b7ea6d4c33424ea825d: No bootstrap required, opened a new log
I20260709 13:02:48.375985  9369 ts_tablet_manager.cc:1403] T 93ba4182a04b450ca3fc7a15896f889e P 8846d581359a4b7ea6d4c33424ea825d: Time spent bootstrapping tablet: real 0.123s	user 0.015s	sys 0.001s
I20260709 13:02:48.377321  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3044a44ee984c489779dc339d162407" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" is_pre_election: true
I20260709 13:02:48.378016  9100 raft_consensus.cc:2468] T d3044a44ee984c489779dc339d162407 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74ac2cf163ee475e8a280cb3aa738f57 in term 0.
I20260709 13:02:48.379217  9412 leader_election.cc:290] T d3044a44ee984c489779dc339d162407 P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311), 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979)
I20260709 13:02:48.380275  9372 raft_consensus.cc:359] T f2229e498f7f472f97c088fddb802939 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:48.380959  9372 raft_consensus.cc:385] T f2229e498f7f472f97c088fddb802939 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:48.381249  9372 raft_consensus.cc:740] T f2229e498f7f472f97c088fddb802939 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Initialized, Role: FOLLOWER
I20260709 13:02:48.381919  9372 consensus_queue.cc:260] T f2229e498f7f472f97c088fddb802939 P 65ed95869fbb4b69b5d6eb99c51adf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:48.390110  9371 tablet_bootstrap.cc:492] T a1ab6d75958044aeac9e1d43da9dc4b9 P c694531b0e1d47988b291f1214efc4cb: No bootstrap required, opened a new log
I20260709 13:02:48.390735  9371 ts_tablet_manager.cc:1403] T a1ab6d75958044aeac9e1d43da9dc4b9 P c694531b0e1d47988b291f1214efc4cb: Time spent bootstrapping tablet: real 0.066s	user 0.007s	sys 0.011s
I20260709 13:02:48.378963  9369 raft_consensus.cc:359] T 93ba4182a04b450ca3fc7a15896f889e P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:48.379881  9289 leader_election.cc:304] T d3044a44ee984c489779dc339d162407 P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65ed95869fbb4b69b5d6eb99c51adf85, 74ac2cf163ee475e8a280cb3aa738f57; no voters: 
I20260709 13:02:48.394095  9372 ts_tablet_manager.cc:1434] T f2229e498f7f472f97c088fddb802939 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.002s
I20260709 13:02:48.366456  9474 raft_consensus.cc:493] T f2229e498f7f472f97c088fddb802939 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.394702  9370 raft_consensus.cc:359] T f2229e498f7f472f97c088fddb802939 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:48.393807  9371 raft_consensus.cc:359] T a1ab6d75958044aeac9e1d43da9dc4b9 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:48.396880  9371 raft_consensus.cc:385] T a1ab6d75958044aeac9e1d43da9dc4b9 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:48.396624  9370 raft_consensus.cc:385] T f2229e498f7f472f97c088fddb802939 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:48.397790  9370 raft_consensus.cc:740] T f2229e498f7f472f97c088fddb802939 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74ac2cf163ee475e8a280cb3aa738f57, State: Initialized, Role: FOLLOWER
I20260709 13:02:48.397186  9371 raft_consensus.cc:740] T a1ab6d75958044aeac9e1d43da9dc4b9 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c694531b0e1d47988b291f1214efc4cb, State: Initialized, Role: FOLLOWER
I20260709 13:02:48.396195  9412 raft_consensus.cc:493] T 50f8080d64c04e738a6a36d748c8ee1e P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.398553  9549 raft_consensus.cc:2804] T d3044a44ee984c489779dc339d162407 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:48.398763  9412 raft_consensus.cc:515] T 50f8080d64c04e738a6a36d748c8ee1e P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:48.387595  9176 raft_consensus.cc:2468] T 5b6b34440fd14f3ea66bd5de7a2a8260 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8846d581359a4b7ea6d4c33424ea825d in term 1.
I20260709 13:02:48.401476  9370 consensus_queue.cc:260] T f2229e498f7f472f97c088fddb802939 P 74ac2cf163ee475e8a280cb3aa738f57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:48.394342  9369 raft_consensus.cc:385] T 93ba4182a04b450ca3fc7a15896f889e P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:48.395877  9372 tablet_bootstrap.cc:492] T 93ba4182a04b450ca3fc7a15896f889e P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap starting.
I20260709 13:02:48.401867  9549 raft_consensus.cc:493] T d3044a44ee984c489779dc339d162407 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:48.405062  9549 raft_consensus.cc:3060] T d3044a44ee984c489779dc339d162407 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:48.405284  9175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50f8080d64c04e738a6a36d748c8ee1e" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694531b0e1d47988b291f1214efc4cb" is_pre_election: true
W20260709 13:02:48.406912  9288 leader_election.cc:343] T 50f8080d64c04e738a6a36d748c8ee1e P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:48.407652  9371 consensus_queue.cc:260] T a1ab6d75958044aeac9e1d43da9dc4b9 P c694531b0e1d47988b291f1214efc4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:48.402737  9369 raft_consensus.cc:740] T 93ba4182a04b450ca3fc7a15896f889e P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8846d581359a4b7ea6d4c33424ea825d, State: Initialized, Role: FOLLOWER
I20260709 13:02:48.409391  9369 consensus_queue.cc:260] T 93ba4182a04b450ca3fc7a15896f889e P 8846d581359a4b7ea6d4c33424ea825d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:48.411417  9371 ts_tablet_manager.cc:1434] T a1ab6d75958044aeac9e1d43da9dc4b9 P c694531b0e1d47988b291f1214efc4cb: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:02:48.412873  9371 tablet_bootstrap.cc:492] T 50f8080d64c04e738a6a36d748c8ee1e P c694531b0e1d47988b291f1214efc4cb: Bootstrap starting.
I20260709 13:02:48.413479  9549 raft_consensus.cc:515] T d3044a44ee984c489779dc339d162407 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:48.397972  9474 raft_consensus.cc:515] T f2229e498f7f472f97c088fddb802939 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:48.418128  9319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2229e498f7f472f97c088fddb802939" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57" is_pre_election: true
I20260709 13:02:48.418473  9369 ts_tablet_manager.cc:1434] T 93ba4182a04b450ca3fc7a15896f889e P 8846d581359a4b7ea6d4c33424ea825d: Time spent starting tablet: real 0.042s	user 0.003s	sys 0.003s
I20260709 13:02:48.419003  9319 raft_consensus.cc:2468] T f2229e498f7f472f97c088fddb802939 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c694531b0e1d47988b291f1214efc4cb in term 0.
I20260709 13:02:48.419485  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2229e498f7f472f97c088fddb802939" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" is_pre_election: true
I20260709 13:02:48.420141  9100 raft_consensus.cc:2468] T f2229e498f7f472f97c088fddb802939 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c694531b0e1d47988b291f1214efc4cb in term 0.
I20260709 13:02:48.420301  9410 raft_consensus.cc:493] T 48e91509dfc74d53a930cdc636976db6 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.420789  9410 raft_consensus.cc:515] T 48e91509dfc74d53a930cdc636976db6 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:48.421451  9141 leader_election.cc:304] T f2229e498f7f472f97c088fddb802939 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65ed95869fbb4b69b5d6eb99c51adf85, c694531b0e1d47988b291f1214efc4cb; no voters: 
I20260709 13:02:48.422273  9473 raft_consensus.cc:2804] T f2229e498f7f472f97c088fddb802939 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:48.422626  9473 raft_consensus.cc:493] T f2229e498f7f472f97c088fddb802939 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:48.422910  9474 leader_election.cc:290] T f2229e498f7f472f97c088fddb802939 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351), 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979)
I20260709 13:02:48.422987  9473 raft_consensus.cc:3060] T f2229e498f7f472f97c088fddb802939 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:48.429253  9412 leader_election.cc:290] T 50f8080d64c04e738a6a36d748c8ee1e P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455), 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311)
I20260709 13:02:48.430519  9529 raft_consensus.cc:493] T 48e91509dfc74d53a930cdc636976db6 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.431092  9529 raft_consensus.cc:515] T 48e91509dfc74d53a930cdc636976db6 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:48.433205  9529 leader_election.cc:290] T 48e91509dfc74d53a930cdc636976db6 P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311), 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351)
I20260709 13:02:48.435348  9214 leader_election.cc:304] T 5b6b34440fd14f3ea66bd5de7a2a8260 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8846d581359a4b7ea6d4c33424ea825d, c694531b0e1d47988b291f1214efc4cb; no voters: 
I20260709 13:02:48.441984  9410 leader_election.cc:290] T 48e91509dfc74d53a930cdc636976db6 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351), 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979)
I20260709 13:02:48.437798  9247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e91509dfc74d53a930cdc636976db6" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d" is_pre_election: true
I20260709 13:02:48.441306  9481 raft_consensus.cc:493] T d3044a44ee984c489779dc339d162407 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.419505  9369 tablet_bootstrap.cc:492] T a1ab6d75958044aeac9e1d43da9dc4b9 P 8846d581359a4b7ea6d4c33424ea825d: Bootstrap starting.
I20260709 13:02:48.453974  9481 raft_consensus.cc:515] T d3044a44ee984c489779dc339d162407 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:48.454233  9410 raft_consensus.cc:2804] T 5b6b34440fd14f3ea66bd5de7a2a8260 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:48.464682  9410 raft_consensus.cc:697] T 5b6b34440fd14f3ea66bd5de7a2a8260 P 8846d581359a4b7ea6d4c33424ea825d [term 1 LEADER]: Becoming Leader. State: Replica: 8846d581359a4b7ea6d4c33424ea825d, State: Running, Role: LEADER
I20260709 13:02:48.465555  9410 consensus_queue.cc:237] T 5b6b34440fd14f3ea66bd5de7a2a8260 P 8846d581359a4b7ea6d4c33424ea825d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
W20260709 13:02:48.446964  9215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:44351, user_credentials={real_user=slave}} blocked reactor thread for 48788.4us
W20260709 13:02:48.471462  9215 leader_election.cc:343] T 5b6b34440fd14f3ea66bd5de7a2a8260 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:48.474452  9409 consensus_queue.cc:1048] T 0a377c4fc6c04b0aa8f74f64f4f59409 P 8846d581359a4b7ea6d4c33424ea825d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:48.474929  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6b34440fd14f3ea66bd5de7a2a8260" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85"
I20260709 13:02:48.477560  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e91509dfc74d53a930cdc636976db6" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" is_pre_election: true
I20260709 13:02:48.478406  9098 raft_consensus.cc:2468] T 48e91509dfc74d53a930cdc636976db6 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8846d581359a4b7ea6d4c33424ea825d in term 0.
I20260709 13:02:48.477953  9319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e91509dfc74d53a930cdc636976db6" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57" is_pre_election: true
I20260709 13:02:48.478307  9481 leader_election.cc:290] T d3044a44ee984c489779dc339d162407 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351), 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979)
I20260709 13:02:48.482807  9319 raft_consensus.cc:2468] T 48e91509dfc74d53a930cdc636976db6 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8846d581359a4b7ea6d4c33424ea825d in term 0.
I20260709 13:02:48.454957  9247 raft_consensus.cc:2468] T 48e91509dfc74d53a930cdc636976db6 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65ed95869fbb4b69b5d6eb99c51adf85 in term 0.
I20260709 13:02:48.484714  9064 leader_election.cc:304] T 48e91509dfc74d53a930cdc636976db6 P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65ed95869fbb4b69b5d6eb99c51adf85, 8846d581359a4b7ea6d4c33424ea825d; no voters: 
I20260709 13:02:48.485512  9529 raft_consensus.cc:2804] T 48e91509dfc74d53a930cdc636976db6 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:48.485883  9529 raft_consensus.cc:493] T 48e91509dfc74d53a930cdc636976db6 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:48.486214  9529 raft_consensus.cc:3060] T 48e91509dfc74d53a930cdc636976db6 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:48.478628  9483 raft_consensus.cc:493] T 50f8080d64c04e738a6a36d748c8ee1e P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.492019  9483 raft_consensus.cc:515] T 50f8080d64c04e738a6a36d748c8ee1e P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:48.494297  9483 leader_election.cc:290] T 50f8080d64c04e738a6a36d748c8ee1e P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455), 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351)
I20260709 13:02:48.494355  8997 catalog_manager.cc:5697] T 389a20133d8b4ebfaab346741dff367f P c694531b0e1d47988b291f1214efc4cb reported cstate change: term changed from 0 to 1, leader changed from <none> to c694531b0e1d47988b291f1214efc4cb (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c694531b0e1d47988b291f1214efc4cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:48.495843  9246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50f8080d64c04e738a6a36d748c8ee1e" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d" is_pre_election: true
I20260709 13:02:48.496985  9549 leader_election.cc:290] T d3044a44ee984c489779dc339d162407 P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 election: Requested vote from peers 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311), 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979)
I20260709 13:02:48.498270  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3044a44ee984c489779dc339d162407" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85"
I20260709 13:02:48.498420  9320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3044a44ee984c489779dc339d162407" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57" is_pre_election: true
I20260709 13:02:48.499972  9319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50f8080d64c04e738a6a36d748c8ee1e" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57" is_pre_election: true
W20260709 13:02:48.498827  9215 leader_election.cc:343] T 5b6b34440fd14f3ea66bd5de7a2a8260 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:48.499446  9247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3044a44ee984c489779dc339d162407" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d" is_pre_election: true
I20260709 13:02:48.502856  9098 raft_consensus.cc:3060] T d3044a44ee984c489779dc339d162407 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:48.500809  9473 raft_consensus.cc:515] T f2229e498f7f472f97c088fddb802939 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:48.502456  9372 tablet_bootstrap.cc:654] T 93ba4182a04b450ca3fc7a15896f889e P 65ed95869fbb4b69b5d6eb99c51adf85: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:48.501469  9371 tablet_bootstrap.cc:654] T 50f8080d64c04e738a6a36d748c8ee1e P c694531b0e1d47988b291f1214efc4cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:48.507252  9370 ts_tablet_manager.cc:1434] T f2229e498f7f472f97c088fddb802939 P 74ac2cf163ee475e8a280cb3aa738f57: Time spent starting tablet: real 0.150s	user 0.008s	sys 0.006s
I20260709 13:02:48.508222  9370 tablet_bootstrap.cc:492] T cb7f6aeb8116423481ea2b2dca5a06d4 P 74ac2cf163ee475e8a280cb3aa738f57: Bootstrap starting.
I20260709 13:02:48.503682  9247 raft_consensus.cc:2468] T d3044a44ee984c489779dc339d162407 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74ac2cf163ee475e8a280cb3aa738f57 in term 0.
I20260709 13:02:48.501971  9246 raft_consensus.cc:2468] T 50f8080d64c04e738a6a36d748c8ee1e P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74ac2cf163ee475e8a280cb3aa738f57 in term 0.
I20260709 13:02:48.513338  9320 raft_consensus.cc:2393] T d3044a44ee984c489779dc339d162407 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8846d581359a4b7ea6d4c33424ea825d in current term 1: Already voted for candidate 74ac2cf163ee475e8a280cb3aa738f57 in this term.
I20260709 13:02:48.504957  9319 raft_consensus.cc:2468] T 50f8080d64c04e738a6a36d748c8ee1e P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8846d581359a4b7ea6d4c33424ea825d in term 0.
I20260709 13:02:48.517521  9175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50f8080d64c04e738a6a36d748c8ee1e" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694531b0e1d47988b291f1214efc4cb" is_pre_election: true
I20260709 13:02:48.525627  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3044a44ee984c489779dc339d162407" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" is_pre_election: true
I20260709 13:02:48.536631  9369 tablet_bootstrap.cc:654] T a1ab6d75958044aeac9e1d43da9dc4b9 P 8846d581359a4b7ea6d4c33424ea825d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:48.525068  9529 raft_consensus.cc:515] T 48e91509dfc74d53a930cdc636976db6 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:48.548709  9098 raft_consensus.cc:2468] T d3044a44ee984c489779dc339d162407 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74ac2cf163ee475e8a280cb3aa738f57 in term 1.
I20260709 13:02:48.569053  9369 tablet_bootstrap.cc:492] T a1ab6d75958044aeac9e1d43da9dc4b9 P 8846d581359a4b7ea6d4c33424ea825d: No bootstrap required, opened a new log
I20260709 13:02:48.570024  9369 ts_tablet_manager.cc:1403] T a1ab6d75958044aeac9e1d43da9dc4b9 P 8846d581359a4b7ea6d4c33424ea825d: Time spent bootstrapping tablet: real 0.151s	user 0.014s	sys 0.000s
I20260709 13:02:48.570803  9289 leader_election.cc:304] T d3044a44ee984c489779dc339d162407 P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65ed95869fbb4b69b5d6eb99c51adf85, 74ac2cf163ee475e8a280cb3aa738f57; no voters: 
I20260709 13:02:48.571957  9595 raft_consensus.cc:2804] T d3044a44ee984c489779dc339d162407 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:48.572574  9595 raft_consensus.cc:697] T d3044a44ee984c489779dc339d162407 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 LEADER]: Becoming Leader. State: Replica: 74ac2cf163ee475e8a280cb3aa738f57, State: Running, Role: LEADER
I20260709 13:02:48.573516  9595 consensus_queue.cc:237] T d3044a44ee984c489779dc339d162407 P 74ac2cf163ee475e8a280cb3aa738f57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:48.574011  9369 raft_consensus.cc:359] T a1ab6d75958044aeac9e1d43da9dc4b9 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:48.574920  9369 raft_consensus.cc:385] T a1ab6d75958044aeac9e1d43da9dc4b9 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:48.556963  9408 raft_consensus.cc:493] T a1ab6d75958044aeac9e1d43da9dc4b9 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.575264  9369 raft_consensus.cc:740] T a1ab6d75958044aeac9e1d43da9dc4b9 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8846d581359a4b7ea6d4c33424ea825d, State: Initialized, Role: FOLLOWER
I20260709 13:02:48.576076  9369 consensus_queue.cc:260] T a1ab6d75958044aeac9e1d43da9dc4b9 P 8846d581359a4b7ea6d4c33424ea825d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:48.579416  9369 ts_tablet_manager.cc:1434] T a1ab6d75958044aeac9e1d43da9dc4b9 P 8846d581359a4b7ea6d4c33424ea825d: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:02:48.580940  9369 tablet_bootstrap.cc:492] T 902451f24024496b83b9a05dfe359a22 P 8846d581359a4b7ea6d4c33424ea825d: Bootstrap starting.
I20260709 13:02:48.543494  9215 leader_election.cc:304] T 48e91509dfc74d53a930cdc636976db6 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65ed95869fbb4b69b5d6eb99c51adf85, 8846d581359a4b7ea6d4c33424ea825d; no voters: 
I20260709 13:02:48.583211  9481 raft_consensus.cc:2804] T 48e91509dfc74d53a930cdc636976db6 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:48.583736  9481 raft_consensus.cc:493] T 48e91509dfc74d53a930cdc636976db6 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:48.584543  9319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e91509dfc74d53a930cdc636976db6" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57" is_pre_election: true
I20260709 13:02:48.584954  9408 raft_consensus.cc:515] T a1ab6d75958044aeac9e1d43da9dc4b9 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:48.586498  9481 raft_consensus.cc:3060] T 48e91509dfc74d53a930cdc636976db6 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:48.587203  9408 leader_election.cc:290] T a1ab6d75958044aeac9e1d43da9dc4b9 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979), 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311)
W20260709 13:02:48.554590  9214 leader_election.cc:343] T 50f8080d64c04e738a6a36d748c8ee1e P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:48.555239  9473 leader_election.cc:290] T f2229e498f7f472f97c088fddb802939 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 election: Requested vote from peers 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351), 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979)
I20260709 13:02:48.592403  9246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ab6d75958044aeac9e1d43da9dc4b9" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d" is_pre_election: true
I20260709 13:02:48.593183  9246 raft_consensus.cc:2468] T a1ab6d75958044aeac9e1d43da9dc4b9 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c694531b0e1d47988b291f1214efc4cb in term 0.
I20260709 13:02:48.594075  9369 tablet_bootstrap.cc:654] T 902451f24024496b83b9a05dfe359a22 P 8846d581359a4b7ea6d4c33424ea825d: Neither blocks nor log segments found. Creating new log.
W20260709 13:02:48.583101  9215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33979, user_credentials={real_user=slave}} blocked reactor thread for 52989us
I20260709 13:02:48.594502  9594 raft_consensus.cc:493] T df7e9031dde347b5b9da753cc817ce17 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.595760  9320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2229e498f7f472f97c088fddb802939" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57"
I20260709 13:02:48.596410  9320 raft_consensus.cc:3060] T f2229e498f7f472f97c088fddb802939 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:48.596711  9215 leader_election.cc:304] T 50f8080d64c04e738a6a36d748c8ee1e P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57, 8846d581359a4b7ea6d4c33424ea825d; no voters: c694531b0e1d47988b291f1214efc4cb
I20260709 13:02:48.594584  9139 leader_election.cc:304] T a1ab6d75958044aeac9e1d43da9dc4b9 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8846d581359a4b7ea6d4c33424ea825d, c694531b0e1d47988b291f1214efc4cb; no voters: 
I20260709 13:02:48.597539  9483 raft_consensus.cc:2804] T 50f8080d64c04e738a6a36d748c8ee1e P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:48.595165  9319 raft_consensus.cc:2468] T 48e91509dfc74d53a930cdc636976db6 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65ed95869fbb4b69b5d6eb99c51adf85 in term 0.
I20260709 13:02:48.597961  9483 raft_consensus.cc:493] T 50f8080d64c04e738a6a36d748c8ee1e P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:48.598434  9483 raft_consensus.cc:3060] T 50f8080d64c04e738a6a36d748c8ee1e P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:48.598574  9473 raft_consensus.cc:2804] T a1ab6d75958044aeac9e1d43da9dc4b9 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:48.595222  9594 raft_consensus.cc:515] T df7e9031dde347b5b9da753cc817ce17 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:48.601292  9594 leader_election.cc:290] T df7e9031dde347b5b9da753cc817ce17 P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979), c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455)
I20260709 13:02:48.599102  9246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3044a44ee984c489779dc339d162407" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d"
I20260709 13:02:48.602360  9246 raft_consensus.cc:3060] T d3044a44ee984c489779dc339d162407 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:48.602108  9481 raft_consensus.cc:515] T 48e91509dfc74d53a930cdc636976db6 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:48.604497  9287 leader_election.cc:304] T 50f8080d64c04e738a6a36d748c8ee1e P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57, 8846d581359a4b7ea6d4c33424ea825d; no voters: c694531b0e1d47988b291f1214efc4cb
I20260709 13:02:48.605032  9215 leader_election.cc:304] T d3044a44ee984c489779dc339d162407 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8846d581359a4b7ea6d4c33424ea825d; no voters: 65ed95869fbb4b69b5d6eb99c51adf85, 74ac2cf163ee475e8a280cb3aa738f57
I20260709 13:02:48.605368  9481 leader_election.cc:290] T 48e91509dfc74d53a930cdc636976db6 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 election: Requested vote from peers 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351), 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979)
I20260709 13:02:48.606448  9412 raft_consensus.cc:2804] T 50f8080d64c04e738a6a36d748c8ee1e P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:48.606920  9412 raft_consensus.cc:493] T 50f8080d64c04e738a6a36d748c8ee1e P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:48.607218  9176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7e9031dde347b5b9da753cc817ce17" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694531b0e1d47988b291f1214efc4cb" is_pre_election: true
I20260709 13:02:48.607997  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7e9031dde347b5b9da753cc817ce17" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" is_pre_election: true
I20260709 13:02:48.599074  9473 raft_consensus.cc:493] T a1ab6d75958044aeac9e1d43da9dc4b9 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:48.608804  9473 raft_consensus.cc:3060] T a1ab6d75958044aeac9e1d43da9dc4b9 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:48.609377  9288 leader_election.cc:343] T df7e9031dde347b5b9da753cc817ce17 P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:48.609670  9529 leader_election.cc:290] T 48e91509dfc74d53a930cdc636976db6 P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 1 election: Requested vote from peers 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311), 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351)
I20260709 13:02:48.607257  9412 raft_consensus.cc:3060] T 50f8080d64c04e738a6a36d748c8ee1e P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:48.611250  9370 tablet_bootstrap.cc:654] T cb7f6aeb8116423481ea2b2dca5a06d4 P 74ac2cf163ee475e8a280cb3aa738f57: Neither blocks nor log segments found. Creating new log.
W20260709 13:02:48.614784  9066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:44351, user_credentials={real_user=slave}} blocked reactor thread for 82174.5us
I20260709 13:02:48.638610  8998 catalog_manager.cc:5697] T 5b6b34440fd14f3ea66bd5de7a2a8260 P 8846d581359a4b7ea6d4c33424ea825d reported cstate change: term changed from 0 to 1, leader changed from <none> to 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195). New cstate: current_term: 1 leader_uuid: "8846d581359a4b7ea6d4c33424ea825d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:48.632021  9247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e91509dfc74d53a930cdc636976db6" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d"
I20260709 13:02:48.646603  9319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e91509dfc74d53a930cdc636976db6" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57"
I20260709 13:02:48.647452  9324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e91509dfc74d53a930cdc636976db6" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57"
I20260709 13:02:48.648030  9406 consensus_queue.cc:1048] T 0a377c4fc6c04b0aa8f74f64f4f59409 P 8846d581359a4b7ea6d4c33424ea825d [LEADER]: Connected to new peer: Peer: permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:48.651430  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e91509dfc74d53a930cdc636976db6" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85"
I20260709 13:02:48.652360  9101 raft_consensus.cc:2393] T 48e91509dfc74d53a930cdc636976db6 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8846d581359a4b7ea6d4c33424ea825d in current term 1: Already voted for candidate 65ed95869fbb4b69b5d6eb99c51adf85 in this term.
I20260709 13:02:48.642352  9246 raft_consensus.cc:2468] T d3044a44ee984c489779dc339d162407 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74ac2cf163ee475e8a280cb3aa738f57 in term 1.
I20260709 13:02:48.654768  9410 raft_consensus.cc:2749] T d3044a44ee984c489779dc339d162407 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:48.647330  9319 raft_consensus.cc:3060] T 48e91509dfc74d53a930cdc636976db6 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:48.642352  9320 raft_consensus.cc:2468] T f2229e498f7f472f97c088fddb802939 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c694531b0e1d47988b291f1214efc4cb in term 1.
W20260709 13:02:48.633949  9289 leader_election.cc:343] T df7e9031dde347b5b9da753cc817ce17 P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:48.658483  9377 consensus_queue.cc:1048] T 059a6a9a07d74be4a9f3854317b870ab P 8846d581359a4b7ea6d4c33424ea825d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:02:48.663965  9247 raft_consensus.cc:2393] T 48e91509dfc74d53a930cdc636976db6 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 65ed95869fbb4b69b5d6eb99c51adf85 in current term 1: Already voted for candidate 8846d581359a4b7ea6d4c33424ea825d in this term.
I20260709 13:02:48.673297  9473 raft_consensus.cc:515] T a1ab6d75958044aeac9e1d43da9dc4b9 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:48.677673  9473 leader_election.cc:290] T a1ab6d75958044aeac9e1d43da9dc4b9 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 election: Requested vote from peers 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979), 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311)
I20260709 13:02:48.659637  9289 leader_election.cc:304] T df7e9031dde347b5b9da753cc817ce17 P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57; no voters: 65ed95869fbb4b69b5d6eb99c51adf85, c694531b0e1d47988b291f1214efc4cb
I20260709 13:02:48.700999  9594 raft_consensus.cc:2749] T df7e9031dde347b5b9da753cc817ce17 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:48.683233  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2229e498f7f472f97c088fddb802939" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85"
I20260709 13:02:48.701726  9098 raft_consensus.cc:3060] T f2229e498f7f472f97c088fddb802939 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:48.698869  9372 tablet_bootstrap.cc:492] T 93ba4182a04b450ca3fc7a15896f889e P 65ed95869fbb4b69b5d6eb99c51adf85: No bootstrap required, opened a new log
I20260709 13:02:48.702687  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ab6d75958044aeac9e1d43da9dc4b9" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" is_pre_election: true
I20260709 13:02:48.659458  9483 raft_consensus.cc:515] T 50f8080d64c04e738a6a36d748c8ee1e P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:48.682798  9474 raft_consensus.cc:493] T cb7f6aeb8116423481ea2b2dca5a06d4 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.705462  9066 leader_election.cc:304] T 48e91509dfc74d53a930cdc636976db6 P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65ed95869fbb4b69b5d6eb99c51adf85; no voters: 74ac2cf163ee475e8a280cb3aa738f57, 8846d581359a4b7ea6d4c33424ea825d
I20260709 13:02:48.706480  9464 raft_consensus.cc:2749] T 48e91509dfc74d53a930cdc636976db6 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:02:48.702945  9372 ts_tablet_manager.cc:1403] T 93ba4182a04b450ca3fc7a15896f889e P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent bootstrapping tablet: real 0.307s	user 0.045s	sys 0.015s
I20260709 13:02:48.685551  9246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ab6d75958044aeac9e1d43da9dc4b9" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d"
W20260709 13:02:48.701176  9289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33979, user_credentials={real_user=slave}} blocked reactor thread for 67672us
I20260709 13:02:48.714959  9410 consensus_queue.cc:1048] T 059a6a9a07d74be4a9f3854317b870ab P 8846d581359a4b7ea6d4c33424ea825d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:48.707683  9474 raft_consensus.cc:515] T cb7f6aeb8116423481ea2b2dca5a06d4 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:48.717737  9483 leader_election.cc:290] T 50f8080d64c04e738a6a36d748c8ee1e P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 election: Requested vote from peers c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455), 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351)
I20260709 13:02:48.718478  9246 raft_consensus.cc:3060] T a1ab6d75958044aeac9e1d43da9dc4b9 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:48.719218  9474 leader_election.cc:290] T cb7f6aeb8116423481ea2b2dca5a06d4 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311), 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351)
I20260709 13:02:48.721021  9173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50f8080d64c04e738a6a36d748c8ee1e" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694531b0e1d47988b291f1214efc4cb"
I20260709 13:02:48.721551  9247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7f6aeb8116423481ea2b2dca5a06d4" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d" is_pre_election: true
I20260709 13:02:48.722220  9247 raft_consensus.cc:2468] T cb7f6aeb8116423481ea2b2dca5a06d4 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c694531b0e1d47988b291f1214efc4cb in term 0.
I20260709 13:02:48.722460  9369 tablet_bootstrap.cc:492] T 902451f24024496b83b9a05dfe359a22 P 8846d581359a4b7ea6d4c33424ea825d: No bootstrap required, opened a new log
I20260709 13:02:48.722977  9369 ts_tablet_manager.cc:1403] T 902451f24024496b83b9a05dfe359a22 P 8846d581359a4b7ea6d4c33424ea825d: Time spent bootstrapping tablet: real 0.142s	user 0.021s	sys 0.022s
W20260709 13:02:48.723172  9214 leader_election.cc:343] T 50f8080d64c04e738a6a36d748c8ee1e P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:48.724331  9139 leader_election.cc:304] T cb7f6aeb8116423481ea2b2dca5a06d4 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8846d581359a4b7ea6d4c33424ea825d, c694531b0e1d47988b291f1214efc4cb; no voters: 
W20260709 13:02:48.725675  9141 leader_election.cc:343] T a1ab6d75958044aeac9e1d43da9dc4b9 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:48.728262  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ab6d75958044aeac9e1d43da9dc4b9" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85"
I20260709 13:02:48.721274  9371 tablet_bootstrap.cc:492] T 50f8080d64c04e738a6a36d748c8ee1e P c694531b0e1d47988b291f1214efc4cb: No bootstrap required, opened a new log
I20260709 13:02:48.732020  9371 ts_tablet_manager.cc:1403] T 50f8080d64c04e738a6a36d748c8ee1e P c694531b0e1d47988b291f1214efc4cb: Time spent bootstrapping tablet: real 0.319s	user 0.011s	sys 0.013s
I20260709 13:02:48.731012  9369 raft_consensus.cc:359] T 902451f24024496b83b9a05dfe359a22 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:48.738461  9369 raft_consensus.cc:385] T 902451f24024496b83b9a05dfe359a22 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:48.738806  9369 raft_consensus.cc:740] T 902451f24024496b83b9a05dfe359a22 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8846d581359a4b7ea6d4c33424ea825d, State: Initialized, Role: FOLLOWER
I20260709 13:02:48.739907  9369 consensus_queue.cc:260] T 902451f24024496b83b9a05dfe359a22 P 8846d581359a4b7ea6d4c33424ea825d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:48.717633  9319 raft_consensus.cc:2468] T 48e91509dfc74d53a930cdc636976db6 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8846d581359a4b7ea6d4c33424ea825d in term 1.
I20260709 13:02:48.751942  9371 raft_consensus.cc:359] T 50f8080d64c04e738a6a36d748c8ee1e P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:48.752542  9371 raft_consensus.cc:385] T 50f8080d64c04e738a6a36d748c8ee1e P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:48.737717  9473 raft_consensus.cc:2804] T cb7f6aeb8116423481ea2b2dca5a06d4 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:48.753705  9369 ts_tablet_manager.cc:1434] T 902451f24024496b83b9a05dfe359a22 P 8846d581359a4b7ea6d4c33424ea825d: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 13:02:48.737104  9483 raft_consensus.cc:493] T 604bd81da85244b6bd6d8bd6ac674f2c P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.752753  9371 raft_consensus.cc:740] T 50f8080d64c04e738a6a36d748c8ee1e P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c694531b0e1d47988b291f1214efc4cb, State: Initialized, Role: FOLLOWER
W20260709 13:02:48.742060  9141 leader_election.cc:343] T a1ab6d75958044aeac9e1d43da9dc4b9 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:48.766486  9370 tablet_bootstrap.cc:492] T cb7f6aeb8116423481ea2b2dca5a06d4 P 74ac2cf163ee475e8a280cb3aa738f57: No bootstrap required, opened a new log
I20260709 13:02:48.767096  9370 ts_tablet_manager.cc:1403] T cb7f6aeb8116423481ea2b2dca5a06d4 P 74ac2cf163ee475e8a280cb3aa738f57: Time spent bootstrapping tablet: real 0.259s	user 0.018s	sys 0.010s
I20260709 13:02:48.767267  9322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7f6aeb8116423481ea2b2dca5a06d4" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57" is_pre_election: true
I20260709 13:02:48.768157  9141 leader_election.cc:304] T f2229e498f7f472f97c088fddb802939 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57, c694531b0e1d47988b291f1214efc4cb; no voters: 
I20260709 13:02:48.768976  9408 raft_consensus.cc:2804] T f2229e498f7f472f97c088fddb802939 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:48.764544  9371 consensus_queue.cc:260] T 50f8080d64c04e738a6a36d748c8ee1e P c694531b0e1d47988b291f1214efc4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:48.757040  9473 raft_consensus.cc:493] T cb7f6aeb8116423481ea2b2dca5a06d4 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:48.740942  9412 raft_consensus.cc:515] T 50f8080d64c04e738a6a36d748c8ee1e P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:48.773912  9215 leader_election.cc:304] T 48e91509dfc74d53a930cdc636976db6 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57, 8846d581359a4b7ea6d4c33424ea825d; no voters: 65ed95869fbb4b69b5d6eb99c51adf85
I20260709 13:02:48.779546  9246 raft_consensus.cc:2468] T a1ab6d75958044aeac9e1d43da9dc4b9 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c694531b0e1d47988b291f1214efc4cb in term 1.
I20260709 13:02:48.781538  9369 tablet_bootstrap.cc:492] T a971867a8d494757a297936fad4bd464 P 8846d581359a4b7ea6d4c33424ea825d: Bootstrap starting.
I20260709 13:02:48.784981  9410 raft_consensus.cc:2804] T 48e91509dfc74d53a930cdc636976db6 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:48.786470  9410 raft_consensus.cc:697] T 48e91509dfc74d53a930cdc636976db6 P 8846d581359a4b7ea6d4c33424ea825d [term 1 LEADER]: Becoming Leader. State: Replica: 8846d581359a4b7ea6d4c33424ea825d, State: Running, Role: LEADER
I20260709 13:02:48.787444  9410 consensus_queue.cc:237] T 48e91509dfc74d53a930cdc636976db6 P 8846d581359a4b7ea6d4c33424ea825d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:48.788671  9370 raft_consensus.cc:359] T cb7f6aeb8116423481ea2b2dca5a06d4 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:48.789386  9370 raft_consensus.cc:385] T cb7f6aeb8116423481ea2b2dca5a06d4 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:48.789654  9370 raft_consensus.cc:740] T cb7f6aeb8116423481ea2b2dca5a06d4 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74ac2cf163ee475e8a280cb3aa738f57, State: Initialized, Role: FOLLOWER
I20260709 13:02:48.792788  9370 consensus_queue.cc:260] T cb7f6aeb8116423481ea2b2dca5a06d4 P 74ac2cf163ee475e8a280cb3aa738f57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:48.775179  9321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50f8080d64c04e738a6a36d748c8ee1e" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57"
I20260709 13:02:48.795063  9408 raft_consensus.cc:697] T f2229e498f7f472f97c088fddb802939 P c694531b0e1d47988b291f1214efc4cb [term 1 LEADER]: Becoming Leader. State: Replica: c694531b0e1d47988b291f1214efc4cb, State: Running, Role: LEADER
I20260709 13:02:48.795776  9322 raft_consensus.cc:2468] T cb7f6aeb8116423481ea2b2dca5a06d4 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c694531b0e1d47988b291f1214efc4cb in term 0.
I20260709 13:02:48.796159  9408 consensus_queue.cc:237] T f2229e498f7f472f97c088fddb802939 P c694531b0e1d47988b291f1214efc4cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:48.775993  9473 raft_consensus.cc:3060] T cb7f6aeb8116423481ea2b2dca5a06d4 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:48.803078  9321 raft_consensus.cc:2393] T 50f8080d64c04e738a6a36d748c8ee1e P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8846d581359a4b7ea6d4c33424ea825d in current term 1: Already voted for candidate 74ac2cf163ee475e8a280cb3aa738f57 in this term.
I20260709 13:02:48.759629  9483 raft_consensus.cc:515] T 604bd81da85244b6bd6d8bd6ac674f2c P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:48.812695  9371 ts_tablet_manager.cc:1434] T 50f8080d64c04e738a6a36d748c8ee1e P c694531b0e1d47988b291f1214efc4cb: Time spent starting tablet: real 0.080s	user 0.006s	sys 0.001s
I20260709 13:02:48.819443  9370 ts_tablet_manager.cc:1434] T cb7f6aeb8116423481ea2b2dca5a06d4 P 74ac2cf163ee475e8a280cb3aa738f57: Time spent starting tablet: real 0.052s	user 0.007s	sys 0.000s
I20260709 13:02:48.820138  9371 tablet_bootstrap.cc:492] T df7e9031dde347b5b9da753cc817ce17 P c694531b0e1d47988b291f1214efc4cb: Bootstrap starting.
I20260709 13:02:48.814049  9369 tablet_bootstrap.cc:654] T a971867a8d494757a297936fad4bd464 P 8846d581359a4b7ea6d4c33424ea825d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:48.816851  8996 catalog_manager.cc:5697] T d3044a44ee984c489779dc339d162407 P 74ac2cf163ee475e8a280cb3aa738f57 reported cstate change: term changed from 0 to 1, leader changed from <none> to 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "74ac2cf163ee475e8a280cb3aa738f57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:48.821239  9594 consensus_queue.cc:1048] T eab411e3927a434ab647aa9b31fcf60d P 74ac2cf163ee475e8a280cb3aa738f57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:02:48.823369  9370 tablet_bootstrap.cc:492] T 902451f24024496b83b9a05dfe359a22 P 74ac2cf163ee475e8a280cb3aa738f57: Bootstrap starting.
I20260709 13:02:48.832212  9174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604bd81da85244b6bd6d8bd6ac674f2c" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694531b0e1d47988b291f1214efc4cb" is_pre_election: true
I20260709 13:02:48.813011  9098 raft_consensus.cc:2468] T f2229e498f7f472f97c088fddb802939 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c694531b0e1d47988b291f1214efc4cb in term 1.
I20260709 13:02:48.825637  9215 leader_election.cc:304] T 50f8080d64c04e738a6a36d748c8ee1e P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8846d581359a4b7ea6d4c33424ea825d; no voters: 74ac2cf163ee475e8a280cb3aa738f57, c694531b0e1d47988b291f1214efc4cb
W20260709 13:02:48.835391  9214 leader_election.cc:343] T 604bd81da85244b6bd6d8bd6ac674f2c P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:48.836177  9474 consensus_queue.cc:1048] T 3899ef948b2e405baaccb81544b7f58b P c694531b0e1d47988b291f1214efc4cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:48.831036  9412 leader_election.cc:290] T 50f8080d64c04e738a6a36d748c8ee1e P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 election: Requested vote from peers c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455), 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311)
W20260709 13:02:48.819964  9047 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:48.828454  9483 leader_election.cc:290] T 604bd81da85244b6bd6d8bd6ac674f2c P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979), c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455)
I20260709 13:02:48.857681  9372 raft_consensus.cc:359] T 93ba4182a04b450ca3fc7a15896f889e P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:48.860953  9372 raft_consensus.cc:385] T 93ba4182a04b450ca3fc7a15896f889e P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:48.861304  9372 raft_consensus.cc:740] T 93ba4182a04b450ca3fc7a15896f889e P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Initialized, Role: FOLLOWER
I20260709 13:02:48.855333  9377 raft_consensus.cc:2749] T 50f8080d64c04e738a6a36d748c8ee1e P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:02:48.863063  9372 consensus_queue.cc:260] T 93ba4182a04b450ca3fc7a15896f889e P 65ed95869fbb4b69b5d6eb99c51adf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:48.865648  9372 ts_tablet_manager.cc:1434] T 93ba4182a04b450ca3fc7a15896f889e P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent starting tablet: real 0.157s	user 0.010s	sys 0.001s
I20260709 13:02:48.867058  9372 tablet_bootstrap.cc:492] T bfb390576f2e4f508caa2d234ed5d425 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap starting.
I20260709 13:02:48.871268  9406 raft_consensus.cc:493] T 93ba4182a04b450ca3fc7a15896f889e P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.871837  9406 raft_consensus.cc:515] T 93ba4182a04b450ca3fc7a15896f889e P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:48.873348  9372 tablet_bootstrap.cc:654] T bfb390576f2e4f508caa2d234ed5d425 P 65ed95869fbb4b69b5d6eb99c51adf85: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:48.873876  9406 leader_election.cc:290] T 93ba4182a04b450ca3fc7a15896f889e P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351), 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979)
I20260709 13:02:48.878368  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604bd81da85244b6bd6d8bd6ac674f2c" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" is_pre_election: true
I20260709 13:02:48.876084  9612 consensus_queue.cc:1048] T 389a20133d8b4ebfaab346741dff367f P c694531b0e1d47988b291f1214efc4cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 13:02:48.901767  9377 raft_consensus.cc:493] T 902451f24024496b83b9a05dfe359a22 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.908453  9246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50f8080d64c04e738a6a36d748c8ee1e" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d"
I20260709 13:02:48.867498  9473 raft_consensus.cc:515] T cb7f6aeb8116423481ea2b2dca5a06d4 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:48.911237  9377 raft_consensus.cc:515] T 902451f24024496b83b9a05dfe359a22 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:48.927485  9176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50f8080d64c04e738a6a36d748c8ee1e" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694531b0e1d47988b291f1214efc4cb"
I20260709 13:02:48.927747  9139 leader_election.cc:304] T a1ab6d75958044aeac9e1d43da9dc4b9 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8846d581359a4b7ea6d4c33424ea825d, c694531b0e1d47988b291f1214efc4cb; no voters: 65ed95869fbb4b69b5d6eb99c51adf85
I20260709 13:02:48.931824  9246 raft_consensus.cc:2393] T 50f8080d64c04e738a6a36d748c8ee1e P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 74ac2cf163ee475e8a280cb3aa738f57 in current term 1: Already voted for candidate 8846d581359a4b7ea6d4c33424ea825d in this term.
I20260709 13:02:48.935060  9371 tablet_bootstrap.cc:654] T df7e9031dde347b5b9da753cc817ce17 P c694531b0e1d47988b291f1214efc4cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:48.935984  9369 tablet_bootstrap.cc:492] T a971867a8d494757a297936fad4bd464 P 8846d581359a4b7ea6d4c33424ea825d: No bootstrap required, opened a new log
I20260709 13:02:48.936484  9369 ts_tablet_manager.cc:1403] T a971867a8d494757a297936fad4bd464 P 8846d581359a4b7ea6d4c33424ea825d: Time spent bootstrapping tablet: real 0.155s	user 0.017s	sys 0.004s
I20260709 13:02:48.930928  9176 raft_consensus.cc:3060] T 50f8080d64c04e738a6a36d748c8ee1e P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:48.940989  8997 catalog_manager.cc:5697] T 48e91509dfc74d53a930cdc636976db6 P 8846d581359a4b7ea6d4c33424ea825d reported cstate change: term changed from 0 to 1, leader changed from <none> to 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195). New cstate: current_term: 1 leader_uuid: "8846d581359a4b7ea6d4c33424ea825d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:48.947182  9369 raft_consensus.cc:359] T a971867a8d494757a297936fad4bd464 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:48.948076  9369 raft_consensus.cc:385] T a971867a8d494757a297936fad4bd464 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:48.948369  9369 raft_consensus.cc:740] T a971867a8d494757a297936fad4bd464 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8846d581359a4b7ea6d4c33424ea825d, State: Initialized, Role: FOLLOWER
I20260709 13:02:48.948980  9369 consensus_queue.cc:260] T a971867a8d494757a297936fad4bd464 P 8846d581359a4b7ea6d4c33424ea825d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:48.951808  9372 tablet_bootstrap.cc:492] T bfb390576f2e4f508caa2d234ed5d425 P 65ed95869fbb4b69b5d6eb99c51adf85: No bootstrap required, opened a new log
I20260709 13:02:48.952370  9372 ts_tablet_manager.cc:1403] T bfb390576f2e4f508caa2d234ed5d425 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent bootstrapping tablet: real 0.086s	user 0.011s	sys 0.017s
I20260709 13:02:48.955613  9408 raft_consensus.cc:2804] T a1ab6d75958044aeac9e1d43da9dc4b9 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:48.956202  9408 raft_consensus.cc:697] T a1ab6d75958044aeac9e1d43da9dc4b9 P c694531b0e1d47988b291f1214efc4cb [term 1 LEADER]: Becoming Leader. State: Replica: c694531b0e1d47988b291f1214efc4cb, State: Running, Role: LEADER
W20260709 13:02:48.957542  9215 leader_election.cc:343] T 604bd81da85244b6bd6d8bd6ac674f2c P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:48.958061  9215 leader_election.cc:304] T 604bd81da85244b6bd6d8bd6ac674f2c P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8846d581359a4b7ea6d4c33424ea825d; no voters: 65ed95869fbb4b69b5d6eb99c51adf85, c694531b0e1d47988b291f1214efc4cb
I20260709 13:02:48.957054  9408 consensus_queue.cc:237] T a1ab6d75958044aeac9e1d43da9dc4b9 P c694531b0e1d47988b291f1214efc4cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:48.960019  9321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93ba4182a04b450ca3fc7a15896f889e" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57" is_pre_election: true
I20260709 13:02:48.955871  9377 leader_election.cc:290] T 902451f24024496b83b9a05dfe359a22 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455), 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351)
I20260709 13:02:48.957964  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93ba4182a04b450ca3fc7a15896f889e" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" is_pre_election: true
I20260709 13:02:48.963218  9174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902451f24024496b83b9a05dfe359a22" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694531b0e1d47988b291f1214efc4cb" is_pre_election: true
I20260709 13:02:48.964076  9176 raft_consensus.cc:2468] T 50f8080d64c04e738a6a36d748c8ee1e P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74ac2cf163ee475e8a280cb3aa738f57 in term 1.
W20260709 13:02:48.965942  9214 leader_election.cc:343] T 902451f24024496b83b9a05dfe359a22 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:48.963274  9101 raft_consensus.cc:2468] T 93ba4182a04b450ca3fc7a15896f889e P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8846d581359a4b7ea6d4c33424ea825d in term 0.
I20260709 13:02:48.973465  9372 raft_consensus.cc:359] T bfb390576f2e4f508caa2d234ed5d425 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:48.974253  9372 raft_consensus.cc:385] T bfb390576f2e4f508caa2d234ed5d425 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:48.966499  9473 leader_election.cc:290] T cb7f6aeb8116423481ea2b2dca5a06d4 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 election: Requested vote from peers 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311), 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351)
I20260709 13:02:48.967504  9370 tablet_bootstrap.cc:654] T 902451f24024496b83b9a05dfe359a22 P 74ac2cf163ee475e8a280cb3aa738f57: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:48.974534  9372 raft_consensus.cc:740] T bfb390576f2e4f508caa2d234ed5d425 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Initialized, Role: FOLLOWER
I20260709 13:02:48.979570  9369 ts_tablet_manager.cc:1434] T a971867a8d494757a297936fad4bd464 P 8846d581359a4b7ea6d4c33424ea825d: Time spent starting tablet: real 0.043s	user 0.006s	sys 0.000s
I20260709 13:02:48.995967  9369 tablet_bootstrap.cc:492] T d755a5211e5c4133bead5603a424005e P 8846d581359a4b7ea6d4c33424ea825d: Bootstrap starting.
I20260709 13:02:48.996347  9372 consensus_queue.cc:260] T bfb390576f2e4f508caa2d234ed5d425 P 65ed95869fbb4b69b5d6eb99c51adf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:48.993568  8996 catalog_manager.cc:5697] T f2229e498f7f472f97c088fddb802939 P c694531b0e1d47988b291f1214efc4cb reported cstate change: term changed from 0 to 1, leader changed from <none> to c694531b0e1d47988b291f1214efc4cb (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c694531b0e1d47988b291f1214efc4cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:48.987849  9250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7f6aeb8116423481ea2b2dca5a06d4" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d"
I20260709 13:02:48.975325  9483 raft_consensus.cc:2749] T 604bd81da85244b6bd6d8bd6ac674f2c P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:48.987201  9288 leader_election.cc:304] T 50f8080d64c04e738a6a36d748c8ee1e P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57, c694531b0e1d47988b291f1214efc4cb; no voters: 
I20260709 13:02:49.025269  9372 ts_tablet_manager.cc:1434] T bfb390576f2e4f508caa2d234ed5d425 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent starting tablet: real 0.073s	user 0.006s	sys 0.001s
I20260709 13:02:49.026402  9371 tablet_bootstrap.cc:492] T df7e9031dde347b5b9da753cc817ce17 P c694531b0e1d47988b291f1214efc4cb: No bootstrap required, opened a new log
I20260709 13:02:49.027061  9371 ts_tablet_manager.cc:1403] T df7e9031dde347b5b9da753cc817ce17 P c694531b0e1d47988b291f1214efc4cb: Time spent bootstrapping tablet: real 0.207s	user 0.032s	sys 0.022s
I20260709 13:02:49.030987  9594 raft_consensus.cc:2804] T 50f8080d64c04e738a6a36d748c8ee1e P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:49.031627  9594 raft_consensus.cc:697] T 50f8080d64c04e738a6a36d748c8ee1e P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 LEADER]: Becoming Leader. State: Replica: 74ac2cf163ee475e8a280cb3aa738f57, State: Running, Role: LEADER
I20260709 13:02:49.032495  9594 consensus_queue.cc:237] T 50f8080d64c04e738a6a36d748c8ee1e P 74ac2cf163ee475e8a280cb3aa738f57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:49.035082  9369 tablet_bootstrap.cc:654] T d755a5211e5c4133bead5603a424005e P 8846d581359a4b7ea6d4c33424ea825d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:49.022455  9250 raft_consensus.cc:3060] T cb7f6aeb8116423481ea2b2dca5a06d4 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:49.044633  9409 consensus_queue.cc:1048] T 5b6b34440fd14f3ea66bd5de7a2a8260 P 8846d581359a4b7ea6d4c33424ea825d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:49.068982  9372 tablet_bootstrap.cc:492] T 604bd81da85244b6bd6d8bd6ac674f2c P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap starting.
I20260709 13:02:49.075500  9370 tablet_bootstrap.cc:492] T 902451f24024496b83b9a05dfe359a22 P 74ac2cf163ee475e8a280cb3aa738f57: No bootstrap required, opened a new log
I20260709 13:02:49.076056  9370 ts_tablet_manager.cc:1403] T 902451f24024496b83b9a05dfe359a22 P 74ac2cf163ee475e8a280cb3aa738f57: Time spent bootstrapping tablet: real 0.256s	user 0.012s	sys 0.000s
I20260709 13:02:49.078768  9370 raft_consensus.cc:359] T 902451f24024496b83b9a05dfe359a22 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:49.066846  9371 raft_consensus.cc:359] T df7e9031dde347b5b9da753cc817ce17 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:49.079631  9370 raft_consensus.cc:385] T 902451f24024496b83b9a05dfe359a22 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:48.979202  9473 consensus_queue.cc:1048] T 3899ef948b2e405baaccb81544b7f58b P c694531b0e1d47988b291f1214efc4cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.075s
I20260709 13:02:48.984489  9215 leader_election.cc:304] T 93ba4182a04b450ca3fc7a15896f889e P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65ed95869fbb4b69b5d6eb99c51adf85, 8846d581359a4b7ea6d4c33424ea825d; no voters: 
I20260709 13:02:49.079990  9371 raft_consensus.cc:385] T df7e9031dde347b5b9da753cc817ce17 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:49.081583  9371 raft_consensus.cc:740] T df7e9031dde347b5b9da753cc817ce17 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c694531b0e1d47988b291f1214efc4cb, State: Initialized, Role: FOLLOWER
I20260709 13:02:49.082343  9371 consensus_queue.cc:260] T df7e9031dde347b5b9da753cc817ce17 P c694531b0e1d47988b291f1214efc4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:49.080001  9370 raft_consensus.cc:740] T 902451f24024496b83b9a05dfe359a22 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74ac2cf163ee475e8a280cb3aa738f57, State: Initialized, Role: FOLLOWER
I20260709 13:02:49.090431  9371 ts_tablet_manager.cc:1434] T df7e9031dde347b5b9da753cc817ce17 P c694531b0e1d47988b291f1214efc4cb: Time spent starting tablet: real 0.063s	user 0.007s	sys 0.000s
I20260709 13:02:49.091425  9371 tablet_bootstrap.cc:492] T 8f67cb568c0745e792c17959b07c5da1 P c694531b0e1d47988b291f1214efc4cb: Bootstrap starting.
I20260709 13:02:49.086311  9409 raft_consensus.cc:2804] T 93ba4182a04b450ca3fc7a15896f889e P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:02:49.081147  9215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33979, user_credentials={real_user=slave}} blocked reactor thread for 96719.8us
I20260709 13:02:49.096215  9409 raft_consensus.cc:493] T 93ba4182a04b450ca3fc7a15896f889e P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:49.104878  9409 raft_consensus.cc:3060] T 93ba4182a04b450ca3fc7a15896f889e P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:49.105460  9371 tablet_bootstrap.cc:654] T 8f67cb568c0745e792c17959b07c5da1 P c694531b0e1d47988b291f1214efc4cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:49.095407  9370 consensus_queue.cc:260] T 902451f24024496b83b9a05dfe359a22 P 74ac2cf163ee475e8a280cb3aa738f57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:49.100111  9623 consensus_queue.cc:1048] T 389a20133d8b4ebfaab346741dff367f P c694531b0e1d47988b291f1214efc4cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:02:49.099100  9599 raft_consensus.cc:493] T bfb390576f2e4f508caa2d234ed5d425 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.111358  9599 raft_consensus.cc:515] T bfb390576f2e4f508caa2d234ed5d425 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:49.113651  9599 leader_election.cc:290] T bfb390576f2e4f508caa2d234ed5d425 P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351), c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455)
I20260709 13:02:49.115666  9321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb390576f2e4f508caa2d234ed5d425" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57" is_pre_election: true
W20260709 13:02:49.117314  9066 leader_election.cc:343] T bfb390576f2e4f508caa2d234ed5d425 P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:49.119174  9409 raft_consensus.cc:515] T 93ba4182a04b450ca3fc7a15896f889e P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:49.121500  9409 leader_election.cc:290] T 93ba4182a04b450ca3fc7a15896f889e P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 election: Requested vote from peers 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351), 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979)
I20260709 13:02:49.123522  9372 tablet_bootstrap.cc:654] T 604bd81da85244b6bd6d8bd6ac674f2c P 65ed95869fbb4b69b5d6eb99c51adf85: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:49.125278  8996 catalog_manager.cc:5697] T 50f8080d64c04e738a6a36d748c8ee1e P 74ac2cf163ee475e8a280cb3aa738f57 reported cstate change: term changed from 0 to 1, leader changed from <none> to 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "74ac2cf163ee475e8a280cb3aa738f57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:49.133823  9595 consensus_queue.cc:1048] T d3044a44ee984c489779dc339d162407 P 74ac2cf163ee475e8a280cb3aa738f57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:49.134568  9370 ts_tablet_manager.cc:1434] T 902451f24024496b83b9a05dfe359a22 P 74ac2cf163ee475e8a280cb3aa738f57: Time spent starting tablet: real 0.058s	user 0.007s	sys 0.000s
I20260709 13:02:49.135589  9370 tablet_bootstrap.cc:492] T 8f67cb568c0745e792c17959b07c5da1 P 74ac2cf163ee475e8a280cb3aa738f57: Bootstrap starting.
I20260709 13:02:49.142014  9370 tablet_bootstrap.cc:654] T 8f67cb568c0745e792c17959b07c5da1 P 74ac2cf163ee475e8a280cb3aa738f57: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:49.143553  9595 consensus_queue.cc:1048] T eab411e3927a434ab647aa9b31fcf60d P 74ac2cf163ee475e8a280cb3aa738f57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:49.145265  9321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902451f24024496b83b9a05dfe359a22" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57" is_pre_election: true
I20260709 13:02:49.145957  9321 raft_consensus.cc:2468] T 902451f24024496b83b9a05dfe359a22 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8846d581359a4b7ea6d4c33424ea825d in term 0.
I20260709 13:02:49.150395  9176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb390576f2e4f508caa2d234ed5d425" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694531b0e1d47988b291f1214efc4cb" is_pre_election: true
I20260709 13:02:49.154249  9369 tablet_bootstrap.cc:492] T d755a5211e5c4133bead5603a424005e P 8846d581359a4b7ea6d4c33424ea825d: No bootstrap required, opened a new log
I20260709 13:02:49.155099  9369 ts_tablet_manager.cc:1403] T d755a5211e5c4133bead5603a424005e P 8846d581359a4b7ea6d4c33424ea825d: Time spent bootstrapping tablet: real 0.159s	user 0.027s	sys 0.009s
I20260709 13:02:49.158900  9369 raft_consensus.cc:359] T d755a5211e5c4133bead5603a424005e P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:49.159598  9369 raft_consensus.cc:385] T d755a5211e5c4133bead5603a424005e P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:49.159858  9369 raft_consensus.cc:740] T d755a5211e5c4133bead5603a424005e P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8846d581359a4b7ea6d4c33424ea825d, State: Initialized, Role: FOLLOWER
I20260709 13:02:49.160522  9369 consensus_queue.cc:260] T d755a5211e5c4133bead5603a424005e P 8846d581359a4b7ea6d4c33424ea825d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:49.166816  9369 ts_tablet_manager.cc:1434] T d755a5211e5c4133bead5603a424005e P 8846d581359a4b7ea6d4c33424ea825d: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
W20260709 13:02:49.169570  9064 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45311, user_credentials={real_user=slave}} blocked reactor thread for 69733us
I20260709 13:02:49.153100  9250 raft_consensus.cc:2468] T cb7f6aeb8116423481ea2b2dca5a06d4 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c694531b0e1d47988b291f1214efc4cb in term 1.
W20260709 13:02:49.171697  9065 leader_election.cc:343] T bfb390576f2e4f508caa2d234ed5d425 P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:49.176167  9065 leader_election.cc:304] T bfb390576f2e4f508caa2d234ed5d425 P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65ed95869fbb4b69b5d6eb99c51adf85; no voters: 74ac2cf163ee475e8a280cb3aa738f57, c694531b0e1d47988b291f1214efc4cb
I20260709 13:02:49.185756  9321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7f6aeb8116423481ea2b2dca5a06d4" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57"
I20260709 13:02:49.195379  9369 tablet_bootstrap.cc:492] T 9d21e8696b0340bea31002b775af50ee P 8846d581359a4b7ea6d4c33424ea825d: Bootstrap starting.
I20260709 13:02:49.189690  9529 raft_consensus.cc:2749] T bfb390576f2e4f508caa2d234ed5d425 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:49.196358  9321 raft_consensus.cc:3060] T cb7f6aeb8116423481ea2b2dca5a06d4 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:49.193471  9139 leader_election.cc:304] T cb7f6aeb8116423481ea2b2dca5a06d4 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8846d581359a4b7ea6d4c33424ea825d, c694531b0e1d47988b291f1214efc4cb; no voters: 
I20260709 13:02:49.217985  9473 raft_consensus.cc:2804] T cb7f6aeb8116423481ea2b2dca5a06d4 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:49.218539  9473 raft_consensus.cc:697] T cb7f6aeb8116423481ea2b2dca5a06d4 P c694531b0e1d47988b291f1214efc4cb [term 1 LEADER]: Becoming Leader. State: Replica: c694531b0e1d47988b291f1214efc4cb, State: Running, Role: LEADER
I20260709 13:02:49.219486  9473 consensus_queue.cc:237] T cb7f6aeb8116423481ea2b2dca5a06d4 P c694531b0e1d47988b291f1214efc4cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:49.223721  9369 tablet_bootstrap.cc:654] T 9d21e8696b0340bea31002b775af50ee P 8846d581359a4b7ea6d4c33424ea825d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:49.223464  8998 catalog_manager.cc:5697] T a1ab6d75958044aeac9e1d43da9dc4b9 P c694531b0e1d47988b291f1214efc4cb reported cstate change: term changed from 0 to 1, leader changed from <none> to c694531b0e1d47988b291f1214efc4cb (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c694531b0e1d47988b291f1214efc4cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:49.231258  9215 leader_election.cc:343] T 93ba4182a04b450ca3fc7a15896f889e P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:49.235671  9215 leader_election.cc:304] T 902451f24024496b83b9a05dfe359a22 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57, 8846d581359a4b7ea6d4c33424ea825d; no voters: c694531b0e1d47988b291f1214efc4cb
I20260709 13:02:49.236495  9377 raft_consensus.cc:2804] T 902451f24024496b83b9a05dfe359a22 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:49.236868  9377 raft_consensus.cc:493] T 902451f24024496b83b9a05dfe359a22 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:49.237205  9377 raft_consensus.cc:3060] T 902451f24024496b83b9a05dfe359a22 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:49.247133  9372 tablet_bootstrap.cc:492] T 604bd81da85244b6bd6d8bd6ac674f2c P 65ed95869fbb4b69b5d6eb99c51adf85: No bootstrap required, opened a new log
I20260709 13:02:49.247815  9372 ts_tablet_manager.cc:1403] T 604bd81da85244b6bd6d8bd6ac674f2c P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent bootstrapping tablet: real 0.179s	user 0.013s	sys 0.012s
I20260709 13:02:49.250808  9371 tablet_bootstrap.cc:492] T 8f67cb568c0745e792c17959b07c5da1 P c694531b0e1d47988b291f1214efc4cb: No bootstrap required, opened a new log
I20260709 13:02:49.251730  9371 ts_tablet_manager.cc:1403] T 8f67cb568c0745e792c17959b07c5da1 P c694531b0e1d47988b291f1214efc4cb: Time spent bootstrapping tablet: real 0.161s	user 0.039s	sys 0.011s
I20260709 13:02:49.256461  9594 consensus_queue.cc:1048] T d3044a44ee984c489779dc339d162407 P 74ac2cf163ee475e8a280cb3aa738f57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:49.258992  9322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93ba4182a04b450ca3fc7a15896f889e" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57"
I20260709 13:02:49.270776  9371 raft_consensus.cc:359] T 8f67cb568c0745e792c17959b07c5da1 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:49.271997  9371 raft_consensus.cc:385] T 8f67cb568c0745e792c17959b07c5da1 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:49.272372  9371 raft_consensus.cc:740] T 8f67cb568c0745e792c17959b07c5da1 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c694531b0e1d47988b291f1214efc4cb, State: Initialized, Role: FOLLOWER
I20260709 13:02:49.274618  9371 consensus_queue.cc:260] T 8f67cb568c0745e792c17959b07c5da1 P c694531b0e1d47988b291f1214efc4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:49.278995  9372 raft_consensus.cc:359] T 604bd81da85244b6bd6d8bd6ac674f2c P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:49.279635  9372 raft_consensus.cc:385] T 604bd81da85244b6bd6d8bd6ac674f2c P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:49.279893  9372 raft_consensus.cc:740] T 604bd81da85244b6bd6d8bd6ac674f2c P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Initialized, Role: FOLLOWER
I20260709 13:02:49.281293  9372 consensus_queue.cc:260] T 604bd81da85244b6bd6d8bd6ac674f2c P 65ed95869fbb4b69b5d6eb99c51adf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:49.283905  9371 ts_tablet_manager.cc:1434] T 8f67cb568c0745e792c17959b07c5da1 P c694531b0e1d47988b291f1214efc4cb: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
W20260709 13:02:49.285173  9627 log.cc:927] Time spent T 5b6b34440fd14f3ea66bd5de7a2a8260 P c694531b0e1d47988b291f1214efc4cb: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:02:49.290143  9321 raft_consensus.cc:2468] T cb7f6aeb8116423481ea2b2dca5a06d4 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c694531b0e1d47988b291f1214efc4cb in term 1.
I20260709 13:02:49.290735  9625 consensus_queue.cc:1048] T f2229e498f7f472f97c088fddb802939 P c694531b0e1d47988b291f1214efc4cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:02:49.297506  9377 raft_consensus.cc:515] T 902451f24024496b83b9a05dfe359a22 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:49.300746  9370 tablet_bootstrap.cc:492] T 8f67cb568c0745e792c17959b07c5da1 P 74ac2cf163ee475e8a280cb3aa738f57: No bootstrap required, opened a new log
I20260709 13:02:49.301299  9370 ts_tablet_manager.cc:1403] T 8f67cb568c0745e792c17959b07c5da1 P 74ac2cf163ee475e8a280cb3aa738f57: Time spent bootstrapping tablet: real 0.166s	user 0.011s	sys 0.006s
I20260709 13:02:49.274123  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93ba4182a04b450ca3fc7a15896f889e" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85"
I20260709 13:02:49.307133  9099 raft_consensus.cc:3060] T 93ba4182a04b450ca3fc7a15896f889e P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:49.311673  9370 raft_consensus.cc:359] T 8f67cb568c0745e792c17959b07c5da1 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:49.312453  9370 raft_consensus.cc:385] T 8f67cb568c0745e792c17959b07c5da1 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:49.312727  9370 raft_consensus.cc:740] T 8f67cb568c0745e792c17959b07c5da1 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74ac2cf163ee475e8a280cb3aa738f57, State: Initialized, Role: FOLLOWER
I20260709 13:02:49.311707  9372 ts_tablet_manager.cc:1434] T 604bd81da85244b6bd6d8bd6ac674f2c P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent starting tablet: real 0.064s	user 0.005s	sys 0.002s
I20260709 13:02:49.316552  9372 tablet_bootstrap.cc:492] T df7e9031dde347b5b9da753cc817ce17 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap starting.
I20260709 13:02:49.317268  9370 consensus_queue.cc:260] T 8f67cb568c0745e792c17959b07c5da1 P 74ac2cf163ee475e8a280cb3aa738f57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
W20260709 13:02:49.283483  9215 consensus_peers.cc:597] T 5b6b34440fd14f3ea66bd5de7a2a8260 P 8846d581359a4b7ea6d4c33424ea825d -> Peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Couldn't send request to peer 65ed95869fbb4b69b5d6eb99c51adf85. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:49.323562  9215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33979, user_credentials={real_user=slave}} blocked reactor thread for 44424.4us
W20260709 13:02:49.326122  9215 leader_election.cc:343] T 93ba4182a04b450ca3fc7a15896f889e P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:49.333278  9371 tablet_bootstrap.cc:492] T 604bd81da85244b6bd6d8bd6ac674f2c P c694531b0e1d47988b291f1214efc4cb: Bootstrap starting.
I20260709 13:02:49.318708  8998 catalog_manager.cc:5697] T cb7f6aeb8116423481ea2b2dca5a06d4 P c694531b0e1d47988b291f1214efc4cb reported cstate change: term changed from 0 to 1, leader changed from <none> to c694531b0e1d47988b291f1214efc4cb (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c694531b0e1d47988b291f1214efc4cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:49.337849  9370 ts_tablet_manager.cc:1434] T 8f67cb568c0745e792c17959b07c5da1 P 74ac2cf163ee475e8a280cb3aa738f57: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.001s
I20260709 13:02:49.338953  9370 tablet_bootstrap.cc:492] T 93ba4182a04b450ca3fc7a15896f889e P 74ac2cf163ee475e8a280cb3aa738f57: Bootstrap starting.
I20260709 13:02:49.345060  9371 tablet_bootstrap.cc:654] T 604bd81da85244b6bd6d8bd6ac674f2c P c694531b0e1d47988b291f1214efc4cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:49.346783  9370 tablet_bootstrap.cc:654] T 93ba4182a04b450ca3fc7a15896f889e P 74ac2cf163ee475e8a280cb3aa738f57: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:49.366195  9408 raft_consensus.cc:493] T 8f67cb568c0745e792c17959b07c5da1 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.366569  9369 tablet_bootstrap.cc:492] T 9d21e8696b0340bea31002b775af50ee P 8846d581359a4b7ea6d4c33424ea825d: No bootstrap required, opened a new log
I20260709 13:02:49.367095  9369 ts_tablet_manager.cc:1403] T 9d21e8696b0340bea31002b775af50ee P 8846d581359a4b7ea6d4c33424ea825d: Time spent bootstrapping tablet: real 0.173s	user 0.010s	sys 0.008s
I20260709 13:02:49.373431  9372 tablet_bootstrap.cc:654] T df7e9031dde347b5b9da753cc817ce17 P 65ed95869fbb4b69b5d6eb99c51adf85: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:49.377146  9474 consensus_queue.cc:1048] T f2229e498f7f472f97c088fddb802939 P c694531b0e1d47988b291f1214efc4cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:49.378235  9099 raft_consensus.cc:2468] T 93ba4182a04b450ca3fc7a15896f889e P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8846d581359a4b7ea6d4c33424ea825d in term 1.
I20260709 13:02:49.387704  9377 leader_election.cc:290] T 902451f24024496b83b9a05dfe359a22 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 election: Requested vote from peers c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455), 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351)
I20260709 13:02:49.379942  9408 raft_consensus.cc:515] T 8f67cb568c0745e792c17959b07c5da1 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:49.396870  9173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902451f24024496b83b9a05dfe359a22" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694531b0e1d47988b291f1214efc4cb"
I20260709 13:02:49.397429  9408 leader_election.cc:290] T 8f67cb568c0745e792c17959b07c5da1 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351), 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979)
W20260709 13:02:49.398433  9214 leader_election.cc:343] T 902451f24024496b83b9a05dfe359a22 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:49.403144  9322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902451f24024496b83b9a05dfe359a22" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57"
I20260709 13:02:49.403823  9322 raft_consensus.cc:3060] T 902451f24024496b83b9a05dfe359a22 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:49.408867  9320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f67cb568c0745e792c17959b07c5da1" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57" is_pre_election: true
I20260709 13:02:49.410888  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f67cb568c0745e792c17959b07c5da1" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" is_pre_election: true
I20260709 13:02:49.411195  9215 leader_election.cc:304] T 93ba4182a04b450ca3fc7a15896f889e P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65ed95869fbb4b69b5d6eb99c51adf85, 8846d581359a4b7ea6d4c33424ea825d; no voters: 74ac2cf163ee475e8a280cb3aa738f57
I20260709 13:02:49.410951  9369 raft_consensus.cc:359] T 9d21e8696b0340bea31002b775af50ee P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:49.412375  9369 raft_consensus.cc:385] T 9d21e8696b0340bea31002b775af50ee P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:49.412628  9369 raft_consensus.cc:740] T 9d21e8696b0340bea31002b775af50ee P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8846d581359a4b7ea6d4c33424ea825d, State: Initialized, Role: FOLLOWER
I20260709 13:02:49.411262  9474 consensus_queue.cc:1048] T a1ab6d75958044aeac9e1d43da9dc4b9 P c694531b0e1d47988b291f1214efc4cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:02:49.413272  9369 consensus_queue.cc:260] T 9d21e8696b0340bea31002b775af50ee P 8846d581359a4b7ea6d4c33424ea825d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:49.415642  9369 ts_tablet_manager.cc:1434] T 9d21e8696b0340bea31002b775af50ee P 8846d581359a4b7ea6d4c33424ea825d: Time spent starting tablet: real 0.048s	user 0.006s	sys 0.000s
I20260709 13:02:49.416728  9369 tablet_bootstrap.cc:492] T 9dea45dda5454393bdfaed3f233a30a5 P 8846d581359a4b7ea6d4c33424ea825d: Bootstrap starting.
I20260709 13:02:49.411597  9320 raft_consensus.cc:2468] T 8f67cb568c0745e792c17959b07c5da1 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c694531b0e1d47988b291f1214efc4cb in term 0.
W20260709 13:02:49.422120  9141 consensus_peers.cc:597] T a1ab6d75958044aeac9e1d43da9dc4b9 P c694531b0e1d47988b291f1214efc4cb -> Peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Couldn't send request to peer 65ed95869fbb4b69b5d6eb99c51adf85. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:49.422850  9481 raft_consensus.cc:2804] T 93ba4182a04b450ca3fc7a15896f889e P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:49.423034  9371 tablet_bootstrap.cc:492] T 604bd81da85244b6bd6d8bd6ac674f2c P c694531b0e1d47988b291f1214efc4cb: No bootstrap required, opened a new log
I20260709 13:02:49.423435  9481 raft_consensus.cc:697] T 93ba4182a04b450ca3fc7a15896f889e P 8846d581359a4b7ea6d4c33424ea825d [term 1 LEADER]: Becoming Leader. State: Replica: 8846d581359a4b7ea6d4c33424ea825d, State: Running, Role: LEADER
I20260709 13:02:49.423894  9371 ts_tablet_manager.cc:1403] T 604bd81da85244b6bd6d8bd6ac674f2c P c694531b0e1d47988b291f1214efc4cb: Time spent bootstrapping tablet: real 0.091s	user 0.009s	sys 0.005s
I20260709 13:02:49.424377  9481 consensus_queue.cc:237] T 93ba4182a04b450ca3fc7a15896f889e P 8846d581359a4b7ea6d4c33424ea825d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
W20260709 13:02:49.423116  9141 leader_election.cc:343] T 8f67cb568c0745e792c17959b07c5da1 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:49.426649  9371 raft_consensus.cc:359] T 604bd81da85244b6bd6d8bd6ac674f2c P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:49.427443  9371 raft_consensus.cc:385] T 604bd81da85244b6bd6d8bd6ac674f2c P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:49.427721  9371 raft_consensus.cc:740] T 604bd81da85244b6bd6d8bd6ac674f2c P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c694531b0e1d47988b291f1214efc4cb, State: Initialized, Role: FOLLOWER
I20260709 13:02:49.428347  9371 consensus_queue.cc:260] T 604bd81da85244b6bd6d8bd6ac674f2c P c694531b0e1d47988b291f1214efc4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:49.422982  9372 tablet_bootstrap.cc:492] T df7e9031dde347b5b9da753cc817ce17 P 65ed95869fbb4b69b5d6eb99c51adf85: No bootstrap required, opened a new log
I20260709 13:02:49.430456  9371 ts_tablet_manager.cc:1434] T 604bd81da85244b6bd6d8bd6ac674f2c P c694531b0e1d47988b291f1214efc4cb: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:02:49.431605  9371 tablet_bootstrap.cc:492] T 902451f24024496b83b9a05dfe359a22 P c694531b0e1d47988b291f1214efc4cb: Bootstrap starting.
I20260709 13:02:49.433591  9372 ts_tablet_manager.cc:1403] T df7e9031dde347b5b9da753cc817ce17 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent bootstrapping tablet: real 0.117s	user 0.003s	sys 0.011s
I20260709 13:02:49.441195  9322 raft_consensus.cc:2468] T 902451f24024496b83b9a05dfe359a22 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8846d581359a4b7ea6d4c33424ea825d in term 1.
I20260709 13:02:49.442272  9141 leader_election.cc:304] T 8f67cb568c0745e792c17959b07c5da1 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57, c694531b0e1d47988b291f1214efc4cb; no voters: 65ed95869fbb4b69b5d6eb99c51adf85
I20260709 13:02:49.443779  9408 raft_consensus.cc:2804] T 8f67cb568c0745e792c17959b07c5da1 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:49.444203  9408 raft_consensus.cc:493] T 8f67cb568c0745e792c17959b07c5da1 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:49.444545  9408 raft_consensus.cc:3060] T 8f67cb568c0745e792c17959b07c5da1 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:49.447054  9371 tablet_bootstrap.cc:654] T 902451f24024496b83b9a05dfe359a22 P c694531b0e1d47988b291f1214efc4cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:49.450148  9369 tablet_bootstrap.cc:654] T 9dea45dda5454393bdfaed3f233a30a5 P 8846d581359a4b7ea6d4c33424ea825d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:49.451927  9408 raft_consensus.cc:515] T 8f67cb568c0745e792c17959b07c5da1 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:49.453526  9370 tablet_bootstrap.cc:492] T 93ba4182a04b450ca3fc7a15896f889e P 74ac2cf163ee475e8a280cb3aa738f57: No bootstrap required, opened a new log
I20260709 13:02:49.454100  9370 ts_tablet_manager.cc:1403] T 93ba4182a04b450ca3fc7a15896f889e P 74ac2cf163ee475e8a280cb3aa738f57: Time spent bootstrapping tablet: real 0.115s	user 0.017s	sys 0.017s
I20260709 13:02:49.458026  9322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f67cb568c0745e792c17959b07c5da1" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57"
I20260709 13:02:49.458828  9322 raft_consensus.cc:3060] T 8f67cb568c0745e792c17959b07c5da1 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:49.459607  9370 raft_consensus.cc:359] T 93ba4182a04b450ca3fc7a15896f889e P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:49.460415  9370 raft_consensus.cc:385] T 93ba4182a04b450ca3fc7a15896f889e P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:49.460721  9370 raft_consensus.cc:740] T 93ba4182a04b450ca3fc7a15896f889e P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74ac2cf163ee475e8a280cb3aa738f57, State: Initialized, Role: FOLLOWER
I20260709 13:02:49.461633  9370 consensus_queue.cc:260] T 93ba4182a04b450ca3fc7a15896f889e P 74ac2cf163ee475e8a280cb3aa738f57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:49.464593  9370 ts_tablet_manager.cc:1434] T 93ba4182a04b450ca3fc7a15896f889e P 74ac2cf163ee475e8a280cb3aa738f57: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.004s
I20260709 13:02:49.468339  9369 tablet_bootstrap.cc:492] T 9dea45dda5454393bdfaed3f233a30a5 P 8846d581359a4b7ea6d4c33424ea825d: No bootstrap required, opened a new log
I20260709 13:02:49.469560  9369 ts_tablet_manager.cc:1403] T 9dea45dda5454393bdfaed3f233a30a5 P 8846d581359a4b7ea6d4c33424ea825d: Time spent bootstrapping tablet: real 0.053s	user 0.009s	sys 0.005s
I20260709 13:02:49.471227  9377 consensus_queue.cc:1048] T 48e91509dfc74d53a930cdc636976db6 P 8846d581359a4b7ea6d4c33424ea825d [LEADER]: Connected to new peer: Peer: permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:49.472100  9370 tablet_bootstrap.cc:492] T a971867a8d494757a297936fad4bd464 P 74ac2cf163ee475e8a280cb3aa738f57: Bootstrap starting.
I20260709 13:02:49.473158  9371 tablet_bootstrap.cc:492] T 902451f24024496b83b9a05dfe359a22 P c694531b0e1d47988b291f1214efc4cb: No bootstrap required, opened a new log
I20260709 13:02:49.486313  9371 ts_tablet_manager.cc:1403] T 902451f24024496b83b9a05dfe359a22 P c694531b0e1d47988b291f1214efc4cb: Time spent bootstrapping tablet: real 0.055s	user 0.012s	sys 0.002s
I20260709 13:02:49.475363  9369 raft_consensus.cc:359] T 9dea45dda5454393bdfaed3f233a30a5 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:49.486852  9369 raft_consensus.cc:385] T 9dea45dda5454393bdfaed3f233a30a5 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:49.487149  9369 raft_consensus.cc:740] T 9dea45dda5454393bdfaed3f233a30a5 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8846d581359a4b7ea6d4c33424ea825d, State: Initialized, Role: FOLLOWER
I20260709 13:02:49.487773  9369 consensus_queue.cc:260] T 9dea45dda5454393bdfaed3f233a30a5 P 8846d581359a4b7ea6d4c33424ea825d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:49.489390  9371 raft_consensus.cc:359] T 902451f24024496b83b9a05dfe359a22 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:49.490221  9371 raft_consensus.cc:385] T 902451f24024496b83b9a05dfe359a22 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:49.473374  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f67cb568c0745e792c17959b07c5da1" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85"
I20260709 13:02:49.442346  9372 raft_consensus.cc:359] T df7e9031dde347b5b9da753cc817ce17 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:49.494879  9372 raft_consensus.cc:385] T df7e9031dde347b5b9da753cc817ce17 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:49.495211  9372 raft_consensus.cc:740] T df7e9031dde347b5b9da753cc817ce17 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Initialized, Role: FOLLOWER
I20260709 13:02:49.454092  9408 leader_election.cc:290] T 8f67cb568c0745e792c17959b07c5da1 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 election: Requested vote from peers 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351), 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979)
I20260709 13:02:49.476691  9215 leader_election.cc:304] T 902451f24024496b83b9a05dfe359a22 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57, 8846d581359a4b7ea6d4c33424ea825d; no voters: c694531b0e1d47988b291f1214efc4cb
I20260709 13:02:49.490515  9371 raft_consensus.cc:740] T 902451f24024496b83b9a05dfe359a22 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c694531b0e1d47988b291f1214efc4cb, State: Initialized, Role: FOLLOWER
I20260709 13:02:49.496817  9371 consensus_queue.cc:260] T 902451f24024496b83b9a05dfe359a22 P c694531b0e1d47988b291f1214efc4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:49.497727  9483 raft_consensus.cc:2804] T 902451f24024496b83b9a05dfe359a22 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:49.498301  9483 raft_consensus.cc:697] T 902451f24024496b83b9a05dfe359a22 P 8846d581359a4b7ea6d4c33424ea825d [term 1 LEADER]: Becoming Leader. State: Replica: 8846d581359a4b7ea6d4c33424ea825d, State: Running, Role: LEADER
I20260709 13:02:49.499693  9371 ts_tablet_manager.cc:1434] T 902451f24024496b83b9a05dfe359a22 P c694531b0e1d47988b291f1214efc4cb: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:02:49.499375  9483 consensus_queue.cc:237] T 902451f24024496b83b9a05dfe359a22 P 8846d581359a4b7ea6d4c33424ea825d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:49.500910  9371 tablet_bootstrap.cc:492] T 87959c0c174141f0958bbba169370488 P c694531b0e1d47988b291f1214efc4cb: Bootstrap starting.
I20260709 13:02:49.505995  9410 consensus_queue.cc:1048] T 48e91509dfc74d53a930cdc636976db6 P 8846d581359a4b7ea6d4c33424ea825d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:49.489899  9369 ts_tablet_manager.cc:1434] T 9dea45dda5454393bdfaed3f233a30a5 P 8846d581359a4b7ea6d4c33424ea825d: Time spent starting tablet: real 0.019s	user 0.000s	sys 0.003s
I20260709 13:02:49.508441  9409 raft_consensus.cc:493] T d755a5211e5c4133bead5603a424005e P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.513113  9409 raft_consensus.cc:515] T d755a5211e5c4133bead5603a424005e P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:49.500624  9594 consensus_queue.cc:1048] T 50f8080d64c04e738a6a36d748c8ee1e P 74ac2cf163ee475e8a280cb3aa738f57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:49.518827  9174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d755a5211e5c4133bead5603a424005e" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694531b0e1d47988b291f1214efc4cb" is_pre_election: true
I20260709 13:02:49.519423  9369 tablet_bootstrap.cc:492] T 87959c0c174141f0958bbba169370488 P 8846d581359a4b7ea6d4c33424ea825d: Bootstrap starting.
I20260709 13:02:49.486174  9322 raft_consensus.cc:2468] T 8f67cb568c0745e792c17959b07c5da1 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c694531b0e1d47988b291f1214efc4cb in term 1.
W20260709 13:02:49.523533  9214 leader_election.cc:343] T d755a5211e5c4133bead5603a424005e P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:49.522740  9372 consensus_queue.cc:260] T df7e9031dde347b5b9da753cc817ce17 P 65ed95869fbb4b69b5d6eb99c51adf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:49.524235  9370 tablet_bootstrap.cc:654] T a971867a8d494757a297936fad4bd464 P 74ac2cf163ee475e8a280cb3aa738f57: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:49.530164  9409 leader_election.cc:290] T d755a5211e5c4133bead5603a424005e P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455), 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351)
I20260709 13:02:49.530638  9372 ts_tablet_manager.cc:1434] T df7e9031dde347b5b9da753cc817ce17 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent starting tablet: real 0.097s	user 0.004s	sys 0.004s
I20260709 13:02:49.535581  9372 tablet_bootstrap.cc:492] T a1ab6d75958044aeac9e1d43da9dc4b9 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap starting.
I20260709 13:02:49.537644  9369 tablet_bootstrap.cc:654] T 87959c0c174141f0958bbba169370488 P 8846d581359a4b7ea6d4c33424ea825d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:49.544096  9371 tablet_bootstrap.cc:654] T 87959c0c174141f0958bbba169370488 P c694531b0e1d47988b291f1214efc4cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:49.544394  9408 raft_consensus.cc:493] T df7e9031dde347b5b9da753cc817ce17 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.545003  9408 raft_consensus.cc:515] T df7e9031dde347b5b9da753cc817ce17 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:49.560268  9625 raft_consensus.cc:493] T 902451f24024496b83b9a05dfe359a22 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.560896  9625 raft_consensus.cc:515] T 902451f24024496b83b9a05dfe359a22 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:49.540171  9481 raft_consensus.cc:493] T a971867a8d494757a297936fad4bd464 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.551255  9409 raft_consensus.cc:493] T 9d21e8696b0340bea31002b775af50ee P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.574265  9246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902451f24024496b83b9a05dfe359a22" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d" is_pre_election: true
I20260709 13:02:49.571039  9481 raft_consensus.cc:515] T a971867a8d494757a297936fad4bd464 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:49.570741  9409 raft_consensus.cc:515] T 9d21e8696b0340bea31002b775af50ee P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:49.583376  9625 leader_election.cc:290] T 902451f24024496b83b9a05dfe359a22 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311), 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351)
I20260709 13:02:49.587436  9408 leader_election.cc:290] T df7e9031dde347b5b9da753cc817ce17 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351), 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979)
I20260709 13:02:49.620909  9319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d755a5211e5c4133bead5603a424005e" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57" is_pre_election: true
W20260709 13:02:49.630759  9141 leader_election.cc:343] T 8f67cb568c0745e792c17959b07c5da1 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:49.651165  9371 tablet_bootstrap.cc:492] T 87959c0c174141f0958bbba169370488 P c694531b0e1d47988b291f1214efc4cb: No bootstrap required, opened a new log
I20260709 13:02:49.651722  9371 ts_tablet_manager.cc:1403] T 87959c0c174141f0958bbba169370488 P c694531b0e1d47988b291f1214efc4cb: Time spent bootstrapping tablet: real 0.151s	user 0.021s	sys 0.007s
I20260709 13:02:49.666419  9371 raft_consensus.cc:359] T 87959c0c174141f0958bbba169370488 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:49.667168  9371 raft_consensus.cc:385] T 87959c0c174141f0958bbba169370488 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:49.667451  9371 raft_consensus.cc:740] T 87959c0c174141f0958bbba169370488 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c694531b0e1d47988b291f1214efc4cb, State: Initialized, Role: FOLLOWER
I20260709 13:02:49.668221  9371 consensus_queue.cc:260] T 87959c0c174141f0958bbba169370488 P c694531b0e1d47988b291f1214efc4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
W20260709 13:02:49.671823  9215 leader_election.cc:343] T d755a5211e5c4133bead5603a424005e P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:49.672421  9215 leader_election.cc:304] T d755a5211e5c4133bead5603a424005e P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8846d581359a4b7ea6d4c33424ea825d; no voters: 74ac2cf163ee475e8a280cb3aa738f57, c694531b0e1d47988b291f1214efc4cb
I20260709 13:02:49.677124  9372 tablet_bootstrap.cc:654] T a1ab6d75958044aeac9e1d43da9dc4b9 P 65ed95869fbb4b69b5d6eb99c51adf85: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:49.679553  9410 raft_consensus.cc:2749] T d755a5211e5c4133bead5603a424005e P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:49.687453  9408 consensus_queue.cc:1048] T cb7f6aeb8116423481ea2b2dca5a06d4 P c694531b0e1d47988b291f1214efc4cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:49.688802  9409 leader_election.cc:290] T 9d21e8696b0340bea31002b775af50ee P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351), 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979)
I20260709 13:02:49.696488  9481 leader_election.cc:290] T a971867a8d494757a297936fad4bd464 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351), 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979)
I20260709 13:02:49.702330  9371 ts_tablet_manager.cc:1434] T 87959c0c174141f0958bbba169370488 P c694531b0e1d47988b291f1214efc4cb: Time spent starting tablet: real 0.050s	user 0.006s	sys 0.000s
I20260709 13:02:49.703583  9371 tablet_bootstrap.cc:492] T bfb390576f2e4f508caa2d234ed5d425 P c694531b0e1d47988b291f1214efc4cb: Bootstrap starting.
I20260709 13:02:49.708149  9370 tablet_bootstrap.cc:492] T a971867a8d494757a297936fad4bd464 P 74ac2cf163ee475e8a280cb3aa738f57: No bootstrap required, opened a new log
I20260709 13:02:49.708866  9370 ts_tablet_manager.cc:1403] T a971867a8d494757a297936fad4bd464 P 74ac2cf163ee475e8a280cb3aa738f57: Time spent bootstrapping tablet: real 0.237s	user 0.012s	sys 0.002s
I20260709 13:02:49.711151  9654 raft_consensus.cc:493] T 604bd81da85244b6bd6d8bd6ac674f2c P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.711927  9654 raft_consensus.cc:515] T 604bd81da85244b6bd6d8bd6ac674f2c P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:49.714645  9654 leader_election.cc:290] T 604bd81da85244b6bd6d8bd6ac674f2c P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979), 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311)
W20260709 13:02:49.699759  9141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33979, user_credentials={real_user=slave}} blocked reactor thread for 56949.1us
I20260709 13:02:49.718297  8998 catalog_manager.cc:5697] T 902451f24024496b83b9a05dfe359a22 P 8846d581359a4b7ea6d4c33424ea825d reported cstate change: term changed from 0 to 1, leader changed from <none> to 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195). New cstate: current_term: 1 leader_uuid: "8846d581359a4b7ea6d4c33424ea825d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:49.716279  9246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604bd81da85244b6bd6d8bd6ac674f2c" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d" is_pre_election: true
I20260709 13:02:49.745599  9246 raft_consensus.cc:2468] T 604bd81da85244b6bd6d8bd6ac674f2c P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c694531b0e1d47988b291f1214efc4cb in term 0.
I20260709 13:02:49.747824  9139 leader_election.cc:304] T 604bd81da85244b6bd6d8bd6ac674f2c P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8846d581359a4b7ea6d4c33424ea825d, c694531b0e1d47988b291f1214efc4cb; no voters: 
I20260709 13:02:49.722564  9322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d21e8696b0340bea31002b775af50ee" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57" is_pre_election: true
I20260709 13:02:49.722908  9319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7e9031dde347b5b9da753cc817ce17" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57" is_pre_election: true
I20260709 13:02:49.724997  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7e9031dde347b5b9da753cc817ce17" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" is_pre_election: true
I20260709 13:02:49.749173  9599 raft_consensus.cc:493] T 604bd81da85244b6bd6d8bd6ac674f2c P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.749632  9100 raft_consensus.cc:2468] T df7e9031dde347b5b9da753cc817ce17 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c694531b0e1d47988b291f1214efc4cb in term 0.
I20260709 13:02:49.749712  9599 raft_consensus.cc:515] T 604bd81da85244b6bd6d8bd6ac674f2c P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:49.725538  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604bd81da85244b6bd6d8bd6ac674f2c" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" is_pre_election: true
I20260709 13:02:49.750793  9097 raft_consensus.cc:2468] T 604bd81da85244b6bd6d8bd6ac674f2c P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c694531b0e1d47988b291f1214efc4cb in term 0.
I20260709 13:02:49.752007  9599 leader_election.cc:290] T 604bd81da85244b6bd6d8bd6ac674f2c P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455), 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311)
I20260709 13:02:49.731613  9320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902451f24024496b83b9a05dfe359a22" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57" is_pre_election: true
I20260709 13:02:49.733506  9370 raft_consensus.cc:359] T a971867a8d494757a297936fad4bd464 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:49.737984  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d21e8696b0340bea31002b775af50ee" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" is_pre_election: true
I20260709 13:02:49.754163  9246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604bd81da85244b6bd6d8bd6ac674f2c" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d" is_pre_election: true
I20260709 13:02:49.738456  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a971867a8d494757a297936fad4bd464" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" is_pre_election: true
I20260709 13:02:49.755048  9246 raft_consensus.cc:2468] T 604bd81da85244b6bd6d8bd6ac674f2c P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65ed95869fbb4b69b5d6eb99c51adf85 in term 0.
I20260709 13:02:49.755844  9370 raft_consensus.cc:385] T a971867a8d494757a297936fad4bd464 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:49.739805  9321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a971867a8d494757a297936fad4bd464" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57" is_pre_election: true
I20260709 13:02:49.756140  9370 raft_consensus.cc:740] T a971867a8d494757a297936fad4bd464 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74ac2cf163ee475e8a280cb3aa738f57, State: Initialized, Role: FOLLOWER
I20260709 13:02:49.740465  9412 consensus_queue.cc:1048] T 50f8080d64c04e738a6a36d748c8ee1e P 74ac2cf163ee475e8a280cb3aa738f57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:49.754304  9320 raft_consensus.cc:2393] T 902451f24024496b83b9a05dfe359a22 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c694531b0e1d47988b291f1214efc4cb in current term 1: Already voted for candidate 8846d581359a4b7ea6d4c33424ea825d in this term.
I20260709 13:02:49.757283  9064 leader_election.cc:304] T 604bd81da85244b6bd6d8bd6ac674f2c P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65ed95869fbb4b69b5d6eb99c51adf85, 8846d581359a4b7ea6d4c33424ea825d; no voters: 
I20260709 13:02:49.758847  9599 raft_consensus.cc:2804] T 604bd81da85244b6bd6d8bd6ac674f2c P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:49.754240  8998 catalog_manager.cc:5697] T 93ba4182a04b450ca3fc7a15896f889e P 8846d581359a4b7ea6d4c33424ea825d reported cstate change: term changed from 0 to 1, leader changed from <none> to 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195). New cstate: current_term: 1 leader_uuid: "8846d581359a4b7ea6d4c33424ea825d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:49.752671  9319 raft_consensus.cc:2468] T df7e9031dde347b5b9da753cc817ce17 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c694531b0e1d47988b291f1214efc4cb in term 0.
I20260709 13:02:49.753221  9654 raft_consensus.cc:2804] T 604bd81da85244b6bd6d8bd6ac674f2c P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:49.760726  9654 raft_consensus.cc:493] T 604bd81da85244b6bd6d8bd6ac674f2c P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:49.761178  9654 raft_consensus.cc:3060] T 604bd81da85244b6bd6d8bd6ac674f2c P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:49.759843  9370 consensus_queue.cc:260] T a971867a8d494757a297936fad4bd464 P 74ac2cf163ee475e8a280cb3aa738f57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:49.761956  9321 raft_consensus.cc:2468] T a971867a8d494757a297936fad4bd464 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8846d581359a4b7ea6d4c33424ea825d in term 0.
I20260709 13:02:49.765043  9372 tablet_bootstrap.cc:492] T a1ab6d75958044aeac9e1d43da9dc4b9 P 65ed95869fbb4b69b5d6eb99c51adf85: No bootstrap required, opened a new log
I20260709 13:02:49.730414  9141 leader_election.cc:304] T 8f67cb568c0745e792c17959b07c5da1 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57, c694531b0e1d47988b291f1214efc4cb; no voters: 65ed95869fbb4b69b5d6eb99c51adf85
I20260709 13:02:49.759265  9599 raft_consensus.cc:493] T 604bd81da85244b6bd6d8bd6ac674f2c P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:49.752528  9215 leader_election.cc:343] T 9d21e8696b0340bea31002b775af50ee P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:49.765614  9599 raft_consensus.cc:3060] T 604bd81da85244b6bd6d8bd6ac674f2c P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:49.766144  9370 ts_tablet_manager.cc:1434] T a971867a8d494757a297936fad4bd464 P 74ac2cf163ee475e8a280cb3aa738f57: Time spent starting tablet: real 0.057s	user 0.005s	sys 0.000s
W20260709 13:02:49.766470  9215 leader_election.cc:343] T 9d21e8696b0340bea31002b775af50ee P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:49.766970  9215 leader_election.cc:304] T 9d21e8696b0340bea31002b775af50ee P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8846d581359a4b7ea6d4c33424ea825d; no voters: 65ed95869fbb4b69b5d6eb99c51adf85, 74ac2cf163ee475e8a280cb3aa738f57
I20260709 13:02:49.767150  9370 tablet_bootstrap.cc:492] T d26bd321e5604f8aa61723f418be35a9 P 74ac2cf163ee475e8a280cb3aa738f57: Bootstrap starting.
W20260709 13:02:49.768134  9215 leader_election.cc:343] T a971867a8d494757a297936fad4bd464 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:49.771430  9409 raft_consensus.cc:2749] T 9d21e8696b0340bea31002b775af50ee P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:49.768810  9215 leader_election.cc:304] T a971867a8d494757a297936fad4bd464 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57, 8846d581359a4b7ea6d4c33424ea825d; no voters: 65ed95869fbb4b69b5d6eb99c51adf85
I20260709 13:02:49.773141  9599 raft_consensus.cc:515] T 604bd81da85244b6bd6d8bd6ac674f2c P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:49.773572  9370 tablet_bootstrap.cc:654] T d26bd321e5604f8aa61723f418be35a9 P 74ac2cf163ee475e8a280cb3aa738f57: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:49.773458  9409 raft_consensus.cc:2804] T a971867a8d494757a297936fad4bd464 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:49.773950  9372 ts_tablet_manager.cc:1403] T a1ab6d75958044aeac9e1d43da9dc4b9 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent bootstrapping tablet: real 0.239s	user 0.022s	sys 0.000s
I20260709 13:02:49.774017  9474 raft_consensus.cc:2804] T 8f67cb568c0745e792c17959b07c5da1 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:49.776705  9409 raft_consensus.cc:493] T a971867a8d494757a297936fad4bd464 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:49.777245  9409 raft_consensus.cc:3060] T a971867a8d494757a297936fad4bd464 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:49.776991  9474 raft_consensus.cc:697] T 8f67cb568c0745e792c17959b07c5da1 P c694531b0e1d47988b291f1214efc4cb [term 1 LEADER]: Becoming Leader. State: Replica: c694531b0e1d47988b291f1214efc4cb, State: Running, Role: LEADER
I20260709 13:02:49.778331  9474 consensus_queue.cc:237] T 8f67cb568c0745e792c17959b07c5da1 P c694531b0e1d47988b291f1214efc4cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:49.778990  9247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604bd81da85244b6bd6d8bd6ac674f2c" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d"
I20260709 13:02:49.779611  9247 raft_consensus.cc:3060] T 604bd81da85244b6bd6d8bd6ac674f2c P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:49.785228  9409 raft_consensus.cc:515] T a971867a8d494757a297936fad4bd464 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:49.786047  9369 tablet_bootstrap.cc:492] T 87959c0c174141f0958bbba169370488 P 8846d581359a4b7ea6d4c33424ea825d: No bootstrap required, opened a new log
I20260709 13:02:49.787045  9369 ts_tablet_manager.cc:1403] T 87959c0c174141f0958bbba169370488 P 8846d581359a4b7ea6d4c33424ea825d: Time spent bootstrapping tablet: real 0.274s	user 0.014s	sys 0.011s
I20260709 13:02:49.787333  9409 leader_election.cc:290] T a971867a8d494757a297936fad4bd464 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 election: Requested vote from peers 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351), 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979)
I20260709 13:02:49.789696  9369 raft_consensus.cc:359] T 87959c0c174141f0958bbba169370488 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:49.791342  9247 raft_consensus.cc:2468] T 604bd81da85244b6bd6d8bd6ac674f2c P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65ed95869fbb4b69b5d6eb99c51adf85 in term 1.
I20260709 13:02:49.790323  9654 raft_consensus.cc:515] T 604bd81da85244b6bd6d8bd6ac674f2c P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:49.793493  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a971867a8d494757a297936fad4bd464" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85"
I20260709 13:02:49.794329  9321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a971867a8d494757a297936fad4bd464" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57"
I20260709 13:02:49.794759  9625 raft_consensus.cc:493] T 87959c0c174141f0958bbba169370488 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.795210  9654 leader_election.cc:290] T 604bd81da85244b6bd6d8bd6ac674f2c P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 election: Requested vote from peers 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979), 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311)
I20260709 13:02:49.795395  9625 raft_consensus.cc:515] T 87959c0c174141f0958bbba169370488 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:49.796103  9250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604bd81da85244b6bd6d8bd6ac674f2c" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d"
I20260709 13:02:49.796895  9250 raft_consensus.cc:2393] T 604bd81da85244b6bd6d8bd6ac674f2c P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c694531b0e1d47988b291f1214efc4cb in current term 1: Already voted for candidate 65ed95869fbb4b69b5d6eb99c51adf85 in this term.
I20260709 13:02:49.797538  9625 leader_election.cc:290] T 87959c0c174141f0958bbba169370488 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311), 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351)
I20260709 13:02:49.799594  9250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87959c0c174141f0958bbba169370488" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d" is_pre_election: true
I20260709 13:02:49.800530  9321 raft_consensus.cc:3060] T a971867a8d494757a297936fad4bd464 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:49.801391  9215 leader_election.cc:343] T a971867a8d494757a297936fad4bd464 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:49.790412  9369 raft_consensus.cc:385] T 87959c0c174141f0958bbba169370488 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:49.802858  9369 raft_consensus.cc:740] T 87959c0c174141f0958bbba169370488 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8846d581359a4b7ea6d4c33424ea825d, State: Initialized, Role: FOLLOWER
I20260709 13:02:49.803500  9369 consensus_queue.cc:260] T 87959c0c174141f0958bbba169370488 P 8846d581359a4b7ea6d4c33424ea825d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:49.808209  9321 raft_consensus.cc:2468] T a971867a8d494757a297936fad4bd464 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8846d581359a4b7ea6d4c33424ea825d in term 1.
W20260709 13:02:49.774797  9141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:44351, user_credentials={real_user=slave}} blocked reactor thread for 44473.5us
I20260709 13:02:49.753328  9371 tablet_bootstrap.cc:654] T bfb390576f2e4f508caa2d234ed5d425 P c694531b0e1d47988b291f1214efc4cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:49.809948  9064 leader_election.cc:304] T 604bd81da85244b6bd6d8bd6ac674f2c P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65ed95869fbb4b69b5d6eb99c51adf85, 8846d581359a4b7ea6d4c33424ea825d; no voters: 
I20260709 13:02:49.811301  9599 leader_election.cc:290] T 604bd81da85244b6bd6d8bd6ac674f2c P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 1 election: Requested vote from peers c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455), 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311)
I20260709 13:02:49.808856  9250 raft_consensus.cc:2468] T 87959c0c174141f0958bbba169370488 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c694531b0e1d47988b291f1214efc4cb in term 0.
I20260709 13:02:49.812940  9659 raft_consensus.cc:2804] T 604bd81da85244b6bd6d8bd6ac674f2c P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:49.822964  9139 leader_election.cc:304] T 87959c0c174141f0958bbba169370488 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8846d581359a4b7ea6d4c33424ea825d, c694531b0e1d47988b291f1214efc4cb; no voters: 
I20260709 13:02:49.823925  9625 raft_consensus.cc:2804] T 87959c0c174141f0958bbba169370488 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:49.824331  9625 raft_consensus.cc:493] T 87959c0c174141f0958bbba169370488 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:49.824658  9625 raft_consensus.cc:3060] T 87959c0c174141f0958bbba169370488 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:49.814219  9369 ts_tablet_manager.cc:1434] T 87959c0c174141f0958bbba169370488 P 8846d581359a4b7ea6d4c33424ea825d: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.001s
I20260709 13:02:49.816020  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604bd81da85244b6bd6d8bd6ac674f2c" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85"
I20260709 13:02:49.816022  9319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87959c0c174141f0958bbba169370488" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57" is_pre_election: true
I20260709 13:02:49.825397  9412 raft_consensus.cc:493] T 93ba4182a04b450ca3fc7a15896f889e P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.825909  9412 raft_consensus.cc:515] T 93ba4182a04b450ca3fc7a15896f889e P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:49.826328  9369 tablet_bootstrap.cc:492] T 02048c7b44ac4e8a984dfa44a3b3b3e5 P 8846d581359a4b7ea6d4c33424ea825d: Bootstrap starting.
I20260709 13:02:49.809247  9372 raft_consensus.cc:359] T a1ab6d75958044aeac9e1d43da9dc4b9 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:49.827013  9372 raft_consensus.cc:385] T a1ab6d75958044aeac9e1d43da9dc4b9 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:49.827375  9372 raft_consensus.cc:740] T a1ab6d75958044aeac9e1d43da9dc4b9 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Initialized, Role: FOLLOWER
I20260709 13:02:49.828166  9372 consensus_queue.cc:260] T a1ab6d75958044aeac9e1d43da9dc4b9 P 65ed95869fbb4b69b5d6eb99c51adf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:49.819983  9215 leader_election.cc:304] T a971867a8d494757a297936fad4bd464 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57, 8846d581359a4b7ea6d4c33424ea825d; no voters: 65ed95869fbb4b69b5d6eb99c51adf85
I20260709 13:02:49.828995  9412 leader_election.cc:290] T 93ba4182a04b450ca3fc7a15896f889e P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311), 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979)
I20260709 13:02:49.829299  9409 raft_consensus.cc:2804] T a971867a8d494757a297936fad4bd464 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:49.829860  9409 raft_consensus.cc:697] T a971867a8d494757a297936fad4bd464 P 8846d581359a4b7ea6d4c33424ea825d [term 1 LEADER]: Becoming Leader. State: Replica: 8846d581359a4b7ea6d4c33424ea825d, State: Running, Role: LEADER
I20260709 13:02:49.830708  9409 consensus_queue.cc:237] T a971867a8d494757a297936fad4bd464 P 8846d581359a4b7ea6d4c33424ea825d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:49.831255  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93ba4182a04b450ca3fc7a15896f889e" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" is_pre_election: true
I20260709 13:02:49.832033  9101 raft_consensus.cc:2393] T 93ba4182a04b450ca3fc7a15896f889e P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74ac2cf163ee475e8a280cb3aa738f57 in current term 1: Already voted for candidate 8846d581359a4b7ea6d4c33424ea825d in this term.
I20260709 13:02:49.818639  9141 leader_election.cc:304] T df7e9031dde347b5b9da753cc817ce17 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65ed95869fbb4b69b5d6eb99c51adf85, c694531b0e1d47988b291f1214efc4cb; no voters: 
I20260709 13:02:49.834236  9369 tablet_bootstrap.cc:654] T 02048c7b44ac4e8a984dfa44a3b3b3e5 P 8846d581359a4b7ea6d4c33424ea825d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:49.837658  9474 raft_consensus.cc:2804] T df7e9031dde347b5b9da753cc817ce17 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:49.838106  9474 raft_consensus.cc:493] T df7e9031dde347b5b9da753cc817ce17 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:49.838452  9474 raft_consensus.cc:3060] T df7e9031dde347b5b9da753cc817ce17 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:49.839265  8997 catalog_manager.cc:5697] T 8f67cb568c0745e792c17959b07c5da1 P c694531b0e1d47988b291f1214efc4cb reported cstate change: term changed from 0 to 1, leader changed from <none> to c694531b0e1d47988b291f1214efc4cb (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c694531b0e1d47988b291f1214efc4cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:49.846292  9474 raft_consensus.cc:515] T df7e9031dde347b5b9da753cc817ce17 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:49.848505  9474 leader_election.cc:290] T df7e9031dde347b5b9da753cc817ce17 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 election: Requested vote from peers 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351), 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979)
I20260709 13:02:49.852881  9370 tablet_bootstrap.cc:492] T d26bd321e5604f8aa61723f418be35a9 P 74ac2cf163ee475e8a280cb3aa738f57: No bootstrap required, opened a new log
I20260709 13:02:49.854249  9370 ts_tablet_manager.cc:1403] T d26bd321e5604f8aa61723f418be35a9 P 74ac2cf163ee475e8a280cb3aa738f57: Time spent bootstrapping tablet: real 0.087s	user 0.016s	sys 0.020s
I20260709 13:02:49.855355  9246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93ba4182a04b450ca3fc7a15896f889e" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d" is_pre_election: true
I20260709 13:02:49.856572  9173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604bd81da85244b6bd6d8bd6ac674f2c" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694531b0e1d47988b291f1214efc4cb" is_pre_election: true
I20260709 13:02:49.857056  9287 leader_election.cc:304] T 93ba4182a04b450ca3fc7a15896f889e P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57; no voters: 65ed95869fbb4b69b5d6eb99c51adf85, 8846d581359a4b7ea6d4c33424ea825d
I20260709 13:02:49.857487  9173 raft_consensus.cc:2393] T 604bd81da85244b6bd6d8bd6ac674f2c P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65ed95869fbb4b69b5d6eb99c51adf85 in current term 1: Already voted for candidate c694531b0e1d47988b291f1214efc4cb in this term.
I20260709 13:02:49.857517  9370 raft_consensus.cc:359] T d26bd321e5604f8aa61723f418be35a9 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:49.858354  9412 raft_consensus.cc:3060] T 93ba4182a04b450ca3fc7a15896f889e P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:49.860010  9370 raft_consensus.cc:385] T d26bd321e5604f8aa61723f418be35a9 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:49.860486  9370 raft_consensus.cc:740] T d26bd321e5604f8aa61723f418be35a9 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74ac2cf163ee475e8a280cb3aa738f57, State: Initialized, Role: FOLLOWER
I20260709 13:02:49.860625  9173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604bd81da85244b6bd6d8bd6ac674f2c" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694531b0e1d47988b291f1214efc4cb"
I20260709 13:02:49.861491  9173 raft_consensus.cc:2393] T 604bd81da85244b6bd6d8bd6ac674f2c P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 65ed95869fbb4b69b5d6eb99c51adf85 in current term 1: Already voted for candidate c694531b0e1d47988b291f1214efc4cb in this term.
I20260709 13:02:49.861430  9370 consensus_queue.cc:260] T d26bd321e5604f8aa61723f418be35a9 P 74ac2cf163ee475e8a280cb3aa738f57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:49.865666  9141 leader_election.cc:304] T 902451f24024496b83b9a05dfe359a22 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c694531b0e1d47988b291f1214efc4cb; no voters: 74ac2cf163ee475e8a280cb3aa738f57, 8846d581359a4b7ea6d4c33424ea825d
I20260709 13:02:49.849095  9625 raft_consensus.cc:515] T 87959c0c174141f0958bbba169370488 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
W20260709 13:02:49.868340  9064 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45311, user_credentials={real_user=slave}} blocked reactor thread for 58486.3us
I20260709 13:02:49.869236  9474 raft_consensus.cc:3060] T 902451f24024496b83b9a05dfe359a22 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:49.868360  9412 raft_consensus.cc:2749] T 93ba4182a04b450ca3fc7a15896f889e P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:49.871943  9246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87959c0c174141f0958bbba169370488" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d"
I20260709 13:02:49.870405  9625 leader_election.cc:290] T 87959c0c174141f0958bbba169370488 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 election: Requested vote from peers 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311), 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351)
I20260709 13:02:49.872269  9370 ts_tablet_manager.cc:1434] T d26bd321e5604f8aa61723f418be35a9 P 74ac2cf163ee475e8a280cb3aa738f57: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.001s
I20260709 13:02:49.872632  9246 raft_consensus.cc:3060] T 87959c0c174141f0958bbba169370488 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:49.874899  9654 consensus_queue.cc:1048] T cb7f6aeb8116423481ea2b2dca5a06d4 P c694531b0e1d47988b291f1214efc4cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:49.875970  9372 ts_tablet_manager.cc:1434] T a1ab6d75958044aeac9e1d43da9dc4b9 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent starting tablet: real 0.093s	user 0.005s	sys 0.000s
I20260709 13:02:49.878145  9370 tablet_bootstrap.cc:492] T bfb390576f2e4f508caa2d234ed5d425 P 74ac2cf163ee475e8a280cb3aa738f57: Bootstrap starting.
I20260709 13:02:49.879678  9372 tablet_bootstrap.cc:492] T a971867a8d494757a297936fad4bd464 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap starting.
W20260709 13:02:49.876637  9141 leader_election.cc:343] T 87959c0c174141f0958bbba169370488 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:49.891544  9369 tablet_bootstrap.cc:492] T 02048c7b44ac4e8a984dfa44a3b3b3e5 P 8846d581359a4b7ea6d4c33424ea825d: No bootstrap required, opened a new log
I20260709 13:02:49.892892  9412 raft_consensus.cc:493] T d26bd321e5604f8aa61723f418be35a9 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.889650  9474 raft_consensus.cc:2749] T 902451f24024496b83b9a05dfe359a22 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:49.893654  9412 raft_consensus.cc:515] T d26bd321e5604f8aa61723f418be35a9 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:49.893187  9246 raft_consensus.cc:2468] T 87959c0c174141f0958bbba169370488 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c694531b0e1d47988b291f1214efc4cb in term 1.
I20260709 13:02:49.910781  9659 raft_consensus.cc:697] T 604bd81da85244b6bd6d8bd6ac674f2c P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 LEADER]: Becoming Leader. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Running, Role: LEADER
I20260709 13:02:49.913843  9659 consensus_queue.cc:237] T 604bd81da85244b6bd6d8bd6ac674f2c P 65ed95869fbb4b69b5d6eb99c51adf85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:49.919175  9481 consensus_queue.cc:1048] T 902451f24024496b83b9a05dfe359a22 P 8846d581359a4b7ea6d4c33424ea825d [LEADER]: Connected to new peer: Peer: permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:02:49.943156  9141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:44351, user_credentials={real_user=slave}} blocked reactor thread for 66200.1us
I20260709 13:02:49.945191  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7e9031dde347b5b9da753cc817ce17" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85"
I20260709 13:02:49.945473  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26bd321e5604f8aa61723f418be35a9" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" is_pre_election: true
I20260709 13:02:49.945936  9097 raft_consensus.cc:3060] T df7e9031dde347b5b9da753cc817ce17 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:49.947511  9289 leader_election.cc:343] T d26bd321e5604f8aa61723f418be35a9 P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:49.948401  9321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7e9031dde347b5b9da753cc817ce17" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57"
I20260709 13:02:49.949146  9321 raft_consensus.cc:3060] T df7e9031dde347b5b9da753cc817ce17 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:49.950223  9372 tablet_bootstrap.cc:654] T a971867a8d494757a297936fad4bd464 P 65ed95869fbb4b69b5d6eb99c51adf85: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:49.945078  9371 tablet_bootstrap.cc:492] T bfb390576f2e4f508caa2d234ed5d425 P c694531b0e1d47988b291f1214efc4cb: No bootstrap required, opened a new log
I20260709 13:02:49.951071  9371 ts_tablet_manager.cc:1403] T bfb390576f2e4f508caa2d234ed5d425 P c694531b0e1d47988b291f1214efc4cb: Time spent bootstrapping tablet: real 0.248s	user 0.014s	sys 0.002s
I20260709 13:02:49.953791  9371 raft_consensus.cc:359] T bfb390576f2e4f508caa2d234ed5d425 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:49.954485  9371 raft_consensus.cc:385] T bfb390576f2e4f508caa2d234ed5d425 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:49.954772  9371 raft_consensus.cc:740] T bfb390576f2e4f508caa2d234ed5d425 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c694531b0e1d47988b291f1214efc4cb, State: Initialized, Role: FOLLOWER
I20260709 13:02:49.954926  9369 ts_tablet_manager.cc:1403] T 02048c7b44ac4e8a984dfa44a3b3b3e5 P 8846d581359a4b7ea6d4c33424ea825d: Time spent bootstrapping tablet: real 0.129s	user 0.013s	sys 0.006s
I20260709 13:02:49.902472  9370 tablet_bootstrap.cc:654] T bfb390576f2e4f508caa2d234ed5d425 P 74ac2cf163ee475e8a280cb3aa738f57: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:49.955111  9097 raft_consensus.cc:2468] T df7e9031dde347b5b9da753cc817ce17 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c694531b0e1d47988b291f1214efc4cb in term 1.
I20260709 13:02:49.960970  9371 consensus_queue.cc:260] T bfb390576f2e4f508caa2d234ed5d425 P c694531b0e1d47988b291f1214efc4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:49.961465  9176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26bd321e5604f8aa61723f418be35a9" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694531b0e1d47988b291f1214efc4cb" is_pre_election: true
I20260709 13:02:49.962634  9371 ts_tablet_manager.cc:1434] T bfb390576f2e4f508caa2d234ed5d425 P c694531b0e1d47988b291f1214efc4cb: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.000s
I20260709 13:02:49.963603  9371 tablet_bootstrap.cc:492] T d755a5211e5c4133bead5603a424005e P c694531b0e1d47988b291f1214efc4cb: Bootstrap starting.
I20260709 13:02:49.967650  9474 raft_consensus.cc:493] T bfb390576f2e4f508caa2d234ed5d425 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.968248  9474 raft_consensus.cc:515] T bfb390576f2e4f508caa2d234ed5d425 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:49.970324  9474 leader_election.cc:290] T bfb390576f2e4f508caa2d234ed5d425 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351), 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979)
I20260709 13:02:49.973080  9322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87959c0c174141f0958bbba169370488" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57"
W20260709 13:02:49.978633  9288 leader_election.cc:343] T d26bd321e5604f8aa61723f418be35a9 P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:49.980669  9288 leader_election.cc:304] T d26bd321e5604f8aa61723f418be35a9 P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57; no voters: 65ed95869fbb4b69b5d6eb99c51adf85, c694531b0e1d47988b291f1214efc4cb
I20260709 13:02:49.981336  9409 raft_consensus.cc:493] T 9dea45dda5454393bdfaed3f233a30a5 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.984095  9409 raft_consensus.cc:515] T 9dea45dda5454393bdfaed3f233a30a5 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:49.986363  9320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb390576f2e4f508caa2d234ed5d425" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57" is_pre_election: true
I20260709 13:02:49.980021  9371 tablet_bootstrap.cc:654] T d755a5211e5c4133bead5603a424005e P c694531b0e1d47988b291f1214efc4cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:49.982647  9139 leader_election.cc:304] T 87959c0c174141f0958bbba169370488 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8846d581359a4b7ea6d4c33424ea825d, c694531b0e1d47988b291f1214efc4cb; no voters: 
I20260709 13:02:49.987881  9176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dea45dda5454393bdfaed3f233a30a5" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694531b0e1d47988b291f1214efc4cb" is_pre_election: true
I20260709 13:02:49.989248  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dea45dda5454393bdfaed3f233a30a5" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" is_pre_election: true
W20260709 13:02:49.989436  9214 leader_election.cc:343] T 9dea45dda5454393bdfaed3f233a30a5 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:49.989565  9474 raft_consensus.cc:2804] T 87959c0c174141f0958bbba169370488 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:49.990247  9474 raft_consensus.cc:697] T 87959c0c174141f0958bbba169370488 P c694531b0e1d47988b291f1214efc4cb [term 1 LEADER]: Becoming Leader. State: Replica: c694531b0e1d47988b291f1214efc4cb, State: Running, Role: LEADER
W20260709 13:02:49.990839  9215 leader_election.cc:343] T 9dea45dda5454393bdfaed3f233a30a5 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:49.988001  9409 leader_election.cc:290] T 9dea45dda5454393bdfaed3f233a30a5 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979), c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455)
I20260709 13:02:49.991350  9215 leader_election.cc:304] T 9dea45dda5454393bdfaed3f233a30a5 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8846d581359a4b7ea6d4c33424ea825d; no voters: 65ed95869fbb4b69b5d6eb99c51adf85, c694531b0e1d47988b291f1214efc4cb
I20260709 13:02:49.991178  9474 consensus_queue.cc:237] T 87959c0c174141f0958bbba169370488 P c694531b0e1d47988b291f1214efc4cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:49.993619  9409 raft_consensus.cc:2749] T 9dea45dda5454393bdfaed3f233a30a5 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:49.996155  9595 raft_consensus.cc:2749] T d26bd321e5604f8aa61723f418be35a9 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:49.996486  9665 raft_consensus.cc:493] T a1ab6d75958044aeac9e1d43da9dc4b9 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.997038  9665 raft_consensus.cc:515] T a1ab6d75958044aeac9e1d43da9dc4b9 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:49.948096  8998 catalog_manager.cc:5697] T a971867a8d494757a297936fad4bd464 P 8846d581359a4b7ea6d4c33424ea825d reported cstate change: term changed from 0 to 1, leader changed from <none> to 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195). New cstate: current_term: 1 leader_uuid: "8846d581359a4b7ea6d4c33424ea825d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:49.999284  9665 leader_election.cc:290] T a1ab6d75958044aeac9e1d43da9dc4b9 P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455), 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311)
I20260709 13:02:49.991940  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb390576f2e4f508caa2d234ed5d425" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" is_pre_election: true
I20260709 13:02:50.000757  9097 raft_consensus.cc:2468] T bfb390576f2e4f508caa2d234ed5d425 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c694531b0e1d47988b291f1214efc4cb in term 0.
I20260709 13:02:50.002759  9141 leader_election.cc:304] T df7e9031dde347b5b9da753cc817ce17 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65ed95869fbb4b69b5d6eb99c51adf85, c694531b0e1d47988b291f1214efc4cb; no voters: 
I20260709 13:02:50.013535  9409 consensus_queue.cc:1048] T 93ba4182a04b450ca3fc7a15896f889e P 8846d581359a4b7ea6d4c33424ea825d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:50.014478  9654 raft_consensus.cc:2804] T df7e9031dde347b5b9da753cc817ce17 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:50.015040  9654 raft_consensus.cc:697] T df7e9031dde347b5b9da753cc817ce17 P c694531b0e1d47988b291f1214efc4cb [term 1 LEADER]: Becoming Leader. State: Replica: c694531b0e1d47988b291f1214efc4cb, State: Running, Role: LEADER
I20260709 13:02:50.015429  9372 tablet_bootstrap.cc:492] T a971867a8d494757a297936fad4bd464 P 65ed95869fbb4b69b5d6eb99c51adf85: No bootstrap required, opened a new log
I20260709 13:02:50.015944  9372 ts_tablet_manager.cc:1403] T a971867a8d494757a297936fad4bd464 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent bootstrapping tablet: real 0.136s	user 0.024s	sys 0.000s
I20260709 13:02:50.015937  9654 consensus_queue.cc:237] T df7e9031dde347b5b9da753cc817ce17 P c694531b0e1d47988b291f1214efc4cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:50.019840  9371 tablet_bootstrap.cc:492] T d755a5211e5c4133bead5603a424005e P c694531b0e1d47988b291f1214efc4cb: No bootstrap required, opened a new log
I20260709 13:02:50.020428  9371 ts_tablet_manager.cc:1403] T d755a5211e5c4133bead5603a424005e P c694531b0e1d47988b291f1214efc4cb: Time spent bootstrapping tablet: real 0.057s	user 0.011s	sys 0.003s
I20260709 13:02:50.013418  8999 catalog_manager.cc:5697] T 604bd81da85244b6bd6d8bd6ac674f2c P 65ed95869fbb4b69b5d6eb99c51adf85 reported cstate change: term changed from 0 to 1, leader changed from <none> to 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:49.960084  9412 leader_election.cc:290] T d26bd321e5604f8aa61723f418be35a9 P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979), c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455)
I20260709 13:02:50.023375  9371 raft_consensus.cc:359] T d755a5211e5c4133bead5603a424005e P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:50.024108  9371 raft_consensus.cc:385] T d755a5211e5c4133bead5603a424005e P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:50.024433  9371 raft_consensus.cc:740] T d755a5211e5c4133bead5603a424005e P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c694531b0e1d47988b291f1214efc4cb, State: Initialized, Role: FOLLOWER
I20260709 13:02:50.014943  9141 leader_election.cc:304] T bfb390576f2e4f508caa2d234ed5d425 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65ed95869fbb4b69b5d6eb99c51adf85, c694531b0e1d47988b291f1214efc4cb; no voters: 
I20260709 13:02:50.025624  9409 consensus_queue.cc:1048] T 93ba4182a04b450ca3fc7a15896f889e P 8846d581359a4b7ea6d4c33424ea825d [LEADER]: Connected to new peer: Peer: permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:50.026206  9141 leader_election.cc:304] T 604bd81da85244b6bd6d8bd6ac674f2c P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c694531b0e1d47988b291f1214efc4cb; no voters: 65ed95869fbb4b69b5d6eb99c51adf85, 8846d581359a4b7ea6d4c33424ea825d
I20260709 13:02:50.026472  9372 raft_consensus.cc:359] T a971867a8d494757a297936fad4bd464 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:50.026851  9473 raft_consensus.cc:2804] T bfb390576f2e4f508caa2d234ed5d425 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:50.027227  9372 raft_consensus.cc:385] T a971867a8d494757a297936fad4bd464 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:50.027647  9408 raft_consensus.cc:2749] T 604bd81da85244b6bd6d8bd6ac674f2c P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 13:02:50.028196  9141 leader_election.cc:343] T 87959c0c174141f0958bbba169370488 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:50.027297  9473 raft_consensus.cc:493] T bfb390576f2e4f508caa2d234ed5d425 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:50.029938  9473 raft_consensus.cc:3060] T bfb390576f2e4f508caa2d234ed5d425 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:50.027590  9372 raft_consensus.cc:740] T a971867a8d494757a297936fad4bd464 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Initialized, Role: FOLLOWER
W20260709 13:02:50.030306  9141 leader_election.cc:343] T bfb390576f2e4f508caa2d234ed5d425 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:50.033764  9371 consensus_queue.cc:260] T d755a5211e5c4133bead5603a424005e P c694531b0e1d47988b291f1214efc4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:50.036092  9371 ts_tablet_manager.cc:1434] T d755a5211e5c4133bead5603a424005e P c694531b0e1d47988b291f1214efc4cb: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.002s
I20260709 13:02:50.037017  9371 tablet_bootstrap.cc:492] T d26bd321e5604f8aa61723f418be35a9 P c694531b0e1d47988b291f1214efc4cb: Bootstrap starting.
I20260709 13:02:50.039247  9473 raft_consensus.cc:515] T bfb390576f2e4f508caa2d234ed5d425 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:50.013978  9246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ab6d75958044aeac9e1d43da9dc4b9" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d" is_pre_election: true
I20260709 13:02:50.040114  9372 consensus_queue.cc:260] T a971867a8d494757a297936fad4bd464 P 65ed95869fbb4b69b5d6eb99c51adf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:50.047986  9372 ts_tablet_manager.cc:1434] T a971867a8d494757a297936fad4bd464 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 13:02:50.049515  9372 tablet_bootstrap.cc:492] T 9dea45dda5454393bdfaed3f233a30a5 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap starting.
I20260709 13:02:50.052860  9473 leader_election.cc:290] T bfb390576f2e4f508caa2d234ed5d425 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 election: Requested vote from peers 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351), 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979)
I20260709 13:02:50.055780  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb390576f2e4f508caa2d234ed5d425" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85"
I20260709 13:02:50.056525  9098 raft_consensus.cc:3060] T bfb390576f2e4f508caa2d234ed5d425 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:50.057305  9322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb390576f2e4f508caa2d234ed5d425" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57"
I20260709 13:02:50.045663  9173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ab6d75958044aeac9e1d43da9dc4b9" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694531b0e1d47988b291f1214efc4cb" is_pre_election: true
I20260709 13:02:50.044203  8998 catalog_manager.cc:5697] T 87959c0c174141f0958bbba169370488 P c694531b0e1d47988b291f1214efc4cb reported cstate change: term changed from 0 to 1, leader changed from <none> to c694531b0e1d47988b291f1214efc4cb (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c694531b0e1d47988b291f1214efc4cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:50.008069  9369 raft_consensus.cc:359] T 02048c7b44ac4e8a984dfa44a3b3b3e5 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:50.058801  9369 raft_consensus.cc:385] T 02048c7b44ac4e8a984dfa44a3b3b3e5 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:50.059239  9369 raft_consensus.cc:740] T 02048c7b44ac4e8a984dfa44a3b3b3e5 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8846d581359a4b7ea6d4c33424ea825d, State: Initialized, Role: FOLLOWER
I20260709 13:02:50.056524  9372 tablet_bootstrap.cc:654] T 9dea45dda5454393bdfaed3f233a30a5 P 65ed95869fbb4b69b5d6eb99c51adf85: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:50.063616  9369 consensus_queue.cc:260] T 02048c7b44ac4e8a984dfa44a3b3b3e5 P 8846d581359a4b7ea6d4c33424ea825d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:50.069533  9369 ts_tablet_manager.cc:1434] T 02048c7b44ac4e8a984dfa44a3b3b3e5 P 8846d581359a4b7ea6d4c33424ea825d: Time spent starting tablet: real 0.064s	user 0.006s	sys 0.000s
I20260709 13:02:50.069444  9065 leader_election.cc:304] T a1ab6d75958044aeac9e1d43da9dc4b9 P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65ed95869fbb4b69b5d6eb99c51adf85; no voters: 8846d581359a4b7ea6d4c33424ea825d, c694531b0e1d47988b291f1214efc4cb
I20260709 13:02:50.070812  9665 raft_consensus.cc:2749] T a1ab6d75958044aeac9e1d43da9dc4b9 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:02:50.073688  9141 leader_election.cc:343] T bfb390576f2e4f508caa2d234ed5d425 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:50.075536  9098 raft_consensus.cc:2468] T bfb390576f2e4f508caa2d234ed5d425 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c694531b0e1d47988b291f1214efc4cb in term 1.
I20260709 13:02:50.070587  9369 tablet_bootstrap.cc:492] T c7c964979a0443f68e90c8678d083c96 P 8846d581359a4b7ea6d4c33424ea825d: Bootstrap starting.
I20260709 13:02:50.085637  9141 leader_election.cc:304] T bfb390576f2e4f508caa2d234ed5d425 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65ed95869fbb4b69b5d6eb99c51adf85, c694531b0e1d47988b291f1214efc4cb; no voters: 74ac2cf163ee475e8a280cb3aa738f57
I20260709 13:02:50.087069  9473 raft_consensus.cc:2804] T bfb390576f2e4f508caa2d234ed5d425 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:50.087585  9473 raft_consensus.cc:697] T bfb390576f2e4f508caa2d234ed5d425 P c694531b0e1d47988b291f1214efc4cb [term 1 LEADER]: Becoming Leader. State: Replica: c694531b0e1d47988b291f1214efc4cb, State: Running, Role: LEADER
I20260709 13:02:50.088449  9473 consensus_queue.cc:237] T bfb390576f2e4f508caa2d234ed5d425 P c694531b0e1d47988b291f1214efc4cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:50.100370  9370 tablet_bootstrap.cc:492] T bfb390576f2e4f508caa2d234ed5d425 P 74ac2cf163ee475e8a280cb3aa738f57: No bootstrap required, opened a new log
I20260709 13:02:50.102592  9370 ts_tablet_manager.cc:1403] T bfb390576f2e4f508caa2d234ed5d425 P 74ac2cf163ee475e8a280cb3aa738f57: Time spent bootstrapping tablet: real 0.225s	user 0.021s	sys 0.021s
I20260709 13:02:50.109035  9410 consensus_queue.cc:1048] T 902451f24024496b83b9a05dfe359a22 P 8846d581359a4b7ea6d4c33424ea825d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:50.111018  9659 raft_consensus.cc:493] T a971867a8d494757a297936fad4bd464 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:50.111542  9659 raft_consensus.cc:515] T a971867a8d494757a297936fad4bd464 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:50.113267  9659 leader_election.cc:290] T a971867a8d494757a297936fad4bd464 P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311), 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351)
I20260709 13:02:50.111018  9371 tablet_bootstrap.cc:654] T d26bd321e5604f8aa61723f418be35a9 P c694531b0e1d47988b291f1214efc4cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:50.115027  9320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a971867a8d494757a297936fad4bd464" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57" is_pre_election: true
I20260709 13:02:50.115931  9320 raft_consensus.cc:2393] T a971867a8d494757a297936fad4bd464 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65ed95869fbb4b69b5d6eb99c51adf85 in current term 1: Already voted for candidate 8846d581359a4b7ea6d4c33424ea825d in this term.
I20260709 13:02:50.090997  9321 raft_consensus.cc:2468] T df7e9031dde347b5b9da753cc817ce17 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c694531b0e1d47988b291f1214efc4cb in term 1.
I20260709 13:02:50.118041  9246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a971867a8d494757a297936fad4bd464" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d" is_pre_election: true
I20260709 13:02:50.129020  9064 leader_election.cc:304] T a971867a8d494757a297936fad4bd464 P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65ed95869fbb4b69b5d6eb99c51adf85; no voters: 74ac2cf163ee475e8a280cb3aa738f57, 8846d581359a4b7ea6d4c33424ea825d
I20260709 13:02:50.135723  9370 raft_consensus.cc:359] T bfb390576f2e4f508caa2d234ed5d425 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:50.131367  9659 raft_consensus.cc:3060] T a971867a8d494757a297936fad4bd464 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:50.148239  9047 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:50.150779  9370 raft_consensus.cc:385] T bfb390576f2e4f508caa2d234ed5d425 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:50.158548  9654 raft_consensus.cc:493] T d755a5211e5c4133bead5603a424005e P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:50.158135  9481 raft_consensus.cc:493] T 02048c7b44ac4e8a984dfa44a3b3b3e5 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:50.179334  9370 raft_consensus.cc:740] T bfb390576f2e4f508caa2d234ed5d425 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74ac2cf163ee475e8a280cb3aa738f57, State: Initialized, Role: FOLLOWER
I20260709 13:02:50.180962  9370 consensus_queue.cc:260] T bfb390576f2e4f508caa2d234ed5d425 P 74ac2cf163ee475e8a280cb3aa738f57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:50.168849  8999 catalog_manager.cc:5697] T df7e9031dde347b5b9da753cc817ce17 P c694531b0e1d47988b291f1214efc4cb reported cstate change: term changed from 0 to 1, leader changed from <none> to c694531b0e1d47988b291f1214efc4cb (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c694531b0e1d47988b291f1214efc4cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:50.170145  9369 tablet_bootstrap.cc:654] T c7c964979a0443f68e90c8678d083c96 P 8846d581359a4b7ea6d4c33424ea825d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:50.178535  9659 raft_consensus.cc:2749] T a971867a8d494757a297936fad4bd464 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:50.182832  9481 raft_consensus.cc:515] T 02048c7b44ac4e8a984dfa44a3b3b3e5 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:50.184927  9481 leader_election.cc:290] T 02048c7b44ac4e8a984dfa44a3b3b3e5 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455), 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351)
I20260709 13:02:50.181818  9654 raft_consensus.cc:515] T d755a5211e5c4133bead5603a424005e P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:50.179071  9097 raft_consensus.cc:3060] T a1ab6d75958044aeac9e1d43da9dc4b9 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:50.193588  9319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02048c7b44ac4e8a984dfa44a3b3b3e5" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57" is_pre_election: true
W20260709 13:02:50.195169  9215 leader_election.cc:343] T 02048c7b44ac4e8a984dfa44a3b3b3e5 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:50.199497  9654 leader_election.cc:290] T d755a5211e5c4133bead5603a424005e P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311), 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351)
I20260709 13:02:50.200676  9372 tablet_bootstrap.cc:492] T 9dea45dda5454393bdfaed3f233a30a5 P 65ed95869fbb4b69b5d6eb99c51adf85: No bootstrap required, opened a new log
I20260709 13:02:50.201377  9372 ts_tablet_manager.cc:1403] T 9dea45dda5454393bdfaed3f233a30a5 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent bootstrapping tablet: real 0.152s	user 0.027s	sys 0.010s
I20260709 13:02:50.208802  9370 ts_tablet_manager.cc:1434] T bfb390576f2e4f508caa2d234ed5d425 P 74ac2cf163ee475e8a280cb3aa738f57: Time spent starting tablet: real 0.106s	user 0.008s	sys 0.000s
I20260709 13:02:50.210105  9370 tablet_bootstrap.cc:492] T d755a5211e5c4133bead5603a424005e P 74ac2cf163ee475e8a280cb3aa738f57: Bootstrap starting.
I20260709 13:02:50.212667  9250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d755a5211e5c4133bead5603a424005e" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d" is_pre_election: true
I20260709 13:02:50.213397  9250 raft_consensus.cc:2468] T d755a5211e5c4133bead5603a424005e P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c694531b0e1d47988b291f1214efc4cb in term 0.
I20260709 13:02:50.220008  9372 raft_consensus.cc:359] T 9dea45dda5454393bdfaed3f233a30a5 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:50.220626  9372 raft_consensus.cc:385] T 9dea45dda5454393bdfaed3f233a30a5 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:50.220839  9372 raft_consensus.cc:740] T 9dea45dda5454393bdfaed3f233a30a5 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Initialized, Role: FOLLOWER
I20260709 13:02:50.221305  9372 consensus_queue.cc:260] T 9dea45dda5454393bdfaed3f233a30a5 P 65ed95869fbb4b69b5d6eb99c51adf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:50.223022  9372 ts_tablet_manager.cc:1434] T 9dea45dda5454393bdfaed3f233a30a5 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.000s
I20260709 13:02:50.224067  9372 tablet_bootstrap.cc:492] T 5b6b34440fd14f3ea66bd5de7a2a8260 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap starting.
I20260709 13:02:50.227186  9174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02048c7b44ac4e8a984dfa44a3b3b3e5" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694531b0e1d47988b291f1214efc4cb" is_pre_election: true
I20260709 13:02:50.227404  9319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d755a5211e5c4133bead5603a424005e" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57" is_pre_election: true
I20260709 13:02:50.229395  9595 raft_consensus.cc:493] T bfb390576f2e4f508caa2d234ed5d425 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:50.229751  9214 leader_election.cc:343] T 02048c7b44ac4e8a984dfa44a3b3b3e5 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:50.229966  9595 raft_consensus.cc:515] T bfb390576f2e4f508caa2d234ed5d425 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:50.230266  9214 leader_election.cc:304] T 02048c7b44ac4e8a984dfa44a3b3b3e5 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8846d581359a4b7ea6d4c33424ea825d; no voters: 74ac2cf163ee475e8a280cb3aa738f57, c694531b0e1d47988b291f1214efc4cb
I20260709 13:02:50.231478  9409 raft_consensus.cc:2749] T 02048c7b44ac4e8a984dfa44a3b3b3e5 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:50.232152  9595 leader_election.cc:290] T bfb390576f2e4f508caa2d234ed5d425 P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979), c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455)
I20260709 13:02:50.233510  9174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb390576f2e4f508caa2d234ed5d425" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694531b0e1d47988b291f1214efc4cb" is_pre_election: true
W20260709 13:02:50.237679  9141 leader_election.cc:343] T d755a5211e5c4133bead5603a424005e P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:50.237998  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb390576f2e4f508caa2d234ed5d425" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" is_pre_election: true
I20260709 13:02:50.238884  9098 raft_consensus.cc:2393] T bfb390576f2e4f508caa2d234ed5d425 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74ac2cf163ee475e8a280cb3aa738f57 in current term 1: Already voted for candidate c694531b0e1d47988b291f1214efc4cb in this term.
I20260709 13:02:50.240450  9139 leader_election.cc:304] T d755a5211e5c4133bead5603a424005e P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8846d581359a4b7ea6d4c33424ea825d, c694531b0e1d47988b291f1214efc4cb; no voters: 74ac2cf163ee475e8a280cb3aa738f57
I20260709 13:02:50.241149  9481 consensus_queue.cc:1048] T a971867a8d494757a297936fad4bd464 P 8846d581359a4b7ea6d4c33424ea825d [LEADER]: Connected to new peer: Peer: permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:50.242105  9289 leader_election.cc:304] T bfb390576f2e4f508caa2d234ed5d425 P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57; no voters: 65ed95869fbb4b69b5d6eb99c51adf85, c694531b0e1d47988b291f1214efc4cb
I20260709 13:02:50.242367  9473 raft_consensus.cc:2804] T d755a5211e5c4133bead5603a424005e P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:50.242779  9473 raft_consensus.cc:493] T d755a5211e5c4133bead5603a424005e P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:50.243115  9473 raft_consensus.cc:3060] T d755a5211e5c4133bead5603a424005e P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:50.243340  9412 raft_consensus.cc:3060] T bfb390576f2e4f508caa2d234ed5d425 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:50.244621  9370 tablet_bootstrap.cc:654] T d755a5211e5c4133bead5603a424005e P 74ac2cf163ee475e8a280cb3aa738f57: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:50.249184  9372 tablet_bootstrap.cc:654] T 5b6b34440fd14f3ea66bd5de7a2a8260 P 65ed95869fbb4b69b5d6eb99c51adf85: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:50.254352  9371 tablet_bootstrap.cc:492] T d26bd321e5604f8aa61723f418be35a9 P c694531b0e1d47988b291f1214efc4cb: No bootstrap required, opened a new log
I20260709 13:02:50.254932  9371 ts_tablet_manager.cc:1403] T d26bd321e5604f8aa61723f418be35a9 P c694531b0e1d47988b291f1214efc4cb: Time spent bootstrapping tablet: real 0.218s	user 0.035s	sys 0.026s
I20260709 13:02:50.257685  9371 raft_consensus.cc:359] T d26bd321e5604f8aa61723f418be35a9 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:50.258402  9371 raft_consensus.cc:385] T d26bd321e5604f8aa61723f418be35a9 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:50.258684  9371 raft_consensus.cc:740] T d26bd321e5604f8aa61723f418be35a9 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c694531b0e1d47988b291f1214efc4cb, State: Initialized, Role: FOLLOWER
I20260709 13:02:50.261678  9371 consensus_queue.cc:260] T d26bd321e5604f8aa61723f418be35a9 P c694531b0e1d47988b291f1214efc4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:50.263651  9371 ts_tablet_manager.cc:1434] T d26bd321e5604f8aa61723f418be35a9 P c694531b0e1d47988b291f1214efc4cb: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:02:50.266850  9412 raft_consensus.cc:2749] T bfb390576f2e4f508caa2d234ed5d425 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:50.270733  9371 tablet_bootstrap.cc:492] T 9dea45dda5454393bdfaed3f233a30a5 P c694531b0e1d47988b291f1214efc4cb: Bootstrap starting.
I20260709 13:02:50.278012  8999 catalog_manager.cc:5697] T bfb390576f2e4f508caa2d234ed5d425 P c694531b0e1d47988b291f1214efc4cb reported cstate change: term changed from 0 to 1, leader changed from <none> to c694531b0e1d47988b291f1214efc4cb (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c694531b0e1d47988b291f1214efc4cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:50.293207  9371 tablet_bootstrap.cc:654] T 9dea45dda5454393bdfaed3f233a30a5 P c694531b0e1d47988b291f1214efc4cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:50.303292  9370 tablet_bootstrap.cc:492] T d755a5211e5c4133bead5603a424005e P 74ac2cf163ee475e8a280cb3aa738f57: No bootstrap required, opened a new log
I20260709 13:02:50.303835  9370 ts_tablet_manager.cc:1403] T d755a5211e5c4133bead5603a424005e P 74ac2cf163ee475e8a280cb3aa738f57: Time spent bootstrapping tablet: real 0.094s	user 0.015s	sys 0.012s
I20260709 13:02:50.303859  9369 tablet_bootstrap.cc:492] T c7c964979a0443f68e90c8678d083c96 P 8846d581359a4b7ea6d4c33424ea825d: No bootstrap required, opened a new log
I20260709 13:02:50.304919  9369 ts_tablet_manager.cc:1403] T c7c964979a0443f68e90c8678d083c96 P 8846d581359a4b7ea6d4c33424ea825d: Time spent bootstrapping tablet: real 0.235s	user 0.013s	sys 0.026s
I20260709 13:02:50.298231  9473 raft_consensus.cc:515] T d755a5211e5c4133bead5603a424005e P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:50.310825  9247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d755a5211e5c4133bead5603a424005e" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d"
I20260709 13:02:50.311025  9319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d755a5211e5c4133bead5603a424005e" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57"
I20260709 13:02:50.311470  9247 raft_consensus.cc:3060] T d755a5211e5c4133bead5603a424005e P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:50.311643  9473 leader_election.cc:290] T d755a5211e5c4133bead5603a424005e P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 election: Requested vote from peers 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311), 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351)
I20260709 13:02:50.335299  9473 raft_consensus.cc:493] T d26bd321e5604f8aa61723f418be35a9 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:50.335587  9654 consensus_queue.cc:1048] T 8f67cb568c0745e792c17959b07c5da1 P c694531b0e1d47988b291f1214efc4cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:50.336874  9247 raft_consensus.cc:2468] T d755a5211e5c4133bead5603a424005e P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c694531b0e1d47988b291f1214efc4cb in term 1.
W20260709 13:02:50.348996  9141 leader_election.cc:343] T d755a5211e5c4133bead5603a424005e P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:50.343227  9473 raft_consensus.cc:515] T d26bd321e5604f8aa61723f418be35a9 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:50.368124  9370 raft_consensus.cc:359] T d755a5211e5c4133bead5603a424005e P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:50.368953  9370 raft_consensus.cc:385] T d755a5211e5c4133bead5603a424005e P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:50.369235  9370 raft_consensus.cc:740] T d755a5211e5c4133bead5603a424005e P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74ac2cf163ee475e8a280cb3aa738f57, State: Initialized, Role: FOLLOWER
I20260709 13:02:50.370464  9372 tablet_bootstrap.cc:492] T 5b6b34440fd14f3ea66bd5de7a2a8260 P 65ed95869fbb4b69b5d6eb99c51adf85: No bootstrap required, opened a new log
I20260709 13:02:50.370971  9372 ts_tablet_manager.cc:1403] T 5b6b34440fd14f3ea66bd5de7a2a8260 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent bootstrapping tablet: real 0.147s	user 0.014s	sys 0.005s
I20260709 13:02:50.373020  9372 raft_consensus.cc:359] T 5b6b34440fd14f3ea66bd5de7a2a8260 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:50.373565  9372 raft_consensus.cc:385] T 5b6b34440fd14f3ea66bd5de7a2a8260 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:50.374071  9372 raft_consensus.cc:740] T 5b6b34440fd14f3ea66bd5de7a2a8260 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Initialized, Role: FOLLOWER
I20260709 13:02:50.374698  9372 consensus_queue.cc:260] T 5b6b34440fd14f3ea66bd5de7a2a8260 P 65ed95869fbb4b69b5d6eb99c51adf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:50.370018  9370 consensus_queue.cc:260] T d755a5211e5c4133bead5603a424005e P 74ac2cf163ee475e8a280cb3aa738f57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:50.377526  9139 leader_election.cc:304] T d755a5211e5c4133bead5603a424005e P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8846d581359a4b7ea6d4c33424ea825d, c694531b0e1d47988b291f1214efc4cb; no voters: 74ac2cf163ee475e8a280cb3aa738f57
I20260709 13:02:50.379212  9473 leader_election.cc:290] T d26bd321e5604f8aa61723f418be35a9 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351), 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979)
I20260709 13:02:50.379877  9372 ts_tablet_manager.cc:1434] T 5b6b34440fd14f3ea66bd5de7a2a8260 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:02:50.380935  9372 tablet_bootstrap.cc:492] T d26bd321e5604f8aa61723f418be35a9 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap starting.
I20260709 13:02:50.381959  9369 raft_consensus.cc:359] T c7c964979a0443f68e90c8678d083c96 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:50.379493  9654 raft_consensus.cc:2804] T d755a5211e5c4133bead5603a424005e P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:50.382777  9369 raft_consensus.cc:385] T c7c964979a0443f68e90c8678d083c96 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:50.383306  9654 raft_consensus.cc:697] T d755a5211e5c4133bead5603a424005e P c694531b0e1d47988b291f1214efc4cb [term 1 LEADER]: Becoming Leader. State: Replica: c694531b0e1d47988b291f1214efc4cb, State: Running, Role: LEADER
I20260709 13:02:50.383265  9369 raft_consensus.cc:740] T c7c964979a0443f68e90c8678d083c96 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8846d581359a4b7ea6d4c33424ea825d, State: Initialized, Role: FOLLOWER
I20260709 13:02:50.384233  9654 consensus_queue.cc:237] T d755a5211e5c4133bead5603a424005e P c694531b0e1d47988b291f1214efc4cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:50.385068  9369 consensus_queue.cc:260] T c7c964979a0443f68e90c8678d083c96 P 8846d581359a4b7ea6d4c33424ea825d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
W20260709 13:02:50.386420  9141 consensus_peers.cc:597] T 8f67cb568c0745e792c17959b07c5da1 P c694531b0e1d47988b291f1214efc4cb -> Peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Couldn't send request to peer 65ed95869fbb4b69b5d6eb99c51adf85. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:50.382131  9319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26bd321e5604f8aa61723f418be35a9" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57" is_pre_election: true
I20260709 13:02:50.388688  9319 raft_consensus.cc:2468] T d26bd321e5604f8aa61723f418be35a9 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c694531b0e1d47988b291f1214efc4cb in term 0.
I20260709 13:02:50.389575  9098 raft_consensus.cc:3060] T 5b6b34440fd14f3ea66bd5de7a2a8260 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:50.390991  9370 ts_tablet_manager.cc:1434] T d755a5211e5c4133bead5603a424005e P 74ac2cf163ee475e8a280cb3aa738f57: Time spent starting tablet: real 0.087s	user 0.010s	sys 0.012s
I20260709 13:02:50.391271  9141 leader_election.cc:304] T d26bd321e5604f8aa61723f418be35a9 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57, c694531b0e1d47988b291f1214efc4cb; no voters: 
I20260709 13:02:50.391932  9370 tablet_bootstrap.cc:492] T 7f278d22c55747ee8ee613bfa5c59391 P 74ac2cf163ee475e8a280cb3aa738f57: Bootstrap starting.
I20260709 13:02:50.382561  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26bd321e5604f8aa61723f418be35a9" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" is_pre_election: true
I20260709 13:02:50.394876  9408 raft_consensus.cc:2804] T d26bd321e5604f8aa61723f418be35a9 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:50.395299  9408 raft_consensus.cc:493] T d26bd321e5604f8aa61723f418be35a9 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:50.395618  9408 raft_consensus.cc:3060] T d26bd321e5604f8aa61723f418be35a9 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:50.398483  9141 leader_election.cc:343] T d26bd321e5604f8aa61723f418be35a9 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:50.399030  9410 raft_consensus.cc:493] T c7c964979a0443f68e90c8678d083c96 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:50.399544  9410 raft_consensus.cc:515] T c7c964979a0443f68e90c8678d083c96 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:50.403833  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c964979a0443f68e90c8678d083c96" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" is_pre_election: true
I20260709 13:02:50.404852  9371 tablet_bootstrap.cc:492] T 9dea45dda5454393bdfaed3f233a30a5 P c694531b0e1d47988b291f1214efc4cb: No bootstrap required, opened a new log
W20260709 13:02:50.405210  9215 leader_election.cc:343] T c7c964979a0443f68e90c8678d083c96 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:50.405385  9371 ts_tablet_manager.cc:1403] T 9dea45dda5454393bdfaed3f233a30a5 P c694531b0e1d47988b291f1214efc4cb: Time spent bootstrapping tablet: real 0.141s	user 0.024s	sys 0.014s
I20260709 13:02:50.409046  9408 raft_consensus.cc:515] T d26bd321e5604f8aa61723f418be35a9 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:50.409773  9371 raft_consensus.cc:359] T 9dea45dda5454393bdfaed3f233a30a5 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:50.410473  9371 raft_consensus.cc:385] T 9dea45dda5454393bdfaed3f233a30a5 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:50.410755  9371 raft_consensus.cc:740] T 9dea45dda5454393bdfaed3f233a30a5 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c694531b0e1d47988b291f1214efc4cb, State: Initialized, Role: FOLLOWER
I20260709 13:02:50.411362  9371 consensus_queue.cc:260] T 9dea45dda5454393bdfaed3f233a30a5 P c694531b0e1d47988b291f1214efc4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:50.412303  9408 leader_election.cc:290] T d26bd321e5604f8aa61723f418be35a9 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 election: Requested vote from peers 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351), 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979)
I20260709 13:02:50.414352  9371 ts_tablet_manager.cc:1434] T 9dea45dda5454393bdfaed3f233a30a5 P c694531b0e1d47988b291f1214efc4cb: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:02:50.415061  9410 leader_election.cc:290] T c7c964979a0443f68e90c8678d083c96 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979), c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455)
I20260709 13:02:50.418434  9371 tablet_bootstrap.cc:492] T 6007c141b1134cb18ab1200556127236 P c694531b0e1d47988b291f1214efc4cb: Bootstrap starting.
I20260709 13:02:50.419212  9369 ts_tablet_manager.cc:1434] T c7c964979a0443f68e90c8678d083c96 P 8846d581359a4b7ea6d4c33424ea825d: Time spent starting tablet: real 0.114s	user 0.006s	sys 0.001s
I20260709 13:02:50.420374  9369 tablet_bootstrap.cc:492] T 6007c141b1134cb18ab1200556127236 P 8846d581359a4b7ea6d4c33424ea825d: Bootstrap starting.
I20260709 13:02:50.426952  9320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26bd321e5604f8aa61723f418be35a9" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57"
I20260709 13:02:50.427640  9320 raft_consensus.cc:3060] T d26bd321e5604f8aa61723f418be35a9 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:50.432075  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26bd321e5604f8aa61723f418be35a9" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85"
I20260709 13:02:50.432075  9173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c964979a0443f68e90c8678d083c96" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694531b0e1d47988b291f1214efc4cb" is_pre_election: true
I20260709 13:02:50.434198  9369 tablet_bootstrap.cc:654] T 6007c141b1134cb18ab1200556127236 P 8846d581359a4b7ea6d4c33424ea825d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:50.434412  9665 consensus_queue.cc:1048] T 604bd81da85244b6bd6d8bd6ac674f2c P 65ed95869fbb4b69b5d6eb99c51adf85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:02:50.434763  9214 leader_election.cc:343] T c7c964979a0443f68e90c8678d083c96 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:50.435214  9214 leader_election.cc:304] T c7c964979a0443f68e90c8678d083c96 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8846d581359a4b7ea6d4c33424ea825d; no voters: 65ed95869fbb4b69b5d6eb99c51adf85, c694531b0e1d47988b291f1214efc4cb
I20260709 13:02:50.435971  9406 raft_consensus.cc:2749] T c7c964979a0443f68e90c8678d083c96 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:50.438090  9372 tablet_bootstrap.cc:654] T d26bd321e5604f8aa61723f418be35a9 P 65ed95869fbb4b69b5d6eb99c51adf85: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:50.441293  9320 raft_consensus.cc:2468] T d26bd321e5604f8aa61723f418be35a9 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c694531b0e1d47988b291f1214efc4cb in term 1.
W20260709 13:02:50.442006  9141 leader_election.cc:343] T d26bd321e5604f8aa61723f418be35a9 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:50.453032  9141 leader_election.cc:304] T d26bd321e5604f8aa61723f418be35a9 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57, c694531b0e1d47988b291f1214efc4cb; no voters: 65ed95869fbb4b69b5d6eb99c51adf85
I20260709 13:02:50.455674  9473 raft_consensus.cc:2804] T d26bd321e5604f8aa61723f418be35a9 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:50.461299  9473 raft_consensus.cc:697] T d26bd321e5604f8aa61723f418be35a9 P c694531b0e1d47988b291f1214efc4cb [term 1 LEADER]: Becoming Leader. State: Replica: c694531b0e1d47988b291f1214efc4cb, State: Running, Role: LEADER
I20260709 13:02:50.462158  9473 consensus_queue.cc:237] T d26bd321e5604f8aa61723f418be35a9 P c694531b0e1d47988b291f1214efc4cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:50.469015  8997 catalog_manager.cc:5697] T d755a5211e5c4133bead5603a424005e P c694531b0e1d47988b291f1214efc4cb reported cstate change: term changed from 0 to 1, leader changed from <none> to c694531b0e1d47988b291f1214efc4cb (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c694531b0e1d47988b291f1214efc4cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:50.481669  9141 consensus_peers.cc:597] T 87959c0c174141f0958bbba169370488 P c694531b0e1d47988b291f1214efc4cb -> Peer 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351): Couldn't send request to peer 74ac2cf163ee475e8a280cb3aa738f57. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:50.479908  9410 consensus_queue.cc:1048] T a971867a8d494757a297936fad4bd464 P 8846d581359a4b7ea6d4c33424ea825d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:02:50.485448  9370 tablet_bootstrap.cc:654] T 7f278d22c55747ee8ee613bfa5c59391 P 74ac2cf163ee475e8a280cb3aa738f57: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:50.491418  9372 tablet_bootstrap.cc:492] T d26bd321e5604f8aa61723f418be35a9 P 65ed95869fbb4b69b5d6eb99c51adf85: No bootstrap required, opened a new log
I20260709 13:02:50.491976  9372 ts_tablet_manager.cc:1403] T d26bd321e5604f8aa61723f418be35a9 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent bootstrapping tablet: real 0.111s	user 0.007s	sys 0.011s
I20260709 13:02:50.499039  9612 consensus_queue.cc:1048] T df7e9031dde347b5b9da753cc817ce17 P c694531b0e1d47988b291f1214efc4cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:50.520295  9659 raft_consensus.cc:493] T 9dea45dda5454393bdfaed3f233a30a5 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:50.524453  8999 catalog_manager.cc:5697] T d26bd321e5604f8aa61723f418be35a9 P c694531b0e1d47988b291f1214efc4cb reported cstate change: term changed from 0 to 1, leader changed from <none> to c694531b0e1d47988b291f1214efc4cb (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c694531b0e1d47988b291f1214efc4cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:50.527727  9659 raft_consensus.cc:515] T 9dea45dda5454393bdfaed3f233a30a5 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:50.529844  9659 leader_election.cc:290] T 9dea45dda5454393bdfaed3f233a30a5 P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455), 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311)
I20260709 13:02:50.528261  9612 consensus_queue.cc:1048] T df7e9031dde347b5b9da753cc817ce17 P c694531b0e1d47988b291f1214efc4cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:02:50.532022  9173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dea45dda5454393bdfaed3f233a30a5" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694531b0e1d47988b291f1214efc4cb" is_pre_election: true
I20260709 13:02:50.532711  9173 raft_consensus.cc:2468] T 9dea45dda5454393bdfaed3f233a30a5 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65ed95869fbb4b69b5d6eb99c51adf85 in term 0.
I20260709 13:02:50.536983  9250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dea45dda5454393bdfaed3f233a30a5" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d" is_pre_election: true
I20260709 13:02:50.537748  9250 raft_consensus.cc:2468] T 9dea45dda5454393bdfaed3f233a30a5 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65ed95869fbb4b69b5d6eb99c51adf85 in term 0.
I20260709 13:02:50.541999  9372 raft_consensus.cc:359] T d26bd321e5604f8aa61723f418be35a9 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:50.542784  9372 raft_consensus.cc:385] T d26bd321e5604f8aa61723f418be35a9 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:50.543066  9372 raft_consensus.cc:740] T d26bd321e5604f8aa61723f418be35a9 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Initialized, Role: FOLLOWER
I20260709 13:02:50.546352  9371 tablet_bootstrap.cc:654] T 6007c141b1134cb18ab1200556127236 P c694531b0e1d47988b291f1214efc4cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:50.551235  9372 consensus_queue.cc:260] T d26bd321e5604f8aa61723f418be35a9 P 65ed95869fbb4b69b5d6eb99c51adf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:50.542935  9064 leader_election.cc:304] T 9dea45dda5454393bdfaed3f233a30a5 P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65ed95869fbb4b69b5d6eb99c51adf85, 8846d581359a4b7ea6d4c33424ea825d; no voters: 
I20260709 13:02:50.556845  9372 ts_tablet_manager.cc:1434] T d26bd321e5604f8aa61723f418be35a9 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent starting tablet: real 0.065s	user 0.006s	sys 0.001s
I20260709 13:02:50.557844  9372 tablet_bootstrap.cc:492] T 9d21e8696b0340bea31002b775af50ee P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap starting.
I20260709 13:02:50.561061  9702 raft_consensus.cc:2804] T 9dea45dda5454393bdfaed3f233a30a5 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:50.561555  9702 raft_consensus.cc:493] T 9dea45dda5454393bdfaed3f233a30a5 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:50.561904  9702 raft_consensus.cc:3060] T 9dea45dda5454393bdfaed3f233a30a5 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:50.563067  9663 consensus_queue.cc:1048] T 604bd81da85244b6bd6d8bd6ac674f2c P 65ed95869fbb4b69b5d6eb99c51adf85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:50.573160  9369 tablet_bootstrap.cc:492] T 6007c141b1134cb18ab1200556127236 P 8846d581359a4b7ea6d4c33424ea825d: No bootstrap required, opened a new log
I20260709 13:02:50.573745  9369 ts_tablet_manager.cc:1403] T 6007c141b1134cb18ab1200556127236 P 8846d581359a4b7ea6d4c33424ea825d: Time spent bootstrapping tablet: real 0.154s	user 0.028s	sys 0.015s
I20260709 13:02:50.577212  9369 raft_consensus.cc:359] T 6007c141b1134cb18ab1200556127236 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:50.577977  9369 raft_consensus.cc:385] T 6007c141b1134cb18ab1200556127236 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:50.578276  9369 raft_consensus.cc:740] T 6007c141b1134cb18ab1200556127236 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8846d581359a4b7ea6d4c33424ea825d, State: Initialized, Role: FOLLOWER
I20260709 13:02:50.579383  9701 raft_consensus.cc:493] T d26bd321e5604f8aa61723f418be35a9 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:50.579926  9701 raft_consensus.cc:515] T d26bd321e5604f8aa61723f418be35a9 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:50.582870  9369 consensus_queue.cc:260] T 6007c141b1134cb18ab1200556127236 P 8846d581359a4b7ea6d4c33424ea825d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:50.584519  9319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26bd321e5604f8aa61723f418be35a9" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57" is_pre_election: true
I20260709 13:02:50.585373  9319 raft_consensus.cc:2393] T d26bd321e5604f8aa61723f418be35a9 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65ed95869fbb4b69b5d6eb99c51adf85 in current term 1: Already voted for candidate c694531b0e1d47988b291f1214efc4cb in this term.
I20260709 13:02:50.585642  9369 ts_tablet_manager.cc:1434] T 6007c141b1134cb18ab1200556127236 P 8846d581359a4b7ea6d4c33424ea825d: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:02:50.590080  9371 tablet_bootstrap.cc:492] T 6007c141b1134cb18ab1200556127236 P c694531b0e1d47988b291f1214efc4cb: No bootstrap required, opened a new log
I20260709 13:02:50.590711  9371 ts_tablet_manager.cc:1403] T 6007c141b1134cb18ab1200556127236 P c694531b0e1d47988b291f1214efc4cb: Time spent bootstrapping tablet: real 0.174s	user 0.014s	sys 0.001s
I20260709 13:02:50.593504  9701 leader_election.cc:290] T d26bd321e5604f8aa61723f418be35a9 P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351), c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455)
I20260709 13:02:50.590093  9702 raft_consensus.cc:515] T 9dea45dda5454393bdfaed3f233a30a5 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:50.595348  9369 tablet_bootstrap.cc:492] T 534ae119bf014235a99dfbbfcff690e1 P 8846d581359a4b7ea6d4c33424ea825d: Bootstrap starting.
I20260709 13:02:50.596807  9702 leader_election.cc:290] T 9dea45dda5454393bdfaed3f233a30a5 P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 1 election: Requested vote from peers c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455), 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311)
I20260709 13:02:50.573716  9372 tablet_bootstrap.cc:654] T 9d21e8696b0340bea31002b775af50ee P 65ed95869fbb4b69b5d6eb99c51adf85: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:50.599427  9625 consensus_queue.cc:1048] T bfb390576f2e4f508caa2d234ed5d425 P c694531b0e1d47988b291f1214efc4cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:50.601078  9247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dea45dda5454393bdfaed3f233a30a5" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d"
I20260709 13:02:50.601722  9247 raft_consensus.cc:3060] T 9dea45dda5454393bdfaed3f233a30a5 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:50.602891  9369 tablet_bootstrap.cc:654] T 534ae119bf014235a99dfbbfcff690e1 P 8846d581359a4b7ea6d4c33424ea825d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:50.606638  9173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26bd321e5604f8aa61723f418be35a9" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694531b0e1d47988b291f1214efc4cb" is_pre_election: true
I20260709 13:02:50.608402  9371 raft_consensus.cc:359] T 6007c141b1134cb18ab1200556127236 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:50.609220  9371 raft_consensus.cc:385] T 6007c141b1134cb18ab1200556127236 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:50.609483  9371 raft_consensus.cc:740] T 6007c141b1134cb18ab1200556127236 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c694531b0e1d47988b291f1214efc4cb, State: Initialized, Role: FOLLOWER
I20260709 13:02:50.610174  9371 consensus_queue.cc:260] T 6007c141b1134cb18ab1200556127236 P c694531b0e1d47988b291f1214efc4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:50.617806  9625 consensus_queue.cc:1048] T 87959c0c174141f0958bbba169370488 P c694531b0e1d47988b291f1214efc4cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:50.620736  9173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dea45dda5454393bdfaed3f233a30a5" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694531b0e1d47988b291f1214efc4cb"
I20260709 13:02:50.621392  9173 raft_consensus.cc:3060] T 9dea45dda5454393bdfaed3f233a30a5 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:50.623294  9371 ts_tablet_manager.cc:1434] T 6007c141b1134cb18ab1200556127236 P c694531b0e1d47988b291f1214efc4cb: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.001s
I20260709 13:02:50.626211  9371 tablet_bootstrap.cc:492] T 7f278d22c55747ee8ee613bfa5c59391 P c694531b0e1d47988b291f1214efc4cb: Bootstrap starting.
I20260709 13:02:50.627527  9065 leader_election.cc:304] T d26bd321e5604f8aa61723f418be35a9 P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65ed95869fbb4b69b5d6eb99c51adf85; no voters: 74ac2cf163ee475e8a280cb3aa738f57, c694531b0e1d47988b291f1214efc4cb
I20260709 13:02:50.643503  9702 raft_consensus.cc:3060] T d26bd321e5604f8aa61723f418be35a9 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:50.655831  9247 raft_consensus.cc:2468] T 9dea45dda5454393bdfaed3f233a30a5 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65ed95869fbb4b69b5d6eb99c51adf85 in term 1.
I20260709 13:02:50.657444  9064 leader_election.cc:304] T 9dea45dda5454393bdfaed3f233a30a5 P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65ed95869fbb4b69b5d6eb99c51adf85, 8846d581359a4b7ea6d4c33424ea825d; no voters: 
I20260709 13:02:50.658866  9659 raft_consensus.cc:2804] T 9dea45dda5454393bdfaed3f233a30a5 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:50.659798  9659 raft_consensus.cc:697] T 9dea45dda5454393bdfaed3f233a30a5 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 LEADER]: Becoming Leader. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Running, Role: LEADER
I20260709 13:02:50.660686  9659 consensus_queue.cc:237] T 9dea45dda5454393bdfaed3f233a30a5 P 65ed95869fbb4b69b5d6eb99c51adf85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:50.669868  9370 tablet_bootstrap.cc:492] T 7f278d22c55747ee8ee613bfa5c59391 P 74ac2cf163ee475e8a280cb3aa738f57: No bootstrap required, opened a new log
I20260709 13:02:50.670542  9370 ts_tablet_manager.cc:1403] T 7f278d22c55747ee8ee613bfa5c59391 P 74ac2cf163ee475e8a280cb3aa738f57: Time spent bootstrapping tablet: real 0.279s	user 0.015s	sys 0.011s
W20260709 13:02:50.675408  9699 log.cc:927] Time spent T df7e9031dde347b5b9da753cc817ce17 P 74ac2cf163ee475e8a280cb3aa738f57: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 13:02:50.684733  9371 tablet_bootstrap.cc:654] T 7f278d22c55747ee8ee613bfa5c59391 P c694531b0e1d47988b291f1214efc4cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:50.676672  9473 consensus_queue.cc:1048] T bfb390576f2e4f508caa2d234ed5d425 P c694531b0e1d47988b291f1214efc4cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 13:02:50.678849  9173 raft_consensus.cc:2468] T 9dea45dda5454393bdfaed3f233a30a5 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65ed95869fbb4b69b5d6eb99c51adf85 in term 1.
I20260709 13:02:50.688979  9474 raft_consensus.cc:493] T 6007c141b1134cb18ab1200556127236 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:50.706826  9412 raft_consensus.cc:493] T d755a5211e5c4133bead5603a424005e P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:50.718583  9412 raft_consensus.cc:515] T d755a5211e5c4133bead5603a424005e P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:50.730171  9412 leader_election.cc:290] T d755a5211e5c4133bead5603a424005e P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455), 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311)
I20260709 13:02:50.731635  9372 tablet_bootstrap.cc:492] T 9d21e8696b0340bea31002b775af50ee P 65ed95869fbb4b69b5d6eb99c51adf85: No bootstrap required, opened a new log
I20260709 13:02:50.732203  9372 ts_tablet_manager.cc:1403] T 9d21e8696b0340bea31002b775af50ee P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent bootstrapping tablet: real 0.175s	user 0.012s	sys 0.007s
I20260709 13:02:50.707149  9474 raft_consensus.cc:515] T 6007c141b1134cb18ab1200556127236 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:50.735525  9372 raft_consensus.cc:359] T 9d21e8696b0340bea31002b775af50ee P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:50.736274  9372 raft_consensus.cc:385] T 9d21e8696b0340bea31002b775af50ee P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:50.736668  9372 raft_consensus.cc:740] T 9d21e8696b0340bea31002b775af50ee P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Initialized, Role: FOLLOWER
I20260709 13:02:50.743997  9372 consensus_queue.cc:260] T 9d21e8696b0340bea31002b775af50ee P 65ed95869fbb4b69b5d6eb99c51adf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:50.746230  9372 ts_tablet_manager.cc:1434] T 9d21e8696b0340bea31002b775af50ee P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:02:50.747161  9372 tablet_bootstrap.cc:492] T 8f67cb568c0745e792c17959b07c5da1 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap starting.
I20260709 13:02:50.754944  8999 catalog_manager.cc:5697] T 9dea45dda5454393bdfaed3f233a30a5 P 65ed95869fbb4b69b5d6eb99c51adf85 reported cstate change: term changed from 0 to 1, leader changed from <none> to 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:50.755622  9370 raft_consensus.cc:359] T 7f278d22c55747ee8ee613bfa5c59391 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:50.757468  9370 raft_consensus.cc:385] T 7f278d22c55747ee8ee613bfa5c59391 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:50.757721  9370 raft_consensus.cc:740] T 7f278d22c55747ee8ee613bfa5c59391 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74ac2cf163ee475e8a280cb3aa738f57, State: Initialized, Role: FOLLOWER
I20260709 13:02:50.759739  9370 consensus_queue.cc:260] T 7f278d22c55747ee8ee613bfa5c59391 P 74ac2cf163ee475e8a280cb3aa738f57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:50.764595  9370 ts_tablet_manager.cc:1434] T 7f278d22c55747ee8ee613bfa5c59391 P 74ac2cf163ee475e8a280cb3aa738f57: Time spent starting tablet: real 0.094s	user 0.005s	sys 0.001s
I20260709 13:02:50.767335  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6007c141b1134cb18ab1200556127236" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" is_pre_election: true
I20260709 13:02:50.769342  9474 leader_election.cc:290] T 6007c141b1134cb18ab1200556127236 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979), 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311)
I20260709 13:02:50.776984  9663 raft_consensus.cc:493] T 9d21e8696b0340bea31002b775af50ee P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:50.777592  9663 raft_consensus.cc:515] T 9d21e8696b0340bea31002b775af50ee P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:50.780267  9663 leader_election.cc:290] T 9d21e8696b0340bea31002b775af50ee P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311), 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351)
I20260709 13:02:50.787488  9684 raft_consensus.cc:493] T 7f278d22c55747ee8ee613bfa5c59391 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:50.792346  9684 raft_consensus.cc:515] T 7f278d22c55747ee8ee613bfa5c59391 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
W20260709 13:02:50.787559  9141 leader_election.cc:343] T 6007c141b1134cb18ab1200556127236 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:50.789248  9321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d21e8696b0340bea31002b775af50ee" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57" is_pre_election: true
I20260709 13:02:50.797919  9249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6007c141b1134cb18ab1200556127236" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d" is_pre_election: true
I20260709 13:02:50.794602  9684 leader_election.cc:290] T 7f278d22c55747ee8ee613bfa5c59391 P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979), c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455)
I20260709 13:02:50.814478  9370 tablet_bootstrap.cc:492] T 87959c0c174141f0958bbba169370488 P 74ac2cf163ee475e8a280cb3aa738f57: Bootstrap starting.
I20260709 13:02:50.767293  9248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d755a5211e5c4133bead5603a424005e" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d" is_pre_election: true
I20260709 13:02:50.819067  9248 raft_consensus.cc:2393] T d755a5211e5c4133bead5603a424005e P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74ac2cf163ee475e8a280cb3aa738f57 in current term 1: Already voted for candidate c694531b0e1d47988b291f1214efc4cb in this term.
I20260709 13:02:50.821604  9702 raft_consensus.cc:2749] T d26bd321e5604f8aa61723f418be35a9 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:50.822367  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f278d22c55747ee8ee613bfa5c59391" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" is_pre_election: true
I20260709 13:02:50.823060  9173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d755a5211e5c4133bead5603a424005e" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694531b0e1d47988b291f1214efc4cb" is_pre_election: true
W20260709 13:02:50.823593  9066 leader_election.cc:343] T 9d21e8696b0340bea31002b775af50ee P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:50.798650  9249 raft_consensus.cc:2468] T 6007c141b1134cb18ab1200556127236 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c694531b0e1d47988b291f1214efc4cb in term 0.
I20260709 13:02:50.832858  9369 tablet_bootstrap.cc:492] T 534ae119bf014235a99dfbbfcff690e1 P 8846d581359a4b7ea6d4c33424ea825d: No bootstrap required, opened a new log
I20260709 13:02:50.833398  9369 ts_tablet_manager.cc:1403] T 534ae119bf014235a99dfbbfcff690e1 P 8846d581359a4b7ea6d4c33424ea825d: Time spent bootstrapping tablet: real 0.238s	user 0.019s	sys 0.045s
W20260709 13:02:50.844682  9289 leader_election.cc:343] T 7f278d22c55747ee8ee613bfa5c59391 P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:50.832875  9246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d21e8696b0340bea31002b775af50ee" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d" is_pre_election: true
I20260709 13:02:50.845912  9246 raft_consensus.cc:2468] T 9d21e8696b0340bea31002b775af50ee P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65ed95869fbb4b69b5d6eb99c51adf85 in term 0.
W20260709 13:02:50.844686  9703 log.cc:927] Time spent T 604bd81da85244b6bd6d8bd6ac674f2c P 8846d581359a4b7ea6d4c33424ea825d: Append to log took a long time: real 0.100s	user 0.000s	sys 0.003s
I20260709 13:02:50.850989  9064 leader_election.cc:304] T 9d21e8696b0340bea31002b775af50ee P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65ed95869fbb4b69b5d6eb99c51adf85, 8846d581359a4b7ea6d4c33424ea825d; no voters: 74ac2cf163ee475e8a280cb3aa738f57
I20260709 13:02:50.851713  9702 raft_consensus.cc:2804] T 9d21e8696b0340bea31002b775af50ee P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:50.852101  9702 raft_consensus.cc:493] T 9d21e8696b0340bea31002b775af50ee P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:50.852448  9702 raft_consensus.cc:3060] T 9d21e8696b0340bea31002b775af50ee P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:50.853423  9710 log.cc:927] Time spent T 9dea45dda5454393bdfaed3f233a30a5 P 65ed95869fbb4b69b5d6eb99c51adf85: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 13:02:50.860013  9369 raft_consensus.cc:359] T 534ae119bf014235a99dfbbfcff690e1 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:50.862164  9474 consensus_queue.cc:1048] T d26bd321e5604f8aa61723f418be35a9 P c694531b0e1d47988b291f1214efc4cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:02:50.864326  9707 log.cc:927] Time spent T bfb390576f2e4f508caa2d234ed5d425 P 74ac2cf163ee475e8a280cb3aa738f57: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
I20260709 13:02:50.867462  9173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f278d22c55747ee8ee613bfa5c59391" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694531b0e1d47988b291f1214efc4cb" is_pre_election: true
I20260709 13:02:50.860913  9369 raft_consensus.cc:385] T 534ae119bf014235a99dfbbfcff690e1 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:50.869632  9369 raft_consensus.cc:740] T 534ae119bf014235a99dfbbfcff690e1 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8846d581359a4b7ea6d4c33424ea825d, State: Initialized, Role: FOLLOWER
I20260709 13:02:50.860065  9371 tablet_bootstrap.cc:492] T 7f278d22c55747ee8ee613bfa5c59391 P c694531b0e1d47988b291f1214efc4cb: No bootstrap required, opened a new log
I20260709 13:02:50.870591  9369 consensus_queue.cc:260] T 534ae119bf014235a99dfbbfcff690e1 P 8846d581359a4b7ea6d4c33424ea825d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:50.871083  9371 ts_tablet_manager.cc:1403] T 7f278d22c55747ee8ee613bfa5c59391 P c694531b0e1d47988b291f1214efc4cb: Time spent bootstrapping tablet: real 0.245s	user 0.020s	sys 0.022s
I20260709 13:02:50.872148  9372 tablet_bootstrap.cc:654] T 8f67cb568c0745e792c17959b07c5da1 P 65ed95869fbb4b69b5d6eb99c51adf85: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:50.874377  9288 leader_election.cc:304] T d755a5211e5c4133bead5603a424005e P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57; no voters: 8846d581359a4b7ea6d4c33424ea825d, c694531b0e1d47988b291f1214efc4cb
I20260709 13:02:50.877152  9595 raft_consensus.cc:3060] T d755a5211e5c4133bead5603a424005e P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:50.878831  9288 leader_election.cc:343] T 7f278d22c55747ee8ee613bfa5c59391 P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:50.879382  9288 leader_election.cc:304] T 7f278d22c55747ee8ee613bfa5c59391 P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57; no voters: 65ed95869fbb4b69b5d6eb99c51adf85, c694531b0e1d47988b291f1214efc4cb
I20260709 13:02:50.880786  9684 raft_consensus.cc:2749] T 7f278d22c55747ee8ee613bfa5c59391 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:50.884341  9139 leader_election.cc:304] T 6007c141b1134cb18ab1200556127236 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8846d581359a4b7ea6d4c33424ea825d, c694531b0e1d47988b291f1214efc4cb; no voters: 65ed95869fbb4b69b5d6eb99c51adf85
I20260709 13:02:50.884720  9370 tablet_bootstrap.cc:654] T 87959c0c174141f0958bbba169370488 P 74ac2cf163ee475e8a280cb3aa738f57: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:50.886974  9623 raft_consensus.cc:2804] T 6007c141b1134cb18ab1200556127236 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:50.887449  9623 raft_consensus.cc:493] T 6007c141b1134cb18ab1200556127236 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:50.887823  9623 raft_consensus.cc:3060] T 6007c141b1134cb18ab1200556127236 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:50.889729  9702 raft_consensus.cc:515] T 9d21e8696b0340bea31002b775af50ee P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:50.896855  9702 leader_election.cc:290] T 9d21e8696b0340bea31002b775af50ee P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 1 election: Requested vote from peers 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311), 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351)
I20260709 13:02:50.901722  9623 raft_consensus.cc:515] T 6007c141b1134cb18ab1200556127236 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:50.904002  9250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d21e8696b0340bea31002b775af50ee" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d"
I20260709 13:02:50.904225  9623 leader_election.cc:290] T 6007c141b1134cb18ab1200556127236 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 election: Requested vote from peers 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979), 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311)
I20260709 13:02:50.904721  9250 raft_consensus.cc:3060] T 9d21e8696b0340bea31002b775af50ee P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:50.905880  9371 raft_consensus.cc:359] T 7f278d22c55747ee8ee613bfa5c59391 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:50.906509  9371 raft_consensus.cc:385] T 7f278d22c55747ee8ee613bfa5c59391 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:50.906822  9371 raft_consensus.cc:740] T 7f278d22c55747ee8ee613bfa5c59391 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c694531b0e1d47988b291f1214efc4cb, State: Initialized, Role: FOLLOWER
I20260709 13:02:50.907475  9371 consensus_queue.cc:260] T 7f278d22c55747ee8ee613bfa5c59391 P c694531b0e1d47988b291f1214efc4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:50.908692  9595 raft_consensus.cc:2749] T d755a5211e5c4133bead5603a424005e P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:50.909217  9371 ts_tablet_manager.cc:1434] T 7f278d22c55747ee8ee613bfa5c59391 P c694531b0e1d47988b291f1214efc4cb: Time spent starting tablet: real 0.038s	user 0.004s	sys 0.000s
I20260709 13:02:50.910187  9371 tablet_bootstrap.cc:492] T d75fae153be542ccbf70c92676ffd30d P c694531b0e1d47988b291f1214efc4cb: Bootstrap starting.
I20260709 13:02:50.911258  9369 ts_tablet_manager.cc:1434] T 534ae119bf014235a99dfbbfcff690e1 P 8846d581359a4b7ea6d4c33424ea825d: Time spent starting tablet: real 0.078s	user 0.009s	sys 0.000s
I20260709 13:02:50.915156  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6007c141b1134cb18ab1200556127236" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85"
I20260709 13:02:50.915511  9369 tablet_bootstrap.cc:492] T 76b3d3cd810b46dbac2b534c0be568d2 P 8846d581359a4b7ea6d4c33424ea825d: Bootstrap starting.
I20260709 13:02:50.916527  9246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6007c141b1134cb18ab1200556127236" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d"
I20260709 13:02:50.917285  9246 raft_consensus.cc:3060] T 6007c141b1134cb18ab1200556127236 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:50.921090  9371 tablet_bootstrap.cc:654] T d75fae153be542ccbf70c92676ffd30d P c694531b0e1d47988b291f1214efc4cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:50.921777  9369 tablet_bootstrap.cc:654] T 76b3d3cd810b46dbac2b534c0be568d2 P 8846d581359a4b7ea6d4c33424ea825d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:50.921185  9320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d21e8696b0340bea31002b775af50ee" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57"
W20260709 13:02:50.938760  9141 leader_election.cc:343] T 6007c141b1134cb18ab1200556127236 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:50.940083  9066 leader_election.cc:343] T 9d21e8696b0340bea31002b775af50ee P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:50.921676  9370 tablet_bootstrap.cc:492] T 87959c0c174141f0958bbba169370488 P 74ac2cf163ee475e8a280cb3aa738f57: No bootstrap required, opened a new log
I20260709 13:02:50.946818  9370 ts_tablet_manager.cc:1403] T 87959c0c174141f0958bbba169370488 P 74ac2cf163ee475e8a280cb3aa738f57: Time spent bootstrapping tablet: real 0.135s	user 0.016s	sys 0.006s
I20260709 13:02:50.949328  9612 consensus_queue.cc:1048] T d26bd321e5604f8aa61723f418be35a9 P c694531b0e1d47988b291f1214efc4cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:50.954351  9250 raft_consensus.cc:2468] T 9d21e8696b0340bea31002b775af50ee P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65ed95869fbb4b69b5d6eb99c51adf85 in term 1.
I20260709 13:02:50.955556  9064 leader_election.cc:304] T 9d21e8696b0340bea31002b775af50ee P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65ed95869fbb4b69b5d6eb99c51adf85, 8846d581359a4b7ea6d4c33424ea825d; no voters: 74ac2cf163ee475e8a280cb3aa738f57
I20260709 13:02:50.959187  9372 tablet_bootstrap.cc:492] T 8f67cb568c0745e792c17959b07c5da1 P 65ed95869fbb4b69b5d6eb99c51adf85: No bootstrap required, opened a new log
I20260709 13:02:50.959805  9372 ts_tablet_manager.cc:1403] T 8f67cb568c0745e792c17959b07c5da1 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent bootstrapping tablet: real 0.213s	user 0.016s	sys 0.006s
I20260709 13:02:50.960579  9702 raft_consensus.cc:2804] T 9d21e8696b0340bea31002b775af50ee P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:50.961143  9702 raft_consensus.cc:697] T 9d21e8696b0340bea31002b775af50ee P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 LEADER]: Becoming Leader. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Running, Role: LEADER
I20260709 13:02:50.961978  9702 consensus_queue.cc:237] T 9d21e8696b0340bea31002b775af50ee P 65ed95869fbb4b69b5d6eb99c51adf85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:50.964141  9246 raft_consensus.cc:2468] T 6007c141b1134cb18ab1200556127236 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c694531b0e1d47988b291f1214efc4cb in term 1.
I20260709 13:02:50.965363  9139 leader_election.cc:304] T 6007c141b1134cb18ab1200556127236 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8846d581359a4b7ea6d4c33424ea825d, c694531b0e1d47988b291f1214efc4cb; no voters: 65ed95869fbb4b69b5d6eb99c51adf85
I20260709 13:02:50.966233  9474 raft_consensus.cc:2804] T 6007c141b1134cb18ab1200556127236 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:50.966990  9474 raft_consensus.cc:697] T 6007c141b1134cb18ab1200556127236 P c694531b0e1d47988b291f1214efc4cb [term 1 LEADER]: Becoming Leader. State: Replica: c694531b0e1d47988b291f1214efc4cb, State: Running, Role: LEADER
I20260709 13:02:50.967893  9474 consensus_queue.cc:237] T 6007c141b1134cb18ab1200556127236 P c694531b0e1d47988b291f1214efc4cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:50.971803  9372 raft_consensus.cc:359] T 8f67cb568c0745e792c17959b07c5da1 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:50.972638  9372 raft_consensus.cc:385] T 8f67cb568c0745e792c17959b07c5da1 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:50.972921  9372 raft_consensus.cc:740] T 8f67cb568c0745e792c17959b07c5da1 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Initialized, Role: FOLLOWER
I20260709 13:02:50.973575  9372 consensus_queue.cc:260] T 8f67cb568c0745e792c17959b07c5da1 P 65ed95869fbb4b69b5d6eb99c51adf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:50.980412  9370 raft_consensus.cc:359] T 87959c0c174141f0958bbba169370488 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:50.983251  9370 raft_consensus.cc:385] T 87959c0c174141f0958bbba169370488 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:50.983543  9370 raft_consensus.cc:740] T 87959c0c174141f0958bbba169370488 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74ac2cf163ee475e8a280cb3aa738f57, State: Initialized, Role: FOLLOWER
I20260709 13:02:50.983516  9371 tablet_bootstrap.cc:492] T d75fae153be542ccbf70c92676ffd30d P c694531b0e1d47988b291f1214efc4cb: No bootstrap required, opened a new log
I20260709 13:02:50.984189  9623 consensus_queue.cc:1048] T d755a5211e5c4133bead5603a424005e P c694531b0e1d47988b291f1214efc4cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:50.984851  9371 ts_tablet_manager.cc:1403] T d75fae153be542ccbf70c92676ffd30d P c694531b0e1d47988b291f1214efc4cb: Time spent bootstrapping tablet: real 0.075s	user 0.015s	sys 0.008s
I20260709 13:02:50.984637  9370 consensus_queue.cc:260] T 87959c0c174141f0958bbba169370488 P 74ac2cf163ee475e8a280cb3aa738f57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:50.986841  9372 ts_tablet_manager.cc:1434] T 8f67cb568c0745e792c17959b07c5da1 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 13:02:50.987879  9372 tablet_bootstrap.cc:492] T 7f278d22c55747ee8ee613bfa5c59391 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap starting.
I20260709 13:02:50.987794  9370 ts_tablet_manager.cc:1434] T 87959c0c174141f0958bbba169370488 P 74ac2cf163ee475e8a280cb3aa738f57: Time spent starting tablet: real 0.040s	user 0.004s	sys 0.004s
I20260709 13:02:50.990947  9623 consensus_queue.cc:1048] T d755a5211e5c4133bead5603a424005e P c694531b0e1d47988b291f1214efc4cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:50.992789  9371 raft_consensus.cc:359] T d75fae153be542ccbf70c92676ffd30d P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:50.993552  9371 raft_consensus.cc:385] T d75fae153be542ccbf70c92676ffd30d P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:50.993854  9371 raft_consensus.cc:740] T d75fae153be542ccbf70c92676ffd30d P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c694531b0e1d47988b291f1214efc4cb, State: Initialized, Role: FOLLOWER
I20260709 13:02:50.995106  9370 tablet_bootstrap.cc:492] T 9d21e8696b0340bea31002b775af50ee P 74ac2cf163ee475e8a280cb3aa738f57: Bootstrap starting.
I20260709 13:02:50.998106  9369 tablet_bootstrap.cc:492] T 76b3d3cd810b46dbac2b534c0be568d2 P 8846d581359a4b7ea6d4c33424ea825d: No bootstrap required, opened a new log
I20260709 13:02:50.998697  9369 ts_tablet_manager.cc:1403] T 76b3d3cd810b46dbac2b534c0be568d2 P 8846d581359a4b7ea6d4c33424ea825d: Time spent bootstrapping tablet: real 0.083s	user 0.017s	sys 0.003s
I20260709 13:02:50.998374  9371 consensus_queue.cc:260] T d75fae153be542ccbf70c92676ffd30d P c694531b0e1d47988b291f1214efc4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:51.002592  9370 tablet_bootstrap.cc:654] T 9d21e8696b0340bea31002b775af50ee P 74ac2cf163ee475e8a280cb3aa738f57: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:51.003682  9369 raft_consensus.cc:359] T 76b3d3cd810b46dbac2b534c0be568d2 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:51.004401  9369 raft_consensus.cc:385] T 76b3d3cd810b46dbac2b534c0be568d2 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:51.004690  9369 raft_consensus.cc:740] T 76b3d3cd810b46dbac2b534c0be568d2 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8846d581359a4b7ea6d4c33424ea825d, State: Initialized, Role: FOLLOWER
I20260709 13:02:51.005334  9369 consensus_queue.cc:260] T 76b3d3cd810b46dbac2b534c0be568d2 P 8846d581359a4b7ea6d4c33424ea825d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:51.005681  9371 ts_tablet_manager.cc:1434] T d75fae153be542ccbf70c92676ffd30d P c694531b0e1d47988b291f1214efc4cb: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:02:51.010582  9371 tablet_bootstrap.cc:492] T c7c964979a0443f68e90c8678d083c96 P c694531b0e1d47988b291f1214efc4cb: Bootstrap starting.
I20260709 13:02:51.012573  9369 ts_tablet_manager.cc:1434] T 76b3d3cd810b46dbac2b534c0be568d2 P 8846d581359a4b7ea6d4c33424ea825d: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:02:51.013583  9369 tablet_bootstrap.cc:492] T 4d2b02247c21448ea824065ad29304e7 P 8846d581359a4b7ea6d4c33424ea825d: Bootstrap starting.
I20260709 13:02:51.015638  8997 catalog_manager.cc:5697] T 9d21e8696b0340bea31002b775af50ee P 65ed95869fbb4b69b5d6eb99c51adf85 reported cstate change: term changed from 0 to 1, leader changed from <none> to 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:51.016979  9371 tablet_bootstrap.cc:654] T c7c964979a0443f68e90c8678d083c96 P c694531b0e1d47988b291f1214efc4cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:51.025839  9370 tablet_bootstrap.cc:492] T 9d21e8696b0340bea31002b775af50ee P 74ac2cf163ee475e8a280cb3aa738f57: No bootstrap required, opened a new log
I20260709 13:02:51.026327  9370 ts_tablet_manager.cc:1403] T 9d21e8696b0340bea31002b775af50ee P 74ac2cf163ee475e8a280cb3aa738f57: Time spent bootstrapping tablet: real 0.031s	user 0.004s	sys 0.006s
I20260709 13:02:51.028991  9370 raft_consensus.cc:359] T 9d21e8696b0340bea31002b775af50ee P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:51.029947  9370 raft_consensus.cc:385] T 9d21e8696b0340bea31002b775af50ee P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:51.030247  9370 raft_consensus.cc:740] T 9d21e8696b0340bea31002b775af50ee P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74ac2cf163ee475e8a280cb3aa738f57, State: Initialized, Role: FOLLOWER
I20260709 13:02:51.030903  9370 consensus_queue.cc:260] T 9d21e8696b0340bea31002b775af50ee P 74ac2cf163ee475e8a280cb3aa738f57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:51.032917  9370 ts_tablet_manager.cc:1434] T 9d21e8696b0340bea31002b775af50ee P 74ac2cf163ee475e8a280cb3aa738f57: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.003s
I20260709 13:02:51.033779  9370 tablet_bootstrap.cc:492] T 02048c7b44ac4e8a984dfa44a3b3b3e5 P 74ac2cf163ee475e8a280cb3aa738f57: Bootstrap starting.
I20260709 13:02:51.039423  9369 tablet_bootstrap.cc:654] T 4d2b02247c21448ea824065ad29304e7 P 8846d581359a4b7ea6d4c33424ea825d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:51.043217  8995 catalog_manager.cc:5697] T 6007c141b1134cb18ab1200556127236 P c694531b0e1d47988b291f1214efc4cb reported cstate change: term changed from 0 to 1, leader changed from <none> to c694531b0e1d47988b291f1214efc4cb (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c694531b0e1d47988b291f1214efc4cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:51.005733  9372 tablet_bootstrap.cc:654] T 7f278d22c55747ee8ee613bfa5c59391 P 65ed95869fbb4b69b5d6eb99c51adf85: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:51.059608  9372 tablet_bootstrap.cc:492] T 7f278d22c55747ee8ee613bfa5c59391 P 65ed95869fbb4b69b5d6eb99c51adf85: No bootstrap required, opened a new log
I20260709 13:02:51.060200  9372 ts_tablet_manager.cc:1403] T 7f278d22c55747ee8ee613bfa5c59391 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent bootstrapping tablet: real 0.073s	user 0.012s	sys 0.000s
I20260709 13:02:51.065079  9371 tablet_bootstrap.cc:492] T c7c964979a0443f68e90c8678d083c96 P c694531b0e1d47988b291f1214efc4cb: No bootstrap required, opened a new log
I20260709 13:02:51.065623  9371 ts_tablet_manager.cc:1403] T c7c964979a0443f68e90c8678d083c96 P c694531b0e1d47988b291f1214efc4cb: Time spent bootstrapping tablet: real 0.055s	user 0.012s	sys 0.014s
I20260709 13:02:51.045167  9369 tablet_bootstrap.cc:492] T 4d2b02247c21448ea824065ad29304e7 P 8846d581359a4b7ea6d4c33424ea825d: No bootstrap required, opened a new log
I20260709 13:02:51.048199  9370 tablet_bootstrap.cc:654] T 02048c7b44ac4e8a984dfa44a3b3b3e5 P 74ac2cf163ee475e8a280cb3aa738f57: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:51.072528  9369 ts_tablet_manager.cc:1403] T 4d2b02247c21448ea824065ad29304e7 P 8846d581359a4b7ea6d4c33424ea825d: Time spent bootstrapping tablet: real 0.059s	user 0.010s	sys 0.001s
I20260709 13:02:51.075147  9369 raft_consensus.cc:359] T 4d2b02247c21448ea824065ad29304e7 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:51.075871  9369 raft_consensus.cc:385] T 4d2b02247c21448ea824065ad29304e7 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:51.076136  9369 raft_consensus.cc:740] T 4d2b02247c21448ea824065ad29304e7 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8846d581359a4b7ea6d4c33424ea825d, State: Initialized, Role: FOLLOWER
I20260709 13:02:51.076735  9369 consensus_queue.cc:260] T 4d2b02247c21448ea824065ad29304e7 P 8846d581359a4b7ea6d4c33424ea825d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:51.078164  9369 ts_tablet_manager.cc:1434] T 4d2b02247c21448ea824065ad29304e7 P 8846d581359a4b7ea6d4c33424ea825d: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.000s
I20260709 13:02:51.080104  9369 tablet_bootstrap.cc:492] T c500a4c76ad3464aaa2f8985f7d3a53d P 8846d581359a4b7ea6d4c33424ea825d: Bootstrap starting.
I20260709 13:02:51.068256  9371 raft_consensus.cc:359] T c7c964979a0443f68e90c8678d083c96 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:51.082144  9371 raft_consensus.cc:385] T c7c964979a0443f68e90c8678d083c96 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:51.082450  9371 raft_consensus.cc:740] T c7c964979a0443f68e90c8678d083c96 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c694531b0e1d47988b291f1214efc4cb, State: Initialized, Role: FOLLOWER
I20260709 13:02:51.083141  9371 consensus_queue.cc:260] T c7c964979a0443f68e90c8678d083c96 P c694531b0e1d47988b291f1214efc4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:51.085515  9371 ts_tablet_manager.cc:1434] T c7c964979a0443f68e90c8678d083c96 P c694531b0e1d47988b291f1214efc4cb: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:02:51.086418  9371 tablet_bootstrap.cc:492] T 02048c7b44ac4e8a984dfa44a3b3b3e5 P c694531b0e1d47988b291f1214efc4cb: Bootstrap starting.
I20260709 13:02:51.082505  9370 tablet_bootstrap.cc:492] T 02048c7b44ac4e8a984dfa44a3b3b3e5 P 74ac2cf163ee475e8a280cb3aa738f57: No bootstrap required, opened a new log
I20260709 13:02:51.088656  9370 ts_tablet_manager.cc:1403] T 02048c7b44ac4e8a984dfa44a3b3b3e5 P 74ac2cf163ee475e8a280cb3aa738f57: Time spent bootstrapping tablet: real 0.055s	user 0.011s	sys 0.000s
I20260709 13:02:51.089198  9369 tablet_bootstrap.cc:654] T c500a4c76ad3464aaa2f8985f7d3a53d P 8846d581359a4b7ea6d4c33424ea825d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:51.091513  9370 raft_consensus.cc:359] T 02048c7b44ac4e8a984dfa44a3b3b3e5 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:51.092300  9370 raft_consensus.cc:385] T 02048c7b44ac4e8a984dfa44a3b3b3e5 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:51.092592  9370 raft_consensus.cc:740] T 02048c7b44ac4e8a984dfa44a3b3b3e5 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74ac2cf163ee475e8a280cb3aa738f57, State: Initialized, Role: FOLLOWER
I20260709 13:02:51.093432  9370 consensus_queue.cc:260] T 02048c7b44ac4e8a984dfa44a3b3b3e5 P 74ac2cf163ee475e8a280cb3aa738f57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:51.094465  9372 raft_consensus.cc:359] T 7f278d22c55747ee8ee613bfa5c59391 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:51.095196  9372 raft_consensus.cc:385] T 7f278d22c55747ee8ee613bfa5c59391 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:51.095467  9372 raft_consensus.cc:740] T 7f278d22c55747ee8ee613bfa5c59391 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Initialized, Role: FOLLOWER
I20260709 13:02:51.096035  9370 ts_tablet_manager.cc:1434] T 02048c7b44ac4e8a984dfa44a3b3b3e5 P 74ac2cf163ee475e8a280cb3aa738f57: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:02:51.097215  9370 tablet_bootstrap.cc:492] T 76b3d3cd810b46dbac2b534c0be568d2 P 74ac2cf163ee475e8a280cb3aa738f57: Bootstrap starting.
I20260709 13:02:51.099001  9372 consensus_queue.cc:260] T 7f278d22c55747ee8ee613bfa5c59391 P 65ed95869fbb4b69b5d6eb99c51adf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:51.105702  9369 tablet_bootstrap.cc:492] T c500a4c76ad3464aaa2f8985f7d3a53d P 8846d581359a4b7ea6d4c33424ea825d: No bootstrap required, opened a new log
I20260709 13:02:51.106393  9369 ts_tablet_manager.cc:1403] T c500a4c76ad3464aaa2f8985f7d3a53d P 8846d581359a4b7ea6d4c33424ea825d: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.005s
I20260709 13:02:51.109118  9369 raft_consensus.cc:359] T c500a4c76ad3464aaa2f8985f7d3a53d P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:51.109822  9369 raft_consensus.cc:385] T c500a4c76ad3464aaa2f8985f7d3a53d P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:51.110098  9369 raft_consensus.cc:740] T c500a4c76ad3464aaa2f8985f7d3a53d P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8846d581359a4b7ea6d4c33424ea825d, State: Initialized, Role: FOLLOWER
I20260709 13:02:51.110895  9369 consensus_queue.cc:260] T c500a4c76ad3464aaa2f8985f7d3a53d P 8846d581359a4b7ea6d4c33424ea825d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:51.114038  9370 tablet_bootstrap.cc:654] T 76b3d3cd810b46dbac2b534c0be568d2 P 74ac2cf163ee475e8a280cb3aa738f57: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:51.117601  9372 ts_tablet_manager.cc:1434] T 7f278d22c55747ee8ee613bfa5c59391 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent starting tablet: real 0.054s	user 0.004s	sys 0.002s
I20260709 13:02:51.118924  9372 tablet_bootstrap.cc:492] T 76b3d3cd810b46dbac2b534c0be568d2 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap starting.
I20260709 13:02:51.123839  9369 ts_tablet_manager.cc:1434] T c500a4c76ad3464aaa2f8985f7d3a53d P 8846d581359a4b7ea6d4c33424ea825d: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.002s
I20260709 13:02:51.125147  9369 tablet_bootstrap.cc:492] T a581cc3c19254d4ca39e1f7328268a93 P 8846d581359a4b7ea6d4c33424ea825d: Bootstrap starting.
I20260709 13:02:51.127579  9371 tablet_bootstrap.cc:654] T 02048c7b44ac4e8a984dfa44a3b3b3e5 P c694531b0e1d47988b291f1214efc4cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:51.131996  9372 tablet_bootstrap.cc:654] T 76b3d3cd810b46dbac2b534c0be568d2 P 65ed95869fbb4b69b5d6eb99c51adf85: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:51.154973  9369 tablet_bootstrap.cc:654] T a581cc3c19254d4ca39e1f7328268a93 P 8846d581359a4b7ea6d4c33424ea825d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:51.164237  9623 raft_consensus.cc:493] T d75fae153be542ccbf70c92676ffd30d P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:51.164947  9623 raft_consensus.cc:515] T d75fae153be542ccbf70c92676ffd30d P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:51.166356  9410 raft_consensus.cc:493] T 534ae119bf014235a99dfbbfcff690e1 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:51.167107  9623 leader_election.cc:290] T d75fae153be542ccbf70c92676ffd30d P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351), 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979)
I20260709 13:02:51.167347  9410 raft_consensus.cc:515] T 534ae119bf014235a99dfbbfcff690e1 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:51.170102  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d75fae153be542ccbf70c92676ffd30d" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" is_pre_election: true
W20260709 13:02:51.176142  9141 leader_election.cc:343] T d75fae153be542ccbf70c92676ffd30d P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:51.180405  9409 raft_consensus.cc:493] T 76b3d3cd810b46dbac2b534c0be568d2 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:51.181236  9409 raft_consensus.cc:515] T 76b3d3cd810b46dbac2b534c0be568d2 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:51.182978  9410 leader_election.cc:290] T 534ae119bf014235a99dfbbfcff690e1 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351), 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979)
I20260709 13:02:51.184067  9409 leader_election.cc:290] T 76b3d3cd810b46dbac2b534c0be568d2 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351), 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979)
I20260709 13:02:51.181249  9099 raft_consensus.cc:3060] T 8f67cb568c0745e792c17959b07c5da1 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:51.186367  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534ae119bf014235a99dfbbfcff690e1" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" is_pre_election: true
I20260709 13:02:51.187933  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76b3d3cd810b46dbac2b534c0be568d2" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" is_pre_election: true
I20260709 13:02:51.189935  9319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534ae119bf014235a99dfbbfcff690e1" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57" is_pre_election: true
I20260709 13:02:51.191490  9320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76b3d3cd810b46dbac2b534c0be568d2" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57" is_pre_election: true
W20260709 13:02:51.192673  9215 leader_election.cc:343] T 534ae119bf014235a99dfbbfcff690e1 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:51.193495  9215 leader_election.cc:343] T 76b3d3cd810b46dbac2b534c0be568d2 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:51.179224  9370 tablet_bootstrap.cc:492] T 76b3d3cd810b46dbac2b534c0be568d2 P 74ac2cf163ee475e8a280cb3aa738f57: No bootstrap required, opened a new log
W20260709 13:02:51.201805  9215 leader_election.cc:343] T 76b3d3cd810b46dbac2b534c0be568d2 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:51.202016  9370 ts_tablet_manager.cc:1403] T 76b3d3cd810b46dbac2b534c0be568d2 P 74ac2cf163ee475e8a280cb3aa738f57: Time spent bootstrapping tablet: real 0.105s	user 0.016s	sys 0.000s
I20260709 13:02:51.202834  9215 leader_election.cc:304] T 76b3d3cd810b46dbac2b534c0be568d2 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8846d581359a4b7ea6d4c33424ea825d; no voters: 65ed95869fbb4b69b5d6eb99c51adf85, 74ac2cf163ee475e8a280cb3aa738f57
I20260709 13:02:51.180358  9321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d75fae153be542ccbf70c92676ffd30d" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57" is_pre_election: true
I20260709 13:02:51.204936  9409 raft_consensus.cc:2749] T 76b3d3cd810b46dbac2b534c0be568d2 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:02:51.205411  9215 leader_election.cc:343] T 534ae119bf014235a99dfbbfcff690e1 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:51.206104  9215 leader_election.cc:304] T 534ae119bf014235a99dfbbfcff690e1 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8846d581359a4b7ea6d4c33424ea825d; no voters: 65ed95869fbb4b69b5d6eb99c51adf85, 74ac2cf163ee475e8a280cb3aa738f57
I20260709 13:02:51.207176  9409 raft_consensus.cc:2749] T 534ae119bf014235a99dfbbfcff690e1 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:51.209445  9372 tablet_bootstrap.cc:492] T 76b3d3cd810b46dbac2b534c0be568d2 P 65ed95869fbb4b69b5d6eb99c51adf85: No bootstrap required, opened a new log
I20260709 13:02:51.209987  9372 ts_tablet_manager.cc:1403] T 76b3d3cd810b46dbac2b534c0be568d2 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent bootstrapping tablet: real 0.092s	user 0.015s	sys 0.000s
I20260709 13:02:51.212831  9372 raft_consensus.cc:359] T 76b3d3cd810b46dbac2b534c0be568d2 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:51.213053  9370 raft_consensus.cc:359] T 76b3d3cd810b46dbac2b534c0be568d2 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:51.213503  9372 raft_consensus.cc:385] T 76b3d3cd810b46dbac2b534c0be568d2 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:51.213796  9370 raft_consensus.cc:385] T 76b3d3cd810b46dbac2b534c0be568d2 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:51.213868  9372 raft_consensus.cc:740] T 76b3d3cd810b46dbac2b534c0be568d2 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Initialized, Role: FOLLOWER
I20260709 13:02:51.214133  9370 raft_consensus.cc:740] T 76b3d3cd810b46dbac2b534c0be568d2 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74ac2cf163ee475e8a280cb3aa738f57, State: Initialized, Role: FOLLOWER
I20260709 13:02:51.214963  9370 consensus_queue.cc:260] T 76b3d3cd810b46dbac2b534c0be568d2 P 74ac2cf163ee475e8a280cb3aa738f57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:51.215906  9372 consensus_queue.cc:260] T 76b3d3cd810b46dbac2b534c0be568d2 P 65ed95869fbb4b69b5d6eb99c51adf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:51.217147  9370 ts_tablet_manager.cc:1434] T 76b3d3cd810b46dbac2b534c0be568d2 P 74ac2cf163ee475e8a280cb3aa738f57: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.000s
I20260709 13:02:51.218715  9372 ts_tablet_manager.cc:1434] T 76b3d3cd810b46dbac2b534c0be568d2 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 13:02:51.219192  9371 tablet_bootstrap.cc:492] T 02048c7b44ac4e8a984dfa44a3b3b3e5 P c694531b0e1d47988b291f1214efc4cb: No bootstrap required, opened a new log
I20260709 13:02:51.219730  9372 tablet_bootstrap.cc:492] T d75fae153be542ccbf70c92676ffd30d P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap starting.
W20260709 13:02:51.220463  9141 leader_election.cc:343] T d75fae153be542ccbf70c92676ffd30d P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:51.219780  9371 ts_tablet_manager.cc:1403] T 02048c7b44ac4e8a984dfa44a3b3b3e5 P c694531b0e1d47988b291f1214efc4cb: Time spent bootstrapping tablet: real 0.134s	user 0.029s	sys 0.029s
I20260709 13:02:51.221010  9141 leader_election.cc:304] T d75fae153be542ccbf70c92676ffd30d P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c694531b0e1d47988b291f1214efc4cb; no voters: 65ed95869fbb4b69b5d6eb99c51adf85, 74ac2cf163ee475e8a280cb3aa738f57
I20260709 13:02:51.222404  9623 raft_consensus.cc:2749] T d75fae153be542ccbf70c92676ffd30d P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:51.223750  9370 tablet_bootstrap.cc:492] T d75fae153be542ccbf70c92676ffd30d P 74ac2cf163ee475e8a280cb3aa738f57: Bootstrap starting.
I20260709 13:02:51.230186  9370 tablet_bootstrap.cc:654] T d75fae153be542ccbf70c92676ffd30d P 74ac2cf163ee475e8a280cb3aa738f57: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:51.232525  9371 raft_consensus.cc:359] T 02048c7b44ac4e8a984dfa44a3b3b3e5 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:51.233281  9371 raft_consensus.cc:385] T 02048c7b44ac4e8a984dfa44a3b3b3e5 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:51.234977  9371 raft_consensus.cc:740] T 02048c7b44ac4e8a984dfa44a3b3b3e5 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c694531b0e1d47988b291f1214efc4cb, State: Initialized, Role: FOLLOWER
I20260709 13:02:51.235569  9370 tablet_bootstrap.cc:492] T d75fae153be542ccbf70c92676ffd30d P 74ac2cf163ee475e8a280cb3aa738f57: No bootstrap required, opened a new log
I20260709 13:02:51.235656  9369 tablet_bootstrap.cc:492] T a581cc3c19254d4ca39e1f7328268a93 P 8846d581359a4b7ea6d4c33424ea825d: No bootstrap required, opened a new log
I20260709 13:02:51.236333  9369 ts_tablet_manager.cc:1403] T a581cc3c19254d4ca39e1f7328268a93 P 8846d581359a4b7ea6d4c33424ea825d: Time spent bootstrapping tablet: real 0.111s	user 0.025s	sys 0.024s
I20260709 13:02:51.236572  9372 tablet_bootstrap.cc:654] T d75fae153be542ccbf70c92676ffd30d P 65ed95869fbb4b69b5d6eb99c51adf85: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:51.235692  9371 consensus_queue.cc:260] T 02048c7b44ac4e8a984dfa44a3b3b3e5 P c694531b0e1d47988b291f1214efc4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:51.339571  9410 raft_consensus.cc:493] T 4d2b02247c21448ea824065ad29304e7 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:51.341022  9410 raft_consensus.cc:515] T 4d2b02247c21448ea824065ad29304e7 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:51.361352  9481 raft_consensus.cc:493] T c500a4c76ad3464aaa2f8985f7d3a53d P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:51.362241  9481 raft_consensus.cc:515] T c500a4c76ad3464aaa2f8985f7d3a53d P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:51.366513  9410 leader_election.cc:290] T 4d2b02247c21448ea824065ad29304e7 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351), 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979)
W20260709 13:02:51.367802  9139 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45311, user_credentials={real_user=slave}} blocked reactor thread for 47509.4us
I20260709 13:02:51.379362  9663 raft_consensus.cc:493] T 76b3d3cd810b46dbac2b534c0be568d2 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:51.380210  9663 raft_consensus.cc:515] T 76b3d3cd810b46dbac2b534c0be568d2 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:51.236333  9370 ts_tablet_manager.cc:1403] T d75fae153be542ccbf70c92676ffd30d P 74ac2cf163ee475e8a280cb3aa738f57: Time spent bootstrapping tablet: real 0.013s	user 0.008s	sys 0.004s
I20260709 13:02:51.384686  9663 leader_election.cc:290] T 76b3d3cd810b46dbac2b534c0be568d2 P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311), 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351)
I20260709 13:02:51.386715  9321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76b3d3cd810b46dbac2b534c0be568d2" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57" is_pre_election: true
I20260709 13:02:51.388231  9321 raft_consensus.cc:2468] T 76b3d3cd810b46dbac2b534c0be568d2 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65ed95869fbb4b69b5d6eb99c51adf85 in term 0.
I20260709 13:02:51.388195  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2b02247c21448ea824065ad29304e7" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" is_pre_election: true
I20260709 13:02:51.394325  9066 leader_election.cc:304] T 76b3d3cd810b46dbac2b534c0be568d2 P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65ed95869fbb4b69b5d6eb99c51adf85, 74ac2cf163ee475e8a280cb3aa738f57; no voters: 
I20260709 13:02:51.394816  9474 raft_consensus.cc:493] T 7f278d22c55747ee8ee613bfa5c59391 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:51.395586  9702 raft_consensus.cc:2804] T 76b3d3cd810b46dbac2b534c0be568d2 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:51.396049  9702 raft_consensus.cc:493] T 76b3d3cd810b46dbac2b534c0be568d2 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:51.396400  9702 raft_consensus.cc:3060] T 76b3d3cd810b46dbac2b534c0be568d2 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:51.399317  9173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c500a4c76ad3464aaa2f8985f7d3a53d" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694531b0e1d47988b291f1214efc4cb" is_pre_election: true
I20260709 13:02:51.311230  9735 consensus_queue.cc:1048] T 9dea45dda5454393bdfaed3f233a30a5 P 65ed95869fbb4b69b5d6eb99c51adf85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.091s
W20260709 13:02:51.407649  9214 leader_election.cc:343] T c500a4c76ad3464aaa2f8985f7d3a53d P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:51.407998  9684 raft_consensus.cc:493] T 87959c0c174141f0958bbba169370488 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:51.408864  9684 raft_consensus.cc:515] T 87959c0c174141f0958bbba169370488 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:51.411914  9594 raft_consensus.cc:493] T 9d21e8696b0340bea31002b775af50ee P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:51.412833  9594 raft_consensus.cc:515] T 9d21e8696b0340bea31002b775af50ee P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:51.415019  9481 leader_election.cc:290] T c500a4c76ad3464aaa2f8985f7d3a53d P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455), 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351)
I20260709 13:02:51.395783  9474 raft_consensus.cc:515] T 7f278d22c55747ee8ee613bfa5c59391 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:51.418334  9371 ts_tablet_manager.cc:1434] T 02048c7b44ac4e8a984dfa44a3b3b3e5 P c694531b0e1d47988b291f1214efc4cb: Time spent starting tablet: real 0.197s	user 0.018s	sys 0.022s
I20260709 13:02:51.420730  9371 tablet_bootstrap.cc:492] T c500a4c76ad3464aaa2f8985f7d3a53d P c694531b0e1d47988b291f1214efc4cb: Bootstrap starting.
W20260709 13:02:51.421726  9215 leader_election.cc:343] T 4d2b02247c21448ea824065ad29304e7 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:51.414029  9702 raft_consensus.cc:515] T 76b3d3cd810b46dbac2b534c0be568d2 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:51.426076  9702 leader_election.cc:290] T 76b3d3cd810b46dbac2b534c0be568d2 P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 1 election: Requested vote from peers 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311), 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351)
I20260709 13:02:51.439081  9474 leader_election.cc:290] T 7f278d22c55747ee8ee613bfa5c59391 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351), 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979)
I20260709 13:02:51.444891  9370 raft_consensus.cc:359] T d75fae153be542ccbf70c92676ffd30d P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:51.445830  9370 raft_consensus.cc:385] T d75fae153be542ccbf70c92676ffd30d P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:51.445938  9321 raft_consensus.cc:3060] T 9d21e8696b0340bea31002b775af50ee P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:51.446183  9370 raft_consensus.cc:740] T d75fae153be542ccbf70c92676ffd30d P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74ac2cf163ee475e8a280cb3aa738f57, State: Initialized, Role: FOLLOWER
I20260709 13:02:51.447000  9370 consensus_queue.cc:260] T d75fae153be542ccbf70c92676ffd30d P 74ac2cf163ee475e8a280cb3aa738f57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:51.448058  9594 leader_election.cc:290] T 9d21e8696b0340bea31002b775af50ee P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311), 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979)
I20260709 13:02:51.448750  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d21e8696b0340bea31002b775af50ee" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" is_pre_election: true
I20260709 13:02:51.450156  9250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76b3d3cd810b46dbac2b534c0be568d2" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d"
I20260709 13:02:51.451114  9250 raft_consensus.cc:3060] T 76b3d3cd810b46dbac2b534c0be568d2 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:51.453418  9369 raft_consensus.cc:359] T a581cc3c19254d4ca39e1f7328268a93 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:51.454298  9369 raft_consensus.cc:385] T a581cc3c19254d4ca39e1f7328268a93 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:51.455813  9684 leader_election.cc:290] T 87959c0c174141f0958bbba169370488 P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455), 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311)
I20260709 13:02:51.456110  9370 ts_tablet_manager.cc:1434] T d75fae153be542ccbf70c92676ffd30d P 74ac2cf163ee475e8a280cb3aa738f57: Time spent starting tablet: real 0.045s	user 0.009s	sys 0.000s
I20260709 13:02:51.454586  9369 raft_consensus.cc:740] T a581cc3c19254d4ca39e1f7328268a93 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8846d581359a4b7ea6d4c33424ea825d, State: Initialized, Role: FOLLOWER
I20260709 13:02:51.465492  9654 raft_consensus.cc:493] T 02048c7b44ac4e8a984dfa44a3b3b3e5 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:51.470273  9320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76b3d3cd810b46dbac2b534c0be568d2" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57"
I20260709 13:02:51.471334  9320 raft_consensus.cc:3060] T 76b3d3cd810b46dbac2b534c0be568d2 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:51.474852  9369 consensus_queue.cc:260] T a581cc3c19254d4ca39e1f7328268a93 P 8846d581359a4b7ea6d4c33424ea825d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:51.478891  9369 ts_tablet_manager.cc:1434] T a581cc3c19254d4ca39e1f7328268a93 P 8846d581359a4b7ea6d4c33424ea825d: Time spent starting tablet: real 0.242s	user 0.009s	sys 0.001s
W20260709 13:02:51.481676  9141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33979, user_credentials={real_user=slave}} blocked reactor thread for 62450.4us
I20260709 13:02:51.482301  9173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87959c0c174141f0958bbba169370488" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694531b0e1d47988b291f1214efc4cb" is_pre_election: true
I20260709 13:02:51.498543  9247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d21e8696b0340bea31002b775af50ee" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d" is_pre_election: true
I20260709 13:02:51.499918  9247 raft_consensus.cc:2393] T 9d21e8696b0340bea31002b775af50ee P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74ac2cf163ee475e8a280cb3aa738f57 in current term 1: Already voted for candidate 65ed95869fbb4b69b5d6eb99c51adf85 in this term.
I20260709 13:02:51.484606  9654 raft_consensus.cc:515] T 02048c7b44ac4e8a984dfa44a3b3b3e5 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:51.512112  9654 leader_election.cc:290] T 02048c7b44ac4e8a984dfa44a3b3b3e5 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311), 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351)
I20260709 13:02:51.511597  9247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02048c7b44ac4e8a984dfa44a3b3b3e5" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d" is_pre_election: true
I20260709 13:02:51.515769  9247 raft_consensus.cc:2468] T 02048c7b44ac4e8a984dfa44a3b3b3e5 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c694531b0e1d47988b291f1214efc4cb in term 0.
I20260709 13:02:51.517313  9098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f278d22c55747ee8ee613bfa5c59391" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" is_pre_election: true
I20260709 13:02:51.518253  9098 raft_consensus.cc:2468] T 7f278d22c55747ee8ee613bfa5c59391 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c694531b0e1d47988b291f1214efc4cb in term 0.
I20260709 13:02:51.513773  9319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f278d22c55747ee8ee613bfa5c59391" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57" is_pre_election: true
I20260709 13:02:51.519503  9244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87959c0c174141f0958bbba169370488" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d" is_pre_election: true
I20260709 13:02:51.520663  9319 raft_consensus.cc:2468] T 7f278d22c55747ee8ee613bfa5c59391 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c694531b0e1d47988b291f1214efc4cb in term 0.
I20260709 13:02:51.524080  9318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2b02247c21448ea824065ad29304e7" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57" is_pre_election: true
I20260709 13:02:51.521660  9659 raft_consensus.cc:493] T 7f278d22c55747ee8ee613bfa5c59391 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:51.528267  9659 raft_consensus.cc:515] T 7f278d22c55747ee8ee613bfa5c59391 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:51.530192  9702 consensus_queue.cc:1048] T 9d21e8696b0340bea31002b775af50ee P 65ed95869fbb4b69b5d6eb99c51adf85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:51.531273  9659 leader_election.cc:290] T 7f278d22c55747ee8ee613bfa5c59391 P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351), c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455)
I20260709 13:02:51.533438  9318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f278d22c55747ee8ee613bfa5c59391" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57" is_pre_election: true
I20260709 13:02:51.534122  9370 tablet_bootstrap.cc:492] T e2fbc9c2c0a947f1b4a078db7c8402d0 P 74ac2cf163ee475e8a280cb3aa738f57: Bootstrap starting.
I20260709 13:02:51.534320  9318 raft_consensus.cc:2468] T 7f278d22c55747ee8ee613bfa5c59391 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65ed95869fbb4b69b5d6eb99c51adf85 in term 0.
I20260709 13:02:51.554874  9372 tablet_bootstrap.cc:492] T d75fae153be542ccbf70c92676ffd30d P 65ed95869fbb4b69b5d6eb99c51adf85: No bootstrap required, opened a new log
I20260709 13:02:51.554646  9066 leader_election.cc:304] T 7f278d22c55747ee8ee613bfa5c59391 P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65ed95869fbb4b69b5d6eb99c51adf85, 74ac2cf163ee475e8a280cb3aa738f57; no voters: 
I20260709 13:02:51.543344  9139 leader_election.cc:304] T 02048c7b44ac4e8a984dfa44a3b3b3e5 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8846d581359a4b7ea6d4c33424ea825d, c694531b0e1d47988b291f1214efc4cb; no voters: 
I20260709 13:02:51.562543  9473 raft_consensus.cc:493] T c7c964979a0443f68e90c8678d083c96 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:51.561796  9736 raft_consensus.cc:2804] T 7f278d22c55747ee8ee613bfa5c59391 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:51.563437  9736 raft_consensus.cc:493] T 7f278d22c55747ee8ee613bfa5c59391 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:51.565634  9473 raft_consensus.cc:515] T c7c964979a0443f68e90c8678d083c96 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:51.572950  9372 ts_tablet_manager.cc:1403] T d75fae153be542ccbf70c92676ffd30d P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent bootstrapping tablet: real 0.353s	user 0.019s	sys 0.012s
I20260709 13:02:51.581431  9175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f278d22c55747ee8ee613bfa5c59391" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694531b0e1d47988b291f1214efc4cb" is_pre_election: true
I20260709 13:02:51.582496  9175 raft_consensus.cc:2468] T 7f278d22c55747ee8ee613bfa5c59391 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65ed95869fbb4b69b5d6eb99c51adf85 in term 0.
I20260709 13:02:51.588754  9702 consensus_queue.cc:1048] T 9d21e8696b0340bea31002b775af50ee P 65ed95869fbb4b69b5d6eb99c51adf85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:51.592324  9595 raft_consensus.cc:493] T 02048c7b44ac4e8a984dfa44a3b3b3e5 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:51.593153  9595 raft_consensus.cc:515] T 02048c7b44ac4e8a984dfa44a3b3b3e5 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:51.570432  9736 raft_consensus.cc:3060] T 7f278d22c55747ee8ee613bfa5c59391 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:51.569140  9474 raft_consensus.cc:2804] T 02048c7b44ac4e8a984dfa44a3b3b3e5 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:51.600107  9250 raft_consensus.cc:2468] T 76b3d3cd810b46dbac2b534c0be568d2 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65ed95869fbb4b69b5d6eb99c51adf85 in term 1.
I20260709 13:02:51.609052  9321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c500a4c76ad3464aaa2f8985f7d3a53d" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57" is_pre_election: true
I20260709 13:02:51.603852  9474 raft_consensus.cc:493] T 02048c7b44ac4e8a984dfa44a3b3b3e5 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:51.619190  9320 raft_consensus.cc:2468] T 76b3d3cd810b46dbac2b534c0be568d2 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65ed95869fbb4b69b5d6eb99c51adf85 in term 1.
I20260709 13:02:51.626767  9064 leader_election.cc:304] T 76b3d3cd810b46dbac2b534c0be568d2 P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65ed95869fbb4b69b5d6eb99c51adf85, 8846d581359a4b7ea6d4c33424ea825d; no voters: 
I20260709 13:02:51.627962  9702 raft_consensus.cc:2804] T 76b3d3cd810b46dbac2b534c0be568d2 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:51.628566  9702 raft_consensus.cc:697] T 76b3d3cd810b46dbac2b534c0be568d2 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 LEADER]: Becoming Leader. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Running, Role: LEADER
I20260709 13:02:51.629848  9702 consensus_queue.cc:237] T 76b3d3cd810b46dbac2b534c0be568d2 P 65ed95869fbb4b69b5d6eb99c51adf85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:51.631672  9743 raft_consensus.cc:493] T d75fae153be542ccbf70c92676ffd30d P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:51.632282  9141 leader_election.cc:304] T 7f278d22c55747ee8ee613bfa5c59391 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57, c694531b0e1d47988b291f1214efc4cb; no voters: 
I20260709 13:02:51.634858  9743 raft_consensus.cc:515] T d75fae153be542ccbf70c92676ffd30d P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:51.638988  9623 consensus_queue.cc:1048] T 6007c141b1134cb18ab1200556127236 P c694531b0e1d47988b291f1214efc4cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:02:51.634857  9735 consensus_queue.cc:1048] T 9dea45dda5454393bdfaed3f233a30a5 P 65ed95869fbb4b69b5d6eb99c51adf85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:02:51.642203  9473 leader_election.cc:290] T c7c964979a0443f68e90c8678d083c96 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979), 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311)
I20260709 13:02:51.600121  9249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76b3d3cd810b46dbac2b534c0be568d2" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d" is_pre_election: true
I20260709 13:02:51.643144  9249 raft_consensus.cc:2376] T 76b3d3cd810b46dbac2b534c0be568d2 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 65ed95869fbb4b69b5d6eb99c51adf85 in term 1. Re-sending same reply.
I20260709 13:02:51.643514  9174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d75fae153be542ccbf70c92676ffd30d" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694531b0e1d47988b291f1214efc4cb" is_pre_election: true
I20260709 13:02:51.642783  9369 tablet_bootstrap.cc:492] T c12e80bb348c4ba385ee6ebc8e55d71b P 8846d581359a4b7ea6d4c33424ea825d: Bootstrap starting.
I20260709 13:02:51.644395  9174 raft_consensus.cc:2468] T d75fae153be542ccbf70c92676ffd30d P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74ac2cf163ee475e8a280cb3aa738f57 in term 0.
I20260709 13:02:51.650164  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d75fae153be542ccbf70c92676ffd30d" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" is_pre_election: true
I20260709 13:02:51.651510  9318 raft_consensus.cc:3060] T 87959c0c174141f0958bbba169370488 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:51.621452  9474 raft_consensus.cc:3060] T 02048c7b44ac4e8a984dfa44a3b3b3e5 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:51.639314  9743 leader_election.cc:290] T d75fae153be542ccbf70c92676ffd30d P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979), c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455)
I20260709 13:02:51.641017  9370 tablet_bootstrap.cc:654] T e2fbc9c2c0a947f1b4a078db7c8402d0 P 74ac2cf163ee475e8a280cb3aa738f57: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:51.636438  9740 raft_consensus.cc:2804] T 7f278d22c55747ee8ee613bfa5c59391 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:02:51.682840  9141 consensus_peers.cc:597] T 6007c141b1134cb18ab1200556127236 P c694531b0e1d47988b291f1214efc4cb -> Peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Couldn't send request to peer 65ed95869fbb4b69b5d6eb99c51adf85. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:51.683365  9287 leader_election.cc:304] T 9d21e8696b0340bea31002b775af50ee P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57; no voters: 65ed95869fbb4b69b5d6eb99c51adf85, 8846d581359a4b7ea6d4c33424ea825d
I20260709 13:02:51.684710  9287 leader_election.cc:304] T 87959c0c174141f0958bbba169370488 P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57; no voters: 8846d581359a4b7ea6d4c33424ea825d, c694531b0e1d47988b291f1214efc4cb
I20260709 13:02:51.688058  9246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c964979a0443f68e90c8678d083c96" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d" is_pre_election: true
I20260709 13:02:51.688915  9246 raft_consensus.cc:2468] T c7c964979a0443f68e90c8678d083c96 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c694531b0e1d47988b291f1214efc4cb in term 0.
I20260709 13:02:51.670533  9740 raft_consensus.cc:493] T 7f278d22c55747ee8ee613bfa5c59391 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:51.689744  9740 raft_consensus.cc:3060] T 7f278d22c55747ee8ee613bfa5c59391 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:51.695366  9369 tablet_bootstrap.cc:654] T c12e80bb348c4ba385ee6ebc8e55d71b P 8846d581359a4b7ea6d4c33424ea825d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:51.713436  9594 raft_consensus.cc:2749] T 9d21e8696b0340bea31002b775af50ee P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:51.719507  9371 tablet_bootstrap.cc:654] T c500a4c76ad3464aaa2f8985f7d3a53d P c694531b0e1d47988b291f1214efc4cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:51.755537  9320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02048c7b44ac4e8a984dfa44a3b3b3e5" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57" is_pre_election: true
I20260709 13:02:51.756310  9320 raft_consensus.cc:2468] T 02048c7b44ac4e8a984dfa44a3b3b3e5 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c694531b0e1d47988b291f1214efc4cb in term 0.
W20260709 13:02:51.780144  9047 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:51.818344  9096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c964979a0443f68e90c8678d083c96" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" is_pre_election: true
I20260709 13:02:51.819718  9474 raft_consensus.cc:515] T 02048c7b44ac4e8a984dfa44a3b3b3e5 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:51.759390  9595 leader_election.cc:290] T 02048c7b44ac4e8a984dfa44a3b3b3e5 P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455), 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311)
I20260709 13:02:51.824250  9410 raft_consensus.cc:493] T a581cc3c19254d4ca39e1f7328268a93 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:51.824846  9410 raft_consensus.cc:515] T a581cc3c19254d4ca39e1f7328268a93 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:51.827358  9410 leader_election.cc:290] T a581cc3c19254d4ca39e1f7328268a93 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455), 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351)
I20260709 13:02:51.829109  9173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a581cc3c19254d4ca39e1f7328268a93" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694531b0e1d47988b291f1214efc4cb" is_pre_election: true
W20260709 13:02:51.830924  9214 leader_election.cc:343] T a581cc3c19254d4ca39e1f7328268a93 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:51.838812  9736 raft_consensus.cc:515] T 7f278d22c55747ee8ee613bfa5c59391 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:51.842108  9474 leader_election.cc:290] T 02048c7b44ac4e8a984dfa44a3b3b3e5 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 election: Requested vote from peers 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311), 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351)
I20260709 13:02:51.842968  9372 raft_consensus.cc:359] T d75fae153be542ccbf70c92676ffd30d P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:51.859437  9372 raft_consensus.cc:385] T d75fae153be542ccbf70c92676ffd30d P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:51.859797  9372 raft_consensus.cc:740] T d75fae153be542ccbf70c92676ffd30d P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Initialized, Role: FOLLOWER
I20260709 13:02:51.846323  9139 leader_election.cc:304] T c7c964979a0443f68e90c8678d083c96 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8846d581359a4b7ea6d4c33424ea825d, c694531b0e1d47988b291f1214efc4cb; no voters: 
I20260709 13:02:51.846933  9369 tablet_bootstrap.cc:492] T c12e80bb348c4ba385ee6ebc8e55d71b P 8846d581359a4b7ea6d4c33424ea825d: No bootstrap required, opened a new log
I20260709 13:02:51.861013  9738 raft_consensus.cc:2804] T c7c964979a0443f68e90c8678d083c96 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:51.861410  9738 raft_consensus.cc:493] T c7c964979a0443f68e90c8678d083c96 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:51.861972  9738 raft_consensus.cc:3060] T c7c964979a0443f68e90c8678d083c96 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:51.862428  9289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33979, user_credentials={real_user=slave}} blocked reactor thread for 71645.2us
I20260709 13:02:51.867197  9369 ts_tablet_manager.cc:1403] T c12e80bb348c4ba385ee6ebc8e55d71b P 8846d581359a4b7ea6d4c33424ea825d: Time spent bootstrapping tablet: real 0.225s	user 0.013s	sys 0.019s
I20260709 13:02:51.861385  9288 leader_election.cc:304] T d75fae153be542ccbf70c92676ffd30d P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57, c694531b0e1d47988b291f1214efc4cb; no voters: 
I20260709 13:02:51.870594  9751 raft_consensus.cc:2804] T d75fae153be542ccbf70c92676ffd30d P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:51.847208  9370 tablet_bootstrap.cc:492] T e2fbc9c2c0a947f1b4a078db7c8402d0 P 74ac2cf163ee475e8a280cb3aa738f57: No bootstrap required, opened a new log
I20260709 13:02:51.871681  9370 ts_tablet_manager.cc:1403] T e2fbc9c2c0a947f1b4a078db7c8402d0 P 74ac2cf163ee475e8a280cb3aa738f57: Time spent bootstrapping tablet: real 0.340s	user 0.033s	sys 0.015s
I20260709 13:02:51.830448  9740 raft_consensus.cc:515] T 7f278d22c55747ee8ee613bfa5c59391 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:51.871090  9751 raft_consensus.cc:493] T d75fae153be542ccbf70c92676ffd30d P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:51.871024  9141 leader_election.cc:343] T c7c964979a0443f68e90c8678d083c96 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:51.870424  9369 raft_consensus.cc:359] T c12e80bb348c4ba385ee6ebc8e55d71b P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:51.875394  9369 raft_consensus.cc:385] T c12e80bb348c4ba385ee6ebc8e55d71b P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:51.875718  9369 raft_consensus.cc:740] T c12e80bb348c4ba385ee6ebc8e55d71b P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8846d581359a4b7ea6d4c33424ea825d, State: Initialized, Role: FOLLOWER
I20260709 13:02:51.874279  9751 raft_consensus.cc:3060] T d75fae153be542ccbf70c92676ffd30d P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:51.873677  9289 leader_election.cc:343] T d75fae153be542ccbf70c92676ffd30d P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:51.885295  9370 raft_consensus.cc:359] T e2fbc9c2c0a947f1b4a078db7c8402d0 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:51.886145  9370 raft_consensus.cc:385] T e2fbc9c2c0a947f1b4a078db7c8402d0 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:51.877255  9372 consensus_queue.cc:260] T d75fae153be542ccbf70c92676ffd30d P 65ed95869fbb4b69b5d6eb99c51adf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
W20260709 13:02:51.893018  9215 leader_election.cc:343] T 4d2b02247c21448ea824065ad29304e7 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:51.896052  9215 leader_election.cc:304] T 4d2b02247c21448ea824065ad29304e7 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8846d581359a4b7ea6d4c33424ea825d; no voters: 65ed95869fbb4b69b5d6eb99c51adf85, 74ac2cf163ee475e8a280cb3aa738f57
I20260709 13:02:51.886438  9370 raft_consensus.cc:740] T e2fbc9c2c0a947f1b4a078db7c8402d0 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74ac2cf163ee475e8a280cb3aa738f57, State: Initialized, Role: FOLLOWER
I20260709 13:02:51.892987  9740 leader_election.cc:290] T 7f278d22c55747ee8ee613bfa5c59391 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 election: Requested vote from peers 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351), 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979)
I20260709 13:02:51.899664  9369 consensus_queue.cc:260] T c12e80bb348c4ba385ee6ebc8e55d71b P 8846d581359a4b7ea6d4c33424ea825d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
W20260709 13:02:51.906039  9215 leader_election.cc:343] T c500a4c76ad3464aaa2f8985f7d3a53d P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:51.908771  9215 leader_election.cc:304] T c500a4c76ad3464aaa2f8985f7d3a53d P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8846d581359a4b7ea6d4c33424ea825d; no voters: 74ac2cf163ee475e8a280cb3aa738f57, c694531b0e1d47988b291f1214efc4cb
I20260709 13:02:51.903810  9370 consensus_queue.cc:260] T e2fbc9c2c0a947f1b4a078db7c8402d0 P 74ac2cf163ee475e8a280cb3aa738f57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:51.874007  9738 raft_consensus.cc:515] T c7c964979a0443f68e90c8678d083c96 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:51.918087  9372 ts_tablet_manager.cc:1434] T d75fae153be542ccbf70c92676ffd30d P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent starting tablet: real 0.343s	user 0.006s	sys 0.007s
I20260709 13:02:51.920534  9377 raft_consensus.cc:493] T c12e80bb348c4ba385ee6ebc8e55d71b P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:51.920886  9409 raft_consensus.cc:2749] T c500a4c76ad3464aaa2f8985f7d3a53d P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:51.919890  9369 ts_tablet_manager.cc:1434] T c12e80bb348c4ba385ee6ebc8e55d71b P 8846d581359a4b7ea6d4c33424ea825d: Time spent starting tablet: real 0.052s	user 0.005s	sys 0.002s
I20260709 13:02:51.922547  9739 raft_consensus.cc:2749] T 4d2b02247c21448ea824065ad29304e7 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:51.923177  9595 raft_consensus.cc:493] T e2fbc9c2c0a947f1b4a078db7c8402d0 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:51.924466  9595 raft_consensus.cc:515] T e2fbc9c2c0a947f1b4a078db7c8402d0 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:51.921072  9377 raft_consensus.cc:515] T c12e80bb348c4ba385ee6ebc8e55d71b P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:51.926642  9595 leader_election.cc:290] T e2fbc9c2c0a947f1b4a078db7c8402d0 P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979), c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455)
I20260709 13:02:51.927152  9377 leader_election.cc:290] T c12e80bb348c4ba385ee6ebc8e55d71b P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979), c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455)
I20260709 13:02:51.929112  9173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12e80bb348c4ba385ee6ebc8e55d71b" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694531b0e1d47988b291f1214efc4cb" is_pre_election: true
I20260709 13:02:51.934010  9319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f278d22c55747ee8ee613bfa5c59391" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57"
I20260709 13:02:51.934791  9319 raft_consensus.cc:3060] T 7f278d22c55747ee8ee613bfa5c59391 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:51.939211  9172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fbc9c2c0a947f1b4a078db7c8402d0" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694531b0e1d47988b291f1214efc4cb" is_pre_election: true
I20260709 13:02:51.942279  9321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02048c7b44ac4e8a984dfa44a3b3b3e5" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57"
I20260709 13:02:51.942907  9321 raft_consensus.cc:3060] T 02048c7b44ac4e8a984dfa44a3b3b3e5 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:51.947230  9322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f278d22c55747ee8ee613bfa5c59391" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57"
I20260709 13:02:51.947516  9173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02048c7b44ac4e8a984dfa44a3b3b3e5" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694531b0e1d47988b291f1214efc4cb" is_pre_election: true
I20260709 13:02:51.942981  9371 tablet_bootstrap.cc:492] T c500a4c76ad3464aaa2f8985f7d3a53d P c694531b0e1d47988b291f1214efc4cb: No bootstrap required, opened a new log
I20260709 13:02:51.948406  9371 ts_tablet_manager.cc:1403] T c500a4c76ad3464aaa2f8985f7d3a53d P c694531b0e1d47988b291f1214efc4cb: Time spent bootstrapping tablet: real 0.528s	user 0.023s	sys 0.004s
I20260709 13:02:51.949409  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fbc9c2c0a947f1b4a078db7c8402d0" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" is_pre_election: true
W20260709 13:02:51.949658  9214 leader_election.cc:343] T c12e80bb348c4ba385ee6ebc8e55d71b P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:51.950837  9248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02048c7b44ac4e8a984dfa44a3b3b3e5" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d"
I20260709 13:02:51.951524  9248 raft_consensus.cc:3060] T 02048c7b44ac4e8a984dfa44a3b3b3e5 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:51.951656  9371 raft_consensus.cc:359] T c500a4c76ad3464aaa2f8985f7d3a53d P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:51.952375  9371 raft_consensus.cc:385] T c500a4c76ad3464aaa2f8985f7d3a53d P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:51.952771  9371 raft_consensus.cc:740] T c500a4c76ad3464aaa2f8985f7d3a53d P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c694531b0e1d47988b291f1214efc4cb, State: Initialized, Role: FOLLOWER
I20260709 13:02:51.953424  9371 consensus_queue.cc:260] T c500a4c76ad3464aaa2f8985f7d3a53d P c694531b0e1d47988b291f1214efc4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
W20260709 13:02:51.955050  9288 leader_election.cc:343] T e2fbc9c2c0a947f1b4a078db7c8402d0 P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:51.955399  9371 ts_tablet_manager.cc:1434] T c500a4c76ad3464aaa2f8985f7d3a53d P c694531b0e1d47988b291f1214efc4cb: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:02:51.956640  9371 tablet_bootstrap.cc:492] T c12e80bb348c4ba385ee6ebc8e55d71b P c694531b0e1d47988b291f1214efc4cb: Bootstrap starting.
I20260709 13:02:51.961640  9370 ts_tablet_manager.cc:1434] T e2fbc9c2c0a947f1b4a078db7c8402d0 P 74ac2cf163ee475e8a280cb3aa738f57: Time spent starting tablet: real 0.090s	user 0.003s	sys 0.004s
I20260709 13:02:51.962780  9370 tablet_bootstrap.cc:492] T a581cc3c19254d4ca39e1f7328268a93 P 74ac2cf163ee475e8a280cb3aa738f57: Bootstrap starting.
I20260709 13:02:51.962165  8998 catalog_manager.cc:5697] T 76b3d3cd810b46dbac2b534c0be568d2 P 65ed95869fbb4b69b5d6eb99c51adf85 reported cstate change: term changed from 0 to 1, leader changed from <none> to 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:51.964035  9248 raft_consensus.cc:2468] T 02048c7b44ac4e8a984dfa44a3b3b3e5 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c694531b0e1d47988b291f1214efc4cb in term 1.
W20260709 13:02:51.964730  9289 leader_election.cc:343] T e2fbc9c2c0a947f1b4a078db7c8402d0 P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:51.965891  9289 leader_election.cc:304] T e2fbc9c2c0a947f1b4a078db7c8402d0 P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57; no voters: 65ed95869fbb4b69b5d6eb99c51adf85, c694531b0e1d47988b291f1214efc4cb
I20260709 13:02:51.948333  9173 raft_consensus.cc:2393] T 02048c7b44ac4e8a984dfa44a3b3b3e5 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74ac2cf163ee475e8a280cb3aa738f57 in current term 1: Already voted for candidate c694531b0e1d47988b291f1214efc4cb in this term.
I20260709 13:02:51.947875  9736 leader_election.cc:290] T 7f278d22c55747ee8ee613bfa5c59391 P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 1 election: Requested vote from peers 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351), c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455)
I20260709 13:02:52.004407  9753 raft_consensus.cc:2749] T e2fbc9c2c0a947f1b4a078db7c8402d0 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:52.000026  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f278d22c55747ee8ee613bfa5c59391" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85"
I20260709 13:02:52.010705  9684 raft_consensus.cc:2749] T 87959c0c174141f0958bbba169370488 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:52.021044  9369 tablet_bootstrap.cc:492] T ac928b0582c745b4804afcd30e861439 P 8846d581359a4b7ea6d4c33424ea825d: Bootstrap starting.
I20260709 13:02:52.009366  9175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f278d22c55747ee8ee613bfa5c59391" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694531b0e1d47988b291f1214efc4cb"
I20260709 13:02:52.027793  9101 raft_consensus.cc:2393] T 7f278d22c55747ee8ee613bfa5c59391 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c694531b0e1d47988b291f1214efc4cb in current term 1: Already voted for candidate 65ed95869fbb4b69b5d6eb99c51adf85 in this term.
I20260709 13:02:52.022323  9175 raft_consensus.cc:2393] T 7f278d22c55747ee8ee613bfa5c59391 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 65ed95869fbb4b69b5d6eb99c51adf85 in current term 1: Already voted for candidate c694531b0e1d47988b291f1214efc4cb in this term.
I20260709 13:02:52.029549  9319 raft_consensus.cc:2468] T 7f278d22c55747ee8ee613bfa5c59391 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65ed95869fbb4b69b5d6eb99c51adf85 in term 1.
I20260709 13:02:52.032905  9751 raft_consensus.cc:515] T d75fae153be542ccbf70c92676ffd30d P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:52.035989  9248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02048c7b44ac4e8a984dfa44a3b3b3e5" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d" is_pre_election: true
I20260709 13:02:52.036870  9248 raft_consensus.cc:2393] T 02048c7b44ac4e8a984dfa44a3b3b3e5 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74ac2cf163ee475e8a280cb3aa738f57 in current term 1: Already voted for candidate c694531b0e1d47988b291f1214efc4cb in this term.
I20260709 13:02:52.037501  9324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a581cc3c19254d4ca39e1f7328268a93" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57" is_pre_election: true
I20260709 13:02:52.039106  9702 raft_consensus.cc:493] T d75fae153be542ccbf70c92676ffd30d P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:52.037632  9099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12e80bb348c4ba385ee6ebc8e55d71b" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" is_pre_election: true
I20260709 13:02:52.044468  9141 leader_election.cc:304] T 7f278d22c55747ee8ee613bfa5c59391 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c694531b0e1d47988b291f1214efc4cb; no voters: 65ed95869fbb4b69b5d6eb99c51adf85, 74ac2cf163ee475e8a280cb3aa738f57
I20260709 13:02:52.039741  9702 raft_consensus.cc:515] T d75fae153be542ccbf70c92676ffd30d P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:52.049049  9372 tablet_bootstrap.cc:492] T c7c964979a0443f68e90c8678d083c96 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap starting.
I20260709 13:02:52.033522  9738 leader_election.cc:290] T c7c964979a0443f68e90c8678d083c96 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 election: Requested vote from peers 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979), 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311)
I20260709 13:02:52.054328  9321 raft_consensus.cc:2468] T 02048c7b44ac4e8a984dfa44a3b3b3e5 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c694531b0e1d47988b291f1214efc4cb in term 1.
I20260709 13:02:52.050971  9709 raft_consensus.cc:2749] T 7f278d22c55747ee8ee613bfa5c59391 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:02:52.058612  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d75fae153be542ccbf70c92676ffd30d" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85"
I20260709 13:02:52.061291  9751 leader_election.cc:290] T d75fae153be542ccbf70c92676ffd30d P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 election: Requested vote from peers 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979), c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455)
I20260709 13:02:52.063321  9702 leader_election.cc:290] T d75fae153be542ccbf70c92676ffd30d P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351), c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455)
I20260709 13:02:52.064841  9100 raft_consensus.cc:3060] T d75fae153be542ccbf70c92676ffd30d P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:52.068987  9141 leader_election.cc:304] T 02048c7b44ac4e8a984dfa44a3b3b3e5 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57, c694531b0e1d47988b291f1214efc4cb; no voters: 
I20260709 13:02:52.076968  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c964979a0443f68e90c8678d083c96" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85"
I20260709 13:02:52.080992  9654 raft_consensus.cc:2804] T 02048c7b44ac4e8a984dfa44a3b3b3e5 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:52.082458  9654 raft_consensus.cc:697] T 02048c7b44ac4e8a984dfa44a3b3b3e5 P c694531b0e1d47988b291f1214efc4cb [term 1 LEADER]: Becoming Leader. State: Replica: c694531b0e1d47988b291f1214efc4cb, State: Running, Role: LEADER
I20260709 13:02:52.083491  9654 consensus_queue.cc:237] T 02048c7b44ac4e8a984dfa44a3b3b3e5 P c694531b0e1d47988b291f1214efc4cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:52.088292  9370 tablet_bootstrap.cc:654] T a581cc3c19254d4ca39e1f7328268a93 P 74ac2cf163ee475e8a280cb3aa738f57: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:52.093752  9371 tablet_bootstrap.cc:654] T c12e80bb348c4ba385ee6ebc8e55d71b P c694531b0e1d47988b291f1214efc4cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:52.103922  9372 tablet_bootstrap.cc:654] T c7c964979a0443f68e90c8678d083c96 P 65ed95869fbb4b69b5d6eb99c51adf85: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:52.108587  9369 tablet_bootstrap.cc:654] T ac928b0582c745b4804afcd30e861439 P 8846d581359a4b7ea6d4c33424ea825d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:52.121784  9066 leader_election.cc:304] T 7f278d22c55747ee8ee613bfa5c59391 P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65ed95869fbb4b69b5d6eb99c51adf85, 74ac2cf163ee475e8a280cb3aa738f57; no voters: c694531b0e1d47988b291f1214efc4cb
I20260709 13:02:52.122758  9736 raft_consensus.cc:2804] T 7f278d22c55747ee8ee613bfa5c59391 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:52.123342  9736 raft_consensus.cc:697] T 7f278d22c55747ee8ee613bfa5c59391 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 LEADER]: Becoming Leader. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Running, Role: LEADER
I20260709 13:02:52.124259  9736 consensus_queue.cc:237] T 7f278d22c55747ee8ee613bfa5c59391 P 65ed95869fbb4b69b5d6eb99c51adf85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
W20260709 13:02:52.129694  9215 leader_election.cc:343] T c12e80bb348c4ba385ee6ebc8e55d71b P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:52.130239  9215 leader_election.cc:304] T c12e80bb348c4ba385ee6ebc8e55d71b P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8846d581359a4b7ea6d4c33424ea825d; no voters: 65ed95869fbb4b69b5d6eb99c51adf85, c694531b0e1d47988b291f1214efc4cb
I20260709 13:02:52.131134  9406 raft_consensus.cc:2749] T c12e80bb348c4ba385ee6ebc8e55d71b P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:02:52.159885  9215 leader_election.cc:343] T a581cc3c19254d4ca39e1f7328268a93 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:52.160436  9215 leader_election.cc:304] T a581cc3c19254d4ca39e1f7328268a93 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8846d581359a4b7ea6d4c33424ea825d; no voters: 74ac2cf163ee475e8a280cb3aa738f57, c694531b0e1d47988b291f1214efc4cb
I20260709 13:02:52.161375  9249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c964979a0443f68e90c8678d083c96" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d"
I20260709 13:02:52.164362  9249 raft_consensus.cc:3060] T c7c964979a0443f68e90c8678d083c96 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:52.165376  9100 raft_consensus.cc:2468] T d75fae153be542ccbf70c92676ffd30d P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74ac2cf163ee475e8a280cb3aa738f57 in term 1.
I20260709 13:02:52.165450  9172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d75fae153be542ccbf70c92676ffd30d" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694531b0e1d47988b291f1214efc4cb"
I20260709 13:02:52.166949  9172 raft_consensus.cc:3060] T d75fae153be542ccbf70c92676ffd30d P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:52.163254  9141 leader_election.cc:343] T c7c964979a0443f68e90c8678d083c96 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:52.190950  9371 tablet_bootstrap.cc:492] T c12e80bb348c4ba385ee6ebc8e55d71b P c694531b0e1d47988b291f1214efc4cb: No bootstrap required, opened a new log
I20260709 13:02:52.191640  9371 ts_tablet_manager.cc:1403] T c12e80bb348c4ba385ee6ebc8e55d71b P c694531b0e1d47988b291f1214efc4cb: Time spent bootstrapping tablet: real 0.235s	user 0.018s	sys 0.007s
I20260709 13:02:52.175521  9175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d75fae153be542ccbf70c92676ffd30d" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694531b0e1d47988b291f1214efc4cb" is_pre_election: true
I20260709 13:02:52.161662  9288 leader_election.cc:304] T 02048c7b44ac4e8a984dfa44a3b3b3e5 P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57; no voters: 8846d581359a4b7ea6d4c33424ea825d, c694531b0e1d47988b291f1214efc4cb
W20260709 13:02:52.199196  9288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33455, user_credentials={real_user=slave}} blocked reactor thread for 58302.9us
I20260709 13:02:52.201025  9753 raft_consensus.cc:2749] T 02048c7b44ac4e8a984dfa44a3b3b3e5 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:52.201026  9322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d75fae153be542ccbf70c92676ffd30d" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57" is_pre_election: true
I20260709 13:02:52.204684  9322 raft_consensus.cc:2393] T d75fae153be542ccbf70c92676ffd30d P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65ed95869fbb4b69b5d6eb99c51adf85 in current term 1: Already voted for candidate 74ac2cf163ee475e8a280cb3aa738f57 in this term.
I20260709 13:02:52.194096  9709 raft_consensus.cc:493] T c500a4c76ad3464aaa2f8985f7d3a53d P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:52.206928  9709 raft_consensus.cc:515] T c500a4c76ad3464aaa2f8985f7d3a53d P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:52.209204  9709 leader_election.cc:290] T c500a4c76ad3464aaa2f8985f7d3a53d P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311), 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351)
I20260709 13:02:52.176579  9739 raft_consensus.cc:2749] T a581cc3c19254d4ca39e1f7328268a93 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:52.212289  9702 consensus_queue.cc:1048] T 76b3d3cd810b46dbac2b534c0be568d2 P 65ed95869fbb4b69b5d6eb99c51adf85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:52.212498  9242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c500a4c76ad3464aaa2f8985f7d3a53d" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d" is_pre_election: true
I20260709 13:02:52.213376  9242 raft_consensus.cc:2468] T c500a4c76ad3464aaa2f8985f7d3a53d P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c694531b0e1d47988b291f1214efc4cb in term 0.
I20260709 13:02:52.216504  9139 leader_election.cc:304] T c500a4c76ad3464aaa2f8985f7d3a53d P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8846d581359a4b7ea6d4c33424ea825d, c694531b0e1d47988b291f1214efc4cb; no voters: 
I20260709 13:02:52.221808  9249 raft_consensus.cc:2468] T c7c964979a0443f68e90c8678d083c96 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c694531b0e1d47988b291f1214efc4cb in term 1.
I20260709 13:02:52.225085  9065 leader_election.cc:304] T d75fae153be542ccbf70c92676ffd30d P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65ed95869fbb4b69b5d6eb99c51adf85; no voters: 74ac2cf163ee475e8a280cb3aa738f57, c694531b0e1d47988b291f1214efc4cb
I20260709 13:02:52.228379  9702 raft_consensus.cc:2749] T d75fae153be542ccbf70c92676ffd30d P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:52.230836  9139 leader_election.cc:304] T c7c964979a0443f68e90c8678d083c96 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8846d581359a4b7ea6d4c33424ea825d, c694531b0e1d47988b291f1214efc4cb; no voters: 65ed95869fbb4b69b5d6eb99c51adf85
I20260709 13:02:52.239856  9741 raft_consensus.cc:2804] T c500a4c76ad3464aaa2f8985f7d3a53d P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:52.240486  9741 raft_consensus.cc:493] T c500a4c76ad3464aaa2f8985f7d3a53d P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:52.240876  9623 raft_consensus.cc:2804] T c7c964979a0443f68e90c8678d083c96 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:52.241601  9623 raft_consensus.cc:697] T c7c964979a0443f68e90c8678d083c96 P c694531b0e1d47988b291f1214efc4cb [term 1 LEADER]: Becoming Leader. State: Replica: c694531b0e1d47988b291f1214efc4cb, State: Running, Role: LEADER
I20260709 13:02:52.243575  9318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c500a4c76ad3464aaa2f8985f7d3a53d" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57" is_pre_election: true
I20260709 13:02:52.246946  9623 consensus_queue.cc:237] T c7c964979a0443f68e90c8678d083c96 P c694531b0e1d47988b291f1214efc4cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:52.240846  9741 raft_consensus.cc:3060] T c500a4c76ad3464aaa2f8985f7d3a53d P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:52.259284  9172 raft_consensus.cc:2468] T d75fae153be542ccbf70c92676ffd30d P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74ac2cf163ee475e8a280cb3aa738f57 in term 1.
I20260709 13:02:52.268513  9371 raft_consensus.cc:359] T c12e80bb348c4ba385ee6ebc8e55d71b P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:52.269629  9371 raft_consensus.cc:385] T c12e80bb348c4ba385ee6ebc8e55d71b P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:52.269893  9371 raft_consensus.cc:740] T c12e80bb348c4ba385ee6ebc8e55d71b P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c694531b0e1d47988b291f1214efc4cb, State: Initialized, Role: FOLLOWER
I20260709 13:02:52.270503  9288 leader_election.cc:304] T d75fae153be542ccbf70c92676ffd30d P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57, c694531b0e1d47988b291f1214efc4cb; no voters: 
I20260709 13:02:52.271569  9595 raft_consensus.cc:2804] T d75fae153be542ccbf70c92676ffd30d P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:52.271835  9372 tablet_bootstrap.cc:492] T c7c964979a0443f68e90c8678d083c96 P 65ed95869fbb4b69b5d6eb99c51adf85: No bootstrap required, opened a new log
I20260709 13:02:52.272068  9595 raft_consensus.cc:697] T d75fae153be542ccbf70c92676ffd30d P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 LEADER]: Becoming Leader. State: Replica: 74ac2cf163ee475e8a280cb3aa738f57, State: Running, Role: LEADER
I20260709 13:02:52.272331  9372 ts_tablet_manager.cc:1403] T c7c964979a0443f68e90c8678d083c96 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent bootstrapping tablet: real 0.259s	user 0.008s	sys 0.006s
I20260709 13:02:52.272974  9702 consensus_queue.cc:1048] T 76b3d3cd810b46dbac2b534c0be568d2 P 65ed95869fbb4b69b5d6eb99c51adf85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:52.275141  9372 raft_consensus.cc:359] T c7c964979a0443f68e90c8678d083c96 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:52.275962  9372 raft_consensus.cc:385] T c7c964979a0443f68e90c8678d083c96 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:52.276330  9372 raft_consensus.cc:740] T c7c964979a0443f68e90c8678d083c96 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Initialized, Role: FOLLOWER
I20260709 13:02:52.277062  9372 consensus_queue.cc:260] T c7c964979a0443f68e90c8678d083c96 P 65ed95869fbb4b69b5d6eb99c51adf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:52.278618  9595 consensus_queue.cc:237] T d75fae153be542ccbf70c92676ffd30d P 74ac2cf163ee475e8a280cb3aa738f57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:52.279507  9372 ts_tablet_manager.cc:1434] T c7c964979a0443f68e90c8678d083c96 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:02:52.285140  9369 tablet_bootstrap.cc:492] T ac928b0582c745b4804afcd30e861439 P 8846d581359a4b7ea6d4c33424ea825d: No bootstrap required, opened a new log
I20260709 13:02:52.285719  9369 ts_tablet_manager.cc:1403] T ac928b0582c745b4804afcd30e861439 P 8846d581359a4b7ea6d4c33424ea825d: Time spent bootstrapping tablet: real 0.282s	user 0.018s	sys 0.036s
I20260709 13:02:52.288525  9371 consensus_queue.cc:260] T c12e80bb348c4ba385ee6ebc8e55d71b P c694531b0e1d47988b291f1214efc4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:52.294783  9369 raft_consensus.cc:359] T ac928b0582c745b4804afcd30e861439 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:52.295666  9369 raft_consensus.cc:385] T ac928b0582c745b4804afcd30e861439 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:52.296012  9369 raft_consensus.cc:740] T ac928b0582c745b4804afcd30e861439 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8846d581359a4b7ea6d4c33424ea825d, State: Initialized, Role: FOLLOWER
I20260709 13:02:52.296768  9369 consensus_queue.cc:260] T ac928b0582c745b4804afcd30e861439 P 8846d581359a4b7ea6d4c33424ea825d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:52.300451  9369 ts_tablet_manager.cc:1434] T ac928b0582c745b4804afcd30e861439 P 8846d581359a4b7ea6d4c33424ea825d: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260709 13:02:52.309140  9370 tablet_bootstrap.cc:492] T a581cc3c19254d4ca39e1f7328268a93 P 74ac2cf163ee475e8a280cb3aa738f57: No bootstrap required, opened a new log
I20260709 13:02:52.309703  9370 ts_tablet_manager.cc:1403] T a581cc3c19254d4ca39e1f7328268a93 P 74ac2cf163ee475e8a280cb3aa738f57: Time spent bootstrapping tablet: real 0.347s	user 0.007s	sys 0.020s
I20260709 13:02:52.309862  8997 catalog_manager.cc:5697] T 7f278d22c55747ee8ee613bfa5c59391 P 65ed95869fbb4b69b5d6eb99c51adf85 reported cstate change: term changed from 0 to 1, leader changed from <none> to 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:52.312625  9370 raft_consensus.cc:359] T a581cc3c19254d4ca39e1f7328268a93 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:52.315508  9370 raft_consensus.cc:385] T a581cc3c19254d4ca39e1f7328268a93 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:52.315802  9370 raft_consensus.cc:740] T a581cc3c19254d4ca39e1f7328268a93 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74ac2cf163ee475e8a280cb3aa738f57, State: Initialized, Role: FOLLOWER
I20260709 13:02:52.316540  9370 consensus_queue.cc:260] T a581cc3c19254d4ca39e1f7328268a93 P 74ac2cf163ee475e8a280cb3aa738f57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:52.320534  9370 ts_tablet_manager.cc:1434] T a581cc3c19254d4ca39e1f7328268a93 P 74ac2cf163ee475e8a280cb3aa738f57: Time spent starting tablet: real 0.011s	user 0.000s	sys 0.008s
I20260709 13:02:52.323325  9372 tablet_bootstrap.cc:492] T 6007c141b1134cb18ab1200556127236 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap starting.
I20260709 13:02:52.321836  9736 raft_consensus.cc:493] T c7c964979a0443f68e90c8678d083c96 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:52.327371  9736 raft_consensus.cc:515] T c7c964979a0443f68e90c8678d083c96 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:52.329751  9736 leader_election.cc:290] T c7c964979a0443f68e90c8678d083c96 P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455), 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311)
W20260709 13:02:52.332826  9141 leader_election.cc:343] T c500a4c76ad3464aaa2f8985f7d3a53d P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:52.331295  9371 ts_tablet_manager.cc:1434] T c12e80bb348c4ba385ee6ebc8e55d71b P c694531b0e1d47988b291f1214efc4cb: Time spent starting tablet: real 0.139s	user 0.014s	sys 0.014s
I20260709 13:02:52.331489  9248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c964979a0443f68e90c8678d083c96" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d" is_pre_election: true
I20260709 13:02:52.335963  9371 tablet_bootstrap.cc:492] T 18df0aeb35ec4bb095806227d9bb97a8 P c694531b0e1d47988b291f1214efc4cb: Bootstrap starting.
I20260709 13:02:52.336709  9248 raft_consensus.cc:2393] T c7c964979a0443f68e90c8678d083c96 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65ed95869fbb4b69b5d6eb99c51adf85 in current term 1: Already voted for candidate c694531b0e1d47988b291f1214efc4cb in this term.
I20260709 13:02:52.339267  9370 tablet_bootstrap.cc:492] T 534ae119bf014235a99dfbbfcff690e1 P 74ac2cf163ee475e8a280cb3aa738f57: Bootstrap starting.
I20260709 13:02:52.339764  9175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c964979a0443f68e90c8678d083c96" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694531b0e1d47988b291f1214efc4cb" is_pre_election: true
I20260709 13:02:52.352840  9065 leader_election.cc:304] T c7c964979a0443f68e90c8678d083c96 P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65ed95869fbb4b69b5d6eb99c51adf85; no voters: 8846d581359a4b7ea6d4c33424ea825d, c694531b0e1d47988b291f1214efc4cb
I20260709 13:02:52.354157  9702 raft_consensus.cc:3060] T c7c964979a0443f68e90c8678d083c96 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:52.356385  9741 raft_consensus.cc:515] T c500a4c76ad3464aaa2f8985f7d3a53d P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:52.358628  9741 leader_election.cc:290] T c500a4c76ad3464aaa2f8985f7d3a53d P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 election: Requested vote from peers 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311), 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351)
I20260709 13:02:52.358836  9369 tablet_bootstrap.cc:492] T 070a6f2020a1483381e2baa75e5c0cbf P 8846d581359a4b7ea6d4c33424ea825d: Bootstrap starting.
I20260709 13:02:52.363152  9322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c500a4c76ad3464aaa2f8985f7d3a53d" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57"
I20260709 13:02:52.361061  9249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c500a4c76ad3464aaa2f8985f7d3a53d" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d"
I20260709 13:02:52.365175  9249 raft_consensus.cc:3060] T c500a4c76ad3464aaa2f8985f7d3a53d P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:52.368161  8995 catalog_manager.cc:5697] T d75fae153be542ccbf70c92676ffd30d P 74ac2cf163ee475e8a280cb3aa738f57 reported cstate change: term changed from 0 to 1, leader changed from <none> to 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "74ac2cf163ee475e8a280cb3aa738f57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:52.368790  9702 raft_consensus.cc:2749] T c7c964979a0443f68e90c8678d083c96 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:52.374066  9249 raft_consensus.cc:2468] T c500a4c76ad3464aaa2f8985f7d3a53d P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c694531b0e1d47988b291f1214efc4cb in term 1.
W20260709 13:02:52.375564  9141 leader_election.cc:343] T c500a4c76ad3464aaa2f8985f7d3a53d P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:52.376869  9371 tablet_bootstrap.cc:654] T 18df0aeb35ec4bb095806227d9bb97a8 P c694531b0e1d47988b291f1214efc4cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:52.377861  9372 tablet_bootstrap.cc:654] T 6007c141b1134cb18ab1200556127236 P 65ed95869fbb4b69b5d6eb99c51adf85: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:52.379884  9139 leader_election.cc:304] T c500a4c76ad3464aaa2f8985f7d3a53d P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8846d581359a4b7ea6d4c33424ea825d, c694531b0e1d47988b291f1214efc4cb; no voters: 74ac2cf163ee475e8a280cb3aa738f57
I20260709 13:02:52.381413  9741 raft_consensus.cc:2804] T c500a4c76ad3464aaa2f8985f7d3a53d P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:52.382177  9741 raft_consensus.cc:697] T c500a4c76ad3464aaa2f8985f7d3a53d P c694531b0e1d47988b291f1214efc4cb [term 1 LEADER]: Becoming Leader. State: Replica: c694531b0e1d47988b291f1214efc4cb, State: Running, Role: LEADER
I20260709 13:02:52.383113  9741 consensus_queue.cc:237] T c500a4c76ad3464aaa2f8985f7d3a53d P c694531b0e1d47988b291f1214efc4cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:52.385365  9369 tablet_bootstrap.cc:654] T 070a6f2020a1483381e2baa75e5c0cbf P 8846d581359a4b7ea6d4c33424ea825d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:52.389999  9623 raft_consensus.cc:493] T c12e80bb348c4ba385ee6ebc8e55d71b P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:52.390698  9623 raft_consensus.cc:515] T c12e80bb348c4ba385ee6ebc8e55d71b P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:52.393477  9623 leader_election.cc:290] T c12e80bb348c4ba385ee6ebc8e55d71b P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979), 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311)
I20260709 13:02:52.393558  9370 tablet_bootstrap.cc:654] T 534ae119bf014235a99dfbbfcff690e1 P 74ac2cf163ee475e8a280cb3aa738f57: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:52.403009  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12e80bb348c4ba385ee6ebc8e55d71b" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" is_pre_election: true
I20260709 13:02:52.403854  9369 tablet_bootstrap.cc:492] T 070a6f2020a1483381e2baa75e5c0cbf P 8846d581359a4b7ea6d4c33424ea825d: No bootstrap required, opened a new log
I20260709 13:02:52.404394  9369 ts_tablet_manager.cc:1403] T 070a6f2020a1483381e2baa75e5c0cbf P 8846d581359a4b7ea6d4c33424ea825d: Time spent bootstrapping tablet: real 0.059s	user 0.006s	sys 0.004s
W20260709 13:02:52.404469  9141 leader_election.cc:343] T c12e80bb348c4ba385ee6ebc8e55d71b P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:52.407838  9369 raft_consensus.cc:359] T 070a6f2020a1483381e2baa75e5c0cbf P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:52.408514  9369 raft_consensus.cc:385] T 070a6f2020a1483381e2baa75e5c0cbf P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:52.408774  9369 raft_consensus.cc:740] T 070a6f2020a1483381e2baa75e5c0cbf P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8846d581359a4b7ea6d4c33424ea825d, State: Initialized, Role: FOLLOWER
I20260709 13:02:52.409503  9369 consensus_queue.cc:260] T 070a6f2020a1483381e2baa75e5c0cbf P 8846d581359a4b7ea6d4c33424ea825d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:52.410815  9250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12e80bb348c4ba385ee6ebc8e55d71b" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d" is_pre_election: true
I20260709 13:02:52.411516  9250 raft_consensus.cc:2468] T c12e80bb348c4ba385ee6ebc8e55d71b P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c694531b0e1d47988b291f1214efc4cb in term 0.
I20260709 13:02:52.412623  9139 leader_election.cc:304] T c12e80bb348c4ba385ee6ebc8e55d71b P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8846d581359a4b7ea6d4c33424ea825d, c694531b0e1d47988b291f1214efc4cb; no voters: 65ed95869fbb4b69b5d6eb99c51adf85
I20260709 13:02:52.414837  9654 raft_consensus.cc:2804] T c12e80bb348c4ba385ee6ebc8e55d71b P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:52.415203  9654 raft_consensus.cc:493] T c12e80bb348c4ba385ee6ebc8e55d71b P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:52.415529  9654 raft_consensus.cc:3060] T c12e80bb348c4ba385ee6ebc8e55d71b P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:52.428140  9654 raft_consensus.cc:515] T c12e80bb348c4ba385ee6ebc8e55d71b P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:52.430939  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12e80bb348c4ba385ee6ebc8e55d71b" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85"
W20260709 13:02:52.432677  9141 leader_election.cc:343] T c12e80bb348c4ba385ee6ebc8e55d71b P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:52.419811  8996 catalog_manager.cc:5697] T 02048c7b44ac4e8a984dfa44a3b3b3e5 P c694531b0e1d47988b291f1214efc4cb reported cstate change: term changed from 0 to 1, leader changed from <none> to c694531b0e1d47988b291f1214efc4cb (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c694531b0e1d47988b291f1214efc4cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:52.454916  9743 raft_consensus.cc:493] T a581cc3c19254d4ca39e1f7328268a93 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:52.455466  9743 raft_consensus.cc:515] T a581cc3c19254d4ca39e1f7328268a93 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:52.457530  9743 leader_election.cc:290] T a581cc3c19254d4ca39e1f7328268a93 P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455), 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311)
I20260709 13:02:52.460218  8996 catalog_manager.cc:5697] T c7c964979a0443f68e90c8678d083c96 P c694531b0e1d47988b291f1214efc4cb reported cstate change: term changed from 0 to 1, leader changed from <none> to c694531b0e1d47988b291f1214efc4cb (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c694531b0e1d47988b291f1214efc4cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:52.473088  9175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a581cc3c19254d4ca39e1f7328268a93" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694531b0e1d47988b291f1214efc4cb" is_pre_election: true
I20260709 13:02:52.480172  9250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a581cc3c19254d4ca39e1f7328268a93" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d" is_pre_election: true
I20260709 13:02:52.481016  9250 raft_consensus.cc:2468] T a581cc3c19254d4ca39e1f7328268a93 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74ac2cf163ee475e8a280cb3aa738f57 in term 0.
I20260709 13:02:52.481508  9654 leader_election.cc:290] T c12e80bb348c4ba385ee6ebc8e55d71b P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 election: Requested vote from peers 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979), 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311)
I20260709 13:02:52.484750  9249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12e80bb348c4ba385ee6ebc8e55d71b" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d"
I20260709 13:02:52.485431  9249 raft_consensus.cc:3060] T c12e80bb348c4ba385ee6ebc8e55d71b P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:52.485049  9288 leader_election.cc:343] T a581cc3c19254d4ca39e1f7328268a93 P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:52.500636  9287 leader_election.cc:304] T a581cc3c19254d4ca39e1f7328268a93 P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57, 8846d581359a4b7ea6d4c33424ea825d; no voters: c694531b0e1d47988b291f1214efc4cb
I20260709 13:02:52.502921  9743 raft_consensus.cc:2804] T a581cc3c19254d4ca39e1f7328268a93 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:52.503321  9743 raft_consensus.cc:493] T a581cc3c19254d4ca39e1f7328268a93 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:52.503639  9743 raft_consensus.cc:3060] T a581cc3c19254d4ca39e1f7328268a93 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:52.504142  9370 tablet_bootstrap.cc:492] T 534ae119bf014235a99dfbbfcff690e1 P 74ac2cf163ee475e8a280cb3aa738f57: No bootstrap required, opened a new log
I20260709 13:02:52.504665  9370 ts_tablet_manager.cc:1403] T 534ae119bf014235a99dfbbfcff690e1 P 74ac2cf163ee475e8a280cb3aa738f57: Time spent bootstrapping tablet: real 0.170s	user 0.008s	sys 0.021s
I20260709 13:02:52.508924  9370 raft_consensus.cc:359] T 534ae119bf014235a99dfbbfcff690e1 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:52.509593  9370 raft_consensus.cc:385] T 534ae119bf014235a99dfbbfcff690e1 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:52.509866  9370 raft_consensus.cc:740] T 534ae119bf014235a99dfbbfcff690e1 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74ac2cf163ee475e8a280cb3aa738f57, State: Initialized, Role: FOLLOWER
I20260709 13:02:52.512411  9370 consensus_queue.cc:260] T 534ae119bf014235a99dfbbfcff690e1 P 74ac2cf163ee475e8a280cb3aa738f57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:52.514103  9371 tablet_bootstrap.cc:492] T 18df0aeb35ec4bb095806227d9bb97a8 P c694531b0e1d47988b291f1214efc4cb: No bootstrap required, opened a new log
I20260709 13:02:52.514549  9370 ts_tablet_manager.cc:1434] T 534ae119bf014235a99dfbbfcff690e1 P 74ac2cf163ee475e8a280cb3aa738f57: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 13:02:52.516872  9372 tablet_bootstrap.cc:492] T 6007c141b1134cb18ab1200556127236 P 65ed95869fbb4b69b5d6eb99c51adf85: No bootstrap required, opened a new log
I20260709 13:02:52.517388  9372 ts_tablet_manager.cc:1403] T 6007c141b1134cb18ab1200556127236 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent bootstrapping tablet: real 0.196s	user 0.045s	sys 0.030s
I20260709 13:02:52.518627  8995 catalog_manager.cc:5697] T c500a4c76ad3464aaa2f8985f7d3a53d P c694531b0e1d47988b291f1214efc4cb reported cstate change: term changed from 0 to 1, leader changed from <none> to c694531b0e1d47988b291f1214efc4cb (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c694531b0e1d47988b291f1214efc4cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:52.520007  9372 raft_consensus.cc:359] T 6007c141b1134cb18ab1200556127236 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:52.520684  9372 raft_consensus.cc:385] T 6007c141b1134cb18ab1200556127236 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:52.520938  9372 raft_consensus.cc:740] T 6007c141b1134cb18ab1200556127236 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Initialized, Role: FOLLOWER
I20260709 13:02:52.514676  9371 ts_tablet_manager.cc:1403] T 18df0aeb35ec4bb095806227d9bb97a8 P c694531b0e1d47988b291f1214efc4cb: Time spent bootstrapping tablet: real 0.179s	user 0.010s	sys 0.004s
I20260709 13:02:52.524268  9370 tablet_bootstrap.cc:492] T 18df0aeb35ec4bb095806227d9bb97a8 P 74ac2cf163ee475e8a280cb3aa738f57: Bootstrap starting.
I20260709 13:02:52.525048  9371 raft_consensus.cc:359] T 18df0aeb35ec4bb095806227d9bb97a8 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:52.525722  9371 raft_consensus.cc:385] T 18df0aeb35ec4bb095806227d9bb97a8 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:52.525908  9371 raft_consensus.cc:740] T 18df0aeb35ec4bb095806227d9bb97a8 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c694531b0e1d47988b291f1214efc4cb, State: Initialized, Role: FOLLOWER
I20260709 13:02:52.530009  9370 tablet_bootstrap.cc:654] T 18df0aeb35ec4bb095806227d9bb97a8 P 74ac2cf163ee475e8a280cb3aa738f57: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:52.530943  9372 consensus_queue.cc:260] T 6007c141b1134cb18ab1200556127236 P 65ed95869fbb4b69b5d6eb99c51adf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:52.526503  9371 consensus_queue.cc:260] T 18df0aeb35ec4bb095806227d9bb97a8 P c694531b0e1d47988b291f1214efc4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:52.534228  9372 ts_tablet_manager.cc:1434] T 6007c141b1134cb18ab1200556127236 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.001s
I20260709 13:02:52.534171  9371 ts_tablet_manager.cc:1434] T 18df0aeb35ec4bb095806227d9bb97a8 P c694531b0e1d47988b291f1214efc4cb: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:02:52.536585  9371 tablet_bootstrap.cc:492] T e2fbc9c2c0a947f1b4a078db7c8402d0 P c694531b0e1d47988b291f1214efc4cb: Bootstrap starting.
I20260709 13:02:52.535385  9249 raft_consensus.cc:2468] T c12e80bb348c4ba385ee6ebc8e55d71b P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c694531b0e1d47988b291f1214efc4cb in term 1.
I20260709 13:02:52.539417  9743 raft_consensus.cc:515] T a581cc3c19254d4ca39e1f7328268a93 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:52.539376  9139 leader_election.cc:304] T c12e80bb348c4ba385ee6ebc8e55d71b P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8846d581359a4b7ea6d4c33424ea825d, c694531b0e1d47988b291f1214efc4cb; no voters: 65ed95869fbb4b69b5d6eb99c51adf85
I20260709 13:02:52.543638  9654 raft_consensus.cc:2804] T c12e80bb348c4ba385ee6ebc8e55d71b P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:52.544170  9654 raft_consensus.cc:697] T c12e80bb348c4ba385ee6ebc8e55d71b P c694531b0e1d47988b291f1214efc4cb [term 1 LEADER]: Becoming Leader. State: Replica: c694531b0e1d47988b291f1214efc4cb, State: Running, Role: LEADER
I20260709 13:02:52.545038  9654 consensus_queue.cc:237] T c12e80bb348c4ba385ee6ebc8e55d71b P c694531b0e1d47988b291f1214efc4cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:52.551791  9371 tablet_bootstrap.cc:654] T e2fbc9c2c0a947f1b4a078db7c8402d0 P c694531b0e1d47988b291f1214efc4cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:52.540416  9369 ts_tablet_manager.cc:1434] T 070a6f2020a1483381e2baa75e5c0cbf P 8846d581359a4b7ea6d4c33424ea825d: Time spent starting tablet: real 0.136s	user 0.008s	sys 0.000s
I20260709 13:02:52.541440  9372 tablet_bootstrap.cc:492] T 18df0aeb35ec4bb095806227d9bb97a8 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap starting.
I20260709 13:02:52.562642  9175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a581cc3c19254d4ca39e1f7328268a93" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694531b0e1d47988b291f1214efc4cb"
I20260709 13:02:52.563414  9371 tablet_bootstrap.cc:492] T e2fbc9c2c0a947f1b4a078db7c8402d0 P c694531b0e1d47988b291f1214efc4cb: No bootstrap required, opened a new log
I20260709 13:02:52.563966  9371 ts_tablet_manager.cc:1403] T e2fbc9c2c0a947f1b4a078db7c8402d0 P c694531b0e1d47988b291f1214efc4cb: Time spent bootstrapping tablet: real 0.028s	user 0.007s	sys 0.009s
I20260709 13:02:52.564759  9474 consensus_queue.cc:1048] T 02048c7b44ac4e8a984dfa44a3b3b3e5 P c694531b0e1d47988b291f1214efc4cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:52.563997  9743 leader_election.cc:290] T a581cc3c19254d4ca39e1f7328268a93 P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 election: Requested vote from peers c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455), 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311)
I20260709 13:02:52.572408  9372 tablet_bootstrap.cc:654] T 18df0aeb35ec4bb095806227d9bb97a8 P 65ed95869fbb4b69b5d6eb99c51adf85: Neither blocks nor log segments found. Creating new log.
W20260709 13:02:52.578047  9288 leader_election.cc:343] T a581cc3c19254d4ca39e1f7328268a93 P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:52.574280  9249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a581cc3c19254d4ca39e1f7328268a93" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d"
I20260709 13:02:52.580705  9249 raft_consensus.cc:3060] T a581cc3c19254d4ca39e1f7328268a93 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:52.592681  9249 raft_consensus.cc:2468] T a581cc3c19254d4ca39e1f7328268a93 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74ac2cf163ee475e8a280cb3aa738f57 in term 1.
I20260709 13:02:52.595516  9370 tablet_bootstrap.cc:492] T 18df0aeb35ec4bb095806227d9bb97a8 P 74ac2cf163ee475e8a280cb3aa738f57: No bootstrap required, opened a new log
I20260709 13:02:52.596057  9370 ts_tablet_manager.cc:1403] T 18df0aeb35ec4bb095806227d9bb97a8 P 74ac2cf163ee475e8a280cb3aa738f57: Time spent bootstrapping tablet: real 0.072s	user 0.010s	sys 0.010s
I20260709 13:02:52.597043  9287 leader_election.cc:304] T a581cc3c19254d4ca39e1f7328268a93 P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57, 8846d581359a4b7ea6d4c33424ea825d; no voters: c694531b0e1d47988b291f1214efc4cb
I20260709 13:02:52.598248  9743 raft_consensus.cc:2804] T a581cc3c19254d4ca39e1f7328268a93 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:52.598758  9743 raft_consensus.cc:697] T a581cc3c19254d4ca39e1f7328268a93 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 LEADER]: Becoming Leader. State: Replica: 74ac2cf163ee475e8a280cb3aa738f57, State: Running, Role: LEADER
I20260709 13:02:52.599644  9743 consensus_queue.cc:237] T a581cc3c19254d4ca39e1f7328268a93 P 74ac2cf163ee475e8a280cb3aa738f57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:52.607372  9654 consensus_queue.cc:1048] T 02048c7b44ac4e8a984dfa44a3b3b3e5 P c694531b0e1d47988b291f1214efc4cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:52.607424  9370 raft_consensus.cc:359] T 18df0aeb35ec4bb095806227d9bb97a8 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:52.608283  9370 raft_consensus.cc:385] T 18df0aeb35ec4bb095806227d9bb97a8 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:52.608565  9370 raft_consensus.cc:740] T 18df0aeb35ec4bb095806227d9bb97a8 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74ac2cf163ee475e8a280cb3aa738f57, State: Initialized, Role: FOLLOWER
I20260709 13:02:52.609395  9370 consensus_queue.cc:260] T 18df0aeb35ec4bb095806227d9bb97a8 P 74ac2cf163ee475e8a280cb3aa738f57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:52.611922  9371 raft_consensus.cc:359] T e2fbc9c2c0a947f1b4a078db7c8402d0 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:52.612684  9371 raft_consensus.cc:385] T e2fbc9c2c0a947f1b4a078db7c8402d0 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:52.612941  9371 raft_consensus.cc:740] T e2fbc9c2c0a947f1b4a078db7c8402d0 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c694531b0e1d47988b291f1214efc4cb, State: Initialized, Role: FOLLOWER
I20260709 13:02:52.615036  9654 raft_consensus.cc:493] T 18df0aeb35ec4bb095806227d9bb97a8 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:52.615613  9654 raft_consensus.cc:515] T 18df0aeb35ec4bb095806227d9bb97a8 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:52.614061  8995 catalog_manager.cc:5697] T c12e80bb348c4ba385ee6ebc8e55d71b P c694531b0e1d47988b291f1214efc4cb reported cstate change: term changed from 0 to 1, leader changed from <none> to c694531b0e1d47988b291f1214efc4cb (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c694531b0e1d47988b291f1214efc4cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:52.618022  9654 leader_election.cc:290] T 18df0aeb35ec4bb095806227d9bb97a8 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351), 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979)
I20260709 13:02:52.619035  9324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18df0aeb35ec4bb095806227d9bb97a8" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57" is_pre_election: true
I20260709 13:02:52.619717  9324 raft_consensus.cc:2468] T 18df0aeb35ec4bb095806227d9bb97a8 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c694531b0e1d47988b291f1214efc4cb in term 0.
I20260709 13:02:52.620513  9370 ts_tablet_manager.cc:1434] T 18df0aeb35ec4bb095806227d9bb97a8 P 74ac2cf163ee475e8a280cb3aa738f57: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 13:02:52.620988  9141 leader_election.cc:304] T 18df0aeb35ec4bb095806227d9bb97a8 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57, c694531b0e1d47988b291f1214efc4cb; no voters: 
I20260709 13:02:52.622242  9654 raft_consensus.cc:2804] T 18df0aeb35ec4bb095806227d9bb97a8 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:52.622592  9654 raft_consensus.cc:493] T 18df0aeb35ec4bb095806227d9bb97a8 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:52.622947  9654 raft_consensus.cc:3060] T 18df0aeb35ec4bb095806227d9bb97a8 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:52.624011  9371 consensus_queue.cc:260] T e2fbc9c2c0a947f1b4a078db7c8402d0 P c694531b0e1d47988b291f1214efc4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:52.624531  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18df0aeb35ec4bb095806227d9bb97a8" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" is_pre_election: true
W20260709 13:02:52.626073  9141 leader_election.cc:343] T 18df0aeb35ec4bb095806227d9bb97a8 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:52.626801  9481 raft_consensus.cc:493] T 070a6f2020a1483381e2baa75e5c0cbf P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:52.627285  9481 raft_consensus.cc:515] T 070a6f2020a1483381e2baa75e5c0cbf P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:52.629276  9481 leader_election.cc:290] T 070a6f2020a1483381e2baa75e5c0cbf P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979), c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455)
I20260709 13:02:52.630764  9372 tablet_bootstrap.cc:492] T 18df0aeb35ec4bb095806227d9bb97a8 P 65ed95869fbb4b69b5d6eb99c51adf85: No bootstrap required, opened a new log
I20260709 13:02:52.631353  9372 ts_tablet_manager.cc:1403] T 18df0aeb35ec4bb095806227d9bb97a8 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent bootstrapping tablet: real 0.090s	user 0.015s	sys 0.005s
I20260709 13:02:52.633283  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070a6f2020a1483381e2baa75e5c0cbf" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" is_pre_election: true
I20260709 13:02:52.633558  9175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070a6f2020a1483381e2baa75e5c0cbf" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694531b0e1d47988b291f1214efc4cb" is_pre_election: true
I20260709 13:02:52.634059  9654 raft_consensus.cc:515] T 18df0aeb35ec4bb095806227d9bb97a8 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:52.634358  9372 raft_consensus.cc:359] T 18df0aeb35ec4bb095806227d9bb97a8 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
W20260709 13:02:52.634765  9215 leader_election.cc:343] T 070a6f2020a1483381e2baa75e5c0cbf P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:52.635506  9214 leader_election.cc:343] T 070a6f2020a1483381e2baa75e5c0cbf P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:52.635924  9214 leader_election.cc:304] T 070a6f2020a1483381e2baa75e5c0cbf P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8846d581359a4b7ea6d4c33424ea825d; no voters: 65ed95869fbb4b69b5d6eb99c51adf85, c694531b0e1d47988b291f1214efc4cb
I20260709 13:02:52.636269  9654 leader_election.cc:290] T 18df0aeb35ec4bb095806227d9bb97a8 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 election: Requested vote from peers 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351), 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979)
I20260709 13:02:52.635178  9372 raft_consensus.cc:385] T 18df0aeb35ec4bb095806227d9bb97a8 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:52.639276  9372 raft_consensus.cc:740] T 18df0aeb35ec4bb095806227d9bb97a8 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Initialized, Role: FOLLOWER
I20260709 13:02:52.641649  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18df0aeb35ec4bb095806227d9bb97a8" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85"
I20260709 13:02:52.638609  9409 raft_consensus.cc:2749] T 070a6f2020a1483381e2baa75e5c0cbf P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:52.642297  9738 raft_consensus.cc:493] T e2fbc9c2c0a947f1b4a078db7c8402d0 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:52.642782  9738 raft_consensus.cc:515] T e2fbc9c2c0a947f1b4a078db7c8402d0 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:52.641825  9319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18df0aeb35ec4bb095806227d9bb97a8" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57"
I20260709 13:02:52.644506  9319 raft_consensus.cc:3060] T 18df0aeb35ec4bb095806227d9bb97a8 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:52.628026  9370 tablet_bootstrap.cc:492] T ac928b0582c745b4804afcd30e861439 P 74ac2cf163ee475e8a280cb3aa738f57: Bootstrap starting.
I20260709 13:02:52.647267  9738 leader_election.cc:290] T e2fbc9c2c0a947f1b4a078db7c8402d0 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351), 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979)
I20260709 13:02:52.647995  9371 ts_tablet_manager.cc:1434] T e2fbc9c2c0a947f1b4a078db7c8402d0 P c694531b0e1d47988b291f1214efc4cb: Time spent starting tablet: real 0.084s	user 0.006s	sys 0.000s
I20260709 13:02:52.640074  9372 consensus_queue.cc:260] T 18df0aeb35ec4bb095806227d9bb97a8 P 65ed95869fbb4b69b5d6eb99c51adf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:52.654182  9324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fbc9c2c0a947f1b4a078db7c8402d0" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57" is_pre_election: true
I20260709 13:02:52.654955  9324 raft_consensus.cc:2468] T e2fbc9c2c0a947f1b4a078db7c8402d0 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c694531b0e1d47988b291f1214efc4cb in term 0.
I20260709 13:02:52.657342  9319 raft_consensus.cc:2468] T 18df0aeb35ec4bb095806227d9bb97a8 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c694531b0e1d47988b291f1214efc4cb in term 1.
I20260709 13:02:52.660683  9371 tablet_bootstrap.cc:492] T a581cc3c19254d4ca39e1f7328268a93 P c694531b0e1d47988b291f1214efc4cb: Bootstrap starting.
I20260709 13:02:52.667148  8995 catalog_manager.cc:5697] T a581cc3c19254d4ca39e1f7328268a93 P 74ac2cf163ee475e8a280cb3aa738f57 reported cstate change: term changed from 0 to 1, leader changed from <none> to 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "74ac2cf163ee475e8a280cb3aa738f57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:52.663524  9372 ts_tablet_manager.cc:1434] T 18df0aeb35ec4bb095806227d9bb97a8 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.000s
I20260709 13:02:52.657550  9101 raft_consensus.cc:3060] T 18df0aeb35ec4bb095806227d9bb97a8 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:52.671599  9372 tablet_bootstrap.cc:492] T 534ae119bf014235a99dfbbfcff690e1 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap starting.
I20260709 13:02:52.672610  9371 tablet_bootstrap.cc:654] T a581cc3c19254d4ca39e1f7328268a93 P c694531b0e1d47988b291f1214efc4cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:52.666215  9370 tablet_bootstrap.cc:654] T ac928b0582c745b4804afcd30e861439 P 74ac2cf163ee475e8a280cb3aa738f57: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:52.669914  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fbc9c2c0a947f1b4a078db7c8402d0" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" is_pre_election: true
I20260709 13:02:52.678193  9372 tablet_bootstrap.cc:654] T 534ae119bf014235a99dfbbfcff690e1 P 65ed95869fbb4b69b5d6eb99c51adf85: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:52.681619  9371 tablet_bootstrap.cc:492] T a581cc3c19254d4ca39e1f7328268a93 P c694531b0e1d47988b291f1214efc4cb: No bootstrap required, opened a new log
I20260709 13:02:52.682027  9371 ts_tablet_manager.cc:1403] T a581cc3c19254d4ca39e1f7328268a93 P c694531b0e1d47988b291f1214efc4cb: Time spent bootstrapping tablet: real 0.022s	user 0.007s	sys 0.002s
I20260709 13:02:52.683516  9372 tablet_bootstrap.cc:492] T 534ae119bf014235a99dfbbfcff690e1 P 65ed95869fbb4b69b5d6eb99c51adf85: No bootstrap required, opened a new log
W20260709 13:02:52.685070  9141 leader_election.cc:343] T e2fbc9c2c0a947f1b4a078db7c8402d0 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:52.687889  9141 leader_election.cc:304] T e2fbc9c2c0a947f1b4a078db7c8402d0 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57, c694531b0e1d47988b291f1214efc4cb; no voters: 65ed95869fbb4b69b5d6eb99c51adf85
I20260709 13:02:52.687853  9371 raft_consensus.cc:359] T a581cc3c19254d4ca39e1f7328268a93 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:52.688271  9101 raft_consensus.cc:2468] T 18df0aeb35ec4bb095806227d9bb97a8 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c694531b0e1d47988b291f1214efc4cb in term 1.
I20260709 13:02:52.685966  9372 ts_tablet_manager.cc:1403] T 534ae119bf014235a99dfbbfcff690e1 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent bootstrapping tablet: real 0.015s	user 0.011s	sys 0.001s
I20260709 13:02:52.690050  9141 leader_election.cc:304] T 18df0aeb35ec4bb095806227d9bb97a8 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57, c694531b0e1d47988b291f1214efc4cb; no voters: 
I20260709 13:02:52.688835  9738 raft_consensus.cc:2804] T e2fbc9c2c0a947f1b4a078db7c8402d0 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:52.688719  9371 raft_consensus.cc:385] T a581cc3c19254d4ca39e1f7328268a93 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:52.691656  9738 raft_consensus.cc:493] T e2fbc9c2c0a947f1b4a078db7c8402d0 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:52.691696  9371 raft_consensus.cc:740] T a581cc3c19254d4ca39e1f7328268a93 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c694531b0e1d47988b291f1214efc4cb, State: Initialized, Role: FOLLOWER
I20260709 13:02:52.692168  9738 raft_consensus.cc:3060] T e2fbc9c2c0a947f1b4a078db7c8402d0 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:52.692695  9371 consensus_queue.cc:260] T a581cc3c19254d4ca39e1f7328268a93 P c694531b0e1d47988b291f1214efc4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:52.692874  9372 raft_consensus.cc:359] T 534ae119bf014235a99dfbbfcff690e1 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:52.699860  9372 raft_consensus.cc:385] T 534ae119bf014235a99dfbbfcff690e1 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:52.700268  9372 raft_consensus.cc:740] T 534ae119bf014235a99dfbbfcff690e1 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Initialized, Role: FOLLOWER
I20260709 13:02:52.702734  9743 consensus_queue.cc:1048] T d75fae153be542ccbf70c92676ffd30d P 74ac2cf163ee475e8a280cb3aa738f57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:52.700994  9372 consensus_queue.cc:260] T 534ae119bf014235a99dfbbfcff690e1 P 65ed95869fbb4b69b5d6eb99c51adf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:52.705601  9654 raft_consensus.cc:2804] T 18df0aeb35ec4bb095806227d9bb97a8 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:52.707050  9654 raft_consensus.cc:697] T 18df0aeb35ec4bb095806227d9bb97a8 P c694531b0e1d47988b291f1214efc4cb [term 1 LEADER]: Becoming Leader. State: Replica: c694531b0e1d47988b291f1214efc4cb, State: Running, Role: LEADER
I20260709 13:02:52.707870  9654 consensus_queue.cc:237] T 18df0aeb35ec4bb095806227d9bb97a8 P c694531b0e1d47988b291f1214efc4cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:52.714385  9738 raft_consensus.cc:515] T e2fbc9c2c0a947f1b4a078db7c8402d0 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:52.719254  9738 leader_election.cc:290] T e2fbc9c2c0a947f1b4a078db7c8402d0 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 election: Requested vote from peers 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351), 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979)
I20260709 13:02:52.717276  9372 ts_tablet_manager.cc:1434] T 534ae119bf014235a99dfbbfcff690e1 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 13:02:52.721745  9372 tablet_bootstrap.cc:492] T 070a6f2020a1483381e2baa75e5c0cbf P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap starting.
I20260709 13:02:52.722138  9736 consensus_queue.cc:1048] T 7f278d22c55747ee8ee613bfa5c59391 P 65ed95869fbb4b69b5d6eb99c51adf85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:52.726866  9736 raft_consensus.cc:493] T 6007c141b1134cb18ab1200556127236 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:52.727380  9736 raft_consensus.cc:515] T 6007c141b1134cb18ab1200556127236 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:52.728811  9371 ts_tablet_manager.cc:1434] T a581cc3c19254d4ca39e1f7328268a93 P c694531b0e1d47988b291f1214efc4cb: Time spent starting tablet: real 0.047s	user 0.007s	sys 0.002s
I20260709 13:02:52.729692  9736 leader_election.cc:290] T 6007c141b1134cb18ab1200556127236 P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455), 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311)
I20260709 13:02:52.730340  9474 consensus_queue.cc:1048] T c7c964979a0443f68e90c8678d083c96 P c694531b0e1d47988b291f1214efc4cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:52.731701  9371 tablet_bootstrap.cc:492] T 070a6f2020a1483381e2baa75e5c0cbf P c694531b0e1d47988b291f1214efc4cb: Bootstrap starting.
I20260709 13:02:52.736580  9249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6007c141b1134cb18ab1200556127236" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d" is_pre_election: true
I20260709 13:02:52.739140  9372 tablet_bootstrap.cc:654] T 070a6f2020a1483381e2baa75e5c0cbf P 65ed95869fbb4b69b5d6eb99c51adf85: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:52.744097  9322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fbc9c2c0a947f1b4a078db7c8402d0" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57"
I20260709 13:02:52.745551  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fbc9c2c0a947f1b4a078db7c8402d0" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85"
I20260709 13:02:52.754360  9173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6007c141b1134cb18ab1200556127236" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694531b0e1d47988b291f1214efc4cb" is_pre_election: true
I20260709 13:02:52.765095  9322 raft_consensus.cc:3060] T e2fbc9c2c0a947f1b4a078db7c8402d0 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:52.768246  9370 tablet_bootstrap.cc:492] T ac928b0582c745b4804afcd30e861439 P 74ac2cf163ee475e8a280cb3aa738f57: No bootstrap required, opened a new log
I20260709 13:02:52.768769  9370 ts_tablet_manager.cc:1403] T ac928b0582c745b4804afcd30e861439 P 74ac2cf163ee475e8a280cb3aa738f57: Time spent bootstrapping tablet: real 0.147s	user 0.006s	sys 0.020s
I20260709 13:02:52.770639  9371 tablet_bootstrap.cc:654] T 070a6f2020a1483381e2baa75e5c0cbf P c694531b0e1d47988b291f1214efc4cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:52.775216  9409 raft_consensus.cc:493] T ac928b0582c745b4804afcd30e861439 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:52.775764  9409 raft_consensus.cc:515] T ac928b0582c745b4804afcd30e861439 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:52.778280  9409 leader_election.cc:290] T ac928b0582c745b4804afcd30e861439 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351), 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979)
I20260709 13:02:52.777132  9370 raft_consensus.cc:359] T ac928b0582c745b4804afcd30e861439 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:52.786641  9370 raft_consensus.cc:385] T ac928b0582c745b4804afcd30e861439 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:52.779749  9097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac928b0582c745b4804afcd30e861439" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" is_pre_election: true
I20260709 13:02:52.787317  9370 raft_consensus.cc:740] T ac928b0582c745b4804afcd30e861439 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74ac2cf163ee475e8a280cb3aa738f57, State: Initialized, Role: FOLLOWER
W20260709 13:02:52.788422  9215 leader_election.cc:343] T ac928b0582c745b4804afcd30e861439 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:52.788357  9370 consensus_queue.cc:260] T ac928b0582c745b4804afcd30e861439 P 74ac2cf163ee475e8a280cb3aa738f57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:52.780365  9319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac928b0582c745b4804afcd30e861439" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57" is_pre_election: true
I20260709 13:02:52.790789  9319 raft_consensus.cc:2468] T ac928b0582c745b4804afcd30e861439 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8846d581359a4b7ea6d4c33424ea825d in term 0.
I20260709 13:02:52.793732  9370 ts_tablet_manager.cc:1434] T ac928b0582c745b4804afcd30e861439 P 74ac2cf163ee475e8a280cb3aa738f57: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.001s
I20260709 13:02:52.795060  9215 leader_election.cc:304] T ac928b0582c745b4804afcd30e861439 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57, 8846d581359a4b7ea6d4c33424ea825d; no voters: 65ed95869fbb4b69b5d6eb99c51adf85
I20260709 13:02:52.795900  9370 tablet_bootstrap.cc:492] T c500a4c76ad3464aaa2f8985f7d3a53d P 74ac2cf163ee475e8a280cb3aa738f57: Bootstrap starting.
I20260709 13:02:52.796218  9409 raft_consensus.cc:2804] T ac928b0582c745b4804afcd30e861439 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:52.796859  9409 raft_consensus.cc:493] T ac928b0582c745b4804afcd30e861439 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:52.797163  9409 raft_consensus.cc:3060] T ac928b0582c745b4804afcd30e861439 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:52.804471  9409 raft_consensus.cc:515] T ac928b0582c745b4804afcd30e861439 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:52.804775  9370 tablet_bootstrap.cc:654] T c500a4c76ad3464aaa2f8985f7d3a53d P 74ac2cf163ee475e8a280cb3aa738f57: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:52.807333  9319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac928b0582c745b4804afcd30e861439" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57"
I20260709 13:02:52.807922  9319 raft_consensus.cc:3060] T ac928b0582c745b4804afcd30e861439 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:52.811954  9702 consensus_queue.cc:1048] T 7f278d22c55747ee8ee613bfa5c59391 P 65ed95869fbb4b69b5d6eb99c51adf85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:52.812002  9371 tablet_bootstrap.cc:492] T 070a6f2020a1483381e2baa75e5c0cbf P c694531b0e1d47988b291f1214efc4cb: No bootstrap required, opened a new log
I20260709 13:02:52.813906  9371 ts_tablet_manager.cc:1403] T 070a6f2020a1483381e2baa75e5c0cbf P c694531b0e1d47988b291f1214efc4cb: Time spent bootstrapping tablet: real 0.083s	user 0.013s	sys 0.002s
I20260709 13:02:52.816697  9371 raft_consensus.cc:359] T 070a6f2020a1483381e2baa75e5c0cbf P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:52.817350  9371 raft_consensus.cc:385] T 070a6f2020a1483381e2baa75e5c0cbf P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:52.817616  9371 raft_consensus.cc:740] T 070a6f2020a1483381e2baa75e5c0cbf P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c694531b0e1d47988b291f1214efc4cb, State: Initialized, Role: FOLLOWER
I20260709 13:02:52.823357  9065 leader_election.cc:304] T 6007c141b1134cb18ab1200556127236 P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65ed95869fbb4b69b5d6eb99c51adf85; no voters: 8846d581359a4b7ea6d4c33424ea825d, c694531b0e1d47988b291f1214efc4cb
I20260709 13:02:52.824497  9736 raft_consensus.cc:2749] T 6007c141b1134cb18ab1200556127236 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:02:52.825980  9141 leader_election.cc:343] T e2fbc9c2c0a947f1b4a078db7c8402d0 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:52.827865  9322 raft_consensus.cc:2468] T e2fbc9c2c0a947f1b4a078db7c8402d0 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c694531b0e1d47988b291f1214efc4cb in term 1.
I20260709 13:02:52.832448  9372 tablet_bootstrap.cc:492] T 070a6f2020a1483381e2baa75e5c0cbf P 65ed95869fbb4b69b5d6eb99c51adf85: No bootstrap required, opened a new log
I20260709 13:02:52.833039  9702 raft_consensus.cc:493] T 534ae119bf014235a99dfbbfcff690e1 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:52.833741  9372 ts_tablet_manager.cc:1403] T 070a6f2020a1483381e2baa75e5c0cbf P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent bootstrapping tablet: real 0.112s	user 0.023s	sys 0.021s
I20260709 13:02:52.833748  9702 raft_consensus.cc:515] T 534ae119bf014235a99dfbbfcff690e1 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:52.837214  9372 raft_consensus.cc:359] T 070a6f2020a1483381e2baa75e5c0cbf P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:52.837929  9372 raft_consensus.cc:385] T 070a6f2020a1483381e2baa75e5c0cbf P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:52.838208  9372 raft_consensus.cc:740] T 070a6f2020a1483381e2baa75e5c0cbf P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Initialized, Role: FOLLOWER
I20260709 13:02:52.839010  9372 consensus_queue.cc:260] T 070a6f2020a1483381e2baa75e5c0cbf P 65ed95869fbb4b69b5d6eb99c51adf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:52.839516  9250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534ae119bf014235a99dfbbfcff690e1" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d" is_pre_election: true
I20260709 13:02:52.840245  9250 raft_consensus.cc:2468] T 534ae119bf014235a99dfbbfcff690e1 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65ed95869fbb4b69b5d6eb99c51adf85 in term 0.
I20260709 13:02:52.841440  9064 leader_election.cc:304] T 534ae119bf014235a99dfbbfcff690e1 P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65ed95869fbb4b69b5d6eb99c51adf85, 8846d581359a4b7ea6d4c33424ea825d; no voters: 
I20260709 13:02:52.841889  9372 ts_tablet_manager.cc:1434] T 070a6f2020a1483381e2baa75e5c0cbf P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:02:52.842299  9701 raft_consensus.cc:2804] T 534ae119bf014235a99dfbbfcff690e1 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:52.842748  9701 raft_consensus.cc:493] T 534ae119bf014235a99dfbbfcff690e1 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:52.842993  9372 tablet_bootstrap.cc:492] T e2fbc9c2c0a947f1b4a078db7c8402d0 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap starting.
I20260709 13:02:52.843061  9701 raft_consensus.cc:3060] T 534ae119bf014235a99dfbbfcff690e1 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:52.847841  9370 tablet_bootstrap.cc:492] T c500a4c76ad3464aaa2f8985f7d3a53d P 74ac2cf163ee475e8a280cb3aa738f57: No bootstrap required, opened a new log
I20260709 13:02:52.848460  9370 ts_tablet_manager.cc:1403] T c500a4c76ad3464aaa2f8985f7d3a53d P 74ac2cf163ee475e8a280cb3aa738f57: Time spent bootstrapping tablet: real 0.053s	user 0.010s	sys 0.009s
I20260709 13:02:52.849705  9372 tablet_bootstrap.cc:654] T e2fbc9c2c0a947f1b4a078db7c8402d0 P 65ed95869fbb4b69b5d6eb99c51adf85: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:52.850464  9594 consensus_queue.cc:1048] T d75fae153be542ccbf70c92676ffd30d P 74ac2cf163ee475e8a280cb3aa738f57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:52.855047  9370 raft_consensus.cc:359] T c500a4c76ad3464aaa2f8985f7d3a53d P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:52.860934  9318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534ae119bf014235a99dfbbfcff690e1" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57" is_pre_election: true
I20260709 13:02:52.861804  9372 tablet_bootstrap.cc:492] T e2fbc9c2c0a947f1b4a078db7c8402d0 P 65ed95869fbb4b69b5d6eb99c51adf85: No bootstrap required, opened a new log
I20260709 13:02:52.862037  9318 raft_consensus.cc:2468] T 534ae119bf014235a99dfbbfcff690e1 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65ed95869fbb4b69b5d6eb99c51adf85 in term 0.
I20260709 13:02:52.862387  9372 ts_tablet_manager.cc:1403] T e2fbc9c2c0a947f1b4a078db7c8402d0 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.005s
I20260709 13:02:52.863138  9370 raft_consensus.cc:385] T c500a4c76ad3464aaa2f8985f7d3a53d P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:52.863518  9370 raft_consensus.cc:740] T c500a4c76ad3464aaa2f8985f7d3a53d P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74ac2cf163ee475e8a280cb3aa738f57, State: Initialized, Role: FOLLOWER
I20260709 13:02:52.864070  9738 consensus_queue.cc:1048] T c7c964979a0443f68e90c8678d083c96 P c694531b0e1d47988b291f1214efc4cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:52.864374  9370 consensus_queue.cc:260] T c500a4c76ad3464aaa2f8985f7d3a53d P 74ac2cf163ee475e8a280cb3aa738f57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:52.866955  9370 ts_tablet_manager.cc:1434] T c500a4c76ad3464aaa2f8985f7d3a53d P 74ac2cf163ee475e8a280cb3aa738f57: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:02:52.866789  9372 raft_consensus.cc:359] T e2fbc9c2c0a947f1b4a078db7c8402d0 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:52.867493  9372 raft_consensus.cc:385] T e2fbc9c2c0a947f1b4a078db7c8402d0 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:52.868255  9370 tablet_bootstrap.cc:492] T 4d2b02247c21448ea824065ad29304e7 P 74ac2cf163ee475e8a280cb3aa738f57: Bootstrap starting.
I20260709 13:02:52.872906  8997 catalog_manager.cc:5697] T 18df0aeb35ec4bb095806227d9bb97a8 P c694531b0e1d47988b291f1214efc4cb reported cstate change: term changed from 0 to 1, leader changed from <none> to c694531b0e1d47988b291f1214efc4cb (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c694531b0e1d47988b291f1214efc4cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:52.867803  9702 leader_election.cc:290] T 534ae119bf014235a99dfbbfcff690e1 P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311), 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351)
I20260709 13:02:52.867162  9141 leader_election.cc:304] T e2fbc9c2c0a947f1b4a078db7c8402d0 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57, c694531b0e1d47988b291f1214efc4cb; no voters: 65ed95869fbb4b69b5d6eb99c51adf85
I20260709 13:02:52.867794  9372 raft_consensus.cc:740] T e2fbc9c2c0a947f1b4a078db7c8402d0 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Initialized, Role: FOLLOWER
I20260709 13:02:52.876267  9741 raft_consensus.cc:2804] T e2fbc9c2c0a947f1b4a078db7c8402d0 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:52.876879  9741 raft_consensus.cc:697] T e2fbc9c2c0a947f1b4a078db7c8402d0 P c694531b0e1d47988b291f1214efc4cb [term 1 LEADER]: Becoming Leader. State: Replica: c694531b0e1d47988b291f1214efc4cb, State: Running, Role: LEADER
I20260709 13:02:52.877381  9372 consensus_queue.cc:260] T e2fbc9c2c0a947f1b4a078db7c8402d0 P 65ed95869fbb4b69b5d6eb99c51adf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:52.877722  9741 consensus_queue.cc:237] T e2fbc9c2c0a947f1b4a078db7c8402d0 P c694531b0e1d47988b291f1214efc4cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:52.885020  9372 ts_tablet_manager.cc:1434] T e2fbc9c2c0a947f1b4a078db7c8402d0 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.001s
I20260709 13:02:52.885766  9370 tablet_bootstrap.cc:654] T 4d2b02247c21448ea824065ad29304e7 P 74ac2cf163ee475e8a280cb3aa738f57: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:52.890280  9372 tablet_bootstrap.cc:492] T c12e80bb348c4ba385ee6ebc8e55d71b P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap starting.
W20260709 13:02:52.891273  9141 consensus_peers.cc:597] T c500a4c76ad3464aaa2f8985f7d3a53d P c694531b0e1d47988b291f1214efc4cb -> Peer 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351): Couldn't send request to peer 74ac2cf163ee475e8a280cb3aa738f57. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:52.896608  9372 tablet_bootstrap.cc:654] T c12e80bb348c4ba385ee6ebc8e55d71b P 65ed95869fbb4b69b5d6eb99c51adf85: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:52.896813  9371 consensus_queue.cc:260] T 070a6f2020a1483381e2baa75e5c0cbf P c694531b0e1d47988b291f1214efc4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:52.899104  9371 ts_tablet_manager.cc:1434] T 070a6f2020a1483381e2baa75e5c0cbf P c694531b0e1d47988b291f1214efc4cb: Time spent starting tablet: real 0.085s	user 0.007s	sys 0.000s
I20260709 13:02:52.903540  9736 raft_consensus.cc:493] T 070a6f2020a1483381e2baa75e5c0cbf P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:52.904088  9736 raft_consensus.cc:515] T 070a6f2020a1483381e2baa75e5c0cbf P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:52.910362  9249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070a6f2020a1483381e2baa75e5c0cbf" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d" is_pre_election: true
I20260709 13:02:52.911161  9249 raft_consensus.cc:2468] T 070a6f2020a1483381e2baa75e5c0cbf P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65ed95869fbb4b69b5d6eb99c51adf85 in term 0.
I20260709 13:02:52.911854  9736 leader_election.cc:290] T 070a6f2020a1483381e2baa75e5c0cbf P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455), 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311)
I20260709 13:02:52.916297  9319 raft_consensus.cc:2468] T ac928b0582c745b4804afcd30e861439 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8846d581359a4b7ea6d4c33424ea825d in term 1.
I20260709 13:02:52.917843  9215 leader_election.cc:304] T ac928b0582c745b4804afcd30e861439 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57, 8846d581359a4b7ea6d4c33424ea825d; no voters: 
I20260709 13:02:52.919391  9410 raft_consensus.cc:2804] T ac928b0582c745b4804afcd30e861439 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:52.920423  9410 raft_consensus.cc:697] T ac928b0582c745b4804afcd30e861439 P 8846d581359a4b7ea6d4c33424ea825d [term 1 LEADER]: Becoming Leader. State: Replica: 8846d581359a4b7ea6d4c33424ea825d, State: Running, Role: LEADER
I20260709 13:02:52.921387  9410 consensus_queue.cc:237] T ac928b0582c745b4804afcd30e861439 P 8846d581359a4b7ea6d4c33424ea825d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:52.919284  9701 raft_consensus.cc:515] T 534ae119bf014235a99dfbbfcff690e1 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:52.923579  9064 leader_election.cc:304] T 070a6f2020a1483381e2baa75e5c0cbf P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65ed95869fbb4b69b5d6eb99c51adf85, 8846d581359a4b7ea6d4c33424ea825d; no voters: 
I20260709 13:02:52.929390  9736 raft_consensus.cc:2804] T 070a6f2020a1483381e2baa75e5c0cbf P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:52.929877  9736 raft_consensus.cc:493] T 070a6f2020a1483381e2baa75e5c0cbf P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:52.930927  9736 raft_consensus.cc:3060] T 070a6f2020a1483381e2baa75e5c0cbf P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:52.934265  9175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070a6f2020a1483381e2baa75e5c0cbf" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694531b0e1d47988b291f1214efc4cb" is_pre_election: true
I20260709 13:02:52.935030  9175 raft_consensus.cc:2468] T 070a6f2020a1483381e2baa75e5c0cbf P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65ed95869fbb4b69b5d6eb99c51adf85 in term 0.
I20260709 13:02:52.938422  9249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534ae119bf014235a99dfbbfcff690e1" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d"
I20260709 13:02:52.939182  9249 raft_consensus.cc:3060] T 534ae119bf014235a99dfbbfcff690e1 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:52.940474  9800 log.cc:927] Time spent T d75fae153be542ccbf70c92676ffd30d P 65ed95869fbb4b69b5d6eb99c51adf85: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:02:52.941591  9474 raft_consensus.cc:493] T a581cc3c19254d4ca39e1f7328268a93 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:52.942137  9474 raft_consensus.cc:515] T a581cc3c19254d4ca39e1f7328268a93 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:52.944057  9474 leader_election.cc:290] T a581cc3c19254d4ca39e1f7328268a93 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311), 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351)
I20260709 13:02:52.952299  9248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a581cc3c19254d4ca39e1f7328268a93" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d" is_pre_election: true
I20260709 13:02:52.953117  9248 raft_consensus.cc:2393] T a581cc3c19254d4ca39e1f7328268a93 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c694531b0e1d47988b291f1214efc4cb in current term 1: Already voted for candidate 74ac2cf163ee475e8a280cb3aa738f57 in this term.
I20260709 13:02:52.962483  9701 leader_election.cc:290] T 534ae119bf014235a99dfbbfcff690e1 P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 1 election: Requested vote from peers 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311), 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351)
W20260709 13:02:52.963663  9066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:44351, user_credentials={real_user=slave}} blocked reactor thread for 61073.7us
I20260709 13:02:52.966823  8995 catalog_manager.cc:5697] T e2fbc9c2c0a947f1b4a078db7c8402d0 P c694531b0e1d47988b291f1214efc4cb reported cstate change: term changed from 0 to 1, leader changed from <none> to c694531b0e1d47988b291f1214efc4cb (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c694531b0e1d47988b291f1214efc4cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:52.969563  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac928b0582c745b4804afcd30e861439" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85"
W20260709 13:02:52.970903  9215 leader_election.cc:343] T ac928b0582c745b4804afcd30e861439 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:52.972378  9324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534ae119bf014235a99dfbbfcff690e1" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57"
I20260709 13:02:52.973037  9324 raft_consensus.cc:3060] T 534ae119bf014235a99dfbbfcff690e1 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:52.977550  9100 raft_consensus.cc:3060] T 6007c141b1134cb18ab1200556127236 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:52.981145  9409 leader_election.cc:290] T ac928b0582c745b4804afcd30e861439 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 1 election: Requested vote from peers 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351), 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979)
I20260709 13:02:52.984339  9324 raft_consensus.cc:2468] T 534ae119bf014235a99dfbbfcff690e1 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65ed95869fbb4b69b5d6eb99c51adf85 in term 1.
I20260709 13:02:52.963256  9319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a581cc3c19254d4ca39e1f7328268a93" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57" is_pre_election: true
I20260709 13:02:52.992655  9474 consensus_queue.cc:1048] T c500a4c76ad3464aaa2f8985f7d3a53d P c694531b0e1d47988b291f1214efc4cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:52.993031  9141 leader_election.cc:304] T a581cc3c19254d4ca39e1f7328268a93 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c694531b0e1d47988b291f1214efc4cb; no voters: 74ac2cf163ee475e8a280cb3aa738f57, 8846d581359a4b7ea6d4c33424ea825d
I20260709 13:02:52.994563  9654 raft_consensus.cc:3060] T a581cc3c19254d4ca39e1f7328268a93 P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:53.004664  9654 raft_consensus.cc:2749] T a581cc3c19254d4ca39e1f7328268a93 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:52.999917  9249 raft_consensus.cc:2468] T 534ae119bf014235a99dfbbfcff690e1 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65ed95869fbb4b69b5d6eb99c51adf85 in term 1.
I20260709 13:02:53.008512  9064 leader_election.cc:304] T 534ae119bf014235a99dfbbfcff690e1 P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65ed95869fbb4b69b5d6eb99c51adf85, 8846d581359a4b7ea6d4c33424ea825d; no voters: 
W20260709 13:02:53.009295  9047 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:53.010211  9594 consensus_queue.cc:1048] T a581cc3c19254d4ca39e1f7328268a93 P 74ac2cf163ee475e8a280cb3aa738f57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:53.010908  9702 raft_consensus.cc:2804] T 534ae119bf014235a99dfbbfcff690e1 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:53.011471  9702 raft_consensus.cc:697] T 534ae119bf014235a99dfbbfcff690e1 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 LEADER]: Becoming Leader. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Running, Role: LEADER
I20260709 13:02:53.013674  9702 consensus_queue.cc:237] T 534ae119bf014235a99dfbbfcff690e1 P 65ed95869fbb4b69b5d6eb99c51adf85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:53.022374  9701 raft_consensus.cc:493] T e2fbc9c2c0a947f1b4a078db7c8402d0 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:53.022929  9701 raft_consensus.cc:515] T e2fbc9c2c0a947f1b4a078db7c8402d0 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:53.025070  9701 leader_election.cc:290] T e2fbc9c2c0a947f1b4a078db7c8402d0 P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351), c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455)
I20260709 13:02:53.029726  9324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fbc9c2c0a947f1b4a078db7c8402d0" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57" is_pre_election: true
I20260709 13:02:53.030650  9324 raft_consensus.cc:2393] T e2fbc9c2c0a947f1b4a078db7c8402d0 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65ed95869fbb4b69b5d6eb99c51adf85 in current term 1: Already voted for candidate c694531b0e1d47988b291f1214efc4cb in this term.
I20260709 13:02:53.033811  9175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2fbc9c2c0a947f1b4a078db7c8402d0" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694531b0e1d47988b291f1214efc4cb" is_pre_election: true
I20260709 13:02:53.037274  9372 tablet_bootstrap.cc:492] T c12e80bb348c4ba385ee6ebc8e55d71b P 65ed95869fbb4b69b5d6eb99c51adf85: No bootstrap required, opened a new log
I20260709 13:02:53.037858  9372 ts_tablet_manager.cc:1403] T c12e80bb348c4ba385ee6ebc8e55d71b P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent bootstrapping tablet: real 0.148s	user 0.021s	sys 0.024s
I20260709 13:02:53.038686  9066 leader_election.cc:304] T e2fbc9c2c0a947f1b4a078db7c8402d0 P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65ed95869fbb4b69b5d6eb99c51adf85; no voters: 74ac2cf163ee475e8a280cb3aa738f57, c694531b0e1d47988b291f1214efc4cb
I20260709 13:02:53.040251  9806 raft_consensus.cc:3060] T e2fbc9c2c0a947f1b4a078db7c8402d0 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:53.042811  9370 tablet_bootstrap.cc:492] T 4d2b02247c21448ea824065ad29304e7 P 74ac2cf163ee475e8a280cb3aa738f57: No bootstrap required, opened a new log
I20260709 13:02:53.043357  9370 ts_tablet_manager.cc:1403] T 4d2b02247c21448ea824065ad29304e7 P 74ac2cf163ee475e8a280cb3aa738f57: Time spent bootstrapping tablet: real 0.175s	user 0.032s	sys 0.022s
I20260709 13:02:53.000283  9736 raft_consensus.cc:515] T 070a6f2020a1483381e2baa75e5c0cbf P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:53.053915  9736 leader_election.cc:290] T 070a6f2020a1483381e2baa75e5c0cbf P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 1 election: Requested vote from peers c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455), 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311)
I20260709 13:02:53.055874  9173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070a6f2020a1483381e2baa75e5c0cbf" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694531b0e1d47988b291f1214efc4cb"
I20260709 13:02:53.056552  9173 raft_consensus.cc:3060] T 070a6f2020a1483381e2baa75e5c0cbf P c694531b0e1d47988b291f1214efc4cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:53.057291  9249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070a6f2020a1483381e2baa75e5c0cbf" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d"
I20260709 13:02:53.057952  9249 raft_consensus.cc:3060] T 070a6f2020a1483381e2baa75e5c0cbf P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:53.062321  9372 raft_consensus.cc:359] T c12e80bb348c4ba385ee6ebc8e55d71b P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:53.066222  9173 raft_consensus.cc:2468] T 070a6f2020a1483381e2baa75e5c0cbf P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65ed95869fbb4b69b5d6eb99c51adf85 in term 1.
I20260709 13:02:53.046132  9370 raft_consensus.cc:359] T 4d2b02247c21448ea824065ad29304e7 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:53.067272  9370 raft_consensus.cc:385] T 4d2b02247c21448ea824065ad29304e7 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:53.067584  9370 raft_consensus.cc:740] T 4d2b02247c21448ea824065ad29304e7 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74ac2cf163ee475e8a280cb3aa738f57, State: Initialized, Role: FOLLOWER
I20260709 13:02:53.068404  9370 consensus_queue.cc:260] T 4d2b02247c21448ea824065ad29304e7 P 74ac2cf163ee475e8a280cb3aa738f57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:53.066529  9372 raft_consensus.cc:385] T c12e80bb348c4ba385ee6ebc8e55d71b P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:53.069679  9372 raft_consensus.cc:740] T c12e80bb348c4ba385ee6ebc8e55d71b P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Initialized, Role: FOLLOWER
I20260709 13:02:53.070348  9372 consensus_queue.cc:260] T c12e80bb348c4ba385ee6ebc8e55d71b P 65ed95869fbb4b69b5d6eb99c51adf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:53.071991  9372 ts_tablet_manager.cc:1434] T c12e80bb348c4ba385ee6ebc8e55d71b P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.000s
I20260709 13:02:53.081305  9806 raft_consensus.cc:2749] T e2fbc9c2c0a947f1b4a078db7c8402d0 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:53.086407  9370 ts_tablet_manager.cc:1434] T 4d2b02247c21448ea824065ad29304e7 P 74ac2cf163ee475e8a280cb3aa738f57: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.000s
I20260709 13:02:53.089160  9065 leader_election.cc:304] T 070a6f2020a1483381e2baa75e5c0cbf P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65ed95869fbb4b69b5d6eb99c51adf85, c694531b0e1d47988b291f1214efc4cb; no voters: 
W20260709 13:02:53.089529  9141 consensus_peers.cc:597] T c12e80bb348c4ba385ee6ebc8e55d71b P c694531b0e1d47988b291f1214efc4cb -> Peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Couldn't send request to peer 65ed95869fbb4b69b5d6eb99c51adf85. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:53.090828  9702 raft_consensus.cc:2804] T 070a6f2020a1483381e2baa75e5c0cbf P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:53.093043  9702 raft_consensus.cc:697] T 070a6f2020a1483381e2baa75e5c0cbf P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 LEADER]: Becoming Leader. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Running, Role: LEADER
I20260709 13:02:53.093966  9702 consensus_queue.cc:237] T 070a6f2020a1483381e2baa75e5c0cbf P 65ed95869fbb4b69b5d6eb99c51adf85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:53.096529  9249 raft_consensus.cc:2468] T 070a6f2020a1483381e2baa75e5c0cbf P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65ed95869fbb4b69b5d6eb99c51adf85 in term 1.
I20260709 13:02:53.101426  8997 catalog_manager.cc:5697] T ac928b0582c745b4804afcd30e861439 P 8846d581359a4b7ea6d4c33424ea825d reported cstate change: term changed from 0 to 1, leader changed from <none> to 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195). New cstate: current_term: 1 leader_uuid: "8846d581359a4b7ea6d4c33424ea825d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:53.109822  9594 consensus_queue.cc:1048] T a581cc3c19254d4ca39e1f7328268a93 P 74ac2cf163ee475e8a280cb3aa738f57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:53.122809  9372 tablet_bootstrap.cc:492] T ac928b0582c745b4804afcd30e861439 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap starting.
I20260709 13:02:53.127067  9474 consensus_queue.cc:1048] T c12e80bb348c4ba385ee6ebc8e55d71b P c694531b0e1d47988b291f1214efc4cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:53.128126  9702 raft_consensus.cc:493] T c12e80bb348c4ba385ee6ebc8e55d71b P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:53.128666  9702 raft_consensus.cc:515] T c12e80bb348c4ba385ee6ebc8e55d71b P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:53.149221  9372 tablet_bootstrap.cc:654] T ac928b0582c745b4804afcd30e861439 P 65ed95869fbb4b69b5d6eb99c51adf85: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:53.151580  9250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12e80bb348c4ba385ee6ebc8e55d71b" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d" is_pre_election: true
I20260709 13:02:53.154383  9173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12e80bb348c4ba385ee6ebc8e55d71b" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694531b0e1d47988b291f1214efc4cb" is_pre_election: true
I20260709 13:02:53.157629  9738 consensus_queue.cc:1048] T 18df0aeb35ec4bb095806227d9bb97a8 P c694531b0e1d47988b291f1214efc4cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:53.169348  9064 leader_election.cc:304] T c12e80bb348c4ba385ee6ebc8e55d71b P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65ed95869fbb4b69b5d6eb99c51adf85; no voters: 8846d581359a4b7ea6d4c33424ea825d, c694531b0e1d47988b291f1214efc4cb
I20260709 13:02:53.170328  9701 raft_consensus.cc:2749] T c12e80bb348c4ba385ee6ebc8e55d71b P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:53.176610  8997 catalog_manager.cc:5697] T 070a6f2020a1483381e2baa75e5c0cbf P 65ed95869fbb4b69b5d6eb99c51adf85 reported cstate change: term changed from 0 to 1, leader changed from <none> to 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:53.178582  8997 catalog_manager.cc:5697] T 534ae119bf014235a99dfbbfcff690e1 P 65ed95869fbb4b69b5d6eb99c51adf85 reported cstate change: term changed from 0 to 1, leader changed from <none> to 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:53.181291  9741 consensus_queue.cc:1048] T 18df0aeb35ec4bb095806227d9bb97a8 P c694531b0e1d47988b291f1214efc4cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:53.191756  9702 leader_election.cc:290] T c12e80bb348c4ba385ee6ebc8e55d71b P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455), 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311)
I20260709 13:02:53.204764  9684 raft_consensus.cc:493] T c500a4c76ad3464aaa2f8985f7d3a53d P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:53.206683  9684 raft_consensus.cc:515] T c500a4c76ad3464aaa2f8985f7d3a53d P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:53.208798  9684 leader_election.cc:290] T c500a4c76ad3464aaa2f8985f7d3a53d P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455), 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311)
I20260709 13:02:53.210763  9249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c500a4c76ad3464aaa2f8985f7d3a53d" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d" is_pre_election: true
I20260709 13:02:53.211897  9372 tablet_bootstrap.cc:492] T ac928b0582c745b4804afcd30e861439 P 65ed95869fbb4b69b5d6eb99c51adf85: No bootstrap required, opened a new log
I20260709 13:02:53.216394  9372 ts_tablet_manager.cc:1403] T ac928b0582c745b4804afcd30e861439 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent bootstrapping tablet: real 0.094s	user 0.016s	sys 0.000s
I20260709 13:02:53.213193  9175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c500a4c76ad3464aaa2f8985f7d3a53d" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694531b0e1d47988b291f1214efc4cb" is_pre_election: true
I20260709 13:02:53.220387  9288 leader_election.cc:304] T c500a4c76ad3464aaa2f8985f7d3a53d P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57; no voters: 8846d581359a4b7ea6d4c33424ea825d, c694531b0e1d47988b291f1214efc4cb
I20260709 13:02:53.221019  9684 raft_consensus.cc:2749] T c500a4c76ad3464aaa2f8985f7d3a53d P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:53.224007  9372 raft_consensus.cc:359] T ac928b0582c745b4804afcd30e861439 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:53.225328  9372 raft_consensus.cc:385] T ac928b0582c745b4804afcd30e861439 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:53.226418  9372 raft_consensus.cc:740] T ac928b0582c745b4804afcd30e861439 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Initialized, Role: FOLLOWER
I20260709 13:02:53.227471  9324 raft_consensus.cc:3060] T c500a4c76ad3464aaa2f8985f7d3a53d P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:53.227253  9372 consensus_queue.cc:260] T ac928b0582c745b4804afcd30e861439 P 65ed95869fbb4b69b5d6eb99c51adf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:53.231142  9372 ts_tablet_manager.cc:1434] T ac928b0582c745b4804afcd30e861439 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:02:53.232115  9372 tablet_bootstrap.cc:492] T 4d2b02247c21448ea824065ad29304e7 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap starting.
I20260709 13:02:53.237916  9372 tablet_bootstrap.cc:654] T 4d2b02247c21448ea824065ad29304e7 P 65ed95869fbb4b69b5d6eb99c51adf85: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:53.250010  9372 tablet_bootstrap.cc:492] T 4d2b02247c21448ea824065ad29304e7 P 65ed95869fbb4b69b5d6eb99c51adf85: No bootstrap required, opened a new log
I20260709 13:02:53.250497  9372 ts_tablet_manager.cc:1403] T 4d2b02247c21448ea824065ad29304e7 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent bootstrapping tablet: real 0.019s	user 0.007s	sys 0.002s
I20260709 13:02:53.253191  9372 raft_consensus.cc:359] T 4d2b02247c21448ea824065ad29304e7 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:53.253839  9372 raft_consensus.cc:385] T 4d2b02247c21448ea824065ad29304e7 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:53.254688  9372 raft_consensus.cc:740] T 4d2b02247c21448ea824065ad29304e7 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Initialized, Role: FOLLOWER
I20260709 13:02:53.255353  9372 consensus_queue.cc:260] T 4d2b02247c21448ea824065ad29304e7 P 65ed95869fbb4b69b5d6eb99c51adf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:53.257514  9372 ts_tablet_manager.cc:1434] T 4d2b02247c21448ea824065ad29304e7 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.000s
I20260709 13:02:53.291662  9741 consensus_queue.cc:1048] T e2fbc9c2c0a947f1b4a078db7c8402d0 P c694531b0e1d47988b291f1214efc4cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:53.305110  9654 consensus_queue.cc:1048] T e2fbc9c2c0a947f1b4a078db7c8402d0 P c694531b0e1d47988b291f1214efc4cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:53.346168  9701 raft_consensus.cc:493] T ac928b0582c745b4804afcd30e861439 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:53.346695  9701 raft_consensus.cc:515] T ac928b0582c745b4804afcd30e861439 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:53.348445  9701 leader_election.cc:290] T ac928b0582c745b4804afcd30e861439 P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311), 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351)
I20260709 13:02:53.349444  9319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac928b0582c745b4804afcd30e861439" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57" is_pre_election: true
I20260709 13:02:53.350248  9319 raft_consensus.cc:2393] T ac928b0582c745b4804afcd30e861439 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65ed95869fbb4b69b5d6eb99c51adf85 in current term 1: Already voted for candidate 8846d581359a4b7ea6d4c33424ea825d in this term.
I20260709 13:02:53.351421  9250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac928b0582c745b4804afcd30e861439" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d" is_pre_election: true
I20260709 13:02:53.353737  9064 leader_election.cc:304] T ac928b0582c745b4804afcd30e861439 P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65ed95869fbb4b69b5d6eb99c51adf85; no voters: 74ac2cf163ee475e8a280cb3aa738f57, 8846d581359a4b7ea6d4c33424ea825d
I20260709 13:02:53.355636  9702 raft_consensus.cc:3060] T ac928b0582c745b4804afcd30e861439 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:53.358196  9684 raft_consensus.cc:493] T 4d2b02247c21448ea824065ad29304e7 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:53.358771  9684 raft_consensus.cc:515] T 4d2b02247c21448ea824065ad29304e7 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:53.360965  9684 leader_election.cc:290] T 4d2b02247c21448ea824065ad29304e7 P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311), 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979)
I20260709 13:02:53.363132  9101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2b02247c21448ea824065ad29304e7" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" is_pre_election: true
I20260709 13:02:53.363857  9101 raft_consensus.cc:2468] T 4d2b02247c21448ea824065ad29304e7 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74ac2cf163ee475e8a280cb3aa738f57 in term 0.
I20260709 13:02:53.364874  9289 leader_election.cc:304] T 4d2b02247c21448ea824065ad29304e7 P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65ed95869fbb4b69b5d6eb99c51adf85, 74ac2cf163ee475e8a280cb3aa738f57; no voters: 
I20260709 13:02:53.365612  9594 raft_consensus.cc:2804] T 4d2b02247c21448ea824065ad29304e7 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:53.363149  9250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2b02247c21448ea824065ad29304e7" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d" is_pre_election: true
I20260709 13:02:53.366050  9594 raft_consensus.cc:493] T 4d2b02247c21448ea824065ad29304e7 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:53.366591  9594 raft_consensus.cc:3060] T 4d2b02247c21448ea824065ad29304e7 P 74ac2cf163ee475e8a280cb3aa738f57 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:53.366629  9250 raft_consensus.cc:2468] T 4d2b02247c21448ea824065ad29304e7 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74ac2cf163ee475e8a280cb3aa738f57 in term 0.
I20260709 13:02:53.370774  9702 raft_consensus.cc:2749] T ac928b0582c745b4804afcd30e861439 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:53.373276  9594 raft_consensus.cc:515] T 4d2b02247c21448ea824065ad29304e7 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:53.375146  9594 leader_election.cc:290] T 4d2b02247c21448ea824065ad29304e7 P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 election: Requested vote from peers 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311), 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979)
I20260709 13:02:53.376192  9100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2b02247c21448ea824065ad29304e7" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85"
I20260709 13:02:53.376591  9250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d2b02247c21448ea824065ad29304e7" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d"
I20260709 13:02:53.376901  9100 raft_consensus.cc:3060] T 4d2b02247c21448ea824065ad29304e7 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:53.377229  9250 raft_consensus.cc:3060] T 4d2b02247c21448ea824065ad29304e7 P 8846d581359a4b7ea6d4c33424ea825d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:53.383627  9250 raft_consensus.cc:2468] T 4d2b02247c21448ea824065ad29304e7 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74ac2cf163ee475e8a280cb3aa738f57 in term 1.
I20260709 13:02:53.383957  9100 raft_consensus.cc:2468] T 4d2b02247c21448ea824065ad29304e7 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74ac2cf163ee475e8a280cb3aa738f57 in term 1.
I20260709 13:02:53.384869  9287 leader_election.cc:304] T 4d2b02247c21448ea824065ad29304e7 P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57, 8846d581359a4b7ea6d4c33424ea825d; no voters: 
I20260709 13:02:53.388581  9594 raft_consensus.cc:2804] T 4d2b02247c21448ea824065ad29304e7 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:53.390256  9594 raft_consensus.cc:697] T 4d2b02247c21448ea824065ad29304e7 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 LEADER]: Becoming Leader. State: Replica: 74ac2cf163ee475e8a280cb3aa738f57, State: Running, Role: LEADER
I20260709 13:02:53.391189  9594 consensus_queue.cc:237] T 4d2b02247c21448ea824065ad29304e7 P 74ac2cf163ee475e8a280cb3aa738f57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:53.402470  8998 catalog_manager.cc:5697] T 4d2b02247c21448ea824065ad29304e7 P 74ac2cf163ee475e8a280cb3aa738f57 reported cstate change: term changed from 0 to 1, leader changed from <none> to 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "74ac2cf163ee475e8a280cb3aa738f57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:53.409822  9410 consensus_queue.cc:1048] T ac928b0582c745b4804afcd30e861439 P 8846d581359a4b7ea6d4c33424ea825d [LEADER]: Connected to new peer: Peer: permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:53.422348  9409 consensus_queue.cc:1048] T ac928b0582c745b4804afcd30e861439 P 8846d581359a4b7ea6d4c33424ea825d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:53.429191  9701 consensus_queue.cc:1048] T 534ae119bf014235a99dfbbfcff690e1 P 65ed95869fbb4b69b5d6eb99c51adf85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:53.445583  9701 consensus_queue.cc:1048] T 534ae119bf014235a99dfbbfcff690e1 P 65ed95869fbb4b69b5d6eb99c51adf85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:53.457664  9100 raft_consensus.cc:3060] T c12e80bb348c4ba385ee6ebc8e55d71b P 65ed95869fbb4b69b5d6eb99c51adf85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:53.538180  9702 consensus_queue.cc:1048] T 070a6f2020a1483381e2baa75e5c0cbf P 65ed95869fbb4b69b5d6eb99c51adf85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:53.548738  9701 consensus_queue.cc:1048] T 070a6f2020a1483381e2baa75e5c0cbf P 65ed95869fbb4b69b5d6eb99c51adf85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:53.811092  9594 consensus_queue.cc:1048] T 4d2b02247c21448ea824065ad29304e7 P 74ac2cf163ee475e8a280cb3aa738f57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:53.821419  9684 consensus_queue.cc:1048] T 4d2b02247c21448ea824065ad29304e7 P 74ac2cf163ee475e8a280cb3aa738f57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:54.453495   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
W20260709 13:02:54.491194  9141 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:54.492884   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:02:54.493849   431 tablet_replica.cc:333] T 4d2b02247c21448ea824065ad29304e7 P 65ed95869fbb4b69b5d6eb99c51adf85: stopping tablet replica
I20260709 13:02:54.494709   431 raft_consensus.cc:2243] T 4d2b02247c21448ea824065ad29304e7 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:54.495239   431 raft_consensus.cc:2272] T 4d2b02247c21448ea824065ad29304e7 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:54.495998  9141 consensus_peers.cc:597] T c12e80bb348c4ba385ee6ebc8e55d71b P c694531b0e1d47988b291f1214efc4cb -> Peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Couldn't send request to peer 65ed95869fbb4b69b5d6eb99c51adf85. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:54.496711  9141 consensus_peers.cc:597] T f2229e498f7f472f97c088fddb802939 P c694531b0e1d47988b291f1214efc4cb -> Peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Couldn't send request to peer 65ed95869fbb4b69b5d6eb99c51adf85. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:54.499024   431 tablet_replica.cc:333] T ac928b0582c745b4804afcd30e861439 P 65ed95869fbb4b69b5d6eb99c51adf85: stopping tablet replica
I20260709 13:02:54.499709   431 raft_consensus.cc:2243] T ac928b0582c745b4804afcd30e861439 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:54.500109   431 raft_consensus.cc:2272] T ac928b0582c745b4804afcd30e861439 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:54.501955   431 tablet_replica.cc:333] T 18df0aeb35ec4bb095806227d9bb97a8 P 65ed95869fbb4b69b5d6eb99c51adf85: stopping tablet replica
I20260709 13:02:54.502561   431 raft_consensus.cc:2243] T 18df0aeb35ec4bb095806227d9bb97a8 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:54.502972   431 raft_consensus.cc:2272] T 18df0aeb35ec4bb095806227d9bb97a8 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:54.504715   431 tablet_replica.cc:333] T 070a6f2020a1483381e2baa75e5c0cbf P 65ed95869fbb4b69b5d6eb99c51adf85: stopping tablet replica
I20260709 13:02:54.505252   431 raft_consensus.cc:2243] T 070a6f2020a1483381e2baa75e5c0cbf P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:54.505967   431 raft_consensus.cc:2272] T 070a6f2020a1483381e2baa75e5c0cbf P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:54.508205   431 tablet_replica.cc:333] T 6007c141b1134cb18ab1200556127236 P 65ed95869fbb4b69b5d6eb99c51adf85: stopping tablet replica
I20260709 13:02:54.508854   431 raft_consensus.cc:2243] T 6007c141b1134cb18ab1200556127236 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:54.509282   431 raft_consensus.cc:2272] T 6007c141b1134cb18ab1200556127236 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:54.511106   431 tablet_replica.cc:333] T e2fbc9c2c0a947f1b4a078db7c8402d0 P 65ed95869fbb4b69b5d6eb99c51adf85: stopping tablet replica
I20260709 13:02:54.511689   431 raft_consensus.cc:2243] T e2fbc9c2c0a947f1b4a078db7c8402d0 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:54.512094   431 raft_consensus.cc:2272] T e2fbc9c2c0a947f1b4a078db7c8402d0 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:54.513907   431 tablet_replica.cc:333] T c7c964979a0443f68e90c8678d083c96 P 65ed95869fbb4b69b5d6eb99c51adf85: stopping tablet replica
I20260709 13:02:54.514467   431 raft_consensus.cc:2243] T c7c964979a0443f68e90c8678d083c96 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:54.514919   431 raft_consensus.cc:2272] T c7c964979a0443f68e90c8678d083c96 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:54.516839   431 tablet_replica.cc:333] T 7f278d22c55747ee8ee613bfa5c59391 P 65ed95869fbb4b69b5d6eb99c51adf85: stopping tablet replica
I20260709 13:02:54.517441   431 raft_consensus.cc:2243] T 7f278d22c55747ee8ee613bfa5c59391 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:54.518179   431 raft_consensus.cc:2272] T 7f278d22c55747ee8ee613bfa5c59391 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:54.520145   431 tablet_replica.cc:333] T 534ae119bf014235a99dfbbfcff690e1 P 65ed95869fbb4b69b5d6eb99c51adf85: stopping tablet replica
I20260709 13:02:54.520673   431 raft_consensus.cc:2243] T 534ae119bf014235a99dfbbfcff690e1 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:54.521402   431 raft_consensus.cc:2272] T 534ae119bf014235a99dfbbfcff690e1 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:54.523234   431 tablet_replica.cc:333] T 8f67cb568c0745e792c17959b07c5da1 P 65ed95869fbb4b69b5d6eb99c51adf85: stopping tablet replica
I20260709 13:02:54.523805   431 raft_consensus.cc:2243] T 8f67cb568c0745e792c17959b07c5da1 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:54.524191   431 raft_consensus.cc:2272] T 8f67cb568c0745e792c17959b07c5da1 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:54.526314   431 tablet_replica.cc:333] T 9d21e8696b0340bea31002b775af50ee P 65ed95869fbb4b69b5d6eb99c51adf85: stopping tablet replica
I20260709 13:02:54.526929   431 raft_consensus.cc:2243] T 9d21e8696b0340bea31002b775af50ee P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:54.527707   431 raft_consensus.cc:2272] T 9d21e8696b0340bea31002b775af50ee P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:54.529788   431 tablet_replica.cc:333] T c12e80bb348c4ba385ee6ebc8e55d71b P 65ed95869fbb4b69b5d6eb99c51adf85: stopping tablet replica
I20260709 13:02:54.530345   431 raft_consensus.cc:2243] T c12e80bb348c4ba385ee6ebc8e55d71b P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:54.530764   431 raft_consensus.cc:2272] T c12e80bb348c4ba385ee6ebc8e55d71b P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:54.532454   431 tablet_replica.cc:333] T 5b6b34440fd14f3ea66bd5de7a2a8260 P 65ed95869fbb4b69b5d6eb99c51adf85: stopping tablet replica
I20260709 13:02:54.533087   431 raft_consensus.cc:2243] T 5b6b34440fd14f3ea66bd5de7a2a8260 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:54.533522   431 raft_consensus.cc:2272] T 5b6b34440fd14f3ea66bd5de7a2a8260 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:54.536551   431 tablet_replica.cc:333] T 9dea45dda5454393bdfaed3f233a30a5 P 65ed95869fbb4b69b5d6eb99c51adf85: stopping tablet replica
I20260709 13:02:54.537321   431 raft_consensus.cc:2243] T 9dea45dda5454393bdfaed3f233a30a5 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:54.538247   431 raft_consensus.cc:2272] T 9dea45dda5454393bdfaed3f233a30a5 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:54.540800   431 tablet_replica.cc:333] T a1ab6d75958044aeac9e1d43da9dc4b9 P 65ed95869fbb4b69b5d6eb99c51adf85: stopping tablet replica
I20260709 13:02:54.541635   431 raft_consensus.cc:2243] T a1ab6d75958044aeac9e1d43da9dc4b9 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:54.542186   431 raft_consensus.cc:2272] T a1ab6d75958044aeac9e1d43da9dc4b9 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:54.545156   431 tablet_replica.cc:333] T bfb390576f2e4f508caa2d234ed5d425 P 65ed95869fbb4b69b5d6eb99c51adf85: stopping tablet replica
I20260709 13:02:54.546032   431 raft_consensus.cc:2243] T bfb390576f2e4f508caa2d234ed5d425 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:54.546555   431 raft_consensus.cc:2272] T bfb390576f2e4f508caa2d234ed5d425 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:54.549396   431 tablet_replica.cc:333] T f2229e498f7f472f97c088fddb802939 P 65ed95869fbb4b69b5d6eb99c51adf85: stopping tablet replica
I20260709 13:02:54.550199   431 raft_consensus.cc:2243] T f2229e498f7f472f97c088fddb802939 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:54.550729   431 raft_consensus.cc:2272] T f2229e498f7f472f97c088fddb802939 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:54.553153  9215 consensus_peers.cc:597] T 0effc3d52a6d43ef8aa59821958f4e52 P 8846d581359a4b7ea6d4c33424ea825d -> Peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Couldn't send request to peer 65ed95869fbb4b69b5d6eb99c51adf85. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:54.553642   431 tablet_replica.cc:333] T eab411e3927a434ab647aa9b31fcf60d P 65ed95869fbb4b69b5d6eb99c51adf85: stopping tablet replica
I20260709 13:02:54.554569   431 raft_consensus.cc:2243] T eab411e3927a434ab647aa9b31fcf60d P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:54.555147   431 raft_consensus.cc:2272] T eab411e3927a434ab647aa9b31fcf60d P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:54.555707  9215 consensus_peers.cc:597] T a971867a8d494757a297936fad4bd464 P 8846d581359a4b7ea6d4c33424ea825d -> Peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Couldn't send request to peer 65ed95869fbb4b69b5d6eb99c51adf85. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:54.557382   431 tablet_replica.cc:333] T 604bd81da85244b6bd6d8bd6ac674f2c P 65ed95869fbb4b69b5d6eb99c51adf85: stopping tablet replica
I20260709 13:02:54.557976   431 raft_consensus.cc:2243] T 604bd81da85244b6bd6d8bd6ac674f2c P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:54.558743   431 raft_consensus.cc:2272] T 604bd81da85244b6bd6d8bd6ac674f2c P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:54.560876   431 tablet_replica.cc:333] T 93ba4182a04b450ca3fc7a15896f889e P 65ed95869fbb4b69b5d6eb99c51adf85: stopping tablet replica
I20260709 13:02:54.561496   431 raft_consensus.cc:2243] T 93ba4182a04b450ca3fc7a15896f889e P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:54.561940   431 raft_consensus.cc:2272] T 93ba4182a04b450ca3fc7a15896f889e P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:54.564429   431 tablet_replica.cc:333] T 48e91509dfc74d53a930cdc636976db6 P 65ed95869fbb4b69b5d6eb99c51adf85: stopping tablet replica
I20260709 13:02:54.564929   431 raft_consensus.cc:2243] T 48e91509dfc74d53a930cdc636976db6 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:54.565337   431 raft_consensus.cc:2272] T 48e91509dfc74d53a930cdc636976db6 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:54.567364   431 tablet_replica.cc:333] T d75fae153be542ccbf70c92676ffd30d P 65ed95869fbb4b69b5d6eb99c51adf85: stopping tablet replica
I20260709 13:02:54.567903   431 raft_consensus.cc:2243] T d75fae153be542ccbf70c92676ffd30d P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:54.568321   431 raft_consensus.cc:2272] T d75fae153be542ccbf70c92676ffd30d P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:54.570370   431 tablet_replica.cc:333] T eb666e221e5f4e4fbaba194838a28448 P 65ed95869fbb4b69b5d6eb99c51adf85: stopping tablet replica
I20260709 13:02:54.571035   431 raft_consensus.cc:2243] T eb666e221e5f4e4fbaba194838a28448 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:02:54.571522  9215 consensus_peers.cc:597] T e6ee00de30e149f58789799810d595a4 P 8846d581359a4b7ea6d4c33424ea825d -> Peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Couldn't send request to peer 65ed95869fbb4b69b5d6eb99c51adf85. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:54.571530   431 raft_consensus.cc:2272] T eb666e221e5f4e4fbaba194838a28448 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:54.574644   431 tablet_replica.cc:333] T 059a6a9a07d74be4a9f3854317b870ab P 65ed95869fbb4b69b5d6eb99c51adf85: stopping tablet replica
I20260709 13:02:54.575489   431 raft_consensus.cc:2243] T 059a6a9a07d74be4a9f3854317b870ab P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:54.576072   431 raft_consensus.cc:2272] T 059a6a9a07d74be4a9f3854317b870ab P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:54.576537  9289 consensus_peers.cc:597] T d3044a44ee984c489779dc339d162407 P 74ac2cf163ee475e8a280cb3aa738f57 -> Peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Couldn't send request to peer 65ed95869fbb4b69b5d6eb99c51adf85. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:54.578379   431 tablet_replica.cc:333] T d26bd321e5604f8aa61723f418be35a9 P 65ed95869fbb4b69b5d6eb99c51adf85: stopping tablet replica
I20260709 13:02:54.579017   431 raft_consensus.cc:2243] T d26bd321e5604f8aa61723f418be35a9 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:54.579401   431 raft_consensus.cc:2272] T d26bd321e5604f8aa61723f418be35a9 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:54.581419   431 tablet_replica.cc:333] T a731a965126b406988eecb7829bc9981 P 65ed95869fbb4b69b5d6eb99c51adf85: stopping tablet replica
I20260709 13:02:54.581912   431 raft_consensus.cc:2243] T a731a965126b406988eecb7829bc9981 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:54.582315   431 raft_consensus.cc:2272] T a731a965126b406988eecb7829bc9981 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:54.584564   431 tablet_replica.cc:333] T 0effc3d52a6d43ef8aa59821958f4e52 P 65ed95869fbb4b69b5d6eb99c51adf85: stopping tablet replica
I20260709 13:02:54.585170   431 raft_consensus.cc:2243] T 0effc3d52a6d43ef8aa59821958f4e52 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:54.585599   431 raft_consensus.cc:2272] T 0effc3d52a6d43ef8aa59821958f4e52 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:54.587740   431 tablet_replica.cc:333] T 5ce2a33a3b914f6297946ded34c256bf P 65ed95869fbb4b69b5d6eb99c51adf85: stopping tablet replica
I20260709 13:02:54.588254   431 raft_consensus.cc:2243] T 5ce2a33a3b914f6297946ded34c256bf P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:54.589000   431 raft_consensus.cc:2272] T 5ce2a33a3b914f6297946ded34c256bf P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:54.591050   431 tablet_replica.cc:333] T df7e9031dde347b5b9da753cc817ce17 P 65ed95869fbb4b69b5d6eb99c51adf85: stopping tablet replica
I20260709 13:02:54.591559   431 raft_consensus.cc:2243] T df7e9031dde347b5b9da753cc817ce17 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:54.591940   431 raft_consensus.cc:2272] T df7e9031dde347b5b9da753cc817ce17 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:54.594821   431 tablet_replica.cc:333] T 5cea8a8078e8456186d4d1a184d3f157 P 65ed95869fbb4b69b5d6eb99c51adf85: stopping tablet replica
I20260709 13:02:54.595577   431 raft_consensus.cc:2243] T 5cea8a8078e8456186d4d1a184d3f157 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:54.596076   431 raft_consensus.cc:2272] T 5cea8a8078e8456186d4d1a184d3f157 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:54.596320  9215 consensus_peers.cc:597] T ac928b0582c745b4804afcd30e861439 P 8846d581359a4b7ea6d4c33424ea825d -> Peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Couldn't send request to peer 65ed95869fbb4b69b5d6eb99c51adf85. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:54.598225   431 tablet_replica.cc:333] T 389a20133d8b4ebfaab346741dff367f P 65ed95869fbb4b69b5d6eb99c51adf85: stopping tablet replica
I20260709 13:02:54.598904   431 raft_consensus.cc:2243] T 389a20133d8b4ebfaab346741dff367f P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:54.599327   431 raft_consensus.cc:2272] T 389a20133d8b4ebfaab346741dff367f P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:54.601966   431 tablet_replica.cc:333] T 76b3d3cd810b46dbac2b534c0be568d2 P 65ed95869fbb4b69b5d6eb99c51adf85: stopping tablet replica
I20260709 13:02:54.602722   431 raft_consensus.cc:2243] T 76b3d3cd810b46dbac2b534c0be568d2 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:54.603492   431 raft_consensus.cc:2272] T 76b3d3cd810b46dbac2b534c0be568d2 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:54.605274   431 tablet_replica.cc:333] T e6797c587fdc4754b091a2be102e5927 P 65ed95869fbb4b69b5d6eb99c51adf85: stopping tablet replica
I20260709 13:02:54.605757   431 raft_consensus.cc:2243] T e6797c587fdc4754b091a2be102e5927 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:54.606482   431 raft_consensus.cc:2272] T e6797c587fdc4754b091a2be102e5927 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:54.608695   431 tablet_replica.cc:333] T 51a2ca964a8f4fb89b26d77b1b334f30 P 65ed95869fbb4b69b5d6eb99c51adf85: stopping tablet replica
I20260709 13:02:54.609196   431 raft_consensus.cc:2243] T 51a2ca964a8f4fb89b26d77b1b334f30 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:54.609704   431 raft_consensus.cc:2272] T 51a2ca964a8f4fb89b26d77b1b334f30 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:54.612262   431 tablet_replica.cc:333] T 3899ef948b2e405baaccb81544b7f58b P 65ed95869fbb4b69b5d6eb99c51adf85: stopping tablet replica
I20260709 13:02:54.613011   431 raft_consensus.cc:2243] T 3899ef948b2e405baaccb81544b7f58b P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:54.613531   431 raft_consensus.cc:2272] T 3899ef948b2e405baaccb81544b7f58b P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:54.615854   431 tablet_replica.cc:333] T e6ee00de30e149f58789799810d595a4 P 65ed95869fbb4b69b5d6eb99c51adf85: stopping tablet replica
I20260709 13:02:54.616552   431 raft_consensus.cc:2243] T e6ee00de30e149f58789799810d595a4 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:54.616998   431 raft_consensus.cc:2272] T e6ee00de30e149f58789799810d595a4 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:54.619637   431 tablet_replica.cc:333] T 0a377c4fc6c04b0aa8f74f64f4f59409 P 65ed95869fbb4b69b5d6eb99c51adf85: stopping tablet replica
I20260709 13:02:54.620362   431 raft_consensus.cc:2243] T 0a377c4fc6c04b0aa8f74f64f4f59409 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:54.620883   431 raft_consensus.cc:2272] T 0a377c4fc6c04b0aa8f74f64f4f59409 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:54.623664   431 tablet_replica.cc:333] T d2ef0242573643178d56d10a6c26ae8e P 65ed95869fbb4b69b5d6eb99c51adf85: stopping tablet replica
I20260709 13:02:54.624398   431 raft_consensus.cc:2243] T d2ef0242573643178d56d10a6c26ae8e P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:54.625387   431 raft_consensus.cc:2272] T d2ef0242573643178d56d10a6c26ae8e P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:54.628029   431 tablet_replica.cc:333] T ea3bb46b177b4bbdaa60f464370aa9a0 P 65ed95869fbb4b69b5d6eb99c51adf85: stopping tablet replica
I20260709 13:02:54.628688   431 raft_consensus.cc:2243] T ea3bb46b177b4bbdaa60f464370aa9a0 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:54.629144   431 raft_consensus.cc:2272] T ea3bb46b177b4bbdaa60f464370aa9a0 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:54.631014   431 tablet_replica.cc:333] T 8bfbc32cc1ba4ecc8fddc7e7f4711778 P 65ed95869fbb4b69b5d6eb99c51adf85: stopping tablet replica
I20260709 13:02:54.631501   431 raft_consensus.cc:2243] T 8bfbc32cc1ba4ecc8fddc7e7f4711778 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:54.631881   431 raft_consensus.cc:2272] T 8bfbc32cc1ba4ecc8fddc7e7f4711778 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:54.634423   431 tablet_replica.cc:333] T a971867a8d494757a297936fad4bd464 P 65ed95869fbb4b69b5d6eb99c51adf85: stopping tablet replica
I20260709 13:02:54.635035   431 raft_consensus.cc:2243] T a971867a8d494757a297936fad4bd464 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:54.635527   431 raft_consensus.cc:2272] T a971867a8d494757a297936fad4bd464 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:54.637085  9289 consensus_peers.cc:597] T eab411e3927a434ab647aa9b31fcf60d P 74ac2cf163ee475e8a280cb3aa738f57 -> Peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Couldn't send request to peer 65ed95869fbb4b69b5d6eb99c51adf85. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:54.637674   431 tablet_replica.cc:333] T dbdc8579cca94ef7ab4babd287837e8c P 65ed95869fbb4b69b5d6eb99c51adf85: stopping tablet replica
I20260709 13:02:54.638258   431 raft_consensus.cc:2243] T dbdc8579cca94ef7ab4babd287837e8c P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:54.638767   431 raft_consensus.cc:2272] T dbdc8579cca94ef7ab4babd287837e8c P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:54.640705   431 tablet_replica.cc:333] T d3044a44ee984c489779dc339d162407 P 65ed95869fbb4b69b5d6eb99c51adf85: stopping tablet replica
I20260709 13:02:54.641161   431 raft_consensus.cc:2243] T d3044a44ee984c489779dc339d162407 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:54.641572   431 raft_consensus.cc:2272] T d3044a44ee984c489779dc339d162407 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:54.644100   431 tablet_replica.cc:333] T b3f19df7d93748a1802678c56b5e2208 P 65ed95869fbb4b69b5d6eb99c51adf85: stopping tablet replica
I20260709 13:02:54.644716   431 raft_consensus.cc:2243] T b3f19df7d93748a1802678c56b5e2208 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:54.645637   431 raft_consensus.cc:2272] T b3f19df7d93748a1802678c56b5e2208 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:54.648169   431 tablet_replica.cc:333] T 6f8b7d72409f45eebf4208f98310f378 P 65ed95869fbb4b69b5d6eb99c51adf85: stopping tablet replica
I20260709 13:02:54.648800   431 raft_consensus.cc:2243] T 6f8b7d72409f45eebf4208f98310f378 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:54.649339   431 raft_consensus.cc:2272] T 6f8b7d72409f45eebf4208f98310f378 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:54.662140  9141 consensus_peers.cc:597] T eb666e221e5f4e4fbaba194838a28448 P c694531b0e1d47988b291f1214efc4cb -> Peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Couldn't send request to peer 65ed95869fbb4b69b5d6eb99c51adf85. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:54.663865  9215 consensus_peers.cc:597] T 0a377c4fc6c04b0aa8f74f64f4f59409 P 8846d581359a4b7ea6d4c33424ea825d -> Peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Couldn't send request to peer 65ed95869fbb4b69b5d6eb99c51adf85. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:54.680603  9141 consensus_peers.cc:597] T df7e9031dde347b5b9da753cc817ce17 P c694531b0e1d47988b291f1214efc4cb -> Peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Couldn't send request to peer 65ed95869fbb4b69b5d6eb99c51adf85. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:54.690346  9141 consensus_peers.cc:597] T a1ab6d75958044aeac9e1d43da9dc4b9 P c694531b0e1d47988b291f1214efc4cb -> Peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Couldn't send request to peer 65ed95869fbb4b69b5d6eb99c51adf85. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:54.694031  9141 consensus_peers.cc:597] T 389a20133d8b4ebfaab346741dff367f P c694531b0e1d47988b291f1214efc4cb -> Peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Couldn't send request to peer 65ed95869fbb4b69b5d6eb99c51adf85. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:54.703296  9289 consensus_peers.cc:597] T dbdc8579cca94ef7ab4babd287837e8c P 74ac2cf163ee475e8a280cb3aa738f57 -> Peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Couldn't send request to peer 65ed95869fbb4b69b5d6eb99c51adf85. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:54.720156   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
W20260709 13:02:54.723255  9141 consensus_peers.cc:597] T 5cea8a8078e8456186d4d1a184d3f157 P c694531b0e1d47988b291f1214efc4cb -> Peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Couldn't send request to peer 65ed95869fbb4b69b5d6eb99c51adf85. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33979: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:54.731323  9141 consensus_peers.cc:597] T 8f67cb568c0745e792c17959b07c5da1 P c694531b0e1d47988b291f1214efc4cb -> Peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Couldn't send request to peer 65ed95869fbb4b69b5d6eb99c51adf85. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33979: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:54.742769  9141 consensus_peers.cc:597] T bfb390576f2e4f508caa2d234ed5d425 P c694531b0e1d47988b291f1214efc4cb -> Peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Couldn't send request to peer 65ed95869fbb4b69b5d6eb99c51adf85. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33979: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:54.766781  9141 consensus_peers.cc:597] T 8bfbc32cc1ba4ecc8fddc7e7f4711778 P c694531b0e1d47988b291f1214efc4cb -> Peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Couldn't send request to peer 65ed95869fbb4b69b5d6eb99c51adf85. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33979: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:54.777168  9215 consensus_peers.cc:597] T 5b6b34440fd14f3ea66bd5de7a2a8260 P 8846d581359a4b7ea6d4c33424ea825d -> Peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Couldn't send request to peer 65ed95869fbb4b69b5d6eb99c51adf85. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33979: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:54.777747  9215 consensus_peers.cc:597] T 059a6a9a07d74be4a9f3854317b870ab P 8846d581359a4b7ea6d4c33424ea825d -> Peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Couldn't send request to peer 65ed95869fbb4b69b5d6eb99c51adf85. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33979: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:54.784703  9215 consensus_peers.cc:597] T ea3bb46b177b4bbdaa60f464370aa9a0 P 8846d581359a4b7ea6d4c33424ea825d -> Peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Couldn't send request to peer 65ed95869fbb4b69b5d6eb99c51adf85. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33979: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:54.793664   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:54.801301  9289 consensus_peers.cc:597] T 4d2b02247c21448ea824065ad29304e7 P 74ac2cf163ee475e8a280cb3aa738f57 -> Peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Couldn't send request to peer 65ed95869fbb4b69b5d6eb99c51adf85. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33979: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:54.805016  9841 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:54.805339  9842 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:54.810524  9289 consensus_peers.cc:597] T 51a2ca964a8f4fb89b26d77b1b334f30 P 74ac2cf163ee475e8a280cb3aa738f57 -> Peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Couldn't send request to peer 65ed95869fbb4b69b5d6eb99c51adf85. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33979: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:54.811404  9844 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:54.813328  9289 consensus_peers.cc:597] T d75fae153be542ccbf70c92676ffd30d P 74ac2cf163ee475e8a280cb3aa738f57 -> Peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Couldn't send request to peer 65ed95869fbb4b69b5d6eb99c51adf85. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33979: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:54.817422   431 server_base.cc:1061] running on GCE node
I20260709 13:02:54.819722   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:54.820082   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:54.820360   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602174820339 us; error 0 us; skew 500 ppm
I20260709 13:02:54.821085   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
W20260709 13:02:54.824630  9215 consensus_peers.cc:597] T 93ba4182a04b450ca3fc7a15896f889e P 8846d581359a4b7ea6d4c33424ea825d -> Peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Couldn't send request to peer 65ed95869fbb4b69b5d6eb99c51adf85. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33979: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:54.826821   431 webserver.cc:533] Webserver started at http://127.0.107.193:46691/ using document root <none> and password file <none>
I20260709 13:02:54.827526   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:54.827785   431 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:02:54.832736   431 fs_manager.cc:714] Time spent opening directory manager: real 0.004s	user 0.000s	sys 0.005s
W20260709 13:02:54.833941  9141 consensus_peers.cc:597] T d26bd321e5604f8aa61723f418be35a9 P c694531b0e1d47988b291f1214efc4cb -> Peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Couldn't send request to peer 65ed95869fbb4b69b5d6eb99c51adf85. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33979: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:54.834022  9215 consensus_peers.cc:597] T a731a965126b406988eecb7829bc9981 P 8846d581359a4b7ea6d4c33424ea825d -> Peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Couldn't send request to peer 65ed95869fbb4b69b5d6eb99c51adf85. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33979: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:54.834683  9215 consensus_peers.cc:597] T 48e91509dfc74d53a930cdc636976db6 P 8846d581359a4b7ea6d4c33424ea825d -> Peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Couldn't send request to peer 65ed95869fbb4b69b5d6eb99c51adf85. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33979: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:54.840874  9849 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:54.842226   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.000s
I20260709 13:02:54.842602   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601891739070-431-0/minicluster-data/ts-0-root
uuid: "65ed95869fbb4b69b5d6eb99c51adf85"
format_stamp: "Formatted at 2026-07-09 13:02:43 on dist-test-slave-qzg2"
I20260709 13:02:54.843009   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601891739070-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601891739070-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601891739070-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260709 13:02:54.852886  9141 consensus_peers.cc:597] T 18df0aeb35ec4bb095806227d9bb97a8 P c694531b0e1d47988b291f1214efc4cb -> Peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Couldn't send request to peer 65ed95869fbb4b69b5d6eb99c51adf85. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33979: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:54.856182  9141 consensus_peers.cc:597] T c7c964979a0443f68e90c8678d083c96 P c694531b0e1d47988b291f1214efc4cb -> Peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Couldn't send request to peer 65ed95869fbb4b69b5d6eb99c51adf85. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33979: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:54.857909  9141 consensus_peers.cc:597] T e2fbc9c2c0a947f1b4a078db7c8402d0 P c694531b0e1d47988b291f1214efc4cb -> Peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Couldn't send request to peer 65ed95869fbb4b69b5d6eb99c51adf85. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33979: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:54.872499   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:54.873864   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:54.875289   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:02:54.880221  9856 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
W20260709 13:02:54.906010  9141 consensus_peers.cc:597] T 3899ef948b2e405baaccb81544b7f58b P c694531b0e1d47988b291f1214efc4cb -> Peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Couldn't send request to peer 65ed95869fbb4b69b5d6eb99c51adf85. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33979: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:54.951552  9141 consensus_peers.cc:597] T 6007c141b1134cb18ab1200556127236 P c694531b0e1d47988b291f1214efc4cb -> Peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Couldn't send request to peer 65ed95869fbb4b69b5d6eb99c51adf85. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33979: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:54.958248  9215 consensus_peers.cc:597] T 6f8b7d72409f45eebf4208f98310f378 P 8846d581359a4b7ea6d4c33424ea825d -> Peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Couldn't send request to peer 65ed95869fbb4b69b5d6eb99c51adf85. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33979: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:55.201506   431 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 13:02:55.201944   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.323s	user 0.007s	sys 0.000s
I20260709 13:02:55.202309   431 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 13:02:55.208197  9856 tablet_bootstrap.cc:492] T a971867a8d494757a297936fad4bd464 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap starting.
I20260709 13:02:55.228225  9856 tablet_bootstrap.cc:492] T a971867a8d494757a297936fad4bd464 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:55.229249  9856 tablet_bootstrap.cc:492] T a971867a8d494757a297936fad4bd464 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap complete.
I20260709 13:02:55.230150  9856 ts_tablet_manager.cc:1403] T a971867a8d494757a297936fad4bd464 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.004s
I20260709 13:02:55.233134  9856 raft_consensus.cc:359] T a971867a8d494757a297936fad4bd464 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:55.233839  9856 raft_consensus.cc:740] T a971867a8d494757a297936fad4bd464 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Initialized, Role: FOLLOWER
I20260709 13:02:55.234752  9856 consensus_queue.cc:260] T a971867a8d494757a297936fad4bd464 P 65ed95869fbb4b69b5d6eb99c51adf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:55.245728  9856 ts_tablet_manager.cc:1434] T a971867a8d494757a297936fad4bd464 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent starting tablet: real 0.015s	user 0.014s	sys 0.000s
I20260709 13:02:55.246640  9856 tablet_bootstrap.cc:492] T d75fae153be542ccbf70c92676ffd30d P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap starting.
I20260709 13:02:55.262187  9856 tablet_bootstrap.cc:492] T d75fae153be542ccbf70c92676ffd30d P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:55.263175  9856 tablet_bootstrap.cc:492] T d75fae153be542ccbf70c92676ffd30d P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap complete.
I20260709 13:02:55.263917  9856 ts_tablet_manager.cc:1403] T d75fae153be542ccbf70c92676ffd30d P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.004s
I20260709 13:02:55.266304  9856 raft_consensus.cc:359] T d75fae153be542ccbf70c92676ffd30d P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:55.267017  9856 raft_consensus.cc:740] T d75fae153be542ccbf70c92676ffd30d P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Initialized, Role: FOLLOWER
I20260709 13:02:55.267802  9856 consensus_queue.cc:260] T d75fae153be542ccbf70c92676ffd30d P 65ed95869fbb4b69b5d6eb99c51adf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:55.269596  9856 ts_tablet_manager.cc:1434] T d75fae153be542ccbf70c92676ffd30d P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:02:55.270377  9856 tablet_bootstrap.cc:492] T c12e80bb348c4ba385ee6ebc8e55d71b P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap starting.
I20260709 13:02:55.298436  9856 tablet_bootstrap.cc:492] T c12e80bb348c4ba385ee6ebc8e55d71b P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:55.299404  9856 tablet_bootstrap.cc:492] T c12e80bb348c4ba385ee6ebc8e55d71b P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap complete.
I20260709 13:02:55.300055  9856 ts_tablet_manager.cc:1403] T c12e80bb348c4ba385ee6ebc8e55d71b P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent bootstrapping tablet: real 0.030s	user 0.018s	sys 0.008s
I20260709 13:02:55.302425  9856 raft_consensus.cc:359] T c12e80bb348c4ba385ee6ebc8e55d71b P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:55.303148  9856 raft_consensus.cc:740] T c12e80bb348c4ba385ee6ebc8e55d71b P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Initialized, Role: FOLLOWER
I20260709 13:02:55.303839  9856 consensus_queue.cc:260] T c12e80bb348c4ba385ee6ebc8e55d71b P 65ed95869fbb4b69b5d6eb99c51adf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:55.305667  9856 ts_tablet_manager.cc:1434] T c12e80bb348c4ba385ee6ebc8e55d71b P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:02:55.306440  9856 tablet_bootstrap.cc:492] T 18df0aeb35ec4bb095806227d9bb97a8 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap starting.
I20260709 13:02:55.322590  9856 tablet_bootstrap.cc:492] T 18df0aeb35ec4bb095806227d9bb97a8 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:55.323577  9856 tablet_bootstrap.cc:492] T 18df0aeb35ec4bb095806227d9bb97a8 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap complete.
I20260709 13:02:55.324250  9856 ts_tablet_manager.cc:1403] T 18df0aeb35ec4bb095806227d9bb97a8 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.004s
I20260709 13:02:55.326591  9856 raft_consensus.cc:359] T 18df0aeb35ec4bb095806227d9bb97a8 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:55.327286  9856 raft_consensus.cc:740] T 18df0aeb35ec4bb095806227d9bb97a8 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Initialized, Role: FOLLOWER
I20260709 13:02:55.327971  9856 consensus_queue.cc:260] T 18df0aeb35ec4bb095806227d9bb97a8 P 65ed95869fbb4b69b5d6eb99c51adf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:55.330016  9856 ts_tablet_manager.cc:1434] T 18df0aeb35ec4bb095806227d9bb97a8 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:02:55.330858  9856 tablet_bootstrap.cc:492] T 059a6a9a07d74be4a9f3854317b870ab P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap starting.
I20260709 13:02:55.356786  9856 tablet_bootstrap.cc:492] T 059a6a9a07d74be4a9f3854317b870ab P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:55.357805  9856 tablet_bootstrap.cc:492] T 059a6a9a07d74be4a9f3854317b870ab P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap complete.
I20260709 13:02:55.358513  9856 ts_tablet_manager.cc:1403] T 059a6a9a07d74be4a9f3854317b870ab P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent bootstrapping tablet: real 0.028s	user 0.013s	sys 0.004s
I20260709 13:02:55.360739  9856 raft_consensus.cc:359] T 059a6a9a07d74be4a9f3854317b870ab P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:55.361214  9856 raft_consensus.cc:740] T 059a6a9a07d74be4a9f3854317b870ab P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Initialized, Role: FOLLOWER
I20260709 13:02:55.361775  9856 consensus_queue.cc:260] T 059a6a9a07d74be4a9f3854317b870ab P 65ed95869fbb4b69b5d6eb99c51adf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:55.363209  9856 ts_tablet_manager.cc:1434] T 059a6a9a07d74be4a9f3854317b870ab P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:02:55.363885  9856 tablet_bootstrap.cc:492] T 9dea45dda5454393bdfaed3f233a30a5 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap starting.
I20260709 13:02:55.401404  9856 tablet_bootstrap.cc:492] T 9dea45dda5454393bdfaed3f233a30a5 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:55.402324  9856 tablet_bootstrap.cc:492] T 9dea45dda5454393bdfaed3f233a30a5 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap complete.
I20260709 13:02:55.402973  9856 ts_tablet_manager.cc:1403] T 9dea45dda5454393bdfaed3f233a30a5 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent bootstrapping tablet: real 0.039s	user 0.030s	sys 0.008s
I20260709 13:02:55.405390  9856 raft_consensus.cc:359] T 9dea45dda5454393bdfaed3f233a30a5 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:55.405937  9856 raft_consensus.cc:740] T 9dea45dda5454393bdfaed3f233a30a5 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Initialized, Role: FOLLOWER
I20260709 13:02:55.406462  9856 consensus_queue.cc:260] T 9dea45dda5454393bdfaed3f233a30a5 P 65ed95869fbb4b69b5d6eb99c51adf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:55.408285  9856 ts_tablet_manager.cc:1434] T 9dea45dda5454393bdfaed3f233a30a5 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:02:55.409076  9856 tablet_bootstrap.cc:492] T 8bfbc32cc1ba4ecc8fddc7e7f4711778 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap starting.
I20260709 13:02:55.432753  9856 tablet_bootstrap.cc:492] T 8bfbc32cc1ba4ecc8fddc7e7f4711778 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:55.434123  9856 tablet_bootstrap.cc:492] T 8bfbc32cc1ba4ecc8fddc7e7f4711778 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap complete.
I20260709 13:02:55.435259  9856 ts_tablet_manager.cc:1403] T 8bfbc32cc1ba4ecc8fddc7e7f4711778 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent bootstrapping tablet: real 0.026s	user 0.017s	sys 0.008s
I20260709 13:02:55.437381  9856 raft_consensus.cc:359] T 8bfbc32cc1ba4ecc8fddc7e7f4711778 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:55.437903  9856 raft_consensus.cc:740] T 8bfbc32cc1ba4ecc8fddc7e7f4711778 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Initialized, Role: FOLLOWER
I20260709 13:02:55.438441  9856 consensus_queue.cc:260] T 8bfbc32cc1ba4ecc8fddc7e7f4711778 P 65ed95869fbb4b69b5d6eb99c51adf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:55.440155  9856 ts_tablet_manager.cc:1434] T 8bfbc32cc1ba4ecc8fddc7e7f4711778 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:02:55.440862  9856 tablet_bootstrap.cc:492] T f2229e498f7f472f97c088fddb802939 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap starting.
I20260709 13:02:55.483248  9856 tablet_bootstrap.cc:492] T f2229e498f7f472f97c088fddb802939 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:55.483994  9856 tablet_bootstrap.cc:492] T f2229e498f7f472f97c088fddb802939 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap complete.
I20260709 13:02:55.484536  9856 ts_tablet_manager.cc:1403] T f2229e498f7f472f97c088fddb802939 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent bootstrapping tablet: real 0.044s	user 0.021s	sys 0.016s
I20260709 13:02:55.486479  9856 raft_consensus.cc:359] T f2229e498f7f472f97c088fddb802939 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:55.487102  9856 raft_consensus.cc:740] T f2229e498f7f472f97c088fddb802939 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Initialized, Role: FOLLOWER
I20260709 13:02:55.487771  9856 consensus_queue.cc:260] T f2229e498f7f472f97c088fddb802939 P 65ed95869fbb4b69b5d6eb99c51adf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:55.489867  9856 ts_tablet_manager.cc:1434] T f2229e498f7f472f97c088fddb802939 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:02:55.490633  9856 tablet_bootstrap.cc:492] T 0a377c4fc6c04b0aa8f74f64f4f59409 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap starting.
I20260709 13:02:55.503140  9856 tablet_bootstrap.cc:492] T 0a377c4fc6c04b0aa8f74f64f4f59409 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:55.504280  9856 tablet_bootstrap.cc:492] T 0a377c4fc6c04b0aa8f74f64f4f59409 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap complete.
I20260709 13:02:55.504932  9856 ts_tablet_manager.cc:1403] T 0a377c4fc6c04b0aa8f74f64f4f59409 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent bootstrapping tablet: real 0.014s	user 0.005s	sys 0.008s
I20260709 13:02:55.506989  9856 raft_consensus.cc:359] T 0a377c4fc6c04b0aa8f74f64f4f59409 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:55.507472  9856 raft_consensus.cc:740] T 0a377c4fc6c04b0aa8f74f64f4f59409 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Initialized, Role: FOLLOWER
I20260709 13:02:55.508013  9856 consensus_queue.cc:260] T 0a377c4fc6c04b0aa8f74f64f4f59409 P 65ed95869fbb4b69b5d6eb99c51adf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:55.509780  9856 ts_tablet_manager.cc:1434] T 0a377c4fc6c04b0aa8f74f64f4f59409 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 13:02:55.510530  9856 tablet_bootstrap.cc:492] T ea3bb46b177b4bbdaa60f464370aa9a0 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap starting.
I20260709 13:02:55.516014  9836 raft_consensus.cc:493] T 070a6f2020a1483381e2baa75e5c0cbf P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65ed95869fbb4b69b5d6eb99c51adf85)
I20260709 13:02:55.516615  9836 raft_consensus.cc:515] T 070a6f2020a1483381e2baa75e5c0cbf P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:55.518860  9836 leader_election.cc:290] T 070a6f2020a1483381e2baa75e5c0cbf P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979), c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455)
I20260709 13:02:55.520114   431 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 13:02:55.520488   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.318s	user 0.250s	sys 0.008s
I20260709 13:02:55.520679  9172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070a6f2020a1483381e2baa75e5c0cbf" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c694531b0e1d47988b291f1214efc4cb" is_pre_election: true
I20260709 13:02:55.526572  9856 tablet_bootstrap.cc:492] T ea3bb46b177b4bbdaa60f464370aa9a0 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:55.527745  9856 tablet_bootstrap.cc:492] T ea3bb46b177b4bbdaa60f464370aa9a0 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap complete.
I20260709 13:02:55.528488  9856 ts_tablet_manager.cc:1403] T ea3bb46b177b4bbdaa60f464370aa9a0 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.000s
I20260709 13:02:55.531802  9856 raft_consensus.cc:359] T ea3bb46b177b4bbdaa60f464370aa9a0 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:55.532610  9856 raft_consensus.cc:740] T ea3bb46b177b4bbdaa60f464370aa9a0 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Initialized, Role: FOLLOWER
I20260709 13:02:55.533352  9856 consensus_queue.cc:260] T ea3bb46b177b4bbdaa60f464370aa9a0 P 65ed95869fbb4b69b5d6eb99c51adf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:55.535756  9856 ts_tablet_manager.cc:1434] T ea3bb46b177b4bbdaa60f464370aa9a0 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:02:55.536595  9856 tablet_bootstrap.cc:492] T e6ee00de30e149f58789799810d595a4 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap starting.
W20260709 13:02:55.539618  9215 leader_election.cc:336] T 070a6f2020a1483381e2baa75e5c0cbf P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33979: connect: Connection refused (error 111)
I20260709 13:02:55.540072  9215 leader_election.cc:304] T 070a6f2020a1483381e2baa75e5c0cbf P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8846d581359a4b7ea6d4c33424ea825d; no voters: 65ed95869fbb4b69b5d6eb99c51adf85, c694531b0e1d47988b291f1214efc4cb
I20260709 13:02:55.540664  9836 raft_consensus.cc:2749] T 070a6f2020a1483381e2baa75e5c0cbf P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:55.553184  9856 tablet_bootstrap.cc:492] T e6ee00de30e149f58789799810d595a4 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:55.554337  9856 tablet_bootstrap.cc:492] T e6ee00de30e149f58789799810d595a4 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap complete.
I20260709 13:02:55.555095  9856 ts_tablet_manager.cc:1403] T e6ee00de30e149f58789799810d595a4 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent bootstrapping tablet: real 0.019s	user 0.018s	sys 0.000s
I20260709 13:02:55.557883  9856 raft_consensus.cc:359] T e6ee00de30e149f58789799810d595a4 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:55.558694  9856 raft_consensus.cc:740] T e6ee00de30e149f58789799810d595a4 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Initialized, Role: FOLLOWER
I20260709 13:02:55.559440  9856 consensus_queue.cc:260] T e6ee00de30e149f58789799810d595a4 P 65ed95869fbb4b69b5d6eb99c51adf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:55.561877  9856 ts_tablet_manager.cc:1434] T e6ee00de30e149f58789799810d595a4 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:02:55.562841  9856 tablet_bootstrap.cc:492] T 389a20133d8b4ebfaab346741dff367f P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap starting.
I20260709 13:02:55.585968  9856 tablet_bootstrap.cc:492] T 389a20133d8b4ebfaab346741dff367f P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:55.587087  9856 tablet_bootstrap.cc:492] T 389a20133d8b4ebfaab346741dff367f P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap complete.
I20260709 13:02:55.587826  9856 ts_tablet_manager.cc:1403] T 389a20133d8b4ebfaab346741dff367f P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent bootstrapping tablet: real 0.025s	user 0.020s	sys 0.004s
I20260709 13:02:55.590544  9856 raft_consensus.cc:359] T 389a20133d8b4ebfaab346741dff367f P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:55.591336  9856 raft_consensus.cc:740] T 389a20133d8b4ebfaab346741dff367f P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Initialized, Role: FOLLOWER
I20260709 13:02:55.592160  9856 consensus_queue.cc:260] T 389a20133d8b4ebfaab346741dff367f P 65ed95869fbb4b69b5d6eb99c51adf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:55.594622  9856 ts_tablet_manager.cc:1434] T 389a20133d8b4ebfaab346741dff367f P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:02:55.595485  9856 tablet_bootstrap.cc:492] T d26bd321e5604f8aa61723f418be35a9 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap starting.
I20260709 13:02:55.610811  9856 tablet_bootstrap.cc:492] T d26bd321e5604f8aa61723f418be35a9 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:55.611759  9856 tablet_bootstrap.cc:492] T d26bd321e5604f8aa61723f418be35a9 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap complete.
I20260709 13:02:55.612389  9856 ts_tablet_manager.cc:1403] T d26bd321e5604f8aa61723f418be35a9 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.006s
I20260709 13:02:55.614758  9856 raft_consensus.cc:359] T d26bd321e5604f8aa61723f418be35a9 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:55.615475  9856 raft_consensus.cc:740] T d26bd321e5604f8aa61723f418be35a9 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Initialized, Role: FOLLOWER
I20260709 13:02:55.615283  9738 raft_consensus.cc:493] T 070a6f2020a1483381e2baa75e5c0cbf P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65ed95869fbb4b69b5d6eb99c51adf85)
I20260709 13:02:55.616171  9856 consensus_queue.cc:260] T d26bd321e5604f8aa61723f418be35a9 P 65ed95869fbb4b69b5d6eb99c51adf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:55.616876  9738 raft_consensus.cc:515] T 070a6f2020a1483381e2baa75e5c0cbf P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:55.618177  9856 ts_tablet_manager.cc:1434] T d26bd321e5604f8aa61723f418be35a9 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:02:55.619059  9738 leader_election.cc:290] T 070a6f2020a1483381e2baa75e5c0cbf P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979), 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311)
I20260709 13:02:55.620635  9250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070a6f2020a1483381e2baa75e5c0cbf" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d" is_pre_election: true
I20260709 13:02:55.621290  9250 raft_consensus.cc:2468] T 070a6f2020a1483381e2baa75e5c0cbf P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c694531b0e1d47988b291f1214efc4cb in term 1.
I20260709 13:02:55.622505  9139 leader_election.cc:304] T 070a6f2020a1483381e2baa75e5c0cbf P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8846d581359a4b7ea6d4c33424ea825d, c694531b0e1d47988b291f1214efc4cb; no voters: 
I20260709 13:02:55.623338  9738 raft_consensus.cc:2804] T 070a6f2020a1483381e2baa75e5c0cbf P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:55.623396  9856 tablet_bootstrap.cc:492] T b3f19df7d93748a1802678c56b5e2208 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap starting.
W20260709 13:02:55.623572  9141 leader_election.cc:336] T 070a6f2020a1483381e2baa75e5c0cbf P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33979: connect: Connection refused (error 111)
I20260709 13:02:55.624650  9738 raft_consensus.cc:493] T 070a6f2020a1483381e2baa75e5c0cbf P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 65ed95869fbb4b69b5d6eb99c51adf85)
I20260709 13:02:55.625077  9738 raft_consensus.cc:3060] T 070a6f2020a1483381e2baa75e5c0cbf P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:55.639348  9738 raft_consensus.cc:515] T 070a6f2020a1483381e2baa75e5c0cbf P c694531b0e1d47988b291f1214efc4cb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:55.645704  9250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070a6f2020a1483381e2baa75e5c0cbf" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d"
I20260709 13:02:55.646395  9250 raft_consensus.cc:3060] T 070a6f2020a1483381e2baa75e5c0cbf P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:55.646098  9738 leader_election.cc:290] T 070a6f2020a1483381e2baa75e5c0cbf P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 2 election: Requested vote from peers 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979), 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311)
W20260709 13:02:55.648141  9141 leader_election.cc:336] T 070a6f2020a1483381e2baa75e5c0cbf P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33979: connect: Connection refused (error 111)
I20260709 13:02:55.651012  9856 tablet_bootstrap.cc:492] T b3f19df7d93748a1802678c56b5e2208 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:55.652024  9856 tablet_bootstrap.cc:492] T b3f19df7d93748a1802678c56b5e2208 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap complete.
I20260709 13:02:55.654125  9856 ts_tablet_manager.cc:1403] T b3f19df7d93748a1802678c56b5e2208 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent bootstrapping tablet: real 0.031s	user 0.021s	sys 0.004s
I20260709 13:02:55.654350  9250 raft_consensus.cc:2468] T 070a6f2020a1483381e2baa75e5c0cbf P 8846d581359a4b7ea6d4c33424ea825d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c694531b0e1d47988b291f1214efc4cb in term 2.
I20260709 13:02:55.655758  9139 leader_election.cc:304] T 070a6f2020a1483381e2baa75e5c0cbf P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8846d581359a4b7ea6d4c33424ea825d, c694531b0e1d47988b291f1214efc4cb; no voters: 65ed95869fbb4b69b5d6eb99c51adf85
I20260709 13:02:55.656921  9887 raft_consensus.cc:2804] T 070a6f2020a1483381e2baa75e5c0cbf P c694531b0e1d47988b291f1214efc4cb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:55.657415  9887 raft_consensus.cc:697] T 070a6f2020a1483381e2baa75e5c0cbf P c694531b0e1d47988b291f1214efc4cb [term 2 LEADER]: Becoming Leader. State: Replica: c694531b0e1d47988b291f1214efc4cb, State: Running, Role: LEADER
I20260709 13:02:55.657590  9856 raft_consensus.cc:359] T b3f19df7d93748a1802678c56b5e2208 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:55.658339  9856 raft_consensus.cc:740] T b3f19df7d93748a1802678c56b5e2208 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Initialized, Role: FOLLOWER
I20260709 13:02:55.659013  9856 consensus_queue.cc:260] T b3f19df7d93748a1802678c56b5e2208 P 65ed95869fbb4b69b5d6eb99c51adf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:55.661059  9856 ts_tablet_manager.cc:1434] T b3f19df7d93748a1802678c56b5e2208 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:02:55.662137  9856 tablet_bootstrap.cc:492] T 6f8b7d72409f45eebf4208f98310f378 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap starting.
I20260709 13:02:55.666967  9887 consensus_queue.cc:237] T 070a6f2020a1483381e2baa75e5c0cbf P c694531b0e1d47988b291f1214efc4cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:55.669348  9684 raft_consensus.cc:493] T 76b3d3cd810b46dbac2b534c0be568d2 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65ed95869fbb4b69b5d6eb99c51adf85)
I20260709 13:02:55.669946  9684 raft_consensus.cc:515] T 76b3d3cd810b46dbac2b534c0be568d2 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:55.673269  9249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76b3d3cd810b46dbac2b534c0be568d2" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d" is_pre_election: true
I20260709 13:02:55.685803  9741 raft_consensus.cc:493] T 604bd81da85244b6bd6d8bd6ac674f2c P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65ed95869fbb4b69b5d6eb99c51adf85)
I20260709 13:02:55.686465  9741 raft_consensus.cc:515] T 604bd81da85244b6bd6d8bd6ac674f2c P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:55.688753  9741 leader_election.cc:290] T 604bd81da85244b6bd6d8bd6ac674f2c P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979), 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311)
I20260709 13:02:55.693795  9249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604bd81da85244b6bd6d8bd6ac674f2c" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d" is_pre_election: true
W20260709 13:02:55.699292  9141 leader_election.cc:336] T 604bd81da85244b6bd6d8bd6ac674f2c P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33979: connect: Connection refused (error 111)
W20260709 13:02:55.700987  9289 leader_election.cc:336] T 76b3d3cd810b46dbac2b534c0be568d2 P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33979: connect: Connection refused (error 111)
I20260709 13:02:55.701583  9289 leader_election.cc:304] T 76b3d3cd810b46dbac2b534c0be568d2 P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57; no voters: 65ed95869fbb4b69b5d6eb99c51adf85, 8846d581359a4b7ea6d4c33424ea825d
I20260709 13:02:55.702386  9857 raft_consensus.cc:2749] T 76b3d3cd810b46dbac2b534c0be568d2 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:55.708300  9139 leader_election.cc:304] T 604bd81da85244b6bd6d8bd6ac674f2c P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c694531b0e1d47988b291f1214efc4cb; no voters: 65ed95869fbb4b69b5d6eb99c51adf85, 8846d581359a4b7ea6d4c33424ea825d
I20260709 13:02:55.712421  9836 raft_consensus.cc:493] T 604bd81da85244b6bd6d8bd6ac674f2c P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65ed95869fbb4b69b5d6eb99c51adf85)
I20260709 13:02:55.713173  9836 raft_consensus.cc:515] T 604bd81da85244b6bd6d8bd6ac674f2c P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:55.716465  9654 raft_consensus.cc:2749] T 604bd81da85244b6bd6d8bd6ac674f2c P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:55.740842  9836 leader_election.cc:290] T 604bd81da85244b6bd6d8bd6ac674f2c P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979), c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455)
I20260709 13:02:55.750036  9172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604bd81da85244b6bd6d8bd6ac674f2c" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c694531b0e1d47988b291f1214efc4cb" is_pre_election: true
I20260709 13:02:55.751159  9172 raft_consensus.cc:2468] T 604bd81da85244b6bd6d8bd6ac674f2c P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8846d581359a4b7ea6d4c33424ea825d in term 1.
I20260709 13:02:55.752635  9214 leader_election.cc:304] T 604bd81da85244b6bd6d8bd6ac674f2c P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8846d581359a4b7ea6d4c33424ea825d, c694531b0e1d47988b291f1214efc4cb; no voters: 
I20260709 13:02:55.754151  9858 raft_consensus.cc:2804] T 604bd81da85244b6bd6d8bd6ac674f2c P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:55.754626  9858 raft_consensus.cc:493] T 604bd81da85244b6bd6d8bd6ac674f2c P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 65ed95869fbb4b69b5d6eb99c51adf85)
I20260709 13:02:55.755021  9858 raft_consensus.cc:3060] T 604bd81da85244b6bd6d8bd6ac674f2c P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:55.757669  9684 leader_election.cc:290] T 76b3d3cd810b46dbac2b534c0be568d2 P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311), 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979)
I20260709 13:02:55.764649  9858 raft_consensus.cc:515] T 604bd81da85244b6bd6d8bd6ac674f2c P 8846d581359a4b7ea6d4c33424ea825d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:55.770609  9173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604bd81da85244b6bd6d8bd6ac674f2c" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c694531b0e1d47988b291f1214efc4cb"
I20260709 13:02:55.771440  9173 raft_consensus.cc:3060] T 604bd81da85244b6bd6d8bd6ac674f2c P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:55.775166  9857 raft_consensus.cc:493] T b3f19df7d93748a1802678c56b5e2208 P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 65ed95869fbb4b69b5d6eb99c51adf85)
I20260709 13:02:55.775955  9857 raft_consensus.cc:515] T b3f19df7d93748a1802678c56b5e2208 P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:55.778357  9857 leader_election.cc:290] T b3f19df7d93748a1802678c56b5e2208 P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311), 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979)
I20260709 13:02:55.787914  9173 raft_consensus.cc:2468] T 604bd81da85244b6bd6d8bd6ac674f2c P c694531b0e1d47988b291f1214efc4cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8846d581359a4b7ea6d4c33424ea825d in term 2.
I20260709 13:02:55.800261  9214 leader_election.cc:304] T 604bd81da85244b6bd6d8bd6ac674f2c P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8846d581359a4b7ea6d4c33424ea825d, c694531b0e1d47988b291f1214efc4cb; no voters: 
I20260709 13:02:55.800076  9858 leader_election.cc:290] T 604bd81da85244b6bd6d8bd6ac674f2c P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 2 election: Requested vote from peers 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979), c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455)
I20260709 13:02:55.801621  9858 raft_consensus.cc:2804] T 604bd81da85244b6bd6d8bd6ac674f2c P 8846d581359a4b7ea6d4c33424ea825d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:55.802312  9858 raft_consensus.cc:697] T 604bd81da85244b6bd6d8bd6ac674f2c P 8846d581359a4b7ea6d4c33424ea825d [term 2 LEADER]: Becoming Leader. State: Replica: 8846d581359a4b7ea6d4c33424ea825d, State: Running, Role: LEADER
I20260709 13:02:55.803447  9858 consensus_queue.cc:237] T 604bd81da85244b6bd6d8bd6ac674f2c P 8846d581359a4b7ea6d4c33424ea825d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:55.805470  9916 raft_consensus.cc:493] T 9dea45dda5454393bdfaed3f233a30a5 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65ed95869fbb4b69b5d6eb99c51adf85)
I20260709 13:02:55.806094  9916 raft_consensus.cc:515] T 9dea45dda5454393bdfaed3f233a30a5 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:55.808490  9738 raft_consensus.cc:493] T d2ef0242573643178d56d10a6c26ae8e P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65ed95869fbb4b69b5d6eb99c51adf85)
I20260709 13:02:55.809170  9738 raft_consensus.cc:515] T d2ef0242573643178d56d10a6c26ae8e P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:55.812034  9916 leader_election.cc:290] T 9dea45dda5454393bdfaed3f233a30a5 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979), 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311)
W20260709 13:02:55.813508  9141 leader_election.cc:336] T 9dea45dda5454393bdfaed3f233a30a5 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33979: connect: Connection refused (error 111)
I20260709 13:02:55.814509  9738 leader_election.cc:290] T d2ef0242573643178d56d10a6c26ae8e P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351), 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979)
W20260709 13:02:55.817416  9215 leader_election.cc:336] T 604bd81da85244b6bd6d8bd6ac674f2c P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33979: connect: Connection refused (error 111)
W20260709 13:02:55.824108  9141 leader_election.cc:336] T d2ef0242573643178d56d10a6c26ae8e P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33979: connect: Connection refused (error 111)
I20260709 13:02:55.825816  9914 raft_consensus.cc:493] T 76b3d3cd810b46dbac2b534c0be568d2 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65ed95869fbb4b69b5d6eb99c51adf85)
I20260709 13:02:55.826491  9914 raft_consensus.cc:515] T 76b3d3cd810b46dbac2b534c0be568d2 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:55.828851  9914 leader_election.cc:290] T 76b3d3cd810b46dbac2b534c0be568d2 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351), 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979)
I20260709 13:02:55.844167  9249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dea45dda5454393bdfaed3f233a30a5" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d" is_pre_election: true
I20260709 13:02:55.845654  8997 catalog_manager.cc:5697] T 604bd81da85244b6bd6d8bd6ac674f2c P 8846d581359a4b7ea6d4c33424ea825d reported cstate change: term changed from 1 to 2, leader changed from 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193) to 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195). New cstate: current_term: 2 leader_uuid: "8846d581359a4b7ea6d4c33424ea825d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:55.846699  9139 leader_election.cc:304] T 9dea45dda5454393bdfaed3f233a30a5 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c694531b0e1d47988b291f1214efc4cb; no voters: 65ed95869fbb4b69b5d6eb99c51adf85, 8846d581359a4b7ea6d4c33424ea825d
I20260709 13:02:55.848718  9684 raft_consensus.cc:493] T 7f278d22c55747ee8ee613bfa5c59391 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65ed95869fbb4b69b5d6eb99c51adf85)
I20260709 13:02:55.849848  9684 raft_consensus.cc:515] T 7f278d22c55747ee8ee613bfa5c59391 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:55.848766  9654 raft_consensus.cc:2749] T 9dea45dda5454393bdfaed3f233a30a5 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:55.855790  9684 leader_election.cc:290] T 7f278d22c55747ee8ee613bfa5c59391 P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979), c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455)
I20260709 13:02:55.859920  9249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f19df7d93748a1802678c56b5e2208" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d" is_pre_election: true
I20260709 13:02:55.861116  9654 raft_consensus.cc:493] T 7f278d22c55747ee8ee613bfa5c59391 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65ed95869fbb4b69b5d6eb99c51adf85)
I20260709 13:02:55.862075  9654 raft_consensus.cc:515] T 7f278d22c55747ee8ee613bfa5c59391 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:55.864682  9654 leader_election.cc:290] T 7f278d22c55747ee8ee613bfa5c59391 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351), 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979)
I20260709 13:02:55.864807  9319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76b3d3cd810b46dbac2b534c0be568d2" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57" is_pre_election: true
I20260709 13:02:55.866750  9319 raft_consensus.cc:2468] T 76b3d3cd810b46dbac2b534c0be568d2 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8846d581359a4b7ea6d4c33424ea825d in term 1.
I20260709 13:02:55.865244  9857 raft_consensus.cc:493] T 5ce2a33a3b914f6297946ded34c256bf P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65ed95869fbb4b69b5d6eb99c51adf85)
I20260709 13:02:55.868453  9857 raft_consensus.cc:515] T 5ce2a33a3b914f6297946ded34c256bf P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
W20260709 13:02:55.872305  9141 leader_election.cc:336] T 7f278d22c55747ee8ee613bfa5c59391 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33979: connect: Connection refused (error 111)
I20260709 13:02:55.865720  9684 raft_consensus.cc:493] T 9d21e8696b0340bea31002b775af50ee P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65ed95869fbb4b69b5d6eb99c51adf85)
I20260709 13:02:55.873196  9859 raft_consensus.cc:493] T 534ae119bf014235a99dfbbfcff690e1 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65ed95869fbb4b69b5d6eb99c51adf85)
I20260709 13:02:55.874810  9172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f278d22c55747ee8ee613bfa5c59391" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c694531b0e1d47988b291f1214efc4cb" is_pre_election: true
I20260709 13:02:55.875523  9172 raft_consensus.cc:2468] T 7f278d22c55747ee8ee613bfa5c59391 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74ac2cf163ee475e8a280cb3aa738f57 in term 1.
I20260709 13:02:55.878090  9319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2ef0242573643178d56d10a6c26ae8e" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57" is_pre_election: true
I20260709 13:02:55.880543  9321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f278d22c55747ee8ee613bfa5c59391" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57" is_pre_election: true
I20260709 13:02:55.881232  9321 raft_consensus.cc:2468] T 7f278d22c55747ee8ee613bfa5c59391 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c694531b0e1d47988b291f1214efc4cb in term 1.
I20260709 13:02:55.884734  9288 leader_election.cc:304] T 7f278d22c55747ee8ee613bfa5c59391 P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57, c694531b0e1d47988b291f1214efc4cb; no voters: 
I20260709 13:02:55.874162  9859 raft_consensus.cc:515] T 534ae119bf014235a99dfbbfcff690e1 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:55.891104  9858 raft_consensus.cc:493] T 9d21e8696b0340bea31002b775af50ee P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65ed95869fbb4b69b5d6eb99c51adf85)
I20260709 13:02:55.891812  9858 raft_consensus.cc:515] T 9d21e8696b0340bea31002b775af50ee P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:55.892745  9859 leader_election.cc:290] T 534ae119bf014235a99dfbbfcff690e1 P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311), 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979)
I20260709 13:02:55.893652  9859 raft_consensus.cc:2804] T 7f278d22c55747ee8ee613bfa5c59391 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:55.894129  9858 leader_election.cc:290] T 9d21e8696b0340bea31002b775af50ee P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351), 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979)
I20260709 13:02:55.894164  9859 raft_consensus.cc:493] T 7f278d22c55747ee8ee613bfa5c59391 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 65ed95869fbb4b69b5d6eb99c51adf85)
I20260709 13:02:55.896742  9859 raft_consensus.cc:3060] T 7f278d22c55747ee8ee613bfa5c59391 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:55.902982  9684 raft_consensus.cc:515] T 9d21e8696b0340bea31002b775af50ee P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:55.912173  9684 leader_election.cc:290] T 9d21e8696b0340bea31002b775af50ee P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311), 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979)
I20260709 13:02:55.917289  9857 leader_election.cc:290] T 5ce2a33a3b914f6297946ded34c256bf P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311), 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979)
I20260709 13:02:55.920280  9858 raft_consensus.cc:493] T 5ce2a33a3b914f6297946ded34c256bf P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65ed95869fbb4b69b5d6eb99c51adf85)
I20260709 13:02:55.935643  8997 catalog_manager.cc:5697] T 070a6f2020a1483381e2baa75e5c0cbf P c694531b0e1d47988b291f1214efc4cb reported cstate change: term changed from 1 to 2, leader changed from 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193) to c694531b0e1d47988b291f1214efc4cb (127.0.107.194). New cstate: current_term: 2 leader_uuid: "c694531b0e1d47988b291f1214efc4cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:55.921427  9215 leader_election.cc:304] T 76b3d3cd810b46dbac2b534c0be568d2 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57, 8846d581359a4b7ea6d4c33424ea825d; no voters: 
I20260709 13:02:55.936636  9858 raft_consensus.cc:515] T 5ce2a33a3b914f6297946ded34c256bf P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
W20260709 13:02:55.938323  9289 leader_election.cc:336] T b3f19df7d93748a1802678c56b5e2208 P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33979: connect: Connection refused (error 111)
I20260709 13:02:55.938835  9914 raft_consensus.cc:2804] T 76b3d3cd810b46dbac2b534c0be568d2 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:55.939263  9914 raft_consensus.cc:493] T 76b3d3cd810b46dbac2b534c0be568d2 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 65ed95869fbb4b69b5d6eb99c51adf85)
I20260709 13:02:55.939649  9914 raft_consensus.cc:3060] T 76b3d3cd810b46dbac2b534c0be568d2 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:02:55.939980  9215 leader_election.cc:336] T 604bd81da85244b6bd6d8bd6ac674f2c P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33979: connect: Connection refused (error 111)
I20260709 13:02:55.927502  9836 raft_consensus.cc:493] T b3f19df7d93748a1802678c56b5e2208 P 8846d581359a4b7ea6d4c33424ea825d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 65ed95869fbb4b69b5d6eb99c51adf85)
I20260709 13:02:55.938829  9289 leader_election.cc:304] T b3f19df7d93748a1802678c56b5e2208 P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57; no voters: 65ed95869fbb4b69b5d6eb99c51adf85, 8846d581359a4b7ea6d4c33424ea825d
I20260709 13:02:55.943368  9836 raft_consensus.cc:515] T b3f19df7d93748a1802678c56b5e2208 P 8846d581359a4b7ea6d4c33424ea825d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:55.945523  9836 leader_election.cc:290] T b3f19df7d93748a1802678c56b5e2208 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351), 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979)
I20260709 13:02:55.948328  9141 leader_election.cc:304] T d2ef0242573643178d56d10a6c26ae8e P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c694531b0e1d47988b291f1214efc4cb; no voters: 65ed95869fbb4b69b5d6eb99c51adf85, 74ac2cf163ee475e8a280cb3aa738f57
I20260709 13:02:55.949127  9887 raft_consensus.cc:2749] T d2ef0242573643178d56d10a6c26ae8e P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:55.951073  9249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce2a33a3b914f6297946ded34c256bf" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d" is_pre_election: true
I20260709 13:02:55.951457  9250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534ae119bf014235a99dfbbfcff690e1" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d" is_pre_election: true
I20260709 13:02:55.951799  9249 raft_consensus.cc:2468] T 5ce2a33a3b914f6297946ded34c256bf P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74ac2cf163ee475e8a280cb3aa738f57 in term 1.
I20260709 13:02:55.952919  9249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d21e8696b0340bea31002b775af50ee" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d" is_pre_election: true
W20260709 13:02:55.953725  9215 leader_election.cc:336] T 76b3d3cd810b46dbac2b534c0be568d2 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33979: connect: Connection refused (error 111)
I20260709 13:02:55.953473  9249 raft_consensus.cc:2468] T 9d21e8696b0340bea31002b775af50ee P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74ac2cf163ee475e8a280cb3aa738f57 in term 1.
W20260709 13:02:55.951042  9289 leader_election.cc:336] T 7f278d22c55747ee8ee613bfa5c59391 P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33979: connect: Connection refused (error 111)
I20260709 13:02:55.957247  9141 leader_election.cc:304] T 7f278d22c55747ee8ee613bfa5c59391 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57, c694531b0e1d47988b291f1214efc4cb; no voters: 65ed95869fbb4b69b5d6eb99c51adf85
I20260709 13:02:55.958009  9654 raft_consensus.cc:2804] T 7f278d22c55747ee8ee613bfa5c59391 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:55.958341  9654 raft_consensus.cc:493] T 7f278d22c55747ee8ee613bfa5c59391 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 65ed95869fbb4b69b5d6eb99c51adf85)
I20260709 13:02:55.958637  9654 raft_consensus.cc:3060] T 7f278d22c55747ee8ee613bfa5c59391 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:55.960417  9858 leader_election.cc:290] T 5ce2a33a3b914f6297946ded34c256bf P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351), 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979)
I20260709 13:02:55.965631  9654 raft_consensus.cc:515] T 7f278d22c55747ee8ee613bfa5c59391 P c694531b0e1d47988b291f1214efc4cb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
W20260709 13:02:55.955735  9289 leader_election.cc:336] T 534ae119bf014235a99dfbbfcff690e1 P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33979: connect: Connection refused (error 111)
W20260709 13:02:55.967829  9289 leader_election.cc:336] T 9d21e8696b0340bea31002b775af50ee P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33979: connect: Connection refused (error 111)
W20260709 13:02:55.968286  9289 leader_election.cc:336] T 5ce2a33a3b914f6297946ded34c256bf P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33979: connect: Connection refused (error 111)
W20260709 13:02:55.970325  9215 leader_election.cc:336] T 9d21e8696b0340bea31002b775af50ee P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33979: connect: Connection refused (error 111)
I20260709 13:02:55.970459  9654 leader_election.cc:290] T 7f278d22c55747ee8ee613bfa5c59391 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 2 election: Requested vote from peers 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351), 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979)
I20260709 13:02:55.971441  9836 raft_consensus.cc:493] T 9dea45dda5454393bdfaed3f233a30a5 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65ed95869fbb4b69b5d6eb99c51adf85)
I20260709 13:02:55.972038  9836 raft_consensus.cc:515] T 9dea45dda5454393bdfaed3f233a30a5 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:55.975667  9319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f278d22c55747ee8ee613bfa5c59391" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57"
I20260709 13:02:55.976768  9173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dea45dda5454393bdfaed3f233a30a5" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c694531b0e1d47988b291f1214efc4cb" is_pre_election: true
W20260709 13:02:55.977598  9215 leader_election.cc:336] T b3f19df7d93748a1802678c56b5e2208 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33979: connect: Connection refused (error 111)
W20260709 13:02:55.978010  9141 leader_election.cc:336] T 7f278d22c55747ee8ee613bfa5c59391 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33979: connect: Connection refused (error 111)
I20260709 13:02:55.979243  9857 raft_consensus.cc:2749] T b3f19df7d93748a1802678c56b5e2208 P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:55.980675  9832 raft_consensus.cc:493] T 534ae119bf014235a99dfbbfcff690e1 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65ed95869fbb4b69b5d6eb99c51adf85)
I20260709 13:02:55.981271  9832 raft_consensus.cc:515] T 534ae119bf014235a99dfbbfcff690e1 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:55.974385  9914 raft_consensus.cc:515] T 76b3d3cd810b46dbac2b534c0be568d2 P 8846d581359a4b7ea6d4c33424ea825d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
W20260709 13:02:55.982791  9215 leader_election.cc:336] T 5ce2a33a3b914f6297946ded34c256bf P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33979: connect: Connection refused (error 111)
I20260709 13:02:55.984017  9832 leader_election.cc:290] T 534ae119bf014235a99dfbbfcff690e1 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351), 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979)
W20260709 13:02:55.984238  9215 leader_election.cc:336] T 9dea45dda5454393bdfaed3f233a30a5 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33979: connect: Connection refused (error 111)
I20260709 13:02:55.977540  9173 raft_consensus.cc:2468] T 9dea45dda5454393bdfaed3f233a30a5 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8846d581359a4b7ea6d4c33424ea825d in term 1.
I20260709 13:02:55.987346  9214 leader_election.cc:304] T 9dea45dda5454393bdfaed3f233a30a5 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8846d581359a4b7ea6d4c33424ea825d, c694531b0e1d47988b291f1214efc4cb; no voters: 65ed95869fbb4b69b5d6eb99c51adf85
I20260709 13:02:55.988308  9858 raft_consensus.cc:2804] T 9dea45dda5454393bdfaed3f233a30a5 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:55.988804  9858 raft_consensus.cc:493] T 9dea45dda5454393bdfaed3f233a30a5 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 65ed95869fbb4b69b5d6eb99c51adf85)
I20260709 13:02:55.989219  9858 raft_consensus.cc:3060] T 9dea45dda5454393bdfaed3f233a30a5 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:55.991349  9836 leader_election.cc:290] T 9dea45dda5454393bdfaed3f233a30a5 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979), c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455)
W20260709 13:02:55.991782  9215 leader_election.cc:336] T 534ae119bf014235a99dfbbfcff690e1 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33979: connect: Connection refused (error 111)
W20260709 13:02:55.992317  9288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33455, user_credentials={real_user=slave}} blocked reactor thread for 107657us
I20260709 13:02:55.993582  9287 leader_election.cc:304] T 534ae119bf014235a99dfbbfcff690e1 P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57; no voters: 65ed95869fbb4b69b5d6eb99c51adf85, 8846d581359a4b7ea6d4c33424ea825d
I20260709 13:02:55.995358  9925 raft_consensus.cc:2749] T 534ae119bf014235a99dfbbfcff690e1 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:55.997449  9914 leader_election.cc:290] T 76b3d3cd810b46dbac2b534c0be568d2 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 2 election: Requested vote from peers 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351), 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979)
I20260709 13:02:55.999087  9856 tablet_bootstrap.cc:492] T 6f8b7d72409f45eebf4208f98310f378 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:55.999446  9858 raft_consensus.cc:515] T 9dea45dda5454393bdfaed3f233a30a5 P 8846d581359a4b7ea6d4c33424ea825d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:56.000159  9856 tablet_bootstrap.cc:492] T 6f8b7d72409f45eebf4208f98310f378 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap complete.
I20260709 13:02:56.000902  9856 ts_tablet_manager.cc:1403] T 6f8b7d72409f45eebf4208f98310f378 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent bootstrapping tablet: real 0.339s	user 0.032s	sys 0.046s
W20260709 13:02:56.002755  9215 leader_election.cc:336] T 76b3d3cd810b46dbac2b534c0be568d2 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33979: connect: Connection refused (error 111)
I20260709 13:02:56.005455  9859 raft_consensus.cc:515] T 7f278d22c55747ee8ee613bfa5c59391 P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:56.006623  9173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dea45dda5454393bdfaed3f233a30a5" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c694531b0e1d47988b291f1214efc4cb"
I20260709 13:02:56.007381  9287 leader_election.cc:304] T 5ce2a33a3b914f6297946ded34c256bf P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57, 8846d581359a4b7ea6d4c33424ea825d; no voters: 65ed95869fbb4b69b5d6eb99c51adf85
I20260709 13:02:56.008610  9173 raft_consensus.cc:3060] T 9dea45dda5454393bdfaed3f233a30a5 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:56.009275  9287 leader_election.cc:304] T 9d21e8696b0340bea31002b775af50ee P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57, 8846d581359a4b7ea6d4c33424ea825d; no voters: 65ed95869fbb4b69b5d6eb99c51adf85
I20260709 13:02:56.008096  9858 leader_election.cc:290] T 9dea45dda5454393bdfaed3f233a30a5 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 2 election: Requested vote from peers 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979), c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455)
W20260709 13:02:56.009996  9215 leader_election.cc:336] T 9dea45dda5454393bdfaed3f233a30a5 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33979: connect: Connection refused (error 111)
I20260709 13:02:56.010887  9321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d21e8696b0340bea31002b775af50ee" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57" is_pre_election: true
I20260709 13:02:56.011535  9321 raft_consensus.cc:2468] T 9d21e8696b0340bea31002b775af50ee P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8846d581359a4b7ea6d4c33424ea825d in term 1.
I20260709 13:02:56.016322  9321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f19df7d93748a1802678c56b5e2208" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57" is_pre_election: true
I20260709 13:02:56.017081  9321 raft_consensus.cc:2468] T b3f19df7d93748a1802678c56b5e2208 P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8846d581359a4b7ea6d4c33424ea825d in term 2.
I20260709 13:02:56.017360  9173 raft_consensus.cc:2468] T 9dea45dda5454393bdfaed3f233a30a5 P c694531b0e1d47988b291f1214efc4cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8846d581359a4b7ea6d4c33424ea825d in term 2.
I20260709 13:02:56.018494  9321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce2a33a3b914f6297946ded34c256bf" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57" is_pre_election: true
I20260709 13:02:56.018916  9214 leader_election.cc:304] T 9dea45dda5454393bdfaed3f233a30a5 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8846d581359a4b7ea6d4c33424ea825d, c694531b0e1d47988b291f1214efc4cb; no voters: 65ed95869fbb4b69b5d6eb99c51adf85
I20260709 13:02:56.019176  9321 raft_consensus.cc:2468] T 5ce2a33a3b914f6297946ded34c256bf P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8846d581359a4b7ea6d4c33424ea825d in term 1.
I20260709 13:02:56.019686  9858 raft_consensus.cc:2804] T 9dea45dda5454393bdfaed3f233a30a5 P 8846d581359a4b7ea6d4c33424ea825d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:56.020211  9858 raft_consensus.cc:697] T 9dea45dda5454393bdfaed3f233a30a5 P 8846d581359a4b7ea6d4c33424ea825d [term 2 LEADER]: Becoming Leader. State: Replica: 8846d581359a4b7ea6d4c33424ea825d, State: Running, Role: LEADER
I20260709 13:02:56.021238  9321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534ae119bf014235a99dfbbfcff690e1" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57" is_pre_election: true
I20260709 13:02:56.021960  9321 raft_consensus.cc:2468] T 534ae119bf014235a99dfbbfcff690e1 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8846d581359a4b7ea6d4c33424ea825d in term 1.
I20260709 13:02:56.023559  9925 raft_consensus.cc:2804] T 5ce2a33a3b914f6297946ded34c256bf P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:56.024051  9925 raft_consensus.cc:493] T 5ce2a33a3b914f6297946ded34c256bf P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 65ed95869fbb4b69b5d6eb99c51adf85)
I20260709 13:02:56.024406  9925 raft_consensus.cc:3060] T 5ce2a33a3b914f6297946ded34c256bf P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:56.023635  9321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76b3d3cd810b46dbac2b534c0be568d2" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57"
I20260709 13:02:56.021261  9858 consensus_queue.cc:237] T 9dea45dda5454393bdfaed3f233a30a5 P 8846d581359a4b7ea6d4c33424ea825d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:56.028472  9857 raft_consensus.cc:2804] T 9d21e8696b0340bea31002b775af50ee P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:56.031522  9857 raft_consensus.cc:493] T 9d21e8696b0340bea31002b775af50ee P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 65ed95869fbb4b69b5d6eb99c51adf85)
I20260709 13:02:56.031977  9857 raft_consensus.cc:3060] T 9d21e8696b0340bea31002b775af50ee P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:56.028493  9321 raft_consensus.cc:3060] T 76b3d3cd810b46dbac2b534c0be568d2 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:56.034602  9215 leader_election.cc:304] T 9d21e8696b0340bea31002b775af50ee P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57, 8846d581359a4b7ea6d4c33424ea825d; no voters: 65ed95869fbb4b69b5d6eb99c51adf85
I20260709 13:02:56.035029  9319 raft_consensus.cc:2393] T 7f278d22c55747ee8ee613bfa5c59391 P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c694531b0e1d47988b291f1214efc4cb in current term 2: Already voted for candidate 74ac2cf163ee475e8a280cb3aa738f57 in this term.
I20260709 13:02:56.036465  9925 raft_consensus.cc:515] T 5ce2a33a3b914f6297946ded34c256bf P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:56.038937  9925 leader_election.cc:290] T 5ce2a33a3b914f6297946ded34c256bf P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 2 election: Requested vote from peers 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311), 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979)
I20260709 13:02:56.039801  9914 raft_consensus.cc:2804] T 9d21e8696b0340bea31002b775af50ee P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:56.040174  9914 raft_consensus.cc:493] T 9d21e8696b0340bea31002b775af50ee P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 65ed95869fbb4b69b5d6eb99c51adf85)
I20260709 13:02:56.040560  9914 raft_consensus.cc:3060] T 9d21e8696b0340bea31002b775af50ee P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:56.044584  9215 leader_election.cc:304] T b3f19df7d93748a1802678c56b5e2208 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57, 8846d581359a4b7ea6d4c33424ea825d; no voters: 65ed95869fbb4b69b5d6eb99c51adf85
I20260709 13:02:56.045748  9836 raft_consensus.cc:2804] T b3f19df7d93748a1802678c56b5e2208 P 8846d581359a4b7ea6d4c33424ea825d [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:02:56.046059  9288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:33455, user_credentials={real_user=slave}} blocked reactor thread for 51847.9us
I20260709 13:02:56.046141  9836 raft_consensus.cc:493] T b3f19df7d93748a1802678c56b5e2208 P 8846d581359a4b7ea6d4c33424ea825d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 65ed95869fbb4b69b5d6eb99c51adf85)
I20260709 13:02:56.046875  9836 raft_consensus.cc:3060] T b3f19df7d93748a1802678c56b5e2208 P 8846d581359a4b7ea6d4c33424ea825d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:56.047022  9321 raft_consensus.cc:2468] T 76b3d3cd810b46dbac2b534c0be568d2 P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8846d581359a4b7ea6d4c33424ea825d in term 2.
I20260709 13:02:56.047212  9215 leader_election.cc:304] T 5ce2a33a3b914f6297946ded34c256bf P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57, 8846d581359a4b7ea6d4c33424ea825d; no voters: 65ed95869fbb4b69b5d6eb99c51adf85
I20260709 13:02:56.048040  9832 raft_consensus.cc:2804] T 5ce2a33a3b914f6297946ded34c256bf P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:56.048235  9887 raft_consensus.cc:493] T e6797c587fdc4754b091a2be102e5927 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65ed95869fbb4b69b5d6eb99c51adf85)
I20260709 13:02:56.048404  9215 leader_election.cc:304] T 534ae119bf014235a99dfbbfcff690e1 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57, 8846d581359a4b7ea6d4c33424ea825d; no voters: 65ed95869fbb4b69b5d6eb99c51adf85
I20260709 13:02:56.048439  9832 raft_consensus.cc:493] T 5ce2a33a3b914f6297946ded34c256bf P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 65ed95869fbb4b69b5d6eb99c51adf85)
I20260709 13:02:56.048853  9887 raft_consensus.cc:515] T e6797c587fdc4754b091a2be102e5927 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:56.049454  9832 raft_consensus.cc:3060] T 5ce2a33a3b914f6297946ded34c256bf P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:56.051358  9887 leader_election.cc:290] T e6797c587fdc4754b091a2be102e5927 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979), 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311)
I20260709 13:02:56.055357  9836 raft_consensus.cc:515] T b3f19df7d93748a1802678c56b5e2208 P 8846d581359a4b7ea6d4c33424ea825d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:56.057294  9141 leader_election.cc:304] T 7f278d22c55747ee8ee613bfa5c59391 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c694531b0e1d47988b291f1214efc4cb; no voters: 65ed95869fbb4b69b5d6eb99c51adf85, 74ac2cf163ee475e8a280cb3aa738f57
I20260709 13:02:56.057803  9248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6797c587fdc4754b091a2be102e5927" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d" is_pre_election: true
W20260709 13:02:56.044669  9289 leader_election.cc:336] T 7f278d22c55747ee8ee613bfa5c59391 P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33979: connect: Connection refused (error 111)
I20260709 13:02:56.060025  9887 raft_consensus.cc:2749] T 7f278d22c55747ee8ee613bfa5c59391 P c694531b0e1d47988b291f1214efc4cb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:02:56.060014  9289 leader_election.cc:336] T 5ce2a33a3b914f6297946ded34c256bf P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33979: connect: Connection refused (error 111)
I20260709 13:02:56.063983  9832 raft_consensus.cc:515] T 5ce2a33a3b914f6297946ded34c256bf P 8846d581359a4b7ea6d4c33424ea825d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:56.075394  8997 catalog_manager.cc:5697] T 9dea45dda5454393bdfaed3f233a30a5 P 8846d581359a4b7ea6d4c33424ea825d reported cstate change: term changed from 1 to 2, leader changed from 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193) to 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195). New cstate: current_term: 2 leader_uuid: "8846d581359a4b7ea6d4c33424ea825d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:56.076910  9832 leader_election.cc:290] T 5ce2a33a3b914f6297946ded34c256bf P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 2 election: Requested vote from peers 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351), 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979)
I20260709 13:02:56.064806  9856 raft_consensus.cc:359] T 6f8b7d72409f45eebf4208f98310f378 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:56.078588  9856 raft_consensus.cc:740] T 6f8b7d72409f45eebf4208f98310f378 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Initialized, Role: FOLLOWER
I20260709 13:02:56.065853  9859 leader_election.cc:290] T 7f278d22c55747ee8ee613bfa5c59391 P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 2 election: Requested vote from peers 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979), c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455)
I20260709 13:02:56.057432  9836 leader_election.cc:290] T b3f19df7d93748a1802678c56b5e2208 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 3 election: Requested vote from peers 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351), 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979)
I20260709 13:02:56.069564  9858 raft_consensus.cc:2804] T 534ae119bf014235a99dfbbfcff690e1 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:56.080087  9858 raft_consensus.cc:493] T 534ae119bf014235a99dfbbfcff690e1 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 65ed95869fbb4b69b5d6eb99c51adf85)
I20260709 13:02:56.080734  9858 raft_consensus.cc:3060] T 534ae119bf014235a99dfbbfcff690e1 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:56.083952  9856 consensus_queue.cc:260] T 6f8b7d72409f45eebf4208f98310f378 P 65ed95869fbb4b69b5d6eb99c51adf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:56.086585  9856 ts_tablet_manager.cc:1434] T 6f8b7d72409f45eebf4208f98310f378 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent starting tablet: real 0.085s	user 0.006s	sys 0.000s
I20260709 13:02:56.087505  9856 tablet_bootstrap.cc:492] T 0effc3d52a6d43ef8aa59821958f4e52 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap starting.
I20260709 13:02:56.088527  9215 leader_election.cc:304] T 76b3d3cd810b46dbac2b534c0be568d2 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57, 8846d581359a4b7ea6d4c33424ea825d; no voters: 65ed95869fbb4b69b5d6eb99c51adf85
I20260709 13:02:56.089815  9930 raft_consensus.cc:2804] T 76b3d3cd810b46dbac2b534c0be568d2 P 8846d581359a4b7ea6d4c33424ea825d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:56.089907  9859 raft_consensus.cc:493] T d2ef0242573643178d56d10a6c26ae8e P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65ed95869fbb4b69b5d6eb99c51adf85)
I20260709 13:02:56.090504  9321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f19df7d93748a1802678c56b5e2208" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57"
I20260709 13:02:56.090608  9859 raft_consensus.cc:515] T d2ef0242573643178d56d10a6c26ae8e P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:56.091285  9930 raft_consensus.cc:697] T 76b3d3cd810b46dbac2b534c0be568d2 P 8846d581359a4b7ea6d4c33424ea825d [term 2 LEADER]: Becoming Leader. State: Replica: 8846d581359a4b7ea6d4c33424ea825d, State: Running, Role: LEADER
I20260709 13:02:56.092180  9930 consensus_queue.cc:237] T 76b3d3cd810b46dbac2b534c0be568d2 P 8846d581359a4b7ea6d4c33424ea825d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:56.094063  9319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce2a33a3b914f6297946ded34c256bf" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57"
I20260709 13:02:56.094935  9319 raft_consensus.cc:2393] T 5ce2a33a3b914f6297946ded34c256bf P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8846d581359a4b7ea6d4c33424ea825d in current term 2: Already voted for candidate 74ac2cf163ee475e8a280cb3aa738f57 in this term.
I20260709 13:02:56.095173  9248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce2a33a3b914f6297946ded34c256bf" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d"
I20260709 13:02:56.095979  9248 raft_consensus.cc:2393] T 5ce2a33a3b914f6297946ded34c256bf P 8846d581359a4b7ea6d4c33424ea825d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 74ac2cf163ee475e8a280cb3aa738f57 in current term 2: Already voted for candidate 8846d581359a4b7ea6d4c33424ea825d in this term.
I20260709 13:02:56.064800  9857 raft_consensus.cc:515] T 9d21e8696b0340bea31002b775af50ee P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:56.066427  9914 raft_consensus.cc:515] T 9d21e8696b0340bea31002b775af50ee P 8846d581359a4b7ea6d4c33424ea825d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:56.071153  9172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f278d22c55747ee8ee613bfa5c59391" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c694531b0e1d47988b291f1214efc4cb"
W20260709 13:02:56.072543  9141 leader_election.cc:336] T e6797c587fdc4754b091a2be102e5927 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33979: connect: Connection refused (error 111)
I20260709 13:02:56.098625  9172 raft_consensus.cc:2393] T 7f278d22c55747ee8ee613bfa5c59391 P c694531b0e1d47988b291f1214efc4cb [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 74ac2cf163ee475e8a280cb3aa738f57 in current term 2: Already voted for candidate c694531b0e1d47988b291f1214efc4cb in this term.
I20260709 13:02:56.098516  9141 leader_election.cc:304] T e6797c587fdc4754b091a2be102e5927 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c694531b0e1d47988b291f1214efc4cb; no voters: 65ed95869fbb4b69b5d6eb99c51adf85, 8846d581359a4b7ea6d4c33424ea825d
I20260709 13:02:56.100890  9914 leader_election.cc:290] T 9d21e8696b0340bea31002b775af50ee P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 2 election: Requested vote from peers 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351), 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979)
I20260709 13:02:56.102065  9887 raft_consensus.cc:2749] T e6797c587fdc4754b091a2be102e5927 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:56.102456  9914 raft_consensus.cc:493] T e6797c587fdc4754b091a2be102e5927 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65ed95869fbb4b69b5d6eb99c51adf85)
I20260709 13:02:56.103048  9914 raft_consensus.cc:515] T e6797c587fdc4754b091a2be102e5927 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
W20260709 13:02:56.103313  9289 leader_election.cc:336] T d2ef0242573643178d56d10a6c26ae8e P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33979: connect: Connection refused (error 111)
I20260709 13:02:56.105293  9914 leader_election.cc:290] T e6797c587fdc4754b091a2be102e5927 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979), c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455)
I20260709 13:02:56.106848  9172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6797c587fdc4754b091a2be102e5927" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c694531b0e1d47988b291f1214efc4cb" is_pre_election: true
I20260709 13:02:56.091229  9321 raft_consensus.cc:3060] T b3f19df7d93748a1802678c56b5e2208 P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:02:56.140599  9215 leader_election.cc:336] T b3f19df7d93748a1802678c56b5e2208 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33979: connect: Connection refused (error 111)
W20260709 13:02:56.141357  9215 leader_election.cc:336] T 5ce2a33a3b914f6297946ded34c256bf P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33979: connect: Connection refused (error 111)
I20260709 13:02:56.143791  9172 raft_consensus.cc:2468] T e6797c587fdc4754b091a2be102e5927 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8846d581359a4b7ea6d4c33424ea825d in term 1.
I20260709 13:02:56.106805  9857 leader_election.cc:290] T 9d21e8696b0340bea31002b775af50ee P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 2 election: Requested vote from peers 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311), 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979)
I20260709 13:02:56.140543  9287 leader_election.cc:304] T 5ce2a33a3b914f6297946ded34c256bf P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57; no voters: 65ed95869fbb4b69b5d6eb99c51adf85, 8846d581359a4b7ea6d4c33424ea825d
I20260709 13:02:56.149088  9927 raft_consensus.cc:2749] T 5ce2a33a3b914f6297946ded34c256bf P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:02:56.142433  9215 leader_election.cc:304] T 5ce2a33a3b914f6297946ded34c256bf P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8846d581359a4b7ea6d4c33424ea825d; no voters: 65ed95869fbb4b69b5d6eb99c51adf85, 74ac2cf163ee475e8a280cb3aa738f57
I20260709 13:02:56.146605  9214 leader_election.cc:304] T e6797c587fdc4754b091a2be102e5927 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8846d581359a4b7ea6d4c33424ea825d, c694531b0e1d47988b291f1214efc4cb; no voters: 
I20260709 13:02:56.150816  9832 raft_consensus.cc:2749] T 5ce2a33a3b914f6297946ded34c256bf P 8846d581359a4b7ea6d4c33424ea825d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:02:56.147034  9859 leader_election.cc:290] T d2ef0242573643178d56d10a6c26ae8e P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979), c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455)
I20260709 13:02:56.151551  9832 raft_consensus.cc:2804] T e6797c587fdc4754b091a2be102e5927 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:56.151925  9832 raft_consensus.cc:493] T e6797c587fdc4754b091a2be102e5927 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 65ed95869fbb4b69b5d6eb99c51adf85)
I20260709 13:02:56.152310  9832 raft_consensus.cc:3060] T e6797c587fdc4754b091a2be102e5927 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:56.152945  9316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d21e8696b0340bea31002b775af50ee" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57"
I20260709 13:02:56.153762  9316 raft_consensus.cc:2393] T 9d21e8696b0340bea31002b775af50ee P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8846d581359a4b7ea6d4c33424ea825d in current term 2: Already voted for candidate 74ac2cf163ee475e8a280cb3aa738f57 in this term.
I20260709 13:02:56.154273  9249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d21e8696b0340bea31002b775af50ee" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d"
I20260709 13:02:56.159862  9249 raft_consensus.cc:2393] T 9d21e8696b0340bea31002b775af50ee P 8846d581359a4b7ea6d4c33424ea825d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 74ac2cf163ee475e8a280cb3aa738f57 in current term 2: Already voted for candidate 8846d581359a4b7ea6d4c33424ea825d in this term.
W20260709 13:02:56.159420  9215 leader_election.cc:336] T 9d21e8696b0340bea31002b775af50ee P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33979: connect: Connection refused (error 111)
I20260709 13:02:56.157394  9858 raft_consensus.cc:515] T 534ae119bf014235a99dfbbfcff690e1 P 8846d581359a4b7ea6d4c33424ea825d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
W20260709 13:02:56.160713  9215 leader_election.cc:336] T e6797c587fdc4754b091a2be102e5927 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33979: connect: Connection refused (error 111)
I20260709 13:02:56.162195  9215 leader_election.cc:304] T 9d21e8696b0340bea31002b775af50ee P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8846d581359a4b7ea6d4c33424ea825d; no voters: 65ed95869fbb4b69b5d6eb99c51adf85, 74ac2cf163ee475e8a280cb3aa738f57
I20260709 13:02:56.162457  9858 leader_election.cc:290] T 534ae119bf014235a99dfbbfcff690e1 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 2 election: Requested vote from peers 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351), 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979)
I20260709 13:02:56.164870  9316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534ae119bf014235a99dfbbfcff690e1" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57"
I20260709 13:02:56.165575  9316 raft_consensus.cc:3060] T 534ae119bf014235a99dfbbfcff690e1 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:56.140543  9288 leader_election.cc:304] T 7f278d22c55747ee8ee613bfa5c59391 P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57; no voters: 65ed95869fbb4b69b5d6eb99c51adf85, c694531b0e1d47988b291f1214efc4cb
I20260709 13:02:56.166743  9857 raft_consensus.cc:2749] T 7f278d22c55747ee8ee613bfa5c59391 P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:02:56.160708  9321 raft_consensus.cc:2468] T b3f19df7d93748a1802678c56b5e2208 P 74ac2cf163ee475e8a280cb3aa738f57 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8846d581359a4b7ea6d4c33424ea825d in term 3.
I20260709 13:02:56.163419  9914 raft_consensus.cc:2749] T 9d21e8696b0340bea31002b775af50ee P 8846d581359a4b7ea6d4c33424ea825d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:02:56.169800  9289 leader_election.cc:336] T 9d21e8696b0340bea31002b775af50ee P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33979: connect: Connection refused (error 111)
I20260709 13:02:56.170398  9289 leader_election.cc:304] T 9d21e8696b0340bea31002b775af50ee P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57; no voters: 65ed95869fbb4b69b5d6eb99c51adf85, 8846d581359a4b7ea6d4c33424ea825d
W20260709 13:02:56.166635  9288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33455, user_credentials={real_user=slave}} blocked reactor thread for 57249.3us
I20260709 13:02:56.172263  9175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2ef0242573643178d56d10a6c26ae8e" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c694531b0e1d47988b291f1214efc4cb" is_pre_election: true
I20260709 13:02:56.172876  9175 raft_consensus.cc:2468] T d2ef0242573643178d56d10a6c26ae8e P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74ac2cf163ee475e8a280cb3aa738f57 in term 1.
I20260709 13:02:56.176304  9857 raft_consensus.cc:2749] T 9d21e8696b0340bea31002b775af50ee P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:02:56.176417  9141 consensus_peers.cc:597] T 070a6f2020a1483381e2baa75e5c0cbf P c694531b0e1d47988b291f1214efc4cb -> Peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Couldn't send request to peer 65ed95869fbb4b69b5d6eb99c51adf85. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33979: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:56.179538  9288 leader_election.cc:304] T d2ef0242573643178d56d10a6c26ae8e P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57, c694531b0e1d47988b291f1214efc4cb; no voters: 65ed95869fbb4b69b5d6eb99c51adf85
I20260709 13:02:56.180380  9857 raft_consensus.cc:2804] T d2ef0242573643178d56d10a6c26ae8e P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:56.180757  9857 raft_consensus.cc:493] T d2ef0242573643178d56d10a6c26ae8e P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 65ed95869fbb4b69b5d6eb99c51adf85)
I20260709 13:02:56.181109  9857 raft_consensus.cc:3060] T d2ef0242573643178d56d10a6c26ae8e P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:56.190068  9857 raft_consensus.cc:515] T d2ef0242573643178d56d10a6c26ae8e P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:56.193943  9175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2ef0242573643178d56d10a6c26ae8e" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c694531b0e1d47988b291f1214efc4cb"
I20260709 13:02:56.194511  9175 raft_consensus.cc:3060] T d2ef0242573643178d56d10a6c26ae8e P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:56.145391  8997 catalog_manager.cc:5697] T 76b3d3cd810b46dbac2b534c0be568d2 P 8846d581359a4b7ea6d4c33424ea825d reported cstate change: term changed from 1 to 2, leader changed from 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193) to 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195). New cstate: current_term: 2 leader_uuid: "8846d581359a4b7ea6d4c33424ea825d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:56.209839  9215 leader_election.cc:304] T b3f19df7d93748a1802678c56b5e2208 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57, 8846d581359a4b7ea6d4c33424ea825d; no voters: 65ed95869fbb4b69b5d6eb99c51adf85
I20260709 13:02:56.214381  9914 raft_consensus.cc:2804] T b3f19df7d93748a1802678c56b5e2208 P 8846d581359a4b7ea6d4c33424ea825d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:56.215448  9914 raft_consensus.cc:697] T b3f19df7d93748a1802678c56b5e2208 P 8846d581359a4b7ea6d4c33424ea825d [term 3 LEADER]: Becoming Leader. State: Replica: 8846d581359a4b7ea6d4c33424ea825d, State: Running, Role: LEADER
I20260709 13:02:56.216568  9914 consensus_queue.cc:237] T b3f19df7d93748a1802678c56b5e2208 P 8846d581359a4b7ea6d4c33424ea825d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
W20260709 13:02:56.217913  9289 leader_election.cc:336] T d2ef0242573643178d56d10a6c26ae8e P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33979: connect: Connection refused (error 111)
I20260709 13:02:56.212512  9175 raft_consensus.cc:2468] T d2ef0242573643178d56d10a6c26ae8e P c694531b0e1d47988b291f1214efc4cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74ac2cf163ee475e8a280cb3aa738f57 in term 2.
I20260709 13:02:56.219714  9288 leader_election.cc:304] T d2ef0242573643178d56d10a6c26ae8e P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57, c694531b0e1d47988b291f1214efc4cb; no voters: 65ed95869fbb4b69b5d6eb99c51adf85
I20260709 13:02:56.220566  9859 raft_consensus.cc:2804] T d2ef0242573643178d56d10a6c26ae8e P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:56.221065  9859 raft_consensus.cc:697] T d2ef0242573643178d56d10a6c26ae8e P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 LEADER]: Becoming Leader. State: Replica: 74ac2cf163ee475e8a280cb3aa738f57, State: Running, Role: LEADER
I20260709 13:02:56.221948  9859 consensus_queue.cc:237] T d2ef0242573643178d56d10a6c26ae8e P 74ac2cf163ee475e8a280cb3aa738f57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:56.225231  9316 raft_consensus.cc:2468] T 534ae119bf014235a99dfbbfcff690e1 P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8846d581359a4b7ea6d4c33424ea825d in term 2.
I20260709 13:02:56.225780  9857 leader_election.cc:290] T d2ef0242573643178d56d10a6c26ae8e P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 2 election: Requested vote from peers 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979), c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455)
I20260709 13:02:56.234702  9249 raft_consensus.cc:1275] T 070a6f2020a1483381e2baa75e5c0cbf P 8846d581359a4b7ea6d4c33424ea825d [term 2 FOLLOWER]: Refusing update from remote peer c694531b0e1d47988b291f1214efc4cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:56.236198  9215 leader_election.cc:304] T 534ae119bf014235a99dfbbfcff690e1 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57, 8846d581359a4b7ea6d4c33424ea825d; no voters: 
I20260709 13:02:56.237015  9858 raft_consensus.cc:2804] T 534ae119bf014235a99dfbbfcff690e1 P 8846d581359a4b7ea6d4c33424ea825d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:56.237500  9858 raft_consensus.cc:697] T 534ae119bf014235a99dfbbfcff690e1 P 8846d581359a4b7ea6d4c33424ea825d [term 2 LEADER]: Becoming Leader. State: Replica: 8846d581359a4b7ea6d4c33424ea825d, State: Running, Role: LEADER
I20260709 13:02:56.238266  9858 consensus_queue.cc:237] T 534ae119bf014235a99dfbbfcff690e1 P 8846d581359a4b7ea6d4c33424ea825d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
W20260709 13:02:56.238404  9215 leader_election.cc:336] T 534ae119bf014235a99dfbbfcff690e1 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33979: connect: Connection refused (error 111)
I20260709 13:02:56.241706  8996 catalog_manager.cc:5697] T d2ef0242573643178d56d10a6c26ae8e P 74ac2cf163ee475e8a280cb3aa738f57 reported cstate change: term changed from 1 to 2, leader changed from 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193) to 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "74ac2cf163ee475e8a280cb3aa738f57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:56.247370  9832 raft_consensus.cc:515] T e6797c587fdc4754b091a2be102e5927 P 8846d581359a4b7ea6d4c33424ea825d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:56.252948  9832 leader_election.cc:290] T e6797c587fdc4754b091a2be102e5927 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 2 election: Requested vote from peers 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979), c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455)
I20260709 13:02:56.276213  9175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6797c587fdc4754b091a2be102e5927" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c694531b0e1d47988b291f1214efc4cb"
I20260709 13:02:56.276989  9175 raft_consensus.cc:3060] T e6797c587fdc4754b091a2be102e5927 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:02:56.280385  9215 leader_election.cc:336] T e6797c587fdc4754b091a2be102e5927 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33979: connect: Connection refused (error 111)
I20260709 13:02:56.281386  9856 tablet_bootstrap.cc:492] T 0effc3d52a6d43ef8aa59821958f4e52 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:56.282434  9856 tablet_bootstrap.cc:492] T 0effc3d52a6d43ef8aa59821958f4e52 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap complete.
I20260709 13:02:56.283142  9856 ts_tablet_manager.cc:1403] T 0effc3d52a6d43ef8aa59821958f4e52 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent bootstrapping tablet: real 0.196s	user 0.045s	sys 0.045s
I20260709 13:02:56.283854  9741 consensus_queue.cc:1048] T 070a6f2020a1483381e2baa75e5c0cbf P c694531b0e1d47988b291f1214efc4cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:56.293731  9856 raft_consensus.cc:359] T 0effc3d52a6d43ef8aa59821958f4e52 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:56.294517  9856 raft_consensus.cc:740] T 0effc3d52a6d43ef8aa59821958f4e52 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Initialized, Role: FOLLOWER
I20260709 13:02:56.295279  9856 consensus_queue.cc:260] T 0effc3d52a6d43ef8aa59821958f4e52 P 65ed95869fbb4b69b5d6eb99c51adf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:56.294579  9175 raft_consensus.cc:2468] T e6797c587fdc4754b091a2be102e5927 P c694531b0e1d47988b291f1214efc4cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8846d581359a4b7ea6d4c33424ea825d in term 2.
I20260709 13:02:56.301373  9856 ts_tablet_manager.cc:1434] T 0effc3d52a6d43ef8aa59821958f4e52 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:02:56.301740  9214 leader_election.cc:304] T e6797c587fdc4754b091a2be102e5927 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8846d581359a4b7ea6d4c33424ea825d, c694531b0e1d47988b291f1214efc4cb; no voters: 65ed95869fbb4b69b5d6eb99c51adf85
I20260709 13:02:56.302227  9856 tablet_bootstrap.cc:492] T 8f67cb568c0745e792c17959b07c5da1 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap starting.
I20260709 13:02:56.302448  9914 raft_consensus.cc:2804] T e6797c587fdc4754b091a2be102e5927 P 8846d581359a4b7ea6d4c33424ea825d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:56.303158  9914 raft_consensus.cc:697] T e6797c587fdc4754b091a2be102e5927 P 8846d581359a4b7ea6d4c33424ea825d [term 2 LEADER]: Becoming Leader. State: Replica: 8846d581359a4b7ea6d4c33424ea825d, State: Running, Role: LEADER
I20260709 13:02:56.304061  9914 consensus_queue.cc:237] T e6797c587fdc4754b091a2be102e5927 P 8846d581359a4b7ea6d4c33424ea825d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
W20260709 13:02:56.317857  9215 consensus_peers.cc:597] T 604bd81da85244b6bd6d8bd6ac674f2c P 8846d581359a4b7ea6d4c33424ea825d -> Peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Couldn't send request to peer 65ed95869fbb4b69b5d6eb99c51adf85. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33979: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:56.325845  8996 catalog_manager.cc:5697] T 534ae119bf014235a99dfbbfcff690e1 P 8846d581359a4b7ea6d4c33424ea825d reported cstate change: term changed from 1 to 2, leader changed from 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193) to 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195). New cstate: current_term: 2 leader_uuid: "8846d581359a4b7ea6d4c33424ea825d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:56.330580  8996 catalog_manager.cc:5697] T b3f19df7d93748a1802678c56b5e2208 P 8846d581359a4b7ea6d4c33424ea825d reported cstate change: term changed from 2 to 3, leader changed from 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193) to 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195). New cstate: current_term: 3 leader_uuid: "8846d581359a4b7ea6d4c33424ea825d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:56.335493  9856 tablet_bootstrap.cc:492] T 8f67cb568c0745e792c17959b07c5da1 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:56.336591  9856 tablet_bootstrap.cc:492] T 8f67cb568c0745e792c17959b07c5da1 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap complete.
I20260709 13:02:56.337422  9856 ts_tablet_manager.cc:1403] T 8f67cb568c0745e792c17959b07c5da1 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent bootstrapping tablet: real 0.035s	user 0.011s	sys 0.010s
I20260709 13:02:56.341471  9856 raft_consensus.cc:359] T 8f67cb568c0745e792c17959b07c5da1 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:56.342159  9856 raft_consensus.cc:740] T 8f67cb568c0745e792c17959b07c5da1 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Initialized, Role: FOLLOWER
I20260709 13:02:56.350343  9856 consensus_queue.cc:260] T 8f67cb568c0745e792c17959b07c5da1 P 65ed95869fbb4b69b5d6eb99c51adf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:56.356681  9856 ts_tablet_manager.cc:1434] T 8f67cb568c0745e792c17959b07c5da1 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:02:56.357492  9856 tablet_bootstrap.cc:492] T 76b3d3cd810b46dbac2b534c0be568d2 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap starting.
I20260709 13:02:56.358410  8997 catalog_manager.cc:5697] T e6797c587fdc4754b091a2be102e5927 P 8846d581359a4b7ea6d4c33424ea825d reported cstate change: term changed from 1 to 2, leader changed from 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193) to 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195). New cstate: current_term: 2 leader_uuid: "8846d581359a4b7ea6d4c33424ea825d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:56.377537   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:33979
I20260709 13:02:56.377609  9960 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:33979 every 8 connection(s)
I20260709 13:02:56.378832  9856 tablet_bootstrap.cc:492] T 76b3d3cd810b46dbac2b534c0be568d2 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:56.379814  9856 tablet_bootstrap.cc:492] T 76b3d3cd810b46dbac2b534c0be568d2 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap complete.
I20260709 13:02:56.380494  9856 ts_tablet_manager.cc:1403] T 76b3d3cd810b46dbac2b534c0be568d2 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent bootstrapping tablet: real 0.023s	user 0.018s	sys 0.001s
I20260709 13:02:56.383549  9856 raft_consensus.cc:359] T 76b3d3cd810b46dbac2b534c0be568d2 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:56.384671  9856 raft_consensus.cc:740] T 76b3d3cd810b46dbac2b534c0be568d2 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Initialized, Role: FOLLOWER
I20260709 13:02:56.385497  9856 consensus_queue.cc:260] T 76b3d3cd810b46dbac2b534c0be568d2 P 65ed95869fbb4b69b5d6eb99c51adf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:56.387428  9856 ts_tablet_manager.cc:1434] T 76b3d3cd810b46dbac2b534c0be568d2 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 13:02:56.388264  9856 tablet_bootstrap.cc:492] T 3899ef948b2e405baaccb81544b7f58b P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap starting.
I20260709 13:02:56.392388  9175 raft_consensus.cc:1275] T 604bd81da85244b6bd6d8bd6ac674f2c P c694531b0e1d47988b291f1214efc4cb [term 2 FOLLOWER]: Refusing update from remote peer 8846d581359a4b7ea6d4c33424ea825d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:56.394232  9914 consensus_queue.cc:1048] T 604bd81da85244b6bd6d8bd6ac674f2c P 8846d581359a4b7ea6d4c33424ea825d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:56.412827  9856 tablet_bootstrap.cc:492] T 3899ef948b2e405baaccb81544b7f58b P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:56.414202  9856 tablet_bootstrap.cc:492] T 3899ef948b2e405baaccb81544b7f58b P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap complete.
I20260709 13:02:56.414945  9856 ts_tablet_manager.cc:1403] T 3899ef948b2e405baaccb81544b7f58b P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.012s
I20260709 13:02:56.417474  9856 raft_consensus.cc:359] T 3899ef948b2e405baaccb81544b7f58b P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:56.418170  9856 raft_consensus.cc:740] T 3899ef948b2e405baaccb81544b7f58b P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Initialized, Role: FOLLOWER
I20260709 13:02:56.418820  9856 consensus_queue.cc:260] T 3899ef948b2e405baaccb81544b7f58b P 65ed95869fbb4b69b5d6eb99c51adf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:56.421066  9856 ts_tablet_manager.cc:1434] T 3899ef948b2e405baaccb81544b7f58b P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:02:56.421861  9856 tablet_bootstrap.cc:492] T eab411e3927a434ab647aa9b31fcf60d P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap starting.
I20260709 13:02:56.438253  9856 tablet_bootstrap.cc:492] T eab411e3927a434ab647aa9b31fcf60d P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:56.439291  9856 tablet_bootstrap.cc:492] T eab411e3927a434ab647aa9b31fcf60d P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap complete.
I20260709 13:02:56.440685  9856 ts_tablet_manager.cc:1403] T eab411e3927a434ab647aa9b31fcf60d P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.004s
I20260709 13:02:56.443926  9856 raft_consensus.cc:359] T eab411e3927a434ab647aa9b31fcf60d P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:56.444797  9856 raft_consensus.cc:740] T eab411e3927a434ab647aa9b31fcf60d P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Initialized, Role: FOLLOWER
I20260709 13:02:56.445425  9856 consensus_queue.cc:260] T eab411e3927a434ab647aa9b31fcf60d P 65ed95869fbb4b69b5d6eb99c51adf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:56.447552  9856 ts_tablet_manager.cc:1434] T eab411e3927a434ab647aa9b31fcf60d P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:02:56.447827  9961 heartbeater.cc:344] Connected to a master server at 127.0.107.254:45205
I20260709 13:02:56.448257  9856 tablet_bootstrap.cc:492] T 604bd81da85244b6bd6d8bd6ac674f2c P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap starting.
I20260709 13:02:56.448298  9961 heartbeater.cc:461] Registering TS with master...
I20260709 13:02:56.449422  9961 heartbeater.cc:507] Master 127.0.107.254:45205 requested a full tablet report, sending...
I20260709 13:02:56.463693  9856 tablet_bootstrap.cc:492] T 604bd81da85244b6bd6d8bd6ac674f2c P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:56.464466  9856 tablet_bootstrap.cc:492] T 604bd81da85244b6bd6d8bd6ac674f2c P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap complete.
I20260709 13:02:56.465004  9856 ts_tablet_manager.cc:1403] T 604bd81da85244b6bd6d8bd6ac674f2c P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent bootstrapping tablet: real 0.017s	user 0.004s	sys 0.010s
I20260709 13:02:56.466987  8997 ts_manager.cc:194] Re-registered known tserver with Master: 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979)
I20260709 13:02:56.467352  9856 raft_consensus.cc:359] T 604bd81da85244b6bd6d8bd6ac674f2c P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:56.468086  9856 raft_consensus.cc:740] T 604bd81da85244b6bd6d8bd6ac674f2c P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Initialized, Role: FOLLOWER
I20260709 13:02:56.468787  9856 consensus_queue.cc:260] T 604bd81da85244b6bd6d8bd6ac674f2c P 65ed95869fbb4b69b5d6eb99c51adf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:56.470624  9856 ts_tablet_manager.cc:1434] T 604bd81da85244b6bd6d8bd6ac674f2c P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.001s
I20260709 13:02:56.471292  9856 tablet_bootstrap.cc:492] T 7f278d22c55747ee8ee613bfa5c59391 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap starting.
I20260709 13:02:56.483139  9856 tablet_bootstrap.cc:492] T 7f278d22c55747ee8ee613bfa5c59391 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:56.483985  9856 tablet_bootstrap.cc:492] T 7f278d22c55747ee8ee613bfa5c59391 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap complete.
I20260709 13:02:56.484609  9856 ts_tablet_manager.cc:1403] T 7f278d22c55747ee8ee613bfa5c59391 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent bootstrapping tablet: real 0.013s	user 0.011s	sys 0.000s
I20260709 13:02:56.486954  9856 raft_consensus.cc:359] T 7f278d22c55747ee8ee613bfa5c59391 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:56.487633  9856 raft_consensus.cc:740] T 7f278d22c55747ee8ee613bfa5c59391 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Initialized, Role: FOLLOWER
I20260709 13:02:56.488258  9856 consensus_queue.cc:260] T 7f278d22c55747ee8ee613bfa5c59391 P 65ed95869fbb4b69b5d6eb99c51adf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:56.489845  9856 ts_tablet_manager.cc:1434] T 7f278d22c55747ee8ee613bfa5c59391 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:02:56.490609  9856 tablet_bootstrap.cc:492] T 5ce2a33a3b914f6297946ded34c256bf P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap starting.
I20260709 13:02:56.504550  8997 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54514
I20260709 13:02:56.507766  9321 raft_consensus.cc:1275] T 76b3d3cd810b46dbac2b534c0be568d2 P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Refusing update from remote peer 8846d581359a4b7ea6d4c33424ea825d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:56.509598  9961 heartbeater.cc:499] Master 127.0.107.254:45205 was elected leader, sending a full tablet report...
I20260709 13:02:56.510073  9856 tablet_bootstrap.cc:492] T 5ce2a33a3b914f6297946ded34c256bf P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:56.510474  9937 consensus_queue.cc:1048] T 76b3d3cd810b46dbac2b534c0be568d2 P 8846d581359a4b7ea6d4c33424ea825d [LEADER]: Connected to new peer: Peer: permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:56.511090  9856 tablet_bootstrap.cc:492] T 5ce2a33a3b914f6297946ded34c256bf P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap complete.
I20260709 13:02:56.511768  9856 ts_tablet_manager.cc:1403] T 5ce2a33a3b914f6297946ded34c256bf P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent bootstrapping tablet: real 0.021s	user 0.007s	sys 0.012s
I20260709 13:02:56.514403  9856 raft_consensus.cc:359] T 5ce2a33a3b914f6297946ded34c256bf P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:56.515115  9856 raft_consensus.cc:740] T 5ce2a33a3b914f6297946ded34c256bf P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Initialized, Role: FOLLOWER
I20260709 13:02:56.515762  9856 consensus_queue.cc:260] T 5ce2a33a3b914f6297946ded34c256bf P 65ed95869fbb4b69b5d6eb99c51adf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:56.517769  9856 ts_tablet_manager.cc:1434] T 5ce2a33a3b914f6297946ded34c256bf P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:02:56.518684  9856 tablet_bootstrap.cc:492] T 9d21e8696b0340bea31002b775af50ee P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap starting.
I20260709 13:02:56.544504  9908 raft_consensus.cc:3060] T 76b3d3cd810b46dbac2b534c0be568d2 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:56.552644  9908 raft_consensus.cc:1275] T 76b3d3cd810b46dbac2b534c0be568d2 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 2 FOLLOWER]: Refusing update from remote peer 8846d581359a4b7ea6d4c33424ea825d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:56.555987  9832 consensus_queue.cc:1048] T 76b3d3cd810b46dbac2b534c0be568d2 P 8846d581359a4b7ea6d4c33424ea825d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:56.582376  9856 tablet_bootstrap.cc:492] T 9d21e8696b0340bea31002b775af50ee P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:56.583968  9856 tablet_bootstrap.cc:492] T 9d21e8696b0340bea31002b775af50ee P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap complete.
I20260709 13:02:56.584707  9856 ts_tablet_manager.cc:1403] T 9d21e8696b0340bea31002b775af50ee P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent bootstrapping tablet: real 0.066s	user 0.019s	sys 0.004s
I20260709 13:02:56.593271  9904 raft_consensus.cc:3060] T 9dea45dda5454393bdfaed3f233a30a5 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:56.606393  9904 raft_consensus.cc:1275] T 9dea45dda5454393bdfaed3f233a30a5 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 2 FOLLOWER]: Refusing update from remote peer 8846d581359a4b7ea6d4c33424ea825d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:56.611430  9856 raft_consensus.cc:359] T 9d21e8696b0340bea31002b775af50ee P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:56.612813  9856 raft_consensus.cc:740] T 9d21e8696b0340bea31002b775af50ee P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Initialized, Role: FOLLOWER
I20260709 13:02:56.613919  9856 consensus_queue.cc:260] T 9d21e8696b0340bea31002b775af50ee P 65ed95869fbb4b69b5d6eb99c51adf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:56.616107  9856 ts_tablet_manager.cc:1434] T 9d21e8696b0340bea31002b775af50ee P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:02:56.616717  9173 raft_consensus.cc:1275] T 9dea45dda5454393bdfaed3f233a30a5 P c694531b0e1d47988b291f1214efc4cb [term 2 FOLLOWER]: Refusing update from remote peer 8846d581359a4b7ea6d4c33424ea825d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:56.617635  9856 tablet_bootstrap.cc:492] T e6797c587fdc4754b091a2be102e5927 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap starting.
I20260709 13:02:56.619094  9914 consensus_queue.cc:1048] T 9dea45dda5454393bdfaed3f233a30a5 P 8846d581359a4b7ea6d4c33424ea825d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:56.628960  9858 consensus_queue.cc:1048] T 9dea45dda5454393bdfaed3f233a30a5 P 8846d581359a4b7ea6d4c33424ea825d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:56.629312  9175 raft_consensus.cc:1275] T d2ef0242573643178d56d10a6c26ae8e P c694531b0e1d47988b291f1214efc4cb [term 2 FOLLOWER]: Refusing update from remote peer 74ac2cf163ee475e8a280cb3aa738f57: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:56.630939  9857 consensus_queue.cc:1048] T d2ef0242573643178d56d10a6c26ae8e P 74ac2cf163ee475e8a280cb3aa738f57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:56.652155  9856 tablet_bootstrap.cc:492] T e6797c587fdc4754b091a2be102e5927 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:02:56.653431  9289 consensus_peers.cc:597] T d2ef0242573643178d56d10a6c26ae8e P 74ac2cf163ee475e8a280cb3aa738f57 -> Peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Couldn't send request to peer 65ed95869fbb4b69b5d6eb99c51adf85. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:56.653120  9856 tablet_bootstrap.cc:492] T e6797c587fdc4754b091a2be102e5927 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap complete.
I20260709 13:02:56.654597  9856 ts_tablet_manager.cc:1403] T e6797c587fdc4754b091a2be102e5927 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent bootstrapping tablet: real 0.038s	user 0.021s	sys 0.000s
I20260709 13:02:56.661491  9856 raft_consensus.cc:359] T e6797c587fdc4754b091a2be102e5927 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:56.662220  9856 raft_consensus.cc:740] T e6797c587fdc4754b091a2be102e5927 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Initialized, Role: FOLLOWER
I20260709 13:02:56.663257  9856 consensus_queue.cc:260] T e6797c587fdc4754b091a2be102e5927 P 65ed95869fbb4b69b5d6eb99c51adf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:56.664804  9856 ts_tablet_manager.cc:1434] T e6797c587fdc4754b091a2be102e5927 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.000s
I20260709 13:02:56.665637  9856 tablet_bootstrap.cc:492] T a731a965126b406988eecb7829bc9981 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap starting.
I20260709 13:02:56.666841  9861 raft_consensus.cc:493] T ea3bb46b177b4bbdaa60f464370aa9a0 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:56.667424  9861 raft_consensus.cc:515] T ea3bb46b177b4bbdaa60f464370aa9a0 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:56.668166  9321 raft_consensus.cc:1275] T b3f19df7d93748a1802678c56b5e2208 P 74ac2cf163ee475e8a280cb3aa738f57 [term 3 FOLLOWER]: Refusing update from remote peer 8846d581359a4b7ea6d4c33424ea825d: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:56.669936  9914 consensus_queue.cc:1048] T b3f19df7d93748a1802678c56b5e2208 P 8846d581359a4b7ea6d4c33424ea825d [LEADER]: Connected to new peer: Peer: permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:56.670109  9861 leader_election.cc:290] T ea3bb46b177b4bbdaa60f464370aa9a0 P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455), 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311)
I20260709 13:02:56.751822  9173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea3bb46b177b4bbdaa60f464370aa9a0" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c694531b0e1d47988b291f1214efc4cb" is_pre_election: true
I20260709 13:02:56.759473  9856 tablet_bootstrap.cc:492] T a731a965126b406988eecb7829bc9981 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:56.760579  9905 raft_consensus.cc:3060] T b3f19df7d93748a1802678c56b5e2208 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:56.767462  9249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea3bb46b177b4bbdaa60f464370aa9a0" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d" is_pre_election: true
I20260709 13:02:56.760619  9856 tablet_bootstrap.cc:492] T a731a965126b406988eecb7829bc9981 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap complete.
I20260709 13:02:56.769315  9850 leader_election.cc:304] T ea3bb46b177b4bbdaa60f464370aa9a0 P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65ed95869fbb4b69b5d6eb99c51adf85; no voters: 8846d581359a4b7ea6d4c33424ea825d, c694531b0e1d47988b291f1214efc4cb
I20260709 13:02:56.769285  9905 raft_consensus.cc:1275] T b3f19df7d93748a1802678c56b5e2208 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 3 FOLLOWER]: Refusing update from remote peer 8846d581359a4b7ea6d4c33424ea825d: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:56.770380  9861 raft_consensus.cc:2749] T ea3bb46b177b4bbdaa60f464370aa9a0 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:56.770437  9856 ts_tablet_manager.cc:1403] T a731a965126b406988eecb7829bc9981 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent bootstrapping tablet: real 0.105s	user 0.054s	sys 0.025s
I20260709 13:02:56.773437  9858 consensus_queue.cc:1048] T b3f19df7d93748a1802678c56b5e2208 P 8846d581359a4b7ea6d4c33424ea825d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:56.774148  9856 raft_consensus.cc:359] T a731a965126b406988eecb7829bc9981 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:56.774914  9856 raft_consensus.cc:740] T a731a965126b406988eecb7829bc9981 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Initialized, Role: FOLLOWER
I20260709 13:02:56.775600  9856 consensus_queue.cc:260] T a731a965126b406988eecb7829bc9981 P 65ed95869fbb4b69b5d6eb99c51adf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:02:56.785584  9856 ts_tablet_manager.cc:1434] T a731a965126b406988eecb7829bc9981 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.000s
I20260709 13:02:56.786442  9856 tablet_bootstrap.cc:492] T d2ef0242573643178d56d10a6c26ae8e P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap starting.
W20260709 13:02:56.795214  9215 consensus_peers.cc:597] T 534ae119bf014235a99dfbbfcff690e1 P 8846d581359a4b7ea6d4c33424ea825d -> Peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Couldn't send request to peer 65ed95869fbb4b69b5d6eb99c51adf85. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:56.800262  9173 raft_consensus.cc:1275] T e6797c587fdc4754b091a2be102e5927 P c694531b0e1d47988b291f1214efc4cb [term 2 FOLLOWER]: Refusing update from remote peer 8846d581359a4b7ea6d4c33424ea825d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:56.801808  9914 consensus_queue.cc:1048] T e6797c587fdc4754b091a2be102e5927 P 8846d581359a4b7ea6d4c33424ea825d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:56.820426  9856 tablet_bootstrap.cc:492] T d2ef0242573643178d56d10a6c26ae8e P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:56.821673  9856 tablet_bootstrap.cc:492] T d2ef0242573643178d56d10a6c26ae8e P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap complete.
I20260709 13:02:56.822464  9856 ts_tablet_manager.cc:1403] T d2ef0242573643178d56d10a6c26ae8e P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent bootstrapping tablet: real 0.036s	user 0.010s	sys 0.004s
I20260709 13:02:56.825032  9856 raft_consensus.cc:359] T d2ef0242573643178d56d10a6c26ae8e P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:56.825692  9856 raft_consensus.cc:740] T d2ef0242573643178d56d10a6c26ae8e P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Initialized, Role: FOLLOWER
I20260709 13:02:56.826443  9856 consensus_queue.cc:260] T d2ef0242573643178d56d10a6c26ae8e P 65ed95869fbb4b69b5d6eb99c51adf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:56.831317  9908 raft_consensus.cc:3060] T e6797c587fdc4754b091a2be102e5927 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:56.828502  9856 ts_tablet_manager.cc:1434] T d2ef0242573643178d56d10a6c26ae8e P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:02:56.834571  9856 tablet_bootstrap.cc:492] T dbdc8579cca94ef7ab4babd287837e8c P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap starting.
I20260709 13:02:56.839643  9321 raft_consensus.cc:1275] T 534ae119bf014235a99dfbbfcff690e1 P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Refusing update from remote peer 8846d581359a4b7ea6d4c33424ea825d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:56.840044  9908 raft_consensus.cc:1275] T e6797c587fdc4754b091a2be102e5927 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 2 FOLLOWER]: Refusing update from remote peer 8846d581359a4b7ea6d4c33424ea825d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:56.844135  9937 consensus_queue.cc:1048] T 534ae119bf014235a99dfbbfcff690e1 P 8846d581359a4b7ea6d4c33424ea825d [LEADER]: Connected to new peer: Peer: permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:56.844099  9930 consensus_queue.cc:1048] T e6797c587fdc4754b091a2be102e5927 P 8846d581359a4b7ea6d4c33424ea825d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:56.847114  9908 raft_consensus.cc:3060] T 604bd81da85244b6bd6d8bd6ac674f2c P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:56.899726  9856 tablet_bootstrap.cc:492] T dbdc8579cca94ef7ab4babd287837e8c P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:56.900718  9856 tablet_bootstrap.cc:492] T dbdc8579cca94ef7ab4babd287837e8c P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap complete.
I20260709 13:02:56.901420  9856 ts_tablet_manager.cc:1403] T dbdc8579cca94ef7ab4babd287837e8c P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent bootstrapping tablet: real 0.067s	user 0.021s	sys 0.031s
I20260709 13:02:56.903879  9856 raft_consensus.cc:359] T dbdc8579cca94ef7ab4babd287837e8c P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:56.904552  9856 raft_consensus.cc:740] T dbdc8579cca94ef7ab4babd287837e8c P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Initialized, Role: FOLLOWER
I20260709 13:02:56.905169  9856 consensus_queue.cc:260] T dbdc8579cca94ef7ab4babd287837e8c P 65ed95869fbb4b69b5d6eb99c51adf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:56.907109  9856 ts_tablet_manager.cc:1434] T dbdc8579cca94ef7ab4babd287837e8c P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:02:56.907886  9856 tablet_bootstrap.cc:492] T e2fbc9c2c0a947f1b4a078db7c8402d0 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap starting.
I20260709 13:02:56.922379  9856 tablet_bootstrap.cc:492] T e2fbc9c2c0a947f1b4a078db7c8402d0 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:56.923187  9856 tablet_bootstrap.cc:492] T e2fbc9c2c0a947f1b4a078db7c8402d0 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap complete.
I20260709 13:02:56.923840  9856 ts_tablet_manager.cc:1403] T e2fbc9c2c0a947f1b4a078db7c8402d0 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.000s
I20260709 13:02:56.925858  9856 raft_consensus.cc:359] T e2fbc9c2c0a947f1b4a078db7c8402d0 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:56.926409  9856 raft_consensus.cc:740] T e2fbc9c2c0a947f1b4a078db7c8402d0 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Initialized, Role: FOLLOWER
I20260709 13:02:56.927034  9856 consensus_queue.cc:260] T e2fbc9c2c0a947f1b4a078db7c8402d0 P 65ed95869fbb4b69b5d6eb99c51adf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:56.928808  9856 ts_tablet_manager.cc:1434] T e2fbc9c2c0a947f1b4a078db7c8402d0 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:02:56.929490  9856 tablet_bootstrap.cc:492] T 6007c141b1134cb18ab1200556127236 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap starting.
I20260709 13:02:56.947408  9856 tablet_bootstrap.cc:492] T 6007c141b1134cb18ab1200556127236 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:56.948168  9856 tablet_bootstrap.cc:492] T 6007c141b1134cb18ab1200556127236 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap complete.
I20260709 13:02:56.948791  9856 ts_tablet_manager.cc:1403] T 6007c141b1134cb18ab1200556127236 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.000s
I20260709 13:02:56.951100  9856 raft_consensus.cc:359] T 6007c141b1134cb18ab1200556127236 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:56.951716  9856 raft_consensus.cc:740] T 6007c141b1134cb18ab1200556127236 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Initialized, Role: FOLLOWER
I20260709 13:02:56.952390  9856 consensus_queue.cc:260] T 6007c141b1134cb18ab1200556127236 P 65ed95869fbb4b69b5d6eb99c51adf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:56.954098  9856 ts_tablet_manager.cc:1434] T 6007c141b1134cb18ab1200556127236 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:02:56.954771  9856 tablet_bootstrap.cc:492] T 5b6b34440fd14f3ea66bd5de7a2a8260 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap starting.
I20260709 13:02:56.973194  9856 tablet_bootstrap.cc:492] T 5b6b34440fd14f3ea66bd5de7a2a8260 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:02:56.973523  9141 consensus_peers.cc:597] T eb666e221e5f4e4fbaba194838a28448 P c694531b0e1d47988b291f1214efc4cb -> Peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Couldn't send request to peer 65ed95869fbb4b69b5d6eb99c51adf85. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:56.974192  9856 tablet_bootstrap.cc:492] T 5b6b34440fd14f3ea66bd5de7a2a8260 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap complete.
I20260709 13:02:56.974956  9856 ts_tablet_manager.cc:1403] T 5b6b34440fd14f3ea66bd5de7a2a8260 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent bootstrapping tablet: real 0.020s	user 0.018s	sys 0.000s
W20260709 13:02:56.976485  9289 consensus_peers.cc:597] T d3044a44ee984c489779dc339d162407 P 74ac2cf163ee475e8a280cb3aa738f57 -> Peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Couldn't send request to peer 65ed95869fbb4b69b5d6eb99c51adf85. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:56.977401  9856 raft_consensus.cc:359] T 5b6b34440fd14f3ea66bd5de7a2a8260 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:56.977959  9856 raft_consensus.cc:740] T 5b6b34440fd14f3ea66bd5de7a2a8260 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Initialized, Role: FOLLOWER
I20260709 13:02:56.978538  9856 consensus_queue.cc:260] T 5b6b34440fd14f3ea66bd5de7a2a8260 P 65ed95869fbb4b69b5d6eb99c51adf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:56.980449  9856 ts_tablet_manager.cc:1434] T 5b6b34440fd14f3ea66bd5de7a2a8260 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:02:56.981730  9856 tablet_bootstrap.cc:492] T 93ba4182a04b450ca3fc7a15896f889e P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap starting.
I20260709 13:02:57.001613  9856 tablet_bootstrap.cc:492] T 93ba4182a04b450ca3fc7a15896f889e P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:57.002528  9856 tablet_bootstrap.cc:492] T 93ba4182a04b450ca3fc7a15896f889e P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap complete.
I20260709 13:02:57.003224  9856 ts_tablet_manager.cc:1403] T 93ba4182a04b450ca3fc7a15896f889e P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent bootstrapping tablet: real 0.022s	user 0.016s	sys 0.004s
I20260709 13:02:57.005458  9856 raft_consensus.cc:359] T 93ba4182a04b450ca3fc7a15896f889e P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:57.006016  9856 raft_consensus.cc:740] T 93ba4182a04b450ca3fc7a15896f889e P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Initialized, Role: FOLLOWER
I20260709 13:02:57.006713  9856 consensus_queue.cc:260] T 93ba4182a04b450ca3fc7a15896f889e P 65ed95869fbb4b69b5d6eb99c51adf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:57.008369  9856 ts_tablet_manager.cc:1434] T 93ba4182a04b450ca3fc7a15896f889e P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:02:57.009479  9856 tablet_bootstrap.cc:492] T ac928b0582c745b4804afcd30e861439 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap starting.
I20260709 13:02:57.026176  9856 tablet_bootstrap.cc:492] T ac928b0582c745b4804afcd30e861439 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:57.027105  9856 tablet_bootstrap.cc:492] T ac928b0582c745b4804afcd30e861439 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap complete.
I20260709 13:02:57.027689  9856 ts_tablet_manager.cc:1403] T ac928b0582c745b4804afcd30e861439 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.005s
I20260709 13:02:57.029628  9856 raft_consensus.cc:359] T ac928b0582c745b4804afcd30e861439 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:57.030319  9856 raft_consensus.cc:740] T ac928b0582c745b4804afcd30e861439 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Initialized, Role: FOLLOWER
I20260709 13:02:57.030895  9856 consensus_queue.cc:260] T ac928b0582c745b4804afcd30e861439 P 65ed95869fbb4b69b5d6eb99c51adf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:57.032423  9856 ts_tablet_manager.cc:1434] T ac928b0582c745b4804afcd30e861439 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent starting tablet: real 0.005s	user 0.000s	sys 0.004s
I20260709 13:02:57.033128  9856 tablet_bootstrap.cc:492] T 534ae119bf014235a99dfbbfcff690e1 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap starting.
I20260709 13:02:57.046517  9856 tablet_bootstrap.cc:492] T 534ae119bf014235a99dfbbfcff690e1 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:57.047461  9856 tablet_bootstrap.cc:492] T 534ae119bf014235a99dfbbfcff690e1 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap complete.
I20260709 13:02:57.048162  9856 ts_tablet_manager.cc:1403] T 534ae119bf014235a99dfbbfcff690e1 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent bootstrapping tablet: real 0.015s	user 0.013s	sys 0.000s
I20260709 13:02:57.050498  9856 raft_consensus.cc:359] T 534ae119bf014235a99dfbbfcff690e1 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:57.051155  9856 raft_consensus.cc:740] T 534ae119bf014235a99dfbbfcff690e1 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Initialized, Role: FOLLOWER
I20260709 13:02:57.051709  9856 consensus_queue.cc:260] T 534ae119bf014235a99dfbbfcff690e1 P 65ed95869fbb4b69b5d6eb99c51adf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:57.053256  9856 ts_tablet_manager.cc:1434] T 534ae119bf014235a99dfbbfcff690e1 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:02:57.053913  9856 tablet_bootstrap.cc:492] T eb666e221e5f4e4fbaba194838a28448 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap starting.
W20260709 13:02:57.062170  9141 consensus_peers.cc:597] T bfb390576f2e4f508caa2d234ed5d425 P c694531b0e1d47988b291f1214efc4cb -> Peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Couldn't send request to peer 65ed95869fbb4b69b5d6eb99c51adf85. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:57.066876  9856 tablet_bootstrap.cc:492] T eb666e221e5f4e4fbaba194838a28448 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:57.067930  9856 tablet_bootstrap.cc:492] T eb666e221e5f4e4fbaba194838a28448 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap complete.
I20260709 13:02:57.068634  9856 ts_tablet_manager.cc:1403] T eb666e221e5f4e4fbaba194838a28448 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.003s
I20260709 13:02:57.071190  9856 raft_consensus.cc:359] T eb666e221e5f4e4fbaba194838a28448 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:57.071890  9856 raft_consensus.cc:740] T eb666e221e5f4e4fbaba194838a28448 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Initialized, Role: FOLLOWER
I20260709 13:02:57.072592  9856 consensus_queue.cc:260] T eb666e221e5f4e4fbaba194838a28448 P 65ed95869fbb4b69b5d6eb99c51adf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:57.074600  9856 ts_tablet_manager.cc:1434] T eb666e221e5f4e4fbaba194838a28448 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:02:57.075436  9856 tablet_bootstrap.cc:492] T a1ab6d75958044aeac9e1d43da9dc4b9 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap starting.
I20260709 13:02:57.098392  9856 tablet_bootstrap.cc:492] T a1ab6d75958044aeac9e1d43da9dc4b9 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:57.099335  9856 tablet_bootstrap.cc:492] T a1ab6d75958044aeac9e1d43da9dc4b9 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap complete.
I20260709 13:02:57.099984  9856 ts_tablet_manager.cc:1403] T a1ab6d75958044aeac9e1d43da9dc4b9 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent bootstrapping tablet: real 0.025s	user 0.014s	sys 0.008s
I20260709 13:02:57.102265  9856 raft_consensus.cc:359] T a1ab6d75958044aeac9e1d43da9dc4b9 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:57.102761  9856 raft_consensus.cc:740] T a1ab6d75958044aeac9e1d43da9dc4b9 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Initialized, Role: FOLLOWER
I20260709 13:02:57.103271  9856 consensus_queue.cc:260] T a1ab6d75958044aeac9e1d43da9dc4b9 P 65ed95869fbb4b69b5d6eb99c51adf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:57.105145  9856 ts_tablet_manager.cc:1434] T a1ab6d75958044aeac9e1d43da9dc4b9 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:02:57.106293  9856 tablet_bootstrap.cc:492] T df7e9031dde347b5b9da753cc817ce17 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap starting.
I20260709 13:02:57.118355  9856 tablet_bootstrap.cc:492] T df7e9031dde347b5b9da753cc817ce17 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:57.119202  9856 tablet_bootstrap.cc:492] T df7e9031dde347b5b9da753cc817ce17 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap complete.
I20260709 13:02:57.119822  9856 ts_tablet_manager.cc:1403] T df7e9031dde347b5b9da753cc817ce17 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent bootstrapping tablet: real 0.014s	user 0.008s	sys 0.004s
I20260709 13:02:57.122159  9856 raft_consensus.cc:359] T df7e9031dde347b5b9da753cc817ce17 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:57.122800  9856 raft_consensus.cc:740] T df7e9031dde347b5b9da753cc817ce17 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Initialized, Role: FOLLOWER
I20260709 13:02:57.123576  9856 consensus_queue.cc:260] T df7e9031dde347b5b9da753cc817ce17 P 65ed95869fbb4b69b5d6eb99c51adf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:57.125437  9856 ts_tablet_manager.cc:1434] T df7e9031dde347b5b9da753cc817ce17 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent starting tablet: real 0.005s	user 0.000s	sys 0.004s
I20260709 13:02:57.126497  9856 tablet_bootstrap.cc:492] T 48e91509dfc74d53a930cdc636976db6 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap starting.
I20260709 13:02:57.139904  9856 tablet_bootstrap.cc:492] T 48e91509dfc74d53a930cdc636976db6 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:57.141083  9856 tablet_bootstrap.cc:492] T 48e91509dfc74d53a930cdc636976db6 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap complete.
I20260709 13:02:57.141768  9856 ts_tablet_manager.cc:1403] T 48e91509dfc74d53a930cdc636976db6 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.003s
I20260709 13:02:57.143997  9856 raft_consensus.cc:359] T 48e91509dfc74d53a930cdc636976db6 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:57.144688  9856 raft_consensus.cc:740] T 48e91509dfc74d53a930cdc636976db6 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Initialized, Role: FOLLOWER
I20260709 13:02:57.145385  9856 consensus_queue.cc:260] T 48e91509dfc74d53a930cdc636976db6 P 65ed95869fbb4b69b5d6eb99c51adf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:57.147048  9856 ts_tablet_manager.cc:1434] T 48e91509dfc74d53a930cdc636976db6 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:02:57.147768  9856 tablet_bootstrap.cc:492] T 070a6f2020a1483381e2baa75e5c0cbf P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap starting.
I20260709 13:02:57.169023  9905 raft_consensus.cc:3060] T d2ef0242573643178d56d10a6c26ae8e P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:57.178519  9856 tablet_bootstrap.cc:492] T 070a6f2020a1483381e2baa75e5c0cbf P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:57.179580  9856 tablet_bootstrap.cc:492] T 070a6f2020a1483381e2baa75e5c0cbf P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap complete.
I20260709 13:02:57.180227  9856 ts_tablet_manager.cc:1403] T 070a6f2020a1483381e2baa75e5c0cbf P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent bootstrapping tablet: real 0.033s	user 0.011s	sys 0.016s
I20260709 13:02:57.182701  9856 raft_consensus.cc:359] T 070a6f2020a1483381e2baa75e5c0cbf P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:57.184387  9856 raft_consensus.cc:740] T 070a6f2020a1483381e2baa75e5c0cbf P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Initialized, Role: FOLLOWER
I20260709 13:02:57.185019  9856 consensus_queue.cc:260] T 070a6f2020a1483381e2baa75e5c0cbf P 65ed95869fbb4b69b5d6eb99c51adf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
W20260709 13:02:57.192564  9289 consensus_peers.cc:597] T 4d2b02247c21448ea824065ad29304e7 P 74ac2cf163ee475e8a280cb3aa738f57 -> Peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Couldn't send request to peer 65ed95869fbb4b69b5d6eb99c51adf85. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:57.195101  9856 ts_tablet_manager.cc:1434] T 070a6f2020a1483381e2baa75e5c0cbf P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent starting tablet: real 0.015s	user 0.010s	sys 0.004s
I20260709 13:02:57.196048  9856 tablet_bootstrap.cc:492] T c7c964979a0443f68e90c8678d083c96 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap starting.
I20260709 13:02:57.234187  9856 tablet_bootstrap.cc:492] T c7c964979a0443f68e90c8678d083c96 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:57.235157  9856 tablet_bootstrap.cc:492] T c7c964979a0443f68e90c8678d083c96 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap complete.
I20260709 13:02:57.235777  9856 ts_tablet_manager.cc:1403] T c7c964979a0443f68e90c8678d083c96 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent bootstrapping tablet: real 0.040s	user 0.018s	sys 0.011s
I20260709 13:02:57.238082  9856 raft_consensus.cc:359] T c7c964979a0443f68e90c8678d083c96 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:57.238792  9856 raft_consensus.cc:740] T c7c964979a0443f68e90c8678d083c96 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Initialized, Role: FOLLOWER
I20260709 13:02:57.239457  9856 consensus_queue.cc:260] T c7c964979a0443f68e90c8678d083c96 P 65ed95869fbb4b69b5d6eb99c51adf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:02:57.241534  9856 ts_tablet_manager.cc:1434] T c7c964979a0443f68e90c8678d083c96 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent starting tablet: real 0.005s	user 0.000s	sys 0.004s
I20260709 13:02:57.242374  9856 tablet_bootstrap.cc:492] T bfb390576f2e4f508caa2d234ed5d425 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap starting.
W20260709 13:02:57.251124  9141 consensus_peers.cc:597] T 5cea8a8078e8456186d4d1a184d3f157 P c694531b0e1d47988b291f1214efc4cb -> Peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Couldn't send request to peer 65ed95869fbb4b69b5d6eb99c51adf85. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:57.263090  9856 tablet_bootstrap.cc:492] T bfb390576f2e4f508caa2d234ed5d425 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:57.263453  9905 raft_consensus.cc:3060] T 070a6f2020a1483381e2baa75e5c0cbf P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:57.264179  9856 tablet_bootstrap.cc:492] T bfb390576f2e4f508caa2d234ed5d425 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap complete.
I20260709 13:02:57.264954  9856 ts_tablet_manager.cc:1403] T bfb390576f2e4f508caa2d234ed5d425 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent bootstrapping tablet: real 0.023s	user 0.015s	sys 0.004s
I20260709 13:02:57.268229  9856 raft_consensus.cc:359] T bfb390576f2e4f508caa2d234ed5d425 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:57.269019  9856 raft_consensus.cc:740] T bfb390576f2e4f508caa2d234ed5d425 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Initialized, Role: FOLLOWER
I20260709 13:02:57.269680  9856 consensus_queue.cc:260] T bfb390576f2e4f508caa2d234ed5d425 P 65ed95869fbb4b69b5d6eb99c51adf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:57.272034  9856 ts_tablet_manager.cc:1434] T bfb390576f2e4f508caa2d234ed5d425 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 13:02:57.273993  9856 tablet_bootstrap.cc:492] T 51a2ca964a8f4fb89b26d77b1b334f30 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap starting.
I20260709 13:02:57.292029  9856 tablet_bootstrap.cc:492] T 51a2ca964a8f4fb89b26d77b1b334f30 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:57.292764  9856 tablet_bootstrap.cc:492] T 51a2ca964a8f4fb89b26d77b1b334f30 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap complete.
I20260709 13:02:57.293290  9856 ts_tablet_manager.cc:1403] T 51a2ca964a8f4fb89b26d77b1b334f30 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.000s
I20260709 13:02:57.295140  9856 raft_consensus.cc:359] T 51a2ca964a8f4fb89b26d77b1b334f30 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:57.295636  9856 raft_consensus.cc:740] T 51a2ca964a8f4fb89b26d77b1b334f30 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Initialized, Role: FOLLOWER
I20260709 13:02:57.296156  9856 consensus_queue.cc:260] T 51a2ca964a8f4fb89b26d77b1b334f30 P 65ed95869fbb4b69b5d6eb99c51adf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:57.298272  9856 ts_tablet_manager.cc:1434] T 51a2ca964a8f4fb89b26d77b1b334f30 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent starting tablet: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:02:57.299038  9856 tablet_bootstrap.cc:492] T d3044a44ee984c489779dc339d162407 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap starting.
I20260709 13:02:57.313553  9856 tablet_bootstrap.cc:492] T d3044a44ee984c489779dc339d162407 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:57.314481  9856 tablet_bootstrap.cc:492] T d3044a44ee984c489779dc339d162407 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap complete.
I20260709 13:02:57.315155  9856 ts_tablet_manager.cc:1403] T d3044a44ee984c489779dc339d162407 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent bootstrapping tablet: real 0.016s	user 0.014s	sys 0.000s
I20260709 13:02:57.318511  9856 raft_consensus.cc:359] T d3044a44ee984c489779dc339d162407 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:57.319263  9856 raft_consensus.cc:740] T d3044a44ee984c489779dc339d162407 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Initialized, Role: FOLLOWER
I20260709 13:02:57.319923  9856 consensus_queue.cc:260] T d3044a44ee984c489779dc339d162407 P 65ed95869fbb4b69b5d6eb99c51adf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:57.328166  9856 ts_tablet_manager.cc:1434] T d3044a44ee984c489779dc339d162407 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.000s
I20260709 13:02:57.328864  9856 tablet_bootstrap.cc:492] T 4d2b02247c21448ea824065ad29304e7 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap starting.
I20260709 13:02:57.343776  9856 tablet_bootstrap.cc:492] T 4d2b02247c21448ea824065ad29304e7 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:57.344493  9856 tablet_bootstrap.cc:492] T 4d2b02247c21448ea824065ad29304e7 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap complete.
I20260709 13:02:57.345067  9856 ts_tablet_manager.cc:1403] T 4d2b02247c21448ea824065ad29304e7 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.000s
I20260709 13:02:57.346915  9856 raft_consensus.cc:359] T 4d2b02247c21448ea824065ad29304e7 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:57.347575  9856 raft_consensus.cc:740] T 4d2b02247c21448ea824065ad29304e7 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Initialized, Role: FOLLOWER
I20260709 13:02:57.348237  9856 consensus_queue.cc:260] T 4d2b02247c21448ea824065ad29304e7 P 65ed95869fbb4b69b5d6eb99c51adf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:57.349516  9904 raft_consensus.cc:3060] T 534ae119bf014235a99dfbbfcff690e1 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:57.350239  9856 ts_tablet_manager.cc:1434] T 4d2b02247c21448ea824065ad29304e7 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:02:57.351634  9856 tablet_bootstrap.cc:492] T 5cea8a8078e8456186d4d1a184d3f157 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap starting.
I20260709 13:02:57.399017  9856 tablet_bootstrap.cc:492] T 5cea8a8078e8456186d4d1a184d3f157 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:57.400619  9856 tablet_bootstrap.cc:492] T 5cea8a8078e8456186d4d1a184d3f157 P 65ed95869fbb4b69b5d6eb99c51adf85: Bootstrap complete.
I20260709 13:02:57.401414  9856 ts_tablet_manager.cc:1403] T 5cea8a8078e8456186d4d1a184d3f157 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent bootstrapping tablet: real 0.050s	user 0.035s	sys 0.012s
I20260709 13:02:57.403887  9856 raft_consensus.cc:359] T 5cea8a8078e8456186d4d1a184d3f157 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:57.404557  9856 raft_consensus.cc:740] T 5cea8a8078e8456186d4d1a184d3f157 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Initialized, Role: FOLLOWER
I20260709 13:02:57.405229  9856 consensus_queue.cc:260] T 5cea8a8078e8456186d4d1a184d3f157 P 65ed95869fbb4b69b5d6eb99c51adf85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:57.407474  9856 ts_tablet_manager.cc:1434] T 5cea8a8078e8456186d4d1a184d3f157 P 65ed95869fbb4b69b5d6eb99c51adf85: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:02:57.751192 10008 raft_consensus.cc:493] T 7f278d22c55747ee8ee613bfa5c59391 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:57.751729 10008 raft_consensus.cc:515] T 7f278d22c55747ee8ee613bfa5c59391 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:57.753720 10008 leader_election.cc:290] T 7f278d22c55747ee8ee613bfa5c59391 P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351), c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455)
I20260709 13:02:57.757545  9173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f278d22c55747ee8ee613bfa5c59391" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c694531b0e1d47988b291f1214efc4cb" is_pre_election: true
I20260709 13:02:57.758392  9173 raft_consensus.cc:2393] T 7f278d22c55747ee8ee613bfa5c59391 P c694531b0e1d47988b291f1214efc4cb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65ed95869fbb4b69b5d6eb99c51adf85 in current term 2: Already voted for candidate c694531b0e1d47988b291f1214efc4cb in this term.
I20260709 13:02:57.772574  9319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f278d22c55747ee8ee613bfa5c59391" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57" is_pre_election: true
I20260709 13:02:57.773361  9319 raft_consensus.cc:2393] T 7f278d22c55747ee8ee613bfa5c59391 P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65ed95869fbb4b69b5d6eb99c51adf85 in current term 2: Already voted for candidate 74ac2cf163ee475e8a280cb3aa738f57 in this term.
I20260709 13:02:57.774493  9852 leader_election.cc:304] T 7f278d22c55747ee8ee613bfa5c59391 P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65ed95869fbb4b69b5d6eb99c51adf85; no voters: 74ac2cf163ee475e8a280cb3aa738f57, c694531b0e1d47988b291f1214efc4cb
I20260709 13:02:57.775494 10008 raft_consensus.cc:3060] T 7f278d22c55747ee8ee613bfa5c59391 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:57.782545 10008 raft_consensus.cc:2749] T 7f278d22c55747ee8ee613bfa5c59391 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:57.797485 10008 raft_consensus.cc:493] T 5ce2a33a3b914f6297946ded34c256bf P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:57.797916 10008 raft_consensus.cc:515] T 5ce2a33a3b914f6297946ded34c256bf P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:57.799772 10008 leader_election.cc:290] T 5ce2a33a3b914f6297946ded34c256bf P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311), 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351)
I20260709 13:02:57.800503  9250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce2a33a3b914f6297946ded34c256bf" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d" is_pre_election: true
I20260709 13:02:57.800726  9321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce2a33a3b914f6297946ded34c256bf" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57" is_pre_election: true
I20260709 13:02:57.801298  9321 raft_consensus.cc:2393] T 5ce2a33a3b914f6297946ded34c256bf P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65ed95869fbb4b69b5d6eb99c51adf85 in current term 2: Already voted for candidate 74ac2cf163ee475e8a280cb3aa738f57 in this term.
I20260709 13:02:57.801337  9250 raft_consensus.cc:2393] T 5ce2a33a3b914f6297946ded34c256bf P 8846d581359a4b7ea6d4c33424ea825d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65ed95869fbb4b69b5d6eb99c51adf85 in current term 2: Already voted for candidate 8846d581359a4b7ea6d4c33424ea825d in this term.
I20260709 13:02:57.802502  9850 leader_election.cc:304] T 5ce2a33a3b914f6297946ded34c256bf P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65ed95869fbb4b69b5d6eb99c51adf85; no voters: 74ac2cf163ee475e8a280cb3aa738f57, 8846d581359a4b7ea6d4c33424ea825d
I20260709 13:02:57.803303 10008 raft_consensus.cc:3060] T 5ce2a33a3b914f6297946ded34c256bf P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:57.808329 10008 raft_consensus.cc:2749] T 5ce2a33a3b914f6297946ded34c256bf P 65ed95869fbb4b69b5d6eb99c51adf85 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:57.838615  9858 raft_consensus.cc:493] T 5ce2a33a3b914f6297946ded34c256bf P 8846d581359a4b7ea6d4c33424ea825d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:57.839227  9858 raft_consensus.cc:515] T 5ce2a33a3b914f6297946ded34c256bf P 8846d581359a4b7ea6d4c33424ea825d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:57.841369  9858 leader_election.cc:290] T 5ce2a33a3b914f6297946ded34c256bf P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351), 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979)
I20260709 13:02:57.842561  9321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce2a33a3b914f6297946ded34c256bf" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57" is_pre_election: true
I20260709 13:02:57.843252  9321 raft_consensus.cc:2468] T 5ce2a33a3b914f6297946ded34c256bf P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8846d581359a4b7ea6d4c33424ea825d in term 2.
I20260709 13:02:57.843343  9904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce2a33a3b914f6297946ded34c256bf" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" is_pre_election: true
I20260709 13:02:57.844058  9904 raft_consensus.cc:2468] T 5ce2a33a3b914f6297946ded34c256bf P 65ed95869fbb4b69b5d6eb99c51adf85 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8846d581359a4b7ea6d4c33424ea825d in term 2.
I20260709 13:02:57.844310  9215 leader_election.cc:304] T 5ce2a33a3b914f6297946ded34c256bf P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57, 8846d581359a4b7ea6d4c33424ea825d; no voters: 
I20260709 13:02:57.845160  9858 raft_consensus.cc:2804] T 5ce2a33a3b914f6297946ded34c256bf P 8846d581359a4b7ea6d4c33424ea825d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:57.845525  9858 raft_consensus.cc:493] T 5ce2a33a3b914f6297946ded34c256bf P 8846d581359a4b7ea6d4c33424ea825d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:57.845870  9858 raft_consensus.cc:3060] T 5ce2a33a3b914f6297946ded34c256bf P 8846d581359a4b7ea6d4c33424ea825d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:57.852728  9858 raft_consensus.cc:515] T 5ce2a33a3b914f6297946ded34c256bf P 8846d581359a4b7ea6d4c33424ea825d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:57.854774  9858 leader_election.cc:290] T 5ce2a33a3b914f6297946ded34c256bf P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 3 election: Requested vote from peers 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351), 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979)
I20260709 13:02:57.855268  9321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce2a33a3b914f6297946ded34c256bf" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57"
I20260709 13:02:57.855770  9905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce2a33a3b914f6297946ded34c256bf" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85"
I20260709 13:02:57.856103  9321 raft_consensus.cc:3060] T 5ce2a33a3b914f6297946ded34c256bf P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:57.856437  9905 raft_consensus.cc:3060] T 5ce2a33a3b914f6297946ded34c256bf P 65ed95869fbb4b69b5d6eb99c51adf85 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:57.863543  9905 raft_consensus.cc:2468] T 5ce2a33a3b914f6297946ded34c256bf P 65ed95869fbb4b69b5d6eb99c51adf85 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8846d581359a4b7ea6d4c33424ea825d in term 3.
I20260709 13:02:57.864691  9215 leader_election.cc:304] T 5ce2a33a3b914f6297946ded34c256bf P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65ed95869fbb4b69b5d6eb99c51adf85, 8846d581359a4b7ea6d4c33424ea825d; no voters: 
I20260709 13:02:57.865641  9858 raft_consensus.cc:2804] T 5ce2a33a3b914f6297946ded34c256bf P 8846d581359a4b7ea6d4c33424ea825d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:57.866055  9858 raft_consensus.cc:697] T 5ce2a33a3b914f6297946ded34c256bf P 8846d581359a4b7ea6d4c33424ea825d [term 3 LEADER]: Becoming Leader. State: Replica: 8846d581359a4b7ea6d4c33424ea825d, State: Running, Role: LEADER
I20260709 13:02:57.866852  9858 consensus_queue.cc:237] T 5ce2a33a3b914f6297946ded34c256bf P 8846d581359a4b7ea6d4c33424ea825d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:57.869640 10008 raft_consensus.cc:493] T 9d21e8696b0340bea31002b775af50ee P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:57.870283 10008 raft_consensus.cc:515] T 9d21e8696b0340bea31002b775af50ee P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:57.870808  9321 raft_consensus.cc:2468] T 5ce2a33a3b914f6297946ded34c256bf P 74ac2cf163ee475e8a280cb3aa738f57 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8846d581359a4b7ea6d4c33424ea825d in term 3.
I20260709 13:02:57.872404 10008 leader_election.cc:290] T 9d21e8696b0340bea31002b775af50ee P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311), 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351)
I20260709 13:02:57.873904  9250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d21e8696b0340bea31002b775af50ee" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8846d581359a4b7ea6d4c33424ea825d" is_pre_election: true
I20260709 13:02:57.874351  9316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d21e8696b0340bea31002b775af50ee" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57" is_pre_election: true
I20260709 13:02:57.874794  9250 raft_consensus.cc:2393] T 9d21e8696b0340bea31002b775af50ee P 8846d581359a4b7ea6d4c33424ea825d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65ed95869fbb4b69b5d6eb99c51adf85 in current term 2: Already voted for candidate 8846d581359a4b7ea6d4c33424ea825d in this term.
I20260709 13:02:57.875169  9316 raft_consensus.cc:2393] T 9d21e8696b0340bea31002b775af50ee P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65ed95869fbb4b69b5d6eb99c51adf85 in current term 2: Already voted for candidate 74ac2cf163ee475e8a280cb3aa738f57 in this term.
I20260709 13:02:57.878147  9852 leader_election.cc:304] T 9d21e8696b0340bea31002b775af50ee P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65ed95869fbb4b69b5d6eb99c51adf85; no voters: 74ac2cf163ee475e8a280cb3aa738f57, 8846d581359a4b7ea6d4c33424ea825d
I20260709 13:02:57.881742 10008 raft_consensus.cc:3060] T 9d21e8696b0340bea31002b775af50ee P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:57.889287 10008 raft_consensus.cc:2749] T 9d21e8696b0340bea31002b775af50ee P 65ed95869fbb4b69b5d6eb99c51adf85 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:57.891770  8997 catalog_manager.cc:5697] T 5ce2a33a3b914f6297946ded34c256bf P 8846d581359a4b7ea6d4c33424ea825d reported cstate change: term changed from 1 to 3, leader changed from 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193) to 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195). New cstate: current_term: 3 leader_uuid: "8846d581359a4b7ea6d4c33424ea825d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:57.911625  9858 raft_consensus.cc:493] T 9d21e8696b0340bea31002b775af50ee P 8846d581359a4b7ea6d4c33424ea825d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:57.912173  9858 raft_consensus.cc:515] T 9d21e8696b0340bea31002b775af50ee P 8846d581359a4b7ea6d4c33424ea825d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:57.914407  9858 leader_election.cc:290] T 9d21e8696b0340bea31002b775af50ee P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351), 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979)
I20260709 13:02:57.915374  9319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d21e8696b0340bea31002b775af50ee" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57" is_pre_election: true
I20260709 13:02:57.916085  9319 raft_consensus.cc:2468] T 9d21e8696b0340bea31002b775af50ee P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8846d581359a4b7ea6d4c33424ea825d in term 2.
I20260709 13:02:57.916887  9905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d21e8696b0340bea31002b775af50ee" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" is_pre_election: true
I20260709 13:02:57.916996  9215 leader_election.cc:304] T 9d21e8696b0340bea31002b775af50ee P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57, 8846d581359a4b7ea6d4c33424ea825d; no voters: 
I20260709 13:02:57.917491  9905 raft_consensus.cc:2468] T 9d21e8696b0340bea31002b775af50ee P 65ed95869fbb4b69b5d6eb99c51adf85 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8846d581359a4b7ea6d4c33424ea825d in term 2.
I20260709 13:02:57.917837  9858 raft_consensus.cc:2804] T 9d21e8696b0340bea31002b775af50ee P 8846d581359a4b7ea6d4c33424ea825d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:57.918311  9858 raft_consensus.cc:493] T 9d21e8696b0340bea31002b775af50ee P 8846d581359a4b7ea6d4c33424ea825d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:57.918695  9858 raft_consensus.cc:3060] T 9d21e8696b0340bea31002b775af50ee P 8846d581359a4b7ea6d4c33424ea825d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:57.924465  9858 raft_consensus.cc:515] T 9d21e8696b0340bea31002b775af50ee P 8846d581359a4b7ea6d4c33424ea825d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:57.926014  9858 leader_election.cc:290] T 9d21e8696b0340bea31002b775af50ee P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 3 election: Requested vote from peers 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351), 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979)
I20260709 13:02:57.926729  9319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d21e8696b0340bea31002b775af50ee" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57"
I20260709 13:02:57.926971  9905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d21e8696b0340bea31002b775af50ee" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85"
I20260709 13:02:57.927261  9319 raft_consensus.cc:3060] T 9d21e8696b0340bea31002b775af50ee P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:57.927575  9905 raft_consensus.cc:3060] T 9d21e8696b0340bea31002b775af50ee P 65ed95869fbb4b69b5d6eb99c51adf85 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:57.932519  9319 raft_consensus.cc:2468] T 9d21e8696b0340bea31002b775af50ee P 74ac2cf163ee475e8a280cb3aa738f57 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8846d581359a4b7ea6d4c33424ea825d in term 3.
I20260709 13:02:57.933611  9905 raft_consensus.cc:2468] T 9d21e8696b0340bea31002b775af50ee P 65ed95869fbb4b69b5d6eb99c51adf85 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8846d581359a4b7ea6d4c33424ea825d in term 3.
I20260709 13:02:57.933840  9215 leader_election.cc:304] T 9d21e8696b0340bea31002b775af50ee P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57, 8846d581359a4b7ea6d4c33424ea825d; no voters: 
I20260709 13:02:57.934600  9858 raft_consensus.cc:2804] T 9d21e8696b0340bea31002b775af50ee P 8846d581359a4b7ea6d4c33424ea825d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:57.935021  9858 raft_consensus.cc:697] T 9d21e8696b0340bea31002b775af50ee P 8846d581359a4b7ea6d4c33424ea825d [term 3 LEADER]: Becoming Leader. State: Replica: 8846d581359a4b7ea6d4c33424ea825d, State: Running, Role: LEADER
I20260709 13:02:57.935721  9858 consensus_queue.cc:237] T 9d21e8696b0340bea31002b775af50ee P 8846d581359a4b7ea6d4c33424ea825d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:02:57.943780  8997 catalog_manager.cc:5697] T 9d21e8696b0340bea31002b775af50ee P 8846d581359a4b7ea6d4c33424ea825d reported cstate change: term changed from 1 to 3, leader changed from 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193) to 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195). New cstate: current_term: 3 leader_uuid: "8846d581359a4b7ea6d4c33424ea825d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:58.024036  9887 raft_consensus.cc:493] T 7f278d22c55747ee8ee613bfa5c59391 P c694531b0e1d47988b291f1214efc4cb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:58.024601  9887 raft_consensus.cc:515] T 7f278d22c55747ee8ee613bfa5c59391 P c694531b0e1d47988b291f1214efc4cb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:58.027215  9324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f278d22c55747ee8ee613bfa5c59391" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57" is_pre_election: true
I20260709 13:02:58.026599  9887 leader_election.cc:290] T 7f278d22c55747ee8ee613bfa5c59391 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351), 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979)
I20260709 13:02:58.027956  9324 raft_consensus.cc:2468] T 7f278d22c55747ee8ee613bfa5c59391 P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c694531b0e1d47988b291f1214efc4cb in term 2.
I20260709 13:02:58.028093  9904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f278d22c55747ee8ee613bfa5c59391" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" is_pre_election: true
I20260709 13:02:58.028867  9904 raft_consensus.cc:2468] T 7f278d22c55747ee8ee613bfa5c59391 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c694531b0e1d47988b291f1214efc4cb in term 2.
I20260709 13:02:58.029419  9141 leader_election.cc:304] T 7f278d22c55747ee8ee613bfa5c59391 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57, c694531b0e1d47988b291f1214efc4cb; no voters: 
I20260709 13:02:58.030145  9887 raft_consensus.cc:2804] T 7f278d22c55747ee8ee613bfa5c59391 P c694531b0e1d47988b291f1214efc4cb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:58.030540  9887 raft_consensus.cc:493] T 7f278d22c55747ee8ee613bfa5c59391 P c694531b0e1d47988b291f1214efc4cb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:58.030898  9887 raft_consensus.cc:3060] T 7f278d22c55747ee8ee613bfa5c59391 P c694531b0e1d47988b291f1214efc4cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:58.038318  9887 raft_consensus.cc:515] T 7f278d22c55747ee8ee613bfa5c59391 P c694531b0e1d47988b291f1214efc4cb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:58.040879  9887 leader_election.cc:290] T 7f278d22c55747ee8ee613bfa5c59391 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 3 election: Requested vote from peers 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351), 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979)
I20260709 13:02:58.041061  9324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f278d22c55747ee8ee613bfa5c59391" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57"
I20260709 13:02:58.041675  9324 raft_consensus.cc:3060] T 7f278d22c55747ee8ee613bfa5c59391 P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:58.041824  9904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f278d22c55747ee8ee613bfa5c59391" candidate_uuid: "c694531b0e1d47988b291f1214efc4cb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85"
I20260709 13:02:58.042697  9904 raft_consensus.cc:3060] T 7f278d22c55747ee8ee613bfa5c59391 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:58.049324  9324 raft_consensus.cc:2468] T 7f278d22c55747ee8ee613bfa5c59391 P 74ac2cf163ee475e8a280cb3aa738f57 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c694531b0e1d47988b291f1214efc4cb in term 3.
I20260709 13:02:58.050529  9141 leader_election.cc:304] T 7f278d22c55747ee8ee613bfa5c59391 P c694531b0e1d47988b291f1214efc4cb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57, c694531b0e1d47988b291f1214efc4cb; no voters: 
I20260709 13:02:58.051422  9887 raft_consensus.cc:2804] T 7f278d22c55747ee8ee613bfa5c59391 P c694531b0e1d47988b291f1214efc4cb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:58.051925  9887 raft_consensus.cc:697] T 7f278d22c55747ee8ee613bfa5c59391 P c694531b0e1d47988b291f1214efc4cb [term 3 LEADER]: Becoming Leader. State: Replica: c694531b0e1d47988b291f1214efc4cb, State: Running, Role: LEADER
I20260709 13:02:58.053229  9904 raft_consensus.cc:2468] T 7f278d22c55747ee8ee613bfa5c59391 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c694531b0e1d47988b291f1214efc4cb in term 3.
I20260709 13:02:58.052757  9887 consensus_queue.cc:237] T 7f278d22c55747ee8ee613bfa5c59391 P c694531b0e1d47988b291f1214efc4cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:02:58.064142  8997 catalog_manager.cc:5697] T 7f278d22c55747ee8ee613bfa5c59391 P c694531b0e1d47988b291f1214efc4cb reported cstate change: term changed from 1 to 3, leader changed from 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193) to c694531b0e1d47988b291f1214efc4cb (127.0.107.194). New cstate: current_term: 3 leader_uuid: "c694531b0e1d47988b291f1214efc4cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:58.348950  9905 raft_consensus.cc:1275] T 5ce2a33a3b914f6297946ded34c256bf P 65ed95869fbb4b69b5d6eb99c51adf85 [term 3 FOLLOWER]: Refusing update from remote peer 8846d581359a4b7ea6d4c33424ea825d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:58.350459  9914 consensus_queue.cc:1048] T 5ce2a33a3b914f6297946ded34c256bf P 8846d581359a4b7ea6d4c33424ea825d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:58.361790  9324 raft_consensus.cc:1275] T 5ce2a33a3b914f6297946ded34c256bf P 74ac2cf163ee475e8a280cb3aa738f57 [term 3 FOLLOWER]: Refusing update from remote peer 8846d581359a4b7ea6d4c33424ea825d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:58.364693  9914 consensus_queue.cc:1048] T 5ce2a33a3b914f6297946ded34c256bf P 8846d581359a4b7ea6d4c33424ea825d [LEADER]: Connected to new peer: Peer: permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:58.408824  9905 raft_consensus.cc:1275] T 9d21e8696b0340bea31002b775af50ee P 65ed95869fbb4b69b5d6eb99c51adf85 [term 3 FOLLOWER]: Refusing update from remote peer 8846d581359a4b7ea6d4c33424ea825d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:58.410174  9930 consensus_queue.cc:1048] T 9d21e8696b0340bea31002b775af50ee P 8846d581359a4b7ea6d4c33424ea825d [LEADER]: Connected to new peer: Peer: permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:58.421855  9319 raft_consensus.cc:1275] T 9d21e8696b0340bea31002b775af50ee P 74ac2cf163ee475e8a280cb3aa738f57 [term 3 FOLLOWER]: Refusing update from remote peer 8846d581359a4b7ea6d4c33424ea825d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:58.423386  9858 consensus_queue.cc:1048] T 9d21e8696b0340bea31002b775af50ee P 8846d581359a4b7ea6d4c33424ea825d [LEADER]: Connected to new peer: Peer: permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:58.584266  9319 raft_consensus.cc:1275] T 7f278d22c55747ee8ee613bfa5c59391 P 74ac2cf163ee475e8a280cb3aa738f57 [term 3 FOLLOWER]: Refusing update from remote peer c694531b0e1d47988b291f1214efc4cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:58.585340  9887 consensus_queue.cc:1048] T 7f278d22c55747ee8ee613bfa5c59391 P c694531b0e1d47988b291f1214efc4cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:58.593916  9904 raft_consensus.cc:1275] T 7f278d22c55747ee8ee613bfa5c59391 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 3 FOLLOWER]: Refusing update from remote peer c694531b0e1d47988b291f1214efc4cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:58.595610 10005 consensus_queue.cc:1048] T 7f278d22c55747ee8ee613bfa5c59391 P c694531b0e1d47988b291f1214efc4cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:06.387822   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:06.441551  9248 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0effc3d52a6d43ef8aa59821958f4e52"
dest_uuid: "8846d581359a4b7ea6d4c33424ea825d"
mode: GRACEFUL
new_leader_uuid: "65ed95869fbb4b69b5d6eb99c51adf85"
 from {username='slave'} at 127.0.0.1:55078
I20260709 13:03:06.442190  9248 raft_consensus.cc:606] T 0effc3d52a6d43ef8aa59821958f4e52 P 8846d581359a4b7ea6d4c33424ea825d [term 1 LEADER]: Received request to transfer leadership to TS 65ed95869fbb4b69b5d6eb99c51adf85
I20260709 13:03:06.444782  9248 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6cb786213d5d48779533059bc333ac6f"
dest_uuid: "8846d581359a4b7ea6d4c33424ea825d"
mode: GRACEFUL
new_leader_uuid: "74ac2cf163ee475e8a280cb3aa738f57"
 from {username='slave'} at 127.0.0.1:55078
I20260709 13:03:06.445272  9248 raft_consensus.cc:606] T 6cb786213d5d48779533059bc333ac6f P 8846d581359a4b7ea6d4c33424ea825d [term 1 LEADER]: Received request to transfer leadership to TS 74ac2cf163ee475e8a280cb3aa738f57
I20260709 13:03:06.456471  9173 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8f67cb568c0745e792c17959b07c5da1"
dest_uuid: "c694531b0e1d47988b291f1214efc4cb"
mode: GRACEFUL
new_leader_uuid: "65ed95869fbb4b69b5d6eb99c51adf85"
 from {username='slave'} at 127.0.0.1:35670
I20260709 13:03:06.457122  9173 raft_consensus.cc:606] T 8f67cb568c0745e792c17959b07c5da1 P c694531b0e1d47988b291f1214efc4cb [term 1 LEADER]: Received request to transfer leadership to TS 65ed95869fbb4b69b5d6eb99c51adf85
I20260709 13:03:06.459843  9248 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "902451f24024496b83b9a05dfe359a22"
dest_uuid: "8846d581359a4b7ea6d4c33424ea825d"
mode: GRACEFUL
new_leader_uuid: "74ac2cf163ee475e8a280cb3aa738f57"
 from {username='slave'} at 127.0.0.1:55078
I20260709 13:03:06.460314  9248 raft_consensus.cc:606] T 902451f24024496b83b9a05dfe359a22 P 8846d581359a4b7ea6d4c33424ea825d [term 1 LEADER]: Received request to transfer leadership to TS 74ac2cf163ee475e8a280cb3aa738f57
I20260709 13:03:06.462796  9248 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9d21e8696b0340bea31002b775af50ee"
dest_uuid: "8846d581359a4b7ea6d4c33424ea825d"
mode: GRACEFUL
new_leader_uuid: "65ed95869fbb4b69b5d6eb99c51adf85"
 from {username='slave'} at 127.0.0.1:55078
I20260709 13:03:06.463308  9248 raft_consensus.cc:606] T 9d21e8696b0340bea31002b775af50ee P 8846d581359a4b7ea6d4c33424ea825d [term 3 LEADER]: Received request to transfer leadership to TS 65ed95869fbb4b69b5d6eb99c51adf85
I20260709 13:03:06.466586  9248 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a731a965126b406988eecb7829bc9981"
dest_uuid: "8846d581359a4b7ea6d4c33424ea825d"
mode: GRACEFUL
new_leader_uuid: "65ed95869fbb4b69b5d6eb99c51adf85"
 from {username='slave'} at 127.0.0.1:55078
I20260709 13:03:06.467171  9248 raft_consensus.cc:606] T a731a965126b406988eecb7829bc9981 P 8846d581359a4b7ea6d4c33424ea825d [term 1 LEADER]: Received request to transfer leadership to TS 65ed95869fbb4b69b5d6eb99c51adf85
I20260709 13:03:06.468334   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:03:06.469951   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:06.489647 10047 raft_consensus.cc:993] T 9d21e8696b0340bea31002b775af50ee P 8846d581359a4b7ea6d4c33424ea825d: : Instructing follower 65ed95869fbb4b69b5d6eb99c51adf85 to start an election
I20260709 13:03:06.490244 10047 raft_consensus.cc:1081] T 9d21e8696b0340bea31002b775af50ee P 8846d581359a4b7ea6d4c33424ea825d [term 3 LEADER]: Signalling peer 65ed95869fbb4b69b5d6eb99c51adf85 to start an election
I20260709 13:03:06.492157  9905 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9d21e8696b0340bea31002b775af50ee"
dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85"
 from {username='slave'} at 127.0.0.1:59622
I20260709 13:03:06.492765  9905 raft_consensus.cc:493] T 9d21e8696b0340bea31002b775af50ee P 65ed95869fbb4b69b5d6eb99c51adf85 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:06.493139  9905 raft_consensus.cc:3060] T 9d21e8696b0340bea31002b775af50ee P 65ed95869fbb4b69b5d6eb99c51adf85 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:06.500352  9905 raft_consensus.cc:515] T 9d21e8696b0340bea31002b775af50ee P 65ed95869fbb4b69b5d6eb99c51adf85 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:03:06.501995  9905 leader_election.cc:290] T 9d21e8696b0340bea31002b775af50ee P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 4 election: Requested vote from peers 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311), 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351)
I20260709 13:03:06.502995  9248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d21e8696b0340bea31002b775af50ee" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "8846d581359a4b7ea6d4c33424ea825d"
I20260709 13:03:06.503219  9319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d21e8696b0340bea31002b775af50ee" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57"
I20260709 13:03:06.503726  9248 raft_consensus.cc:3055] T 9d21e8696b0340bea31002b775af50ee P 8846d581359a4b7ea6d4c33424ea825d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:06.503845  9319 raft_consensus.cc:3060] T 9d21e8696b0340bea31002b775af50ee P 74ac2cf163ee475e8a280cb3aa738f57 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:06.503983  9248 raft_consensus.cc:740] T 9d21e8696b0340bea31002b775af50ee P 8846d581359a4b7ea6d4c33424ea825d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8846d581359a4b7ea6d4c33424ea825d, State: Running, Role: LEADER
I20260709 13:03:06.504683  9248 consensus_queue.cc:260] T 9d21e8696b0340bea31002b775af50ee P 8846d581359a4b7ea6d4c33424ea825d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:03:06.505602  9248 raft_consensus.cc:3060] T 9d21e8696b0340bea31002b775af50ee P 8846d581359a4b7ea6d4c33424ea825d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:06.509101  9319 raft_consensus.cc:2468] T 9d21e8696b0340bea31002b775af50ee P 74ac2cf163ee475e8a280cb3aa738f57 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65ed95869fbb4b69b5d6eb99c51adf85 in term 4.
I20260709 13:03:06.510556  9852 leader_election.cc:304] T 9d21e8696b0340bea31002b775af50ee P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65ed95869fbb4b69b5d6eb99c51adf85, 74ac2cf163ee475e8a280cb3aa738f57; no voters: 
I20260709 13:03:06.514312  9248 raft_consensus.cc:2468] T 9d21e8696b0340bea31002b775af50ee P 8846d581359a4b7ea6d4c33424ea825d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65ed95869fbb4b69b5d6eb99c51adf85 in term 4.
I20260709 13:03:06.516147 10073 raft_consensus.cc:2804] T 9d21e8696b0340bea31002b775af50ee P 65ed95869fbb4b69b5d6eb99c51adf85 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:06.517553 10073 raft_consensus.cc:697] T 9d21e8696b0340bea31002b775af50ee P 65ed95869fbb4b69b5d6eb99c51adf85 [term 4 LEADER]: Becoming Leader. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Running, Role: LEADER
I20260709 13:03:06.518427 10073 consensus_queue.cc:237] T 9d21e8696b0340bea31002b775af50ee P 65ed95869fbb4b69b5d6eb99c51adf85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:03:06.529320  8997 catalog_manager.cc:5697] T 9d21e8696b0340bea31002b775af50ee P 65ed95869fbb4b69b5d6eb99c51adf85 reported cstate change: term changed from 3 to 4, leader changed from 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195) to 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:06.649820 10067 raft_consensus.cc:993] T 902451f24024496b83b9a05dfe359a22 P 8846d581359a4b7ea6d4c33424ea825d: : Instructing follower 74ac2cf163ee475e8a280cb3aa738f57 to start an election
I20260709 13:03:06.650323 10047 raft_consensus.cc:1081] T 902451f24024496b83b9a05dfe359a22 P 8846d581359a4b7ea6d4c33424ea825d [term 1 LEADER]: Signalling peer 74ac2cf163ee475e8a280cb3aa738f57 to start an election
I20260709 13:03:06.651970  9316 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "902451f24024496b83b9a05dfe359a22"
dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57"
 from {username='slave'} at 127.0.0.1:43714
I20260709 13:03:06.652405  9316 raft_consensus.cc:493] T 902451f24024496b83b9a05dfe359a22 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:06.652705  9316 raft_consensus.cc:3060] T 902451f24024496b83b9a05dfe359a22 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:06.659128  9316 raft_consensus.cc:515] T 902451f24024496b83b9a05dfe359a22 P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:03:06.661391  9316 leader_election.cc:290] T 902451f24024496b83b9a05dfe359a22 P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 2 election: Requested vote from peers c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455), 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311)
I20260709 13:03:06.662411  9248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902451f24024496b83b9a05dfe359a22" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8846d581359a4b7ea6d4c33424ea825d"
I20260709 13:03:06.663093  9248 raft_consensus.cc:3055] T 902451f24024496b83b9a05dfe359a22 P 8846d581359a4b7ea6d4c33424ea825d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:06.663398  9248 raft_consensus.cc:740] T 902451f24024496b83b9a05dfe359a22 P 8846d581359a4b7ea6d4c33424ea825d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8846d581359a4b7ea6d4c33424ea825d, State: Running, Role: LEADER
I20260709 13:03:06.663344  9173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902451f24024496b83b9a05dfe359a22" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c694531b0e1d47988b291f1214efc4cb"
I20260709 13:03:06.664095  9173 raft_consensus.cc:3060] T 902451f24024496b83b9a05dfe359a22 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:06.664347  9248 consensus_queue.cc:260] T 902451f24024496b83b9a05dfe359a22 P 8846d581359a4b7ea6d4c33424ea825d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:03:06.665669  9248 raft_consensus.cc:3060] T 902451f24024496b83b9a05dfe359a22 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:06.671425  9173 raft_consensus.cc:2468] T 902451f24024496b83b9a05dfe359a22 P c694531b0e1d47988b291f1214efc4cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74ac2cf163ee475e8a280cb3aa738f57 in term 2.
I20260709 13:03:06.672821  9288 leader_election.cc:304] T 902451f24024496b83b9a05dfe359a22 P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57, c694531b0e1d47988b291f1214efc4cb; no voters: 
I20260709 13:03:06.672886  9248 raft_consensus.cc:2468] T 902451f24024496b83b9a05dfe359a22 P 8846d581359a4b7ea6d4c33424ea825d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74ac2cf163ee475e8a280cb3aa738f57 in term 2.
I20260709 13:03:06.673833 10069 raft_consensus.cc:2804] T 902451f24024496b83b9a05dfe359a22 P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:06.674357 10069 raft_consensus.cc:697] T 902451f24024496b83b9a05dfe359a22 P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 LEADER]: Becoming Leader. State: Replica: 74ac2cf163ee475e8a280cb3aa738f57, State: Running, Role: LEADER
I20260709 13:03:06.675239 10069 consensus_queue.cc:237] T 902451f24024496b83b9a05dfe359a22 P 74ac2cf163ee475e8a280cb3aa738f57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:03:06.685688  8997 catalog_manager.cc:5697] T 902451f24024496b83b9a05dfe359a22 P 74ac2cf163ee475e8a280cb3aa738f57 reported cstate change: term changed from 1 to 2, leader changed from 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195) to 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "74ac2cf163ee475e8a280cb3aa738f57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:06.721481 10067 raft_consensus.cc:993] T a731a965126b406988eecb7829bc9981 P 8846d581359a4b7ea6d4c33424ea825d: : Instructing follower 65ed95869fbb4b69b5d6eb99c51adf85 to start an election
I20260709 13:03:06.722075 10047 raft_consensus.cc:1081] T a731a965126b406988eecb7829bc9981 P 8846d581359a4b7ea6d4c33424ea825d [term 1 LEADER]: Signalling peer 65ed95869fbb4b69b5d6eb99c51adf85 to start an election
I20260709 13:03:06.723683  9904 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a731a965126b406988eecb7829bc9981"
dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85"
 from {username='slave'} at 127.0.0.1:59622
I20260709 13:03:06.724084  9904 raft_consensus.cc:493] T a731a965126b406988eecb7829bc9981 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:06.724308  9904 raft_consensus.cc:3060] T a731a965126b406988eecb7829bc9981 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:06.730474  9904 raft_consensus.cc:515] T a731a965126b406988eecb7829bc9981 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:03:06.732026  9904 leader_election.cc:290] T a731a965126b406988eecb7829bc9981 P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 2 election: Requested vote from peers 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311), 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351)
I20260709 13:03:06.732818  9248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a731a965126b406988eecb7829bc9981" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8846d581359a4b7ea6d4c33424ea825d"
I20260709 13:03:06.732858  9316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a731a965126b406988eecb7829bc9981" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57"
I20260709 13:03:06.733554  9248 raft_consensus.cc:3055] T a731a965126b406988eecb7829bc9981 P 8846d581359a4b7ea6d4c33424ea825d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:06.733606  9316 raft_consensus.cc:3060] T a731a965126b406988eecb7829bc9981 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:06.733944  9248 raft_consensus.cc:740] T a731a965126b406988eecb7829bc9981 P 8846d581359a4b7ea6d4c33424ea825d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8846d581359a4b7ea6d4c33424ea825d, State: Running, Role: LEADER
I20260709 13:03:06.734817  9248 consensus_queue.cc:260] T a731a965126b406988eecb7829bc9981 P 8846d581359a4b7ea6d4c33424ea825d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:03:06.736027  9248 raft_consensus.cc:3060] T a731a965126b406988eecb7829bc9981 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:06.740311  9316 raft_consensus.cc:2468] T a731a965126b406988eecb7829bc9981 P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65ed95869fbb4b69b5d6eb99c51adf85 in term 2.
I20260709 13:03:06.741640  9852 leader_election.cc:304] T a731a965126b406988eecb7829bc9981 P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65ed95869fbb4b69b5d6eb99c51adf85, 74ac2cf163ee475e8a280cb3aa738f57; no voters: 
I20260709 13:03:06.742503 10073 raft_consensus.cc:2804] T a731a965126b406988eecb7829bc9981 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:06.743031 10073 raft_consensus.cc:697] T a731a965126b406988eecb7829bc9981 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 2 LEADER]: Becoming Leader. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Running, Role: LEADER
I20260709 13:03:06.743220  9248 raft_consensus.cc:2468] T a731a965126b406988eecb7829bc9981 P 8846d581359a4b7ea6d4c33424ea825d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65ed95869fbb4b69b5d6eb99c51adf85 in term 2.
I20260709 13:03:06.743996 10073 consensus_queue.cc:237] T a731a965126b406988eecb7829bc9981 P 65ed95869fbb4b69b5d6eb99c51adf85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:03:06.758708 10067 raft_consensus.cc:993] T 6cb786213d5d48779533059bc333ac6f P 8846d581359a4b7ea6d4c33424ea825d: : Instructing follower 74ac2cf163ee475e8a280cb3aa738f57 to start an election
I20260709 13:03:06.759266 10067 raft_consensus.cc:1081] T 6cb786213d5d48779533059bc333ac6f P 8846d581359a4b7ea6d4c33424ea825d [term 1 LEADER]: Signalling peer 74ac2cf163ee475e8a280cb3aa738f57 to start an election
I20260709 13:03:06.758522  8997 catalog_manager.cc:5697] T a731a965126b406988eecb7829bc9981 P 65ed95869fbb4b69b5d6eb99c51adf85 reported cstate change: term changed from 1 to 2, leader changed from 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195) to 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:06.760708  9316 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6cb786213d5d48779533059bc333ac6f"
dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57"
 from {username='slave'} at 127.0.0.1:43714
I20260709 13:03:06.761181  9316 raft_consensus.cc:493] T 6cb786213d5d48779533059bc333ac6f P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:06.761431  9316 raft_consensus.cc:3060] T 6cb786213d5d48779533059bc333ac6f P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:06.766160  9316 raft_consensus.cc:515] T 6cb786213d5d48779533059bc333ac6f P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:03:06.768002  9316 leader_election.cc:290] T 6cb786213d5d48779533059bc333ac6f P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 2 election: Requested vote from peers c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455), 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311)
I20260709 13:03:06.768788  9173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb786213d5d48779533059bc333ac6f" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c694531b0e1d47988b291f1214efc4cb"
I20260709 13:03:06.769263  9173 raft_consensus.cc:3060] T 6cb786213d5d48779533059bc333ac6f P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:06.770442  9248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb786213d5d48779533059bc333ac6f" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8846d581359a4b7ea6d4c33424ea825d"
I20260709 13:03:06.770951  9248 raft_consensus.cc:3055] T 6cb786213d5d48779533059bc333ac6f P 8846d581359a4b7ea6d4c33424ea825d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:06.771220  9248 raft_consensus.cc:740] T 6cb786213d5d48779533059bc333ac6f P 8846d581359a4b7ea6d4c33424ea825d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8846d581359a4b7ea6d4c33424ea825d, State: Running, Role: LEADER
I20260709 13:03:06.771919  9248 consensus_queue.cc:260] T 6cb786213d5d48779533059bc333ac6f P 8846d581359a4b7ea6d4c33424ea825d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:03:06.773425  9248 raft_consensus.cc:3060] T 6cb786213d5d48779533059bc333ac6f P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:06.775569  9173 raft_consensus.cc:2468] T 6cb786213d5d48779533059bc333ac6f P c694531b0e1d47988b291f1214efc4cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74ac2cf163ee475e8a280cb3aa738f57 in term 2.
I20260709 13:03:06.776589  9288 leader_election.cc:304] T 6cb786213d5d48779533059bc333ac6f P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57, c694531b0e1d47988b291f1214efc4cb; no voters: 
I20260709 13:03:06.777261 10069 raft_consensus.cc:2804] T 6cb786213d5d48779533059bc333ac6f P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:06.777690 10069 raft_consensus.cc:697] T 6cb786213d5d48779533059bc333ac6f P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 LEADER]: Becoming Leader. State: Replica: 74ac2cf163ee475e8a280cb3aa738f57, State: Running, Role: LEADER
I20260709 13:03:06.778519 10069 consensus_queue.cc:237] T 6cb786213d5d48779533059bc333ac6f P 74ac2cf163ee475e8a280cb3aa738f57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:03:06.778726  9248 raft_consensus.cc:2468] T 6cb786213d5d48779533059bc333ac6f P 8846d581359a4b7ea6d4c33424ea825d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74ac2cf163ee475e8a280cb3aa738f57 in term 2.
I20260709 13:03:06.800370  8997 catalog_manager.cc:5697] T 6cb786213d5d48779533059bc333ac6f P 74ac2cf163ee475e8a280cb3aa738f57 reported cstate change: term changed from 1 to 2, leader changed from 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195) to 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "74ac2cf163ee475e8a280cb3aa738f57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:06.808179 10068 raft_consensus.cc:993] T 8f67cb568c0745e792c17959b07c5da1 P c694531b0e1d47988b291f1214efc4cb: : Instructing follower 65ed95869fbb4b69b5d6eb99c51adf85 to start an election
I20260709 13:03:06.808746 10061 raft_consensus.cc:1081] T 8f67cb568c0745e792c17959b07c5da1 P c694531b0e1d47988b291f1214efc4cb [term 1 LEADER]: Signalling peer 65ed95869fbb4b69b5d6eb99c51adf85 to start an election
I20260709 13:03:06.810025  9905 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8f67cb568c0745e792c17959b07c5da1"
dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85"
 from {username='slave'} at 127.0.0.1:59612
I20260709 13:03:06.810452  9905 raft_consensus.cc:493] T 8f67cb568c0745e792c17959b07c5da1 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:06.810750  9905 raft_consensus.cc:3060] T 8f67cb568c0745e792c17959b07c5da1 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:06.815603  9905 raft_consensus.cc:515] T 8f67cb568c0745e792c17959b07c5da1 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:03:06.817402  9905 leader_election.cc:290] T 8f67cb568c0745e792c17959b07c5da1 P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 2 election: Requested vote from peers 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351), c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455)
I20260709 13:03:06.818518  9316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f67cb568c0745e792c17959b07c5da1" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57"
I20260709 13:03:06.819170  9316 raft_consensus.cc:3060] T 8f67cb568c0745e792c17959b07c5da1 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:06.819301  9173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f67cb568c0745e792c17959b07c5da1" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c694531b0e1d47988b291f1214efc4cb"
I20260709 13:03:06.819953  9173 raft_consensus.cc:3055] T 8f67cb568c0745e792c17959b07c5da1 P c694531b0e1d47988b291f1214efc4cb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:06.820226  9173 raft_consensus.cc:740] T 8f67cb568c0745e792c17959b07c5da1 P c694531b0e1d47988b291f1214efc4cb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c694531b0e1d47988b291f1214efc4cb, State: Running, Role: LEADER
I20260709 13:03:06.821117  9173 consensus_queue.cc:260] T 8f67cb568c0745e792c17959b07c5da1 P c694531b0e1d47988b291f1214efc4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:03:06.822364  9173 raft_consensus.cc:3060] T 8f67cb568c0745e792c17959b07c5da1 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:06.829124  9173 raft_consensus.cc:2468] T 8f67cb568c0745e792c17959b07c5da1 P c694531b0e1d47988b291f1214efc4cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65ed95869fbb4b69b5d6eb99c51adf85 in term 2.
I20260709 13:03:06.830420  9851 leader_election.cc:304] T 8f67cb568c0745e792c17959b07c5da1 P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65ed95869fbb4b69b5d6eb99c51adf85, c694531b0e1d47988b291f1214efc4cb; no voters: 
I20260709 13:03:06.830848  9316 raft_consensus.cc:2468] T 8f67cb568c0745e792c17959b07c5da1 P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65ed95869fbb4b69b5d6eb99c51adf85 in term 2.
I20260709 13:03:06.831274 10073 raft_consensus.cc:2804] T 8f67cb568c0745e792c17959b07c5da1 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:06.831842 10073 raft_consensus.cc:697] T 8f67cb568c0745e792c17959b07c5da1 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 2 LEADER]: Becoming Leader. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Running, Role: LEADER
I20260709 13:03:06.832852 10073 consensus_queue.cc:237] T 8f67cb568c0745e792c17959b07c5da1 P 65ed95869fbb4b69b5d6eb99c51adf85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:03:06.853731  8997 catalog_manager.cc:5697] T 8f67cb568c0745e792c17959b07c5da1 P 65ed95869fbb4b69b5d6eb99c51adf85 reported cstate change: term changed from 1 to 2, leader changed from c694531b0e1d47988b291f1214efc4cb (127.0.107.194) to 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:06.950626 10067 raft_consensus.cc:993] T 0effc3d52a6d43ef8aa59821958f4e52 P 8846d581359a4b7ea6d4c33424ea825d: : Instructing follower 65ed95869fbb4b69b5d6eb99c51adf85 to start an election
I20260709 13:03:06.951210 10047 raft_consensus.cc:1081] T 0effc3d52a6d43ef8aa59821958f4e52 P 8846d581359a4b7ea6d4c33424ea825d [term 1 LEADER]: Signalling peer 65ed95869fbb4b69b5d6eb99c51adf85 to start an election
I20260709 13:03:06.952554  9904 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0effc3d52a6d43ef8aa59821958f4e52"
dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85"
 from {username='slave'} at 127.0.0.1:59622
I20260709 13:03:06.953392  9904 raft_consensus.cc:493] T 0effc3d52a6d43ef8aa59821958f4e52 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:06.953780  9904 raft_consensus.cc:3060] T 0effc3d52a6d43ef8aa59821958f4e52 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:06.960812  9904 raft_consensus.cc:515] T 0effc3d52a6d43ef8aa59821958f4e52 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:03:06.963493  9173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0effc3d52a6d43ef8aa59821958f4e52" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c694531b0e1d47988b291f1214efc4cb"
I20260709 13:03:06.963639  9904 leader_election.cc:290] T 0effc3d52a6d43ef8aa59821958f4e52 P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 2 election: Requested vote from peers c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455), 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311)
I20260709 13:03:06.964071  9173 raft_consensus.cc:3060] T 0effc3d52a6d43ef8aa59821958f4e52 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:06.966890  9248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0effc3d52a6d43ef8aa59821958f4e52" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8846d581359a4b7ea6d4c33424ea825d"
I20260709 13:03:06.967501  9248 raft_consensus.cc:3055] T 0effc3d52a6d43ef8aa59821958f4e52 P 8846d581359a4b7ea6d4c33424ea825d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:06.967794  9248 raft_consensus.cc:740] T 0effc3d52a6d43ef8aa59821958f4e52 P 8846d581359a4b7ea6d4c33424ea825d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8846d581359a4b7ea6d4c33424ea825d, State: Running, Role: LEADER
I20260709 13:03:06.968523  9248 consensus_queue.cc:260] T 0effc3d52a6d43ef8aa59821958f4e52 P 8846d581359a4b7ea6d4c33424ea825d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:03:06.969614  9248 raft_consensus.cc:3060] T 0effc3d52a6d43ef8aa59821958f4e52 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:06.972301  9173 raft_consensus.cc:2468] T 0effc3d52a6d43ef8aa59821958f4e52 P c694531b0e1d47988b291f1214efc4cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65ed95869fbb4b69b5d6eb99c51adf85 in term 2.
I20260709 13:03:06.973394  9851 leader_election.cc:304] T 0effc3d52a6d43ef8aa59821958f4e52 P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65ed95869fbb4b69b5d6eb99c51adf85, c694531b0e1d47988b291f1214efc4cb; no voters: 
I20260709 13:03:06.974325 10074 raft_consensus.cc:2804] T 0effc3d52a6d43ef8aa59821958f4e52 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:06.976506  9248 raft_consensus.cc:2468] T 0effc3d52a6d43ef8aa59821958f4e52 P 8846d581359a4b7ea6d4c33424ea825d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65ed95869fbb4b69b5d6eb99c51adf85 in term 2.
I20260709 13:03:06.976739  9250 raft_consensus.cc:1275] T 9d21e8696b0340bea31002b775af50ee P 8846d581359a4b7ea6d4c33424ea825d [term 4 FOLLOWER]: Refusing update from remote peer 65ed95869fbb4b69b5d6eb99c51adf85: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:03:06.977815 10074 raft_consensus.cc:697] T 0effc3d52a6d43ef8aa59821958f4e52 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 2 LEADER]: Becoming Leader. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Running, Role: LEADER
I20260709 13:03:06.978585 10073 consensus_queue.cc:1048] T 9d21e8696b0340bea31002b775af50ee P 65ed95869fbb4b69b5d6eb99c51adf85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:06.978843 10074 consensus_queue.cc:237] T 0effc3d52a6d43ef8aa59821958f4e52 P 65ed95869fbb4b69b5d6eb99c51adf85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:03:06.997701  8997 catalog_manager.cc:5697] T 0effc3d52a6d43ef8aa59821958f4e52 P 65ed95869fbb4b69b5d6eb99c51adf85 reported cstate change: term changed from 1 to 2, leader changed from 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195) to 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:07.006750  9316 raft_consensus.cc:1275] T 9d21e8696b0340bea31002b775af50ee P 74ac2cf163ee475e8a280cb3aa738f57 [term 4 FOLLOWER]: Refusing update from remote peer 65ed95869fbb4b69b5d6eb99c51adf85: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:03:07.012122 10084 consensus_queue.cc:1048] T 9d21e8696b0340bea31002b775af50ee P 65ed95869fbb4b69b5d6eb99c51adf85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:07.081314  9173 raft_consensus.cc:1275] T 902451f24024496b83b9a05dfe359a22 P c694531b0e1d47988b291f1214efc4cb [term 2 FOLLOWER]: Refusing update from remote peer 74ac2cf163ee475e8a280cb3aa738f57: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:07.082499 10066 consensus_queue.cc:1048] T 902451f24024496b83b9a05dfe359a22 P 74ac2cf163ee475e8a280cb3aa738f57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:07.091545  9248 raft_consensus.cc:1275] T 902451f24024496b83b9a05dfe359a22 P 8846d581359a4b7ea6d4c33424ea825d [term 2 FOLLOWER]: Refusing update from remote peer 74ac2cf163ee475e8a280cb3aa738f57: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:07.094031 10069 consensus_queue.cc:1048] T 902451f24024496b83b9a05dfe359a22 P 74ac2cf163ee475e8a280cb3aa738f57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:07.202781  9248 raft_consensus.cc:1275] T a731a965126b406988eecb7829bc9981 P 8846d581359a4b7ea6d4c33424ea825d [term 2 FOLLOWER]: Refusing update from remote peer 65ed95869fbb4b69b5d6eb99c51adf85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:07.203943 10084 consensus_queue.cc:1048] T a731a965126b406988eecb7829bc9981 P 65ed95869fbb4b69b5d6eb99c51adf85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:07.214804  9316 raft_consensus.cc:1275] T a731a965126b406988eecb7829bc9981 P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Refusing update from remote peer 65ed95869fbb4b69b5d6eb99c51adf85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:07.218694 10096 consensus_queue.cc:1048] T a731a965126b406988eecb7829bc9981 P 65ed95869fbb4b69b5d6eb99c51adf85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:07.326150  9248 raft_consensus.cc:1275] T 6cb786213d5d48779533059bc333ac6f P 8846d581359a4b7ea6d4c33424ea825d [term 2 FOLLOWER]: Refusing update from remote peer 74ac2cf163ee475e8a280cb3aa738f57: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:07.327332 10066 consensus_queue.cc:1048] T 6cb786213d5d48779533059bc333ac6f P 74ac2cf163ee475e8a280cb3aa738f57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:07.330220  9173 raft_consensus.cc:1275] T 8f67cb568c0745e792c17959b07c5da1 P c694531b0e1d47988b291f1214efc4cb [term 2 FOLLOWER]: Refusing update from remote peer 65ed95869fbb4b69b5d6eb99c51adf85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:07.331915 10096 consensus_queue.cc:1048] T 8f67cb568c0745e792c17959b07c5da1 P 65ed95869fbb4b69b5d6eb99c51adf85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:07.346714  9172 raft_consensus.cc:1275] T 6cb786213d5d48779533059bc333ac6f P c694531b0e1d47988b291f1214efc4cb [term 2 FOLLOWER]: Refusing update from remote peer 74ac2cf163ee475e8a280cb3aa738f57: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:07.347919 10069 consensus_queue.cc:1048] T 6cb786213d5d48779533059bc333ac6f P 74ac2cf163ee475e8a280cb3aa738f57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:07.348035  9319 raft_consensus.cc:1275] T 8f67cb568c0745e792c17959b07c5da1 P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Refusing update from remote peer 65ed95869fbb4b69b5d6eb99c51adf85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:07.353312 10073 consensus_queue.cc:1048] T 8f67cb568c0745e792c17959b07c5da1 P 65ed95869fbb4b69b5d6eb99c51adf85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:07.401960  9248 raft_consensus.cc:1275] T 0effc3d52a6d43ef8aa59821958f4e52 P 8846d581359a4b7ea6d4c33424ea825d [term 2 FOLLOWER]: Refusing update from remote peer 65ed95869fbb4b69b5d6eb99c51adf85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:07.403867 10073 consensus_queue.cc:1048] T 0effc3d52a6d43ef8aa59821958f4e52 P 65ed95869fbb4b69b5d6eb99c51adf85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:07.416644  9172 raft_consensus.cc:1275] T 0effc3d52a6d43ef8aa59821958f4e52 P c694531b0e1d47988b291f1214efc4cb [term 2 FOLLOWER]: Refusing update from remote peer 65ed95869fbb4b69b5d6eb99c51adf85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:07.418442 10073 consensus_queue.cc:1048] T 0effc3d52a6d43ef8aa59821958f4e52 P 65ed95869fbb4b69b5d6eb99c51adf85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:07.471119   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:07.507942   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:07.546694  9250 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "989e9796152e4796a3408e00419403fa"
dest_uuid: "8846d581359a4b7ea6d4c33424ea825d"
mode: GRACEFUL
new_leader_uuid: "74ac2cf163ee475e8a280cb3aa738f57"
 from {username='slave'} at 127.0.0.1:55078
I20260709 13:03:07.552610  9250 raft_consensus.cc:606] T 989e9796152e4796a3408e00419403fa P 8846d581359a4b7ea6d4c33424ea825d [term 1 LEADER]: Received request to transfer leadership to TS 74ac2cf163ee475e8a280cb3aa738f57
I20260709 13:03:07.555428  9250 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ac928b0582c745b4804afcd30e861439"
dest_uuid: "8846d581359a4b7ea6d4c33424ea825d"
mode: GRACEFUL
new_leader_uuid: "65ed95869fbb4b69b5d6eb99c51adf85"
 from {username='slave'} at 127.0.0.1:55078
I20260709 13:03:07.556015  9250 raft_consensus.cc:606] T ac928b0582c745b4804afcd30e861439 P 8846d581359a4b7ea6d4c33424ea825d [term 1 LEADER]: Received request to transfer leadership to TS 65ed95869fbb4b69b5d6eb99c51adf85
I20260709 13:03:07.558383  9172 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d26bd321e5604f8aa61723f418be35a9"
dest_uuid: "c694531b0e1d47988b291f1214efc4cb"
mode: GRACEFUL
new_leader_uuid: "65ed95869fbb4b69b5d6eb99c51adf85"
 from {username='slave'} at 127.0.0.1:35670
I20260709 13:03:07.558965  9172 raft_consensus.cc:606] T d26bd321e5604f8aa61723f418be35a9 P c694531b0e1d47988b291f1214efc4cb [term 1 LEADER]: Received request to transfer leadership to TS 65ed95869fbb4b69b5d6eb99c51adf85
I20260709 13:03:07.561591  9250 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ea3bb46b177b4bbdaa60f464370aa9a0"
dest_uuid: "8846d581359a4b7ea6d4c33424ea825d"
mode: GRACEFUL
new_leader_uuid: "65ed95869fbb4b69b5d6eb99c51adf85"
 from {username='slave'} at 127.0.0.1:55078
I20260709 13:03:07.562131  9250 raft_consensus.cc:606] T ea3bb46b177b4bbdaa60f464370aa9a0 P 8846d581359a4b7ea6d4c33424ea825d [term 1 LEADER]: Received request to transfer leadership to TS 65ed95869fbb4b69b5d6eb99c51adf85
I20260709 13:03:07.564397  9172 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f2229e498f7f472f97c088fddb802939"
dest_uuid: "c694531b0e1d47988b291f1214efc4cb"
mode: GRACEFUL
new_leader_uuid: "65ed95869fbb4b69b5d6eb99c51adf85"
 from {username='slave'} at 127.0.0.1:35670
I20260709 13:03:07.564838  9172 raft_consensus.cc:606] T f2229e498f7f472f97c088fddb802939 P c694531b0e1d47988b291f1214efc4cb [term 1 LEADER]: Received request to transfer leadership to TS 65ed95869fbb4b69b5d6eb99c51adf85
I20260709 13:03:07.565810   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:03:07.566985   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:07.839916 10047 raft_consensus.cc:993] T ac928b0582c745b4804afcd30e861439 P 8846d581359a4b7ea6d4c33424ea825d: : Instructing follower 65ed95869fbb4b69b5d6eb99c51adf85 to start an election
I20260709 13:03:07.840374 10067 raft_consensus.cc:1081] T ac928b0582c745b4804afcd30e861439 P 8846d581359a4b7ea6d4c33424ea825d [term 1 LEADER]: Signalling peer 65ed95869fbb4b69b5d6eb99c51adf85 to start an election
I20260709 13:03:07.841761  9904 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ac928b0582c745b4804afcd30e861439"
dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85"
 from {username='slave'} at 127.0.0.1:59622
I20260709 13:03:07.842216  9904 raft_consensus.cc:493] T ac928b0582c745b4804afcd30e861439 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:07.842484  9904 raft_consensus.cc:3060] T ac928b0582c745b4804afcd30e861439 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:07.846089 10047 raft_consensus.cc:993] T ea3bb46b177b4bbdaa60f464370aa9a0 P 8846d581359a4b7ea6d4c33424ea825d: : Instructing follower 65ed95869fbb4b69b5d6eb99c51adf85 to start an election
I20260709 13:03:07.846639 10067 raft_consensus.cc:1081] T ea3bb46b177b4bbdaa60f464370aa9a0 P 8846d581359a4b7ea6d4c33424ea825d [term 1 LEADER]: Signalling peer 65ed95869fbb4b69b5d6eb99c51adf85 to start an election
I20260709 13:03:07.848202  9905 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ea3bb46b177b4bbdaa60f464370aa9a0"
dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85"
 from {username='slave'} at 127.0.0.1:59622
I20260709 13:03:07.848697  9905 raft_consensus.cc:493] T ea3bb46b177b4bbdaa60f464370aa9a0 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:07.849031  9905 raft_consensus.cc:3060] T ea3bb46b177b4bbdaa60f464370aa9a0 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:07.848834  9904 raft_consensus.cc:515] T ac928b0582c745b4804afcd30e861439 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:03:07.850936  9904 leader_election.cc:290] T ac928b0582c745b4804afcd30e861439 P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 2 election: Requested vote from peers 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311), 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351)
I20260709 13:03:07.851466  9319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac928b0582c745b4804afcd30e861439" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57"
I20260709 13:03:07.852035  9319 raft_consensus.cc:3060] T ac928b0582c745b4804afcd30e861439 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:07.851297  9250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac928b0582c745b4804afcd30e861439" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8846d581359a4b7ea6d4c33424ea825d"
I20260709 13:03:07.852914  9250 raft_consensus.cc:3055] T ac928b0582c745b4804afcd30e861439 P 8846d581359a4b7ea6d4c33424ea825d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:07.853186  9250 raft_consensus.cc:740] T ac928b0582c745b4804afcd30e861439 P 8846d581359a4b7ea6d4c33424ea825d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8846d581359a4b7ea6d4c33424ea825d, State: Running, Role: LEADER
I20260709 13:03:07.853968  9250 consensus_queue.cc:260] T ac928b0582c745b4804afcd30e861439 P 8846d581359a4b7ea6d4c33424ea825d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:03:07.854651  9905 raft_consensus.cc:515] T ea3bb46b177b4bbdaa60f464370aa9a0 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:03:07.855329  9250 raft_consensus.cc:3060] T ac928b0582c745b4804afcd30e861439 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:07.856734  9905 leader_election.cc:290] T ea3bb46b177b4bbdaa60f464370aa9a0 P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 2 election: Requested vote from peers c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455), 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311)
I20260709 13:03:07.857460  9173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea3bb46b177b4bbdaa60f464370aa9a0" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c694531b0e1d47988b291f1214efc4cb"
I20260709 13:03:07.857975  9173 raft_consensus.cc:3060] T ea3bb46b177b4bbdaa60f464370aa9a0 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:07.862542  9250 raft_consensus.cc:2468] T ac928b0582c745b4804afcd30e861439 P 8846d581359a4b7ea6d4c33424ea825d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65ed95869fbb4b69b5d6eb99c51adf85 in term 2.
I20260709 13:03:07.862977  9319 raft_consensus.cc:2468] T ac928b0582c745b4804afcd30e861439 P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65ed95869fbb4b69b5d6eb99c51adf85 in term 2.
I20260709 13:03:07.864274  9850 leader_election.cc:304] T ac928b0582c745b4804afcd30e861439 P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65ed95869fbb4b69b5d6eb99c51adf85, 8846d581359a4b7ea6d4c33424ea825d; no voters: 
I20260709 13:03:07.864327  9250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea3bb46b177b4bbdaa60f464370aa9a0" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8846d581359a4b7ea6d4c33424ea825d"
I20260709 13:03:07.865031  9250 raft_consensus.cc:3055] T ea3bb46b177b4bbdaa60f464370aa9a0 P 8846d581359a4b7ea6d4c33424ea825d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:07.865273 10073 raft_consensus.cc:2804] T ac928b0582c745b4804afcd30e861439 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:07.865319  9250 raft_consensus.cc:740] T ea3bb46b177b4bbdaa60f464370aa9a0 P 8846d581359a4b7ea6d4c33424ea825d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8846d581359a4b7ea6d4c33424ea825d, State: Running, Role: LEADER
I20260709 13:03:07.865945 10073 raft_consensus.cc:697] T ac928b0582c745b4804afcd30e861439 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 2 LEADER]: Becoming Leader. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Running, Role: LEADER
I20260709 13:03:07.866477  9250 consensus_queue.cc:260] T ea3bb46b177b4bbdaa60f464370aa9a0 P 8846d581359a4b7ea6d4c33424ea825d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:03:07.866936 10073 consensus_queue.cc:237] T ac928b0582c745b4804afcd30e861439 P 65ed95869fbb4b69b5d6eb99c51adf85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:03:07.868855  9173 raft_consensus.cc:2468] T ea3bb46b177b4bbdaa60f464370aa9a0 P c694531b0e1d47988b291f1214efc4cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65ed95869fbb4b69b5d6eb99c51adf85 in term 2.
I20260709 13:03:07.868090  9250 raft_consensus.cc:3060] T ea3bb46b177b4bbdaa60f464370aa9a0 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:07.872027  9851 leader_election.cc:304] T ea3bb46b177b4bbdaa60f464370aa9a0 P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65ed95869fbb4b69b5d6eb99c51adf85, c694531b0e1d47988b291f1214efc4cb; no voters: 
I20260709 13:03:07.874464 10073 raft_consensus.cc:2804] T ea3bb46b177b4bbdaa60f464370aa9a0 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:07.875029 10073 raft_consensus.cc:697] T ea3bb46b177b4bbdaa60f464370aa9a0 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 2 LEADER]: Becoming Leader. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Running, Role: LEADER
I20260709 13:03:07.877651  9250 raft_consensus.cc:2468] T ea3bb46b177b4bbdaa60f464370aa9a0 P 8846d581359a4b7ea6d4c33424ea825d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65ed95869fbb4b69b5d6eb99c51adf85 in term 2.
I20260709 13:03:07.876926 10073 consensus_queue.cc:237] T ea3bb46b177b4bbdaa60f464370aa9a0 P 65ed95869fbb4b69b5d6eb99c51adf85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:03:07.884456  8998 catalog_manager.cc:5697] T ac928b0582c745b4804afcd30e861439 P 65ed95869fbb4b69b5d6eb99c51adf85 reported cstate change: term changed from 1 to 2, leader changed from 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195) to 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:07.902992  8998 catalog_manager.cc:5697] T ea3bb46b177b4bbdaa60f464370aa9a0 P 65ed95869fbb4b69b5d6eb99c51adf85 reported cstate change: term changed from 1 to 2, leader changed from 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195) to 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:07.923465 10061 raft_consensus.cc:993] T d26bd321e5604f8aa61723f418be35a9 P c694531b0e1d47988b291f1214efc4cb: : Instructing follower 65ed95869fbb4b69b5d6eb99c51adf85 to start an election
I20260709 13:03:07.923930 10052 raft_consensus.cc:1081] T d26bd321e5604f8aa61723f418be35a9 P c694531b0e1d47988b291f1214efc4cb [term 1 LEADER]: Signalling peer 65ed95869fbb4b69b5d6eb99c51adf85 to start an election
I20260709 13:03:07.925644  9905 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d26bd321e5604f8aa61723f418be35a9"
dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85"
 from {username='slave'} at 127.0.0.1:59612
I20260709 13:03:07.926190  9905 raft_consensus.cc:493] T d26bd321e5604f8aa61723f418be35a9 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:07.926565  9905 raft_consensus.cc:3060] T d26bd321e5604f8aa61723f418be35a9 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:07.934957  9905 raft_consensus.cc:515] T d26bd321e5604f8aa61723f418be35a9 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:03:07.937359  9319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26bd321e5604f8aa61723f418be35a9" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57"
I20260709 13:03:07.937582  9905 leader_election.cc:290] T d26bd321e5604f8aa61723f418be35a9 P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 2 election: Requested vote from peers 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351), c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455)
I20260709 13:03:07.937707  9173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26bd321e5604f8aa61723f418be35a9" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c694531b0e1d47988b291f1214efc4cb"
I20260709 13:03:07.938055  9319 raft_consensus.cc:3060] T d26bd321e5604f8aa61723f418be35a9 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:07.938392  9173 raft_consensus.cc:3055] T d26bd321e5604f8aa61723f418be35a9 P c694531b0e1d47988b291f1214efc4cb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:07.938763  9173 raft_consensus.cc:740] T d26bd321e5604f8aa61723f418be35a9 P c694531b0e1d47988b291f1214efc4cb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c694531b0e1d47988b291f1214efc4cb, State: Running, Role: LEADER
I20260709 13:03:07.939534  9173 consensus_queue.cc:260] T d26bd321e5604f8aa61723f418be35a9 P c694531b0e1d47988b291f1214efc4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:03:07.940862  9173 raft_consensus.cc:3060] T d26bd321e5604f8aa61723f418be35a9 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:07.944494  9319 raft_consensus.cc:2468] T d26bd321e5604f8aa61723f418be35a9 P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65ed95869fbb4b69b5d6eb99c51adf85 in term 2.
I20260709 13:03:07.945670  9852 leader_election.cc:304] T d26bd321e5604f8aa61723f418be35a9 P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65ed95869fbb4b69b5d6eb99c51adf85, 74ac2cf163ee475e8a280cb3aa738f57; no voters: 
I20260709 13:03:07.946583 10073 raft_consensus.cc:2804] T d26bd321e5604f8aa61723f418be35a9 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:07.947067 10073 raft_consensus.cc:697] T d26bd321e5604f8aa61723f418be35a9 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 2 LEADER]: Becoming Leader. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Running, Role: LEADER
I20260709 13:03:07.947266  9173 raft_consensus.cc:2468] T d26bd321e5604f8aa61723f418be35a9 P c694531b0e1d47988b291f1214efc4cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65ed95869fbb4b69b5d6eb99c51adf85 in term 2.
I20260709 13:03:07.947847 10073 consensus_queue.cc:237] T d26bd321e5604f8aa61723f418be35a9 P 65ed95869fbb4b69b5d6eb99c51adf85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:03:07.957592  8998 catalog_manager.cc:5697] T d26bd321e5604f8aa61723f418be35a9 P 65ed95869fbb4b69b5d6eb99c51adf85 reported cstate change: term changed from 1 to 2, leader changed from c694531b0e1d47988b291f1214efc4cb (127.0.107.194) to 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:08.008466 10047 raft_consensus.cc:993] T 989e9796152e4796a3408e00419403fa P 8846d581359a4b7ea6d4c33424ea825d: : Instructing follower 74ac2cf163ee475e8a280cb3aa738f57 to start an election
I20260709 13:03:08.008915 10067 raft_consensus.cc:1081] T 989e9796152e4796a3408e00419403fa P 8846d581359a4b7ea6d4c33424ea825d [term 1 LEADER]: Signalling peer 74ac2cf163ee475e8a280cb3aa738f57 to start an election
I20260709 13:03:08.010358  9319 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "989e9796152e4796a3408e00419403fa"
dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57"
 from {username='slave'} at 127.0.0.1:43714
I20260709 13:03:08.010896  9319 raft_consensus.cc:493] T 989e9796152e4796a3408e00419403fa P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:08.011250  9319 raft_consensus.cc:3060] T 989e9796152e4796a3408e00419403fa P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:08.017232  9319 raft_consensus.cc:515] T 989e9796152e4796a3408e00419403fa P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:03:08.019912  9173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "989e9796152e4796a3408e00419403fa" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c694531b0e1d47988b291f1214efc4cb"
I20260709 13:03:08.020457  9319 leader_election.cc:290] T 989e9796152e4796a3408e00419403fa P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 2 election: Requested vote from peers c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455), 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311)
I20260709 13:03:08.020627  9173 raft_consensus.cc:3060] T 989e9796152e4796a3408e00419403fa P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:08.020277  9250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "989e9796152e4796a3408e00419403fa" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8846d581359a4b7ea6d4c33424ea825d"
I20260709 13:03:08.021571  9250 raft_consensus.cc:3055] T 989e9796152e4796a3408e00419403fa P 8846d581359a4b7ea6d4c33424ea825d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:08.021914  9250 raft_consensus.cc:740] T 989e9796152e4796a3408e00419403fa P 8846d581359a4b7ea6d4c33424ea825d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8846d581359a4b7ea6d4c33424ea825d, State: Running, Role: LEADER
I20260709 13:03:08.022588  9250 consensus_queue.cc:260] T 989e9796152e4796a3408e00419403fa P 8846d581359a4b7ea6d4c33424ea825d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:03:08.023936  9250 raft_consensus.cc:3060] T 989e9796152e4796a3408e00419403fa P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:08.030920  9250 raft_consensus.cc:2468] T 989e9796152e4796a3408e00419403fa P 8846d581359a4b7ea6d4c33424ea825d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74ac2cf163ee475e8a280cb3aa738f57 in term 2.
I20260709 13:03:08.031306  9173 raft_consensus.cc:2468] T 989e9796152e4796a3408e00419403fa P c694531b0e1d47988b291f1214efc4cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74ac2cf163ee475e8a280cb3aa738f57 in term 2.
I20260709 13:03:08.032410  9287 leader_election.cc:304] T 989e9796152e4796a3408e00419403fa P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57, 8846d581359a4b7ea6d4c33424ea825d; no voters: 
I20260709 13:03:08.033105 10066 raft_consensus.cc:2804] T 989e9796152e4796a3408e00419403fa P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:08.033633 10066 raft_consensus.cc:697] T 989e9796152e4796a3408e00419403fa P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 LEADER]: Becoming Leader. State: Replica: 74ac2cf163ee475e8a280cb3aa738f57, State: Running, Role: LEADER
I20260709 13:03:08.034515 10066 consensus_queue.cc:237] T 989e9796152e4796a3408e00419403fa P 74ac2cf163ee475e8a280cb3aa738f57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:03:08.044752  8998 catalog_manager.cc:5697] T 989e9796152e4796a3408e00419403fa P 74ac2cf163ee475e8a280cb3aa738f57 reported cstate change: term changed from 1 to 2, leader changed from 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195) to 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "74ac2cf163ee475e8a280cb3aa738f57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:08.051704 10061 raft_consensus.cc:993] T f2229e498f7f472f97c088fddb802939 P c694531b0e1d47988b291f1214efc4cb: : Instructing follower 65ed95869fbb4b69b5d6eb99c51adf85 to start an election
I20260709 13:03:08.052217 10052 raft_consensus.cc:1081] T f2229e498f7f472f97c088fddb802939 P c694531b0e1d47988b291f1214efc4cb [term 1 LEADER]: Signalling peer 65ed95869fbb4b69b5d6eb99c51adf85 to start an election
I20260709 13:03:08.055684  9905 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f2229e498f7f472f97c088fddb802939"
dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85"
 from {username='slave'} at 127.0.0.1:59612
I20260709 13:03:08.056195  9905 raft_consensus.cc:493] T f2229e498f7f472f97c088fddb802939 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:08.056504  9905 raft_consensus.cc:3060] T f2229e498f7f472f97c088fddb802939 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:08.061159  9905 raft_consensus.cc:515] T f2229e498f7f472f97c088fddb802939 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:03:08.063261  9905 leader_election.cc:290] T f2229e498f7f472f97c088fddb802939 P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 2 election: Requested vote from peers 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351), c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455)
I20260709 13:03:08.063809  9316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2229e498f7f472f97c088fddb802939" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57"
I20260709 13:03:08.063782  9173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2229e498f7f472f97c088fddb802939" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c694531b0e1d47988b291f1214efc4cb"
I20260709 13:03:08.064599  9316 raft_consensus.cc:3060] T f2229e498f7f472f97c088fddb802939 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:08.064924  9173 raft_consensus.cc:3055] T f2229e498f7f472f97c088fddb802939 P c694531b0e1d47988b291f1214efc4cb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:08.065282  9173 raft_consensus.cc:740] T f2229e498f7f472f97c088fddb802939 P c694531b0e1d47988b291f1214efc4cb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c694531b0e1d47988b291f1214efc4cb, State: Running, Role: LEADER
I20260709 13:03:08.066058  9173 consensus_queue.cc:260] T f2229e498f7f472f97c088fddb802939 P c694531b0e1d47988b291f1214efc4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:03:08.067644  9173 raft_consensus.cc:3060] T f2229e498f7f472f97c088fddb802939 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:08.071841  9316 raft_consensus.cc:2468] T f2229e498f7f472f97c088fddb802939 P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65ed95869fbb4b69b5d6eb99c51adf85 in term 2.
I20260709 13:03:08.073527  9852 leader_election.cc:304] T f2229e498f7f472f97c088fddb802939 P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65ed95869fbb4b69b5d6eb99c51adf85, 74ac2cf163ee475e8a280cb3aa738f57; no voters: 
I20260709 13:03:08.073982  9173 raft_consensus.cc:2468] T f2229e498f7f472f97c088fddb802939 P c694531b0e1d47988b291f1214efc4cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65ed95869fbb4b69b5d6eb99c51adf85 in term 2.
I20260709 13:03:08.074518 10073 raft_consensus.cc:2804] T f2229e498f7f472f97c088fddb802939 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:08.075143 10073 raft_consensus.cc:697] T f2229e498f7f472f97c088fddb802939 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 2 LEADER]: Becoming Leader. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Running, Role: LEADER
I20260709 13:03:08.076081 10073 consensus_queue.cc:237] T f2229e498f7f472f97c088fddb802939 P 65ed95869fbb4b69b5d6eb99c51adf85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:03:08.095448  8998 catalog_manager.cc:5697] T f2229e498f7f472f97c088fddb802939 P 65ed95869fbb4b69b5d6eb99c51adf85 reported cstate change: term changed from 1 to 2, leader changed from c694531b0e1d47988b291f1214efc4cb (127.0.107.194) to 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:08.278332  9248 raft_consensus.cc:1275] T ea3bb46b177b4bbdaa60f464370aa9a0 P 8846d581359a4b7ea6d4c33424ea825d [term 2 FOLLOWER]: Refusing update from remote peer 65ed95869fbb4b69b5d6eb99c51adf85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:08.279631 10073 consensus_queue.cc:1048] T ea3bb46b177b4bbdaa60f464370aa9a0 P 65ed95869fbb4b69b5d6eb99c51adf85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:08.289525  9173 raft_consensus.cc:1275] T ea3bb46b177b4bbdaa60f464370aa9a0 P c694531b0e1d47988b291f1214efc4cb [term 2 FOLLOWER]: Refusing update from remote peer 65ed95869fbb4b69b5d6eb99c51adf85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:08.291106 10084 consensus_queue.cc:1048] T ea3bb46b177b4bbdaa60f464370aa9a0 P 65ed95869fbb4b69b5d6eb99c51adf85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:08.294893  9319 raft_consensus.cc:1275] T ac928b0582c745b4804afcd30e861439 P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Refusing update from remote peer 65ed95869fbb4b69b5d6eb99c51adf85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:08.300664 10073 consensus_queue.cc:1048] T ac928b0582c745b4804afcd30e861439 P 65ed95869fbb4b69b5d6eb99c51adf85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:08.313330  9248 raft_consensus.cc:1275] T ac928b0582c745b4804afcd30e861439 P 8846d581359a4b7ea6d4c33424ea825d [term 2 FOLLOWER]: Refusing update from remote peer 65ed95869fbb4b69b5d6eb99c51adf85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:08.317113 10096 consensus_queue.cc:1048] T ac928b0582c745b4804afcd30e861439 P 65ed95869fbb4b69b5d6eb99c51adf85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:08.394356  9173 raft_consensus.cc:1275] T d26bd321e5604f8aa61723f418be35a9 P c694531b0e1d47988b291f1214efc4cb [term 2 FOLLOWER]: Refusing update from remote peer 65ed95869fbb4b69b5d6eb99c51adf85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:08.396554 10073 consensus_queue.cc:1048] T d26bd321e5604f8aa61723f418be35a9 P 65ed95869fbb4b69b5d6eb99c51adf85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:08.437695  9319 raft_consensus.cc:1275] T d26bd321e5604f8aa61723f418be35a9 P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Refusing update from remote peer 65ed95869fbb4b69b5d6eb99c51adf85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:08.441713 10096 consensus_queue.cc:1048] T d26bd321e5604f8aa61723f418be35a9 P 65ed95869fbb4b69b5d6eb99c51adf85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:08.461608  9316 raft_consensus.cc:1275] T f2229e498f7f472f97c088fddb802939 P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Refusing update from remote peer 65ed95869fbb4b69b5d6eb99c51adf85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:08.467715 10096 consensus_queue.cc:1048] T f2229e498f7f472f97c088fddb802939 P 65ed95869fbb4b69b5d6eb99c51adf85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:08.478062  9173 raft_consensus.cc:1275] T f2229e498f7f472f97c088fddb802939 P c694531b0e1d47988b291f1214efc4cb [term 2 FOLLOWER]: Refusing update from remote peer 65ed95869fbb4b69b5d6eb99c51adf85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:08.479516 10073 consensus_queue.cc:1048] T f2229e498f7f472f97c088fddb802939 P 65ed95869fbb4b69b5d6eb99c51adf85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:08.506875  9250 raft_consensus.cc:1275] T 989e9796152e4796a3408e00419403fa P 8846d581359a4b7ea6d4c33424ea825d [term 2 FOLLOWER]: Refusing update from remote peer 74ac2cf163ee475e8a280cb3aa738f57: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:08.511233 10066 consensus_queue.cc:1048] T 989e9796152e4796a3408e00419403fa P 74ac2cf163ee475e8a280cb3aa738f57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:08.534637  9173 raft_consensus.cc:1275] T 989e9796152e4796a3408e00419403fa P c694531b0e1d47988b291f1214efc4cb [term 2 FOLLOWER]: Refusing update from remote peer 74ac2cf163ee475e8a280cb3aa738f57: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:08.537344 10066 consensus_queue.cc:1048] T 989e9796152e4796a3408e00419403fa P 74ac2cf163ee475e8a280cb3aa738f57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:08.567858   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:08.606619   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:08.639106  9175 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "02048c7b44ac4e8a984dfa44a3b3b3e5"
dest_uuid: "c694531b0e1d47988b291f1214efc4cb"
mode: GRACEFUL
new_leader_uuid: "74ac2cf163ee475e8a280cb3aa738f57"
 from {username='slave'} at 127.0.0.1:35670
I20260709 13:03:08.639626  9175 raft_consensus.cc:606] T 02048c7b44ac4e8a984dfa44a3b3b3e5 P c694531b0e1d47988b291f1214efc4cb [term 1 LEADER]: Received request to transfer leadership to TS 74ac2cf163ee475e8a280cb3aa738f57
I20260709 13:03:08.642242  9175 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cb7f6aeb8116423481ea2b2dca5a06d4"
dest_uuid: "c694531b0e1d47988b291f1214efc4cb"
mode: GRACEFUL
new_leader_uuid: "74ac2cf163ee475e8a280cb3aa738f57"
 from {username='slave'} at 127.0.0.1:35670
I20260709 13:03:08.642817  9175 raft_consensus.cc:606] T cb7f6aeb8116423481ea2b2dca5a06d4 P c694531b0e1d47988b291f1214efc4cb [term 1 LEADER]: Received request to transfer leadership to TS 74ac2cf163ee475e8a280cb3aa738f57
I20260709 13:03:08.645129  9175 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d755a5211e5c4133bead5603a424005e"
dest_uuid: "c694531b0e1d47988b291f1214efc4cb"
mode: GRACEFUL
new_leader_uuid: "74ac2cf163ee475e8a280cb3aa738f57"
 from {username='slave'} at 127.0.0.1:35670
I20260709 13:03:08.645555  9175 raft_consensus.cc:606] T d755a5211e5c4133bead5603a424005e P c694531b0e1d47988b291f1214efc4cb [term 1 LEADER]: Received request to transfer leadership to TS 74ac2cf163ee475e8a280cb3aa738f57
I20260709 13:03:08.647825  9175 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "df7e9031dde347b5b9da753cc817ce17"
dest_uuid: "c694531b0e1d47988b291f1214efc4cb"
mode: GRACEFUL
new_leader_uuid: "65ed95869fbb4b69b5d6eb99c51adf85"
 from {username='slave'} at 127.0.0.1:35670
I20260709 13:03:08.648247  9175 raft_consensus.cc:606] T df7e9031dde347b5b9da753cc817ce17 P c694531b0e1d47988b291f1214efc4cb [term 1 LEADER]: Received request to transfer leadership to TS 65ed95869fbb4b69b5d6eb99c51adf85
I20260709 13:03:08.650293  9175 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eb666e221e5f4e4fbaba194838a28448"
dest_uuid: "c694531b0e1d47988b291f1214efc4cb"
mode: GRACEFUL
new_leader_uuid: "65ed95869fbb4b69b5d6eb99c51adf85"
 from {username='slave'} at 127.0.0.1:35670
I20260709 13:03:08.650738  9175 raft_consensus.cc:606] T eb666e221e5f4e4fbaba194838a28448 P c694531b0e1d47988b291f1214efc4cb [term 1 LEADER]: Received request to transfer leadership to TS 65ed95869fbb4b69b5d6eb99c51adf85
I20260709 13:03:08.651671   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:03:08.652962   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:08.788728 10068 raft_consensus.cc:993] T df7e9031dde347b5b9da753cc817ce17 P c694531b0e1d47988b291f1214efc4cb: : Instructing follower 65ed95869fbb4b69b5d6eb99c51adf85 to start an election
I20260709 13:03:08.789346 10123 raft_consensus.cc:1081] T df7e9031dde347b5b9da753cc817ce17 P c694531b0e1d47988b291f1214efc4cb [term 1 LEADER]: Signalling peer 65ed95869fbb4b69b5d6eb99c51adf85 to start an election
I20260709 13:03:08.790875  9905 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "df7e9031dde347b5b9da753cc817ce17"
dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85"
 from {username='slave'} at 127.0.0.1:59612
I20260709 13:03:08.791355  9905 raft_consensus.cc:493] T df7e9031dde347b5b9da753cc817ce17 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:08.791656  9905 raft_consensus.cc:3060] T df7e9031dde347b5b9da753cc817ce17 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:08.796924  9905 raft_consensus.cc:515] T df7e9031dde347b5b9da753cc817ce17 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:03:08.798471  9905 leader_election.cc:290] T df7e9031dde347b5b9da753cc817ce17 P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 2 election: Requested vote from peers 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351), c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455)
I20260709 13:03:08.799520  9175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7e9031dde347b5b9da753cc817ce17" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c694531b0e1d47988b291f1214efc4cb"
I20260709 13:03:08.799757  9319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7e9031dde347b5b9da753cc817ce17" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57"
I20260709 13:03:08.800096  9175 raft_consensus.cc:3055] T df7e9031dde347b5b9da753cc817ce17 P c694531b0e1d47988b291f1214efc4cb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:08.800316  9319 raft_consensus.cc:3060] T df7e9031dde347b5b9da753cc817ce17 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:08.800412  9175 raft_consensus.cc:740] T df7e9031dde347b5b9da753cc817ce17 P c694531b0e1d47988b291f1214efc4cb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c694531b0e1d47988b291f1214efc4cb, State: Running, Role: LEADER
I20260709 13:03:08.801235  9175 consensus_queue.cc:260] T df7e9031dde347b5b9da753cc817ce17 P c694531b0e1d47988b291f1214efc4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:03:08.802469  9175 raft_consensus.cc:3060] T df7e9031dde347b5b9da753cc817ce17 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:08.807852  9319 raft_consensus.cc:2468] T df7e9031dde347b5b9da753cc817ce17 P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65ed95869fbb4b69b5d6eb99c51adf85 in term 2.
I20260709 13:03:08.808458  9175 raft_consensus.cc:2468] T df7e9031dde347b5b9da753cc817ce17 P c694531b0e1d47988b291f1214efc4cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65ed95869fbb4b69b5d6eb99c51adf85 in term 2.
I20260709 13:03:08.809659  9851 leader_election.cc:304] T df7e9031dde347b5b9da753cc817ce17 P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65ed95869fbb4b69b5d6eb99c51adf85, c694531b0e1d47988b291f1214efc4cb; no voters: 
I20260709 13:03:08.810562 10073 raft_consensus.cc:2804] T df7e9031dde347b5b9da753cc817ce17 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:08.811096 10073 raft_consensus.cc:697] T df7e9031dde347b5b9da753cc817ce17 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 2 LEADER]: Becoming Leader. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Running, Role: LEADER
I20260709 13:03:08.811957 10073 consensus_queue.cc:237] T df7e9031dde347b5b9da753cc817ce17 P 65ed95869fbb4b69b5d6eb99c51adf85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:03:08.824496  8997 catalog_manager.cc:5697] T df7e9031dde347b5b9da753cc817ce17 P 65ed95869fbb4b69b5d6eb99c51adf85 reported cstate change: term changed from 1 to 2, leader changed from c694531b0e1d47988b291f1214efc4cb (127.0.107.194) to 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:08.957471 10061 raft_consensus.cc:993] T eb666e221e5f4e4fbaba194838a28448 P c694531b0e1d47988b291f1214efc4cb: : Instructing follower 65ed95869fbb4b69b5d6eb99c51adf85 to start an election
I20260709 13:03:08.957927 10123 raft_consensus.cc:1081] T eb666e221e5f4e4fbaba194838a28448 P c694531b0e1d47988b291f1214efc4cb [term 1 LEADER]: Signalling peer 65ed95869fbb4b69b5d6eb99c51adf85 to start an election
I20260709 13:03:08.959414  9904 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eb666e221e5f4e4fbaba194838a28448"
dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85"
 from {username='slave'} at 127.0.0.1:59612
I20260709 13:03:08.959949  9904 raft_consensus.cc:493] T eb666e221e5f4e4fbaba194838a28448 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:08.960424  9904 raft_consensus.cc:3060] T eb666e221e5f4e4fbaba194838a28448 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:08.966491  9904 raft_consensus.cc:515] T eb666e221e5f4e4fbaba194838a28448 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:03:08.968369  9904 leader_election.cc:290] T eb666e221e5f4e4fbaba194838a28448 P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 2 election: Requested vote from peers 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351), c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455)
I20260709 13:03:08.968567  9319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb666e221e5f4e4fbaba194838a28448" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57"
I20260709 13:03:08.968853  9173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb666e221e5f4e4fbaba194838a28448" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c694531b0e1d47988b291f1214efc4cb"
I20260709 13:03:08.969354  9319 raft_consensus.cc:3060] T eb666e221e5f4e4fbaba194838a28448 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:08.969707  9173 raft_consensus.cc:3055] T eb666e221e5f4e4fbaba194838a28448 P c694531b0e1d47988b291f1214efc4cb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:08.970026  9173 raft_consensus.cc:740] T eb666e221e5f4e4fbaba194838a28448 P c694531b0e1d47988b291f1214efc4cb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c694531b0e1d47988b291f1214efc4cb, State: Running, Role: LEADER
I20260709 13:03:08.970836  9173 consensus_queue.cc:260] T eb666e221e5f4e4fbaba194838a28448 P c694531b0e1d47988b291f1214efc4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:03:08.972055  9173 raft_consensus.cc:3060] T eb666e221e5f4e4fbaba194838a28448 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:08.976385  9319 raft_consensus.cc:2468] T eb666e221e5f4e4fbaba194838a28448 P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65ed95869fbb4b69b5d6eb99c51adf85 in term 2.
I20260709 13:03:08.977715  9852 leader_election.cc:304] T eb666e221e5f4e4fbaba194838a28448 P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65ed95869fbb4b69b5d6eb99c51adf85, 74ac2cf163ee475e8a280cb3aa738f57; no voters: 
I20260709 13:03:08.978631 10073 raft_consensus.cc:2804] T eb666e221e5f4e4fbaba194838a28448 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:08.979125 10073 raft_consensus.cc:697] T eb666e221e5f4e4fbaba194838a28448 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 2 LEADER]: Becoming Leader. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Running, Role: LEADER
I20260709 13:03:08.980998 10073 consensus_queue.cc:237] T eb666e221e5f4e4fbaba194838a28448 P 65ed95869fbb4b69b5d6eb99c51adf85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:03:08.987291  9173 raft_consensus.cc:2468] T eb666e221e5f4e4fbaba194838a28448 P c694531b0e1d47988b291f1214efc4cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65ed95869fbb4b69b5d6eb99c51adf85 in term 2.
I20260709 13:03:08.993791  8997 catalog_manager.cc:5697] T eb666e221e5f4e4fbaba194838a28448 P 65ed95869fbb4b69b5d6eb99c51adf85 reported cstate change: term changed from 1 to 2, leader changed from c694531b0e1d47988b291f1214efc4cb (127.0.107.194) to 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:09.003454 10123 raft_consensus.cc:993] T cb7f6aeb8116423481ea2b2dca5a06d4 P c694531b0e1d47988b291f1214efc4cb: : Instructing follower 74ac2cf163ee475e8a280cb3aa738f57 to start an election
I20260709 13:03:09.003964 10123 raft_consensus.cc:1081] T cb7f6aeb8116423481ea2b2dca5a06d4 P c694531b0e1d47988b291f1214efc4cb [term 1 LEADER]: Signalling peer 74ac2cf163ee475e8a280cb3aa738f57 to start an election
I20260709 13:03:09.005621  9316 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cb7f6aeb8116423481ea2b2dca5a06d4"
dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57"
 from {username='slave'} at 127.0.0.1:43728
I20260709 13:03:09.006170  9316 raft_consensus.cc:493] T cb7f6aeb8116423481ea2b2dca5a06d4 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:09.006505  9316 raft_consensus.cc:3060] T cb7f6aeb8116423481ea2b2dca5a06d4 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:09.011910  9316 raft_consensus.cc:515] T cb7f6aeb8116423481ea2b2dca5a06d4 P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:03:09.014273  9173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7f6aeb8116423481ea2b2dca5a06d4" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c694531b0e1d47988b291f1214efc4cb"
I20260709 13:03:09.016557  9173 raft_consensus.cc:3055] T cb7f6aeb8116423481ea2b2dca5a06d4 P c694531b0e1d47988b291f1214efc4cb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:09.016860  9173 raft_consensus.cc:740] T cb7f6aeb8116423481ea2b2dca5a06d4 P c694531b0e1d47988b291f1214efc4cb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c694531b0e1d47988b291f1214efc4cb, State: Running, Role: LEADER
I20260709 13:03:09.017654  9173 consensus_queue.cc:260] T cb7f6aeb8116423481ea2b2dca5a06d4 P c694531b0e1d47988b291f1214efc4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:03:09.019794  9316 leader_election.cc:290] T cb7f6aeb8116423481ea2b2dca5a06d4 P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 2 election: Requested vote from peers c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455), 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311)
I20260709 13:03:09.021029  9173 raft_consensus.cc:3060] T cb7f6aeb8116423481ea2b2dca5a06d4 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:09.020841  9248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7f6aeb8116423481ea2b2dca5a06d4" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8846d581359a4b7ea6d4c33424ea825d"
I20260709 13:03:09.021700  9248 raft_consensus.cc:3060] T cb7f6aeb8116423481ea2b2dca5a06d4 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:09.021963 10123 raft_consensus.cc:993] T d755a5211e5c4133bead5603a424005e P c694531b0e1d47988b291f1214efc4cb: : Instructing follower 74ac2cf163ee475e8a280cb3aa738f57 to start an election
I20260709 13:03:09.022382 10061 raft_consensus.cc:1081] T d755a5211e5c4133bead5603a424005e P c694531b0e1d47988b291f1214efc4cb [term 1 LEADER]: Signalling peer 74ac2cf163ee475e8a280cb3aa738f57 to start an election
I20260709 13:03:09.024600  9324 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d755a5211e5c4133bead5603a424005e"
dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57"
 from {username='slave'} at 127.0.0.1:43728
I20260709 13:03:09.025758  9324 raft_consensus.cc:493] T d755a5211e5c4133bead5603a424005e P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:09.026116  9324 raft_consensus.cc:3060] T d755a5211e5c4133bead5603a424005e P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:09.028755  9173 raft_consensus.cc:2468] T cb7f6aeb8116423481ea2b2dca5a06d4 P c694531b0e1d47988b291f1214efc4cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74ac2cf163ee475e8a280cb3aa738f57 in term 2.
I20260709 13:03:09.035511  9288 leader_election.cc:304] T cb7f6aeb8116423481ea2b2dca5a06d4 P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57, c694531b0e1d47988b291f1214efc4cb; no voters: 
I20260709 13:03:09.034399  9324 raft_consensus.cc:515] T d755a5211e5c4133bead5603a424005e P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:03:09.039379  9324 leader_election.cc:290] T d755a5211e5c4133bead5603a424005e P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 2 election: Requested vote from peers c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455), 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311)
I20260709 13:03:09.040576 10069 raft_consensus.cc:2804] T cb7f6aeb8116423481ea2b2dca5a06d4 P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:09.040621  9250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d755a5211e5c4133bead5603a424005e" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8846d581359a4b7ea6d4c33424ea825d"
I20260709 13:03:09.041355  9250 raft_consensus.cc:3060] T d755a5211e5c4133bead5603a424005e P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:09.034415  9248 raft_consensus.cc:2468] T cb7f6aeb8116423481ea2b2dca5a06d4 P 8846d581359a4b7ea6d4c33424ea825d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74ac2cf163ee475e8a280cb3aa738f57 in term 2.
I20260709 13:03:09.042114 10069 raft_consensus.cc:697] T cb7f6aeb8116423481ea2b2dca5a06d4 P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 LEADER]: Becoming Leader. State: Replica: 74ac2cf163ee475e8a280cb3aa738f57, State: Running, Role: LEADER
I20260709 13:03:09.042912  9173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d755a5211e5c4133bead5603a424005e" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c694531b0e1d47988b291f1214efc4cb"
I20260709 13:03:09.045337  9173 raft_consensus.cc:3055] T d755a5211e5c4133bead5603a424005e P c694531b0e1d47988b291f1214efc4cb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:09.043219 10069 consensus_queue.cc:237] T cb7f6aeb8116423481ea2b2dca5a06d4 P 74ac2cf163ee475e8a280cb3aa738f57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:03:09.045753  9173 raft_consensus.cc:740] T d755a5211e5c4133bead5603a424005e P c694531b0e1d47988b291f1214efc4cb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c694531b0e1d47988b291f1214efc4cb, State: Running, Role: LEADER
I20260709 13:03:09.046708  9173 consensus_queue.cc:260] T d755a5211e5c4133bead5603a424005e P c694531b0e1d47988b291f1214efc4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:03:09.048720  9250 raft_consensus.cc:2468] T d755a5211e5c4133bead5603a424005e P 8846d581359a4b7ea6d4c33424ea825d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74ac2cf163ee475e8a280cb3aa738f57 in term 2.
I20260709 13:03:09.049147  9173 raft_consensus.cc:3060] T d755a5211e5c4133bead5603a424005e P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:09.050168  9287 leader_election.cc:304] T d755a5211e5c4133bead5603a424005e P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57, 8846d581359a4b7ea6d4c33424ea825d; no voters: 
I20260709 13:03:09.051417 10066 raft_consensus.cc:2804] T d755a5211e5c4133bead5603a424005e P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:09.056780  9173 raft_consensus.cc:2468] T d755a5211e5c4133bead5603a424005e P c694531b0e1d47988b291f1214efc4cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74ac2cf163ee475e8a280cb3aa738f57 in term 2.
I20260709 13:03:09.058313 10066 raft_consensus.cc:697] T d755a5211e5c4133bead5603a424005e P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 LEADER]: Becoming Leader. State: Replica: 74ac2cf163ee475e8a280cb3aa738f57, State: Running, Role: LEADER
I20260709 13:03:09.059144 10066 consensus_queue.cc:237] T d755a5211e5c4133bead5603a424005e P 74ac2cf163ee475e8a280cb3aa738f57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:03:09.065714  8997 catalog_manager.cc:5697] T cb7f6aeb8116423481ea2b2dca5a06d4 P 74ac2cf163ee475e8a280cb3aa738f57 reported cstate change: term changed from 1 to 2, leader changed from c694531b0e1d47988b291f1214efc4cb (127.0.107.194) to 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "74ac2cf163ee475e8a280cb3aa738f57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:09.081544  8997 catalog_manager.cc:5697] T d755a5211e5c4133bead5603a424005e P 74ac2cf163ee475e8a280cb3aa738f57 reported cstate change: term changed from 1 to 2, leader changed from c694531b0e1d47988b291f1214efc4cb (127.0.107.194) to 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "74ac2cf163ee475e8a280cb3aa738f57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:09.180747 10052 raft_consensus.cc:993] T 02048c7b44ac4e8a984dfa44a3b3b3e5 P c694531b0e1d47988b291f1214efc4cb: : Instructing follower 74ac2cf163ee475e8a280cb3aa738f57 to start an election
I20260709 13:03:09.181281 10123 raft_consensus.cc:1081] T 02048c7b44ac4e8a984dfa44a3b3b3e5 P c694531b0e1d47988b291f1214efc4cb [term 1 LEADER]: Signalling peer 74ac2cf163ee475e8a280cb3aa738f57 to start an election
I20260709 13:03:09.182785  9316 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "02048c7b44ac4e8a984dfa44a3b3b3e5"
dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57"
 from {username='slave'} at 127.0.0.1:43728
I20260709 13:03:09.183324  9316 raft_consensus.cc:493] T 02048c7b44ac4e8a984dfa44a3b3b3e5 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:09.183651  9316 raft_consensus.cc:3060] T 02048c7b44ac4e8a984dfa44a3b3b3e5 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:09.188412  9316 raft_consensus.cc:515] T 02048c7b44ac4e8a984dfa44a3b3b3e5 P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:03:09.189960  9316 leader_election.cc:290] T 02048c7b44ac4e8a984dfa44a3b3b3e5 P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 2 election: Requested vote from peers c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455), 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311)
I20260709 13:03:09.190902  9173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02048c7b44ac4e8a984dfa44a3b3b3e5" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c694531b0e1d47988b291f1214efc4cb"
I20260709 13:03:09.191155  9250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02048c7b44ac4e8a984dfa44a3b3b3e5" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8846d581359a4b7ea6d4c33424ea825d"
I20260709 13:03:09.191677  9173 raft_consensus.cc:3055] T 02048c7b44ac4e8a984dfa44a3b3b3e5 P c694531b0e1d47988b291f1214efc4cb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:09.191834  9250 raft_consensus.cc:3060] T 02048c7b44ac4e8a984dfa44a3b3b3e5 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:09.192022  9173 raft_consensus.cc:740] T 02048c7b44ac4e8a984dfa44a3b3b3e5 P c694531b0e1d47988b291f1214efc4cb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c694531b0e1d47988b291f1214efc4cb, State: Running, Role: LEADER
I20260709 13:03:09.192957  9173 consensus_queue.cc:260] T 02048c7b44ac4e8a984dfa44a3b3b3e5 P c694531b0e1d47988b291f1214efc4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:03:09.194167  9173 raft_consensus.cc:3060] T 02048c7b44ac4e8a984dfa44a3b3b3e5 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:09.198086  9250 raft_consensus.cc:2468] T 02048c7b44ac4e8a984dfa44a3b3b3e5 P 8846d581359a4b7ea6d4c33424ea825d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74ac2cf163ee475e8a280cb3aa738f57 in term 2.
I20260709 13:03:09.199323  9287 leader_election.cc:304] T 02048c7b44ac4e8a984dfa44a3b3b3e5 P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57, 8846d581359a4b7ea6d4c33424ea825d; no voters: 
I20260709 13:03:09.199929  9173 raft_consensus.cc:2468] T 02048c7b44ac4e8a984dfa44a3b3b3e5 P c694531b0e1d47988b291f1214efc4cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74ac2cf163ee475e8a280cb3aa738f57 in term 2.
I20260709 13:03:09.200008 10066 raft_consensus.cc:2804] T 02048c7b44ac4e8a984dfa44a3b3b3e5 P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:09.200856 10066 raft_consensus.cc:697] T 02048c7b44ac4e8a984dfa44a3b3b3e5 P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 LEADER]: Becoming Leader. State: Replica: 74ac2cf163ee475e8a280cb3aa738f57, State: Running, Role: LEADER
I20260709 13:03:09.201675 10066 consensus_queue.cc:237] T 02048c7b44ac4e8a984dfa44a3b3b3e5 P 74ac2cf163ee475e8a280cb3aa738f57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:03:09.209784  9173 raft_consensus.cc:1275] T df7e9031dde347b5b9da753cc817ce17 P c694531b0e1d47988b291f1214efc4cb [term 2 FOLLOWER]: Refusing update from remote peer 65ed95869fbb4b69b5d6eb99c51adf85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:09.211097 10084 consensus_queue.cc:1048] T df7e9031dde347b5b9da753cc817ce17 P 65ed95869fbb4b69b5d6eb99c51adf85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:09.211321  8997 catalog_manager.cc:5697] T 02048c7b44ac4e8a984dfa44a3b3b3e5 P 74ac2cf163ee475e8a280cb3aa738f57 reported cstate change: term changed from 1 to 2, leader changed from c694531b0e1d47988b291f1214efc4cb (127.0.107.194) to 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "74ac2cf163ee475e8a280cb3aa738f57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:09.223367  9316 raft_consensus.cc:1275] T df7e9031dde347b5b9da753cc817ce17 P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Refusing update from remote peer 65ed95869fbb4b69b5d6eb99c51adf85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:09.224582 10096 consensus_queue.cc:1048] T df7e9031dde347b5b9da753cc817ce17 P 65ed95869fbb4b69b5d6eb99c51adf85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:09.397266  9175 raft_consensus.cc:1275] T eb666e221e5f4e4fbaba194838a28448 P c694531b0e1d47988b291f1214efc4cb [term 2 FOLLOWER]: Refusing update from remote peer 65ed95869fbb4b69b5d6eb99c51adf85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:09.399150 10096 consensus_queue.cc:1048] T eb666e221e5f4e4fbaba194838a28448 P 65ed95869fbb4b69b5d6eb99c51adf85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:09.411834  9316 raft_consensus.cc:1275] T eb666e221e5f4e4fbaba194838a28448 P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Refusing update from remote peer 65ed95869fbb4b69b5d6eb99c51adf85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:09.413133 10096 consensus_queue.cc:1048] T eb666e221e5f4e4fbaba194838a28448 P 65ed95869fbb4b69b5d6eb99c51adf85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:09.451217  9173 raft_consensus.cc:1275] T cb7f6aeb8116423481ea2b2dca5a06d4 P c694531b0e1d47988b291f1214efc4cb [term 2 FOLLOWER]: Refusing update from remote peer 74ac2cf163ee475e8a280cb3aa738f57: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:09.452808 10066 consensus_queue.cc:1048] T cb7f6aeb8116423481ea2b2dca5a06d4 P 74ac2cf163ee475e8a280cb3aa738f57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:09.462405  9250 raft_consensus.cc:1275] T cb7f6aeb8116423481ea2b2dca5a06d4 P 8846d581359a4b7ea6d4c33424ea825d [term 2 FOLLOWER]: Refusing update from remote peer 74ac2cf163ee475e8a280cb3aa738f57: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:09.463747 10066 consensus_queue.cc:1048] T cb7f6aeb8116423481ea2b2dca5a06d4 P 74ac2cf163ee475e8a280cb3aa738f57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:09.599516  9173 raft_consensus.cc:1275] T d755a5211e5c4133bead5603a424005e P c694531b0e1d47988b291f1214efc4cb [term 2 FOLLOWER]: Refusing update from remote peer 74ac2cf163ee475e8a280cb3aa738f57: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:09.600690 10066 consensus_queue.cc:1048] T d755a5211e5c4133bead5603a424005e P 74ac2cf163ee475e8a280cb3aa738f57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:09.605612  9248 raft_consensus.cc:1275] T d755a5211e5c4133bead5603a424005e P 8846d581359a4b7ea6d4c33424ea825d [term 2 FOLLOWER]: Refusing update from remote peer 74ac2cf163ee475e8a280cb3aa738f57: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:09.606978 10066 consensus_queue.cc:1048] T d755a5211e5c4133bead5603a424005e P 74ac2cf163ee475e8a280cb3aa738f57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:09.653731   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:09.660271  9248 raft_consensus.cc:1275] T 02048c7b44ac4e8a984dfa44a3b3b3e5 P 8846d581359a4b7ea6d4c33424ea825d [term 2 FOLLOWER]: Refusing update from remote peer 74ac2cf163ee475e8a280cb3aa738f57: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:09.661761 10069 consensus_queue.cc:1048] T 02048c7b44ac4e8a984dfa44a3b3b3e5 P 74ac2cf163ee475e8a280cb3aa738f57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:09.672376  9173 raft_consensus.cc:1275] T 02048c7b44ac4e8a984dfa44a3b3b3e5 P c694531b0e1d47988b291f1214efc4cb [term 2 FOLLOWER]: Refusing update from remote peer 74ac2cf163ee475e8a280cb3aa738f57: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:09.673892 10066 consensus_queue.cc:1048] T 02048c7b44ac4e8a984dfa44a3b3b3e5 P 74ac2cf163ee475e8a280cb3aa738f57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:09.715001   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:09.753855  9173 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "070a6f2020a1483381e2baa75e5c0cbf"
dest_uuid: "c694531b0e1d47988b291f1214efc4cb"
mode: GRACEFUL
new_leader_uuid: "65ed95869fbb4b69b5d6eb99c51adf85"
 from {username='slave'} at 127.0.0.1:35670
I20260709 13:03:09.754349  9173 raft_consensus.cc:606] T 070a6f2020a1483381e2baa75e5c0cbf P c694531b0e1d47988b291f1214efc4cb [term 2 LEADER]: Received request to transfer leadership to TS 65ed95869fbb4b69b5d6eb99c51adf85
I20260709 13:03:09.756723  9173 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "18df0aeb35ec4bb095806227d9bb97a8"
dest_uuid: "c694531b0e1d47988b291f1214efc4cb"
mode: GRACEFUL
new_leader_uuid: "65ed95869fbb4b69b5d6eb99c51adf85"
 from {username='slave'} at 127.0.0.1:35670
I20260709 13:03:09.757275  9173 raft_consensus.cc:606] T 18df0aeb35ec4bb095806227d9bb97a8 P c694531b0e1d47988b291f1214efc4cb [term 1 LEADER]: Received request to transfer leadership to TS 65ed95869fbb4b69b5d6eb99c51adf85
I20260709 13:03:09.759611  9173 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "53bdda361da242a1b37aa013fad1ee60"
dest_uuid: "c694531b0e1d47988b291f1214efc4cb"
mode: GRACEFUL
new_leader_uuid: "74ac2cf163ee475e8a280cb3aa738f57"
 from {username='slave'} at 127.0.0.1:35670
I20260709 13:03:09.760107  9173 raft_consensus.cc:606] T 53bdda361da242a1b37aa013fad1ee60 P c694531b0e1d47988b291f1214efc4cb [term 1 LEADER]: Received request to transfer leadership to TS 74ac2cf163ee475e8a280cb3aa738f57
I20260709 13:03:09.778286  9316 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eab411e3927a434ab647aa9b31fcf60d"
dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57"
mode: GRACEFUL
new_leader_uuid: "65ed95869fbb4b69b5d6eb99c51adf85"
 from {username='slave'} at 127.0.0.1:49574
I20260709 13:03:09.778900  9316 raft_consensus.cc:606] T eab411e3927a434ab647aa9b31fcf60d P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 LEADER]: Received request to transfer leadership to TS 65ed95869fbb4b69b5d6eb99c51adf85
I20260709 13:03:09.780632   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:03:09.782871   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:09.850121 10061 raft_consensus.cc:993] T 53bdda361da242a1b37aa013fad1ee60 P c694531b0e1d47988b291f1214efc4cb: : Instructing follower 74ac2cf163ee475e8a280cb3aa738f57 to start an election
I20260709 13:03:09.850636 10052 raft_consensus.cc:1081] T 53bdda361da242a1b37aa013fad1ee60 P c694531b0e1d47988b291f1214efc4cb [term 1 LEADER]: Signalling peer 74ac2cf163ee475e8a280cb3aa738f57 to start an election
I20260709 13:03:09.852097  9316 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "53bdda361da242a1b37aa013fad1ee60"
dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57"
 from {username='slave'} at 127.0.0.1:43728
I20260709 13:03:09.852634  9316 raft_consensus.cc:493] T 53bdda361da242a1b37aa013fad1ee60 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:09.852962  9316 raft_consensus.cc:3060] T 53bdda361da242a1b37aa013fad1ee60 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:09.858997  9316 raft_consensus.cc:515] T 53bdda361da242a1b37aa013fad1ee60 P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:03:09.860886  9316 leader_election.cc:290] T 53bdda361da242a1b37aa013fad1ee60 P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 2 election: Requested vote from peers c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455), 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311)
I20260709 13:03:09.861186  9173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53bdda361da242a1b37aa013fad1ee60" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c694531b0e1d47988b291f1214efc4cb"
I20260709 13:03:09.861400  9248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53bdda361da242a1b37aa013fad1ee60" candidate_uuid: "74ac2cf163ee475e8a280cb3aa738f57" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8846d581359a4b7ea6d4c33424ea825d"
I20260709 13:03:09.861855  9173 raft_consensus.cc:3055] T 53bdda361da242a1b37aa013fad1ee60 P c694531b0e1d47988b291f1214efc4cb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:09.862051  9248 raft_consensus.cc:3060] T 53bdda361da242a1b37aa013fad1ee60 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:09.862396  9173 raft_consensus.cc:740] T 53bdda361da242a1b37aa013fad1ee60 P c694531b0e1d47988b291f1214efc4cb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c694531b0e1d47988b291f1214efc4cb, State: Running, Role: LEADER
I20260709 13:03:09.863176  9173 consensus_queue.cc:260] T 53bdda361da242a1b37aa013fad1ee60 P c694531b0e1d47988b291f1214efc4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:03:09.864401  9173 raft_consensus.cc:3060] T 53bdda361da242a1b37aa013fad1ee60 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:09.870802  9173 raft_consensus.cc:2468] T 53bdda361da242a1b37aa013fad1ee60 P c694531b0e1d47988b291f1214efc4cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74ac2cf163ee475e8a280cb3aa738f57 in term 2.
I20260709 13:03:09.868939  9248 raft_consensus.cc:2468] T 53bdda361da242a1b37aa013fad1ee60 P 8846d581359a4b7ea6d4c33424ea825d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74ac2cf163ee475e8a280cb3aa738f57 in term 2.
I20260709 13:03:09.872133  9287 leader_election.cc:304] T 53bdda361da242a1b37aa013fad1ee60 P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57, 8846d581359a4b7ea6d4c33424ea825d; no voters: 
I20260709 13:03:09.873226 10066 raft_consensus.cc:2804] T 53bdda361da242a1b37aa013fad1ee60 P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:09.875136 10066 raft_consensus.cc:697] T 53bdda361da242a1b37aa013fad1ee60 P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 LEADER]: Becoming Leader. State: Replica: 74ac2cf163ee475e8a280cb3aa738f57, State: Running, Role: LEADER
I20260709 13:03:09.875952 10066 consensus_queue.cc:237] T 53bdda361da242a1b37aa013fad1ee60 P 74ac2cf163ee475e8a280cb3aa738f57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:03:09.888581  8998 catalog_manager.cc:5697] T 53bdda361da242a1b37aa013fad1ee60 P 74ac2cf163ee475e8a280cb3aa738f57 reported cstate change: term changed from 1 to 2, leader changed from c694531b0e1d47988b291f1214efc4cb (127.0.107.194) to 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "74ac2cf163ee475e8a280cb3aa738f57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:10.037272 10066 raft_consensus.cc:993] T eab411e3927a434ab647aa9b31fcf60d P 74ac2cf163ee475e8a280cb3aa738f57: : Instructing follower 65ed95869fbb4b69b5d6eb99c51adf85 to start an election
I20260709 13:03:10.037732 10069 raft_consensus.cc:1081] T eab411e3927a434ab647aa9b31fcf60d P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 LEADER]: Signalling peer 65ed95869fbb4b69b5d6eb99c51adf85 to start an election
I20260709 13:03:10.039156  9905 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eab411e3927a434ab647aa9b31fcf60d"
dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85"
 from {username='slave'} at 127.0.0.1:59628
I20260709 13:03:10.039677  9905 raft_consensus.cc:493] T eab411e3927a434ab647aa9b31fcf60d P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:10.039966  9905 raft_consensus.cc:3060] T eab411e3927a434ab647aa9b31fcf60d P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:10.044960  9905 raft_consensus.cc:515] T eab411e3927a434ab647aa9b31fcf60d P 65ed95869fbb4b69b5d6eb99c51adf85 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:03:10.047706  9248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eab411e3927a434ab647aa9b31fcf60d" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8846d581359a4b7ea6d4c33424ea825d"
I20260709 13:03:10.048448  9248 raft_consensus.cc:3060] T eab411e3927a434ab647aa9b31fcf60d P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:10.049376  9316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eab411e3927a434ab647aa9b31fcf60d" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57"
I20260709 13:03:10.050031  9316 raft_consensus.cc:3055] T eab411e3927a434ab647aa9b31fcf60d P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:10.050338  9316 raft_consensus.cc:740] T eab411e3927a434ab647aa9b31fcf60d P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 74ac2cf163ee475e8a280cb3aa738f57, State: Running, Role: LEADER
I20260709 13:03:10.051189  9316 consensus_queue.cc:260] T eab411e3927a434ab647aa9b31fcf60d P 74ac2cf163ee475e8a280cb3aa738f57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:03:10.052217  9316 raft_consensus.cc:3060] T eab411e3927a434ab647aa9b31fcf60d P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:10.055363  9248 raft_consensus.cc:2468] T eab411e3927a434ab647aa9b31fcf60d P 8846d581359a4b7ea6d4c33424ea825d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65ed95869fbb4b69b5d6eb99c51adf85 in term 2.
I20260709 13:03:10.057224  9905 leader_election.cc:290] T eab411e3927a434ab647aa9b31fcf60d P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 2 election: Requested vote from peers 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311), 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351)
I20260709 13:03:10.058422  9850 leader_election.cc:304] T eab411e3927a434ab647aa9b31fcf60d P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65ed95869fbb4b69b5d6eb99c51adf85, 8846d581359a4b7ea6d4c33424ea825d; no voters: 
I20260709 13:03:10.060221 10096 raft_consensus.cc:2804] T eab411e3927a434ab647aa9b31fcf60d P 65ed95869fbb4b69b5d6eb99c51adf85 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:10.060777 10096 raft_consensus.cc:697] T eab411e3927a434ab647aa9b31fcf60d P 65ed95869fbb4b69b5d6eb99c51adf85 [term 2 LEADER]: Becoming Leader. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Running, Role: LEADER
I20260709 13:03:10.061702 10096 consensus_queue.cc:237] T eab411e3927a434ab647aa9b31fcf60d P 65ed95869fbb4b69b5d6eb99c51adf85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:03:10.063231  9316 raft_consensus.cc:2468] T eab411e3927a434ab647aa9b31fcf60d P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65ed95869fbb4b69b5d6eb99c51adf85 in term 2.
I20260709 13:03:10.074437  8998 catalog_manager.cc:5697] T eab411e3927a434ab647aa9b31fcf60d P 65ed95869fbb4b69b5d6eb99c51adf85 reported cstate change: term changed from 1 to 2, leader changed from 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196) to 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:10.114560 10061 raft_consensus.cc:993] T 18df0aeb35ec4bb095806227d9bb97a8 P c694531b0e1d47988b291f1214efc4cb: : Instructing follower 65ed95869fbb4b69b5d6eb99c51adf85 to start an election
I20260709 13:03:10.114993 10052 raft_consensus.cc:1081] T 18df0aeb35ec4bb095806227d9bb97a8 P c694531b0e1d47988b291f1214efc4cb [term 1 LEADER]: Signalling peer 65ed95869fbb4b69b5d6eb99c51adf85 to start an election
I20260709 13:03:10.116601  9905 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "18df0aeb35ec4bb095806227d9bb97a8"
dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85"
 from {username='slave'} at 127.0.0.1:59612
I20260709 13:03:10.117215  9905 raft_consensus.cc:493] T 18df0aeb35ec4bb095806227d9bb97a8 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:10.117554  9905 raft_consensus.cc:3060] T 18df0aeb35ec4bb095806227d9bb97a8 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:10.121218 10061 raft_consensus.cc:993] T 070a6f2020a1483381e2baa75e5c0cbf P c694531b0e1d47988b291f1214efc4cb: : Instructing follower 65ed95869fbb4b69b5d6eb99c51adf85 to start an election
I20260709 13:03:10.121708 10052 raft_consensus.cc:1081] T 070a6f2020a1483381e2baa75e5c0cbf P c694531b0e1d47988b291f1214efc4cb [term 2 LEADER]: Signalling peer 65ed95869fbb4b69b5d6eb99c51adf85 to start an election
I20260709 13:03:10.123674  9908 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "070a6f2020a1483381e2baa75e5c0cbf"
dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85"
 from {username='slave'} at 127.0.0.1:59612
I20260709 13:03:10.124228  9908 raft_consensus.cc:493] T 070a6f2020a1483381e2baa75e5c0cbf P 65ed95869fbb4b69b5d6eb99c51adf85 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:10.124536  9908 raft_consensus.cc:3060] T 070a6f2020a1483381e2baa75e5c0cbf P 65ed95869fbb4b69b5d6eb99c51adf85 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:10.125012  9905 raft_consensus.cc:515] T 18df0aeb35ec4bb095806227d9bb97a8 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:03:10.126816  9905 leader_election.cc:290] T 18df0aeb35ec4bb095806227d9bb97a8 P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 2 election: Requested vote from peers 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351), c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455)
I20260709 13:03:10.127624  9316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18df0aeb35ec4bb095806227d9bb97a8" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57"
I20260709 13:03:10.127830  9175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18df0aeb35ec4bb095806227d9bb97a8" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c694531b0e1d47988b291f1214efc4cb"
I20260709 13:03:10.128294  9316 raft_consensus.cc:3060] T 18df0aeb35ec4bb095806227d9bb97a8 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:10.128499  9175 raft_consensus.cc:3055] T 18df0aeb35ec4bb095806227d9bb97a8 P c694531b0e1d47988b291f1214efc4cb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:10.128916  9175 raft_consensus.cc:740] T 18df0aeb35ec4bb095806227d9bb97a8 P c694531b0e1d47988b291f1214efc4cb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c694531b0e1d47988b291f1214efc4cb, State: Running, Role: LEADER
I20260709 13:03:10.129932  9175 consensus_queue.cc:260] T 18df0aeb35ec4bb095806227d9bb97a8 P c694531b0e1d47988b291f1214efc4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:03:10.131255  9175 raft_consensus.cc:3060] T 18df0aeb35ec4bb095806227d9bb97a8 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:10.132532  9908 raft_consensus.cc:515] T 070a6f2020a1483381e2baa75e5c0cbf P 65ed95869fbb4b69b5d6eb99c51adf85 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:03:10.133555  9316 raft_consensus.cc:2468] T 18df0aeb35ec4bb095806227d9bb97a8 P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65ed95869fbb4b69b5d6eb99c51adf85 in term 2.
I20260709 13:03:10.135155  9908 leader_election.cc:290] T 070a6f2020a1483381e2baa75e5c0cbf P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 3 election: Requested vote from peers c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455), 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311)
I20260709 13:03:10.135386  9173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070a6f2020a1483381e2baa75e5c0cbf" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c694531b0e1d47988b291f1214efc4cb"
I20260709 13:03:10.135730  9852 leader_election.cc:304] T 18df0aeb35ec4bb095806227d9bb97a8 P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65ed95869fbb4b69b5d6eb99c51adf85, 74ac2cf163ee475e8a280cb3aa738f57; no voters: 
I20260709 13:03:10.136437  9173 raft_consensus.cc:3055] T 070a6f2020a1483381e2baa75e5c0cbf P c694531b0e1d47988b291f1214efc4cb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:10.136762  9173 raft_consensus.cc:740] T 070a6f2020a1483381e2baa75e5c0cbf P c694531b0e1d47988b291f1214efc4cb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c694531b0e1d47988b291f1214efc4cb, State: Running, Role: LEADER
I20260709 13:03:10.136916  9248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "070a6f2020a1483381e2baa75e5c0cbf" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8846d581359a4b7ea6d4c33424ea825d"
I20260709 13:03:10.137607  9248 raft_consensus.cc:3060] T 070a6f2020a1483381e2baa75e5c0cbf P 8846d581359a4b7ea6d4c33424ea825d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:10.137575  9173 consensus_queue.cc:260] T 070a6f2020a1483381e2baa75e5c0cbf P c694531b0e1d47988b291f1214efc4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:03:10.138820  9173 raft_consensus.cc:3060] T 070a6f2020a1483381e2baa75e5c0cbf P c694531b0e1d47988b291f1214efc4cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:10.139782  9175 raft_consensus.cc:2468] T 18df0aeb35ec4bb095806227d9bb97a8 P c694531b0e1d47988b291f1214efc4cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65ed95869fbb4b69b5d6eb99c51adf85 in term 2.
I20260709 13:03:10.140092 10073 raft_consensus.cc:2804] T 18df0aeb35ec4bb095806227d9bb97a8 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:10.140713 10073 raft_consensus.cc:697] T 18df0aeb35ec4bb095806227d9bb97a8 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 2 LEADER]: Becoming Leader. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Running, Role: LEADER
I20260709 13:03:10.141559 10073 consensus_queue.cc:237] T 18df0aeb35ec4bb095806227d9bb97a8 P 65ed95869fbb4b69b5d6eb99c51adf85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:03:10.150051  9173 raft_consensus.cc:2468] T 070a6f2020a1483381e2baa75e5c0cbf P c694531b0e1d47988b291f1214efc4cb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65ed95869fbb4b69b5d6eb99c51adf85 in term 3.
I20260709 13:03:10.151542  9851 leader_election.cc:304] T 070a6f2020a1483381e2baa75e5c0cbf P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65ed95869fbb4b69b5d6eb99c51adf85, c694531b0e1d47988b291f1214efc4cb; no voters: 
I20260709 13:03:10.152781 10096 raft_consensus.cc:2804] T 070a6f2020a1483381e2baa75e5c0cbf P 65ed95869fbb4b69b5d6eb99c51adf85 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:10.153420 10096 raft_consensus.cc:697] T 070a6f2020a1483381e2baa75e5c0cbf P 65ed95869fbb4b69b5d6eb99c51adf85 [term 3 LEADER]: Becoming Leader. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Running, Role: LEADER
I20260709 13:03:10.154337 10096 consensus_queue.cc:237] T 070a6f2020a1483381e2baa75e5c0cbf P 65ed95869fbb4b69b5d6eb99c51adf85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } }
I20260709 13:03:10.159747  9248 raft_consensus.cc:2468] T 070a6f2020a1483381e2baa75e5c0cbf P 8846d581359a4b7ea6d4c33424ea825d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65ed95869fbb4b69b5d6eb99c51adf85 in term 3.
I20260709 13:03:10.176261  8998 catalog_manager.cc:5697] T 18df0aeb35ec4bb095806227d9bb97a8 P 65ed95869fbb4b69b5d6eb99c51adf85 reported cstate change: term changed from 1 to 2, leader changed from c694531b0e1d47988b291f1214efc4cb (127.0.107.194) to 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:10.194939  8998 catalog_manager.cc:5697] T 070a6f2020a1483381e2baa75e5c0cbf P 65ed95869fbb4b69b5d6eb99c51adf85 reported cstate change: term changed from 2 to 3, leader changed from c694531b0e1d47988b291f1214efc4cb (127.0.107.194) to 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:10.273818  9173 raft_consensus.cc:1275] T 53bdda361da242a1b37aa013fad1ee60 P c694531b0e1d47988b291f1214efc4cb [term 2 FOLLOWER]: Refusing update from remote peer 74ac2cf163ee475e8a280cb3aa738f57: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:10.275198 10069 consensus_queue.cc:1048] T 53bdda361da242a1b37aa013fad1ee60 P 74ac2cf163ee475e8a280cb3aa738f57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:10.299433  9250 raft_consensus.cc:1275] T 53bdda361da242a1b37aa013fad1ee60 P 8846d581359a4b7ea6d4c33424ea825d [term 2 FOLLOWER]: Refusing update from remote peer 74ac2cf163ee475e8a280cb3aa738f57: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:10.301117 10066 consensus_queue.cc:1048] T 53bdda361da242a1b37aa013fad1ee60 P 74ac2cf163ee475e8a280cb3aa738f57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:10.474056  9250 raft_consensus.cc:1275] T eab411e3927a434ab647aa9b31fcf60d P 8846d581359a4b7ea6d4c33424ea825d [term 2 FOLLOWER]: Refusing update from remote peer 65ed95869fbb4b69b5d6eb99c51adf85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:10.475355 10073 consensus_queue.cc:1048] T eab411e3927a434ab647aa9b31fcf60d P 65ed95869fbb4b69b5d6eb99c51adf85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:10.486727  9319 raft_consensus.cc:1275] T eab411e3927a434ab647aa9b31fcf60d P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Refusing update from remote peer 65ed95869fbb4b69b5d6eb99c51adf85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:10.488106 10096 consensus_queue.cc:1048] T eab411e3927a434ab647aa9b31fcf60d P 65ed95869fbb4b69b5d6eb99c51adf85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:10.527781  9319 raft_consensus.cc:1275] T 18df0aeb35ec4bb095806227d9bb97a8 P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Refusing update from remote peer 65ed95869fbb4b69b5d6eb99c51adf85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:10.528882 10084 consensus_queue.cc:1048] T 18df0aeb35ec4bb095806227d9bb97a8 P 65ed95869fbb4b69b5d6eb99c51adf85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:10.542156  9173 raft_consensus.cc:1275] T 18df0aeb35ec4bb095806227d9bb97a8 P c694531b0e1d47988b291f1214efc4cb [term 2 FOLLOWER]: Refusing update from remote peer 65ed95869fbb4b69b5d6eb99c51adf85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:10.543601 10084 consensus_queue.cc:1048] T 18df0aeb35ec4bb095806227d9bb97a8 P 65ed95869fbb4b69b5d6eb99c51adf85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:10.609223  9248 raft_consensus.cc:1275] T 070a6f2020a1483381e2baa75e5c0cbf P 8846d581359a4b7ea6d4c33424ea825d [term 3 FOLLOWER]: Refusing update from remote peer 65ed95869fbb4b69b5d6eb99c51adf85: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:10.610698 10084 consensus_queue.cc:1048] T 070a6f2020a1483381e2baa75e5c0cbf P 65ed95869fbb4b69b5d6eb99c51adf85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:10.619648  9173 raft_consensus.cc:1275] T 070a6f2020a1483381e2baa75e5c0cbf P c694531b0e1d47988b291f1214efc4cb [term 3 FOLLOWER]: Refusing update from remote peer 65ed95869fbb4b69b5d6eb99c51adf85: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:10.621223 10096 consensus_queue.cc:1048] T 070a6f2020a1483381e2baa75e5c0cbf P 65ed95869fbb4b69b5d6eb99c51adf85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:10.783949   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:10.827554   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:10.869907  9319 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "902451f24024496b83b9a05dfe359a22"
dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57"
mode: GRACEFUL
new_leader_uuid: "8846d581359a4b7ea6d4c33424ea825d"
 from {username='slave'} at 127.0.0.1:49574
I20260709 13:03:10.870434  9319 raft_consensus.cc:606] T 902451f24024496b83b9a05dfe359a22 P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 LEADER]: Received request to transfer leadership to TS 8846d581359a4b7ea6d4c33424ea825d
I20260709 13:03:10.871562   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:03:10.872659   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:11.065936 10069 raft_consensus.cc:993] T 902451f24024496b83b9a05dfe359a22 P 74ac2cf163ee475e8a280cb3aa738f57: : Instructing follower 8846d581359a4b7ea6d4c33424ea825d to start an election
I20260709 13:03:11.066411 10066 raft_consensus.cc:1081] T 902451f24024496b83b9a05dfe359a22 P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 LEADER]: Signalling peer 8846d581359a4b7ea6d4c33424ea825d to start an election
I20260709 13:03:11.067759  9250 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "902451f24024496b83b9a05dfe359a22"
dest_uuid: "8846d581359a4b7ea6d4c33424ea825d"
 from {username='slave'} at 127.0.0.1:45092
I20260709 13:03:11.068188  9250 raft_consensus.cc:493] T 902451f24024496b83b9a05dfe359a22 P 8846d581359a4b7ea6d4c33424ea825d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:11.068413  9250 raft_consensus.cc:3060] T 902451f24024496b83b9a05dfe359a22 P 8846d581359a4b7ea6d4c33424ea825d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:11.073009  9250 raft_consensus.cc:515] T 902451f24024496b83b9a05dfe359a22 P 8846d581359a4b7ea6d4c33424ea825d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:03:11.074924  9250 leader_election.cc:290] T 902451f24024496b83b9a05dfe359a22 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 3 election: Requested vote from peers c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455), 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351)
I20260709 13:03:11.075690  9175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902451f24024496b83b9a05dfe359a22" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c694531b0e1d47988b291f1214efc4cb"
I20260709 13:03:11.075954  9319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902451f24024496b83b9a05dfe359a22" candidate_uuid: "8846d581359a4b7ea6d4c33424ea825d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57"
I20260709 13:03:11.076233  9175 raft_consensus.cc:3060] T 902451f24024496b83b9a05dfe359a22 P c694531b0e1d47988b291f1214efc4cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:11.076504  9319 raft_consensus.cc:3055] T 902451f24024496b83b9a05dfe359a22 P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:11.076856  9319 raft_consensus.cc:740] T 902451f24024496b83b9a05dfe359a22 P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 74ac2cf163ee475e8a280cb3aa738f57, State: Running, Role: LEADER
I20260709 13:03:11.077613  9319 consensus_queue.cc:260] T 902451f24024496b83b9a05dfe359a22 P 74ac2cf163ee475e8a280cb3aa738f57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:03:11.078759  9319 raft_consensus.cc:3060] T 902451f24024496b83b9a05dfe359a22 P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:11.082556  9175 raft_consensus.cc:2468] T 902451f24024496b83b9a05dfe359a22 P c694531b0e1d47988b291f1214efc4cb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8846d581359a4b7ea6d4c33424ea825d in term 3.
I20260709 13:03:11.084553  9214 leader_election.cc:304] T 902451f24024496b83b9a05dfe359a22 P 8846d581359a4b7ea6d4c33424ea825d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8846d581359a4b7ea6d4c33424ea825d, c694531b0e1d47988b291f1214efc4cb; no voters: 
I20260709 13:03:11.085806 10152 raft_consensus.cc:2804] T 902451f24024496b83b9a05dfe359a22 P 8846d581359a4b7ea6d4c33424ea825d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:11.086160  9319 raft_consensus.cc:2468] T 902451f24024496b83b9a05dfe359a22 P 74ac2cf163ee475e8a280cb3aa738f57 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8846d581359a4b7ea6d4c33424ea825d in term 3.
I20260709 13:03:11.086496 10152 raft_consensus.cc:697] T 902451f24024496b83b9a05dfe359a22 P 8846d581359a4b7ea6d4c33424ea825d [term 3 LEADER]: Becoming Leader. State: Replica: 8846d581359a4b7ea6d4c33424ea825d, State: Running, Role: LEADER
I20260709 13:03:11.089360 10152 consensus_queue.cc:237] T 902451f24024496b83b9a05dfe359a22 P 8846d581359a4b7ea6d4c33424ea825d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:03:11.104151  8996 catalog_manager.cc:5697] T 902451f24024496b83b9a05dfe359a22 P 8846d581359a4b7ea6d4c33424ea825d reported cstate change: term changed from 2 to 3, leader changed from 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196) to 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195). New cstate: current_term: 3 leader_uuid: "8846d581359a4b7ea6d4c33424ea825d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:11.522962  9175 raft_consensus.cc:1275] T 902451f24024496b83b9a05dfe359a22 P c694531b0e1d47988b291f1214efc4cb [term 3 FOLLOWER]: Refusing update from remote peer 8846d581359a4b7ea6d4c33424ea825d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:11.530817 10186 consensus_queue.cc:1048] T 902451f24024496b83b9a05dfe359a22 P 8846d581359a4b7ea6d4c33424ea825d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:11.562323  9324 raft_consensus.cc:1275] T 902451f24024496b83b9a05dfe359a22 P 74ac2cf163ee475e8a280cb3aa738f57 [term 3 FOLLOWER]: Refusing update from remote peer 8846d581359a4b7ea6d4c33424ea825d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:11.569720 10047 consensus_queue.cc:1048] T 902451f24024496b83b9a05dfe359a22 P 8846d581359a4b7ea6d4c33424ea825d [LEADER]: Connected to new peer: Peer: permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:11.873791   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:11.939169   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:11.976838  9248 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5ce2a33a3b914f6297946ded34c256bf"
dest_uuid: "8846d581359a4b7ea6d4c33424ea825d"
mode: GRACEFUL
new_leader_uuid: "65ed95869fbb4b69b5d6eb99c51adf85"
 from {username='slave'} at 127.0.0.1:55078
I20260709 13:03:11.977435  9248 raft_consensus.cc:606] T 5ce2a33a3b914f6297946ded34c256bf P 8846d581359a4b7ea6d4c33424ea825d [term 3 LEADER]: Received request to transfer leadership to TS 65ed95869fbb4b69b5d6eb99c51adf85
I20260709 13:03:11.978785   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:03:11.979853   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:12.435141 10047 raft_consensus.cc:993] T 5ce2a33a3b914f6297946ded34c256bf P 8846d581359a4b7ea6d4c33424ea825d: : Instructing follower 65ed95869fbb4b69b5d6eb99c51adf85 to start an election
I20260709 13:03:12.435667 10047 raft_consensus.cc:1081] T 5ce2a33a3b914f6297946ded34c256bf P 8846d581359a4b7ea6d4c33424ea825d [term 3 LEADER]: Signalling peer 65ed95869fbb4b69b5d6eb99c51adf85 to start an election
I20260709 13:03:12.437264  9905 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5ce2a33a3b914f6297946ded34c256bf"
dest_uuid: "65ed95869fbb4b69b5d6eb99c51adf85"
 from {username='slave'} at 127.0.0.1:59622
I20260709 13:03:12.437923  9905 raft_consensus.cc:493] T 5ce2a33a3b914f6297946ded34c256bf P 65ed95869fbb4b69b5d6eb99c51adf85 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:12.438287  9905 raft_consensus.cc:3060] T 5ce2a33a3b914f6297946ded34c256bf P 65ed95869fbb4b69b5d6eb99c51adf85 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:12.445051  9905 raft_consensus.cc:515] T 5ce2a33a3b914f6297946ded34c256bf P 65ed95869fbb4b69b5d6eb99c51adf85 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:03:12.446976  9905 leader_election.cc:290] T 5ce2a33a3b914f6297946ded34c256bf P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 4 election: Requested vote from peers 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311), 74ac2cf163ee475e8a280cb3aa738f57 (127.0.107.196:44351)
I20260709 13:03:12.447813  9250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce2a33a3b914f6297946ded34c256bf" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "8846d581359a4b7ea6d4c33424ea825d"
I20260709 13:03:12.448431  9319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce2a33a3b914f6297946ded34c256bf" candidate_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "74ac2cf163ee475e8a280cb3aa738f57"
I20260709 13:03:12.448488  9250 raft_consensus.cc:3055] T 5ce2a33a3b914f6297946ded34c256bf P 8846d581359a4b7ea6d4c33424ea825d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:12.449060  9319 raft_consensus.cc:3060] T 5ce2a33a3b914f6297946ded34c256bf P 74ac2cf163ee475e8a280cb3aa738f57 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:12.449082  9250 raft_consensus.cc:740] T 5ce2a33a3b914f6297946ded34c256bf P 8846d581359a4b7ea6d4c33424ea825d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8846d581359a4b7ea6d4c33424ea825d, State: Running, Role: LEADER
I20260709 13:03:12.450860  9250 consensus_queue.cc:260] T 5ce2a33a3b914f6297946ded34c256bf P 8846d581359a4b7ea6d4c33424ea825d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:03:12.451889  9250 raft_consensus.cc:3060] T 5ce2a33a3b914f6297946ded34c256bf P 8846d581359a4b7ea6d4c33424ea825d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:12.455722  9319 raft_consensus.cc:2468] T 5ce2a33a3b914f6297946ded34c256bf P 74ac2cf163ee475e8a280cb3aa738f57 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65ed95869fbb4b69b5d6eb99c51adf85 in term 4.
I20260709 13:03:12.457099  9852 leader_election.cc:304] T 5ce2a33a3b914f6297946ded34c256bf P 65ed95869fbb4b69b5d6eb99c51adf85 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65ed95869fbb4b69b5d6eb99c51adf85, 74ac2cf163ee475e8a280cb3aa738f57; no voters: 
I20260709 13:03:12.457708  9250 raft_consensus.cc:2468] T 5ce2a33a3b914f6297946ded34c256bf P 8846d581359a4b7ea6d4c33424ea825d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65ed95869fbb4b69b5d6eb99c51adf85 in term 4.
I20260709 13:03:12.458009 10084 raft_consensus.cc:2804] T 5ce2a33a3b914f6297946ded34c256bf P 65ed95869fbb4b69b5d6eb99c51adf85 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:12.458639 10084 raft_consensus.cc:697] T 5ce2a33a3b914f6297946ded34c256bf P 65ed95869fbb4b69b5d6eb99c51adf85 [term 4 LEADER]: Becoming Leader. State: Replica: 65ed95869fbb4b69b5d6eb99c51adf85, State: Running, Role: LEADER
I20260709 13:03:12.459584 10084 consensus_queue.cc:237] T 5ce2a33a3b914f6297946ded34c256bf P 65ed95869fbb4b69b5d6eb99c51adf85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } }
I20260709 13:03:12.470197  8998 catalog_manager.cc:5697] T 5ce2a33a3b914f6297946ded34c256bf P 65ed95869fbb4b69b5d6eb99c51adf85 reported cstate change: term changed from 3 to 4, leader changed from 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195) to 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:12.968899  9324 raft_consensus.cc:1275] T 5ce2a33a3b914f6297946ded34c256bf P 74ac2cf163ee475e8a280cb3aa738f57 [term 4 FOLLOWER]: Refusing update from remote peer 65ed95869fbb4b69b5d6eb99c51adf85: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:03:12.970158 10084 consensus_queue.cc:1048] T 5ce2a33a3b914f6297946ded34c256bf P 65ed95869fbb4b69b5d6eb99c51adf85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:12.981381  9248 raft_consensus.cc:1275] T 5ce2a33a3b914f6297946ded34c256bf P 8846d581359a4b7ea6d4c33424ea825d [term 4 FOLLOWER]: Refusing update from remote peer 65ed95869fbb4b69b5d6eb99c51adf85: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:03:12.982782 10192 consensus_queue.cc:1048] T 5ce2a33a3b914f6297946ded34c256bf P 65ed95869fbb4b69b5d6eb99c51adf85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:12.984375   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:13.065043   431 tablet_server.cc:179] TabletServer@127.0.107.193:33979 shutting down...
W20260709 13:03:13.084426  9215 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 163 similar messages]
W20260709 13:03:13.090422  9215 consensus_peers.cc:597] T 604bd81da85244b6bd6d8bd6ac674f2c P 8846d581359a4b7ea6d4c33424ea825d -> Peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Couldn't send request to peer 65ed95869fbb4b69b5d6eb99c51adf85. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:13.107956   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:13.108982   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:13.109862   431 raft_consensus.cc:2243] T 4d2b02247c21448ea824065ad29304e7 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.110481   431 raft_consensus.cc:2272] T 4d2b02247c21448ea824065ad29304e7 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.114432   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:13.115388   431 raft_consensus.cc:2243] T d3044a44ee984c489779dc339d162407 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.116056   431 raft_consensus.cc:2272] T d3044a44ee984c489779dc339d162407 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.119778   431 tablet_replica.cc:333] stopping tablet replica
W20260709 13:03:13.120218  9141 consensus_peers.cc:597] T a1ab6d75958044aeac9e1d43da9dc4b9 P c694531b0e1d47988b291f1214efc4cb -> Peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Couldn't send request to peer 65ed95869fbb4b69b5d6eb99c51adf85. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:13.120806   431 raft_consensus.cc:2243] T 51a2ca964a8f4fb89b26d77b1b334f30 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.121455   431 raft_consensus.cc:2272] T 51a2ca964a8f4fb89b26d77b1b334f30 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:13.123703  9141 consensus_peers.cc:597] T 3899ef948b2e405baaccb81544b7f58b P c694531b0e1d47988b291f1214efc4cb -> Peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Couldn't send request to peer 65ed95869fbb4b69b5d6eb99c51adf85. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:13.124526   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:13.125257   431 raft_consensus.cc:2243] T bfb390576f2e4f508caa2d234ed5d425 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.125702   431 raft_consensus.cc:2272] T bfb390576f2e4f508caa2d234ed5d425 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.128127   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:13.128993   431 raft_consensus.cc:2243] T 5cea8a8078e8456186d4d1a184d3f157 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.129526   431 raft_consensus.cc:2272] T 5cea8a8078e8456186d4d1a184d3f157 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.132437   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:13.133245   431 raft_consensus.cc:2243] T df7e9031dde347b5b9da753cc817ce17 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:13.134431   431 raft_consensus.cc:2272] T df7e9031dde347b5b9da753cc817ce17 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.138001   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:13.139067   431 raft_consensus.cc:2243] T 070a6f2020a1483381e2baa75e5c0cbf P 65ed95869fbb4b69b5d6eb99c51adf85 [term 3 LEADER]: Raft consensus shutting down.
W20260709 13:03:13.140033  9141 consensus_peers.cc:597] T c7c964979a0443f68e90c8678d083c96 P c694531b0e1d47988b291f1214efc4cb -> Peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Couldn't send request to peer 65ed95869fbb4b69b5d6eb99c51adf85. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:13.140404   431 raft_consensus.cc:2272] T 070a6f2020a1483381e2baa75e5c0cbf P 65ed95869fbb4b69b5d6eb99c51adf85 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.143580   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:13.144196   431 raft_consensus.cc:2243] T 6007c141b1134cb18ab1200556127236 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.144646   431 raft_consensus.cc:2272] T 6007c141b1134cb18ab1200556127236 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.147678   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:13.148406   431 raft_consensus.cc:2243] T c7c964979a0443f68e90c8678d083c96 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.148856   431 raft_consensus.cc:2272] T c7c964979a0443f68e90c8678d083c96 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.151729   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:13.152701   431 raft_consensus.cc:2243] T e2fbc9c2c0a947f1b4a078db7c8402d0 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.153419   431 raft_consensus.cc:2272] T e2fbc9c2c0a947f1b4a078db7c8402d0 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:13.155539  9289 consensus_peers.cc:597] T d3044a44ee984c489779dc339d162407 P 74ac2cf163ee475e8a280cb3aa738f57 -> Peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Couldn't send request to peer 65ed95869fbb4b69b5d6eb99c51adf85. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:13.156780   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:13.157701   431 raft_consensus.cc:2243] T d2ef0242573643178d56d10a6c26ae8e P 65ed95869fbb4b69b5d6eb99c51adf85 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.158311   431 raft_consensus.cc:2272] T d2ef0242573643178d56d10a6c26ae8e P 65ed95869fbb4b69b5d6eb99c51adf85 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.160864   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:13.161525   431 raft_consensus.cc:2243] T 9d21e8696b0340bea31002b775af50ee P 65ed95869fbb4b69b5d6eb99c51adf85 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:03:13.162420   431 raft_consensus.cc:2272] T 9d21e8696b0340bea31002b775af50ee P 65ed95869fbb4b69b5d6eb99c51adf85 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.165300   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:13.166189   431 raft_consensus.cc:2243] T eab411e3927a434ab647aa9b31fcf60d P 65ed95869fbb4b69b5d6eb99c51adf85 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:13.167063   431 raft_consensus.cc:2272] T eab411e3927a434ab647aa9b31fcf60d P 65ed95869fbb4b69b5d6eb99c51adf85 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.170490   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:13.171358   431 raft_consensus.cc:2243] T e6797c587fdc4754b091a2be102e5927 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:03:13.171375  9215 consensus_peers.cc:597] T 5b6b34440fd14f3ea66bd5de7a2a8260 P 8846d581359a4b7ea6d4c33424ea825d -> Peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Couldn't send request to peer 65ed95869fbb4b69b5d6eb99c51adf85. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:13.171960   431 raft_consensus.cc:2272] T e6797c587fdc4754b091a2be102e5927 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.174860   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:13.175725   431 raft_consensus.cc:2243] T 76b3d3cd810b46dbac2b534c0be568d2 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:03:13.176453  9141 consensus_peers.cc:597] T 8bfbc32cc1ba4ecc8fddc7e7f4711778 P c694531b0e1d47988b291f1214efc4cb -> Peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Couldn't send request to peer 65ed95869fbb4b69b5d6eb99c51adf85. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:13.176465   431 raft_consensus.cc:2272] T 76b3d3cd810b46dbac2b534c0be568d2 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.180351   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:13.181165   431 raft_consensus.cc:2243] T a731a965126b406988eecb7829bc9981 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:13.182103   431 raft_consensus.cc:2272] T a731a965126b406988eecb7829bc9981 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.185427   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:13.186087   431 raft_consensus.cc:2243] T d26bd321e5604f8aa61723f418be35a9 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:13.187120   431 raft_consensus.cc:2272] T d26bd321e5604f8aa61723f418be35a9 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.189847   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:13.190445   431 raft_consensus.cc:2243] T 0effc3d52a6d43ef8aa59821958f4e52 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:13.191293   431 raft_consensus.cc:2272] T 0effc3d52a6d43ef8aa59821958f4e52 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.193997   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:13.194886   431 raft_consensus.cc:2243] T 534ae119bf014235a99dfbbfcff690e1 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.195432   431 raft_consensus.cc:2272] T 534ae119bf014235a99dfbbfcff690e1 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.198503   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:13.199165   431 raft_consensus.cc:2243] T 8f67cb568c0745e792c17959b07c5da1 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:13.200174   431 raft_consensus.cc:2272] T 8f67cb568c0745e792c17959b07c5da1 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.202793   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:13.203596   431 raft_consensus.cc:2243] T b3f19df7d93748a1802678c56b5e2208 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.204262   431 raft_consensus.cc:2272] T b3f19df7d93748a1802678c56b5e2208 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.206954   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:13.207551   431 raft_consensus.cc:2243] T 48e91509dfc74d53a930cdc636976db6 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.208019   431 raft_consensus.cc:2272] T 48e91509dfc74d53a930cdc636976db6 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.210148   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:13.210690   431 raft_consensus.cc:2243] T 93ba4182a04b450ca3fc7a15896f889e P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.211086   431 raft_consensus.cc:2272] T 93ba4182a04b450ca3fc7a15896f889e P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.213064   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:13.213610   431 raft_consensus.cc:2243] T 604bd81da85244b6bd6d8bd6ac674f2c P 65ed95869fbb4b69b5d6eb99c51adf85 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.214044   431 raft_consensus.cc:2272] T 604bd81da85244b6bd6d8bd6ac674f2c P 65ed95869fbb4b69b5d6eb99c51adf85 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.216630   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:13.217247   431 raft_consensus.cc:2243] T 389a20133d8b4ebfaab346741dff367f P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.217665   431 raft_consensus.cc:2272] T 389a20133d8b4ebfaab346741dff367f P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:13.218041  9289 consensus_peers.cc:597] T dbdc8579cca94ef7ab4babd287837e8c P 74ac2cf163ee475e8a280cb3aa738f57 -> Peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Couldn't send request to peer 65ed95869fbb4b69b5d6eb99c51adf85. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:13.220008   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:13.220695   431 raft_consensus.cc:2243] T ea3bb46b177b4bbdaa60f464370aa9a0 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:13.221647   431 raft_consensus.cc:2272] T ea3bb46b177b4bbdaa60f464370aa9a0 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.225033   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:13.225818   431 raft_consensus.cc:2243] T 0a377c4fc6c04b0aa8f74f64f4f59409 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.226374   431 raft_consensus.cc:2272] T 0a377c4fc6c04b0aa8f74f64f4f59409 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.229720   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:13.230562   431 raft_consensus.cc:2243] T f2229e498f7f472f97c088fddb802939 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:13.231599   431 raft_consensus.cc:2272] T f2229e498f7f472f97c088fddb802939 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.234550   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:13.235414   431 raft_consensus.cc:2243] T 8bfbc32cc1ba4ecc8fddc7e7f4711778 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.235905   431 raft_consensus.cc:2272] T 8bfbc32cc1ba4ecc8fddc7e7f4711778 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:13.236881  9215 consensus_peers.cc:597] T 059a6a9a07d74be4a9f3854317b870ab P 8846d581359a4b7ea6d4c33424ea825d -> Peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Couldn't send request to peer 65ed95869fbb4b69b5d6eb99c51adf85. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:13.238250   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:13.238961   431 raft_consensus.cc:2243] T 7f278d22c55747ee8ee613bfa5c59391 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.239436   431 raft_consensus.cc:2272] T 7f278d22c55747ee8ee613bfa5c59391 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.241575   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:13.242154   431 raft_consensus.cc:2243] T eb666e221e5f4e4fbaba194838a28448 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:13.242995   431 raft_consensus.cc:2272] T eb666e221e5f4e4fbaba194838a28448 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.245216   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:13.245759   431 raft_consensus.cc:2243] T d75fae153be542ccbf70c92676ffd30d P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.246160   431 raft_consensus.cc:2272] T d75fae153be542ccbf70c92676ffd30d P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.248751   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:13.249464   431 raft_consensus.cc:2243] T 059a6a9a07d74be4a9f3854317b870ab P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.249986   431 raft_consensus.cc:2272] T 059a6a9a07d74be4a9f3854317b870ab P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:13.252164  9141 consensus_peers.cc:597] T bfb390576f2e4f508caa2d234ed5d425 P c694531b0e1d47988b291f1214efc4cb -> Peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Couldn't send request to peer 65ed95869fbb4b69b5d6eb99c51adf85. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:13.253098   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:13.254004   431 raft_consensus.cc:2243] T ac928b0582c745b4804afcd30e861439 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:03:13.254765  9215 consensus_peers.cc:597] T a971867a8d494757a297936fad4bd464 P 8846d581359a4b7ea6d4c33424ea825d -> Peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Couldn't send request to peer 65ed95869fbb4b69b5d6eb99c51adf85. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:13.255208   431 raft_consensus.cc:2272] T ac928b0582c745b4804afcd30e861439 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.258752   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:13.259518   431 raft_consensus.cc:2243] T 18df0aeb35ec4bb095806227d9bb97a8 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:13.260522   431 raft_consensus.cc:2272] T 18df0aeb35ec4bb095806227d9bb97a8 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:13.261565  9215 consensus_peers.cc:597] T e6797c587fdc4754b091a2be102e5927 P 8846d581359a4b7ea6d4c33424ea825d -> Peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Couldn't send request to peer 65ed95869fbb4b69b5d6eb99c51adf85. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:13.263168   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:13.263808   431 raft_consensus.cc:2243] T 5ce2a33a3b914f6297946ded34c256bf P 65ed95869fbb4b69b5d6eb99c51adf85 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:03:13.264786   431 raft_consensus.cc:2272] T 5ce2a33a3b914f6297946ded34c256bf P 65ed95869fbb4b69b5d6eb99c51adf85 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:13.267099  9215 consensus_peers.cc:597] T 534ae119bf014235a99dfbbfcff690e1 P 8846d581359a4b7ea6d4c33424ea825d -> Peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Couldn't send request to peer 65ed95869fbb4b69b5d6eb99c51adf85. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:13.268214   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:13.269060   431 raft_consensus.cc:2243] T a1ab6d75958044aeac9e1d43da9dc4b9 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.269544   431 raft_consensus.cc:2272] T a1ab6d75958044aeac9e1d43da9dc4b9 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.272586   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:13.273309   431 raft_consensus.cc:2243] T 9dea45dda5454393bdfaed3f233a30a5 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.273890   431 raft_consensus.cc:2272] T 9dea45dda5454393bdfaed3f233a30a5 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.276973   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:13.277742   431 raft_consensus.cc:2243] T 5b6b34440fd14f3ea66bd5de7a2a8260 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.278329   431 raft_consensus.cc:2272] T 5b6b34440fd14f3ea66bd5de7a2a8260 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.281365   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:13.282236   431 raft_consensus.cc:2243] T c12e80bb348c4ba385ee6ebc8e55d71b P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.282796   431 raft_consensus.cc:2272] T c12e80bb348c4ba385ee6ebc8e55d71b P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.285358   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:13.285948   431 raft_consensus.cc:2243] T 3899ef948b2e405baaccb81544b7f58b P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.286384   431 raft_consensus.cc:2272] T 3899ef948b2e405baaccb81544b7f58b P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.288815   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:13.289356   431 raft_consensus.cc:2243] T dbdc8579cca94ef7ab4babd287837e8c P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.289804   431 raft_consensus.cc:2272] T dbdc8579cca94ef7ab4babd287837e8c P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.291949   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:13.292479   431 raft_consensus.cc:2243] T a971867a8d494757a297936fad4bd464 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.292886   431 raft_consensus.cc:2272] T a971867a8d494757a297936fad4bd464 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.294994   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:13.295501   431 raft_consensus.cc:2243] T e6ee00de30e149f58789799810d595a4 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.295912   431 raft_consensus.cc:2272] T e6ee00de30e149f58789799810d595a4 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.298007   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:13.298513   431 raft_consensus.cc:2243] T 6f8b7d72409f45eebf4208f98310f378 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.298933   431 raft_consensus.cc:2272] T 6f8b7d72409f45eebf4208f98310f378 P 65ed95869fbb4b69b5d6eb99c51adf85 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:13.310052  9289 consensus_peers.cc:597] T d2ef0242573643178d56d10a6c26ae8e P 74ac2cf163ee475e8a280cb3aa738f57 -> Peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Couldn't send request to peer 65ed95869fbb4b69b5d6eb99c51adf85. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:13.334089  9215 consensus_peers.cc:597] T 76b3d3cd810b46dbac2b534c0be568d2 P 8846d581359a4b7ea6d4c33424ea825d -> Peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Couldn't send request to peer 65ed95869fbb4b69b5d6eb99c51adf85. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:13.336934  9289 consensus_peers.cc:597] T d75fae153be542ccbf70c92676ffd30d P 74ac2cf163ee475e8a280cb3aa738f57 -> Peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Couldn't send request to peer 65ed95869fbb4b69b5d6eb99c51adf85. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:13.346825  9289 consensus_peers.cc:597] T 51a2ca964a8f4fb89b26d77b1b334f30 P 74ac2cf163ee475e8a280cb3aa738f57 -> Peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Couldn't send request to peer 65ed95869fbb4b69b5d6eb99c51adf85. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:13.368849  9141 consensus_peers.cc:597] T 389a20133d8b4ebfaab346741dff367f P c694531b0e1d47988b291f1214efc4cb -> Peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Couldn't send request to peer 65ed95869fbb4b69b5d6eb99c51adf85. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33979: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:13.378494   431 tablet_server.cc:196] TabletServer@127.0.107.193:33979 shutdown complete.
W20260709 13:03:13.381115  9215 consensus_peers.cc:597] T e6ee00de30e149f58789799810d595a4 P 8846d581359a4b7ea6d4c33424ea825d -> Peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Couldn't send request to peer 65ed95869fbb4b69b5d6eb99c51adf85. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33979: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:13.390440  9215 consensus_peers.cc:597] T 9dea45dda5454393bdfaed3f233a30a5 P 8846d581359a4b7ea6d4c33424ea825d -> Peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Couldn't send request to peer 65ed95869fbb4b69b5d6eb99c51adf85. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33979: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:13.416055  9289 consensus_peers.cc:597] T 4d2b02247c21448ea824065ad29304e7 P 74ac2cf163ee475e8a280cb3aa738f57 -> Peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Couldn't send request to peer 65ed95869fbb4b69b5d6eb99c51adf85. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33979: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:13.432773  9141 consensus_peers.cc:597] T 7f278d22c55747ee8ee613bfa5c59391 P c694531b0e1d47988b291f1214efc4cb -> Peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Couldn't send request to peer 65ed95869fbb4b69b5d6eb99c51adf85. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33979: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:13.451790  9215 consensus_peers.cc:597] T 6f8b7d72409f45eebf4208f98310f378 P 8846d581359a4b7ea6d4c33424ea825d -> Peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Couldn't send request to peer 65ed95869fbb4b69b5d6eb99c51adf85. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33979: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:13.462944  9141 consensus_peers.cc:597] T 5cea8a8078e8456186d4d1a184d3f157 P c694531b0e1d47988b291f1214efc4cb -> Peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Couldn't send request to peer 65ed95869fbb4b69b5d6eb99c51adf85. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33979: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:13.469604  9215 consensus_peers.cc:597] T 48e91509dfc74d53a930cdc636976db6 P 8846d581359a4b7ea6d4c33424ea825d -> Peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Couldn't send request to peer 65ed95869fbb4b69b5d6eb99c51adf85. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33979: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:13.470045   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
W20260709 13:03:13.479250  9214 consensus_peers.cc:597] T 9dea45dda5454393bdfaed3f233a30a5 P 8846d581359a4b7ea6d4c33424ea825d -> Peer c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455): Couldn't send request to peer c694531b0e1d47988b291f1214efc4cb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:13.487632  9141 consensus_peers.cc:597] T c12e80bb348c4ba385ee6ebc8e55d71b P c694531b0e1d47988b291f1214efc4cb -> Peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Couldn't send request to peer 65ed95869fbb4b69b5d6eb99c51adf85. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33979: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:13.487293  9215 consensus_peers.cc:597] T 93ba4182a04b450ca3fc7a15896f889e P 8846d581359a4b7ea6d4c33424ea825d -> Peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Couldn't send request to peer 65ed95869fbb4b69b5d6eb99c51adf85. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33979: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:13.509706   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:13.510695   431 tablet_replica.cc:333] T 18df0aeb35ec4bb095806227d9bb97a8 P c694531b0e1d47988b291f1214efc4cb: stopping tablet replica
I20260709 13:03:13.511612   431 raft_consensus.cc:2243] T 18df0aeb35ec4bb095806227d9bb97a8 P c694531b0e1d47988b291f1214efc4cb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.512109   431 raft_consensus.cc:2272] T 18df0aeb35ec4bb095806227d9bb97a8 P c694531b0e1d47988b291f1214efc4cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.514776   431 tablet_replica.cc:333] T 02048c7b44ac4e8a984dfa44a3b3b3e5 P c694531b0e1d47988b291f1214efc4cb: stopping tablet replica
I20260709 13:03:13.515657   431 raft_consensus.cc:2243] T 02048c7b44ac4e8a984dfa44a3b3b3e5 P c694531b0e1d47988b291f1214efc4cb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.516251   431 raft_consensus.cc:2272] T 02048c7b44ac4e8a984dfa44a3b3b3e5 P c694531b0e1d47988b291f1214efc4cb [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:13.516602  9214 consensus_peers.cc:597] T 5b6b34440fd14f3ea66bd5de7a2a8260 P 8846d581359a4b7ea6d4c33424ea825d -> Peer c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455): Couldn't send request to peer c694531b0e1d47988b291f1214efc4cb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:13.519435   431 tablet_replica.cc:333] T 7f278d22c55747ee8ee613bfa5c59391 P c694531b0e1d47988b291f1214efc4cb: stopping tablet replica
I20260709 13:03:13.520370   431 raft_consensus.cc:2243] T 7f278d22c55747ee8ee613bfa5c59391 P c694531b0e1d47988b291f1214efc4cb [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:03:13.521653   431 raft_consensus.cc:2272] T 7f278d22c55747ee8ee613bfa5c59391 P c694531b0e1d47988b291f1214efc4cb [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:13.523371  9288 consensus_peers.cc:597] T d755a5211e5c4133bead5603a424005e P 74ac2cf163ee475e8a280cb3aa738f57 -> Peer c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455): Couldn't send request to peer c694531b0e1d47988b291f1214efc4cb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:13.524914   431 tablet_replica.cc:333] T 070a6f2020a1483381e2baa75e5c0cbf P c694531b0e1d47988b291f1214efc4cb: stopping tablet replica
I20260709 13:03:13.525799   431 raft_consensus.cc:2243] T 070a6f2020a1483381e2baa75e5c0cbf P c694531b0e1d47988b291f1214efc4cb [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.526403   431 raft_consensus.cc:2272] T 070a6f2020a1483381e2baa75e5c0cbf P c694531b0e1d47988b291f1214efc4cb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.528692   431 tablet_replica.cc:333] T 6007c141b1134cb18ab1200556127236 P c694531b0e1d47988b291f1214efc4cb: stopping tablet replica
I20260709 13:03:13.529277   431 raft_consensus.cc:2243] T 6007c141b1134cb18ab1200556127236 P c694531b0e1d47988b291f1214efc4cb [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:13.530068   431 raft_consensus.cc:2272] T 6007c141b1134cb18ab1200556127236 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.532503   431 tablet_replica.cc:333] T d755a5211e5c4133bead5603a424005e P c694531b0e1d47988b291f1214efc4cb: stopping tablet replica
I20260709 13:03:13.533110   431 raft_consensus.cc:2243] T d755a5211e5c4133bead5603a424005e P c694531b0e1d47988b291f1214efc4cb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.533632   431 raft_consensus.cc:2272] T d755a5211e5c4133bead5603a424005e P c694531b0e1d47988b291f1214efc4cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.536221   431 tablet_replica.cc:333] T bfb390576f2e4f508caa2d234ed5d425 P c694531b0e1d47988b291f1214efc4cb: stopping tablet replica
I20260709 13:03:13.536870   431 raft_consensus.cc:2243] T bfb390576f2e4f508caa2d234ed5d425 P c694531b0e1d47988b291f1214efc4cb [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:13.537694   431 raft_consensus.cc:2272] T bfb390576f2e4f508caa2d234ed5d425 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.540585   431 tablet_replica.cc:333] T 604bd81da85244b6bd6d8bd6ac674f2c P c694531b0e1d47988b291f1214efc4cb: stopping tablet replica
I20260709 13:03:13.541401   431 raft_consensus.cc:2243] T 604bd81da85244b6bd6d8bd6ac674f2c P c694531b0e1d47988b291f1214efc4cb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.542027   431 raft_consensus.cc:2272] T 604bd81da85244b6bd6d8bd6ac674f2c P c694531b0e1d47988b291f1214efc4cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.544917   431 tablet_replica.cc:333] T 8f67cb568c0745e792c17959b07c5da1 P c694531b0e1d47988b291f1214efc4cb: stopping tablet replica
I20260709 13:03:13.545662   431 raft_consensus.cc:2243] T 8f67cb568c0745e792c17959b07c5da1 P c694531b0e1d47988b291f1214efc4cb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.546255   431 raft_consensus.cc:2272] T 8f67cb568c0745e792c17959b07c5da1 P c694531b0e1d47988b291f1214efc4cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.549209   431 tablet_replica.cc:333] T 50f8080d64c04e738a6a36d748c8ee1e P c694531b0e1d47988b291f1214efc4cb: stopping tablet replica
I20260709 13:03:13.550011   431 raft_consensus.cc:2243] T 50f8080d64c04e738a6a36d748c8ee1e P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.550607   431 raft_consensus.cc:2272] T 50f8080d64c04e738a6a36d748c8ee1e P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.553689   431 tablet_replica.cc:333] T 9dea45dda5454393bdfaed3f233a30a5 P c694531b0e1d47988b291f1214efc4cb: stopping tablet replica
I20260709 13:03:13.554512   431 raft_consensus.cc:2243] T 9dea45dda5454393bdfaed3f233a30a5 P c694531b0e1d47988b291f1214efc4cb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.555025   431 raft_consensus.cc:2272] T 9dea45dda5454393bdfaed3f233a30a5 P c694531b0e1d47988b291f1214efc4cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.557379   431 tablet_replica.cc:333] T a1ab6d75958044aeac9e1d43da9dc4b9 P c694531b0e1d47988b291f1214efc4cb: stopping tablet replica
I20260709 13:03:13.558099   431 raft_consensus.cc:2243] T a1ab6d75958044aeac9e1d43da9dc4b9 P c694531b0e1d47988b291f1214efc4cb [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:13.559044   431 raft_consensus.cc:2272] T a1ab6d75958044aeac9e1d43da9dc4b9 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.561308   431 tablet_replica.cc:333] T a581cc3c19254d4ca39e1f7328268a93 P c694531b0e1d47988b291f1214efc4cb: stopping tablet replica
I20260709 13:03:13.561870   431 raft_consensus.cc:2243] T a581cc3c19254d4ca39e1f7328268a93 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.562330   431 raft_consensus.cc:2272] T a581cc3c19254d4ca39e1f7328268a93 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.564271   431 tablet_replica.cc:333] T cb7f6aeb8116423481ea2b2dca5a06d4 P c694531b0e1d47988b291f1214efc4cb: stopping tablet replica
I20260709 13:03:13.564814   431 raft_consensus.cc:2243] T cb7f6aeb8116423481ea2b2dca5a06d4 P c694531b0e1d47988b291f1214efc4cb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.565261   431 raft_consensus.cc:2272] T cb7f6aeb8116423481ea2b2dca5a06d4 P c694531b0e1d47988b291f1214efc4cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.567289   431 tablet_replica.cc:333] T f2229e498f7f472f97c088fddb802939 P c694531b0e1d47988b291f1214efc4cb: stopping tablet replica
I20260709 13:03:13.567860   431 raft_consensus.cc:2243] T f2229e498f7f472f97c088fddb802939 P c694531b0e1d47988b291f1214efc4cb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.568282   431 raft_consensus.cc:2272] T f2229e498f7f472f97c088fddb802939 P c694531b0e1d47988b291f1214efc4cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.570747   431 tablet_replica.cc:333] T 989e9796152e4796a3408e00419403fa P c694531b0e1d47988b291f1214efc4cb: stopping tablet replica
I20260709 13:03:13.571365   431 raft_consensus.cc:2243] T 989e9796152e4796a3408e00419403fa P c694531b0e1d47988b291f1214efc4cb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.571817   431 raft_consensus.cc:2272] T 989e9796152e4796a3408e00419403fa P c694531b0e1d47988b291f1214efc4cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.573700   431 tablet_replica.cc:333] T dbdc8579cca94ef7ab4babd287837e8c P c694531b0e1d47988b291f1214efc4cb: stopping tablet replica
I20260709 13:03:13.574250   431 raft_consensus.cc:2243] T dbdc8579cca94ef7ab4babd287837e8c P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.574714   431 raft_consensus.cc:2272] T dbdc8579cca94ef7ab4babd287837e8c P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.577373   431 tablet_replica.cc:333] T d26bd321e5604f8aa61723f418be35a9 P c694531b0e1d47988b291f1214efc4cb: stopping tablet replica
I20260709 13:03:13.578027   431 raft_consensus.cc:2243] T d26bd321e5604f8aa61723f418be35a9 P c694531b0e1d47988b291f1214efc4cb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.578560   431 raft_consensus.cc:2272] T d26bd321e5604f8aa61723f418be35a9 P c694531b0e1d47988b291f1214efc4cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.581257   431 tablet_replica.cc:333] T 0effc3d52a6d43ef8aa59821958f4e52 P c694531b0e1d47988b291f1214efc4cb: stopping tablet replica
I20260709 13:03:13.581876   431 raft_consensus.cc:2243] T 0effc3d52a6d43ef8aa59821958f4e52 P c694531b0e1d47988b291f1214efc4cb [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:03:13.582156  9288 consensus_peers.cc:597] T 02048c7b44ac4e8a984dfa44a3b3b3e5 P 74ac2cf163ee475e8a280cb3aa738f57 -> Peer c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455): Couldn't send request to peer c694531b0e1d47988b291f1214efc4cb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:13.582549   431 raft_consensus.cc:2272] T 0effc3d52a6d43ef8aa59821958f4e52 P c694531b0e1d47988b291f1214efc4cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.585080   431 tablet_replica.cc:333] T 3899ef948b2e405baaccb81544b7f58b P c694531b0e1d47988b291f1214efc4cb: stopping tablet replica
I20260709 13:03:13.585711   431 raft_consensus.cc:2243] T 3899ef948b2e405baaccb81544b7f58b P c694531b0e1d47988b291f1214efc4cb [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:13.586522   431 raft_consensus.cc:2272] T 3899ef948b2e405baaccb81544b7f58b P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:13.586838  9141 consensus_peers.cc:597] T e2fbc9c2c0a947f1b4a078db7c8402d0 P c694531b0e1d47988b291f1214efc4cb -> Peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Couldn't send request to peer 65ed95869fbb4b69b5d6eb99c51adf85. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33979: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:13.589000   431 tablet_replica.cc:333] T 6cb786213d5d48779533059bc333ac6f P c694531b0e1d47988b291f1214efc4cb: stopping tablet replica
W20260709 13:03:13.589469  9288 consensus_peers.cc:597] T d2ef0242573643178d56d10a6c26ae8e P 74ac2cf163ee475e8a280cb3aa738f57 -> Peer c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455): Couldn't send request to peer c694531b0e1d47988b291f1214efc4cb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:13.589859   431 raft_consensus.cc:2243] T 6cb786213d5d48779533059bc333ac6f P c694531b0e1d47988b291f1214efc4cb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.590502   431 raft_consensus.cc:2272] T 6cb786213d5d48779533059bc333ac6f P c694531b0e1d47988b291f1214efc4cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.593138   431 tablet_replica.cc:333] T 53bdda361da242a1b37aa013fad1ee60 P c694531b0e1d47988b291f1214efc4cb: stopping tablet replica
I20260709 13:03:13.593739   431 raft_consensus.cc:2243] T 53bdda361da242a1b37aa013fad1ee60 P c694531b0e1d47988b291f1214efc4cb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.594177   431 raft_consensus.cc:2272] T 53bdda361da242a1b37aa013fad1ee60 P c694531b0e1d47988b291f1214efc4cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.597123   431 tablet_replica.cc:333] T e6ee00de30e149f58789799810d595a4 P c694531b0e1d47988b291f1214efc4cb: stopping tablet replica
I20260709 13:03:13.597927   431 raft_consensus.cc:2243] T e6ee00de30e149f58789799810d595a4 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.598503   431 raft_consensus.cc:2272] T e6ee00de30e149f58789799810d595a4 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.601472   431 tablet_replica.cc:333] T e2fbc9c2c0a947f1b4a078db7c8402d0 P c694531b0e1d47988b291f1214efc4cb: stopping tablet replica
I20260709 13:03:13.602234   431 raft_consensus.cc:2243] T e2fbc9c2c0a947f1b4a078db7c8402d0 P c694531b0e1d47988b291f1214efc4cb [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:13.603129   431 raft_consensus.cc:2272] T e2fbc9c2c0a947f1b4a078db7c8402d0 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.605151   431 tablet_replica.cc:333] T c7c964979a0443f68e90c8678d083c96 P c694531b0e1d47988b291f1214efc4cb: stopping tablet replica
I20260709 13:03:13.605711   431 raft_consensus.cc:2243] T c7c964979a0443f68e90c8678d083c96 P c694531b0e1d47988b291f1214efc4cb [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:13.606521   431 raft_consensus.cc:2272] T c7c964979a0443f68e90c8678d083c96 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.608605   431 tablet_replica.cc:333] T 69a5fd219b1a4d4c94b346f38909f024 P c694531b0e1d47988b291f1214efc4cb: stopping tablet replica
I20260709 13:03:13.609182   431 raft_consensus.cc:2243] T 69a5fd219b1a4d4c94b346f38909f024 P c694531b0e1d47988b291f1214efc4cb [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:13.609969   431 raft_consensus.cc:2272] T 69a5fd219b1a4d4c94b346f38909f024 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.612479   431 tablet_replica.cc:333] T c12e80bb348c4ba385ee6ebc8e55d71b P c694531b0e1d47988b291f1214efc4cb: stopping tablet replica
I20260709 13:03:13.613174   431 raft_consensus.cc:2243] T c12e80bb348c4ba385ee6ebc8e55d71b P c694531b0e1d47988b291f1214efc4cb [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:13.614265   431 raft_consensus.cc:2272] T c12e80bb348c4ba385ee6ebc8e55d71b P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.617300   431 tablet_replica.cc:333] T c500a4c76ad3464aaa2f8985f7d3a53d P c694531b0e1d47988b291f1214efc4cb: stopping tablet replica
W20260709 13:03:13.617379  9215 consensus_peers.cc:597] T b3f19df7d93748a1802678c56b5e2208 P 8846d581359a4b7ea6d4c33424ea825d -> Peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Couldn't send request to peer 65ed95869fbb4b69b5d6eb99c51adf85. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33979: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:13.618232   431 raft_consensus.cc:2243] T c500a4c76ad3464aaa2f8985f7d3a53d P c694531b0e1d47988b291f1214efc4cb [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:13.619383   431 raft_consensus.cc:2272] T c500a4c76ad3464aaa2f8985f7d3a53d P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.622115   431 tablet_replica.cc:333] T 5b6b34440fd14f3ea66bd5de7a2a8260 P c694531b0e1d47988b291f1214efc4cb: stopping tablet replica
I20260709 13:03:13.622936   431 raft_consensus.cc:2243] T 5b6b34440fd14f3ea66bd5de7a2a8260 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.623478   431 raft_consensus.cc:2272] T 5b6b34440fd14f3ea66bd5de7a2a8260 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.625924   431 tablet_replica.cc:333] T d75fae153be542ccbf70c92676ffd30d P c694531b0e1d47988b291f1214efc4cb: stopping tablet replica
I20260709 13:03:13.626405   431 raft_consensus.cc:2243] T d75fae153be542ccbf70c92676ffd30d P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.626834   431 raft_consensus.cc:2272] T d75fae153be542ccbf70c92676ffd30d P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.629427   431 tablet_replica.cc:333] T eb666e221e5f4e4fbaba194838a28448 P c694531b0e1d47988b291f1214efc4cb: stopping tablet replica
I20260709 13:03:13.630082   431 raft_consensus.cc:2243] T eb666e221e5f4e4fbaba194838a28448 P c694531b0e1d47988b291f1214efc4cb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.630712   431 raft_consensus.cc:2272] T eb666e221e5f4e4fbaba194838a28448 P c694531b0e1d47988b291f1214efc4cb [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:13.630831  9288 consensus_peers.cc:597] T cb7f6aeb8116423481ea2b2dca5a06d4 P 74ac2cf163ee475e8a280cb3aa738f57 -> Peer c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455): Couldn't send request to peer c694531b0e1d47988b291f1214efc4cb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:13.633284  9288 consensus_peers.cc:597] T 50f8080d64c04e738a6a36d748c8ee1e P 74ac2cf163ee475e8a280cb3aa738f57 -> Peer c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455): Couldn't send request to peer c694531b0e1d47988b291f1214efc4cb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:13.633504   431 tablet_replica.cc:333] T 059a6a9a07d74be4a9f3854317b870ab P c694531b0e1d47988b291f1214efc4cb: stopping tablet replica
I20260709 13:03:13.634395   431 raft_consensus.cc:2243] T 059a6a9a07d74be4a9f3854317b870ab P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.634951   431 raft_consensus.cc:2272] T 059a6a9a07d74be4a9f3854317b870ab P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:13.637324  9215 consensus_peers.cc:597] T 0a377c4fc6c04b0aa8f74f64f4f59409 P 8846d581359a4b7ea6d4c33424ea825d -> Peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Couldn't send request to peer 65ed95869fbb4b69b5d6eb99c51adf85. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33979: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:13.637616   431 tablet_replica.cc:333] T 3ac2da3cd17d470495fd5fbb986e4936 P c694531b0e1d47988b291f1214efc4cb: stopping tablet replica
I20260709 13:03:13.638361   431 raft_consensus.cc:2243] T 3ac2da3cd17d470495fd5fbb986e4936 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.638782   431 raft_consensus.cc:2272] T 3ac2da3cd17d470495fd5fbb986e4936 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.641276   431 tablet_replica.cc:333] T d2ef0242573643178d56d10a6c26ae8e P c694531b0e1d47988b291f1214efc4cb: stopping tablet replica
I20260709 13:03:13.641860   431 raft_consensus.cc:2243] T d2ef0242573643178d56d10a6c26ae8e P c694531b0e1d47988b291f1214efc4cb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.642396   431 raft_consensus.cc:2272] T d2ef0242573643178d56d10a6c26ae8e P c694531b0e1d47988b291f1214efc4cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.644650   431 tablet_replica.cc:333] T 902451f24024496b83b9a05dfe359a22 P c694531b0e1d47988b291f1214efc4cb: stopping tablet replica
I20260709 13:03:13.645212   431 raft_consensus.cc:2243] T 902451f24024496b83b9a05dfe359a22 P c694531b0e1d47988b291f1214efc4cb [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.645722   431 raft_consensus.cc:2272] T 902451f24024496b83b9a05dfe359a22 P c694531b0e1d47988b291f1214efc4cb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.648856   431 tablet_replica.cc:333] T ea3bb46b177b4bbdaa60f464370aa9a0 P c694531b0e1d47988b291f1214efc4cb: stopping tablet replica
I20260709 13:03:13.649426   431 raft_consensus.cc:2243] T ea3bb46b177b4bbdaa60f464370aa9a0 P c694531b0e1d47988b291f1214efc4cb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.649915   431 raft_consensus.cc:2272] T ea3bb46b177b4bbdaa60f464370aa9a0 P c694531b0e1d47988b291f1214efc4cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.652475   431 tablet_replica.cc:333] T 5f076a85481e43d7a969bf5d8bb589dd P c694531b0e1d47988b291f1214efc4cb: stopping tablet replica
I20260709 13:03:13.653188   431 raft_consensus.cc:2243] T 5f076a85481e43d7a969bf5d8bb589dd P c694531b0e1d47988b291f1214efc4cb [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:13.654245   431 raft_consensus.cc:2272] T 5f076a85481e43d7a969bf5d8bb589dd P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.657076   431 tablet_replica.cc:333] T 6f8b7d72409f45eebf4208f98310f378 P c694531b0e1d47988b291f1214efc4cb: stopping tablet replica
I20260709 13:03:13.657792   431 raft_consensus.cc:2243] T 6f8b7d72409f45eebf4208f98310f378 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.658346   431 raft_consensus.cc:2272] T 6f8b7d72409f45eebf4208f98310f378 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.660979   431 tablet_replica.cc:333] T 389a20133d8b4ebfaab346741dff367f P c694531b0e1d47988b291f1214efc4cb: stopping tablet replica
I20260709 13:03:13.661513   431 raft_consensus.cc:2243] T 389a20133d8b4ebfaab346741dff367f P c694531b0e1d47988b291f1214efc4cb [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:13.662352   431 raft_consensus.cc:2272] T 389a20133d8b4ebfaab346741dff367f P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.665062   431 tablet_replica.cc:333] T 87959c0c174141f0958bbba169370488 P c694531b0e1d47988b291f1214efc4cb: stopping tablet replica
I20260709 13:03:13.665622   431 raft_consensus.cc:2243] T 87959c0c174141f0958bbba169370488 P c694531b0e1d47988b291f1214efc4cb [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:13.666791   431 raft_consensus.cc:2272] T 87959c0c174141f0958bbba169370488 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:13.668111  9214 consensus_peers.cc:597] T e6ee00de30e149f58789799810d595a4 P 8846d581359a4b7ea6d4c33424ea825d -> Peer c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455): Couldn't send request to peer c694531b0e1d47988b291f1214efc4cb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:13.669950   431 tablet_replica.cc:333] T e6797c587fdc4754b091a2be102e5927 P c694531b0e1d47988b291f1214efc4cb: stopping tablet replica
I20260709 13:03:13.670786   431 raft_consensus.cc:2243] T e6797c587fdc4754b091a2be102e5927 P c694531b0e1d47988b291f1214efc4cb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.671381   431 raft_consensus.cc:2272] T e6797c587fdc4754b091a2be102e5927 P c694531b0e1d47988b291f1214efc4cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.674379   431 tablet_replica.cc:333] T 8bfbc32cc1ba4ecc8fddc7e7f4711778 P c694531b0e1d47988b291f1214efc4cb: stopping tablet replica
I20260709 13:03:13.674973   431 raft_consensus.cc:2243] T 8bfbc32cc1ba4ecc8fddc7e7f4711778 P c694531b0e1d47988b291f1214efc4cb [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:13.677574   431 raft_consensus.cc:2272] T 8bfbc32cc1ba4ecc8fddc7e7f4711778 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.680160   431 tablet_replica.cc:333] T df7e9031dde347b5b9da753cc817ce17 P c694531b0e1d47988b291f1214efc4cb: stopping tablet replica
I20260709 13:03:13.680702   431 raft_consensus.cc:2243] T df7e9031dde347b5b9da753cc817ce17 P c694531b0e1d47988b291f1214efc4cb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.681135   431 raft_consensus.cc:2272] T df7e9031dde347b5b9da753cc817ce17 P c694531b0e1d47988b291f1214efc4cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.683226   431 tablet_replica.cc:333] T 5cea8a8078e8456186d4d1a184d3f157 P c694531b0e1d47988b291f1214efc4cb: stopping tablet replica
I20260709 13:03:13.683851   431 raft_consensus.cc:2243] T 5cea8a8078e8456186d4d1a184d3f157 P c694531b0e1d47988b291f1214efc4cb [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:13.684749   431 raft_consensus.cc:2272] T 5cea8a8078e8456186d4d1a184d3f157 P c694531b0e1d47988b291f1214efc4cb [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:13.700799  9288 consensus_peers.cc:597] T dbdc8579cca94ef7ab4babd287837e8c P 74ac2cf163ee475e8a280cb3aa738f57 -> Peer c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455): Couldn't send request to peer c694531b0e1d47988b291f1214efc4cb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:13.707307  9288 consensus_peers.cc:597] T d75fae153be542ccbf70c92676ffd30d P 74ac2cf163ee475e8a280cb3aa738f57 -> Peer c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455): Couldn't send request to peer c694531b0e1d47988b291f1214efc4cb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:13.712498  9288 consensus_peers.cc:597] T a581cc3c19254d4ca39e1f7328268a93 P 74ac2cf163ee475e8a280cb3aa738f57 -> Peer c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455): Couldn't send request to peer c694531b0e1d47988b291f1214efc4cb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:13.737263  9288 consensus_peers.cc:597] T 53bdda361da242a1b37aa013fad1ee60 P 74ac2cf163ee475e8a280cb3aa738f57 -> Peer c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455): Couldn't send request to peer c694531b0e1d47988b291f1214efc4cb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:13.756917  9288 consensus_peers.cc:597] T 989e9796152e4796a3408e00419403fa P 74ac2cf163ee475e8a280cb3aa738f57 -> Peer c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455): Couldn't send request to peer c694531b0e1d47988b291f1214efc4cb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33455: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:13.764611   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
W20260709 13:03:13.778427  9214 consensus_peers.cc:597] T 059a6a9a07d74be4a9f3854317b870ab P 8846d581359a4b7ea6d4c33424ea825d -> Peer c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455): Couldn't send request to peer c694531b0e1d47988b291f1214efc4cb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33455: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:13.793605  9214 consensus_peers.cc:597] T 902451f24024496b83b9a05dfe359a22 P 8846d581359a4b7ea6d4c33424ea825d -> Peer c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455): Couldn't send request to peer c694531b0e1d47988b291f1214efc4cb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33455: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:13.800469  9214 consensus_peers.cc:597] T e6797c587fdc4754b091a2be102e5927 P 8846d581359a4b7ea6d4c33424ea825d -> Peer c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455): Couldn't send request to peer c694531b0e1d47988b291f1214efc4cb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33455: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:13.807255  9214 consensus_peers.cc:597] T 6f8b7d72409f45eebf4208f98310f378 P 8846d581359a4b7ea6d4c33424ea825d -> Peer c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455): Couldn't send request to peer c694531b0e1d47988b291f1214efc4cb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33455: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:13.844863   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
W20260709 13:03:13.890908  9288 consensus_peers.cc:597] T 3ac2da3cd17d470495fd5fbb986e4936 P 74ac2cf163ee475e8a280cb3aa738f57 -> Peer c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455): Couldn't send request to peer c694531b0e1d47988b291f1214efc4cb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33455: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:13.893841  9214 consensus_peers.cc:597] T 604bd81da85244b6bd6d8bd6ac674f2c P 8846d581359a4b7ea6d4c33424ea825d -> Peer c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455): Couldn't send request to peer c694531b0e1d47988b291f1214efc4cb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33455: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:13.895714   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:13.896554   431 tablet_replica.cc:333] T ac928b0582c745b4804afcd30e861439 P 8846d581359a4b7ea6d4c33424ea825d: stopping tablet replica
I20260709 13:03:13.897410   431 raft_consensus.cc:2243] T ac928b0582c745b4804afcd30e861439 P 8846d581359a4b7ea6d4c33424ea825d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.898030   431 raft_consensus.cc:2272] T ac928b0582c745b4804afcd30e861439 P 8846d581359a4b7ea6d4c33424ea825d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.900497   431 tablet_replica.cc:333] T 4d2b02247c21448ea824065ad29304e7 P 8846d581359a4b7ea6d4c33424ea825d: stopping tablet replica
I20260709 13:03:13.901124   431 raft_consensus.cc:2243] T 4d2b02247c21448ea824065ad29304e7 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.901536   431 raft_consensus.cc:2272] T 4d2b02247c21448ea824065ad29304e7 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.903616   431 tablet_replica.cc:333] T 534ae119bf014235a99dfbbfcff690e1 P 8846d581359a4b7ea6d4c33424ea825d: stopping tablet replica
I20260709 13:03:13.904176   431 raft_consensus.cc:2243] T 534ae119bf014235a99dfbbfcff690e1 P 8846d581359a4b7ea6d4c33424ea825d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:13.904944   431 raft_consensus.cc:2272] T 534ae119bf014235a99dfbbfcff690e1 P 8846d581359a4b7ea6d4c33424ea825d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.906955   431 tablet_replica.cc:333] T 070a6f2020a1483381e2baa75e5c0cbf P 8846d581359a4b7ea6d4c33424ea825d: stopping tablet replica
I20260709 13:03:13.907509   431 raft_consensus.cc:2243] T 070a6f2020a1483381e2baa75e5c0cbf P 8846d581359a4b7ea6d4c33424ea825d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.907955   431 raft_consensus.cc:2272] T 070a6f2020a1483381e2baa75e5c0cbf P 8846d581359a4b7ea6d4c33424ea825d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.909797   431 tablet_replica.cc:333] T 6007c141b1134cb18ab1200556127236 P 8846d581359a4b7ea6d4c33424ea825d: stopping tablet replica
I20260709 13:03:13.910363   431 raft_consensus.cc:2243] T 6007c141b1134cb18ab1200556127236 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.910797   431 raft_consensus.cc:2272] T 6007c141b1134cb18ab1200556127236 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.912714   431 tablet_replica.cc:333] T 02048c7b44ac4e8a984dfa44a3b3b3e5 P 8846d581359a4b7ea6d4c33424ea825d: stopping tablet replica
I20260709 13:03:13.913224   431 raft_consensus.cc:2243] T 02048c7b44ac4e8a984dfa44a3b3b3e5 P 8846d581359a4b7ea6d4c33424ea825d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.913632   431 raft_consensus.cc:2272] T 02048c7b44ac4e8a984dfa44a3b3b3e5 P 8846d581359a4b7ea6d4c33424ea825d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.915568   431 tablet_replica.cc:333] T 9d21e8696b0340bea31002b775af50ee P 8846d581359a4b7ea6d4c33424ea825d: stopping tablet replica
I20260709 13:03:13.916095   431 raft_consensus.cc:2243] T 9d21e8696b0340bea31002b775af50ee P 8846d581359a4b7ea6d4c33424ea825d [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.916512   431 raft_consensus.cc:2272] T 9d21e8696b0340bea31002b775af50ee P 8846d581359a4b7ea6d4c33424ea825d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.918277   431 tablet_replica.cc:333] T d755a5211e5c4133bead5603a424005e P 8846d581359a4b7ea6d4c33424ea825d: stopping tablet replica
I20260709 13:03:13.918845   431 raft_consensus.cc:2243] T d755a5211e5c4133bead5603a424005e P 8846d581359a4b7ea6d4c33424ea825d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.919260   431 raft_consensus.cc:2272] T d755a5211e5c4133bead5603a424005e P 8846d581359a4b7ea6d4c33424ea825d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.921656   431 tablet_replica.cc:333] T 9dea45dda5454393bdfaed3f233a30a5 P 8846d581359a4b7ea6d4c33424ea825d: stopping tablet replica
I20260709 13:03:13.922356   431 raft_consensus.cc:2243] T 9dea45dda5454393bdfaed3f233a30a5 P 8846d581359a4b7ea6d4c33424ea825d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:13.923141   431 raft_consensus.cc:2272] T 9dea45dda5454393bdfaed3f233a30a5 P 8846d581359a4b7ea6d4c33424ea825d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.925602   431 tablet_replica.cc:333] T a1ab6d75958044aeac9e1d43da9dc4b9 P 8846d581359a4b7ea6d4c33424ea825d: stopping tablet replica
I20260709 13:03:13.926120   431 raft_consensus.cc:2243] T a1ab6d75958044aeac9e1d43da9dc4b9 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.926499   431 raft_consensus.cc:2272] T a1ab6d75958044aeac9e1d43da9dc4b9 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.928454   431 tablet_replica.cc:333] T 50f8080d64c04e738a6a36d748c8ee1e P 8846d581359a4b7ea6d4c33424ea825d: stopping tablet replica
I20260709 13:03:13.929075   431 raft_consensus.cc:2243] T 50f8080d64c04e738a6a36d748c8ee1e P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.929503   431 raft_consensus.cc:2272] T 50f8080d64c04e738a6a36d748c8ee1e P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.931890   431 tablet_replica.cc:333] T 93ba4182a04b450ca3fc7a15896f889e P 8846d581359a4b7ea6d4c33424ea825d: stopping tablet replica
I20260709 13:03:13.932598   431 raft_consensus.cc:2243] T 93ba4182a04b450ca3fc7a15896f889e P 8846d581359a4b7ea6d4c33424ea825d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:13.933487   431 raft_consensus.cc:2272] T 93ba4182a04b450ca3fc7a15896f889e P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:13.935170  9287 consensus_peers.cc:597] T a581cc3c19254d4ca39e1f7328268a93 P 74ac2cf163ee475e8a280cb3aa738f57 -> Peer 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311): Couldn't send request to peer 8846d581359a4b7ea6d4c33424ea825d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:13.935964   431 tablet_replica.cc:333] T 604bd81da85244b6bd6d8bd6ac674f2c P 8846d581359a4b7ea6d4c33424ea825d: stopping tablet replica
I20260709 13:03:13.936563   431 raft_consensus.cc:2243] T 604bd81da85244b6bd6d8bd6ac674f2c P 8846d581359a4b7ea6d4c33424ea825d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:13.937301   431 raft_consensus.cc:2272] T 604bd81da85244b6bd6d8bd6ac674f2c P 8846d581359a4b7ea6d4c33424ea825d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.939268   431 tablet_replica.cc:333] T 48e91509dfc74d53a930cdc636976db6 P 8846d581359a4b7ea6d4c33424ea825d: stopping tablet replica
I20260709 13:03:13.939811   431 raft_consensus.cc:2243] T 48e91509dfc74d53a930cdc636976db6 P 8846d581359a4b7ea6d4c33424ea825d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:13.940886   431 raft_consensus.cc:2272] T 48e91509dfc74d53a930cdc636976db6 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.942737   431 tablet_replica.cc:333] T a581cc3c19254d4ca39e1f7328268a93 P 8846d581359a4b7ea6d4c33424ea825d: stopping tablet replica
I20260709 13:03:13.943250   431 raft_consensus.cc:2243] T a581cc3c19254d4ca39e1f7328268a93 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.943615   431 raft_consensus.cc:2272] T a581cc3c19254d4ca39e1f7328268a93 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.945659   431 tablet_replica.cc:333] T cb7f6aeb8116423481ea2b2dca5a06d4 P 8846d581359a4b7ea6d4c33424ea825d: stopping tablet replica
I20260709 13:03:13.946210   431 raft_consensus.cc:2243] T cb7f6aeb8116423481ea2b2dca5a06d4 P 8846d581359a4b7ea6d4c33424ea825d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.946605   431 raft_consensus.cc:2272] T cb7f6aeb8116423481ea2b2dca5a06d4 P 8846d581359a4b7ea6d4c33424ea825d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.948491   431 tablet_replica.cc:333] T a971867a8d494757a297936fad4bd464 P 8846d581359a4b7ea6d4c33424ea825d: stopping tablet replica
I20260709 13:03:13.949028   431 raft_consensus.cc:2243] T a971867a8d494757a297936fad4bd464 P 8846d581359a4b7ea6d4c33424ea825d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:13.949724   431 raft_consensus.cc:2272] T a971867a8d494757a297936fad4bd464 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.951634   431 tablet_replica.cc:333] T 989e9796152e4796a3408e00419403fa P 8846d581359a4b7ea6d4c33424ea825d: stopping tablet replica
I20260709 13:03:13.952209   431 raft_consensus.cc:2243] T 989e9796152e4796a3408e00419403fa P 8846d581359a4b7ea6d4c33424ea825d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.952636   431 raft_consensus.cc:2272] T 989e9796152e4796a3408e00419403fa P 8846d581359a4b7ea6d4c33424ea825d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.954684   431 tablet_replica.cc:333] T c12e80bb348c4ba385ee6ebc8e55d71b P 8846d581359a4b7ea6d4c33424ea825d: stopping tablet replica
I20260709 13:03:13.955276   431 raft_consensus.cc:2243] T c12e80bb348c4ba385ee6ebc8e55d71b P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.955718   431 raft_consensus.cc:2272] T c12e80bb348c4ba385ee6ebc8e55d71b P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.957970   431 tablet_replica.cc:333] T c500a4c76ad3464aaa2f8985f7d3a53d P 8846d581359a4b7ea6d4c33424ea825d: stopping tablet replica
I20260709 13:03:13.958563   431 raft_consensus.cc:2243] T c500a4c76ad3464aaa2f8985f7d3a53d P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.959048   431 raft_consensus.cc:2272] T c500a4c76ad3464aaa2f8985f7d3a53d P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:13.960911  9287 consensus_peers.cc:597] T d3044a44ee984c489779dc339d162407 P 74ac2cf163ee475e8a280cb3aa738f57 -> Peer 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311): Couldn't send request to peer 8846d581359a4b7ea6d4c33424ea825d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:13.961534   431 tablet_replica.cc:333] T 5b6b34440fd14f3ea66bd5de7a2a8260 P 8846d581359a4b7ea6d4c33424ea825d: stopping tablet replica
I20260709 13:03:13.962139   431 raft_consensus.cc:2243] T 5b6b34440fd14f3ea66bd5de7a2a8260 P 8846d581359a4b7ea6d4c33424ea825d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:13.962903   431 raft_consensus.cc:2272] T 5b6b34440fd14f3ea66bd5de7a2a8260 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.965175   431 tablet_replica.cc:333] T e6ee00de30e149f58789799810d595a4 P 8846d581359a4b7ea6d4c33424ea825d: stopping tablet replica
I20260709 13:03:13.965884   431 raft_consensus.cc:2243] T e6ee00de30e149f58789799810d595a4 P 8846d581359a4b7ea6d4c33424ea825d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:13.966828   431 raft_consensus.cc:2272] T e6ee00de30e149f58789799810d595a4 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:13.967392  9287 consensus_peers.cc:597] T 50f8080d64c04e738a6a36d748c8ee1e P 74ac2cf163ee475e8a280cb3aa738f57 -> Peer 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311): Couldn't send request to peer 8846d581359a4b7ea6d4c33424ea825d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:13.969054   431 tablet_replica.cc:333] T 6cb786213d5d48779533059bc333ac6f P 8846d581359a4b7ea6d4c33424ea825d: stopping tablet replica
I20260709 13:03:13.969726   431 raft_consensus.cc:2243] T 6cb786213d5d48779533059bc333ac6f P 8846d581359a4b7ea6d4c33424ea825d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.970161   431 raft_consensus.cc:2272] T 6cb786213d5d48779533059bc333ac6f P 8846d581359a4b7ea6d4c33424ea825d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.972224   431 tablet_replica.cc:333] T 53bdda361da242a1b37aa013fad1ee60 P 8846d581359a4b7ea6d4c33424ea825d: stopping tablet replica
I20260709 13:03:13.972761   431 raft_consensus.cc:2243] T 53bdda361da242a1b37aa013fad1ee60 P 8846d581359a4b7ea6d4c33424ea825d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.973160   431 raft_consensus.cc:2272] T 53bdda361da242a1b37aa013fad1ee60 P 8846d581359a4b7ea6d4c33424ea825d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.975232   431 tablet_replica.cc:333] T a731a965126b406988eecb7829bc9981 P 8846d581359a4b7ea6d4c33424ea825d: stopping tablet replica
I20260709 13:03:13.975798   431 raft_consensus.cc:2243] T a731a965126b406988eecb7829bc9981 P 8846d581359a4b7ea6d4c33424ea825d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.976312   431 raft_consensus.cc:2272] T a731a965126b406988eecb7829bc9981 P 8846d581359a4b7ea6d4c33424ea825d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.978534   431 tablet_replica.cc:333] T 0effc3d52a6d43ef8aa59821958f4e52 P 8846d581359a4b7ea6d4c33424ea825d: stopping tablet replica
I20260709 13:03:13.979121   431 raft_consensus.cc:2243] T 0effc3d52a6d43ef8aa59821958f4e52 P 8846d581359a4b7ea6d4c33424ea825d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.979574   431 raft_consensus.cc:2272] T 0effc3d52a6d43ef8aa59821958f4e52 P 8846d581359a4b7ea6d4c33424ea825d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.982477   431 tablet_replica.cc:333] T 5ce2a33a3b914f6297946ded34c256bf P 8846d581359a4b7ea6d4c33424ea825d: stopping tablet replica
I20260709 13:03:13.983273   431 raft_consensus.cc:2243] T 5ce2a33a3b914f6297946ded34c256bf P 8846d581359a4b7ea6d4c33424ea825d [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.983773   431 raft_consensus.cc:2272] T 5ce2a33a3b914f6297946ded34c256bf P 8846d581359a4b7ea6d4c33424ea825d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.987056   431 tablet_replica.cc:333] T c7c964979a0443f68e90c8678d083c96 P 8846d581359a4b7ea6d4c33424ea825d: stopping tablet replica
I20260709 13:03:13.987618   431 raft_consensus.cc:2243] T c7c964979a0443f68e90c8678d083c96 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.988051   431 raft_consensus.cc:2272] T c7c964979a0443f68e90c8678d083c96 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.990231   431 tablet_replica.cc:333] T 69a5fd219b1a4d4c94b346f38909f024 P 8846d581359a4b7ea6d4c33424ea825d: stopping tablet replica
I20260709 13:03:13.990818   431 raft_consensus.cc:2243] T 69a5fd219b1a4d4c94b346f38909f024 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.991250   431 raft_consensus.cc:2272] T 69a5fd219b1a4d4c94b346f38909f024 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.993183   431 tablet_replica.cc:333] T eab411e3927a434ab647aa9b31fcf60d P 8846d581359a4b7ea6d4c33424ea825d: stopping tablet replica
I20260709 13:03:13.993696   431 raft_consensus.cc:2243] T eab411e3927a434ab647aa9b31fcf60d P 8846d581359a4b7ea6d4c33424ea825d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.994112   431 raft_consensus.cc:2272] T eab411e3927a434ab647aa9b31fcf60d P 8846d581359a4b7ea6d4c33424ea825d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.996053   431 tablet_replica.cc:333] T 389a20133d8b4ebfaab346741dff367f P 8846d581359a4b7ea6d4c33424ea825d: stopping tablet replica
I20260709 13:03:13.996624   431 raft_consensus.cc:2243] T 389a20133d8b4ebfaab346741dff367f P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.997040   431 raft_consensus.cc:2272] T 389a20133d8b4ebfaab346741dff367f P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.999405   431 tablet_replica.cc:333] T 76b3d3cd810b46dbac2b534c0be568d2 P 8846d581359a4b7ea6d4c33424ea825d: stopping tablet replica
I20260709 13:03:14.000114   431 raft_consensus.cc:2243] T 76b3d3cd810b46dbac2b534c0be568d2 P 8846d581359a4b7ea6d4c33424ea825d [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:03:14.000164  9287 consensus_peers.cc:597] T 51a2ca964a8f4fb89b26d77b1b334f30 P 74ac2cf163ee475e8a280cb3aa738f57 -> Peer 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311): Couldn't send request to peer 8846d581359a4b7ea6d4c33424ea825d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:14.000943   431 raft_consensus.cc:2272] T 76b3d3cd810b46dbac2b534c0be568d2 P 8846d581359a4b7ea6d4c33424ea825d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:14.003053   431 tablet_replica.cc:333] T 87959c0c174141f0958bbba169370488 P 8846d581359a4b7ea6d4c33424ea825d: stopping tablet replica
I20260709 13:03:14.003597   431 raft_consensus.cc:2243] T 87959c0c174141f0958bbba169370488 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:14.004017   431 raft_consensus.cc:2272] T 87959c0c174141f0958bbba169370488 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:14.006021   431 tablet_replica.cc:333] T e6797c587fdc4754b091a2be102e5927 P 8846d581359a4b7ea6d4c33424ea825d: stopping tablet replica
I20260709 13:03:14.006561   431 raft_consensus.cc:2243] T e6797c587fdc4754b091a2be102e5927 P 8846d581359a4b7ea6d4c33424ea825d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:14.007341   431 raft_consensus.cc:2272] T e6797c587fdc4754b091a2be102e5927 P 8846d581359a4b7ea6d4c33424ea825d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:14.009382   431 tablet_replica.cc:333] T 3ac2da3cd17d470495fd5fbb986e4936 P 8846d581359a4b7ea6d4c33424ea825d: stopping tablet replica
I20260709 13:03:14.009914   431 raft_consensus.cc:2243] T 3ac2da3cd17d470495fd5fbb986e4936 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:14.010377   431 raft_consensus.cc:2272] T 3ac2da3cd17d470495fd5fbb986e4936 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:14.012531   431 tablet_replica.cc:333] T 51a2ca964a8f4fb89b26d77b1b334f30 P 8846d581359a4b7ea6d4c33424ea825d: stopping tablet replica
I20260709 13:03:14.013188   431 raft_consensus.cc:2243] T 51a2ca964a8f4fb89b26d77b1b334f30 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:14.013634   431 raft_consensus.cc:2272] T 51a2ca964a8f4fb89b26d77b1b334f30 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:14.016188   431 tablet_replica.cc:333] T 059a6a9a07d74be4a9f3854317b870ab P 8846d581359a4b7ea6d4c33424ea825d: stopping tablet replica
I20260709 13:03:14.016904   431 raft_consensus.cc:2243] T 059a6a9a07d74be4a9f3854317b870ab P 8846d581359a4b7ea6d4c33424ea825d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:14.017872   431 raft_consensus.cc:2272] T 059a6a9a07d74be4a9f3854317b870ab P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:14.020702   431 tablet_replica.cc:333] T 0a377c4fc6c04b0aa8f74f64f4f59409 P 8846d581359a4b7ea6d4c33424ea825d: stopping tablet replica
I20260709 13:03:14.022161   431 raft_consensus.cc:2243] T 0a377c4fc6c04b0aa8f74f64f4f59409 P 8846d581359a4b7ea6d4c33424ea825d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:14.023187   431 raft_consensus.cc:2272] T 0a377c4fc6c04b0aa8f74f64f4f59409 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:14.025355   431 tablet_replica.cc:333] T 902451f24024496b83b9a05dfe359a22 P 8846d581359a4b7ea6d4c33424ea825d: stopping tablet replica
I20260709 13:03:14.025879   431 raft_consensus.cc:2243] T 902451f24024496b83b9a05dfe359a22 P 8846d581359a4b7ea6d4c33424ea825d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:03:14.026691   431 raft_consensus.cc:2272] T 902451f24024496b83b9a05dfe359a22 P 8846d581359a4b7ea6d4c33424ea825d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:14.029016   431 tablet_replica.cc:333] T ea3bb46b177b4bbdaa60f464370aa9a0 P 8846d581359a4b7ea6d4c33424ea825d: stopping tablet replica
I20260709 13:03:14.029700   431 raft_consensus.cc:2243] T ea3bb46b177b4bbdaa60f464370aa9a0 P 8846d581359a4b7ea6d4c33424ea825d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:14.030334   431 raft_consensus.cc:2272] T ea3bb46b177b4bbdaa60f464370aa9a0 P 8846d581359a4b7ea6d4c33424ea825d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:14.032778   431 tablet_replica.cc:333] T d3044a44ee984c489779dc339d162407 P 8846d581359a4b7ea6d4c33424ea825d: stopping tablet replica
I20260709 13:03:14.033429   431 raft_consensus.cc:2243] T d3044a44ee984c489779dc339d162407 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:14.033874   431 raft_consensus.cc:2272] T d3044a44ee984c489779dc339d162407 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:14.036194   431 tablet_replica.cc:333] T b3f19df7d93748a1802678c56b5e2208 P 8846d581359a4b7ea6d4c33424ea825d: stopping tablet replica
I20260709 13:03:14.036847   431 raft_consensus.cc:2243] T b3f19df7d93748a1802678c56b5e2208 P 8846d581359a4b7ea6d4c33424ea825d [term 3 LEADER]: Raft consensus shutting down.
W20260709 13:03:14.037441  9288 consensus_peers.cc:597] T 6cb786213d5d48779533059bc333ac6f P 74ac2cf163ee475e8a280cb3aa738f57 -> Peer c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455): Couldn't send request to peer c694531b0e1d47988b291f1214efc4cb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33455: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:14.037838   431 raft_consensus.cc:2272] T b3f19df7d93748a1802678c56b5e2208 P 8846d581359a4b7ea6d4c33424ea825d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:14.040462   431 tablet_replica.cc:333] T 5f076a85481e43d7a969bf5d8bb589dd P 8846d581359a4b7ea6d4c33424ea825d: stopping tablet replica
I20260709 13:03:14.041154   431 raft_consensus.cc:2243] T 5f076a85481e43d7a969bf5d8bb589dd P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:14.041625   431 raft_consensus.cc:2272] T 5f076a85481e43d7a969bf5d8bb589dd P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:14.043025  9287 consensus_peers.cc:597] T cb7f6aeb8116423481ea2b2dca5a06d4 P 74ac2cf163ee475e8a280cb3aa738f57 -> Peer 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311): Couldn't send request to peer 8846d581359a4b7ea6d4c33424ea825d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:14.043985   431 tablet_replica.cc:333] T 6f8b7d72409f45eebf4208f98310f378 P 8846d581359a4b7ea6d4c33424ea825d: stopping tablet replica
I20260709 13:03:14.044514   431 raft_consensus.cc:2243] T 6f8b7d72409f45eebf4208f98310f378 P 8846d581359a4b7ea6d4c33424ea825d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:14.045235   431 raft_consensus.cc:2272] T 6f8b7d72409f45eebf4208f98310f378 P 8846d581359a4b7ea6d4c33424ea825d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:14.073647  9287 consensus_peers.cc:597] T 4d2b02247c21448ea824065ad29304e7 P 74ac2cf163ee475e8a280cb3aa738f57 -> Peer 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311): Couldn't send request to peer 8846d581359a4b7ea6d4c33424ea825d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:14.085273  9287 consensus_peers.cc:597] T d755a5211e5c4133bead5603a424005e P 74ac2cf163ee475e8a280cb3aa738f57 -> Peer 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311): Couldn't send request to peer 8846d581359a4b7ea6d4c33424ea825d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:14.089425  9287 consensus_peers.cc:597] T 989e9796152e4796a3408e00419403fa P 74ac2cf163ee475e8a280cb3aa738f57 -> Peer 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311): Couldn't send request to peer 8846d581359a4b7ea6d4c33424ea825d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:14.115630  9287 consensus_peers.cc:597] T 6cb786213d5d48779533059bc333ac6f P 74ac2cf163ee475e8a280cb3aa738f57 -> Peer 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311): Couldn't send request to peer 8846d581359a4b7ea6d4c33424ea825d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:45311: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:14.120167   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
W20260709 13:03:14.143750  9287 consensus_peers.cc:597] T 53bdda361da242a1b37aa013fad1ee60 P 74ac2cf163ee475e8a280cb3aa738f57 -> Peer 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311): Couldn't send request to peer 8846d581359a4b7ea6d4c33424ea825d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:45311: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:14.198783   431 tablet_server.cc:179] TabletServer@127.0.107.196:0 shutting down...
I20260709 13:03:14.203431 10066 raft_consensus.cc:493] T a731a965126b406988eecb7829bc9981 P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 65ed95869fbb4b69b5d6eb99c51adf85)
I20260709 13:03:14.204020 10066 raft_consensus.cc:515] T a731a965126b406988eecb7829bc9981 P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "8846d581359a4b7ea6d4c33424ea825d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45311 } } peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } }
I20260709 13:03:14.212213 10066 leader_election.cc:290] T a731a965126b406988eecb7829bc9981 P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979), 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311)
W20260709 13:03:14.214512  9287 leader_election.cc:336] T a731a965126b406988eecb7829bc9981 P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311): Network error: Client connection negotiation failed: client connection to 127.0.107.195:45311: connect: Connection refused (error 111)
W20260709 13:03:14.215956  9289 leader_election.cc:336] T a731a965126b406988eecb7829bc9981 P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33979: connect: Connection refused (error 111)
I20260709 13:03:14.216476  9289 leader_election.cc:304] T a731a965126b406988eecb7829bc9981 P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57; no voters: 65ed95869fbb4b69b5d6eb99c51adf85, 8846d581359a4b7ea6d4c33424ea825d
I20260709 13:03:14.217319 10217 raft_consensus.cc:2749] T a731a965126b406988eecb7829bc9981 P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:14.243662 10217 raft_consensus.cc:493] T df7e9031dde347b5b9da753cc817ce17 P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 65ed95869fbb4b69b5d6eb99c51adf85)
I20260709 13:03:14.244159 10217 raft_consensus.cc:515] T df7e9031dde347b5b9da753cc817ce17 P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:03:14.246044 10217 leader_election.cc:290] T df7e9031dde347b5b9da753cc817ce17 P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979), c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455)
W20260709 13:03:14.250010  9289 leader_election.cc:336] T df7e9031dde347b5b9da753cc817ce17 P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33979: connect: Connection refused (error 111)
W20260709 13:03:14.250572  9288 leader_election.cc:336] T df7e9031dde347b5b9da753cc817ce17 P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33455: connect: Connection refused (error 111)
I20260709 13:03:14.250990  9288 leader_election.cc:304] T df7e9031dde347b5b9da753cc817ce17 P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57; no voters: 65ed95869fbb4b69b5d6eb99c51adf85, c694531b0e1d47988b291f1214efc4cb
I20260709 13:03:14.251570 10217 raft_consensus.cc:2749] T df7e9031dde347b5b9da753cc817ce17 P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:14.254344   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:14.255259   431 tablet_replica.cc:333] T 4d2b02247c21448ea824065ad29304e7 P 74ac2cf163ee475e8a280cb3aa738f57: stopping tablet replica
I20260709 13:03:14.255919   431 raft_consensus.cc:2243] T 4d2b02247c21448ea824065ad29304e7 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:14.256886   431 raft_consensus.cc:2272] T 4d2b02247c21448ea824065ad29304e7 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:14.259498   431 tablet_replica.cc:333] T c500a4c76ad3464aaa2f8985f7d3a53d P 74ac2cf163ee475e8a280cb3aa738f57: stopping tablet replica
I20260709 13:03:14.260113   431 raft_consensus.cc:2243] T c500a4c76ad3464aaa2f8985f7d3a53d P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:14.260602   431 raft_consensus.cc:2272] T c500a4c76ad3464aaa2f8985f7d3a53d P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:14.263069   431 tablet_replica.cc:333] T ac928b0582c745b4804afcd30e861439 P 74ac2cf163ee475e8a280cb3aa738f57: stopping tablet replica
I20260709 13:03:14.263769   431 raft_consensus.cc:2243] T ac928b0582c745b4804afcd30e861439 P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:03:14.263944  9287 consensus_peers.cc:597] T 3ac2da3cd17d470495fd5fbb986e4936 P 74ac2cf163ee475e8a280cb3aa738f57 -> Peer 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311): Couldn't send request to peer 8846d581359a4b7ea6d4c33424ea825d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:45311: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:14.264343   431 raft_consensus.cc:2272] T ac928b0582c745b4804afcd30e861439 P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:14.265838  9287 consensus_peers.cc:597] T 02048c7b44ac4e8a984dfa44a3b3b3e5 P 74ac2cf163ee475e8a280cb3aa738f57 -> Peer 8846d581359a4b7ea6d4c33424ea825d (127.0.107.195:45311): Couldn't send request to peer 8846d581359a4b7ea6d4c33424ea825d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:45311: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:14.266623   431 tablet_replica.cc:333] T 18df0aeb35ec4bb095806227d9bb97a8 P 74ac2cf163ee475e8a280cb3aa738f57: stopping tablet replica
I20260709 13:03:14.267303   431 raft_consensus.cc:2243] T 18df0aeb35ec4bb095806227d9bb97a8 P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:14.267731   431 raft_consensus.cc:2272] T 18df0aeb35ec4bb095806227d9bb97a8 P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:14.269680   431 tablet_replica.cc:333] T 02048c7b44ac4e8a984dfa44a3b3b3e5 P 74ac2cf163ee475e8a280cb3aa738f57: stopping tablet replica
I20260709 13:03:14.270277   431 raft_consensus.cc:2243] T 02048c7b44ac4e8a984dfa44a3b3b3e5 P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:14.271095   431 raft_consensus.cc:2272] T 02048c7b44ac4e8a984dfa44a3b3b3e5 P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:14.273248   431 tablet_replica.cc:333] T 9d21e8696b0340bea31002b775af50ee P 74ac2cf163ee475e8a280cb3aa738f57: stopping tablet replica
I20260709 13:03:14.273677 10217 raft_consensus.cc:493] T d26bd321e5604f8aa61723f418be35a9 P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 65ed95869fbb4b69b5d6eb99c51adf85)
I20260709 13:03:14.273869   431 raft_consensus.cc:2243] T 9d21e8696b0340bea31002b775af50ee P 74ac2cf163ee475e8a280cb3aa738f57 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:14.274156 10217 raft_consensus.cc:515] T d26bd321e5604f8aa61723f418be35a9 P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74ac2cf163ee475e8a280cb3aa738f57" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 44351 } } peers { permanent_uuid: "65ed95869fbb4b69b5d6eb99c51adf85" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33979 } } peers { permanent_uuid: "c694531b0e1d47988b291f1214efc4cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33455 } }
I20260709 13:03:14.274417   431 raft_consensus.cc:2272] T 9d21e8696b0340bea31002b775af50ee P 74ac2cf163ee475e8a280cb3aa738f57 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:14.276165 10217 leader_election.cc:290] T d26bd321e5604f8aa61723f418be35a9 P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979), c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455)
I20260709 13:03:14.277132   431 tablet_replica.cc:333] T 76b3d3cd810b46dbac2b534c0be568d2 P 74ac2cf163ee475e8a280cb3aa738f57: stopping tablet replica
I20260709 13:03:14.277925   431 raft_consensus.cc:2243] T 76b3d3cd810b46dbac2b534c0be568d2 P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:14.278484   431 raft_consensus.cc:2272] T 76b3d3cd810b46dbac2b534c0be568d2 P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:14.280372  9289 leader_election.cc:336] T d26bd321e5604f8aa61723f418be35a9 P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 65ed95869fbb4b69b5d6eb99c51adf85 (127.0.107.193:33979): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33979: connect: Connection refused (error 111)
W20260709 13:03:14.280910  9288 leader_election.cc:336] T d26bd321e5604f8aa61723f418be35a9 P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c694531b0e1d47988b291f1214efc4cb (127.0.107.194:33455): Network error: Client connection negotiation failed: client connection to 127.0.107.194:33455: connect: Connection refused (error 111)
I20260709 13:03:14.281157   431 tablet_replica.cc:333] T 87959c0c174141f0958bbba169370488 P 74ac2cf163ee475e8a280cb3aa738f57: stopping tablet replica
I20260709 13:03:14.281256  9288 leader_election.cc:304] T d26bd321e5604f8aa61723f418be35a9 P 74ac2cf163ee475e8a280cb3aa738f57 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74ac2cf163ee475e8a280cb3aa738f57; no voters: 65ed95869fbb4b69b5d6eb99c51adf85, c694531b0e1d47988b291f1214efc4cb
I20260709 13:03:14.281873   431 raft_consensus.cc:2243] T 87959c0c174141f0958bbba169370488 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:14.281906 10217 raft_consensus.cc:2749] T d26bd321e5604f8aa61723f418be35a9 P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:14.282393   431 raft_consensus.cc:2272] T 87959c0c174141f0958bbba169370488 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:14.284566   431 tablet_replica.cc:333] T 7f278d22c55747ee8ee613bfa5c59391 P 74ac2cf163ee475e8a280cb3aa738f57: stopping tablet replica
I20260709 13:03:14.285128   431 raft_consensus.cc:2243] T 7f278d22c55747ee8ee613bfa5c59391 P 74ac2cf163ee475e8a280cb3aa738f57 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:14.285565   431 raft_consensus.cc:2272] T 7f278d22c55747ee8ee613bfa5c59391 P 74ac2cf163ee475e8a280cb3aa738f57 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:14.287460   431 tablet_replica.cc:333] T d755a5211e5c4133bead5603a424005e P 74ac2cf163ee475e8a280cb3aa738f57: stopping tablet replica
I20260709 13:03:14.287990   431 raft_consensus.cc:2243] T d755a5211e5c4133bead5603a424005e P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:14.288725   431 raft_consensus.cc:2272] T d755a5211e5c4133bead5603a424005e P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:14.290637   431 tablet_replica.cc:333] T bfb390576f2e4f508caa2d234ed5d425 P 74ac2cf163ee475e8a280cb3aa738f57: stopping tablet replica
I20260709 13:03:14.291216   431 raft_consensus.cc:2243] T bfb390576f2e4f508caa2d234ed5d425 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:14.291610   431 raft_consensus.cc:2272] T bfb390576f2e4f508caa2d234ed5d425 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:14.293607   431 tablet_replica.cc:333] T 534ae119bf014235a99dfbbfcff690e1 P 74ac2cf163ee475e8a280cb3aa738f57: stopping tablet replica
I20260709 13:03:14.294143   431 raft_consensus.cc:2243] T 534ae119bf014235a99dfbbfcff690e1 P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:14.294569   431 raft_consensus.cc:2272] T 534ae119bf014235a99dfbbfcff690e1 P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:14.296494   431 tablet_replica.cc:333] T 8f67cb568c0745e792c17959b07c5da1 P 74ac2cf163ee475e8a280cb3aa738f57: stopping tablet replica
I20260709 13:03:14.297003   431 raft_consensus.cc:2243] T 8f67cb568c0745e792c17959b07c5da1 P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:14.297427   431 raft_consensus.cc:2272] T 8f67cb568c0745e792c17959b07c5da1 P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:14.299305   431 tablet_replica.cc:333] T 902451f24024496b83b9a05dfe359a22 P 74ac2cf163ee475e8a280cb3aa738f57: stopping tablet replica
I20260709 13:03:14.299786   431 raft_consensus.cc:2243] T 902451f24024496b83b9a05dfe359a22 P 74ac2cf163ee475e8a280cb3aa738f57 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:14.300189   431 raft_consensus.cc:2272] T 902451f24024496b83b9a05dfe359a22 P 74ac2cf163ee475e8a280cb3aa738f57 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:14.301951   431 tablet_replica.cc:333] T a581cc3c19254d4ca39e1f7328268a93 P 74ac2cf163ee475e8a280cb3aa738f57: stopping tablet replica
I20260709 13:03:14.302452   431 raft_consensus.cc:2243] T a581cc3c19254d4ca39e1f7328268a93 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:14.303208   431 raft_consensus.cc:2272] T a581cc3c19254d4ca39e1f7328268a93 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:14.305043   431 tablet_replica.cc:333] T cb7f6aeb8116423481ea2b2dca5a06d4 P 74ac2cf163ee475e8a280cb3aa738f57: stopping tablet replica
I20260709 13:03:14.305505   431 raft_consensus.cc:2243] T cb7f6aeb8116423481ea2b2dca5a06d4 P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:14.306233   431 raft_consensus.cc:2272] T cb7f6aeb8116423481ea2b2dca5a06d4 P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:14.308101   431 tablet_replica.cc:333] T f2229e498f7f472f97c088fddb802939 P 74ac2cf163ee475e8a280cb3aa738f57: stopping tablet replica
I20260709 13:03:14.308590   431 raft_consensus.cc:2243] T f2229e498f7f472f97c088fddb802939 P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:14.308995   431 raft_consensus.cc:2272] T f2229e498f7f472f97c088fddb802939 P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:14.310878   431 tablet_replica.cc:333] T 93ba4182a04b450ca3fc7a15896f889e P 74ac2cf163ee475e8a280cb3aa738f57: stopping tablet replica
I20260709 13:03:14.311375   431 raft_consensus.cc:2243] T 93ba4182a04b450ca3fc7a15896f889e P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:14.311756   431 raft_consensus.cc:2272] T 93ba4182a04b450ca3fc7a15896f889e P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:14.313627   431 tablet_replica.cc:333] T 48e91509dfc74d53a930cdc636976db6 P 74ac2cf163ee475e8a280cb3aa738f57: stopping tablet replica
I20260709 13:03:14.314122   431 raft_consensus.cc:2243] T 48e91509dfc74d53a930cdc636976db6 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:14.314518   431 raft_consensus.cc:2272] T 48e91509dfc74d53a930cdc636976db6 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:14.316365   431 tablet_replica.cc:333] T 50f8080d64c04e738a6a36d748c8ee1e P 74ac2cf163ee475e8a280cb3aa738f57: stopping tablet replica
I20260709 13:03:14.316857   431 raft_consensus.cc:2243] T 50f8080d64c04e738a6a36d748c8ee1e P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:14.317600   431 raft_consensus.cc:2272] T 50f8080d64c04e738a6a36d748c8ee1e P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:14.319410   431 tablet_replica.cc:333] T a971867a8d494757a297936fad4bd464 P 74ac2cf163ee475e8a280cb3aa738f57: stopping tablet replica
I20260709 13:03:14.319895   431 raft_consensus.cc:2243] T a971867a8d494757a297936fad4bd464 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:14.320341   431 raft_consensus.cc:2272] T a971867a8d494757a297936fad4bd464 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:14.322140   431 tablet_replica.cc:333] T dbdc8579cca94ef7ab4babd287837e8c P 74ac2cf163ee475e8a280cb3aa738f57: stopping tablet replica
I20260709 13:03:14.322650   431 raft_consensus.cc:2243] T dbdc8579cca94ef7ab4babd287837e8c P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:14.323379   431 raft_consensus.cc:2272] T dbdc8579cca94ef7ab4babd287837e8c P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:14.325312   431 tablet_replica.cc:333] T 989e9796152e4796a3408e00419403fa P 74ac2cf163ee475e8a280cb3aa738f57: stopping tablet replica
I20260709 13:03:14.326032   431 raft_consensus.cc:2243] T 989e9796152e4796a3408e00419403fa P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:14.326900   431 raft_consensus.cc:2272] T 989e9796152e4796a3408e00419403fa P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:14.329398   431 tablet_replica.cc:333] T 5ce2a33a3b914f6297946ded34c256bf P 74ac2cf163ee475e8a280cb3aa738f57: stopping tablet replica
I20260709 13:03:14.329943   431 raft_consensus.cc:2243] T 5ce2a33a3b914f6297946ded34c256bf P 74ac2cf163ee475e8a280cb3aa738f57 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:14.330339   431 raft_consensus.cc:2272] T 5ce2a33a3b914f6297946ded34c256bf P 74ac2cf163ee475e8a280cb3aa738f57 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:14.332122   431 tablet_replica.cc:333] T 6cb786213d5d48779533059bc333ac6f P 74ac2cf163ee475e8a280cb3aa738f57: stopping tablet replica
I20260709 13:03:14.332615   431 raft_consensus.cc:2243] T 6cb786213d5d48779533059bc333ac6f P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:14.333398   431 raft_consensus.cc:2272] T 6cb786213d5d48779533059bc333ac6f P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:14.336210   431 tablet_replica.cc:333] T 53bdda361da242a1b37aa013fad1ee60 P 74ac2cf163ee475e8a280cb3aa738f57: stopping tablet replica
I20260709 13:03:14.336711   431 raft_consensus.cc:2243] T 53bdda361da242a1b37aa013fad1ee60 P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:14.337440   431 raft_consensus.cc:2272] T 53bdda361da242a1b37aa013fad1ee60 P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:14.339424   431 tablet_replica.cc:333] T eab411e3927a434ab647aa9b31fcf60d P 74ac2cf163ee475e8a280cb3aa738f57: stopping tablet replica
I20260709 13:03:14.339941   431 raft_consensus.cc:2243] T eab411e3927a434ab647aa9b31fcf60d P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:14.340366   431 raft_consensus.cc:2272] T eab411e3927a434ab647aa9b31fcf60d P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:14.342271   431 tablet_replica.cc:333] T e2fbc9c2c0a947f1b4a078db7c8402d0 P 74ac2cf163ee475e8a280cb3aa738f57: stopping tablet replica
I20260709 13:03:14.342796   431 raft_consensus.cc:2243] T e2fbc9c2c0a947f1b4a078db7c8402d0 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:14.343199   431 raft_consensus.cc:2272] T e2fbc9c2c0a947f1b4a078db7c8402d0 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:14.345059   431 tablet_replica.cc:333] T 69a5fd219b1a4d4c94b346f38909f024 P 74ac2cf163ee475e8a280cb3aa738f57: stopping tablet replica
I20260709 13:03:14.345585   431 raft_consensus.cc:2243] T 69a5fd219b1a4d4c94b346f38909f024 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:14.345978   431 raft_consensus.cc:2272] T 69a5fd219b1a4d4c94b346f38909f024 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:14.347795   431 tablet_replica.cc:333] T 51a2ca964a8f4fb89b26d77b1b334f30 P 74ac2cf163ee475e8a280cb3aa738f57: stopping tablet replica
I20260709 13:03:14.348289   431 raft_consensus.cc:2243] T 51a2ca964a8f4fb89b26d77b1b334f30 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:14.349049   431 raft_consensus.cc:2272] T 51a2ca964a8f4fb89b26d77b1b334f30 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:14.351358   431 tablet_replica.cc:333] T 3ac2da3cd17d470495fd5fbb986e4936 P 74ac2cf163ee475e8a280cb3aa738f57: stopping tablet replica
I20260709 13:03:14.351974   431 raft_consensus.cc:2243] T 3ac2da3cd17d470495fd5fbb986e4936 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:14.352864   431 raft_consensus.cc:2272] T 3ac2da3cd17d470495fd5fbb986e4936 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:14.354835   431 tablet_replica.cc:333] T 5cea8a8078e8456186d4d1a184d3f157 P 74ac2cf163ee475e8a280cb3aa738f57: stopping tablet replica
I20260709 13:03:14.355321   431 raft_consensus.cc:2243] T 5cea8a8078e8456186d4d1a184d3f157 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:14.355682   431 raft_consensus.cc:2272] T 5cea8a8078e8456186d4d1a184d3f157 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:14.357470   431 tablet_replica.cc:333] T df7e9031dde347b5b9da753cc817ce17 P 74ac2cf163ee475e8a280cb3aa738f57: stopping tablet replica
I20260709 13:03:14.357960   431 raft_consensus.cc:2243] T df7e9031dde347b5b9da753cc817ce17 P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:14.358362   431 raft_consensus.cc:2272] T df7e9031dde347b5b9da753cc817ce17 P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:14.360109   431 tablet_replica.cc:333] T 0a377c4fc6c04b0aa8f74f64f4f59409 P 74ac2cf163ee475e8a280cb3aa738f57: stopping tablet replica
I20260709 13:03:14.360584   431 raft_consensus.cc:2243] T 0a377c4fc6c04b0aa8f74f64f4f59409 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:14.360953   431 raft_consensus.cc:2272] T 0a377c4fc6c04b0aa8f74f64f4f59409 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:14.362799   431 tablet_replica.cc:333] T d75fae153be542ccbf70c92676ffd30d P 74ac2cf163ee475e8a280cb3aa738f57: stopping tablet replica
I20260709 13:03:14.363270   431 raft_consensus.cc:2243] T d75fae153be542ccbf70c92676ffd30d P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:14.364004   431 raft_consensus.cc:2272] T d75fae153be542ccbf70c92676ffd30d P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:14.365861   431 tablet_replica.cc:333] T eb666e221e5f4e4fbaba194838a28448 P 74ac2cf163ee475e8a280cb3aa738f57: stopping tablet replica
I20260709 13:03:14.366339   431 raft_consensus.cc:2243] T eb666e221e5f4e4fbaba194838a28448 P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:14.366791   431 raft_consensus.cc:2272] T eb666e221e5f4e4fbaba194838a28448 P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:14.368659   431 tablet_replica.cc:333] T d2ef0242573643178d56d10a6c26ae8e P 74ac2cf163ee475e8a280cb3aa738f57: stopping tablet replica
I20260709 13:03:14.369155   431 raft_consensus.cc:2243] T d2ef0242573643178d56d10a6c26ae8e P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:14.369887   431 raft_consensus.cc:2272] T d2ef0242573643178d56d10a6c26ae8e P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:14.371776   431 tablet_replica.cc:333] T 3899ef948b2e405baaccb81544b7f58b P 74ac2cf163ee475e8a280cb3aa738f57: stopping tablet replica
I20260709 13:03:14.372274   431 raft_consensus.cc:2243] T 3899ef948b2e405baaccb81544b7f58b P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:14.372682   431 raft_consensus.cc:2272] T 3899ef948b2e405baaccb81544b7f58b P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:14.374562   431 tablet_replica.cc:333] T d26bd321e5604f8aa61723f418be35a9 P 74ac2cf163ee475e8a280cb3aa738f57: stopping tablet replica
I20260709 13:03:14.375123   431 raft_consensus.cc:2243] T d26bd321e5604f8aa61723f418be35a9 P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:14.375560   431 raft_consensus.cc:2272] T d26bd321e5604f8aa61723f418be35a9 P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:14.377493   431 tablet_replica.cc:333] T a731a965126b406988eecb7829bc9981 P 74ac2cf163ee475e8a280cb3aa738f57: stopping tablet replica
I20260709 13:03:14.378095   431 raft_consensus.cc:2243] T a731a965126b406988eecb7829bc9981 P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:14.378479   431 raft_consensus.cc:2272] T a731a965126b406988eecb7829bc9981 P 74ac2cf163ee475e8a280cb3aa738f57 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:14.380429   431 tablet_replica.cc:333] T d3044a44ee984c489779dc339d162407 P 74ac2cf163ee475e8a280cb3aa738f57: stopping tablet replica
I20260709 13:03:14.380967   431 raft_consensus.cc:2243] T d3044a44ee984c489779dc339d162407 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:14.381760   431 raft_consensus.cc:2272] T d3044a44ee984c489779dc339d162407 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:14.383651   431 tablet_replica.cc:333] T b3f19df7d93748a1802678c56b5e2208 P 74ac2cf163ee475e8a280cb3aa738f57: stopping tablet replica
I20260709 13:03:14.384223   431 raft_consensus.cc:2243] T b3f19df7d93748a1802678c56b5e2208 P 74ac2cf163ee475e8a280cb3aa738f57 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:14.384625   431 raft_consensus.cc:2272] T b3f19df7d93748a1802678c56b5e2208 P 74ac2cf163ee475e8a280cb3aa738f57 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:14.386413   431 tablet_replica.cc:333] T 5f076a85481e43d7a969bf5d8bb589dd P 74ac2cf163ee475e8a280cb3aa738f57: stopping tablet replica
I20260709 13:03:14.386866   431 raft_consensus.cc:2243] T 5f076a85481e43d7a969bf5d8bb589dd P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:14.387255   431 raft_consensus.cc:2272] T 5f076a85481e43d7a969bf5d8bb589dd P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:14.389032   431 tablet_replica.cc:333] T 8bfbc32cc1ba4ecc8fddc7e7f4711778 P 74ac2cf163ee475e8a280cb3aa738f57: stopping tablet replica
I20260709 13:03:14.389447   431 raft_consensus.cc:2243] T 8bfbc32cc1ba4ecc8fddc7e7f4711778 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:14.389837   431 raft_consensus.cc:2272] T 8bfbc32cc1ba4ecc8fddc7e7f4711778 P 74ac2cf163ee475e8a280cb3aa738f57 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:14.458796   431 tablet_server.cc:196] TabletServer@127.0.107.196:0 shutdown complete.
I20260709 13:03:14.519047   431 master.cc:562] Master@127.0.107.254:45205 shutting down...
I20260709 13:03:14.540899   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P c4e14f7d7b4843cd93fd255fcd379522 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:14.541507   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P c4e14f7d7b4843cd93fd255fcd379522 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:14.541874   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P c4e14f7d7b4843cd93fd255fcd379522: stopping tablet replica
I20260709 13:03:14.563351   431 master.cc:584] Master@127.0.107.254:45205 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (31395 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 13:03:14.645998   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:38331
I20260709 13:03:14.647358   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:14.653172 10220 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:14.653220 10219 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:14.654386   431 server_base.cc:1061] running on GCE node
W20260709 13:03:14.654341 10222 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:14.655787   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:14.655982   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:14.656101   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602194656083 us; error 0 us; skew 500 ppm
I20260709 13:03:14.656556   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:14.659003   431 webserver.cc:533] Webserver started at http://127.0.107.254:39081/ using document root <none> and password file <none>
I20260709 13:03:14.659487   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:14.659643   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:14.659853   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:14.660909   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601891739070-431-0/minicluster-data/master-0-root/instance:
uuid: "5fb71e9cf392414c99288eb79ceb7e70"
format_stamp: "Formatted at 2026-07-09 13:03:14 on dist-test-slave-qzg2"
I20260709 13:03:14.665330   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 13:03:14.668897 10227 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:14.669680   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:03:14.669978   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601891739070-431-0/minicluster-data/master-0-root
uuid: "5fb71e9cf392414c99288eb79ceb7e70"
format_stamp: "Formatted at 2026-07-09 13:03:14 on dist-test-slave-qzg2"
I20260709 13:03:14.670261   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601891739070-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601891739070-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601891739070-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:14.684512   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:14.685768   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:14.722926   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:38331
I20260709 13:03:14.723047 10278 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:38331 every 8 connection(s)
I20260709 13:03:14.726703 10279 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:14.738153 10279 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5fb71e9cf392414c99288eb79ceb7e70: Bootstrap starting.
I20260709 13:03:14.743181 10279 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5fb71e9cf392414c99288eb79ceb7e70: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:14.747716 10279 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5fb71e9cf392414c99288eb79ceb7e70: No bootstrap required, opened a new log
I20260709 13:03:14.749998 10279 raft_consensus.cc:359] T 00000000000000000000000000000000 P 5fb71e9cf392414c99288eb79ceb7e70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5fb71e9cf392414c99288eb79ceb7e70" member_type: VOTER }
I20260709 13:03:14.750411 10279 raft_consensus.cc:385] T 00000000000000000000000000000000 P 5fb71e9cf392414c99288eb79ceb7e70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:14.750633 10279 raft_consensus.cc:740] T 00000000000000000000000000000000 P 5fb71e9cf392414c99288eb79ceb7e70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5fb71e9cf392414c99288eb79ceb7e70, State: Initialized, Role: FOLLOWER
I20260709 13:03:14.751268 10279 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5fb71e9cf392414c99288eb79ceb7e70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5fb71e9cf392414c99288eb79ceb7e70" member_type: VOTER }
I20260709 13:03:14.751704 10279 raft_consensus.cc:399] T 00000000000000000000000000000000 P 5fb71e9cf392414c99288eb79ceb7e70 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:03:14.751909 10279 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5fb71e9cf392414c99288eb79ceb7e70 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:03:14.752166 10279 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 5fb71e9cf392414c99288eb79ceb7e70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:14.756805 10279 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5fb71e9cf392414c99288eb79ceb7e70 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5fb71e9cf392414c99288eb79ceb7e70" member_type: VOTER }
I20260709 13:03:14.757323 10279 leader_election.cc:304] T 00000000000000000000000000000000 P 5fb71e9cf392414c99288eb79ceb7e70 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5fb71e9cf392414c99288eb79ceb7e70; no voters: 
I20260709 13:03:14.758445 10279 leader_election.cc:290] T 00000000000000000000000000000000 P 5fb71e9cf392414c99288eb79ceb7e70 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:03:14.758919 10282 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 5fb71e9cf392414c99288eb79ceb7e70 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:14.760234 10282 raft_consensus.cc:697] T 00000000000000000000000000000000 P 5fb71e9cf392414c99288eb79ceb7e70 [term 1 LEADER]: Becoming Leader. State: Replica: 5fb71e9cf392414c99288eb79ceb7e70, State: Running, Role: LEADER
I20260709 13:03:14.760953 10282 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5fb71e9cf392414c99288eb79ceb7e70 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5fb71e9cf392414c99288eb79ceb7e70" member_type: VOTER }
I20260709 13:03:14.761411 10279 sys_catalog.cc:565] T 00000000000000000000000000000000 P 5fb71e9cf392414c99288eb79ceb7e70 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:03:14.765847 10283 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5fb71e9cf392414c99288eb79ceb7e70 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5fb71e9cf392414c99288eb79ceb7e70" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5fb71e9cf392414c99288eb79ceb7e70" member_type: VOTER } }
I20260709 13:03:14.765897 10284 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5fb71e9cf392414c99288eb79ceb7e70 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5fb71e9cf392414c99288eb79ceb7e70. Latest consensus state: current_term: 1 leader_uuid: "5fb71e9cf392414c99288eb79ceb7e70" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5fb71e9cf392414c99288eb79ceb7e70" member_type: VOTER } }
I20260709 13:03:14.766808 10283 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5fb71e9cf392414c99288eb79ceb7e70 [sys.catalog]: This master's current role is: LEADER
I20260709 13:03:14.766902 10284 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5fb71e9cf392414c99288eb79ceb7e70 [sys.catalog]: This master's current role is: LEADER
I20260709 13:03:14.773012 10290 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:03:14.777884 10290 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:03:14.779021   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:03:14.786938 10290 catalog_manager.cc:1383] Generated new cluster ID: 0cc9cf8279084e0dbe30dffc94d7afa8
I20260709 13:03:14.787250 10290 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:03:14.808743 10290 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:03:14.810026 10290 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:03:14.823966 10290 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 5fb71e9cf392414c99288eb79ceb7e70: Generated new TSK 0
I20260709 13:03:14.824625 10290 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:03:14.846258   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:14.852408 10300 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:14.852924 10301 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:14.856907   431 server_base.cc:1061] running on GCE node
W20260709 13:03:14.856825 10303 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:14.858745   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:14.858968   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:14.859146   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602194859127 us; error 0 us; skew 500 ppm
I20260709 13:03:14.859673   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:14.861954   431 webserver.cc:533] Webserver started at http://127.0.107.193:37925/ using document root <none> and password file <none>
I20260709 13:03:14.862388   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:14.862536   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:14.862845   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:14.863883   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601891739070-431-0/minicluster-data/ts-0-root/instance:
uuid: "22139e7a5ea041588dd21a8d06ba1741"
format_stamp: "Formatted at 2026-07-09 13:03:14 on dist-test-slave-qzg2"
I20260709 13:03:14.868323   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:03:14.871749 10308 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:14.872484   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:03:14.872769   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601891739070-431-0/minicluster-data/ts-0-root
uuid: "22139e7a5ea041588dd21a8d06ba1741"
format_stamp: "Formatted at 2026-07-09 13:03:14 on dist-test-slave-qzg2"
I20260709 13:03:14.873019   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601891739070-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601891739070-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601891739070-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:14.912294   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:14.913594   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:14.915156   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:14.917526   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:03:14.917730   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:14.917973   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:03:14.918139   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:14.958878   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:45479
I20260709 13:03:14.958993 10370 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:45479 every 8 connection(s)
I20260709 13:03:14.963948   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:14.970877 10375 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:14.974129 10376 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:14.976045   431 server_base.cc:1061] running on GCE node
W20260709 13:03:14.976919 10378 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:14.977923   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:14.978206   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:14.978423   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602194978403 us; error 0 us; skew 500 ppm
I20260709 13:03:14.979090   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:14.982227   431 webserver.cc:533] Webserver started at http://127.0.107.194:36393/ using document root <none> and password file <none>
I20260709 13:03:14.982326 10371 heartbeater.cc:344] Connected to a master server at 127.0.107.254:38331
I20260709 13:03:14.982807 10371 heartbeater.cc:461] Registering TS with master...
I20260709 13:03:14.982970   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:14.983273   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:14.983592   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:14.983737 10371 heartbeater.cc:507] Master 127.0.107.254:38331 requested a full tablet report, sending...
I20260709 13:03:14.985358   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601891739070-431-0/minicluster-data/ts-1-root/instance:
uuid: "24479f93a03b4364837c81f7efbdf9d3"
format_stamp: "Formatted at 2026-07-09 13:03:14 on dist-test-slave-qzg2"
I20260709 13:03:14.986515 10244 ts_manager.cc:194] Registered new tserver with Master: 22139e7a5ea041588dd21a8d06ba1741 (127.0.107.193:45479)
I20260709 13:03:14.988487 10244 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47476
I20260709 13:03:14.990571   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.004s
I20260709 13:03:14.994728 10383 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:14.995525   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.004s
I20260709 13:03:14.995859   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601891739070-431-0/minicluster-data/ts-1-root
uuid: "24479f93a03b4364837c81f7efbdf9d3"
format_stamp: "Formatted at 2026-07-09 13:03:14 on dist-test-slave-qzg2"
I20260709 13:03:14.996145   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601891739070-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601891739070-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601891739070-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:15.015393   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:15.016652   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:15.018115   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:15.020388   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:03:15.020604   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:15.020838   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:03:15.020987   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:15.061540   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:44467
I20260709 13:03:15.061712 10445 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:44467 every 8 connection(s)
I20260709 13:03:15.066339   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:15.073565 10449 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:15.075505 10450 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:15.077909 10452 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:15.078348   431 server_base.cc:1061] running on GCE node
I20260709 13:03:15.079222 10446 heartbeater.cc:344] Connected to a master server at 127.0.107.254:38331
I20260709 13:03:15.079427   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:03:15.079613 10446 heartbeater.cc:461] Registering TS with master...
W20260709 13:03:15.079723   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:15.080034   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602195080020 us; error 0 us; skew 500 ppm
I20260709 13:03:15.080545 10446 heartbeater.cc:507] Master 127.0.107.254:38331 requested a full tablet report, sending...
I20260709 13:03:15.080650   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:15.082794 10244 ts_manager.cc:194] Registered new tserver with Master: 24479f93a03b4364837c81f7efbdf9d3 (127.0.107.194:44467)
I20260709 13:03:15.083340   431 webserver.cc:533] Webserver started at http://127.0.107.195:34937/ using document root <none> and password file <none>
I20260709 13:03:15.083886   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:15.084070   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:15.084324   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:15.084296 10244 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47478
I20260709 13:03:15.085865   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601891739070-431-0/minicluster-data/ts-2-root/instance:
uuid: "17d104ff42224d8c9cdf4c53a2152582"
format_stamp: "Formatted at 2026-07-09 13:03:15 on dist-test-slave-qzg2"
I20260709 13:03:15.090415   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:03:15.093964 10457 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:15.094834   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:03:15.095160   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601891739070-431-0/minicluster-data/ts-2-root
uuid: "17d104ff42224d8c9cdf4c53a2152582"
format_stamp: "Formatted at 2026-07-09 13:03:15 on dist-test-slave-qzg2"
I20260709 13:03:15.095453   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601891739070-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601891739070-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601891739070-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:15.129719   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:15.131004   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:15.132454   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:15.134747   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:03:15.134950   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:15.135175   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:03:15.135334   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:15.177213   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:41601
I20260709 13:03:15.177316 10519 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:41601 every 8 connection(s)
I20260709 13:03:15.191063 10520 heartbeater.cc:344] Connected to a master server at 127.0.107.254:38331
I20260709 13:03:15.191520 10520 heartbeater.cc:461] Registering TS with master...
I20260709 13:03:15.192287 10520 heartbeater.cc:507] Master 127.0.107.254:38331 requested a full tablet report, sending...
I20260709 13:03:15.194293 10244 ts_manager.cc:194] Registered new tserver with Master: 17d104ff42224d8c9cdf4c53a2152582 (127.0.107.195:41601)
I20260709 13:03:15.195099   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014671361s
I20260709 13:03:15.195711 10244 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47482
I20260709 13:03:15.221261 10244 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47492:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:03:15.224189 10244 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:03:15.310478 10335 tablet_service.cc:1511] Processing CreateTablet for tablet 77c2a758545e45e29d62d8d71ea3f43d (DEFAULT_TABLE table=test-workload [id=83e0f97f0a39461d9a703d13a686e188]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:03:15.311584 10334 tablet_service.cc:1511] Processing CreateTablet for tablet e0ad84cc4e1942d99055ab43ea0bdac0 (DEFAULT_TABLE table=test-workload [id=83e0f97f0a39461d9a703d13a686e188]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:03:15.312093 10335 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77c2a758545e45e29d62d8d71ea3f43d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:15.311750 10332 tablet_service.cc:1511] Processing CreateTablet for tablet b038dccd00b44161b10a08f5b963dd45 (DEFAULT_TABLE table=test-workload [id=83e0f97f0a39461d9a703d13a686e188]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:03:15.313210 10332 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b038dccd00b44161b10a08f5b963dd45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:15.310478 10336 tablet_service.cc:1511] Processing CreateTablet for tablet a848edc7d33e48a1a475daf70fb66449 (DEFAULT_TABLE table=test-workload [id=83e0f97f0a39461d9a703d13a686e188]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:03:15.314318 10334 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0ad84cc4e1942d99055ab43ea0bdac0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:15.315071 10336 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a848edc7d33e48a1a475daf70fb66449. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:15.313371 10333 tablet_service.cc:1511] Processing CreateTablet for tablet 89649f4e196f44a3b3b98fa009c228f8 (DEFAULT_TABLE table=test-workload [id=83e0f97f0a39461d9a703d13a686e188]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:03:15.318274 10333 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89649f4e196f44a3b3b98fa009c228f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:15.329172 10484 tablet_service.cc:1511] Processing CreateTablet for tablet 77c2a758545e45e29d62d8d71ea3f43d (DEFAULT_TABLE table=test-workload [id=83e0f97f0a39461d9a703d13a686e188]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:03:15.330293 10411 tablet_service.cc:1511] Processing CreateTablet for tablet a848edc7d33e48a1a475daf70fb66449 (DEFAULT_TABLE table=test-workload [id=83e0f97f0a39461d9a703d13a686e188]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:03:15.327867 10485 tablet_service.cc:1511] Processing CreateTablet for tablet a848edc7d33e48a1a475daf70fb66449 (DEFAULT_TABLE table=test-workload [id=83e0f97f0a39461d9a703d13a686e188]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:03:15.330591 10484 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77c2a758545e45e29d62d8d71ea3f43d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:15.335378 10485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a848edc7d33e48a1a475daf70fb66449. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:15.335095 10409 tablet_service.cc:1511] Processing CreateTablet for tablet e0ad84cc4e1942d99055ab43ea0bdac0 (DEFAULT_TABLE table=test-workload [id=83e0f97f0a39461d9a703d13a686e188]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:03:15.331661 10411 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a848edc7d33e48a1a475daf70fb66449. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:15.331737 10483 tablet_service.cc:1511] Processing CreateTablet for tablet e0ad84cc4e1942d99055ab43ea0bdac0 (DEFAULT_TABLE table=test-workload [id=83e0f97f0a39461d9a703d13a686e188]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:03:15.340305 10483 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0ad84cc4e1942d99055ab43ea0bdac0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:15.333350 10410 tablet_service.cc:1511] Processing CreateTablet for tablet 77c2a758545e45e29d62d8d71ea3f43d (DEFAULT_TABLE table=test-workload [id=83e0f97f0a39461d9a703d13a686e188]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:03:15.345124 10410 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77c2a758545e45e29d62d8d71ea3f43d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:15.332855 10482 tablet_service.cc:1511] Processing CreateTablet for tablet 89649f4e196f44a3b3b98fa009c228f8 (DEFAULT_TABLE table=test-workload [id=83e0f97f0a39461d9a703d13a686e188]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:03:15.347270 10482 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89649f4e196f44a3b3b98fa009c228f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:15.348615 10409 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0ad84cc4e1942d99055ab43ea0bdac0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:15.362639 10535 tablet_bootstrap.cc:492] T a848edc7d33e48a1a475daf70fb66449 P 22139e7a5ea041588dd21a8d06ba1741: Bootstrap starting.
I20260709 13:03:15.368860 10535 tablet_bootstrap.cc:654] T a848edc7d33e48a1a475daf70fb66449 P 22139e7a5ea041588dd21a8d06ba1741: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:15.379802 10407 tablet_service.cc:1511] Processing CreateTablet for tablet b038dccd00b44161b10a08f5b963dd45 (DEFAULT_TABLE table=test-workload [id=83e0f97f0a39461d9a703d13a686e188]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:03:15.380738 10481 tablet_service.cc:1511] Processing CreateTablet for tablet b038dccd00b44161b10a08f5b963dd45 (DEFAULT_TABLE table=test-workload [id=83e0f97f0a39461d9a703d13a686e188]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:03:15.382146 10408 tablet_service.cc:1511] Processing CreateTablet for tablet 89649f4e196f44a3b3b98fa009c228f8 (DEFAULT_TABLE table=test-workload [id=83e0f97f0a39461d9a703d13a686e188]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:03:15.382165 10481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b038dccd00b44161b10a08f5b963dd45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:15.384994 10480 tablet_service.cc:1511] Processing CreateTablet for tablet 2df7bfe151e349f1a30cd3142e13c021 (DEFAULT_TABLE table=test-workload [id=83e0f97f0a39461d9a703d13a686e188]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:03:15.386479 10480 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2df7bfe151e349f1a30cd3142e13c021. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:15.381258 10407 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b038dccd00b44161b10a08f5b963dd45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:15.388396 10408 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89649f4e196f44a3b3b98fa009c228f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:15.389472 10406 tablet_service.cc:1511] Processing CreateTablet for tablet 2df7bfe151e349f1a30cd3142e13c021 (DEFAULT_TABLE table=test-workload [id=83e0f97f0a39461d9a703d13a686e188]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:03:15.390929 10406 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2df7bfe151e349f1a30cd3142e13c021. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:15.399578 10405 tablet_service.cc:1511] Processing CreateTablet for tablet 1484bae8a7264a0e9f328dd5ce7edad8 (DEFAULT_TABLE table=test-workload [id=83e0f97f0a39461d9a703d13a686e188]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:03:15.401005 10405 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1484bae8a7264a0e9f328dd5ce7edad8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:15.403683 10336 tablet_service.cc:1511] Processing CreateTablet for tablet 1484bae8a7264a0e9f328dd5ce7edad8 (DEFAULT_TABLE table=test-workload [id=83e0f97f0a39461d9a703d13a686e188]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:03:15.405081 10336 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1484bae8a7264a0e9f328dd5ce7edad8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:15.411988 10536 tablet_bootstrap.cc:492] T e0ad84cc4e1942d99055ab43ea0bdac0 P 24479f93a03b4364837c81f7efbdf9d3: Bootstrap starting.
I20260709 13:03:15.413556 10537 tablet_bootstrap.cc:492] T a848edc7d33e48a1a475daf70fb66449 P 17d104ff42224d8c9cdf4c53a2152582: Bootstrap starting.
I20260709 13:03:15.419517 10536 tablet_bootstrap.cc:654] T e0ad84cc4e1942d99055ab43ea0bdac0 P 24479f93a03b4364837c81f7efbdf9d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:15.430748 10333 tablet_service.cc:1511] Processing CreateTablet for tablet afe8b130a0d1484e9f08fed8f6be2f61 (DEFAULT_TABLE table=test-workload [id=83e0f97f0a39461d9a703d13a686e188]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:03:15.432106 10333 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afe8b130a0d1484e9f08fed8f6be2f61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:15.436152 10409 tablet_service.cc:1511] Processing CreateTablet for tablet afe8b130a0d1484e9f08fed8f6be2f61 (DEFAULT_TABLE table=test-workload [id=83e0f97f0a39461d9a703d13a686e188]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:03:15.437601 10409 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afe8b130a0d1484e9f08fed8f6be2f61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:15.428648 10480 tablet_service.cc:1511] Processing CreateTablet for tablet 1484bae8a7264a0e9f328dd5ce7edad8 (DEFAULT_TABLE table=test-workload [id=83e0f97f0a39461d9a703d13a686e188]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:03:15.439725 10480 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1484bae8a7264a0e9f328dd5ce7edad8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:15.445670 10535 tablet_bootstrap.cc:492] T a848edc7d33e48a1a475daf70fb66449 P 22139e7a5ea041588dd21a8d06ba1741: No bootstrap required, opened a new log
I20260709 13:03:15.446251 10535 ts_tablet_manager.cc:1403] T a848edc7d33e48a1a475daf70fb66449 P 22139e7a5ea041588dd21a8d06ba1741: Time spent bootstrapping tablet: real 0.084s	user 0.006s	sys 0.003s
I20260709 13:03:15.446810 10537 tablet_bootstrap.cc:654] T a848edc7d33e48a1a475daf70fb66449 P 17d104ff42224d8c9cdf4c53a2152582: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:15.449461 10484 tablet_service.cc:1511] Processing CreateTablet for tablet afe8b130a0d1484e9f08fed8f6be2f61 (DEFAULT_TABLE table=test-workload [id=83e0f97f0a39461d9a703d13a686e188]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:03:15.451937 10332 tablet_service.cc:1511] Processing CreateTablet for tablet 4feb1aa9b1d14601b28b28a6d515ee65 (DEFAULT_TABLE table=test-workload [id=83e0f97f0a39461d9a703d13a686e188]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:03:15.453480 10332 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4feb1aa9b1d14601b28b28a6d515ee65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:15.456540 10535 raft_consensus.cc:359] T a848edc7d33e48a1a475daf70fb66449 P 22139e7a5ea041588dd21a8d06ba1741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } }
I20260709 13:03:15.457376 10535 raft_consensus.cc:385] T a848edc7d33e48a1a475daf70fb66449 P 22139e7a5ea041588dd21a8d06ba1741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:15.457675 10535 raft_consensus.cc:740] T a848edc7d33e48a1a475daf70fb66449 P 22139e7a5ea041588dd21a8d06ba1741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22139e7a5ea041588dd21a8d06ba1741, State: Initialized, Role: FOLLOWER
I20260709 13:03:15.459302 10484 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afe8b130a0d1484e9f08fed8f6be2f61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:15.460812 10409 tablet_service.cc:1511] Processing CreateTablet for tablet 4feb1aa9b1d14601b28b28a6d515ee65 (DEFAULT_TABLE table=test-workload [id=83e0f97f0a39461d9a703d13a686e188]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:03:15.464057 10409 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4feb1aa9b1d14601b28b28a6d515ee65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:15.463735 10485 tablet_service.cc:1511] Processing CreateTablet for tablet 4feb1aa9b1d14601b28b28a6d515ee65 (DEFAULT_TABLE table=test-workload [id=83e0f97f0a39461d9a703d13a686e188]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:03:15.467599 10485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4feb1aa9b1d14601b28b28a6d515ee65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:15.467427 10335 tablet_service.cc:1511] Processing CreateTablet for tablet 19c2daa20bbe47afa5289e2b32987709 (DEFAULT_TABLE table=test-workload [id=83e0f97f0a39461d9a703d13a686e188]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:03:15.468747 10335 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19c2daa20bbe47afa5289e2b32987709. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:15.468696 10411 tablet_service.cc:1511] Processing CreateTablet for tablet 19c2daa20bbe47afa5289e2b32987709 (DEFAULT_TABLE table=test-workload [id=83e0f97f0a39461d9a703d13a686e188]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:03:15.463090 10535 consensus_queue.cc:260] T a848edc7d33e48a1a475daf70fb66449 P 22139e7a5ea041588dd21a8d06ba1741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } }
I20260709 13:03:15.466447 10536 tablet_bootstrap.cc:492] T e0ad84cc4e1942d99055ab43ea0bdac0 P 24479f93a03b4364837c81f7efbdf9d3: No bootstrap required, opened a new log
I20260709 13:03:15.470939 10536 ts_tablet_manager.cc:1403] T e0ad84cc4e1942d99055ab43ea0bdac0 P 24479f93a03b4364837c81f7efbdf9d3: Time spent bootstrapping tablet: real 0.059s	user 0.012s	sys 0.019s
I20260709 13:03:15.474620 10536 raft_consensus.cc:359] T e0ad84cc4e1942d99055ab43ea0bdac0 P 24479f93a03b4364837c81f7efbdf9d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:15.480278 10536 raft_consensus.cc:385] T e0ad84cc4e1942d99055ab43ea0bdac0 P 24479f93a03b4364837c81f7efbdf9d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:15.480958 10482 tablet_service.cc:1511] Processing CreateTablet for tablet 19c2daa20bbe47afa5289e2b32987709 (DEFAULT_TABLE table=test-workload [id=83e0f97f0a39461d9a703d13a686e188]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:03:15.480726 10536 raft_consensus.cc:740] T e0ad84cc4e1942d99055ab43ea0bdac0 P 24479f93a03b4364837c81f7efbdf9d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24479f93a03b4364837c81f7efbdf9d3, State: Initialized, Role: FOLLOWER
I20260709 13:03:15.482364 10482 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19c2daa20bbe47afa5289e2b32987709. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:15.482692 10536 consensus_queue.cc:260] T e0ad84cc4e1942d99055ab43ea0bdac0 P 24479f93a03b4364837c81f7efbdf9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:15.479018 10411 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19c2daa20bbe47afa5289e2b32987709. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:15.431723 10334 tablet_service.cc:1511] Processing CreateTablet for tablet 2df7bfe151e349f1a30cd3142e13c021 (DEFAULT_TABLE table=test-workload [id=83e0f97f0a39461d9a703d13a686e188]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:03:15.506273 10334 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2df7bfe151e349f1a30cd3142e13c021. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:15.510483 10537 tablet_bootstrap.cc:492] T a848edc7d33e48a1a475daf70fb66449 P 17d104ff42224d8c9cdf4c53a2152582: No bootstrap required, opened a new log
I20260709 13:03:15.511176 10537 ts_tablet_manager.cc:1403] T a848edc7d33e48a1a475daf70fb66449 P 17d104ff42224d8c9cdf4c53a2152582: Time spent bootstrapping tablet: real 0.098s	user 0.012s	sys 0.000s
I20260709 13:03:15.523510 10371 heartbeater.cc:499] Master 127.0.107.254:38331 was elected leader, sending a full tablet report...
I20260709 13:03:15.524267 10535 ts_tablet_manager.cc:1434] T a848edc7d33e48a1a475daf70fb66449 P 22139e7a5ea041588dd21a8d06ba1741: Time spent starting tablet: real 0.078s	user 0.020s	sys 0.003s
I20260709 13:03:15.525751 10535 tablet_bootstrap.cc:492] T 77c2a758545e45e29d62d8d71ea3f43d P 22139e7a5ea041588dd21a8d06ba1741: Bootstrap starting.
I20260709 13:03:15.514247 10537 raft_consensus.cc:359] T a848edc7d33e48a1a475daf70fb66449 P 17d104ff42224d8c9cdf4c53a2152582 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } }
I20260709 13:03:15.528509 10446 heartbeater.cc:499] Master 127.0.107.254:38331 was elected leader, sending a full tablet report...
I20260709 13:03:15.528937 10537 raft_consensus.cc:385] T a848edc7d33e48a1a475daf70fb66449 P 17d104ff42224d8c9cdf4c53a2152582 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:15.529254 10537 raft_consensus.cc:740] T a848edc7d33e48a1a475daf70fb66449 P 17d104ff42224d8c9cdf4c53a2152582 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17d104ff42224d8c9cdf4c53a2152582, State: Initialized, Role: FOLLOWER
I20260709 13:03:15.531073 10537 consensus_queue.cc:260] T a848edc7d33e48a1a475daf70fb66449 P 17d104ff42224d8c9cdf4c53a2152582 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } }
I20260709 13:03:15.533172 10535 tablet_bootstrap.cc:654] T 77c2a758545e45e29d62d8d71ea3f43d P 22139e7a5ea041588dd21a8d06ba1741: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:15.542419 10536 ts_tablet_manager.cc:1434] T e0ad84cc4e1942d99055ab43ea0bdac0 P 24479f93a03b4364837c81f7efbdf9d3: Time spent starting tablet: real 0.070s	user 0.016s	sys 0.013s
I20260709 13:03:15.544039 10536 tablet_bootstrap.cc:492] T 77c2a758545e45e29d62d8d71ea3f43d P 24479f93a03b4364837c81f7efbdf9d3: Bootstrap starting.
I20260709 13:03:15.552367 10536 tablet_bootstrap.cc:654] T 77c2a758545e45e29d62d8d71ea3f43d P 24479f93a03b4364837c81f7efbdf9d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:15.553972 10535 tablet_bootstrap.cc:492] T 77c2a758545e45e29d62d8d71ea3f43d P 22139e7a5ea041588dd21a8d06ba1741: No bootstrap required, opened a new log
I20260709 13:03:15.554713 10535 ts_tablet_manager.cc:1403] T 77c2a758545e45e29d62d8d71ea3f43d P 22139e7a5ea041588dd21a8d06ba1741: Time spent bootstrapping tablet: real 0.029s	user 0.017s	sys 0.011s
I20260709 13:03:15.558393 10535 raft_consensus.cc:359] T 77c2a758545e45e29d62d8d71ea3f43d P 22139e7a5ea041588dd21a8d06ba1741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:15.559466 10535 raft_consensus.cc:385] T 77c2a758545e45e29d62d8d71ea3f43d P 22139e7a5ea041588dd21a8d06ba1741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:15.559892 10535 raft_consensus.cc:740] T 77c2a758545e45e29d62d8d71ea3f43d P 22139e7a5ea041588dd21a8d06ba1741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22139e7a5ea041588dd21a8d06ba1741, State: Initialized, Role: FOLLOWER
I20260709 13:03:15.561036 10535 consensus_queue.cc:260] T 77c2a758545e45e29d62d8d71ea3f43d P 22139e7a5ea041588dd21a8d06ba1741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:15.564415 10535 ts_tablet_manager.cc:1434] T 77c2a758545e45e29d62d8d71ea3f43d P 22139e7a5ea041588dd21a8d06ba1741: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 13:03:15.565676 10535 tablet_bootstrap.cc:492] T b038dccd00b44161b10a08f5b963dd45 P 22139e7a5ea041588dd21a8d06ba1741: Bootstrap starting.
W20260709 13:03:15.565764 10447 tablet.cc:2406] T e0ad84cc4e1942d99055ab43ea0bdac0 P 24479f93a03b4364837c81f7efbdf9d3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:03:15.568660 10537 ts_tablet_manager.cc:1434] T a848edc7d33e48a1a475daf70fb66449 P 17d104ff42224d8c9cdf4c53a2152582: Time spent starting tablet: real 0.057s	user 0.015s	sys 0.020s
I20260709 13:03:15.569550 10520 heartbeater.cc:499] Master 127.0.107.254:38331 was elected leader, sending a full tablet report...
I20260709 13:03:15.570807 10537 tablet_bootstrap.cc:492] T e0ad84cc4e1942d99055ab43ea0bdac0 P 17d104ff42224d8c9cdf4c53a2152582: Bootstrap starting.
I20260709 13:03:15.572275 10536 tablet_bootstrap.cc:492] T 77c2a758545e45e29d62d8d71ea3f43d P 24479f93a03b4364837c81f7efbdf9d3: No bootstrap required, opened a new log
I20260709 13:03:15.572831 10536 ts_tablet_manager.cc:1403] T 77c2a758545e45e29d62d8d71ea3f43d P 24479f93a03b4364837c81f7efbdf9d3: Time spent bootstrapping tablet: real 0.029s	user 0.018s	sys 0.009s
I20260709 13:03:15.575832 10536 raft_consensus.cc:359] T 77c2a758545e45e29d62d8d71ea3f43d P 24479f93a03b4364837c81f7efbdf9d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:15.576617 10536 raft_consensus.cc:385] T 77c2a758545e45e29d62d8d71ea3f43d P 24479f93a03b4364837c81f7efbdf9d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:15.576996 10536 raft_consensus.cc:740] T 77c2a758545e45e29d62d8d71ea3f43d P 24479f93a03b4364837c81f7efbdf9d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24479f93a03b4364837c81f7efbdf9d3, State: Initialized, Role: FOLLOWER
I20260709 13:03:15.577787 10536 consensus_queue.cc:260] T 77c2a758545e45e29d62d8d71ea3f43d P 24479f93a03b4364837c81f7efbdf9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:15.578781 10535 tablet_bootstrap.cc:654] T b038dccd00b44161b10a08f5b963dd45 P 22139e7a5ea041588dd21a8d06ba1741: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:15.579385 10537 tablet_bootstrap.cc:654] T e0ad84cc4e1942d99055ab43ea0bdac0 P 17d104ff42224d8c9cdf4c53a2152582: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:15.580327 10536 ts_tablet_manager.cc:1434] T 77c2a758545e45e29d62d8d71ea3f43d P 24479f93a03b4364837c81f7efbdf9d3: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:03:15.581431 10536 tablet_bootstrap.cc:492] T 1484bae8a7264a0e9f328dd5ce7edad8 P 24479f93a03b4364837c81f7efbdf9d3: Bootstrap starting.
I20260709 13:03:15.587745 10536 tablet_bootstrap.cc:654] T 1484bae8a7264a0e9f328dd5ce7edad8 P 24479f93a03b4364837c81f7efbdf9d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:15.591995 10535 tablet_bootstrap.cc:492] T b038dccd00b44161b10a08f5b963dd45 P 22139e7a5ea041588dd21a8d06ba1741: No bootstrap required, opened a new log
I20260709 13:03:15.592677 10535 ts_tablet_manager.cc:1403] T b038dccd00b44161b10a08f5b963dd45 P 22139e7a5ea041588dd21a8d06ba1741: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.009s
I20260709 13:03:15.594554 10537 tablet_bootstrap.cc:492] T e0ad84cc4e1942d99055ab43ea0bdac0 P 17d104ff42224d8c9cdf4c53a2152582: No bootstrap required, opened a new log
I20260709 13:03:15.594554 10536 tablet_bootstrap.cc:492] T 1484bae8a7264a0e9f328dd5ce7edad8 P 24479f93a03b4364837c81f7efbdf9d3: No bootstrap required, opened a new log
I20260709 13:03:15.595409 10537 ts_tablet_manager.cc:1403] T e0ad84cc4e1942d99055ab43ea0bdac0 P 17d104ff42224d8c9cdf4c53a2152582: Time spent bootstrapping tablet: real 0.025s	user 0.017s	sys 0.003s
I20260709 13:03:15.595430 10536 ts_tablet_manager.cc:1403] T 1484bae8a7264a0e9f328dd5ce7edad8 P 24479f93a03b4364837c81f7efbdf9d3: Time spent bootstrapping tablet: real 0.014s	user 0.009s	sys 0.004s
I20260709 13:03:15.596421 10535 raft_consensus.cc:359] T b038dccd00b44161b10a08f5b963dd45 P 22139e7a5ea041588dd21a8d06ba1741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:15.597455 10535 raft_consensus.cc:385] T b038dccd00b44161b10a08f5b963dd45 P 22139e7a5ea041588dd21a8d06ba1741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:15.597949 10535 raft_consensus.cc:740] T b038dccd00b44161b10a08f5b963dd45 P 22139e7a5ea041588dd21a8d06ba1741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22139e7a5ea041588dd21a8d06ba1741, State: Initialized, Role: FOLLOWER
I20260709 13:03:15.598776 10537 raft_consensus.cc:359] T e0ad84cc4e1942d99055ab43ea0bdac0 P 17d104ff42224d8c9cdf4c53a2152582 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:15.599130 10536 raft_consensus.cc:359] T 1484bae8a7264a0e9f328dd5ce7edad8 P 24479f93a03b4364837c81f7efbdf9d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:15.599584 10537 raft_consensus.cc:385] T e0ad84cc4e1942d99055ab43ea0bdac0 P 17d104ff42224d8c9cdf4c53a2152582 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:15.600026 10536 raft_consensus.cc:385] T 1484bae8a7264a0e9f328dd5ce7edad8 P 24479f93a03b4364837c81f7efbdf9d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:15.600108 10537 raft_consensus.cc:740] T e0ad84cc4e1942d99055ab43ea0bdac0 P 17d104ff42224d8c9cdf4c53a2152582 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17d104ff42224d8c9cdf4c53a2152582, State: Initialized, Role: FOLLOWER
I20260709 13:03:15.599138 10535 consensus_queue.cc:260] T b038dccd00b44161b10a08f5b963dd45 P 22139e7a5ea041588dd21a8d06ba1741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:15.600976 10537 consensus_queue.cc:260] T e0ad84cc4e1942d99055ab43ea0bdac0 P 17d104ff42224d8c9cdf4c53a2152582 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:15.600415 10536 raft_consensus.cc:740] T 1484bae8a7264a0e9f328dd5ce7edad8 P 24479f93a03b4364837c81f7efbdf9d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24479f93a03b4364837c81f7efbdf9d3, State: Initialized, Role: FOLLOWER
I20260709 13:03:15.602495 10536 consensus_queue.cc:260] T 1484bae8a7264a0e9f328dd5ce7edad8 P 24479f93a03b4364837c81f7efbdf9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:15.603447 10537 ts_tablet_manager.cc:1434] T e0ad84cc4e1942d99055ab43ea0bdac0 P 17d104ff42224d8c9cdf4c53a2152582: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:03:15.605502 10537 tablet_bootstrap.cc:492] T 77c2a758545e45e29d62d8d71ea3f43d P 17d104ff42224d8c9cdf4c53a2152582: Bootstrap starting.
I20260709 13:03:15.606455 10536 ts_tablet_manager.cc:1434] T 1484bae8a7264a0e9f328dd5ce7edad8 P 24479f93a03b4364837c81f7efbdf9d3: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:03:15.607669 10536 tablet_bootstrap.cc:492] T 2df7bfe151e349f1a30cd3142e13c021 P 24479f93a03b4364837c81f7efbdf9d3: Bootstrap starting.
I20260709 13:03:15.611894 10537 tablet_bootstrap.cc:654] T 77c2a758545e45e29d62d8d71ea3f43d P 17d104ff42224d8c9cdf4c53a2152582: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:15.604251 10535 ts_tablet_manager.cc:1434] T b038dccd00b44161b10a08f5b963dd45 P 22139e7a5ea041588dd21a8d06ba1741: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.002s
I20260709 13:03:15.614821 10536 tablet_bootstrap.cc:654] T 2df7bfe151e349f1a30cd3142e13c021 P 24479f93a03b4364837c81f7efbdf9d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:15.615429 10535 tablet_bootstrap.cc:492] T e0ad84cc4e1942d99055ab43ea0bdac0 P 22139e7a5ea041588dd21a8d06ba1741: Bootstrap starting.
I20260709 13:03:15.621856 10535 tablet_bootstrap.cc:654] T e0ad84cc4e1942d99055ab43ea0bdac0 P 22139e7a5ea041588dd21a8d06ba1741: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:15.622694 10537 tablet_bootstrap.cc:492] T 77c2a758545e45e29d62d8d71ea3f43d P 17d104ff42224d8c9cdf4c53a2152582: No bootstrap required, opened a new log
I20260709 13:03:15.622732 10536 tablet_bootstrap.cc:492] T 2df7bfe151e349f1a30cd3142e13c021 P 24479f93a03b4364837c81f7efbdf9d3: No bootstrap required, opened a new log
I20260709 13:03:15.623370 10537 ts_tablet_manager.cc:1403] T 77c2a758545e45e29d62d8d71ea3f43d P 17d104ff42224d8c9cdf4c53a2152582: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.002s
I20260709 13:03:15.623546 10536 ts_tablet_manager.cc:1403] T 2df7bfe151e349f1a30cd3142e13c021 P 24479f93a03b4364837c81f7efbdf9d3: Time spent bootstrapping tablet: real 0.016s	user 0.015s	sys 0.000s
I20260709 13:03:15.626735 10537 raft_consensus.cc:359] T 77c2a758545e45e29d62d8d71ea3f43d P 17d104ff42224d8c9cdf4c53a2152582 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:15.626808 10536 raft_consensus.cc:359] T 2df7bfe151e349f1a30cd3142e13c021 P 24479f93a03b4364837c81f7efbdf9d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:15.627691 10537 raft_consensus.cc:385] T 77c2a758545e45e29d62d8d71ea3f43d P 17d104ff42224d8c9cdf4c53a2152582 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:15.627765 10536 raft_consensus.cc:385] T 2df7bfe151e349f1a30cd3142e13c021 P 24479f93a03b4364837c81f7efbdf9d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:15.628001 10537 raft_consensus.cc:740] T 77c2a758545e45e29d62d8d71ea3f43d P 17d104ff42224d8c9cdf4c53a2152582 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17d104ff42224d8c9cdf4c53a2152582, State: Initialized, Role: FOLLOWER
I20260709 13:03:15.628225 10536 raft_consensus.cc:740] T 2df7bfe151e349f1a30cd3142e13c021 P 24479f93a03b4364837c81f7efbdf9d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24479f93a03b4364837c81f7efbdf9d3, State: Initialized, Role: FOLLOWER
I20260709 13:03:15.628445 10535 tablet_bootstrap.cc:492] T e0ad84cc4e1942d99055ab43ea0bdac0 P 22139e7a5ea041588dd21a8d06ba1741: No bootstrap required, opened a new log
I20260709 13:03:15.628966 10535 ts_tablet_manager.cc:1403] T e0ad84cc4e1942d99055ab43ea0bdac0 P 22139e7a5ea041588dd21a8d06ba1741: Time spent bootstrapping tablet: real 0.014s	user 0.007s	sys 0.004s
I20260709 13:03:15.628824 10537 consensus_queue.cc:260] T 77c2a758545e45e29d62d8d71ea3f43d P 17d104ff42224d8c9cdf4c53a2152582 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:15.629101 10536 consensus_queue.cc:260] T 2df7bfe151e349f1a30cd3142e13c021 P 24479f93a03b4364837c81f7efbdf9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:15.632289 10535 raft_consensus.cc:359] T e0ad84cc4e1942d99055ab43ea0bdac0 P 22139e7a5ea041588dd21a8d06ba1741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:15.633034 10535 raft_consensus.cc:385] T e0ad84cc4e1942d99055ab43ea0bdac0 P 22139e7a5ea041588dd21a8d06ba1741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:15.633338 10535 raft_consensus.cc:740] T e0ad84cc4e1942d99055ab43ea0bdac0 P 22139e7a5ea041588dd21a8d06ba1741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22139e7a5ea041588dd21a8d06ba1741, State: Initialized, Role: FOLLOWER
I20260709 13:03:15.633901 10536 ts_tablet_manager.cc:1434] T 2df7bfe151e349f1a30cd3142e13c021 P 24479f93a03b4364837c81f7efbdf9d3: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:03:15.634097 10535 consensus_queue.cc:260] T e0ad84cc4e1942d99055ab43ea0bdac0 P 22139e7a5ea041588dd21a8d06ba1741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:15.635059 10536 tablet_bootstrap.cc:492] T a848edc7d33e48a1a475daf70fb66449 P 24479f93a03b4364837c81f7efbdf9d3: Bootstrap starting.
I20260709 13:03:15.636077 10537 ts_tablet_manager.cc:1434] T 77c2a758545e45e29d62d8d71ea3f43d P 17d104ff42224d8c9cdf4c53a2152582: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:03:15.637246 10537 tablet_bootstrap.cc:492] T 2df7bfe151e349f1a30cd3142e13c021 P 17d104ff42224d8c9cdf4c53a2152582: Bootstrap starting.
I20260709 13:03:15.640383 10543 raft_consensus.cc:493] T e0ad84cc4e1942d99055ab43ea0bdac0 P 17d104ff42224d8c9cdf4c53a2152582 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.640959 10543 raft_consensus.cc:515] T e0ad84cc4e1942d99055ab43ea0bdac0 P 17d104ff42224d8c9cdf4c53a2152582 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:15.641953 10536 tablet_bootstrap.cc:654] T a848edc7d33e48a1a475daf70fb66449 P 24479f93a03b4364837c81f7efbdf9d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:15.643991 10537 tablet_bootstrap.cc:654] T 2df7bfe151e349f1a30cd3142e13c021 P 17d104ff42224d8c9cdf4c53a2152582: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:15.655779 10540 raft_consensus.cc:493] T e0ad84cc4e1942d99055ab43ea0bdac0 P 22139e7a5ea041588dd21a8d06ba1741 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.656493 10540 raft_consensus.cc:515] T e0ad84cc4e1942d99055ab43ea0bdac0 P 22139e7a5ea041588dd21a8d06ba1741 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:15.664187 10537 tablet_bootstrap.cc:492] T 2df7bfe151e349f1a30cd3142e13c021 P 17d104ff42224d8c9cdf4c53a2152582: No bootstrap required, opened a new log
I20260709 13:03:15.664944 10537 ts_tablet_manager.cc:1403] T 2df7bfe151e349f1a30cd3142e13c021 P 17d104ff42224d8c9cdf4c53a2152582: Time spent bootstrapping tablet: real 0.028s	user 0.012s	sys 0.013s
I20260709 13:03:15.664981 10421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0ad84cc4e1942d99055ab43ea0bdac0" candidate_uuid: "17d104ff42224d8c9cdf4c53a2152582" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24479f93a03b4364837c81f7efbdf9d3" is_pre_election: true
I20260709 13:03:15.665931 10421 raft_consensus.cc:2468] T e0ad84cc4e1942d99055ab43ea0bdac0 P 24479f93a03b4364837c81f7efbdf9d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17d104ff42224d8c9cdf4c53a2152582 in term 0.
I20260709 13:03:15.668824 10537 raft_consensus.cc:359] T 2df7bfe151e349f1a30cd3142e13c021 P 17d104ff42224d8c9cdf4c53a2152582 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:15.669889 10537 raft_consensus.cc:385] T 2df7bfe151e349f1a30cd3142e13c021 P 17d104ff42224d8c9cdf4c53a2152582 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:15.670399 10537 raft_consensus.cc:740] T 2df7bfe151e349f1a30cd3142e13c021 P 17d104ff42224d8c9cdf4c53a2152582 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17d104ff42224d8c9cdf4c53a2152582, State: Initialized, Role: FOLLOWER
I20260709 13:03:15.669931 10543 leader_election.cc:290] T e0ad84cc4e1942d99055ab43ea0bdac0 P 17d104ff42224d8c9cdf4c53a2152582 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22139e7a5ea041588dd21a8d06ba1741 (127.0.107.193:45479), 24479f93a03b4364837c81f7efbdf9d3 (127.0.107.194:44467)
I20260709 13:03:15.671099 10459 leader_election.cc:304] T e0ad84cc4e1942d99055ab43ea0bdac0 P 17d104ff42224d8c9cdf4c53a2152582 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17d104ff42224d8c9cdf4c53a2152582, 24479f93a03b4364837c81f7efbdf9d3; no voters: 
I20260709 13:03:15.671903 10540 leader_election.cc:290] T e0ad84cc4e1942d99055ab43ea0bdac0 P 22139e7a5ea041588dd21a8d06ba1741 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24479f93a03b4364837c81f7efbdf9d3 (127.0.107.194:44467), 17d104ff42224d8c9cdf4c53a2152582 (127.0.107.195:41601)
I20260709 13:03:15.671526 10537 consensus_queue.cc:260] T 2df7bfe151e349f1a30cd3142e13c021 P 17d104ff42224d8c9cdf4c53a2152582 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:15.672755 10543 raft_consensus.cc:2804] T e0ad84cc4e1942d99055ab43ea0bdac0 P 17d104ff42224d8c9cdf4c53a2152582 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:15.673177 10543 raft_consensus.cc:493] T e0ad84cc4e1942d99055ab43ea0bdac0 P 17d104ff42224d8c9cdf4c53a2152582 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:15.673553 10543 raft_consensus.cc:3060] T e0ad84cc4e1942d99055ab43ea0bdac0 P 17d104ff42224d8c9cdf4c53a2152582 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:15.689829 10535 ts_tablet_manager.cc:1434] T e0ad84cc4e1942d99055ab43ea0bdac0 P 22139e7a5ea041588dd21a8d06ba1741: Time spent starting tablet: real 0.060s	user 0.007s	sys 0.000s
I20260709 13:03:15.697853 10540 raft_consensus.cc:493] T 77c2a758545e45e29d62d8d71ea3f43d P 22139e7a5ea041588dd21a8d06ba1741 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.698593 10540 raft_consensus.cc:515] T 77c2a758545e45e29d62d8d71ea3f43d P 22139e7a5ea041588dd21a8d06ba1741 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:15.701175 10541 raft_consensus.cc:493] T 2df7bfe151e349f1a30cd3142e13c021 P 24479f93a03b4364837c81f7efbdf9d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.701871 10541 raft_consensus.cc:515] T 2df7bfe151e349f1a30cd3142e13c021 P 24479f93a03b4364837c81f7efbdf9d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:15.708933 10535 tablet_bootstrap.cc:492] T 89649f4e196f44a3b3b98fa009c228f8 P 22139e7a5ea041588dd21a8d06ba1741: Bootstrap starting.
I20260709 13:03:15.709697 10541 leader_election.cc:290] T 2df7bfe151e349f1a30cd3142e13c021 P 24479f93a03b4364837c81f7efbdf9d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22139e7a5ea041588dd21a8d06ba1741 (127.0.107.193:45479), 17d104ff42224d8c9cdf4c53a2152582 (127.0.107.195:41601)
I20260709 13:03:15.719619 10543 raft_consensus.cc:515] T e0ad84cc4e1942d99055ab43ea0bdac0 P 17d104ff42224d8c9cdf4c53a2152582 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:15.701292 10540 leader_election.cc:290] T 77c2a758545e45e29d62d8d71ea3f43d P 22139e7a5ea041588dd21a8d06ba1741 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24479f93a03b4364837c81f7efbdf9d3 (127.0.107.194:44467), 17d104ff42224d8c9cdf4c53a2152582 (127.0.107.195:41601)
I20260709 13:03:15.732411 10535 tablet_bootstrap.cc:654] T 89649f4e196f44a3b3b98fa009c228f8 P 22139e7a5ea041588dd21a8d06ba1741: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:15.722332 10543 leader_election.cc:290] T e0ad84cc4e1942d99055ab43ea0bdac0 P 17d104ff42224d8c9cdf4c53a2152582 [CANDIDATE]: Term 1 election: Requested vote from peers 22139e7a5ea041588dd21a8d06ba1741 (127.0.107.193:45479), 24479f93a03b4364837c81f7efbdf9d3 (127.0.107.194:44467)
I20260709 13:03:15.744963 10495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0ad84cc4e1942d99055ab43ea0bdac0" candidate_uuid: "22139e7a5ea041588dd21a8d06ba1741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17d104ff42224d8c9cdf4c53a2152582" is_pre_election: true
I20260709 13:03:15.746001 10495 raft_consensus.cc:2393] T e0ad84cc4e1942d99055ab43ea0bdac0 P 17d104ff42224d8c9cdf4c53a2152582 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22139e7a5ea041588dd21a8d06ba1741 in current term 1: Already voted for candidate 17d104ff42224d8c9cdf4c53a2152582 in this term.
I20260709 13:03:15.747231 10494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77c2a758545e45e29d62d8d71ea3f43d" candidate_uuid: "22139e7a5ea041588dd21a8d06ba1741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17d104ff42224d8c9cdf4c53a2152582" is_pre_election: true
I20260709 13:03:15.748037 10494 raft_consensus.cc:2468] T 77c2a758545e45e29d62d8d71ea3f43d P 17d104ff42224d8c9cdf4c53a2152582 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22139e7a5ea041588dd21a8d06ba1741 in term 0.
I20260709 13:03:15.748325 10421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0ad84cc4e1942d99055ab43ea0bdac0" candidate_uuid: "17d104ff42224d8c9cdf4c53a2152582" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24479f93a03b4364837c81f7efbdf9d3"
I20260709 13:03:15.748940 10421 raft_consensus.cc:3060] T e0ad84cc4e1942d99055ab43ea0bdac0 P 24479f93a03b4364837c81f7efbdf9d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:15.749948 10312 leader_election.cc:304] T 77c2a758545e45e29d62d8d71ea3f43d P 22139e7a5ea041588dd21a8d06ba1741 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17d104ff42224d8c9cdf4c53a2152582, 22139e7a5ea041588dd21a8d06ba1741; no voters: 
I20260709 13:03:15.753469 10536 tablet_bootstrap.cc:492] T a848edc7d33e48a1a475daf70fb66449 P 24479f93a03b4364837c81f7efbdf9d3: No bootstrap required, opened a new log
I20260709 13:03:15.754096 10536 ts_tablet_manager.cc:1403] T a848edc7d33e48a1a475daf70fb66449 P 24479f93a03b4364837c81f7efbdf9d3: Time spent bootstrapping tablet: real 0.119s	user 0.027s	sys 0.078s
I20260709 13:03:15.754873 10540 raft_consensus.cc:2804] T 77c2a758545e45e29d62d8d71ea3f43d P 22139e7a5ea041588dd21a8d06ba1741 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:15.755342 10540 raft_consensus.cc:493] T 77c2a758545e45e29d62d8d71ea3f43d P 22139e7a5ea041588dd21a8d06ba1741 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:15.755673 10540 raft_consensus.cc:3060] T 77c2a758545e45e29d62d8d71ea3f43d P 22139e7a5ea041588dd21a8d06ba1741 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:15.757191 10536 raft_consensus.cc:359] T a848edc7d33e48a1a475daf70fb66449 P 24479f93a03b4364837c81f7efbdf9d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } }
I20260709 13:03:15.758076 10536 raft_consensus.cc:385] T a848edc7d33e48a1a475daf70fb66449 P 24479f93a03b4364837c81f7efbdf9d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:15.758381 10536 raft_consensus.cc:740] T a848edc7d33e48a1a475daf70fb66449 P 24479f93a03b4364837c81f7efbdf9d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24479f93a03b4364837c81f7efbdf9d3, State: Initialized, Role: FOLLOWER
I20260709 13:03:15.759157 10536 consensus_queue.cc:260] T a848edc7d33e48a1a475daf70fb66449 P 24479f93a03b4364837c81f7efbdf9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } }
I20260709 13:03:15.761417 10536 ts_tablet_manager.cc:1434] T a848edc7d33e48a1a475daf70fb66449 P 24479f93a03b4364837c81f7efbdf9d3: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:03:15.762403 10536 tablet_bootstrap.cc:492] T afe8b130a0d1484e9f08fed8f6be2f61 P 24479f93a03b4364837c81f7efbdf9d3: Bootstrap starting.
I20260709 13:03:15.767488 10535 tablet_bootstrap.cc:492] T 89649f4e196f44a3b3b98fa009c228f8 P 22139e7a5ea041588dd21a8d06ba1741: No bootstrap required, opened a new log
I20260709 13:03:15.768213 10535 ts_tablet_manager.cc:1403] T 89649f4e196f44a3b3b98fa009c228f8 P 22139e7a5ea041588dd21a8d06ba1741: Time spent bootstrapping tablet: real 0.060s	user 0.010s	sys 0.006s
I20260709 13:03:15.768841 10536 tablet_bootstrap.cc:654] T afe8b130a0d1484e9f08fed8f6be2f61 P 24479f93a03b4364837c81f7efbdf9d3: Neither blocks nor log segments found. Creating new log.
W20260709 13:03:15.772403 10292 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:03:15.777016 10535 raft_consensus.cc:359] T 89649f4e196f44a3b3b98fa009c228f8 P 22139e7a5ea041588dd21a8d06ba1741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:15.777666 10421 raft_consensus.cc:2468] T e0ad84cc4e1942d99055ab43ea0bdac0 P 24479f93a03b4364837c81f7efbdf9d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17d104ff42224d8c9cdf4c53a2152582 in term 1.
I20260709 13:03:15.778012 10535 raft_consensus.cc:385] T 89649f4e196f44a3b3b98fa009c228f8 P 22139e7a5ea041588dd21a8d06ba1741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:15.778429 10535 raft_consensus.cc:740] T 89649f4e196f44a3b3b98fa009c228f8 P 22139e7a5ea041588dd21a8d06ba1741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22139e7a5ea041588dd21a8d06ba1741, State: Initialized, Role: FOLLOWER
I20260709 13:03:15.780402 10536 tablet_bootstrap.cc:492] T afe8b130a0d1484e9f08fed8f6be2f61 P 24479f93a03b4364837c81f7efbdf9d3: No bootstrap required, opened a new log
I20260709 13:03:15.781005 10536 ts_tablet_manager.cc:1403] T afe8b130a0d1484e9f08fed8f6be2f61 P 24479f93a03b4364837c81f7efbdf9d3: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.004s
I20260709 13:03:15.782814 10535 consensus_queue.cc:260] T 89649f4e196f44a3b3b98fa009c228f8 P 22139e7a5ea041588dd21a8d06ba1741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:15.783890 10536 raft_consensus.cc:359] T afe8b130a0d1484e9f08fed8f6be2f61 P 24479f93a03b4364837c81f7efbdf9d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:15.784752 10536 raft_consensus.cc:385] T afe8b130a0d1484e9f08fed8f6be2f61 P 24479f93a03b4364837c81f7efbdf9d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:15.785051 10536 raft_consensus.cc:740] T afe8b130a0d1484e9f08fed8f6be2f61 P 24479f93a03b4364837c81f7efbdf9d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24479f93a03b4364837c81f7efbdf9d3, State: Initialized, Role: FOLLOWER
I20260709 13:03:15.786039 10536 consensus_queue.cc:260] T afe8b130a0d1484e9f08fed8f6be2f61 P 24479f93a03b4364837c81f7efbdf9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:15.788303 10536 ts_tablet_manager.cc:1434] T afe8b130a0d1484e9f08fed8f6be2f61 P 24479f93a03b4364837c81f7efbdf9d3: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:03:15.789270 10536 tablet_bootstrap.cc:492] T b038dccd00b44161b10a08f5b963dd45 P 24479f93a03b4364837c81f7efbdf9d3: Bootstrap starting.
I20260709 13:03:15.795594 10536 tablet_bootstrap.cc:654] T b038dccd00b44161b10a08f5b963dd45 P 24479f93a03b4364837c81f7efbdf9d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:15.794215 10535 ts_tablet_manager.cc:1434] T 89649f4e196f44a3b3b98fa009c228f8 P 22139e7a5ea041588dd21a8d06ba1741: Time spent starting tablet: real 0.026s	user 0.009s	sys 0.002s
I20260709 13:03:15.800951 10535 tablet_bootstrap.cc:492] T 1484bae8a7264a0e9f328dd5ce7edad8 P 22139e7a5ea041588dd21a8d06ba1741: Bootstrap starting.
I20260709 13:03:15.812853 10459 leader_election.cc:304] T e0ad84cc4e1942d99055ab43ea0bdac0 P 17d104ff42224d8c9cdf4c53a2152582 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17d104ff42224d8c9cdf4c53a2152582, 24479f93a03b4364837c81f7efbdf9d3; no voters: 
I20260709 13:03:15.816298 10543 raft_consensus.cc:2804] T e0ad84cc4e1942d99055ab43ea0bdac0 P 17d104ff42224d8c9cdf4c53a2152582 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:15.816778 10543 raft_consensus.cc:697] T e0ad84cc4e1942d99055ab43ea0bdac0 P 17d104ff42224d8c9cdf4c53a2152582 [term 1 LEADER]: Becoming Leader. State: Replica: 17d104ff42224d8c9cdf4c53a2152582, State: Running, Role: LEADER
I20260709 13:03:15.817655 10543 consensus_queue.cc:237] T e0ad84cc4e1942d99055ab43ea0bdac0 P 17d104ff42224d8c9cdf4c53a2152582 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:15.818459 10537 ts_tablet_manager.cc:1434] T 2df7bfe151e349f1a30cd3142e13c021 P 17d104ff42224d8c9cdf4c53a2152582: Time spent starting tablet: real 0.153s	user 0.073s	sys 0.056s
I20260709 13:03:15.820284 10537 tablet_bootstrap.cc:492] T 89649f4e196f44a3b3b98fa009c228f8 P 17d104ff42224d8c9cdf4c53a2152582: Bootstrap starting.
I20260709 13:03:15.820976 10535 tablet_bootstrap.cc:654] T 1484bae8a7264a0e9f328dd5ce7edad8 P 22139e7a5ea041588dd21a8d06ba1741: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:15.826752 10536 tablet_bootstrap.cc:492] T b038dccd00b44161b10a08f5b963dd45 P 24479f93a03b4364837c81f7efbdf9d3: No bootstrap required, opened a new log
I20260709 13:03:15.827111 10420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77c2a758545e45e29d62d8d71ea3f43d" candidate_uuid: "22139e7a5ea041588dd21a8d06ba1741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24479f93a03b4364837c81f7efbdf9d3" is_pre_election: true
I20260709 13:03:15.827414 10536 ts_tablet_manager.cc:1403] T b038dccd00b44161b10a08f5b963dd45 P 24479f93a03b4364837c81f7efbdf9d3: Time spent bootstrapping tablet: real 0.038s	user 0.006s	sys 0.011s
I20260709 13:03:15.828680 10421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0ad84cc4e1942d99055ab43ea0bdac0" candidate_uuid: "22139e7a5ea041588dd21a8d06ba1741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24479f93a03b4364837c81f7efbdf9d3" is_pre_election: true
I20260709 13:03:15.829249 10346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0ad84cc4e1942d99055ab43ea0bdac0" candidate_uuid: "17d104ff42224d8c9cdf4c53a2152582" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22139e7a5ea041588dd21a8d06ba1741" is_pre_election: true
I20260709 13:03:15.829981 10346 raft_consensus.cc:2468] T e0ad84cc4e1942d99055ab43ea0bdac0 P 22139e7a5ea041588dd21a8d06ba1741 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17d104ff42224d8c9cdf4c53a2152582 in term 0.
I20260709 13:03:15.830125 10537 tablet_bootstrap.cc:654] T 89649f4e196f44a3b3b98fa009c228f8 P 17d104ff42224d8c9cdf4c53a2152582: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:15.830792 10344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2df7bfe151e349f1a30cd3142e13c021" candidate_uuid: "24479f93a03b4364837c81f7efbdf9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22139e7a5ea041588dd21a8d06ba1741" is_pre_election: true
I20260709 13:03:15.829533 10421 raft_consensus.cc:2393] T e0ad84cc4e1942d99055ab43ea0bdac0 P 24479f93a03b4364837c81f7efbdf9d3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22139e7a5ea041588dd21a8d06ba1741 in current term 1: Already voted for candidate 17d104ff42224d8c9cdf4c53a2152582 in this term.
I20260709 13:03:15.831313 10536 raft_consensus.cc:359] T b038dccd00b44161b10a08f5b963dd45 P 24479f93a03b4364837c81f7efbdf9d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:15.832142 10536 raft_consensus.cc:385] T b038dccd00b44161b10a08f5b963dd45 P 24479f93a03b4364837c81f7efbdf9d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:15.832479 10536 raft_consensus.cc:740] T b038dccd00b44161b10a08f5b963dd45 P 24479f93a03b4364837c81f7efbdf9d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24479f93a03b4364837c81f7efbdf9d3, State: Initialized, Role: FOLLOWER
W20260709 13:03:15.832968 10384 leader_election.cc:343] T 2df7bfe151e349f1a30cd3142e13c021 P 24479f93a03b4364837c81f7efbdf9d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22139e7a5ea041588dd21a8d06ba1741 (127.0.107.193:45479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:15.831171 10345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0ad84cc4e1942d99055ab43ea0bdac0" candidate_uuid: "17d104ff42224d8c9cdf4c53a2152582" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22139e7a5ea041588dd21a8d06ba1741"
I20260709 13:03:15.833129 10310 leader_election.cc:304] T e0ad84cc4e1942d99055ab43ea0bdac0 P 22139e7a5ea041588dd21a8d06ba1741 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22139e7a5ea041588dd21a8d06ba1741; no voters: 17d104ff42224d8c9cdf4c53a2152582, 24479f93a03b4364837c81f7efbdf9d3
I20260709 13:03:15.827956 10420 raft_consensus.cc:2468] T 77c2a758545e45e29d62d8d71ea3f43d P 24479f93a03b4364837c81f7efbdf9d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22139e7a5ea041588dd21a8d06ba1741 in term 0.
I20260709 13:03:15.834028 10345 raft_consensus.cc:3060] T e0ad84cc4e1942d99055ab43ea0bdac0 P 22139e7a5ea041588dd21a8d06ba1741 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:15.833204 10536 consensus_queue.cc:260] T b038dccd00b44161b10a08f5b963dd45 P 24479f93a03b4364837c81f7efbdf9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:15.838546 10536 ts_tablet_manager.cc:1434] T b038dccd00b44161b10a08f5b963dd45 P 24479f93a03b4364837c81f7efbdf9d3: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 13:03:15.814705 10540 raft_consensus.cc:515] T 77c2a758545e45e29d62d8d71ea3f43d P 22139e7a5ea041588dd21a8d06ba1741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:15.844491 10345 raft_consensus.cc:2468] T e0ad84cc4e1942d99055ab43ea0bdac0 P 22139e7a5ea041588dd21a8d06ba1741 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17d104ff42224d8c9cdf4c53a2152582 in term 1.
I20260709 13:03:15.845412 10563 raft_consensus.cc:2749] T e0ad84cc4e1942d99055ab43ea0bdac0 P 22139e7a5ea041588dd21a8d06ba1741 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:15.845993 10540 leader_election.cc:290] T 77c2a758545e45e29d62d8d71ea3f43d P 22139e7a5ea041588dd21a8d06ba1741 [CANDIDATE]: Term 1 election: Requested vote from peers 24479f93a03b4364837c81f7efbdf9d3 (127.0.107.194:44467), 17d104ff42224d8c9cdf4c53a2152582 (127.0.107.195:41601)
I20260709 13:03:15.847287 10494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77c2a758545e45e29d62d8d71ea3f43d" candidate_uuid: "22139e7a5ea041588dd21a8d06ba1741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17d104ff42224d8c9cdf4c53a2152582"
I20260709 13:03:15.847942 10494 raft_consensus.cc:3060] T 77c2a758545e45e29d62d8d71ea3f43d P 17d104ff42224d8c9cdf4c53a2152582 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:15.850956 10495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2df7bfe151e349f1a30cd3142e13c021" candidate_uuid: "24479f93a03b4364837c81f7efbdf9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17d104ff42224d8c9cdf4c53a2152582" is_pre_election: true
I20260709 13:03:15.847925 10420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77c2a758545e45e29d62d8d71ea3f43d" candidate_uuid: "22139e7a5ea041588dd21a8d06ba1741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24479f93a03b4364837c81f7efbdf9d3"
I20260709 13:03:15.851680 10495 raft_consensus.cc:2468] T 2df7bfe151e349f1a30cd3142e13c021 P 17d104ff42224d8c9cdf4c53a2152582 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24479f93a03b4364837c81f7efbdf9d3 in term 0.
I20260709 13:03:15.851917 10536 tablet_bootstrap.cc:492] T 89649f4e196f44a3b3b98fa009c228f8 P 24479f93a03b4364837c81f7efbdf9d3: Bootstrap starting.
I20260709 13:03:15.851825 10420 raft_consensus.cc:3060] T 77c2a758545e45e29d62d8d71ea3f43d P 24479f93a03b4364837c81f7efbdf9d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:15.857547 10494 raft_consensus.cc:2468] T 77c2a758545e45e29d62d8d71ea3f43d P 17d104ff42224d8c9cdf4c53a2152582 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22139e7a5ea041588dd21a8d06ba1741 in term 1.
I20260709 13:03:15.859486 10312 leader_election.cc:304] T 77c2a758545e45e29d62d8d71ea3f43d P 22139e7a5ea041588dd21a8d06ba1741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17d104ff42224d8c9cdf4c53a2152582, 22139e7a5ea041588dd21a8d06ba1741; no voters: 
I20260709 13:03:15.860380 10563 raft_consensus.cc:2804] T 77c2a758545e45e29d62d8d71ea3f43d P 22139e7a5ea041588dd21a8d06ba1741 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:15.860909 10563 raft_consensus.cc:697] T 77c2a758545e45e29d62d8d71ea3f43d P 22139e7a5ea041588dd21a8d06ba1741 [term 1 LEADER]: Becoming Leader. State: Replica: 22139e7a5ea041588dd21a8d06ba1741, State: Running, Role: LEADER
I20260709 13:03:15.862043 10536 tablet_bootstrap.cc:654] T 89649f4e196f44a3b3b98fa009c228f8 P 24479f93a03b4364837c81f7efbdf9d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:15.861770 10563 consensus_queue.cc:237] T 77c2a758545e45e29d62d8d71ea3f43d P 22139e7a5ea041588dd21a8d06ba1741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:15.860900 10387 leader_election.cc:304] T 2df7bfe151e349f1a30cd3142e13c021 P 24479f93a03b4364837c81f7efbdf9d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17d104ff42224d8c9cdf4c53a2152582, 24479f93a03b4364837c81f7efbdf9d3; no voters: 22139e7a5ea041588dd21a8d06ba1741
I20260709 13:03:15.864691 10541 raft_consensus.cc:2804] T 2df7bfe151e349f1a30cd3142e13c021 P 24479f93a03b4364837c81f7efbdf9d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:15.865065 10541 raft_consensus.cc:493] T 2df7bfe151e349f1a30cd3142e13c021 P 24479f93a03b4364837c81f7efbdf9d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:15.865408 10541 raft_consensus.cc:3060] T 2df7bfe151e349f1a30cd3142e13c021 P 24479f93a03b4364837c81f7efbdf9d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:15.871052 10537 tablet_bootstrap.cc:492] T 89649f4e196f44a3b3b98fa009c228f8 P 17d104ff42224d8c9cdf4c53a2152582: No bootstrap required, opened a new log
I20260709 13:03:15.871795 10537 ts_tablet_manager.cc:1403] T 89649f4e196f44a3b3b98fa009c228f8 P 17d104ff42224d8c9cdf4c53a2152582: Time spent bootstrapping tablet: real 0.052s	user 0.018s	sys 0.007s
I20260709 13:03:15.873507 10535 tablet_bootstrap.cc:492] T 1484bae8a7264a0e9f328dd5ce7edad8 P 22139e7a5ea041588dd21a8d06ba1741: No bootstrap required, opened a new log
I20260709 13:03:15.874258 10535 ts_tablet_manager.cc:1403] T 1484bae8a7264a0e9f328dd5ce7edad8 P 22139e7a5ea041588dd21a8d06ba1741: Time spent bootstrapping tablet: real 0.074s	user 0.008s	sys 0.006s
I20260709 13:03:15.874814 10537 raft_consensus.cc:359] T 89649f4e196f44a3b3b98fa009c228f8 P 17d104ff42224d8c9cdf4c53a2152582 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:15.875623 10537 raft_consensus.cc:385] T 89649f4e196f44a3b3b98fa009c228f8 P 17d104ff42224d8c9cdf4c53a2152582 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:15.875917 10537 raft_consensus.cc:740] T 89649f4e196f44a3b3b98fa009c228f8 P 17d104ff42224d8c9cdf4c53a2152582 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17d104ff42224d8c9cdf4c53a2152582, State: Initialized, Role: FOLLOWER
I20260709 13:03:15.876247 10541 raft_consensus.cc:515] T 2df7bfe151e349f1a30cd3142e13c021 P 24479f93a03b4364837c81f7efbdf9d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:15.876963 10537 consensus_queue.cc:260] T 89649f4e196f44a3b3b98fa009c228f8 P 17d104ff42224d8c9cdf4c53a2152582 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:15.878791 10557 raft_consensus.cc:493] T a848edc7d33e48a1a475daf70fb66449 P 17d104ff42224d8c9cdf4c53a2152582 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.879309 10345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2df7bfe151e349f1a30cd3142e13c021" candidate_uuid: "24479f93a03b4364837c81f7efbdf9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22139e7a5ea041588dd21a8d06ba1741"
I20260709 13:03:15.879348 10557 raft_consensus.cc:515] T a848edc7d33e48a1a475daf70fb66449 P 17d104ff42224d8c9cdf4c53a2152582 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } }
I20260709 13:03:15.882813 10557 leader_election.cc:290] T a848edc7d33e48a1a475daf70fb66449 P 17d104ff42224d8c9cdf4c53a2152582 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22139e7a5ea041588dd21a8d06ba1741 (127.0.107.193:45479), 24479f93a03b4364837c81f7efbdf9d3 (127.0.107.194:44467)
I20260709 13:03:15.883229 10541 leader_election.cc:290] T 2df7bfe151e349f1a30cd3142e13c021 P 24479f93a03b4364837c81f7efbdf9d3 [CANDIDATE]: Term 1 election: Requested vote from peers 22139e7a5ea041588dd21a8d06ba1741 (127.0.107.193:45479), 17d104ff42224d8c9cdf4c53a2152582 (127.0.107.195:41601)
I20260709 13:03:15.879426 10537 ts_tablet_manager.cc:1434] T 89649f4e196f44a3b3b98fa009c228f8 P 17d104ff42224d8c9cdf4c53a2152582: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:03:15.888137 10494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2df7bfe151e349f1a30cd3142e13c021" candidate_uuid: "24479f93a03b4364837c81f7efbdf9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17d104ff42224d8c9cdf4c53a2152582"
I20260709 13:03:15.888430 10537 tablet_bootstrap.cc:492] T b038dccd00b44161b10a08f5b963dd45 P 17d104ff42224d8c9cdf4c53a2152582: Bootstrap starting.
I20260709 13:03:15.884460 10421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a848edc7d33e48a1a475daf70fb66449" candidate_uuid: "17d104ff42224d8c9cdf4c53a2152582" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24479f93a03b4364837c81f7efbdf9d3" is_pre_election: true
I20260709 13:03:15.889241 10421 raft_consensus.cc:2468] T a848edc7d33e48a1a475daf70fb66449 P 24479f93a03b4364837c81f7efbdf9d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17d104ff42224d8c9cdf4c53a2152582 in term 0.
I20260709 13:03:15.888968 10244 catalog_manager.cc:5697] T 77c2a758545e45e29d62d8d71ea3f43d P 22139e7a5ea041588dd21a8d06ba1741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 22139e7a5ea041588dd21a8d06ba1741 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "22139e7a5ea041588dd21a8d06ba1741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:15.890292 10540 raft_consensus.cc:493] T b038dccd00b44161b10a08f5b963dd45 P 22139e7a5ea041588dd21a8d06ba1741 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.890826 10540 raft_consensus.cc:515] T b038dccd00b44161b10a08f5b963dd45 P 22139e7a5ea041588dd21a8d06ba1741 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:15.891428 10241 catalog_manager.cc:5697] T e0ad84cc4e1942d99055ab43ea0bdac0 P 17d104ff42224d8c9cdf4c53a2152582 reported cstate change: term changed from 0 to 1, leader changed from <none> to 17d104ff42224d8c9cdf4c53a2152582 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "17d104ff42224d8c9cdf4c53a2152582" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:15.894423 10495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b038dccd00b44161b10a08f5b963dd45" candidate_uuid: "22139e7a5ea041588dd21a8d06ba1741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17d104ff42224d8c9cdf4c53a2152582" is_pre_election: true
W20260709 13:03:15.896329 10312 leader_election.cc:343] T b038dccd00b44161b10a08f5b963dd45 P 22139e7a5ea041588dd21a8d06ba1741 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17d104ff42224d8c9cdf4c53a2152582 (127.0.107.195:41601): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:15.896863 10536 tablet_bootstrap.cc:492] T 89649f4e196f44a3b3b98fa009c228f8 P 24479f93a03b4364837c81f7efbdf9d3: No bootstrap required, opened a new log
I20260709 13:03:15.896886 10537 tablet_bootstrap.cc:654] T b038dccd00b44161b10a08f5b963dd45 P 17d104ff42224d8c9cdf4c53a2152582: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:15.897594 10536 ts_tablet_manager.cc:1403] T 89649f4e196f44a3b3b98fa009c228f8 P 24479f93a03b4364837c81f7efbdf9d3: Time spent bootstrapping tablet: real 0.046s	user 0.013s	sys 0.016s
I20260709 13:03:15.888820 10494 raft_consensus.cc:3060] T 2df7bfe151e349f1a30cd3142e13c021 P 17d104ff42224d8c9cdf4c53a2152582 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:15.900780 10536 raft_consensus.cc:359] T 89649f4e196f44a3b3b98fa009c228f8 P 24479f93a03b4364837c81f7efbdf9d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:15.901569 10536 raft_consensus.cc:385] T 89649f4e196f44a3b3b98fa009c228f8 P 24479f93a03b4364837c81f7efbdf9d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:15.901849 10536 raft_consensus.cc:740] T 89649f4e196f44a3b3b98fa009c228f8 P 24479f93a03b4364837c81f7efbdf9d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24479f93a03b4364837c81f7efbdf9d3, State: Initialized, Role: FOLLOWER
I20260709 13:03:15.902884 10536 consensus_queue.cc:260] T 89649f4e196f44a3b3b98fa009c228f8 P 24479f93a03b4364837c81f7efbdf9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:15.906785 10563 raft_consensus.cc:493] T a848edc7d33e48a1a475daf70fb66449 P 22139e7a5ea041588dd21a8d06ba1741 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.907500 10563 raft_consensus.cc:515] T a848edc7d33e48a1a475daf70fb66449 P 22139e7a5ea041588dd21a8d06ba1741 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } }
I20260709 13:03:15.910032 10563 leader_election.cc:290] T a848edc7d33e48a1a475daf70fb66449 P 22139e7a5ea041588dd21a8d06ba1741 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17d104ff42224d8c9cdf4c53a2152582 (127.0.107.195:41601), 24479f93a03b4364837c81f7efbdf9d3 (127.0.107.194:44467)
I20260709 13:03:15.912047 10495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a848edc7d33e48a1a475daf70fb66449" candidate_uuid: "22139e7a5ea041588dd21a8d06ba1741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17d104ff42224d8c9cdf4c53a2152582" is_pre_election: true
I20260709 13:03:15.912937 10495 raft_consensus.cc:2468] T a848edc7d33e48a1a475daf70fb66449 P 17d104ff42224d8c9cdf4c53a2152582 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22139e7a5ea041588dd21a8d06ba1741 in term 0.
I20260709 13:03:15.914414 10536 ts_tablet_manager.cc:1434] T 89649f4e196f44a3b3b98fa009c228f8 P 24479f93a03b4364837c81f7efbdf9d3: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:03:15.919337 10536 tablet_bootstrap.cc:492] T 4feb1aa9b1d14601b28b28a6d515ee65 P 24479f93a03b4364837c81f7efbdf9d3: Bootstrap starting.
I20260709 13:03:15.919701 10312 leader_election.cc:304] T a848edc7d33e48a1a475daf70fb66449 P 22139e7a5ea041588dd21a8d06ba1741 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17d104ff42224d8c9cdf4c53a2152582, 22139e7a5ea041588dd21a8d06ba1741; no voters: 
I20260709 13:03:15.921025 10563 raft_consensus.cc:2804] T a848edc7d33e48a1a475daf70fb66449 P 22139e7a5ea041588dd21a8d06ba1741 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:15.921489 10563 raft_consensus.cc:493] T a848edc7d33e48a1a475daf70fb66449 P 22139e7a5ea041588dd21a8d06ba1741 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:15.921841 10563 raft_consensus.cc:3060] T a848edc7d33e48a1a475daf70fb66449 P 22139e7a5ea041588dd21a8d06ba1741 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:15.925501 10536 tablet_bootstrap.cc:654] T 4feb1aa9b1d14601b28b28a6d515ee65 P 24479f93a03b4364837c81f7efbdf9d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:15.897678 10540 leader_election.cc:290] T b038dccd00b44161b10a08f5b963dd45 P 22139e7a5ea041588dd21a8d06ba1741 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24479f93a03b4364837c81f7efbdf9d3 (127.0.107.194:44467), 17d104ff42224d8c9cdf4c53a2152582 (127.0.107.195:41601)
I20260709 13:03:15.885664 10420 raft_consensus.cc:2468] T 77c2a758545e45e29d62d8d71ea3f43d P 24479f93a03b4364837c81f7efbdf9d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22139e7a5ea041588dd21a8d06ba1741 in term 1.
I20260709 13:03:15.885829 10345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a848edc7d33e48a1a475daf70fb66449" candidate_uuid: "17d104ff42224d8c9cdf4c53a2152582" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22139e7a5ea041588dd21a8d06ba1741" is_pre_election: true
W20260709 13:03:15.886411 10384 leader_election.cc:343] T 2df7bfe151e349f1a30cd3142e13c021 P 24479f93a03b4364837c81f7efbdf9d3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 22139e7a5ea041588dd21a8d06ba1741 (127.0.107.193:45479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:15.886731 10535 raft_consensus.cc:359] T 1484bae8a7264a0e9f328dd5ce7edad8 P 22139e7a5ea041588dd21a8d06ba1741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:15.931881 10535 raft_consensus.cc:385] T 1484bae8a7264a0e9f328dd5ce7edad8 P 22139e7a5ea041588dd21a8d06ba1741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:03:15.931826 10384 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45479, user_credentials={real_user=slave}} blocked reactor thread for 45443.2us
I20260709 13:03:15.932556 10535 raft_consensus.cc:740] T 1484bae8a7264a0e9f328dd5ce7edad8 P 22139e7a5ea041588dd21a8d06ba1741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22139e7a5ea041588dd21a8d06ba1741, State: Initialized, Role: FOLLOWER
I20260709 13:03:15.933470 10535 consensus_queue.cc:260] T 1484bae8a7264a0e9f328dd5ce7edad8 P 22139e7a5ea041588dd21a8d06ba1741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:15.934293 10459 leader_election.cc:304] T a848edc7d33e48a1a475daf70fb66449 P 17d104ff42224d8c9cdf4c53a2152582 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17d104ff42224d8c9cdf4c53a2152582, 24479f93a03b4364837c81f7efbdf9d3; no voters: 
I20260709 13:03:15.935335 10543 raft_consensus.cc:2804] T a848edc7d33e48a1a475daf70fb66449 P 17d104ff42224d8c9cdf4c53a2152582 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:15.935709 10543 raft_consensus.cc:493] T a848edc7d33e48a1a475daf70fb66449 P 17d104ff42224d8c9cdf4c53a2152582 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:15.936040 10543 raft_consensus.cc:3060] T a848edc7d33e48a1a475daf70fb66449 P 17d104ff42224d8c9cdf4c53a2152582 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:15.935984 10535 ts_tablet_manager.cc:1434] T 1484bae8a7264a0e9f328dd5ce7edad8 P 22139e7a5ea041588dd21a8d06ba1741: Time spent starting tablet: real 0.061s	user 0.003s	sys 0.004s
I20260709 13:03:15.937685 10535 tablet_bootstrap.cc:492] T 4feb1aa9b1d14601b28b28a6d515ee65 P 22139e7a5ea041588dd21a8d06ba1741: Bootstrap starting.
I20260709 13:03:15.938282 10536 tablet_bootstrap.cc:492] T 4feb1aa9b1d14601b28b28a6d515ee65 P 24479f93a03b4364837c81f7efbdf9d3: No bootstrap required, opened a new log
I20260709 13:03:15.938135 10421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b038dccd00b44161b10a08f5b963dd45" candidate_uuid: "22139e7a5ea041588dd21a8d06ba1741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24479f93a03b4364837c81f7efbdf9d3" is_pre_election: true
I20260709 13:03:15.938948 10536 ts_tablet_manager.cc:1403] T 4feb1aa9b1d14601b28b28a6d515ee65 P 24479f93a03b4364837c81f7efbdf9d3: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.005s
I20260709 13:03:15.939060 10421 raft_consensus.cc:2468] T b038dccd00b44161b10a08f5b963dd45 P 24479f93a03b4364837c81f7efbdf9d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22139e7a5ea041588dd21a8d06ba1741 in term 0.
I20260709 13:03:15.940752 10310 leader_election.cc:304] T b038dccd00b44161b10a08f5b963dd45 P 22139e7a5ea041588dd21a8d06ba1741 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22139e7a5ea041588dd21a8d06ba1741, 24479f93a03b4364837c81f7efbdf9d3; no voters: 17d104ff42224d8c9cdf4c53a2152582
I20260709 13:03:15.941818 10536 raft_consensus.cc:359] T 4feb1aa9b1d14601b28b28a6d515ee65 P 24479f93a03b4364837c81f7efbdf9d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:15.942255 10541 raft_consensus.cc:493] T 1484bae8a7264a0e9f328dd5ce7edad8 P 24479f93a03b4364837c81f7efbdf9d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.942596 10536 raft_consensus.cc:385] T 4feb1aa9b1d14601b28b28a6d515ee65 P 24479f93a03b4364837c81f7efbdf9d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:15.943840 10536 raft_consensus.cc:740] T 4feb1aa9b1d14601b28b28a6d515ee65 P 24479f93a03b4364837c81f7efbdf9d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24479f93a03b4364837c81f7efbdf9d3, State: Initialized, Role: FOLLOWER
I20260709 13:03:15.942924 10541 raft_consensus.cc:515] T 1484bae8a7264a0e9f328dd5ce7edad8 P 24479f93a03b4364837c81f7efbdf9d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:15.944564 10536 consensus_queue.cc:260] T 4feb1aa9b1d14601b28b28a6d515ee65 P 24479f93a03b4364837c81f7efbdf9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:15.945237 10535 tablet_bootstrap.cc:654] T 4feb1aa9b1d14601b28b28a6d515ee65 P 22139e7a5ea041588dd21a8d06ba1741: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:15.946746 10541 leader_election.cc:290] T 1484bae8a7264a0e9f328dd5ce7edad8 P 24479f93a03b4364837c81f7efbdf9d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22139e7a5ea041588dd21a8d06ba1741 (127.0.107.193:45479), 17d104ff42224d8c9cdf4c53a2152582 (127.0.107.195:41601)
I20260709 13:03:15.949623 10346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1484bae8a7264a0e9f328dd5ce7edad8" candidate_uuid: "24479f93a03b4364837c81f7efbdf9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22139e7a5ea041588dd21a8d06ba1741" is_pre_election: true
I20260709 13:03:15.950251 10494 raft_consensus.cc:2468] T 2df7bfe151e349f1a30cd3142e13c021 P 17d104ff42224d8c9cdf4c53a2152582 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24479f93a03b4364837c81f7efbdf9d3 in term 1.
I20260709 13:03:15.950320 10346 raft_consensus.cc:2468] T 1484bae8a7264a0e9f328dd5ce7edad8 P 22139e7a5ea041588dd21a8d06ba1741 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24479f93a03b4364837c81f7efbdf9d3 in term 0.
I20260709 13:03:15.951107 10495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1484bae8a7264a0e9f328dd5ce7edad8" candidate_uuid: "24479f93a03b4364837c81f7efbdf9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17d104ff42224d8c9cdf4c53a2152582" is_pre_election: true
I20260709 13:03:15.951823 10384 leader_election.cc:304] T 1484bae8a7264a0e9f328dd5ce7edad8 P 24479f93a03b4364837c81f7efbdf9d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22139e7a5ea041588dd21a8d06ba1741, 24479f93a03b4364837c81f7efbdf9d3; no voters: 
W20260709 13:03:15.952628 10387 leader_election.cc:343] T 1484bae8a7264a0e9f328dd5ce7edad8 P 24479f93a03b4364837c81f7efbdf9d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17d104ff42224d8c9cdf4c53a2152582 (127.0.107.195:41601): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:15.953702 10419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a848edc7d33e48a1a475daf70fb66449" candidate_uuid: "22139e7a5ea041588dd21a8d06ba1741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24479f93a03b4364837c81f7efbdf9d3" is_pre_election: true
I20260709 13:03:15.954475 10419 raft_consensus.cc:2468] T a848edc7d33e48a1a475daf70fb66449 P 24479f93a03b4364837c81f7efbdf9d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22139e7a5ea041588dd21a8d06ba1741 in term 0.
I20260709 13:03:15.954553 10387 leader_election.cc:304] T 2df7bfe151e349f1a30cd3142e13c021 P 24479f93a03b4364837c81f7efbdf9d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17d104ff42224d8c9cdf4c53a2152582, 24479f93a03b4364837c81f7efbdf9d3; no voters: 22139e7a5ea041588dd21a8d06ba1741
I20260709 13:03:15.953956 10541 raft_consensus.cc:2804] T 1484bae8a7264a0e9f328dd5ce7edad8 P 24479f93a03b4364837c81f7efbdf9d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:15.956943 10541 raft_consensus.cc:493] T 1484bae8a7264a0e9f328dd5ce7edad8 P 24479f93a03b4364837c81f7efbdf9d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:15.957394 10541 raft_consensus.cc:3060] T 1484bae8a7264a0e9f328dd5ce7edad8 P 24479f93a03b4364837c81f7efbdf9d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:15.962112 10535 tablet_bootstrap.cc:492] T 4feb1aa9b1d14601b28b28a6d515ee65 P 22139e7a5ea041588dd21a8d06ba1741: No bootstrap required, opened a new log
I20260709 13:03:15.943203 10540 raft_consensus.cc:2804] T b038dccd00b44161b10a08f5b963dd45 P 22139e7a5ea041588dd21a8d06ba1741 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:15.949400 10543 raft_consensus.cc:515] T a848edc7d33e48a1a475daf70fb66449 P 17d104ff42224d8c9cdf4c53a2152582 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } }
I20260709 13:03:15.964798 10537 tablet_bootstrap.cc:492] T b038dccd00b44161b10a08f5b963dd45 P 17d104ff42224d8c9cdf4c53a2152582: No bootstrap required, opened a new log
I20260709 13:03:15.966316 10540 raft_consensus.cc:493] T b038dccd00b44161b10a08f5b963dd45 P 22139e7a5ea041588dd21a8d06ba1741 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:15.968189 10540 raft_consensus.cc:3060] T b038dccd00b44161b10a08f5b963dd45 P 22139e7a5ea041588dd21a8d06ba1741 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:15.968194 10535 ts_tablet_manager.cc:1403] T 4feb1aa9b1d14601b28b28a6d515ee65 P 22139e7a5ea041588dd21a8d06ba1741: Time spent bootstrapping tablet: real 0.031s	user 0.012s	sys 0.004s
I20260709 13:03:15.975045 10346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a848edc7d33e48a1a475daf70fb66449" candidate_uuid: "17d104ff42224d8c9cdf4c53a2152582" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22139e7a5ea041588dd21a8d06ba1741"
I20260709 13:03:15.979513 10536 ts_tablet_manager.cc:1434] T 4feb1aa9b1d14601b28b28a6d515ee65 P 24479f93a03b4364837c81f7efbdf9d3: Time spent starting tablet: real 0.040s	user 0.009s	sys 0.015s
I20260709 13:03:15.973210 10543 leader_election.cc:290] T a848edc7d33e48a1a475daf70fb66449 P 17d104ff42224d8c9cdf4c53a2152582 [CANDIDATE]: Term 1 election: Requested vote from peers 22139e7a5ea041588dd21a8d06ba1741 (127.0.107.193:45479), 24479f93a03b4364837c81f7efbdf9d3 (127.0.107.194:44467)
I20260709 13:03:15.971395 10541 raft_consensus.cc:515] T 1484bae8a7264a0e9f328dd5ce7edad8 P 24479f93a03b4364837c81f7efbdf9d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:15.982229 10535 raft_consensus.cc:359] T 4feb1aa9b1d14601b28b28a6d515ee65 P 22139e7a5ea041588dd21a8d06ba1741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:15.983533 10535 raft_consensus.cc:385] T 4feb1aa9b1d14601b28b28a6d515ee65 P 22139e7a5ea041588dd21a8d06ba1741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:15.983939 10535 raft_consensus.cc:740] T 4feb1aa9b1d14601b28b28a6d515ee65 P 22139e7a5ea041588dd21a8d06ba1741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22139e7a5ea041588dd21a8d06ba1741, State: Initialized, Role: FOLLOWER
I20260709 13:03:15.984849 10346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1484bae8a7264a0e9f328dd5ce7edad8" candidate_uuid: "24479f93a03b4364837c81f7efbdf9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22139e7a5ea041588dd21a8d06ba1741"
I20260709 13:03:15.976025 10420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a848edc7d33e48a1a475daf70fb66449" candidate_uuid: "17d104ff42224d8c9cdf4c53a2152582" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24479f93a03b4364837c81f7efbdf9d3"
I20260709 13:03:15.985634 10420 raft_consensus.cc:3060] T a848edc7d33e48a1a475daf70fb66449 P 24479f93a03b4364837c81f7efbdf9d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:15.985558 10346 raft_consensus.cc:3060] T 1484bae8a7264a0e9f328dd5ce7edad8 P 22139e7a5ea041588dd21a8d06ba1741 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:15.978001 10540 raft_consensus.cc:515] T b038dccd00b44161b10a08f5b963dd45 P 22139e7a5ea041588dd21a8d06ba1741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:15.987882 10536 tablet_bootstrap.cc:492] T 19c2daa20bbe47afa5289e2b32987709 P 24479f93a03b4364837c81f7efbdf9d3: Bootstrap starting.
I20260709 13:03:15.988970 10541 leader_election.cc:290] T 1484bae8a7264a0e9f328dd5ce7edad8 P 24479f93a03b4364837c81f7efbdf9d3 [CANDIDATE]: Term 1 election: Requested vote from peers 22139e7a5ea041588dd21a8d06ba1741 (127.0.107.193:45479), 17d104ff42224d8c9cdf4c53a2152582 (127.0.107.195:41601)
I20260709 13:03:15.978780 10573 raft_consensus.cc:2804] T 2df7bfe151e349f1a30cd3142e13c021 P 24479f93a03b4364837c81f7efbdf9d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:15.975319 10537 ts_tablet_manager.cc:1403] T b038dccd00b44161b10a08f5b963dd45 P 17d104ff42224d8c9cdf4c53a2152582: Time spent bootstrapping tablet: real 0.087s	user 0.025s	sys 0.025s
I20260709 13:03:15.989188 10494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1484bae8a7264a0e9f328dd5ce7edad8" candidate_uuid: "24479f93a03b4364837c81f7efbdf9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17d104ff42224d8c9cdf4c53a2152582"
I20260709 13:03:15.989230 10419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b038dccd00b44161b10a08f5b963dd45" candidate_uuid: "22139e7a5ea041588dd21a8d06ba1741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24479f93a03b4364837c81f7efbdf9d3"
I20260709 13:03:15.989673 10573 raft_consensus.cc:697] T 2df7bfe151e349f1a30cd3142e13c021 P 24479f93a03b4364837c81f7efbdf9d3 [term 1 LEADER]: Becoming Leader. State: Replica: 24479f93a03b4364837c81f7efbdf9d3, State: Running, Role: LEADER
I20260709 13:03:15.990360 10419 raft_consensus.cc:3060] T b038dccd00b44161b10a08f5b963dd45 P 24479f93a03b4364837c81f7efbdf9d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:15.991196 10573 consensus_queue.cc:237] T 2df7bfe151e349f1a30cd3142e13c021 P 24479f93a03b4364837c81f7efbdf9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:15.992661 10537 raft_consensus.cc:359] T b038dccd00b44161b10a08f5b963dd45 P 17d104ff42224d8c9cdf4c53a2152582 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:15.993443 10537 raft_consensus.cc:385] T b038dccd00b44161b10a08f5b963dd45 P 17d104ff42224d8c9cdf4c53a2152582 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:15.993713 10537 raft_consensus.cc:740] T b038dccd00b44161b10a08f5b963dd45 P 17d104ff42224d8c9cdf4c53a2152582 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17d104ff42224d8c9cdf4c53a2152582, State: Initialized, Role: FOLLOWER
I20260709 13:03:15.994576 10536 tablet_bootstrap.cc:654] T 19c2daa20bbe47afa5289e2b32987709 P 24479f93a03b4364837c81f7efbdf9d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:15.996027 10494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b038dccd00b44161b10a08f5b963dd45" candidate_uuid: "22139e7a5ea041588dd21a8d06ba1741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17d104ff42224d8c9cdf4c53a2152582"
I20260709 13:03:15.984902 10535 consensus_queue.cc:260] T 4feb1aa9b1d14601b28b28a6d515ee65 P 22139e7a5ea041588dd21a8d06ba1741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
W20260709 13:03:15.997088 10387 leader_election.cc:343] T 1484bae8a7264a0e9f328dd5ce7edad8 P 24479f93a03b4364837c81f7efbdf9d3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 17d104ff42224d8c9cdf4c53a2152582 (127.0.107.195:41601): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:16.001127 10346 raft_consensus.cc:2468] T 1484bae8a7264a0e9f328dd5ce7edad8 P 22139e7a5ea041588dd21a8d06ba1741 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24479f93a03b4364837c81f7efbdf9d3 in term 1.
I20260709 13:03:16.001806 10419 raft_consensus.cc:2468] T b038dccd00b44161b10a08f5b963dd45 P 24479f93a03b4364837c81f7efbdf9d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22139e7a5ea041588dd21a8d06ba1741 in term 1.
I20260709 13:03:16.002514 10384 leader_election.cc:304] T 1484bae8a7264a0e9f328dd5ce7edad8 P 24479f93a03b4364837c81f7efbdf9d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22139e7a5ea041588dd21a8d06ba1741, 24479f93a03b4364837c81f7efbdf9d3; no voters: 17d104ff42224d8c9cdf4c53a2152582
I20260709 13:03:16.002009 10579 raft_consensus.cc:493] T 4feb1aa9b1d14601b28b28a6d515ee65 P 22139e7a5ea041588dd21a8d06ba1741 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:16.003511 10579 raft_consensus.cc:515] T 4feb1aa9b1d14601b28b28a6d515ee65 P 22139e7a5ea041588dd21a8d06ba1741 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:16.004192 10541 raft_consensus.cc:2804] T 1484bae8a7264a0e9f328dd5ce7edad8 P 24479f93a03b4364837c81f7efbdf9d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:16.004114 10310 leader_election.cc:304] T b038dccd00b44161b10a08f5b963dd45 P 22139e7a5ea041588dd21a8d06ba1741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22139e7a5ea041588dd21a8d06ba1741, 24479f93a03b4364837c81f7efbdf9d3; no voters: 
I20260709 13:03:15.969944 10563 raft_consensus.cc:515] T a848edc7d33e48a1a475daf70fb66449 P 22139e7a5ea041588dd21a8d06ba1741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } }
I20260709 13:03:15.995697 10540 leader_election.cc:290] T b038dccd00b44161b10a08f5b963dd45 P 22139e7a5ea041588dd21a8d06ba1741 [CANDIDATE]: Term 1 election: Requested vote from peers 24479f93a03b4364837c81f7efbdf9d3 (127.0.107.194:44467), 17d104ff42224d8c9cdf4c53a2152582 (127.0.107.195:41601)
I20260709 13:03:16.006903 10345 raft_consensus.cc:2393] T a848edc7d33e48a1a475daf70fb66449 P 22139e7a5ea041588dd21a8d06ba1741 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17d104ff42224d8c9cdf4c53a2152582 in current term 1: Already voted for candidate 22139e7a5ea041588dd21a8d06ba1741 in this term.
I20260709 13:03:16.006975 10540 raft_consensus.cc:2804] T b038dccd00b44161b10a08f5b963dd45 P 22139e7a5ea041588dd21a8d06ba1741 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:16.007524 10540 raft_consensus.cc:697] T b038dccd00b44161b10a08f5b963dd45 P 22139e7a5ea041588dd21a8d06ba1741 [term 1 LEADER]: Becoming Leader. State: Replica: 22139e7a5ea041588dd21a8d06ba1741, State: Running, Role: LEADER
I20260709 13:03:16.008006 10495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4feb1aa9b1d14601b28b28a6d515ee65" candidate_uuid: "22139e7a5ea041588dd21a8d06ba1741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17d104ff42224d8c9cdf4c53a2152582" is_pre_election: true
W20260709 13:03:16.009624 10312 leader_election.cc:343] T 4feb1aa9b1d14601b28b28a6d515ee65 P 22139e7a5ea041588dd21a8d06ba1741 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17d104ff42224d8c9cdf4c53a2152582 (127.0.107.195:41601): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:16.009774 10420 raft_consensus.cc:2468] T a848edc7d33e48a1a475daf70fb66449 P 24479f93a03b4364837c81f7efbdf9d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17d104ff42224d8c9cdf4c53a2152582 in term 1.
I20260709 13:03:16.010880 10459 leader_election.cc:304] T a848edc7d33e48a1a475daf70fb66449 P 17d104ff42224d8c9cdf4c53a2152582 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17d104ff42224d8c9cdf4c53a2152582, 24479f93a03b4364837c81f7efbdf9d3; no voters: 22139e7a5ea041588dd21a8d06ba1741
I20260709 13:03:16.008391 10540 consensus_queue.cc:237] T b038dccd00b44161b10a08f5b963dd45 P 22139e7a5ea041588dd21a8d06ba1741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:16.012048 10543 raft_consensus.cc:2804] T a848edc7d33e48a1a475daf70fb66449 P 17d104ff42224d8c9cdf4c53a2152582 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:16.012667 10543 raft_consensus.cc:697] T a848edc7d33e48a1a475daf70fb66449 P 17d104ff42224d8c9cdf4c53a2152582 [term 1 LEADER]: Becoming Leader. State: Replica: 17d104ff42224d8c9cdf4c53a2152582, State: Running, Role: LEADER
I20260709 13:03:16.013504 10543 consensus_queue.cc:237] T a848edc7d33e48a1a475daf70fb66449 P 17d104ff42224d8c9cdf4c53a2152582 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } }
I20260709 13:03:16.018436 10495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a848edc7d33e48a1a475daf70fb66449" candidate_uuid: "22139e7a5ea041588dd21a8d06ba1741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17d104ff42224d8c9cdf4c53a2152582"
I20260709 13:03:16.018926 10563 leader_election.cc:290] T a848edc7d33e48a1a475daf70fb66449 P 22139e7a5ea041588dd21a8d06ba1741 [CANDIDATE]: Term 1 election: Requested vote from peers 17d104ff42224d8c9cdf4c53a2152582 (127.0.107.195:41601), 24479f93a03b4364837c81f7efbdf9d3 (127.0.107.194:44467)
I20260709 13:03:16.019312 10573 raft_consensus.cc:493] T afe8b130a0d1484e9f08fed8f6be2f61 P 24479f93a03b4364837c81f7efbdf9d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.994481 10537 consensus_queue.cc:260] T b038dccd00b44161b10a08f5b963dd45 P 17d104ff42224d8c9cdf4c53a2152582 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:16.023124 10494 raft_consensus.cc:3060] T b038dccd00b44161b10a08f5b963dd45 P 17d104ff42224d8c9cdf4c53a2152582 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:16.026031 10420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4feb1aa9b1d14601b28b28a6d515ee65" candidate_uuid: "22139e7a5ea041588dd21a8d06ba1741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24479f93a03b4364837c81f7efbdf9d3" is_pre_election: true
I20260709 13:03:16.026794 10420 raft_consensus.cc:2468] T 4feb1aa9b1d14601b28b28a6d515ee65 P 24479f93a03b4364837c81f7efbdf9d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22139e7a5ea041588dd21a8d06ba1741 in term 0.
I20260709 13:03:16.027244 10579 leader_election.cc:290] T 4feb1aa9b1d14601b28b28a6d515ee65 P 22139e7a5ea041588dd21a8d06ba1741 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24479f93a03b4364837c81f7efbdf9d3 (127.0.107.194:44467), 17d104ff42224d8c9cdf4c53a2152582 (127.0.107.195:41601)
I20260709 13:03:16.028111 10419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a848edc7d33e48a1a475daf70fb66449" candidate_uuid: "22139e7a5ea041588dd21a8d06ba1741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24479f93a03b4364837c81f7efbdf9d3"
I20260709 13:03:16.029034 10419 raft_consensus.cc:2393] T a848edc7d33e48a1a475daf70fb66449 P 24479f93a03b4364837c81f7efbdf9d3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 22139e7a5ea041588dd21a8d06ba1741 in current term 1: Already voted for candidate 17d104ff42224d8c9cdf4c53a2152582 in this term.
I20260709 13:03:16.030526 10310 leader_election.cc:304] T 4feb1aa9b1d14601b28b28a6d515ee65 P 22139e7a5ea041588dd21a8d06ba1741 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22139e7a5ea041588dd21a8d06ba1741, 24479f93a03b4364837c81f7efbdf9d3; no voters: 17d104ff42224d8c9cdf4c53a2152582
I20260709 13:03:16.031499 10579 raft_consensus.cc:2804] T 4feb1aa9b1d14601b28b28a6d515ee65 P 22139e7a5ea041588dd21a8d06ba1741 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:16.020283 10535 ts_tablet_manager.cc:1434] T 4feb1aa9b1d14601b28b28a6d515ee65 P 22139e7a5ea041588dd21a8d06ba1741: Time spent starting tablet: real 0.041s	user 0.002s	sys 0.006s
I20260709 13:03:16.031770 10541 raft_consensus.cc:697] T 1484bae8a7264a0e9f328dd5ce7edad8 P 24479f93a03b4364837c81f7efbdf9d3 [term 1 LEADER]: Becoming Leader. State: Replica: 24479f93a03b4364837c81f7efbdf9d3, State: Running, Role: LEADER
I20260709 13:03:16.032097 10310 leader_election.cc:304] T a848edc7d33e48a1a475daf70fb66449 P 22139e7a5ea041588dd21a8d06ba1741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22139e7a5ea041588dd21a8d06ba1741; no voters: 17d104ff42224d8c9cdf4c53a2152582, 24479f93a03b4364837c81f7efbdf9d3
I20260709 13:03:16.033116 10580 raft_consensus.cc:2749] T a848edc7d33e48a1a475daf70fb66449 P 22139e7a5ea041588dd21a8d06ba1741 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:03:16.032976 10541 consensus_queue.cc:237] T 1484bae8a7264a0e9f328dd5ce7edad8 P 24479f93a03b4364837c81f7efbdf9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:16.032071 10579 raft_consensus.cc:493] T 4feb1aa9b1d14601b28b28a6d515ee65 P 22139e7a5ea041588dd21a8d06ba1741 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:16.034816 10579 raft_consensus.cc:3060] T 4feb1aa9b1d14601b28b28a6d515ee65 P 22139e7a5ea041588dd21a8d06ba1741 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:16.031492 10494 raft_consensus.cc:2468] T b038dccd00b44161b10a08f5b963dd45 P 17d104ff42224d8c9cdf4c53a2152582 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22139e7a5ea041588dd21a8d06ba1741 in term 1.
I20260709 13:03:16.036224 10535 tablet_bootstrap.cc:492] T 19c2daa20bbe47afa5289e2b32987709 P 22139e7a5ea041588dd21a8d06ba1741: Bootstrap starting.
I20260709 13:03:16.040160 10243 catalog_manager.cc:5697] T 2df7bfe151e349f1a30cd3142e13c021 P 24479f93a03b4364837c81f7efbdf9d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 24479f93a03b4364837c81f7efbdf9d3 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "24479f93a03b4364837c81f7efbdf9d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:16.022147 10573 raft_consensus.cc:515] T afe8b130a0d1484e9f08fed8f6be2f61 P 24479f93a03b4364837c81f7efbdf9d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:16.046461 10579 raft_consensus.cc:515] T 4feb1aa9b1d14601b28b28a6d515ee65 P 22139e7a5ea041588dd21a8d06ba1741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:16.046547 10346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe8b130a0d1484e9f08fed8f6be2f61" candidate_uuid: "24479f93a03b4364837c81f7efbdf9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22139e7a5ea041588dd21a8d06ba1741" is_pre_election: true
W20260709 13:03:16.048971 10384 leader_election.cc:343] T afe8b130a0d1484e9f08fed8f6be2f61 P 24479f93a03b4364837c81f7efbdf9d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 22139e7a5ea041588dd21a8d06ba1741 (127.0.107.193:45479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:16.050736 10419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4feb1aa9b1d14601b28b28a6d515ee65" candidate_uuid: "22139e7a5ea041588dd21a8d06ba1741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24479f93a03b4364837c81f7efbdf9d3"
I20260709 13:03:16.054046 10419 raft_consensus.cc:3060] T 4feb1aa9b1d14601b28b28a6d515ee65 P 24479f93a03b4364837c81f7efbdf9d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:16.057091 10494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4feb1aa9b1d14601b28b28a6d515ee65" candidate_uuid: "22139e7a5ea041588dd21a8d06ba1741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17d104ff42224d8c9cdf4c53a2152582"
W20260709 13:03:16.058826 10312 leader_election.cc:343] T 4feb1aa9b1d14601b28b28a6d515ee65 P 22139e7a5ea041588dd21a8d06ba1741 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 17d104ff42224d8c9cdf4c53a2152582 (127.0.107.195:41601): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:16.060053 10579 leader_election.cc:290] T 4feb1aa9b1d14601b28b28a6d515ee65 P 22139e7a5ea041588dd21a8d06ba1741 [CANDIDATE]: Term 1 election: Requested vote from peers 24479f93a03b4364837c81f7efbdf9d3 (127.0.107.194:44467), 17d104ff42224d8c9cdf4c53a2152582 (127.0.107.195:41601)
I20260709 13:03:16.040160 10537 ts_tablet_manager.cc:1434] T b038dccd00b44161b10a08f5b963dd45 P 17d104ff42224d8c9cdf4c53a2152582: Time spent starting tablet: real 0.050s	user 0.008s	sys 0.000s
I20260709 13:03:16.067797 10537 tablet_bootstrap.cc:492] T 4feb1aa9b1d14601b28b28a6d515ee65 P 17d104ff42224d8c9cdf4c53a2152582: Bootstrap starting.
I20260709 13:03:16.069664 10419 raft_consensus.cc:2468] T 4feb1aa9b1d14601b28b28a6d515ee65 P 24479f93a03b4364837c81f7efbdf9d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22139e7a5ea041588dd21a8d06ba1741 in term 1.
I20260709 13:03:16.085345 10573 leader_election.cc:290] T afe8b130a0d1484e9f08fed8f6be2f61 P 24479f93a03b4364837c81f7efbdf9d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22139e7a5ea041588dd21a8d06ba1741 (127.0.107.193:45479), 17d104ff42224d8c9cdf4c53a2152582 (127.0.107.195:41601)
I20260709 13:03:16.087442 10494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe8b130a0d1484e9f08fed8f6be2f61" candidate_uuid: "24479f93a03b4364837c81f7efbdf9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17d104ff42224d8c9cdf4c53a2152582" is_pre_election: true
W20260709 13:03:16.089390 10387 leader_election.cc:343] T afe8b130a0d1484e9f08fed8f6be2f61 P 24479f93a03b4364837c81f7efbdf9d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17d104ff42224d8c9cdf4c53a2152582 (127.0.107.195:41601): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:16.088750 10244 catalog_manager.cc:5697] T b038dccd00b44161b10a08f5b963dd45 P 22139e7a5ea041588dd21a8d06ba1741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 22139e7a5ea041588dd21a8d06ba1741 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "22139e7a5ea041588dd21a8d06ba1741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:16.089968 10387 leader_election.cc:304] T afe8b130a0d1484e9f08fed8f6be2f61 P 24479f93a03b4364837c81f7efbdf9d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24479f93a03b4364837c81f7efbdf9d3; no voters: 17d104ff42224d8c9cdf4c53a2152582, 22139e7a5ea041588dd21a8d06ba1741
I20260709 13:03:16.092547 10573 raft_consensus.cc:2749] T afe8b130a0d1484e9f08fed8f6be2f61 P 24479f93a03b4364837c81f7efbdf9d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:16.096660 10535 tablet_bootstrap.cc:654] T 19c2daa20bbe47afa5289e2b32987709 P 22139e7a5ea041588dd21a8d06ba1741: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:16.096047 10310 leader_election.cc:304] T 4feb1aa9b1d14601b28b28a6d515ee65 P 22139e7a5ea041588dd21a8d06ba1741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22139e7a5ea041588dd21a8d06ba1741, 24479f93a03b4364837c81f7efbdf9d3; no voters: 17d104ff42224d8c9cdf4c53a2152582
I20260709 13:03:16.106415 10537 tablet_bootstrap.cc:654] T 4feb1aa9b1d14601b28b28a6d515ee65 P 17d104ff42224d8c9cdf4c53a2152582: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:16.139945 10541 raft_consensus.cc:493] T 89649f4e196f44a3b3b98fa009c228f8 P 24479f93a03b4364837c81f7efbdf9d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:16.140614 10541 raft_consensus.cc:515] T 89649f4e196f44a3b3b98fa009c228f8 P 24479f93a03b4364837c81f7efbdf9d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:16.143237 10541 leader_election.cc:290] T 89649f4e196f44a3b3b98fa009c228f8 P 24479f93a03b4364837c81f7efbdf9d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22139e7a5ea041588dd21a8d06ba1741 (127.0.107.193:45479), 17d104ff42224d8c9cdf4c53a2152582 (127.0.107.195:41601)
I20260709 13:03:16.144008 10346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89649f4e196f44a3b3b98fa009c228f8" candidate_uuid: "24479f93a03b4364837c81f7efbdf9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22139e7a5ea041588dd21a8d06ba1741" is_pre_election: true
I20260709 13:03:16.144876 10346 raft_consensus.cc:2468] T 89649f4e196f44a3b3b98fa009c228f8 P 22139e7a5ea041588dd21a8d06ba1741 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24479f93a03b4364837c81f7efbdf9d3 in term 0.
I20260709 13:03:16.146159 10384 leader_election.cc:304] T 89649f4e196f44a3b3b98fa009c228f8 P 24479f93a03b4364837c81f7efbdf9d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22139e7a5ea041588dd21a8d06ba1741, 24479f93a03b4364837c81f7efbdf9d3; no voters: 
I20260709 13:03:16.147330 10541 raft_consensus.cc:2804] T 89649f4e196f44a3b3b98fa009c228f8 P 24479f93a03b4364837c81f7efbdf9d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:16.147716 10541 raft_consensus.cc:493] T 89649f4e196f44a3b3b98fa009c228f8 P 24479f93a03b4364837c81f7efbdf9d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:16.148038 10541 raft_consensus.cc:3060] T 89649f4e196f44a3b3b98fa009c228f8 P 24479f93a03b4364837c81f7efbdf9d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:16.156893 10540 raft_consensus.cc:2804] T 4feb1aa9b1d14601b28b28a6d515ee65 P 22139e7a5ea041588dd21a8d06ba1741 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:16.157704 10540 raft_consensus.cc:697] T 4feb1aa9b1d14601b28b28a6d515ee65 P 22139e7a5ea041588dd21a8d06ba1741 [term 1 LEADER]: Becoming Leader. State: Replica: 22139e7a5ea041588dd21a8d06ba1741, State: Running, Role: LEADER
I20260709 13:03:16.158648 10540 consensus_queue.cc:237] T 4feb1aa9b1d14601b28b28a6d515ee65 P 22139e7a5ea041588dd21a8d06ba1741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
W20260709 13:03:16.175794 10525 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.IsCreateTableDone -> {remote=127.0.107.254:38331, user_credentials={real_user=slave}} blocked reactor thread for 59058.4us
I20260709 13:03:16.177985 10536 tablet_bootstrap.cc:492] T 19c2daa20bbe47afa5289e2b32987709 P 24479f93a03b4364837c81f7efbdf9d3: No bootstrap required, opened a new log
I20260709 13:03:16.179106 10494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89649f4e196f44a3b3b98fa009c228f8" candidate_uuid: "24479f93a03b4364837c81f7efbdf9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17d104ff42224d8c9cdf4c53a2152582" is_pre_election: true
I20260709 13:03:16.179842 10494 raft_consensus.cc:2468] T 89649f4e196f44a3b3b98fa009c228f8 P 17d104ff42224d8c9cdf4c53a2152582 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24479f93a03b4364837c81f7efbdf9d3 in term 0.
I20260709 13:03:16.180398 10535 tablet_bootstrap.cc:492] T 19c2daa20bbe47afa5289e2b32987709 P 22139e7a5ea041588dd21a8d06ba1741: No bootstrap required, opened a new log
I20260709 13:03:16.180932 10535 ts_tablet_manager.cc:1403] T 19c2daa20bbe47afa5289e2b32987709 P 22139e7a5ea041588dd21a8d06ba1741: Time spent bootstrapping tablet: real 0.145s	user 0.023s	sys 0.034s
I20260709 13:03:16.183687 10535 raft_consensus.cc:359] T 19c2daa20bbe47afa5289e2b32987709 P 22139e7a5ea041588dd21a8d06ba1741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:16.184374 10535 raft_consensus.cc:385] T 19c2daa20bbe47afa5289e2b32987709 P 22139e7a5ea041588dd21a8d06ba1741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:16.184659 10535 raft_consensus.cc:740] T 19c2daa20bbe47afa5289e2b32987709 P 22139e7a5ea041588dd21a8d06ba1741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22139e7a5ea041588dd21a8d06ba1741, State: Initialized, Role: FOLLOWER
I20260709 13:03:16.185338 10535 consensus_queue.cc:260] T 19c2daa20bbe47afa5289e2b32987709 P 22139e7a5ea041588dd21a8d06ba1741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:16.186721 10541 raft_consensus.cc:515] T 89649f4e196f44a3b3b98fa009c228f8 P 24479f93a03b4364837c81f7efbdf9d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:16.187407 10535 ts_tablet_manager.cc:1434] T 19c2daa20bbe47afa5289e2b32987709 P 22139e7a5ea041588dd21a8d06ba1741: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:03:16.187266 10241 catalog_manager.cc:5697] T 1484bae8a7264a0e9f328dd5ce7edad8 P 24479f93a03b4364837c81f7efbdf9d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 24479f93a03b4364837c81f7efbdf9d3 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "24479f93a03b4364837c81f7efbdf9d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:16.188457 10535 tablet_bootstrap.cc:492] T 2df7bfe151e349f1a30cd3142e13c021 P 22139e7a5ea041588dd21a8d06ba1741: Bootstrap starting.
I20260709 13:03:16.178612 10536 ts_tablet_manager.cc:1403] T 19c2daa20bbe47afa5289e2b32987709 P 24479f93a03b4364837c81f7efbdf9d3: Time spent bootstrapping tablet: real 0.191s	user 0.033s	sys 0.030s
I20260709 13:03:16.192444 10346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89649f4e196f44a3b3b98fa009c228f8" candidate_uuid: "24479f93a03b4364837c81f7efbdf9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22139e7a5ea041588dd21a8d06ba1741"
I20260709 13:03:16.193058 10346 raft_consensus.cc:3060] T 89649f4e196f44a3b3b98fa009c228f8 P 22139e7a5ea041588dd21a8d06ba1741 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:16.194518 10535 tablet_bootstrap.cc:654] T 2df7bfe151e349f1a30cd3142e13c021 P 22139e7a5ea041588dd21a8d06ba1741: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:16.193218 10536 raft_consensus.cc:359] T 19c2daa20bbe47afa5289e2b32987709 P 24479f93a03b4364837c81f7efbdf9d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:16.195499 10536 raft_consensus.cc:385] T 19c2daa20bbe47afa5289e2b32987709 P 24479f93a03b4364837c81f7efbdf9d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:16.195763 10536 raft_consensus.cc:740] T 19c2daa20bbe47afa5289e2b32987709 P 24479f93a03b4364837c81f7efbdf9d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24479f93a03b4364837c81f7efbdf9d3, State: Initialized, Role: FOLLOWER
I20260709 13:03:16.196561 10536 consensus_queue.cc:260] T 19c2daa20bbe47afa5289e2b32987709 P 24479f93a03b4364837c81f7efbdf9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:16.199671 10536 ts_tablet_manager.cc:1434] T 19c2daa20bbe47afa5289e2b32987709 P 24479f93a03b4364837c81f7efbdf9d3: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:03:16.197400 10244 catalog_manager.cc:5697] T 4feb1aa9b1d14601b28b28a6d515ee65 P 22139e7a5ea041588dd21a8d06ba1741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 22139e7a5ea041588dd21a8d06ba1741 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "22139e7a5ea041588dd21a8d06ba1741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:16.203002 10243 catalog_manager.cc:5697] T a848edc7d33e48a1a475daf70fb66449 P 17d104ff42224d8c9cdf4c53a2152582 reported cstate change: term changed from 0 to 1, leader changed from <none> to 17d104ff42224d8c9cdf4c53a2152582 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "17d104ff42224d8c9cdf4c53a2152582" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:16.207957 10346 raft_consensus.cc:2468] T 89649f4e196f44a3b3b98fa009c228f8 P 22139e7a5ea041588dd21a8d06ba1741 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24479f93a03b4364837c81f7efbdf9d3 in term 1.
I20260709 13:03:16.209321 10384 leader_election.cc:304] T 89649f4e196f44a3b3b98fa009c228f8 P 24479f93a03b4364837c81f7efbdf9d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22139e7a5ea041588dd21a8d06ba1741, 24479f93a03b4364837c81f7efbdf9d3; no voters: 
I20260709 13:03:16.210211 10573 raft_consensus.cc:2804] T 89649f4e196f44a3b3b98fa009c228f8 P 24479f93a03b4364837c81f7efbdf9d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:16.210727 10573 raft_consensus.cc:697] T 89649f4e196f44a3b3b98fa009c228f8 P 24479f93a03b4364837c81f7efbdf9d3 [term 1 LEADER]: Becoming Leader. State: Replica: 24479f93a03b4364837c81f7efbdf9d3, State: Running, Role: LEADER
I20260709 13:03:16.211525 10573 consensus_queue.cc:237] T 89649f4e196f44a3b3b98fa009c228f8 P 24479f93a03b4364837c81f7efbdf9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:16.226406 10535 tablet_bootstrap.cc:492] T 2df7bfe151e349f1a30cd3142e13c021 P 22139e7a5ea041588dd21a8d06ba1741: No bootstrap required, opened a new log
I20260709 13:03:16.227152 10535 ts_tablet_manager.cc:1403] T 2df7bfe151e349f1a30cd3142e13c021 P 22139e7a5ea041588dd21a8d06ba1741: Time spent bootstrapping tablet: real 0.039s	user 0.020s	sys 0.011s
I20260709 13:03:16.229128 10494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89649f4e196f44a3b3b98fa009c228f8" candidate_uuid: "24479f93a03b4364837c81f7efbdf9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17d104ff42224d8c9cdf4c53a2152582"
I20260709 13:03:16.229853 10494 raft_consensus.cc:3060] T 89649f4e196f44a3b3b98fa009c228f8 P 17d104ff42224d8c9cdf4c53a2152582 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:16.227958 10541 leader_election.cc:290] T 89649f4e196f44a3b3b98fa009c228f8 P 24479f93a03b4364837c81f7efbdf9d3 [CANDIDATE]: Term 1 election: Requested vote from peers 22139e7a5ea041588dd21a8d06ba1741 (127.0.107.193:45479), 17d104ff42224d8c9cdf4c53a2152582 (127.0.107.195:41601)
I20260709 13:03:16.232640 10535 raft_consensus.cc:359] T 2df7bfe151e349f1a30cd3142e13c021 P 22139e7a5ea041588dd21a8d06ba1741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:16.233417 10535 raft_consensus.cc:385] T 2df7bfe151e349f1a30cd3142e13c021 P 22139e7a5ea041588dd21a8d06ba1741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:16.233695 10535 raft_consensus.cc:740] T 2df7bfe151e349f1a30cd3142e13c021 P 22139e7a5ea041588dd21a8d06ba1741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22139e7a5ea041588dd21a8d06ba1741, State: Initialized, Role: FOLLOWER
I20260709 13:03:16.234423 10535 consensus_queue.cc:260] T 2df7bfe151e349f1a30cd3142e13c021 P 22139e7a5ea041588dd21a8d06ba1741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:16.236797 10535 ts_tablet_manager.cc:1434] T 2df7bfe151e349f1a30cd3142e13c021 P 22139e7a5ea041588dd21a8d06ba1741: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:03:16.236553 10543 consensus_queue.cc:1048] T e0ad84cc4e1942d99055ab43ea0bdac0 P 17d104ff42224d8c9cdf4c53a2152582 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:16.237775 10535 tablet_bootstrap.cc:492] T afe8b130a0d1484e9f08fed8f6be2f61 P 22139e7a5ea041588dd21a8d06ba1741: Bootstrap starting.
I20260709 13:03:16.238790 10494 raft_consensus.cc:2468] T 89649f4e196f44a3b3b98fa009c228f8 P 17d104ff42224d8c9cdf4c53a2152582 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24479f93a03b4364837c81f7efbdf9d3 in term 1.
I20260709 13:03:16.242895 10537 tablet_bootstrap.cc:492] T 4feb1aa9b1d14601b28b28a6d515ee65 P 17d104ff42224d8c9cdf4c53a2152582: No bootstrap required, opened a new log
I20260709 13:03:16.243479 10537 ts_tablet_manager.cc:1403] T 4feb1aa9b1d14601b28b28a6d515ee65 P 17d104ff42224d8c9cdf4c53a2152582: Time spent bootstrapping tablet: real 0.176s	user 0.034s	sys 0.044s
I20260709 13:03:16.243899 10535 tablet_bootstrap.cc:654] T afe8b130a0d1484e9f08fed8f6be2f61 P 22139e7a5ea041588dd21a8d06ba1741: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:16.241147 10244 catalog_manager.cc:5697] T 89649f4e196f44a3b3b98fa009c228f8 P 24479f93a03b4364837c81f7efbdf9d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 24479f93a03b4364837c81f7efbdf9d3 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "24479f93a03b4364837c81f7efbdf9d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:16.246781 10537 raft_consensus.cc:359] T 4feb1aa9b1d14601b28b28a6d515ee65 P 17d104ff42224d8c9cdf4c53a2152582 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:16.247666 10537 raft_consensus.cc:385] T 4feb1aa9b1d14601b28b28a6d515ee65 P 17d104ff42224d8c9cdf4c53a2152582 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:16.247985 10537 raft_consensus.cc:740] T 4feb1aa9b1d14601b28b28a6d515ee65 P 17d104ff42224d8c9cdf4c53a2152582 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17d104ff42224d8c9cdf4c53a2152582, State: Initialized, Role: FOLLOWER
I20260709 13:03:16.248968 10537 consensus_queue.cc:260] T 4feb1aa9b1d14601b28b28a6d515ee65 P 17d104ff42224d8c9cdf4c53a2152582 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:16.254125 10537 ts_tablet_manager.cc:1434] T 4feb1aa9b1d14601b28b28a6d515ee65 P 17d104ff42224d8c9cdf4c53a2152582: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:03:16.255505 10537 tablet_bootstrap.cc:492] T 19c2daa20bbe47afa5289e2b32987709 P 17d104ff42224d8c9cdf4c53a2152582: Bootstrap starting.
I20260709 13:03:16.262748 10537 tablet_bootstrap.cc:654] T 19c2daa20bbe47afa5289e2b32987709 P 17d104ff42224d8c9cdf4c53a2152582: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:16.265404 10535 tablet_bootstrap.cc:492] T afe8b130a0d1484e9f08fed8f6be2f61 P 22139e7a5ea041588dd21a8d06ba1741: No bootstrap required, opened a new log
I20260709 13:03:16.265949 10535 ts_tablet_manager.cc:1403] T afe8b130a0d1484e9f08fed8f6be2f61 P 22139e7a5ea041588dd21a8d06ba1741: Time spent bootstrapping tablet: real 0.028s	user 0.016s	sys 0.011s
I20260709 13:03:16.267221 10540 raft_consensus.cc:493] T 19c2daa20bbe47afa5289e2b32987709 P 22139e7a5ea041588dd21a8d06ba1741 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:16.267789 10540 raft_consensus.cc:515] T 19c2daa20bbe47afa5289e2b32987709 P 22139e7a5ea041588dd21a8d06ba1741 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:16.268865 10535 raft_consensus.cc:359] T afe8b130a0d1484e9f08fed8f6be2f61 P 22139e7a5ea041588dd21a8d06ba1741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:16.269691 10535 raft_consensus.cc:385] T afe8b130a0d1484e9f08fed8f6be2f61 P 22139e7a5ea041588dd21a8d06ba1741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:16.269965 10535 raft_consensus.cc:740] T afe8b130a0d1484e9f08fed8f6be2f61 P 22139e7a5ea041588dd21a8d06ba1741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22139e7a5ea041588dd21a8d06ba1741, State: Initialized, Role: FOLLOWER
I20260709 13:03:16.271006 10535 consensus_queue.cc:260] T afe8b130a0d1484e9f08fed8f6be2f61 P 22139e7a5ea041588dd21a8d06ba1741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:16.271296 10494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19c2daa20bbe47afa5289e2b32987709" candidate_uuid: "22139e7a5ea041588dd21a8d06ba1741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17d104ff42224d8c9cdf4c53a2152582" is_pre_election: true
W20260709 13:03:16.272936 10312 leader_election.cc:343] T 19c2daa20bbe47afa5289e2b32987709 P 22139e7a5ea041588dd21a8d06ba1741 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17d104ff42224d8c9cdf4c53a2152582 (127.0.107.195:41601): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:16.273147 10535 ts_tablet_manager.cc:1434] T afe8b130a0d1484e9f08fed8f6be2f61 P 22139e7a5ea041588dd21a8d06ba1741: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:03:16.274863 10420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19c2daa20bbe47afa5289e2b32987709" candidate_uuid: "22139e7a5ea041588dd21a8d06ba1741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24479f93a03b4364837c81f7efbdf9d3" is_pre_election: true
I20260709 13:03:16.275583 10420 raft_consensus.cc:2468] T 19c2daa20bbe47afa5289e2b32987709 P 24479f93a03b4364837c81f7efbdf9d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22139e7a5ea041588dd21a8d06ba1741 in term 0.
I20260709 13:03:16.276669 10310 leader_election.cc:304] T 19c2daa20bbe47afa5289e2b32987709 P 22139e7a5ea041588dd21a8d06ba1741 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22139e7a5ea041588dd21a8d06ba1741, 24479f93a03b4364837c81f7efbdf9d3; no voters: 17d104ff42224d8c9cdf4c53a2152582
I20260709 13:03:16.276762 10541 raft_consensus.cc:493] T 19c2daa20bbe47afa5289e2b32987709 P 24479f93a03b4364837c81f7efbdf9d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:16.277490 10579 raft_consensus.cc:2804] T 19c2daa20bbe47afa5289e2b32987709 P 22139e7a5ea041588dd21a8d06ba1741 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:16.277356 10541 raft_consensus.cc:515] T 19c2daa20bbe47afa5289e2b32987709 P 24479f93a03b4364837c81f7efbdf9d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:16.269898 10540 leader_election.cc:290] T 19c2daa20bbe47afa5289e2b32987709 P 22139e7a5ea041588dd21a8d06ba1741 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24479f93a03b4364837c81f7efbdf9d3 (127.0.107.194:44467), 17d104ff42224d8c9cdf4c53a2152582 (127.0.107.195:41601)
I20260709 13:03:16.277947 10579 raft_consensus.cc:493] T 19c2daa20bbe47afa5289e2b32987709 P 22139e7a5ea041588dd21a8d06ba1741 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:16.278353 10579 raft_consensus.cc:3060] T 19c2daa20bbe47afa5289e2b32987709 P 22139e7a5ea041588dd21a8d06ba1741 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:16.280704 10494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19c2daa20bbe47afa5289e2b32987709" candidate_uuid: "24479f93a03b4364837c81f7efbdf9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17d104ff42224d8c9cdf4c53a2152582" is_pre_election: true
W20260709 13:03:16.282332 10387 leader_election.cc:343] T 19c2daa20bbe47afa5289e2b32987709 P 24479f93a03b4364837c81f7efbdf9d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17d104ff42224d8c9cdf4c53a2152582 (127.0.107.195:41601): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:16.283399 10541 leader_election.cc:290] T 19c2daa20bbe47afa5289e2b32987709 P 24479f93a03b4364837c81f7efbdf9d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22139e7a5ea041588dd21a8d06ba1741 (127.0.107.193:45479), 17d104ff42224d8c9cdf4c53a2152582 (127.0.107.195:41601)
I20260709 13:03:16.284999 10537 tablet_bootstrap.cc:492] T 19c2daa20bbe47afa5289e2b32987709 P 17d104ff42224d8c9cdf4c53a2152582: No bootstrap required, opened a new log
I20260709 13:03:16.285621 10537 ts_tablet_manager.cc:1403] T 19c2daa20bbe47afa5289e2b32987709 P 17d104ff42224d8c9cdf4c53a2152582: Time spent bootstrapping tablet: real 0.030s	user 0.010s	sys 0.008s
I20260709 13:03:16.286674 10346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19c2daa20bbe47afa5289e2b32987709" candidate_uuid: "24479f93a03b4364837c81f7efbdf9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22139e7a5ea041588dd21a8d06ba1741" is_pre_election: true
I20260709 13:03:16.288842 10537 raft_consensus.cc:359] T 19c2daa20bbe47afa5289e2b32987709 P 17d104ff42224d8c9cdf4c53a2152582 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:16.289680 10537 raft_consensus.cc:385] T 19c2daa20bbe47afa5289e2b32987709 P 17d104ff42224d8c9cdf4c53a2152582 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:16.290004 10537 raft_consensus.cc:740] T 19c2daa20bbe47afa5289e2b32987709 P 17d104ff42224d8c9cdf4c53a2152582 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17d104ff42224d8c9cdf4c53a2152582, State: Initialized, Role: FOLLOWER
I20260709 13:03:16.290850 10537 consensus_queue.cc:260] T 19c2daa20bbe47afa5289e2b32987709 P 17d104ff42224d8c9cdf4c53a2152582 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:16.292905 10537 ts_tablet_manager.cc:1434] T 19c2daa20bbe47afa5289e2b32987709 P 17d104ff42224d8c9cdf4c53a2152582: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:03:16.294065 10579 raft_consensus.cc:515] T 19c2daa20bbe47afa5289e2b32987709 P 22139e7a5ea041588dd21a8d06ba1741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:16.295212 10346 raft_consensus.cc:2393] T 19c2daa20bbe47afa5289e2b32987709 P 22139e7a5ea041588dd21a8d06ba1741 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24479f93a03b4364837c81f7efbdf9d3 in current term 1: Already voted for candidate 22139e7a5ea041588dd21a8d06ba1741 in this term.
I20260709 13:03:16.296779 10537 tablet_bootstrap.cc:492] T afe8b130a0d1484e9f08fed8f6be2f61 P 17d104ff42224d8c9cdf4c53a2152582: Bootstrap starting.
I20260709 13:03:16.297068 10384 leader_election.cc:304] T 19c2daa20bbe47afa5289e2b32987709 P 24479f93a03b4364837c81f7efbdf9d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24479f93a03b4364837c81f7efbdf9d3; no voters: 17d104ff42224d8c9cdf4c53a2152582, 22139e7a5ea041588dd21a8d06ba1741
I20260709 13:03:16.299304 10541 raft_consensus.cc:3060] T 19c2daa20bbe47afa5289e2b32987709 P 24479f93a03b4364837c81f7efbdf9d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:16.299955 10579 leader_election.cc:290] T 19c2daa20bbe47afa5289e2b32987709 P 22139e7a5ea041588dd21a8d06ba1741 [CANDIDATE]: Term 1 election: Requested vote from peers 24479f93a03b4364837c81f7efbdf9d3 (127.0.107.194:44467), 17d104ff42224d8c9cdf4c53a2152582 (127.0.107.195:41601)
I20260709 13:03:16.303707 10494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19c2daa20bbe47afa5289e2b32987709" candidate_uuid: "22139e7a5ea041588dd21a8d06ba1741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17d104ff42224d8c9cdf4c53a2152582"
I20260709 13:03:16.304901 10494 raft_consensus.cc:3060] T 19c2daa20bbe47afa5289e2b32987709 P 17d104ff42224d8c9cdf4c53a2152582 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:16.305832 10537 tablet_bootstrap.cc:654] T afe8b130a0d1484e9f08fed8f6be2f61 P 17d104ff42224d8c9cdf4c53a2152582: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:16.303876 10543 raft_consensus.cc:493] T 4feb1aa9b1d14601b28b28a6d515ee65 P 17d104ff42224d8c9cdf4c53a2152582 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:16.310104 10420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19c2daa20bbe47afa5289e2b32987709" candidate_uuid: "22139e7a5ea041588dd21a8d06ba1741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24479f93a03b4364837c81f7efbdf9d3"
I20260709 13:03:16.309016 10543 raft_consensus.cc:515] T 4feb1aa9b1d14601b28b28a6d515ee65 P 17d104ff42224d8c9cdf4c53a2152582 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:16.315116 10543 leader_election.cc:290] T 4feb1aa9b1d14601b28b28a6d515ee65 P 17d104ff42224d8c9cdf4c53a2152582 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22139e7a5ea041588dd21a8d06ba1741 (127.0.107.193:45479), 24479f93a03b4364837c81f7efbdf9d3 (127.0.107.194:44467)
I20260709 13:03:16.316012 10346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4feb1aa9b1d14601b28b28a6d515ee65" candidate_uuid: "17d104ff42224d8c9cdf4c53a2152582" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22139e7a5ea041588dd21a8d06ba1741" is_pre_election: true
I20260709 13:03:16.312599 10579 consensus_queue.cc:1048] T 77c2a758545e45e29d62d8d71ea3f43d P 22139e7a5ea041588dd21a8d06ba1741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:03:16.319024 10419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4feb1aa9b1d14601b28b28a6d515ee65" candidate_uuid: "17d104ff42224d8c9cdf4c53a2152582" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24479f93a03b4364837c81f7efbdf9d3" is_pre_election: true
I20260709 13:03:16.319715 10541 raft_consensus.cc:2749] T 19c2daa20bbe47afa5289e2b32987709 P 24479f93a03b4364837c81f7efbdf9d3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:16.319984 10419 raft_consensus.cc:2393] T 4feb1aa9b1d14601b28b28a6d515ee65 P 24479f93a03b4364837c81f7efbdf9d3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17d104ff42224d8c9cdf4c53a2152582 in current term 1: Already voted for candidate 22139e7a5ea041588dd21a8d06ba1741 in this term.
I20260709 13:03:16.321303 10459 leader_election.cc:304] T 4feb1aa9b1d14601b28b28a6d515ee65 P 17d104ff42224d8c9cdf4c53a2152582 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17d104ff42224d8c9cdf4c53a2152582; no voters: 22139e7a5ea041588dd21a8d06ba1741, 24479f93a03b4364837c81f7efbdf9d3
I20260709 13:03:16.322558 10543 raft_consensus.cc:3060] T 4feb1aa9b1d14601b28b28a6d515ee65 P 17d104ff42224d8c9cdf4c53a2152582 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:16.327754 10494 raft_consensus.cc:2468] T 19c2daa20bbe47afa5289e2b32987709 P 17d104ff42224d8c9cdf4c53a2152582 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22139e7a5ea041588dd21a8d06ba1741 in term 1.
I20260709 13:03:16.330736 10420 raft_consensus.cc:2468] T 19c2daa20bbe47afa5289e2b32987709 P 24479f93a03b4364837c81f7efbdf9d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22139e7a5ea041588dd21a8d06ba1741 in term 1.
I20260709 13:03:16.332170 10312 leader_election.cc:304] T 19c2daa20bbe47afa5289e2b32987709 P 22139e7a5ea041588dd21a8d06ba1741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17d104ff42224d8c9cdf4c53a2152582, 22139e7a5ea041588dd21a8d06ba1741; no voters: 
I20260709 13:03:16.334527 10537 tablet_bootstrap.cc:492] T afe8b130a0d1484e9f08fed8f6be2f61 P 17d104ff42224d8c9cdf4c53a2152582: No bootstrap required, opened a new log
I20260709 13:03:16.335119 10537 ts_tablet_manager.cc:1403] T afe8b130a0d1484e9f08fed8f6be2f61 P 17d104ff42224d8c9cdf4c53a2152582: Time spent bootstrapping tablet: real 0.039s	user 0.015s	sys 0.012s
I20260709 13:03:16.335237 10543 raft_consensus.cc:2749] T 4feb1aa9b1d14601b28b28a6d515ee65 P 17d104ff42224d8c9cdf4c53a2152582 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:16.337288 10579 raft_consensus.cc:2804] T 19c2daa20bbe47afa5289e2b32987709 P 22139e7a5ea041588dd21a8d06ba1741 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:16.337850 10579 raft_consensus.cc:697] T 19c2daa20bbe47afa5289e2b32987709 P 22139e7a5ea041588dd21a8d06ba1741 [term 1 LEADER]: Becoming Leader. State: Replica: 22139e7a5ea041588dd21a8d06ba1741, State: Running, Role: LEADER
I20260709 13:03:16.337837 10537 raft_consensus.cc:359] T afe8b130a0d1484e9f08fed8f6be2f61 P 17d104ff42224d8c9cdf4c53a2152582 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:16.338728 10537 raft_consensus.cc:385] T afe8b130a0d1484e9f08fed8f6be2f61 P 17d104ff42224d8c9cdf4c53a2152582 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:16.339026 10537 raft_consensus.cc:740] T afe8b130a0d1484e9f08fed8f6be2f61 P 17d104ff42224d8c9cdf4c53a2152582 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17d104ff42224d8c9cdf4c53a2152582, State: Initialized, Role: FOLLOWER
I20260709 13:03:16.338984 10579 consensus_queue.cc:237] T 19c2daa20bbe47afa5289e2b32987709 P 22139e7a5ea041588dd21a8d06ba1741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:16.339920 10537 consensus_queue.cc:260] T afe8b130a0d1484e9f08fed8f6be2f61 P 17d104ff42224d8c9cdf4c53a2152582 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:16.342182 10537 ts_tablet_manager.cc:1434] T afe8b130a0d1484e9f08fed8f6be2f61 P 17d104ff42224d8c9cdf4c53a2152582: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:03:16.344149 10537 tablet_bootstrap.cc:492] T 1484bae8a7264a0e9f328dd5ce7edad8 P 17d104ff42224d8c9cdf4c53a2152582: Bootstrap starting.
I20260709 13:03:16.348060 10599 consensus_queue.cc:1048] T e0ad84cc4e1942d99055ab43ea0bdac0 P 17d104ff42224d8c9cdf4c53a2152582 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:16.349494 10537 tablet_bootstrap.cc:654] T 1484bae8a7264a0e9f328dd5ce7edad8 P 17d104ff42224d8c9cdf4c53a2152582: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:16.365425 10242 catalog_manager.cc:5697] T 19c2daa20bbe47afa5289e2b32987709 P 22139e7a5ea041588dd21a8d06ba1741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 22139e7a5ea041588dd21a8d06ba1741 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "22139e7a5ea041588dd21a8d06ba1741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:16.364241 10579 consensus_queue.cc:1048] T 77c2a758545e45e29d62d8d71ea3f43d P 22139e7a5ea041588dd21a8d06ba1741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:03:16.375676 10540 raft_consensus.cc:493] T afe8b130a0d1484e9f08fed8f6be2f61 P 22139e7a5ea041588dd21a8d06ba1741 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:16.376252 10540 raft_consensus.cc:515] T afe8b130a0d1484e9f08fed8f6be2f61 P 22139e7a5ea041588dd21a8d06ba1741 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:16.377236 10537 tablet_bootstrap.cc:492] T 1484bae8a7264a0e9f328dd5ce7edad8 P 17d104ff42224d8c9cdf4c53a2152582: No bootstrap required, opened a new log
I20260709 13:03:16.377893 10537 ts_tablet_manager.cc:1403] T 1484bae8a7264a0e9f328dd5ce7edad8 P 17d104ff42224d8c9cdf4c53a2152582: Time spent bootstrapping tablet: real 0.034s	user 0.015s	sys 0.016s
I20260709 13:03:16.378414 10540 leader_election.cc:290] T afe8b130a0d1484e9f08fed8f6be2f61 P 22139e7a5ea041588dd21a8d06ba1741 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24479f93a03b4364837c81f7efbdf9d3 (127.0.107.194:44467), 17d104ff42224d8c9cdf4c53a2152582 (127.0.107.195:41601)
I20260709 13:03:16.379884 10419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe8b130a0d1484e9f08fed8f6be2f61" candidate_uuid: "22139e7a5ea041588dd21a8d06ba1741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24479f93a03b4364837c81f7efbdf9d3" is_pre_election: true
I20260709 13:03:16.380573 10419 raft_consensus.cc:2468] T afe8b130a0d1484e9f08fed8f6be2f61 P 24479f93a03b4364837c81f7efbdf9d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22139e7a5ea041588dd21a8d06ba1741 in term 0.
I20260709 13:03:16.380649 10537 raft_consensus.cc:359] T 1484bae8a7264a0e9f328dd5ce7edad8 P 17d104ff42224d8c9cdf4c53a2152582 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:16.381486 10537 raft_consensus.cc:385] T 1484bae8a7264a0e9f328dd5ce7edad8 P 17d104ff42224d8c9cdf4c53a2152582 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:16.381767 10537 raft_consensus.cc:740] T 1484bae8a7264a0e9f328dd5ce7edad8 P 17d104ff42224d8c9cdf4c53a2152582 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17d104ff42224d8c9cdf4c53a2152582, State: Initialized, Role: FOLLOWER
I20260709 13:03:16.382339 10557 raft_consensus.cc:493] T afe8b130a0d1484e9f08fed8f6be2f61 P 17d104ff42224d8c9cdf4c53a2152582 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:16.382467 10537 consensus_queue.cc:260] T 1484bae8a7264a0e9f328dd5ce7edad8 P 17d104ff42224d8c9cdf4c53a2152582 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:16.382879 10557 raft_consensus.cc:515] T afe8b130a0d1484e9f08fed8f6be2f61 P 17d104ff42224d8c9cdf4c53a2152582 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:16.383987 10310 leader_election.cc:304] T afe8b130a0d1484e9f08fed8f6be2f61 P 22139e7a5ea041588dd21a8d06ba1741 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22139e7a5ea041588dd21a8d06ba1741, 24479f93a03b4364837c81f7efbdf9d3; no voters: 
I20260709 13:03:16.385051 10537 ts_tablet_manager.cc:1434] T 1484bae8a7264a0e9f328dd5ce7edad8 P 17d104ff42224d8c9cdf4c53a2152582: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:03:16.385505 10540 raft_consensus.cc:2804] T afe8b130a0d1484e9f08fed8f6be2f61 P 22139e7a5ea041588dd21a8d06ba1741 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:16.385957 10540 raft_consensus.cc:493] T afe8b130a0d1484e9f08fed8f6be2f61 P 22139e7a5ea041588dd21a8d06ba1741 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:16.386286 10540 raft_consensus.cc:3060] T afe8b130a0d1484e9f08fed8f6be2f61 P 22139e7a5ea041588dd21a8d06ba1741 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:16.383109 10495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe8b130a0d1484e9f08fed8f6be2f61" candidate_uuid: "22139e7a5ea041588dd21a8d06ba1741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17d104ff42224d8c9cdf4c53a2152582" is_pre_election: true
I20260709 13:03:16.389001 10495 raft_consensus.cc:2468] T afe8b130a0d1484e9f08fed8f6be2f61 P 17d104ff42224d8c9cdf4c53a2152582 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22139e7a5ea041588dd21a8d06ba1741 in term 0.
I20260709 13:03:16.390769 10346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe8b130a0d1484e9f08fed8f6be2f61" candidate_uuid: "17d104ff42224d8c9cdf4c53a2152582" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22139e7a5ea041588dd21a8d06ba1741" is_pre_election: true
I20260709 13:03:16.392014 10557 leader_election.cc:290] T afe8b130a0d1484e9f08fed8f6be2f61 P 17d104ff42224d8c9cdf4c53a2152582 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22139e7a5ea041588dd21a8d06ba1741 (127.0.107.193:45479), 24479f93a03b4364837c81f7efbdf9d3 (127.0.107.194:44467)
I20260709 13:03:16.392206 10419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe8b130a0d1484e9f08fed8f6be2f61" candidate_uuid: "17d104ff42224d8c9cdf4c53a2152582" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24479f93a03b4364837c81f7efbdf9d3" is_pre_election: true
I20260709 13:03:16.392838 10419 raft_consensus.cc:2468] T afe8b130a0d1484e9f08fed8f6be2f61 P 24479f93a03b4364837c81f7efbdf9d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17d104ff42224d8c9cdf4c53a2152582 in term 0.
I20260709 13:03:16.393795 10459 leader_election.cc:304] T afe8b130a0d1484e9f08fed8f6be2f61 P 17d104ff42224d8c9cdf4c53a2152582 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17d104ff42224d8c9cdf4c53a2152582, 24479f93a03b4364837c81f7efbdf9d3; no voters: 
I20260709 13:03:16.394477 10557 raft_consensus.cc:2804] T afe8b130a0d1484e9f08fed8f6be2f61 P 17d104ff42224d8c9cdf4c53a2152582 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:16.394863 10557 raft_consensus.cc:493] T afe8b130a0d1484e9f08fed8f6be2f61 P 17d104ff42224d8c9cdf4c53a2152582 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:16.395151 10557 raft_consensus.cc:3060] T afe8b130a0d1484e9f08fed8f6be2f61 P 17d104ff42224d8c9cdf4c53a2152582 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:16.395418 10540 raft_consensus.cc:515] T afe8b130a0d1484e9f08fed8f6be2f61 P 22139e7a5ea041588dd21a8d06ba1741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:16.396473 10346 raft_consensus.cc:2393] T afe8b130a0d1484e9f08fed8f6be2f61 P 22139e7a5ea041588dd21a8d06ba1741 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17d104ff42224d8c9cdf4c53a2152582 in current term 1: Already voted for candidate 22139e7a5ea041588dd21a8d06ba1741 in this term.
I20260709 13:03:16.398958 10540 leader_election.cc:290] T afe8b130a0d1484e9f08fed8f6be2f61 P 22139e7a5ea041588dd21a8d06ba1741 [CANDIDATE]: Term 1 election: Requested vote from peers 24479f93a03b4364837c81f7efbdf9d3 (127.0.107.194:44467), 17d104ff42224d8c9cdf4c53a2152582 (127.0.107.195:41601)
I20260709 13:03:16.399611 10419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe8b130a0d1484e9f08fed8f6be2f61" candidate_uuid: "22139e7a5ea041588dd21a8d06ba1741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24479f93a03b4364837c81f7efbdf9d3"
I20260709 13:03:16.400162 10419 raft_consensus.cc:3060] T afe8b130a0d1484e9f08fed8f6be2f61 P 24479f93a03b4364837c81f7efbdf9d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:16.400180 10495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe8b130a0d1484e9f08fed8f6be2f61" candidate_uuid: "22139e7a5ea041588dd21a8d06ba1741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17d104ff42224d8c9cdf4c53a2152582"
I20260709 13:03:16.402218 10557 raft_consensus.cc:515] T afe8b130a0d1484e9f08fed8f6be2f61 P 17d104ff42224d8c9cdf4c53a2152582 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:16.402884 10346 raft_consensus.cc:3060] T 2df7bfe151e349f1a30cd3142e13c021 P 22139e7a5ea041588dd21a8d06ba1741 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:16.403582 10495 raft_consensus.cc:2393] T afe8b130a0d1484e9f08fed8f6be2f61 P 17d104ff42224d8c9cdf4c53a2152582 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 22139e7a5ea041588dd21a8d06ba1741 in current term 1: Already voted for candidate 17d104ff42224d8c9cdf4c53a2152582 in this term.
I20260709 13:03:16.405490 10345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe8b130a0d1484e9f08fed8f6be2f61" candidate_uuid: "17d104ff42224d8c9cdf4c53a2152582" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22139e7a5ea041588dd21a8d06ba1741"
I20260709 13:03:16.405810 10420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe8b130a0d1484e9f08fed8f6be2f61" candidate_uuid: "17d104ff42224d8c9cdf4c53a2152582" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24479f93a03b4364837c81f7efbdf9d3"
I20260709 13:03:16.406308 10345 raft_consensus.cc:2393] T afe8b130a0d1484e9f08fed8f6be2f61 P 22139e7a5ea041588dd21a8d06ba1741 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 17d104ff42224d8c9cdf4c53a2152582 in current term 1: Already voted for candidate 22139e7a5ea041588dd21a8d06ba1741 in this term.
I20260709 13:03:16.407732 10557 leader_election.cc:290] T afe8b130a0d1484e9f08fed8f6be2f61 P 17d104ff42224d8c9cdf4c53a2152582 [CANDIDATE]: Term 1 election: Requested vote from peers 22139e7a5ea041588dd21a8d06ba1741 (127.0.107.193:45479), 24479f93a03b4364837c81f7efbdf9d3 (127.0.107.194:44467)
I20260709 13:03:16.407867 10458 leader_election.cc:304] T afe8b130a0d1484e9f08fed8f6be2f61 P 17d104ff42224d8c9cdf4c53a2152582 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17d104ff42224d8c9cdf4c53a2152582; no voters: 22139e7a5ea041588dd21a8d06ba1741, 24479f93a03b4364837c81f7efbdf9d3
I20260709 13:03:16.409689 10599 raft_consensus.cc:2749] T afe8b130a0d1484e9f08fed8f6be2f61 P 17d104ff42224d8c9cdf4c53a2152582 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:03:16.408162 10419 raft_consensus.cc:2468] T afe8b130a0d1484e9f08fed8f6be2f61 P 24479f93a03b4364837c81f7efbdf9d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22139e7a5ea041588dd21a8d06ba1741 in term 1.
I20260709 13:03:16.411828 10541 consensus_queue.cc:1048] T 2df7bfe151e349f1a30cd3142e13c021 P 24479f93a03b4364837c81f7efbdf9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:16.412211 10310 leader_election.cc:304] T afe8b130a0d1484e9f08fed8f6be2f61 P 22139e7a5ea041588dd21a8d06ba1741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 22139e7a5ea041588dd21a8d06ba1741, 24479f93a03b4364837c81f7efbdf9d3; no voters: 17d104ff42224d8c9cdf4c53a2152582
I20260709 13:03:16.413033 10540 raft_consensus.cc:2804] T afe8b130a0d1484e9f08fed8f6be2f61 P 22139e7a5ea041588dd21a8d06ba1741 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:16.413514 10540 raft_consensus.cc:697] T afe8b130a0d1484e9f08fed8f6be2f61 P 22139e7a5ea041588dd21a8d06ba1741 [term 1 LEADER]: Becoming Leader. State: Replica: 22139e7a5ea041588dd21a8d06ba1741, State: Running, Role: LEADER
I20260709 13:03:16.414384 10540 consensus_queue.cc:237] T afe8b130a0d1484e9f08fed8f6be2f61 P 22139e7a5ea041588dd21a8d06ba1741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:16.424228 10581 consensus_queue.cc:1048] T 2df7bfe151e349f1a30cd3142e13c021 P 24479f93a03b4364837c81f7efbdf9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:16.423682 10242 catalog_manager.cc:5697] T afe8b130a0d1484e9f08fed8f6be2f61 P 22139e7a5ea041588dd21a8d06ba1741 reported cstate change: term changed from 0 to 1, leader changed from <none> to 22139e7a5ea041588dd21a8d06ba1741 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "22139e7a5ea041588dd21a8d06ba1741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:16.436919 10599 consensus_queue.cc:1048] T a848edc7d33e48a1a475daf70fb66449 P 17d104ff42224d8c9cdf4c53a2152582 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:16.448536 10543 consensus_queue.cc:1048] T a848edc7d33e48a1a475daf70fb66449 P 17d104ff42224d8c9cdf4c53a2152582 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:16.464525 10581 consensus_queue.cc:1048] T 1484bae8a7264a0e9f328dd5ce7edad8 P 24479f93a03b4364837c81f7efbdf9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:16.473562 10495 raft_consensus.cc:3060] T 1484bae8a7264a0e9f328dd5ce7edad8 P 17d104ff42224d8c9cdf4c53a2152582 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:16.483237 10582 consensus_queue.cc:1048] T 1484bae8a7264a0e9f328dd5ce7edad8 P 24479f93a03b4364837c81f7efbdf9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:16.490128 10540 consensus_queue.cc:1048] T b038dccd00b44161b10a08f5b963dd45 P 22139e7a5ea041588dd21a8d06ba1741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:16.501739 10579 consensus_queue.cc:1048] T b038dccd00b44161b10a08f5b963dd45 P 22139e7a5ea041588dd21a8d06ba1741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:16.563867 10580 consensus_queue.cc:1048] T 4feb1aa9b1d14601b28b28a6d515ee65 P 22139e7a5ea041588dd21a8d06ba1741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:16.568897   431 ts_manager.cc:295] Set tserver state for 22139e7a5ea041588dd21a8d06ba1741 to MAINTENANCE_MODE
I20260709 13:03:16.569769   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
I20260709 13:03:16.579622 10580 consensus_queue.cc:1048] T 4feb1aa9b1d14601b28b28a6d515ee65 P 22139e7a5ea041588dd21a8d06ba1741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:16.611193   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:16.612170   431 tablet_replica.cc:333] T 2df7bfe151e349f1a30cd3142e13c021 P 22139e7a5ea041588dd21a8d06ba1741: stopping tablet replica
I20260709 13:03:16.612998   431 raft_consensus.cc:2243] T 2df7bfe151e349f1a30cd3142e13c021 P 22139e7a5ea041588dd21a8d06ba1741 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:16.613548   431 raft_consensus.cc:2272] T 2df7bfe151e349f1a30cd3142e13c021 P 22139e7a5ea041588dd21a8d06ba1741 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.616353   431 tablet_replica.cc:333] T 4feb1aa9b1d14601b28b28a6d515ee65 P 22139e7a5ea041588dd21a8d06ba1741: stopping tablet replica
I20260709 13:03:16.616914   431 raft_consensus.cc:2243] T 4feb1aa9b1d14601b28b28a6d515ee65 P 22139e7a5ea041588dd21a8d06ba1741 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:16.617688   431 raft_consensus.cc:2272] T 4feb1aa9b1d14601b28b28a6d515ee65 P 22139e7a5ea041588dd21a8d06ba1741 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.619958   431 tablet_replica.cc:333] T 1484bae8a7264a0e9f328dd5ce7edad8 P 22139e7a5ea041588dd21a8d06ba1741: stopping tablet replica
I20260709 13:03:16.620481   431 raft_consensus.cc:2243] T 1484bae8a7264a0e9f328dd5ce7edad8 P 22139e7a5ea041588dd21a8d06ba1741 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:16.620846   431 raft_consensus.cc:2272] T 1484bae8a7264a0e9f328dd5ce7edad8 P 22139e7a5ea041588dd21a8d06ba1741 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.623174   431 tablet_replica.cc:333] T afe8b130a0d1484e9f08fed8f6be2f61 P 22139e7a5ea041588dd21a8d06ba1741: stopping tablet replica
I20260709 13:03:16.623705   431 raft_consensus.cc:2243] T afe8b130a0d1484e9f08fed8f6be2f61 P 22139e7a5ea041588dd21a8d06ba1741 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:16.624274   431 pending_rounds.cc:70] T afe8b130a0d1484e9f08fed8f6be2f61 P 22139e7a5ea041588dd21a8d06ba1741: Trying to abort 1 pending ops.
I20260709 13:03:16.624426   431 pending_rounds.cc:77] T afe8b130a0d1484e9f08fed8f6be2f61 P 22139e7a5ea041588dd21a8d06ba1741: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305634596522704896 op_type: NO_OP noop_request { }
I20260709 13:03:16.624719   431 raft_consensus.cc:2889] T afe8b130a0d1484e9f08fed8f6be2f61 P 22139e7a5ea041588dd21a8d06ba1741 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:03:16.624943   431 raft_consensus.cc:2272] T afe8b130a0d1484e9f08fed8f6be2f61 P 22139e7a5ea041588dd21a8d06ba1741 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.627322   431 tablet_replica.cc:333] T 19c2daa20bbe47afa5289e2b32987709 P 22139e7a5ea041588dd21a8d06ba1741: stopping tablet replica
I20260709 13:03:16.627848   431 raft_consensus.cc:2243] T 19c2daa20bbe47afa5289e2b32987709 P 22139e7a5ea041588dd21a8d06ba1741 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:16.628404   431 pending_rounds.cc:70] T 19c2daa20bbe47afa5289e2b32987709 P 22139e7a5ea041588dd21a8d06ba1741: Trying to abort 1 pending ops.
I20260709 13:03:16.628561   431 pending_rounds.cc:77] T 19c2daa20bbe47afa5289e2b32987709 P 22139e7a5ea041588dd21a8d06ba1741: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305634596215640064 op_type: NO_OP noop_request { }
I20260709 13:03:16.628778   431 raft_consensus.cc:2889] T 19c2daa20bbe47afa5289e2b32987709 P 22139e7a5ea041588dd21a8d06ba1741 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:03:16.628988   431 raft_consensus.cc:2272] T 19c2daa20bbe47afa5289e2b32987709 P 22139e7a5ea041588dd21a8d06ba1741 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.631379   431 tablet_replica.cc:333] T 89649f4e196f44a3b3b98fa009c228f8 P 22139e7a5ea041588dd21a8d06ba1741: stopping tablet replica
I20260709 13:03:16.631891   431 raft_consensus.cc:2243] T 89649f4e196f44a3b3b98fa009c228f8 P 22139e7a5ea041588dd21a8d06ba1741 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:16.632215   431 raft_consensus.cc:2272] T 89649f4e196f44a3b3b98fa009c228f8 P 22139e7a5ea041588dd21a8d06ba1741 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.633852   431 tablet_replica.cc:333] T e0ad84cc4e1942d99055ab43ea0bdac0 P 22139e7a5ea041588dd21a8d06ba1741: stopping tablet replica
I20260709 13:03:16.634308   431 raft_consensus.cc:2243] T e0ad84cc4e1942d99055ab43ea0bdac0 P 22139e7a5ea041588dd21a8d06ba1741 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:16.634687   431 raft_consensus.cc:2272] T e0ad84cc4e1942d99055ab43ea0bdac0 P 22139e7a5ea041588dd21a8d06ba1741 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.636811   431 tablet_replica.cc:333] T b038dccd00b44161b10a08f5b963dd45 P 22139e7a5ea041588dd21a8d06ba1741: stopping tablet replica
I20260709 13:03:16.637297   431 raft_consensus.cc:2243] T b038dccd00b44161b10a08f5b963dd45 P 22139e7a5ea041588dd21a8d06ba1741 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:16.638015   431 raft_consensus.cc:2272] T b038dccd00b44161b10a08f5b963dd45 P 22139e7a5ea041588dd21a8d06ba1741 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.640029   431 tablet_replica.cc:333] T 77c2a758545e45e29d62d8d71ea3f43d P 22139e7a5ea041588dd21a8d06ba1741: stopping tablet replica
I20260709 13:03:16.640511   431 raft_consensus.cc:2243] T 77c2a758545e45e29d62d8d71ea3f43d P 22139e7a5ea041588dd21a8d06ba1741 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:16.641232   431 raft_consensus.cc:2272] T 77c2a758545e45e29d62d8d71ea3f43d P 22139e7a5ea041588dd21a8d06ba1741 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.643385   431 tablet_replica.cc:333] T a848edc7d33e48a1a475daf70fb66449 P 22139e7a5ea041588dd21a8d06ba1741: stopping tablet replica
I20260709 13:03:16.643862   431 raft_consensus.cc:2243] T a848edc7d33e48a1a475daf70fb66449 P 22139e7a5ea041588dd21a8d06ba1741 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:16.644225   431 raft_consensus.cc:2272] T a848edc7d33e48a1a475daf70fb66449 P 22139e7a5ea041588dd21a8d06ba1741 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.673957   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
W20260709 13:03:16.773604 10292 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:03:16.773574 10573 consensus_queue.cc:1048] T 89649f4e196f44a3b3b98fa009c228f8 P 24479f93a03b4364837c81f7efbdf9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:03:16.778962 10384 consensus_peers.cc:597] T 89649f4e196f44a3b3b98fa009c228f8 P 24479f93a03b4364837c81f7efbdf9d3 -> Peer 22139e7a5ea041588dd21a8d06ba1741 (127.0.107.193:45479): Couldn't send request to peer 22139e7a5ea041588dd21a8d06ba1741. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45479: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:16.968020 10458 consensus_peers.cc:597] T e0ad84cc4e1942d99055ab43ea0bdac0 P 17d104ff42224d8c9cdf4c53a2152582 -> Peer 22139e7a5ea041588dd21a8d06ba1741 (127.0.107.193:45479): Couldn't send request to peer 22139e7a5ea041588dd21a8d06ba1741. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45479: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:16.996531 10384 consensus_peers.cc:597] T 1484bae8a7264a0e9f328dd5ce7edad8 P 24479f93a03b4364837c81f7efbdf9d3 -> Peer 22139e7a5ea041588dd21a8d06ba1741 (127.0.107.193:45479): Couldn't send request to peer 22139e7a5ea041588dd21a8d06ba1741. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45479: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:17.024917 10384 consensus_peers.cc:597] T 2df7bfe151e349f1a30cd3142e13c021 P 24479f93a03b4364837c81f7efbdf9d3 -> Peer 22139e7a5ea041588dd21a8d06ba1741 (127.0.107.193:45479): Couldn't send request to peer 22139e7a5ea041588dd21a8d06ba1741. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45479: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:17.068030 10458 consensus_peers.cc:597] T a848edc7d33e48a1a475daf70fb66449 P 17d104ff42224d8c9cdf4c53a2152582 -> Peer 22139e7a5ea041588dd21a8d06ba1741 (127.0.107.193:45479): Couldn't send request to peer 22139e7a5ea041588dd21a8d06ba1741. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45479: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:17.774986 10292 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:03:17.847296 10573 raft_consensus.cc:493] T 77c2a758545e45e29d62d8d71ea3f43d P 24479f93a03b4364837c81f7efbdf9d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22139e7a5ea041588dd21a8d06ba1741)
I20260709 13:03:17.847831 10573 raft_consensus.cc:515] T 77c2a758545e45e29d62d8d71ea3f43d P 24479f93a03b4364837c81f7efbdf9d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:17.849542 10573 leader_election.cc:290] T 77c2a758545e45e29d62d8d71ea3f43d P 24479f93a03b4364837c81f7efbdf9d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22139e7a5ea041588dd21a8d06ba1741 (127.0.107.193:45479), 17d104ff42224d8c9cdf4c53a2152582 (127.0.107.195:41601)
I20260709 13:03:17.850590 10495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77c2a758545e45e29d62d8d71ea3f43d" candidate_uuid: "24479f93a03b4364837c81f7efbdf9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17d104ff42224d8c9cdf4c53a2152582" is_pre_election: true
W20260709 13:03:17.853313 10384 leader_election.cc:336] T 77c2a758545e45e29d62d8d71ea3f43d P 24479f93a03b4364837c81f7efbdf9d3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 22139e7a5ea041588dd21a8d06ba1741 (127.0.107.193:45479): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45479: connect: Connection refused (error 111)
I20260709 13:03:17.853801 10384 leader_election.cc:304] T 77c2a758545e45e29d62d8d71ea3f43d P 24479f93a03b4364837c81f7efbdf9d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24479f93a03b4364837c81f7efbdf9d3; no voters: 17d104ff42224d8c9cdf4c53a2152582, 22139e7a5ea041588dd21a8d06ba1741
I20260709 13:03:17.854557 10573 raft_consensus.cc:2749] T 77c2a758545e45e29d62d8d71ea3f43d P 24479f93a03b4364837c81f7efbdf9d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:17.876590 10543 raft_consensus.cc:493] T 77c2a758545e45e29d62d8d71ea3f43d P 17d104ff42224d8c9cdf4c53a2152582 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22139e7a5ea041588dd21a8d06ba1741)
I20260709 13:03:17.877177 10543 raft_consensus.cc:515] T 77c2a758545e45e29d62d8d71ea3f43d P 17d104ff42224d8c9cdf4c53a2152582 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:17.879019 10543 leader_election.cc:290] T 77c2a758545e45e29d62d8d71ea3f43d P 17d104ff42224d8c9cdf4c53a2152582 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22139e7a5ea041588dd21a8d06ba1741 (127.0.107.193:45479), 24479f93a03b4364837c81f7efbdf9d3 (127.0.107.194:44467)
I20260709 13:03:17.880174 10420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77c2a758545e45e29d62d8d71ea3f43d" candidate_uuid: "17d104ff42224d8c9cdf4c53a2152582" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "24479f93a03b4364837c81f7efbdf9d3" is_pre_election: true
I20260709 13:03:17.880950 10420 raft_consensus.cc:2468] T 77c2a758545e45e29d62d8d71ea3f43d P 24479f93a03b4364837c81f7efbdf9d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17d104ff42224d8c9cdf4c53a2152582 in term 1.
I20260709 13:03:17.882000 10459 leader_election.cc:304] T 77c2a758545e45e29d62d8d71ea3f43d P 17d104ff42224d8c9cdf4c53a2152582 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17d104ff42224d8c9cdf4c53a2152582, 24479f93a03b4364837c81f7efbdf9d3; no voters: 
I20260709 13:03:17.882858 10543 raft_consensus.cc:2804] T 77c2a758545e45e29d62d8d71ea3f43d P 17d104ff42224d8c9cdf4c53a2152582 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:03:17.882977 10458 leader_election.cc:336] T 77c2a758545e45e29d62d8d71ea3f43d P 17d104ff42224d8c9cdf4c53a2152582 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 22139e7a5ea041588dd21a8d06ba1741 (127.0.107.193:45479): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45479: connect: Connection refused (error 111)
I20260709 13:03:17.883236 10543 raft_consensus.cc:493] T 77c2a758545e45e29d62d8d71ea3f43d P 17d104ff42224d8c9cdf4c53a2152582 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 22139e7a5ea041588dd21a8d06ba1741)
I20260709 13:03:17.883571 10543 raft_consensus.cc:3060] T 77c2a758545e45e29d62d8d71ea3f43d P 17d104ff42224d8c9cdf4c53a2152582 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:17.890000 10543 raft_consensus.cc:515] T 77c2a758545e45e29d62d8d71ea3f43d P 17d104ff42224d8c9cdf4c53a2152582 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:17.891625 10543 leader_election.cc:290] T 77c2a758545e45e29d62d8d71ea3f43d P 17d104ff42224d8c9cdf4c53a2152582 [CANDIDATE]: Term 2 election: Requested vote from peers 22139e7a5ea041588dd21a8d06ba1741 (127.0.107.193:45479), 24479f93a03b4364837c81f7efbdf9d3 (127.0.107.194:44467)
I20260709 13:03:17.892748 10420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77c2a758545e45e29d62d8d71ea3f43d" candidate_uuid: "17d104ff42224d8c9cdf4c53a2152582" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "24479f93a03b4364837c81f7efbdf9d3"
I20260709 13:03:17.893322 10420 raft_consensus.cc:3060] T 77c2a758545e45e29d62d8d71ea3f43d P 24479f93a03b4364837c81f7efbdf9d3 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:03:17.895104 10458 leader_election.cc:336] T 77c2a758545e45e29d62d8d71ea3f43d P 17d104ff42224d8c9cdf4c53a2152582 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 22139e7a5ea041588dd21a8d06ba1741 (127.0.107.193:45479): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45479: connect: Connection refused (error 111)
I20260709 13:03:17.898898 10420 raft_consensus.cc:2468] T 77c2a758545e45e29d62d8d71ea3f43d P 24479f93a03b4364837c81f7efbdf9d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17d104ff42224d8c9cdf4c53a2152582 in term 2.
I20260709 13:03:17.899945 10459 leader_election.cc:304] T 77c2a758545e45e29d62d8d71ea3f43d P 17d104ff42224d8c9cdf4c53a2152582 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17d104ff42224d8c9cdf4c53a2152582, 24479f93a03b4364837c81f7efbdf9d3; no voters: 22139e7a5ea041588dd21a8d06ba1741
I20260709 13:03:17.900578 10543 raft_consensus.cc:2804] T 77c2a758545e45e29d62d8d71ea3f43d P 17d104ff42224d8c9cdf4c53a2152582 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:17.900974 10543 raft_consensus.cc:697] T 77c2a758545e45e29d62d8d71ea3f43d P 17d104ff42224d8c9cdf4c53a2152582 [term 2 LEADER]: Becoming Leader. State: Replica: 17d104ff42224d8c9cdf4c53a2152582, State: Running, Role: LEADER
I20260709 13:03:17.901675 10543 consensus_queue.cc:237] T 77c2a758545e45e29d62d8d71ea3f43d P 17d104ff42224d8c9cdf4c53a2152582 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:17.908895 10243 catalog_manager.cc:5697] T 77c2a758545e45e29d62d8d71ea3f43d P 17d104ff42224d8c9cdf4c53a2152582 reported cstate change: term changed from 1 to 2, leader changed from 22139e7a5ea041588dd21a8d06ba1741 (127.0.107.193) to 17d104ff42224d8c9cdf4c53a2152582 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "17d104ff42224d8c9cdf4c53a2152582" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:18.001569 10573 raft_consensus.cc:493] T b038dccd00b44161b10a08f5b963dd45 P 24479f93a03b4364837c81f7efbdf9d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22139e7a5ea041588dd21a8d06ba1741)
I20260709 13:03:18.002159 10573 raft_consensus.cc:515] T b038dccd00b44161b10a08f5b963dd45 P 24479f93a03b4364837c81f7efbdf9d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:18.003875 10573 leader_election.cc:290] T b038dccd00b44161b10a08f5b963dd45 P 24479f93a03b4364837c81f7efbdf9d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22139e7a5ea041588dd21a8d06ba1741 (127.0.107.193:45479), 17d104ff42224d8c9cdf4c53a2152582 (127.0.107.195:41601)
I20260709 13:03:18.005043 10495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b038dccd00b44161b10a08f5b963dd45" candidate_uuid: "24479f93a03b4364837c81f7efbdf9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17d104ff42224d8c9cdf4c53a2152582" is_pre_election: true
I20260709 13:03:18.005657 10495 raft_consensus.cc:2468] T b038dccd00b44161b10a08f5b963dd45 P 17d104ff42224d8c9cdf4c53a2152582 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24479f93a03b4364837c81f7efbdf9d3 in term 1.
I20260709 13:03:18.006116 10543 raft_consensus.cc:493] T b038dccd00b44161b10a08f5b963dd45 P 17d104ff42224d8c9cdf4c53a2152582 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22139e7a5ea041588dd21a8d06ba1741)
I20260709 13:03:18.006624 10543 raft_consensus.cc:515] T b038dccd00b44161b10a08f5b963dd45 P 17d104ff42224d8c9cdf4c53a2152582 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:18.006764 10387 leader_election.cc:304] T b038dccd00b44161b10a08f5b963dd45 P 24479f93a03b4364837c81f7efbdf9d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17d104ff42224d8c9cdf4c53a2152582, 24479f93a03b4364837c81f7efbdf9d3; no voters: 
I20260709 13:03:18.007622 10573 raft_consensus.cc:2804] T b038dccd00b44161b10a08f5b963dd45 P 24479f93a03b4364837c81f7efbdf9d3 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:03:18.007851 10384 leader_election.cc:336] T b038dccd00b44161b10a08f5b963dd45 P 24479f93a03b4364837c81f7efbdf9d3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 22139e7a5ea041588dd21a8d06ba1741 (127.0.107.193:45479): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45479: connect: Connection refused (error 111)
I20260709 13:03:18.007995 10573 raft_consensus.cc:493] T b038dccd00b44161b10a08f5b963dd45 P 24479f93a03b4364837c81f7efbdf9d3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 22139e7a5ea041588dd21a8d06ba1741)
I20260709 13:03:18.008466 10573 raft_consensus.cc:3060] T b038dccd00b44161b10a08f5b963dd45 P 24479f93a03b4364837c81f7efbdf9d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:18.008678 10543 leader_election.cc:290] T b038dccd00b44161b10a08f5b963dd45 P 17d104ff42224d8c9cdf4c53a2152582 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22139e7a5ea041588dd21a8d06ba1741 (127.0.107.193:45479), 24479f93a03b4364837c81f7efbdf9d3 (127.0.107.194:44467)
I20260709 13:03:18.010177 10420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b038dccd00b44161b10a08f5b963dd45" candidate_uuid: "17d104ff42224d8c9cdf4c53a2152582" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "24479f93a03b4364837c81f7efbdf9d3" is_pre_election: true
W20260709 13:03:18.012135 10458 leader_election.cc:336] T b038dccd00b44161b10a08f5b963dd45 P 17d104ff42224d8c9cdf4c53a2152582 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 22139e7a5ea041588dd21a8d06ba1741 (127.0.107.193:45479): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45479: connect: Connection refused (error 111)
I20260709 13:03:18.014186 10573 raft_consensus.cc:515] T b038dccd00b44161b10a08f5b963dd45 P 24479f93a03b4364837c81f7efbdf9d3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:18.015235 10420 raft_consensus.cc:2393] T b038dccd00b44161b10a08f5b963dd45 P 24479f93a03b4364837c81f7efbdf9d3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17d104ff42224d8c9cdf4c53a2152582 in current term 2: Already voted for candidate 24479f93a03b4364837c81f7efbdf9d3 in this term.
I20260709 13:03:18.016134 10573 leader_election.cc:290] T b038dccd00b44161b10a08f5b963dd45 P 24479f93a03b4364837c81f7efbdf9d3 [CANDIDATE]: Term 2 election: Requested vote from peers 22139e7a5ea041588dd21a8d06ba1741 (127.0.107.193:45479), 17d104ff42224d8c9cdf4c53a2152582 (127.0.107.195:41601)
I20260709 13:03:18.017529 10495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b038dccd00b44161b10a08f5b963dd45" candidate_uuid: "24479f93a03b4364837c81f7efbdf9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17d104ff42224d8c9cdf4c53a2152582"
I20260709 13:03:18.017388 10459 leader_election.cc:304] T b038dccd00b44161b10a08f5b963dd45 P 17d104ff42224d8c9cdf4c53a2152582 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17d104ff42224d8c9cdf4c53a2152582; no voters: 22139e7a5ea041588dd21a8d06ba1741, 24479f93a03b4364837c81f7efbdf9d3
I20260709 13:03:18.018225 10495 raft_consensus.cc:3060] T b038dccd00b44161b10a08f5b963dd45 P 17d104ff42224d8c9cdf4c53a2152582 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:03:18.020728 10384 leader_election.cc:336] T b038dccd00b44161b10a08f5b963dd45 P 24479f93a03b4364837c81f7efbdf9d3 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 22139e7a5ea041588dd21a8d06ba1741 (127.0.107.193:45479): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45479: connect: Connection refused (error 111)
I20260709 13:03:18.023883 10495 raft_consensus.cc:2468] T b038dccd00b44161b10a08f5b963dd45 P 17d104ff42224d8c9cdf4c53a2152582 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24479f93a03b4364837c81f7efbdf9d3 in term 2.
I20260709 13:03:18.024410 10543 raft_consensus.cc:2749] T b038dccd00b44161b10a08f5b963dd45 P 17d104ff42224d8c9cdf4c53a2152582 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:18.024996 10387 leader_election.cc:304] T b038dccd00b44161b10a08f5b963dd45 P 24479f93a03b4364837c81f7efbdf9d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17d104ff42224d8c9cdf4c53a2152582, 24479f93a03b4364837c81f7efbdf9d3; no voters: 22139e7a5ea041588dd21a8d06ba1741
I20260709 13:03:18.025717 10573 raft_consensus.cc:2804] T b038dccd00b44161b10a08f5b963dd45 P 24479f93a03b4364837c81f7efbdf9d3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:18.026156 10573 raft_consensus.cc:697] T b038dccd00b44161b10a08f5b963dd45 P 24479f93a03b4364837c81f7efbdf9d3 [term 2 LEADER]: Becoming Leader. State: Replica: 24479f93a03b4364837c81f7efbdf9d3, State: Running, Role: LEADER
I20260709 13:03:18.026921 10573 consensus_queue.cc:237] T b038dccd00b44161b10a08f5b963dd45 P 24479f93a03b4364837c81f7efbdf9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:18.034101 10243 catalog_manager.cc:5697] T b038dccd00b44161b10a08f5b963dd45 P 24479f93a03b4364837c81f7efbdf9d3 reported cstate change: term changed from 1 to 2, leader changed from 22139e7a5ea041588dd21a8d06ba1741 (127.0.107.193) to 24479f93a03b4364837c81f7efbdf9d3 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "24479f93a03b4364837c81f7efbdf9d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:18.080991 10573 raft_consensus.cc:493] T 4feb1aa9b1d14601b28b28a6d515ee65 P 24479f93a03b4364837c81f7efbdf9d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22139e7a5ea041588dd21a8d06ba1741)
I20260709 13:03:18.081496 10573 raft_consensus.cc:515] T 4feb1aa9b1d14601b28b28a6d515ee65 P 24479f93a03b4364837c81f7efbdf9d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:18.083223 10573 leader_election.cc:290] T 4feb1aa9b1d14601b28b28a6d515ee65 P 24479f93a03b4364837c81f7efbdf9d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22139e7a5ea041588dd21a8d06ba1741 (127.0.107.193:45479), 17d104ff42224d8c9cdf4c53a2152582 (127.0.107.195:41601)
I20260709 13:03:18.084096 10543 raft_consensus.cc:493] T 4feb1aa9b1d14601b28b28a6d515ee65 P 17d104ff42224d8c9cdf4c53a2152582 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22139e7a5ea041588dd21a8d06ba1741)
I20260709 13:03:18.084385 10495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4feb1aa9b1d14601b28b28a6d515ee65" candidate_uuid: "24479f93a03b4364837c81f7efbdf9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17d104ff42224d8c9cdf4c53a2152582" is_pre_election: true
W20260709 13:03:18.084756 10384 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45479: connect: Connection refused (error 111) [suppressed 117 similar messages]
I20260709 13:03:18.084692 10543 raft_consensus.cc:515] T 4feb1aa9b1d14601b28b28a6d515ee65 P 17d104ff42224d8c9cdf4c53a2152582 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:18.085856 10495 raft_consensus.cc:2468] T 4feb1aa9b1d14601b28b28a6d515ee65 P 17d104ff42224d8c9cdf4c53a2152582 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24479f93a03b4364837c81f7efbdf9d3 in term 1.
I20260709 13:03:18.087311 10543 leader_election.cc:290] T 4feb1aa9b1d14601b28b28a6d515ee65 P 17d104ff42224d8c9cdf4c53a2152582 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22139e7a5ea041588dd21a8d06ba1741 (127.0.107.193:45479), 24479f93a03b4364837c81f7efbdf9d3 (127.0.107.194:44467)
I20260709 13:03:18.087611 10387 leader_election.cc:304] T 4feb1aa9b1d14601b28b28a6d515ee65 P 24479f93a03b4364837c81f7efbdf9d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17d104ff42224d8c9cdf4c53a2152582, 24479f93a03b4364837c81f7efbdf9d3; no voters: 
W20260709 13:03:18.088276 10384 leader_election.cc:336] T 4feb1aa9b1d14601b28b28a6d515ee65 P 24479f93a03b4364837c81f7efbdf9d3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 22139e7a5ea041588dd21a8d06ba1741 (127.0.107.193:45479): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45479: connect: Connection refused (error 111)
I20260709 13:03:18.088449 10573 raft_consensus.cc:2804] T 4feb1aa9b1d14601b28b28a6d515ee65 P 24479f93a03b4364837c81f7efbdf9d3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:18.088871 10573 raft_consensus.cc:493] T 4feb1aa9b1d14601b28b28a6d515ee65 P 24479f93a03b4364837c81f7efbdf9d3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 22139e7a5ea041588dd21a8d06ba1741)
I20260709 13:03:18.089226 10573 raft_consensus.cc:3060] T 4feb1aa9b1d14601b28b28a6d515ee65 P 24479f93a03b4364837c81f7efbdf9d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:18.089913 10420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4feb1aa9b1d14601b28b28a6d515ee65" candidate_uuid: "17d104ff42224d8c9cdf4c53a2152582" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "24479f93a03b4364837c81f7efbdf9d3" is_pre_election: true
W20260709 13:03:18.090349 10458 leader_election.cc:336] T 4feb1aa9b1d14601b28b28a6d515ee65 P 17d104ff42224d8c9cdf4c53a2152582 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 22139e7a5ea041588dd21a8d06ba1741 (127.0.107.193:45479): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45479: connect: Connection refused (error 111)
I20260709 13:03:18.094811 10573 raft_consensus.cc:515] T 4feb1aa9b1d14601b28b28a6d515ee65 P 24479f93a03b4364837c81f7efbdf9d3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:18.095921 10420 raft_consensus.cc:2393] T 4feb1aa9b1d14601b28b28a6d515ee65 P 24479f93a03b4364837c81f7efbdf9d3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17d104ff42224d8c9cdf4c53a2152582 in current term 2: Already voted for candidate 24479f93a03b4364837c81f7efbdf9d3 in this term.
I20260709 13:03:18.096982 10573 leader_election.cc:290] T 4feb1aa9b1d14601b28b28a6d515ee65 P 24479f93a03b4364837c81f7efbdf9d3 [CANDIDATE]: Term 2 election: Requested vote from peers 22139e7a5ea041588dd21a8d06ba1741 (127.0.107.193:45479), 17d104ff42224d8c9cdf4c53a2152582 (127.0.107.195:41601)
I20260709 13:03:18.098209 10495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4feb1aa9b1d14601b28b28a6d515ee65" candidate_uuid: "24479f93a03b4364837c81f7efbdf9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17d104ff42224d8c9cdf4c53a2152582"
I20260709 13:03:18.098542 10459 leader_election.cc:304] T 4feb1aa9b1d14601b28b28a6d515ee65 P 17d104ff42224d8c9cdf4c53a2152582 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17d104ff42224d8c9cdf4c53a2152582; no voters: 22139e7a5ea041588dd21a8d06ba1741, 24479f93a03b4364837c81f7efbdf9d3
I20260709 13:03:18.098839 10495 raft_consensus.cc:3060] T 4feb1aa9b1d14601b28b28a6d515ee65 P 17d104ff42224d8c9cdf4c53a2152582 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:03:18.101145 10384 leader_election.cc:336] T 4feb1aa9b1d14601b28b28a6d515ee65 P 24479f93a03b4364837c81f7efbdf9d3 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 22139e7a5ea041588dd21a8d06ba1741 (127.0.107.193:45479): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45479: connect: Connection refused (error 111)
I20260709 13:03:18.105743 10495 raft_consensus.cc:2468] T 4feb1aa9b1d14601b28b28a6d515ee65 P 17d104ff42224d8c9cdf4c53a2152582 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24479f93a03b4364837c81f7efbdf9d3 in term 2.
I20260709 13:03:18.106276 10543 raft_consensus.cc:2749] T 4feb1aa9b1d14601b28b28a6d515ee65 P 17d104ff42224d8c9cdf4c53a2152582 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:18.106884 10387 leader_election.cc:304] T 4feb1aa9b1d14601b28b28a6d515ee65 P 24479f93a03b4364837c81f7efbdf9d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17d104ff42224d8c9cdf4c53a2152582, 24479f93a03b4364837c81f7efbdf9d3; no voters: 22139e7a5ea041588dd21a8d06ba1741
I20260709 13:03:18.107749 10573 raft_consensus.cc:2804] T 4feb1aa9b1d14601b28b28a6d515ee65 P 24479f93a03b4364837c81f7efbdf9d3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:18.108165 10573 raft_consensus.cc:697] T 4feb1aa9b1d14601b28b28a6d515ee65 P 24479f93a03b4364837c81f7efbdf9d3 [term 2 LEADER]: Becoming Leader. State: Replica: 24479f93a03b4364837c81f7efbdf9d3, State: Running, Role: LEADER
I20260709 13:03:18.108887 10573 consensus_queue.cc:237] T 4feb1aa9b1d14601b28b28a6d515ee65 P 24479f93a03b4364837c81f7efbdf9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:18.116207 10243 catalog_manager.cc:5697] T 4feb1aa9b1d14601b28b28a6d515ee65 P 24479f93a03b4364837c81f7efbdf9d3 reported cstate change: term changed from 1 to 2, leader changed from 22139e7a5ea041588dd21a8d06ba1741 (127.0.107.193) to 24479f93a03b4364837c81f7efbdf9d3 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "24479f93a03b4364837c81f7efbdf9d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:18.432281 10458 consensus_peers.cc:597] T 77c2a758545e45e29d62d8d71ea3f43d P 17d104ff42224d8c9cdf4c53a2152582 -> Peer 22139e7a5ea041588dd21a8d06ba1741 (127.0.107.193:45479): Couldn't send request to peer 22139e7a5ea041588dd21a8d06ba1741. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45479: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:18.446193 10420 raft_consensus.cc:1275] T 77c2a758545e45e29d62d8d71ea3f43d P 24479f93a03b4364837c81f7efbdf9d3 [term 2 FOLLOWER]: Refusing update from remote peer 17d104ff42224d8c9cdf4c53a2152582: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:18.447629 10543 consensus_queue.cc:1048] T 77c2a758545e45e29d62d8d71ea3f43d P 17d104ff42224d8c9cdf4c53a2152582 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:03:18.457176 10384 consensus_peers.cc:597] T b038dccd00b44161b10a08f5b963dd45 P 24479f93a03b4364837c81f7efbdf9d3 -> Peer 22139e7a5ea041588dd21a8d06ba1741 (127.0.107.193:45479): Couldn't send request to peer 22139e7a5ea041588dd21a8d06ba1741. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45479: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:18.489955 10495 raft_consensus.cc:1275] T 4feb1aa9b1d14601b28b28a6d515ee65 P 17d104ff42224d8c9cdf4c53a2152582 [term 2 FOLLOWER]: Refusing update from remote peer 24479f93a03b4364837c81f7efbdf9d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:18.491212 10573 consensus_queue.cc:1048] T 4feb1aa9b1d14601b28b28a6d515ee65 P 24479f93a03b4364837c81f7efbdf9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:03:18.503973 10384 consensus_peers.cc:597] T 4feb1aa9b1d14601b28b28a6d515ee65 P 24479f93a03b4364837c81f7efbdf9d3 -> Peer 22139e7a5ea041588dd21a8d06ba1741 (127.0.107.193:45479): Couldn't send request to peer 22139e7a5ea041588dd21a8d06ba1741. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45479: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:18.508807 10543 raft_consensus.cc:493] T afe8b130a0d1484e9f08fed8f6be2f61 P 17d104ff42224d8c9cdf4c53a2152582 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:18.509354 10543 raft_consensus.cc:515] T afe8b130a0d1484e9f08fed8f6be2f61 P 17d104ff42224d8c9cdf4c53a2152582 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:18.510957 10543 leader_election.cc:290] T afe8b130a0d1484e9f08fed8f6be2f61 P 17d104ff42224d8c9cdf4c53a2152582 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22139e7a5ea041588dd21a8d06ba1741 (127.0.107.193:45479), 24479f93a03b4364837c81f7efbdf9d3 (127.0.107.194:44467)
I20260709 13:03:18.512007 10420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe8b130a0d1484e9f08fed8f6be2f61" candidate_uuid: "17d104ff42224d8c9cdf4c53a2152582" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24479f93a03b4364837c81f7efbdf9d3" is_pre_election: true
I20260709 13:03:18.512727 10420 raft_consensus.cc:2468] T afe8b130a0d1484e9f08fed8f6be2f61 P 24479f93a03b4364837c81f7efbdf9d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17d104ff42224d8c9cdf4c53a2152582 in term 1.
I20260709 13:03:18.513655 10459 leader_election.cc:304] T afe8b130a0d1484e9f08fed8f6be2f61 P 17d104ff42224d8c9cdf4c53a2152582 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17d104ff42224d8c9cdf4c53a2152582, 24479f93a03b4364837c81f7efbdf9d3; no voters: 
I20260709 13:03:18.514322 10543 raft_consensus.cc:2804] T afe8b130a0d1484e9f08fed8f6be2f61 P 17d104ff42224d8c9cdf4c53a2152582 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:03:18.514544 10458 leader_election.cc:336] T afe8b130a0d1484e9f08fed8f6be2f61 P 17d104ff42224d8c9cdf4c53a2152582 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 22139e7a5ea041588dd21a8d06ba1741 (127.0.107.193:45479): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45479: connect: Connection refused (error 111)
I20260709 13:03:18.514747 10543 raft_consensus.cc:493] T afe8b130a0d1484e9f08fed8f6be2f61 P 17d104ff42224d8c9cdf4c53a2152582 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:18.515107 10543 raft_consensus.cc:3060] T afe8b130a0d1484e9f08fed8f6be2f61 P 17d104ff42224d8c9cdf4c53a2152582 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:18.520147 10543 raft_consensus.cc:515] T afe8b130a0d1484e9f08fed8f6be2f61 P 17d104ff42224d8c9cdf4c53a2152582 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:18.521935 10543 leader_election.cc:290] T afe8b130a0d1484e9f08fed8f6be2f61 P 17d104ff42224d8c9cdf4c53a2152582 [CANDIDATE]: Term 2 election: Requested vote from peers 22139e7a5ea041588dd21a8d06ba1741 (127.0.107.193:45479), 24479f93a03b4364837c81f7efbdf9d3 (127.0.107.194:44467)
I20260709 13:03:18.523300 10420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe8b130a0d1484e9f08fed8f6be2f61" candidate_uuid: "17d104ff42224d8c9cdf4c53a2152582" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24479f93a03b4364837c81f7efbdf9d3"
I20260709 13:03:18.523974 10420 raft_consensus.cc:3060] T afe8b130a0d1484e9f08fed8f6be2f61 P 24479f93a03b4364837c81f7efbdf9d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:18.524941 10495 raft_consensus.cc:1275] T b038dccd00b44161b10a08f5b963dd45 P 17d104ff42224d8c9cdf4c53a2152582 [term 2 FOLLOWER]: Refusing update from remote peer 24479f93a03b4364837c81f7efbdf9d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:03:18.526244 10458 leader_election.cc:336] T afe8b130a0d1484e9f08fed8f6be2f61 P 17d104ff42224d8c9cdf4c53a2152582 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 22139e7a5ea041588dd21a8d06ba1741 (127.0.107.193:45479): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45479: connect: Connection refused (error 111)
I20260709 13:03:18.526356 10633 consensus_queue.cc:1048] T b038dccd00b44161b10a08f5b963dd45 P 24479f93a03b4364837c81f7efbdf9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:18.533085 10420 raft_consensus.cc:2468] T afe8b130a0d1484e9f08fed8f6be2f61 P 24479f93a03b4364837c81f7efbdf9d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17d104ff42224d8c9cdf4c53a2152582 in term 2.
I20260709 13:03:18.534806 10459 leader_election.cc:304] T afe8b130a0d1484e9f08fed8f6be2f61 P 17d104ff42224d8c9cdf4c53a2152582 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17d104ff42224d8c9cdf4c53a2152582, 24479f93a03b4364837c81f7efbdf9d3; no voters: 22139e7a5ea041588dd21a8d06ba1741
I20260709 13:03:18.538069 10543 raft_consensus.cc:2804] T afe8b130a0d1484e9f08fed8f6be2f61 P 17d104ff42224d8c9cdf4c53a2152582 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:18.542071 10543 raft_consensus.cc:697] T afe8b130a0d1484e9f08fed8f6be2f61 P 17d104ff42224d8c9cdf4c53a2152582 [term 2 LEADER]: Becoming Leader. State: Replica: 17d104ff42224d8c9cdf4c53a2152582, State: Running, Role: LEADER
I20260709 13:03:18.542994 10543 consensus_queue.cc:237] T afe8b130a0d1484e9f08fed8f6be2f61 P 17d104ff42224d8c9cdf4c53a2152582 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:18.550436 10243 catalog_manager.cc:5697] T afe8b130a0d1484e9f08fed8f6be2f61 P 17d104ff42224d8c9cdf4c53a2152582 reported cstate change: term changed from 1 to 2, leader changed from 22139e7a5ea041588dd21a8d06ba1741 (127.0.107.193) to 17d104ff42224d8c9cdf4c53a2152582 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "17d104ff42224d8c9cdf4c53a2152582" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:18.551546 10543 raft_consensus.cc:493] T 19c2daa20bbe47afa5289e2b32987709 P 17d104ff42224d8c9cdf4c53a2152582 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:18.552073 10543 raft_consensus.cc:515] T 19c2daa20bbe47afa5289e2b32987709 P 17d104ff42224d8c9cdf4c53a2152582 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:18.554134 10543 leader_election.cc:290] T 19c2daa20bbe47afa5289e2b32987709 P 17d104ff42224d8c9cdf4c53a2152582 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22139e7a5ea041588dd21a8d06ba1741 (127.0.107.193:45479), 24479f93a03b4364837c81f7efbdf9d3 (127.0.107.194:44467)
I20260709 13:03:18.555364 10420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19c2daa20bbe47afa5289e2b32987709" candidate_uuid: "17d104ff42224d8c9cdf4c53a2152582" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24479f93a03b4364837c81f7efbdf9d3" is_pre_election: true
I20260709 13:03:18.556068 10420 raft_consensus.cc:2468] T 19c2daa20bbe47afa5289e2b32987709 P 24479f93a03b4364837c81f7efbdf9d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17d104ff42224d8c9cdf4c53a2152582 in term 1.
I20260709 13:03:18.557245 10459 leader_election.cc:304] T 19c2daa20bbe47afa5289e2b32987709 P 17d104ff42224d8c9cdf4c53a2152582 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17d104ff42224d8c9cdf4c53a2152582, 24479f93a03b4364837c81f7efbdf9d3; no voters: 
I20260709 13:03:18.558086 10543 raft_consensus.cc:2804] T 19c2daa20bbe47afa5289e2b32987709 P 17d104ff42224d8c9cdf4c53a2152582 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:18.558463 10543 raft_consensus.cc:493] T 19c2daa20bbe47afa5289e2b32987709 P 17d104ff42224d8c9cdf4c53a2152582 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:18.558820 10543 raft_consensus.cc:3060] T 19c2daa20bbe47afa5289e2b32987709 P 17d104ff42224d8c9cdf4c53a2152582 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:03:18.559648 10458 leader_election.cc:336] T 19c2daa20bbe47afa5289e2b32987709 P 17d104ff42224d8c9cdf4c53a2152582 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 22139e7a5ea041588dd21a8d06ba1741 (127.0.107.193:45479): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45479: connect: Connection refused (error 111)
I20260709 13:03:18.564327 10543 raft_consensus.cc:515] T 19c2daa20bbe47afa5289e2b32987709 P 17d104ff42224d8c9cdf4c53a2152582 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:18.566133 10543 leader_election.cc:290] T 19c2daa20bbe47afa5289e2b32987709 P 17d104ff42224d8c9cdf4c53a2152582 [CANDIDATE]: Term 2 election: Requested vote from peers 22139e7a5ea041588dd21a8d06ba1741 (127.0.107.193:45479), 24479f93a03b4364837c81f7efbdf9d3 (127.0.107.194:44467)
I20260709 13:03:18.567459 10420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19c2daa20bbe47afa5289e2b32987709" candidate_uuid: "17d104ff42224d8c9cdf4c53a2152582" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24479f93a03b4364837c81f7efbdf9d3"
I20260709 13:03:18.568128 10420 raft_consensus.cc:3060] T 19c2daa20bbe47afa5289e2b32987709 P 24479f93a03b4364837c81f7efbdf9d3 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:03:18.569722 10458 leader_election.cc:336] T 19c2daa20bbe47afa5289e2b32987709 P 17d104ff42224d8c9cdf4c53a2152582 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 22139e7a5ea041588dd21a8d06ba1741 (127.0.107.193:45479): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45479: connect: Connection refused (error 111)
I20260709 13:03:18.573818 10420 raft_consensus.cc:2468] T 19c2daa20bbe47afa5289e2b32987709 P 24479f93a03b4364837c81f7efbdf9d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17d104ff42224d8c9cdf4c53a2152582 in term 2.
I20260709 13:03:18.574971 10459 leader_election.cc:304] T 19c2daa20bbe47afa5289e2b32987709 P 17d104ff42224d8c9cdf4c53a2152582 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17d104ff42224d8c9cdf4c53a2152582, 24479f93a03b4364837c81f7efbdf9d3; no voters: 22139e7a5ea041588dd21a8d06ba1741
I20260709 13:03:18.575659 10543 raft_consensus.cc:2804] T 19c2daa20bbe47afa5289e2b32987709 P 17d104ff42224d8c9cdf4c53a2152582 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:18.576071 10543 raft_consensus.cc:697] T 19c2daa20bbe47afa5289e2b32987709 P 17d104ff42224d8c9cdf4c53a2152582 [term 2 LEADER]: Becoming Leader. State: Replica: 17d104ff42224d8c9cdf4c53a2152582, State: Running, Role: LEADER
I20260709 13:03:18.576804 10543 consensus_queue.cc:237] T 19c2daa20bbe47afa5289e2b32987709 P 17d104ff42224d8c9cdf4c53a2152582 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:18.583524 10243 catalog_manager.cc:5697] T 19c2daa20bbe47afa5289e2b32987709 P 17d104ff42224d8c9cdf4c53a2152582 reported cstate change: term changed from 1 to 2, leader changed from 22139e7a5ea041588dd21a8d06ba1741 (127.0.107.193) to 17d104ff42224d8c9cdf4c53a2152582 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "17d104ff42224d8c9cdf4c53a2152582" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } health_report { overall_health: HEALTHY } } }
W20260709 13:03:18.775933 10292 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:03:19.014163 10420 raft_consensus.cc:1275] T 19c2daa20bbe47afa5289e2b32987709 P 24479f93a03b4364837c81f7efbdf9d3 [term 2 FOLLOWER]: Refusing update from remote peer 17d104ff42224d8c9cdf4c53a2152582: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:03:19.015681 10543 consensus_queue.cc:1048] T 19c2daa20bbe47afa5289e2b32987709 P 17d104ff42224d8c9cdf4c53a2152582 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:19.030365 10420 raft_consensus.cc:1275] T afe8b130a0d1484e9f08fed8f6be2f61 P 24479f93a03b4364837c81f7efbdf9d3 [term 2 FOLLOWER]: Refusing update from remote peer 17d104ff42224d8c9cdf4c53a2152582: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
W20260709 13:03:19.031397 10458 consensus_peers.cc:597] T 19c2daa20bbe47afa5289e2b32987709 P 17d104ff42224d8c9cdf4c53a2152582 -> Peer 22139e7a5ea041588dd21a8d06ba1741 (127.0.107.193:45479): Couldn't send request to peer 22139e7a5ea041588dd21a8d06ba1741. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45479: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:19.031772 10639 consensus_queue.cc:1048] T afe8b130a0d1484e9f08fed8f6be2f61 P 17d104ff42224d8c9cdf4c53a2152582 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:03:19.045409 10458 consensus_peers.cc:597] T afe8b130a0d1484e9f08fed8f6be2f61 P 17d104ff42224d8c9cdf4c53a2152582 -> Peer 22139e7a5ea041588dd21a8d06ba1741 (127.0.107.193:45479): Couldn't send request to peer 22139e7a5ea041588dd21a8d06ba1741. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45479: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:19.329509 10384 consensus_peers.cc:597] T 89649f4e196f44a3b3b98fa009c228f8 P 24479f93a03b4364837c81f7efbdf9d3 -> Peer 22139e7a5ea041588dd21a8d06ba1741 (127.0.107.193:45479): Couldn't send request to peer 22139e7a5ea041588dd21a8d06ba1741. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45479: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:19.374481 10458 consensus_peers.cc:597] T a848edc7d33e48a1a475daf70fb66449 P 17d104ff42224d8c9cdf4c53a2152582 -> Peer 22139e7a5ea041588dd21a8d06ba1741 (127.0.107.193:45479): Couldn't send request to peer 22139e7a5ea041588dd21a8d06ba1741. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45479: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:19.646996 10458 consensus_peers.cc:597] T e0ad84cc4e1942d99055ab43ea0bdac0 P 17d104ff42224d8c9cdf4c53a2152582 -> Peer 22139e7a5ea041588dd21a8d06ba1741 (127.0.107.193:45479): Couldn't send request to peer 22139e7a5ea041588dd21a8d06ba1741. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45479: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:19.704454 10384 consensus_peers.cc:597] T 1484bae8a7264a0e9f328dd5ce7edad8 P 24479f93a03b4364837c81f7efbdf9d3 -> Peer 22139e7a5ea041588dd21a8d06ba1741 (127.0.107.193:45479): Couldn't send request to peer 22139e7a5ea041588dd21a8d06ba1741. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45479: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:19.776834 10292 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:03:19.853886 10384 consensus_peers.cc:597] T 2df7bfe151e349f1a30cd3142e13c021 P 24479f93a03b4364837c81f7efbdf9d3 -> Peer 22139e7a5ea041588dd21a8d06ba1741 (127.0.107.193:45479): Couldn't send request to peer 22139e7a5ea041588dd21a8d06ba1741. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45479: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:20.777920 10292 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:03:20.800680 10384 consensus_peers.cc:597] T b038dccd00b44161b10a08f5b963dd45 P 24479f93a03b4364837c81f7efbdf9d3 -> Peer 22139e7a5ea041588dd21a8d06ba1741 (127.0.107.193:45479): Couldn't send request to peer 22139e7a5ea041588dd21a8d06ba1741. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45479: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:20.908638 10384 consensus_peers.cc:597] T 4feb1aa9b1d14601b28b28a6d515ee65 P 24479f93a03b4364837c81f7efbdf9d3 -> Peer 22139e7a5ea041588dd21a8d06ba1741 (127.0.107.193:45479): Couldn't send request to peer 22139e7a5ea041588dd21a8d06ba1741. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45479: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:20.948715 10458 consensus_peers.cc:597] T 77c2a758545e45e29d62d8d71ea3f43d P 17d104ff42224d8c9cdf4c53a2152582 -> Peer 22139e7a5ea041588dd21a8d06ba1741 (127.0.107.193:45479): Couldn't send request to peer 22139e7a5ea041588dd21a8d06ba1741. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45479: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:21.292330 10458 consensus_peers.cc:597] T afe8b130a0d1484e9f08fed8f6be2f61 P 17d104ff42224d8c9cdf4c53a2152582 -> Peer 22139e7a5ea041588dd21a8d06ba1741 (127.0.107.193:45479): Couldn't send request to peer 22139e7a5ea041588dd21a8d06ba1741. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45479: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:21.611433 10458 consensus_peers.cc:597] T a848edc7d33e48a1a475daf70fb66449 P 17d104ff42224d8c9cdf4c53a2152582 -> Peer 22139e7a5ea041588dd21a8d06ba1741 (127.0.107.193:45479): Couldn't send request to peer 22139e7a5ea041588dd21a8d06ba1741. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45479: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:03:21.692828   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:21.701745 10645 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:21.701754 10644 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:21.703886   431 server_base.cc:1061] running on GCE node
W20260709 13:03:21.704103 10647 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:21.706336   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:21.706689   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:21.706915   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602201706897 us; error 0 us; skew 500 ppm
I20260709 13:03:21.707597   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:21.710297   431 webserver.cc:533] Webserver started at http://127.0.107.193:37925/ using document root <none> and password file <none>
I20260709 13:03:21.711066   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:21.711361   431 fs_manager.cc:365] Using existing metadata directory in first data directory
W20260709 13:03:21.716020 10458 consensus_peers.cc:597] T 19c2daa20bbe47afa5289e2b32987709 P 17d104ff42224d8c9cdf4c53a2152582 -> Peer 22139e7a5ea041588dd21a8d06ba1741 (127.0.107.193:45479): Couldn't send request to peer 22139e7a5ea041588dd21a8d06ba1741. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45479: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:21.716805   431 fs_manager.cc:714] Time spent opening directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:03:21.721297 10652 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:21.722065   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:03:21.722370   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601891739070-431-0/minicluster-data/ts-0-root
uuid: "22139e7a5ea041588dd21a8d06ba1741"
format_stamp: "Formatted at 2026-07-09 13:03:14 on dist-test-slave-qzg2"
I20260709 13:03:21.722864   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601891739070-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601891739070-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601891739070-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:21.743858   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:21.745347   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:21.747227   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:21.751041 10659 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
W20260709 13:03:21.779785 10292 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:03:21.815917   431 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 13:03:21.816293   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.066s	user 0.000s	sys 0.003s
I20260709 13:03:21.816571   431 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 13:03:21.822742 10659 tablet_bootstrap.cc:492] T b038dccd00b44161b10a08f5b963dd45 P 22139e7a5ea041588dd21a8d06ba1741: Bootstrap starting.
I20260709 13:03:21.836735 10659 tablet_bootstrap.cc:492] T b038dccd00b44161b10a08f5b963dd45 P 22139e7a5ea041588dd21a8d06ba1741: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:21.837497 10659 tablet_bootstrap.cc:492] T b038dccd00b44161b10a08f5b963dd45 P 22139e7a5ea041588dd21a8d06ba1741: Bootstrap complete.
I20260709 13:03:21.838038 10659 ts_tablet_manager.cc:1403] T b038dccd00b44161b10a08f5b963dd45 P 22139e7a5ea041588dd21a8d06ba1741: Time spent bootstrapping tablet: real 0.016s	user 0.007s	sys 0.005s
I20260709 13:03:21.840428 10659 raft_consensus.cc:359] T b038dccd00b44161b10a08f5b963dd45 P 22139e7a5ea041588dd21a8d06ba1741 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:21.841225 10659 raft_consensus.cc:740] T b038dccd00b44161b10a08f5b963dd45 P 22139e7a5ea041588dd21a8d06ba1741 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22139e7a5ea041588dd21a8d06ba1741, State: Initialized, Role: FOLLOWER
I20260709 13:03:21.841912 10659 consensus_queue.cc:260] T b038dccd00b44161b10a08f5b963dd45 P 22139e7a5ea041588dd21a8d06ba1741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:21.844370 10659 ts_tablet_manager.cc:1434] T b038dccd00b44161b10a08f5b963dd45 P 22139e7a5ea041588dd21a8d06ba1741: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.006s
I20260709 13:03:21.845108 10659 tablet_bootstrap.cc:492] T afe8b130a0d1484e9f08fed8f6be2f61 P 22139e7a5ea041588dd21a8d06ba1741: Bootstrap starting.
I20260709 13:03:21.858147 10659 tablet_bootstrap.cc:492] T afe8b130a0d1484e9f08fed8f6be2f61 P 22139e7a5ea041588dd21a8d06ba1741: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:03:21.858965 10659 tablet_bootstrap.cc:492] T afe8b130a0d1484e9f08fed8f6be2f61 P 22139e7a5ea041588dd21a8d06ba1741: Bootstrap complete.
I20260709 13:03:21.859543 10659 ts_tablet_manager.cc:1403] T afe8b130a0d1484e9f08fed8f6be2f61 P 22139e7a5ea041588dd21a8d06ba1741: Time spent bootstrapping tablet: real 0.015s	user 0.013s	sys 0.000s
I20260709 13:03:21.859561   431 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 13:03:21.859972   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.043s	user 0.043s	sys 0.001s
I20260709 13:03:21.861850 10659 raft_consensus.cc:359] T afe8b130a0d1484e9f08fed8f6be2f61 P 22139e7a5ea041588dd21a8d06ba1741 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:21.862783 10659 raft_consensus.cc:740] T afe8b130a0d1484e9f08fed8f6be2f61 P 22139e7a5ea041588dd21a8d06ba1741 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22139e7a5ea041588dd21a8d06ba1741, State: Initialized, Role: FOLLOWER
I20260709 13:03:21.863449 10659 consensus_queue.cc:260] T afe8b130a0d1484e9f08fed8f6be2f61 P 22139e7a5ea041588dd21a8d06ba1741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:21.865053 10659 ts_tablet_manager.cc:1434] T afe8b130a0d1484e9f08fed8f6be2f61 P 22139e7a5ea041588dd21a8d06ba1741: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:03:21.865813 10659 tablet_bootstrap.cc:492] T 1484bae8a7264a0e9f328dd5ce7edad8 P 22139e7a5ea041588dd21a8d06ba1741: Bootstrap starting.
I20260709 13:03:21.884858 10659 tablet_bootstrap.cc:492] T 1484bae8a7264a0e9f328dd5ce7edad8 P 22139e7a5ea041588dd21a8d06ba1741: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:21.885710 10659 tablet_bootstrap.cc:492] T 1484bae8a7264a0e9f328dd5ce7edad8 P 22139e7a5ea041588dd21a8d06ba1741: Bootstrap complete.
I20260709 13:03:21.886288 10659 ts_tablet_manager.cc:1403] T 1484bae8a7264a0e9f328dd5ce7edad8 P 22139e7a5ea041588dd21a8d06ba1741: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.004s
I20260709 13:03:21.888907 10659 raft_consensus.cc:359] T 1484bae8a7264a0e9f328dd5ce7edad8 P 22139e7a5ea041588dd21a8d06ba1741 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:21.889720 10659 raft_consensus.cc:740] T 1484bae8a7264a0e9f328dd5ce7edad8 P 22139e7a5ea041588dd21a8d06ba1741 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22139e7a5ea041588dd21a8d06ba1741, State: Initialized, Role: FOLLOWER
I20260709 13:03:21.890396 10659 consensus_queue.cc:260] T 1484bae8a7264a0e9f328dd5ce7edad8 P 22139e7a5ea041588dd21a8d06ba1741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:21.892221 10659 ts_tablet_manager.cc:1434] T 1484bae8a7264a0e9f328dd5ce7edad8 P 22139e7a5ea041588dd21a8d06ba1741: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:03:21.893236 10659 tablet_bootstrap.cc:492] T 2df7bfe151e349f1a30cd3142e13c021 P 22139e7a5ea041588dd21a8d06ba1741: Bootstrap starting.
I20260709 13:03:21.912190 10659 tablet_bootstrap.cc:492] T 2df7bfe151e349f1a30cd3142e13c021 P 22139e7a5ea041588dd21a8d06ba1741: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:21.913137 10659 tablet_bootstrap.cc:492] T 2df7bfe151e349f1a30cd3142e13c021 P 22139e7a5ea041588dd21a8d06ba1741: Bootstrap complete.
I20260709 13:03:21.913786 10659 ts_tablet_manager.cc:1403] T 2df7bfe151e349f1a30cd3142e13c021 P 22139e7a5ea041588dd21a8d06ba1741: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.004s
I20260709 13:03:21.915959 10659 raft_consensus.cc:359] T 2df7bfe151e349f1a30cd3142e13c021 P 22139e7a5ea041588dd21a8d06ba1741 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:21.916443 10659 raft_consensus.cc:740] T 2df7bfe151e349f1a30cd3142e13c021 P 22139e7a5ea041588dd21a8d06ba1741 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22139e7a5ea041588dd21a8d06ba1741, State: Initialized, Role: FOLLOWER
I20260709 13:03:21.917017 10659 consensus_queue.cc:260] T 2df7bfe151e349f1a30cd3142e13c021 P 22139e7a5ea041588dd21a8d06ba1741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:21.918417 10659 ts_tablet_manager.cc:1434] T 2df7bfe151e349f1a30cd3142e13c021 P 22139e7a5ea041588dd21a8d06ba1741: Time spent starting tablet: real 0.004s	user 0.002s	sys 0.000s
I20260709 13:03:21.919221 10659 tablet_bootstrap.cc:492] T a848edc7d33e48a1a475daf70fb66449 P 22139e7a5ea041588dd21a8d06ba1741: Bootstrap starting.
I20260709 13:03:21.933853 10659 tablet_bootstrap.cc:492] T a848edc7d33e48a1a475daf70fb66449 P 22139e7a5ea041588dd21a8d06ba1741: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:21.934882 10659 tablet_bootstrap.cc:492] T a848edc7d33e48a1a475daf70fb66449 P 22139e7a5ea041588dd21a8d06ba1741: Bootstrap complete.
I20260709 13:03:21.935479 10659 ts_tablet_manager.cc:1403] T a848edc7d33e48a1a475daf70fb66449 P 22139e7a5ea041588dd21a8d06ba1741: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.004s
I20260709 13:03:21.938287 10659 raft_consensus.cc:359] T a848edc7d33e48a1a475daf70fb66449 P 22139e7a5ea041588dd21a8d06ba1741 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } }
I20260709 13:03:21.939073 10659 raft_consensus.cc:740] T a848edc7d33e48a1a475daf70fb66449 P 22139e7a5ea041588dd21a8d06ba1741 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22139e7a5ea041588dd21a8d06ba1741, State: Initialized, Role: FOLLOWER
I20260709 13:03:21.939935 10659 consensus_queue.cc:260] T a848edc7d33e48a1a475daf70fb66449 P 22139e7a5ea041588dd21a8d06ba1741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } }
I20260709 13:03:21.942056 10659 ts_tablet_manager.cc:1434] T a848edc7d33e48a1a475daf70fb66449 P 22139e7a5ea041588dd21a8d06ba1741: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:03:21.942899 10659 tablet_bootstrap.cc:492] T 4feb1aa9b1d14601b28b28a6d515ee65 P 22139e7a5ea041588dd21a8d06ba1741: Bootstrap starting.
W20260709 13:03:21.942799 10384 consensus_peers.cc:597] T 89649f4e196f44a3b3b98fa009c228f8 P 24479f93a03b4364837c81f7efbdf9d3 -> Peer 22139e7a5ea041588dd21a8d06ba1741 (127.0.107.193:45479): Couldn't send request to peer 22139e7a5ea041588dd21a8d06ba1741. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45479: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:03:21.945341   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:45479
I20260709 13:03:21.945444 10721 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:45479 every 8 connection(s)
I20260709 13:03:21.951297   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:21.971581 10659 tablet_bootstrap.cc:492] T 4feb1aa9b1d14601b28b28a6d515ee65 P 22139e7a5ea041588dd21a8d06ba1741: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:21.973055 10659 tablet_bootstrap.cc:492] T 4feb1aa9b1d14601b28b28a6d515ee65 P 22139e7a5ea041588dd21a8d06ba1741: Bootstrap complete.
I20260709 13:03:21.973873 10659 ts_tablet_manager.cc:1403] T 4feb1aa9b1d14601b28b28a6d515ee65 P 22139e7a5ea041588dd21a8d06ba1741: Time spent bootstrapping tablet: real 0.031s	user 0.020s	sys 0.008s
I20260709 13:03:21.978179 10659 raft_consensus.cc:359] T 4feb1aa9b1d14601b28b28a6d515ee65 P 22139e7a5ea041588dd21a8d06ba1741 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:21.979034 10659 raft_consensus.cc:740] T 4feb1aa9b1d14601b28b28a6d515ee65 P 22139e7a5ea041588dd21a8d06ba1741 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22139e7a5ea041588dd21a8d06ba1741, State: Initialized, Role: FOLLOWER
I20260709 13:03:21.979809 10659 consensus_queue.cc:260] T 4feb1aa9b1d14601b28b28a6d515ee65 P 22139e7a5ea041588dd21a8d06ba1741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:21.982050 10659 ts_tablet_manager.cc:1434] T 4feb1aa9b1d14601b28b28a6d515ee65 P 22139e7a5ea041588dd21a8d06ba1741: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:03:21.983069 10659 tablet_bootstrap.cc:492] T 89649f4e196f44a3b3b98fa009c228f8 P 22139e7a5ea041588dd21a8d06ba1741: Bootstrap starting.
I20260709 13:03:21.988638 10722 heartbeater.cc:344] Connected to a master server at 127.0.107.254:38331
I20260709 13:03:21.989147 10722 heartbeater.cc:461] Registering TS with master...
I20260709 13:03:21.990123 10722 heartbeater.cc:507] Master 127.0.107.254:38331 requested a full tablet report, sending...
I20260709 13:03:21.992123 10420 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1484bae8a7264a0e9f328dd5ce7edad8"
dest_uuid: "24479f93a03b4364837c81f7efbdf9d3"
mode: GRACEFUL
new_leader_uuid: "17d104ff42224d8c9cdf4c53a2152582"
 from {username='slave'} at 127.0.0.1:51992
I20260709 13:03:21.992947 10420 raft_consensus.cc:606] T 1484bae8a7264a0e9f328dd5ce7edad8 P 24479f93a03b4364837c81f7efbdf9d3 [term 1 LEADER]: Received request to transfer leadership to TS 17d104ff42224d8c9cdf4c53a2152582
I20260709 13:03:21.996435 10420 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4feb1aa9b1d14601b28b28a6d515ee65"
dest_uuid: "24479f93a03b4364837c81f7efbdf9d3"
mode: GRACEFUL
new_leader_uuid: "17d104ff42224d8c9cdf4c53a2152582"
 from {username='slave'} at 127.0.0.1:51992
I20260709 13:03:21.997089 10420 raft_consensus.cc:606] T 4feb1aa9b1d14601b28b28a6d515ee65 P 24479f93a03b4364837c81f7efbdf9d3 [term 2 LEADER]: Received request to transfer leadership to TS 17d104ff42224d8c9cdf4c53a2152582
I20260709 13:03:21.997965 10659 tablet_bootstrap.cc:492] T 89649f4e196f44a3b3b98fa009c228f8 P 22139e7a5ea041588dd21a8d06ba1741: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:21.997964 10243 ts_manager.cc:194] Re-registered known tserver with Master: 22139e7a5ea041588dd21a8d06ba1741 (127.0.107.193:45479)
I20260709 13:03:21.999264 10659 tablet_bootstrap.cc:492] T 89649f4e196f44a3b3b98fa009c228f8 P 22139e7a5ea041588dd21a8d06ba1741: Bootstrap complete.
I20260709 13:03:22.000077 10659 ts_tablet_manager.cc:1403] T 89649f4e196f44a3b3b98fa009c228f8 P 22139e7a5ea041588dd21a8d06ba1741: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.003s
I20260709 13:03:22.002848 10659 raft_consensus.cc:359] T 89649f4e196f44a3b3b98fa009c228f8 P 22139e7a5ea041588dd21a8d06ba1741 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:22.003559 10659 raft_consensus.cc:740] T 89649f4e196f44a3b3b98fa009c228f8 P 22139e7a5ea041588dd21a8d06ba1741 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22139e7a5ea041588dd21a8d06ba1741, State: Initialized, Role: FOLLOWER
I20260709 13:03:22.004321 10659 consensus_queue.cc:260] T 89649f4e196f44a3b3b98fa009c228f8 P 22139e7a5ea041588dd21a8d06ba1741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:22.006304 10659 ts_tablet_manager.cc:1434] T 89649f4e196f44a3b3b98fa009c228f8 P 22139e7a5ea041588dd21a8d06ba1741: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:03:22.007231 10659 tablet_bootstrap.cc:492] T 19c2daa20bbe47afa5289e2b32987709 P 22139e7a5ea041588dd21a8d06ba1741: Bootstrap starting.
I20260709 13:03:22.009398 10243 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35876
I20260709 13:03:22.013999 10722 heartbeater.cc:499] Master 127.0.107.254:38331 was elected leader, sending a full tablet report...
I20260709 13:03:22.015079 10495 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a848edc7d33e48a1a475daf70fb66449"
dest_uuid: "17d104ff42224d8c9cdf4c53a2152582"
mode: GRACEFUL
new_leader_uuid: "24479f93a03b4364837c81f7efbdf9d3"
 from {username='slave'} at 127.0.0.1:52156
I20260709 13:03:22.015781 10495 raft_consensus.cc:606] T a848edc7d33e48a1a475daf70fb66449 P 17d104ff42224d8c9cdf4c53a2152582 [term 1 LEADER]: Received request to transfer leadership to TS 24479f93a03b4364837c81f7efbdf9d3
I20260709 13:03:22.017876   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:03:22.018442   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:22.019207   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:22.022469 10659 tablet_bootstrap.cc:492] T 19c2daa20bbe47afa5289e2b32987709 P 22139e7a5ea041588dd21a8d06ba1741: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:03:22.023485 10659 tablet_bootstrap.cc:492] T 19c2daa20bbe47afa5289e2b32987709 P 22139e7a5ea041588dd21a8d06ba1741: Bootstrap complete.
I20260709 13:03:22.024158 10659 ts_tablet_manager.cc:1403] T 19c2daa20bbe47afa5289e2b32987709 P 22139e7a5ea041588dd21a8d06ba1741: Time spent bootstrapping tablet: real 0.017s	user 0.014s	sys 0.000s
I20260709 13:03:22.026865 10659 raft_consensus.cc:359] T 19c2daa20bbe47afa5289e2b32987709 P 22139e7a5ea041588dd21a8d06ba1741 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:22.027748 10659 raft_consensus.cc:740] T 19c2daa20bbe47afa5289e2b32987709 P 22139e7a5ea041588dd21a8d06ba1741 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22139e7a5ea041588dd21a8d06ba1741, State: Initialized, Role: FOLLOWER
I20260709 13:03:22.028493 10659 consensus_queue.cc:260] T 19c2daa20bbe47afa5289e2b32987709 P 22139e7a5ea041588dd21a8d06ba1741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:22.030529 10659 ts_tablet_manager.cc:1434] T 19c2daa20bbe47afa5289e2b32987709 P 22139e7a5ea041588dd21a8d06ba1741: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.000s
I20260709 13:03:22.031371 10659 tablet_bootstrap.cc:492] T e0ad84cc4e1942d99055ab43ea0bdac0 P 22139e7a5ea041588dd21a8d06ba1741: Bootstrap starting.
I20260709 13:03:22.044513 10659 tablet_bootstrap.cc:492] T e0ad84cc4e1942d99055ab43ea0bdac0 P 22139e7a5ea041588dd21a8d06ba1741: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:22.045324 10659 tablet_bootstrap.cc:492] T e0ad84cc4e1942d99055ab43ea0bdac0 P 22139e7a5ea041588dd21a8d06ba1741: Bootstrap complete.
I20260709 13:03:22.045892 10659 ts_tablet_manager.cc:1403] T e0ad84cc4e1942d99055ab43ea0bdac0 P 22139e7a5ea041588dd21a8d06ba1741: Time spent bootstrapping tablet: real 0.015s	user 0.007s	sys 0.004s
I20260709 13:03:22.047771 10659 raft_consensus.cc:359] T e0ad84cc4e1942d99055ab43ea0bdac0 P 22139e7a5ea041588dd21a8d06ba1741 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:22.048367 10659 raft_consensus.cc:740] T e0ad84cc4e1942d99055ab43ea0bdac0 P 22139e7a5ea041588dd21a8d06ba1741 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22139e7a5ea041588dd21a8d06ba1741, State: Initialized, Role: FOLLOWER
I20260709 13:03:22.049088 10659 consensus_queue.cc:260] T e0ad84cc4e1942d99055ab43ea0bdac0 P 22139e7a5ea041588dd21a8d06ba1741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:22.050586 10659 ts_tablet_manager.cc:1434] T e0ad84cc4e1942d99055ab43ea0bdac0 P 22139e7a5ea041588dd21a8d06ba1741: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:03:22.051545 10659 tablet_bootstrap.cc:492] T 77c2a758545e45e29d62d8d71ea3f43d P 22139e7a5ea041588dd21a8d06ba1741: Bootstrap starting.
I20260709 13:03:22.065865 10659 tablet_bootstrap.cc:492] T 77c2a758545e45e29d62d8d71ea3f43d P 22139e7a5ea041588dd21a8d06ba1741: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:22.066748 10659 tablet_bootstrap.cc:492] T 77c2a758545e45e29d62d8d71ea3f43d P 22139e7a5ea041588dd21a8d06ba1741: Bootstrap complete.
I20260709 13:03:22.067318 10659 ts_tablet_manager.cc:1403] T 77c2a758545e45e29d62d8d71ea3f43d P 22139e7a5ea041588dd21a8d06ba1741: Time spent bootstrapping tablet: real 0.016s	user 0.015s	sys 0.000s
I20260709 13:03:22.069175 10659 raft_consensus.cc:359] T 77c2a758545e45e29d62d8d71ea3f43d P 22139e7a5ea041588dd21a8d06ba1741 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:22.069676 10659 raft_consensus.cc:740] T 77c2a758545e45e29d62d8d71ea3f43d P 22139e7a5ea041588dd21a8d06ba1741 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22139e7a5ea041588dd21a8d06ba1741, State: Initialized, Role: FOLLOWER
I20260709 13:03:22.070264 10659 consensus_queue.cc:260] T 77c2a758545e45e29d62d8d71ea3f43d P 22139e7a5ea041588dd21a8d06ba1741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:22.072237 10659 ts_tablet_manager.cc:1434] T 77c2a758545e45e29d62d8d71ea3f43d P 22139e7a5ea041588dd21a8d06ba1741: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:03:22.098738 10641 raft_consensus.cc:993] T a848edc7d33e48a1a475daf70fb66449 P 17d104ff42224d8c9cdf4c53a2152582: : Instructing follower 24479f93a03b4364837c81f7efbdf9d3 to start an election
I20260709 13:03:22.099299 10735 raft_consensus.cc:1081] T a848edc7d33e48a1a475daf70fb66449 P 17d104ff42224d8c9cdf4c53a2152582 [term 1 LEADER]: Signalling peer 24479f93a03b4364837c81f7efbdf9d3 to start an election
I20260709 13:03:22.100934 10420 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a848edc7d33e48a1a475daf70fb66449"
dest_uuid: "24479f93a03b4364837c81f7efbdf9d3"
 from {username='slave'} at 127.0.0.1:33552
I20260709 13:03:22.101444 10420 raft_consensus.cc:493] T a848edc7d33e48a1a475daf70fb66449 P 24479f93a03b4364837c81f7efbdf9d3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:22.101755 10420 raft_consensus.cc:3060] T a848edc7d33e48a1a475daf70fb66449 P 24479f93a03b4364837c81f7efbdf9d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:22.108208 10420 raft_consensus.cc:515] T a848edc7d33e48a1a475daf70fb66449 P 24479f93a03b4364837c81f7efbdf9d3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } }
I20260709 13:03:22.109905 10420 leader_election.cc:290] T a848edc7d33e48a1a475daf70fb66449 P 24479f93a03b4364837c81f7efbdf9d3 [CANDIDATE]: Term 2 election: Requested vote from peers 22139e7a5ea041588dd21a8d06ba1741 (127.0.107.193:45479), 17d104ff42224d8c9cdf4c53a2152582 (127.0.107.195:41601)
I20260709 13:03:22.111330 10495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a848edc7d33e48a1a475daf70fb66449" candidate_uuid: "24479f93a03b4364837c81f7efbdf9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "17d104ff42224d8c9cdf4c53a2152582"
I20260709 13:03:22.112067 10495 raft_consensus.cc:3055] T a848edc7d33e48a1a475daf70fb66449 P 17d104ff42224d8c9cdf4c53a2152582 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:22.112411 10495 raft_consensus.cc:740] T a848edc7d33e48a1a475daf70fb66449 P 17d104ff42224d8c9cdf4c53a2152582 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 17d104ff42224d8c9cdf4c53a2152582, State: Running, Role: LEADER
I20260709 13:03:22.113377 10495 consensus_queue.cc:260] T a848edc7d33e48a1a475daf70fb66449 P 17d104ff42224d8c9cdf4c53a2152582 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } }
I20260709 13:03:22.114442 10495 raft_consensus.cc:3060] T a848edc7d33e48a1a475daf70fb66449 P 17d104ff42224d8c9cdf4c53a2152582 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:22.119802 10695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a848edc7d33e48a1a475daf70fb66449" candidate_uuid: "24479f93a03b4364837c81f7efbdf9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "22139e7a5ea041588dd21a8d06ba1741"
I20260709 13:03:22.120419 10695 raft_consensus.cc:3060] T a848edc7d33e48a1a475daf70fb66449 P 22139e7a5ea041588dd21a8d06ba1741 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:22.121608 10495 raft_consensus.cc:2468] T a848edc7d33e48a1a475daf70fb66449 P 17d104ff42224d8c9cdf4c53a2152582 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24479f93a03b4364837c81f7efbdf9d3 in term 2.
I20260709 13:03:22.122980 10387 leader_election.cc:304] T a848edc7d33e48a1a475daf70fb66449 P 24479f93a03b4364837c81f7efbdf9d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17d104ff42224d8c9cdf4c53a2152582, 24479f93a03b4364837c81f7efbdf9d3; no voters: 
I20260709 13:03:22.123786 10581 raft_consensus.cc:2804] T a848edc7d33e48a1a475daf70fb66449 P 24479f93a03b4364837c81f7efbdf9d3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:22.125020 10581 raft_consensus.cc:697] T a848edc7d33e48a1a475daf70fb66449 P 24479f93a03b4364837c81f7efbdf9d3 [term 2 LEADER]: Becoming Leader. State: Replica: 24479f93a03b4364837c81f7efbdf9d3, State: Running, Role: LEADER
I20260709 13:03:22.125955 10581 consensus_queue.cc:237] T a848edc7d33e48a1a475daf70fb66449 P 24479f93a03b4364837c81f7efbdf9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } }
I20260709 13:03:22.127197 10695 raft_consensus.cc:2468] T a848edc7d33e48a1a475daf70fb66449 P 22139e7a5ea041588dd21a8d06ba1741 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24479f93a03b4364837c81f7efbdf9d3 in term 2.
I20260709 13:03:22.133814 10242 catalog_manager.cc:5697] T a848edc7d33e48a1a475daf70fb66449 P 24479f93a03b4364837c81f7efbdf9d3 reported cstate change: term changed from 1 to 2, leader changed from 17d104ff42224d8c9cdf4c53a2152582 (127.0.107.195) to 24479f93a03b4364837c81f7efbdf9d3 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "24479f93a03b4364837c81f7efbdf9d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:22.263413 10736 raft_consensus.cc:993] T 1484bae8a7264a0e9f328dd5ce7edad8 P 24479f93a03b4364837c81f7efbdf9d3: : Instructing follower 17d104ff42224d8c9cdf4c53a2152582 to start an election
I20260709 13:03:22.263852 10581 raft_consensus.cc:1081] T 1484bae8a7264a0e9f328dd5ce7edad8 P 24479f93a03b4364837c81f7efbdf9d3 [term 1 LEADER]: Signalling peer 17d104ff42224d8c9cdf4c53a2152582 to start an election
I20260709 13:03:22.265281 10495 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1484bae8a7264a0e9f328dd5ce7edad8"
dest_uuid: "17d104ff42224d8c9cdf4c53a2152582"
 from {username='slave'} at 127.0.0.1:38496
I20260709 13:03:22.265822 10495 raft_consensus.cc:493] T 1484bae8a7264a0e9f328dd5ce7edad8 P 17d104ff42224d8c9cdf4c53a2152582 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:22.266141 10495 raft_consensus.cc:3060] T 1484bae8a7264a0e9f328dd5ce7edad8 P 17d104ff42224d8c9cdf4c53a2152582 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:22.271814 10495 raft_consensus.cc:515] T 1484bae8a7264a0e9f328dd5ce7edad8 P 17d104ff42224d8c9cdf4c53a2152582 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:22.273658 10495 leader_election.cc:290] T 1484bae8a7264a0e9f328dd5ce7edad8 P 17d104ff42224d8c9cdf4c53a2152582 [CANDIDATE]: Term 2 election: Requested vote from peers 22139e7a5ea041588dd21a8d06ba1741 (127.0.107.193:45479), 24479f93a03b4364837c81f7efbdf9d3 (127.0.107.194:44467)
I20260709 13:03:22.274567 10695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1484bae8a7264a0e9f328dd5ce7edad8" candidate_uuid: "17d104ff42224d8c9cdf4c53a2152582" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "22139e7a5ea041588dd21a8d06ba1741"
I20260709 13:03:22.274720 10420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1484bae8a7264a0e9f328dd5ce7edad8" candidate_uuid: "17d104ff42224d8c9cdf4c53a2152582" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "24479f93a03b4364837c81f7efbdf9d3"
I20260709 13:03:22.275418 10695 raft_consensus.cc:3060] T 1484bae8a7264a0e9f328dd5ce7edad8 P 22139e7a5ea041588dd21a8d06ba1741 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:22.275477 10420 raft_consensus.cc:3055] T 1484bae8a7264a0e9f328dd5ce7edad8 P 24479f93a03b4364837c81f7efbdf9d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:22.275897 10420 raft_consensus.cc:740] T 1484bae8a7264a0e9f328dd5ce7edad8 P 24479f93a03b4364837c81f7efbdf9d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 24479f93a03b4364837c81f7efbdf9d3, State: Running, Role: LEADER
I20260709 13:03:22.276676 10420 consensus_queue.cc:260] T 1484bae8a7264a0e9f328dd5ce7edad8 P 24479f93a03b4364837c81f7efbdf9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:22.277796 10420 raft_consensus.cc:3060] T 1484bae8a7264a0e9f328dd5ce7edad8 P 24479f93a03b4364837c81f7efbdf9d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:22.280956 10695 raft_consensus.cc:2468] T 1484bae8a7264a0e9f328dd5ce7edad8 P 22139e7a5ea041588dd21a8d06ba1741 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17d104ff42224d8c9cdf4c53a2152582 in term 2.
I20260709 13:03:22.282121 10458 leader_election.cc:304] T 1484bae8a7264a0e9f328dd5ce7edad8 P 17d104ff42224d8c9cdf4c53a2152582 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17d104ff42224d8c9cdf4c53a2152582, 22139e7a5ea041588dd21a8d06ba1741; no voters: 
I20260709 13:03:22.282941 10735 raft_consensus.cc:2804] T 1484bae8a7264a0e9f328dd5ce7edad8 P 17d104ff42224d8c9cdf4c53a2152582 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:22.283447 10735 raft_consensus.cc:697] T 1484bae8a7264a0e9f328dd5ce7edad8 P 17d104ff42224d8c9cdf4c53a2152582 [term 2 LEADER]: Becoming Leader. State: Replica: 17d104ff42224d8c9cdf4c53a2152582, State: Running, Role: LEADER
I20260709 13:03:22.283684 10420 raft_consensus.cc:2468] T 1484bae8a7264a0e9f328dd5ce7edad8 P 24479f93a03b4364837c81f7efbdf9d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17d104ff42224d8c9cdf4c53a2152582 in term 2.
I20260709 13:03:22.284431 10735 consensus_queue.cc:237] T 1484bae8a7264a0e9f328dd5ce7edad8 P 17d104ff42224d8c9cdf4c53a2152582 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:22.288834 10695 raft_consensus.cc:3060] T 19c2daa20bbe47afa5289e2b32987709 P 22139e7a5ea041588dd21a8d06ba1741 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:22.292353 10242 catalog_manager.cc:5697] T 1484bae8a7264a0e9f328dd5ce7edad8 P 17d104ff42224d8c9cdf4c53a2152582 reported cstate change: term changed from 1 to 2, leader changed from 24479f93a03b4364837c81f7efbdf9d3 (127.0.107.194) to 17d104ff42224d8c9cdf4c53a2152582 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "17d104ff42224d8c9cdf4c53a2152582" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:22.294394 10695 pending_rounds.cc:85] T 19c2daa20bbe47afa5289e2b32987709 P 22139e7a5ea041588dd21a8d06ba1741: Aborting all ops after (but not including) 0
I20260709 13:03:22.294727 10695 pending_rounds.cc:107] T 19c2daa20bbe47afa5289e2b32987709 P 22139e7a5ea041588dd21a8d06ba1741: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:03:22.294967 10695 raft_consensus.cc:2889] T 19c2daa20bbe47afa5289e2b32987709 P 22139e7a5ea041588dd21a8d06ba1741 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:22.326642 10695 raft_consensus.cc:3060] T b038dccd00b44161b10a08f5b963dd45 P 22139e7a5ea041588dd21a8d06ba1741 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:22.365501 10695 raft_consensus.cc:3060] T 77c2a758545e45e29d62d8d71ea3f43d P 22139e7a5ea041588dd21a8d06ba1741 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:22.413600 10695 raft_consensus.cc:3060] T afe8b130a0d1484e9f08fed8f6be2f61 P 22139e7a5ea041588dd21a8d06ba1741 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:22.418802 10695 pending_rounds.cc:85] T afe8b130a0d1484e9f08fed8f6be2f61 P 22139e7a5ea041588dd21a8d06ba1741: Aborting all ops after (but not including) 0
I20260709 13:03:22.419027 10695 pending_rounds.cc:107] T afe8b130a0d1484e9f08fed8f6be2f61 P 22139e7a5ea041588dd21a8d06ba1741: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:03:22.419243 10695 raft_consensus.cc:2889] T afe8b130a0d1484e9f08fed8f6be2f61 P 22139e7a5ea041588dd21a8d06ba1741 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:22.502537 10695 raft_consensus.cc:3060] T 4feb1aa9b1d14601b28b28a6d515ee65 P 22139e7a5ea041588dd21a8d06ba1741 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:22.520469 10695 raft_consensus.cc:1275] T a848edc7d33e48a1a475daf70fb66449 P 22139e7a5ea041588dd21a8d06ba1741 [term 2 FOLLOWER]: Refusing update from remote peer 24479f93a03b4364837c81f7efbdf9d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:22.522045 10581 consensus_queue.cc:1048] T a848edc7d33e48a1a475daf70fb66449 P 24479f93a03b4364837c81f7efbdf9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:22.523566 10751 raft_consensus.cc:993] T 4feb1aa9b1d14601b28b28a6d515ee65 P 24479f93a03b4364837c81f7efbdf9d3: : Instructing follower 17d104ff42224d8c9cdf4c53a2152582 to start an election
I20260709 13:03:22.524161 10581 raft_consensus.cc:1081] T 4feb1aa9b1d14601b28b28a6d515ee65 P 24479f93a03b4364837c81f7efbdf9d3 [term 2 LEADER]: Signalling peer 17d104ff42224d8c9cdf4c53a2152582 to start an election
I20260709 13:03:22.525638 10495 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4feb1aa9b1d14601b28b28a6d515ee65"
dest_uuid: "17d104ff42224d8c9cdf4c53a2152582"
 from {username='slave'} at 127.0.0.1:38496
I20260709 13:03:22.526203 10495 raft_consensus.cc:493] T 4feb1aa9b1d14601b28b28a6d515ee65 P 17d104ff42224d8c9cdf4c53a2152582 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:22.526583 10495 raft_consensus.cc:3060] T 4feb1aa9b1d14601b28b28a6d515ee65 P 17d104ff42224d8c9cdf4c53a2152582 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:22.534188 10495 raft_consensus.cc:515] T 4feb1aa9b1d14601b28b28a6d515ee65 P 17d104ff42224d8c9cdf4c53a2152582 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:22.536540 10695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4feb1aa9b1d14601b28b28a6d515ee65" candidate_uuid: "17d104ff42224d8c9cdf4c53a2152582" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "22139e7a5ea041588dd21a8d06ba1741"
I20260709 13:03:22.537153 10695 raft_consensus.cc:3060] T 4feb1aa9b1d14601b28b28a6d515ee65 P 22139e7a5ea041588dd21a8d06ba1741 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:22.537786 10420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4feb1aa9b1d14601b28b28a6d515ee65" candidate_uuid: "17d104ff42224d8c9cdf4c53a2152582" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "24479f93a03b4364837c81f7efbdf9d3"
I20260709 13:03:22.538445 10420 raft_consensus.cc:3055] T 4feb1aa9b1d14601b28b28a6d515ee65 P 24479f93a03b4364837c81f7efbdf9d3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:22.538767 10420 raft_consensus.cc:740] T 4feb1aa9b1d14601b28b28a6d515ee65 P 24479f93a03b4364837c81f7efbdf9d3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 24479f93a03b4364837c81f7efbdf9d3, State: Running, Role: LEADER
I20260709 13:03:22.539654 10420 consensus_queue.cc:260] T 4feb1aa9b1d14601b28b28a6d515ee65 P 24479f93a03b4364837c81f7efbdf9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:22.540800 10420 raft_consensus.cc:3060] T 4feb1aa9b1d14601b28b28a6d515ee65 P 24479f93a03b4364837c81f7efbdf9d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:22.544440 10695 raft_consensus.cc:2468] T 4feb1aa9b1d14601b28b28a6d515ee65 P 22139e7a5ea041588dd21a8d06ba1741 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17d104ff42224d8c9cdf4c53a2152582 in term 3.
I20260709 13:03:22.545092 10495 leader_election.cc:290] T 4feb1aa9b1d14601b28b28a6d515ee65 P 17d104ff42224d8c9cdf4c53a2152582 [CANDIDATE]: Term 3 election: Requested vote from peers 22139e7a5ea041588dd21a8d06ba1741 (127.0.107.193:45479), 24479f93a03b4364837c81f7efbdf9d3 (127.0.107.194:44467)
I20260709 13:03:22.545617 10458 leader_election.cc:304] T 4feb1aa9b1d14601b28b28a6d515ee65 P 17d104ff42224d8c9cdf4c53a2152582 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17d104ff42224d8c9cdf4c53a2152582, 22139e7a5ea041588dd21a8d06ba1741; no voters: 
I20260709 13:03:22.546815 10735 raft_consensus.cc:2804] T 4feb1aa9b1d14601b28b28a6d515ee65 P 17d104ff42224d8c9cdf4c53a2152582 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:22.547272 10735 raft_consensus.cc:697] T 4feb1aa9b1d14601b28b28a6d515ee65 P 17d104ff42224d8c9cdf4c53a2152582 [term 3 LEADER]: Becoming Leader. State: Replica: 17d104ff42224d8c9cdf4c53a2152582, State: Running, Role: LEADER
I20260709 13:03:22.548379 10735 consensus_queue.cc:237] T 4feb1aa9b1d14601b28b28a6d515ee65 P 17d104ff42224d8c9cdf4c53a2152582 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:22.549302 10420 raft_consensus.cc:2468] T 4feb1aa9b1d14601b28b28a6d515ee65 P 24479f93a03b4364837c81f7efbdf9d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17d104ff42224d8c9cdf4c53a2152582 in term 3.
I20260709 13:03:22.550935 10495 raft_consensus.cc:1275] T a848edc7d33e48a1a475daf70fb66449 P 17d104ff42224d8c9cdf4c53a2152582 [term 2 FOLLOWER]: Refusing update from remote peer 24479f93a03b4364837c81f7efbdf9d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:22.552577 10751 consensus_queue.cc:1048] T a848edc7d33e48a1a475daf70fb66449 P 24479f93a03b4364837c81f7efbdf9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:22.557407 10242 catalog_manager.cc:5697] T 4feb1aa9b1d14601b28b28a6d515ee65 P 17d104ff42224d8c9cdf4c53a2152582 reported cstate change: term changed from 2 to 3, leader changed from 24479f93a03b4364837c81f7efbdf9d3 (127.0.107.194) to 17d104ff42224d8c9cdf4c53a2152582 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "17d104ff42224d8c9cdf4c53a2152582" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } health_report { overall_health: HEALTHY } } }
W20260709 13:03:22.781215 10292 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:03:22.852293 10420 raft_consensus.cc:1275] T 1484bae8a7264a0e9f328dd5ce7edad8 P 24479f93a03b4364837c81f7efbdf9d3 [term 2 FOLLOWER]: Refusing update from remote peer 17d104ff42224d8c9cdf4c53a2152582: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:22.853546 10757 consensus_queue.cc:1048] T 1484bae8a7264a0e9f328dd5ce7edad8 P 17d104ff42224d8c9cdf4c53a2152582 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:22.862120 10695 raft_consensus.cc:1275] T 1484bae8a7264a0e9f328dd5ce7edad8 P 22139e7a5ea041588dd21a8d06ba1741 [term 2 FOLLOWER]: Refusing update from remote peer 17d104ff42224d8c9cdf4c53a2152582: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:22.865267 10757 consensus_queue.cc:1048] T 1484bae8a7264a0e9f328dd5ce7edad8 P 17d104ff42224d8c9cdf4c53a2152582 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:23.026702   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:23.035898 10495 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "19c2daa20bbe47afa5289e2b32987709"
dest_uuid: "17d104ff42224d8c9cdf4c53a2152582"
mode: GRACEFUL
new_leader_uuid: "24479f93a03b4364837c81f7efbdf9d3"
 from {username='slave'} at 127.0.0.1:52156
I20260709 13:03:23.036396 10495 raft_consensus.cc:606] T 19c2daa20bbe47afa5289e2b32987709 P 17d104ff42224d8c9cdf4c53a2152582 [term 2 LEADER]: Received request to transfer leadership to TS 24479f93a03b4364837c81f7efbdf9d3
I20260709 13:03:23.038781 10495 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "77c2a758545e45e29d62d8d71ea3f43d"
dest_uuid: "17d104ff42224d8c9cdf4c53a2152582"
mode: GRACEFUL
new_leader_uuid: "24479f93a03b4364837c81f7efbdf9d3"
 from {username='slave'} at 127.0.0.1:52156
I20260709 13:03:23.039208 10495 raft_consensus.cc:606] T 77c2a758545e45e29d62d8d71ea3f43d P 17d104ff42224d8c9cdf4c53a2152582 [term 2 LEADER]: Received request to transfer leadership to TS 24479f93a03b4364837c81f7efbdf9d3
I20260709 13:03:23.041354 10420 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "89649f4e196f44a3b3b98fa009c228f8"
dest_uuid: "24479f93a03b4364837c81f7efbdf9d3"
mode: GRACEFUL
new_leader_uuid: "17d104ff42224d8c9cdf4c53a2152582"
 from {username='slave'} at 127.0.0.1:51992
I20260709 13:03:23.041812 10420 raft_consensus.cc:606] T 89649f4e196f44a3b3b98fa009c228f8 P 24479f93a03b4364837c81f7efbdf9d3 [term 1 LEADER]: Received request to transfer leadership to TS 17d104ff42224d8c9cdf4c53a2152582
I20260709 13:03:23.042883   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:03:23.043359   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:23.043995   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:23.101410 10420 raft_consensus.cc:1275] T 4feb1aa9b1d14601b28b28a6d515ee65 P 24479f93a03b4364837c81f7efbdf9d3 [term 3 FOLLOWER]: Refusing update from remote peer 17d104ff42224d8c9cdf4c53a2152582: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:23.102833 10757 consensus_queue.cc:1048] T 4feb1aa9b1d14601b28b28a6d515ee65 P 17d104ff42224d8c9cdf4c53a2152582 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:23.111970 10695 raft_consensus.cc:1275] T 4feb1aa9b1d14601b28b28a6d515ee65 P 22139e7a5ea041588dd21a8d06ba1741 [term 3 FOLLOWER]: Refusing update from remote peer 17d104ff42224d8c9cdf4c53a2152582: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:23.113590 10641 consensus_queue.cc:1048] T 4feb1aa9b1d14601b28b28a6d515ee65 P 17d104ff42224d8c9cdf4c53a2152582 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:23.251477 10736 raft_consensus.cc:993] T 89649f4e196f44a3b3b98fa009c228f8 P 24479f93a03b4364837c81f7efbdf9d3: : Instructing follower 17d104ff42224d8c9cdf4c53a2152582 to start an election
I20260709 13:03:23.251917 10751 raft_consensus.cc:1081] T 89649f4e196f44a3b3b98fa009c228f8 P 24479f93a03b4364837c81f7efbdf9d3 [term 1 LEADER]: Signalling peer 17d104ff42224d8c9cdf4c53a2152582 to start an election
I20260709 13:03:23.253433 10495 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "89649f4e196f44a3b3b98fa009c228f8"
dest_uuid: "17d104ff42224d8c9cdf4c53a2152582"
 from {username='slave'} at 127.0.0.1:38496
I20260709 13:03:23.253939 10495 raft_consensus.cc:493] T 89649f4e196f44a3b3b98fa009c228f8 P 17d104ff42224d8c9cdf4c53a2152582 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:23.254257 10495 raft_consensus.cc:3060] T 89649f4e196f44a3b3b98fa009c228f8 P 17d104ff42224d8c9cdf4c53a2152582 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:23.258971 10495 raft_consensus.cc:515] T 89649f4e196f44a3b3b98fa009c228f8 P 17d104ff42224d8c9cdf4c53a2152582 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:23.260561 10495 leader_election.cc:290] T 89649f4e196f44a3b3b98fa009c228f8 P 17d104ff42224d8c9cdf4c53a2152582 [CANDIDATE]: Term 2 election: Requested vote from peers 22139e7a5ea041588dd21a8d06ba1741 (127.0.107.193:45479), 24479f93a03b4364837c81f7efbdf9d3 (127.0.107.194:44467)
I20260709 13:03:23.261587 10420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89649f4e196f44a3b3b98fa009c228f8" candidate_uuid: "17d104ff42224d8c9cdf4c53a2152582" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "24479f93a03b4364837c81f7efbdf9d3"
I20260709 13:03:23.261584 10695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89649f4e196f44a3b3b98fa009c228f8" candidate_uuid: "17d104ff42224d8c9cdf4c53a2152582" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "22139e7a5ea041588dd21a8d06ba1741"
I20260709 13:03:23.262481 10420 raft_consensus.cc:3055] T 89649f4e196f44a3b3b98fa009c228f8 P 24479f93a03b4364837c81f7efbdf9d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:23.262595 10695 raft_consensus.cc:3060] T 89649f4e196f44a3b3b98fa009c228f8 P 22139e7a5ea041588dd21a8d06ba1741 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:23.262955 10420 raft_consensus.cc:740] T 89649f4e196f44a3b3b98fa009c228f8 P 24479f93a03b4364837c81f7efbdf9d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 24479f93a03b4364837c81f7efbdf9d3, State: Running, Role: LEADER
I20260709 13:03:23.263931 10420 consensus_queue.cc:260] T 89649f4e196f44a3b3b98fa009c228f8 P 24479f93a03b4364837c81f7efbdf9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:23.265250 10420 raft_consensus.cc:3060] T 89649f4e196f44a3b3b98fa009c228f8 P 24479f93a03b4364837c81f7efbdf9d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:23.270555 10695 raft_consensus.cc:2468] T 89649f4e196f44a3b3b98fa009c228f8 P 22139e7a5ea041588dd21a8d06ba1741 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17d104ff42224d8c9cdf4c53a2152582 in term 2.
I20260709 13:03:23.272043 10458 leader_election.cc:304] T 89649f4e196f44a3b3b98fa009c228f8 P 17d104ff42224d8c9cdf4c53a2152582 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17d104ff42224d8c9cdf4c53a2152582, 22139e7a5ea041588dd21a8d06ba1741; no voters: 
I20260709 13:03:23.272434 10420 raft_consensus.cc:2468] T 89649f4e196f44a3b3b98fa009c228f8 P 24479f93a03b4364837c81f7efbdf9d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17d104ff42224d8c9cdf4c53a2152582 in term 2.
I20260709 13:03:23.272800 10641 raft_consensus.cc:2804] T 89649f4e196f44a3b3b98fa009c228f8 P 17d104ff42224d8c9cdf4c53a2152582 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:23.273327 10641 raft_consensus.cc:697] T 89649f4e196f44a3b3b98fa009c228f8 P 17d104ff42224d8c9cdf4c53a2152582 [term 2 LEADER]: Becoming Leader. State: Replica: 17d104ff42224d8c9cdf4c53a2152582, State: Running, Role: LEADER
I20260709 13:03:23.274299 10641 consensus_queue.cc:237] T 89649f4e196f44a3b3b98fa009c228f8 P 17d104ff42224d8c9cdf4c53a2152582 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:23.281464 10242 catalog_manager.cc:5697] T 89649f4e196f44a3b3b98fa009c228f8 P 17d104ff42224d8c9cdf4c53a2152582 reported cstate change: term changed from 1 to 2, leader changed from 24479f93a03b4364837c81f7efbdf9d3 (127.0.107.194) to 17d104ff42224d8c9cdf4c53a2152582 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "17d104ff42224d8c9cdf4c53a2152582" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:23.478957 10757 raft_consensus.cc:993] T 19c2daa20bbe47afa5289e2b32987709 P 17d104ff42224d8c9cdf4c53a2152582: : Instructing follower 24479f93a03b4364837c81f7efbdf9d3 to start an election
I20260709 13:03:23.479461 10641 raft_consensus.cc:1081] T 19c2daa20bbe47afa5289e2b32987709 P 17d104ff42224d8c9cdf4c53a2152582 [term 2 LEADER]: Signalling peer 24479f93a03b4364837c81f7efbdf9d3 to start an election
I20260709 13:03:23.481123 10420 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "19c2daa20bbe47afa5289e2b32987709"
dest_uuid: "24479f93a03b4364837c81f7efbdf9d3"
 from {username='slave'} at 127.0.0.1:33552
I20260709 13:03:23.481623 10420 raft_consensus.cc:493] T 19c2daa20bbe47afa5289e2b32987709 P 24479f93a03b4364837c81f7efbdf9d3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:23.481899 10420 raft_consensus.cc:3060] T 19c2daa20bbe47afa5289e2b32987709 P 24479f93a03b4364837c81f7efbdf9d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:23.486531 10420 raft_consensus.cc:515] T 19c2daa20bbe47afa5289e2b32987709 P 24479f93a03b4364837c81f7efbdf9d3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:23.488106 10420 leader_election.cc:290] T 19c2daa20bbe47afa5289e2b32987709 P 24479f93a03b4364837c81f7efbdf9d3 [CANDIDATE]: Term 3 election: Requested vote from peers 22139e7a5ea041588dd21a8d06ba1741 (127.0.107.193:45479), 17d104ff42224d8c9cdf4c53a2152582 (127.0.107.195:41601)
I20260709 13:03:23.489146 10495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19c2daa20bbe47afa5289e2b32987709" candidate_uuid: "24479f93a03b4364837c81f7efbdf9d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "17d104ff42224d8c9cdf4c53a2152582"
I20260709 13:03:23.489171 10695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19c2daa20bbe47afa5289e2b32987709" candidate_uuid: "24479f93a03b4364837c81f7efbdf9d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "22139e7a5ea041588dd21a8d06ba1741"
I20260709 13:03:23.489956 10495 raft_consensus.cc:3055] T 19c2daa20bbe47afa5289e2b32987709 P 17d104ff42224d8c9cdf4c53a2152582 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:23.489980 10695 raft_consensus.cc:3060] T 19c2daa20bbe47afa5289e2b32987709 P 22139e7a5ea041588dd21a8d06ba1741 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:23.490360 10495 raft_consensus.cc:740] T 19c2daa20bbe47afa5289e2b32987709 P 17d104ff42224d8c9cdf4c53a2152582 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 17d104ff42224d8c9cdf4c53a2152582, State: Running, Role: LEADER
I20260709 13:03:23.491127 10495 consensus_queue.cc:260] T 19c2daa20bbe47afa5289e2b32987709 P 17d104ff42224d8c9cdf4c53a2152582 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:23.492054 10495 raft_consensus.cc:3060] T 19c2daa20bbe47afa5289e2b32987709 P 17d104ff42224d8c9cdf4c53a2152582 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:23.495477 10695 raft_consensus.cc:2468] T 19c2daa20bbe47afa5289e2b32987709 P 22139e7a5ea041588dd21a8d06ba1741 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24479f93a03b4364837c81f7efbdf9d3 in term 3.
I20260709 13:03:23.496877 10384 leader_election.cc:304] T 19c2daa20bbe47afa5289e2b32987709 P 24479f93a03b4364837c81f7efbdf9d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22139e7a5ea041588dd21a8d06ba1741, 24479f93a03b4364837c81f7efbdf9d3; no voters: 
I20260709 13:03:23.497448 10495 raft_consensus.cc:2468] T 19c2daa20bbe47afa5289e2b32987709 P 17d104ff42224d8c9cdf4c53a2152582 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24479f93a03b4364837c81f7efbdf9d3 in term 3.
I20260709 13:03:23.497677 10751 raft_consensus.cc:2804] T 19c2daa20bbe47afa5289e2b32987709 P 24479f93a03b4364837c81f7efbdf9d3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:23.498391 10751 raft_consensus.cc:697] T 19c2daa20bbe47afa5289e2b32987709 P 24479f93a03b4364837c81f7efbdf9d3 [term 3 LEADER]: Becoming Leader. State: Replica: 24479f93a03b4364837c81f7efbdf9d3, State: Running, Role: LEADER
I20260709 13:03:23.499471 10751 consensus_queue.cc:237] T 19c2daa20bbe47afa5289e2b32987709 P 24479f93a03b4364837c81f7efbdf9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:23.507191 10242 catalog_manager.cc:5697] T 19c2daa20bbe47afa5289e2b32987709 P 24479f93a03b4364837c81f7efbdf9d3 reported cstate change: term changed from 2 to 3, leader changed from 17d104ff42224d8c9cdf4c53a2152582 (127.0.107.195) to 24479f93a03b4364837c81f7efbdf9d3 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "24479f93a03b4364837c81f7efbdf9d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:23.549330 10757 raft_consensus.cc:993] T 77c2a758545e45e29d62d8d71ea3f43d P 17d104ff42224d8c9cdf4c53a2152582: : Instructing follower 24479f93a03b4364837c81f7efbdf9d3 to start an election
I20260709 13:03:23.549777 10641 raft_consensus.cc:1081] T 77c2a758545e45e29d62d8d71ea3f43d P 17d104ff42224d8c9cdf4c53a2152582 [term 2 LEADER]: Signalling peer 24479f93a03b4364837c81f7efbdf9d3 to start an election
I20260709 13:03:23.551282 10419 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "77c2a758545e45e29d62d8d71ea3f43d"
dest_uuid: "24479f93a03b4364837c81f7efbdf9d3"
 from {username='slave'} at 127.0.0.1:33552
I20260709 13:03:23.551744 10419 raft_consensus.cc:493] T 77c2a758545e45e29d62d8d71ea3f43d P 24479f93a03b4364837c81f7efbdf9d3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:23.551993 10419 raft_consensus.cc:3060] T 77c2a758545e45e29d62d8d71ea3f43d P 24479f93a03b4364837c81f7efbdf9d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:23.557670 10419 raft_consensus.cc:515] T 77c2a758545e45e29d62d8d71ea3f43d P 24479f93a03b4364837c81f7efbdf9d3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:23.559512 10419 leader_election.cc:290] T 77c2a758545e45e29d62d8d71ea3f43d P 24479f93a03b4364837c81f7efbdf9d3 [CANDIDATE]: Term 3 election: Requested vote from peers 22139e7a5ea041588dd21a8d06ba1741 (127.0.107.193:45479), 17d104ff42224d8c9cdf4c53a2152582 (127.0.107.195:41601)
I20260709 13:03:23.560348 10694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77c2a758545e45e29d62d8d71ea3f43d" candidate_uuid: "24479f93a03b4364837c81f7efbdf9d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "22139e7a5ea041588dd21a8d06ba1741"
I20260709 13:03:23.560496 10495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77c2a758545e45e29d62d8d71ea3f43d" candidate_uuid: "24479f93a03b4364837c81f7efbdf9d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "17d104ff42224d8c9cdf4c53a2152582"
I20260709 13:03:23.560940 10694 raft_consensus.cc:3060] T 77c2a758545e45e29d62d8d71ea3f43d P 22139e7a5ea041588dd21a8d06ba1741 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:23.560998 10495 raft_consensus.cc:3055] T 77c2a758545e45e29d62d8d71ea3f43d P 17d104ff42224d8c9cdf4c53a2152582 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:23.561288 10495 raft_consensus.cc:740] T 77c2a758545e45e29d62d8d71ea3f43d P 17d104ff42224d8c9cdf4c53a2152582 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 17d104ff42224d8c9cdf4c53a2152582, State: Running, Role: LEADER
I20260709 13:03:23.561873 10495 consensus_queue.cc:260] T 77c2a758545e45e29d62d8d71ea3f43d P 17d104ff42224d8c9cdf4c53a2152582 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:23.562870 10495 raft_consensus.cc:3060] T 77c2a758545e45e29d62d8d71ea3f43d P 17d104ff42224d8c9cdf4c53a2152582 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:23.566502 10694 raft_consensus.cc:2468] T 77c2a758545e45e29d62d8d71ea3f43d P 22139e7a5ea041588dd21a8d06ba1741 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24479f93a03b4364837c81f7efbdf9d3 in term 3.
I20260709 13:03:23.567283 10495 raft_consensus.cc:2468] T 77c2a758545e45e29d62d8d71ea3f43d P 17d104ff42224d8c9cdf4c53a2152582 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24479f93a03b4364837c81f7efbdf9d3 in term 3.
I20260709 13:03:23.567898 10384 leader_election.cc:304] T 77c2a758545e45e29d62d8d71ea3f43d P 24479f93a03b4364837c81f7efbdf9d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22139e7a5ea041588dd21a8d06ba1741, 24479f93a03b4364837c81f7efbdf9d3; no voters: 
I20260709 13:03:23.568674 10751 raft_consensus.cc:2804] T 77c2a758545e45e29d62d8d71ea3f43d P 24479f93a03b4364837c81f7efbdf9d3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:23.569173 10751 raft_consensus.cc:697] T 77c2a758545e45e29d62d8d71ea3f43d P 24479f93a03b4364837c81f7efbdf9d3 [term 3 LEADER]: Becoming Leader. State: Replica: 24479f93a03b4364837c81f7efbdf9d3, State: Running, Role: LEADER
I20260709 13:03:23.569969 10751 consensus_queue.cc:237] T 77c2a758545e45e29d62d8d71ea3f43d P 24479f93a03b4364837c81f7efbdf9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:23.576457 10242 catalog_manager.cc:5697] T 77c2a758545e45e29d62d8d71ea3f43d P 24479f93a03b4364837c81f7efbdf9d3 reported cstate change: term changed from 2 to 3, leader changed from 17d104ff42224d8c9cdf4c53a2152582 (127.0.107.195) to 24479f93a03b4364837c81f7efbdf9d3 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "24479f93a03b4364837c81f7efbdf9d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:23.666513 10419 raft_consensus.cc:1275] T 89649f4e196f44a3b3b98fa009c228f8 P 24479f93a03b4364837c81f7efbdf9d3 [term 2 FOLLOWER]: Refusing update from remote peer 17d104ff42224d8c9cdf4c53a2152582: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:23.667807 10641 consensus_queue.cc:1048] T 89649f4e196f44a3b3b98fa009c228f8 P 17d104ff42224d8c9cdf4c53a2152582 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:23.677963 10694 raft_consensus.cc:1275] T 89649f4e196f44a3b3b98fa009c228f8 P 22139e7a5ea041588dd21a8d06ba1741 [term 2 FOLLOWER]: Refusing update from remote peer 17d104ff42224d8c9cdf4c53a2152582: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:23.679921 10735 consensus_queue.cc:1048] T 89649f4e196f44a3b3b98fa009c228f8 P 17d104ff42224d8c9cdf4c53a2152582 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:03:23.782399 10292 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:03:23.991149 10695 raft_consensus.cc:1275] T 77c2a758545e45e29d62d8d71ea3f43d P 22139e7a5ea041588dd21a8d06ba1741 [term 3 FOLLOWER]: Refusing update from remote peer 24479f93a03b4364837c81f7efbdf9d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:23.992435 10581 consensus_queue.cc:1048] T 77c2a758545e45e29d62d8d71ea3f43d P 24479f93a03b4364837c81f7efbdf9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:24.004777 10495 raft_consensus.cc:1275] T 77c2a758545e45e29d62d8d71ea3f43d P 17d104ff42224d8c9cdf4c53a2152582 [term 3 FOLLOWER]: Refusing update from remote peer 24479f93a03b4364837c81f7efbdf9d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:24.006244 10581 consensus_queue.cc:1048] T 77c2a758545e45e29d62d8d71ea3f43d P 24479f93a03b4364837c81f7efbdf9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:24.050405   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:24.058238 10419 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2df7bfe151e349f1a30cd3142e13c021"
dest_uuid: "24479f93a03b4364837c81f7efbdf9d3"
mode: GRACEFUL
new_leader_uuid: "17d104ff42224d8c9cdf4c53a2152582"
 from {username='slave'} at 127.0.0.1:51992
I20260709 13:03:24.058799 10419 raft_consensus.cc:606] T 2df7bfe151e349f1a30cd3142e13c021 P 24479f93a03b4364837c81f7efbdf9d3 [term 1 LEADER]: Received request to transfer leadership to TS 17d104ff42224d8c9cdf4c53a2152582
I20260709 13:03:24.061390 10419 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "77c2a758545e45e29d62d8d71ea3f43d"
dest_uuid: "24479f93a03b4364837c81f7efbdf9d3"
mode: GRACEFUL
new_leader_uuid: "17d104ff42224d8c9cdf4c53a2152582"
 from {username='slave'} at 127.0.0.1:51992
I20260709 13:03:24.061892 10419 raft_consensus.cc:606] T 77c2a758545e45e29d62d8d71ea3f43d P 24479f93a03b4364837c81f7efbdf9d3 [term 3 LEADER]: Received request to transfer leadership to TS 17d104ff42224d8c9cdf4c53a2152582
I20260709 13:03:24.064407 10495 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "afe8b130a0d1484e9f08fed8f6be2f61"
dest_uuid: "17d104ff42224d8c9cdf4c53a2152582"
mode: GRACEFUL
new_leader_uuid: "24479f93a03b4364837c81f7efbdf9d3"
 from {username='slave'} at 127.0.0.1:52156
I20260709 13:03:24.064885 10495 raft_consensus.cc:606] T afe8b130a0d1484e9f08fed8f6be2f61 P 17d104ff42224d8c9cdf4c53a2152582 [term 2 LEADER]: Received request to transfer leadership to TS 24479f93a03b4364837c81f7efbdf9d3
I20260709 13:03:24.066021   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:03:24.066521   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:24.067127   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:24.073414 10695 raft_consensus.cc:1275] T 19c2daa20bbe47afa5289e2b32987709 P 22139e7a5ea041588dd21a8d06ba1741 [term 3 FOLLOWER]: Refusing update from remote peer 24479f93a03b4364837c81f7efbdf9d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:03:24.075007 10581 consensus_queue.cc:1048] T 19c2daa20bbe47afa5289e2b32987709 P 24479f93a03b4364837c81f7efbdf9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:24.086073 10495 raft_consensus.cc:1275] T 19c2daa20bbe47afa5289e2b32987709 P 17d104ff42224d8c9cdf4c53a2152582 [term 3 FOLLOWER]: Refusing update from remote peer 24479f93a03b4364837c81f7efbdf9d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:03:24.087426 10777 consensus_queue.cc:1048] T 19c2daa20bbe47afa5289e2b32987709 P 24479f93a03b4364837c81f7efbdf9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:24.376796 10751 raft_consensus.cc:993] T 2df7bfe151e349f1a30cd3142e13c021 P 24479f93a03b4364837c81f7efbdf9d3: : Instructing follower 17d104ff42224d8c9cdf4c53a2152582 to start an election
I20260709 13:03:24.377264 10751 raft_consensus.cc:1081] T 2df7bfe151e349f1a30cd3142e13c021 P 24479f93a03b4364837c81f7efbdf9d3 [term 1 LEADER]: Signalling peer 17d104ff42224d8c9cdf4c53a2152582 to start an election
I20260709 13:03:24.378808 10495 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2df7bfe151e349f1a30cd3142e13c021"
dest_uuid: "17d104ff42224d8c9cdf4c53a2152582"
 from {username='slave'} at 127.0.0.1:38496
I20260709 13:03:24.379271 10495 raft_consensus.cc:493] T 2df7bfe151e349f1a30cd3142e13c021 P 17d104ff42224d8c9cdf4c53a2152582 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:24.379560 10495 raft_consensus.cc:3060] T 2df7bfe151e349f1a30cd3142e13c021 P 17d104ff42224d8c9cdf4c53a2152582 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:24.384922 10495 raft_consensus.cc:515] T 2df7bfe151e349f1a30cd3142e13c021 P 17d104ff42224d8c9cdf4c53a2152582 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:24.386384 10495 leader_election.cc:290] T 2df7bfe151e349f1a30cd3142e13c021 P 17d104ff42224d8c9cdf4c53a2152582 [CANDIDATE]: Term 2 election: Requested vote from peers 22139e7a5ea041588dd21a8d06ba1741 (127.0.107.193:45479), 24479f93a03b4364837c81f7efbdf9d3 (127.0.107.194:44467)
I20260709 13:03:24.387282 10695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2df7bfe151e349f1a30cd3142e13c021" candidate_uuid: "17d104ff42224d8c9cdf4c53a2152582" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "22139e7a5ea041588dd21a8d06ba1741"
I20260709 13:03:24.387410 10419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2df7bfe151e349f1a30cd3142e13c021" candidate_uuid: "17d104ff42224d8c9cdf4c53a2152582" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "24479f93a03b4364837c81f7efbdf9d3"
I20260709 13:03:24.388111 10695 raft_consensus.cc:3060] T 2df7bfe151e349f1a30cd3142e13c021 P 22139e7a5ea041588dd21a8d06ba1741 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:24.388154 10419 raft_consensus.cc:3055] T 2df7bfe151e349f1a30cd3142e13c021 P 24479f93a03b4364837c81f7efbdf9d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:24.388651 10419 raft_consensus.cc:740] T 2df7bfe151e349f1a30cd3142e13c021 P 24479f93a03b4364837c81f7efbdf9d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 24479f93a03b4364837c81f7efbdf9d3, State: Running, Role: LEADER
I20260709 13:03:24.389468 10419 consensus_queue.cc:260] T 2df7bfe151e349f1a30cd3142e13c021 P 24479f93a03b4364837c81f7efbdf9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:24.390914 10419 raft_consensus.cc:3060] T 2df7bfe151e349f1a30cd3142e13c021 P 24479f93a03b4364837c81f7efbdf9d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:24.395408 10695 raft_consensus.cc:2468] T 2df7bfe151e349f1a30cd3142e13c021 P 22139e7a5ea041588dd21a8d06ba1741 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17d104ff42224d8c9cdf4c53a2152582 in term 2.
I20260709 13:03:24.396770 10458 leader_election.cc:304] T 2df7bfe151e349f1a30cd3142e13c021 P 17d104ff42224d8c9cdf4c53a2152582 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17d104ff42224d8c9cdf4c53a2152582, 22139e7a5ea041588dd21a8d06ba1741; no voters: 
I20260709 13:03:24.397619 10757 raft_consensus.cc:2804] T 2df7bfe151e349f1a30cd3142e13c021 P 17d104ff42224d8c9cdf4c53a2152582 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:24.398011 10757 raft_consensus.cc:697] T 2df7bfe151e349f1a30cd3142e13c021 P 17d104ff42224d8c9cdf4c53a2152582 [term 2 LEADER]: Becoming Leader. State: Replica: 17d104ff42224d8c9cdf4c53a2152582, State: Running, Role: LEADER
I20260709 13:03:24.398128 10419 raft_consensus.cc:2468] T 2df7bfe151e349f1a30cd3142e13c021 P 24479f93a03b4364837c81f7efbdf9d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17d104ff42224d8c9cdf4c53a2152582 in term 2.
I20260709 13:03:24.398960 10757 consensus_queue.cc:237] T 2df7bfe151e349f1a30cd3142e13c021 P 17d104ff42224d8c9cdf4c53a2152582 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:24.405663 10243 catalog_manager.cc:5697] T 2df7bfe151e349f1a30cd3142e13c021 P 17d104ff42224d8c9cdf4c53a2152582 reported cstate change: term changed from 1 to 2, leader changed from 24479f93a03b4364837c81f7efbdf9d3 (127.0.107.194) to 17d104ff42224d8c9cdf4c53a2152582 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "17d104ff42224d8c9cdf4c53a2152582" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:24.460906 10641 raft_consensus.cc:993] T afe8b130a0d1484e9f08fed8f6be2f61 P 17d104ff42224d8c9cdf4c53a2152582: : Instructing follower 24479f93a03b4364837c81f7efbdf9d3 to start an election
I20260709 13:03:24.461359 10735 raft_consensus.cc:1081] T afe8b130a0d1484e9f08fed8f6be2f61 P 17d104ff42224d8c9cdf4c53a2152582 [term 2 LEADER]: Signalling peer 24479f93a03b4364837c81f7efbdf9d3 to start an election
I20260709 13:03:24.462843 10419 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "afe8b130a0d1484e9f08fed8f6be2f61"
dest_uuid: "24479f93a03b4364837c81f7efbdf9d3"
 from {username='slave'} at 127.0.0.1:33552
I20260709 13:03:24.463388 10419 raft_consensus.cc:493] T afe8b130a0d1484e9f08fed8f6be2f61 P 24479f93a03b4364837c81f7efbdf9d3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:24.463662 10419 raft_consensus.cc:3060] T afe8b130a0d1484e9f08fed8f6be2f61 P 24479f93a03b4364837c81f7efbdf9d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:24.468536 10419 raft_consensus.cc:515] T afe8b130a0d1484e9f08fed8f6be2f61 P 24479f93a03b4364837c81f7efbdf9d3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:24.470106 10419 leader_election.cc:290] T afe8b130a0d1484e9f08fed8f6be2f61 P 24479f93a03b4364837c81f7efbdf9d3 [CANDIDATE]: Term 3 election: Requested vote from peers 22139e7a5ea041588dd21a8d06ba1741 (127.0.107.193:45479), 17d104ff42224d8c9cdf4c53a2152582 (127.0.107.195:41601)
I20260709 13:03:24.470924 10695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe8b130a0d1484e9f08fed8f6be2f61" candidate_uuid: "24479f93a03b4364837c81f7efbdf9d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "22139e7a5ea041588dd21a8d06ba1741"
I20260709 13:03:24.471185 10495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe8b130a0d1484e9f08fed8f6be2f61" candidate_uuid: "24479f93a03b4364837c81f7efbdf9d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "17d104ff42224d8c9cdf4c53a2152582"
I20260709 13:03:24.471514 10695 raft_consensus.cc:3060] T afe8b130a0d1484e9f08fed8f6be2f61 P 22139e7a5ea041588dd21a8d06ba1741 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:24.471786 10495 raft_consensus.cc:3055] T afe8b130a0d1484e9f08fed8f6be2f61 P 17d104ff42224d8c9cdf4c53a2152582 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:24.472146 10495 raft_consensus.cc:740] T afe8b130a0d1484e9f08fed8f6be2f61 P 17d104ff42224d8c9cdf4c53a2152582 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 17d104ff42224d8c9cdf4c53a2152582, State: Running, Role: LEADER
I20260709 13:03:24.472894 10495 consensus_queue.cc:260] T afe8b130a0d1484e9f08fed8f6be2f61 P 17d104ff42224d8c9cdf4c53a2152582 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:24.473845 10495 raft_consensus.cc:3060] T afe8b130a0d1484e9f08fed8f6be2f61 P 17d104ff42224d8c9cdf4c53a2152582 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:24.476189 10695 raft_consensus.cc:2468] T afe8b130a0d1484e9f08fed8f6be2f61 P 22139e7a5ea041588dd21a8d06ba1741 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24479f93a03b4364837c81f7efbdf9d3 in term 3.
I20260709 13:03:24.477149 10384 leader_election.cc:304] T afe8b130a0d1484e9f08fed8f6be2f61 P 24479f93a03b4364837c81f7efbdf9d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22139e7a5ea041588dd21a8d06ba1741, 24479f93a03b4364837c81f7efbdf9d3; no voters: 
I20260709 13:03:24.477756 10751 raft_consensus.cc:2804] T afe8b130a0d1484e9f08fed8f6be2f61 P 24479f93a03b4364837c81f7efbdf9d3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:24.478124 10751 raft_consensus.cc:697] T afe8b130a0d1484e9f08fed8f6be2f61 P 24479f93a03b4364837c81f7efbdf9d3 [term 3 LEADER]: Becoming Leader. State: Replica: 24479f93a03b4364837c81f7efbdf9d3, State: Running, Role: LEADER
I20260709 13:03:24.478221 10495 raft_consensus.cc:2468] T afe8b130a0d1484e9f08fed8f6be2f61 P 17d104ff42224d8c9cdf4c53a2152582 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24479f93a03b4364837c81f7efbdf9d3 in term 3.
I20260709 13:03:24.478957 10751 consensus_queue.cc:237] T afe8b130a0d1484e9f08fed8f6be2f61 P 24479f93a03b4364837c81f7efbdf9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:24.485741 10243 catalog_manager.cc:5697] T afe8b130a0d1484e9f08fed8f6be2f61 P 24479f93a03b4364837c81f7efbdf9d3 reported cstate change: term changed from 2 to 3, leader changed from 17d104ff42224d8c9cdf4c53a2152582 (127.0.107.195) to 24479f93a03b4364837c81f7efbdf9d3 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "24479f93a03b4364837c81f7efbdf9d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:24.634176 10581 raft_consensus.cc:993] T 77c2a758545e45e29d62d8d71ea3f43d P 24479f93a03b4364837c81f7efbdf9d3: : Instructing follower 17d104ff42224d8c9cdf4c53a2152582 to start an election
I20260709 13:03:24.634646 10751 raft_consensus.cc:1081] T 77c2a758545e45e29d62d8d71ea3f43d P 24479f93a03b4364837c81f7efbdf9d3 [term 3 LEADER]: Signalling peer 17d104ff42224d8c9cdf4c53a2152582 to start an election
I20260709 13:03:24.636109 10495 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "77c2a758545e45e29d62d8d71ea3f43d"
dest_uuid: "17d104ff42224d8c9cdf4c53a2152582"
 from {username='slave'} at 127.0.0.1:38496
I20260709 13:03:24.636538 10495 raft_consensus.cc:493] T 77c2a758545e45e29d62d8d71ea3f43d P 17d104ff42224d8c9cdf4c53a2152582 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:24.636814 10495 raft_consensus.cc:3060] T 77c2a758545e45e29d62d8d71ea3f43d P 17d104ff42224d8c9cdf4c53a2152582 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:24.641520 10495 raft_consensus.cc:515] T 77c2a758545e45e29d62d8d71ea3f43d P 17d104ff42224d8c9cdf4c53a2152582 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:24.643179 10495 leader_election.cc:290] T 77c2a758545e45e29d62d8d71ea3f43d P 17d104ff42224d8c9cdf4c53a2152582 [CANDIDATE]: Term 4 election: Requested vote from peers 22139e7a5ea041588dd21a8d06ba1741 (127.0.107.193:45479), 24479f93a03b4364837c81f7efbdf9d3 (127.0.107.194:44467)
I20260709 13:03:24.643949 10695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77c2a758545e45e29d62d8d71ea3f43d" candidate_uuid: "17d104ff42224d8c9cdf4c53a2152582" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "22139e7a5ea041588dd21a8d06ba1741"
I20260709 13:03:24.644192 10419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77c2a758545e45e29d62d8d71ea3f43d" candidate_uuid: "17d104ff42224d8c9cdf4c53a2152582" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "24479f93a03b4364837c81f7efbdf9d3"
I20260709 13:03:24.644510 10695 raft_consensus.cc:3060] T 77c2a758545e45e29d62d8d71ea3f43d P 22139e7a5ea041588dd21a8d06ba1741 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:24.644797 10419 raft_consensus.cc:3055] T 77c2a758545e45e29d62d8d71ea3f43d P 24479f93a03b4364837c81f7efbdf9d3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:24.645066 10419 raft_consensus.cc:740] T 77c2a758545e45e29d62d8d71ea3f43d P 24479f93a03b4364837c81f7efbdf9d3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 24479f93a03b4364837c81f7efbdf9d3, State: Running, Role: LEADER
I20260709 13:03:24.645702 10419 consensus_queue.cc:260] T 77c2a758545e45e29d62d8d71ea3f43d P 24479f93a03b4364837c81f7efbdf9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:24.646620 10419 raft_consensus.cc:3060] T 77c2a758545e45e29d62d8d71ea3f43d P 24479f93a03b4364837c81f7efbdf9d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:24.649042 10695 raft_consensus.cc:2468] T 77c2a758545e45e29d62d8d71ea3f43d P 22139e7a5ea041588dd21a8d06ba1741 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17d104ff42224d8c9cdf4c53a2152582 in term 4.
I20260709 13:03:24.650161 10458 leader_election.cc:304] T 77c2a758545e45e29d62d8d71ea3f43d P 17d104ff42224d8c9cdf4c53a2152582 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17d104ff42224d8c9cdf4c53a2152582, 22139e7a5ea041588dd21a8d06ba1741; no voters: 
I20260709 13:03:24.650820 10735 raft_consensus.cc:2804] T 77c2a758545e45e29d62d8d71ea3f43d P 17d104ff42224d8c9cdf4c53a2152582 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:24.651304 10735 raft_consensus.cc:697] T 77c2a758545e45e29d62d8d71ea3f43d P 17d104ff42224d8c9cdf4c53a2152582 [term 4 LEADER]: Becoming Leader. State: Replica: 17d104ff42224d8c9cdf4c53a2152582, State: Running, Role: LEADER
I20260709 13:03:24.652210 10419 raft_consensus.cc:2468] T 77c2a758545e45e29d62d8d71ea3f43d P 24479f93a03b4364837c81f7efbdf9d3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17d104ff42224d8c9cdf4c53a2152582 in term 4.
I20260709 13:03:24.652223 10735 consensus_queue.cc:237] T 77c2a758545e45e29d62d8d71ea3f43d P 17d104ff42224d8c9cdf4c53a2152582 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:24.658691 10243 catalog_manager.cc:5697] T 77c2a758545e45e29d62d8d71ea3f43d P 17d104ff42224d8c9cdf4c53a2152582 reported cstate change: term changed from 3 to 4, leader changed from 24479f93a03b4364837c81f7efbdf9d3 (127.0.107.194) to 17d104ff42224d8c9cdf4c53a2152582 (127.0.107.195). New cstate: current_term: 4 leader_uuid: "17d104ff42224d8c9cdf4c53a2152582" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } health_report { overall_health: HEALTHY } } }
W20260709 13:03:24.783341 10292 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:03:24.830489 10695 raft_consensus.cc:1275] T 2df7bfe151e349f1a30cd3142e13c021 P 22139e7a5ea041588dd21a8d06ba1741 [term 2 FOLLOWER]: Refusing update from remote peer 17d104ff42224d8c9cdf4c53a2152582: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:24.831928 10735 consensus_queue.cc:1048] T 2df7bfe151e349f1a30cd3142e13c021 P 17d104ff42224d8c9cdf4c53a2152582 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:24.841624 10419 raft_consensus.cc:1275] T 2df7bfe151e349f1a30cd3142e13c021 P 24479f93a03b4364837c81f7efbdf9d3 [term 2 FOLLOWER]: Refusing update from remote peer 17d104ff42224d8c9cdf4c53a2152582: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:24.843005 10735 consensus_queue.cc:1048] T 2df7bfe151e349f1a30cd3142e13c021 P 17d104ff42224d8c9cdf4c53a2152582 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:25.030766 10495 raft_consensus.cc:1275] T afe8b130a0d1484e9f08fed8f6be2f61 P 17d104ff42224d8c9cdf4c53a2152582 [term 3 FOLLOWER]: Refusing update from remote peer 24479f93a03b4364837c81f7efbdf9d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:03:25.031903 10751 consensus_queue.cc:1048] T afe8b130a0d1484e9f08fed8f6be2f61 P 24479f93a03b4364837c81f7efbdf9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:25.040004 10695 raft_consensus.cc:1275] T afe8b130a0d1484e9f08fed8f6be2f61 P 22139e7a5ea041588dd21a8d06ba1741 [term 3 FOLLOWER]: Refusing update from remote peer 24479f93a03b4364837c81f7efbdf9d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:03:25.041498 10751 consensus_queue.cc:1048] T afe8b130a0d1484e9f08fed8f6be2f61 P 24479f93a03b4364837c81f7efbdf9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:25.074033   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:25.081384 10495 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "77c2a758545e45e29d62d8d71ea3f43d"
dest_uuid: "17d104ff42224d8c9cdf4c53a2152582"
mode: GRACEFUL
new_leader_uuid: "24479f93a03b4364837c81f7efbdf9d3"
 from {username='slave'} at 127.0.0.1:52156
I20260709 13:03:25.081921 10495 raft_consensus.cc:606] T 77c2a758545e45e29d62d8d71ea3f43d P 17d104ff42224d8c9cdf4c53a2152582 [term 4 LEADER]: Received request to transfer leadership to TS 24479f93a03b4364837c81f7efbdf9d3
I20260709 13:03:25.084477 10419 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "afe8b130a0d1484e9f08fed8f6be2f61"
dest_uuid: "24479f93a03b4364837c81f7efbdf9d3"
mode: GRACEFUL
new_leader_uuid: "17d104ff42224d8c9cdf4c53a2152582"
 from {username='slave'} at 127.0.0.1:51992
I20260709 13:03:25.084975 10419 raft_consensus.cc:606] T afe8b130a0d1484e9f08fed8f6be2f61 P 24479f93a03b4364837c81f7efbdf9d3 [term 3 LEADER]: Received request to transfer leadership to TS 17d104ff42224d8c9cdf4c53a2152582
I20260709 13:03:25.087544 10495 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e0ad84cc4e1942d99055ab43ea0bdac0"
dest_uuid: "17d104ff42224d8c9cdf4c53a2152582"
mode: GRACEFUL
new_leader_uuid: "24479f93a03b4364837c81f7efbdf9d3"
 from {username='slave'} at 127.0.0.1:52156
I20260709 13:03:25.087972 10495 raft_consensus.cc:606] T e0ad84cc4e1942d99055ab43ea0bdac0 P 17d104ff42224d8c9cdf4c53a2152582 [term 1 LEADER]: Received request to transfer leadership to TS 24479f93a03b4364837c81f7efbdf9d3
I20260709 13:03:25.088951   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:03:25.089447   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:25.089967   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:25.122407 10695 raft_consensus.cc:1275] T 77c2a758545e45e29d62d8d71ea3f43d P 22139e7a5ea041588dd21a8d06ba1741 [term 4 FOLLOWER]: Refusing update from remote peer 17d104ff42224d8c9cdf4c53a2152582: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:03:25.124033 10641 consensus_queue.cc:1048] T 77c2a758545e45e29d62d8d71ea3f43d P 17d104ff42224d8c9cdf4c53a2152582 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:25.132483 10419 raft_consensus.cc:1275] T 77c2a758545e45e29d62d8d71ea3f43d P 24479f93a03b4364837c81f7efbdf9d3 [term 4 FOLLOWER]: Refusing update from remote peer 17d104ff42224d8c9cdf4c53a2152582: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:03:25.134492 10757 consensus_queue.cc:1048] T 77c2a758545e45e29d62d8d71ea3f43d P 17d104ff42224d8c9cdf4c53a2152582 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:25.143226 10735 raft_consensus.cc:993] T 77c2a758545e45e29d62d8d71ea3f43d P 17d104ff42224d8c9cdf4c53a2152582: : Instructing follower 24479f93a03b4364837c81f7efbdf9d3 to start an election
I20260709 13:03:25.143747 10757 raft_consensus.cc:1081] T 77c2a758545e45e29d62d8d71ea3f43d P 17d104ff42224d8c9cdf4c53a2152582 [term 4 LEADER]: Signalling peer 24479f93a03b4364837c81f7efbdf9d3 to start an election
I20260709 13:03:25.145325 10419 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "77c2a758545e45e29d62d8d71ea3f43d"
dest_uuid: "24479f93a03b4364837c81f7efbdf9d3"
 from {username='slave'} at 127.0.0.1:33552
I20260709 13:03:25.145999 10419 raft_consensus.cc:493] T 77c2a758545e45e29d62d8d71ea3f43d P 24479f93a03b4364837c81f7efbdf9d3 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:25.146427 10419 raft_consensus.cc:3060] T 77c2a758545e45e29d62d8d71ea3f43d P 24479f93a03b4364837c81f7efbdf9d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:25.151687 10419 raft_consensus.cc:515] T 77c2a758545e45e29d62d8d71ea3f43d P 24479f93a03b4364837c81f7efbdf9d3 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:25.153728 10419 leader_election.cc:290] T 77c2a758545e45e29d62d8d71ea3f43d P 24479f93a03b4364837c81f7efbdf9d3 [CANDIDATE]: Term 5 election: Requested vote from peers 22139e7a5ea041588dd21a8d06ba1741 (127.0.107.193:45479), 17d104ff42224d8c9cdf4c53a2152582 (127.0.107.195:41601)
I20260709 13:03:25.154536 10695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77c2a758545e45e29d62d8d71ea3f43d" candidate_uuid: "24479f93a03b4364837c81f7efbdf9d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "22139e7a5ea041588dd21a8d06ba1741"
I20260709 13:03:25.154809 10495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77c2a758545e45e29d62d8d71ea3f43d" candidate_uuid: "24479f93a03b4364837c81f7efbdf9d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "17d104ff42224d8c9cdf4c53a2152582"
I20260709 13:03:25.155283 10695 raft_consensus.cc:3060] T 77c2a758545e45e29d62d8d71ea3f43d P 22139e7a5ea041588dd21a8d06ba1741 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:25.155323 10495 raft_consensus.cc:3055] T 77c2a758545e45e29d62d8d71ea3f43d P 17d104ff42224d8c9cdf4c53a2152582 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:25.155819 10495 raft_consensus.cc:740] T 77c2a758545e45e29d62d8d71ea3f43d P 17d104ff42224d8c9cdf4c53a2152582 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 17d104ff42224d8c9cdf4c53a2152582, State: Running, Role: LEADER
I20260709 13:03:25.156574 10495 consensus_queue.cc:260] T 77c2a758545e45e29d62d8d71ea3f43d P 17d104ff42224d8c9cdf4c53a2152582 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:25.157831 10495 raft_consensus.cc:3060] T 77c2a758545e45e29d62d8d71ea3f43d P 17d104ff42224d8c9cdf4c53a2152582 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:25.162321 10695 raft_consensus.cc:2468] T 77c2a758545e45e29d62d8d71ea3f43d P 22139e7a5ea041588dd21a8d06ba1741 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24479f93a03b4364837c81f7efbdf9d3 in term 5.
I20260709 13:03:25.164435 10384 leader_election.cc:304] T 77c2a758545e45e29d62d8d71ea3f43d P 24479f93a03b4364837c81f7efbdf9d3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22139e7a5ea041588dd21a8d06ba1741, 24479f93a03b4364837c81f7efbdf9d3; no voters: 
I20260709 13:03:25.164536 10495 raft_consensus.cc:2468] T 77c2a758545e45e29d62d8d71ea3f43d P 17d104ff42224d8c9cdf4c53a2152582 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24479f93a03b4364837c81f7efbdf9d3 in term 5.
I20260709 13:03:25.165141 10751 raft_consensus.cc:2804] T 77c2a758545e45e29d62d8d71ea3f43d P 24479f93a03b4364837c81f7efbdf9d3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:25.165640 10751 raft_consensus.cc:697] T 77c2a758545e45e29d62d8d71ea3f43d P 24479f93a03b4364837c81f7efbdf9d3 [term 5 LEADER]: Becoming Leader. State: Replica: 24479f93a03b4364837c81f7efbdf9d3, State: Running, Role: LEADER
I20260709 13:03:25.166451 10751 consensus_queue.cc:237] T 77c2a758545e45e29d62d8d71ea3f43d P 24479f93a03b4364837c81f7efbdf9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:25.172837 10242 catalog_manager.cc:5697] T 77c2a758545e45e29d62d8d71ea3f43d P 24479f93a03b4364837c81f7efbdf9d3 reported cstate change: term changed from 4 to 5, leader changed from 17d104ff42224d8c9cdf4c53a2152582 (127.0.107.195) to 24479f93a03b4364837c81f7efbdf9d3 (127.0.107.194). New cstate: current_term: 5 leader_uuid: "24479f93a03b4364837c81f7efbdf9d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:25.376062 10735 raft_consensus.cc:993] T e0ad84cc4e1942d99055ab43ea0bdac0 P 17d104ff42224d8c9cdf4c53a2152582: : Instructing follower 24479f93a03b4364837c81f7efbdf9d3 to start an election
I20260709 13:03:25.376524 10757 raft_consensus.cc:1081] T e0ad84cc4e1942d99055ab43ea0bdac0 P 17d104ff42224d8c9cdf4c53a2152582 [term 1 LEADER]: Signalling peer 24479f93a03b4364837c81f7efbdf9d3 to start an election
I20260709 13:03:25.377948 10419 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e0ad84cc4e1942d99055ab43ea0bdac0"
dest_uuid: "24479f93a03b4364837c81f7efbdf9d3"
 from {username='slave'} at 127.0.0.1:33552
I20260709 13:03:25.378393 10419 raft_consensus.cc:493] T e0ad84cc4e1942d99055ab43ea0bdac0 P 24479f93a03b4364837c81f7efbdf9d3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:25.378654 10419 raft_consensus.cc:3060] T e0ad84cc4e1942d99055ab43ea0bdac0 P 24479f93a03b4364837c81f7efbdf9d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:25.383311 10419 raft_consensus.cc:515] T e0ad84cc4e1942d99055ab43ea0bdac0 P 24479f93a03b4364837c81f7efbdf9d3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:25.384883 10419 leader_election.cc:290] T e0ad84cc4e1942d99055ab43ea0bdac0 P 24479f93a03b4364837c81f7efbdf9d3 [CANDIDATE]: Term 2 election: Requested vote from peers 22139e7a5ea041588dd21a8d06ba1741 (127.0.107.193:45479), 17d104ff42224d8c9cdf4c53a2152582 (127.0.107.195:41601)
I20260709 13:03:25.385599 10695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0ad84cc4e1942d99055ab43ea0bdac0" candidate_uuid: "24479f93a03b4364837c81f7efbdf9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "22139e7a5ea041588dd21a8d06ba1741"
I20260709 13:03:25.385910 10495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0ad84cc4e1942d99055ab43ea0bdac0" candidate_uuid: "24479f93a03b4364837c81f7efbdf9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "17d104ff42224d8c9cdf4c53a2152582"
I20260709 13:03:25.386248 10695 raft_consensus.cc:3060] T e0ad84cc4e1942d99055ab43ea0bdac0 P 22139e7a5ea041588dd21a8d06ba1741 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:25.386494 10495 raft_consensus.cc:3055] T e0ad84cc4e1942d99055ab43ea0bdac0 P 17d104ff42224d8c9cdf4c53a2152582 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:25.386847 10495 raft_consensus.cc:740] T e0ad84cc4e1942d99055ab43ea0bdac0 P 17d104ff42224d8c9cdf4c53a2152582 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 17d104ff42224d8c9cdf4c53a2152582, State: Running, Role: LEADER
I20260709 13:03:25.387447 10495 consensus_queue.cc:260] T e0ad84cc4e1942d99055ab43ea0bdac0 P 17d104ff42224d8c9cdf4c53a2152582 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:25.388345 10495 raft_consensus.cc:3060] T e0ad84cc4e1942d99055ab43ea0bdac0 P 17d104ff42224d8c9cdf4c53a2152582 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:25.390977 10695 raft_consensus.cc:2468] T e0ad84cc4e1942d99055ab43ea0bdac0 P 22139e7a5ea041588dd21a8d06ba1741 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24479f93a03b4364837c81f7efbdf9d3 in term 2.
I20260709 13:03:25.391928 10384 leader_election.cc:304] T e0ad84cc4e1942d99055ab43ea0bdac0 P 24479f93a03b4364837c81f7efbdf9d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22139e7a5ea041588dd21a8d06ba1741, 24479f93a03b4364837c81f7efbdf9d3; no voters: 
I20260709 13:03:25.392536 10777 raft_consensus.cc:2804] T e0ad84cc4e1942d99055ab43ea0bdac0 P 24479f93a03b4364837c81f7efbdf9d3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:25.392704 10495 raft_consensus.cc:2468] T e0ad84cc4e1942d99055ab43ea0bdac0 P 17d104ff42224d8c9cdf4c53a2152582 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24479f93a03b4364837c81f7efbdf9d3 in term 2.
I20260709 13:03:25.392905 10777 raft_consensus.cc:697] T e0ad84cc4e1942d99055ab43ea0bdac0 P 24479f93a03b4364837c81f7efbdf9d3 [term 2 LEADER]: Becoming Leader. State: Replica: 24479f93a03b4364837c81f7efbdf9d3, State: Running, Role: LEADER
I20260709 13:03:25.394274 10777 consensus_queue.cc:237] T e0ad84cc4e1942d99055ab43ea0bdac0 P 24479f93a03b4364837c81f7efbdf9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:25.401075 10242 catalog_manager.cc:5697] T e0ad84cc4e1942d99055ab43ea0bdac0 P 24479f93a03b4364837c81f7efbdf9d3 reported cstate change: term changed from 1 to 2, leader changed from 17d104ff42224d8c9cdf4c53a2152582 (127.0.107.195) to 24479f93a03b4364837c81f7efbdf9d3 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "24479f93a03b4364837c81f7efbdf9d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:25.519393 10751 raft_consensus.cc:993] T afe8b130a0d1484e9f08fed8f6be2f61 P 24479f93a03b4364837c81f7efbdf9d3: : Instructing follower 17d104ff42224d8c9cdf4c53a2152582 to start an election
I20260709 13:03:25.519851 10777 raft_consensus.cc:1081] T afe8b130a0d1484e9f08fed8f6be2f61 P 24479f93a03b4364837c81f7efbdf9d3 [term 3 LEADER]: Signalling peer 17d104ff42224d8c9cdf4c53a2152582 to start an election
I20260709 13:03:25.521317 10495 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "afe8b130a0d1484e9f08fed8f6be2f61"
dest_uuid: "17d104ff42224d8c9cdf4c53a2152582"
 from {username='slave'} at 127.0.0.1:38496
I20260709 13:03:25.521760 10495 raft_consensus.cc:493] T afe8b130a0d1484e9f08fed8f6be2f61 P 17d104ff42224d8c9cdf4c53a2152582 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:25.522002 10495 raft_consensus.cc:3060] T afe8b130a0d1484e9f08fed8f6be2f61 P 17d104ff42224d8c9cdf4c53a2152582 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:25.528424 10495 raft_consensus.cc:515] T afe8b130a0d1484e9f08fed8f6be2f61 P 17d104ff42224d8c9cdf4c53a2152582 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:25.530123 10495 leader_election.cc:290] T afe8b130a0d1484e9f08fed8f6be2f61 P 17d104ff42224d8c9cdf4c53a2152582 [CANDIDATE]: Term 4 election: Requested vote from peers 22139e7a5ea041588dd21a8d06ba1741 (127.0.107.193:45479), 24479f93a03b4364837c81f7efbdf9d3 (127.0.107.194:44467)
I20260709 13:03:25.530771 10695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe8b130a0d1484e9f08fed8f6be2f61" candidate_uuid: "17d104ff42224d8c9cdf4c53a2152582" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "22139e7a5ea041588dd21a8d06ba1741"
I20260709 13:03:25.531381 10695 raft_consensus.cc:3060] T afe8b130a0d1484e9f08fed8f6be2f61 P 22139e7a5ea041588dd21a8d06ba1741 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:25.531479 10419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afe8b130a0d1484e9f08fed8f6be2f61" candidate_uuid: "17d104ff42224d8c9cdf4c53a2152582" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "24479f93a03b4364837c81f7efbdf9d3"
I20260709 13:03:25.532025 10419 raft_consensus.cc:3055] T afe8b130a0d1484e9f08fed8f6be2f61 P 24479f93a03b4364837c81f7efbdf9d3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:25.532251 10419 raft_consensus.cc:740] T afe8b130a0d1484e9f08fed8f6be2f61 P 24479f93a03b4364837c81f7efbdf9d3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 24479f93a03b4364837c81f7efbdf9d3, State: Running, Role: LEADER
I20260709 13:03:25.532799 10419 consensus_queue.cc:260] T afe8b130a0d1484e9f08fed8f6be2f61 P 24479f93a03b4364837c81f7efbdf9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:25.533649 10419 raft_consensus.cc:3060] T afe8b130a0d1484e9f08fed8f6be2f61 P 24479f93a03b4364837c81f7efbdf9d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:25.536068 10695 raft_consensus.cc:2468] T afe8b130a0d1484e9f08fed8f6be2f61 P 22139e7a5ea041588dd21a8d06ba1741 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17d104ff42224d8c9cdf4c53a2152582 in term 4.
I20260709 13:03:25.537103 10458 leader_election.cc:304] T afe8b130a0d1484e9f08fed8f6be2f61 P 17d104ff42224d8c9cdf4c53a2152582 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17d104ff42224d8c9cdf4c53a2152582, 22139e7a5ea041588dd21a8d06ba1741; no voters: 
I20260709 13:03:25.537772 10757 raft_consensus.cc:2804] T afe8b130a0d1484e9f08fed8f6be2f61 P 17d104ff42224d8c9cdf4c53a2152582 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:25.538249 10757 raft_consensus.cc:697] T afe8b130a0d1484e9f08fed8f6be2f61 P 17d104ff42224d8c9cdf4c53a2152582 [term 4 LEADER]: Becoming Leader. State: Replica: 17d104ff42224d8c9cdf4c53a2152582, State: Running, Role: LEADER
I20260709 13:03:25.538364 10419 raft_consensus.cc:2468] T afe8b130a0d1484e9f08fed8f6be2f61 P 24479f93a03b4364837c81f7efbdf9d3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17d104ff42224d8c9cdf4c53a2152582 in term 4.
I20260709 13:03:25.539139 10757 consensus_queue.cc:237] T afe8b130a0d1484e9f08fed8f6be2f61 P 17d104ff42224d8c9cdf4c53a2152582 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:25.545270 10242 catalog_manager.cc:5697] T afe8b130a0d1484e9f08fed8f6be2f61 P 17d104ff42224d8c9cdf4c53a2152582 reported cstate change: term changed from 3 to 4, leader changed from 24479f93a03b4364837c81f7efbdf9d3 (127.0.107.194) to 17d104ff42224d8c9cdf4c53a2152582 (127.0.107.195). New cstate: current_term: 4 leader_uuid: "17d104ff42224d8c9cdf4c53a2152582" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:25.672592 10495 raft_consensus.cc:1275] T 77c2a758545e45e29d62d8d71ea3f43d P 17d104ff42224d8c9cdf4c53a2152582 [term 5 FOLLOWER]: Refusing update from remote peer 24479f93a03b4364837c81f7efbdf9d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:03:25.673724 10777 consensus_queue.cc:1048] T 77c2a758545e45e29d62d8d71ea3f43d P 24479f93a03b4364837c81f7efbdf9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:25.685581 10695 raft_consensus.cc:1275] T 77c2a758545e45e29d62d8d71ea3f43d P 22139e7a5ea041588dd21a8d06ba1741 [term 5 FOLLOWER]: Refusing update from remote peer 24479f93a03b4364837c81f7efbdf9d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:03:25.686868 10581 consensus_queue.cc:1048] T 77c2a758545e45e29d62d8d71ea3f43d P 24479f93a03b4364837c81f7efbdf9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:03:25.784276 10292 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:03:25.809182 10695 raft_consensus.cc:1275] T e0ad84cc4e1942d99055ab43ea0bdac0 P 22139e7a5ea041588dd21a8d06ba1741 [term 2 FOLLOWER]: Refusing update from remote peer 24479f93a03b4364837c81f7efbdf9d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:25.810544 10581 consensus_queue.cc:1048] T e0ad84cc4e1942d99055ab43ea0bdac0 P 24479f93a03b4364837c81f7efbdf9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:25.818951 10495 raft_consensus.cc:1275] T e0ad84cc4e1942d99055ab43ea0bdac0 P 17d104ff42224d8c9cdf4c53a2152582 [term 2 FOLLOWER]: Refusing update from remote peer 24479f93a03b4364837c81f7efbdf9d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:25.820714 10777 consensus_queue.cc:1048] T e0ad84cc4e1942d99055ab43ea0bdac0 P 24479f93a03b4364837c81f7efbdf9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:26.028545 10695 raft_consensus.cc:1275] T afe8b130a0d1484e9f08fed8f6be2f61 P 22139e7a5ea041588dd21a8d06ba1741 [term 4 FOLLOWER]: Refusing update from remote peer 17d104ff42224d8c9cdf4c53a2152582: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:03:26.029693 10757 consensus_queue.cc:1048] T afe8b130a0d1484e9f08fed8f6be2f61 P 17d104ff42224d8c9cdf4c53a2152582 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:26.040483 10419 raft_consensus.cc:1275] T afe8b130a0d1484e9f08fed8f6be2f61 P 24479f93a03b4364837c81f7efbdf9d3 [term 4 FOLLOWER]: Refusing update from remote peer 17d104ff42224d8c9cdf4c53a2152582: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:03:26.043092 10735 consensus_queue.cc:1048] T afe8b130a0d1484e9f08fed8f6be2f61 P 17d104ff42224d8c9cdf4c53a2152582 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:26.096439   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:26.103880 10495 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4feb1aa9b1d14601b28b28a6d515ee65"
dest_uuid: "17d104ff42224d8c9cdf4c53a2152582"
mode: GRACEFUL
new_leader_uuid: "24479f93a03b4364837c81f7efbdf9d3"
 from {username='slave'} at 127.0.0.1:52156
I20260709 13:03:26.104352 10495 raft_consensus.cc:606] T 4feb1aa9b1d14601b28b28a6d515ee65 P 17d104ff42224d8c9cdf4c53a2152582 [term 3 LEADER]: Received request to transfer leadership to TS 24479f93a03b4364837c81f7efbdf9d3
I20260709 13:03:26.106865 10419 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "77c2a758545e45e29d62d8d71ea3f43d"
dest_uuid: "24479f93a03b4364837c81f7efbdf9d3"
mode: GRACEFUL
new_leader_uuid: "17d104ff42224d8c9cdf4c53a2152582"
 from {username='slave'} at 127.0.0.1:51992
I20260709 13:03:26.107357 10419 raft_consensus.cc:606] T 77c2a758545e45e29d62d8d71ea3f43d P 24479f93a03b4364837c81f7efbdf9d3 [term 5 LEADER]: Received request to transfer leadership to TS 17d104ff42224d8c9cdf4c53a2152582
I20260709 13:03:26.109764 10419 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e0ad84cc4e1942d99055ab43ea0bdac0"
dest_uuid: "24479f93a03b4364837c81f7efbdf9d3"
mode: GRACEFUL
new_leader_uuid: "17d104ff42224d8c9cdf4c53a2152582"
 from {username='slave'} at 127.0.0.1:51992
I20260709 13:03:26.110255 10419 raft_consensus.cc:606] T e0ad84cc4e1942d99055ab43ea0bdac0 P 24479f93a03b4364837c81f7efbdf9d3 [term 2 LEADER]: Received request to transfer leadership to TS 17d104ff42224d8c9cdf4c53a2152582
I20260709 13:03:26.111302   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:03:26.111758   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:26.112308   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:26.125061 10735 raft_consensus.cc:993] T 4feb1aa9b1d14601b28b28a6d515ee65 P 17d104ff42224d8c9cdf4c53a2152582: : Instructing follower 24479f93a03b4364837c81f7efbdf9d3 to start an election
I20260709 13:03:26.125663 10804 raft_consensus.cc:1081] T 4feb1aa9b1d14601b28b28a6d515ee65 P 17d104ff42224d8c9cdf4c53a2152582 [term 3 LEADER]: Signalling peer 24479f93a03b4364837c81f7efbdf9d3 to start an election
I20260709 13:03:26.127061 10419 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4feb1aa9b1d14601b28b28a6d515ee65"
dest_uuid: "24479f93a03b4364837c81f7efbdf9d3"
 from {username='slave'} at 127.0.0.1:33552
I20260709 13:03:26.127511 10419 raft_consensus.cc:493] T 4feb1aa9b1d14601b28b28a6d515ee65 P 24479f93a03b4364837c81f7efbdf9d3 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:26.127767 10419 raft_consensus.cc:3060] T 4feb1aa9b1d14601b28b28a6d515ee65 P 24479f93a03b4364837c81f7efbdf9d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:26.132139 10419 raft_consensus.cc:515] T 4feb1aa9b1d14601b28b28a6d515ee65 P 24479f93a03b4364837c81f7efbdf9d3 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:26.133551 10419 leader_election.cc:290] T 4feb1aa9b1d14601b28b28a6d515ee65 P 24479f93a03b4364837c81f7efbdf9d3 [CANDIDATE]: Term 4 election: Requested vote from peers 22139e7a5ea041588dd21a8d06ba1741 (127.0.107.193:45479), 17d104ff42224d8c9cdf4c53a2152582 (127.0.107.195:41601)
I20260709 13:03:26.134418 10695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4feb1aa9b1d14601b28b28a6d515ee65" candidate_uuid: "24479f93a03b4364837c81f7efbdf9d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "22139e7a5ea041588dd21a8d06ba1741"
I20260709 13:03:26.134536 10495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4feb1aa9b1d14601b28b28a6d515ee65" candidate_uuid: "24479f93a03b4364837c81f7efbdf9d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "17d104ff42224d8c9cdf4c53a2152582"
I20260709 13:03:26.134982 10695 raft_consensus.cc:3060] T 4feb1aa9b1d14601b28b28a6d515ee65 P 22139e7a5ea041588dd21a8d06ba1741 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:26.135076 10495 raft_consensus.cc:3055] T 4feb1aa9b1d14601b28b28a6d515ee65 P 17d104ff42224d8c9cdf4c53a2152582 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:26.135402 10495 raft_consensus.cc:740] T 4feb1aa9b1d14601b28b28a6d515ee65 P 17d104ff42224d8c9cdf4c53a2152582 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 17d104ff42224d8c9cdf4c53a2152582, State: Running, Role: LEADER
I20260709 13:03:26.135993 10495 consensus_queue.cc:260] T 4feb1aa9b1d14601b28b28a6d515ee65 P 17d104ff42224d8c9cdf4c53a2152582 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:26.136850 10495 raft_consensus.cc:3060] T 4feb1aa9b1d14601b28b28a6d515ee65 P 17d104ff42224d8c9cdf4c53a2152582 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:26.139649 10695 raft_consensus.cc:2468] T 4feb1aa9b1d14601b28b28a6d515ee65 P 22139e7a5ea041588dd21a8d06ba1741 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24479f93a03b4364837c81f7efbdf9d3 in term 4.
I20260709 13:03:26.140806 10384 leader_election.cc:304] T 4feb1aa9b1d14601b28b28a6d515ee65 P 24479f93a03b4364837c81f7efbdf9d3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22139e7a5ea041588dd21a8d06ba1741, 24479f93a03b4364837c81f7efbdf9d3; no voters: 
I20260709 13:03:26.141585 10777 raft_consensus.cc:2804] T 4feb1aa9b1d14601b28b28a6d515ee65 P 24479f93a03b4364837c81f7efbdf9d3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:26.141781 10495 raft_consensus.cc:2468] T 4feb1aa9b1d14601b28b28a6d515ee65 P 17d104ff42224d8c9cdf4c53a2152582 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24479f93a03b4364837c81f7efbdf9d3 in term 4.
I20260709 13:03:26.141968 10777 raft_consensus.cc:697] T 4feb1aa9b1d14601b28b28a6d515ee65 P 24479f93a03b4364837c81f7efbdf9d3 [term 4 LEADER]: Becoming Leader. State: Replica: 24479f93a03b4364837c81f7efbdf9d3, State: Running, Role: LEADER
I20260709 13:03:26.142904 10777 consensus_queue.cc:237] T 4feb1aa9b1d14601b28b28a6d515ee65 P 24479f93a03b4364837c81f7efbdf9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:26.150043 10241 catalog_manager.cc:5697] T 4feb1aa9b1d14601b28b28a6d515ee65 P 24479f93a03b4364837c81f7efbdf9d3 reported cstate change: term changed from 3 to 4, leader changed from 17d104ff42224d8c9cdf4c53a2152582 (127.0.107.195) to 24479f93a03b4364837c81f7efbdf9d3 (127.0.107.194). New cstate: current_term: 4 leader_uuid: "24479f93a03b4364837c81f7efbdf9d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:26.404896 10811 raft_consensus.cc:993] T e0ad84cc4e1942d99055ab43ea0bdac0 P 24479f93a03b4364837c81f7efbdf9d3: : Instructing follower 17d104ff42224d8c9cdf4c53a2152582 to start an election
I20260709 13:03:26.405390 10811 raft_consensus.cc:1081] T e0ad84cc4e1942d99055ab43ea0bdac0 P 24479f93a03b4364837c81f7efbdf9d3 [term 2 LEADER]: Signalling peer 17d104ff42224d8c9cdf4c53a2152582 to start an election
I20260709 13:03:26.406970 10495 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e0ad84cc4e1942d99055ab43ea0bdac0"
dest_uuid: "17d104ff42224d8c9cdf4c53a2152582"
 from {username='slave'} at 127.0.0.1:38496
I20260709 13:03:26.407527 10495 raft_consensus.cc:493] T e0ad84cc4e1942d99055ab43ea0bdac0 P 17d104ff42224d8c9cdf4c53a2152582 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:26.407866 10495 raft_consensus.cc:3060] T e0ad84cc4e1942d99055ab43ea0bdac0 P 17d104ff42224d8c9cdf4c53a2152582 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:26.503005 10495 raft_consensus.cc:515] T e0ad84cc4e1942d99055ab43ea0bdac0 P 17d104ff42224d8c9cdf4c53a2152582 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:26.506049 10695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0ad84cc4e1942d99055ab43ea0bdac0" candidate_uuid: "17d104ff42224d8c9cdf4c53a2152582" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "22139e7a5ea041588dd21a8d06ba1741"
I20260709 13:03:26.506433 10420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0ad84cc4e1942d99055ab43ea0bdac0" candidate_uuid: "17d104ff42224d8c9cdf4c53a2152582" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "24479f93a03b4364837c81f7efbdf9d3"
I20260709 13:03:26.506712 10695 raft_consensus.cc:3060] T e0ad84cc4e1942d99055ab43ea0bdac0 P 22139e7a5ea041588dd21a8d06ba1741 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:26.507144 10420 raft_consensus.cc:3055] T e0ad84cc4e1942d99055ab43ea0bdac0 P 24479f93a03b4364837c81f7efbdf9d3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:26.507470 10420 raft_consensus.cc:740] T e0ad84cc4e1942d99055ab43ea0bdac0 P 24479f93a03b4364837c81f7efbdf9d3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 24479f93a03b4364837c81f7efbdf9d3, State: Running, Role: LEADER
I20260709 13:03:26.508211 10420 consensus_queue.cc:260] T e0ad84cc4e1942d99055ab43ea0bdac0 P 24479f93a03b4364837c81f7efbdf9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:26.509611 10420 raft_consensus.cc:3060] T e0ad84cc4e1942d99055ab43ea0bdac0 P 24479f93a03b4364837c81f7efbdf9d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:26.515347 10695 raft_consensus.cc:2468] T e0ad84cc4e1942d99055ab43ea0bdac0 P 22139e7a5ea041588dd21a8d06ba1741 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17d104ff42224d8c9cdf4c53a2152582 in term 3.
I20260709 13:03:26.516484 10458 leader_election.cc:304] T e0ad84cc4e1942d99055ab43ea0bdac0 P 17d104ff42224d8c9cdf4c53a2152582 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17d104ff42224d8c9cdf4c53a2152582, 22139e7a5ea041588dd21a8d06ba1741; no voters: 
I20260709 13:03:26.517040 10420 raft_consensus.cc:2468] T e0ad84cc4e1942d99055ab43ea0bdac0 P 24479f93a03b4364837c81f7efbdf9d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17d104ff42224d8c9cdf4c53a2152582 in term 3.
I20260709 13:03:26.517210 10735 raft_consensus.cc:2804] T e0ad84cc4e1942d99055ab43ea0bdac0 P 17d104ff42224d8c9cdf4c53a2152582 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:26.517964 10735 raft_consensus.cc:697] T e0ad84cc4e1942d99055ab43ea0bdac0 P 17d104ff42224d8c9cdf4c53a2152582 [term 3 LEADER]: Becoming Leader. State: Replica: 17d104ff42224d8c9cdf4c53a2152582, State: Running, Role: LEADER
I20260709 13:03:26.518682 10735 consensus_queue.cc:237] T e0ad84cc4e1942d99055ab43ea0bdac0 P 17d104ff42224d8c9cdf4c53a2152582 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:26.523368 10495 leader_election.cc:290] T e0ad84cc4e1942d99055ab43ea0bdac0 P 17d104ff42224d8c9cdf4c53a2152582 [CANDIDATE]: Term 3 election: Requested vote from peers 22139e7a5ea041588dd21a8d06ba1741 (127.0.107.193:45479), 24479f93a03b4364837c81f7efbdf9d3 (127.0.107.194:44467)
I20260709 13:03:26.531528 10243 catalog_manager.cc:5697] T e0ad84cc4e1942d99055ab43ea0bdac0 P 17d104ff42224d8c9cdf4c53a2152582 reported cstate change: term changed from 2 to 3, leader changed from 24479f93a03b4364837c81f7efbdf9d3 (127.0.107.194) to 17d104ff42224d8c9cdf4c53a2152582 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "17d104ff42224d8c9cdf4c53a2152582" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:26.609094 10777 raft_consensus.cc:993] T 77c2a758545e45e29d62d8d71ea3f43d P 24479f93a03b4364837c81f7efbdf9d3: : Instructing follower 17d104ff42224d8c9cdf4c53a2152582 to start an election
I20260709 13:03:26.609532 10777 raft_consensus.cc:1081] T 77c2a758545e45e29d62d8d71ea3f43d P 24479f93a03b4364837c81f7efbdf9d3 [term 5 LEADER]: Signalling peer 17d104ff42224d8c9cdf4c53a2152582 to start an election
I20260709 13:03:26.611002 10495 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "77c2a758545e45e29d62d8d71ea3f43d"
dest_uuid: "17d104ff42224d8c9cdf4c53a2152582"
 from {username='slave'} at 127.0.0.1:38496
I20260709 13:03:26.611474 10495 raft_consensus.cc:493] T 77c2a758545e45e29d62d8d71ea3f43d P 17d104ff42224d8c9cdf4c53a2152582 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:26.611744 10495 raft_consensus.cc:3060] T 77c2a758545e45e29d62d8d71ea3f43d P 17d104ff42224d8c9cdf4c53a2152582 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:26.616168 10495 raft_consensus.cc:515] T 77c2a758545e45e29d62d8d71ea3f43d P 17d104ff42224d8c9cdf4c53a2152582 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:26.617762 10495 leader_election.cc:290] T 77c2a758545e45e29d62d8d71ea3f43d P 17d104ff42224d8c9cdf4c53a2152582 [CANDIDATE]: Term 6 election: Requested vote from peers 22139e7a5ea041588dd21a8d06ba1741 (127.0.107.193:45479), 24479f93a03b4364837c81f7efbdf9d3 (127.0.107.194:44467)
I20260709 13:03:26.618491 10695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77c2a758545e45e29d62d8d71ea3f43d" candidate_uuid: "17d104ff42224d8c9cdf4c53a2152582" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: true dest_uuid: "22139e7a5ea041588dd21a8d06ba1741"
I20260709 13:03:26.618687 10420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77c2a758545e45e29d62d8d71ea3f43d" candidate_uuid: "17d104ff42224d8c9cdf4c53a2152582" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: true dest_uuid: "24479f93a03b4364837c81f7efbdf9d3"
I20260709 13:03:26.619168 10695 raft_consensus.cc:3060] T 77c2a758545e45e29d62d8d71ea3f43d P 22139e7a5ea041588dd21a8d06ba1741 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:26.619251 10420 raft_consensus.cc:3055] T 77c2a758545e45e29d62d8d71ea3f43d P 24479f93a03b4364837c81f7efbdf9d3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:26.619577 10420 raft_consensus.cc:740] T 77c2a758545e45e29d62d8d71ea3f43d P 24479f93a03b4364837c81f7efbdf9d3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 24479f93a03b4364837c81f7efbdf9d3, State: Running, Role: LEADER
I20260709 13:03:26.620173 10420 consensus_queue.cc:260] T 77c2a758545e45e29d62d8d71ea3f43d P 24479f93a03b4364837c81f7efbdf9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:26.621011 10420 raft_consensus.cc:3060] T 77c2a758545e45e29d62d8d71ea3f43d P 24479f93a03b4364837c81f7efbdf9d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:26.623606 10695 raft_consensus.cc:2468] T 77c2a758545e45e29d62d8d71ea3f43d P 22139e7a5ea041588dd21a8d06ba1741 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17d104ff42224d8c9cdf4c53a2152582 in term 6.
I20260709 13:03:26.624625 10458 leader_election.cc:304] T 77c2a758545e45e29d62d8d71ea3f43d P 17d104ff42224d8c9cdf4c53a2152582 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17d104ff42224d8c9cdf4c53a2152582, 22139e7a5ea041588dd21a8d06ba1741; no voters: 
I20260709 13:03:26.625355 10735 raft_consensus.cc:2804] T 77c2a758545e45e29d62d8d71ea3f43d P 17d104ff42224d8c9cdf4c53a2152582 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:26.625564 10420 raft_consensus.cc:2468] T 77c2a758545e45e29d62d8d71ea3f43d P 24479f93a03b4364837c81f7efbdf9d3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17d104ff42224d8c9cdf4c53a2152582 in term 6.
I20260709 13:03:26.625733 10735 raft_consensus.cc:697] T 77c2a758545e45e29d62d8d71ea3f43d P 17d104ff42224d8c9cdf4c53a2152582 [term 6 LEADER]: Becoming Leader. State: Replica: 17d104ff42224d8c9cdf4c53a2152582, State: Running, Role: LEADER
I20260709 13:03:26.626624 10735 consensus_queue.cc:237] T 77c2a758545e45e29d62d8d71ea3f43d P 17d104ff42224d8c9cdf4c53a2152582 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } }
I20260709 13:03:26.633028 10695 raft_consensus.cc:1275] T 4feb1aa9b1d14601b28b28a6d515ee65 P 22139e7a5ea041588dd21a8d06ba1741 [term 4 FOLLOWER]: Refusing update from remote peer 24479f93a03b4364837c81f7efbdf9d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:03:26.633549 10243 catalog_manager.cc:5697] T 77c2a758545e45e29d62d8d71ea3f43d P 17d104ff42224d8c9cdf4c53a2152582 reported cstate change: term changed from 5 to 6, leader changed from 24479f93a03b4364837c81f7efbdf9d3 (127.0.107.194) to 17d104ff42224d8c9cdf4c53a2152582 (127.0.107.195). New cstate: current_term: 6 leader_uuid: "17d104ff42224d8c9cdf4c53a2152582" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:26.634546 10777 consensus_queue.cc:1048] T 4feb1aa9b1d14601b28b28a6d515ee65 P 24479f93a03b4364837c81f7efbdf9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:26.645093 10495 raft_consensus.cc:1275] T 4feb1aa9b1d14601b28b28a6d515ee65 P 17d104ff42224d8c9cdf4c53a2152582 [term 4 FOLLOWER]: Refusing update from remote peer 24479f93a03b4364837c81f7efbdf9d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:03:26.646579 10751 consensus_queue.cc:1048] T 4feb1aa9b1d14601b28b28a6d515ee65 P 24479f93a03b4364837c81f7efbdf9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17d104ff42224d8c9cdf4c53a2152582" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:03:26.785295 10292 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:03:26.938311 10420 raft_consensus.cc:1275] T e0ad84cc4e1942d99055ab43ea0bdac0 P 24479f93a03b4364837c81f7efbdf9d3 [term 3 FOLLOWER]: Refusing update from remote peer 17d104ff42224d8c9cdf4c53a2152582: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:26.939460 10804 consensus_queue.cc:1048] T e0ad84cc4e1942d99055ab43ea0bdac0 P 17d104ff42224d8c9cdf4c53a2152582 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:26.949671 10695 raft_consensus.cc:1275] T e0ad84cc4e1942d99055ab43ea0bdac0 P 22139e7a5ea041588dd21a8d06ba1741 [term 3 FOLLOWER]: Refusing update from remote peer 17d104ff42224d8c9cdf4c53a2152582: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:26.950791 10804 consensus_queue.cc:1048] T e0ad84cc4e1942d99055ab43ea0bdac0 P 17d104ff42224d8c9cdf4c53a2152582 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:27.017519 10420 raft_consensus.cc:1275] T 77c2a758545e45e29d62d8d71ea3f43d P 24479f93a03b4364837c81f7efbdf9d3 [term 6 FOLLOWER]: Refusing update from remote peer 17d104ff42224d8c9cdf4c53a2152582: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:03:27.018936 10804 consensus_queue.cc:1048] T 77c2a758545e45e29d62d8d71ea3f43d P 17d104ff42224d8c9cdf4c53a2152582 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24479f93a03b4364837c81f7efbdf9d3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:27.027549 10695 raft_consensus.cc:1275] T 77c2a758545e45e29d62d8d71ea3f43d P 22139e7a5ea041588dd21a8d06ba1741 [term 6 FOLLOWER]: Refusing update from remote peer 17d104ff42224d8c9cdf4c53a2152582: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:03:27.029014 10804 consensus_queue.cc:1048] T 77c2a758545e45e29d62d8d71ea3f43d P 17d104ff42224d8c9cdf4c53a2152582 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22139e7a5ea041588dd21a8d06ba1741" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:27.223052   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:27.260842   431 tablet_server.cc:179] TabletServer@127.0.107.193:45479 shutting down...
I20260709 13:03:27.283725   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:27.284395   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:27.284986   431 raft_consensus.cc:2243] T 77c2a758545e45e29d62d8d71ea3f43d P 22139e7a5ea041588dd21a8d06ba1741 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:27.285470   431 raft_consensus.cc:2272] T 77c2a758545e45e29d62d8d71ea3f43d P 22139e7a5ea041588dd21a8d06ba1741 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:27.287818   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:27.288363   431 raft_consensus.cc:2243] T e0ad84cc4e1942d99055ab43ea0bdac0 P 22139e7a5ea041588dd21a8d06ba1741 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:27.288784   431 raft_consensus.cc:2272] T e0ad84cc4e1942d99055ab43ea0bdac0 P 22139e7a5ea041588dd21a8d06ba1741 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:27.291092   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:27.291646   431 raft_consensus.cc:2243] T 4feb1aa9b1d14601b28b28a6d515ee65 P 22139e7a5ea041588dd21a8d06ba1741 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:27.292073   431 raft_consensus.cc:2272] T 4feb1aa9b1d14601b28b28a6d515ee65 P 22139e7a5ea041588dd21a8d06ba1741 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:27.294252   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:27.294831   431 raft_consensus.cc:2243] T 2df7bfe151e349f1a30cd3142e13c021 P 22139e7a5ea041588dd21a8d06ba1741 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:27.295244   431 raft_consensus.cc:2272] T 2df7bfe151e349f1a30cd3142e13c021 P 22139e7a5ea041588dd21a8d06ba1741 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:27.297022   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:27.297547   431 raft_consensus.cc:2243] T 1484bae8a7264a0e9f328dd5ce7edad8 P 22139e7a5ea041588dd21a8d06ba1741 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:27.297924   431 raft_consensus.cc:2272] T 1484bae8a7264a0e9f328dd5ce7edad8 P 22139e7a5ea041588dd21a8d06ba1741 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:27.299811   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:27.300277   431 raft_consensus.cc:2243] T a848edc7d33e48a1a475daf70fb66449 P 22139e7a5ea041588dd21a8d06ba1741 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:27.300639   431 raft_consensus.cc:2272] T a848edc7d33e48a1a475daf70fb66449 P 22139e7a5ea041588dd21a8d06ba1741 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:27.302351   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:27.302857   431 raft_consensus.cc:2243] T 19c2daa20bbe47afa5289e2b32987709 P 22139e7a5ea041588dd21a8d06ba1741 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:27.303244   431 raft_consensus.cc:2272] T 19c2daa20bbe47afa5289e2b32987709 P 22139e7a5ea041588dd21a8d06ba1741 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:27.304979   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:27.305429   431 raft_consensus.cc:2243] T 89649f4e196f44a3b3b98fa009c228f8 P 22139e7a5ea041588dd21a8d06ba1741 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:27.305799   431 raft_consensus.cc:2272] T 89649f4e196f44a3b3b98fa009c228f8 P 22139e7a5ea041588dd21a8d06ba1741 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:27.307600   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:27.308074   431 raft_consensus.cc:2243] T afe8b130a0d1484e9f08fed8f6be2f61 P 22139e7a5ea041588dd21a8d06ba1741 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:27.308472   431 raft_consensus.cc:2272] T afe8b130a0d1484e9f08fed8f6be2f61 P 22139e7a5ea041588dd21a8d06ba1741 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:27.310262   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:27.310710   431 raft_consensus.cc:2243] T b038dccd00b44161b10a08f5b963dd45 P 22139e7a5ea041588dd21a8d06ba1741 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:27.311079   431 raft_consensus.cc:2272] T b038dccd00b44161b10a08f5b963dd45 P 22139e7a5ea041588dd21a8d06ba1741 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:27.339594   431 tablet_server.cc:196] TabletServer@127.0.107.193:45479 shutdown complete.
W20260709 13:03:27.345237 10516 debug-util.cc:398] Leaking SignalData structure 0x7b08002df3a0 after lost signal to thread 434
W20260709 13:03:27.346225 10516 debug-util.cc:398] Leaking SignalData structure 0x7b08002a2060 after lost signal to thread 10278
W20260709 13:03:27.347429 10516 debug-util.cc:398] Leaking SignalData structure 0x7b08000d34a0 after lost signal to thread 10445
W20260709 13:03:27.348333 10516 debug-util.cc:398] Leaking SignalData structure 0x7b08000daf20 after lost signal to thread 10519
I20260709 13:03:27.358691   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
W20260709 13:03:27.363333 10458 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45479: connect: Connection refused (error 111) [suppressed 81 similar messages]
W20260709 13:03:27.368332 10458 consensus_peers.cc:597] T 2df7bfe151e349f1a30cd3142e13c021 P 17d104ff42224d8c9cdf4c53a2152582 -> Peer 22139e7a5ea041588dd21a8d06ba1741 (127.0.107.193:45479): Couldn't send request to peer 22139e7a5ea041588dd21a8d06ba1741. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45479: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:27.388307   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:27.389191   431 tablet_replica.cc:333] T 4feb1aa9b1d14601b28b28a6d515ee65 P 24479f93a03b4364837c81f7efbdf9d3: stopping tablet replica
I20260709 13:03:27.390085   431 raft_consensus.cc:2243] T 4feb1aa9b1d14601b28b28a6d515ee65 P 24479f93a03b4364837c81f7efbdf9d3 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:03:27.391111   431 raft_consensus.cc:2272] T 4feb1aa9b1d14601b28b28a6d515ee65 P 24479f93a03b4364837c81f7efbdf9d3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:27.394469   431 tablet_replica.cc:333] T b038dccd00b44161b10a08f5b963dd45 P 24479f93a03b4364837c81f7efbdf9d3: stopping tablet replica
I20260709 13:03:27.395413   431 raft_consensus.cc:2243] T b038dccd00b44161b10a08f5b963dd45 P 24479f93a03b4364837c81f7efbdf9d3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:27.396509   431 raft_consensus.cc:2272] T b038dccd00b44161b10a08f5b963dd45 P 24479f93a03b4364837c81f7efbdf9d3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:27.400169   431 tablet_replica.cc:333] T 19c2daa20bbe47afa5289e2b32987709 P 24479f93a03b4364837c81f7efbdf9d3: stopping tablet replica
I20260709 13:03:27.400851   431 raft_consensus.cc:2243] T 19c2daa20bbe47afa5289e2b32987709 P 24479f93a03b4364837c81f7efbdf9d3 [term 3 LEADER]: Raft consensus shutting down.
W20260709 13:03:27.401643 10459 consensus_peers.cc:597] T e0ad84cc4e1942d99055ab43ea0bdac0 P 17d104ff42224d8c9cdf4c53a2152582 -> Peer 24479f93a03b4364837c81f7efbdf9d3 (127.0.107.194:44467): Couldn't send request to peer 24479f93a03b4364837c81f7efbdf9d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:27.401844   431 raft_consensus.cc:2272] T 19c2daa20bbe47afa5289e2b32987709 P 24479f93a03b4364837c81f7efbdf9d3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:27.404924   431 tablet_replica.cc:333] T 89649f4e196f44a3b3b98fa009c228f8 P 24479f93a03b4364837c81f7efbdf9d3: stopping tablet replica
W20260709 13:03:27.405181 10459 consensus_peers.cc:597] T 77c2a758545e45e29d62d8d71ea3f43d P 17d104ff42224d8c9cdf4c53a2152582 -> Peer 24479f93a03b4364837c81f7efbdf9d3 (127.0.107.194:44467): Couldn't send request to peer 24479f93a03b4364837c81f7efbdf9d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:27.405813   431 raft_consensus.cc:2243] T 89649f4e196f44a3b3b98fa009c228f8 P 24479f93a03b4364837c81f7efbdf9d3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:27.406332   431 raft_consensus.cc:2272] T 89649f4e196f44a3b3b98fa009c228f8 P 24479f93a03b4364837c81f7efbdf9d3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:27.408728   431 tablet_replica.cc:333] T afe8b130a0d1484e9f08fed8f6be2f61 P 24479f93a03b4364837c81f7efbdf9d3: stopping tablet replica
I20260709 13:03:27.409261   431 raft_consensus.cc:2243] T afe8b130a0d1484e9f08fed8f6be2f61 P 24479f93a03b4364837c81f7efbdf9d3 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:27.409657   431 raft_consensus.cc:2272] T afe8b130a0d1484e9f08fed8f6be2f61 P 24479f93a03b4364837c81f7efbdf9d3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:27.412088   431 tablet_replica.cc:333] T a848edc7d33e48a1a475daf70fb66449 P 24479f93a03b4364837c81f7efbdf9d3: stopping tablet replica
I20260709 13:03:27.412732   431 raft_consensus.cc:2243] T a848edc7d33e48a1a475daf70fb66449 P 24479f93a03b4364837c81f7efbdf9d3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:27.413482   431 raft_consensus.cc:2272] T a848edc7d33e48a1a475daf70fb66449 P 24479f93a03b4364837c81f7efbdf9d3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:27.415827   431 tablet_replica.cc:333] T 2df7bfe151e349f1a30cd3142e13c021 P 24479f93a03b4364837c81f7efbdf9d3: stopping tablet replica
I20260709 13:03:27.416395   431 raft_consensus.cc:2243] T 2df7bfe151e349f1a30cd3142e13c021 P 24479f93a03b4364837c81f7efbdf9d3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:27.416790   431 raft_consensus.cc:2272] T 2df7bfe151e349f1a30cd3142e13c021 P 24479f93a03b4364837c81f7efbdf9d3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:27.419075   431 tablet_replica.cc:333] T 77c2a758545e45e29d62d8d71ea3f43d P 24479f93a03b4364837c81f7efbdf9d3: stopping tablet replica
I20260709 13:03:27.419544   431 raft_consensus.cc:2243] T 77c2a758545e45e29d62d8d71ea3f43d P 24479f93a03b4364837c81f7efbdf9d3 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:27.419937   431 raft_consensus.cc:2272] T 77c2a758545e45e29d62d8d71ea3f43d P 24479f93a03b4364837c81f7efbdf9d3 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:27.422643   431 tablet_replica.cc:333] T 1484bae8a7264a0e9f328dd5ce7edad8 P 24479f93a03b4364837c81f7efbdf9d3: stopping tablet replica
I20260709 13:03:27.423252   431 raft_consensus.cc:2243] T 1484bae8a7264a0e9f328dd5ce7edad8 P 24479f93a03b4364837c81f7efbdf9d3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:27.423658   431 raft_consensus.cc:2272] T 1484bae8a7264a0e9f328dd5ce7edad8 P 24479f93a03b4364837c81f7efbdf9d3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:27.425689   431 tablet_replica.cc:333] T e0ad84cc4e1942d99055ab43ea0bdac0 P 24479f93a03b4364837c81f7efbdf9d3: stopping tablet replica
I20260709 13:03:27.426167   431 raft_consensus.cc:2243] T e0ad84cc4e1942d99055ab43ea0bdac0 P 24479f93a03b4364837c81f7efbdf9d3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:27.426559   431 raft_consensus.cc:2272] T e0ad84cc4e1942d99055ab43ea0bdac0 P 24479f93a03b4364837c81f7efbdf9d3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:27.452980   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
W20260709 13:03:27.453117 10458 consensus_peers.cc:597] T 89649f4e196f44a3b3b98fa009c228f8 P 17d104ff42224d8c9cdf4c53a2152582 -> Peer 22139e7a5ea041588dd21a8d06ba1741 (127.0.107.193:45479): Couldn't send request to peer 22139e7a5ea041588dd21a8d06ba1741. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45479: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:27.483317   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
W20260709 13:03:27.487298 10458 consensus_peers.cc:597] T e0ad84cc4e1942d99055ab43ea0bdac0 P 17d104ff42224d8c9cdf4c53a2152582 -> Peer 22139e7a5ea041588dd21a8d06ba1741 (127.0.107.193:45479): Couldn't send request to peer 22139e7a5ea041588dd21a8d06ba1741. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45479: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:27.520823   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:27.521678   431 tablet_replica.cc:333] T 1484bae8a7264a0e9f328dd5ce7edad8 P 17d104ff42224d8c9cdf4c53a2152582: stopping tablet replica
I20260709 13:03:27.522497   431 raft_consensus.cc:2243] T 1484bae8a7264a0e9f328dd5ce7edad8 P 17d104ff42224d8c9cdf4c53a2152582 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:27.523345   431 raft_consensus.cc:2272] T 1484bae8a7264a0e9f328dd5ce7edad8 P 17d104ff42224d8c9cdf4c53a2152582 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:27.525956   431 tablet_replica.cc:333] T 4feb1aa9b1d14601b28b28a6d515ee65 P 17d104ff42224d8c9cdf4c53a2152582: stopping tablet replica
I20260709 13:03:27.526778   431 raft_consensus.cc:2243] T 4feb1aa9b1d14601b28b28a6d515ee65 P 17d104ff42224d8c9cdf4c53a2152582 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:27.527416   431 raft_consensus.cc:2272] T 4feb1aa9b1d14601b28b28a6d515ee65 P 17d104ff42224d8c9cdf4c53a2152582 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:27.530889   431 tablet_replica.cc:333] T b038dccd00b44161b10a08f5b963dd45 P 17d104ff42224d8c9cdf4c53a2152582: stopping tablet replica
I20260709 13:03:27.531690   431 raft_consensus.cc:2243] T b038dccd00b44161b10a08f5b963dd45 P 17d104ff42224d8c9cdf4c53a2152582 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:27.532341   431 raft_consensus.cc:2272] T b038dccd00b44161b10a08f5b963dd45 P 17d104ff42224d8c9cdf4c53a2152582 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:27.535589   431 tablet_replica.cc:333] T afe8b130a0d1484e9f08fed8f6be2f61 P 17d104ff42224d8c9cdf4c53a2152582: stopping tablet replica
I20260709 13:03:27.536302   431 raft_consensus.cc:2243] T afe8b130a0d1484e9f08fed8f6be2f61 P 17d104ff42224d8c9cdf4c53a2152582 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:03:27.537325   431 raft_consensus.cc:2272] T afe8b130a0d1484e9f08fed8f6be2f61 P 17d104ff42224d8c9cdf4c53a2152582 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:27.540436   431 tablet_replica.cc:333] T 19c2daa20bbe47afa5289e2b32987709 P 17d104ff42224d8c9cdf4c53a2152582: stopping tablet replica
I20260709 13:03:27.541181   431 raft_consensus.cc:2243] T 19c2daa20bbe47afa5289e2b32987709 P 17d104ff42224d8c9cdf4c53a2152582 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:27.541711   431 raft_consensus.cc:2272] T 19c2daa20bbe47afa5289e2b32987709 P 17d104ff42224d8c9cdf4c53a2152582 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:27.544667   431 tablet_replica.cc:333] T 89649f4e196f44a3b3b98fa009c228f8 P 17d104ff42224d8c9cdf4c53a2152582: stopping tablet replica
I20260709 13:03:27.545400   431 raft_consensus.cc:2243] T 89649f4e196f44a3b3b98fa009c228f8 P 17d104ff42224d8c9cdf4c53a2152582 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:27.546381   431 raft_consensus.cc:2272] T 89649f4e196f44a3b3b98fa009c228f8 P 17d104ff42224d8c9cdf4c53a2152582 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:27.549517   431 tablet_replica.cc:333] T 2df7bfe151e349f1a30cd3142e13c021 P 17d104ff42224d8c9cdf4c53a2152582: stopping tablet replica
I20260709 13:03:27.550274   431 raft_consensus.cc:2243] T 2df7bfe151e349f1a30cd3142e13c021 P 17d104ff42224d8c9cdf4c53a2152582 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:27.551319   431 raft_consensus.cc:2272] T 2df7bfe151e349f1a30cd3142e13c021 P 17d104ff42224d8c9cdf4c53a2152582 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:27.554271   431 tablet_replica.cc:333] T 77c2a758545e45e29d62d8d71ea3f43d P 17d104ff42224d8c9cdf4c53a2152582: stopping tablet replica
I20260709 13:03:27.555006   431 raft_consensus.cc:2243] T 77c2a758545e45e29d62d8d71ea3f43d P 17d104ff42224d8c9cdf4c53a2152582 [term 6 LEADER]: Raft consensus shutting down.
I20260709 13:03:27.556140   431 raft_consensus.cc:2272] T 77c2a758545e45e29d62d8d71ea3f43d P 17d104ff42224d8c9cdf4c53a2152582 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:27.559629   431 tablet_replica.cc:333] T e0ad84cc4e1942d99055ab43ea0bdac0 P 17d104ff42224d8c9cdf4c53a2152582: stopping tablet replica
I20260709 13:03:27.560375   431 raft_consensus.cc:2243] T e0ad84cc4e1942d99055ab43ea0bdac0 P 17d104ff42224d8c9cdf4c53a2152582 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:03:27.561437   431 raft_consensus.cc:2272] T e0ad84cc4e1942d99055ab43ea0bdac0 P 17d104ff42224d8c9cdf4c53a2152582 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:27.564849   431 tablet_replica.cc:333] T a848edc7d33e48a1a475daf70fb66449 P 17d104ff42224d8c9cdf4c53a2152582: stopping tablet replica
I20260709 13:03:27.565515   431 raft_consensus.cc:2243] T a848edc7d33e48a1a475daf70fb66449 P 17d104ff42224d8c9cdf4c53a2152582 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:27.566030   431 raft_consensus.cc:2272] T a848edc7d33e48a1a475daf70fb66449 P 17d104ff42224d8c9cdf4c53a2152582 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:27.786425 10292 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:03:28.604552   431 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 10516)
W20260709 13:03:28.787732 10292 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:03:29.605082   431 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 10516)
W20260709 13:03:29.788805 10292 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:03:30.173725   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 13:03:30.196272   431 master.cc:562] Master@127.0.107.254:38331 shutting down...
I20260709 13:03:30.220548   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 5fb71e9cf392414c99288eb79ceb7e70 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:30.221087   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 5fb71e9cf392414c99288eb79ceb7e70 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:30.221426   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P 5fb71e9cf392414c99288eb79ceb7e70: stopping tablet replica
I20260709 13:03:30.241678   431 master.cc:584] Master@127.0.107.254:38331 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (15638 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 13:03:30.284250   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:41103
I20260709 13:03:30.285338   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:30.290454 10829 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:30.290588 10830 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:30.291657 10832 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:30.293061   431 server_base.cc:1061] running on GCE node
I20260709 13:03:30.294010   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:30.294183   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:30.294323   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602210294309 us; error 0 us; skew 500 ppm
I20260709 13:03:30.294942   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:30.297441   431 webserver.cc:533] Webserver started at http://127.0.107.254:41529/ using document root <none> and password file <none>
I20260709 13:03:30.297978   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:30.298151   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:30.298410   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:30.299575   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601891739070-431-0/minicluster-data/master-0-root/instance:
uuid: "6fec3f62b0f14202a0098089a0d182d9"
format_stamp: "Formatted at 2026-07-09 13:03:30 on dist-test-slave-qzg2"
I20260709 13:03:30.303942   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:03:30.307214 10837 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:30.307904   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:03:30.308163   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601891739070-431-0/minicluster-data/master-0-root
uuid: "6fec3f62b0f14202a0098089a0d182d9"
format_stamp: "Formatted at 2026-07-09 13:03:30 on dist-test-slave-qzg2"
I20260709 13:03:30.308442   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601891739070-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601891739070-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601891739070-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:30.328866   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:30.330109   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:30.366519   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:41103
I20260709 13:03:30.366626 10888 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:41103 every 8 connection(s)
I20260709 13:03:30.370194 10889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:30.381222 10889 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6fec3f62b0f14202a0098089a0d182d9: Bootstrap starting.
I20260709 13:03:30.386011 10889 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6fec3f62b0f14202a0098089a0d182d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:30.390180 10889 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6fec3f62b0f14202a0098089a0d182d9: No bootstrap required, opened a new log
I20260709 13:03:30.392369 10889 raft_consensus.cc:359] T 00000000000000000000000000000000 P 6fec3f62b0f14202a0098089a0d182d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6fec3f62b0f14202a0098089a0d182d9" member_type: VOTER }
I20260709 13:03:30.392769 10889 raft_consensus.cc:385] T 00000000000000000000000000000000 P 6fec3f62b0f14202a0098089a0d182d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:30.392958 10889 raft_consensus.cc:740] T 00000000000000000000000000000000 P 6fec3f62b0f14202a0098089a0d182d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fec3f62b0f14202a0098089a0d182d9, State: Initialized, Role: FOLLOWER
I20260709 13:03:30.393519 10889 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6fec3f62b0f14202a0098089a0d182d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6fec3f62b0f14202a0098089a0d182d9" member_type: VOTER }
I20260709 13:03:30.393970 10889 raft_consensus.cc:399] T 00000000000000000000000000000000 P 6fec3f62b0f14202a0098089a0d182d9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:03:30.394160 10889 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6fec3f62b0f14202a0098089a0d182d9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:03:30.394374 10889 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6fec3f62b0f14202a0098089a0d182d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:30.399096 10889 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6fec3f62b0f14202a0098089a0d182d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6fec3f62b0f14202a0098089a0d182d9" member_type: VOTER }
I20260709 13:03:30.399605 10889 leader_election.cc:304] T 00000000000000000000000000000000 P 6fec3f62b0f14202a0098089a0d182d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6fec3f62b0f14202a0098089a0d182d9; no voters: 
I20260709 13:03:30.400758 10889 leader_election.cc:290] T 00000000000000000000000000000000 P 6fec3f62b0f14202a0098089a0d182d9 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:03:30.401073 10892 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 6fec3f62b0f14202a0098089a0d182d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:30.402379 10892 raft_consensus.cc:697] T 00000000000000000000000000000000 P 6fec3f62b0f14202a0098089a0d182d9 [term 1 LEADER]: Becoming Leader. State: Replica: 6fec3f62b0f14202a0098089a0d182d9, State: Running, Role: LEADER
I20260709 13:03:30.403074 10892 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6fec3f62b0f14202a0098089a0d182d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6fec3f62b0f14202a0098089a0d182d9" member_type: VOTER }
I20260709 13:03:30.403601 10889 sys_catalog.cc:565] T 00000000000000000000000000000000 P 6fec3f62b0f14202a0098089a0d182d9 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:03:30.407286 10893 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6fec3f62b0f14202a0098089a0d182d9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6fec3f62b0f14202a0098089a0d182d9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6fec3f62b0f14202a0098089a0d182d9" member_type: VOTER } }
I20260709 13:03:30.407621 10894 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6fec3f62b0f14202a0098089a0d182d9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6fec3f62b0f14202a0098089a0d182d9. Latest consensus state: current_term: 1 leader_uuid: "6fec3f62b0f14202a0098089a0d182d9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6fec3f62b0f14202a0098089a0d182d9" member_type: VOTER } }
I20260709 13:03:30.408160 10893 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6fec3f62b0f14202a0098089a0d182d9 [sys.catalog]: This master's current role is: LEADER
I20260709 13:03:30.408324 10894 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6fec3f62b0f14202a0098089a0d182d9 [sys.catalog]: This master's current role is: LEADER
I20260709 13:03:30.411677 10898 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:03:30.416440 10898 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:03:30.420212   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:03:30.425379 10898 catalog_manager.cc:1383] Generated new cluster ID: 6b264d2d83c045458f39e2536434b2df
I20260709 13:03:30.425642 10898 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:03:30.442902 10898 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:03:30.444151 10898 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:03:30.455981 10898 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 6fec3f62b0f14202a0098089a0d182d9: Generated new TSK 0
I20260709 13:03:30.456550 10898 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:03:30.487205   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:30.493077 10910 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:30.494150 10911 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:30.495187 10913 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:30.495873   431 server_base.cc:1061] running on GCE node
I20260709 13:03:30.496802   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:30.496989   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:30.497118   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602210497106 us; error 0 us; skew 500 ppm
I20260709 13:03:30.497614   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:30.499938   431 webserver.cc:533] Webserver started at http://127.0.107.193:33565/ using document root <none> and password file <none>
I20260709 13:03:30.500381   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:30.500535   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:30.500747   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:30.501816   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601891739070-431-0/minicluster-data/ts-0-root/instance:
uuid: "2fb048a7b080470d87c5c78bbafbe833"
format_stamp: "Formatted at 2026-07-09 13:03:30 on dist-test-slave-qzg2"
I20260709 13:03:30.506464   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:03:30.509922 10918 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:30.510715   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:03:30.510993   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601891739070-431-0/minicluster-data/ts-0-root
uuid: "2fb048a7b080470d87c5c78bbafbe833"
format_stamp: "Formatted at 2026-07-09 13:03:30 on dist-test-slave-qzg2"
I20260709 13:03:30.511264   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601891739070-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601891739070-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601891739070-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:30.523963   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:30.525139   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:30.526608   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:30.528877   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:03:30.529068   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:30.529304   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:03:30.529452   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:30.569589   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:33871
I20260709 13:03:30.569718 10980 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:33871 every 8 connection(s)
I20260709 13:03:30.574445   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:30.581063 10985 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:30.582479 10986 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:30.586447 10988 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:30.587160 10981 heartbeater.cc:344] Connected to a master server at 127.0.107.254:41103
I20260709 13:03:30.587414   431 server_base.cc:1061] running on GCE node
I20260709 13:03:30.587625 10981 heartbeater.cc:461] Registering TS with master...
I20260709 13:03:30.588438   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:03:30.588459 10981 heartbeater.cc:507] Master 127.0.107.254:41103 requested a full tablet report, sending...
W20260709 13:03:30.588795   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:30.589010   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602210588994 us; error 0 us; skew 500 ppm
I20260709 13:03:30.589725   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:30.591012 10854 ts_manager.cc:194] Registered new tserver with Master: 2fb048a7b080470d87c5c78bbafbe833 (127.0.107.193:33871)
I20260709 13:03:30.592617   431 webserver.cc:533] Webserver started at http://127.0.107.194:39593/ using document root <none> and password file <none>
I20260709 13:03:30.593317   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:30.593537   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:30.593559 10854 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58920
I20260709 13:03:30.593972   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:30.595476   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601891739070-431-0/minicluster-data/ts-1-root/instance:
uuid: "5d33b52fc607443586b756116ae39d32"
format_stamp: "Formatted at 2026-07-09 13:03:30 on dist-test-slave-qzg2"
I20260709 13:03:30.600251   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:03:30.603629 10993 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:30.604439   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:03:30.604727   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601891739070-431-0/minicluster-data/ts-1-root
uuid: "5d33b52fc607443586b756116ae39d32"
format_stamp: "Formatted at 2026-07-09 13:03:30 on dist-test-slave-qzg2"
I20260709 13:03:30.605000   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601891739070-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601891739070-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601891739070-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:30.623610   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:30.624785   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:30.626224   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:30.628448   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:03:30.628643   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:30.628865   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:03:30.629011   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:30.668527   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:46693
I20260709 13:03:30.668624 11055 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:46693 every 8 connection(s)
I20260709 13:03:30.673096   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:30.679481 11059 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:30.680545 11060 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:30.682914 11062 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:30.683746   431 server_base.cc:1061] running on GCE node
I20260709 13:03:30.684681   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:30.684899   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:30.684939 11056 heartbeater.cc:344] Connected to a master server at 127.0.107.254:41103
I20260709 13:03:30.685117   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602210685097 us; error 0 us; skew 500 ppm
I20260709 13:03:30.685389 11056 heartbeater.cc:461] Registering TS with master...
I20260709 13:03:30.685830   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:30.686168 11056 heartbeater.cc:507] Master 127.0.107.254:41103 requested a full tablet report, sending...
I20260709 13:03:30.688423   431 webserver.cc:533] Webserver started at http://127.0.107.195:44879/ using document root <none> and password file <none>
I20260709 13:03:30.688652 10854 ts_manager.cc:194] Registered new tserver with Master: 5d33b52fc607443586b756116ae39d32 (127.0.107.194:46693)
I20260709 13:03:30.689220   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:30.689502   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:30.689814   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:30.690528 10854 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58928
I20260709 13:03:30.691354   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601891739070-431-0/minicluster-data/ts-2-root/instance:
uuid: "f77602fc49a648cc8d469201d9ad2859"
format_stamp: "Formatted at 2026-07-09 13:03:30 on dist-test-slave-qzg2"
I20260709 13:03:30.696460   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:03:30.699947 11067 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:30.700736   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:03:30.701040   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601891739070-431-0/minicluster-data/ts-2-root
uuid: "f77602fc49a648cc8d469201d9ad2859"
format_stamp: "Formatted at 2026-07-09 13:03:30 on dist-test-slave-qzg2"
I20260709 13:03:30.701336   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601891739070-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601891739070-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601891739070-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:30.717358   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:30.718878   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:30.720808   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:30.723378   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:03:30.723580   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:30.723767   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:03:30.723891   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:30.763582   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:35111
I20260709 13:03:30.763700 11129 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:35111 every 8 connection(s)
I20260709 13:03:30.777967 11130 heartbeater.cc:344] Connected to a master server at 127.0.107.254:41103
I20260709 13:03:30.778471 11130 heartbeater.cc:461] Registering TS with master...
I20260709 13:03:30.779299 11130 heartbeater.cc:507] Master 127.0.107.254:41103 requested a full tablet report, sending...
I20260709 13:03:30.781283 10854 ts_manager.cc:194] Registered new tserver with Master: f77602fc49a648cc8d469201d9ad2859 (127.0.107.195:35111)
I20260709 13:03:30.781713   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014820824s
I20260709 13:03:30.783038 10854 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58940
I20260709 13:03:30.809955 10854 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54890:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:03:30.812144 10854 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:03:30.856750 11095 tablet_service.cc:1511] Processing CreateTablet for tablet 271483c6d24f4c638351ee7b145d8a90 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=bcdcf121e12547cfb77c476578b62961]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:03:30.857311 11094 tablet_service.cc:1511] Processing CreateTablet for tablet 0c357d1f432146c48ba178e6681fcfa0 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=bcdcf121e12547cfb77c476578b62961]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:03:30.858340 11095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 271483c6d24f4c638351ee7b145d8a90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:30.859055 11094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c357d1f432146c48ba178e6681fcfa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:30.861876 10946 tablet_service.cc:1511] Processing CreateTablet for tablet 271483c6d24f4c638351ee7b145d8a90 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=bcdcf121e12547cfb77c476578b62961]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:03:30.862239 11020 tablet_service.cc:1511] Processing CreateTablet for tablet 0c357d1f432146c48ba178e6681fcfa0 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=bcdcf121e12547cfb77c476578b62961]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:03:30.863551 10946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 271483c6d24f4c638351ee7b145d8a90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:30.865001 10945 tablet_service.cc:1511] Processing CreateTablet for tablet 0c357d1f432146c48ba178e6681fcfa0 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=bcdcf121e12547cfb77c476578b62961]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:03:30.866309 10945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c357d1f432146c48ba178e6681fcfa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:30.871876 11021 tablet_service.cc:1511] Processing CreateTablet for tablet 271483c6d24f4c638351ee7b145d8a90 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=bcdcf121e12547cfb77c476578b62961]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:03:30.863634 11020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c357d1f432146c48ba178e6681fcfa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:30.876426 11021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 271483c6d24f4c638351ee7b145d8a90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:30.903815 11145 tablet_bootstrap.cc:492] T 0c357d1f432146c48ba178e6681fcfa0 P f77602fc49a648cc8d469201d9ad2859: Bootstrap starting.
I20260709 13:03:30.906613 11146 tablet_bootstrap.cc:492] T 271483c6d24f4c638351ee7b145d8a90 P 2fb048a7b080470d87c5c78bbafbe833: Bootstrap starting.
I20260709 13:03:30.909834 11147 tablet_bootstrap.cc:492] T 271483c6d24f4c638351ee7b145d8a90 P 5d33b52fc607443586b756116ae39d32: Bootstrap starting.
I20260709 13:03:30.930557 11145 tablet_bootstrap.cc:654] T 0c357d1f432146c48ba178e6681fcfa0 P f77602fc49a648cc8d469201d9ad2859: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:30.931111 11146 tablet_bootstrap.cc:654] T 271483c6d24f4c638351ee7b145d8a90 P 2fb048a7b080470d87c5c78bbafbe833: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:30.934247 11147 tablet_bootstrap.cc:654] T 271483c6d24f4c638351ee7b145d8a90 P 5d33b52fc607443586b756116ae39d32: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:30.936004 11145 tablet_bootstrap.cc:492] T 0c357d1f432146c48ba178e6681fcfa0 P f77602fc49a648cc8d469201d9ad2859: No bootstrap required, opened a new log
I20260709 13:03:30.936578 11145 ts_tablet_manager.cc:1403] T 0c357d1f432146c48ba178e6681fcfa0 P f77602fc49a648cc8d469201d9ad2859: Time spent bootstrapping tablet: real 0.033s	user 0.017s	sys 0.005s
I20260709 13:03:30.937039 11146 tablet_bootstrap.cc:492] T 271483c6d24f4c638351ee7b145d8a90 P 2fb048a7b080470d87c5c78bbafbe833: No bootstrap required, opened a new log
I20260709 13:03:30.937637 11146 ts_tablet_manager.cc:1403] T 271483c6d24f4c638351ee7b145d8a90 P 2fb048a7b080470d87c5c78bbafbe833: Time spent bootstrapping tablet: real 0.031s	user 0.013s	sys 0.000s
I20260709 13:03:30.939528 11147 tablet_bootstrap.cc:492] T 271483c6d24f4c638351ee7b145d8a90 P 5d33b52fc607443586b756116ae39d32: No bootstrap required, opened a new log
I20260709 13:03:30.939536 11145 raft_consensus.cc:359] T 0c357d1f432146c48ba178e6681fcfa0 P f77602fc49a648cc8d469201d9ad2859 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb048a7b080470d87c5c78bbafbe833" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33871 } } peers { permanent_uuid: "5d33b52fc607443586b756116ae39d32" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46693 } } peers { permanent_uuid: "f77602fc49a648cc8d469201d9ad2859" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35111 } }
I20260709 13:03:30.940191 11147 ts_tablet_manager.cc:1403] T 271483c6d24f4c638351ee7b145d8a90 P 5d33b52fc607443586b756116ae39d32: Time spent bootstrapping tablet: real 0.031s	user 0.006s	sys 0.011s
I20260709 13:03:30.940011 11146 raft_consensus.cc:359] T 271483c6d24f4c638351ee7b145d8a90 P 2fb048a7b080470d87c5c78bbafbe833 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f77602fc49a648cc8d469201d9ad2859" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35111 } } peers { permanent_uuid: "5d33b52fc607443586b756116ae39d32" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46693 } } peers { permanent_uuid: "2fb048a7b080470d87c5c78bbafbe833" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33871 } }
I20260709 13:03:30.940590 11145 raft_consensus.cc:385] T 0c357d1f432146c48ba178e6681fcfa0 P f77602fc49a648cc8d469201d9ad2859 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:30.940836 11146 raft_consensus.cc:385] T 271483c6d24f4c638351ee7b145d8a90 P 2fb048a7b080470d87c5c78bbafbe833 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:30.941045 11145 raft_consensus.cc:740] T 0c357d1f432146c48ba178e6681fcfa0 P f77602fc49a648cc8d469201d9ad2859 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f77602fc49a648cc8d469201d9ad2859, State: Initialized, Role: FOLLOWER
I20260709 13:03:30.941270 11146 raft_consensus.cc:740] T 271483c6d24f4c638351ee7b145d8a90 P 2fb048a7b080470d87c5c78bbafbe833 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fb048a7b080470d87c5c78bbafbe833, State: Initialized, Role: FOLLOWER
I20260709 13:03:30.942094 11145 consensus_queue.cc:260] T 0c357d1f432146c48ba178e6681fcfa0 P f77602fc49a648cc8d469201d9ad2859 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb048a7b080470d87c5c78bbafbe833" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33871 } } peers { permanent_uuid: "5d33b52fc607443586b756116ae39d32" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46693 } } peers { permanent_uuid: "f77602fc49a648cc8d469201d9ad2859" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35111 } }
I20260709 13:03:30.942339 11146 consensus_queue.cc:260] T 271483c6d24f4c638351ee7b145d8a90 P 2fb048a7b080470d87c5c78bbafbe833 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f77602fc49a648cc8d469201d9ad2859" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35111 } } peers { permanent_uuid: "5d33b52fc607443586b756116ae39d32" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46693 } } peers { permanent_uuid: "2fb048a7b080470d87c5c78bbafbe833" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33871 } }
I20260709 13:03:30.943233 11147 raft_consensus.cc:359] T 271483c6d24f4c638351ee7b145d8a90 P 5d33b52fc607443586b756116ae39d32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f77602fc49a648cc8d469201d9ad2859" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35111 } } peers { permanent_uuid: "5d33b52fc607443586b756116ae39d32" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46693 } } peers { permanent_uuid: "2fb048a7b080470d87c5c78bbafbe833" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33871 } }
I20260709 13:03:30.944080 11147 raft_consensus.cc:385] T 271483c6d24f4c638351ee7b145d8a90 P 5d33b52fc607443586b756116ae39d32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:30.944413 11147 raft_consensus.cc:740] T 271483c6d24f4c638351ee7b145d8a90 P 5d33b52fc607443586b756116ae39d32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d33b52fc607443586b756116ae39d32, State: Initialized, Role: FOLLOWER
I20260709 13:03:30.944690 11130 heartbeater.cc:499] Master 127.0.107.254:41103 was elected leader, sending a full tablet report...
I20260709 13:03:30.945231 11147 consensus_queue.cc:260] T 271483c6d24f4c638351ee7b145d8a90 P 5d33b52fc607443586b756116ae39d32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f77602fc49a648cc8d469201d9ad2859" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35111 } } peers { permanent_uuid: "5d33b52fc607443586b756116ae39d32" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46693 } } peers { permanent_uuid: "2fb048a7b080470d87c5c78bbafbe833" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33871 } }
I20260709 13:03:30.945665 10981 heartbeater.cc:499] Master 127.0.107.254:41103 was elected leader, sending a full tablet report...
I20260709 13:03:30.946116 11146 ts_tablet_manager.cc:1434] T 271483c6d24f4c638351ee7b145d8a90 P 2fb048a7b080470d87c5c78bbafbe833: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 13:03:30.947171 11146 tablet_bootstrap.cc:492] T 0c357d1f432146c48ba178e6681fcfa0 P 2fb048a7b080470d87c5c78bbafbe833: Bootstrap starting.
I20260709 13:03:30.953480 11146 tablet_bootstrap.cc:654] T 0c357d1f432146c48ba178e6681fcfa0 P 2fb048a7b080470d87c5c78bbafbe833: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:30.954627 11147 ts_tablet_manager.cc:1434] T 271483c6d24f4c638351ee7b145d8a90 P 5d33b52fc607443586b756116ae39d32: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.007s
I20260709 13:03:30.952790 11145 ts_tablet_manager.cc:1434] T 0c357d1f432146c48ba178e6681fcfa0 P f77602fc49a648cc8d469201d9ad2859: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.003s
I20260709 13:03:30.955451 11056 heartbeater.cc:499] Master 127.0.107.254:41103 was elected leader, sending a full tablet report...
I20260709 13:03:30.956230 11145 tablet_bootstrap.cc:492] T 271483c6d24f4c638351ee7b145d8a90 P f77602fc49a648cc8d469201d9ad2859: Bootstrap starting.
I20260709 13:03:30.958011 11147 tablet_bootstrap.cc:492] T 0c357d1f432146c48ba178e6681fcfa0 P 5d33b52fc607443586b756116ae39d32: Bootstrap starting.
I20260709 13:03:30.964771 11145 tablet_bootstrap.cc:654] T 271483c6d24f4c638351ee7b145d8a90 P f77602fc49a648cc8d469201d9ad2859: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:30.965894 11147 tablet_bootstrap.cc:654] T 0c357d1f432146c48ba178e6681fcfa0 P 5d33b52fc607443586b756116ae39d32: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:30.977306 11145 tablet_bootstrap.cc:492] T 271483c6d24f4c638351ee7b145d8a90 P f77602fc49a648cc8d469201d9ad2859: No bootstrap required, opened a new log
I20260709 13:03:30.978015 11145 ts_tablet_manager.cc:1403] T 271483c6d24f4c638351ee7b145d8a90 P f77602fc49a648cc8d469201d9ad2859: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.005s
I20260709 13:03:30.980007 11147 tablet_bootstrap.cc:492] T 0c357d1f432146c48ba178e6681fcfa0 P 5d33b52fc607443586b756116ae39d32: No bootstrap required, opened a new log
I20260709 13:03:30.980647 11147 ts_tablet_manager.cc:1403] T 0c357d1f432146c48ba178e6681fcfa0 P 5d33b52fc607443586b756116ae39d32: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.006s
I20260709 13:03:30.981093 11145 raft_consensus.cc:359] T 271483c6d24f4c638351ee7b145d8a90 P f77602fc49a648cc8d469201d9ad2859 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f77602fc49a648cc8d469201d9ad2859" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35111 } } peers { permanent_uuid: "5d33b52fc607443586b756116ae39d32" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46693 } } peers { permanent_uuid: "2fb048a7b080470d87c5c78bbafbe833" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33871 } }
I20260709 13:03:30.981827 11146 tablet_bootstrap.cc:492] T 0c357d1f432146c48ba178e6681fcfa0 P 2fb048a7b080470d87c5c78bbafbe833: No bootstrap required, opened a new log
I20260709 13:03:30.981940 11145 raft_consensus.cc:385] T 271483c6d24f4c638351ee7b145d8a90 P f77602fc49a648cc8d469201d9ad2859 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:30.982393 11145 raft_consensus.cc:740] T 271483c6d24f4c638351ee7b145d8a90 P f77602fc49a648cc8d469201d9ad2859 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f77602fc49a648cc8d469201d9ad2859, State: Initialized, Role: FOLLOWER
I20260709 13:03:30.982527 11146 ts_tablet_manager.cc:1403] T 0c357d1f432146c48ba178e6681fcfa0 P 2fb048a7b080470d87c5c78bbafbe833: Time spent bootstrapping tablet: real 0.036s	user 0.020s	sys 0.014s
I20260709 13:03:30.983171 11145 consensus_queue.cc:260] T 271483c6d24f4c638351ee7b145d8a90 P f77602fc49a648cc8d469201d9ad2859 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f77602fc49a648cc8d469201d9ad2859" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35111 } } peers { permanent_uuid: "5d33b52fc607443586b756116ae39d32" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46693 } } peers { permanent_uuid: "2fb048a7b080470d87c5c78bbafbe833" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33871 } }
I20260709 13:03:30.984226 11147 raft_consensus.cc:359] T 0c357d1f432146c48ba178e6681fcfa0 P 5d33b52fc607443586b756116ae39d32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb048a7b080470d87c5c78bbafbe833" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33871 } } peers { permanent_uuid: "5d33b52fc607443586b756116ae39d32" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46693 } } peers { permanent_uuid: "f77602fc49a648cc8d469201d9ad2859" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35111 } }
I20260709 13:03:30.985064 11147 raft_consensus.cc:385] T 0c357d1f432146c48ba178e6681fcfa0 P 5d33b52fc607443586b756116ae39d32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:30.985239 11145 ts_tablet_manager.cc:1434] T 271483c6d24f4c638351ee7b145d8a90 P f77602fc49a648cc8d469201d9ad2859: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.004s
I20260709 13:03:30.985423 11147 raft_consensus.cc:740] T 0c357d1f432146c48ba178e6681fcfa0 P 5d33b52fc607443586b756116ae39d32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d33b52fc607443586b756116ae39d32, State: Initialized, Role: FOLLOWER
I20260709 13:03:30.986001 11146 raft_consensus.cc:359] T 0c357d1f432146c48ba178e6681fcfa0 P 2fb048a7b080470d87c5c78bbafbe833 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb048a7b080470d87c5c78bbafbe833" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33871 } } peers { permanent_uuid: "5d33b52fc607443586b756116ae39d32" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46693 } } peers { permanent_uuid: "f77602fc49a648cc8d469201d9ad2859" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35111 } }
I20260709 13:03:30.986442 11151 raft_consensus.cc:493] T 0c357d1f432146c48ba178e6681fcfa0 P f77602fc49a648cc8d469201d9ad2859 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.986850 11146 raft_consensus.cc:385] T 0c357d1f432146c48ba178e6681fcfa0 P 2fb048a7b080470d87c5c78bbafbe833 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:30.986577 11147 consensus_queue.cc:260] T 0c357d1f432146c48ba178e6681fcfa0 P 5d33b52fc607443586b756116ae39d32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb048a7b080470d87c5c78bbafbe833" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33871 } } peers { permanent_uuid: "5d33b52fc607443586b756116ae39d32" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46693 } } peers { permanent_uuid: "f77602fc49a648cc8d469201d9ad2859" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35111 } }
I20260709 13:03:30.987253 11146 raft_consensus.cc:740] T 0c357d1f432146c48ba178e6681fcfa0 P 2fb048a7b080470d87c5c78bbafbe833 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fb048a7b080470d87c5c78bbafbe833, State: Initialized, Role: FOLLOWER
I20260709 13:03:30.987021 11151 raft_consensus.cc:515] T 0c357d1f432146c48ba178e6681fcfa0 P f77602fc49a648cc8d469201d9ad2859 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb048a7b080470d87c5c78bbafbe833" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33871 } } peers { permanent_uuid: "5d33b52fc607443586b756116ae39d32" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46693 } } peers { permanent_uuid: "f77602fc49a648cc8d469201d9ad2859" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35111 } }
I20260709 13:03:30.988070 11146 consensus_queue.cc:260] T 0c357d1f432146c48ba178e6681fcfa0 P 2fb048a7b080470d87c5c78bbafbe833 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb048a7b080470d87c5c78bbafbe833" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33871 } } peers { permanent_uuid: "5d33b52fc607443586b756116ae39d32" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46693 } } peers { permanent_uuid: "f77602fc49a648cc8d469201d9ad2859" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35111 } }
I20260709 13:03:30.990312 11146 ts_tablet_manager.cc:1434] T 0c357d1f432146c48ba178e6681fcfa0 P 2fb048a7b080470d87c5c78bbafbe833: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.004s
I20260709 13:03:30.990944 11147 ts_tablet_manager.cc:1434] T 0c357d1f432146c48ba178e6681fcfa0 P 5d33b52fc607443586b756116ae39d32: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:03:30.993141 11153 raft_consensus.cc:493] T 271483c6d24f4c638351ee7b145d8a90 P 5d33b52fc607443586b756116ae39d32 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.993702 11153 raft_consensus.cc:515] T 271483c6d24f4c638351ee7b145d8a90 P 5d33b52fc607443586b756116ae39d32 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f77602fc49a648cc8d469201d9ad2859" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35111 } } peers { permanent_uuid: "5d33b52fc607443586b756116ae39d32" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46693 } } peers { permanent_uuid: "2fb048a7b080470d87c5c78bbafbe833" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33871 } }
I20260709 13:03:30.997777 11153 leader_election.cc:290] T 271483c6d24f4c638351ee7b145d8a90 P 5d33b52fc607443586b756116ae39d32 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f77602fc49a648cc8d469201d9ad2859 (127.0.107.195:35111), 2fb048a7b080470d87c5c78bbafbe833 (127.0.107.193:33871)
I20260709 13:03:30.998678 11151 leader_election.cc:290] T 0c357d1f432146c48ba178e6681fcfa0 P f77602fc49a648cc8d469201d9ad2859 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fb048a7b080470d87c5c78bbafbe833 (127.0.107.193:33871), 5d33b52fc607443586b756116ae39d32 (127.0.107.194:46693)
I20260709 13:03:31.012579 11105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271483c6d24f4c638351ee7b145d8a90" candidate_uuid: "5d33b52fc607443586b756116ae39d32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f77602fc49a648cc8d469201d9ad2859" is_pre_election: true
I20260709 13:03:31.013435 11105 raft_consensus.cc:2468] T 271483c6d24f4c638351ee7b145d8a90 P f77602fc49a648cc8d469201d9ad2859 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d33b52fc607443586b756116ae39d32 in term 0.
I20260709 13:03:31.014961 10996 leader_election.cc:304] T 271483c6d24f4c638351ee7b145d8a90 P 5d33b52fc607443586b756116ae39d32 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d33b52fc607443586b756116ae39d32, f77602fc49a648cc8d469201d9ad2859; no voters: 
I20260709 13:03:31.015987 11153 raft_consensus.cc:2804] T 271483c6d24f4c638351ee7b145d8a90 P 5d33b52fc607443586b756116ae39d32 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:31.016433 11153 raft_consensus.cc:493] T 271483c6d24f4c638351ee7b145d8a90 P 5d33b52fc607443586b756116ae39d32 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:31.018723 11153 raft_consensus.cc:3060] T 271483c6d24f4c638351ee7b145d8a90 P 5d33b52fc607443586b756116ae39d32 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:31.018985 10956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c357d1f432146c48ba178e6681fcfa0" candidate_uuid: "f77602fc49a648cc8d469201d9ad2859" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fb048a7b080470d87c5c78bbafbe833" is_pre_election: true
I20260709 13:03:31.019805 10956 raft_consensus.cc:2468] T 0c357d1f432146c48ba178e6681fcfa0 P 2fb048a7b080470d87c5c78bbafbe833 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f77602fc49a648cc8d469201d9ad2859 in term 0.
I20260709 13:03:31.021204 11069 leader_election.cc:304] T 0c357d1f432146c48ba178e6681fcfa0 P f77602fc49a648cc8d469201d9ad2859 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fb048a7b080470d87c5c78bbafbe833, f77602fc49a648cc8d469201d9ad2859; no voters: 
I20260709 13:03:31.022068 11151 raft_consensus.cc:2804] T 0c357d1f432146c48ba178e6681fcfa0 P f77602fc49a648cc8d469201d9ad2859 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:31.022450 11151 raft_consensus.cc:493] T 0c357d1f432146c48ba178e6681fcfa0 P f77602fc49a648cc8d469201d9ad2859 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:31.022789 11151 raft_consensus.cc:3060] T 0c357d1f432146c48ba178e6681fcfa0 P f77602fc49a648cc8d469201d9ad2859 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:31.024073 10956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271483c6d24f4c638351ee7b145d8a90" candidate_uuid: "5d33b52fc607443586b756116ae39d32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fb048a7b080470d87c5c78bbafbe833" is_pre_election: true
I20260709 13:03:31.024255 11031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c357d1f432146c48ba178e6681fcfa0" candidate_uuid: "f77602fc49a648cc8d469201d9ad2859" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d33b52fc607443586b756116ae39d32" is_pre_election: true
I20260709 13:03:31.024806 10956 raft_consensus.cc:2468] T 271483c6d24f4c638351ee7b145d8a90 P 2fb048a7b080470d87c5c78bbafbe833 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d33b52fc607443586b756116ae39d32 in term 0.
I20260709 13:03:31.025025 11031 raft_consensus.cc:2468] T 0c357d1f432146c48ba178e6681fcfa0 P 5d33b52fc607443586b756116ae39d32 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f77602fc49a648cc8d469201d9ad2859 in term 0.
I20260709 13:03:31.026741 11153 raft_consensus.cc:515] T 271483c6d24f4c638351ee7b145d8a90 P 5d33b52fc607443586b756116ae39d32 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f77602fc49a648cc8d469201d9ad2859" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35111 } } peers { permanent_uuid: "5d33b52fc607443586b756116ae39d32" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46693 } } peers { permanent_uuid: "2fb048a7b080470d87c5c78bbafbe833" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33871 } }
I20260709 13:03:31.028399 11153 leader_election.cc:290] T 271483c6d24f4c638351ee7b145d8a90 P 5d33b52fc607443586b756116ae39d32 [CANDIDATE]: Term 1 election: Requested vote from peers f77602fc49a648cc8d469201d9ad2859 (127.0.107.195:35111), 2fb048a7b080470d87c5c78bbafbe833 (127.0.107.193:33871)
I20260709 13:03:31.029307 11105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271483c6d24f4c638351ee7b145d8a90" candidate_uuid: "5d33b52fc607443586b756116ae39d32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f77602fc49a648cc8d469201d9ad2859"
I20260709 13:03:31.029541 10956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271483c6d24f4c638351ee7b145d8a90" candidate_uuid: "5d33b52fc607443586b756116ae39d32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fb048a7b080470d87c5c78bbafbe833"
I20260709 13:03:31.029844 11105 raft_consensus.cc:3060] T 271483c6d24f4c638351ee7b145d8a90 P f77602fc49a648cc8d469201d9ad2859 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:31.029728 11151 raft_consensus.cc:515] T 0c357d1f432146c48ba178e6681fcfa0 P f77602fc49a648cc8d469201d9ad2859 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb048a7b080470d87c5c78bbafbe833" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33871 } } peers { permanent_uuid: "5d33b52fc607443586b756116ae39d32" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46693 } } peers { permanent_uuid: "f77602fc49a648cc8d469201d9ad2859" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35111 } }
I20260709 13:03:31.030169 10956 raft_consensus.cc:3060] T 271483c6d24f4c638351ee7b145d8a90 P 2fb048a7b080470d87c5c78bbafbe833 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:31.032552 10955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c357d1f432146c48ba178e6681fcfa0" candidate_uuid: "f77602fc49a648cc8d469201d9ad2859" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fb048a7b080470d87c5c78bbafbe833"
I20260709 13:03:31.033192 10955 raft_consensus.cc:3060] T 0c357d1f432146c48ba178e6681fcfa0 P 2fb048a7b080470d87c5c78bbafbe833 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:31.033464 11031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c357d1f432146c48ba178e6681fcfa0" candidate_uuid: "f77602fc49a648cc8d469201d9ad2859" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d33b52fc607443586b756116ae39d32"
I20260709 13:03:31.034080 11031 raft_consensus.cc:3060] T 0c357d1f432146c48ba178e6681fcfa0 P 5d33b52fc607443586b756116ae39d32 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:31.037216 11105 raft_consensus.cc:2468] T 271483c6d24f4c638351ee7b145d8a90 P f77602fc49a648cc8d469201d9ad2859 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d33b52fc607443586b756116ae39d32 in term 1.
I20260709 13:03:31.037811 10956 raft_consensus.cc:2468] T 271483c6d24f4c638351ee7b145d8a90 P 2fb048a7b080470d87c5c78bbafbe833 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d33b52fc607443586b756116ae39d32 in term 1.
I20260709 13:03:31.038790 10996 leader_election.cc:304] T 271483c6d24f4c638351ee7b145d8a90 P 5d33b52fc607443586b756116ae39d32 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d33b52fc607443586b756116ae39d32, f77602fc49a648cc8d469201d9ad2859; no voters: 
I20260709 13:03:31.039744 11153 raft_consensus.cc:2804] T 271483c6d24f4c638351ee7b145d8a90 P 5d33b52fc607443586b756116ae39d32 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:31.040501 11151 leader_election.cc:290] T 0c357d1f432146c48ba178e6681fcfa0 P f77602fc49a648cc8d469201d9ad2859 [CANDIDATE]: Term 1 election: Requested vote from peers 2fb048a7b080470d87c5c78bbafbe833 (127.0.107.193:33871), 5d33b52fc607443586b756116ae39d32 (127.0.107.194:46693)
I20260709 13:03:31.040618 10955 raft_consensus.cc:2468] T 0c357d1f432146c48ba178e6681fcfa0 P 2fb048a7b080470d87c5c78bbafbe833 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f77602fc49a648cc8d469201d9ad2859 in term 1.
I20260709 13:03:31.042160 11069 leader_election.cc:304] T 0c357d1f432146c48ba178e6681fcfa0 P f77602fc49a648cc8d469201d9ad2859 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fb048a7b080470d87c5c78bbafbe833, f77602fc49a648cc8d469201d9ad2859; no voters: 
I20260709 13:03:31.042507 11031 raft_consensus.cc:2468] T 0c357d1f432146c48ba178e6681fcfa0 P 5d33b52fc607443586b756116ae39d32 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f77602fc49a648cc8d469201d9ad2859 in term 1.
I20260709 13:03:31.042900 11151 raft_consensus.cc:2804] T 0c357d1f432146c48ba178e6681fcfa0 P f77602fc49a648cc8d469201d9ad2859 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:31.043519 11153 raft_consensus.cc:697] T 271483c6d24f4c638351ee7b145d8a90 P 5d33b52fc607443586b756116ae39d32 [term 1 LEADER]: Becoming Leader. State: Replica: 5d33b52fc607443586b756116ae39d32, State: Running, Role: LEADER
I20260709 13:03:31.044533 11151 raft_consensus.cc:697] T 0c357d1f432146c48ba178e6681fcfa0 P f77602fc49a648cc8d469201d9ad2859 [term 1 LEADER]: Becoming Leader. State: Replica: f77602fc49a648cc8d469201d9ad2859, State: Running, Role: LEADER
I20260709 13:03:31.044515 11153 consensus_queue.cc:237] T 271483c6d24f4c638351ee7b145d8a90 P 5d33b52fc607443586b756116ae39d32 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f77602fc49a648cc8d469201d9ad2859" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35111 } } peers { permanent_uuid: "5d33b52fc607443586b756116ae39d32" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46693 } } peers { permanent_uuid: "2fb048a7b080470d87c5c78bbafbe833" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33871 } }
I20260709 13:03:31.045524 11151 consensus_queue.cc:237] T 0c357d1f432146c48ba178e6681fcfa0 P f77602fc49a648cc8d469201d9ad2859 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb048a7b080470d87c5c78bbafbe833" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33871 } } peers { permanent_uuid: "5d33b52fc607443586b756116ae39d32" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46693 } } peers { permanent_uuid: "f77602fc49a648cc8d469201d9ad2859" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35111 } }
I20260709 13:03:31.054394 10852 catalog_manager.cc:5697] T 271483c6d24f4c638351ee7b145d8a90 P 5d33b52fc607443586b756116ae39d32 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d33b52fc607443586b756116ae39d32 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "5d33b52fc607443586b756116ae39d32" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f77602fc49a648cc8d469201d9ad2859" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d33b52fc607443586b756116ae39d32" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46693 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fb048a7b080470d87c5c78bbafbe833" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33871 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:31.054284 10854 catalog_manager.cc:5697] T 0c357d1f432146c48ba178e6681fcfa0 P f77602fc49a648cc8d469201d9ad2859 reported cstate change: term changed from 0 to 1, leader changed from <none> to f77602fc49a648cc8d469201d9ad2859 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "f77602fc49a648cc8d469201d9ad2859" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb048a7b080470d87c5c78bbafbe833" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d33b52fc607443586b756116ae39d32" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f77602fc49a648cc8d469201d9ad2859" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35111 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:31.095522 10854 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54894:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:03:31.097438 10854 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:03:31.120913 10946 tablet_service.cc:1511] Processing CreateTablet for tablet 398fbdd47ee8495082338d265269b718 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=65296de5967c4a77b1f2bc862df23836]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:03:31.122258 10946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 398fbdd47ee8495082338d265269b718. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:31.121990 11020 tablet_service.cc:1511] Processing CreateTablet for tablet 398fbdd47ee8495082338d265269b718 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=65296de5967c4a77b1f2bc862df23836]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:03:31.123358 11020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 398fbdd47ee8495082338d265269b718. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:31.123438 11094 tablet_service.cc:1511] Processing CreateTablet for tablet 398fbdd47ee8495082338d265269b718 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=65296de5967c4a77b1f2bc862df23836]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:03:31.124722 11094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 398fbdd47ee8495082338d265269b718. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:31.127753 10945 tablet_service.cc:1511] Processing CreateTablet for tablet 3af502197ed64f4181fe0513d5527542 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=65296de5967c4a77b1f2bc862df23836]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:03:31.129102 10945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3af502197ed64f4181fe0513d5527542. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:31.132128 11021 tablet_service.cc:1511] Processing CreateTablet for tablet 3af502197ed64f4181fe0513d5527542 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=65296de5967c4a77b1f2bc862df23836]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:03:31.133404 11021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3af502197ed64f4181fe0513d5527542. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:31.139351 11095 tablet_service.cc:1511] Processing CreateTablet for tablet 3af502197ed64f4181fe0513d5527542 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=65296de5967c4a77b1f2bc862df23836]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:03:31.140789 11095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3af502197ed64f4181fe0513d5527542. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:31.149724 11146 tablet_bootstrap.cc:492] T 398fbdd47ee8495082338d265269b718 P 2fb048a7b080470d87c5c78bbafbe833: Bootstrap starting.
I20260709 13:03:31.151875 11145 tablet_bootstrap.cc:492] T 398fbdd47ee8495082338d265269b718 P f77602fc49a648cc8d469201d9ad2859: Bootstrap starting.
I20260709 13:03:31.156450 11146 tablet_bootstrap.cc:654] T 398fbdd47ee8495082338d265269b718 P 2fb048a7b080470d87c5c78bbafbe833: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:31.158468 11145 tablet_bootstrap.cc:654] T 398fbdd47ee8495082338d265269b718 P f77602fc49a648cc8d469201d9ad2859: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:31.166435 11147 tablet_bootstrap.cc:492] T 3af502197ed64f4181fe0513d5527542 P 5d33b52fc607443586b756116ae39d32: Bootstrap starting.
I20260709 13:03:31.173920 11147 tablet_bootstrap.cc:654] T 3af502197ed64f4181fe0513d5527542 P 5d33b52fc607443586b756116ae39d32: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:31.175522 11146 tablet_bootstrap.cc:492] T 398fbdd47ee8495082338d265269b718 P 2fb048a7b080470d87c5c78bbafbe833: No bootstrap required, opened a new log
I20260709 13:03:31.176934 11145 tablet_bootstrap.cc:492] T 398fbdd47ee8495082338d265269b718 P f77602fc49a648cc8d469201d9ad2859: No bootstrap required, opened a new log
I20260709 13:03:31.177033 11146 ts_tablet_manager.cc:1403] T 398fbdd47ee8495082338d265269b718 P 2fb048a7b080470d87c5c78bbafbe833: Time spent bootstrapping tablet: real 0.028s	user 0.011s	sys 0.004s
I20260709 13:03:31.177764 11145 ts_tablet_manager.cc:1403] T 398fbdd47ee8495082338d265269b718 P f77602fc49a648cc8d469201d9ad2859: Time spent bootstrapping tablet: real 0.026s	user 0.009s	sys 0.003s
I20260709 13:03:31.180281 11146 raft_consensus.cc:359] T 398fbdd47ee8495082338d265269b718 P 2fb048a7b080470d87c5c78bbafbe833 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb048a7b080470d87c5c78bbafbe833" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33871 } } peers { permanent_uuid: "5d33b52fc607443586b756116ae39d32" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46693 } } peers { permanent_uuid: "f77602fc49a648cc8d469201d9ad2859" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35111 } }
I20260709 13:03:31.180932 11146 raft_consensus.cc:385] T 398fbdd47ee8495082338d265269b718 P 2fb048a7b080470d87c5c78bbafbe833 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:31.180727 11145 raft_consensus.cc:359] T 398fbdd47ee8495082338d265269b718 P f77602fc49a648cc8d469201d9ad2859 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb048a7b080470d87c5c78bbafbe833" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33871 } } peers { permanent_uuid: "5d33b52fc607443586b756116ae39d32" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46693 } } peers { permanent_uuid: "f77602fc49a648cc8d469201d9ad2859" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35111 } }
I20260709 13:03:31.181241 11146 raft_consensus.cc:740] T 398fbdd47ee8495082338d265269b718 P 2fb048a7b080470d87c5c78bbafbe833 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fb048a7b080470d87c5c78bbafbe833, State: Initialized, Role: FOLLOWER
I20260709 13:03:31.181547 11145 raft_consensus.cc:385] T 398fbdd47ee8495082338d265269b718 P f77602fc49a648cc8d469201d9ad2859 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:31.181622 11147 tablet_bootstrap.cc:492] T 3af502197ed64f4181fe0513d5527542 P 5d33b52fc607443586b756116ae39d32: No bootstrap required, opened a new log
I20260709 13:03:31.181953 11145 raft_consensus.cc:740] T 398fbdd47ee8495082338d265269b718 P f77602fc49a648cc8d469201d9ad2859 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f77602fc49a648cc8d469201d9ad2859, State: Initialized, Role: FOLLOWER
I20260709 13:03:31.182298 11147 ts_tablet_manager.cc:1403] T 3af502197ed64f4181fe0513d5527542 P 5d33b52fc607443586b756116ae39d32: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.006s
I20260709 13:03:31.182024 11146 consensus_queue.cc:260] T 398fbdd47ee8495082338d265269b718 P 2fb048a7b080470d87c5c78bbafbe833 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb048a7b080470d87c5c78bbafbe833" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33871 } } peers { permanent_uuid: "5d33b52fc607443586b756116ae39d32" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46693 } } peers { permanent_uuid: "f77602fc49a648cc8d469201d9ad2859" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35111 } }
I20260709 13:03:31.182826 11145 consensus_queue.cc:260] T 398fbdd47ee8495082338d265269b718 P f77602fc49a648cc8d469201d9ad2859 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb048a7b080470d87c5c78bbafbe833" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33871 } } peers { permanent_uuid: "5d33b52fc607443586b756116ae39d32" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46693 } } peers { permanent_uuid: "f77602fc49a648cc8d469201d9ad2859" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35111 } }
I20260709 13:03:31.184340 11146 ts_tablet_manager.cc:1434] T 398fbdd47ee8495082338d265269b718 P 2fb048a7b080470d87c5c78bbafbe833: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:03:31.185024 11145 ts_tablet_manager.cc:1434] T 398fbdd47ee8495082338d265269b718 P f77602fc49a648cc8d469201d9ad2859: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:03:31.185529 11146 tablet_bootstrap.cc:492] T 3af502197ed64f4181fe0513d5527542 P 2fb048a7b080470d87c5c78bbafbe833: Bootstrap starting.
I20260709 13:03:31.186048 11145 tablet_bootstrap.cc:492] T 3af502197ed64f4181fe0513d5527542 P f77602fc49a648cc8d469201d9ad2859: Bootstrap starting.
I20260709 13:03:31.192368 11146 tablet_bootstrap.cc:654] T 3af502197ed64f4181fe0513d5527542 P 2fb048a7b080470d87c5c78bbafbe833: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:31.192986 11145 tablet_bootstrap.cc:654] T 3af502197ed64f4181fe0513d5527542 P f77602fc49a648cc8d469201d9ad2859: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:31.206732 11147 raft_consensus.cc:359] T 3af502197ed64f4181fe0513d5527542 P 5d33b52fc607443586b756116ae39d32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb048a7b080470d87c5c78bbafbe833" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33871 } } peers { permanent_uuid: "5d33b52fc607443586b756116ae39d32" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46693 } } peers { permanent_uuid: "f77602fc49a648cc8d469201d9ad2859" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35111 } }
I20260709 13:03:31.207551 11147 raft_consensus.cc:385] T 3af502197ed64f4181fe0513d5527542 P 5d33b52fc607443586b756116ae39d32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:31.207785 11147 raft_consensus.cc:740] T 3af502197ed64f4181fe0513d5527542 P 5d33b52fc607443586b756116ae39d32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d33b52fc607443586b756116ae39d32, State: Initialized, Role: FOLLOWER
I20260709 13:03:31.208721 11147 consensus_queue.cc:260] T 3af502197ed64f4181fe0513d5527542 P 5d33b52fc607443586b756116ae39d32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb048a7b080470d87c5c78bbafbe833" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33871 } } peers { permanent_uuid: "5d33b52fc607443586b756116ae39d32" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46693 } } peers { permanent_uuid: "f77602fc49a648cc8d469201d9ad2859" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35111 } }
I20260709 13:03:31.209555 11146 tablet_bootstrap.cc:492] T 3af502197ed64f4181fe0513d5527542 P 2fb048a7b080470d87c5c78bbafbe833: No bootstrap required, opened a new log
I20260709 13:03:31.210145 11146 ts_tablet_manager.cc:1403] T 3af502197ed64f4181fe0513d5527542 P 2fb048a7b080470d87c5c78bbafbe833: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.011s
I20260709 13:03:31.211000 11147 ts_tablet_manager.cc:1434] T 3af502197ed64f4181fe0513d5527542 P 5d33b52fc607443586b756116ae39d32: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 13:03:31.211153 11145 tablet_bootstrap.cc:492] T 3af502197ed64f4181fe0513d5527542 P f77602fc49a648cc8d469201d9ad2859: No bootstrap required, opened a new log
I20260709 13:03:31.211815 11145 ts_tablet_manager.cc:1403] T 3af502197ed64f4181fe0513d5527542 P f77602fc49a648cc8d469201d9ad2859: Time spent bootstrapping tablet: real 0.026s	user 0.024s	sys 0.000s
I20260709 13:03:31.212098 11147 tablet_bootstrap.cc:492] T 398fbdd47ee8495082338d265269b718 P 5d33b52fc607443586b756116ae39d32: Bootstrap starting.
I20260709 13:03:31.213070 11146 raft_consensus.cc:359] T 3af502197ed64f4181fe0513d5527542 P 2fb048a7b080470d87c5c78bbafbe833 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb048a7b080470d87c5c78bbafbe833" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33871 } } peers { permanent_uuid: "5d33b52fc607443586b756116ae39d32" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46693 } } peers { permanent_uuid: "f77602fc49a648cc8d469201d9ad2859" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35111 } }
I20260709 13:03:31.213829 11146 raft_consensus.cc:385] T 3af502197ed64f4181fe0513d5527542 P 2fb048a7b080470d87c5c78bbafbe833 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:31.214144 11146 raft_consensus.cc:740] T 3af502197ed64f4181fe0513d5527542 P 2fb048a7b080470d87c5c78bbafbe833 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fb048a7b080470d87c5c78bbafbe833, State: Initialized, Role: FOLLOWER
I20260709 13:03:31.215075 11146 consensus_queue.cc:260] T 3af502197ed64f4181fe0513d5527542 P 2fb048a7b080470d87c5c78bbafbe833 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb048a7b080470d87c5c78bbafbe833" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33871 } } peers { permanent_uuid: "5d33b52fc607443586b756116ae39d32" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46693 } } peers { permanent_uuid: "f77602fc49a648cc8d469201d9ad2859" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35111 } }
I20260709 13:03:31.217680 11146 ts_tablet_manager.cc:1434] T 3af502197ed64f4181fe0513d5527542 P 2fb048a7b080470d87c5c78bbafbe833: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:03:31.215157 11145 raft_consensus.cc:359] T 3af502197ed64f4181fe0513d5527542 P f77602fc49a648cc8d469201d9ad2859 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb048a7b080470d87c5c78bbafbe833" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33871 } } peers { permanent_uuid: "5d33b52fc607443586b756116ae39d32" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46693 } } peers { permanent_uuid: "f77602fc49a648cc8d469201d9ad2859" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35111 } }
I20260709 13:03:31.218500 11145 raft_consensus.cc:385] T 3af502197ed64f4181fe0513d5527542 P f77602fc49a648cc8d469201d9ad2859 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:31.218848 11145 raft_consensus.cc:740] T 3af502197ed64f4181fe0513d5527542 P f77602fc49a648cc8d469201d9ad2859 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f77602fc49a648cc8d469201d9ad2859, State: Initialized, Role: FOLLOWER
I20260709 13:03:31.219862 11147 tablet_bootstrap.cc:654] T 398fbdd47ee8495082338d265269b718 P 5d33b52fc607443586b756116ae39d32: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:31.219677 11145 consensus_queue.cc:260] T 3af502197ed64f4181fe0513d5527542 P f77602fc49a648cc8d469201d9ad2859 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb048a7b080470d87c5c78bbafbe833" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33871 } } peers { permanent_uuid: "5d33b52fc607443586b756116ae39d32" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46693 } } peers { permanent_uuid: "f77602fc49a648cc8d469201d9ad2859" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35111 } }
I20260709 13:03:31.222047 11145 ts_tablet_manager.cc:1434] T 3af502197ed64f4181fe0513d5527542 P f77602fc49a648cc8d469201d9ad2859: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.000s
I20260709 13:03:31.226379 11147 tablet_bootstrap.cc:492] T 398fbdd47ee8495082338d265269b718 P 5d33b52fc607443586b756116ae39d32: No bootstrap required, opened a new log
I20260709 13:03:31.226938 11147 ts_tablet_manager.cc:1403] T 398fbdd47ee8495082338d265269b718 P 5d33b52fc607443586b756116ae39d32: Time spent bootstrapping tablet: real 0.015s	user 0.003s	sys 0.010s
I20260709 13:03:31.229382 11147 raft_consensus.cc:359] T 398fbdd47ee8495082338d265269b718 P 5d33b52fc607443586b756116ae39d32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb048a7b080470d87c5c78bbafbe833" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33871 } } peers { permanent_uuid: "5d33b52fc607443586b756116ae39d32" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46693 } } peers { permanent_uuid: "f77602fc49a648cc8d469201d9ad2859" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35111 } }
I20260709 13:03:31.230090 11147 raft_consensus.cc:385] T 398fbdd47ee8495082338d265269b718 P 5d33b52fc607443586b756116ae39d32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:31.230382 11147 raft_consensus.cc:740] T 398fbdd47ee8495082338d265269b718 P 5d33b52fc607443586b756116ae39d32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d33b52fc607443586b756116ae39d32, State: Initialized, Role: FOLLOWER
I20260709 13:03:31.231132 11147 consensus_queue.cc:260] T 398fbdd47ee8495082338d265269b718 P 5d33b52fc607443586b756116ae39d32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb048a7b080470d87c5c78bbafbe833" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33871 } } peers { permanent_uuid: "5d33b52fc607443586b756116ae39d32" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46693 } } peers { permanent_uuid: "f77602fc49a648cc8d469201d9ad2859" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35111 } }
I20260709 13:03:31.233147 11147 ts_tablet_manager.cc:1434] T 398fbdd47ee8495082338d265269b718 P 5d33b52fc607443586b756116ae39d32: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:03:31.355140 11151 raft_consensus.cc:493] T 3af502197ed64f4181fe0513d5527542 P f77602fc49a648cc8d469201d9ad2859 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.355705 11151 raft_consensus.cc:515] T 3af502197ed64f4181fe0513d5527542 P f77602fc49a648cc8d469201d9ad2859 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb048a7b080470d87c5c78bbafbe833" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33871 } } peers { permanent_uuid: "5d33b52fc607443586b756116ae39d32" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46693 } } peers { permanent_uuid: "f77602fc49a648cc8d469201d9ad2859" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35111 } }
I20260709 13:03:31.357432 11151 leader_election.cc:290] T 3af502197ed64f4181fe0513d5527542 P f77602fc49a648cc8d469201d9ad2859 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fb048a7b080470d87c5c78bbafbe833 (127.0.107.193:33871), 5d33b52fc607443586b756116ae39d32 (127.0.107.194:46693)
I20260709 13:03:31.358244 10955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af502197ed64f4181fe0513d5527542" candidate_uuid: "f77602fc49a648cc8d469201d9ad2859" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fb048a7b080470d87c5c78bbafbe833" is_pre_election: true
I20260709 13:03:31.358515 11031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af502197ed64f4181fe0513d5527542" candidate_uuid: "f77602fc49a648cc8d469201d9ad2859" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d33b52fc607443586b756116ae39d32" is_pre_election: true
I20260709 13:03:31.358893 10955 raft_consensus.cc:2468] T 3af502197ed64f4181fe0513d5527542 P 2fb048a7b080470d87c5c78bbafbe833 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f77602fc49a648cc8d469201d9ad2859 in term 0.
I20260709 13:03:31.359176 11031 raft_consensus.cc:2468] T 3af502197ed64f4181fe0513d5527542 P 5d33b52fc607443586b756116ae39d32 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f77602fc49a648cc8d469201d9ad2859 in term 0.
I20260709 13:03:31.359988 11069 leader_election.cc:304] T 3af502197ed64f4181fe0513d5527542 P f77602fc49a648cc8d469201d9ad2859 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fb048a7b080470d87c5c78bbafbe833, f77602fc49a648cc8d469201d9ad2859; no voters: 
I20260709 13:03:31.360718 11151 raft_consensus.cc:2804] T 3af502197ed64f4181fe0513d5527542 P f77602fc49a648cc8d469201d9ad2859 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:31.361052 11151 raft_consensus.cc:493] T 3af502197ed64f4181fe0513d5527542 P f77602fc49a648cc8d469201d9ad2859 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:31.361306 11151 raft_consensus.cc:3060] T 3af502197ed64f4181fe0513d5527542 P f77602fc49a648cc8d469201d9ad2859 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:31.366298 11151 raft_consensus.cc:515] T 3af502197ed64f4181fe0513d5527542 P f77602fc49a648cc8d469201d9ad2859 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb048a7b080470d87c5c78bbafbe833" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33871 } } peers { permanent_uuid: "5d33b52fc607443586b756116ae39d32" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46693 } } peers { permanent_uuid: "f77602fc49a648cc8d469201d9ad2859" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35111 } }
I20260709 13:03:31.368016 11151 leader_election.cc:290] T 3af502197ed64f4181fe0513d5527542 P f77602fc49a648cc8d469201d9ad2859 [CANDIDATE]: Term 1 election: Requested vote from peers 2fb048a7b080470d87c5c78bbafbe833 (127.0.107.193:33871), 5d33b52fc607443586b756116ae39d32 (127.0.107.194:46693)
I20260709 13:03:31.368784 10955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af502197ed64f4181fe0513d5527542" candidate_uuid: "f77602fc49a648cc8d469201d9ad2859" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fb048a7b080470d87c5c78bbafbe833"
I20260709 13:03:31.368973 11031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af502197ed64f4181fe0513d5527542" candidate_uuid: "f77602fc49a648cc8d469201d9ad2859" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d33b52fc607443586b756116ae39d32"
I20260709 13:03:31.369300 10955 raft_consensus.cc:3060] T 3af502197ed64f4181fe0513d5527542 P 2fb048a7b080470d87c5c78bbafbe833 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:31.369493 11031 raft_consensus.cc:3060] T 3af502197ed64f4181fe0513d5527542 P 5d33b52fc607443586b756116ae39d32 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:31.374127 11031 raft_consensus.cc:2468] T 3af502197ed64f4181fe0513d5527542 P 5d33b52fc607443586b756116ae39d32 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f77602fc49a648cc8d469201d9ad2859 in term 1.
I20260709 13:03:31.374127 10955 raft_consensus.cc:2468] T 3af502197ed64f4181fe0513d5527542 P 2fb048a7b080470d87c5c78bbafbe833 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f77602fc49a648cc8d469201d9ad2859 in term 1.
I20260709 13:03:31.375437 11068 leader_election.cc:304] T 3af502197ed64f4181fe0513d5527542 P f77602fc49a648cc8d469201d9ad2859 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d33b52fc607443586b756116ae39d32, f77602fc49a648cc8d469201d9ad2859; no voters: 
I20260709 13:03:31.376161 11151 raft_consensus.cc:2804] T 3af502197ed64f4181fe0513d5527542 P f77602fc49a648cc8d469201d9ad2859 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:31.376592 11151 raft_consensus.cc:697] T 3af502197ed64f4181fe0513d5527542 P f77602fc49a648cc8d469201d9ad2859 [term 1 LEADER]: Becoming Leader. State: Replica: f77602fc49a648cc8d469201d9ad2859, State: Running, Role: LEADER
I20260709 13:03:31.377202 11151 consensus_queue.cc:237] T 3af502197ed64f4181fe0513d5527542 P f77602fc49a648cc8d469201d9ad2859 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb048a7b080470d87c5c78bbafbe833" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33871 } } peers { permanent_uuid: "5d33b52fc607443586b756116ae39d32" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46693 } } peers { permanent_uuid: "f77602fc49a648cc8d469201d9ad2859" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35111 } }
I20260709 13:03:31.384383 10854 catalog_manager.cc:5697] T 3af502197ed64f4181fe0513d5527542 P f77602fc49a648cc8d469201d9ad2859 reported cstate change: term changed from 0 to 1, leader changed from <none> to f77602fc49a648cc8d469201d9ad2859 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "f77602fc49a648cc8d469201d9ad2859" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb048a7b080470d87c5c78bbafbe833" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d33b52fc607443586b756116ae39d32" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f77602fc49a648cc8d469201d9ad2859" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35111 } health_report { overall_health: HEALTHY } } }
W20260709 13:03:31.415161 10902 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:03:31.436091 11152 raft_consensus.cc:493] T 398fbdd47ee8495082338d265269b718 P 2fb048a7b080470d87c5c78bbafbe833 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.436654 11152 raft_consensus.cc:515] T 398fbdd47ee8495082338d265269b718 P 2fb048a7b080470d87c5c78bbafbe833 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb048a7b080470d87c5c78bbafbe833" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33871 } } peers { permanent_uuid: "5d33b52fc607443586b756116ae39d32" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46693 } } peers { permanent_uuid: "f77602fc49a648cc8d469201d9ad2859" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35111 } }
I20260709 13:03:31.439038 11152 leader_election.cc:290] T 398fbdd47ee8495082338d265269b718 P 2fb048a7b080470d87c5c78bbafbe833 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d33b52fc607443586b756116ae39d32 (127.0.107.194:46693), f77602fc49a648cc8d469201d9ad2859 (127.0.107.195:35111)
I20260709 13:03:31.449544 11031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398fbdd47ee8495082338d265269b718" candidate_uuid: "2fb048a7b080470d87c5c78bbafbe833" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d33b52fc607443586b756116ae39d32" is_pre_election: true
I20260709 13:03:31.449795 11105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398fbdd47ee8495082338d265269b718" candidate_uuid: "2fb048a7b080470d87c5c78bbafbe833" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f77602fc49a648cc8d469201d9ad2859" is_pre_election: true
I20260709 13:03:31.450372 11031 raft_consensus.cc:2468] T 398fbdd47ee8495082338d265269b718 P 5d33b52fc607443586b756116ae39d32 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fb048a7b080470d87c5c78bbafbe833 in term 0.
I20260709 13:03:31.450377 11105 raft_consensus.cc:2468] T 398fbdd47ee8495082338d265269b718 P f77602fc49a648cc8d469201d9ad2859 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fb048a7b080470d87c5c78bbafbe833 in term 0.
I20260709 13:03:31.451704 10919 leader_election.cc:304] T 398fbdd47ee8495082338d265269b718 P 2fb048a7b080470d87c5c78bbafbe833 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fb048a7b080470d87c5c78bbafbe833, 5d33b52fc607443586b756116ae39d32; no voters: 
I20260709 13:03:31.452359 11152 raft_consensus.cc:2804] T 398fbdd47ee8495082338d265269b718 P 2fb048a7b080470d87c5c78bbafbe833 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:31.452651 11152 raft_consensus.cc:493] T 398fbdd47ee8495082338d265269b718 P 2fb048a7b080470d87c5c78bbafbe833 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:31.452906 11152 raft_consensus.cc:3060] T 398fbdd47ee8495082338d265269b718 P 2fb048a7b080470d87c5c78bbafbe833 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:31.458099 11152 raft_consensus.cc:515] T 398fbdd47ee8495082338d265269b718 P 2fb048a7b080470d87c5c78bbafbe833 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb048a7b080470d87c5c78bbafbe833" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33871 } } peers { permanent_uuid: "5d33b52fc607443586b756116ae39d32" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46693 } } peers { permanent_uuid: "f77602fc49a648cc8d469201d9ad2859" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35111 } }
I20260709 13:03:31.459743 11152 leader_election.cc:290] T 398fbdd47ee8495082338d265269b718 P 2fb048a7b080470d87c5c78bbafbe833 [CANDIDATE]: Term 1 election: Requested vote from peers 5d33b52fc607443586b756116ae39d32 (127.0.107.194:46693), f77602fc49a648cc8d469201d9ad2859 (127.0.107.195:35111)
I20260709 13:03:31.460666 11031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398fbdd47ee8495082338d265269b718" candidate_uuid: "2fb048a7b080470d87c5c78bbafbe833" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d33b52fc607443586b756116ae39d32"
I20260709 13:03:31.460840 11105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398fbdd47ee8495082338d265269b718" candidate_uuid: "2fb048a7b080470d87c5c78bbafbe833" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f77602fc49a648cc8d469201d9ad2859"
I20260709 13:03:31.461206 11031 raft_consensus.cc:3060] T 398fbdd47ee8495082338d265269b718 P 5d33b52fc607443586b756116ae39d32 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:31.461417 11105 raft_consensus.cc:3060] T 398fbdd47ee8495082338d265269b718 P f77602fc49a648cc8d469201d9ad2859 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:31.466493 11031 raft_consensus.cc:2468] T 398fbdd47ee8495082338d265269b718 P 5d33b52fc607443586b756116ae39d32 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fb048a7b080470d87c5c78bbafbe833 in term 1.
I20260709 13:03:31.466533 11105 raft_consensus.cc:2468] T 398fbdd47ee8495082338d265269b718 P f77602fc49a648cc8d469201d9ad2859 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fb048a7b080470d87c5c78bbafbe833 in term 1.
I20260709 13:03:31.467730 10919 leader_election.cc:304] T 398fbdd47ee8495082338d265269b718 P 2fb048a7b080470d87c5c78bbafbe833 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fb048a7b080470d87c5c78bbafbe833, 5d33b52fc607443586b756116ae39d32; no voters: 
I20260709 13:03:31.468407 11152 raft_consensus.cc:2804] T 398fbdd47ee8495082338d265269b718 P 2fb048a7b080470d87c5c78bbafbe833 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:31.469393 11152 raft_consensus.cc:697] T 398fbdd47ee8495082338d265269b718 P 2fb048a7b080470d87c5c78bbafbe833 [term 1 LEADER]: Becoming Leader. State: Replica: 2fb048a7b080470d87c5c78bbafbe833, State: Running, Role: LEADER
I20260709 13:03:31.470052 11152 consensus_queue.cc:237] T 398fbdd47ee8495082338d265269b718 P 2fb048a7b080470d87c5c78bbafbe833 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb048a7b080470d87c5c78bbafbe833" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33871 } } peers { permanent_uuid: "5d33b52fc607443586b756116ae39d32" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46693 } } peers { permanent_uuid: "f77602fc49a648cc8d469201d9ad2859" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35111 } }
I20260709 13:03:31.477283 10854 catalog_manager.cc:5697] T 398fbdd47ee8495082338d265269b718 P 2fb048a7b080470d87c5c78bbafbe833 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2fb048a7b080470d87c5c78bbafbe833 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "2fb048a7b080470d87c5c78bbafbe833" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb048a7b080470d87c5c78bbafbe833" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d33b52fc607443586b756116ae39d32" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f77602fc49a648cc8d469201d9ad2859" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:31.530911 11031 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "271483c6d24f4c638351ee7b145d8a90"
dest_uuid: "5d33b52fc607443586b756116ae39d32"
mode: GRACEFUL
new_leader_uuid: "2fb048a7b080470d87c5c78bbafbe833"
 from {username='slave'} at 127.0.0.1:34356
I20260709 13:03:31.531443 11031 raft_consensus.cc:606] T 271483c6d24f4c638351ee7b145d8a90 P 5d33b52fc607443586b756116ae39d32 [term 1 LEADER]: Received request to transfer leadership to TS 2fb048a7b080470d87c5c78bbafbe833
I20260709 13:03:31.543628 11105 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0c357d1f432146c48ba178e6681fcfa0"
dest_uuid: "f77602fc49a648cc8d469201d9ad2859"
mode: GRACEFUL
new_leader_uuid: "5d33b52fc607443586b756116ae39d32"
 from {username='slave'} at 127.0.0.1:37262
I20260709 13:03:31.544154 11105 raft_consensus.cc:606] T 0c357d1f432146c48ba178e6681fcfa0 P f77602fc49a648cc8d469201d9ad2859 [term 1 LEADER]: Received request to transfer leadership to TS 5d33b52fc607443586b756116ae39d32
I20260709 13:03:31.544277 11153 consensus_queue.cc:1048] T 271483c6d24f4c638351ee7b145d8a90 P 5d33b52fc607443586b756116ae39d32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fb048a7b080470d87c5c78bbafbe833" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:31.553232 11182 raft_consensus.cc:993] T 271483c6d24f4c638351ee7b145d8a90 P 5d33b52fc607443586b756116ae39d32: : Instructing follower 2fb048a7b080470d87c5c78bbafbe833 to start an election
I20260709 13:03:31.553751 11153 raft_consensus.cc:1081] T 271483c6d24f4c638351ee7b145d8a90 P 5d33b52fc607443586b756116ae39d32 [term 1 LEADER]: Signalling peer 2fb048a7b080470d87c5c78bbafbe833 to start an election
I20260709 13:03:31.555426 10956 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "271483c6d24f4c638351ee7b145d8a90"
dest_uuid: "2fb048a7b080470d87c5c78bbafbe833"
 from {username='slave'} at 127.0.0.1:38370
I20260709 13:03:31.557175 10956 raft_consensus.cc:493] T 271483c6d24f4c638351ee7b145d8a90 P 2fb048a7b080470d87c5c78bbafbe833 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:31.557592 10956 raft_consensus.cc:3060] T 271483c6d24f4c638351ee7b145d8a90 P 2fb048a7b080470d87c5c78bbafbe833 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:31.561602 11153 consensus_queue.cc:1048] T 271483c6d24f4c638351ee7b145d8a90 P 5d33b52fc607443586b756116ae39d32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f77602fc49a648cc8d469201d9ad2859" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:31.616258 11105 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3af502197ed64f4181fe0513d5527542"
dest_uuid: "f77602fc49a648cc8d469201d9ad2859"
mode: GRACEFUL
new_leader_uuid: "2fb048a7b080470d87c5c78bbafbe833"
 from {username='slave'} at 127.0.0.1:37262
I20260709 13:03:31.617762 11105 raft_consensus.cc:606] T 3af502197ed64f4181fe0513d5527542 P f77602fc49a648cc8d469201d9ad2859 [term 1 LEADER]: Received request to transfer leadership to TS 2fb048a7b080470d87c5c78bbafbe833
I20260709 13:03:31.617689 11151 consensus_queue.cc:1048] T 0c357d1f432146c48ba178e6681fcfa0 P f77602fc49a648cc8d469201d9ad2859 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fb048a7b080470d87c5c78bbafbe833" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:31.619470 11160 consensus_queue.cc:1048] T 0c357d1f432146c48ba178e6681fcfa0 P f77602fc49a648cc8d469201d9ad2859 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d33b52fc607443586b756116ae39d32" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:31.618183 10956 raft_consensus.cc:515] T 271483c6d24f4c638351ee7b145d8a90 P 2fb048a7b080470d87c5c78bbafbe833 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f77602fc49a648cc8d469201d9ad2859" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35111 } } peers { permanent_uuid: "5d33b52fc607443586b756116ae39d32" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46693 } } peers { permanent_uuid: "2fb048a7b080470d87c5c78bbafbe833" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33871 } }
I20260709 13:03:31.627903 10956 leader_election.cc:290] T 271483c6d24f4c638351ee7b145d8a90 P 2fb048a7b080470d87c5c78bbafbe833 [CANDIDATE]: Term 2 election: Requested vote from peers f77602fc49a648cc8d469201d9ad2859 (127.0.107.195:35111), 5d33b52fc607443586b756116ae39d32 (127.0.107.194:46693)
I20260709 13:03:31.630270 11030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271483c6d24f4c638351ee7b145d8a90" candidate_uuid: "2fb048a7b080470d87c5c78bbafbe833" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5d33b52fc607443586b756116ae39d32"
I20260709 13:03:31.631455 11030 raft_consensus.cc:3055] T 271483c6d24f4c638351ee7b145d8a90 P 5d33b52fc607443586b756116ae39d32 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:31.631846 11030 raft_consensus.cc:740] T 271483c6d24f4c638351ee7b145d8a90 P 5d33b52fc607443586b756116ae39d32 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5d33b52fc607443586b756116ae39d32, State: Running, Role: LEADER
I20260709 13:03:31.633183 11030 consensus_queue.cc:260] T 271483c6d24f4c638351ee7b145d8a90 P 5d33b52fc607443586b756116ae39d32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f77602fc49a648cc8d469201d9ad2859" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35111 } } peers { permanent_uuid: "5d33b52fc607443586b756116ae39d32" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46693 } } peers { permanent_uuid: "2fb048a7b080470d87c5c78bbafbe833" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33871 } }
I20260709 13:03:31.630386 11105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271483c6d24f4c638351ee7b145d8a90" candidate_uuid: "2fb048a7b080470d87c5c78bbafbe833" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f77602fc49a648cc8d469201d9ad2859"
I20260709 13:03:31.635744 11105 raft_consensus.cc:3060] T 271483c6d24f4c638351ee7b145d8a90 P f77602fc49a648cc8d469201d9ad2859 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:31.636224 11030 raft_consensus.cc:3060] T 271483c6d24f4c638351ee7b145d8a90 P 5d33b52fc607443586b756116ae39d32 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:31.646564 11105 raft_consensus.cc:2468] T 271483c6d24f4c638351ee7b145d8a90 P f77602fc49a648cc8d469201d9ad2859 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fb048a7b080470d87c5c78bbafbe833 in term 2.
I20260709 13:03:31.648512 10921 leader_election.cc:304] T 271483c6d24f4c638351ee7b145d8a90 P 2fb048a7b080470d87c5c78bbafbe833 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fb048a7b080470d87c5c78bbafbe833, f77602fc49a648cc8d469201d9ad2859; no voters: 
I20260709 13:03:31.649780 11152 raft_consensus.cc:2804] T 271483c6d24f4c638351ee7b145d8a90 P 2fb048a7b080470d87c5c78bbafbe833 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:31.650374 11152 raft_consensus.cc:697] T 271483c6d24f4c638351ee7b145d8a90 P 2fb048a7b080470d87c5c78bbafbe833 [term 2 LEADER]: Becoming Leader. State: Replica: 2fb048a7b080470d87c5c78bbafbe833, State: Running, Role: LEADER
I20260709 13:03:31.650877 11030 raft_consensus.cc:2468] T 271483c6d24f4c638351ee7b145d8a90 P 5d33b52fc607443586b756116ae39d32 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fb048a7b080470d87c5c78bbafbe833 in term 2.
I20260709 13:03:31.651695 11152 consensus_queue.cc:237] T 271483c6d24f4c638351ee7b145d8a90 P 2fb048a7b080470d87c5c78bbafbe833 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f77602fc49a648cc8d469201d9ad2859" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35111 } } peers { permanent_uuid: "5d33b52fc607443586b756116ae39d32" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46693 } } peers { permanent_uuid: "2fb048a7b080470d87c5c78bbafbe833" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33871 } }
I20260709 13:03:31.653256 11160 raft_consensus.cc:993] T 0c357d1f432146c48ba178e6681fcfa0 P f77602fc49a648cc8d469201d9ad2859: : Instructing follower 5d33b52fc607443586b756116ae39d32 to start an election
I20260709 13:03:31.654551 11151 raft_consensus.cc:1081] T 0c357d1f432146c48ba178e6681fcfa0 P f77602fc49a648cc8d469201d9ad2859 [term 1 LEADER]: Signalling peer 5d33b52fc607443586b756116ae39d32 to start an election
I20260709 13:03:31.657704 11031 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0c357d1f432146c48ba178e6681fcfa0"
dest_uuid: "5d33b52fc607443586b756116ae39d32"
 from {username='slave'} at 127.0.0.1:34326
I20260709 13:03:31.659327 11031 raft_consensus.cc:493] T 0c357d1f432146c48ba178e6681fcfa0 P 5d33b52fc607443586b756116ae39d32 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:31.659890 11031 raft_consensus.cc:3060] T 0c357d1f432146c48ba178e6681fcfa0 P 5d33b52fc607443586b756116ae39d32 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:31.670419 11031 raft_consensus.cc:515] T 0c357d1f432146c48ba178e6681fcfa0 P 5d33b52fc607443586b756116ae39d32 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb048a7b080470d87c5c78bbafbe833" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33871 } } peers { permanent_uuid: "5d33b52fc607443586b756116ae39d32" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46693 } } peers { permanent_uuid: "f77602fc49a648cc8d469201d9ad2859" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35111 } }
I20260709 13:03:31.670652 10851 catalog_manager.cc:5697] T 271483c6d24f4c638351ee7b145d8a90 P 2fb048a7b080470d87c5c78bbafbe833 reported cstate change: term changed from 1 to 2, leader changed from 5d33b52fc607443586b756116ae39d32 (127.0.107.194) to 2fb048a7b080470d87c5c78bbafbe833 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "2fb048a7b080470d87c5c78bbafbe833" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f77602fc49a648cc8d469201d9ad2859" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d33b52fc607443586b756116ae39d32" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fb048a7b080470d87c5c78bbafbe833" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33871 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:31.674790 11030 raft_consensus.cc:1240] T 0c357d1f432146c48ba178e6681fcfa0 P 5d33b52fc607443586b756116ae39d32 [term 2 FOLLOWER]: Rejecting Update request from peer f77602fc49a648cc8d469201d9ad2859 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:31.679097 10956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c357d1f432146c48ba178e6681fcfa0" candidate_uuid: "5d33b52fc607443586b756116ae39d32" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2fb048a7b080470d87c5c78bbafbe833"
I20260709 13:03:31.679756 10956 raft_consensus.cc:3060] T 0c357d1f432146c48ba178e6681fcfa0 P 2fb048a7b080470d87c5c78bbafbe833 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:31.681319 11190 consensus_queue.cc:1059] T 0c357d1f432146c48ba178e6681fcfa0 P f77602fc49a648cc8d469201d9ad2859 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d33b52fc607443586b756116ae39d32" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46693 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:31.682637 11031 leader_election.cc:290] T 0c357d1f432146c48ba178e6681fcfa0 P 5d33b52fc607443586b756116ae39d32 [CANDIDATE]: Term 2 election: Requested vote from peers 2fb048a7b080470d87c5c78bbafbe833 (127.0.107.193:33871), f77602fc49a648cc8d469201d9ad2859 (127.0.107.195:35111)
I20260709 13:03:31.683379 11105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c357d1f432146c48ba178e6681fcfa0" candidate_uuid: "5d33b52fc607443586b756116ae39d32" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f77602fc49a648cc8d469201d9ad2859"
I20260709 13:03:31.684118 11105 raft_consensus.cc:3055] T 0c357d1f432146c48ba178e6681fcfa0 P f77602fc49a648cc8d469201d9ad2859 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:31.684491 11105 raft_consensus.cc:740] T 0c357d1f432146c48ba178e6681fcfa0 P f77602fc49a648cc8d469201d9ad2859 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f77602fc49a648cc8d469201d9ad2859, State: Running, Role: LEADER
I20260709 13:03:31.685680 11105 consensus_queue.cc:260] T 0c357d1f432146c48ba178e6681fcfa0 P f77602fc49a648cc8d469201d9ad2859 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb048a7b080470d87c5c78bbafbe833" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33871 } } peers { permanent_uuid: "5d33b52fc607443586b756116ae39d32" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46693 } } peers { permanent_uuid: "f77602fc49a648cc8d469201d9ad2859" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35111 } }
I20260709 13:03:31.687412 11105 raft_consensus.cc:3060] T 0c357d1f432146c48ba178e6681fcfa0 P f77602fc49a648cc8d469201d9ad2859 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:31.690240 10956 raft_consensus.cc:2468] T 0c357d1f432146c48ba178e6681fcfa0 P 2fb048a7b080470d87c5c78bbafbe833 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d33b52fc607443586b756116ae39d32 in term 2.
I20260709 13:03:31.691936 10995 leader_election.cc:304] T 0c357d1f432146c48ba178e6681fcfa0 P 5d33b52fc607443586b756116ae39d32 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fb048a7b080470d87c5c78bbafbe833, 5d33b52fc607443586b756116ae39d32; no voters: 
I20260709 13:03:31.692979 11153 raft_consensus.cc:2804] T 0c357d1f432146c48ba178e6681fcfa0 P 5d33b52fc607443586b756116ae39d32 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:31.693482 11153 raft_consensus.cc:697] T 0c357d1f432146c48ba178e6681fcfa0 P 5d33b52fc607443586b756116ae39d32 [term 2 LEADER]: Becoming Leader. State: Replica: 5d33b52fc607443586b756116ae39d32, State: Running, Role: LEADER
I20260709 13:03:31.693809 11105 raft_consensus.cc:2468] T 0c357d1f432146c48ba178e6681fcfa0 P f77602fc49a648cc8d469201d9ad2859 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d33b52fc607443586b756116ae39d32 in term 2.
I20260709 13:03:31.694612 11153 consensus_queue.cc:237] T 0c357d1f432146c48ba178e6681fcfa0 P 5d33b52fc607443586b756116ae39d32 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb048a7b080470d87c5c78bbafbe833" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33871 } } peers { permanent_uuid: "5d33b52fc607443586b756116ae39d32" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46693 } } peers { permanent_uuid: "f77602fc49a648cc8d469201d9ad2859" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35111 } }
W20260709 13:03:31.696856 11151 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:03:31.704711 10851 catalog_manager.cc:5697] T 0c357d1f432146c48ba178e6681fcfa0 P 5d33b52fc607443586b756116ae39d32 reported cstate change: term changed from 1 to 2, leader changed from f77602fc49a648cc8d469201d9ad2859 (127.0.107.195) to 5d33b52fc607443586b756116ae39d32 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "5d33b52fc607443586b756116ae39d32" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb048a7b080470d87c5c78bbafbe833" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d33b52fc607443586b756116ae39d32" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46693 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f77602fc49a648cc8d469201d9ad2859" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:31.759076 11151 consensus_queue.cc:1048] T 3af502197ed64f4181fe0513d5527542 P f77602fc49a648cc8d469201d9ad2859 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d33b52fc607443586b756116ae39d32" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:31.770687 11151 consensus_queue.cc:1048] T 3af502197ed64f4181fe0513d5527542 P f77602fc49a648cc8d469201d9ad2859 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fb048a7b080470d87c5c78bbafbe833" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:31.790266 11190 raft_consensus.cc:993] T 3af502197ed64f4181fe0513d5527542 P f77602fc49a648cc8d469201d9ad2859: : Instructing follower 2fb048a7b080470d87c5c78bbafbe833 to start an election
I20260709 13:03:31.790947 11192 raft_consensus.cc:1081] T 3af502197ed64f4181fe0513d5527542 P f77602fc49a648cc8d469201d9ad2859 [term 1 LEADER]: Signalling peer 2fb048a7b080470d87c5c78bbafbe833 to start an election
I20260709 13:03:31.792790 10956 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3af502197ed64f4181fe0513d5527542"
dest_uuid: "2fb048a7b080470d87c5c78bbafbe833"
 from {username='slave'} at 127.0.0.1:38362
I20260709 13:03:31.793308 10956 raft_consensus.cc:493] T 3af502197ed64f4181fe0513d5527542 P 2fb048a7b080470d87c5c78bbafbe833 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:31.793665 10956 raft_consensus.cc:3060] T 3af502197ed64f4181fe0513d5527542 P 2fb048a7b080470d87c5c78bbafbe833 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:31.799579 10956 raft_consensus.cc:515] T 3af502197ed64f4181fe0513d5527542 P 2fb048a7b080470d87c5c78bbafbe833 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb048a7b080470d87c5c78bbafbe833" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33871 } } peers { permanent_uuid: "5d33b52fc607443586b756116ae39d32" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46693 } } peers { permanent_uuid: "f77602fc49a648cc8d469201d9ad2859" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35111 } }
I20260709 13:03:31.801748 10956 leader_election.cc:290] T 3af502197ed64f4181fe0513d5527542 P 2fb048a7b080470d87c5c78bbafbe833 [CANDIDATE]: Term 2 election: Requested vote from peers 5d33b52fc607443586b756116ae39d32 (127.0.107.194:46693), f77602fc49a648cc8d469201d9ad2859 (127.0.107.195:35111)
I20260709 13:03:31.802591 11031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af502197ed64f4181fe0513d5527542" candidate_uuid: "2fb048a7b080470d87c5c78bbafbe833" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5d33b52fc607443586b756116ae39d32"
I20260709 13:03:31.803028 11105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3af502197ed64f4181fe0513d5527542" candidate_uuid: "2fb048a7b080470d87c5c78bbafbe833" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f77602fc49a648cc8d469201d9ad2859"
I20260709 13:03:31.803309 11031 raft_consensus.cc:3060] T 3af502197ed64f4181fe0513d5527542 P 5d33b52fc607443586b756116ae39d32 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:31.803674 11105 raft_consensus.cc:3055] T 3af502197ed64f4181fe0513d5527542 P f77602fc49a648cc8d469201d9ad2859 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:31.804052 11105 raft_consensus.cc:740] T 3af502197ed64f4181fe0513d5527542 P f77602fc49a648cc8d469201d9ad2859 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f77602fc49a648cc8d469201d9ad2859, State: Running, Role: LEADER
I20260709 13:03:31.804971 11105 consensus_queue.cc:260] T 3af502197ed64f4181fe0513d5527542 P f77602fc49a648cc8d469201d9ad2859 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb048a7b080470d87c5c78bbafbe833" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33871 } } peers { permanent_uuid: "5d33b52fc607443586b756116ae39d32" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46693 } } peers { permanent_uuid: "f77602fc49a648cc8d469201d9ad2859" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35111 } }
I20260709 13:03:31.806298 11105 raft_consensus.cc:3060] T 3af502197ed64f4181fe0513d5527542 P f77602fc49a648cc8d469201d9ad2859 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:31.809075 11031 raft_consensus.cc:2468] T 3af502197ed64f4181fe0513d5527542 P 5d33b52fc607443586b756116ae39d32 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fb048a7b080470d87c5c78bbafbe833 in term 2.
I20260709 13:03:31.810245 10919 leader_election.cc:304] T 3af502197ed64f4181fe0513d5527542 P 2fb048a7b080470d87c5c78bbafbe833 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fb048a7b080470d87c5c78bbafbe833, 5d33b52fc607443586b756116ae39d32; no voters: 
I20260709 13:03:31.811096 11152 raft_consensus.cc:2804] T 3af502197ed64f4181fe0513d5527542 P 2fb048a7b080470d87c5c78bbafbe833 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:31.811578 11152 raft_consensus.cc:697] T 3af502197ed64f4181fe0513d5527542 P 2fb048a7b080470d87c5c78bbafbe833 [term 2 LEADER]: Becoming Leader. State: Replica: 2fb048a7b080470d87c5c78bbafbe833, State: Running, Role: LEADER
I20260709 13:03:31.812599 11105 raft_consensus.cc:2468] T 3af502197ed64f4181fe0513d5527542 P f77602fc49a648cc8d469201d9ad2859 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fb048a7b080470d87c5c78bbafbe833 in term 2.
I20260709 13:03:31.812635 11152 consensus_queue.cc:237] T 3af502197ed64f4181fe0513d5527542 P 2fb048a7b080470d87c5c78bbafbe833 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb048a7b080470d87c5c78bbafbe833" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33871 } } peers { permanent_uuid: "5d33b52fc607443586b756116ae39d32" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46693 } } peers { permanent_uuid: "f77602fc49a648cc8d469201d9ad2859" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35111 } }
I20260709 13:03:31.820148 10853 catalog_manager.cc:5697] T 3af502197ed64f4181fe0513d5527542 P 2fb048a7b080470d87c5c78bbafbe833 reported cstate change: term changed from 1 to 2, leader changed from f77602fc49a648cc8d469201d9ad2859 (127.0.107.195) to 2fb048a7b080470d87c5c78bbafbe833 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "2fb048a7b080470d87c5c78bbafbe833" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb048a7b080470d87c5c78bbafbe833" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d33b52fc607443586b756116ae39d32" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f77602fc49a648cc8d469201d9ad2859" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:31.833181   431 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 13:03:31.834792   431 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 13:03:31.835137   431 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 13:03:31.848353 10956 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "398fbdd47ee8495082338d265269b718"
dest_uuid: "2fb048a7b080470d87c5c78bbafbe833"
mode: GRACEFUL
new_leader_uuid: "f77602fc49a648cc8d469201d9ad2859"
 from {username='slave'} at 127.0.0.1:38386
I20260709 13:03:31.848866 10956 raft_consensus.cc:606] T 398fbdd47ee8495082338d265269b718 P 2fb048a7b080470d87c5c78bbafbe833 [term 1 LEADER]: Received request to transfer leadership to TS f77602fc49a648cc8d469201d9ad2859
I20260709 13:03:31.850111   431 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 13:03:32.020172 11152 consensus_queue.cc:1048] T 398fbdd47ee8495082338d265269b718 P 2fb048a7b080470d87c5c78bbafbe833 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d33b52fc607443586b756116ae39d32" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:32.033237 11152 consensus_queue.cc:1048] T 398fbdd47ee8495082338d265269b718 P 2fb048a7b080470d87c5c78bbafbe833 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f77602fc49a648cc8d469201d9ad2859" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:32.041594 11177 raft_consensus.cc:993] T 398fbdd47ee8495082338d265269b718 P 2fb048a7b080470d87c5c78bbafbe833: : Instructing follower f77602fc49a648cc8d469201d9ad2859 to start an election
I20260709 13:03:32.042183 11197 raft_consensus.cc:1081] T 398fbdd47ee8495082338d265269b718 P 2fb048a7b080470d87c5c78bbafbe833 [term 1 LEADER]: Signalling peer f77602fc49a648cc8d469201d9ad2859 to start an election
I20260709 13:03:32.043852 11031 raft_consensus.cc:1275] T 271483c6d24f4c638351ee7b145d8a90 P 5d33b52fc607443586b756116ae39d32 [term 2 FOLLOWER]: Refusing update from remote peer 2fb048a7b080470d87c5c78bbafbe833: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:32.044638 11105 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "398fbdd47ee8495082338d265269b718"
dest_uuid: "f77602fc49a648cc8d469201d9ad2859"
 from {username='slave'} at 127.0.0.1:37248
I20260709 13:03:32.045224 11105 raft_consensus.cc:493] T 398fbdd47ee8495082338d265269b718 P f77602fc49a648cc8d469201d9ad2859 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:32.045595 11105 raft_consensus.cc:3060] T 398fbdd47ee8495082338d265269b718 P f77602fc49a648cc8d469201d9ad2859 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:32.045495 11197 consensus_queue.cc:1048] T 271483c6d24f4c638351ee7b145d8a90 P 2fb048a7b080470d87c5c78bbafbe833 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d33b52fc607443586b756116ae39d32" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:32.055716 11104 raft_consensus.cc:1275] T 271483c6d24f4c638351ee7b145d8a90 P f77602fc49a648cc8d469201d9ad2859 [term 2 FOLLOWER]: Refusing update from remote peer 2fb048a7b080470d87c5c78bbafbe833: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:32.058198 11105 raft_consensus.cc:515] T 398fbdd47ee8495082338d265269b718 P f77602fc49a648cc8d469201d9ad2859 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb048a7b080470d87c5c78bbafbe833" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33871 } } peers { permanent_uuid: "5d33b52fc607443586b756116ae39d32" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46693 } } peers { permanent_uuid: "f77602fc49a648cc8d469201d9ad2859" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35111 } }
I20260709 13:03:32.058818 11197 consensus_queue.cc:1048] T 271483c6d24f4c638351ee7b145d8a90 P 2fb048a7b080470d87c5c78bbafbe833 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f77602fc49a648cc8d469201d9ad2859" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:32.063057 10956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398fbdd47ee8495082338d265269b718" candidate_uuid: "f77602fc49a648cc8d469201d9ad2859" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2fb048a7b080470d87c5c78bbafbe833"
I20260709 13:03:32.063701 10956 raft_consensus.cc:3055] T 398fbdd47ee8495082338d265269b718 P 2fb048a7b080470d87c5c78bbafbe833 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:32.064006 10956 raft_consensus.cc:740] T 398fbdd47ee8495082338d265269b718 P 2fb048a7b080470d87c5c78bbafbe833 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2fb048a7b080470d87c5c78bbafbe833, State: Running, Role: LEADER
I20260709 13:03:32.064931 10956 consensus_queue.cc:260] T 398fbdd47ee8495082338d265269b718 P 2fb048a7b080470d87c5c78bbafbe833 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb048a7b080470d87c5c78bbafbe833" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33871 } } peers { permanent_uuid: "5d33b52fc607443586b756116ae39d32" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46693 } } peers { permanent_uuid: "f77602fc49a648cc8d469201d9ad2859" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35111 } }
I20260709 13:03:32.070744 10956 raft_consensus.cc:3060] T 398fbdd47ee8495082338d265269b718 P 2fb048a7b080470d87c5c78bbafbe833 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:32.079216 11105 leader_election.cc:290] T 398fbdd47ee8495082338d265269b718 P f77602fc49a648cc8d469201d9ad2859 [CANDIDATE]: Term 2 election: Requested vote from peers 2fb048a7b080470d87c5c78bbafbe833 (127.0.107.193:33871), 5d33b52fc607443586b756116ae39d32 (127.0.107.194:46693)
I20260709 13:03:32.080339 11031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398fbdd47ee8495082338d265269b718" candidate_uuid: "f77602fc49a648cc8d469201d9ad2859" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5d33b52fc607443586b756116ae39d32"
I20260709 13:03:32.080709 10956 raft_consensus.cc:2468] T 398fbdd47ee8495082338d265269b718 P 2fb048a7b080470d87c5c78bbafbe833 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f77602fc49a648cc8d469201d9ad2859 in term 2.
I20260709 13:03:32.081069 11031 raft_consensus.cc:3060] T 398fbdd47ee8495082338d265269b718 P 5d33b52fc607443586b756116ae39d32 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:32.082052 11069 leader_election.cc:304] T 398fbdd47ee8495082338d265269b718 P f77602fc49a648cc8d469201d9ad2859 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fb048a7b080470d87c5c78bbafbe833, f77602fc49a648cc8d469201d9ad2859; no voters: 
I20260709 13:03:32.082953 11192 raft_consensus.cc:2804] T 398fbdd47ee8495082338d265269b718 P f77602fc49a648cc8d469201d9ad2859 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:32.083436 11192 raft_consensus.cc:697] T 398fbdd47ee8495082338d265269b718 P f77602fc49a648cc8d469201d9ad2859 [term 2 LEADER]: Becoming Leader. State: Replica: f77602fc49a648cc8d469201d9ad2859, State: Running, Role: LEADER
I20260709 13:03:32.084396 11192 consensus_queue.cc:237] T 398fbdd47ee8495082338d265269b718 P f77602fc49a648cc8d469201d9ad2859 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb048a7b080470d87c5c78bbafbe833" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33871 } } peers { permanent_uuid: "5d33b52fc607443586b756116ae39d32" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46693 } } peers { permanent_uuid: "f77602fc49a648cc8d469201d9ad2859" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35111 } }
I20260709 13:03:32.087879 10956 raft_consensus.cc:1275] T 0c357d1f432146c48ba178e6681fcfa0 P 2fb048a7b080470d87c5c78bbafbe833 [term 2 FOLLOWER]: Refusing update from remote peer 5d33b52fc607443586b756116ae39d32: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:32.088387 11031 raft_consensus.cc:2468] T 398fbdd47ee8495082338d265269b718 P 5d33b52fc607443586b756116ae39d32 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f77602fc49a648cc8d469201d9ad2859 in term 2.
I20260709 13:03:32.089439 11153 consensus_queue.cc:1048] T 0c357d1f432146c48ba178e6681fcfa0 P 5d33b52fc607443586b756116ae39d32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fb048a7b080470d87c5c78bbafbe833" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:32.092386 10851 catalog_manager.cc:5697] T 398fbdd47ee8495082338d265269b718 P f77602fc49a648cc8d469201d9ad2859 reported cstate change: term changed from 1 to 2, leader changed from 2fb048a7b080470d87c5c78bbafbe833 (127.0.107.193) to f77602fc49a648cc8d469201d9ad2859 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "f77602fc49a648cc8d469201d9ad2859" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb048a7b080470d87c5c78bbafbe833" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d33b52fc607443586b756116ae39d32" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f77602fc49a648cc8d469201d9ad2859" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35111 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:32.102618 11105 raft_consensus.cc:1275] T 0c357d1f432146c48ba178e6681fcfa0 P f77602fc49a648cc8d469201d9ad2859 [term 2 FOLLOWER]: Refusing update from remote peer 5d33b52fc607443586b756116ae39d32: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:32.104267 11153 consensus_queue.cc:1048] T 0c357d1f432146c48ba178e6681fcfa0 P 5d33b52fc607443586b756116ae39d32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f77602fc49a648cc8d469201d9ad2859" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 35111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:32.214506   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
I20260709 13:03:32.237960   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:32.238721   431 tablet_replica.cc:333] T 3af502197ed64f4181fe0513d5527542 P 2fb048a7b080470d87c5c78bbafbe833: stopping tablet replica
I20260709 13:03:32.239467   431 raft_consensus.cc:2243] T 3af502197ed64f4181fe0513d5527542 P 2fb048a7b080470d87c5c78bbafbe833 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:32.240124   431 pending_rounds.cc:70] T 3af502197ed64f4181fe0513d5527542 P 2fb048a7b080470d87c5c78bbafbe833: Trying to abort 1 pending ops.
I20260709 13:03:32.240326   431 pending_rounds.cc:77] T 3af502197ed64f4181fe0513d5527542 P 2fb048a7b080470d87c5c78bbafbe833: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305634659594272768 op_type: NO_OP noop_request { }
I20260709 13:03:32.240614   431 raft_consensus.cc:2889] T 3af502197ed64f4181fe0513d5527542 P 2fb048a7b080470d87c5c78bbafbe833 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:03:32.240875   431 raft_consensus.cc:2272] T 3af502197ed64f4181fe0513d5527542 P 2fb048a7b080470d87c5c78bbafbe833 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:32.243814   431 tablet_replica.cc:333] T 398fbdd47ee8495082338d265269b718 P 2fb048a7b080470d87c5c78bbafbe833: stopping tablet replica
I20260709 13:03:32.244438   431 raft_consensus.cc:2243] T 398fbdd47ee8495082338d265269b718 P 2fb048a7b080470d87c5c78bbafbe833 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:32.244856   431 raft_consensus.cc:2272] T 398fbdd47ee8495082338d265269b718 P 2fb048a7b080470d87c5c78bbafbe833 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:32.247655   431 tablet_replica.cc:333] T 0c357d1f432146c48ba178e6681fcfa0 P 2fb048a7b080470d87c5c78bbafbe833: stopping tablet replica
I20260709 13:03:32.248198   431 raft_consensus.cc:2243] T 0c357d1f432146c48ba178e6681fcfa0 P 2fb048a7b080470d87c5c78bbafbe833 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:32.248636   431 raft_consensus.cc:2272] T 0c357d1f432146c48ba178e6681fcfa0 P 2fb048a7b080470d87c5c78bbafbe833 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:32.251260   431 tablet_replica.cc:333] T 271483c6d24f4c638351ee7b145d8a90 P 2fb048a7b080470d87c5c78bbafbe833: stopping tablet replica
I20260709 13:03:32.251803   431 raft_consensus.cc:2243] T 271483c6d24f4c638351ee7b145d8a90 P 2fb048a7b080470d87c5c78bbafbe833 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:32.252583   431 raft_consensus.cc:2272] T 271483c6d24f4c638351ee7b145d8a90 P 2fb048a7b080470d87c5c78bbafbe833 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:32.280151   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
I20260709 13:03:32.297597   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
I20260709 13:03:32.318413   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:32.319164   431 tablet_replica.cc:333] T 398fbdd47ee8495082338d265269b718 P 5d33b52fc607443586b756116ae39d32: stopping tablet replica
I20260709 13:03:32.319867   431 raft_consensus.cc:2243] T 398fbdd47ee8495082338d265269b718 P 5d33b52fc607443586b756116ae39d32 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:32.320300   431 raft_consensus.cc:2272] T 398fbdd47ee8495082338d265269b718 P 5d33b52fc607443586b756116ae39d32 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:32.323019   431 tablet_replica.cc:333] T 3af502197ed64f4181fe0513d5527542 P 5d33b52fc607443586b756116ae39d32: stopping tablet replica
I20260709 13:03:32.323527   431 raft_consensus.cc:2243] T 3af502197ed64f4181fe0513d5527542 P 5d33b52fc607443586b756116ae39d32 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:32.323911   431 raft_consensus.cc:2272] T 3af502197ed64f4181fe0513d5527542 P 5d33b52fc607443586b756116ae39d32 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:32.326519   431 tablet_replica.cc:333] T 0c357d1f432146c48ba178e6681fcfa0 P 5d33b52fc607443586b756116ae39d32: stopping tablet replica
I20260709 13:03:32.327134   431 raft_consensus.cc:2243] T 0c357d1f432146c48ba178e6681fcfa0 P 5d33b52fc607443586b756116ae39d32 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:32.327920   431 raft_consensus.cc:2272] T 0c357d1f432146c48ba178e6681fcfa0 P 5d33b52fc607443586b756116ae39d32 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:32.330536   431 tablet_replica.cc:333] T 271483c6d24f4c638351ee7b145d8a90 P 5d33b52fc607443586b756116ae39d32: stopping tablet replica
I20260709 13:03:32.331070   431 raft_consensus.cc:2243] T 271483c6d24f4c638351ee7b145d8a90 P 5d33b52fc607443586b756116ae39d32 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:32.331466   431 raft_consensus.cc:2272] T 271483c6d24f4c638351ee7b145d8a90 P 5d33b52fc607443586b756116ae39d32 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:32.345975   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
I20260709 13:03:32.361660   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
I20260709 13:03:32.385555   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:32.386335   431 tablet_replica.cc:333] T 3af502197ed64f4181fe0513d5527542 P f77602fc49a648cc8d469201d9ad2859: stopping tablet replica
I20260709 13:03:32.387056   431 raft_consensus.cc:2243] T 3af502197ed64f4181fe0513d5527542 P f77602fc49a648cc8d469201d9ad2859 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:32.387526   431 raft_consensus.cc:2272] T 3af502197ed64f4181fe0513d5527542 P f77602fc49a648cc8d469201d9ad2859 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:32.390043   431 tablet_replica.cc:333] T 398fbdd47ee8495082338d265269b718 P f77602fc49a648cc8d469201d9ad2859: stopping tablet replica
I20260709 13:03:32.390617   431 raft_consensus.cc:2243] T 398fbdd47ee8495082338d265269b718 P f77602fc49a648cc8d469201d9ad2859 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:32.391264   431 pending_rounds.cc:70] T 398fbdd47ee8495082338d265269b718 P f77602fc49a648cc8d469201d9ad2859: Trying to abort 1 pending ops.
I20260709 13:03:32.391419   431 pending_rounds.cc:77] T 398fbdd47ee8495082338d265269b718 P f77602fc49a648cc8d469201d9ad2859: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305634660708040704 op_type: NO_OP noop_request { }
I20260709 13:03:32.391673   431 raft_consensus.cc:2889] T 398fbdd47ee8495082338d265269b718 P f77602fc49a648cc8d469201d9ad2859 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:03:32.391919   431 raft_consensus.cc:2272] T 398fbdd47ee8495082338d265269b718 P f77602fc49a648cc8d469201d9ad2859 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:32.394914   431 tablet_replica.cc:333] T 271483c6d24f4c638351ee7b145d8a90 P f77602fc49a648cc8d469201d9ad2859: stopping tablet replica
I20260709 13:03:32.395452   431 raft_consensus.cc:2243] T 271483c6d24f4c638351ee7b145d8a90 P f77602fc49a648cc8d469201d9ad2859 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:32.395889   431 raft_consensus.cc:2272] T 271483c6d24f4c638351ee7b145d8a90 P f77602fc49a648cc8d469201d9ad2859 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:32.398499   431 tablet_replica.cc:333] T 0c357d1f432146c48ba178e6681fcfa0 P f77602fc49a648cc8d469201d9ad2859: stopping tablet replica
I20260709 13:03:32.399062   431 raft_consensus.cc:2243] T 0c357d1f432146c48ba178e6681fcfa0 P f77602fc49a648cc8d469201d9ad2859 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:32.399473   431 raft_consensus.cc:2272] T 0c357d1f432146c48ba178e6681fcfa0 P f77602fc49a648cc8d469201d9ad2859 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:32.425302   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 13:03:32.442250   431 master.cc:562] Master@127.0.107.254:41103 shutting down...
I20260709 13:03:32.462057   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 6fec3f62b0f14202a0098089a0d182d9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:32.462607   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 6fec3f62b0f14202a0098089a0d182d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:32.462989   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P 6fec3f62b0f14202a0098089a0d182d9: stopping tablet replica
I20260709 13:03:32.482098   431 master.cc:584] Master@127.0.107.254:41103 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2236 ms)
[----------] 6 tests from LeaderRebalancerTest (320609 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 13:03:32.521407   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:33795
I20260709 13:03:32.522604   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:32.528263 11201 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:32.528311 11202 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:32.529523 11204 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:32.530305   431 server_base.cc:1061] running on GCE node
I20260709 13:03:32.531160   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:32.531358   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:32.531500   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602212531487 us; error 0 us; skew 500 ppm
I20260709 13:03:32.532013   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:32.534354   431 webserver.cc:533] Webserver started at http://127.0.107.254:35325/ using document root <none> and password file <none>
I20260709 13:03:32.534864   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:32.535029   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:32.535291   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:32.536405   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601891739070-431-0/minicluster-data/master-0-root/instance:
uuid: "b4c5ce56bb0448d098ee6b5c515762c5"
format_stamp: "Formatted at 2026-07-09 13:03:32 on dist-test-slave-qzg2"
I20260709 13:03:32.540750   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.002s
I20260709 13:03:32.544384 11209 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:32.545212   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:03:32.545473   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601891739070-431-0/minicluster-data/master-0-root
uuid: "b4c5ce56bb0448d098ee6b5c515762c5"
format_stamp: "Formatted at 2026-07-09 13:03:32 on dist-test-slave-qzg2"
I20260709 13:03:32.545718   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601891739070-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601891739070-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601891739070-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:32.557855   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:32.559158   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:32.597018   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:33795
I20260709 13:03:32.597141 11260 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:33795 every 8 connection(s)
I20260709 13:03:32.601065 11261 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:32.612942 11261 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b4c5ce56bb0448d098ee6b5c515762c5: Bootstrap starting.
I20260709 13:03:32.617959 11261 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b4c5ce56bb0448d098ee6b5c515762c5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:32.622323 11261 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b4c5ce56bb0448d098ee6b5c515762c5: No bootstrap required, opened a new log
I20260709 13:03:32.624557 11261 raft_consensus.cc:359] T 00000000000000000000000000000000 P b4c5ce56bb0448d098ee6b5c515762c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4c5ce56bb0448d098ee6b5c515762c5" member_type: VOTER }
I20260709 13:03:32.624953 11261 raft_consensus.cc:385] T 00000000000000000000000000000000 P b4c5ce56bb0448d098ee6b5c515762c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:32.625171 11261 raft_consensus.cc:740] T 00000000000000000000000000000000 P b4c5ce56bb0448d098ee6b5c515762c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4c5ce56bb0448d098ee6b5c515762c5, State: Initialized, Role: FOLLOWER
I20260709 13:03:32.625733 11261 consensus_queue.cc:260] T 00000000000000000000000000000000 P b4c5ce56bb0448d098ee6b5c515762c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4c5ce56bb0448d098ee6b5c515762c5" member_type: VOTER }
I20260709 13:03:32.626180 11261 raft_consensus.cc:399] T 00000000000000000000000000000000 P b4c5ce56bb0448d098ee6b5c515762c5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:03:32.626415 11261 raft_consensus.cc:493] T 00000000000000000000000000000000 P b4c5ce56bb0448d098ee6b5c515762c5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:03:32.626648 11261 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b4c5ce56bb0448d098ee6b5c515762c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:32.631534 11261 raft_consensus.cc:515] T 00000000000000000000000000000000 P b4c5ce56bb0448d098ee6b5c515762c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4c5ce56bb0448d098ee6b5c515762c5" member_type: VOTER }
I20260709 13:03:32.632042 11261 leader_election.cc:304] T 00000000000000000000000000000000 P b4c5ce56bb0448d098ee6b5c515762c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b4c5ce56bb0448d098ee6b5c515762c5; no voters: 
I20260709 13:03:32.633155 11261 leader_election.cc:290] T 00000000000000000000000000000000 P b4c5ce56bb0448d098ee6b5c515762c5 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:03:32.633567 11264 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b4c5ce56bb0448d098ee6b5c515762c5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:32.634953 11264 raft_consensus.cc:697] T 00000000000000000000000000000000 P b4c5ce56bb0448d098ee6b5c515762c5 [term 1 LEADER]: Becoming Leader. State: Replica: b4c5ce56bb0448d098ee6b5c515762c5, State: Running, Role: LEADER
I20260709 13:03:32.635636 11264 consensus_queue.cc:237] T 00000000000000000000000000000000 P b4c5ce56bb0448d098ee6b5c515762c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4c5ce56bb0448d098ee6b5c515762c5" member_type: VOTER }
I20260709 13:03:32.636042 11261 sys_catalog.cc:565] T 00000000000000000000000000000000 P b4c5ce56bb0448d098ee6b5c515762c5 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:03:32.638478 11266 sys_catalog.cc:455] T 00000000000000000000000000000000 P b4c5ce56bb0448d098ee6b5c515762c5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b4c5ce56bb0448d098ee6b5c515762c5. Latest consensus state: current_term: 1 leader_uuid: "b4c5ce56bb0448d098ee6b5c515762c5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4c5ce56bb0448d098ee6b5c515762c5" member_type: VOTER } }
I20260709 13:03:32.638530 11265 sys_catalog.cc:455] T 00000000000000000000000000000000 P b4c5ce56bb0448d098ee6b5c515762c5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b4c5ce56bb0448d098ee6b5c515762c5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4c5ce56bb0448d098ee6b5c515762c5" member_type: VOTER } }
I20260709 13:03:32.639187 11266 sys_catalog.cc:458] T 00000000000000000000000000000000 P b4c5ce56bb0448d098ee6b5c515762c5 [sys.catalog]: This master's current role is: LEADER
I20260709 13:03:32.639557 11265 sys_catalog.cc:458] T 00000000000000000000000000000000 P b4c5ce56bb0448d098ee6b5c515762c5 [sys.catalog]: This master's current role is: LEADER
I20260709 13:03:32.641815 11269 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:03:32.647168 11269 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:03:32.650866   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:03:32.655947 11269 catalog_manager.cc:1383] Generated new cluster ID: 8ef1558078754e4f86910043a0beb59b
I20260709 13:03:32.656252 11269 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:03:32.679643 11269 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:03:32.681042 11269 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:03:32.699996 11269 catalog_manager.cc:6070] T 00000000000000000000000000000000 P b4c5ce56bb0448d098ee6b5c515762c5: Generated new TSK 0
I20260709 13:03:32.700649 11269 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:03:32.717455   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:32.723918 11282 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:32.724360 11283 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:32.728287 11285 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:32.728255   431 server_base.cc:1061] running on GCE node
I20260709 13:03:32.729694   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:32.729895   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:32.730016   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602212730006 us; error 0 us; skew 500 ppm
I20260709 13:03:32.730495   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:32.732800   431 webserver.cc:533] Webserver started at http://127.0.107.193:41519/ using document root <none> and password file <none>
I20260709 13:03:32.733282   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:32.733448   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:32.733655   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:32.734748   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601891739070-431-0/minicluster-data/ts-0-root/instance:
uuid: "e3760873d2be4dc7b991027c1deef35d"
format_stamp: "Formatted at 2026-07-09 13:03:32 on dist-test-slave-qzg2"
I20260709 13:03:32.739315   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.002s
I20260709 13:03:32.742730 11290 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:32.743496   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:03:32.743829   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601891739070-431-0/minicluster-data/ts-0-root
uuid: "e3760873d2be4dc7b991027c1deef35d"
format_stamp: "Formatted at 2026-07-09 13:03:32 on dist-test-slave-qzg2"
I20260709 13:03:32.744154   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601891739070-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601891739070-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601891739070-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:32.754524   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:32.755750   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:32.757262   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:32.759589   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:03:32.759805   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:32.760025   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:03:32.760195   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:32.799597   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:35003
I20260709 13:03:32.799697 11352 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:35003 every 8 connection(s)
I20260709 13:03:32.806177   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:32.813851 11357 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:32.816378 11358 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:32.817662   431 server_base.cc:1061] running on GCE node
W20260709 13:03:32.819145 11360 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:32.820138   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:32.820363   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:32.820554   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602212820534 us; error 0 us; skew 500 ppm
I20260709 13:03:32.821043   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:32.823485   431 webserver.cc:533] Webserver started at http://127.0.107.194:37175/ using document root <none> and password file <none>
I20260709 13:03:32.823932   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:32.824105   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:32.824350   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:32.825505   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601891739070-431-0/minicluster-data/ts-1-root/instance:
uuid: "7eb6f135338f4b84b60b7e67ab3d81d7"
format_stamp: "Formatted at 2026-07-09 13:03:32 on dist-test-slave-qzg2"
I20260709 13:03:32.830770   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:03:32.830778 11353 heartbeater.cc:344] Connected to a master server at 127.0.107.254:33795
I20260709 13:03:32.831270 11353 heartbeater.cc:461] Registering TS with master...
I20260709 13:03:32.831984 11353 heartbeater.cc:507] Master 127.0.107.254:33795 requested a full tablet report, sending...
I20260709 13:03:32.834120 11226 ts_manager.cc:194] Registered new tserver with Master: e3760873d2be4dc7b991027c1deef35d (127.0.107.193:35003)
I20260709 13:03:32.834432 11365 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:32.835359   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:03:32.835717   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601891739070-431-0/minicluster-data/ts-1-root
uuid: "7eb6f135338f4b84b60b7e67ab3d81d7"
format_stamp: "Formatted at 2026-07-09 13:03:32 on dist-test-slave-qzg2"
I20260709 13:03:32.836077   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601891739070-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601891739070-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601891739070-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:32.836603 11226 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59204
I20260709 13:03:32.855856   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:32.857204   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:32.858927   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:32.861233   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:03:32.861459   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:32.861690   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:03:32.861841   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:32.902576   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:42689
I20260709 13:03:32.902717 11427 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:42689 every 8 connection(s)
I20260709 13:03:32.907269   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:32.914481 11431 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:32.916890 11432 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:32.917330   431 server_base.cc:1061] running on GCE node
W20260709 13:03:32.919078 11434 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:32.919636 11428 heartbeater.cc:344] Connected to a master server at 127.0.107.254:33795
I20260709 13:03:32.920112 11428 heartbeater.cc:461] Registering TS with master...
I20260709 13:03:32.920253   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:32.920553   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:32.920753   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602212920735 us; error 0 us; skew 500 ppm
I20260709 13:03:32.921051 11428 heartbeater.cc:507] Master 127.0.107.254:33795 requested a full tablet report, sending...
I20260709 13:03:32.921552   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:32.923509 11226 ts_manager.cc:194] Registered new tserver with Master: 7eb6f135338f4b84b60b7e67ab3d81d7 (127.0.107.194:42689)
I20260709 13:03:32.924307   431 webserver.cc:533] Webserver started at http://127.0.107.195:46539/ using document root <none> and password file <none>
I20260709 13:03:32.924839   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:32.924875 11226 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59210
I20260709 13:03:32.925038   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:32.925446   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:32.926963   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601891739070-431-0/minicluster-data/ts-2-root/instance:
uuid: "57da47b50bc847c997f07dccaeae280a"
format_stamp: "Formatted at 2026-07-09 13:03:32 on dist-test-slave-qzg2"
I20260709 13:03:32.931385   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:03:32.934588 11439 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:32.935511   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:03:32.935814   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601891739070-431-0/minicluster-data/ts-2-root
uuid: "57da47b50bc847c997f07dccaeae280a"
format_stamp: "Formatted at 2026-07-09 13:03:32 on dist-test-slave-qzg2"
I20260709 13:03:32.936128   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601891739070-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601891739070-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601891739070-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:32.962138   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:32.963420   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:32.964879   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:32.967142   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:03:32.967326   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:32.967571   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:03:32.967715   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:33.006287   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:37515
I20260709 13:03:33.006392 11501 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:37515 every 8 connection(s)
I20260709 13:03:33.020229 11502 heartbeater.cc:344] Connected to a master server at 127.0.107.254:33795
I20260709 13:03:33.020681 11502 heartbeater.cc:461] Registering TS with master...
I20260709 13:03:33.021390 11502 heartbeater.cc:507] Master 127.0.107.254:33795 requested a full tablet report, sending...
I20260709 13:03:33.023330 11226 ts_manager.cc:194] Registered new tserver with Master: 57da47b50bc847c997f07dccaeae280a (127.0.107.195:37515)
I20260709 13:03:33.024276   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014737363s
I20260709 13:03:33.024730 11226 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59220
I20260709 13:03:33.049355 11226 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59226:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:03:33.052114 11226 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:03:33.121496 11393 tablet_service.cc:1511] Processing CreateTablet for tablet 9e659a7e9644447daa84c89a46e934de (DEFAULT_TABLE table=test-workload [id=b8faf91948724647aefca13aaae9da9e]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:03:33.123778 11392 tablet_service.cc:1511] Processing CreateTablet for tablet a802e0f3aab1477091f50d46836a5e34 (DEFAULT_TABLE table=test-workload [id=b8faf91948724647aefca13aaae9da9e]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:03:33.125509 11392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a802e0f3aab1477091f50d46836a5e34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:33.130353 11391 tablet_service.cc:1511] Processing CreateTablet for tablet dd5040fb5b614dd2990e57812dadd3b7 (DEFAULT_TABLE table=test-workload [id=b8faf91948724647aefca13aaae9da9e]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:03:33.131906 11393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e659a7e9644447daa84c89a46e934de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:33.132812 11391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd5040fb5b614dd2990e57812dadd3b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:33.136822 11390 tablet_service.cc:1511] Processing CreateTablet for tablet 120ae599baa547b1855a1ba361226d3e (DEFAULT_TABLE table=test-workload [id=b8faf91948724647aefca13aaae9da9e]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:03:33.138484 11390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 120ae599baa547b1855a1ba361226d3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:33.145377 11389 tablet_service.cc:1511] Processing CreateTablet for tablet 205736ed2ee6439588e8db06793e4cd6 (DEFAULT_TABLE table=test-workload [id=b8faf91948724647aefca13aaae9da9e]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:03:33.147528 11389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 205736ed2ee6439588e8db06793e4cd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:33.168103 11318 tablet_service.cc:1511] Processing CreateTablet for tablet 9e659a7e9644447daa84c89a46e934de (DEFAULT_TABLE table=test-workload [id=b8faf91948724647aefca13aaae9da9e]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:03:33.169646 11318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e659a7e9644447daa84c89a46e934de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:33.169390 11388 tablet_service.cc:1511] Processing CreateTablet for tablet b35e87dce47b43119d13bd514d434a76 (DEFAULT_TABLE table=test-workload [id=b8faf91948724647aefca13aaae9da9e]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:03:33.171176 11388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b35e87dce47b43119d13bd514d434a76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:33.173122 11467 tablet_service.cc:1511] Processing CreateTablet for tablet 9e659a7e9644447daa84c89a46e934de (DEFAULT_TABLE table=test-workload [id=b8faf91948724647aefca13aaae9da9e]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:03:33.174698 11467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e659a7e9644447daa84c89a46e934de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:33.174950 11317 tablet_service.cc:1511] Processing CreateTablet for tablet a802e0f3aab1477091f50d46836a5e34 (DEFAULT_TABLE table=test-workload [id=b8faf91948724647aefca13aaae9da9e]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:03:33.176368 11317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a802e0f3aab1477091f50d46836a5e34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:33.178741 11315 tablet_service.cc:1511] Processing CreateTablet for tablet 120ae599baa547b1855a1ba361226d3e (DEFAULT_TABLE table=test-workload [id=b8faf91948724647aefca13aaae9da9e]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:03:33.180867 11313 tablet_service.cc:1511] Processing CreateTablet for tablet b35e87dce47b43119d13bd514d434a76 (DEFAULT_TABLE table=test-workload [id=b8faf91948724647aefca13aaae9da9e]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:03:33.182104 11315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 120ae599baa547b1855a1ba361226d3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:33.180866 11314 tablet_service.cc:1511] Processing CreateTablet for tablet 205736ed2ee6439588e8db06793e4cd6 (DEFAULT_TABLE table=test-workload [id=b8faf91948724647aefca13aaae9da9e]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:03:33.179663 11316 tablet_service.cc:1511] Processing CreateTablet for tablet dd5040fb5b614dd2990e57812dadd3b7 (DEFAULT_TABLE table=test-workload [id=b8faf91948724647aefca13aaae9da9e]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:03:33.185487 11464 tablet_service.cc:1511] Processing CreateTablet for tablet 120ae599baa547b1855a1ba361226d3e (DEFAULT_TABLE table=test-workload [id=b8faf91948724647aefca13aaae9da9e]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:03:33.184000 11314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 205736ed2ee6439588e8db06793e4cd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:33.191844 11313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b35e87dce47b43119d13bd514d434a76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:33.186193 11462 tablet_service.cc:1511] Processing CreateTablet for tablet b35e87dce47b43119d13bd514d434a76 (DEFAULT_TABLE table=test-workload [id=b8faf91948724647aefca13aaae9da9e]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:03:33.188146 11465 tablet_service.cc:1511] Processing CreateTablet for tablet dd5040fb5b614dd2990e57812dadd3b7 (DEFAULT_TABLE table=test-workload [id=b8faf91948724647aefca13aaae9da9e]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:03:33.188146 11466 tablet_service.cc:1511] Processing CreateTablet for tablet a802e0f3aab1477091f50d46836a5e34 (DEFAULT_TABLE table=test-workload [id=b8faf91948724647aefca13aaae9da9e]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:03:33.193817 11316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd5040fb5b614dd2990e57812dadd3b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:33.189417 11463 tablet_service.cc:1511] Processing CreateTablet for tablet 205736ed2ee6439588e8db06793e4cd6 (DEFAULT_TABLE table=test-workload [id=b8faf91948724647aefca13aaae9da9e]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:03:33.194198 11312 tablet_service.cc:1511] Processing CreateTablet for tablet 71db464af9104a8a86fd623394da3511 (DEFAULT_TABLE table=test-workload [id=b8faf91948724647aefca13aaae9da9e]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:03:33.191041 11464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 120ae599baa547b1855a1ba361226d3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:33.195788 11312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71db464af9104a8a86fd623394da3511. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:33.199923 11463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 205736ed2ee6439588e8db06793e4cd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:33.204439 11462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b35e87dce47b43119d13bd514d434a76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:33.210923 11465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd5040fb5b614dd2990e57812dadd3b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:33.211179 11517 tablet_bootstrap.cc:492] T 9e659a7e9644447daa84c89a46e934de P 7eb6f135338f4b84b60b7e67ab3d81d7: Bootstrap starting.
I20260709 13:03:33.219025 11466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a802e0f3aab1477091f50d46836a5e34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:33.225836 11517 tablet_bootstrap.cc:654] T 9e659a7e9644447daa84c89a46e934de P 7eb6f135338f4b84b60b7e67ab3d81d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:33.225517 11393 tablet_service.cc:1511] Processing CreateTablet for tablet 71db464af9104a8a86fd623394da3511 (DEFAULT_TABLE table=test-workload [id=b8faf91948724647aefca13aaae9da9e]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:03:33.227048 11393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71db464af9104a8a86fd623394da3511. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:03:33.276239 11211 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.0.107.194:42689, user_credentials={real_user=slave}} blocked reactor thread for 44778.9us
I20260709 13:03:33.282868 11519 tablet_bootstrap.cc:492] T b35e87dce47b43119d13bd514d434a76 P e3760873d2be4dc7b991027c1deef35d: Bootstrap starting.
I20260709 13:03:33.285621 11461 tablet_service.cc:1511] Processing CreateTablet for tablet 71db464af9104a8a86fd623394da3511 (DEFAULT_TABLE table=test-workload [id=b8faf91948724647aefca13aaae9da9e]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:03:33.287123 11461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71db464af9104a8a86fd623394da3511. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:33.290134 11311 tablet_service.cc:1511] Processing CreateTablet for tablet ec9a5210a9a84816bc2d263d456f9a93 (DEFAULT_TABLE table=test-workload [id=b8faf91948724647aefca13aaae9da9e]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:03:33.291591 11311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec9a5210a9a84816bc2d263d456f9a93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:33.294344 11388 tablet_service.cc:1511] Processing CreateTablet for tablet ec9a5210a9a84816bc2d263d456f9a93 (DEFAULT_TABLE table=test-workload [id=b8faf91948724647aefca13aaae9da9e]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:03:33.295876 11388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec9a5210a9a84816bc2d263d456f9a93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:33.311692 11460 tablet_service.cc:1511] Processing CreateTablet for tablet ec9a5210a9a84816bc2d263d456f9a93 (DEFAULT_TABLE table=test-workload [id=b8faf91948724647aefca13aaae9da9e]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:03:33.312763 11517 tablet_bootstrap.cc:492] T 9e659a7e9644447daa84c89a46e934de P 7eb6f135338f4b84b60b7e67ab3d81d7: No bootstrap required, opened a new log
I20260709 13:03:33.313167 11460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec9a5210a9a84816bc2d263d456f9a93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:33.314335 11312 tablet_service.cc:1511] Processing CreateTablet for tablet de8c0dddbdc34ad88de9156beb74bef7 (DEFAULT_TABLE table=test-workload [id=b8faf91948724647aefca13aaae9da9e]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:03:33.321234 11312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de8c0dddbdc34ad88de9156beb74bef7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:33.321416 11390 tablet_service.cc:1511] Processing CreateTablet for tablet de8c0dddbdc34ad88de9156beb74bef7 (DEFAULT_TABLE table=test-workload [id=b8faf91948724647aefca13aaae9da9e]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:03:33.322724 11390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de8c0dddbdc34ad88de9156beb74bef7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:33.322921 11519 tablet_bootstrap.cc:654] T b35e87dce47b43119d13bd514d434a76 P e3760873d2be4dc7b991027c1deef35d: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:33.313382 11517 ts_tablet_manager.cc:1403] T 9e659a7e9644447daa84c89a46e934de P 7eb6f135338f4b84b60b7e67ab3d81d7: Time spent bootstrapping tablet: real 0.103s	user 0.012s	sys 0.005s
I20260709 13:03:33.395838 11517 raft_consensus.cc:359] T 9e659a7e9644447daa84c89a46e934de P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } } peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } }
I20260709 13:03:33.396603 11517 raft_consensus.cc:385] T 9e659a7e9644447daa84c89a46e934de P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:33.396895 11517 raft_consensus.cc:740] T 9e659a7e9644447daa84c89a46e934de P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7eb6f135338f4b84b60b7e67ab3d81d7, State: Initialized, Role: FOLLOWER
I20260709 13:03:33.397640 11517 consensus_queue.cc:260] T 9e659a7e9644447daa84c89a46e934de P 7eb6f135338f4b84b60b7e67ab3d81d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } } peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } }
I20260709 13:03:33.400643 11459 tablet_service.cc:1511] Processing CreateTablet for tablet de8c0dddbdc34ad88de9156beb74bef7 (DEFAULT_TABLE table=test-workload [id=b8faf91948724647aefca13aaae9da9e]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:03:33.402077 11459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de8c0dddbdc34ad88de9156beb74bef7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:33.424556 11519 tablet_bootstrap.cc:492] T b35e87dce47b43119d13bd514d434a76 P e3760873d2be4dc7b991027c1deef35d: No bootstrap required, opened a new log
I20260709 13:03:33.425261 11519 ts_tablet_manager.cc:1403] T b35e87dce47b43119d13bd514d434a76 P e3760873d2be4dc7b991027c1deef35d: Time spent bootstrapping tablet: real 0.143s	user 0.013s	sys 0.007s
I20260709 13:03:33.427968 11519 raft_consensus.cc:359] T b35e87dce47b43119d13bd514d434a76 P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:33.428896 11519 raft_consensus.cc:385] T b35e87dce47b43119d13bd514d434a76 P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:33.429207 11519 raft_consensus.cc:740] T b35e87dce47b43119d13bd514d434a76 P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3760873d2be4dc7b991027c1deef35d, State: Initialized, Role: FOLLOWER
I20260709 13:03:33.430148 11519 consensus_queue.cc:260] T b35e87dce47b43119d13bd514d434a76 P e3760873d2be4dc7b991027c1deef35d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:33.431687 11428 heartbeater.cc:499] Master 127.0.107.254:33795 was elected leader, sending a full tablet report...
I20260709 13:03:33.432798 11517 ts_tablet_manager.cc:1434] T 9e659a7e9644447daa84c89a46e934de P 7eb6f135338f4b84b60b7e67ab3d81d7: Time spent starting tablet: real 0.100s	user 0.019s	sys 0.009s
I20260709 13:03:33.434003 11517 tablet_bootstrap.cc:492] T dd5040fb5b614dd2990e57812dadd3b7 P 7eb6f135338f4b84b60b7e67ab3d81d7: Bootstrap starting.
I20260709 13:03:33.431736 11521 tablet_bootstrap.cc:492] T 71db464af9104a8a86fd623394da3511 P 57da47b50bc847c997f07dccaeae280a: Bootstrap starting.
I20260709 13:03:33.441048 11353 heartbeater.cc:499] Master 127.0.107.254:33795 was elected leader, sending a full tablet report...
I20260709 13:03:33.441504 11517 tablet_bootstrap.cc:654] T dd5040fb5b614dd2990e57812dadd3b7 P 7eb6f135338f4b84b60b7e67ab3d81d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:33.447990 11519 ts_tablet_manager.cc:1434] T b35e87dce47b43119d13bd514d434a76 P e3760873d2be4dc7b991027c1deef35d: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:03:33.449304 11521 tablet_bootstrap.cc:654] T 71db464af9104a8a86fd623394da3511 P 57da47b50bc847c997f07dccaeae280a: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:33.450519 11519 tablet_bootstrap.cc:492] T 71db464af9104a8a86fd623394da3511 P e3760873d2be4dc7b991027c1deef35d: Bootstrap starting.
I20260709 13:03:33.453169 11517 tablet_bootstrap.cc:492] T dd5040fb5b614dd2990e57812dadd3b7 P 7eb6f135338f4b84b60b7e67ab3d81d7: No bootstrap required, opened a new log
I20260709 13:03:33.453814 11517 ts_tablet_manager.cc:1403] T dd5040fb5b614dd2990e57812dadd3b7 P 7eb6f135338f4b84b60b7e67ab3d81d7: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.000s
I20260709 13:03:33.457070 11517 raft_consensus.cc:359] T dd5040fb5b614dd2990e57812dadd3b7 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:33.457875 11517 raft_consensus.cc:385] T dd5040fb5b614dd2990e57812dadd3b7 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:33.458181 11517 raft_consensus.cc:740] T dd5040fb5b614dd2990e57812dadd3b7 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7eb6f135338f4b84b60b7e67ab3d81d7, State: Initialized, Role: FOLLOWER
I20260709 13:03:33.458267 11519 tablet_bootstrap.cc:654] T 71db464af9104a8a86fd623394da3511 P e3760873d2be4dc7b991027c1deef35d: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:33.459233 11517 consensus_queue.cc:260] T dd5040fb5b614dd2990e57812dadd3b7 P 7eb6f135338f4b84b60b7e67ab3d81d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:33.460927 11521 tablet_bootstrap.cc:492] T 71db464af9104a8a86fd623394da3511 P 57da47b50bc847c997f07dccaeae280a: No bootstrap required, opened a new log
I20260709 13:03:33.461438 11521 ts_tablet_manager.cc:1403] T 71db464af9104a8a86fd623394da3511 P 57da47b50bc847c997f07dccaeae280a: Time spent bootstrapping tablet: real 0.030s	user 0.010s	sys 0.009s
I20260709 13:03:33.462795 11517 ts_tablet_manager.cc:1434] T dd5040fb5b614dd2990e57812dadd3b7 P 7eb6f135338f4b84b60b7e67ab3d81d7: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.000s
I20260709 13:03:33.463820 11517 tablet_bootstrap.cc:492] T a802e0f3aab1477091f50d46836a5e34 P 7eb6f135338f4b84b60b7e67ab3d81d7: Bootstrap starting.
I20260709 13:03:33.464543 11521 raft_consensus.cc:359] T 71db464af9104a8a86fd623394da3511 P 57da47b50bc847c997f07dccaeae280a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:33.465304 11521 raft_consensus.cc:385] T 71db464af9104a8a86fd623394da3511 P 57da47b50bc847c997f07dccaeae280a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:33.465592 11521 raft_consensus.cc:740] T 71db464af9104a8a86fd623394da3511 P 57da47b50bc847c997f07dccaeae280a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57da47b50bc847c997f07dccaeae280a, State: Initialized, Role: FOLLOWER
I20260709 13:03:33.466567 11521 consensus_queue.cc:260] T 71db464af9104a8a86fd623394da3511 P 57da47b50bc847c997f07dccaeae280a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:33.471491 11517 tablet_bootstrap.cc:654] T a802e0f3aab1477091f50d46836a5e34 P 7eb6f135338f4b84b60b7e67ab3d81d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:33.472573 11519 tablet_bootstrap.cc:492] T 71db464af9104a8a86fd623394da3511 P e3760873d2be4dc7b991027c1deef35d: No bootstrap required, opened a new log
I20260709 13:03:33.473234 11519 ts_tablet_manager.cc:1403] T 71db464af9104a8a86fd623394da3511 P e3760873d2be4dc7b991027c1deef35d: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.008s
I20260709 13:03:33.474175 11521 ts_tablet_manager.cc:1434] T 71db464af9104a8a86fd623394da3511 P 57da47b50bc847c997f07dccaeae280a: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 13:03:33.475008 11502 heartbeater.cc:499] Master 127.0.107.254:33795 was elected leader, sending a full tablet report...
I20260709 13:03:33.476526 11519 raft_consensus.cc:359] T 71db464af9104a8a86fd623394da3511 P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:33.477349 11519 raft_consensus.cc:385] T 71db464af9104a8a86fd623394da3511 P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:33.477687 11519 raft_consensus.cc:740] T 71db464af9104a8a86fd623394da3511 P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3760873d2be4dc7b991027c1deef35d, State: Initialized, Role: FOLLOWER
I20260709 13:03:33.478507 11519 consensus_queue.cc:260] T 71db464af9104a8a86fd623394da3511 P e3760873d2be4dc7b991027c1deef35d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:33.480588 11521 tablet_bootstrap.cc:492] T 120ae599baa547b1855a1ba361226d3e P 57da47b50bc847c997f07dccaeae280a: Bootstrap starting.
I20260709 13:03:33.480770 11519 ts_tablet_manager.cc:1434] T 71db464af9104a8a86fd623394da3511 P e3760873d2be4dc7b991027c1deef35d: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:03:33.482043 11519 tablet_bootstrap.cc:492] T dd5040fb5b614dd2990e57812dadd3b7 P e3760873d2be4dc7b991027c1deef35d: Bootstrap starting.
I20260709 13:03:33.483891 11517 tablet_bootstrap.cc:492] T a802e0f3aab1477091f50d46836a5e34 P 7eb6f135338f4b84b60b7e67ab3d81d7: No bootstrap required, opened a new log
I20260709 13:03:33.484584 11517 ts_tablet_manager.cc:1403] T a802e0f3aab1477091f50d46836a5e34 P 7eb6f135338f4b84b60b7e67ab3d81d7: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.008s
I20260709 13:03:33.488082 11521 tablet_bootstrap.cc:654] T 120ae599baa547b1855a1ba361226d3e P 57da47b50bc847c997f07dccaeae280a: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:33.487854 11517 raft_consensus.cc:359] T a802e0f3aab1477091f50d46836a5e34 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:33.488613 11517 raft_consensus.cc:385] T a802e0f3aab1477091f50d46836a5e34 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:33.488941 11517 raft_consensus.cc:740] T a802e0f3aab1477091f50d46836a5e34 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7eb6f135338f4b84b60b7e67ab3d81d7, State: Initialized, Role: FOLLOWER
I20260709 13:03:33.489137 11519 tablet_bootstrap.cc:654] T dd5040fb5b614dd2990e57812dadd3b7 P e3760873d2be4dc7b991027c1deef35d: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:33.490188 11517 consensus_queue.cc:260] T a802e0f3aab1477091f50d46836a5e34 P 7eb6f135338f4b84b60b7e67ab3d81d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:33.492892 11517 ts_tablet_manager.cc:1434] T a802e0f3aab1477091f50d46836a5e34 P 7eb6f135338f4b84b60b7e67ab3d81d7: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:03:33.494094 11517 tablet_bootstrap.cc:492] T 120ae599baa547b1855a1ba361226d3e P 7eb6f135338f4b84b60b7e67ab3d81d7: Bootstrap starting.
I20260709 13:03:33.500361 11521 tablet_bootstrap.cc:492] T 120ae599baa547b1855a1ba361226d3e P 57da47b50bc847c997f07dccaeae280a: No bootstrap required, opened a new log
I20260709 13:03:33.500955 11517 tablet_bootstrap.cc:654] T 120ae599baa547b1855a1ba361226d3e P 7eb6f135338f4b84b60b7e67ab3d81d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:33.500955 11521 ts_tablet_manager.cc:1403] T 120ae599baa547b1855a1ba361226d3e P 57da47b50bc847c997f07dccaeae280a: Time spent bootstrapping tablet: real 0.021s	user 0.017s	sys 0.000s
I20260709 13:03:33.504582 11521 raft_consensus.cc:359] T 120ae599baa547b1855a1ba361226d3e P 57da47b50bc847c997f07dccaeae280a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:33.505446 11521 raft_consensus.cc:385] T 120ae599baa547b1855a1ba361226d3e P 57da47b50bc847c997f07dccaeae280a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:33.505761 11521 raft_consensus.cc:740] T 120ae599baa547b1855a1ba361226d3e P 57da47b50bc847c997f07dccaeae280a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57da47b50bc847c997f07dccaeae280a, State: Initialized, Role: FOLLOWER
I20260709 13:03:33.506762 11521 consensus_queue.cc:260] T 120ae599baa547b1855a1ba361226d3e P 57da47b50bc847c997f07dccaeae280a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:33.509357 11521 ts_tablet_manager.cc:1434] T 120ae599baa547b1855a1ba361226d3e P 57da47b50bc847c997f07dccaeae280a: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:03:33.510486 11521 tablet_bootstrap.cc:492] T ec9a5210a9a84816bc2d263d456f9a93 P 57da47b50bc847c997f07dccaeae280a: Bootstrap starting.
I20260709 13:03:33.513114 11517 tablet_bootstrap.cc:492] T 120ae599baa547b1855a1ba361226d3e P 7eb6f135338f4b84b60b7e67ab3d81d7: No bootstrap required, opened a new log
I20260709 13:03:33.513728 11517 ts_tablet_manager.cc:1403] T 120ae599baa547b1855a1ba361226d3e P 7eb6f135338f4b84b60b7e67ab3d81d7: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.004s
I20260709 13:03:33.517204 11521 tablet_bootstrap.cc:654] T ec9a5210a9a84816bc2d263d456f9a93 P 57da47b50bc847c997f07dccaeae280a: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:33.516847 11517 raft_consensus.cc:359] T 120ae599baa547b1855a1ba361226d3e P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:33.517704 11517 raft_consensus.cc:385] T 120ae599baa547b1855a1ba361226d3e P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:33.518018 11517 raft_consensus.cc:740] T 120ae599baa547b1855a1ba361226d3e P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7eb6f135338f4b84b60b7e67ab3d81d7, State: Initialized, Role: FOLLOWER
I20260709 13:03:33.518952 11517 consensus_queue.cc:260] T 120ae599baa547b1855a1ba361226d3e P 7eb6f135338f4b84b60b7e67ab3d81d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:33.523566 11517 ts_tablet_manager.cc:1434] T 120ae599baa547b1855a1ba361226d3e P 7eb6f135338f4b84b60b7e67ab3d81d7: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.001s
I20260709 13:03:33.524820 11517 tablet_bootstrap.cc:492] T b35e87dce47b43119d13bd514d434a76 P 7eb6f135338f4b84b60b7e67ab3d81d7: Bootstrap starting.
I20260709 13:03:33.532073 11517 tablet_bootstrap.cc:654] T b35e87dce47b43119d13bd514d434a76 P 7eb6f135338f4b84b60b7e67ab3d81d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:33.536958 11523 raft_consensus.cc:493] T b35e87dce47b43119d13bd514d434a76 P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:33.537577 11523 raft_consensus.cc:515] T b35e87dce47b43119d13bd514d434a76 P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:33.538478 11521 tablet_bootstrap.cc:492] T ec9a5210a9a84816bc2d263d456f9a93 P 57da47b50bc847c997f07dccaeae280a: No bootstrap required, opened a new log
I20260709 13:03:33.539090 11521 ts_tablet_manager.cc:1403] T ec9a5210a9a84816bc2d263d456f9a93 P 57da47b50bc847c997f07dccaeae280a: Time spent bootstrapping tablet: real 0.029s	user 0.016s	sys 0.011s
I20260709 13:03:33.539577 11519 tablet_bootstrap.cc:492] T dd5040fb5b614dd2990e57812dadd3b7 P e3760873d2be4dc7b991027c1deef35d: No bootstrap required, opened a new log
I20260709 13:03:33.540206 11519 ts_tablet_manager.cc:1403] T dd5040fb5b614dd2990e57812dadd3b7 P e3760873d2be4dc7b991027c1deef35d: Time spent bootstrapping tablet: real 0.058s	user 0.025s	sys 0.029s
I20260709 13:03:33.540417 11523 leader_election.cc:290] T b35e87dce47b43119d13bd514d434a76 P e3760873d2be4dc7b991027c1deef35d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7eb6f135338f4b84b60b7e67ab3d81d7 (127.0.107.194:42689), 57da47b50bc847c997f07dccaeae280a (127.0.107.195:37515)
I20260709 13:03:33.543994 11519 raft_consensus.cc:359] T dd5040fb5b614dd2990e57812dadd3b7 P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:33.544795 11519 raft_consensus.cc:385] T dd5040fb5b614dd2990e57812dadd3b7 P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:33.545161 11519 raft_consensus.cc:740] T dd5040fb5b614dd2990e57812dadd3b7 P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3760873d2be4dc7b991027c1deef35d, State: Initialized, Role: FOLLOWER
I20260709 13:03:33.545923 11519 consensus_queue.cc:260] T dd5040fb5b614dd2990e57812dadd3b7 P e3760873d2be4dc7b991027c1deef35d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:33.550208 11519 ts_tablet_manager.cc:1434] T dd5040fb5b614dd2990e57812dadd3b7 P e3760873d2be4dc7b991027c1deef35d: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.004s
I20260709 13:03:33.551481 11519 tablet_bootstrap.cc:492] T 9e659a7e9644447daa84c89a46e934de P e3760873d2be4dc7b991027c1deef35d: Bootstrap starting.
I20260709 13:03:33.556077 11522 raft_consensus.cc:493] T 120ae599baa547b1855a1ba361226d3e P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:33.556659 11522 raft_consensus.cc:515] T 120ae599baa547b1855a1ba361226d3e P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:33.557946 11519 tablet_bootstrap.cc:654] T 9e659a7e9644447daa84c89a46e934de P e3760873d2be4dc7b991027c1deef35d: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:33.559742 11522 leader_election.cc:290] T 120ae599baa547b1855a1ba361226d3e P 7eb6f135338f4b84b60b7e67ab3d81d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3760873d2be4dc7b991027c1deef35d (127.0.107.193:35003), 57da47b50bc847c997f07dccaeae280a (127.0.107.195:37515)
I20260709 13:03:33.549925 11521 raft_consensus.cc:359] T ec9a5210a9a84816bc2d263d456f9a93 P 57da47b50bc847c997f07dccaeae280a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:33.562928 11521 raft_consensus.cc:385] T ec9a5210a9a84816bc2d263d456f9a93 P 57da47b50bc847c997f07dccaeae280a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:33.563297 11521 raft_consensus.cc:740] T ec9a5210a9a84816bc2d263d456f9a93 P 57da47b50bc847c997f07dccaeae280a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57da47b50bc847c997f07dccaeae280a, State: Initialized, Role: FOLLOWER
I20260709 13:03:33.564175 11521 consensus_queue.cc:260] T ec9a5210a9a84816bc2d263d456f9a93 P 57da47b50bc847c997f07dccaeae280a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:33.578557 11521 ts_tablet_manager.cc:1434] T ec9a5210a9a84816bc2d263d456f9a93 P 57da47b50bc847c997f07dccaeae280a: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.000s
I20260709 13:03:33.579811 11521 tablet_bootstrap.cc:492] T b35e87dce47b43119d13bd514d434a76 P 57da47b50bc847c997f07dccaeae280a: Bootstrap starting.
I20260709 13:03:33.593092 11519 tablet_bootstrap.cc:492] T 9e659a7e9644447daa84c89a46e934de P e3760873d2be4dc7b991027c1deef35d: No bootstrap required, opened a new log
I20260709 13:03:33.593830 11519 ts_tablet_manager.cc:1403] T 9e659a7e9644447daa84c89a46e934de P e3760873d2be4dc7b991027c1deef35d: Time spent bootstrapping tablet: real 0.043s	user 0.026s	sys 0.012s
I20260709 13:03:33.597302 11519 raft_consensus.cc:359] T 9e659a7e9644447daa84c89a46e934de P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } } peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } }
I20260709 13:03:33.598165 11519 raft_consensus.cc:385] T 9e659a7e9644447daa84c89a46e934de P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:33.608134 11403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35e87dce47b43119d13bd514d434a76" candidate_uuid: "e3760873d2be4dc7b991027c1deef35d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" is_pre_election: true
I20260709 13:03:33.608366 11328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "120ae599baa547b1855a1ba361226d3e" candidate_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3760873d2be4dc7b991027c1deef35d" is_pre_election: true
W20260709 13:03:33.610000 11292 leader_election.cc:343] T b35e87dce47b43119d13bd514d434a76 P e3760873d2be4dc7b991027c1deef35d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7eb6f135338f4b84b60b7e67ab3d81d7 (127.0.107.194:42689): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:03:33.610384 11369 leader_election.cc:343] T 120ae599baa547b1855a1ba361226d3e P 7eb6f135338f4b84b60b7e67ab3d81d7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3760873d2be4dc7b991027c1deef35d (127.0.107.193:35003): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:33.613122 11517 tablet_bootstrap.cc:492] T b35e87dce47b43119d13bd514d434a76 P 7eb6f135338f4b84b60b7e67ab3d81d7: No bootstrap required, opened a new log
I20260709 13:03:33.613091 11477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35e87dce47b43119d13bd514d434a76" candidate_uuid: "e3760873d2be4dc7b991027c1deef35d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57da47b50bc847c997f07dccaeae280a" is_pre_election: true
I20260709 13:03:33.613869 11517 ts_tablet_manager.cc:1403] T b35e87dce47b43119d13bd514d434a76 P 7eb6f135338f4b84b60b7e67ab3d81d7: Time spent bootstrapping tablet: real 0.089s	user 0.036s	sys 0.039s
W20260709 13:03:33.615041 11294 leader_election.cc:343] T b35e87dce47b43119d13bd514d434a76 P e3760873d2be4dc7b991027c1deef35d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 57da47b50bc847c997f07dccaeae280a (127.0.107.195:37515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:33.615545 11294 leader_election.cc:304] T b35e87dce47b43119d13bd514d434a76 P e3760873d2be4dc7b991027c1deef35d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3760873d2be4dc7b991027c1deef35d; no voters: 57da47b50bc847c997f07dccaeae280a, 7eb6f135338f4b84b60b7e67ab3d81d7
I20260709 13:03:33.616156 11521 tablet_bootstrap.cc:654] T b35e87dce47b43119d13bd514d434a76 P 57da47b50bc847c997f07dccaeae280a: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:33.598479 11519 raft_consensus.cc:740] T 9e659a7e9644447daa84c89a46e934de P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3760873d2be4dc7b991027c1deef35d, State: Initialized, Role: FOLLOWER
I20260709 13:03:33.616709 11523 raft_consensus.cc:2749] T b35e87dce47b43119d13bd514d434a76 P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:33.617241 11517 raft_consensus.cc:359] T b35e87dce47b43119d13bd514d434a76 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:33.618218 11517 raft_consensus.cc:385] T b35e87dce47b43119d13bd514d434a76 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:33.617950 11519 consensus_queue.cc:260] T 9e659a7e9644447daa84c89a46e934de P e3760873d2be4dc7b991027c1deef35d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } } peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } }
I20260709 13:03:33.618592 11517 raft_consensus.cc:740] T b35e87dce47b43119d13bd514d434a76 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7eb6f135338f4b84b60b7e67ab3d81d7, State: Initialized, Role: FOLLOWER
I20260709 13:03:33.619535 11517 consensus_queue.cc:260] T b35e87dce47b43119d13bd514d434a76 P 7eb6f135338f4b84b60b7e67ab3d81d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:33.620537 11519 ts_tablet_manager.cc:1434] T 9e659a7e9644447daa84c89a46e934de P e3760873d2be4dc7b991027c1deef35d: Time spent starting tablet: real 0.026s	user 0.009s	sys 0.000s
I20260709 13:03:33.621780 11519 tablet_bootstrap.cc:492] T 205736ed2ee6439588e8db06793e4cd6 P e3760873d2be4dc7b991027c1deef35d: Bootstrap starting.
I20260709 13:03:33.621912 11517 ts_tablet_manager.cc:1434] T b35e87dce47b43119d13bd514d434a76 P 7eb6f135338f4b84b60b7e67ab3d81d7: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:03:33.623112 11517 tablet_bootstrap.cc:492] T 71db464af9104a8a86fd623394da3511 P 7eb6f135338f4b84b60b7e67ab3d81d7: Bootstrap starting.
I20260709 13:03:33.628330 11521 tablet_bootstrap.cc:492] T b35e87dce47b43119d13bd514d434a76 P 57da47b50bc847c997f07dccaeae280a: No bootstrap required, opened a new log
I20260709 13:03:33.628636 11519 tablet_bootstrap.cc:654] T 205736ed2ee6439588e8db06793e4cd6 P e3760873d2be4dc7b991027c1deef35d: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:33.628968 11521 ts_tablet_manager.cc:1403] T b35e87dce47b43119d13bd514d434a76 P 57da47b50bc847c997f07dccaeae280a: Time spent bootstrapping tablet: real 0.049s	user 0.014s	sys 0.002s
I20260709 13:03:33.629966 11517 tablet_bootstrap.cc:654] T 71db464af9104a8a86fd623394da3511 P 7eb6f135338f4b84b60b7e67ab3d81d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:33.632356 11521 raft_consensus.cc:359] T b35e87dce47b43119d13bd514d434a76 P 57da47b50bc847c997f07dccaeae280a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:33.633258 11521 raft_consensus.cc:385] T b35e87dce47b43119d13bd514d434a76 P 57da47b50bc847c997f07dccaeae280a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:33.633561 11521 raft_consensus.cc:740] T b35e87dce47b43119d13bd514d434a76 P 57da47b50bc847c997f07dccaeae280a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57da47b50bc847c997f07dccaeae280a, State: Initialized, Role: FOLLOWER
I20260709 13:03:33.634629 11521 consensus_queue.cc:260] T b35e87dce47b43119d13bd514d434a76 P 57da47b50bc847c997f07dccaeae280a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:33.637764 11521 ts_tablet_manager.cc:1434] T b35e87dce47b43119d13bd514d434a76 P 57da47b50bc847c997f07dccaeae280a: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.005s
I20260709 13:03:33.638859 11521 tablet_bootstrap.cc:492] T 9e659a7e9644447daa84c89a46e934de P 57da47b50bc847c997f07dccaeae280a: Bootstrap starting.
I20260709 13:03:33.640468 11519 tablet_bootstrap.cc:492] T 205736ed2ee6439588e8db06793e4cd6 P e3760873d2be4dc7b991027c1deef35d: No bootstrap required, opened a new log
I20260709 13:03:33.641081 11519 ts_tablet_manager.cc:1403] T 205736ed2ee6439588e8db06793e4cd6 P e3760873d2be4dc7b991027c1deef35d: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.000s
I20260709 13:03:33.644218 11519 raft_consensus.cc:359] T 205736ed2ee6439588e8db06793e4cd6 P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:33.645376 11519 raft_consensus.cc:385] T 205736ed2ee6439588e8db06793e4cd6 P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:33.647696 11519 raft_consensus.cc:740] T 205736ed2ee6439588e8db06793e4cd6 P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3760873d2be4dc7b991027c1deef35d, State: Initialized, Role: FOLLOWER
W20260709 13:03:33.647343 11274 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:03:33.647927 11477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "120ae599baa547b1855a1ba361226d3e" candidate_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57da47b50bc847c997f07dccaeae280a" is_pre_election: true
I20260709 13:03:33.648653 11477 raft_consensus.cc:2468] T 120ae599baa547b1855a1ba361226d3e P 57da47b50bc847c997f07dccaeae280a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7eb6f135338f4b84b60b7e67ab3d81d7 in term 0.
I20260709 13:03:33.648828 11519 consensus_queue.cc:260] T 205736ed2ee6439588e8db06793e4cd6 P e3760873d2be4dc7b991027c1deef35d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:33.646848 11521 tablet_bootstrap.cc:654] T 9e659a7e9644447daa84c89a46e934de P 57da47b50bc847c997f07dccaeae280a: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:33.650343 11369 leader_election.cc:304] T 120ae599baa547b1855a1ba361226d3e P 7eb6f135338f4b84b60b7e67ab3d81d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 57da47b50bc847c997f07dccaeae280a, 7eb6f135338f4b84b60b7e67ab3d81d7; no voters: e3760873d2be4dc7b991027c1deef35d
I20260709 13:03:33.650811 11517 tablet_bootstrap.cc:492] T 71db464af9104a8a86fd623394da3511 P 7eb6f135338f4b84b60b7e67ab3d81d7: No bootstrap required, opened a new log
I20260709 13:03:33.651234 11519 ts_tablet_manager.cc:1434] T 205736ed2ee6439588e8db06793e4cd6 P e3760873d2be4dc7b991027c1deef35d: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.001s
I20260709 13:03:33.651328 11517 ts_tablet_manager.cc:1403] T 71db464af9104a8a86fd623394da3511 P 7eb6f135338f4b84b60b7e67ab3d81d7: Time spent bootstrapping tablet: real 0.028s	user 0.020s	sys 0.004s
I20260709 13:03:33.652432 11519 tablet_bootstrap.cc:492] T a802e0f3aab1477091f50d46836a5e34 P e3760873d2be4dc7b991027c1deef35d: Bootstrap starting.
I20260709 13:03:33.651580 11522 raft_consensus.cc:2804] T 120ae599baa547b1855a1ba361226d3e P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:33.654541 11517 raft_consensus.cc:359] T 71db464af9104a8a86fd623394da3511 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:33.655138 11522 raft_consensus.cc:493] T 120ae599baa547b1855a1ba361226d3e P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:33.655485 11517 raft_consensus.cc:385] T 71db464af9104a8a86fd623394da3511 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:33.655606 11522 raft_consensus.cc:3060] T 120ae599baa547b1855a1ba361226d3e P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:33.655817 11517 raft_consensus.cc:740] T 71db464af9104a8a86fd623394da3511 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7eb6f135338f4b84b60b7e67ab3d81d7, State: Initialized, Role: FOLLOWER
I20260709 13:03:33.656670 11517 consensus_queue.cc:260] T 71db464af9104a8a86fd623394da3511 P 7eb6f135338f4b84b60b7e67ab3d81d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:33.660171 11519 tablet_bootstrap.cc:654] T a802e0f3aab1477091f50d46836a5e34 P e3760873d2be4dc7b991027c1deef35d: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:33.661720 11521 tablet_bootstrap.cc:492] T 9e659a7e9644447daa84c89a46e934de P 57da47b50bc847c997f07dccaeae280a: No bootstrap required, opened a new log
I20260709 13:03:33.662278 11521 ts_tablet_manager.cc:1403] T 9e659a7e9644447daa84c89a46e934de P 57da47b50bc847c997f07dccaeae280a: Time spent bootstrapping tablet: real 0.024s	user 0.007s	sys 0.010s
I20260709 13:03:33.665587 11521 raft_consensus.cc:359] T 9e659a7e9644447daa84c89a46e934de P 57da47b50bc847c997f07dccaeae280a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } } peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } }
I20260709 13:03:33.666072 11517 ts_tablet_manager.cc:1434] T 71db464af9104a8a86fd623394da3511 P 7eb6f135338f4b84b60b7e67ab3d81d7: Time spent starting tablet: real 0.014s	user 0.001s	sys 0.012s
I20260709 13:03:33.666432 11521 raft_consensus.cc:385] T 9e659a7e9644447daa84c89a46e934de P 57da47b50bc847c997f07dccaeae280a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:33.666829 11521 raft_consensus.cc:740] T 9e659a7e9644447daa84c89a46e934de P 57da47b50bc847c997f07dccaeae280a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57da47b50bc847c997f07dccaeae280a, State: Initialized, Role: FOLLOWER
I20260709 13:03:33.667186 11517 tablet_bootstrap.cc:492] T ec9a5210a9a84816bc2d263d456f9a93 P 7eb6f135338f4b84b60b7e67ab3d81d7: Bootstrap starting.
I20260709 13:03:33.667912 11521 consensus_queue.cc:260] T 9e659a7e9644447daa84c89a46e934de P 57da47b50bc847c997f07dccaeae280a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } } peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } }
I20260709 13:03:33.670831 11521 ts_tablet_manager.cc:1434] T 9e659a7e9644447daa84c89a46e934de P 57da47b50bc847c997f07dccaeae280a: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.004s
I20260709 13:03:33.672019 11521 tablet_bootstrap.cc:492] T dd5040fb5b614dd2990e57812dadd3b7 P 57da47b50bc847c997f07dccaeae280a: Bootstrap starting.
I20260709 13:03:33.673889 11517 tablet_bootstrap.cc:654] T ec9a5210a9a84816bc2d263d456f9a93 P 7eb6f135338f4b84b60b7e67ab3d81d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:33.679358 11521 tablet_bootstrap.cc:654] T dd5040fb5b614dd2990e57812dadd3b7 P 57da47b50bc847c997f07dccaeae280a: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:33.685719 11517 tablet_bootstrap.cc:492] T ec9a5210a9a84816bc2d263d456f9a93 P 7eb6f135338f4b84b60b7e67ab3d81d7: No bootstrap required, opened a new log
I20260709 13:03:33.686091 11523 raft_consensus.cc:493] T dd5040fb5b614dd2990e57812dadd3b7 P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:33.686255 11517 ts_tablet_manager.cc:1403] T ec9a5210a9a84816bc2d263d456f9a93 P 7eb6f135338f4b84b60b7e67ab3d81d7: Time spent bootstrapping tablet: real 0.019s	user 0.005s	sys 0.011s
I20260709 13:03:33.686836 11523 raft_consensus.cc:515] T dd5040fb5b614dd2990e57812dadd3b7 P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:33.689648 11517 raft_consensus.cc:359] T ec9a5210a9a84816bc2d263d456f9a93 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:33.690120 11403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5040fb5b614dd2990e57812dadd3b7" candidate_uuid: "e3760873d2be4dc7b991027c1deef35d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" is_pre_election: true
I20260709 13:03:33.690505 11517 raft_consensus.cc:385] T ec9a5210a9a84816bc2d263d456f9a93 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:33.690879 11517 raft_consensus.cc:740] T ec9a5210a9a84816bc2d263d456f9a93 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7eb6f135338f4b84b60b7e67ab3d81d7, State: Initialized, Role: FOLLOWER
I20260709 13:03:33.690963 11403 raft_consensus.cc:2468] T dd5040fb5b614dd2990e57812dadd3b7 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3760873d2be4dc7b991027c1deef35d in term 0.
I20260709 13:03:33.691787 11517 consensus_queue.cc:260] T ec9a5210a9a84816bc2d263d456f9a93 P 7eb6f135338f4b84b60b7e67ab3d81d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:33.692591 11292 leader_election.cc:304] T dd5040fb5b614dd2990e57812dadd3b7 P e3760873d2be4dc7b991027c1deef35d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7eb6f135338f4b84b60b7e67ab3d81d7, e3760873d2be4dc7b991027c1deef35d; no voters: 
I20260709 13:03:33.694358 11517 ts_tablet_manager.cc:1434] T ec9a5210a9a84816bc2d263d456f9a93 P 7eb6f135338f4b84b60b7e67ab3d81d7: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:03:33.694552 11523 leader_election.cc:290] T dd5040fb5b614dd2990e57812dadd3b7 P e3760873d2be4dc7b991027c1deef35d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7eb6f135338f4b84b60b7e67ab3d81d7 (127.0.107.194:42689), 57da47b50bc847c997f07dccaeae280a (127.0.107.195:37515)
I20260709 13:03:33.700168 11523 raft_consensus.cc:2804] T dd5040fb5b614dd2990e57812dadd3b7 P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:33.700656 11523 raft_consensus.cc:493] T dd5040fb5b614dd2990e57812dadd3b7 P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:33.696118 11477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5040fb5b614dd2990e57812dadd3b7" candidate_uuid: "e3760873d2be4dc7b991027c1deef35d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57da47b50bc847c997f07dccaeae280a" is_pre_election: true
I20260709 13:03:33.701293 11523 raft_consensus.cc:3060] T dd5040fb5b614dd2990e57812dadd3b7 P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:03:33.702702 11294 leader_election.cc:343] T dd5040fb5b614dd2990e57812dadd3b7 P e3760873d2be4dc7b991027c1deef35d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 57da47b50bc847c997f07dccaeae280a (127.0.107.195:37515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:33.701442 11522 raft_consensus.cc:515] T 120ae599baa547b1855a1ba361226d3e P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:33.712342 11522 leader_election.cc:290] T 120ae599baa547b1855a1ba361226d3e P 7eb6f135338f4b84b60b7e67ab3d81d7 [CANDIDATE]: Term 1 election: Requested vote from peers e3760873d2be4dc7b991027c1deef35d (127.0.107.193:35003), 57da47b50bc847c997f07dccaeae280a (127.0.107.195:37515)
I20260709 13:03:33.709028 11523 raft_consensus.cc:515] T dd5040fb5b614dd2990e57812dadd3b7 P e3760873d2be4dc7b991027c1deef35d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:33.700594 11517 tablet_bootstrap.cc:492] T 205736ed2ee6439588e8db06793e4cd6 P 7eb6f135338f4b84b60b7e67ab3d81d7: Bootstrap starting.
I20260709 13:03:33.713310 11328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "120ae599baa547b1855a1ba361226d3e" candidate_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3760873d2be4dc7b991027c1deef35d"
W20260709 13:03:33.715669 11369 leader_election.cc:343] T 120ae599baa547b1855a1ba361226d3e P 7eb6f135338f4b84b60b7e67ab3d81d7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e3760873d2be4dc7b991027c1deef35d (127.0.107.193:35003): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:33.716270 11477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "120ae599baa547b1855a1ba361226d3e" candidate_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57da47b50bc847c997f07dccaeae280a"
I20260709 13:03:33.717051 11477 raft_consensus.cc:3060] T 120ae599baa547b1855a1ba361226d3e P 57da47b50bc847c997f07dccaeae280a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:33.719595 11517 tablet_bootstrap.cc:654] T 205736ed2ee6439588e8db06793e4cd6 P 7eb6f135338f4b84b60b7e67ab3d81d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:33.720770 11523 leader_election.cc:290] T dd5040fb5b614dd2990e57812dadd3b7 P e3760873d2be4dc7b991027c1deef35d [CANDIDATE]: Term 1 election: Requested vote from peers 7eb6f135338f4b84b60b7e67ab3d81d7 (127.0.107.194:42689), 57da47b50bc847c997f07dccaeae280a (127.0.107.195:37515)
I20260709 13:03:33.721700 11476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5040fb5b614dd2990e57812dadd3b7" candidate_uuid: "e3760873d2be4dc7b991027c1deef35d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57da47b50bc847c997f07dccaeae280a"
W20260709 13:03:33.723215 11294 leader_election.cc:343] T dd5040fb5b614dd2990e57812dadd3b7 P e3760873d2be4dc7b991027c1deef35d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 57da47b50bc847c997f07dccaeae280a (127.0.107.195:37515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:33.724133 11519 tablet_bootstrap.cc:492] T a802e0f3aab1477091f50d46836a5e34 P e3760873d2be4dc7b991027c1deef35d: No bootstrap required, opened a new log
I20260709 13:03:33.724486 11403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5040fb5b614dd2990e57812dadd3b7" candidate_uuid: "e3760873d2be4dc7b991027c1deef35d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7"
I20260709 13:03:33.724756 11519 ts_tablet_manager.cc:1403] T a802e0f3aab1477091f50d46836a5e34 P e3760873d2be4dc7b991027c1deef35d: Time spent bootstrapping tablet: real 0.073s	user 0.041s	sys 0.030s
I20260709 13:03:33.725124 11403 raft_consensus.cc:3060] T dd5040fb5b614dd2990e57812dadd3b7 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:33.726857 11521 tablet_bootstrap.cc:492] T dd5040fb5b614dd2990e57812dadd3b7 P 57da47b50bc847c997f07dccaeae280a: No bootstrap required, opened a new log
I20260709 13:03:33.727535 11521 ts_tablet_manager.cc:1403] T dd5040fb5b614dd2990e57812dadd3b7 P 57da47b50bc847c997f07dccaeae280a: Time spent bootstrapping tablet: real 0.056s	user 0.015s	sys 0.004s
I20260709 13:03:33.728343 11519 raft_consensus.cc:359] T a802e0f3aab1477091f50d46836a5e34 P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:33.729192 11519 raft_consensus.cc:385] T a802e0f3aab1477091f50d46836a5e34 P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:33.729540 11519 raft_consensus.cc:740] T a802e0f3aab1477091f50d46836a5e34 P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3760873d2be4dc7b991027c1deef35d, State: Initialized, Role: FOLLOWER
I20260709 13:03:33.730491 11519 consensus_queue.cc:260] T a802e0f3aab1477091f50d46836a5e34 P e3760873d2be4dc7b991027c1deef35d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:33.731477 11477 raft_consensus.cc:2468] T 120ae599baa547b1855a1ba361226d3e P 57da47b50bc847c997f07dccaeae280a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7eb6f135338f4b84b60b7e67ab3d81d7 in term 1.
I20260709 13:03:33.733052 11369 leader_election.cc:304] T 120ae599baa547b1855a1ba361226d3e P 7eb6f135338f4b84b60b7e67ab3d81d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 57da47b50bc847c997f07dccaeae280a, 7eb6f135338f4b84b60b7e67ab3d81d7; no voters: e3760873d2be4dc7b991027c1deef35d
I20260709 13:03:33.734279 11522 raft_consensus.cc:2804] T 120ae599baa547b1855a1ba361226d3e P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:33.734824 11522 raft_consensus.cc:697] T 120ae599baa547b1855a1ba361226d3e P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 LEADER]: Becoming Leader. State: Replica: 7eb6f135338f4b84b60b7e67ab3d81d7, State: Running, Role: LEADER
I20260709 13:03:33.735519 11519 ts_tablet_manager.cc:1434] T a802e0f3aab1477091f50d46836a5e34 P e3760873d2be4dc7b991027c1deef35d: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:03:33.735617 11521 raft_consensus.cc:359] T dd5040fb5b614dd2990e57812dadd3b7 P 57da47b50bc847c997f07dccaeae280a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:33.736555 11521 raft_consensus.cc:385] T dd5040fb5b614dd2990e57812dadd3b7 P 57da47b50bc847c997f07dccaeae280a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:33.736893 11519 tablet_bootstrap.cc:492] T ec9a5210a9a84816bc2d263d456f9a93 P e3760873d2be4dc7b991027c1deef35d: Bootstrap starting.
I20260709 13:03:33.735690 11522 consensus_queue.cc:237] T 120ae599baa547b1855a1ba361226d3e P 7eb6f135338f4b84b60b7e67ab3d81d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:33.736852 11521 raft_consensus.cc:740] T dd5040fb5b614dd2990e57812dadd3b7 P 57da47b50bc847c997f07dccaeae280a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57da47b50bc847c997f07dccaeae280a, State: Initialized, Role: FOLLOWER
I20260709 13:03:33.739001 11521 consensus_queue.cc:260] T dd5040fb5b614dd2990e57812dadd3b7 P 57da47b50bc847c997f07dccaeae280a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:33.741967 11403 raft_consensus.cc:2468] T dd5040fb5b614dd2990e57812dadd3b7 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3760873d2be4dc7b991027c1deef35d in term 1.
I20260709 13:03:33.744771 11517 tablet_bootstrap.cc:492] T 205736ed2ee6439588e8db06793e4cd6 P 7eb6f135338f4b84b60b7e67ab3d81d7: No bootstrap required, opened a new log
I20260709 13:03:33.745345 11517 ts_tablet_manager.cc:1403] T 205736ed2ee6439588e8db06793e4cd6 P 7eb6f135338f4b84b60b7e67ab3d81d7: Time spent bootstrapping tablet: real 0.045s	user 0.011s	sys 0.019s
I20260709 13:03:33.745687 11521 ts_tablet_manager.cc:1434] T dd5040fb5b614dd2990e57812dadd3b7 P 57da47b50bc847c997f07dccaeae280a: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 13:03:33.744616 11292 leader_election.cc:304] T dd5040fb5b614dd2990e57812dadd3b7 P e3760873d2be4dc7b991027c1deef35d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7eb6f135338f4b84b60b7e67ab3d81d7, e3760873d2be4dc7b991027c1deef35d; no voters: 57da47b50bc847c997f07dccaeae280a
I20260709 13:03:33.746315 11519 tablet_bootstrap.cc:654] T ec9a5210a9a84816bc2d263d456f9a93 P e3760873d2be4dc7b991027c1deef35d: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:33.748080 11517 raft_consensus.cc:359] T 205736ed2ee6439588e8db06793e4cd6 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:33.748703 11521 tablet_bootstrap.cc:492] T a802e0f3aab1477091f50d46836a5e34 P 57da47b50bc847c997f07dccaeae280a: Bootstrap starting.
I20260709 13:03:33.748783 11517 raft_consensus.cc:385] T 205736ed2ee6439588e8db06793e4cd6 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:33.749260 11517 raft_consensus.cc:740] T 205736ed2ee6439588e8db06793e4cd6 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7eb6f135338f4b84b60b7e67ab3d81d7, State: Initialized, Role: FOLLOWER
I20260709 13:03:33.750059 11517 consensus_queue.cc:260] T 205736ed2ee6439588e8db06793e4cd6 P 7eb6f135338f4b84b60b7e67ab3d81d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:33.752312 11517 ts_tablet_manager.cc:1434] T 205736ed2ee6439588e8db06793e4cd6 P 7eb6f135338f4b84b60b7e67ab3d81d7: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:03:33.753233 11517 tablet_bootstrap.cc:492] T de8c0dddbdc34ad88de9156beb74bef7 P 7eb6f135338f4b84b60b7e67ab3d81d7: Bootstrap starting.
I20260709 13:03:33.747975 11523 raft_consensus.cc:2804] T dd5040fb5b614dd2990e57812dadd3b7 P e3760873d2be4dc7b991027c1deef35d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:33.756160 11523 raft_consensus.cc:697] T dd5040fb5b614dd2990e57812dadd3b7 P e3760873d2be4dc7b991027c1deef35d [term 1 LEADER]: Becoming Leader. State: Replica: e3760873d2be4dc7b991027c1deef35d, State: Running, Role: LEADER
I20260709 13:03:33.757040 11523 consensus_queue.cc:237] T dd5040fb5b614dd2990e57812dadd3b7 P e3760873d2be4dc7b991027c1deef35d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:33.758878 11519 tablet_bootstrap.cc:492] T ec9a5210a9a84816bc2d263d456f9a93 P e3760873d2be4dc7b991027c1deef35d: No bootstrap required, opened a new log
I20260709 13:03:33.759511 11519 ts_tablet_manager.cc:1403] T ec9a5210a9a84816bc2d263d456f9a93 P e3760873d2be4dc7b991027c1deef35d: Time spent bootstrapping tablet: real 0.023s	user 0.018s	sys 0.001s
I20260709 13:03:33.762820 11517 tablet_bootstrap.cc:654] T de8c0dddbdc34ad88de9156beb74bef7 P 7eb6f135338f4b84b60b7e67ab3d81d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:33.762475 11519 raft_consensus.cc:359] T ec9a5210a9a84816bc2d263d456f9a93 P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:33.763481 11519 raft_consensus.cc:385] T ec9a5210a9a84816bc2d263d456f9a93 P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:33.763868 11519 raft_consensus.cc:740] T ec9a5210a9a84816bc2d263d456f9a93 P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3760873d2be4dc7b991027c1deef35d, State: Initialized, Role: FOLLOWER
I20260709 13:03:33.764755 11519 consensus_queue.cc:260] T ec9a5210a9a84816bc2d263d456f9a93 P e3760873d2be4dc7b991027c1deef35d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:33.765318 11521 tablet_bootstrap.cc:654] T a802e0f3aab1477091f50d46836a5e34 P 57da47b50bc847c997f07dccaeae280a: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:33.767194 11519 ts_tablet_manager.cc:1434] T ec9a5210a9a84816bc2d263d456f9a93 P e3760873d2be4dc7b991027c1deef35d: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:03:33.768298 11519 tablet_bootstrap.cc:492] T 120ae599baa547b1855a1ba361226d3e P e3760873d2be4dc7b991027c1deef35d: Bootstrap starting.
I20260709 13:03:33.775051 11519 tablet_bootstrap.cc:654] T 120ae599baa547b1855a1ba361226d3e P e3760873d2be4dc7b991027c1deef35d: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:33.774544 11226 catalog_manager.cc:5697] T dd5040fb5b614dd2990e57812dadd3b7 P e3760873d2be4dc7b991027c1deef35d reported cstate change: term changed from 0 to 1, leader changed from <none> to e3760873d2be4dc7b991027c1deef35d (127.0.107.193). New cstate: current_term: 1 leader_uuid: "e3760873d2be4dc7b991027c1deef35d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:33.783587 11521 tablet_bootstrap.cc:492] T a802e0f3aab1477091f50d46836a5e34 P 57da47b50bc847c997f07dccaeae280a: No bootstrap required, opened a new log
I20260709 13:03:33.784119 11521 ts_tablet_manager.cc:1403] T a802e0f3aab1477091f50d46836a5e34 P 57da47b50bc847c997f07dccaeae280a: Time spent bootstrapping tablet: real 0.036s	user 0.012s	sys 0.000s
I20260709 13:03:33.784262 11519 tablet_bootstrap.cc:492] T 120ae599baa547b1855a1ba361226d3e P e3760873d2be4dc7b991027c1deef35d: No bootstrap required, opened a new log
I20260709 13:03:33.784884 11519 ts_tablet_manager.cc:1403] T 120ae599baa547b1855a1ba361226d3e P e3760873d2be4dc7b991027c1deef35d: Time spent bootstrapping tablet: real 0.017s	user 0.008s	sys 0.002s
I20260709 13:03:33.787454 11521 raft_consensus.cc:359] T a802e0f3aab1477091f50d46836a5e34 P 57da47b50bc847c997f07dccaeae280a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:33.788444 11521 raft_consensus.cc:385] T a802e0f3aab1477091f50d46836a5e34 P 57da47b50bc847c997f07dccaeae280a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:33.788816 11521 raft_consensus.cc:740] T a802e0f3aab1477091f50d46836a5e34 P 57da47b50bc847c997f07dccaeae280a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57da47b50bc847c997f07dccaeae280a, State: Initialized, Role: FOLLOWER
I20260709 13:03:33.790017 11523 raft_consensus.cc:493] T 9e659a7e9644447daa84c89a46e934de P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:33.789754 11521 consensus_queue.cc:260] T a802e0f3aab1477091f50d46836a5e34 P 57da47b50bc847c997f07dccaeae280a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:33.788009 11519 raft_consensus.cc:359] T 120ae599baa547b1855a1ba361226d3e P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:33.790561 11523 raft_consensus.cc:515] T 9e659a7e9644447daa84c89a46e934de P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } } peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } }
I20260709 13:03:33.792301 11517 tablet_bootstrap.cc:492] T de8c0dddbdc34ad88de9156beb74bef7 P 7eb6f135338f4b84b60b7e67ab3d81d7: No bootstrap required, opened a new log
I20260709 13:03:33.792739 11523 leader_election.cc:290] T 9e659a7e9644447daa84c89a46e934de P e3760873d2be4dc7b991027c1deef35d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7eb6f135338f4b84b60b7e67ab3d81d7 (127.0.107.194:42689), 57da47b50bc847c997f07dccaeae280a (127.0.107.195:37515)
I20260709 13:03:33.793094 11517 ts_tablet_manager.cc:1403] T de8c0dddbdc34ad88de9156beb74bef7 P 7eb6f135338f4b84b60b7e67ab3d81d7: Time spent bootstrapping tablet: real 0.040s	user 0.019s	sys 0.014s
I20260709 13:03:33.792214 11223 catalog_manager.cc:5697] T 120ae599baa547b1855a1ba361226d3e P 7eb6f135338f4b84b60b7e67ab3d81d7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7eb6f135338f4b84b60b7e67ab3d81d7 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:33.790907 11519 raft_consensus.cc:385] T 120ae599baa547b1855a1ba361226d3e P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:33.794312 11519 raft_consensus.cc:740] T 120ae599baa547b1855a1ba361226d3e P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3760873d2be4dc7b991027c1deef35d, State: Initialized, Role: FOLLOWER
I20260709 13:03:33.795085 11519 consensus_queue.cc:260] T 120ae599baa547b1855a1ba361226d3e P e3760873d2be4dc7b991027c1deef35d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:33.795996 11477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e659a7e9644447daa84c89a46e934de" candidate_uuid: "e3760873d2be4dc7b991027c1deef35d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57da47b50bc847c997f07dccaeae280a" is_pre_election: true
I20260709 13:03:33.796667 11477 raft_consensus.cc:2468] T 9e659a7e9644447daa84c89a46e934de P 57da47b50bc847c997f07dccaeae280a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3760873d2be4dc7b991027c1deef35d in term 0.
I20260709 13:03:33.797052 11519 ts_tablet_manager.cc:1434] T 120ae599baa547b1855a1ba361226d3e P e3760873d2be4dc7b991027c1deef35d: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:03:33.798055 11294 leader_election.cc:304] T 9e659a7e9644447daa84c89a46e934de P e3760873d2be4dc7b991027c1deef35d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57da47b50bc847c997f07dccaeae280a, e3760873d2be4dc7b991027c1deef35d; no voters: 
I20260709 13:03:33.799499 11548 raft_consensus.cc:2804] T 9e659a7e9644447daa84c89a46e934de P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:33.795222 11403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e659a7e9644447daa84c89a46e934de" candidate_uuid: "e3760873d2be4dc7b991027c1deef35d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" is_pre_election: true
I20260709 13:03:33.799757 11521 ts_tablet_manager.cc:1434] T a802e0f3aab1477091f50d46836a5e34 P 57da47b50bc847c997f07dccaeae280a: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.000s
I20260709 13:03:33.800423 11403 raft_consensus.cc:2468] T 9e659a7e9644447daa84c89a46e934de P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3760873d2be4dc7b991027c1deef35d in term 0.
I20260709 13:03:33.800726 11517 raft_consensus.cc:359] T de8c0dddbdc34ad88de9156beb74bef7 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:33.801559 11517 raft_consensus.cc:385] T de8c0dddbdc34ad88de9156beb74bef7 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:33.801865 11517 raft_consensus.cc:740] T de8c0dddbdc34ad88de9156beb74bef7 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7eb6f135338f4b84b60b7e67ab3d81d7, State: Initialized, Role: FOLLOWER
I20260709 13:03:33.799880 11548 raft_consensus.cc:493] T 9e659a7e9644447daa84c89a46e934de P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:33.802552 11548 raft_consensus.cc:3060] T 9e659a7e9644447daa84c89a46e934de P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:33.802775 11517 consensus_queue.cc:260] T de8c0dddbdc34ad88de9156beb74bef7 P 7eb6f135338f4b84b60b7e67ab3d81d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:33.804847 11521 tablet_bootstrap.cc:492] T de8c0dddbdc34ad88de9156beb74bef7 P 57da47b50bc847c997f07dccaeae280a: Bootstrap starting.
I20260709 13:03:33.805342 11517 ts_tablet_manager.cc:1434] T de8c0dddbdc34ad88de9156beb74bef7 P 7eb6f135338f4b84b60b7e67ab3d81d7: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:03:33.806440 11527 raft_consensus.cc:493] T 71db464af9104a8a86fd623394da3511 P 57da47b50bc847c997f07dccaeae280a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:33.806973 11527 raft_consensus.cc:515] T 71db464af9104a8a86fd623394da3511 P 57da47b50bc847c997f07dccaeae280a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:33.809954 11548 raft_consensus.cc:515] T 9e659a7e9644447daa84c89a46e934de P e3760873d2be4dc7b991027c1deef35d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } } peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } }
I20260709 13:03:33.812741 11403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e659a7e9644447daa84c89a46e934de" candidate_uuid: "e3760873d2be4dc7b991027c1deef35d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7"
I20260709 13:03:33.813337 11403 raft_consensus.cc:3060] T 9e659a7e9644447daa84c89a46e934de P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:33.814050 11477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e659a7e9644447daa84c89a46e934de" candidate_uuid: "e3760873d2be4dc7b991027c1deef35d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57da47b50bc847c997f07dccaeae280a"
I20260709 13:03:33.814693 11477 raft_consensus.cc:3060] T 9e659a7e9644447daa84c89a46e934de P 57da47b50bc847c997f07dccaeae280a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:33.822273 11403 raft_consensus.cc:2468] T 9e659a7e9644447daa84c89a46e934de P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3760873d2be4dc7b991027c1deef35d in term 1.
I20260709 13:03:33.822995 11522 raft_consensus.cc:493] T a802e0f3aab1477091f50d46836a5e34 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:33.823272 11477 raft_consensus.cc:2468] T 9e659a7e9644447daa84c89a46e934de P 57da47b50bc847c997f07dccaeae280a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3760873d2be4dc7b991027c1deef35d in term 1.
I20260709 13:03:33.823702 11292 leader_election.cc:304] T 9e659a7e9644447daa84c89a46e934de P e3760873d2be4dc7b991027c1deef35d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7eb6f135338f4b84b60b7e67ab3d81d7, e3760873d2be4dc7b991027c1deef35d; no voters: 
I20260709 13:03:33.823607 11522 raft_consensus.cc:515] T a802e0f3aab1477091f50d46836a5e34 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:33.823734 11548 leader_election.cc:290] T 9e659a7e9644447daa84c89a46e934de P e3760873d2be4dc7b991027c1deef35d [CANDIDATE]: Term 1 election: Requested vote from peers 7eb6f135338f4b84b60b7e67ab3d81d7 (127.0.107.194:42689), 57da47b50bc847c997f07dccaeae280a (127.0.107.195:37515)
I20260709 13:03:33.824806 11523 raft_consensus.cc:2804] T 9e659a7e9644447daa84c89a46e934de P e3760873d2be4dc7b991027c1deef35d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:33.826448 11328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a802e0f3aab1477091f50d46836a5e34" candidate_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3760873d2be4dc7b991027c1deef35d" is_pre_election: true
I20260709 13:03:33.827092 11328 raft_consensus.cc:2468] T a802e0f3aab1477091f50d46836a5e34 P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7eb6f135338f4b84b60b7e67ab3d81d7 in term 0.
I20260709 13:03:33.827762 11476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a802e0f3aab1477091f50d46836a5e34" candidate_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57da47b50bc847c997f07dccaeae280a" is_pre_election: true
I20260709 13:03:33.828239 11369 leader_election.cc:304] T a802e0f3aab1477091f50d46836a5e34 P 7eb6f135338f4b84b60b7e67ab3d81d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7eb6f135338f4b84b60b7e67ab3d81d7, e3760873d2be4dc7b991027c1deef35d; no voters: 
I20260709 13:03:33.828461 11476 raft_consensus.cc:2468] T a802e0f3aab1477091f50d46836a5e34 P 57da47b50bc847c997f07dccaeae280a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7eb6f135338f4b84b60b7e67ab3d81d7 in term 0.
I20260709 13:03:33.829427 11544 raft_consensus.cc:2804] T a802e0f3aab1477091f50d46836a5e34 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:33.829831 11544 raft_consensus.cc:493] T a802e0f3aab1477091f50d46836a5e34 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:33.829977 11522 leader_election.cc:290] T a802e0f3aab1477091f50d46836a5e34 P 7eb6f135338f4b84b60b7e67ab3d81d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3760873d2be4dc7b991027c1deef35d (127.0.107.193:35003), 57da47b50bc847c997f07dccaeae280a (127.0.107.195:37515)
I20260709 13:03:33.830353 11544 raft_consensus.cc:3060] T a802e0f3aab1477091f50d46836a5e34 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:33.831949 11527 leader_election.cc:290] T 71db464af9104a8a86fd623394da3511 P 57da47b50bc847c997f07dccaeae280a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3760873d2be4dc7b991027c1deef35d (127.0.107.193:35003), 7eb6f135338f4b84b60b7e67ab3d81d7 (127.0.107.194:42689)
I20260709 13:03:33.831866 11561 raft_consensus.cc:493] T ec9a5210a9a84816bc2d263d456f9a93 P 57da47b50bc847c997f07dccaeae280a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:33.798049 11519 tablet_bootstrap.cc:492] T de8c0dddbdc34ad88de9156beb74bef7 P e3760873d2be4dc7b991027c1deef35d: Bootstrap starting.
I20260709 13:03:33.838918 11544 raft_consensus.cc:515] T a802e0f3aab1477091f50d46836a5e34 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:33.840723 11561 raft_consensus.cc:515] T ec9a5210a9a84816bc2d263d456f9a93 P 57da47b50bc847c997f07dccaeae280a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:33.842967 11544 leader_election.cc:290] T a802e0f3aab1477091f50d46836a5e34 P 7eb6f135338f4b84b60b7e67ab3d81d7 [CANDIDATE]: Term 1 election: Requested vote from peers e3760873d2be4dc7b991027c1deef35d (127.0.107.193:35003), 57da47b50bc847c997f07dccaeae280a (127.0.107.195:37515)
I20260709 13:03:33.839061 11523 raft_consensus.cc:697] T 9e659a7e9644447daa84c89a46e934de P e3760873d2be4dc7b991027c1deef35d [term 1 LEADER]: Becoming Leader. State: Replica: e3760873d2be4dc7b991027c1deef35d, State: Running, Role: LEADER
I20260709 13:03:33.844277 11328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a802e0f3aab1477091f50d46836a5e34" candidate_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3760873d2be4dc7b991027c1deef35d"
I20260709 13:03:33.845173 11328 raft_consensus.cc:3060] T a802e0f3aab1477091f50d46836a5e34 P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:33.846786 11560 raft_consensus.cc:493] T 120ae599baa547b1855a1ba361226d3e P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:33.847322 11560 raft_consensus.cc:515] T 120ae599baa547b1855a1ba361226d3e P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:33.849047 11519 tablet_bootstrap.cc:654] T de8c0dddbdc34ad88de9156beb74bef7 P e3760873d2be4dc7b991027c1deef35d: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:33.850481 11403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "120ae599baa547b1855a1ba361226d3e" candidate_uuid: "e3760873d2be4dc7b991027c1deef35d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" is_pre_election: true
I20260709 13:03:33.844357 11523 consensus_queue.cc:237] T 9e659a7e9644447daa84c89a46e934de P e3760873d2be4dc7b991027c1deef35d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } } peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } }
I20260709 13:03:33.853184 11328 raft_consensus.cc:2468] T a802e0f3aab1477091f50d46836a5e34 P e3760873d2be4dc7b991027c1deef35d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7eb6f135338f4b84b60b7e67ab3d81d7 in term 1.
I20260709 13:03:33.854168 11548 raft_consensus.cc:493] T 71db464af9104a8a86fd623394da3511 P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:33.854512 11369 leader_election.cc:304] T a802e0f3aab1477091f50d46836a5e34 P 7eb6f135338f4b84b60b7e67ab3d81d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7eb6f135338f4b84b60b7e67ab3d81d7, e3760873d2be4dc7b991027c1deef35d; no voters: 
I20260709 13:03:33.854722 11548 raft_consensus.cc:515] T 71db464af9104a8a86fd623394da3511 P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:33.855602 11522 raft_consensus.cc:2804] T a802e0f3aab1477091f50d46836a5e34 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:33.856889 11522 raft_consensus.cc:697] T a802e0f3aab1477091f50d46836a5e34 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 LEADER]: Becoming Leader. State: Replica: 7eb6f135338f4b84b60b7e67ab3d81d7, State: Running, Role: LEADER
I20260709 13:03:33.856986 11548 leader_election.cc:290] T 71db464af9104a8a86fd623394da3511 P e3760873d2be4dc7b991027c1deef35d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7eb6f135338f4b84b60b7e67ab3d81d7 (127.0.107.194:42689), 57da47b50bc847c997f07dccaeae280a (127.0.107.195:37515)
I20260709 13:03:33.857787 11522 consensus_queue.cc:237] T a802e0f3aab1477091f50d46836a5e34 P 7eb6f135338f4b84b60b7e67ab3d81d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:33.858230 11403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71db464af9104a8a86fd623394da3511" candidate_uuid: "e3760873d2be4dc7b991027c1deef35d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" is_pre_election: true
I20260709 13:03:33.860554 11403 raft_consensus.cc:2468] T 71db464af9104a8a86fd623394da3511 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3760873d2be4dc7b991027c1deef35d in term 0.
I20260709 13:03:33.844318 11521 tablet_bootstrap.cc:654] T de8c0dddbdc34ad88de9156beb74bef7 P 57da47b50bc847c997f07dccaeae280a: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:33.858134 11564 raft_consensus.cc:493] T de8c0dddbdc34ad88de9156beb74bef7 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:33.859540 11477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71db464af9104a8a86fd623394da3511" candidate_uuid: "e3760873d2be4dc7b991027c1deef35d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57da47b50bc847c997f07dccaeae280a" is_pre_election: true
I20260709 13:03:33.861896 11477 raft_consensus.cc:2468] T 71db464af9104a8a86fd623394da3511 P 57da47b50bc847c997f07dccaeae280a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3760873d2be4dc7b991027c1deef35d in term 0.
I20260709 13:03:33.862113 11292 leader_election.cc:304] T 71db464af9104a8a86fd623394da3511 P e3760873d2be4dc7b991027c1deef35d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7eb6f135338f4b84b60b7e67ab3d81d7, e3760873d2be4dc7b991027c1deef35d; no voters: 
I20260709 13:03:33.863207 11548 raft_consensus.cc:2804] T 71db464af9104a8a86fd623394da3511 P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:33.863595 11548 raft_consensus.cc:493] T 71db464af9104a8a86fd623394da3511 P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:33.863991 11548 raft_consensus.cc:3060] T 71db464af9104a8a86fd623394da3511 P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:33.863986 11564 raft_consensus.cc:515] T de8c0dddbdc34ad88de9156beb74bef7 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:33.867674 11327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8c0dddbdc34ad88de9156beb74bef7" candidate_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3760873d2be4dc7b991027c1deef35d" is_pre_election: true
W20260709 13:03:33.869357 11369 leader_election.cc:343] T de8c0dddbdc34ad88de9156beb74bef7 P 7eb6f135338f4b84b60b7e67ab3d81d7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3760873d2be4dc7b991027c1deef35d (127.0.107.193:35003): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:33.870584 11560 leader_election.cc:290] T 120ae599baa547b1855a1ba361226d3e P e3760873d2be4dc7b991027c1deef35d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7eb6f135338f4b84b60b7e67ab3d81d7 (127.0.107.194:42689), 57da47b50bc847c997f07dccaeae280a (127.0.107.195:37515)
I20260709 13:03:33.870718 11477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "120ae599baa547b1855a1ba361226d3e" candidate_uuid: "e3760873d2be4dc7b991027c1deef35d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57da47b50bc847c997f07dccaeae280a" is_pre_election: true
I20260709 13:03:33.871694 11477 raft_consensus.cc:2393] T 120ae599baa547b1855a1ba361226d3e P 57da47b50bc847c997f07dccaeae280a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3760873d2be4dc7b991027c1deef35d in current term 1: Already voted for candidate 7eb6f135338f4b84b60b7e67ab3d81d7 in this term.
I20260709 13:03:33.872366 11548 raft_consensus.cc:515] T 71db464af9104a8a86fd623394da3511 P e3760873d2be4dc7b991027c1deef35d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:33.872887 11294 leader_election.cc:304] T 120ae599baa547b1855a1ba361226d3e P e3760873d2be4dc7b991027c1deef35d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3760873d2be4dc7b991027c1deef35d; no voters: 57da47b50bc847c997f07dccaeae280a, 7eb6f135338f4b84b60b7e67ab3d81d7
I20260709 13:03:33.873857 11560 raft_consensus.cc:3060] T 120ae599baa547b1855a1ba361226d3e P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:33.874680 11561 leader_election.cc:290] T ec9a5210a9a84816bc2d263d456f9a93 P 57da47b50bc847c997f07dccaeae280a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3760873d2be4dc7b991027c1deef35d (127.0.107.193:35003), 7eb6f135338f4b84b60b7e67ab3d81d7 (127.0.107.194:42689)
I20260709 13:03:33.875262 11564 leader_election.cc:290] T de8c0dddbdc34ad88de9156beb74bef7 P 7eb6f135338f4b84b60b7e67ab3d81d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3760873d2be4dc7b991027c1deef35d (127.0.107.193:35003), 57da47b50bc847c997f07dccaeae280a (127.0.107.195:37515)
I20260709 13:03:33.875679 11403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71db464af9104a8a86fd623394da3511" candidate_uuid: "e3760873d2be4dc7b991027c1deef35d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7"
I20260709 13:03:33.876364 11403 raft_consensus.cc:3060] T 71db464af9104a8a86fd623394da3511 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:33.884038 11477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a802e0f3aab1477091f50d46836a5e34" candidate_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57da47b50bc847c997f07dccaeae280a"
I20260709 13:03:33.884876 11477 raft_consensus.cc:3060] T a802e0f3aab1477091f50d46836a5e34 P 57da47b50bc847c997f07dccaeae280a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:33.884199 11225 catalog_manager.cc:5697] T a802e0f3aab1477091f50d46836a5e34 P 7eb6f135338f4b84b60b7e67ab3d81d7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7eb6f135338f4b84b60b7e67ab3d81d7 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:33.884987 11521 tablet_bootstrap.cc:492] T de8c0dddbdc34ad88de9156beb74bef7 P 57da47b50bc847c997f07dccaeae280a: No bootstrap required, opened a new log
I20260709 13:03:33.886160 11521 ts_tablet_manager.cc:1403] T de8c0dddbdc34ad88de9156beb74bef7 P 57da47b50bc847c997f07dccaeae280a: Time spent bootstrapping tablet: real 0.082s	user 0.014s	sys 0.000s
I20260709 13:03:33.889233 11521 raft_consensus.cc:359] T de8c0dddbdc34ad88de9156beb74bef7 P 57da47b50bc847c997f07dccaeae280a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:33.889986 11521 raft_consensus.cc:385] T de8c0dddbdc34ad88de9156beb74bef7 P 57da47b50bc847c997f07dccaeae280a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:33.890260 11521 raft_consensus.cc:740] T de8c0dddbdc34ad88de9156beb74bef7 P 57da47b50bc847c997f07dccaeae280a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57da47b50bc847c997f07dccaeae280a, State: Initialized, Role: FOLLOWER
I20260709 13:03:33.892308 11477 raft_consensus.cc:2468] T a802e0f3aab1477091f50d46836a5e34 P 57da47b50bc847c997f07dccaeae280a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7eb6f135338f4b84b60b7e67ab3d81d7 in term 1.
I20260709 13:03:33.893241 11522 raft_consensus.cc:493] T ec9a5210a9a84816bc2d263d456f9a93 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:33.893786 11522 raft_consensus.cc:515] T ec9a5210a9a84816bc2d263d456f9a93 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:33.904707 11477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8c0dddbdc34ad88de9156beb74bef7" candidate_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57da47b50bc847c997f07dccaeae280a" is_pre_election: true
I20260709 13:03:33.905000 11560 raft_consensus.cc:2749] T 120ae599baa547b1855a1ba361226d3e P e3760873d2be4dc7b991027c1deef35d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:33.905859 11560 raft_consensus.cc:493] T 205736ed2ee6439588e8db06793e4cd6 P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:33.907104 11523 raft_consensus.cc:493] T ec9a5210a9a84816bc2d263d456f9a93 P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:33.908025 11523 raft_consensus.cc:515] T ec9a5210a9a84816bc2d263d456f9a93 P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:33.906998 11521 consensus_queue.cc:260] T de8c0dddbdc34ad88de9156beb74bef7 P 57da47b50bc847c997f07dccaeae280a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:33.908852 11328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9a5210a9a84816bc2d263d456f9a93" candidate_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3760873d2be4dc7b991027c1deef35d" is_pre_election: true
I20260709 13:03:33.909636 11328 raft_consensus.cc:2468] T ec9a5210a9a84816bc2d263d456f9a93 P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7eb6f135338f4b84b60b7e67ab3d81d7 in term 0.
I20260709 13:03:33.910948 11369 leader_election.cc:304] T ec9a5210a9a84816bc2d263d456f9a93 P 7eb6f135338f4b84b60b7e67ab3d81d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7eb6f135338f4b84b60b7e67ab3d81d7, e3760873d2be4dc7b991027c1deef35d; no voters: 
I20260709 13:03:33.911329 11402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9a5210a9a84816bc2d263d456f9a93" candidate_uuid: "e3760873d2be4dc7b991027c1deef35d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" is_pre_election: true
I20260709 13:03:33.911841 11564 raft_consensus.cc:2804] T ec9a5210a9a84816bc2d263d456f9a93 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:33.912287 11564 raft_consensus.cc:493] T ec9a5210a9a84816bc2d263d456f9a93 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:33.913002 11564 raft_consensus.cc:3060] T ec9a5210a9a84816bc2d263d456f9a93 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:33.906481 11225 catalog_manager.cc:5697] T 9e659a7e9644447daa84c89a46e934de P e3760873d2be4dc7b991027c1deef35d reported cstate change: term changed from 0 to 1, leader changed from <none> to e3760873d2be4dc7b991027c1deef35d (127.0.107.193). New cstate: current_term: 1 leader_uuid: "e3760873d2be4dc7b991027c1deef35d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:33.917313 11477 raft_consensus.cc:2468] T de8c0dddbdc34ad88de9156beb74bef7 P 57da47b50bc847c997f07dccaeae280a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7eb6f135338f4b84b60b7e67ab3d81d7 in term 0.
I20260709 13:03:33.919098 11476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9a5210a9a84816bc2d263d456f9a93" candidate_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57da47b50bc847c997f07dccaeae280a" is_pre_election: true
I20260709 13:03:33.919823 11476 raft_consensus.cc:2468] T ec9a5210a9a84816bc2d263d456f9a93 P 57da47b50bc847c997f07dccaeae280a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7eb6f135338f4b84b60b7e67ab3d81d7 in term 0.
I20260709 13:03:33.920897 11369 leader_election.cc:304] T de8c0dddbdc34ad88de9156beb74bef7 P 7eb6f135338f4b84b60b7e67ab3d81d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 57da47b50bc847c997f07dccaeae280a, 7eb6f135338f4b84b60b7e67ab3d81d7; no voters: e3760873d2be4dc7b991027c1deef35d
I20260709 13:03:33.921329 11548 leader_election.cc:290] T 71db464af9104a8a86fd623394da3511 P e3760873d2be4dc7b991027c1deef35d [CANDIDATE]: Term 1 election: Requested vote from peers 7eb6f135338f4b84b60b7e67ab3d81d7 (127.0.107.194:42689), 57da47b50bc847c997f07dccaeae280a (127.0.107.195:37515)
I20260709 13:03:33.910754 11521 ts_tablet_manager.cc:1434] T de8c0dddbdc34ad88de9156beb74bef7 P 57da47b50bc847c997f07dccaeae280a: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.001s
I20260709 13:03:33.921924 11476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71db464af9104a8a86fd623394da3511" candidate_uuid: "e3760873d2be4dc7b991027c1deef35d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57da47b50bc847c997f07dccaeae280a"
I20260709 13:03:33.922560 11544 raft_consensus.cc:2804] T de8c0dddbdc34ad88de9156beb74bef7 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:33.923228 11544 raft_consensus.cc:493] T de8c0dddbdc34ad88de9156beb74bef7 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:33.923606 11544 raft_consensus.cc:3060] T de8c0dddbdc34ad88de9156beb74bef7 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:33.923763 11519 tablet_bootstrap.cc:492] T de8c0dddbdc34ad88de9156beb74bef7 P e3760873d2be4dc7b991027c1deef35d: No bootstrap required, opened a new log
I20260709 13:03:33.924412 11477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9a5210a9a84816bc2d263d456f9a93" candidate_uuid: "e3760873d2be4dc7b991027c1deef35d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57da47b50bc847c997f07dccaeae280a" is_pre_election: true
I20260709 13:03:33.923931 11521 tablet_bootstrap.cc:492] T 205736ed2ee6439588e8db06793e4cd6 P 57da47b50bc847c997f07dccaeae280a: Bootstrap starting.
I20260709 13:03:33.922479 11564 raft_consensus.cc:515] T ec9a5210a9a84816bc2d263d456f9a93 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:33.925782 11402 raft_consensus.cc:2393] T ec9a5210a9a84816bc2d263d456f9a93 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3760873d2be4dc7b991027c1deef35d in current term 1: Already voted for candidate 7eb6f135338f4b84b60b7e67ab3d81d7 in this term.
I20260709 13:03:33.922685 11476 raft_consensus.cc:3060] T 71db464af9104a8a86fd623394da3511 P 57da47b50bc847c997f07dccaeae280a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:33.906392 11560 raft_consensus.cc:515] T 205736ed2ee6439588e8db06793e4cd6 P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:33.924417 11519 ts_tablet_manager.cc:1403] T de8c0dddbdc34ad88de9156beb74bef7 P e3760873d2be4dc7b991027c1deef35d: Time spent bootstrapping tablet: real 0.127s	user 0.034s	sys 0.017s
I20260709 13:03:33.931176 11402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205736ed2ee6439588e8db06793e4cd6" candidate_uuid: "e3760873d2be4dc7b991027c1deef35d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" is_pre_election: true
I20260709 13:03:33.929638 11564 leader_election.cc:290] T ec9a5210a9a84816bc2d263d456f9a93 P 7eb6f135338f4b84b60b7e67ab3d81d7 [CANDIDATE]: Term 1 election: Requested vote from peers e3760873d2be4dc7b991027c1deef35d (127.0.107.193:35003), 57da47b50bc847c997f07dccaeae280a (127.0.107.195:37515)
I20260709 13:03:33.924791 11523 leader_election.cc:290] T ec9a5210a9a84816bc2d263d456f9a93 P e3760873d2be4dc7b991027c1deef35d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7eb6f135338f4b84b60b7e67ab3d81d7 (127.0.107.194:42689), 57da47b50bc847c997f07dccaeae280a (127.0.107.195:37515)
I20260709 13:03:33.931844 11402 raft_consensus.cc:2468] T 205736ed2ee6439588e8db06793e4cd6 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3760873d2be4dc7b991027c1deef35d in term 0.
I20260709 13:03:33.933101 11292 leader_election.cc:304] T 205736ed2ee6439588e8db06793e4cd6 P e3760873d2be4dc7b991027c1deef35d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7eb6f135338f4b84b60b7e67ab3d81d7, e3760873d2be4dc7b991027c1deef35d; no voters: 
I20260709 13:03:33.933393 11477 raft_consensus.cc:2468] T ec9a5210a9a84816bc2d263d456f9a93 P 57da47b50bc847c997f07dccaeae280a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3760873d2be4dc7b991027c1deef35d in term 0.
I20260709 13:03:33.934288 11328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9a5210a9a84816bc2d263d456f9a93" candidate_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3760873d2be4dc7b991027c1deef35d"
I20260709 13:03:33.934602 11294 leader_election.cc:304] T ec9a5210a9a84816bc2d263d456f9a93 P e3760873d2be4dc7b991027c1deef35d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 57da47b50bc847c997f07dccaeae280a, e3760873d2be4dc7b991027c1deef35d; no voters: 7eb6f135338f4b84b60b7e67ab3d81d7
I20260709 13:03:33.934957 11328 raft_consensus.cc:3060] T ec9a5210a9a84816bc2d263d456f9a93 P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:33.936820 11569 raft_consensus.cc:2804] T 205736ed2ee6439588e8db06793e4cd6 P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:33.937106 11521 tablet_bootstrap.cc:654] T 205736ed2ee6439588e8db06793e4cd6 P 57da47b50bc847c997f07dccaeae280a: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:33.937788 11477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205736ed2ee6439588e8db06793e4cd6" candidate_uuid: "e3760873d2be4dc7b991027c1deef35d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57da47b50bc847c997f07dccaeae280a" is_pre_election: true
I20260709 13:03:33.934582 11560 leader_election.cc:290] T 205736ed2ee6439588e8db06793e4cd6 P e3760873d2be4dc7b991027c1deef35d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7eb6f135338f4b84b60b7e67ab3d81d7 (127.0.107.194:42689), 57da47b50bc847c997f07dccaeae280a (127.0.107.195:37515)
W20260709 13:03:33.939111 11294 leader_election.cc:343] T 205736ed2ee6439588e8db06793e4cd6 P e3760873d2be4dc7b991027c1deef35d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 57da47b50bc847c997f07dccaeae280a (127.0.107.195:37515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:33.937201 11569 raft_consensus.cc:493] T 205736ed2ee6439588e8db06793e4cd6 P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:33.940217 11569 raft_consensus.cc:3060] T 205736ed2ee6439588e8db06793e4cd6 P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:33.941512 11544 raft_consensus.cc:515] T de8c0dddbdc34ad88de9156beb74bef7 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:33.933091 11519 raft_consensus.cc:359] T de8c0dddbdc34ad88de9156beb74bef7 P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:33.944321 11519 raft_consensus.cc:385] T de8c0dddbdc34ad88de9156beb74bef7 P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:33.944664 11519 raft_consensus.cc:740] T de8c0dddbdc34ad88de9156beb74bef7 P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3760873d2be4dc7b991027c1deef35d, State: Initialized, Role: FOLLOWER
I20260709 13:03:33.943725 11328 raft_consensus.cc:2468] T ec9a5210a9a84816bc2d263d456f9a93 P e3760873d2be4dc7b991027c1deef35d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7eb6f135338f4b84b60b7e67ab3d81d7 in term 1.
I20260709 13:03:33.946307 11560 raft_consensus.cc:2764] T ec9a5210a9a84816bc2d263d456f9a93 P e3760873d2be4dc7b991027c1deef35d [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:03:33.945470 11519 consensus_queue.cc:260] T de8c0dddbdc34ad88de9156beb74bef7 P e3760873d2be4dc7b991027c1deef35d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:33.948710 11519 ts_tablet_manager.cc:1434] T de8c0dddbdc34ad88de9156beb74bef7 P e3760873d2be4dc7b991027c1deef35d: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.000s
I20260709 13:03:33.918315 11403 raft_consensus.cc:2468] T 71db464af9104a8a86fd623394da3511 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3760873d2be4dc7b991027c1deef35d in term 1.
I20260709 13:03:33.950552 11292 leader_election.cc:304] T 71db464af9104a8a86fd623394da3511 P e3760873d2be4dc7b991027c1deef35d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7eb6f135338f4b84b60b7e67ab3d81d7, e3760873d2be4dc7b991027c1deef35d; no voters: 
I20260709 13:03:33.948698 11569 raft_consensus.cc:515] T 205736ed2ee6439588e8db06793e4cd6 P e3760873d2be4dc7b991027c1deef35d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:33.951733 11523 raft_consensus.cc:2804] T 71db464af9104a8a86fd623394da3511 P e3760873d2be4dc7b991027c1deef35d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:33.952327 11523 raft_consensus.cc:697] T 71db464af9104a8a86fd623394da3511 P e3760873d2be4dc7b991027c1deef35d [term 1 LEADER]: Becoming Leader. State: Replica: e3760873d2be4dc7b991027c1deef35d, State: Running, Role: LEADER
I20260709 13:03:33.953362 11403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205736ed2ee6439588e8db06793e4cd6" candidate_uuid: "e3760873d2be4dc7b991027c1deef35d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7"
I20260709 13:03:33.953255 11523 consensus_queue.cc:237] T 71db464af9104a8a86fd623394da3511 P e3760873d2be4dc7b991027c1deef35d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:33.947515 11369 leader_election.cc:304] T ec9a5210a9a84816bc2d263d456f9a93 P 7eb6f135338f4b84b60b7e67ab3d81d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7eb6f135338f4b84b60b7e67ab3d81d7, e3760873d2be4dc7b991027c1deef35d; no voters: 
I20260709 13:03:33.954592 11564 raft_consensus.cc:2804] T ec9a5210a9a84816bc2d263d456f9a93 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:33.954072 11403 raft_consensus.cc:3060] T 205736ed2ee6439588e8db06793e4cd6 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:33.956761 11564 raft_consensus.cc:697] T ec9a5210a9a84816bc2d263d456f9a93 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 LEADER]: Becoming Leader. State: Replica: 7eb6f135338f4b84b60b7e67ab3d81d7, State: Running, Role: LEADER
I20260709 13:03:33.957705 11564 consensus_queue.cc:237] T ec9a5210a9a84816bc2d263d456f9a93 P 7eb6f135338f4b84b60b7e67ab3d81d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:33.958508 11477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9a5210a9a84816bc2d263d456f9a93" candidate_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57da47b50bc847c997f07dccaeae280a"
I20260709 13:03:33.959048 11402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71db464af9104a8a86fd623394da3511" candidate_uuid: "57da47b50bc847c997f07dccaeae280a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" is_pre_election: true
I20260709 13:03:33.959586 11477 raft_consensus.cc:3060] T ec9a5210a9a84816bc2d263d456f9a93 P 57da47b50bc847c997f07dccaeae280a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:33.959781 11522 leader_election.cc:290] T ec9a5210a9a84816bc2d263d456f9a93 P 7eb6f135338f4b84b60b7e67ab3d81d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3760873d2be4dc7b991027c1deef35d (127.0.107.193:35003), 57da47b50bc847c997f07dccaeae280a (127.0.107.195:37515)
I20260709 13:03:33.959981 11402 raft_consensus.cc:2393] T 71db464af9104a8a86fd623394da3511 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 57da47b50bc847c997f07dccaeae280a in current term 1: Already voted for candidate e3760873d2be4dc7b991027c1deef35d in this term.
I20260709 13:03:33.959120 11328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8c0dddbdc34ad88de9156beb74bef7" candidate_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3760873d2be4dc7b991027c1deef35d"
I20260709 13:03:33.961411 11328 raft_consensus.cc:3060] T de8c0dddbdc34ad88de9156beb74bef7 P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:33.953519 11476 raft_consensus.cc:2468] T 71db464af9104a8a86fd623394da3511 P 57da47b50bc847c997f07dccaeae280a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3760873d2be4dc7b991027c1deef35d in term 1.
I20260709 13:03:33.961716 11475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8c0dddbdc34ad88de9156beb74bef7" candidate_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57da47b50bc847c997f07dccaeae280a"
I20260709 13:03:33.962543 11475 raft_consensus.cc:3060] T de8c0dddbdc34ad88de9156beb74bef7 P 57da47b50bc847c997f07dccaeae280a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:33.961807 11402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9a5210a9a84816bc2d263d456f9a93" candidate_uuid: "57da47b50bc847c997f07dccaeae280a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" is_pre_election: true
I20260709 13:03:33.974521 11403 raft_consensus.cc:2468] T 205736ed2ee6439588e8db06793e4cd6 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3760873d2be4dc7b991027c1deef35d in term 1.
I20260709 13:03:33.966109 11544 leader_election.cc:290] T de8c0dddbdc34ad88de9156beb74bef7 P 7eb6f135338f4b84b60b7e67ab3d81d7 [CANDIDATE]: Term 1 election: Requested vote from peers e3760873d2be4dc7b991027c1deef35d (127.0.107.193:35003), 57da47b50bc847c997f07dccaeae280a (127.0.107.195:37515)
I20260709 13:03:33.977990 11226 catalog_manager.cc:5697] T ec9a5210a9a84816bc2d263d456f9a93 P 7eb6f135338f4b84b60b7e67ab3d81d7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7eb6f135338f4b84b60b7e67ab3d81d7 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:33.978855 11292 leader_election.cc:304] T 205736ed2ee6439588e8db06793e4cd6 P e3760873d2be4dc7b991027c1deef35d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7eb6f135338f4b84b60b7e67ab3d81d7, e3760873d2be4dc7b991027c1deef35d; no voters: 
I20260709 13:03:33.980341 11568 raft_consensus.cc:2804] T 205736ed2ee6439588e8db06793e4cd6 P e3760873d2be4dc7b991027c1deef35d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:33.980835 11568 raft_consensus.cc:697] T 205736ed2ee6439588e8db06793e4cd6 P e3760873d2be4dc7b991027c1deef35d [term 1 LEADER]: Becoming Leader. State: Replica: e3760873d2be4dc7b991027c1deef35d, State: Running, Role: LEADER
I20260709 13:03:33.981652 11568 consensus_queue.cc:237] T 205736ed2ee6439588e8db06793e4cd6 P e3760873d2be4dc7b991027c1deef35d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:33.992187 11569 leader_election.cc:290] T 205736ed2ee6439588e8db06793e4cd6 P e3760873d2be4dc7b991027c1deef35d [CANDIDATE]: Term 1 election: Requested vote from peers 7eb6f135338f4b84b60b7e67ab3d81d7 (127.0.107.194:42689), 57da47b50bc847c997f07dccaeae280a (127.0.107.195:37515)
I20260709 13:03:33.992518 11476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205736ed2ee6439588e8db06793e4cd6" candidate_uuid: "e3760873d2be4dc7b991027c1deef35d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57da47b50bc847c997f07dccaeae280a"
I20260709 13:03:33.992794 11475 raft_consensus.cc:2468] T de8c0dddbdc34ad88de9156beb74bef7 P 57da47b50bc847c997f07dccaeae280a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7eb6f135338f4b84b60b7e67ab3d81d7 in term 1.
I20260709 13:03:33.994069 11369 leader_election.cc:304] T de8c0dddbdc34ad88de9156beb74bef7 P 7eb6f135338f4b84b60b7e67ab3d81d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57da47b50bc847c997f07dccaeae280a, 7eb6f135338f4b84b60b7e67ab3d81d7; no voters: 
W20260709 13:03:33.994182 11294 leader_election.cc:343] T 205736ed2ee6439588e8db06793e4cd6 P e3760873d2be4dc7b991027c1deef35d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 57da47b50bc847c997f07dccaeae280a (127.0.107.195:37515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:33.995241 11544 raft_consensus.cc:2804] T de8c0dddbdc34ad88de9156beb74bef7 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:33.995730 11327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71db464af9104a8a86fd623394da3511" candidate_uuid: "57da47b50bc847c997f07dccaeae280a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3760873d2be4dc7b991027c1deef35d" is_pre_election: true
I20260709 13:03:33.996706 11328 raft_consensus.cc:2468] T de8c0dddbdc34ad88de9156beb74bef7 P e3760873d2be4dc7b991027c1deef35d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7eb6f135338f4b84b60b7e67ab3d81d7 in term 1.
I20260709 13:03:33.995759 11544 raft_consensus.cc:697] T de8c0dddbdc34ad88de9156beb74bef7 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 LEADER]: Becoming Leader. State: Replica: 7eb6f135338f4b84b60b7e67ab3d81d7, State: Running, Role: LEADER
I20260709 13:03:33.997455 11326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9a5210a9a84816bc2d263d456f9a93" candidate_uuid: "57da47b50bc847c997f07dccaeae280a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3760873d2be4dc7b991027c1deef35d" is_pre_election: true
I20260709 13:03:33.995260 11477 raft_consensus.cc:2468] T ec9a5210a9a84816bc2d263d456f9a93 P 57da47b50bc847c997f07dccaeae280a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7eb6f135338f4b84b60b7e67ab3d81d7 in term 1.
I20260709 13:03:34.000957 11443 leader_election.cc:304] T 71db464af9104a8a86fd623394da3511 P 57da47b50bc847c997f07dccaeae280a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 57da47b50bc847c997f07dccaeae280a; no voters: 7eb6f135338f4b84b60b7e67ab3d81d7, e3760873d2be4dc7b991027c1deef35d
I20260709 13:03:34.001504 11326 raft_consensus.cc:2393] T ec9a5210a9a84816bc2d263d456f9a93 P e3760873d2be4dc7b991027c1deef35d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 57da47b50bc847c997f07dccaeae280a in current term 1: Already voted for candidate 7eb6f135338f4b84b60b7e67ab3d81d7 in this term.
I20260709 13:03:34.002012 11561 raft_consensus.cc:2749] T 71db464af9104a8a86fd623394da3511 P 57da47b50bc847c997f07dccaeae280a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:34.001906 11544 consensus_queue.cc:237] T de8c0dddbdc34ad88de9156beb74bef7 P 7eb6f135338f4b84b60b7e67ab3d81d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:34.002616 11443 leader_election.cc:304] T ec9a5210a9a84816bc2d263d456f9a93 P 57da47b50bc847c997f07dccaeae280a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 57da47b50bc847c997f07dccaeae280a; no voters: 7eb6f135338f4b84b60b7e67ab3d81d7, e3760873d2be4dc7b991027c1deef35d
I20260709 13:03:34.003480 11561 raft_consensus.cc:2749] T ec9a5210a9a84816bc2d263d456f9a93 P 57da47b50bc847c997f07dccaeae280a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:34.004469 11521 tablet_bootstrap.cc:492] T 205736ed2ee6439588e8db06793e4cd6 P 57da47b50bc847c997f07dccaeae280a: No bootstrap required, opened a new log
I20260709 13:03:34.005064 11521 ts_tablet_manager.cc:1403] T 205736ed2ee6439588e8db06793e4cd6 P 57da47b50bc847c997f07dccaeae280a: Time spent bootstrapping tablet: real 0.081s	user 0.017s	sys 0.032s
I20260709 13:03:34.007964 11521 raft_consensus.cc:359] T 205736ed2ee6439588e8db06793e4cd6 P 57da47b50bc847c997f07dccaeae280a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:34.008627 11521 raft_consensus.cc:385] T 205736ed2ee6439588e8db06793e4cd6 P 57da47b50bc847c997f07dccaeae280a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:34.008890 11521 raft_consensus.cc:740] T 205736ed2ee6439588e8db06793e4cd6 P 57da47b50bc847c997f07dccaeae280a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57da47b50bc847c997f07dccaeae280a, State: Initialized, Role: FOLLOWER
I20260709 13:03:34.009660 11521 consensus_queue.cc:260] T 205736ed2ee6439588e8db06793e4cd6 P 57da47b50bc847c997f07dccaeae280a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:34.011791 11521 ts_tablet_manager.cc:1434] T 205736ed2ee6439588e8db06793e4cd6 P 57da47b50bc847c997f07dccaeae280a: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:03:34.015744 11226 catalog_manager.cc:5697] T 71db464af9104a8a86fd623394da3511 P e3760873d2be4dc7b991027c1deef35d reported cstate change: term changed from 0 to 1, leader changed from <none> to e3760873d2be4dc7b991027c1deef35d (127.0.107.193). New cstate: current_term: 1 leader_uuid: "e3760873d2be4dc7b991027c1deef35d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:34.017622 11226 catalog_manager.cc:5697] T 205736ed2ee6439588e8db06793e4cd6 P e3760873d2be4dc7b991027c1deef35d reported cstate change: term changed from 0 to 1, leader changed from <none> to e3760873d2be4dc7b991027c1deef35d (127.0.107.193). New cstate: current_term: 1 leader_uuid: "e3760873d2be4dc7b991027c1deef35d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:34.026916 11223 catalog_manager.cc:5697] T de8c0dddbdc34ad88de9156beb74bef7 P 7eb6f135338f4b84b60b7e67ab3d81d7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7eb6f135338f4b84b60b7e67ab3d81d7 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:34.084532 11544 raft_consensus.cc:493] T b35e87dce47b43119d13bd514d434a76 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:34.085150 11544 raft_consensus.cc:515] T b35e87dce47b43119d13bd514d434a76 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:34.086938 11544 leader_election.cc:290] T b35e87dce47b43119d13bd514d434a76 P 7eb6f135338f4b84b60b7e67ab3d81d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3760873d2be4dc7b991027c1deef35d (127.0.107.193:35003), 57da47b50bc847c997f07dccaeae280a (127.0.107.195:37515)
I20260709 13:03:34.087723 11326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35e87dce47b43119d13bd514d434a76" candidate_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3760873d2be4dc7b991027c1deef35d" is_pre_election: true
I20260709 13:03:34.087898 11477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35e87dce47b43119d13bd514d434a76" candidate_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57da47b50bc847c997f07dccaeae280a" is_pre_election: true
I20260709 13:03:34.088336 11326 raft_consensus.cc:2468] T b35e87dce47b43119d13bd514d434a76 P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7eb6f135338f4b84b60b7e67ab3d81d7 in term 0.
I20260709 13:03:34.088518 11477 raft_consensus.cc:2468] T b35e87dce47b43119d13bd514d434a76 P 57da47b50bc847c997f07dccaeae280a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7eb6f135338f4b84b60b7e67ab3d81d7 in term 0.
I20260709 13:03:34.089282 11369 leader_election.cc:304] T b35e87dce47b43119d13bd514d434a76 P 7eb6f135338f4b84b60b7e67ab3d81d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7eb6f135338f4b84b60b7e67ab3d81d7, e3760873d2be4dc7b991027c1deef35d; no voters: 
I20260709 13:03:34.089922 11544 raft_consensus.cc:2804] T b35e87dce47b43119d13bd514d434a76 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:34.090225 11544 raft_consensus.cc:493] T b35e87dce47b43119d13bd514d434a76 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:34.090492 11544 raft_consensus.cc:3060] T b35e87dce47b43119d13bd514d434a76 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:34.095307 11544 raft_consensus.cc:515] T b35e87dce47b43119d13bd514d434a76 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:34.096836 11544 leader_election.cc:290] T b35e87dce47b43119d13bd514d434a76 P 7eb6f135338f4b84b60b7e67ab3d81d7 [CANDIDATE]: Term 1 election: Requested vote from peers e3760873d2be4dc7b991027c1deef35d (127.0.107.193:35003), 57da47b50bc847c997f07dccaeae280a (127.0.107.195:37515)
I20260709 13:03:34.097689 11326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35e87dce47b43119d13bd514d434a76" candidate_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3760873d2be4dc7b991027c1deef35d"
I20260709 13:03:34.097851 11477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35e87dce47b43119d13bd514d434a76" candidate_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57da47b50bc847c997f07dccaeae280a"
I20260709 13:03:34.098229 11326 raft_consensus.cc:3060] T b35e87dce47b43119d13bd514d434a76 P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:34.098398 11477 raft_consensus.cc:3060] T b35e87dce47b43119d13bd514d434a76 P 57da47b50bc847c997f07dccaeae280a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:34.103456 11477 raft_consensus.cc:2468] T b35e87dce47b43119d13bd514d434a76 P 57da47b50bc847c997f07dccaeae280a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7eb6f135338f4b84b60b7e67ab3d81d7 in term 1.
I20260709 13:03:34.103518 11326 raft_consensus.cc:2468] T b35e87dce47b43119d13bd514d434a76 P e3760873d2be4dc7b991027c1deef35d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7eb6f135338f4b84b60b7e67ab3d81d7 in term 1.
I20260709 13:03:34.104470 11369 leader_election.cc:304] T b35e87dce47b43119d13bd514d434a76 P 7eb6f135338f4b84b60b7e67ab3d81d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57da47b50bc847c997f07dccaeae280a, 7eb6f135338f4b84b60b7e67ab3d81d7; no voters: 
I20260709 13:03:34.105146 11544 raft_consensus.cc:2804] T b35e87dce47b43119d13bd514d434a76 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:34.105549 11544 raft_consensus.cc:697] T b35e87dce47b43119d13bd514d434a76 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 LEADER]: Becoming Leader. State: Replica: 7eb6f135338f4b84b60b7e67ab3d81d7, State: Running, Role: LEADER
I20260709 13:03:34.106298 11544 consensus_queue.cc:237] T b35e87dce47b43119d13bd514d434a76 P 7eb6f135338f4b84b60b7e67ab3d81d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:34.113372 11223 catalog_manager.cc:5697] T b35e87dce47b43119d13bd514d434a76 P 7eb6f135338f4b84b60b7e67ab3d81d7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7eb6f135338f4b84b60b7e67ab3d81d7 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:34.211508 11477 raft_consensus.cc:3060] T dd5040fb5b614dd2990e57812dadd3b7 P 57da47b50bc847c997f07dccaeae280a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:34.217252 11561 raft_consensus.cc:493] T dd5040fb5b614dd2990e57812dadd3b7 P 57da47b50bc847c997f07dccaeae280a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:34.217602 11568 consensus_queue.cc:1048] T dd5040fb5b614dd2990e57812dadd3b7 P e3760873d2be4dc7b991027c1deef35d [LEADER]: Connected to new peer: Peer: permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:34.217736 11561 raft_consensus.cc:515] T dd5040fb5b614dd2990e57812dadd3b7 P 57da47b50bc847c997f07dccaeae280a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:34.220031 11561 leader_election.cc:290] T dd5040fb5b614dd2990e57812dadd3b7 P 57da47b50bc847c997f07dccaeae280a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3760873d2be4dc7b991027c1deef35d (127.0.107.193:35003), 7eb6f135338f4b84b60b7e67ab3d81d7 (127.0.107.194:42689)
I20260709 13:03:34.220548 11326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5040fb5b614dd2990e57812dadd3b7" candidate_uuid: "57da47b50bc847c997f07dccaeae280a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3760873d2be4dc7b991027c1deef35d" is_pre_election: true
I20260709 13:03:34.221760 11403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5040fb5b614dd2990e57812dadd3b7" candidate_uuid: "57da47b50bc847c997f07dccaeae280a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" is_pre_election: true
I20260709 13:03:34.222513 11403 raft_consensus.cc:2468] T dd5040fb5b614dd2990e57812dadd3b7 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57da47b50bc847c997f07dccaeae280a in term 1.
I20260709 13:03:34.223784 11441 leader_election.cc:304] T dd5040fb5b614dd2990e57812dadd3b7 P 57da47b50bc847c997f07dccaeae280a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 57da47b50bc847c997f07dccaeae280a, 7eb6f135338f4b84b60b7e67ab3d81d7; no voters: e3760873d2be4dc7b991027c1deef35d
I20260709 13:03:34.224607 11561 raft_consensus.cc:2804] T dd5040fb5b614dd2990e57812dadd3b7 P 57da47b50bc847c997f07dccaeae280a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:34.224967 11561 raft_consensus.cc:493] T dd5040fb5b614dd2990e57812dadd3b7 P 57da47b50bc847c997f07dccaeae280a [term 1 FOLLOWER]: Starting leader election (detected failure of leader e3760873d2be4dc7b991027c1deef35d)
I20260709 13:03:34.225313 11561 raft_consensus.cc:3060] T dd5040fb5b614dd2990e57812dadd3b7 P 57da47b50bc847c997f07dccaeae280a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:34.231921 11523 consensus_queue.cc:1048] T dd5040fb5b614dd2990e57812dadd3b7 P e3760873d2be4dc7b991027c1deef35d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:34.233177 11561 raft_consensus.cc:515] T dd5040fb5b614dd2990e57812dadd3b7 P 57da47b50bc847c997f07dccaeae280a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:34.235313 11561 leader_election.cc:290] T dd5040fb5b614dd2990e57812dadd3b7 P 57da47b50bc847c997f07dccaeae280a [CANDIDATE]: Term 2 election: Requested vote from peers e3760873d2be4dc7b991027c1deef35d (127.0.107.193:35003), 7eb6f135338f4b84b60b7e67ab3d81d7 (127.0.107.194:42689)
I20260709 13:03:34.234210 11477 raft_consensus.cc:1240] T dd5040fb5b614dd2990e57812dadd3b7 P 57da47b50bc847c997f07dccaeae280a [term 2 FOLLOWER]: Rejecting Update request from peer e3760873d2be4dc7b991027c1deef35d for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:34.236479 11326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5040fb5b614dd2990e57812dadd3b7" candidate_uuid: "57da47b50bc847c997f07dccaeae280a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3760873d2be4dc7b991027c1deef35d"
I20260709 13:03:34.237874 11402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5040fb5b614dd2990e57812dadd3b7" candidate_uuid: "57da47b50bc847c997f07dccaeae280a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7"
I20260709 13:03:34.238962 11523 consensus_queue.cc:1059] T dd5040fb5b614dd2990e57812dadd3b7 P e3760873d2be4dc7b991027c1deef35d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:34.239789 11523 raft_consensus.cc:3055] T dd5040fb5b614dd2990e57812dadd3b7 P e3760873d2be4dc7b991027c1deef35d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:34.240100 11523 raft_consensus.cc:740] T dd5040fb5b614dd2990e57812dadd3b7 P e3760873d2be4dc7b991027c1deef35d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e3760873d2be4dc7b991027c1deef35d, State: Running, Role: LEADER
I20260709 13:03:34.240749 11544 consensus_queue.cc:1048] T 120ae599baa547b1855a1ba361226d3e P 7eb6f135338f4b84b60b7e67ab3d81d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:34.240908 11523 consensus_queue.cc:260] T dd5040fb5b614dd2990e57812dadd3b7 P e3760873d2be4dc7b991027c1deef35d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:34.241509 11441 leader_election.cc:304] T dd5040fb5b614dd2990e57812dadd3b7 P 57da47b50bc847c997f07dccaeae280a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 57da47b50bc847c997f07dccaeae280a; no voters: 7eb6f135338f4b84b60b7e67ab3d81d7, e3760873d2be4dc7b991027c1deef35d
I20260709 13:03:34.242081 11523 raft_consensus.cc:3060] T dd5040fb5b614dd2990e57812dadd3b7 P e3760873d2be4dc7b991027c1deef35d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:34.241900 11568 consensus_queue.cc:1048] T 9e659a7e9644447daa84c89a46e934de P e3760873d2be4dc7b991027c1deef35d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:34.242691 11561 raft_consensus.cc:2749] T dd5040fb5b614dd2990e57812dadd3b7 P 57da47b50bc847c997f07dccaeae280a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:34.256312 11568 consensus_queue.cc:1048] T 9e659a7e9644447daa84c89a46e934de P e3760873d2be4dc7b991027c1deef35d [LEADER]: Connected to new peer: Peer: permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:34.263736 11571 consensus_queue.cc:1048] T 120ae599baa547b1855a1ba361226d3e P 7eb6f135338f4b84b60b7e67ab3d81d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:34.294196 11544 consensus_queue.cc:1048] T a802e0f3aab1477091f50d46836a5e34 P 7eb6f135338f4b84b60b7e67ab3d81d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:34.300541 11403 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a802e0f3aab1477091f50d46836a5e34"
dest_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7"
mode: GRACEFUL
new_leader_uuid: "e3760873d2be4dc7b991027c1deef35d"
 from {username='slave'} at 127.0.0.1:35462
I20260709 13:03:34.301168 11403 raft_consensus.cc:606] T a802e0f3aab1477091f50d46836a5e34 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 LEADER]: Received request to transfer leadership to TS e3760873d2be4dc7b991027c1deef35d
I20260709 13:03:34.307344 11522 raft_consensus.cc:993] T a802e0f3aab1477091f50d46836a5e34 P 7eb6f135338f4b84b60b7e67ab3d81d7: : Instructing follower e3760873d2be4dc7b991027c1deef35d to start an election
I20260709 13:03:34.307835 11522 raft_consensus.cc:1081] T a802e0f3aab1477091f50d46836a5e34 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 LEADER]: Signalling peer e3760873d2be4dc7b991027c1deef35d to start an election
I20260709 13:03:34.307439 11564 consensus_queue.cc:1048] T a802e0f3aab1477091f50d46836a5e34 P 7eb6f135338f4b84b60b7e67ab3d81d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:03:34.310968 11326 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a802e0f3aab1477091f50d46836a5e34"
dest_uuid: "e3760873d2be4dc7b991027c1deef35d"
 from {username='slave'} at 127.0.0.1:49586
I20260709 13:03:34.311537 11326 raft_consensus.cc:493] T a802e0f3aab1477091f50d46836a5e34 P e3760873d2be4dc7b991027c1deef35d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:34.311900 11326 raft_consensus.cc:3060] T a802e0f3aab1477091f50d46836a5e34 P e3760873d2be4dc7b991027c1deef35d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:34.314451 11403 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "120ae599baa547b1855a1ba361226d3e"
dest_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7"
mode: GRACEFUL
new_leader_uuid: "e3760873d2be4dc7b991027c1deef35d"
 from {username='slave'} at 127.0.0.1:35462
I20260709 13:03:34.315131 11403 raft_consensus.cc:606] T 120ae599baa547b1855a1ba361226d3e P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 LEADER]: Received request to transfer leadership to TS e3760873d2be4dc7b991027c1deef35d
I20260709 13:03:34.321997 11326 raft_consensus.cc:515] T a802e0f3aab1477091f50d46836a5e34 P e3760873d2be4dc7b991027c1deef35d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:34.324908 11403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a802e0f3aab1477091f50d46836a5e34" candidate_uuid: "e3760873d2be4dc7b991027c1deef35d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7"
I20260709 13:03:34.325080 11326 leader_election.cc:290] T a802e0f3aab1477091f50d46836a5e34 P e3760873d2be4dc7b991027c1deef35d [CANDIDATE]: Term 2 election: Requested vote from peers 7eb6f135338f4b84b60b7e67ab3d81d7 (127.0.107.194:42689), 57da47b50bc847c997f07dccaeae280a (127.0.107.195:37515)
I20260709 13:03:34.325274 11477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a802e0f3aab1477091f50d46836a5e34" candidate_uuid: "e3760873d2be4dc7b991027c1deef35d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "57da47b50bc847c997f07dccaeae280a"
I20260709 13:03:34.325539 11403 raft_consensus.cc:3055] T a802e0f3aab1477091f50d46836a5e34 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:34.325875 11403 raft_consensus.cc:740] T a802e0f3aab1477091f50d46836a5e34 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7eb6f135338f4b84b60b7e67ab3d81d7, State: Running, Role: LEADER
I20260709 13:03:34.325901 11477 raft_consensus.cc:3060] T a802e0f3aab1477091f50d46836a5e34 P 57da47b50bc847c997f07dccaeae280a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:34.326838 11403 consensus_queue.cc:260] T a802e0f3aab1477091f50d46836a5e34 P 7eb6f135338f4b84b60b7e67ab3d81d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:34.328305 11403 raft_consensus.cc:3060] T a802e0f3aab1477091f50d46836a5e34 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:34.332736 11326 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "205736ed2ee6439588e8db06793e4cd6"
dest_uuid: "e3760873d2be4dc7b991027c1deef35d"
mode: GRACEFUL
new_leader_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7"
 from {username='slave'} at 127.0.0.1:49600
I20260709 13:03:34.333308 11326 raft_consensus.cc:606] T 205736ed2ee6439588e8db06793e4cd6 P e3760873d2be4dc7b991027c1deef35d [term 1 LEADER]: Received request to transfer leadership to TS 7eb6f135338f4b84b60b7e67ab3d81d7
I20260709 13:03:34.334470 11477 raft_consensus.cc:2468] T a802e0f3aab1477091f50d46836a5e34 P 57da47b50bc847c997f07dccaeae280a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3760873d2be4dc7b991027c1deef35d in term 2.
I20260709 13:03:34.335654 11294 leader_election.cc:304] T a802e0f3aab1477091f50d46836a5e34 P e3760873d2be4dc7b991027c1deef35d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57da47b50bc847c997f07dccaeae280a, e3760873d2be4dc7b991027c1deef35d; no voters: 
I20260709 13:03:34.335938 11403 raft_consensus.cc:2468] T a802e0f3aab1477091f50d46836a5e34 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3760873d2be4dc7b991027c1deef35d in term 2.
I20260709 13:03:34.336508 11523 raft_consensus.cc:2804] T a802e0f3aab1477091f50d46836a5e34 P e3760873d2be4dc7b991027c1deef35d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:34.336998 11523 raft_consensus.cc:697] T a802e0f3aab1477091f50d46836a5e34 P e3760873d2be4dc7b991027c1deef35d [term 2 LEADER]: Becoming Leader. State: Replica: e3760873d2be4dc7b991027c1deef35d, State: Running, Role: LEADER
I20260709 13:03:34.337689 11523 consensus_queue.cc:237] T a802e0f3aab1477091f50d46836a5e34 P e3760873d2be4dc7b991027c1deef35d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:34.343384 11571 consensus_queue.cc:1048] T ec9a5210a9a84816bc2d263d456f9a93 P 7eb6f135338f4b84b60b7e67ab3d81d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:34.344180 11326 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "71db464af9104a8a86fd623394da3511"
dest_uuid: "e3760873d2be4dc7b991027c1deef35d"
mode: GRACEFUL
new_leader_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7"
 from {username='slave'} at 127.0.0.1:49600
I20260709 13:03:34.344991 11326 raft_consensus.cc:606] T 71db464af9104a8a86fd623394da3511 P e3760873d2be4dc7b991027c1deef35d [term 1 LEADER]: Received request to transfer leadership to TS 7eb6f135338f4b84b60b7e67ab3d81d7
I20260709 13:03:34.344300 11225 catalog_manager.cc:5697] T a802e0f3aab1477091f50d46836a5e34 P e3760873d2be4dc7b991027c1deef35d reported cstate change: term changed from 1 to 2, leader changed from 7eb6f135338f4b84b60b7e67ab3d81d7 (127.0.107.194) to e3760873d2be4dc7b991027c1deef35d (127.0.107.193). New cstate: current_term: 2 leader_uuid: "e3760873d2be4dc7b991027c1deef35d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:34.357568 11403 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de8c0dddbdc34ad88de9156beb74bef7"
dest_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7"
mode: GRACEFUL
new_leader_uuid: "57da47b50bc847c997f07dccaeae280a"
 from {username='slave'} at 127.0.0.1:35462
I20260709 13:03:34.359642 11544 consensus_queue.cc:1048] T ec9a5210a9a84816bc2d263d456f9a93 P 7eb6f135338f4b84b60b7e67ab3d81d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:34.358254 11403 raft_consensus.cc:606] T de8c0dddbdc34ad88de9156beb74bef7 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 LEADER]: Received request to transfer leadership to TS 57da47b50bc847c997f07dccaeae280a
I20260709 13:03:34.393757 11544 consensus_queue.cc:1048] T de8c0dddbdc34ad88de9156beb74bef7 P 7eb6f135338f4b84b60b7e67ab3d81d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:34.399916 11522 raft_consensus.cc:993] T de8c0dddbdc34ad88de9156beb74bef7 P 7eb6f135338f4b84b60b7e67ab3d81d7: : Instructing follower 57da47b50bc847c997f07dccaeae280a to start an election
I20260709 13:03:34.400363 11571 raft_consensus.cc:1081] T de8c0dddbdc34ad88de9156beb74bef7 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 LEADER]: Signalling peer 57da47b50bc847c997f07dccaeae280a to start an election
I20260709 13:03:34.402319 11475 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "de8c0dddbdc34ad88de9156beb74bef7"
dest_uuid: "57da47b50bc847c997f07dccaeae280a"
 from {username='slave'} at 127.0.0.1:41480
I20260709 13:03:34.402900 11475 raft_consensus.cc:493] T de8c0dddbdc34ad88de9156beb74bef7 P 57da47b50bc847c997f07dccaeae280a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:34.403276 11475 raft_consensus.cc:3060] T de8c0dddbdc34ad88de9156beb74bef7 P 57da47b50bc847c997f07dccaeae280a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:34.404728 11544 consensus_queue.cc:1048] T de8c0dddbdc34ad88de9156beb74bef7 P 7eb6f135338f4b84b60b7e67ab3d81d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:34.409642 11475 raft_consensus.cc:515] T de8c0dddbdc34ad88de9156beb74bef7 P 57da47b50bc847c997f07dccaeae280a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:34.410821 11477 raft_consensus.cc:1240] T de8c0dddbdc34ad88de9156beb74bef7 P 57da47b50bc847c997f07dccaeae280a [term 2 FOLLOWER]: Rejecting Update request from peer 7eb6f135338f4b84b60b7e67ab3d81d7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:34.412662 11328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8c0dddbdc34ad88de9156beb74bef7" candidate_uuid: "57da47b50bc847c997f07dccaeae280a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e3760873d2be4dc7b991027c1deef35d"
I20260709 13:03:34.413297 11328 raft_consensus.cc:3060] T de8c0dddbdc34ad88de9156beb74bef7 P e3760873d2be4dc7b991027c1deef35d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:34.413363 11403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8c0dddbdc34ad88de9156beb74bef7" candidate_uuid: "57da47b50bc847c997f07dccaeae280a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7"
I20260709 13:03:34.413992 11544 consensus_queue.cc:1059] T de8c0dddbdc34ad88de9156beb74bef7 P 7eb6f135338f4b84b60b7e67ab3d81d7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:34.415024 11475 leader_election.cc:290] T de8c0dddbdc34ad88de9156beb74bef7 P 57da47b50bc847c997f07dccaeae280a [CANDIDATE]: Term 2 election: Requested vote from peers e3760873d2be4dc7b991027c1deef35d (127.0.107.193:35003), 7eb6f135338f4b84b60b7e67ab3d81d7 (127.0.107.194:42689)
I20260709 13:03:34.417577 11403 raft_consensus.cc:3055] T de8c0dddbdc34ad88de9156beb74bef7 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:34.417989 11403 raft_consensus.cc:740] T de8c0dddbdc34ad88de9156beb74bef7 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7eb6f135338f4b84b60b7e67ab3d81d7, State: Running, Role: LEADER
I20260709 13:03:34.418848 11403 consensus_queue.cc:260] T de8c0dddbdc34ad88de9156beb74bef7 P 7eb6f135338f4b84b60b7e67ab3d81d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:34.420141 11403 raft_consensus.cc:3060] T de8c0dddbdc34ad88de9156beb74bef7 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:34.420564 11328 raft_consensus.cc:2468] T de8c0dddbdc34ad88de9156beb74bef7 P e3760873d2be4dc7b991027c1deef35d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57da47b50bc847c997f07dccaeae280a in term 2.
I20260709 13:03:34.420817 11523 consensus_queue.cc:1048] T 71db464af9104a8a86fd623394da3511 P e3760873d2be4dc7b991027c1deef35d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:34.425518 11443 leader_election.cc:304] T de8c0dddbdc34ad88de9156beb74bef7 P 57da47b50bc847c997f07dccaeae280a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57da47b50bc847c997f07dccaeae280a, e3760873d2be4dc7b991027c1deef35d; no voters: 
I20260709 13:03:34.426440 11561 raft_consensus.cc:2804] T de8c0dddbdc34ad88de9156beb74bef7 P 57da47b50bc847c997f07dccaeae280a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:34.426855 11403 raft_consensus.cc:2468] T de8c0dddbdc34ad88de9156beb74bef7 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57da47b50bc847c997f07dccaeae280a in term 2.
W20260709 13:03:34.427515 11544 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:03:34.429021 11523 consensus_queue.cc:1048] T 71db464af9104a8a86fd623394da3511 P e3760873d2be4dc7b991027c1deef35d [LEADER]: Connected to new peer: Peer: permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:34.430178 11561 raft_consensus.cc:697] T de8c0dddbdc34ad88de9156beb74bef7 P 57da47b50bc847c997f07dccaeae280a [term 2 LEADER]: Becoming Leader. State: Replica: 57da47b50bc847c997f07dccaeae280a, State: Running, Role: LEADER
I20260709 13:03:34.431357 11561 consensus_queue.cc:237] T de8c0dddbdc34ad88de9156beb74bef7 P 57da47b50bc847c997f07dccaeae280a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:34.435496 11548 raft_consensus.cc:993] T 71db464af9104a8a86fd623394da3511 P e3760873d2be4dc7b991027c1deef35d: : Instructing follower 7eb6f135338f4b84b60b7e67ab3d81d7 to start an election
I20260709 13:03:34.435564 11595 raft_consensus.cc:493] T 205736ed2ee6439588e8db06793e4cd6 P 57da47b50bc847c997f07dccaeae280a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:34.436225 11548 raft_consensus.cc:1081] T 71db464af9104a8a86fd623394da3511 P e3760873d2be4dc7b991027c1deef35d [term 1 LEADER]: Signalling peer 7eb6f135338f4b84b60b7e67ab3d81d7 to start an election
I20260709 13:03:34.436275 11595 raft_consensus.cc:515] T 205736ed2ee6439588e8db06793e4cd6 P 57da47b50bc847c997f07dccaeae280a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:34.438795 11402 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "71db464af9104a8a86fd623394da3511"
dest_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7"
 from {username='slave'} at 127.0.0.1:35442
I20260709 13:03:34.439358 11402 raft_consensus.cc:493] T 71db464af9104a8a86fd623394da3511 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:34.439774 11402 raft_consensus.cc:3060] T 71db464af9104a8a86fd623394da3511 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:34.440861 11223 catalog_manager.cc:5697] T de8c0dddbdc34ad88de9156beb74bef7 P 57da47b50bc847c997f07dccaeae280a reported cstate change: term changed from 1 to 2, leader changed from 7eb6f135338f4b84b60b7e67ab3d81d7 (127.0.107.194) to 57da47b50bc847c997f07dccaeae280a (127.0.107.195). New cstate: current_term: 2 leader_uuid: "57da47b50bc847c997f07dccaeae280a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:34.441732 11595 leader_election.cc:290] T 205736ed2ee6439588e8db06793e4cd6 P 57da47b50bc847c997f07dccaeae280a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3760873d2be4dc7b991027c1deef35d (127.0.107.193:35003), 7eb6f135338f4b84b60b7e67ab3d81d7 (127.0.107.194:42689)
I20260709 13:03:34.444571 11401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205736ed2ee6439588e8db06793e4cd6" candidate_uuid: "57da47b50bc847c997f07dccaeae280a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" is_pre_election: true
I20260709 13:03:34.445495 11401 raft_consensus.cc:2393] T 205736ed2ee6439588e8db06793e4cd6 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 57da47b50bc847c997f07dccaeae280a in current term 1: Already voted for candidate e3760873d2be4dc7b991027c1deef35d in this term.
I20260709 13:03:34.452041 11402 raft_consensus.cc:515] T 71db464af9104a8a86fd623394da3511 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:34.454898 11403 raft_consensus.cc:1240] T 71db464af9104a8a86fd623394da3511 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 2 FOLLOWER]: Rejecting Update request from peer e3760873d2be4dc7b991027c1deef35d for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:34.457310 11326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71db464af9104a8a86fd623394da3511" candidate_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e3760873d2be4dc7b991027c1deef35d"
I20260709 13:03:34.457221 11548 consensus_queue.cc:1059] T 71db464af9104a8a86fd623394da3511 P e3760873d2be4dc7b991027c1deef35d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:03:34.462031 11402 leader_election.cc:290] T 71db464af9104a8a86fd623394da3511 P 7eb6f135338f4b84b60b7e67ab3d81d7 [CANDIDATE]: Term 2 election: Requested vote from peers e3760873d2be4dc7b991027c1deef35d (127.0.107.193:35003), 57da47b50bc847c997f07dccaeae280a (127.0.107.195:37515)
I20260709 13:03:34.456238 11328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205736ed2ee6439588e8db06793e4cd6" candidate_uuid: "57da47b50bc847c997f07dccaeae280a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3760873d2be4dc7b991027c1deef35d" is_pre_election: true
I20260709 13:03:34.463202 11475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71db464af9104a8a86fd623394da3511" candidate_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "57da47b50bc847c997f07dccaeae280a"
I20260709 13:03:34.463406 11477 raft_consensus.cc:3060] T 205736ed2ee6439588e8db06793e4cd6 P 57da47b50bc847c997f07dccaeae280a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:34.463858 11475 raft_consensus.cc:3060] T 71db464af9104a8a86fd623394da3511 P 57da47b50bc847c997f07dccaeae280a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:34.463992 11326 raft_consensus.cc:3055] T 71db464af9104a8a86fd623394da3511 P e3760873d2be4dc7b991027c1deef35d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:34.464551 11443 leader_election.cc:304] T 205736ed2ee6439588e8db06793e4cd6 P 57da47b50bc847c997f07dccaeae280a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 57da47b50bc847c997f07dccaeae280a; no voters: 7eb6f135338f4b84b60b7e67ab3d81d7, e3760873d2be4dc7b991027c1deef35d
I20260709 13:03:34.464838 11326 raft_consensus.cc:740] T 71db464af9104a8a86fd623394da3511 P e3760873d2be4dc7b991027c1deef35d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e3760873d2be4dc7b991027c1deef35d, State: Running, Role: LEADER
I20260709 13:03:34.465755 11326 consensus_queue.cc:260] T 71db464af9104a8a86fd623394da3511 P e3760873d2be4dc7b991027c1deef35d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:34.466785 11326 raft_consensus.cc:3060] T 71db464af9104a8a86fd623394da3511 P e3760873d2be4dc7b991027c1deef35d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:34.471119 11595 raft_consensus.cc:2749] T 205736ed2ee6439588e8db06793e4cd6 P 57da47b50bc847c997f07dccaeae280a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:34.471184 11475 raft_consensus.cc:2468] T 71db464af9104a8a86fd623394da3511 P 57da47b50bc847c997f07dccaeae280a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7eb6f135338f4b84b60b7e67ab3d81d7 in term 2.
I20260709 13:03:34.471675 11326 raft_consensus.cc:2468] T 71db464af9104a8a86fd623394da3511 P e3760873d2be4dc7b991027c1deef35d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7eb6f135338f4b84b60b7e67ab3d81d7 in term 2.
W20260709 13:03:34.472240 11569 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:03:34.472548 11369 leader_election.cc:304] T 71db464af9104a8a86fd623394da3511 P 7eb6f135338f4b84b60b7e67ab3d81d7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57da47b50bc847c997f07dccaeae280a, 7eb6f135338f4b84b60b7e67ab3d81d7; no voters: 
I20260709 13:03:34.473186 11568 consensus_queue.cc:1048] T 205736ed2ee6439588e8db06793e4cd6 P e3760873d2be4dc7b991027c1deef35d [LEADER]: Connected to new peer: Peer: permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:34.473557 11544 raft_consensus.cc:2804] T 71db464af9104a8a86fd623394da3511 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:34.474020 11544 raft_consensus.cc:697] T 71db464af9104a8a86fd623394da3511 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 2 LEADER]: Becoming Leader. State: Replica: 7eb6f135338f4b84b60b7e67ab3d81d7, State: Running, Role: LEADER
I20260709 13:03:34.474743 11544 consensus_queue.cc:237] T 71db464af9104a8a86fd623394da3511 P 7eb6f135338f4b84b60b7e67ab3d81d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:34.484472 11560 consensus_queue.cc:1048] T 205736ed2ee6439588e8db06793e4cd6 P e3760873d2be4dc7b991027c1deef35d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:34.485312 11226 catalog_manager.cc:5697] T 71db464af9104a8a86fd623394da3511 P 7eb6f135338f4b84b60b7e67ab3d81d7 reported cstate change: term changed from 1 to 2, leader changed from e3760873d2be4dc7b991027c1deef35d (127.0.107.193) to 7eb6f135338f4b84b60b7e67ab3d81d7 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:34.495267 11569 raft_consensus.cc:993] T 205736ed2ee6439588e8db06793e4cd6 P e3760873d2be4dc7b991027c1deef35d: : Instructing follower 7eb6f135338f4b84b60b7e67ab3d81d7 to start an election
I20260709 13:03:34.495684 11560 raft_consensus.cc:1081] T 205736ed2ee6439588e8db06793e4cd6 P e3760873d2be4dc7b991027c1deef35d [term 1 LEADER]: Signalling peer 7eb6f135338f4b84b60b7e67ab3d81d7 to start an election
I20260709 13:03:34.497213 11402 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "205736ed2ee6439588e8db06793e4cd6"
dest_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7"
 from {username='slave'} at 127.0.0.1:35442
I20260709 13:03:34.497660 11402 raft_consensus.cc:493] T 205736ed2ee6439588e8db06793e4cd6 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:34.497953 11402 raft_consensus.cc:3060] T 205736ed2ee6439588e8db06793e4cd6 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:34.502964 11402 raft_consensus.cc:515] T 205736ed2ee6439588e8db06793e4cd6 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:34.504712 11402 leader_election.cc:290] T 205736ed2ee6439588e8db06793e4cd6 P 7eb6f135338f4b84b60b7e67ab3d81d7 [CANDIDATE]: Term 2 election: Requested vote from peers e3760873d2be4dc7b991027c1deef35d (127.0.107.193:35003), 57da47b50bc847c997f07dccaeae280a (127.0.107.195:37515)
I20260709 13:03:34.505383 11326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205736ed2ee6439588e8db06793e4cd6" candidate_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e3760873d2be4dc7b991027c1deef35d"
I20260709 13:03:34.505965 11326 raft_consensus.cc:3055] T 205736ed2ee6439588e8db06793e4cd6 P e3760873d2be4dc7b991027c1deef35d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:34.506002 11477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205736ed2ee6439588e8db06793e4cd6" candidate_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "57da47b50bc847c997f07dccaeae280a"
I20260709 13:03:34.506254 11326 raft_consensus.cc:740] T 205736ed2ee6439588e8db06793e4cd6 P e3760873d2be4dc7b991027c1deef35d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e3760873d2be4dc7b991027c1deef35d, State: Running, Role: LEADER
I20260709 13:03:34.506637 11477 raft_consensus.cc:3060] T 205736ed2ee6439588e8db06793e4cd6 P 57da47b50bc847c997f07dccaeae280a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:34.507086 11326 consensus_queue.cc:260] T 205736ed2ee6439588e8db06793e4cd6 P e3760873d2be4dc7b991027c1deef35d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:34.508069 11326 raft_consensus.cc:3060] T 205736ed2ee6439588e8db06793e4cd6 P e3760873d2be4dc7b991027c1deef35d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:34.511368 11477 raft_consensus.cc:2468] T 205736ed2ee6439588e8db06793e4cd6 P 57da47b50bc847c997f07dccaeae280a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7eb6f135338f4b84b60b7e67ab3d81d7 in term 2.
I20260709 13:03:34.512364 11369 leader_election.cc:304] T 205736ed2ee6439588e8db06793e4cd6 P 7eb6f135338f4b84b60b7e67ab3d81d7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57da47b50bc847c997f07dccaeae280a, 7eb6f135338f4b84b60b7e67ab3d81d7; no voters: 
I20260709 13:03:34.512744 11326 raft_consensus.cc:2468] T 205736ed2ee6439588e8db06793e4cd6 P e3760873d2be4dc7b991027c1deef35d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7eb6f135338f4b84b60b7e67ab3d81d7 in term 2.
I20260709 13:03:34.513195 11544 raft_consensus.cc:2804] T 205736ed2ee6439588e8db06793e4cd6 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:34.513692 11544 raft_consensus.cc:697] T 205736ed2ee6439588e8db06793e4cd6 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 2 LEADER]: Becoming Leader. State: Replica: 7eb6f135338f4b84b60b7e67ab3d81d7, State: Running, Role: LEADER
I20260709 13:03:34.514494 11544 consensus_queue.cc:237] T 205736ed2ee6439588e8db06793e4cd6 P 7eb6f135338f4b84b60b7e67ab3d81d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:34.520465 11223 catalog_manager.cc:5697] T 205736ed2ee6439588e8db06793e4cd6 P 7eb6f135338f4b84b60b7e67ab3d81d7 reported cstate change: term changed from 1 to 2, leader changed from e3760873d2be4dc7b991027c1deef35d (127.0.107.193) to 7eb6f135338f4b84b60b7e67ab3d81d7 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:34.547125 11544 consensus_queue.cc:1048] T b35e87dce47b43119d13bd514d434a76 P 7eb6f135338f4b84b60b7e67ab3d81d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:34.558336 11564 consensus_queue.cc:1048] T b35e87dce47b43119d13bd514d434a76 P 7eb6f135338f4b84b60b7e67ab3d81d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:34.666742 11522 raft_consensus.cc:993] T 120ae599baa547b1855a1ba361226d3e P 7eb6f135338f4b84b60b7e67ab3d81d7: : Instructing follower e3760873d2be4dc7b991027c1deef35d to start an election
I20260709 13:03:34.667160 11564 raft_consensus.cc:1081] T 120ae599baa547b1855a1ba361226d3e P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 LEADER]: Signalling peer e3760873d2be4dc7b991027c1deef35d to start an election
I20260709 13:03:34.668713 11326 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "120ae599baa547b1855a1ba361226d3e"
dest_uuid: "e3760873d2be4dc7b991027c1deef35d"
 from {username='slave'} at 127.0.0.1:49586
I20260709 13:03:34.669204 11326 raft_consensus.cc:493] T 120ae599baa547b1855a1ba361226d3e P e3760873d2be4dc7b991027c1deef35d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:34.669476 11326 raft_consensus.cc:3060] T 120ae599baa547b1855a1ba361226d3e P e3760873d2be4dc7b991027c1deef35d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:34.674571 11326 raft_consensus.cc:515] T 120ae599baa547b1855a1ba361226d3e P e3760873d2be4dc7b991027c1deef35d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:34.676270 11326 leader_election.cc:290] T 120ae599baa547b1855a1ba361226d3e P e3760873d2be4dc7b991027c1deef35d [CANDIDATE]: Term 2 election: Requested vote from peers 7eb6f135338f4b84b60b7e67ab3d81d7 (127.0.107.194:42689), 57da47b50bc847c997f07dccaeae280a (127.0.107.195:37515)
I20260709 13:03:34.677137 11402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "120ae599baa547b1855a1ba361226d3e" candidate_uuid: "e3760873d2be4dc7b991027c1deef35d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7"
I20260709 13:03:34.677392 11477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "120ae599baa547b1855a1ba361226d3e" candidate_uuid: "e3760873d2be4dc7b991027c1deef35d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "57da47b50bc847c997f07dccaeae280a"
I20260709 13:03:34.677837 11402 raft_consensus.cc:3055] T 120ae599baa547b1855a1ba361226d3e P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:34.677968 11477 raft_consensus.cc:3060] T 120ae599baa547b1855a1ba361226d3e P 57da47b50bc847c997f07dccaeae280a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:34.678164 11402 raft_consensus.cc:740] T 120ae599baa547b1855a1ba361226d3e P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7eb6f135338f4b84b60b7e67ab3d81d7, State: Running, Role: LEADER
I20260709 13:03:34.679071 11402 consensus_queue.cc:260] T 120ae599baa547b1855a1ba361226d3e P 7eb6f135338f4b84b60b7e67ab3d81d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:34.680130 11402 raft_consensus.cc:3060] T 120ae599baa547b1855a1ba361226d3e P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:34.683364 11477 raft_consensus.cc:2468] T 120ae599baa547b1855a1ba361226d3e P 57da47b50bc847c997f07dccaeae280a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3760873d2be4dc7b991027c1deef35d in term 2.
I20260709 13:03:34.684664 11294 leader_election.cc:304] T 120ae599baa547b1855a1ba361226d3e P e3760873d2be4dc7b991027c1deef35d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57da47b50bc847c997f07dccaeae280a, e3760873d2be4dc7b991027c1deef35d; no voters: 
I20260709 13:03:34.685391 11560 raft_consensus.cc:2804] T 120ae599baa547b1855a1ba361226d3e P e3760873d2be4dc7b991027c1deef35d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:34.685724 11402 raft_consensus.cc:2468] T 120ae599baa547b1855a1ba361226d3e P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3760873d2be4dc7b991027c1deef35d in term 2.
I20260709 13:03:34.685935 11560 raft_consensus.cc:697] T 120ae599baa547b1855a1ba361226d3e P e3760873d2be4dc7b991027c1deef35d [term 2 LEADER]: Becoming Leader. State: Replica: e3760873d2be4dc7b991027c1deef35d, State: Running, Role: LEADER
I20260709 13:03:34.686882 11560 consensus_queue.cc:237] T 120ae599baa547b1855a1ba361226d3e P e3760873d2be4dc7b991027c1deef35d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:34.693756 11226 catalog_manager.cc:5697] T 120ae599baa547b1855a1ba361226d3e P e3760873d2be4dc7b991027c1deef35d reported cstate change: term changed from 1 to 2, leader changed from 7eb6f135338f4b84b60b7e67ab3d81d7 (127.0.107.194) to e3760873d2be4dc7b991027c1deef35d (127.0.107.193). New cstate: current_term: 2 leader_uuid: "e3760873d2be4dc7b991027c1deef35d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:34.804105 11402 raft_consensus.cc:1275] T a802e0f3aab1477091f50d46836a5e34 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 2 FOLLOWER]: Refusing update from remote peer e3760873d2be4dc7b991027c1deef35d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:34.805411 11560 consensus_queue.cc:1048] T a802e0f3aab1477091f50d46836a5e34 P e3760873d2be4dc7b991027c1deef35d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:34.813364 11477 raft_consensus.cc:1275] T a802e0f3aab1477091f50d46836a5e34 P 57da47b50bc847c997f07dccaeae280a [term 2 FOLLOWER]: Refusing update from remote peer e3760873d2be4dc7b991027c1deef35d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:34.814881 11560 consensus_queue.cc:1048] T a802e0f3aab1477091f50d46836a5e34 P e3760873d2be4dc7b991027c1deef35d [LEADER]: Connected to new peer: Peer: permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:34.893997 11477 raft_consensus.cc:1275] T 71db464af9104a8a86fd623394da3511 P 57da47b50bc847c997f07dccaeae280a [term 2 FOLLOWER]: Refusing update from remote peer 7eb6f135338f4b84b60b7e67ab3d81d7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:34.895385 11564 consensus_queue.cc:1048] T 71db464af9104a8a86fd623394da3511 P 7eb6f135338f4b84b60b7e67ab3d81d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:34.903683 11326 raft_consensus.cc:1275] T 71db464af9104a8a86fd623394da3511 P e3760873d2be4dc7b991027c1deef35d [term 2 FOLLOWER]: Refusing update from remote peer 7eb6f135338f4b84b60b7e67ab3d81d7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:34.905169 11564 consensus_queue.cc:1048] T 71db464af9104a8a86fd623394da3511 P 7eb6f135338f4b84b60b7e67ab3d81d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:34.935019 11326 raft_consensus.cc:1275] T de8c0dddbdc34ad88de9156beb74bef7 P e3760873d2be4dc7b991027c1deef35d [term 2 FOLLOWER]: Refusing update from remote peer 57da47b50bc847c997f07dccaeae280a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:34.936523 11595 consensus_queue.cc:1048] T de8c0dddbdc34ad88de9156beb74bef7 P 57da47b50bc847c997f07dccaeae280a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:34.946199 11402 raft_consensus.cc:1275] T de8c0dddbdc34ad88de9156beb74bef7 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 2 FOLLOWER]: Refusing update from remote peer 57da47b50bc847c997f07dccaeae280a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:34.947839 11602 consensus_queue.cc:1048] T de8c0dddbdc34ad88de9156beb74bef7 P 57da47b50bc847c997f07dccaeae280a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:35.031065 11477 raft_consensus.cc:1275] T 205736ed2ee6439588e8db06793e4cd6 P 57da47b50bc847c997f07dccaeae280a [term 2 FOLLOWER]: Refusing update from remote peer 7eb6f135338f4b84b60b7e67ab3d81d7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:35.032297 11564 consensus_queue.cc:1048] T 205736ed2ee6439588e8db06793e4cd6 P 7eb6f135338f4b84b60b7e67ab3d81d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:35.040028 11326 raft_consensus.cc:1275] T 205736ed2ee6439588e8db06793e4cd6 P e3760873d2be4dc7b991027c1deef35d [term 2 FOLLOWER]: Refusing update from remote peer 7eb6f135338f4b84b60b7e67ab3d81d7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:35.042060 11544 consensus_queue.cc:1048] T 205736ed2ee6439588e8db06793e4cd6 P 7eb6f135338f4b84b60b7e67ab3d81d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:35.158255 11477 raft_consensus.cc:1275] T 120ae599baa547b1855a1ba361226d3e P 57da47b50bc847c997f07dccaeae280a [term 2 FOLLOWER]: Refusing update from remote peer e3760873d2be4dc7b991027c1deef35d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:35.159631 11548 consensus_queue.cc:1048] T 120ae599baa547b1855a1ba361226d3e P e3760873d2be4dc7b991027c1deef35d [LEADER]: Connected to new peer: Peer: permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:35.167268 11402 raft_consensus.cc:1275] T 120ae599baa547b1855a1ba361226d3e P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 2 FOLLOWER]: Refusing update from remote peer e3760873d2be4dc7b991027c1deef35d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:35.169067 11569 consensus_queue.cc:1048] T 120ae599baa547b1855a1ba361226d3e P e3760873d2be4dc7b991027c1deef35d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:35.474105 11569 raft_consensus.cc:493] T dd5040fb5b614dd2990e57812dadd3b7 P e3760873d2be4dc7b991027c1deef35d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:35.474721 11569 raft_consensus.cc:515] T dd5040fb5b614dd2990e57812dadd3b7 P e3760873d2be4dc7b991027c1deef35d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:35.476837 11569 leader_election.cc:290] T dd5040fb5b614dd2990e57812dadd3b7 P e3760873d2be4dc7b991027c1deef35d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7eb6f135338f4b84b60b7e67ab3d81d7 (127.0.107.194:42689), 57da47b50bc847c997f07dccaeae280a (127.0.107.195:37515)
I20260709 13:03:35.477569 11402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5040fb5b614dd2990e57812dadd3b7" candidate_uuid: "e3760873d2be4dc7b991027c1deef35d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" is_pre_election: true
I20260709 13:03:35.478353 11477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5040fb5b614dd2990e57812dadd3b7" candidate_uuid: "e3760873d2be4dc7b991027c1deef35d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "57da47b50bc847c997f07dccaeae280a" is_pre_election: true
I20260709 13:03:35.479669 11294 leader_election.cc:304] T dd5040fb5b614dd2990e57812dadd3b7 P e3760873d2be4dc7b991027c1deef35d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3760873d2be4dc7b991027c1deef35d; no voters: 57da47b50bc847c997f07dccaeae280a, 7eb6f135338f4b84b60b7e67ab3d81d7
I20260709 13:03:35.480310 11569 raft_consensus.cc:2749] T dd5040fb5b614dd2990e57812dadd3b7 P e3760873d2be4dc7b991027c1deef35d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:35.736147 11571 raft_consensus.cc:493] T dd5040fb5b614dd2990e57812dadd3b7 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3760873d2be4dc7b991027c1deef35d)
I20260709 13:03:35.736647 11571 raft_consensus.cc:515] T dd5040fb5b614dd2990e57812dadd3b7 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:35.738440 11571 leader_election.cc:290] T dd5040fb5b614dd2990e57812dadd3b7 P 7eb6f135338f4b84b60b7e67ab3d81d7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3760873d2be4dc7b991027c1deef35d (127.0.107.193:35003), 57da47b50bc847c997f07dccaeae280a (127.0.107.195:37515)
I20260709 13:03:35.739310 11328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5040fb5b614dd2990e57812dadd3b7" candidate_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3760873d2be4dc7b991027c1deef35d" is_pre_election: true
I20260709 13:03:35.739622 11477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5040fb5b614dd2990e57812dadd3b7" candidate_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "57da47b50bc847c997f07dccaeae280a" is_pre_election: true
I20260709 13:03:35.739940 11328 raft_consensus.cc:2468] T dd5040fb5b614dd2990e57812dadd3b7 P e3760873d2be4dc7b991027c1deef35d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7eb6f135338f4b84b60b7e67ab3d81d7 in term 2.
I20260709 13:03:35.740346 11477 raft_consensus.cc:2393] T dd5040fb5b614dd2990e57812dadd3b7 P 57da47b50bc847c997f07dccaeae280a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7eb6f135338f4b84b60b7e67ab3d81d7 in current term 2: Already voted for candidate 57da47b50bc847c997f07dccaeae280a in this term.
I20260709 13:03:35.741003 11369 leader_election.cc:304] T dd5040fb5b614dd2990e57812dadd3b7 P 7eb6f135338f4b84b60b7e67ab3d81d7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7eb6f135338f4b84b60b7e67ab3d81d7, e3760873d2be4dc7b991027c1deef35d; no voters: 
I20260709 13:03:35.741730 11571 raft_consensus.cc:2804] T dd5040fb5b614dd2990e57812dadd3b7 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:35.742080 11571 raft_consensus.cc:493] T dd5040fb5b614dd2990e57812dadd3b7 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e3760873d2be4dc7b991027c1deef35d)
I20260709 13:03:35.742404 11571 raft_consensus.cc:3060] T dd5040fb5b614dd2990e57812dadd3b7 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:35.747689 11571 raft_consensus.cc:515] T dd5040fb5b614dd2990e57812dadd3b7 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:35.749439 11571 leader_election.cc:290] T dd5040fb5b614dd2990e57812dadd3b7 P 7eb6f135338f4b84b60b7e67ab3d81d7 [CANDIDATE]: Term 2 election: Requested vote from peers e3760873d2be4dc7b991027c1deef35d (127.0.107.193:35003), 57da47b50bc847c997f07dccaeae280a (127.0.107.195:37515)
I20260709 13:03:35.750142 11328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5040fb5b614dd2990e57812dadd3b7" candidate_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3760873d2be4dc7b991027c1deef35d"
I20260709 13:03:35.750428 11477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd5040fb5b614dd2990e57812dadd3b7" candidate_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "57da47b50bc847c997f07dccaeae280a"
I20260709 13:03:35.751160 11477 raft_consensus.cc:2393] T dd5040fb5b614dd2990e57812dadd3b7 P 57da47b50bc847c997f07dccaeae280a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 7eb6f135338f4b84b60b7e67ab3d81d7 in current term 2: Already voted for candidate 57da47b50bc847c997f07dccaeae280a in this term.
I20260709 13:03:35.756024 11328 raft_consensus.cc:2468] T dd5040fb5b614dd2990e57812dadd3b7 P e3760873d2be4dc7b991027c1deef35d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7eb6f135338f4b84b60b7e67ab3d81d7 in term 2.
I20260709 13:03:35.757138 11369 leader_election.cc:304] T dd5040fb5b614dd2990e57812dadd3b7 P 7eb6f135338f4b84b60b7e67ab3d81d7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7eb6f135338f4b84b60b7e67ab3d81d7, e3760873d2be4dc7b991027c1deef35d; no voters: 57da47b50bc847c997f07dccaeae280a
I20260709 13:03:35.757817 11571 raft_consensus.cc:2804] T dd5040fb5b614dd2990e57812dadd3b7 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:35.758229 11571 raft_consensus.cc:697] T dd5040fb5b614dd2990e57812dadd3b7 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 2 LEADER]: Becoming Leader. State: Replica: 7eb6f135338f4b84b60b7e67ab3d81d7, State: Running, Role: LEADER
I20260709 13:03:35.759081 11571 consensus_queue.cc:237] T dd5040fb5b614dd2990e57812dadd3b7 P 7eb6f135338f4b84b60b7e67ab3d81d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:35.766083 11225 catalog_manager.cc:5697] T dd5040fb5b614dd2990e57812dadd3b7 P 7eb6f135338f4b84b60b7e67ab3d81d7 reported cstate change: term changed from 1 to 2, leader changed from e3760873d2be4dc7b991027c1deef35d (127.0.107.193) to 7eb6f135338f4b84b60b7e67ab3d81d7 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:36.149215 11475 raft_consensus.cc:1275] T dd5040fb5b614dd2990e57812dadd3b7 P 57da47b50bc847c997f07dccaeae280a [term 2 FOLLOWER]: Refusing update from remote peer 7eb6f135338f4b84b60b7e67ab3d81d7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:36.150439 11571 consensus_queue.cc:1048] T dd5040fb5b614dd2990e57812dadd3b7 P 7eb6f135338f4b84b60b7e67ab3d81d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:36.162762 11328 raft_consensus.cc:1275] T dd5040fb5b614dd2990e57812dadd3b7 P e3760873d2be4dc7b991027c1deef35d [term 2 FOLLOWER]: Refusing update from remote peer 7eb6f135338f4b84b60b7e67ab3d81d7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:36.164549 11571 consensus_queue.cc:1048] T dd5040fb5b614dd2990e57812dadd3b7 P 7eb6f135338f4b84b60b7e67ab3d81d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:37.386394 11225 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59242:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:03:37.388667 11225 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:03:37.439217 11312 tablet_service.cc:1511] Processing CreateTablet for tablet a75eed46652c4944b6302c9569235569 (DEFAULT_TABLE table=soft_deleted_table [id=3b24a765838145c0b49b3a4a72cb7b86]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:03:37.440439 11312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a75eed46652c4944b6302c9569235569. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:37.440284 11390 tablet_service.cc:1511] Processing CreateTablet for tablet a75eed46652c4944b6302c9569235569 (DEFAULT_TABLE table=soft_deleted_table [id=3b24a765838145c0b49b3a4a72cb7b86]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:03:37.441584 11390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a75eed46652c4944b6302c9569235569. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:37.443184 11315 tablet_service.cc:1511] Processing CreateTablet for tablet 14457af646fe430aa855e47d42721a17 (DEFAULT_TABLE table=soft_deleted_table [id=3b24a765838145c0b49b3a4a72cb7b86]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:03:37.444020 11463 tablet_service.cc:1511] Processing CreateTablet for tablet a75eed46652c4944b6302c9569235569 (DEFAULT_TABLE table=soft_deleted_table [id=3b24a765838145c0b49b3a4a72cb7b86]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:03:37.444567 11315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14457af646fe430aa855e47d42721a17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:37.445331 11463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a75eed46652c4944b6302c9569235569. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:37.446143 11389 tablet_service.cc:1511] Processing CreateTablet for tablet 14457af646fe430aa855e47d42721a17 (DEFAULT_TABLE table=soft_deleted_table [id=3b24a765838145c0b49b3a4a72cb7b86]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:03:37.447446 11389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14457af646fe430aa855e47d42721a17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:37.448598 11459 tablet_service.cc:1511] Processing CreateTablet for tablet 14457af646fe430aa855e47d42721a17 (DEFAULT_TABLE table=soft_deleted_table [id=3b24a765838145c0b49b3a4a72cb7b86]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:03:37.449846 11459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14457af646fe430aa855e47d42721a17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:37.454231 11388 tablet_service.cc:1511] Processing CreateTablet for tablet bb4c61cb73ed4c488c741fd69f447642 (DEFAULT_TABLE table=soft_deleted_table [id=3b24a765838145c0b49b3a4a72cb7b86]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:03:37.455691 11388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb4c61cb73ed4c488c741fd69f447642. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:37.456512 11311 tablet_service.cc:1511] Processing CreateTablet for tablet bb4c61cb73ed4c488c741fd69f447642 (DEFAULT_TABLE table=soft_deleted_table [id=3b24a765838145c0b49b3a4a72cb7b86]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:03:37.457890 11311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb4c61cb73ed4c488c741fd69f447642. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:37.461988 11393 tablet_service.cc:1511] Processing CreateTablet for tablet a39eb6d3a8b641d88c8c8bfedce391ed (DEFAULT_TABLE table=soft_deleted_table [id=3b24a765838145c0b49b3a4a72cb7b86]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:03:37.463466 11393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a39eb6d3a8b641d88c8c8bfedce391ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:37.467133 11392 tablet_service.cc:1511] Processing CreateTablet for tablet afdaf36d81c44e9db29f10e201b31e8c (DEFAULT_TABLE table=soft_deleted_table [id=3b24a765838145c0b49b3a4a72cb7b86]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:03:37.468550 11392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afdaf36d81c44e9db29f10e201b31e8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:37.472532 11466 tablet_service.cc:1511] Processing CreateTablet for tablet bb4c61cb73ed4c488c741fd69f447642 (DEFAULT_TABLE table=soft_deleted_table [id=3b24a765838145c0b49b3a4a72cb7b86]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:03:37.473917 11466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb4c61cb73ed4c488c741fd69f447642. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:37.474550 11317 tablet_service.cc:1511] Processing CreateTablet for tablet a39eb6d3a8b641d88c8c8bfedce391ed (DEFAULT_TABLE table=soft_deleted_table [id=3b24a765838145c0b49b3a4a72cb7b86]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:03:37.475883 11317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a39eb6d3a8b641d88c8c8bfedce391ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:37.476979 11465 tablet_service.cc:1511] Processing CreateTablet for tablet afdaf36d81c44e9db29f10e201b31e8c (DEFAULT_TABLE table=soft_deleted_table [id=3b24a765838145c0b49b3a4a72cb7b86]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:03:37.476979 11461 tablet_service.cc:1511] Processing CreateTablet for tablet a39eb6d3a8b641d88c8c8bfedce391ed (DEFAULT_TABLE table=soft_deleted_table [id=3b24a765838145c0b49b3a4a72cb7b86]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:03:37.478338 11465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afdaf36d81c44e9db29f10e201b31e8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:37.478171 11314 tablet_service.cc:1511] Processing CreateTablet for tablet afdaf36d81c44e9db29f10e201b31e8c (DEFAULT_TABLE table=soft_deleted_table [id=3b24a765838145c0b49b3a4a72cb7b86]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:03:37.478382 11387 tablet_service.cc:1511] Processing CreateTablet for tablet e812d0605d24436989fb6ec2c868d47c (DEFAULT_TABLE table=soft_deleted_table [id=3b24a765838145c0b49b3a4a72cb7b86]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:03:37.479454 11314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afdaf36d81c44e9db29f10e201b31e8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:37.479856 11387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e812d0605d24436989fb6ec2c868d47c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:37.480038 11461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a39eb6d3a8b641d88c8c8bfedce391ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:37.482210 11318 tablet_service.cc:1511] Processing CreateTablet for tablet 03c55f66aaf043bba6a0c8d64fbddf0e (DEFAULT_TABLE table=soft_deleted_table [id=3b24a765838145c0b49b3a4a72cb7b86]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:03:37.483551 11318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03c55f66aaf043bba6a0c8d64fbddf0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:37.487730 11391 tablet_service.cc:1511] Processing CreateTablet for tablet 03c55f66aaf043bba6a0c8d64fbddf0e (DEFAULT_TABLE table=soft_deleted_table [id=3b24a765838145c0b49b3a4a72cb7b86]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:03:37.489117 11391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03c55f66aaf043bba6a0c8d64fbddf0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:37.493048 11316 tablet_service.cc:1511] Processing CreateTablet for tablet e812d0605d24436989fb6ec2c868d47c (DEFAULT_TABLE table=soft_deleted_table [id=3b24a765838145c0b49b3a4a72cb7b86]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:03:37.494474 11316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e812d0605d24436989fb6ec2c868d47c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:37.496165 11467 tablet_service.cc:1511] Processing CreateTablet for tablet 03c55f66aaf043bba6a0c8d64fbddf0e (DEFAULT_TABLE table=soft_deleted_table [id=3b24a765838145c0b49b3a4a72cb7b86]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:03:37.497505 11467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03c55f66aaf043bba6a0c8d64fbddf0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:37.502754 11462 tablet_service.cc:1511] Processing CreateTablet for tablet e812d0605d24436989fb6ec2c868d47c (DEFAULT_TABLE table=soft_deleted_table [id=3b24a765838145c0b49b3a4a72cb7b86]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:03:37.504133 11462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e812d0605d24436989fb6ec2c868d47c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:37.515559 11313 tablet_service.cc:1511] Processing CreateTablet for tablet 3ff2fc0ffa2f4ac08a92984cfd462344 (DEFAULT_TABLE table=soft_deleted_table [id=3b24a765838145c0b49b3a4a72cb7b86]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:03:37.516948 11313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ff2fc0ffa2f4ac08a92984cfd462344. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:37.542551 11387 tablet_service.cc:1511] Processing CreateTablet for tablet 3ff2fc0ffa2f4ac08a92984cfd462344 (DEFAULT_TABLE table=soft_deleted_table [id=3b24a765838145c0b49b3a4a72cb7b86]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:03:37.544026 11387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ff2fc0ffa2f4ac08a92984cfd462344. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:37.548492 11465 tablet_service.cc:1511] Processing CreateTablet for tablet 3ff2fc0ffa2f4ac08a92984cfd462344 (DEFAULT_TABLE table=soft_deleted_table [id=3b24a765838145c0b49b3a4a72cb7b86]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:03:37.556295 11465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ff2fc0ffa2f4ac08a92984cfd462344. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:37.548805 11310 tablet_service.cc:1511] Processing CreateTablet for tablet d1ada73b7855443da29b368f50229412 (DEFAULT_TABLE table=soft_deleted_table [id=3b24a765838145c0b49b3a4a72cb7b86]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:03:37.568622 11310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1ada73b7855443da29b368f50229412. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:37.565554 11630 tablet_bootstrap.cc:492] T e812d0605d24436989fb6ec2c868d47c P e3760873d2be4dc7b991027c1deef35d: Bootstrap starting.
I20260709 13:03:37.565889 11393 tablet_service.cc:1511] Processing CreateTablet for tablet d1ada73b7855443da29b368f50229412 (DEFAULT_TABLE table=soft_deleted_table [id=3b24a765838145c0b49b3a4a72cb7b86]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:03:37.566882 11631 tablet_bootstrap.cc:492] T 03c55f66aaf043bba6a0c8d64fbddf0e P 57da47b50bc847c997f07dccaeae280a: Bootstrap starting.
I20260709 13:03:37.583531 11393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1ada73b7855443da29b368f50229412. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:37.583601 11632 tablet_bootstrap.cc:492] T a75eed46652c4944b6302c9569235569 P 7eb6f135338f4b84b60b7e67ab3d81d7: Bootstrap starting.
I20260709 13:03:37.598500 11632 tablet_bootstrap.cc:654] T a75eed46652c4944b6302c9569235569 P 7eb6f135338f4b84b60b7e67ab3d81d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:37.603565 11630 tablet_bootstrap.cc:654] T e812d0605d24436989fb6ec2c868d47c P e3760873d2be4dc7b991027c1deef35d: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:37.606648 11631 tablet_bootstrap.cc:654] T 03c55f66aaf043bba6a0c8d64fbddf0e P 57da47b50bc847c997f07dccaeae280a: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:37.609910 11462 tablet_service.cc:1511] Processing CreateTablet for tablet d1ada73b7855443da29b368f50229412 (DEFAULT_TABLE table=soft_deleted_table [id=3b24a765838145c0b49b3a4a72cb7b86]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:03:37.615490 11462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1ada73b7855443da29b368f50229412. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:37.616096 11632 tablet_bootstrap.cc:492] T a75eed46652c4944b6302c9569235569 P 7eb6f135338f4b84b60b7e67ab3d81d7: No bootstrap required, opened a new log
I20260709 13:03:37.616667 11632 ts_tablet_manager.cc:1403] T a75eed46652c4944b6302c9569235569 P 7eb6f135338f4b84b60b7e67ab3d81d7: Time spent bootstrapping tablet: real 0.033s	user 0.010s	sys 0.002s
I20260709 13:03:37.619599 11632 raft_consensus.cc:359] T a75eed46652c4944b6302c9569235569 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:37.620479 11632 raft_consensus.cc:385] T a75eed46652c4944b6302c9569235569 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:37.620833 11632 raft_consensus.cc:740] T a75eed46652c4944b6302c9569235569 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7eb6f135338f4b84b60b7e67ab3d81d7, State: Initialized, Role: FOLLOWER
I20260709 13:03:37.622742 11632 consensus_queue.cc:260] T a75eed46652c4944b6302c9569235569 P 7eb6f135338f4b84b60b7e67ab3d81d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:37.626608 11632 ts_tablet_manager.cc:1434] T a75eed46652c4944b6302c9569235569 P 7eb6f135338f4b84b60b7e67ab3d81d7: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.003s
I20260709 13:03:37.628103 11632 tablet_bootstrap.cc:492] T 14457af646fe430aa855e47d42721a17 P 7eb6f135338f4b84b60b7e67ab3d81d7: Bootstrap starting.
I20260709 13:03:37.627017 11631 tablet_bootstrap.cc:492] T 03c55f66aaf043bba6a0c8d64fbddf0e P 57da47b50bc847c997f07dccaeae280a: No bootstrap required, opened a new log
I20260709 13:03:37.631701 11631 ts_tablet_manager.cc:1403] T 03c55f66aaf043bba6a0c8d64fbddf0e P 57da47b50bc847c997f07dccaeae280a: Time spent bootstrapping tablet: real 0.065s	user 0.014s	sys 0.011s
I20260709 13:03:37.635666 11631 raft_consensus.cc:359] T 03c55f66aaf043bba6a0c8d64fbddf0e P 57da47b50bc847c997f07dccaeae280a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:37.636693 11631 raft_consensus.cc:385] T 03c55f66aaf043bba6a0c8d64fbddf0e P 57da47b50bc847c997f07dccaeae280a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:37.637137 11631 raft_consensus.cc:740] T 03c55f66aaf043bba6a0c8d64fbddf0e P 57da47b50bc847c997f07dccaeae280a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57da47b50bc847c997f07dccaeae280a, State: Initialized, Role: FOLLOWER
I20260709 13:03:37.635627 11630 tablet_bootstrap.cc:492] T e812d0605d24436989fb6ec2c868d47c P e3760873d2be4dc7b991027c1deef35d: No bootstrap required, opened a new log
I20260709 13:03:37.638013 11631 consensus_queue.cc:260] T 03c55f66aaf043bba6a0c8d64fbddf0e P 57da47b50bc847c997f07dccaeae280a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:37.639042 11630 ts_tablet_manager.cc:1403] T e812d0605d24436989fb6ec2c868d47c P e3760873d2be4dc7b991027c1deef35d: Time spent bootstrapping tablet: real 0.074s	user 0.023s	sys 0.017s
I20260709 13:03:37.640503 11631 ts_tablet_manager.cc:1434] T 03c55f66aaf043bba6a0c8d64fbddf0e P 57da47b50bc847c997f07dccaeae280a: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:03:37.641703 11631 tablet_bootstrap.cc:492] T a39eb6d3a8b641d88c8c8bfedce391ed P 57da47b50bc847c997f07dccaeae280a: Bootstrap starting.
I20260709 13:03:37.642367 11630 raft_consensus.cc:359] T e812d0605d24436989fb6ec2c868d47c P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:37.643258 11630 raft_consensus.cc:385] T e812d0605d24436989fb6ec2c868d47c P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:37.643597 11630 raft_consensus.cc:740] T e812d0605d24436989fb6ec2c868d47c P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3760873d2be4dc7b991027c1deef35d, State: Initialized, Role: FOLLOWER
I20260709 13:03:37.644352 11630 consensus_queue.cc:260] T e812d0605d24436989fb6ec2c868d47c P e3760873d2be4dc7b991027c1deef35d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:37.637465 11632 tablet_bootstrap.cc:654] T 14457af646fe430aa855e47d42721a17 P 7eb6f135338f4b84b60b7e67ab3d81d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:37.646978 11630 ts_tablet_manager.cc:1434] T e812d0605d24436989fb6ec2c868d47c P e3760873d2be4dc7b991027c1deef35d: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:03:37.648890 11631 tablet_bootstrap.cc:654] T a39eb6d3a8b641d88c8c8bfedce391ed P 57da47b50bc847c997f07dccaeae280a: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:37.649490 11630 tablet_bootstrap.cc:492] T bb4c61cb73ed4c488c741fd69f447642 P e3760873d2be4dc7b991027c1deef35d: Bootstrap starting.
I20260709 13:03:37.658025 11630 tablet_bootstrap.cc:654] T bb4c61cb73ed4c488c741fd69f447642 P e3760873d2be4dc7b991027c1deef35d: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:37.666177 11631 tablet_bootstrap.cc:492] T a39eb6d3a8b641d88c8c8bfedce391ed P 57da47b50bc847c997f07dccaeae280a: No bootstrap required, opened a new log
I20260709 13:03:37.666759 11631 ts_tablet_manager.cc:1403] T a39eb6d3a8b641d88c8c8bfedce391ed P 57da47b50bc847c997f07dccaeae280a: Time spent bootstrapping tablet: real 0.025s	user 0.014s	sys 0.004s
I20260709 13:03:37.669615 11631 raft_consensus.cc:359] T a39eb6d3a8b641d88c8c8bfedce391ed P 57da47b50bc847c997f07dccaeae280a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:37.670352 11631 raft_consensus.cc:385] T a39eb6d3a8b641d88c8c8bfedce391ed P 57da47b50bc847c997f07dccaeae280a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:37.670632 11631 raft_consensus.cc:740] T a39eb6d3a8b641d88c8c8bfedce391ed P 57da47b50bc847c997f07dccaeae280a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57da47b50bc847c997f07dccaeae280a, State: Initialized, Role: FOLLOWER
I20260709 13:03:37.671355 11631 consensus_queue.cc:260] T a39eb6d3a8b641d88c8c8bfedce391ed P 57da47b50bc847c997f07dccaeae280a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:37.674002 11631 ts_tablet_manager.cc:1434] T a39eb6d3a8b641d88c8c8bfedce391ed P 57da47b50bc847c997f07dccaeae280a: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 13:03:37.677640 11631 tablet_bootstrap.cc:492] T afdaf36d81c44e9db29f10e201b31e8c P 57da47b50bc847c997f07dccaeae280a: Bootstrap starting.
I20260709 13:03:37.679422 11630 tablet_bootstrap.cc:492] T bb4c61cb73ed4c488c741fd69f447642 P e3760873d2be4dc7b991027c1deef35d: No bootstrap required, opened a new log
I20260709 13:03:37.679541 11632 tablet_bootstrap.cc:492] T 14457af646fe430aa855e47d42721a17 P 7eb6f135338f4b84b60b7e67ab3d81d7: No bootstrap required, opened a new log
I20260709 13:03:37.680138 11630 ts_tablet_manager.cc:1403] T bb4c61cb73ed4c488c741fd69f447642 P e3760873d2be4dc7b991027c1deef35d: Time spent bootstrapping tablet: real 0.031s	user 0.020s	sys 0.006s
I20260709 13:03:37.680223 11632 ts_tablet_manager.cc:1403] T 14457af646fe430aa855e47d42721a17 P 7eb6f135338f4b84b60b7e67ab3d81d7: Time spent bootstrapping tablet: real 0.052s	user 0.018s	sys 0.022s
I20260709 13:03:37.683341 11630 raft_consensus.cc:359] T bb4c61cb73ed4c488c741fd69f447642 P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:37.683621 11632 raft_consensus.cc:359] T 14457af646fe430aa855e47d42721a17 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:37.684139 11630 raft_consensus.cc:385] T bb4c61cb73ed4c488c741fd69f447642 P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:37.684557 11632 raft_consensus.cc:385] T 14457af646fe430aa855e47d42721a17 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:37.684739 11631 tablet_bootstrap.cc:654] T afdaf36d81c44e9db29f10e201b31e8c P 57da47b50bc847c997f07dccaeae280a: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:37.685292 11632 raft_consensus.cc:740] T 14457af646fe430aa855e47d42721a17 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7eb6f135338f4b84b60b7e67ab3d81d7, State: Initialized, Role: FOLLOWER
W20260709 13:03:37.685418 11274 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:03:37.686239 11632 consensus_queue.cc:260] T 14457af646fe430aa855e47d42721a17 P 7eb6f135338f4b84b60b7e67ab3d81d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:37.684581 11630 raft_consensus.cc:740] T bb4c61cb73ed4c488c741fd69f447642 P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3760873d2be4dc7b991027c1deef35d, State: Initialized, Role: FOLLOWER
I20260709 13:03:37.688673 11632 ts_tablet_manager.cc:1434] T 14457af646fe430aa855e47d42721a17 P 7eb6f135338f4b84b60b7e67ab3d81d7: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.002s
I20260709 13:03:37.688481 11630 consensus_queue.cc:260] T bb4c61cb73ed4c488c741fd69f447642 P e3760873d2be4dc7b991027c1deef35d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:37.689658 11632 tablet_bootstrap.cc:492] T bb4c61cb73ed4c488c741fd69f447642 P 7eb6f135338f4b84b60b7e67ab3d81d7: Bootstrap starting.
I20260709 13:03:37.690868 11630 ts_tablet_manager.cc:1434] T bb4c61cb73ed4c488c741fd69f447642 P e3760873d2be4dc7b991027c1deef35d: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:03:37.692167 11630 tablet_bootstrap.cc:492] T 03c55f66aaf043bba6a0c8d64fbddf0e P e3760873d2be4dc7b991027c1deef35d: Bootstrap starting.
I20260709 13:03:37.697016 11632 tablet_bootstrap.cc:654] T bb4c61cb73ed4c488c741fd69f447642 P 7eb6f135338f4b84b60b7e67ab3d81d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:37.698318 11630 tablet_bootstrap.cc:654] T 03c55f66aaf043bba6a0c8d64fbddf0e P e3760873d2be4dc7b991027c1deef35d: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:37.701781 11631 tablet_bootstrap.cc:492] T afdaf36d81c44e9db29f10e201b31e8c P 57da47b50bc847c997f07dccaeae280a: No bootstrap required, opened a new log
I20260709 13:03:37.702245 11631 ts_tablet_manager.cc:1403] T afdaf36d81c44e9db29f10e201b31e8c P 57da47b50bc847c997f07dccaeae280a: Time spent bootstrapping tablet: real 0.025s	user 0.008s	sys 0.004s
I20260709 13:03:37.705085 11631 raft_consensus.cc:359] T afdaf36d81c44e9db29f10e201b31e8c P 57da47b50bc847c997f07dccaeae280a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:37.705780 11631 raft_consensus.cc:385] T afdaf36d81c44e9db29f10e201b31e8c P 57da47b50bc847c997f07dccaeae280a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:37.706045 11631 raft_consensus.cc:740] T afdaf36d81c44e9db29f10e201b31e8c P 57da47b50bc847c997f07dccaeae280a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57da47b50bc847c997f07dccaeae280a, State: Initialized, Role: FOLLOWER
I20260709 13:03:37.707010 11631 consensus_queue.cc:260] T afdaf36d81c44e9db29f10e201b31e8c P 57da47b50bc847c997f07dccaeae280a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:37.710461 11631 ts_tablet_manager.cc:1434] T afdaf36d81c44e9db29f10e201b31e8c P 57da47b50bc847c997f07dccaeae280a: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:03:37.711633 11631 tablet_bootstrap.cc:492] T 14457af646fe430aa855e47d42721a17 P 57da47b50bc847c997f07dccaeae280a: Bootstrap starting.
I20260709 13:03:37.718144 11631 tablet_bootstrap.cc:654] T 14457af646fe430aa855e47d42721a17 P 57da47b50bc847c997f07dccaeae280a: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:37.727635 11632 tablet_bootstrap.cc:492] T bb4c61cb73ed4c488c741fd69f447642 P 7eb6f135338f4b84b60b7e67ab3d81d7: No bootstrap required, opened a new log
I20260709 13:03:37.727803 11630 tablet_bootstrap.cc:492] T 03c55f66aaf043bba6a0c8d64fbddf0e P e3760873d2be4dc7b991027c1deef35d: No bootstrap required, opened a new log
I20260709 13:03:37.728148 11632 ts_tablet_manager.cc:1403] T bb4c61cb73ed4c488c741fd69f447642 P 7eb6f135338f4b84b60b7e67ab3d81d7: Time spent bootstrapping tablet: real 0.039s	user 0.020s	sys 0.012s
I20260709 13:03:37.728439 11630 ts_tablet_manager.cc:1403] T 03c55f66aaf043bba6a0c8d64fbddf0e P e3760873d2be4dc7b991027c1deef35d: Time spent bootstrapping tablet: real 0.036s	user 0.025s	sys 0.008s
I20260709 13:03:37.730965 11631 tablet_bootstrap.cc:492] T 14457af646fe430aa855e47d42721a17 P 57da47b50bc847c997f07dccaeae280a: No bootstrap required, opened a new log
I20260709 13:03:37.731571 11631 ts_tablet_manager.cc:1403] T 14457af646fe430aa855e47d42721a17 P 57da47b50bc847c997f07dccaeae280a: Time spent bootstrapping tablet: real 0.020s	user 0.006s	sys 0.011s
I20260709 13:03:37.731492 11632 raft_consensus.cc:359] T bb4c61cb73ed4c488c741fd69f447642 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:37.731683 11630 raft_consensus.cc:359] T 03c55f66aaf043bba6a0c8d64fbddf0e P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:37.732388 11632 raft_consensus.cc:385] T bb4c61cb73ed4c488c741fd69f447642 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:37.732623 11630 raft_consensus.cc:385] T 03c55f66aaf043bba6a0c8d64fbddf0e P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:37.732682 11632 raft_consensus.cc:740] T bb4c61cb73ed4c488c741fd69f447642 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7eb6f135338f4b84b60b7e67ab3d81d7, State: Initialized, Role: FOLLOWER
I20260709 13:03:37.733039 11630 raft_consensus.cc:740] T 03c55f66aaf043bba6a0c8d64fbddf0e P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3760873d2be4dc7b991027c1deef35d, State: Initialized, Role: FOLLOWER
I20260709 13:03:37.733515 11632 consensus_queue.cc:260] T bb4c61cb73ed4c488c741fd69f447642 P 7eb6f135338f4b84b60b7e67ab3d81d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:37.733850 11630 consensus_queue.cc:260] T 03c55f66aaf043bba6a0c8d64fbddf0e P e3760873d2be4dc7b991027c1deef35d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:37.734833 11631 raft_consensus.cc:359] T 14457af646fe430aa855e47d42721a17 P 57da47b50bc847c997f07dccaeae280a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:37.735546 11631 raft_consensus.cc:385] T 14457af646fe430aa855e47d42721a17 P 57da47b50bc847c997f07dccaeae280a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:37.735674 11632 ts_tablet_manager.cc:1434] T bb4c61cb73ed4c488c741fd69f447642 P 7eb6f135338f4b84b60b7e67ab3d81d7: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:03:37.735824 11631 raft_consensus.cc:740] T 14457af646fe430aa855e47d42721a17 P 57da47b50bc847c997f07dccaeae280a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57da47b50bc847c997f07dccaeae280a, State: Initialized, Role: FOLLOWER
I20260709 13:03:37.736835 11632 tablet_bootstrap.cc:492] T e812d0605d24436989fb6ec2c868d47c P 7eb6f135338f4b84b60b7e67ab3d81d7: Bootstrap starting.
I20260709 13:03:37.736678 11631 consensus_queue.cc:260] T 14457af646fe430aa855e47d42721a17 P 57da47b50bc847c997f07dccaeae280a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:37.739028 11631 ts_tablet_manager.cc:1434] T 14457af646fe430aa855e47d42721a17 P 57da47b50bc847c997f07dccaeae280a: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:03:37.739965 11631 tablet_bootstrap.cc:492] T a75eed46652c4944b6302c9569235569 P 57da47b50bc847c997f07dccaeae280a: Bootstrap starting.
I20260709 13:03:37.743589 11630 ts_tablet_manager.cc:1434] T 03c55f66aaf043bba6a0c8d64fbddf0e P e3760873d2be4dc7b991027c1deef35d: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:03:37.744175 11632 tablet_bootstrap.cc:654] T e812d0605d24436989fb6ec2c868d47c P 7eb6f135338f4b84b60b7e67ab3d81d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:37.746440 11631 tablet_bootstrap.cc:654] T a75eed46652c4944b6302c9569235569 P 57da47b50bc847c997f07dccaeae280a: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:37.747761 11630 tablet_bootstrap.cc:492] T a39eb6d3a8b641d88c8c8bfedce391ed P e3760873d2be4dc7b991027c1deef35d: Bootstrap starting.
I20260709 13:03:37.755841 11630 tablet_bootstrap.cc:654] T a39eb6d3a8b641d88c8c8bfedce391ed P e3760873d2be4dc7b991027c1deef35d: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:37.761793 11631 tablet_bootstrap.cc:492] T a75eed46652c4944b6302c9569235569 P 57da47b50bc847c997f07dccaeae280a: No bootstrap required, opened a new log
I20260709 13:03:37.762042 11630 tablet_bootstrap.cc:492] T a39eb6d3a8b641d88c8c8bfedce391ed P e3760873d2be4dc7b991027c1deef35d: No bootstrap required, opened a new log
I20260709 13:03:37.762327 11631 ts_tablet_manager.cc:1403] T a75eed46652c4944b6302c9569235569 P 57da47b50bc847c997f07dccaeae280a: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.011s
I20260709 13:03:37.762742 11630 ts_tablet_manager.cc:1403] T a39eb6d3a8b641d88c8c8bfedce391ed P e3760873d2be4dc7b991027c1deef35d: Time spent bootstrapping tablet: real 0.015s	user 0.013s	sys 0.000s
I20260709 13:03:37.764401 11632 tablet_bootstrap.cc:492] T e812d0605d24436989fb6ec2c868d47c P 7eb6f135338f4b84b60b7e67ab3d81d7: No bootstrap required, opened a new log
I20260709 13:03:37.764999 11632 ts_tablet_manager.cc:1403] T e812d0605d24436989fb6ec2c868d47c P 7eb6f135338f4b84b60b7e67ab3d81d7: Time spent bootstrapping tablet: real 0.028s	user 0.018s	sys 0.008s
I20260709 13:03:37.765596 11631 raft_consensus.cc:359] T a75eed46652c4944b6302c9569235569 P 57da47b50bc847c997f07dccaeae280a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:37.765820 11630 raft_consensus.cc:359] T a39eb6d3a8b641d88c8c8bfedce391ed P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:37.766422 11631 raft_consensus.cc:385] T a75eed46652c4944b6302c9569235569 P 57da47b50bc847c997f07dccaeae280a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:37.766556 11630 raft_consensus.cc:385] T a39eb6d3a8b641d88c8c8bfedce391ed P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:37.766844 11631 raft_consensus.cc:740] T a75eed46652c4944b6302c9569235569 P 57da47b50bc847c997f07dccaeae280a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57da47b50bc847c997f07dccaeae280a, State: Initialized, Role: FOLLOWER
I20260709 13:03:37.766937 11630 raft_consensus.cc:740] T a39eb6d3a8b641d88c8c8bfedce391ed P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3760873d2be4dc7b991027c1deef35d, State: Initialized, Role: FOLLOWER
I20260709 13:03:37.767751 11630 consensus_queue.cc:260] T a39eb6d3a8b641d88c8c8bfedce391ed P e3760873d2be4dc7b991027c1deef35d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:37.767758 11631 consensus_queue.cc:260] T a75eed46652c4944b6302c9569235569 P 57da47b50bc847c997f07dccaeae280a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:37.769183 11632 raft_consensus.cc:359] T e812d0605d24436989fb6ec2c868d47c P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:37.769817 11632 raft_consensus.cc:385] T e812d0605d24436989fb6ec2c868d47c P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:37.770035 11632 raft_consensus.cc:740] T e812d0605d24436989fb6ec2c868d47c P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7eb6f135338f4b84b60b7e67ab3d81d7, State: Initialized, Role: FOLLOWER
I20260709 13:03:37.770263 11630 ts_tablet_manager.cc:1434] T a39eb6d3a8b641d88c8c8bfedce391ed P e3760873d2be4dc7b991027c1deef35d: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:03:37.770706 11632 consensus_queue.cc:260] T e812d0605d24436989fb6ec2c868d47c P 7eb6f135338f4b84b60b7e67ab3d81d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:37.771301 11630 tablet_bootstrap.cc:492] T afdaf36d81c44e9db29f10e201b31e8c P e3760873d2be4dc7b991027c1deef35d: Bootstrap starting.
I20260709 13:03:37.777472 11631 ts_tablet_manager.cc:1434] T a75eed46652c4944b6302c9569235569 P 57da47b50bc847c997f07dccaeae280a: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:03:37.777973 11630 tablet_bootstrap.cc:654] T afdaf36d81c44e9db29f10e201b31e8c P e3760873d2be4dc7b991027c1deef35d: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:37.778847 11631 tablet_bootstrap.cc:492] T e812d0605d24436989fb6ec2c868d47c P 57da47b50bc847c997f07dccaeae280a: Bootstrap starting.
I20260709 13:03:37.779650 11632 ts_tablet_manager.cc:1434] T e812d0605d24436989fb6ec2c868d47c P 7eb6f135338f4b84b60b7e67ab3d81d7: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.002s
I20260709 13:03:37.780791 11632 tablet_bootstrap.cc:492] T a39eb6d3a8b641d88c8c8bfedce391ed P 7eb6f135338f4b84b60b7e67ab3d81d7: Bootstrap starting.
I20260709 13:03:37.786365 11631 tablet_bootstrap.cc:654] T e812d0605d24436989fb6ec2c868d47c P 57da47b50bc847c997f07dccaeae280a: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:37.787230 11632 tablet_bootstrap.cc:654] T a39eb6d3a8b641d88c8c8bfedce391ed P 7eb6f135338f4b84b60b7e67ab3d81d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:37.805186 11618 raft_consensus.cc:493] T a75eed46652c4944b6302c9569235569 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:37.805927 11618 raft_consensus.cc:515] T a75eed46652c4944b6302c9569235569 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:37.808437 11618 leader_election.cc:290] T a75eed46652c4944b6302c9569235569 P 7eb6f135338f4b84b60b7e67ab3d81d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3760873d2be4dc7b991027c1deef35d (127.0.107.193:35003), 57da47b50bc847c997f07dccaeae280a (127.0.107.195:37515)
I20260709 13:03:37.810883 11475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75eed46652c4944b6302c9569235569" candidate_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57da47b50bc847c997f07dccaeae280a" is_pre_election: true
I20260709 13:03:37.811616 11475 raft_consensus.cc:2468] T a75eed46652c4944b6302c9569235569 P 57da47b50bc847c997f07dccaeae280a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7eb6f135338f4b84b60b7e67ab3d81d7 in term 0.
I20260709 13:03:37.813110 11369 leader_election.cc:304] T a75eed46652c4944b6302c9569235569 P 7eb6f135338f4b84b60b7e67ab3d81d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57da47b50bc847c997f07dccaeae280a, 7eb6f135338f4b84b60b7e67ab3d81d7; no voters: 
I20260709 13:03:37.814781 11326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75eed46652c4944b6302c9569235569" candidate_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3760873d2be4dc7b991027c1deef35d" is_pre_election: true
I20260709 13:03:37.815697 11618 raft_consensus.cc:2804] T a75eed46652c4944b6302c9569235569 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:37.816151 11618 raft_consensus.cc:493] T a75eed46652c4944b6302c9569235569 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:37.816507 11618 raft_consensus.cc:3060] T a75eed46652c4944b6302c9569235569 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:37.835343 11629 raft_consensus.cc:493] T 14457af646fe430aa855e47d42721a17 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:37.836028 11629 raft_consensus.cc:515] T 14457af646fe430aa855e47d42721a17 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
W20260709 13:03:37.845216 11622 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.IsCreateTableDone -> {remote=127.0.107.254:33795, user_credentials={real_user=slave}} blocked reactor thread for 54184.8us
I20260709 13:03:37.847846 11630 tablet_bootstrap.cc:492] T afdaf36d81c44e9db29f10e201b31e8c P e3760873d2be4dc7b991027c1deef35d: No bootstrap required, opened a new log
I20260709 13:03:37.847620 11328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14457af646fe430aa855e47d42721a17" candidate_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3760873d2be4dc7b991027c1deef35d" is_pre_election: true
I20260709 13:03:37.848452 11630 ts_tablet_manager.cc:1403] T afdaf36d81c44e9db29f10e201b31e8c P e3760873d2be4dc7b991027c1deef35d: Time spent bootstrapping tablet: real 0.077s	user 0.008s	sys 0.012s
I20260709 13:03:37.848160 11618 raft_consensus.cc:515] T a75eed46652c4944b6302c9569235569 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
W20260709 13:03:37.849596 11369 leader_election.cc:343] T a75eed46652c4944b6302c9569235569 P 7eb6f135338f4b84b60b7e67ab3d81d7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3760873d2be4dc7b991027c1deef35d (127.0.107.193:35003): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:03:37.850652 11369 leader_election.cc:343] T 14457af646fe430aa855e47d42721a17 P 7eb6f135338f4b84b60b7e67ab3d81d7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3760873d2be4dc7b991027c1deef35d (127.0.107.193:35003): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:37.850998 11618 leader_election.cc:290] T a75eed46652c4944b6302c9569235569 P 7eb6f135338f4b84b60b7e67ab3d81d7 [CANDIDATE]: Term 1 election: Requested vote from peers e3760873d2be4dc7b991027c1deef35d (127.0.107.193:35003), 57da47b50bc847c997f07dccaeae280a (127.0.107.195:37515)
I20260709 13:03:37.851653 11630 raft_consensus.cc:359] T afdaf36d81c44e9db29f10e201b31e8c P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:37.852442 11630 raft_consensus.cc:385] T afdaf36d81c44e9db29f10e201b31e8c P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:37.852563 11475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75eed46652c4944b6302c9569235569" candidate_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57da47b50bc847c997f07dccaeae280a"
I20260709 13:03:37.853003 11630 raft_consensus.cc:740] T afdaf36d81c44e9db29f10e201b31e8c P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3760873d2be4dc7b991027c1deef35d, State: Initialized, Role: FOLLOWER
I20260709 13:03:37.853302 11616 raft_consensus.cc:493] T 03c55f66aaf043bba6a0c8d64fbddf0e P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:37.853775 11630 consensus_queue.cc:260] T afdaf36d81c44e9db29f10e201b31e8c P e3760873d2be4dc7b991027c1deef35d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:37.853813 11616 raft_consensus.cc:515] T 03c55f66aaf043bba6a0c8d64fbddf0e P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:37.856374 11616 leader_election.cc:290] T 03c55f66aaf043bba6a0c8d64fbddf0e P e3760873d2be4dc7b991027c1deef35d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7eb6f135338f4b84b60b7e67ab3d81d7 (127.0.107.194:42689), 57da47b50bc847c997f07dccaeae280a (127.0.107.195:37515)
I20260709 13:03:37.857112 11402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c55f66aaf043bba6a0c8d64fbddf0e" candidate_uuid: "e3760873d2be4dc7b991027c1deef35d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" is_pre_election: true
I20260709 13:03:37.858109 11477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c55f66aaf043bba6a0c8d64fbddf0e" candidate_uuid: "e3760873d2be4dc7b991027c1deef35d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57da47b50bc847c997f07dccaeae280a" is_pre_election: true
I20260709 13:03:37.858737 11477 raft_consensus.cc:2468] T 03c55f66aaf043bba6a0c8d64fbddf0e P 57da47b50bc847c997f07dccaeae280a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3760873d2be4dc7b991027c1deef35d in term 0.
I20260709 13:03:37.857113 11475 raft_consensus.cc:3060] T a75eed46652c4944b6302c9569235569 P 57da47b50bc847c997f07dccaeae280a [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:03:37.862094 11292 leader_election.cc:343] T 03c55f66aaf043bba6a0c8d64fbddf0e P e3760873d2be4dc7b991027c1deef35d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7eb6f135338f4b84b60b7e67ab3d81d7 (127.0.107.194:42689): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:37.853803 11328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75eed46652c4944b6302c9569235569" candidate_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3760873d2be4dc7b991027c1deef35d"
I20260709 13:03:37.866109 11631 tablet_bootstrap.cc:492] T e812d0605d24436989fb6ec2c868d47c P 57da47b50bc847c997f07dccaeae280a: No bootstrap required, opened a new log
I20260709 13:03:37.866819 11629 leader_election.cc:290] T 14457af646fe430aa855e47d42721a17 P 7eb6f135338f4b84b60b7e67ab3d81d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3760873d2be4dc7b991027c1deef35d (127.0.107.193:35003), 57da47b50bc847c997f07dccaeae280a (127.0.107.195:37515)
I20260709 13:03:37.867049 11631 ts_tablet_manager.cc:1403] T e812d0605d24436989fb6ec2c868d47c P 57da47b50bc847c997f07dccaeae280a: Time spent bootstrapping tablet: real 0.088s	user 0.018s	sys 0.026s
I20260709 13:03:37.868273 11650 raft_consensus.cc:493] T afdaf36d81c44e9db29f10e201b31e8c P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:37.866146 11369 leader_election.cc:343] T a75eed46652c4944b6302c9569235569 P 7eb6f135338f4b84b60b7e67ab3d81d7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e3760873d2be4dc7b991027c1deef35d (127.0.107.193:35003): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:37.868860 11650 raft_consensus.cc:515] T afdaf36d81c44e9db29f10e201b31e8c P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:37.869635 11632 tablet_bootstrap.cc:492] T a39eb6d3a8b641d88c8c8bfedce391ed P 7eb6f135338f4b84b60b7e67ab3d81d7: No bootstrap required, opened a new log
I20260709 13:03:37.870168 11632 ts_tablet_manager.cc:1403] T a39eb6d3a8b641d88c8c8bfedce391ed P 7eb6f135338f4b84b60b7e67ab3d81d7: Time spent bootstrapping tablet: real 0.090s	user 0.006s	sys 0.004s
I20260709 13:03:37.870682 11477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14457af646fe430aa855e47d42721a17" candidate_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57da47b50bc847c997f07dccaeae280a" is_pre_election: true
I20260709 13:03:37.871223 11650 leader_election.cc:290] T afdaf36d81c44e9db29f10e201b31e8c P e3760873d2be4dc7b991027c1deef35d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7eb6f135338f4b84b60b7e67ab3d81d7 (127.0.107.194:42689), 57da47b50bc847c997f07dccaeae280a (127.0.107.195:37515)
I20260709 13:03:37.871340 11477 raft_consensus.cc:2468] T 14457af646fe430aa855e47d42721a17 P 57da47b50bc847c997f07dccaeae280a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7eb6f135338f4b84b60b7e67ab3d81d7 in term 0.
I20260709 13:03:37.871971 11402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdaf36d81c44e9db29f10e201b31e8c" candidate_uuid: "e3760873d2be4dc7b991027c1deef35d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" is_pre_election: true
I20260709 13:03:37.872787 11294 leader_election.cc:304] T 03c55f66aaf043bba6a0c8d64fbddf0e P e3760873d2be4dc7b991027c1deef35d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 57da47b50bc847c997f07dccaeae280a, e3760873d2be4dc7b991027c1deef35d; no voters: 7eb6f135338f4b84b60b7e67ab3d81d7
W20260709 13:03:37.873358 11292 leader_election.cc:343] T afdaf36d81c44e9db29f10e201b31e8c P e3760873d2be4dc7b991027c1deef35d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7eb6f135338f4b84b60b7e67ab3d81d7 (127.0.107.194:42689): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:37.873488 11630 ts_tablet_manager.cc:1434] T afdaf36d81c44e9db29f10e201b31e8c P e3760873d2be4dc7b991027c1deef35d: Time spent starting tablet: real 0.025s	user 0.014s	sys 0.006s
I20260709 13:03:37.874679 11630 tablet_bootstrap.cc:492] T a75eed46652c4944b6302c9569235569 P e3760873d2be4dc7b991027c1deef35d: Bootstrap starting.
I20260709 13:03:37.874778 11477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdaf36d81c44e9db29f10e201b31e8c" candidate_uuid: "e3760873d2be4dc7b991027c1deef35d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57da47b50bc847c997f07dccaeae280a" is_pre_election: true
I20260709 13:03:37.874302 11632 raft_consensus.cc:359] T a39eb6d3a8b641d88c8c8bfedce391ed P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:37.875494 11632 raft_consensus.cc:385] T a39eb6d3a8b641d88c8c8bfedce391ed P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:37.875511 11477 raft_consensus.cc:2468] T afdaf36d81c44e9db29f10e201b31e8c P 57da47b50bc847c997f07dccaeae280a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3760873d2be4dc7b991027c1deef35d in term 0.
I20260709 13:03:37.875984 11632 raft_consensus.cc:740] T a39eb6d3a8b641d88c8c8bfedce391ed P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7eb6f135338f4b84b60b7e67ab3d81d7, State: Initialized, Role: FOLLOWER
I20260709 13:03:37.876807 11632 consensus_queue.cc:260] T a39eb6d3a8b641d88c8c8bfedce391ed P 7eb6f135338f4b84b60b7e67ab3d81d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:37.880123 11650 raft_consensus.cc:2804] T 03c55f66aaf043bba6a0c8d64fbddf0e P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:37.880565 11650 raft_consensus.cc:493] T 03c55f66aaf043bba6a0c8d64fbddf0e P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:37.881021 11650 raft_consensus.cc:3060] T 03c55f66aaf043bba6a0c8d64fbddf0e P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:37.882037 11632 ts_tablet_manager.cc:1434] T a39eb6d3a8b641d88c8c8bfedce391ed P 7eb6f135338f4b84b60b7e67ab3d81d7: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.003s
I20260709 13:03:37.882261 11630 tablet_bootstrap.cc:654] T a75eed46652c4944b6302c9569235569 P e3760873d2be4dc7b991027c1deef35d: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:37.883139 11632 tablet_bootstrap.cc:492] T 03c55f66aaf043bba6a0c8d64fbddf0e P 7eb6f135338f4b84b60b7e67ab3d81d7: Bootstrap starting.
I20260709 13:03:37.875190 11631 raft_consensus.cc:359] T e812d0605d24436989fb6ec2c868d47c P 57da47b50bc847c997f07dccaeae280a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:37.886199 11631 raft_consensus.cc:385] T e812d0605d24436989fb6ec2c868d47c P 57da47b50bc847c997f07dccaeae280a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:37.886521 11631 raft_consensus.cc:740] T e812d0605d24436989fb6ec2c868d47c P 57da47b50bc847c997f07dccaeae280a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57da47b50bc847c997f07dccaeae280a, State: Initialized, Role: FOLLOWER
I20260709 13:03:37.887353 11631 consensus_queue.cc:260] T e812d0605d24436989fb6ec2c868d47c P 57da47b50bc847c997f07dccaeae280a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:37.887873 11630 tablet_bootstrap.cc:492] T a75eed46652c4944b6302c9569235569 P e3760873d2be4dc7b991027c1deef35d: No bootstrap required, opened a new log
I20260709 13:03:37.890316 11630 ts_tablet_manager.cc:1403] T a75eed46652c4944b6302c9569235569 P e3760873d2be4dc7b991027c1deef35d: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.002s
I20260709 13:03:37.890448 11632 tablet_bootstrap.cc:654] T 03c55f66aaf043bba6a0c8d64fbddf0e P 7eb6f135338f4b84b60b7e67ab3d81d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:37.890944 11616 raft_consensus.cc:493] T a39eb6d3a8b641d88c8c8bfedce391ed P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:37.891474 11616 raft_consensus.cc:515] T a39eb6d3a8b641d88c8c8bfedce391ed P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:37.893410 11630 raft_consensus.cc:359] T a75eed46652c4944b6302c9569235569 P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:37.894280 11630 raft_consensus.cc:385] T a75eed46652c4944b6302c9569235569 P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:37.894403 11402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a39eb6d3a8b641d88c8c8bfedce391ed" candidate_uuid: "e3760873d2be4dc7b991027c1deef35d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" is_pre_election: true
I20260709 13:03:37.894625 11630 raft_consensus.cc:740] T a75eed46652c4944b6302c9569235569 P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3760873d2be4dc7b991027c1deef35d, State: Initialized, Role: FOLLOWER
I20260709 13:03:37.889765 11631 ts_tablet_manager.cc:1434] T e812d0605d24436989fb6ec2c868d47c P 57da47b50bc847c997f07dccaeae280a: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.000s
I20260709 13:03:37.895190 11402 raft_consensus.cc:2468] T a39eb6d3a8b641d88c8c8bfedce391ed P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3760873d2be4dc7b991027c1deef35d in term 0.
I20260709 13:03:37.895941 11631 tablet_bootstrap.cc:492] T bb4c61cb73ed4c488c741fd69f447642 P 57da47b50bc847c997f07dccaeae280a: Bootstrap starting.
I20260709 13:03:37.895612 11630 consensus_queue.cc:260] T a75eed46652c4944b6302c9569235569 P e3760873d2be4dc7b991027c1deef35d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:37.896481 11292 leader_election.cc:304] T a39eb6d3a8b641d88c8c8bfedce391ed P e3760873d2be4dc7b991027c1deef35d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7eb6f135338f4b84b60b7e67ab3d81d7, e3760873d2be4dc7b991027c1deef35d; no voters: 
I20260709 13:03:37.874908 11369 leader_election.cc:304] T 14457af646fe430aa855e47d42721a17 P 7eb6f135338f4b84b60b7e67ab3d81d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 57da47b50bc847c997f07dccaeae280a, 7eb6f135338f4b84b60b7e67ab3d81d7; no voters: e3760873d2be4dc7b991027c1deef35d
I20260709 13:03:37.901010 11616 leader_election.cc:290] T a39eb6d3a8b641d88c8c8bfedce391ed P e3760873d2be4dc7b991027c1deef35d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7eb6f135338f4b84b60b7e67ab3d81d7 (127.0.107.194:42689), 57da47b50bc847c997f07dccaeae280a (127.0.107.195:37515)
I20260709 13:03:37.901746 11616 raft_consensus.cc:2804] T a39eb6d3a8b641d88c8c8bfedce391ed P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:37.902114 11616 raft_consensus.cc:493] T a39eb6d3a8b641d88c8c8bfedce391ed P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:37.902451 11616 raft_consensus.cc:3060] T a39eb6d3a8b641d88c8c8bfedce391ed P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:37.903559 11631 tablet_bootstrap.cc:654] T bb4c61cb73ed4c488c741fd69f447642 P 57da47b50bc847c997f07dccaeae280a: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:37.907092 11629 raft_consensus.cc:2804] T 14457af646fe430aa855e47d42721a17 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:37.907594 11629 raft_consensus.cc:493] T 14457af646fe430aa855e47d42721a17 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:37.907948 11629 raft_consensus.cc:3060] T 14457af646fe430aa855e47d42721a17 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:37.909740 11630 ts_tablet_manager.cc:1434] T a75eed46652c4944b6302c9569235569 P e3760873d2be4dc7b991027c1deef35d: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.001s
I20260709 13:03:37.911228 11630 tablet_bootstrap.cc:492] T 3ff2fc0ffa2f4ac08a92984cfd462344 P e3760873d2be4dc7b991027c1deef35d: Bootstrap starting.
I20260709 13:03:37.915962 11631 tablet_bootstrap.cc:492] T bb4c61cb73ed4c488c741fd69f447642 P 57da47b50bc847c997f07dccaeae280a: No bootstrap required, opened a new log
I20260709 13:03:37.916667 11631 ts_tablet_manager.cc:1403] T bb4c61cb73ed4c488c741fd69f447642 P 57da47b50bc847c997f07dccaeae280a: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.004s
I20260709 13:03:37.918854 11630 tablet_bootstrap.cc:654] T 3ff2fc0ffa2f4ac08a92984cfd462344 P e3760873d2be4dc7b991027c1deef35d: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:37.919878 11631 raft_consensus.cc:359] T bb4c61cb73ed4c488c741fd69f447642 P 57da47b50bc847c997f07dccaeae280a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:37.920753 11631 raft_consensus.cc:385] T bb4c61cb73ed4c488c741fd69f447642 P 57da47b50bc847c997f07dccaeae280a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:37.920786 11653 raft_consensus.cc:493] T e812d0605d24436989fb6ec2c868d47c P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:37.921250 11631 raft_consensus.cc:740] T bb4c61cb73ed4c488c741fd69f447642 P 57da47b50bc847c997f07dccaeae280a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57da47b50bc847c997f07dccaeae280a, State: Initialized, Role: FOLLOWER
I20260709 13:03:37.921411 11653 raft_consensus.cc:515] T e812d0605d24436989fb6ec2c868d47c P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:37.922246 11631 consensus_queue.cc:260] T bb4c61cb73ed4c488c741fd69f447642 P 57da47b50bc847c997f07dccaeae280a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:37.924340 11402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e812d0605d24436989fb6ec2c868d47c" candidate_uuid: "e3760873d2be4dc7b991027c1deef35d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" is_pre_election: true
I20260709 13:03:37.924996 11402 raft_consensus.cc:2468] T e812d0605d24436989fb6ec2c868d47c P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3760873d2be4dc7b991027c1deef35d in term 0.
I20260709 13:03:37.925150 11631 ts_tablet_manager.cc:1434] T bb4c61cb73ed4c488c741fd69f447642 P 57da47b50bc847c997f07dccaeae280a: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 13:03:37.926507 11631 tablet_bootstrap.cc:492] T 3ff2fc0ffa2f4ac08a92984cfd462344 P 57da47b50bc847c997f07dccaeae280a: Bootstrap starting.
I20260709 13:03:37.926433 11292 leader_election.cc:304] T e812d0605d24436989fb6ec2c868d47c P e3760873d2be4dc7b991027c1deef35d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7eb6f135338f4b84b60b7e67ab3d81d7, e3760873d2be4dc7b991027c1deef35d; no voters: 
I20260709 13:03:37.927336 11654 raft_consensus.cc:2804] T e812d0605d24436989fb6ec2c868d47c P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:37.927830 11654 raft_consensus.cc:493] T e812d0605d24436989fb6ec2c868d47c P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:37.927592 11629 raft_consensus.cc:515] T 14457af646fe430aa855e47d42721a17 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:37.928187 11654 raft_consensus.cc:3060] T e812d0605d24436989fb6ec2c868d47c P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:37.932029 11653 leader_election.cc:290] T e812d0605d24436989fb6ec2c868d47c P e3760873d2be4dc7b991027c1deef35d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7eb6f135338f4b84b60b7e67ab3d81d7 (127.0.107.194:42689), 57da47b50bc847c997f07dccaeae280a (127.0.107.195:37515)
I20260709 13:03:37.934849 11631 tablet_bootstrap.cc:654] T 3ff2fc0ffa2f4ac08a92984cfd462344 P 57da47b50bc847c997f07dccaeae280a: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:37.935952 11629 leader_election.cc:290] T 14457af646fe430aa855e47d42721a17 P 7eb6f135338f4b84b60b7e67ab3d81d7 [CANDIDATE]: Term 1 election: Requested vote from peers e3760873d2be4dc7b991027c1deef35d (127.0.107.193:35003), 57da47b50bc847c997f07dccaeae280a (127.0.107.195:37515)
I20260709 13:03:37.943032 11294 leader_election.cc:304] T afdaf36d81c44e9db29f10e201b31e8c P e3760873d2be4dc7b991027c1deef35d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 57da47b50bc847c997f07dccaeae280a, e3760873d2be4dc7b991027c1deef35d; no voters: 7eb6f135338f4b84b60b7e67ab3d81d7
I20260709 13:03:37.943570 11477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14457af646fe430aa855e47d42721a17" candidate_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57da47b50bc847c997f07dccaeae280a"
I20260709 13:03:37.944222 11477 raft_consensus.cc:3060] T 14457af646fe430aa855e47d42721a17 P 57da47b50bc847c997f07dccaeae280a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:37.945437 11476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a39eb6d3a8b641d88c8c8bfedce391ed" candidate_uuid: "e3760873d2be4dc7b991027c1deef35d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57da47b50bc847c997f07dccaeae280a" is_pre_election: true
I20260709 13:03:37.946110 11476 raft_consensus.cc:2468] T a39eb6d3a8b641d88c8c8bfedce391ed P 57da47b50bc847c997f07dccaeae280a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3760873d2be4dc7b991027c1deef35d in term 0.
I20260709 13:03:37.946643 11653 raft_consensus.cc:2804] T afdaf36d81c44e9db29f10e201b31e8c P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:37.947314 11653 raft_consensus.cc:493] T afdaf36d81c44e9db29f10e201b31e8c P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:37.948414 11476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e812d0605d24436989fb6ec2c868d47c" candidate_uuid: "e3760873d2be4dc7b991027c1deef35d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57da47b50bc847c997f07dccaeae280a" is_pre_election: true
I20260709 13:03:37.949750 11653 raft_consensus.cc:3060] T afdaf36d81c44e9db29f10e201b31e8c P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:37.949851 11476 raft_consensus.cc:2468] T e812d0605d24436989fb6ec2c868d47c P 57da47b50bc847c997f07dccaeae280a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3760873d2be4dc7b991027c1deef35d in term 0.
I20260709 13:03:37.951073 11477 raft_consensus.cc:2468] T 14457af646fe430aa855e47d42721a17 P 57da47b50bc847c997f07dccaeae280a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7eb6f135338f4b84b60b7e67ab3d81d7 in term 1.
I20260709 13:03:37.952764 11369 leader_election.cc:304] T 14457af646fe430aa855e47d42721a17 P 7eb6f135338f4b84b60b7e67ab3d81d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57da47b50bc847c997f07dccaeae280a, 7eb6f135338f4b84b60b7e67ab3d81d7; no voters: 
I20260709 13:03:37.953852 11618 raft_consensus.cc:2804] T 14457af646fe430aa855e47d42721a17 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:37.954336 11618 raft_consensus.cc:697] T 14457af646fe430aa855e47d42721a17 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 LEADER]: Becoming Leader. State: Replica: 7eb6f135338f4b84b60b7e67ab3d81d7, State: Running, Role: LEADER
I20260709 13:03:37.954181 11654 raft_consensus.cc:515] T e812d0605d24436989fb6ec2c868d47c P e3760873d2be4dc7b991027c1deef35d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:37.955267 11618 consensus_queue.cc:237] T 14457af646fe430aa855e47d42721a17 P 7eb6f135338f4b84b60b7e67ab3d81d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:37.957577 11631 tablet_bootstrap.cc:492] T 3ff2fc0ffa2f4ac08a92984cfd462344 P 57da47b50bc847c997f07dccaeae280a: No bootstrap required, opened a new log
I20260709 13:03:37.959451 11631 ts_tablet_manager.cc:1403] T 3ff2fc0ffa2f4ac08a92984cfd462344 P 57da47b50bc847c997f07dccaeae280a: Time spent bootstrapping tablet: real 0.033s	user 0.000s	sys 0.019s
I20260709 13:03:37.962271 11631 raft_consensus.cc:359] T 3ff2fc0ffa2f4ac08a92984cfd462344 P 57da47b50bc847c997f07dccaeae280a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:37.962957 11631 raft_consensus.cc:385] T 3ff2fc0ffa2f4ac08a92984cfd462344 P 57da47b50bc847c997f07dccaeae280a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:37.963218 11631 raft_consensus.cc:740] T 3ff2fc0ffa2f4ac08a92984cfd462344 P 57da47b50bc847c997f07dccaeae280a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57da47b50bc847c997f07dccaeae280a, State: Initialized, Role: FOLLOWER
I20260709 13:03:37.964048 11631 consensus_queue.cc:260] T 3ff2fc0ffa2f4ac08a92984cfd462344 P 57da47b50bc847c997f07dccaeae280a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:37.966077 11631 ts_tablet_manager.cc:1434] T 3ff2fc0ffa2f4ac08a92984cfd462344 P 57da47b50bc847c997f07dccaeae280a: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.001s
I20260709 13:03:37.967353 11631 tablet_bootstrap.cc:492] T d1ada73b7855443da29b368f50229412 P 57da47b50bc847c997f07dccaeae280a: Bootstrap starting.
I20260709 13:03:37.968312 11650 raft_consensus.cc:515] T 03c55f66aaf043bba6a0c8d64fbddf0e P e3760873d2be4dc7b991027c1deef35d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:37.971200 11402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c55f66aaf043bba6a0c8d64fbddf0e" candidate_uuid: "e3760873d2be4dc7b991027c1deef35d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7"
I20260709 13:03:37.958253 11653 raft_consensus.cc:515] T afdaf36d81c44e9db29f10e201b31e8c P e3760873d2be4dc7b991027c1deef35d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:37.971311 11654 leader_election.cc:290] T e812d0605d24436989fb6ec2c868d47c P e3760873d2be4dc7b991027c1deef35d [CANDIDATE]: Term 1 election: Requested vote from peers 7eb6f135338f4b84b60b7e67ab3d81d7 (127.0.107.194:42689), 57da47b50bc847c997f07dccaeae280a (127.0.107.195:37515)
I20260709 13:03:37.974467 11402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e812d0605d24436989fb6ec2c868d47c" candidate_uuid: "e3760873d2be4dc7b991027c1deef35d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7"
I20260709 13:03:37.975066 11402 raft_consensus.cc:3060] T e812d0605d24436989fb6ec2c868d47c P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:37.976609 11475 raft_consensus.cc:2468] T a75eed46652c4944b6302c9569235569 P 57da47b50bc847c997f07dccaeae280a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7eb6f135338f4b84b60b7e67ab3d81d7 in term 1.
I20260709 13:03:37.977463 11631 tablet_bootstrap.cc:654] T d1ada73b7855443da29b368f50229412 P 57da47b50bc847c997f07dccaeae280a: Neither blocks nor log segments found. Creating new log.
W20260709 13:03:37.978967 11292 leader_election.cc:343] T 03c55f66aaf043bba6a0c8d64fbddf0e P e3760873d2be4dc7b991027c1deef35d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7eb6f135338f4b84b60b7e67ab3d81d7 (127.0.107.194:42689): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:37.979827 11326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14457af646fe430aa855e47d42721a17" candidate_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3760873d2be4dc7b991027c1deef35d"
I20260709 13:03:37.980549 11616 raft_consensus.cc:515] T a39eb6d3a8b641d88c8c8bfedce391ed P e3760873d2be4dc7b991027c1deef35d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:37.982717 11616 leader_election.cc:290] T a39eb6d3a8b641d88c8c8bfedce391ed P e3760873d2be4dc7b991027c1deef35d [CANDIDATE]: Term 1 election: Requested vote from peers 7eb6f135338f4b84b60b7e67ab3d81d7 (127.0.107.194:42689), 57da47b50bc847c997f07dccaeae280a (127.0.107.195:37515)
I20260709 13:03:37.983943 11477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a39eb6d3a8b641d88c8c8bfedce391ed" candidate_uuid: "e3760873d2be4dc7b991027c1deef35d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57da47b50bc847c997f07dccaeae280a"
I20260709 13:03:37.984151 11403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a39eb6d3a8b641d88c8c8bfedce391ed" candidate_uuid: "e3760873d2be4dc7b991027c1deef35d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7"
I20260709 13:03:37.984470 11653 leader_election.cc:290] T afdaf36d81c44e9db29f10e201b31e8c P e3760873d2be4dc7b991027c1deef35d [CANDIDATE]: Term 1 election: Requested vote from peers 7eb6f135338f4b84b60b7e67ab3d81d7 (127.0.107.194:42689), 57da47b50bc847c997f07dccaeae280a (127.0.107.195:37515)
I20260709 13:03:37.984558 11477 raft_consensus.cc:3060] T a39eb6d3a8b641d88c8c8bfedce391ed P 57da47b50bc847c997f07dccaeae280a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:37.984920 11403 raft_consensus.cc:3060] T a39eb6d3a8b641d88c8c8bfedce391ed P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:37.985610 11629 raft_consensus.cc:493] T bb4c61cb73ed4c488c741fd69f447642 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:37.986095 11629 raft_consensus.cc:515] T bb4c61cb73ed4c488c741fd69f447642 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:37.986871 11401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdaf36d81c44e9db29f10e201b31e8c" candidate_uuid: "e3760873d2be4dc7b991027c1deef35d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7"
I20260709 13:03:37.988106 11629 leader_election.cc:290] T bb4c61cb73ed4c488c741fd69f447642 P 7eb6f135338f4b84b60b7e67ab3d81d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3760873d2be4dc7b991027c1deef35d (127.0.107.193:35003), 57da47b50bc847c997f07dccaeae280a (127.0.107.195:37515)
W20260709 13:03:37.988369 11292 leader_election.cc:343] T afdaf36d81c44e9db29f10e201b31e8c P e3760873d2be4dc7b991027c1deef35d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7eb6f135338f4b84b60b7e67ab3d81d7 (127.0.107.194:42689): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:37.988749 11475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e812d0605d24436989fb6ec2c868d47c" candidate_uuid: "e3760873d2be4dc7b991027c1deef35d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57da47b50bc847c997f07dccaeae280a"
I20260709 13:03:37.985661 11630 tablet_bootstrap.cc:492] T 3ff2fc0ffa2f4ac08a92984cfd462344 P e3760873d2be4dc7b991027c1deef35d: No bootstrap required, opened a new log
I20260709 13:03:37.990334 11475 raft_consensus.cc:3060] T e812d0605d24436989fb6ec2c868d47c P 57da47b50bc847c997f07dccaeae280a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:37.990792 11476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb4c61cb73ed4c488c741fd69f447642" candidate_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57da47b50bc847c997f07dccaeae280a" is_pre_election: true
I20260709 13:03:37.991446 11476 raft_consensus.cc:2468] T bb4c61cb73ed4c488c741fd69f447642 P 57da47b50bc847c997f07dccaeae280a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7eb6f135338f4b84b60b7e67ab3d81d7 in term 0.
I20260709 13:03:37.993168 11476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdaf36d81c44e9db29f10e201b31e8c" candidate_uuid: "e3760873d2be4dc7b991027c1deef35d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57da47b50bc847c997f07dccaeae280a"
I20260709 13:03:37.993697 11476 raft_consensus.cc:3060] T afdaf36d81c44e9db29f10e201b31e8c P 57da47b50bc847c997f07dccaeae280a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:37.989971 11369 leader_election.cc:304] T a75eed46652c4944b6302c9569235569 P 7eb6f135338f4b84b60b7e67ab3d81d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 57da47b50bc847c997f07dccaeae280a, 7eb6f135338f4b84b60b7e67ab3d81d7; no voters: e3760873d2be4dc7b991027c1deef35d
I20260709 13:03:37.996918 11326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb4c61cb73ed4c488c741fd69f447642" candidate_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3760873d2be4dc7b991027c1deef35d" is_pre_election: true
I20260709 13:03:37.989995 11402 raft_consensus.cc:2468] T e812d0605d24436989fb6ec2c868d47c P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3760873d2be4dc7b991027c1deef35d in term 1.
I20260709 13:03:37.990815 11630 ts_tablet_manager.cc:1403] T 3ff2fc0ffa2f4ac08a92984cfd462344 P e3760873d2be4dc7b991027c1deef35d: Time spent bootstrapping tablet: real 0.080s	user 0.009s	sys 0.004s
I20260709 13:03:37.999452 11292 leader_election.cc:304] T e812d0605d24436989fb6ec2c868d47c P e3760873d2be4dc7b991027c1deef35d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7eb6f135338f4b84b60b7e67ab3d81d7, e3760873d2be4dc7b991027c1deef35d; no voters: 
I20260709 13:03:38.000183 11649 raft_consensus.cc:2804] T a75eed46652c4944b6302c9569235569 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:37.997644 11326 raft_consensus.cc:2468] T bb4c61cb73ed4c488c741fd69f447642 P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7eb6f135338f4b84b60b7e67ab3d81d7 in term 0.
I20260709 13:03:38.001104 11649 raft_consensus.cc:697] T a75eed46652c4944b6302c9569235569 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 LEADER]: Becoming Leader. State: Replica: 7eb6f135338f4b84b60b7e67ab3d81d7, State: Running, Role: LEADER
I20260709 13:03:37.997665 11475 raft_consensus.cc:2468] T e812d0605d24436989fb6ec2c868d47c P 57da47b50bc847c997f07dccaeae280a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3760873d2be4dc7b991027c1deef35d in term 1.
I20260709 13:03:38.002018 11649 consensus_queue.cc:237] T a75eed46652c4944b6302c9569235569 P 7eb6f135338f4b84b60b7e67ab3d81d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:38.003473 11653 raft_consensus.cc:2804] T e812d0605d24436989fb6ec2c868d47c P e3760873d2be4dc7b991027c1deef35d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:38.004029 11653 raft_consensus.cc:697] T e812d0605d24436989fb6ec2c868d47c P e3760873d2be4dc7b991027c1deef35d [term 1 LEADER]: Becoming Leader. State: Replica: e3760873d2be4dc7b991027c1deef35d, State: Running, Role: LEADER
I20260709 13:03:38.008049 11477 raft_consensus.cc:2468] T a39eb6d3a8b641d88c8c8bfedce391ed P 57da47b50bc847c997f07dccaeae280a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3760873d2be4dc7b991027c1deef35d in term 1.
I20260709 13:03:38.004554 11630 raft_consensus.cc:359] T 3ff2fc0ffa2f4ac08a92984cfd462344 P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:38.009013 11630 raft_consensus.cc:385] T 3ff2fc0ffa2f4ac08a92984cfd462344 P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:38.004854 11653 consensus_queue.cc:237] T e812d0605d24436989fb6ec2c868d47c P e3760873d2be4dc7b991027c1deef35d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:38.009439 11630 raft_consensus.cc:740] T 3ff2fc0ffa2f4ac08a92984cfd462344 P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3760873d2be4dc7b991027c1deef35d, State: Initialized, Role: FOLLOWER
I20260709 13:03:38.011158 11476 raft_consensus.cc:2468] T afdaf36d81c44e9db29f10e201b31e8c P 57da47b50bc847c997f07dccaeae280a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3760873d2be4dc7b991027c1deef35d in term 1.
I20260709 13:03:38.010282 11630 consensus_queue.cc:260] T 3ff2fc0ffa2f4ac08a92984cfd462344 P e3760873d2be4dc7b991027c1deef35d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
W20260709 13:03:38.000355 11369 leader_election.cc:343] T 14457af646fe430aa855e47d42721a17 P 7eb6f135338f4b84b60b7e67ab3d81d7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e3760873d2be4dc7b991027c1deef35d (127.0.107.193:35003): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:38.011593 11403 raft_consensus.cc:2468] T a39eb6d3a8b641d88c8c8bfedce391ed P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3760873d2be4dc7b991027c1deef35d in term 1.
I20260709 13:03:38.016085 11294 leader_election.cc:304] T a39eb6d3a8b641d88c8c8bfedce391ed P e3760873d2be4dc7b991027c1deef35d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57da47b50bc847c997f07dccaeae280a, e3760873d2be4dc7b991027c1deef35d; no voters: 
I20260709 13:03:38.017362 11632 tablet_bootstrap.cc:492] T 03c55f66aaf043bba6a0c8d64fbddf0e P 7eb6f135338f4b84b60b7e67ab3d81d7: No bootstrap required, opened a new log
I20260709 13:03:38.017846 11654 raft_consensus.cc:2804] T a39eb6d3a8b641d88c8c8bfedce391ed P e3760873d2be4dc7b991027c1deef35d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:38.017951 11632 ts_tablet_manager.cc:1403] T 03c55f66aaf043bba6a0c8d64fbddf0e P 7eb6f135338f4b84b60b7e67ab3d81d7: Time spent bootstrapping tablet: real 0.135s	user 0.033s	sys 0.043s
I20260709 13:03:38.018297 11654 raft_consensus.cc:697] T a39eb6d3a8b641d88c8c8bfedce391ed P e3760873d2be4dc7b991027c1deef35d [term 1 LEADER]: Becoming Leader. State: Replica: e3760873d2be4dc7b991027c1deef35d, State: Running, Role: LEADER
I20260709 13:03:38.019168 11654 consensus_queue.cc:237] T a39eb6d3a8b641d88c8c8bfedce391ed P e3760873d2be4dc7b991027c1deef35d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:38.019038 11369 leader_election.cc:304] T bb4c61cb73ed4c488c741fd69f447642 P 7eb6f135338f4b84b60b7e67ab3d81d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57da47b50bc847c997f07dccaeae280a, 7eb6f135338f4b84b60b7e67ab3d81d7; no voters: 
I20260709 13:03:38.021044 11632 raft_consensus.cc:359] T 03c55f66aaf043bba6a0c8d64fbddf0e P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:38.013690 11650 leader_election.cc:290] T 03c55f66aaf043bba6a0c8d64fbddf0e P e3760873d2be4dc7b991027c1deef35d [CANDIDATE]: Term 1 election: Requested vote from peers 7eb6f135338f4b84b60b7e67ab3d81d7 (127.0.107.194:42689), 57da47b50bc847c997f07dccaeae280a (127.0.107.195:37515)
I20260709 13:03:38.022269 11649 raft_consensus.cc:2804] T bb4c61cb73ed4c488c741fd69f447642 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:38.025729 11649 raft_consensus.cc:493] T bb4c61cb73ed4c488c741fd69f447642 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:38.026782 11649 raft_consensus.cc:3060] T bb4c61cb73ed4c488c741fd69f447642 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:38.024125 11632 raft_consensus.cc:385] T 03c55f66aaf043bba6a0c8d64fbddf0e P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:38.027616 11632 raft_consensus.cc:740] T 03c55f66aaf043bba6a0c8d64fbddf0e P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7eb6f135338f4b84b60b7e67ab3d81d7, State: Initialized, Role: FOLLOWER
I20260709 13:03:38.028401 11632 consensus_queue.cc:260] T 03c55f66aaf043bba6a0c8d64fbddf0e P 7eb6f135338f4b84b60b7e67ab3d81d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:38.031061 11632 ts_tablet_manager.cc:1434] T 03c55f66aaf043bba6a0c8d64fbddf0e P 7eb6f135338f4b84b60b7e67ab3d81d7: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.002s
I20260709 13:03:38.032452 11294 leader_election.cc:304] T afdaf36d81c44e9db29f10e201b31e8c P e3760873d2be4dc7b991027c1deef35d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 57da47b50bc847c997f07dccaeae280a, e3760873d2be4dc7b991027c1deef35d; no voters: 7eb6f135338f4b84b60b7e67ab3d81d7
I20260709 13:03:38.033696 11225 catalog_manager.cc:5697] T 14457af646fe430aa855e47d42721a17 P 7eb6f135338f4b84b60b7e67ab3d81d7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7eb6f135338f4b84b60b7e67ab3d81d7 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:38.037104 11225 catalog_manager.cc:5697] T a75eed46652c4944b6302c9569235569 P 7eb6f135338f4b84b60b7e67ab3d81d7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7eb6f135338f4b84b60b7e67ab3d81d7 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:38.039734 11476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c55f66aaf043bba6a0c8d64fbddf0e" candidate_uuid: "e3760873d2be4dc7b991027c1deef35d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57da47b50bc847c997f07dccaeae280a"
I20260709 13:03:38.040423 11630 ts_tablet_manager.cc:1434] T 3ff2fc0ffa2f4ac08a92984cfd462344 P e3760873d2be4dc7b991027c1deef35d: Time spent starting tablet: real 0.041s	user 0.004s	sys 0.004s
I20260709 13:03:38.041730 11630 tablet_bootstrap.cc:492] T 14457af646fe430aa855e47d42721a17 P e3760873d2be4dc7b991027c1deef35d: Bootstrap starting.
I20260709 13:03:38.043052 11226 catalog_manager.cc:5697] T e812d0605d24436989fb6ec2c868d47c P e3760873d2be4dc7b991027c1deef35d reported cstate change: term changed from 0 to 1, leader changed from <none> to e3760873d2be4dc7b991027c1deef35d (127.0.107.193). New cstate: current_term: 1 leader_uuid: "e3760873d2be4dc7b991027c1deef35d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:38.043882 11649 raft_consensus.cc:515] T bb4c61cb73ed4c488c741fd69f447642 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:38.044728 11632 tablet_bootstrap.cc:492] T afdaf36d81c44e9db29f10e201b31e8c P 7eb6f135338f4b84b60b7e67ab3d81d7: Bootstrap starting.
I20260709 13:03:38.040418 11476 raft_consensus.cc:3060] T 03c55f66aaf043bba6a0c8d64fbddf0e P 57da47b50bc847c997f07dccaeae280a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:38.049036 11649 leader_election.cc:290] T bb4c61cb73ed4c488c741fd69f447642 P 7eb6f135338f4b84b60b7e67ab3d81d7 [CANDIDATE]: Term 1 election: Requested vote from peers e3760873d2be4dc7b991027c1deef35d (127.0.107.193:35003), 57da47b50bc847c997f07dccaeae280a (127.0.107.195:37515)
I20260709 13:03:38.055821 11630 tablet_bootstrap.cc:654] T 14457af646fe430aa855e47d42721a17 P e3760873d2be4dc7b991027c1deef35d: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:38.056627 11474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb4c61cb73ed4c488c741fd69f447642" candidate_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57da47b50bc847c997f07dccaeae280a"
I20260709 13:03:38.057655 11474 raft_consensus.cc:3060] T bb4c61cb73ed4c488c741fd69f447642 P 57da47b50bc847c997f07dccaeae280a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:38.058770 11326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb4c61cb73ed4c488c741fd69f447642" candidate_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3760873d2be4dc7b991027c1deef35d"
I20260709 13:03:38.050738 11653 raft_consensus.cc:2804] T afdaf36d81c44e9db29f10e201b31e8c P e3760873d2be4dc7b991027c1deef35d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:38.060056 11326 raft_consensus.cc:3060] T bb4c61cb73ed4c488c741fd69f447642 P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:38.062862 11631 tablet_bootstrap.cc:492] T d1ada73b7855443da29b368f50229412 P 57da47b50bc847c997f07dccaeae280a: No bootstrap required, opened a new log
I20260709 13:03:38.060201 11653 raft_consensus.cc:697] T afdaf36d81c44e9db29f10e201b31e8c P e3760873d2be4dc7b991027c1deef35d [term 1 LEADER]: Becoming Leader. State: Replica: e3760873d2be4dc7b991027c1deef35d, State: Running, Role: LEADER
I20260709 13:03:38.064402 11631 ts_tablet_manager.cc:1403] T d1ada73b7855443da29b368f50229412 P 57da47b50bc847c997f07dccaeae280a: Time spent bootstrapping tablet: real 0.097s	user 0.005s	sys 0.021s
I20260709 13:03:38.064895 11653 consensus_queue.cc:237] T afdaf36d81c44e9db29f10e201b31e8c P e3760873d2be4dc7b991027c1deef35d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:38.065725 11474 raft_consensus.cc:2468] T bb4c61cb73ed4c488c741fd69f447642 P 57da47b50bc847c997f07dccaeae280a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7eb6f135338f4b84b60b7e67ab3d81d7 in term 1.
I20260709 13:03:38.067672 11631 raft_consensus.cc:359] T d1ada73b7855443da29b368f50229412 P 57da47b50bc847c997f07dccaeae280a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:38.062914 11632 tablet_bootstrap.cc:654] T afdaf36d81c44e9db29f10e201b31e8c P 7eb6f135338f4b84b60b7e67ab3d81d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:38.056655 11476 raft_consensus.cc:2468] T 03c55f66aaf043bba6a0c8d64fbddf0e P 57da47b50bc847c997f07dccaeae280a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3760873d2be4dc7b991027c1deef35d in term 1.
I20260709 13:03:38.068466 11631 raft_consensus.cc:385] T d1ada73b7855443da29b368f50229412 P 57da47b50bc847c997f07dccaeae280a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:38.070009 11631 raft_consensus.cc:740] T d1ada73b7855443da29b368f50229412 P 57da47b50bc847c997f07dccaeae280a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57da47b50bc847c997f07dccaeae280a, State: Initialized, Role: FOLLOWER
I20260709 13:03:38.070891 11631 consensus_queue.cc:260] T d1ada73b7855443da29b368f50229412 P 57da47b50bc847c997f07dccaeae280a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:38.069432 11369 leader_election.cc:304] T bb4c61cb73ed4c488c741fd69f447642 P 7eb6f135338f4b84b60b7e67ab3d81d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57da47b50bc847c997f07dccaeae280a, 7eb6f135338f4b84b60b7e67ab3d81d7; no voters: 
I20260709 13:03:38.072786 11629 raft_consensus.cc:2804] T bb4c61cb73ed4c488c741fd69f447642 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:38.073448 11629 raft_consensus.cc:697] T bb4c61cb73ed4c488c741fd69f447642 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 LEADER]: Becoming Leader. State: Replica: 7eb6f135338f4b84b60b7e67ab3d81d7, State: Running, Role: LEADER
I20260709 13:03:38.074229 11629 consensus_queue.cc:237] T bb4c61cb73ed4c488c741fd69f447642 P 7eb6f135338f4b84b60b7e67ab3d81d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:38.074997 11630 tablet_bootstrap.cc:492] T 14457af646fe430aa855e47d42721a17 P e3760873d2be4dc7b991027c1deef35d: No bootstrap required, opened a new log
I20260709 13:03:38.075915 11630 ts_tablet_manager.cc:1403] T 14457af646fe430aa855e47d42721a17 P e3760873d2be4dc7b991027c1deef35d: Time spent bootstrapping tablet: real 0.034s	user 0.008s	sys 0.006s
I20260709 13:03:38.078871 11630 raft_consensus.cc:359] T 14457af646fe430aa855e47d42721a17 P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:38.079734 11630 raft_consensus.cc:385] T 14457af646fe430aa855e47d42721a17 P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:38.080065 11630 raft_consensus.cc:740] T 14457af646fe430aa855e47d42721a17 P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3760873d2be4dc7b991027c1deef35d, State: Initialized, Role: FOLLOWER
I20260709 13:03:38.080888 11630 consensus_queue.cc:260] T 14457af646fe430aa855e47d42721a17 P e3760873d2be4dc7b991027c1deef35d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:38.083070 11630 ts_tablet_manager.cc:1434] T 14457af646fe430aa855e47d42721a17 P e3760873d2be4dc7b991027c1deef35d: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:03:38.084139 11630 tablet_bootstrap.cc:492] T d1ada73b7855443da29b368f50229412 P e3760873d2be4dc7b991027c1deef35d: Bootstrap starting.
I20260709 13:03:38.090348 11630 tablet_bootstrap.cc:654] T d1ada73b7855443da29b368f50229412 P e3760873d2be4dc7b991027c1deef35d: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:38.090595 11326 raft_consensus.cc:2468] T bb4c61cb73ed4c488c741fd69f447642 P e3760873d2be4dc7b991027c1deef35d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7eb6f135338f4b84b60b7e67ab3d81d7 in term 1.
I20260709 13:03:38.097595 11294 leader_election.cc:304] T 03c55f66aaf043bba6a0c8d64fbddf0e P e3760873d2be4dc7b991027c1deef35d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 57da47b50bc847c997f07dccaeae280a, e3760873d2be4dc7b991027c1deef35d; no voters: 7eb6f135338f4b84b60b7e67ab3d81d7
I20260709 13:03:38.100064 11654 raft_consensus.cc:2804] T 03c55f66aaf043bba6a0c8d64fbddf0e P e3760873d2be4dc7b991027c1deef35d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:38.100597 11654 raft_consensus.cc:697] T 03c55f66aaf043bba6a0c8d64fbddf0e P e3760873d2be4dc7b991027c1deef35d [term 1 LEADER]: Becoming Leader. State: Replica: e3760873d2be4dc7b991027c1deef35d, State: Running, Role: LEADER
I20260709 13:03:38.101471 11654 consensus_queue.cc:237] T 03c55f66aaf043bba6a0c8d64fbddf0e P e3760873d2be4dc7b991027c1deef35d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:38.110971 11630 tablet_bootstrap.cc:492] T d1ada73b7855443da29b368f50229412 P e3760873d2be4dc7b991027c1deef35d: No bootstrap required, opened a new log
I20260709 13:03:38.111641 11630 ts_tablet_manager.cc:1403] T d1ada73b7855443da29b368f50229412 P e3760873d2be4dc7b991027c1deef35d: Time spent bootstrapping tablet: real 0.028s	user 0.018s	sys 0.005s
I20260709 13:03:38.114995 11630 raft_consensus.cc:359] T d1ada73b7855443da29b368f50229412 P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:38.115861 11630 raft_consensus.cc:385] T d1ada73b7855443da29b368f50229412 P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:38.116149 11630 raft_consensus.cc:740] T d1ada73b7855443da29b368f50229412 P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3760873d2be4dc7b991027c1deef35d, State: Initialized, Role: FOLLOWER
I20260709 13:03:38.117048 11630 consensus_queue.cc:260] T d1ada73b7855443da29b368f50229412 P e3760873d2be4dc7b991027c1deef35d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:38.118345 11654 raft_consensus.cc:493] T 3ff2fc0ffa2f4ac08a92984cfd462344 P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.118840 11654 raft_consensus.cc:515] T 3ff2fc0ffa2f4ac08a92984cfd462344 P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:38.119065 11630 ts_tablet_manager.cc:1434] T d1ada73b7855443da29b368f50229412 P e3760873d2be4dc7b991027c1deef35d: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:03:38.123032 11631 ts_tablet_manager.cc:1434] T d1ada73b7855443da29b368f50229412 P 57da47b50bc847c997f07dccaeae280a: Time spent starting tablet: real 0.058s	user 0.024s	sys 0.004s
I20260709 13:03:38.123390 11403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2fc0ffa2f4ac08a92984cfd462344" candidate_uuid: "e3760873d2be4dc7b991027c1deef35d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" is_pre_election: true
I20260709 13:03:38.124805 11654 leader_election.cc:290] T 3ff2fc0ffa2f4ac08a92984cfd462344 P e3760873d2be4dc7b991027c1deef35d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7eb6f135338f4b84b60b7e67ab3d81d7 (127.0.107.194:42689), 57da47b50bc847c997f07dccaeae280a (127.0.107.195:37515)
I20260709 13:03:38.125188 11632 tablet_bootstrap.cc:492] T afdaf36d81c44e9db29f10e201b31e8c P 7eb6f135338f4b84b60b7e67ab3d81d7: No bootstrap required, opened a new log
W20260709 13:03:38.124972 11292 leader_election.cc:343] T 3ff2fc0ffa2f4ac08a92984cfd462344 P e3760873d2be4dc7b991027c1deef35d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7eb6f135338f4b84b60b7e67ab3d81d7 (127.0.107.194:42689): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:38.126801 11476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2fc0ffa2f4ac08a92984cfd462344" candidate_uuid: "e3760873d2be4dc7b991027c1deef35d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57da47b50bc847c997f07dccaeae280a" is_pre_election: true
I20260709 13:03:38.128116 11632 ts_tablet_manager.cc:1403] T afdaf36d81c44e9db29f10e201b31e8c P 7eb6f135338f4b84b60b7e67ab3d81d7: Time spent bootstrapping tablet: real 0.090s	user 0.012s	sys 0.024s
I20260709 13:03:38.128538 11476 raft_consensus.cc:2468] T 3ff2fc0ffa2f4ac08a92984cfd462344 P 57da47b50bc847c997f07dccaeae280a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3760873d2be4dc7b991027c1deef35d in term 0.
I20260709 13:03:38.129911 11294 leader_election.cc:304] T 3ff2fc0ffa2f4ac08a92984cfd462344 P e3760873d2be4dc7b991027c1deef35d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 57da47b50bc847c997f07dccaeae280a, e3760873d2be4dc7b991027c1deef35d; no voters: 7eb6f135338f4b84b60b7e67ab3d81d7
I20260709 13:03:38.131211 11632 raft_consensus.cc:359] T afdaf36d81c44e9db29f10e201b31e8c P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:38.132099 11632 raft_consensus.cc:385] T afdaf36d81c44e9db29f10e201b31e8c P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:38.132593 11632 raft_consensus.cc:740] T afdaf36d81c44e9db29f10e201b31e8c P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7eb6f135338f4b84b60b7e67ab3d81d7, State: Initialized, Role: FOLLOWER
I20260709 13:03:38.132081 11653 raft_consensus.cc:2804] T 3ff2fc0ffa2f4ac08a92984cfd462344 P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:38.133286 11653 raft_consensus.cc:493] T 3ff2fc0ffa2f4ac08a92984cfd462344 P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:38.133749 11653 raft_consensus.cc:3060] T 3ff2fc0ffa2f4ac08a92984cfd462344 P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:38.133369 11632 consensus_queue.cc:260] T afdaf36d81c44e9db29f10e201b31e8c P 7eb6f135338f4b84b60b7e67ab3d81d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:38.136233 11632 ts_tablet_manager.cc:1434] T afdaf36d81c44e9db29f10e201b31e8c P 7eb6f135338f4b84b60b7e67ab3d81d7: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:03:38.137269 11632 tablet_bootstrap.cc:492] T 3ff2fc0ffa2f4ac08a92984cfd462344 P 7eb6f135338f4b84b60b7e67ab3d81d7: Bootstrap starting.
I20260709 13:03:38.144088 11632 tablet_bootstrap.cc:654] T 3ff2fc0ffa2f4ac08a92984cfd462344 P 7eb6f135338f4b84b60b7e67ab3d81d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:38.144201 11653 raft_consensus.cc:515] T 3ff2fc0ffa2f4ac08a92984cfd462344 P e3760873d2be4dc7b991027c1deef35d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:38.147389 11653 leader_election.cc:290] T 3ff2fc0ffa2f4ac08a92984cfd462344 P e3760873d2be4dc7b991027c1deef35d [CANDIDATE]: Term 1 election: Requested vote from peers 7eb6f135338f4b84b60b7e67ab3d81d7 (127.0.107.194:42689), 57da47b50bc847c997f07dccaeae280a (127.0.107.195:37515)
I20260709 13:03:38.148207 11403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2fc0ffa2f4ac08a92984cfd462344" candidate_uuid: "e3760873d2be4dc7b991027c1deef35d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7"
I20260709 13:03:38.149061 11474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2fc0ffa2f4ac08a92984cfd462344" candidate_uuid: "e3760873d2be4dc7b991027c1deef35d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57da47b50bc847c997f07dccaeae280a"
I20260709 13:03:38.149570 11474 raft_consensus.cc:3060] T 3ff2fc0ffa2f4ac08a92984cfd462344 P 57da47b50bc847c997f07dccaeae280a [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:03:38.149652 11292 leader_election.cc:343] T 3ff2fc0ffa2f4ac08a92984cfd462344 P e3760873d2be4dc7b991027c1deef35d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7eb6f135338f4b84b60b7e67ab3d81d7 (127.0.107.194:42689): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:38.157303 11474 raft_consensus.cc:2468] T 3ff2fc0ffa2f4ac08a92984cfd462344 P 57da47b50bc847c997f07dccaeae280a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3760873d2be4dc7b991027c1deef35d in term 1.
I20260709 13:03:38.158401 11294 leader_election.cc:304] T 3ff2fc0ffa2f4ac08a92984cfd462344 P e3760873d2be4dc7b991027c1deef35d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 57da47b50bc847c997f07dccaeae280a, e3760873d2be4dc7b991027c1deef35d; no voters: 7eb6f135338f4b84b60b7e67ab3d81d7
I20260709 13:03:38.159662 11632 tablet_bootstrap.cc:492] T 3ff2fc0ffa2f4ac08a92984cfd462344 P 7eb6f135338f4b84b60b7e67ab3d81d7: No bootstrap required, opened a new log
I20260709 13:03:38.159865 11653 raft_consensus.cc:2804] T 3ff2fc0ffa2f4ac08a92984cfd462344 P e3760873d2be4dc7b991027c1deef35d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:38.160352 11632 ts_tablet_manager.cc:1403] T 3ff2fc0ffa2f4ac08a92984cfd462344 P 7eb6f135338f4b84b60b7e67ab3d81d7: Time spent bootstrapping tablet: real 0.023s	user 0.015s	sys 0.005s
I20260709 13:03:38.160362 11653 raft_consensus.cc:697] T 3ff2fc0ffa2f4ac08a92984cfd462344 P e3760873d2be4dc7b991027c1deef35d [term 1 LEADER]: Becoming Leader. State: Replica: e3760873d2be4dc7b991027c1deef35d, State: Running, Role: LEADER
I20260709 13:03:38.161340 11653 consensus_queue.cc:237] T 3ff2fc0ffa2f4ac08a92984cfd462344 P e3760873d2be4dc7b991027c1deef35d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:38.163341 11632 raft_consensus.cc:359] T 3ff2fc0ffa2f4ac08a92984cfd462344 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:38.164268 11632 raft_consensus.cc:385] T 3ff2fc0ffa2f4ac08a92984cfd462344 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:38.163378 11226 catalog_manager.cc:5697] T bb4c61cb73ed4c488c741fd69f447642 P 7eb6f135338f4b84b60b7e67ab3d81d7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7eb6f135338f4b84b60b7e67ab3d81d7 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:38.164558 11632 raft_consensus.cc:740] T 3ff2fc0ffa2f4ac08a92984cfd462344 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7eb6f135338f4b84b60b7e67ab3d81d7, State: Initialized, Role: FOLLOWER
I20260709 13:03:38.165347 11632 consensus_queue.cc:260] T 3ff2fc0ffa2f4ac08a92984cfd462344 P 7eb6f135338f4b84b60b7e67ab3d81d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:38.167047 11632 ts_tablet_manager.cc:1434] T 3ff2fc0ffa2f4ac08a92984cfd462344 P 7eb6f135338f4b84b60b7e67ab3d81d7: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:03:38.167757 11632 tablet_bootstrap.cc:492] T d1ada73b7855443da29b368f50229412 P 7eb6f135338f4b84b60b7e67ab3d81d7: Bootstrap starting.
I20260709 13:03:38.173044 11632 tablet_bootstrap.cc:654] T d1ada73b7855443da29b368f50229412 P 7eb6f135338f4b84b60b7e67ab3d81d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:38.178376 11632 tablet_bootstrap.cc:492] T d1ada73b7855443da29b368f50229412 P 7eb6f135338f4b84b60b7e67ab3d81d7: No bootstrap required, opened a new log
I20260709 13:03:38.178926 11632 ts_tablet_manager.cc:1403] T d1ada73b7855443da29b368f50229412 P 7eb6f135338f4b84b60b7e67ab3d81d7: Time spent bootstrapping tablet: real 0.011s	user 0.007s	sys 0.003s
I20260709 13:03:38.178957 11225 catalog_manager.cc:5697] T 3ff2fc0ffa2f4ac08a92984cfd462344 P e3760873d2be4dc7b991027c1deef35d reported cstate change: term changed from 0 to 1, leader changed from <none> to e3760873d2be4dc7b991027c1deef35d (127.0.107.193). New cstate: current_term: 1 leader_uuid: "e3760873d2be4dc7b991027c1deef35d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:38.181221 11632 raft_consensus.cc:359] T d1ada73b7855443da29b368f50229412 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:38.180805 11225 catalog_manager.cc:5697] T a39eb6d3a8b641d88c8c8bfedce391ed P e3760873d2be4dc7b991027c1deef35d reported cstate change: term changed from 0 to 1, leader changed from <none> to e3760873d2be4dc7b991027c1deef35d (127.0.107.193). New cstate: current_term: 1 leader_uuid: "e3760873d2be4dc7b991027c1deef35d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:38.181810 11632 raft_consensus.cc:385] T d1ada73b7855443da29b368f50229412 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:38.182034 11632 raft_consensus.cc:740] T d1ada73b7855443da29b368f50229412 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7eb6f135338f4b84b60b7e67ab3d81d7, State: Initialized, Role: FOLLOWER
I20260709 13:03:38.182597 11632 consensus_queue.cc:260] T d1ada73b7855443da29b368f50229412 P 7eb6f135338f4b84b60b7e67ab3d81d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:38.182482 11225 catalog_manager.cc:5697] T afdaf36d81c44e9db29f10e201b31e8c P e3760873d2be4dc7b991027c1deef35d reported cstate change: term changed from 0 to 1, leader changed from <none> to e3760873d2be4dc7b991027c1deef35d (127.0.107.193). New cstate: current_term: 1 leader_uuid: "e3760873d2be4dc7b991027c1deef35d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:38.184511 11632 ts_tablet_manager.cc:1434] T d1ada73b7855443da29b368f50229412 P 7eb6f135338f4b84b60b7e67ab3d81d7: Time spent starting tablet: real 0.005s	user 0.001s	sys 0.003s
I20260709 13:03:38.184134 11225 catalog_manager.cc:5697] T 03c55f66aaf043bba6a0c8d64fbddf0e P e3760873d2be4dc7b991027c1deef35d reported cstate change: term changed from 0 to 1, leader changed from <none> to e3760873d2be4dc7b991027c1deef35d (127.0.107.193). New cstate: current_term: 1 leader_uuid: "e3760873d2be4dc7b991027c1deef35d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:38.194092 11653 raft_consensus.cc:493] T d1ada73b7855443da29b368f50229412 P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.194800 11653 raft_consensus.cc:515] T d1ada73b7855443da29b368f50229412 P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:38.196928 11653 leader_election.cc:290] T d1ada73b7855443da29b368f50229412 P e3760873d2be4dc7b991027c1deef35d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7eb6f135338f4b84b60b7e67ab3d81d7 (127.0.107.194:42689), 57da47b50bc847c997f07dccaeae280a (127.0.107.195:37515)
I20260709 13:03:38.197667 11403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ada73b7855443da29b368f50229412" candidate_uuid: "e3760873d2be4dc7b991027c1deef35d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" is_pre_election: true
I20260709 13:03:38.198272 11403 raft_consensus.cc:2468] T d1ada73b7855443da29b368f50229412 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3760873d2be4dc7b991027c1deef35d in term 0.
I20260709 13:03:38.199635 11292 leader_election.cc:304] T d1ada73b7855443da29b368f50229412 P e3760873d2be4dc7b991027c1deef35d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7eb6f135338f4b84b60b7e67ab3d81d7, e3760873d2be4dc7b991027c1deef35d; no voters: 
I20260709 13:03:38.201085 11653 raft_consensus.cc:2804] T d1ada73b7855443da29b368f50229412 P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:38.201491 11653 raft_consensus.cc:493] T d1ada73b7855443da29b368f50229412 P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:38.201817 11653 raft_consensus.cc:3060] T d1ada73b7855443da29b368f50229412 P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:38.202631 11474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ada73b7855443da29b368f50229412" candidate_uuid: "e3760873d2be4dc7b991027c1deef35d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57da47b50bc847c997f07dccaeae280a" is_pre_election: true
I20260709 13:03:38.203425 11474 raft_consensus.cc:2468] T d1ada73b7855443da29b368f50229412 P 57da47b50bc847c997f07dccaeae280a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3760873d2be4dc7b991027c1deef35d in term 0.
I20260709 13:03:38.209254 11653 raft_consensus.cc:515] T d1ada73b7855443da29b368f50229412 P e3760873d2be4dc7b991027c1deef35d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:38.211678 11653 leader_election.cc:290] T d1ada73b7855443da29b368f50229412 P e3760873d2be4dc7b991027c1deef35d [CANDIDATE]: Term 1 election: Requested vote from peers 7eb6f135338f4b84b60b7e67ab3d81d7 (127.0.107.194:42689), 57da47b50bc847c997f07dccaeae280a (127.0.107.195:37515)
I20260709 13:03:38.211972 11403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ada73b7855443da29b368f50229412" candidate_uuid: "e3760873d2be4dc7b991027c1deef35d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7"
I20260709 13:03:38.212302 11476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ada73b7855443da29b368f50229412" candidate_uuid: "e3760873d2be4dc7b991027c1deef35d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57da47b50bc847c997f07dccaeae280a"
I20260709 13:03:38.212705 11403 raft_consensus.cc:3060] T d1ada73b7855443da29b368f50229412 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:38.212893 11476 raft_consensus.cc:3060] T d1ada73b7855443da29b368f50229412 P 57da47b50bc847c997f07dccaeae280a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:38.219961 11403 raft_consensus.cc:2468] T d1ada73b7855443da29b368f50229412 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3760873d2be4dc7b991027c1deef35d in term 1.
I20260709 13:03:38.219961 11476 raft_consensus.cc:2468] T d1ada73b7855443da29b368f50229412 P 57da47b50bc847c997f07dccaeae280a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3760873d2be4dc7b991027c1deef35d in term 1.
I20260709 13:03:38.221267 11292 leader_election.cc:304] T d1ada73b7855443da29b368f50229412 P e3760873d2be4dc7b991027c1deef35d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7eb6f135338f4b84b60b7e67ab3d81d7, e3760873d2be4dc7b991027c1deef35d; no voters: 
I20260709 13:03:38.222087 11653 raft_consensus.cc:2804] T d1ada73b7855443da29b368f50229412 P e3760873d2be4dc7b991027c1deef35d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:38.222568 11653 raft_consensus.cc:697] T d1ada73b7855443da29b368f50229412 P e3760873d2be4dc7b991027c1deef35d [term 1 LEADER]: Becoming Leader. State: Replica: e3760873d2be4dc7b991027c1deef35d, State: Running, Role: LEADER
I20260709 13:03:38.223343 11653 consensus_queue.cc:237] T d1ada73b7855443da29b368f50229412 P e3760873d2be4dc7b991027c1deef35d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:38.230458 11225 catalog_manager.cc:5697] T d1ada73b7855443da29b368f50229412 P e3760873d2be4dc7b991027c1deef35d reported cstate change: term changed from 0 to 1, leader changed from <none> to e3760873d2be4dc7b991027c1deef35d (127.0.107.193). New cstate: current_term: 1 leader_uuid: "e3760873d2be4dc7b991027c1deef35d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:38.319131 11403 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a75eed46652c4944b6302c9569235569"
dest_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7"
mode: GRACEFUL
new_leader_uuid: "e3760873d2be4dc7b991027c1deef35d"
 from {username='slave'} at 127.0.0.1:35462
I20260709 13:03:38.319661 11403 raft_consensus.cc:606] T a75eed46652c4944b6302c9569235569 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 LEADER]: Received request to transfer leadership to TS e3760873d2be4dc7b991027c1deef35d
I20260709 13:03:38.324882 11403 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "14457af646fe430aa855e47d42721a17"
dest_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7"
mode: GRACEFUL
new_leader_uuid: "e3760873d2be4dc7b991027c1deef35d"
 from {username='slave'} at 127.0.0.1:35462
I20260709 13:03:38.325392 11403 raft_consensus.cc:606] T 14457af646fe430aa855e47d42721a17 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 LEADER]: Received request to transfer leadership to TS e3760873d2be4dc7b991027c1deef35d
I20260709 13:03:38.330224 11403 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bb4c61cb73ed4c488c741fd69f447642"
dest_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7"
mode: GRACEFUL
new_leader_uuid: "e3760873d2be4dc7b991027c1deef35d"
 from {username='slave'} at 127.0.0.1:35462
I20260709 13:03:38.330751 11403 raft_consensus.cc:606] T bb4c61cb73ed4c488c741fd69f447642 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 LEADER]: Received request to transfer leadership to TS e3760873d2be4dc7b991027c1deef35d
I20260709 13:03:38.338109 11326 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "afdaf36d81c44e9db29f10e201b31e8c"
dest_uuid: "e3760873d2be4dc7b991027c1deef35d"
mode: GRACEFUL
new_leader_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7"
 from {username='slave'} at 127.0.0.1:49600
I20260709 13:03:38.338792 11326 raft_consensus.cc:606] T afdaf36d81c44e9db29f10e201b31e8c P e3760873d2be4dc7b991027c1deef35d [term 1 LEADER]: Received request to transfer leadership to TS 7eb6f135338f4b84b60b7e67ab3d81d7
I20260709 13:03:38.340566 11653 raft_consensus.cc:493] T a75eed46652c4944b6302c9569235569 P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.341058 11653 raft_consensus.cc:515] T a75eed46652c4944b6302c9569235569 P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:38.343166 11653 leader_election.cc:290] T a75eed46652c4944b6302c9569235569 P e3760873d2be4dc7b991027c1deef35d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7eb6f135338f4b84b60b7e67ab3d81d7 (127.0.107.194:42689), 57da47b50bc847c997f07dccaeae280a (127.0.107.195:37515)
I20260709 13:03:38.343443 11403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75eed46652c4944b6302c9569235569" candidate_uuid: "e3760873d2be4dc7b991027c1deef35d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" is_pre_election: true
I20260709 13:03:38.343840 11476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75eed46652c4944b6302c9569235569" candidate_uuid: "e3760873d2be4dc7b991027c1deef35d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57da47b50bc847c997f07dccaeae280a" is_pre_election: true
I20260709 13:03:38.344038 11326 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "03c55f66aaf043bba6a0c8d64fbddf0e"
dest_uuid: "e3760873d2be4dc7b991027c1deef35d"
mode: GRACEFUL
new_leader_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7"
 from {username='slave'} at 127.0.0.1:49600
I20260709 13:03:38.344619 11326 raft_consensus.cc:606] T 03c55f66aaf043bba6a0c8d64fbddf0e P e3760873d2be4dc7b991027c1deef35d [term 1 LEADER]: Received request to transfer leadership to TS 7eb6f135338f4b84b60b7e67ab3d81d7
I20260709 13:03:38.344740 11476 raft_consensus.cc:2393] T a75eed46652c4944b6302c9569235569 P 57da47b50bc847c997f07dccaeae280a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3760873d2be4dc7b991027c1deef35d in current term 1: Already voted for candidate 7eb6f135338f4b84b60b7e67ab3d81d7 in this term.
I20260709 13:03:38.345844 11292 leader_election.cc:304] T a75eed46652c4944b6302c9569235569 P e3760873d2be4dc7b991027c1deef35d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3760873d2be4dc7b991027c1deef35d; no voters: 57da47b50bc847c997f07dccaeae280a, 7eb6f135338f4b84b60b7e67ab3d81d7
I20260709 13:03:38.346531 11653 raft_consensus.cc:3060] T a75eed46652c4944b6302c9569235569 P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:38.350255 11629 raft_consensus.cc:493] T 03c55f66aaf043bba6a0c8d64fbddf0e P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.350356 11326 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e812d0605d24436989fb6ec2c868d47c"
dest_uuid: "e3760873d2be4dc7b991027c1deef35d"
mode: GRACEFUL
new_leader_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7"
 from {username='slave'} at 127.0.0.1:49600
I20260709 13:03:38.350750 11629 raft_consensus.cc:515] T 03c55f66aaf043bba6a0c8d64fbddf0e P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:38.351102 11326 raft_consensus.cc:606] T e812d0605d24436989fb6ec2c868d47c P e3760873d2be4dc7b991027c1deef35d [term 1 LEADER]: Received request to transfer leadership to TS 7eb6f135338f4b84b60b7e67ab3d81d7
I20260709 13:03:38.352517 11629 leader_election.cc:290] T 03c55f66aaf043bba6a0c8d64fbddf0e P 7eb6f135338f4b84b60b7e67ab3d81d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3760873d2be4dc7b991027c1deef35d (127.0.107.193:35003), 57da47b50bc847c997f07dccaeae280a (127.0.107.195:37515)
I20260709 13:03:38.352888 11653 raft_consensus.cc:2749] T a75eed46652c4944b6302c9569235569 P e3760873d2be4dc7b991027c1deef35d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:38.354122 11476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c55f66aaf043bba6a0c8d64fbddf0e" candidate_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57da47b50bc847c997f07dccaeae280a" is_pre_election: true
I20260709 13:03:38.354525 11326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c55f66aaf043bba6a0c8d64fbddf0e" candidate_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3760873d2be4dc7b991027c1deef35d" is_pre_election: true
I20260709 13:03:38.354931 11476 raft_consensus.cc:2393] T 03c55f66aaf043bba6a0c8d64fbddf0e P 57da47b50bc847c997f07dccaeae280a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7eb6f135338f4b84b60b7e67ab3d81d7 in current term 1: Already voted for candidate e3760873d2be4dc7b991027c1deef35d in this term.
I20260709 13:03:38.356336 11369 leader_election.cc:304] T 03c55f66aaf043bba6a0c8d64fbddf0e P 7eb6f135338f4b84b60b7e67ab3d81d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7eb6f135338f4b84b60b7e67ab3d81d7; no voters: 57da47b50bc847c997f07dccaeae280a, e3760873d2be4dc7b991027c1deef35d
I20260709 13:03:38.356742 11326 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3ff2fc0ffa2f4ac08a92984cfd462344"
dest_uuid: "e3760873d2be4dc7b991027c1deef35d"
mode: GRACEFUL
new_leader_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7"
 from {username='slave'} at 127.0.0.1:49600
I20260709 13:03:38.357146 11629 raft_consensus.cc:3060] T 03c55f66aaf043bba6a0c8d64fbddf0e P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:38.357347 11326 raft_consensus.cc:606] T 3ff2fc0ffa2f4ac08a92984cfd462344 P e3760873d2be4dc7b991027c1deef35d [term 1 LEADER]: Received request to transfer leadership to TS 7eb6f135338f4b84b60b7e67ab3d81d7
I20260709 13:03:38.362237 11326 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d1ada73b7855443da29b368f50229412"
dest_uuid: "e3760873d2be4dc7b991027c1deef35d"
mode: GRACEFUL
new_leader_uuid: "57da47b50bc847c997f07dccaeae280a"
 from {username='slave'} at 127.0.0.1:49600
I20260709 13:03:38.362740 11326 raft_consensus.cc:606] T d1ada73b7855443da29b368f50229412 P e3760873d2be4dc7b991027c1deef35d [term 1 LEADER]: Received request to transfer leadership to TS 57da47b50bc847c997f07dccaeae280a
I20260709 13:03:38.362884 11629 raft_consensus.cc:2749] T 03c55f66aaf043bba6a0c8d64fbddf0e P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:38.416144 11653 consensus_queue.cc:1048] T e812d0605d24436989fb6ec2c868d47c P e3760873d2be4dc7b991027c1deef35d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:38.422796 11654 raft_consensus.cc:993] T e812d0605d24436989fb6ec2c868d47c P e3760873d2be4dc7b991027c1deef35d: : Instructing follower 7eb6f135338f4b84b60b7e67ab3d81d7 to start an election
I20260709 13:03:38.422747 11650 raft_consensus.cc:493] T 14457af646fe430aa855e47d42721a17 P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.423391 11616 raft_consensus.cc:1081] T e812d0605d24436989fb6ec2c868d47c P e3760873d2be4dc7b991027c1deef35d [term 1 LEADER]: Signalling peer 7eb6f135338f4b84b60b7e67ab3d81d7 to start an election
I20260709 13:03:38.423497 11650 raft_consensus.cc:515] T 14457af646fe430aa855e47d42721a17 P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:38.425168 11402 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e812d0605d24436989fb6ec2c868d47c"
dest_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7"
 from {username='slave'} at 127.0.0.1:35442
I20260709 13:03:38.426687 11402 raft_consensus.cc:493] T e812d0605d24436989fb6ec2c868d47c P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:38.427098 11402 raft_consensus.cc:3060] T e812d0605d24436989fb6ec2c868d47c P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:38.428174 11476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14457af646fe430aa855e47d42721a17" candidate_uuid: "e3760873d2be4dc7b991027c1deef35d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57da47b50bc847c997f07dccaeae280a" is_pre_election: true
I20260709 13:03:38.428542 11650 leader_election.cc:290] T 14457af646fe430aa855e47d42721a17 P e3760873d2be4dc7b991027c1deef35d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7eb6f135338f4b84b60b7e67ab3d81d7 (127.0.107.194:42689), 57da47b50bc847c997f07dccaeae280a (127.0.107.195:37515)
I20260709 13:03:38.429081 11476 raft_consensus.cc:2393] T 14457af646fe430aa855e47d42721a17 P 57da47b50bc847c997f07dccaeae280a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3760873d2be4dc7b991027c1deef35d in current term 1: Already voted for candidate 7eb6f135338f4b84b60b7e67ab3d81d7 in this term.
I20260709 13:03:38.432035 11403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14457af646fe430aa855e47d42721a17" candidate_uuid: "e3760873d2be4dc7b991027c1deef35d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" is_pre_election: true
I20260709 13:03:38.433591 11292 leader_election.cc:304] T 14457af646fe430aa855e47d42721a17 P e3760873d2be4dc7b991027c1deef35d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3760873d2be4dc7b991027c1deef35d; no voters: 57da47b50bc847c997f07dccaeae280a, 7eb6f135338f4b84b60b7e67ab3d81d7
I20260709 13:03:38.434367 11653 raft_consensus.cc:3060] T 14457af646fe430aa855e47d42721a17 P e3760873d2be4dc7b991027c1deef35d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:38.434181 11616 consensus_queue.cc:1048] T e812d0605d24436989fb6ec2c868d47c P e3760873d2be4dc7b991027c1deef35d [LEADER]: Connected to new peer: Peer: permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:38.435410 11402 raft_consensus.cc:515] T e812d0605d24436989fb6ec2c868d47c P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:38.443495 11402 leader_election.cc:290] T e812d0605d24436989fb6ec2c868d47c P 7eb6f135338f4b84b60b7e67ab3d81d7 [CANDIDATE]: Term 2 election: Requested vote from peers e3760873d2be4dc7b991027c1deef35d (127.0.107.193:35003), 57da47b50bc847c997f07dccaeae280a (127.0.107.195:37515)
I20260709 13:03:38.444114 11474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e812d0605d24436989fb6ec2c868d47c" candidate_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "57da47b50bc847c997f07dccaeae280a"
I20260709 13:03:38.444726 11326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e812d0605d24436989fb6ec2c868d47c" candidate_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e3760873d2be4dc7b991027c1deef35d"
I20260709 13:03:38.445366 11326 raft_consensus.cc:3055] T e812d0605d24436989fb6ec2c868d47c P e3760873d2be4dc7b991027c1deef35d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:38.445632 11326 raft_consensus.cc:740] T e812d0605d24436989fb6ec2c868d47c P e3760873d2be4dc7b991027c1deef35d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e3760873d2be4dc7b991027c1deef35d, State: Running, Role: LEADER
I20260709 13:03:38.446378 11326 consensus_queue.cc:260] T e812d0605d24436989fb6ec2c868d47c P e3760873d2be4dc7b991027c1deef35d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:38.448447 11653 raft_consensus.cc:2749] T 14457af646fe430aa855e47d42721a17 P e3760873d2be4dc7b991027c1deef35d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:38.447403 11326 raft_consensus.cc:3060] T e812d0605d24436989fb6ec2c868d47c P e3760873d2be4dc7b991027c1deef35d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:38.450809 11618 raft_consensus.cc:493] T afdaf36d81c44e9db29f10e201b31e8c P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.451393 11618 raft_consensus.cc:515] T afdaf36d81c44e9db29f10e201b31e8c P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:38.453517 11618 leader_election.cc:290] T afdaf36d81c44e9db29f10e201b31e8c P 7eb6f135338f4b84b60b7e67ab3d81d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3760873d2be4dc7b991027c1deef35d (127.0.107.193:35003), 57da47b50bc847c997f07dccaeae280a (127.0.107.195:37515)
I20260709 13:03:38.454586 11328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdaf36d81c44e9db29f10e201b31e8c" candidate_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3760873d2be4dc7b991027c1deef35d" is_pre_election: true
I20260709 13:03:38.455397 11476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdaf36d81c44e9db29f10e201b31e8c" candidate_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57da47b50bc847c997f07dccaeae280a" is_pre_election: true
I20260709 13:03:38.456077 11326 raft_consensus.cc:2468] T e812d0605d24436989fb6ec2c868d47c P e3760873d2be4dc7b991027c1deef35d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7eb6f135338f4b84b60b7e67ab3d81d7 in term 2.
I20260709 13:03:38.456261 11476 raft_consensus.cc:2393] T afdaf36d81c44e9db29f10e201b31e8c P 57da47b50bc847c997f07dccaeae280a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7eb6f135338f4b84b60b7e67ab3d81d7 in current term 1: Already voted for candidate e3760873d2be4dc7b991027c1deef35d in this term.
I20260709 13:03:38.457214 11369 leader_election.cc:304] T e812d0605d24436989fb6ec2c868d47c P 7eb6f135338f4b84b60b7e67ab3d81d7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7eb6f135338f4b84b60b7e67ab3d81d7, e3760873d2be4dc7b991027c1deef35d; no voters: 57da47b50bc847c997f07dccaeae280a
I20260709 13:03:38.457939 11618 raft_consensus.cc:2804] T e812d0605d24436989fb6ec2c868d47c P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:38.458376 11369 leader_election.cc:304] T afdaf36d81c44e9db29f10e201b31e8c P 7eb6f135338f4b84b60b7e67ab3d81d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7eb6f135338f4b84b60b7e67ab3d81d7; no voters: 57da47b50bc847c997f07dccaeae280a, e3760873d2be4dc7b991027c1deef35d
I20260709 13:03:38.458493 11618 raft_consensus.cc:697] T e812d0605d24436989fb6ec2c868d47c P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 2 LEADER]: Becoming Leader. State: Replica: 7eb6f135338f4b84b60b7e67ab3d81d7, State: Running, Role: LEADER
I20260709 13:03:38.459296 11629 raft_consensus.cc:3060] T afdaf36d81c44e9db29f10e201b31e8c P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:38.459560 11618 consensus_queue.cc:237] T e812d0605d24436989fb6ec2c868d47c P 7eb6f135338f4b84b60b7e67ab3d81d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:38.466334 11629 raft_consensus.cc:2749] T afdaf36d81c44e9db29f10e201b31e8c P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:38.467024 11225 catalog_manager.cc:5697] T e812d0605d24436989fb6ec2c868d47c P 7eb6f135338f4b84b60b7e67ab3d81d7 reported cstate change: term changed from 1 to 2, leader changed from e3760873d2be4dc7b991027c1deef35d (127.0.107.193) to 7eb6f135338f4b84b60b7e67ab3d81d7 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:38.476270 11618 consensus_queue.cc:1048] T 14457af646fe430aa855e47d42721a17 P 7eb6f135338f4b84b60b7e67ab3d81d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:38.488018 11649 consensus_queue.cc:1048] T 14457af646fe430aa855e47d42721a17 P 7eb6f135338f4b84b60b7e67ab3d81d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:38.497926 11618 raft_consensus.cc:993] T 14457af646fe430aa855e47d42721a17 P 7eb6f135338f4b84b60b7e67ab3d81d7: : Instructing follower e3760873d2be4dc7b991027c1deef35d to start an election
I20260709 13:03:38.498355 11649 raft_consensus.cc:1081] T 14457af646fe430aa855e47d42721a17 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 LEADER]: Signalling peer e3760873d2be4dc7b991027c1deef35d to start an election
I20260709 13:03:38.499363 11618 consensus_queue.cc:1048] T bb4c61cb73ed4c488c741fd69f447642 P 7eb6f135338f4b84b60b7e67ab3d81d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:38.500216 11326 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "14457af646fe430aa855e47d42721a17"
dest_uuid: "e3760873d2be4dc7b991027c1deef35d"
 from {username='slave'} at 127.0.0.1:49586
I20260709 13:03:38.501119 11326 raft_consensus.cc:493] T 14457af646fe430aa855e47d42721a17 P e3760873d2be4dc7b991027c1deef35d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:38.501601 11326 raft_consensus.cc:3060] T 14457af646fe430aa855e47d42721a17 P e3760873d2be4dc7b991027c1deef35d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:38.508790 11616 consensus_queue.cc:1048] T a39eb6d3a8b641d88c8c8bfedce391ed P e3760873d2be4dc7b991027c1deef35d [LEADER]: Connected to new peer: Peer: permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:38.509351 11326 raft_consensus.cc:515] T 14457af646fe430aa855e47d42721a17 P e3760873d2be4dc7b991027c1deef35d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:38.510620 11649 raft_consensus.cc:493] T 3ff2fc0ffa2f4ac08a92984cfd462344 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.511179 11649 raft_consensus.cc:515] T 3ff2fc0ffa2f4ac08a92984cfd462344 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:38.514541 11326 leader_election.cc:290] T 14457af646fe430aa855e47d42721a17 P e3760873d2be4dc7b991027c1deef35d [CANDIDATE]: Term 2 election: Requested vote from peers 7eb6f135338f4b84b60b7e67ab3d81d7 (127.0.107.194:42689), 57da47b50bc847c997f07dccaeae280a (127.0.107.195:37515)
I20260709 13:03:38.515167 11403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14457af646fe430aa855e47d42721a17" candidate_uuid: "e3760873d2be4dc7b991027c1deef35d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7"
I20260709 13:03:38.515836 11403 raft_consensus.cc:3055] T 14457af646fe430aa855e47d42721a17 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:38.516171 11403 raft_consensus.cc:740] T 14457af646fe430aa855e47d42721a17 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7eb6f135338f4b84b60b7e67ab3d81d7, State: Running, Role: LEADER
I20260709 13:03:38.516988 11403 consensus_queue.cc:260] T 14457af646fe430aa855e47d42721a17 P 7eb6f135338f4b84b60b7e67ab3d81d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:38.517606 11653 consensus_queue.cc:1048] T 03c55f66aaf043bba6a0c8d64fbddf0e P e3760873d2be4dc7b991027c1deef35d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:38.518756 11403 raft_consensus.cc:3060] T 14457af646fe430aa855e47d42721a17 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:38.518036 11474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14457af646fe430aa855e47d42721a17" candidate_uuid: "e3760873d2be4dc7b991027c1deef35d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "57da47b50bc847c997f07dccaeae280a"
I20260709 13:03:38.523202 11474 raft_consensus.cc:3060] T 14457af646fe430aa855e47d42721a17 P 57da47b50bc847c997f07dccaeae280a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:38.524642 11649 leader_election.cc:290] T 3ff2fc0ffa2f4ac08a92984cfd462344 P 7eb6f135338f4b84b60b7e67ab3d81d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3760873d2be4dc7b991027c1deef35d (127.0.107.193:35003), 57da47b50bc847c997f07dccaeae280a (127.0.107.195:37515)
I20260709 13:03:38.528244 11473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2fc0ffa2f4ac08a92984cfd462344" candidate_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57da47b50bc847c997f07dccaeae280a" is_pre_election: true
I20260709 13:03:38.528779 11328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2fc0ffa2f4ac08a92984cfd462344" candidate_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3760873d2be4dc7b991027c1deef35d" is_pre_election: true
I20260709 13:03:38.529166 11473 raft_consensus.cc:2393] T 3ff2fc0ffa2f4ac08a92984cfd462344 P 57da47b50bc847c997f07dccaeae280a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7eb6f135338f4b84b60b7e67ab3d81d7 in current term 1: Already voted for candidate e3760873d2be4dc7b991027c1deef35d in this term.
I20260709 13:03:38.529876 11649 consensus_queue.cc:1048] T bb4c61cb73ed4c488c741fd69f447642 P 7eb6f135338f4b84b60b7e67ab3d81d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:38.534830 11369 leader_election.cc:304] T 3ff2fc0ffa2f4ac08a92984cfd462344 P 7eb6f135338f4b84b60b7e67ab3d81d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7eb6f135338f4b84b60b7e67ab3d81d7; no voters: 57da47b50bc847c997f07dccaeae280a, e3760873d2be4dc7b991027c1deef35d
I20260709 13:03:38.533972 11629 consensus_queue.cc:1048] T a75eed46652c4944b6302c9569235569 P 7eb6f135338f4b84b60b7e67ab3d81d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:38.536445 11649 raft_consensus.cc:3060] T 3ff2fc0ffa2f4ac08a92984cfd462344 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:38.543149 11474 raft_consensus.cc:2468] T 14457af646fe430aa855e47d42721a17 P 57da47b50bc847c997f07dccaeae280a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3760873d2be4dc7b991027c1deef35d in term 2.
I20260709 13:03:38.541693 11403 raft_consensus.cc:2468] T 14457af646fe430aa855e47d42721a17 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3760873d2be4dc7b991027c1deef35d in term 2.
I20260709 13:03:38.544700 11294 leader_election.cc:304] T 14457af646fe430aa855e47d42721a17 P e3760873d2be4dc7b991027c1deef35d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57da47b50bc847c997f07dccaeae280a, e3760873d2be4dc7b991027c1deef35d; no voters: 
I20260709 13:03:38.546733 11653 raft_consensus.cc:2804] T 14457af646fe430aa855e47d42721a17 P e3760873d2be4dc7b991027c1deef35d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:38.547348 11653 raft_consensus.cc:697] T 14457af646fe430aa855e47d42721a17 P e3760873d2be4dc7b991027c1deef35d [term 2 LEADER]: Becoming Leader. State: Replica: e3760873d2be4dc7b991027c1deef35d, State: Running, Role: LEADER
I20260709 13:03:38.548177 11653 consensus_queue.cc:237] T 14457af646fe430aa855e47d42721a17 P e3760873d2be4dc7b991027c1deef35d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:38.550405 11629 consensus_queue.cc:1048] T a75eed46652c4944b6302c9569235569 P 7eb6f135338f4b84b60b7e67ab3d81d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:38.554557 11649 raft_consensus.cc:2749] T 3ff2fc0ffa2f4ac08a92984cfd462344 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:38.560196 11654 raft_consensus.cc:993] T 03c55f66aaf043bba6a0c8d64fbddf0e P e3760873d2be4dc7b991027c1deef35d: : Instructing follower 7eb6f135338f4b84b60b7e67ab3d81d7 to start an election
I20260709 13:03:38.561321 11616 raft_consensus.cc:1081] T 03c55f66aaf043bba6a0c8d64fbddf0e P e3760873d2be4dc7b991027c1deef35d [term 1 LEADER]: Signalling peer 7eb6f135338f4b84b60b7e67ab3d81d7 to start an election
I20260709 13:03:38.563942 11402 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "03c55f66aaf043bba6a0c8d64fbddf0e"
dest_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7"
 from {username='slave'} at 127.0.0.1:35442
I20260709 13:03:38.564726 11402 raft_consensus.cc:493] T 03c55f66aaf043bba6a0c8d64fbddf0e P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:38.565153 11402 raft_consensus.cc:3060] T 03c55f66aaf043bba6a0c8d64fbddf0e P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:38.563923 11650 consensus_queue.cc:1048] T a39eb6d3a8b641d88c8c8bfedce391ed P e3760873d2be4dc7b991027c1deef35d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:38.570575 11653 consensus_queue.cc:1048] T 03c55f66aaf043bba6a0c8d64fbddf0e P e3760873d2be4dc7b991027c1deef35d [LEADER]: Connected to new peer: Peer: permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:38.584956 11402 raft_consensus.cc:515] T 03c55f66aaf043bba6a0c8d64fbddf0e P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:38.592871 11616 consensus_queue.cc:1048] T 3ff2fc0ffa2f4ac08a92984cfd462344 P e3760873d2be4dc7b991027c1deef35d [LEADER]: Connected to new peer: Peer: permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:38.593961 11629 raft_consensus.cc:993] T bb4c61cb73ed4c488c741fd69f447642 P 7eb6f135338f4b84b60b7e67ab3d81d7: : Instructing follower e3760873d2be4dc7b991027c1deef35d to start an election
I20260709 13:03:38.594547 11618 raft_consensus.cc:1081] T bb4c61cb73ed4c488c741fd69f447642 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 LEADER]: Signalling peer e3760873d2be4dc7b991027c1deef35d to start an election
I20260709 13:03:38.595891 11402 leader_election.cc:290] T 03c55f66aaf043bba6a0c8d64fbddf0e P 7eb6f135338f4b84b60b7e67ab3d81d7 [CANDIDATE]: Term 2 election: Requested vote from peers e3760873d2be4dc7b991027c1deef35d (127.0.107.193:35003), 57da47b50bc847c997f07dccaeae280a (127.0.107.195:37515)
I20260709 13:03:38.600270 11474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c55f66aaf043bba6a0c8d64fbddf0e" candidate_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "57da47b50bc847c997f07dccaeae280a"
I20260709 13:03:38.600459 11326 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bb4c61cb73ed4c488c741fd69f447642"
dest_uuid: "e3760873d2be4dc7b991027c1deef35d"
 from {username='slave'} at 127.0.0.1:49586
I20260709 13:03:38.600564 11327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c55f66aaf043bba6a0c8d64fbddf0e" candidate_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e3760873d2be4dc7b991027c1deef35d"
I20260709 13:03:38.601091 11474 raft_consensus.cc:3060] T 03c55f66aaf043bba6a0c8d64fbddf0e P 57da47b50bc847c997f07dccaeae280a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:38.601380 11327 raft_consensus.cc:3055] T 03c55f66aaf043bba6a0c8d64fbddf0e P e3760873d2be4dc7b991027c1deef35d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:38.601907 11327 raft_consensus.cc:740] T 03c55f66aaf043bba6a0c8d64fbddf0e P e3760873d2be4dc7b991027c1deef35d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e3760873d2be4dc7b991027c1deef35d, State: Running, Role: LEADER
I20260709 13:03:38.602715 11327 consensus_queue.cc:260] T 03c55f66aaf043bba6a0c8d64fbddf0e P e3760873d2be4dc7b991027c1deef35d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:38.604017 11327 raft_consensus.cc:3060] T 03c55f66aaf043bba6a0c8d64fbddf0e P e3760873d2be4dc7b991027c1deef35d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:38.601313 11326 raft_consensus.cc:493] T bb4c61cb73ed4c488c741fd69f447642 P e3760873d2be4dc7b991027c1deef35d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:38.605779 11326 raft_consensus.cc:3060] T bb4c61cb73ed4c488c741fd69f447642 P e3760873d2be4dc7b991027c1deef35d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:38.610489 11654 consensus_queue.cc:1048] T 3ff2fc0ffa2f4ac08a92984cfd462344 P e3760873d2be4dc7b991027c1deef35d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:38.612447 11618 raft_consensus.cc:993] T a75eed46652c4944b6302c9569235569 P 7eb6f135338f4b84b60b7e67ab3d81d7: : Instructing follower e3760873d2be4dc7b991027c1deef35d to start an election
I20260709 13:03:38.612951 11618 raft_consensus.cc:1081] T a75eed46652c4944b6302c9569235569 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 LEADER]: Signalling peer e3760873d2be4dc7b991027c1deef35d to start an election
I20260709 13:03:38.613854 11326 raft_consensus.cc:515] T bb4c61cb73ed4c488c741fd69f447642 P e3760873d2be4dc7b991027c1deef35d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:38.617240 11691 consensus_queue.cc:1048] T d1ada73b7855443da29b368f50229412 P e3760873d2be4dc7b991027c1deef35d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:38.618243 11328 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a75eed46652c4944b6302c9569235569"
dest_uuid: "e3760873d2be4dc7b991027c1deef35d"
 from {username='slave'} at 127.0.0.1:49586
I20260709 13:03:38.618929 11328 raft_consensus.cc:493] T a75eed46652c4944b6302c9569235569 P e3760873d2be4dc7b991027c1deef35d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:38.619302 11328 raft_consensus.cc:3060] T a75eed46652c4944b6302c9569235569 P e3760873d2be4dc7b991027c1deef35d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:38.619338 11474 raft_consensus.cc:2468] T 03c55f66aaf043bba6a0c8d64fbddf0e P 57da47b50bc847c997f07dccaeae280a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7eb6f135338f4b84b60b7e67ab3d81d7 in term 2.
I20260709 13:03:38.622992 11369 leader_election.cc:304] T 03c55f66aaf043bba6a0c8d64fbddf0e P 7eb6f135338f4b84b60b7e67ab3d81d7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57da47b50bc847c997f07dccaeae280a, 7eb6f135338f4b84b60b7e67ab3d81d7; no voters: 
I20260709 13:03:38.624573 11401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb4c61cb73ed4c488c741fd69f447642" candidate_uuid: "e3760873d2be4dc7b991027c1deef35d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7"
I20260709 13:03:38.625458 11401 raft_consensus.cc:3055] T bb4c61cb73ed4c488c741fd69f447642 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:38.625798 11401 raft_consensus.cc:740] T bb4c61cb73ed4c488c741fd69f447642 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7eb6f135338f4b84b60b7e67ab3d81d7, State: Running, Role: LEADER
I20260709 13:03:38.624699 11629 raft_consensus.cc:2804] T 03c55f66aaf043bba6a0c8d64fbddf0e P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:38.626561 11629 raft_consensus.cc:697] T 03c55f66aaf043bba6a0c8d64fbddf0e P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 2 LEADER]: Becoming Leader. State: Replica: 7eb6f135338f4b84b60b7e67ab3d81d7, State: Running, Role: LEADER
I20260709 13:03:38.626796 11401 consensus_queue.cc:260] T bb4c61cb73ed4c488c741fd69f447642 P 7eb6f135338f4b84b60b7e67ab3d81d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:38.627478 11629 consensus_queue.cc:237] T 03c55f66aaf043bba6a0c8d64fbddf0e P 7eb6f135338f4b84b60b7e67ab3d81d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:38.628234 11401 raft_consensus.cc:3060] T bb4c61cb73ed4c488c741fd69f447642 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:38.635360 11654 consensus_queue.cc:1048] T afdaf36d81c44e9db29f10e201b31e8c P e3760873d2be4dc7b991027c1deef35d [LEADER]: Connected to new peer: Peer: permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:38.638715 11654 consensus_queue.cc:1048] T afdaf36d81c44e9db29f10e201b31e8c P e3760873d2be4dc7b991027c1deef35d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:38.642071 11326 leader_election.cc:290] T bb4c61cb73ed4c488c741fd69f447642 P e3760873d2be4dc7b991027c1deef35d [CANDIDATE]: Term 2 election: Requested vote from peers 7eb6f135338f4b84b60b7e67ab3d81d7 (127.0.107.194:42689), 57da47b50bc847c997f07dccaeae280a (127.0.107.195:37515)
I20260709 13:03:38.644434 11401 raft_consensus.cc:2468] T bb4c61cb73ed4c488c741fd69f447642 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3760873d2be4dc7b991027c1deef35d in term 2.
I20260709 13:03:38.645910 11292 leader_election.cc:304] T bb4c61cb73ed4c488c741fd69f447642 P e3760873d2be4dc7b991027c1deef35d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7eb6f135338f4b84b60b7e67ab3d81d7, e3760873d2be4dc7b991027c1deef35d; no voters: 
I20260709 13:03:38.646817 11475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb4c61cb73ed4c488c741fd69f447642" candidate_uuid: "e3760873d2be4dc7b991027c1deef35d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "57da47b50bc847c997f07dccaeae280a"
I20260709 13:03:38.647500 11691 raft_consensus.cc:2804] T bb4c61cb73ed4c488c741fd69f447642 P e3760873d2be4dc7b991027c1deef35d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:38.648193 11691 raft_consensus.cc:697] T bb4c61cb73ed4c488c741fd69f447642 P e3760873d2be4dc7b991027c1deef35d [term 2 LEADER]: Becoming Leader. State: Replica: e3760873d2be4dc7b991027c1deef35d, State: Running, Role: LEADER
I20260709 13:03:38.649032 11691 consensus_queue.cc:237] T bb4c61cb73ed4c488c741fd69f447642 P e3760873d2be4dc7b991027c1deef35d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:38.647492 11475 raft_consensus.cc:3060] T bb4c61cb73ed4c488c741fd69f447642 P 57da47b50bc847c997f07dccaeae280a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:38.657773 11475 raft_consensus.cc:2468] T bb4c61cb73ed4c488c741fd69f447642 P 57da47b50bc847c997f07dccaeae280a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3760873d2be4dc7b991027c1deef35d in term 2.
I20260709 13:03:38.657498 11328 raft_consensus.cc:515] T a75eed46652c4944b6302c9569235569 P e3760873d2be4dc7b991027c1deef35d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:38.662680 11401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75eed46652c4944b6302c9569235569" candidate_uuid: "e3760873d2be4dc7b991027c1deef35d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7"
I20260709 13:03:38.663276 11401 raft_consensus.cc:3055] T a75eed46652c4944b6302c9569235569 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:38.663589 11401 raft_consensus.cc:740] T a75eed46652c4944b6302c9569235569 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7eb6f135338f4b84b60b7e67ab3d81d7, State: Running, Role: LEADER
I20260709 13:03:38.663940 11691 consensus_queue.cc:1048] T d1ada73b7855443da29b368f50229412 P e3760873d2be4dc7b991027c1deef35d [LEADER]: Connected to new peer: Peer: permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:38.664417 11401 consensus_queue.cc:260] T a75eed46652c4944b6302c9569235569 P 7eb6f135338f4b84b60b7e67ab3d81d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:38.665729 11401 raft_consensus.cc:3060] T a75eed46652c4944b6302c9569235569 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:38.672187 11327 raft_consensus.cc:2468] T 03c55f66aaf043bba6a0c8d64fbddf0e P e3760873d2be4dc7b991027c1deef35d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7eb6f135338f4b84b60b7e67ab3d81d7 in term 2.
I20260709 13:03:38.674083 11328 leader_election.cc:290] T a75eed46652c4944b6302c9569235569 P e3760873d2be4dc7b991027c1deef35d [CANDIDATE]: Term 2 election: Requested vote from peers 7eb6f135338f4b84b60b7e67ab3d81d7 (127.0.107.194:42689), 57da47b50bc847c997f07dccaeae280a (127.0.107.195:37515)
I20260709 13:03:38.676097 11472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75eed46652c4944b6302c9569235569" candidate_uuid: "e3760873d2be4dc7b991027c1deef35d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "57da47b50bc847c997f07dccaeae280a"
I20260709 13:03:38.676843 11472 raft_consensus.cc:3060] T a75eed46652c4944b6302c9569235569 P 57da47b50bc847c997f07dccaeae280a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:38.686765 11691 raft_consensus.cc:993] T d1ada73b7855443da29b368f50229412 P e3760873d2be4dc7b991027c1deef35d: : Instructing follower 57da47b50bc847c997f07dccaeae280a to start an election
I20260709 13:03:38.685009 11401 raft_consensus.cc:2468] T a75eed46652c4944b6302c9569235569 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3760873d2be4dc7b991027c1deef35d in term 2.
I20260709 13:03:38.687819 11654 raft_consensus.cc:1081] T d1ada73b7855443da29b368f50229412 P e3760873d2be4dc7b991027c1deef35d [term 1 LEADER]: Signalling peer 57da47b50bc847c997f07dccaeae280a to start an election
I20260709 13:03:38.688289 11292 leader_election.cc:304] T a75eed46652c4944b6302c9569235569 P e3760873d2be4dc7b991027c1deef35d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7eb6f135338f4b84b60b7e67ab3d81d7, e3760873d2be4dc7b991027c1deef35d; no voters: 
I20260709 13:03:38.689126 11653 raft_consensus.cc:2804] T a75eed46652c4944b6302c9569235569 P e3760873d2be4dc7b991027c1deef35d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:38.689599 11653 raft_consensus.cc:697] T a75eed46652c4944b6302c9569235569 P e3760873d2be4dc7b991027c1deef35d [term 2 LEADER]: Becoming Leader. State: Replica: e3760873d2be4dc7b991027c1deef35d, State: Running, Role: LEADER
I20260709 13:03:38.684952 11472 raft_consensus.cc:2468] T a75eed46652c4944b6302c9569235569 P 57da47b50bc847c997f07dccaeae280a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3760873d2be4dc7b991027c1deef35d in term 2.
I20260709 13:03:38.690330 11653 consensus_queue.cc:237] T a75eed46652c4944b6302c9569235569 P e3760873d2be4dc7b991027c1deef35d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:38.696846 11616 raft_consensus.cc:993] T 3ff2fc0ffa2f4ac08a92984cfd462344 P e3760873d2be4dc7b991027c1deef35d: : Instructing follower 7eb6f135338f4b84b60b7e67ab3d81d7 to start an election
I20260709 13:03:38.697325 11616 raft_consensus.cc:1081] T 3ff2fc0ffa2f4ac08a92984cfd462344 P e3760873d2be4dc7b991027c1deef35d [term 1 LEADER]: Signalling peer 7eb6f135338f4b84b60b7e67ab3d81d7 to start an election
I20260709 13:03:38.701517 11403 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3ff2fc0ffa2f4ac08a92984cfd462344"
dest_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7"
 from {username='slave'} at 127.0.0.1:35442
I20260709 13:03:38.702216 11403 raft_consensus.cc:493] T 3ff2fc0ffa2f4ac08a92984cfd462344 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:38.702651 11403 raft_consensus.cc:3060] T 3ff2fc0ffa2f4ac08a92984cfd462344 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:38.704773 11473 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d1ada73b7855443da29b368f50229412"
dest_uuid: "57da47b50bc847c997f07dccaeae280a"
 from {username='slave'} at 127.0.0.1:41474
I20260709 13:03:38.705456 11473 raft_consensus.cc:493] T d1ada73b7855443da29b368f50229412 P 57da47b50bc847c997f07dccaeae280a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:38.705855 11473 raft_consensus.cc:3060] T d1ada73b7855443da29b368f50229412 P 57da47b50bc847c997f07dccaeae280a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:38.711347 11654 raft_consensus.cc:993] T afdaf36d81c44e9db29f10e201b31e8c P e3760873d2be4dc7b991027c1deef35d: : Instructing follower 7eb6f135338f4b84b60b7e67ab3d81d7 to start an election
I20260709 13:03:38.713536 11225 catalog_manager.cc:5697] T bb4c61cb73ed4c488c741fd69f447642 P e3760873d2be4dc7b991027c1deef35d reported cstate change: term changed from 1 to 2, leader changed from 7eb6f135338f4b84b60b7e67ab3d81d7 (127.0.107.194) to e3760873d2be4dc7b991027c1deef35d (127.0.107.193). New cstate: current_term: 2 leader_uuid: "e3760873d2be4dc7b991027c1deef35d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:38.714259 11654 raft_consensus.cc:1081] T afdaf36d81c44e9db29f10e201b31e8c P e3760873d2be4dc7b991027c1deef35d [term 1 LEADER]: Signalling peer 7eb6f135338f4b84b60b7e67ab3d81d7 to start an election
I20260709 13:03:38.717751 11473 raft_consensus.cc:515] T d1ada73b7855443da29b368f50229412 P 57da47b50bc847c997f07dccaeae280a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:38.721779 11400 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "afdaf36d81c44e9db29f10e201b31e8c"
dest_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7"
 from {username='slave'} at 127.0.0.1:35442
I20260709 13:03:38.721834 11403 raft_consensus.cc:515] T 3ff2fc0ffa2f4ac08a92984cfd462344 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:38.722595 11400 raft_consensus.cc:493] T afdaf36d81c44e9db29f10e201b31e8c P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:38.722999 11400 raft_consensus.cc:3060] T afdaf36d81c44e9db29f10e201b31e8c P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:38.723273 11401 raft_consensus.cc:1240] T 3ff2fc0ffa2f4ac08a92984cfd462344 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 2 FOLLOWER]: Rejecting Update request from peer e3760873d2be4dc7b991027c1deef35d for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:38.725482 11225 catalog_manager.cc:5697] T 14457af646fe430aa855e47d42721a17 P e3760873d2be4dc7b991027c1deef35d reported cstate change: term changed from 1 to 2, leader changed from 7eb6f135338f4b84b60b7e67ab3d81d7 (127.0.107.194) to e3760873d2be4dc7b991027c1deef35d (127.0.107.193). New cstate: current_term: 2 leader_uuid: "e3760873d2be4dc7b991027c1deef35d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:38.726970 11472 raft_consensus.cc:1240] T d1ada73b7855443da29b368f50229412 P 57da47b50bc847c997f07dccaeae280a [term 2 FOLLOWER]: Rejecting Update request from peer e3760873d2be4dc7b991027c1deef35d for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:38.731513 11691 consensus_queue.cc:1059] T 3ff2fc0ffa2f4ac08a92984cfd462344 P e3760873d2be4dc7b991027c1deef35d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:38.733426 11616 raft_consensus.cc:3055] T 3ff2fc0ffa2f4ac08a92984cfd462344 P e3760873d2be4dc7b991027c1deef35d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:38.733799 11616 raft_consensus.cc:740] T 3ff2fc0ffa2f4ac08a92984cfd462344 P e3760873d2be4dc7b991027c1deef35d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e3760873d2be4dc7b991027c1deef35d, State: Running, Role: LEADER
I20260709 13:03:38.734625 11616 consensus_queue.cc:260] T 3ff2fc0ffa2f4ac08a92984cfd462344 P e3760873d2be4dc7b991027c1deef35d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:38.735805 11616 raft_consensus.cc:3060] T 3ff2fc0ffa2f4ac08a92984cfd462344 P e3760873d2be4dc7b991027c1deef35d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:38.739157 11654 consensus_queue.cc:1059] T d1ada73b7855443da29b368f50229412 P e3760873d2be4dc7b991027c1deef35d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:38.742415 11473 leader_election.cc:290] T d1ada73b7855443da29b368f50229412 P 57da47b50bc847c997f07dccaeae280a [CANDIDATE]: Term 2 election: Requested vote from peers e3760873d2be4dc7b991027c1deef35d (127.0.107.193:35003), 7eb6f135338f4b84b60b7e67ab3d81d7 (127.0.107.194:42689)
I20260709 13:03:38.743121 11328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ada73b7855443da29b368f50229412" candidate_uuid: "57da47b50bc847c997f07dccaeae280a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e3760873d2be4dc7b991027c1deef35d"
I20260709 13:03:38.743628 11401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ada73b7855443da29b368f50229412" candidate_uuid: "57da47b50bc847c997f07dccaeae280a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7"
I20260709 13:03:38.740667 11654 raft_consensus.cc:3055] T d1ada73b7855443da29b368f50229412 P e3760873d2be4dc7b991027c1deef35d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:38.744340 11401 raft_consensus.cc:3060] T d1ada73b7855443da29b368f50229412 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:38.744908 11654 raft_consensus.cc:740] T d1ada73b7855443da29b368f50229412 P e3760873d2be4dc7b991027c1deef35d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e3760873d2be4dc7b991027c1deef35d, State: Running, Role: LEADER
I20260709 13:03:38.746039 11654 consensus_queue.cc:260] T d1ada73b7855443da29b368f50229412 P e3760873d2be4dc7b991027c1deef35d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:38.747550 11654 raft_consensus.cc:3060] T d1ada73b7855443da29b368f50229412 P e3760873d2be4dc7b991027c1deef35d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:38.752728 11327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2fc0ffa2f4ac08a92984cfd462344" candidate_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e3760873d2be4dc7b991027c1deef35d"
I20260709 13:03:38.753443 11403 leader_election.cc:290] T 3ff2fc0ffa2f4ac08a92984cfd462344 P 7eb6f135338f4b84b60b7e67ab3d81d7 [CANDIDATE]: Term 2 election: Requested vote from peers e3760873d2be4dc7b991027c1deef35d (127.0.107.193:35003), 57da47b50bc847c997f07dccaeae280a (127.0.107.195:37515)
I20260709 13:03:38.753580 11473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff2fc0ffa2f4ac08a92984cfd462344" candidate_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "57da47b50bc847c997f07dccaeae280a"
I20260709 13:03:38.754299 11473 raft_consensus.cc:3060] T 3ff2fc0ffa2f4ac08a92984cfd462344 P 57da47b50bc847c997f07dccaeae280a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:38.758540 11327 raft_consensus.cc:2468] T 3ff2fc0ffa2f4ac08a92984cfd462344 P e3760873d2be4dc7b991027c1deef35d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7eb6f135338f4b84b60b7e67ab3d81d7 in term 2.
I20260709 13:03:38.751924 11224 catalog_manager.cc:5697] T 03c55f66aaf043bba6a0c8d64fbddf0e P 7eb6f135338f4b84b60b7e67ab3d81d7 reported cstate change: term changed from 1 to 2, leader changed from e3760873d2be4dc7b991027c1deef35d (127.0.107.193) to 7eb6f135338f4b84b60b7e67ab3d81d7 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:38.759859 11369 leader_election.cc:304] T 3ff2fc0ffa2f4ac08a92984cfd462344 P 7eb6f135338f4b84b60b7e67ab3d81d7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7eb6f135338f4b84b60b7e67ab3d81d7, e3760873d2be4dc7b991027c1deef35d; no voters: 
I20260709 13:03:38.760767 11649 raft_consensus.cc:2804] T 3ff2fc0ffa2f4ac08a92984cfd462344 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:38.761250 11649 raft_consensus.cc:697] T 3ff2fc0ffa2f4ac08a92984cfd462344 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 2 LEADER]: Becoming Leader. State: Replica: 7eb6f135338f4b84b60b7e67ab3d81d7, State: Running, Role: LEADER
I20260709 13:03:38.762024 11649 consensus_queue.cc:237] T 3ff2fc0ffa2f4ac08a92984cfd462344 P 7eb6f135338f4b84b60b7e67ab3d81d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:38.762581 11473 raft_consensus.cc:2468] T 3ff2fc0ffa2f4ac08a92984cfd462344 P 57da47b50bc847c997f07dccaeae280a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7eb6f135338f4b84b60b7e67ab3d81d7 in term 2.
I20260709 13:03:38.766065 11328 raft_consensus.cc:2468] T d1ada73b7855443da29b368f50229412 P e3760873d2be4dc7b991027c1deef35d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57da47b50bc847c997f07dccaeae280a in term 2.
I20260709 13:03:38.771286 11400 raft_consensus.cc:515] T afdaf36d81c44e9db29f10e201b31e8c P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:38.772234 11402 raft_consensus.cc:1240] T afdaf36d81c44e9db29f10e201b31e8c P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 2 FOLLOWER]: Rejecting Update request from peer e3760873d2be4dc7b991027c1deef35d for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:38.773351 11400 leader_election.cc:290] T afdaf36d81c44e9db29f10e201b31e8c P 7eb6f135338f4b84b60b7e67ab3d81d7 [CANDIDATE]: Term 2 election: Requested vote from peers e3760873d2be4dc7b991027c1deef35d (127.0.107.193:35003), 57da47b50bc847c997f07dccaeae280a (127.0.107.195:37515)
I20260709 13:03:38.774497 11654 consensus_queue.cc:1059] T afdaf36d81c44e9db29f10e201b31e8c P e3760873d2be4dc7b991027c1deef35d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:38.775309 11401 raft_consensus.cc:2468] T d1ada73b7855443da29b368f50229412 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57da47b50bc847c997f07dccaeae280a in term 2.
I20260709 13:03:38.775504 11654 raft_consensus.cc:3055] T afdaf36d81c44e9db29f10e201b31e8c P e3760873d2be4dc7b991027c1deef35d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:38.775584 11443 leader_election.cc:304] T d1ada73b7855443da29b368f50229412 P 57da47b50bc847c997f07dccaeae280a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57da47b50bc847c997f07dccaeae280a, e3760873d2be4dc7b991027c1deef35d; no voters: 
I20260709 13:03:38.776064 11654 raft_consensus.cc:740] T afdaf36d81c44e9db29f10e201b31e8c P e3760873d2be4dc7b991027c1deef35d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e3760873d2be4dc7b991027c1deef35d, State: Running, Role: LEADER
I20260709 13:03:38.776307 11473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdaf36d81c44e9db29f10e201b31e8c" candidate_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "57da47b50bc847c997f07dccaeae280a"
I20260709 13:03:38.776954 11473 raft_consensus.cc:3060] T afdaf36d81c44e9db29f10e201b31e8c P 57da47b50bc847c997f07dccaeae280a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:38.776921 11654 consensus_queue.cc:260] T afdaf36d81c44e9db29f10e201b31e8c P e3760873d2be4dc7b991027c1deef35d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:38.777770 11694 raft_consensus.cc:2804] T d1ada73b7855443da29b368f50229412 P 57da47b50bc847c997f07dccaeae280a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:38.778255 11694 raft_consensus.cc:697] T d1ada73b7855443da29b368f50229412 P 57da47b50bc847c997f07dccaeae280a [term 2 LEADER]: Becoming Leader. State: Replica: 57da47b50bc847c997f07dccaeae280a, State: Running, Role: LEADER
I20260709 13:03:38.779232 11694 consensus_queue.cc:237] T d1ada73b7855443da29b368f50229412 P 57da47b50bc847c997f07dccaeae280a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:38.779908 11327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdaf36d81c44e9db29f10e201b31e8c" candidate_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e3760873d2be4dc7b991027c1deef35d"
I20260709 13:03:38.779537 11225 catalog_manager.cc:5697] T a75eed46652c4944b6302c9569235569 P e3760873d2be4dc7b991027c1deef35d reported cstate change: term changed from 1 to 2, leader changed from 7eb6f135338f4b84b60b7e67ab3d81d7 (127.0.107.194) to e3760873d2be4dc7b991027c1deef35d (127.0.107.193). New cstate: current_term: 2 leader_uuid: "e3760873d2be4dc7b991027c1deef35d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:38.778255 11654 raft_consensus.cc:3060] T afdaf36d81c44e9db29f10e201b31e8c P e3760873d2be4dc7b991027c1deef35d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:38.784375 11473 raft_consensus.cc:2468] T afdaf36d81c44e9db29f10e201b31e8c P 57da47b50bc847c997f07dccaeae280a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7eb6f135338f4b84b60b7e67ab3d81d7 in term 2.
I20260709 13:03:38.785645 11369 leader_election.cc:304] T afdaf36d81c44e9db29f10e201b31e8c P 7eb6f135338f4b84b60b7e67ab3d81d7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57da47b50bc847c997f07dccaeae280a, 7eb6f135338f4b84b60b7e67ab3d81d7; no voters: 
I20260709 13:03:38.786466 11649 raft_consensus.cc:2804] T afdaf36d81c44e9db29f10e201b31e8c P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:38.786970 11649 raft_consensus.cc:697] T afdaf36d81c44e9db29f10e201b31e8c P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 2 LEADER]: Becoming Leader. State: Replica: 7eb6f135338f4b84b60b7e67ab3d81d7, State: Running, Role: LEADER
I20260709 13:03:38.787775 11649 consensus_queue.cc:237] T afdaf36d81c44e9db29f10e201b31e8c P 7eb6f135338f4b84b60b7e67ab3d81d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:38.796146 11327 raft_consensus.cc:2468] T afdaf36d81c44e9db29f10e201b31e8c P e3760873d2be4dc7b991027c1deef35d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7eb6f135338f4b84b60b7e67ab3d81d7 in term 2.
I20260709 13:03:38.798848 11226 catalog_manager.cc:5697] T d1ada73b7855443da29b368f50229412 P 57da47b50bc847c997f07dccaeae280a reported cstate change: term changed from 1 to 2, leader changed from e3760873d2be4dc7b991027c1deef35d (127.0.107.193) to 57da47b50bc847c997f07dccaeae280a (127.0.107.195). New cstate: current_term: 2 leader_uuid: "57da47b50bc847c997f07dccaeae280a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:38.806710 11224 catalog_manager.cc:5697] T 3ff2fc0ffa2f4ac08a92984cfd462344 P 7eb6f135338f4b84b60b7e67ab3d81d7 reported cstate change: term changed from 1 to 2, leader changed from e3760873d2be4dc7b991027c1deef35d (127.0.107.193) to 7eb6f135338f4b84b60b7e67ab3d81d7 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:38.808344 11224 catalog_manager.cc:5697] T afdaf36d81c44e9db29f10e201b31e8c P 7eb6f135338f4b84b60b7e67ab3d81d7 reported cstate change: term changed from 1 to 2, leader changed from e3760873d2be4dc7b991027c1deef35d (127.0.107.193) to 7eb6f135338f4b84b60b7e67ab3d81d7 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:38.867046 11327 raft_consensus.cc:1275] T e812d0605d24436989fb6ec2c868d47c P e3760873d2be4dc7b991027c1deef35d [term 2 FOLLOWER]: Refusing update from remote peer 7eb6f135338f4b84b60b7e67ab3d81d7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:38.868222 11649 consensus_queue.cc:1048] T e812d0605d24436989fb6ec2c868d47c P 7eb6f135338f4b84b60b7e67ab3d81d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:38.875517 11473 raft_consensus.cc:3060] T e812d0605d24436989fb6ec2c868d47c P 57da47b50bc847c997f07dccaeae280a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:38.882748 11473 raft_consensus.cc:1275] T e812d0605d24436989fb6ec2c868d47c P 57da47b50bc847c997f07dccaeae280a [term 2 FOLLOWER]: Refusing update from remote peer 7eb6f135338f4b84b60b7e67ab3d81d7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:38.884022 11649 consensus_queue.cc:1048] T e812d0605d24436989fb6ec2c868d47c P 7eb6f135338f4b84b60b7e67ab3d81d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:39.025447 11473 raft_consensus.cc:1275] T 14457af646fe430aa855e47d42721a17 P 57da47b50bc847c997f07dccaeae280a [term 2 FOLLOWER]: Refusing update from remote peer e3760873d2be4dc7b991027c1deef35d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:39.026799 11654 consensus_queue.cc:1048] T 14457af646fe430aa855e47d42721a17 P e3760873d2be4dc7b991027c1deef35d [LEADER]: Connected to new peer: Peer: permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:39.034407 11401 raft_consensus.cc:1275] T 14457af646fe430aa855e47d42721a17 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 2 FOLLOWER]: Refusing update from remote peer e3760873d2be4dc7b991027c1deef35d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:39.035979 11654 consensus_queue.cc:1048] T 14457af646fe430aa855e47d42721a17 P e3760873d2be4dc7b991027c1deef35d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:39.090931 11473 raft_consensus.cc:1275] T bb4c61cb73ed4c488c741fd69f447642 P 57da47b50bc847c997f07dccaeae280a [term 2 FOLLOWER]: Refusing update from remote peer e3760873d2be4dc7b991027c1deef35d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:39.092265 11654 consensus_queue.cc:1048] T bb4c61cb73ed4c488c741fd69f447642 P e3760873d2be4dc7b991027c1deef35d [LEADER]: Connected to new peer: Peer: permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:39.100183 11401 raft_consensus.cc:1275] T bb4c61cb73ed4c488c741fd69f447642 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 2 FOLLOWER]: Refusing update from remote peer e3760873d2be4dc7b991027c1deef35d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:39.101737 11654 consensus_queue.cc:1048] T bb4c61cb73ed4c488c741fd69f447642 P e3760873d2be4dc7b991027c1deef35d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:39.148170 11472 raft_consensus.cc:1275] T a75eed46652c4944b6302c9569235569 P 57da47b50bc847c997f07dccaeae280a [term 2 FOLLOWER]: Refusing update from remote peer e3760873d2be4dc7b991027c1deef35d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:39.149645 11654 consensus_queue.cc:1048] T a75eed46652c4944b6302c9569235569 P e3760873d2be4dc7b991027c1deef35d [LEADER]: Connected to new peer: Peer: permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:39.159173 11401 raft_consensus.cc:1275] T a75eed46652c4944b6302c9569235569 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 2 FOLLOWER]: Refusing update from remote peer e3760873d2be4dc7b991027c1deef35d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:39.160619 11654 consensus_queue.cc:1048] T a75eed46652c4944b6302c9569235569 P e3760873d2be4dc7b991027c1deef35d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:39.176265 11472 raft_consensus.cc:1275] T 03c55f66aaf043bba6a0c8d64fbddf0e P 57da47b50bc847c997f07dccaeae280a [term 2 FOLLOWER]: Refusing update from remote peer 7eb6f135338f4b84b60b7e67ab3d81d7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:39.177449 11649 consensus_queue.cc:1048] T 03c55f66aaf043bba6a0c8d64fbddf0e P 7eb6f135338f4b84b60b7e67ab3d81d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:39.185204 11327 raft_consensus.cc:1275] T 03c55f66aaf043bba6a0c8d64fbddf0e P e3760873d2be4dc7b991027c1deef35d [term 2 FOLLOWER]: Refusing update from remote peer 7eb6f135338f4b84b60b7e67ab3d81d7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:39.186774 11629 consensus_queue.cc:1048] T 03c55f66aaf043bba6a0c8d64fbddf0e P 7eb6f135338f4b84b60b7e67ab3d81d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:39.210853 11327 raft_consensus.cc:1275] T d1ada73b7855443da29b368f50229412 P e3760873d2be4dc7b991027c1deef35d [term 2 FOLLOWER]: Refusing update from remote peer 57da47b50bc847c997f07dccaeae280a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:39.212203 11668 consensus_queue.cc:1048] T d1ada73b7855443da29b368f50229412 P 57da47b50bc847c997f07dccaeae280a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:39.215224 11472 raft_consensus.cc:1275] T 3ff2fc0ffa2f4ac08a92984cfd462344 P 57da47b50bc847c997f07dccaeae280a [term 2 FOLLOWER]: Refusing update from remote peer 7eb6f135338f4b84b60b7e67ab3d81d7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:39.216603 11649 consensus_queue.cc:1048] T 3ff2fc0ffa2f4ac08a92984cfd462344 P 7eb6f135338f4b84b60b7e67ab3d81d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:39.221868 11400 raft_consensus.cc:1275] T d1ada73b7855443da29b368f50229412 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 2 FOLLOWER]: Refusing update from remote peer 57da47b50bc847c997f07dccaeae280a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:39.223989 11668 consensus_queue.cc:1048] T d1ada73b7855443da29b368f50229412 P 57da47b50bc847c997f07dccaeae280a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:39.231184 11327 raft_consensus.cc:1275] T 3ff2fc0ffa2f4ac08a92984cfd462344 P e3760873d2be4dc7b991027c1deef35d [term 2 FOLLOWER]: Refusing update from remote peer 7eb6f135338f4b84b60b7e67ab3d81d7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:39.233448 11629 consensus_queue.cc:1048] T 3ff2fc0ffa2f4ac08a92984cfd462344 P 7eb6f135338f4b84b60b7e67ab3d81d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:39.299206 11472 raft_consensus.cc:1275] T afdaf36d81c44e9db29f10e201b31e8c P 57da47b50bc847c997f07dccaeae280a [term 2 FOLLOWER]: Refusing update from remote peer 7eb6f135338f4b84b60b7e67ab3d81d7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:39.300473 11629 consensus_queue.cc:1048] T afdaf36d81c44e9db29f10e201b31e8c P 7eb6f135338f4b84b60b7e67ab3d81d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:39.310700 11328 raft_consensus.cc:1275] T afdaf36d81c44e9db29f10e201b31e8c P e3760873d2be4dc7b991027c1deef35d [term 2 FOLLOWER]: Refusing update from remote peer 7eb6f135338f4b84b60b7e67ab3d81d7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:39.313452 11704 consensus_queue.cc:1048] T afdaf36d81c44e9db29f10e201b31e8c P 7eb6f135338f4b84b60b7e67ab3d81d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:41.366230 11225 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59242:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:03:41.385274 11225 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59242:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:03:41.441663   431 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:03:41.543901 11740 tablet.cc:1724] T 03c55f66aaf043bba6a0c8d64fbddf0e P 7eb6f135338f4b84b60b7e67ab3d81d7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:03:41.593063 11737 log.cc:927] Time spent T afdaf36d81c44e9db29f10e201b31e8c P 57da47b50bc847c997f07dccaeae280a: Append to log took a long time: real 0.054s	user 0.000s	sys 0.002s
W20260709 13:03:41.607225 11723 log.cc:927] Time spent T bb4c61cb73ed4c488c741fd69f447642 P e3760873d2be4dc7b991027c1deef35d: Append to log took a long time: real 0.058s	user 0.001s	sys 0.001s
I20260709 13:03:41.625444 11752 tablet.cc:1724] T 03c55f66aaf043bba6a0c8d64fbddf0e P e3760873d2be4dc7b991027c1deef35d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:41.659736 11751 tablet.cc:1724] T a75eed46652c4944b6302c9569235569 P e3760873d2be4dc7b991027c1deef35d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:03:41.658793 11738 log.cc:927] Time spent T 3ff2fc0ffa2f4ac08a92984cfd462344 P 7eb6f135338f4b84b60b7e67ab3d81d7: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
W20260709 13:03:41.664628 11722 log.cc:927] Time spent T afdaf36d81c44e9db29f10e201b31e8c P 7eb6f135338f4b84b60b7e67ab3d81d7: Append to log took a long time: real 0.196s	user 0.005s	sys 0.000s
W20260709 13:03:41.704231 11294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:37515, user_credentials={real_user=slave}} blocked reactor thread for 134090us
W20260709 13:03:41.704365 11292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:42689, user_credentials={real_user=slave}} blocked reactor thread for 53399.8us
W20260709 13:03:41.720983 11731 log.cc:927] Time spent T a39eb6d3a8b641d88c8c8bfedce391ed P e3760873d2be4dc7b991027c1deef35d: Append to log took a long time: real 0.179s	user 0.004s	sys 0.000s
W20260709 13:03:41.743324 11739 log.cc:927] Time spent T a75eed46652c4944b6302c9569235569 P 7eb6f135338f4b84b60b7e67ab3d81d7: Append to log took a long time: real 0.191s	user 0.000s	sys 0.003s
W20260709 13:03:41.748662 11742 log.cc:927] Time spent T e812d0605d24436989fb6ec2c868d47c P 57da47b50bc847c997f07dccaeae280a: Append to log took a long time: real 0.196s	user 0.001s	sys 0.002s
W20260709 13:03:41.775728 11721 log.cc:927] Time spent T 14457af646fe430aa855e47d42721a17 P e3760873d2be4dc7b991027c1deef35d: Append to log took a long time: real 0.219s	user 0.003s	sys 0.000s
W20260709 13:03:41.788496 11443 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35003, user_credentials={real_user=slave}} blocked reactor thread for 72077.3us
I20260709 13:03:41.796079 11761 tablet.cc:1724] T afdaf36d81c44e9db29f10e201b31e8c P 7eb6f135338f4b84b60b7e67ab3d81d7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:41.807863 11758 tablet.cc:1724] T bb4c61cb73ed4c488c741fd69f447642 P e3760873d2be4dc7b991027c1deef35d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:41.806347 11759 tablet.cc:1724] T d1ada73b7855443da29b368f50229412 P 57da47b50bc847c997f07dccaeae280a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:41.806165 11401 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "03c55f66aaf043bba6a0c8d64fbddf0e"
dest_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7"
mode: GRACEFUL
new_leader_uuid: "57da47b50bc847c997f07dccaeae280a"
 from {username='slave'} at 127.0.0.1:60412
I20260709 13:03:41.816349 11401 raft_consensus.cc:606] T 03c55f66aaf043bba6a0c8d64fbddf0e P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 2 LEADER]: Received request to transfer leadership to TS 57da47b50bc847c997f07dccaeae280a
I20260709 13:03:41.852608 11740 tablet.cc:1724] T 3ff2fc0ffa2f4ac08a92984cfd462344 P 7eb6f135338f4b84b60b7e67ab3d81d7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:41.866726 11762 tablet.cc:1724] T e812d0605d24436989fb6ec2c868d47c P 7eb6f135338f4b84b60b7e67ab3d81d7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:41.896775 11752 tablet.cc:1724] T afdaf36d81c44e9db29f10e201b31e8c P e3760873d2be4dc7b991027c1deef35d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:41.914836 11765 tablet.cc:1724] T bb4c61cb73ed4c488c741fd69f447642 P 7eb6f135338f4b84b60b7e67ab3d81d7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:41.917338 11769 tablet.cc:1724] T 14457af646fe430aa855e47d42721a17 P e3760873d2be4dc7b991027c1deef35d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:41.927656 11762 tablet.cc:1724] T 14457af646fe430aa855e47d42721a17 P 7eb6f135338f4b84b60b7e67ab3d81d7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:41.913815 11774 tablet.cc:1724] T afdaf36d81c44e9db29f10e201b31e8c P 57da47b50bc847c997f07dccaeae280a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:41.905918 11773 tablet.cc:1724] T e812d0605d24436989fb6ec2c868d47c P 57da47b50bc847c997f07dccaeae280a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:41.936496 11740 tablet.cc:1724] T a75eed46652c4944b6302c9569235569 P 7eb6f135338f4b84b60b7e67ab3d81d7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:41.948076 11761 tablet.cc:1724] T d1ada73b7855443da29b368f50229412 P 7eb6f135338f4b84b60b7e67ab3d81d7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:41.959465 11752 tablet.cc:1724] T 3ff2fc0ffa2f4ac08a92984cfd462344 P e3760873d2be4dc7b991027c1deef35d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:41.962924 11629 raft_consensus.cc:993] T 03c55f66aaf043bba6a0c8d64fbddf0e P 7eb6f135338f4b84b60b7e67ab3d81d7: : Instructing follower 57da47b50bc847c997f07dccaeae280a to start an election
I20260709 13:03:41.963637 11649 raft_consensus.cc:1081] T 03c55f66aaf043bba6a0c8d64fbddf0e P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 2 LEADER]: Signalling peer 57da47b50bc847c997f07dccaeae280a to start an election
I20260709 13:03:41.971758 11472 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "03c55f66aaf043bba6a0c8d64fbddf0e"
dest_uuid: "57da47b50bc847c997f07dccaeae280a"
 from {username='slave'} at 127.0.0.1:41480
I20260709 13:03:41.972443 11472 raft_consensus.cc:493] T 03c55f66aaf043bba6a0c8d64fbddf0e P 57da47b50bc847c997f07dccaeae280a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:41.972949 11472 raft_consensus.cc:3060] T 03c55f66aaf043bba6a0c8d64fbddf0e P 57da47b50bc847c997f07dccaeae280a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:41.912571 11768 tablet.cc:1724] T a75eed46652c4944b6302c9569235569 P 57da47b50bc847c997f07dccaeae280a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:41.982205 11751 tablet.cc:1724] T e812d0605d24436989fb6ec2c868d47c P e3760873d2be4dc7b991027c1deef35d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:41.987519 11759 tablet.cc:1724] T 3ff2fc0ffa2f4ac08a92984cfd462344 P 57da47b50bc847c997f07dccaeae280a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:42.005939 11768 tablet.cc:1724] T bb4c61cb73ed4c488c741fd69f447642 P 57da47b50bc847c997f07dccaeae280a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:42.029022 11752 tablet.cc:1724] T d1ada73b7855443da29b368f50229412 P e3760873d2be4dc7b991027c1deef35d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:42.030112 11758 tablet.cc:1724] T a39eb6d3a8b641d88c8c8bfedce391ed P e3760873d2be4dc7b991027c1deef35d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:42.033707 11324 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bb4c61cb73ed4c488c741fd69f447642"
dest_uuid: "e3760873d2be4dc7b991027c1deef35d"
mode: GRACEFUL
new_leader_uuid: "57da47b50bc847c997f07dccaeae280a"
 from {username='slave'} at 127.0.0.1:40496
I20260709 13:03:42.041760 11324 raft_consensus.cc:606] T bb4c61cb73ed4c488c741fd69f447642 P e3760873d2be4dc7b991027c1deef35d [term 2 LEADER]: Received request to transfer leadership to TS 57da47b50bc847c997f07dccaeae280a
I20260709 13:03:42.041635 11762 tablet.cc:1724] T a39eb6d3a8b641d88c8c8bfedce391ed P 7eb6f135338f4b84b60b7e67ab3d81d7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:42.043766   431 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 13:03:42.045219   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:42.024289 11773 tablet.cc:1724] T 14457af646fe430aa855e47d42721a17 P 57da47b50bc847c997f07dccaeae280a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:42.026523 11472 raft_consensus.cc:515] T 03c55f66aaf043bba6a0c8d64fbddf0e P 57da47b50bc847c997f07dccaeae280a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:42.047008 11474 raft_consensus.cc:1240] T 03c55f66aaf043bba6a0c8d64fbddf0e P 57da47b50bc847c997f07dccaeae280a [term 3 FOLLOWER]: Rejecting Update request from peer 7eb6f135338f4b84b60b7e67ab3d81d7 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:42.049686 11401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c55f66aaf043bba6a0c8d64fbddf0e" candidate_uuid: "57da47b50bc847c997f07dccaeae280a" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7"
I20260709 13:03:42.050500 11401 raft_consensus.cc:3055] T 03c55f66aaf043bba6a0c8d64fbddf0e P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:42.050853 11401 raft_consensus.cc:740] T 03c55f66aaf043bba6a0c8d64fbddf0e P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7eb6f135338f4b84b60b7e67ab3d81d7, State: Running, Role: LEADER
I20260709 13:03:42.051762 11401 consensus_queue.cc:260] T 03c55f66aaf043bba6a0c8d64fbddf0e P 7eb6f135338f4b84b60b7e67ab3d81d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:42.053151 11401 raft_consensus.cc:3060] T 03c55f66aaf043bba6a0c8d64fbddf0e P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:42.057732 11324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c55f66aaf043bba6a0c8d64fbddf0e" candidate_uuid: "57da47b50bc847c997f07dccaeae280a" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "e3760873d2be4dc7b991027c1deef35d"
I20260709 13:03:42.058497 11324 raft_consensus.cc:3060] T 03c55f66aaf043bba6a0c8d64fbddf0e P e3760873d2be4dc7b991027c1deef35d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:42.062899 11472 leader_election.cc:290] T 03c55f66aaf043bba6a0c8d64fbddf0e P 57da47b50bc847c997f07dccaeae280a [CANDIDATE]: Term 3 election: Requested vote from peers e3760873d2be4dc7b991027c1deef35d (127.0.107.193:35003), 7eb6f135338f4b84b60b7e67ab3d81d7 (127.0.107.194:42689)
I20260709 13:03:42.067312 11399 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b35e87dce47b43119d13bd514d434a76"
dest_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7"
mode: GRACEFUL
new_leader_uuid: "57da47b50bc847c997f07dccaeae280a"
 from {username='slave'} at 127.0.0.1:60412
I20260709 13:03:42.068017 11399 raft_consensus.cc:606] T b35e87dce47b43119d13bd514d434a76 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 LEADER]: Received request to transfer leadership to TS 57da47b50bc847c997f07dccaeae280a
I20260709 13:03:42.068245 11768 tablet.cc:1724] T a39eb6d3a8b641d88c8c8bfedce391ed P 57da47b50bc847c997f07dccaeae280a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:42.072502 11399 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ec9a5210a9a84816bc2d263d456f9a93"
dest_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7"
mode: GRACEFUL
new_leader_uuid: "57da47b50bc847c997f07dccaeae280a"
 from {username='slave'} at 127.0.0.1:60412
I20260709 13:03:42.073122 11399 raft_consensus.cc:606] T ec9a5210a9a84816bc2d263d456f9a93 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 LEADER]: Received request to transfer leadership to TS 57da47b50bc847c997f07dccaeae280a
I20260709 13:03:42.076030 11324 raft_consensus.cc:2468] T 03c55f66aaf043bba6a0c8d64fbddf0e P e3760873d2be4dc7b991027c1deef35d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57da47b50bc847c997f07dccaeae280a in term 3.
I20260709 13:03:42.080518 11401 raft_consensus.cc:2468] T 03c55f66aaf043bba6a0c8d64fbddf0e P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57da47b50bc847c997f07dccaeae280a in term 3.
I20260709 13:03:42.084784   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:03:42.085100 11443 leader_election.cc:304] T 03c55f66aaf043bba6a0c8d64fbddf0e P 57da47b50bc847c997f07dccaeae280a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57da47b50bc847c997f07dccaeae280a, e3760873d2be4dc7b991027c1deef35d; no voters: 
I20260709 13:03:42.085491   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:42.086208 11771 raft_consensus.cc:2804] T 03c55f66aaf043bba6a0c8d64fbddf0e P 57da47b50bc847c997f07dccaeae280a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:42.087697 11771 raft_consensus.cc:697] T 03c55f66aaf043bba6a0c8d64fbddf0e P 57da47b50bc847c997f07dccaeae280a [term 3 LEADER]: Becoming Leader. State: Replica: 57da47b50bc847c997f07dccaeae280a, State: Running, Role: LEADER
I20260709 13:03:42.088634 11771 consensus_queue.cc:237] T 03c55f66aaf043bba6a0c8d64fbddf0e P 57da47b50bc847c997f07dccaeae280a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:42.102109 11226 catalog_manager.cc:5697] T 03c55f66aaf043bba6a0c8d64fbddf0e P 57da47b50bc847c997f07dccaeae280a reported cstate change: term changed from 2 to 3, leader changed from 7eb6f135338f4b84b60b7e67ab3d81d7 (127.0.107.194) to 57da47b50bc847c997f07dccaeae280a (127.0.107.195). New cstate: current_term: 3 leader_uuid: "57da47b50bc847c997f07dccaeae280a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:42.103430 11226 catalog_manager.cc:5789] TS 57da47b50bc847c997f07dccaeae280a (127.0.107.195:37515) does not have the latest schema for tablet 03c55f66aaf043bba6a0c8d64fbddf0e (table soft_deleted_table [id=3b24a765838145c0b49b3a4a72cb7b86]). Expected version 1 got 0
I20260709 13:03:42.104336 11224 catalog_manager.cc:6242] T 00000000000000000000000000000000 P b4c5ce56bb0448d098ee6b5c515762c5: soft_deleted_table [id=3b24a765838145c0b49b3a4a72cb7b86] alter complete (version 1)
I20260709 13:03:42.179121 11729 raft_consensus.cc:993] T bb4c61cb73ed4c488c741fd69f447642 P e3760873d2be4dc7b991027c1deef35d: : Instructing follower 57da47b50bc847c997f07dccaeae280a to start an election
I20260709 13:03:42.179785 11743 raft_consensus.cc:1081] T bb4c61cb73ed4c488c741fd69f447642 P e3760873d2be4dc7b991027c1deef35d [term 2 LEADER]: Signalling peer 57da47b50bc847c997f07dccaeae280a to start an election
I20260709 13:03:42.181597 11474 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bb4c61cb73ed4c488c741fd69f447642"
dest_uuid: "57da47b50bc847c997f07dccaeae280a"
 from {username='slave'} at 127.0.0.1:41474
I20260709 13:03:42.182260 11474 raft_consensus.cc:493] T bb4c61cb73ed4c488c741fd69f447642 P 57da47b50bc847c997f07dccaeae280a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:42.182710 11474 raft_consensus.cc:3060] T bb4c61cb73ed4c488c741fd69f447642 P 57da47b50bc847c997f07dccaeae280a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:42.191735 11474 raft_consensus.cc:515] T bb4c61cb73ed4c488c741fd69f447642 P 57da47b50bc847c997f07dccaeae280a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:42.193912 11474 leader_election.cc:290] T bb4c61cb73ed4c488c741fd69f447642 P 57da47b50bc847c997f07dccaeae280a [CANDIDATE]: Term 3 election: Requested vote from peers e3760873d2be4dc7b991027c1deef35d (127.0.107.193:35003), 7eb6f135338f4b84b60b7e67ab3d81d7 (127.0.107.194:42689)
I20260709 13:03:42.194710 11324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb4c61cb73ed4c488c741fd69f447642" candidate_uuid: "57da47b50bc847c997f07dccaeae280a" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "e3760873d2be4dc7b991027c1deef35d"
I20260709 13:03:42.195053 11399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb4c61cb73ed4c488c741fd69f447642" candidate_uuid: "57da47b50bc847c997f07dccaeae280a" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7"
I20260709 13:03:42.195474 11324 raft_consensus.cc:3055] T bb4c61cb73ed4c488c741fd69f447642 P e3760873d2be4dc7b991027c1deef35d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:42.195678 11399 raft_consensus.cc:3060] T bb4c61cb73ed4c488c741fd69f447642 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:42.195885 11324 raft_consensus.cc:740] T bb4c61cb73ed4c488c741fd69f447642 P e3760873d2be4dc7b991027c1deef35d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e3760873d2be4dc7b991027c1deef35d, State: Running, Role: LEADER
I20260709 13:03:42.196856 11324 consensus_queue.cc:260] T bb4c61cb73ed4c488c741fd69f447642 P e3760873d2be4dc7b991027c1deef35d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:42.198312 11324 raft_consensus.cc:3060] T bb4c61cb73ed4c488c741fd69f447642 P e3760873d2be4dc7b991027c1deef35d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:42.204487 11399 raft_consensus.cc:2468] T bb4c61cb73ed4c488c741fd69f447642 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57da47b50bc847c997f07dccaeae280a in term 3.
I20260709 13:03:42.205979 11324 raft_consensus.cc:2468] T bb4c61cb73ed4c488c741fd69f447642 P e3760873d2be4dc7b991027c1deef35d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57da47b50bc847c997f07dccaeae280a in term 3.
I20260709 13:03:42.206272 11441 leader_election.cc:304] T bb4c61cb73ed4c488c741fd69f447642 P 57da47b50bc847c997f07dccaeae280a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57da47b50bc847c997f07dccaeae280a, 7eb6f135338f4b84b60b7e67ab3d81d7; no voters: 
I20260709 13:03:42.207428 11771 raft_consensus.cc:2804] T bb4c61cb73ed4c488c741fd69f447642 P 57da47b50bc847c997f07dccaeae280a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:42.207928 11771 raft_consensus.cc:697] T bb4c61cb73ed4c488c741fd69f447642 P 57da47b50bc847c997f07dccaeae280a [term 3 LEADER]: Becoming Leader. State: Replica: 57da47b50bc847c997f07dccaeae280a, State: Running, Role: LEADER
I20260709 13:03:42.208779 11771 consensus_queue.cc:237] T bb4c61cb73ed4c488c741fd69f447642 P 57da47b50bc847c997f07dccaeae280a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:42.216284 11226 catalog_manager.cc:5697] T bb4c61cb73ed4c488c741fd69f447642 P 57da47b50bc847c997f07dccaeae280a reported cstate change: term changed from 2 to 3, leader changed from e3760873d2be4dc7b991027c1deef35d (127.0.107.193) to 57da47b50bc847c997f07dccaeae280a (127.0.107.195). New cstate: current_term: 3 leader_uuid: "57da47b50bc847c997f07dccaeae280a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:42.355082 11649 raft_consensus.cc:993] T ec9a5210a9a84816bc2d263d456f9a93 P 7eb6f135338f4b84b60b7e67ab3d81d7: : Instructing follower 57da47b50bc847c997f07dccaeae280a to start an election
I20260709 13:03:42.355623 11629 raft_consensus.cc:1081] T ec9a5210a9a84816bc2d263d456f9a93 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 LEADER]: Signalling peer 57da47b50bc847c997f07dccaeae280a to start an election
I20260709 13:03:42.357227 11474 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ec9a5210a9a84816bc2d263d456f9a93"
dest_uuid: "57da47b50bc847c997f07dccaeae280a"
 from {username='slave'} at 127.0.0.1:41480
I20260709 13:03:42.357730 11474 raft_consensus.cc:493] T ec9a5210a9a84816bc2d263d456f9a93 P 57da47b50bc847c997f07dccaeae280a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:42.358006 11474 raft_consensus.cc:3060] T ec9a5210a9a84816bc2d263d456f9a93 P 57da47b50bc847c997f07dccaeae280a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:42.364804 11649 raft_consensus.cc:993] T b35e87dce47b43119d13bd514d434a76 P 7eb6f135338f4b84b60b7e67ab3d81d7: : Instructing follower 57da47b50bc847c997f07dccaeae280a to start an election
I20260709 13:03:42.365388 11649 raft_consensus.cc:1081] T b35e87dce47b43119d13bd514d434a76 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 LEADER]: Signalling peer 57da47b50bc847c997f07dccaeae280a to start an election
I20260709 13:03:42.364996 11474 raft_consensus.cc:515] T ec9a5210a9a84816bc2d263d456f9a93 P 57da47b50bc847c997f07dccaeae280a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:42.366806 11472 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b35e87dce47b43119d13bd514d434a76"
dest_uuid: "57da47b50bc847c997f07dccaeae280a"
 from {username='slave'} at 127.0.0.1:41480
I20260709 13:03:42.367352 11472 raft_consensus.cc:493] T b35e87dce47b43119d13bd514d434a76 P 57da47b50bc847c997f07dccaeae280a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:42.367734 11474 leader_election.cc:290] T ec9a5210a9a84816bc2d263d456f9a93 P 57da47b50bc847c997f07dccaeae280a [CANDIDATE]: Term 2 election: Requested vote from peers e3760873d2be4dc7b991027c1deef35d (127.0.107.193:35003), 7eb6f135338f4b84b60b7e67ab3d81d7 (127.0.107.194:42689)
I20260709 13:03:42.367923 11324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9a5210a9a84816bc2d263d456f9a93" candidate_uuid: "57da47b50bc847c997f07dccaeae280a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e3760873d2be4dc7b991027c1deef35d"
I20260709 13:03:42.368552 11324 raft_consensus.cc:3060] T ec9a5210a9a84816bc2d263d456f9a93 P e3760873d2be4dc7b991027c1deef35d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:42.368597 11399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9a5210a9a84816bc2d263d456f9a93" candidate_uuid: "57da47b50bc847c997f07dccaeae280a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7"
I20260709 13:03:42.369239 11399 raft_consensus.cc:3055] T ec9a5210a9a84816bc2d263d456f9a93 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:42.369553 11399 raft_consensus.cc:740] T ec9a5210a9a84816bc2d263d456f9a93 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7eb6f135338f4b84b60b7e67ab3d81d7, State: Running, Role: LEADER
I20260709 13:03:42.370450 11399 consensus_queue.cc:260] T ec9a5210a9a84816bc2d263d456f9a93 P 7eb6f135338f4b84b60b7e67ab3d81d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:42.371856 11399 raft_consensus.cc:3060] T ec9a5210a9a84816bc2d263d456f9a93 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:42.367646 11472 raft_consensus.cc:3060] T b35e87dce47b43119d13bd514d434a76 P 57da47b50bc847c997f07dccaeae280a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:42.376456 11324 raft_consensus.cc:2468] T ec9a5210a9a84816bc2d263d456f9a93 P e3760873d2be4dc7b991027c1deef35d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57da47b50bc847c997f07dccaeae280a in term 2.
I20260709 13:03:42.377889 11443 leader_election.cc:304] T ec9a5210a9a84816bc2d263d456f9a93 P 57da47b50bc847c997f07dccaeae280a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57da47b50bc847c997f07dccaeae280a, e3760873d2be4dc7b991027c1deef35d; no voters: 
I20260709 13:03:42.378844 11771 raft_consensus.cc:2804] T ec9a5210a9a84816bc2d263d456f9a93 P 57da47b50bc847c997f07dccaeae280a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:42.379305 11771 raft_consensus.cc:697] T ec9a5210a9a84816bc2d263d456f9a93 P 57da47b50bc847c997f07dccaeae280a [term 2 LEADER]: Becoming Leader. State: Replica: 57da47b50bc847c997f07dccaeae280a, State: Running, Role: LEADER
I20260709 13:03:42.380224 11771 consensus_queue.cc:237] T ec9a5210a9a84816bc2d263d456f9a93 P 57da47b50bc847c997f07dccaeae280a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:42.383132 11472 raft_consensus.cc:515] T b35e87dce47b43119d13bd514d434a76 P 57da47b50bc847c997f07dccaeae280a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:42.389631 11399 raft_consensus.cc:2468] T ec9a5210a9a84816bc2d263d456f9a93 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57da47b50bc847c997f07dccaeae280a in term 2.
I20260709 13:03:42.390877 11324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35e87dce47b43119d13bd514d434a76" candidate_uuid: "57da47b50bc847c997f07dccaeae280a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e3760873d2be4dc7b991027c1deef35d"
I20260709 13:03:42.391604 11324 raft_consensus.cc:3060] T b35e87dce47b43119d13bd514d434a76 P e3760873d2be4dc7b991027c1deef35d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:42.391053 11226 catalog_manager.cc:5697] T ec9a5210a9a84816bc2d263d456f9a93 P 57da47b50bc847c997f07dccaeae280a reported cstate change: term changed from 1 to 2, leader changed from 7eb6f135338f4b84b60b7e67ab3d81d7 (127.0.107.194) to 57da47b50bc847c997f07dccaeae280a (127.0.107.195). New cstate: current_term: 2 leader_uuid: "57da47b50bc847c997f07dccaeae280a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:42.401952 11324 raft_consensus.cc:2468] T b35e87dce47b43119d13bd514d434a76 P e3760873d2be4dc7b991027c1deef35d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57da47b50bc847c997f07dccaeae280a in term 2.
I20260709 13:03:42.402792 11472 leader_election.cc:290] T b35e87dce47b43119d13bd514d434a76 P 57da47b50bc847c997f07dccaeae280a [CANDIDATE]: Term 2 election: Requested vote from peers e3760873d2be4dc7b991027c1deef35d (127.0.107.193:35003), 7eb6f135338f4b84b60b7e67ab3d81d7 (127.0.107.194:42689)
I20260709 13:03:42.402944 11443 leader_election.cc:304] T b35e87dce47b43119d13bd514d434a76 P 57da47b50bc847c997f07dccaeae280a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57da47b50bc847c997f07dccaeae280a, e3760873d2be4dc7b991027c1deef35d; no voters: 
I20260709 13:03:42.404805 11771 raft_consensus.cc:2804] T b35e87dce47b43119d13bd514d434a76 P 57da47b50bc847c997f07dccaeae280a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:42.405346 11771 raft_consensus.cc:697] T b35e87dce47b43119d13bd514d434a76 P 57da47b50bc847c997f07dccaeae280a [term 2 LEADER]: Becoming Leader. State: Replica: 57da47b50bc847c997f07dccaeae280a, State: Running, Role: LEADER
I20260709 13:03:42.406199 11771 consensus_queue.cc:237] T b35e87dce47b43119d13bd514d434a76 P 57da47b50bc847c997f07dccaeae280a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:42.411408 11399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b35e87dce47b43119d13bd514d434a76" candidate_uuid: "57da47b50bc847c997f07dccaeae280a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7"
I20260709 13:03:42.412125 11399 raft_consensus.cc:3055] T b35e87dce47b43119d13bd514d434a76 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:42.412462 11399 raft_consensus.cc:740] T b35e87dce47b43119d13bd514d434a76 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7eb6f135338f4b84b60b7e67ab3d81d7, State: Running, Role: LEADER
I20260709 13:03:42.413302 11399 consensus_queue.cc:260] T b35e87dce47b43119d13bd514d434a76 P 7eb6f135338f4b84b60b7e67ab3d81d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } }
I20260709 13:03:42.414490 11399 raft_consensus.cc:3060] T b35e87dce47b43119d13bd514d434a76 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:42.415683 11226 catalog_manager.cc:5697] T b35e87dce47b43119d13bd514d434a76 P 57da47b50bc847c997f07dccaeae280a reported cstate change: term changed from 1 to 2, leader changed from 7eb6f135338f4b84b60b7e67ab3d81d7 (127.0.107.194) to 57da47b50bc847c997f07dccaeae280a (127.0.107.195). New cstate: current_term: 2 leader_uuid: "57da47b50bc847c997f07dccaeae280a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57da47b50bc847c997f07dccaeae280a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37515 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:42.421577 11399 raft_consensus.cc:2468] T b35e87dce47b43119d13bd514d434a76 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57da47b50bc847c997f07dccaeae280a in term 2.
I20260709 13:03:42.589705 11324 raft_consensus.cc:1275] T bb4c61cb73ed4c488c741fd69f447642 P e3760873d2be4dc7b991027c1deef35d [term 3 FOLLOWER]: Refusing update from remote peer 57da47b50bc847c997f07dccaeae280a: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:03:42.591164 11771 consensus_queue.cc:1048] T bb4c61cb73ed4c488c741fd69f447642 P 57da47b50bc847c997f07dccaeae280a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:42.611454 11399 raft_consensus.cc:1275] T bb4c61cb73ed4c488c741fd69f447642 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 3 FOLLOWER]: Refusing update from remote peer 57da47b50bc847c997f07dccaeae280a: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:03:42.613088 11784 consensus_queue.cc:1048] T bb4c61cb73ed4c488c741fd69f447642 P 57da47b50bc847c997f07dccaeae280a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:42.654639 11399 raft_consensus.cc:1275] T 03c55f66aaf043bba6a0c8d64fbddf0e P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 3 FOLLOWER]: Refusing update from remote peer 57da47b50bc847c997f07dccaeae280a: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:03:42.655910 11784 consensus_queue.cc:1048] T 03c55f66aaf043bba6a0c8d64fbddf0e P 57da47b50bc847c997f07dccaeae280a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:42.667685 11786 tablet.cc:1724] T 03c55f66aaf043bba6a0c8d64fbddf0e P 57da47b50bc847c997f07dccaeae280a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:42.670568 11324 raft_consensus.cc:1275] T 03c55f66aaf043bba6a0c8d64fbddf0e P e3760873d2be4dc7b991027c1deef35d [term 3 FOLLOWER]: Refusing update from remote peer 57da47b50bc847c997f07dccaeae280a: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:03:42.675264 11755 consensus_queue.cc:1048] T 03c55f66aaf043bba6a0c8d64fbddf0e P 57da47b50bc847c997f07dccaeae280a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:42.689683 11786 tablet.cc:1719] T 03c55f66aaf043bba6a0c8d64fbddf0e P 57da47b50bc847c997f07dccaeae280a: Skipping requested alter to schema version 1, tablet already version 1
I20260709 13:03:42.695482 11787 tablet.cc:1719] T 03c55f66aaf043bba6a0c8d64fbddf0e P 7eb6f135338f4b84b60b7e67ab3d81d7: Skipping requested alter to schema version 1, tablet already version 1
I20260709 13:03:42.696597 11788 tablet.cc:1719] T 03c55f66aaf043bba6a0c8d64fbddf0e P e3760873d2be4dc7b991027c1deef35d: Skipping requested alter to schema version 1, tablet already version 1
I20260709 13:03:42.858718 11399 raft_consensus.cc:1275] T b35e87dce47b43119d13bd514d434a76 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 2 FOLLOWER]: Refusing update from remote peer 57da47b50bc847c997f07dccaeae280a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:42.859947 11755 consensus_queue.cc:1048] T b35e87dce47b43119d13bd514d434a76 P 57da47b50bc847c997f07dccaeae280a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:42.870594 11324 raft_consensus.cc:1275] T b35e87dce47b43119d13bd514d434a76 P e3760873d2be4dc7b991027c1deef35d [term 2 FOLLOWER]: Refusing update from remote peer 57da47b50bc847c997f07dccaeae280a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:42.872131 11784 consensus_queue.cc:1048] T b35e87dce47b43119d13bd514d434a76 P 57da47b50bc847c997f07dccaeae280a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:42.954104 11399 raft_consensus.cc:1275] T ec9a5210a9a84816bc2d263d456f9a93 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 2 FOLLOWER]: Refusing update from remote peer 57da47b50bc847c997f07dccaeae280a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:42.955328 11784 consensus_queue.cc:1048] T ec9a5210a9a84816bc2d263d456f9a93 P 57da47b50bc847c997f07dccaeae280a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7eb6f135338f4b84b60b7e67ab3d81d7" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:42.965865 11324 raft_consensus.cc:1275] T ec9a5210a9a84816bc2d263d456f9a93 P e3760873d2be4dc7b991027c1deef35d [term 2 FOLLOWER]: Refusing update from remote peer 57da47b50bc847c997f07dccaeae280a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:42.968464 11755 consensus_queue.cc:1048] T ec9a5210a9a84816bc2d263d456f9a93 P 57da47b50bc847c997f07dccaeae280a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3760873d2be4dc7b991027c1deef35d" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:43.144495   431 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:03:43.149631   431 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 13:03:43.150063   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:43.154829   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:03:43.155246   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:44.187098   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
W20260709 13:03:44.190024 11369 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 4 similar messages]
W20260709 13:03:44.193919 11369 consensus_peers.cc:597] T dd5040fb5b614dd2990e57812dadd3b7 P 7eb6f135338f4b84b60b7e67ab3d81d7 -> Peer e3760873d2be4dc7b991027c1deef35d (127.0.107.193:35003): Couldn't send request to peer e3760873d2be4dc7b991027c1deef35d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:44.217707 11369 consensus_peers.cc:597] T 3ff2fc0ffa2f4ac08a92984cfd462344 P 7eb6f135338f4b84b60b7e67ab3d81d7 -> Peer e3760873d2be4dc7b991027c1deef35d (127.0.107.193:35003): Couldn't send request to peer e3760873d2be4dc7b991027c1deef35d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:44.220530   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:44.221374   431 tablet_replica.cc:333] T d1ada73b7855443da29b368f50229412 P e3760873d2be4dc7b991027c1deef35d: stopping tablet replica
I20260709 13:03:44.222214   431 raft_consensus.cc:2243] T d1ada73b7855443da29b368f50229412 P e3760873d2be4dc7b991027c1deef35d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.222795   431 raft_consensus.cc:2272] T d1ada73b7855443da29b368f50229412 P e3760873d2be4dc7b991027c1deef35d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.224953   431 tablet_replica.cc:333] T a75eed46652c4944b6302c9569235569 P e3760873d2be4dc7b991027c1deef35d: stopping tablet replica
I20260709 13:03:44.225631   431 raft_consensus.cc:2243] T a75eed46652c4944b6302c9569235569 P e3760873d2be4dc7b991027c1deef35d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:44.226410   431 raft_consensus.cc:2272] T a75eed46652c4944b6302c9569235569 P e3760873d2be4dc7b991027c1deef35d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.228590   431 tablet_replica.cc:333] T 14457af646fe430aa855e47d42721a17 P e3760873d2be4dc7b991027c1deef35d: stopping tablet replica
I20260709 13:03:44.229199   431 raft_consensus.cc:2243] T 14457af646fe430aa855e47d42721a17 P e3760873d2be4dc7b991027c1deef35d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:44.229955   431 raft_consensus.cc:2272] T 14457af646fe430aa855e47d42721a17 P e3760873d2be4dc7b991027c1deef35d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.232002   431 tablet_replica.cc:333] T afdaf36d81c44e9db29f10e201b31e8c P e3760873d2be4dc7b991027c1deef35d: stopping tablet replica
I20260709 13:03:44.232694   431 raft_consensus.cc:2243] T afdaf36d81c44e9db29f10e201b31e8c P e3760873d2be4dc7b991027c1deef35d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.233268   431 raft_consensus.cc:2272] T afdaf36d81c44e9db29f10e201b31e8c P e3760873d2be4dc7b991027c1deef35d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.235230   431 tablet_replica.cc:333] T 03c55f66aaf043bba6a0c8d64fbddf0e P e3760873d2be4dc7b991027c1deef35d: stopping tablet replica
I20260709 13:03:44.235798   431 raft_consensus.cc:2243] T 03c55f66aaf043bba6a0c8d64fbddf0e P e3760873d2be4dc7b991027c1deef35d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.236217   431 raft_consensus.cc:2272] T 03c55f66aaf043bba6a0c8d64fbddf0e P e3760873d2be4dc7b991027c1deef35d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.238780   431 tablet_replica.cc:333] T bb4c61cb73ed4c488c741fd69f447642 P e3760873d2be4dc7b991027c1deef35d: stopping tablet replica
I20260709 13:03:44.239367   431 raft_consensus.cc:2243] T bb4c61cb73ed4c488c741fd69f447642 P e3760873d2be4dc7b991027c1deef35d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.239804   431 raft_consensus.cc:2272] T bb4c61cb73ed4c488c741fd69f447642 P e3760873d2be4dc7b991027c1deef35d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.241853   431 tablet_replica.cc:333] T e812d0605d24436989fb6ec2c868d47c P e3760873d2be4dc7b991027c1deef35d: stopping tablet replica
I20260709 13:03:44.242426   431 raft_consensus.cc:2243] T e812d0605d24436989fb6ec2c868d47c P e3760873d2be4dc7b991027c1deef35d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.242972   431 raft_consensus.cc:2272] T e812d0605d24436989fb6ec2c868d47c P e3760873d2be4dc7b991027c1deef35d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.245309   431 tablet_replica.cc:333] T 120ae599baa547b1855a1ba361226d3e P e3760873d2be4dc7b991027c1deef35d: stopping tablet replica
I20260709 13:03:44.246016   431 raft_consensus.cc:2243] T 120ae599baa547b1855a1ba361226d3e P e3760873d2be4dc7b991027c1deef35d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:44.246879   431 raft_consensus.cc:2272] T 120ae599baa547b1855a1ba361226d3e P e3760873d2be4dc7b991027c1deef35d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.249168   431 tablet_replica.cc:333] T de8c0dddbdc34ad88de9156beb74bef7 P e3760873d2be4dc7b991027c1deef35d: stopping tablet replica
I20260709 13:03:44.249680   431 raft_consensus.cc:2243] T de8c0dddbdc34ad88de9156beb74bef7 P e3760873d2be4dc7b991027c1deef35d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.250087   431 raft_consensus.cc:2272] T de8c0dddbdc34ad88de9156beb74bef7 P e3760873d2be4dc7b991027c1deef35d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.252138   431 tablet_replica.cc:333] T ec9a5210a9a84816bc2d263d456f9a93 P e3760873d2be4dc7b991027c1deef35d: stopping tablet replica
I20260709 13:03:44.252662   431 raft_consensus.cc:2243] T ec9a5210a9a84816bc2d263d456f9a93 P e3760873d2be4dc7b991027c1deef35d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.253083   431 raft_consensus.cc:2272] T ec9a5210a9a84816bc2d263d456f9a93 P e3760873d2be4dc7b991027c1deef35d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.255210   431 tablet_replica.cc:333] T 3ff2fc0ffa2f4ac08a92984cfd462344 P e3760873d2be4dc7b991027c1deef35d: stopping tablet replica
I20260709 13:03:44.255812   431 raft_consensus.cc:2243] T 3ff2fc0ffa2f4ac08a92984cfd462344 P e3760873d2be4dc7b991027c1deef35d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.256309   431 raft_consensus.cc:2272] T 3ff2fc0ffa2f4ac08a92984cfd462344 P e3760873d2be4dc7b991027c1deef35d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.258229   431 tablet_replica.cc:333] T a39eb6d3a8b641d88c8c8bfedce391ed P e3760873d2be4dc7b991027c1deef35d: stopping tablet replica
I20260709 13:03:44.258848   431 raft_consensus.cc:2243] T a39eb6d3a8b641d88c8c8bfedce391ed P e3760873d2be4dc7b991027c1deef35d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:44.259632   431 raft_consensus.cc:2272] T a39eb6d3a8b641d88c8c8bfedce391ed P e3760873d2be4dc7b991027c1deef35d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.261888   431 tablet_replica.cc:333] T a802e0f3aab1477091f50d46836a5e34 P e3760873d2be4dc7b991027c1deef35d: stopping tablet replica
I20260709 13:03:44.262501   431 raft_consensus.cc:2243] T a802e0f3aab1477091f50d46836a5e34 P e3760873d2be4dc7b991027c1deef35d [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:03:44.263200 11443 consensus_peers.cc:597] T 03c55f66aaf043bba6a0c8d64fbddf0e P 57da47b50bc847c997f07dccaeae280a -> Peer e3760873d2be4dc7b991027c1deef35d (127.0.107.193:35003): Couldn't send request to peer e3760873d2be4dc7b991027c1deef35d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:44.263327   431 raft_consensus.cc:2272] T a802e0f3aab1477091f50d46836a5e34 P e3760873d2be4dc7b991027c1deef35d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.265739   431 tablet_replica.cc:333] T 205736ed2ee6439588e8db06793e4cd6 P e3760873d2be4dc7b991027c1deef35d: stopping tablet replica
I20260709 13:03:44.266305   431 raft_consensus.cc:2243] T 205736ed2ee6439588e8db06793e4cd6 P e3760873d2be4dc7b991027c1deef35d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.266821   431 raft_consensus.cc:2272] T 205736ed2ee6439588e8db06793e4cd6 P e3760873d2be4dc7b991027c1deef35d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.268988   431 tablet_replica.cc:333] T dd5040fb5b614dd2990e57812dadd3b7 P e3760873d2be4dc7b991027c1deef35d: stopping tablet replica
I20260709 13:03:44.269503   431 raft_consensus.cc:2243] T dd5040fb5b614dd2990e57812dadd3b7 P e3760873d2be4dc7b991027c1deef35d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.269954   431 raft_consensus.cc:2272] T dd5040fb5b614dd2990e57812dadd3b7 P e3760873d2be4dc7b991027c1deef35d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.272094   431 tablet_replica.cc:333] T 71db464af9104a8a86fd623394da3511 P e3760873d2be4dc7b991027c1deef35d: stopping tablet replica
I20260709 13:03:44.272615   431 raft_consensus.cc:2243] T 71db464af9104a8a86fd623394da3511 P e3760873d2be4dc7b991027c1deef35d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.273057   431 raft_consensus.cc:2272] T 71db464af9104a8a86fd623394da3511 P e3760873d2be4dc7b991027c1deef35d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.275219   431 tablet_replica.cc:333] T 9e659a7e9644447daa84c89a46e934de P e3760873d2be4dc7b991027c1deef35d: stopping tablet replica
I20260709 13:03:44.275703   431 raft_consensus.cc:2243] T 9e659a7e9644447daa84c89a46e934de P e3760873d2be4dc7b991027c1deef35d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:44.276465   431 raft_consensus.cc:2272] T 9e659a7e9644447daa84c89a46e934de P e3760873d2be4dc7b991027c1deef35d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.278472   431 tablet_replica.cc:333] T b35e87dce47b43119d13bd514d434a76 P e3760873d2be4dc7b991027c1deef35d: stopping tablet replica
I20260709 13:03:44.279012   431 raft_consensus.cc:2243] T b35e87dce47b43119d13bd514d434a76 P e3760873d2be4dc7b991027c1deef35d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.279409   431 raft_consensus.cc:2272] T b35e87dce47b43119d13bd514d434a76 P e3760873d2be4dc7b991027c1deef35d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:44.304880 11369 consensus_peers.cc:597] T e812d0605d24436989fb6ec2c868d47c P 7eb6f135338f4b84b60b7e67ab3d81d7 -> Peer e3760873d2be4dc7b991027c1deef35d (127.0.107.193:35003): Couldn't send request to peer e3760873d2be4dc7b991027c1deef35d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:44.320523   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
I20260709 13:03:44.357460   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
W20260709 13:03:44.362845 11443 consensus_peers.cc:597] T b35e87dce47b43119d13bd514d434a76 P 57da47b50bc847c997f07dccaeae280a -> Peer e3760873d2be4dc7b991027c1deef35d (127.0.107.193:35003): Couldn't send request to peer e3760873d2be4dc7b991027c1deef35d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35003: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:44.372663 11369 consensus_peers.cc:597] T afdaf36d81c44e9db29f10e201b31e8c P 7eb6f135338f4b84b60b7e67ab3d81d7 -> Peer e3760873d2be4dc7b991027c1deef35d (127.0.107.193:35003): Couldn't send request to peer e3760873d2be4dc7b991027c1deef35d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35003: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:44.388731   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:44.389505   431 tablet_replica.cc:333] T d1ada73b7855443da29b368f50229412 P 7eb6f135338f4b84b60b7e67ab3d81d7: stopping tablet replica
I20260709 13:03:44.390300   431 raft_consensus.cc:2243] T d1ada73b7855443da29b368f50229412 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.390853   431 raft_consensus.cc:2272] T d1ada73b7855443da29b368f50229412 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.392930   431 tablet_replica.cc:333] T 03c55f66aaf043bba6a0c8d64fbddf0e P 7eb6f135338f4b84b60b7e67ab3d81d7: stopping tablet replica
I20260709 13:03:44.393546   431 raft_consensus.cc:2243] T 03c55f66aaf043bba6a0c8d64fbddf0e P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.394016   431 raft_consensus.cc:2272] T 03c55f66aaf043bba6a0c8d64fbddf0e P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.396114   431 tablet_replica.cc:333] T e812d0605d24436989fb6ec2c868d47c P 7eb6f135338f4b84b60b7e67ab3d81d7: stopping tablet replica
I20260709 13:03:44.396669   431 raft_consensus.cc:2243] T e812d0605d24436989fb6ec2c868d47c P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:44.397423   431 raft_consensus.cc:2272] T e812d0605d24436989fb6ec2c868d47c P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.399358   431 tablet_replica.cc:333] T bb4c61cb73ed4c488c741fd69f447642 P 7eb6f135338f4b84b60b7e67ab3d81d7: stopping tablet replica
I20260709 13:03:44.399909   431 raft_consensus.cc:2243] T bb4c61cb73ed4c488c741fd69f447642 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.400353   431 raft_consensus.cc:2272] T bb4c61cb73ed4c488c741fd69f447642 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.402251   431 tablet_replica.cc:333] T a75eed46652c4944b6302c9569235569 P 7eb6f135338f4b84b60b7e67ab3d81d7: stopping tablet replica
I20260709 13:03:44.402843   431 raft_consensus.cc:2243] T a75eed46652c4944b6302c9569235569 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.403347   431 raft_consensus.cc:2272] T a75eed46652c4944b6302c9569235569 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.405989   431 tablet_replica.cc:333] T 120ae599baa547b1855a1ba361226d3e P 7eb6f135338f4b84b60b7e67ab3d81d7: stopping tablet replica
W20260709 13:03:44.406513 11441 consensus_peers.cc:597] T de8c0dddbdc34ad88de9156beb74bef7 P 57da47b50bc847c997f07dccaeae280a -> Peer 7eb6f135338f4b84b60b7e67ab3d81d7 (127.0.107.194:42689): Couldn't send request to peer 7eb6f135338f4b84b60b7e67ab3d81d7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:44.406826   431 raft_consensus.cc:2243] T 120ae599baa547b1855a1ba361226d3e P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.407471   431 raft_consensus.cc:2272] T 120ae599baa547b1855a1ba361226d3e P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:44.409809 11443 consensus_peers.cc:597] T bb4c61cb73ed4c488c741fd69f447642 P 57da47b50bc847c997f07dccaeae280a -> Peer e3760873d2be4dc7b991027c1deef35d (127.0.107.193:35003): Couldn't send request to peer e3760873d2be4dc7b991027c1deef35d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35003: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:44.410422   431 tablet_replica.cc:333] T ec9a5210a9a84816bc2d263d456f9a93 P 7eb6f135338f4b84b60b7e67ab3d81d7: stopping tablet replica
I20260709 13:03:44.411082   431 raft_consensus.cc:2243] T ec9a5210a9a84816bc2d263d456f9a93 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.411470   431 raft_consensus.cc:2272] T ec9a5210a9a84816bc2d263d456f9a93 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.413520   431 tablet_replica.cc:333] T de8c0dddbdc34ad88de9156beb74bef7 P 7eb6f135338f4b84b60b7e67ab3d81d7: stopping tablet replica
I20260709 13:03:44.414004   431 raft_consensus.cc:2243] T de8c0dddbdc34ad88de9156beb74bef7 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.414427   431 raft_consensus.cc:2272] T de8c0dddbdc34ad88de9156beb74bef7 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.416468   431 tablet_replica.cc:333] T 205736ed2ee6439588e8db06793e4cd6 P 7eb6f135338f4b84b60b7e67ab3d81d7: stopping tablet replica
I20260709 13:03:44.417025   431 raft_consensus.cc:2243] T 205736ed2ee6439588e8db06793e4cd6 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:44.417783   431 raft_consensus.cc:2272] T 205736ed2ee6439588e8db06793e4cd6 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.419878   431 tablet_replica.cc:333] T afdaf36d81c44e9db29f10e201b31e8c P 7eb6f135338f4b84b60b7e67ab3d81d7: stopping tablet replica
I20260709 13:03:44.420382   431 raft_consensus.cc:2243] T afdaf36d81c44e9db29f10e201b31e8c P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:44.421166   431 raft_consensus.cc:2272] T afdaf36d81c44e9db29f10e201b31e8c P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.423245   431 tablet_replica.cc:333] T 14457af646fe430aa855e47d42721a17 P 7eb6f135338f4b84b60b7e67ab3d81d7: stopping tablet replica
I20260709 13:03:44.423771   431 raft_consensus.cc:2243] T 14457af646fe430aa855e47d42721a17 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.424193   431 raft_consensus.cc:2272] T 14457af646fe430aa855e47d42721a17 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.426297   431 tablet_replica.cc:333] T 71db464af9104a8a86fd623394da3511 P 7eb6f135338f4b84b60b7e67ab3d81d7: stopping tablet replica
I20260709 13:03:44.426849   431 raft_consensus.cc:2243] T 71db464af9104a8a86fd623394da3511 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:44.427613   431 raft_consensus.cc:2272] T 71db464af9104a8a86fd623394da3511 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.430199   431 tablet_replica.cc:333] T 3ff2fc0ffa2f4ac08a92984cfd462344 P 7eb6f135338f4b84b60b7e67ab3d81d7: stopping tablet replica
I20260709 13:03:44.430864   431 raft_consensus.cc:2243] T 3ff2fc0ffa2f4ac08a92984cfd462344 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:03:44.431298 11441 consensus_peers.cc:597] T bb4c61cb73ed4c488c741fd69f447642 P 57da47b50bc847c997f07dccaeae280a -> Peer 7eb6f135338f4b84b60b7e67ab3d81d7 (127.0.107.194:42689): Couldn't send request to peer 7eb6f135338f4b84b60b7e67ab3d81d7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:44.431772   431 raft_consensus.cc:2272] T 3ff2fc0ffa2f4ac08a92984cfd462344 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.433830   431 tablet_replica.cc:333] T a39eb6d3a8b641d88c8c8bfedce391ed P 7eb6f135338f4b84b60b7e67ab3d81d7: stopping tablet replica
I20260709 13:03:44.434319   431 raft_consensus.cc:2243] T a39eb6d3a8b641d88c8c8bfedce391ed P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.434741   431 raft_consensus.cc:2272] T a39eb6d3a8b641d88c8c8bfedce391ed P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.436885   431 tablet_replica.cc:333] T a802e0f3aab1477091f50d46836a5e34 P 7eb6f135338f4b84b60b7e67ab3d81d7: stopping tablet replica
I20260709 13:03:44.437543   431 raft_consensus.cc:2243] T a802e0f3aab1477091f50d46836a5e34 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.438128   431 raft_consensus.cc:2272] T a802e0f3aab1477091f50d46836a5e34 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:44.439661 11441 consensus_peers.cc:597] T ec9a5210a9a84816bc2d263d456f9a93 P 57da47b50bc847c997f07dccaeae280a -> Peer 7eb6f135338f4b84b60b7e67ab3d81d7 (127.0.107.194:42689): Couldn't send request to peer 7eb6f135338f4b84b60b7e67ab3d81d7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:44.440776   431 tablet_replica.cc:333] T dd5040fb5b614dd2990e57812dadd3b7 P 7eb6f135338f4b84b60b7e67ab3d81d7: stopping tablet replica
I20260709 13:03:44.441344   431 raft_consensus.cc:2243] T dd5040fb5b614dd2990e57812dadd3b7 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:44.442183   431 raft_consensus.cc:2272] T dd5040fb5b614dd2990e57812dadd3b7 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.444334   431 tablet_replica.cc:333] T b35e87dce47b43119d13bd514d434a76 P 7eb6f135338f4b84b60b7e67ab3d81d7: stopping tablet replica
I20260709 13:03:44.444795   431 raft_consensus.cc:2243] T b35e87dce47b43119d13bd514d434a76 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.445194   431 raft_consensus.cc:2272] T b35e87dce47b43119d13bd514d434a76 P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.447337   431 tablet_replica.cc:333] T 9e659a7e9644447daa84c89a46e934de P 7eb6f135338f4b84b60b7e67ab3d81d7: stopping tablet replica
I20260709 13:03:44.447791   431 raft_consensus.cc:2243] T 9e659a7e9644447daa84c89a46e934de P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.448236   431 raft_consensus.cc:2272] T 9e659a7e9644447daa84c89a46e934de P 7eb6f135338f4b84b60b7e67ab3d81d7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:44.453683 11443 consensus_peers.cc:597] T de8c0dddbdc34ad88de9156beb74bef7 P 57da47b50bc847c997f07dccaeae280a -> Peer e3760873d2be4dc7b991027c1deef35d (127.0.107.193:35003): Couldn't send request to peer e3760873d2be4dc7b991027c1deef35d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35003: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:44.469004 11441 consensus_peers.cc:597] T 03c55f66aaf043bba6a0c8d64fbddf0e P 57da47b50bc847c997f07dccaeae280a -> Peer 7eb6f135338f4b84b60b7e67ab3d81d7 (127.0.107.194:42689): Couldn't send request to peer 7eb6f135338f4b84b60b7e67ab3d81d7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:44.491093   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
I20260709 13:03:44.523557   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
I20260709 13:03:44.552465   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:44.553103   431 tablet_replica.cc:333] T d1ada73b7855443da29b368f50229412 P 57da47b50bc847c997f07dccaeae280a: stopping tablet replica
I20260709 13:03:44.553812   431 raft_consensus.cc:2243] T d1ada73b7855443da29b368f50229412 P 57da47b50bc847c997f07dccaeae280a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:44.554643   431 raft_consensus.cc:2272] T d1ada73b7855443da29b368f50229412 P 57da47b50bc847c997f07dccaeae280a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.556762   431 tablet_replica.cc:333] T bb4c61cb73ed4c488c741fd69f447642 P 57da47b50bc847c997f07dccaeae280a: stopping tablet replica
I20260709 13:03:44.557329   431 raft_consensus.cc:2243] T bb4c61cb73ed4c488c741fd69f447642 P 57da47b50bc847c997f07dccaeae280a [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:03:44.558043   431 raft_consensus.cc:2272] T bb4c61cb73ed4c488c741fd69f447642 P 57da47b50bc847c997f07dccaeae280a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.560056   431 tablet_replica.cc:333] T e812d0605d24436989fb6ec2c868d47c P 57da47b50bc847c997f07dccaeae280a: stopping tablet replica
I20260709 13:03:44.560567   431 raft_consensus.cc:2243] T e812d0605d24436989fb6ec2c868d47c P 57da47b50bc847c997f07dccaeae280a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.560982   431 raft_consensus.cc:2272] T e812d0605d24436989fb6ec2c868d47c P 57da47b50bc847c997f07dccaeae280a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.562911   431 tablet_replica.cc:333] T a75eed46652c4944b6302c9569235569 P 57da47b50bc847c997f07dccaeae280a: stopping tablet replica
I20260709 13:03:44.563423   431 raft_consensus.cc:2243] T a75eed46652c4944b6302c9569235569 P 57da47b50bc847c997f07dccaeae280a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.563854   431 raft_consensus.cc:2272] T a75eed46652c4944b6302c9569235569 P 57da47b50bc847c997f07dccaeae280a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.565882   431 tablet_replica.cc:333] T 14457af646fe430aa855e47d42721a17 P 57da47b50bc847c997f07dccaeae280a: stopping tablet replica
I20260709 13:03:44.566424   431 raft_consensus.cc:2243] T 14457af646fe430aa855e47d42721a17 P 57da47b50bc847c997f07dccaeae280a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.566881   431 raft_consensus.cc:2272] T 14457af646fe430aa855e47d42721a17 P 57da47b50bc847c997f07dccaeae280a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.568749   431 tablet_replica.cc:333] T afdaf36d81c44e9db29f10e201b31e8c P 57da47b50bc847c997f07dccaeae280a: stopping tablet replica
I20260709 13:03:44.569325   431 raft_consensus.cc:2243] T afdaf36d81c44e9db29f10e201b31e8c P 57da47b50bc847c997f07dccaeae280a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.569741   431 raft_consensus.cc:2272] T afdaf36d81c44e9db29f10e201b31e8c P 57da47b50bc847c997f07dccaeae280a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.571571   431 tablet_replica.cc:333] T 03c55f66aaf043bba6a0c8d64fbddf0e P 57da47b50bc847c997f07dccaeae280a: stopping tablet replica
I20260709 13:03:44.572095   431 raft_consensus.cc:2243] T 03c55f66aaf043bba6a0c8d64fbddf0e P 57da47b50bc847c997f07dccaeae280a [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:03:44.572819   431 raft_consensus.cc:2272] T 03c55f66aaf043bba6a0c8d64fbddf0e P 57da47b50bc847c997f07dccaeae280a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.574795   431 tablet_replica.cc:333] T 205736ed2ee6439588e8db06793e4cd6 P 57da47b50bc847c997f07dccaeae280a: stopping tablet replica
I20260709 13:03:44.575313   431 raft_consensus.cc:2243] T 205736ed2ee6439588e8db06793e4cd6 P 57da47b50bc847c997f07dccaeae280a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.575732   431 raft_consensus.cc:2272] T 205736ed2ee6439588e8db06793e4cd6 P 57da47b50bc847c997f07dccaeae280a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.577744   431 tablet_replica.cc:333] T 120ae599baa547b1855a1ba361226d3e P 57da47b50bc847c997f07dccaeae280a: stopping tablet replica
I20260709 13:03:44.578274   431 raft_consensus.cc:2243] T 120ae599baa547b1855a1ba361226d3e P 57da47b50bc847c997f07dccaeae280a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.578709   431 raft_consensus.cc:2272] T 120ae599baa547b1855a1ba361226d3e P 57da47b50bc847c997f07dccaeae280a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.580803   431 tablet_replica.cc:333] T ec9a5210a9a84816bc2d263d456f9a93 P 57da47b50bc847c997f07dccaeae280a: stopping tablet replica
I20260709 13:03:44.581327   431 raft_consensus.cc:2243] T ec9a5210a9a84816bc2d263d456f9a93 P 57da47b50bc847c997f07dccaeae280a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:44.582058   431 raft_consensus.cc:2272] T ec9a5210a9a84816bc2d263d456f9a93 P 57da47b50bc847c997f07dccaeae280a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.584019   431 tablet_replica.cc:333] T de8c0dddbdc34ad88de9156beb74bef7 P 57da47b50bc847c997f07dccaeae280a: stopping tablet replica
I20260709 13:03:44.584535   431 raft_consensus.cc:2243] T de8c0dddbdc34ad88de9156beb74bef7 P 57da47b50bc847c997f07dccaeae280a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:44.585316   431 raft_consensus.cc:2272] T de8c0dddbdc34ad88de9156beb74bef7 P 57da47b50bc847c997f07dccaeae280a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.587368   431 tablet_replica.cc:333] T 3ff2fc0ffa2f4ac08a92984cfd462344 P 57da47b50bc847c997f07dccaeae280a: stopping tablet replica
I20260709 13:03:44.587898   431 raft_consensus.cc:2243] T 3ff2fc0ffa2f4ac08a92984cfd462344 P 57da47b50bc847c997f07dccaeae280a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.588325   431 raft_consensus.cc:2272] T 3ff2fc0ffa2f4ac08a92984cfd462344 P 57da47b50bc847c997f07dccaeae280a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.590250   431 tablet_replica.cc:333] T a39eb6d3a8b641d88c8c8bfedce391ed P 57da47b50bc847c997f07dccaeae280a: stopping tablet replica
I20260709 13:03:44.590797   431 raft_consensus.cc:2243] T a39eb6d3a8b641d88c8c8bfedce391ed P 57da47b50bc847c997f07dccaeae280a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.591187   431 raft_consensus.cc:2272] T a39eb6d3a8b641d88c8c8bfedce391ed P 57da47b50bc847c997f07dccaeae280a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.592974   431 tablet_replica.cc:333] T a802e0f3aab1477091f50d46836a5e34 P 57da47b50bc847c997f07dccaeae280a: stopping tablet replica
I20260709 13:03:44.593449   431 raft_consensus.cc:2243] T a802e0f3aab1477091f50d46836a5e34 P 57da47b50bc847c997f07dccaeae280a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.593856   431 raft_consensus.cc:2272] T a802e0f3aab1477091f50d46836a5e34 P 57da47b50bc847c997f07dccaeae280a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.595872   431 tablet_replica.cc:333] T 9e659a7e9644447daa84c89a46e934de P 57da47b50bc847c997f07dccaeae280a: stopping tablet replica
I20260709 13:03:44.596357   431 raft_consensus.cc:2243] T 9e659a7e9644447daa84c89a46e934de P 57da47b50bc847c997f07dccaeae280a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.596740   431 raft_consensus.cc:2272] T 9e659a7e9644447daa84c89a46e934de P 57da47b50bc847c997f07dccaeae280a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.598759   431 tablet_replica.cc:333] T b35e87dce47b43119d13bd514d434a76 P 57da47b50bc847c997f07dccaeae280a: stopping tablet replica
I20260709 13:03:44.599246   431 raft_consensus.cc:2243] T b35e87dce47b43119d13bd514d434a76 P 57da47b50bc847c997f07dccaeae280a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:44.599937   431 raft_consensus.cc:2272] T b35e87dce47b43119d13bd514d434a76 P 57da47b50bc847c997f07dccaeae280a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.601866   431 tablet_replica.cc:333] T dd5040fb5b614dd2990e57812dadd3b7 P 57da47b50bc847c997f07dccaeae280a: stopping tablet replica
I20260709 13:03:44.602329   431 raft_consensus.cc:2243] T dd5040fb5b614dd2990e57812dadd3b7 P 57da47b50bc847c997f07dccaeae280a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.602777   431 raft_consensus.cc:2272] T dd5040fb5b614dd2990e57812dadd3b7 P 57da47b50bc847c997f07dccaeae280a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.604795   431 tablet_replica.cc:333] T 71db464af9104a8a86fd623394da3511 P 57da47b50bc847c997f07dccaeae280a: stopping tablet replica
I20260709 13:03:44.605257   431 raft_consensus.cc:2243] T 71db464af9104a8a86fd623394da3511 P 57da47b50bc847c997f07dccaeae280a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:44.605664   431 raft_consensus.cc:2272] T 71db464af9104a8a86fd623394da3511 P 57da47b50bc847c997f07dccaeae280a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.643337   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 13:03:44.676924   431 master.cc:562] Master@127.0.107.254:33795 shutting down...
I20260709 13:03:44.696864   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P b4c5ce56bb0448d098ee6b5c515762c5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:44.697407   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P b4c5ce56bb0448d098ee6b5c515762c5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:44.697703   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P b4c5ce56bb0448d098ee6b5c515762c5: stopping tablet replica
I20260709 13:03:44.717721   431 master.cc:584] Master@127.0.107.254:33795 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (12244 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 13:03:44.765969   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:40505
I20260709 13:03:44.767100   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:44.773546 11803 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:44.773546 11802 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:44.774075 11805 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:44.774508   431 server_base.cc:1061] running on GCE node
I20260709 13:03:44.775651   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:44.775837   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:44.775950   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602224775940 us; error 0 us; skew 500 ppm
I20260709 13:03:44.776405   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:44.779253   431 webserver.cc:533] Webserver started at http://127.0.107.254:37527/ using document root <none> and password file <none>
I20260709 13:03:44.779704   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:44.779855   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:44.780067   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:44.781121   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601891739070-431-0/minicluster-data/master-0-root/instance:
uuid: "952ff105c515428bad47a809ce3c645b"
format_stamp: "Formatted at 2026-07-09 13:03:44 on dist-test-slave-qzg2"
I20260709 13:03:44.785585   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.001s
I20260709 13:03:44.789170 11810 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:44.789914   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 13:03:44.790184   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601891739070-431-0/minicluster-data/master-0-root
uuid: "952ff105c515428bad47a809ce3c645b"
format_stamp: "Formatted at 2026-07-09 13:03:44 on dist-test-slave-qzg2"
I20260709 13:03:44.790436   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601891739070-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601891739070-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601891739070-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:44.811004   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:44.812184   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:44.851018   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:40505
I20260709 13:03:44.851126 11861 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:40505 every 8 connection(s)
I20260709 13:03:44.855109 11862 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:44.866060 11862 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 952ff105c515428bad47a809ce3c645b: Bootstrap starting.
I20260709 13:03:44.871456 11862 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 952ff105c515428bad47a809ce3c645b: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:44.876029 11862 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 952ff105c515428bad47a809ce3c645b: No bootstrap required, opened a new log
I20260709 13:03:44.878247 11862 raft_consensus.cc:359] T 00000000000000000000000000000000 P 952ff105c515428bad47a809ce3c645b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "952ff105c515428bad47a809ce3c645b" member_type: VOTER }
I20260709 13:03:44.878679 11862 raft_consensus.cc:385] T 00000000000000000000000000000000 P 952ff105c515428bad47a809ce3c645b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:44.878911 11862 raft_consensus.cc:740] T 00000000000000000000000000000000 P 952ff105c515428bad47a809ce3c645b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 952ff105c515428bad47a809ce3c645b, State: Initialized, Role: FOLLOWER
I20260709 13:03:44.879544 11862 consensus_queue.cc:260] T 00000000000000000000000000000000 P 952ff105c515428bad47a809ce3c645b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "952ff105c515428bad47a809ce3c645b" member_type: VOTER }
I20260709 13:03:44.879990 11862 raft_consensus.cc:399] T 00000000000000000000000000000000 P 952ff105c515428bad47a809ce3c645b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:03:44.880213 11862 raft_consensus.cc:493] T 00000000000000000000000000000000 P 952ff105c515428bad47a809ce3c645b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:03:44.880465 11862 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 952ff105c515428bad47a809ce3c645b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:44.885151 11862 raft_consensus.cc:515] T 00000000000000000000000000000000 P 952ff105c515428bad47a809ce3c645b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "952ff105c515428bad47a809ce3c645b" member_type: VOTER }
I20260709 13:03:44.885666 11862 leader_election.cc:304] T 00000000000000000000000000000000 P 952ff105c515428bad47a809ce3c645b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 952ff105c515428bad47a809ce3c645b; no voters: 
I20260709 13:03:44.886890 11862 leader_election.cc:290] T 00000000000000000000000000000000 P 952ff105c515428bad47a809ce3c645b [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:03:44.887212 11865 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 952ff105c515428bad47a809ce3c645b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:44.888548 11865 raft_consensus.cc:697] T 00000000000000000000000000000000 P 952ff105c515428bad47a809ce3c645b [term 1 LEADER]: Becoming Leader. State: Replica: 952ff105c515428bad47a809ce3c645b, State: Running, Role: LEADER
I20260709 13:03:44.889225 11865 consensus_queue.cc:237] T 00000000000000000000000000000000 P 952ff105c515428bad47a809ce3c645b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "952ff105c515428bad47a809ce3c645b" member_type: VOTER }
I20260709 13:03:44.889753 11862 sys_catalog.cc:565] T 00000000000000000000000000000000 P 952ff105c515428bad47a809ce3c645b [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:03:44.893533 11866 sys_catalog.cc:455] T 00000000000000000000000000000000 P 952ff105c515428bad47a809ce3c645b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "952ff105c515428bad47a809ce3c645b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "952ff105c515428bad47a809ce3c645b" member_type: VOTER } }
I20260709 13:03:44.893514 11867 sys_catalog.cc:455] T 00000000000000000000000000000000 P 952ff105c515428bad47a809ce3c645b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 952ff105c515428bad47a809ce3c645b. Latest consensus state: current_term: 1 leader_uuid: "952ff105c515428bad47a809ce3c645b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "952ff105c515428bad47a809ce3c645b" member_type: VOTER } }
I20260709 13:03:44.894352 11867 sys_catalog.cc:458] T 00000000000000000000000000000000 P 952ff105c515428bad47a809ce3c645b [sys.catalog]: This master's current role is: LEADER
I20260709 13:03:44.895359 11866 sys_catalog.cc:458] T 00000000000000000000000000000000 P 952ff105c515428bad47a809ce3c645b [sys.catalog]: This master's current role is: LEADER
I20260709 13:03:44.896039 11871 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:03:44.901044 11871 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:03:44.906070   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:03:44.910015 11871 catalog_manager.cc:1383] Generated new cluster ID: c2b1185d03d14b93b035dfe6bd39dd6a
I20260709 13:03:44.910298 11871 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:03:44.940062 11871 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:03:44.941279 11871 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:03:44.967020 11871 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 952ff105c515428bad47a809ce3c645b: Generated new TSK 0
I20260709 13:03:44.967604 11871 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:03:44.973268   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:44.979868 11883 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:44.980087 11884 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:44.987828   431 server_base.cc:1061] running on GCE node
W20260709 13:03:44.987788 11886 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:44.989095   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:44.989315   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:44.989454   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602224989441 us; error 0 us; skew 500 ppm
I20260709 13:03:44.989914   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:44.992700   431 webserver.cc:533] Webserver started at http://127.0.107.193:38143/ using document root <none> and password file <none>
I20260709 13:03:44.993160   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:44.993309   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:44.993526   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:44.994555   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601891739070-431-0/minicluster-data/ts-0-root/instance:
uuid: "bd1c07cda9da4436b69174af3a1ce92f"
format_stamp: "Formatted at 2026-07-09 13:03:44 on dist-test-slave-qzg2"
I20260709 13:03:44.999249   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:03:45.002609 11891 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:45.003575   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:03:45.003891   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601891739070-431-0/minicluster-data/ts-0-root
uuid: "bd1c07cda9da4436b69174af3a1ce92f"
format_stamp: "Formatted at 2026-07-09 13:03:44 on dist-test-slave-qzg2"
I20260709 13:03:45.004164   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601891739070-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601891739070-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601891739070-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:45.023537   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:45.024753   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:45.026214   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:45.028571   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:03:45.028775   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:45.029006   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:03:45.029170   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:45.069614   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:46131
I20260709 13:03:45.069732 11953 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:46131 every 8 connection(s)
I20260709 13:03:45.074182   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:45.081694 11958 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:45.083297 11959 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:45.085953   431 server_base.cc:1061] running on GCE node
W20260709 13:03:45.087006 11961 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:45.087800 11954 heartbeater.cc:344] Connected to a master server at 127.0.107.254:40505
I20260709 13:03:45.087987   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:03:45.088239 11954 heartbeater.cc:461] Registering TS with master...
W20260709 13:03:45.088299   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:45.088706   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602225088687 us; error 0 us; skew 500 ppm
I20260709 13:03:45.089293   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:45.089210 11954 heartbeater.cc:507] Master 127.0.107.254:40505 requested a full tablet report, sending...
I20260709 13:03:45.091760 11827 ts_manager.cc:194] Registered new tserver with Master: bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131)
I20260709 13:03:45.092088   431 webserver.cc:533] Webserver started at http://127.0.107.194:33021/ using document root <none> and password file <none>
I20260709 13:03:45.092681   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:45.092873   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:45.093123   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:45.093817 11827 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36640
I20260709 13:03:45.094337   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601891739070-431-0/minicluster-data/ts-1-root/instance:
uuid: "367d36143adf465b950244c6baa620a5"
format_stamp: "Formatted at 2026-07-09 13:03:45 on dist-test-slave-qzg2"
I20260709 13:03:45.099203   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:03:45.102619 11966 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:45.103519   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:03:45.103825   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601891739070-431-0/minicluster-data/ts-1-root
uuid: "367d36143adf465b950244c6baa620a5"
format_stamp: "Formatted at 2026-07-09 13:03:45 on dist-test-slave-qzg2"
I20260709 13:03:45.104095   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601891739070-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601891739070-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601891739070-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:45.119616   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:45.120757   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:45.122184   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:45.124387   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:03:45.124589   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:45.124815   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:03:45.124965   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:45.164480   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:46337
I20260709 13:03:45.164573 12028 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:46337 every 8 connection(s)
I20260709 13:03:45.169072   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:45.175912 12032 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:45.177693 12033 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:45.178561 12035 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:45.180491   431 server_base.cc:1061] running on GCE node
I20260709 13:03:45.180811 12029 heartbeater.cc:344] Connected to a master server at 127.0.107.254:40505
I20260709 13:03:45.181317 12029 heartbeater.cc:461] Registering TS with master...
I20260709 13:03:45.181752   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:45.182088   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:45.182276 12029 heartbeater.cc:507] Master 127.0.107.254:40505 requested a full tablet report, sending...
I20260709 13:03:45.182299   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602225182281 us; error 0 us; skew 500 ppm
I20260709 13:03:45.183382   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:45.184906 11827 ts_manager.cc:194] Registered new tserver with Master: 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337)
I20260709 13:03:45.186058   431 webserver.cc:533] Webserver started at http://127.0.107.195:43645/ using document root <none> and password file <none>
I20260709 13:03:45.186610   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:45.186537 11827 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36656
I20260709 13:03:45.186980   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:45.187279   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:45.188687   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601891739070-431-0/minicluster-data/ts-2-root/instance:
uuid: "8dfed99448174185ba5ece679e9d90be"
format_stamp: "Formatted at 2026-07-09 13:03:45 on dist-test-slave-qzg2"
I20260709 13:03:45.193421   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:03:45.196870 12040 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:45.197719   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:03:45.198021   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601891739070-431-0/minicluster-data/ts-2-root
uuid: "8dfed99448174185ba5ece679e9d90be"
format_stamp: "Formatted at 2026-07-09 13:03:45 on dist-test-slave-qzg2"
I20260709 13:03:45.198302   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601891739070-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601891739070-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task8PT1GQ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601891739070-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:45.210611   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:45.211838   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:45.213284   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:45.215551   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:03:45.215752   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:45.215972   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:03:45.216120   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:45.254642   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:39279
I20260709 13:03:45.254767 12102 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:39279 every 8 connection(s)
I20260709 13:03:45.268908 12103 heartbeater.cc:344] Connected to a master server at 127.0.107.254:40505
I20260709 13:03:45.269402 12103 heartbeater.cc:461] Registering TS with master...
I20260709 13:03:45.270183 12103 heartbeater.cc:507] Master 127.0.107.254:40505 requested a full tablet report, sending...
I20260709 13:03:45.272372 11827 ts_manager.cc:194] Registered new tserver with Master: 8dfed99448174185ba5ece679e9d90be (127.0.107.195:39279)
I20260709 13:03:45.272804   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014881906s
I20260709 13:03:45.273835 11827 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36670
I20260709 13:03:45.298488 11827 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36672:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:03:45.301559 11827 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:03:45.392463 11994 tablet_service.cc:1511] Processing CreateTablet for tablet 8b0eaec7710c47e79cc78a1085de9b3f (DEFAULT_TABLE table=test-workload [id=37f5768f23564a8dafc57ab0f59e46fb]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:03:45.393975 11994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b0eaec7710c47e79cc78a1085de9b3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:45.395895 11993 tablet_service.cc:1511] Processing CreateTablet for tablet 95bf609349e54fdd867e40d7fd578e52 (DEFAULT_TABLE table=test-workload [id=37f5768f23564a8dafc57ab0f59e46fb]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:03:45.398069 11993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95bf609349e54fdd867e40d7fd578e52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:45.397792 11992 tablet_service.cc:1511] Processing CreateTablet for tablet 196209061a514376bb68b340c922a883 (DEFAULT_TABLE table=test-workload [id=37f5768f23564a8dafc57ab0f59e46fb]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:03:45.399263 11992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 196209061a514376bb68b340c922a883. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:45.399370 12066 tablet_service.cc:1511] Processing CreateTablet for tablet 196209061a514376bb68b340c922a883 (DEFAULT_TABLE table=test-workload [id=37f5768f23564a8dafc57ab0f59e46fb]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:03:45.399829 11987 tablet_service.cc:1511] Processing CreateTablet for tablet 7f973c97455b4d918d353553cbe194a9 (DEFAULT_TABLE table=test-workload [id=37f5768f23564a8dafc57ab0f59e46fb]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:03:45.400909 12066 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 196209061a514376bb68b340c922a883. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:45.401098 11987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f973c97455b4d918d353553cbe194a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:45.403586 11990 tablet_service.cc:1511] Processing CreateTablet for tablet bda83ed4e6b84bf9985ad11c37b2bd59 (DEFAULT_TABLE table=test-workload [id=37f5768f23564a8dafc57ab0f59e46fb]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:03:45.403729 11988 tablet_service.cc:1511] Processing CreateTablet for tablet a846ec1843bc4dbca0df61be2992759d (DEFAULT_TABLE table=test-workload [id=37f5768f23564a8dafc57ab0f59e46fb]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:03:45.404816 11989 tablet_service.cc:1511] Processing CreateTablet for tablet 03ae675fe38f4f2b96936940980c1ee9 (DEFAULT_TABLE table=test-workload [id=37f5768f23564a8dafc57ab0f59e46fb]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:03:45.403621 12067 tablet_service.cc:1511] Processing CreateTablet for tablet 95bf609349e54fdd867e40d7fd578e52 (DEFAULT_TABLE table=test-workload [id=37f5768f23564a8dafc57ab0f59e46fb]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:03:45.405639 12065 tablet_service.cc:1511] Processing CreateTablet for tablet b8baeafde60b486094f5139efec7eca0 (DEFAULT_TABLE table=test-workload [id=37f5768f23564a8dafc57ab0f59e46fb]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:03:45.406376 12067 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95bf609349e54fdd867e40d7fd578e52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:45.407125 11991 tablet_service.cc:1511] Processing CreateTablet for tablet b8baeafde60b486094f5139efec7eca0 (DEFAULT_TABLE table=test-workload [id=37f5768f23564a8dafc57ab0f59e46fb]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:03:45.407083 12065 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8baeafde60b486094f5139efec7eca0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:45.411264 12062 tablet_service.cc:1511] Processing CreateTablet for tablet a846ec1843bc4dbca0df61be2992759d (DEFAULT_TABLE table=test-workload [id=37f5768f23564a8dafc57ab0f59e46fb]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:03:45.412871 12064 tablet_service.cc:1511] Processing CreateTablet for tablet bda83ed4e6b84bf9985ad11c37b2bd59 (DEFAULT_TABLE table=test-workload [id=37f5768f23564a8dafc57ab0f59e46fb]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:03:45.403779 12063 tablet_service.cc:1511] Processing CreateTablet for tablet 03ae675fe38f4f2b96936940980c1ee9 (DEFAULT_TABLE table=test-workload [id=37f5768f23564a8dafc57ab0f59e46fb]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:03:45.404732 12061 tablet_service.cc:1511] Processing CreateTablet for tablet 7f973c97455b4d918d353553cbe194a9 (DEFAULT_TABLE table=test-workload [id=37f5768f23564a8dafc57ab0f59e46fb]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:03:45.401187 12068 tablet_service.cc:1511] Processing CreateTablet for tablet 8b0eaec7710c47e79cc78a1085de9b3f (DEFAULT_TABLE table=test-workload [id=37f5768f23564a8dafc57ab0f59e46fb]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:03:45.416476 11988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a846ec1843bc4dbca0df61be2992759d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:45.416814 11986 tablet_service.cc:1511] Processing CreateTablet for tablet 5078275d4ea64e67bf0a061eb3011157 (DEFAULT_TABLE table=test-workload [id=37f5768f23564a8dafc57ab0f59e46fb]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:03:45.417541 12063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03ae675fe38f4f2b96936940980c1ee9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:45.417963 11991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8baeafde60b486094f5139efec7eca0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:45.418962 11989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03ae675fe38f4f2b96936940980c1ee9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:45.419569 11986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5078275d4ea64e67bf0a061eb3011157. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:45.418409 12068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b0eaec7710c47e79cc78a1085de9b3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:45.421605 12062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a846ec1843bc4dbca0df61be2992759d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:45.423727 12060 tablet_service.cc:1511] Processing CreateTablet for tablet 5078275d4ea64e67bf0a061eb3011157 (DEFAULT_TABLE table=test-workload [id=37f5768f23564a8dafc57ab0f59e46fb]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:03:45.425206 12060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5078275d4ea64e67bf0a061eb3011157. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:45.427023 12064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bda83ed4e6b84bf9985ad11c37b2bd59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:45.429448 11990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bda83ed4e6b84bf9985ad11c37b2bd59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:45.429513 12061 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f973c97455b4d918d353553cbe194a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:45.491940 11919 tablet_service.cc:1511] Processing CreateTablet for tablet 8b0eaec7710c47e79cc78a1085de9b3f (DEFAULT_TABLE table=test-workload [id=37f5768f23564a8dafc57ab0f59e46fb]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:03:45.493691 11919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b0eaec7710c47e79cc78a1085de9b3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:45.495950 11918 tablet_service.cc:1511] Processing CreateTablet for tablet 95bf609349e54fdd867e40d7fd578e52 (DEFAULT_TABLE table=test-workload [id=37f5768f23564a8dafc57ab0f59e46fb]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:03:45.500427 11918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95bf609349e54fdd867e40d7fd578e52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:45.497575 11916 tablet_service.cc:1511] Processing CreateTablet for tablet b8baeafde60b486094f5139efec7eca0 (DEFAULT_TABLE table=test-workload [id=37f5768f23564a8dafc57ab0f59e46fb]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:03:45.504367 11916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8baeafde60b486094f5139efec7eca0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:45.498811 11917 tablet_service.cc:1511] Processing CreateTablet for tablet 196209061a514376bb68b340c922a883 (DEFAULT_TABLE table=test-workload [id=37f5768f23564a8dafc57ab0f59e46fb]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:03:45.508373 11917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 196209061a514376bb68b340c922a883. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:45.513280 11913 tablet_service.cc:1511] Processing CreateTablet for tablet a846ec1843bc4dbca0df61be2992759d (DEFAULT_TABLE table=test-workload [id=37f5768f23564a8dafc57ab0f59e46fb]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:03:45.516639 11914 tablet_service.cc:1511] Processing CreateTablet for tablet 03ae675fe38f4f2b96936940980c1ee9 (DEFAULT_TABLE table=test-workload [id=37f5768f23564a8dafc57ab0f59e46fb]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:03:45.522796 11912 tablet_service.cc:1511] Processing CreateTablet for tablet 7f973c97455b4d918d353553cbe194a9 (DEFAULT_TABLE table=test-workload [id=37f5768f23564a8dafc57ab0f59e46fb]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:03:45.525013 11915 tablet_service.cc:1511] Processing CreateTablet for tablet bda83ed4e6b84bf9985ad11c37b2bd59 (DEFAULT_TABLE table=test-workload [id=37f5768f23564a8dafc57ab0f59e46fb]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:03:45.529469 11911 tablet_service.cc:1511] Processing CreateTablet for tablet 5078275d4ea64e67bf0a061eb3011157 (DEFAULT_TABLE table=test-workload [id=37f5768f23564a8dafc57ab0f59e46fb]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:03:45.531533 11913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a846ec1843bc4dbca0df61be2992759d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:45.532320 11915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bda83ed4e6b84bf9985ad11c37b2bd59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:45.535043 11914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03ae675fe38f4f2b96936940980c1ee9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:45.539049 11911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5078275d4ea64e67bf0a061eb3011157. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:45.543043 11912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f973c97455b4d918d353553cbe194a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:45.571791 12120 tablet_bootstrap.cc:492] T a846ec1843bc4dbca0df61be2992759d P bd1c07cda9da4436b69174af3a1ce92f: Bootstrap starting.
I20260709 13:03:45.581185 12120 tablet_bootstrap.cc:654] T a846ec1843bc4dbca0df61be2992759d P bd1c07cda9da4436b69174af3a1ce92f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:45.590333 12118 tablet_bootstrap.cc:492] T a846ec1843bc4dbca0df61be2992759d P 8dfed99448174185ba5ece679e9d90be: Bootstrap starting.
I20260709 13:03:45.593027 12120 tablet_bootstrap.cc:492] T a846ec1843bc4dbca0df61be2992759d P bd1c07cda9da4436b69174af3a1ce92f: No bootstrap required, opened a new log
I20260709 13:03:45.593633 12120 ts_tablet_manager.cc:1403] T a846ec1843bc4dbca0df61be2992759d P bd1c07cda9da4436b69174af3a1ce92f: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.008s
I20260709 13:03:45.597067 12120 raft_consensus.cc:359] T a846ec1843bc4dbca0df61be2992759d P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:45.598031 12120 raft_consensus.cc:385] T a846ec1843bc4dbca0df61be2992759d P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:45.598353 12120 raft_consensus.cc:740] T a846ec1843bc4dbca0df61be2992759d P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd1c07cda9da4436b69174af3a1ce92f, State: Initialized, Role: FOLLOWER
I20260709 13:03:45.597067 12118 tablet_bootstrap.cc:654] T a846ec1843bc4dbca0df61be2992759d P 8dfed99448174185ba5ece679e9d90be: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:45.597659 12119 tablet_bootstrap.cc:492] T b8baeafde60b486094f5139efec7eca0 P 367d36143adf465b950244c6baa620a5: Bootstrap starting.
I20260709 13:03:45.599234 12120 consensus_queue.cc:260] T a846ec1843bc4dbca0df61be2992759d P bd1c07cda9da4436b69174af3a1ce92f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:45.610296 12120 ts_tablet_manager.cc:1434] T a846ec1843bc4dbca0df61be2992759d P bd1c07cda9da4436b69174af3a1ce92f: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.003s
I20260709 13:03:45.611155 11954 heartbeater.cc:499] Master 127.0.107.254:40505 was elected leader, sending a full tablet report...
I20260709 13:03:45.620857 12120 tablet_bootstrap.cc:492] T 03ae675fe38f4f2b96936940980c1ee9 P bd1c07cda9da4436b69174af3a1ce92f: Bootstrap starting.
I20260709 13:03:45.624316 12119 tablet_bootstrap.cc:654] T b8baeafde60b486094f5139efec7eca0 P 367d36143adf465b950244c6baa620a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:45.627660 12120 tablet_bootstrap.cc:654] T 03ae675fe38f4f2b96936940980c1ee9 P bd1c07cda9da4436b69174af3a1ce92f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:45.630034 12118 tablet_bootstrap.cc:492] T a846ec1843bc4dbca0df61be2992759d P 8dfed99448174185ba5ece679e9d90be: No bootstrap required, opened a new log
I20260709 13:03:45.630792 12118 ts_tablet_manager.cc:1403] T a846ec1843bc4dbca0df61be2992759d P 8dfed99448174185ba5ece679e9d90be: Time spent bootstrapping tablet: real 0.041s	user 0.030s	sys 0.008s
I20260709 13:03:45.634227 12118 raft_consensus.cc:359] T a846ec1843bc4dbca0df61be2992759d P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:45.635264 12118 raft_consensus.cc:385] T a846ec1843bc4dbca0df61be2992759d P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:45.635682 12118 raft_consensus.cc:740] T a846ec1843bc4dbca0df61be2992759d P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dfed99448174185ba5ece679e9d90be, State: Initialized, Role: FOLLOWER
I20260709 13:03:45.636724 12118 consensus_queue.cc:260] T a846ec1843bc4dbca0df61be2992759d P 8dfed99448174185ba5ece679e9d90be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:45.638473 12119 tablet_bootstrap.cc:492] T b8baeafde60b486094f5139efec7eca0 P 367d36143adf465b950244c6baa620a5: No bootstrap required, opened a new log
I20260709 13:03:45.638509 12120 tablet_bootstrap.cc:492] T 03ae675fe38f4f2b96936940980c1ee9 P bd1c07cda9da4436b69174af3a1ce92f: No bootstrap required, opened a new log
I20260709 13:03:45.639122 12119 ts_tablet_manager.cc:1403] T b8baeafde60b486094f5139efec7eca0 P 367d36143adf465b950244c6baa620a5: Time spent bootstrapping tablet: real 0.042s	user 0.017s	sys 0.004s
I20260709 13:03:45.639231 12120 ts_tablet_manager.cc:1403] T 03ae675fe38f4f2b96936940980c1ee9 P bd1c07cda9da4436b69174af3a1ce92f: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.007s
I20260709 13:03:45.639207 12103 heartbeater.cc:499] Master 127.0.107.254:40505 was elected leader, sending a full tablet report...
I20260709 13:03:45.641937 12118 ts_tablet_manager.cc:1434] T a846ec1843bc4dbca0df61be2992759d P 8dfed99448174185ba5ece679e9d90be: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:03:45.642053 12119 raft_consensus.cc:359] T b8baeafde60b486094f5139efec7eca0 P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:45.642506 12120 raft_consensus.cc:359] T 03ae675fe38f4f2b96936940980c1ee9 P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:45.643064 12119 raft_consensus.cc:385] T b8baeafde60b486094f5139efec7eca0 P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:45.643247 12118 tablet_bootstrap.cc:492] T bda83ed4e6b84bf9985ad11c37b2bd59 P 8dfed99448174185ba5ece679e9d90be: Bootstrap starting.
I20260709 13:03:45.643530 12119 raft_consensus.cc:740] T b8baeafde60b486094f5139efec7eca0 P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 367d36143adf465b950244c6baa620a5, State: Initialized, Role: FOLLOWER
I20260709 13:03:45.643561 12120 raft_consensus.cc:385] T 03ae675fe38f4f2b96936940980c1ee9 P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:45.644166 12120 raft_consensus.cc:740] T 03ae675fe38f4f2b96936940980c1ee9 P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd1c07cda9da4436b69174af3a1ce92f, State: Initialized, Role: FOLLOWER
I20260709 13:03:45.644471 12119 consensus_queue.cc:260] T b8baeafde60b486094f5139efec7eca0 P 367d36143adf465b950244c6baa620a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:45.645344 12120 consensus_queue.cc:260] T 03ae675fe38f4f2b96936940980c1ee9 P bd1c07cda9da4436b69174af3a1ce92f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:45.650362 12118 tablet_bootstrap.cc:654] T bda83ed4e6b84bf9985ad11c37b2bd59 P 8dfed99448174185ba5ece679e9d90be: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:45.651734 12120 ts_tablet_manager.cc:1434] T 03ae675fe38f4f2b96936940980c1ee9 P bd1c07cda9da4436b69174af3a1ce92f: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:03:45.652922 12120 tablet_bootstrap.cc:492] T 8b0eaec7710c47e79cc78a1085de9b3f P bd1c07cda9da4436b69174af3a1ce92f: Bootstrap starting.
I20260709 13:03:45.659932 12120 tablet_bootstrap.cc:654] T 8b0eaec7710c47e79cc78a1085de9b3f P bd1c07cda9da4436b69174af3a1ce92f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:45.672796 12120 tablet_bootstrap.cc:492] T 8b0eaec7710c47e79cc78a1085de9b3f P bd1c07cda9da4436b69174af3a1ce92f: No bootstrap required, opened a new log
I20260709 13:03:45.673450 12120 ts_tablet_manager.cc:1403] T 8b0eaec7710c47e79cc78a1085de9b3f P bd1c07cda9da4436b69174af3a1ce92f: Time spent bootstrapping tablet: real 0.021s	user 0.017s	sys 0.001s
I20260709 13:03:45.676988 12120 raft_consensus.cc:359] T 8b0eaec7710c47e79cc78a1085de9b3f P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } }
I20260709 13:03:45.677839 12120 raft_consensus.cc:385] T 8b0eaec7710c47e79cc78a1085de9b3f P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:45.678182 12120 raft_consensus.cc:740] T 8b0eaec7710c47e79cc78a1085de9b3f P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd1c07cda9da4436b69174af3a1ce92f, State: Initialized, Role: FOLLOWER
I20260709 13:03:45.679399 12120 consensus_queue.cc:260] T 8b0eaec7710c47e79cc78a1085de9b3f P bd1c07cda9da4436b69174af3a1ce92f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } }
I20260709 13:03:45.683542 12120 ts_tablet_manager.cc:1434] T 8b0eaec7710c47e79cc78a1085de9b3f P bd1c07cda9da4436b69174af3a1ce92f: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.004s
I20260709 13:03:45.683810 12029 heartbeater.cc:499] Master 127.0.107.254:40505 was elected leader, sending a full tablet report...
I20260709 13:03:45.684362 12119 ts_tablet_manager.cc:1434] T b8baeafde60b486094f5139efec7eca0 P 367d36143adf465b950244c6baa620a5: Time spent starting tablet: real 0.045s	user 0.017s	sys 0.024s
I20260709 13:03:45.684911 12120 tablet_bootstrap.cc:492] T 196209061a514376bb68b340c922a883 P bd1c07cda9da4436b69174af3a1ce92f: Bootstrap starting.
I20260709 13:03:45.685452 12119 tablet_bootstrap.cc:492] T a846ec1843bc4dbca0df61be2992759d P 367d36143adf465b950244c6baa620a5: Bootstrap starting.
I20260709 13:03:45.692072 12119 tablet_bootstrap.cc:654] T a846ec1843bc4dbca0df61be2992759d P 367d36143adf465b950244c6baa620a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:45.692437 12120 tablet_bootstrap.cc:654] T 196209061a514376bb68b340c922a883 P bd1c07cda9da4436b69174af3a1ce92f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:45.694553 12118 tablet_bootstrap.cc:492] T bda83ed4e6b84bf9985ad11c37b2bd59 P 8dfed99448174185ba5ece679e9d90be: No bootstrap required, opened a new log
I20260709 13:03:45.695490 12118 ts_tablet_manager.cc:1403] T bda83ed4e6b84bf9985ad11c37b2bd59 P 8dfed99448174185ba5ece679e9d90be: Time spent bootstrapping tablet: real 0.052s	user 0.029s	sys 0.011s
I20260709 13:03:45.698990 12118 raft_consensus.cc:359] T bda83ed4e6b84bf9985ad11c37b2bd59 P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:45.700086 12118 raft_consensus.cc:385] T bda83ed4e6b84bf9985ad11c37b2bd59 P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:45.700409 12118 raft_consensus.cc:740] T bda83ed4e6b84bf9985ad11c37b2bd59 P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dfed99448174185ba5ece679e9d90be, State: Initialized, Role: FOLLOWER
I20260709 13:03:45.701356 12118 consensus_queue.cc:260] T bda83ed4e6b84bf9985ad11c37b2bd59 P 8dfed99448174185ba5ece679e9d90be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:45.703497 12118 ts_tablet_manager.cc:1434] T bda83ed4e6b84bf9985ad11c37b2bd59 P 8dfed99448174185ba5ece679e9d90be: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:03:45.704489 12118 tablet_bootstrap.cc:492] T 03ae675fe38f4f2b96936940980c1ee9 P 8dfed99448174185ba5ece679e9d90be: Bootstrap starting.
I20260709 13:03:45.704658 12119 tablet_bootstrap.cc:492] T a846ec1843bc4dbca0df61be2992759d P 367d36143adf465b950244c6baa620a5: No bootstrap required, opened a new log
I20260709 13:03:45.705226 12119 ts_tablet_manager.cc:1403] T a846ec1843bc4dbca0df61be2992759d P 367d36143adf465b950244c6baa620a5: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.000s
I20260709 13:03:45.707759 12120 tablet_bootstrap.cc:492] T 196209061a514376bb68b340c922a883 P bd1c07cda9da4436b69174af3a1ce92f: No bootstrap required, opened a new log
I20260709 13:03:45.708447 12120 ts_tablet_manager.cc:1403] T 196209061a514376bb68b340c922a883 P bd1c07cda9da4436b69174af3a1ce92f: Time spent bootstrapping tablet: real 0.024s	user 0.019s	sys 0.000s
I20260709 13:03:45.708297 12119 raft_consensus.cc:359] T a846ec1843bc4dbca0df61be2992759d P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:45.709184 12119 raft_consensus.cc:385] T a846ec1843bc4dbca0df61be2992759d P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:45.709509 12119 raft_consensus.cc:740] T a846ec1843bc4dbca0df61be2992759d P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 367d36143adf465b950244c6baa620a5, State: Initialized, Role: FOLLOWER
I20260709 13:03:45.710433 12119 consensus_queue.cc:260] T a846ec1843bc4dbca0df61be2992759d P 367d36143adf465b950244c6baa620a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:45.711221 12118 tablet_bootstrap.cc:654] T 03ae675fe38f4f2b96936940980c1ee9 P 8dfed99448174185ba5ece679e9d90be: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:45.712091 12126 raft_consensus.cc:493] T bda83ed4e6b84bf9985ad11c37b2bd59 P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:45.711998 12120 raft_consensus.cc:359] T 196209061a514376bb68b340c922a883 P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:45.712733 12126 raft_consensus.cc:515] T bda83ed4e6b84bf9985ad11c37b2bd59 P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:45.713119 12120 raft_consensus.cc:385] T 196209061a514376bb68b340c922a883 P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:45.713529 12120 raft_consensus.cc:740] T 196209061a514376bb68b340c922a883 P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd1c07cda9da4436b69174af3a1ce92f, State: Initialized, Role: FOLLOWER
I20260709 13:03:45.714371 12120 consensus_queue.cc:260] T 196209061a514376bb68b340c922a883 P bd1c07cda9da4436b69174af3a1ce92f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:45.716619 12120 ts_tablet_manager.cc:1434] T 196209061a514376bb68b340c922a883 P bd1c07cda9da4436b69174af3a1ce92f: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:03:45.718803 12132 raft_consensus.cc:493] T a846ec1843bc4dbca0df61be2992759d P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:45.719368 12120 tablet_bootstrap.cc:492] T bda83ed4e6b84bf9985ad11c37b2bd59 P bd1c07cda9da4436b69174af3a1ce92f: Bootstrap starting.
I20260709 13:03:45.720887 12119 ts_tablet_manager.cc:1434] T a846ec1843bc4dbca0df61be2992759d P 367d36143adf465b950244c6baa620a5: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.004s
I20260709 13:03:45.722229 12119 tablet_bootstrap.cc:492] T 8b0eaec7710c47e79cc78a1085de9b3f P 367d36143adf465b950244c6baa620a5: Bootstrap starting.
I20260709 13:03:45.726711 12120 tablet_bootstrap.cc:654] T bda83ed4e6b84bf9985ad11c37b2bd59 P bd1c07cda9da4436b69174af3a1ce92f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:45.727864 12123 raft_consensus.cc:493] T a846ec1843bc4dbca0df61be2992759d P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:45.728488 12123 raft_consensus.cc:515] T a846ec1843bc4dbca0df61be2992759d P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:45.719404 12132 raft_consensus.cc:515] T a846ec1843bc4dbca0df61be2992759d P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:45.731247 12123 leader_election.cc:290] T a846ec1843bc4dbca0df61be2992759d P bd1c07cda9da4436b69174af3a1ce92f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337), 8dfed99448174185ba5ece679e9d90be (127.0.107.195:39279)
I20260709 13:03:45.733543 12118 tablet_bootstrap.cc:492] T 03ae675fe38f4f2b96936940980c1ee9 P 8dfed99448174185ba5ece679e9d90be: No bootstrap required, opened a new log
I20260709 13:03:45.734230 12118 ts_tablet_manager.cc:1403] T 03ae675fe38f4f2b96936940980c1ee9 P 8dfed99448174185ba5ece679e9d90be: Time spent bootstrapping tablet: real 0.030s	user 0.010s	sys 0.012s
I20260709 13:03:45.737535 12118 raft_consensus.cc:359] T 03ae675fe38f4f2b96936940980c1ee9 P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:45.738273 12118 raft_consensus.cc:385] T 03ae675fe38f4f2b96936940980c1ee9 P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:45.738554 12118 raft_consensus.cc:740] T 03ae675fe38f4f2b96936940980c1ee9 P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dfed99448174185ba5ece679e9d90be, State: Initialized, Role: FOLLOWER
I20260709 13:03:45.739328 12118 consensus_queue.cc:260] T 03ae675fe38f4f2b96936940980c1ee9 P 8dfed99448174185ba5ece679e9d90be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:45.745915 12126 leader_election.cc:290] T bda83ed4e6b84bf9985ad11c37b2bd59 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131), 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337)
I20260709 13:03:45.748890 12118 ts_tablet_manager.cc:1434] T 03ae675fe38f4f2b96936940980c1ee9 P 8dfed99448174185ba5ece679e9d90be: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.009s
I20260709 13:03:45.750048 12118 tablet_bootstrap.cc:492] T 8b0eaec7710c47e79cc78a1085de9b3f P 8dfed99448174185ba5ece679e9d90be: Bootstrap starting.
I20260709 13:03:45.754217 12132 leader_election.cc:290] T a846ec1843bc4dbca0df61be2992759d P 367d36143adf465b950244c6baa620a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131), 8dfed99448174185ba5ece679e9d90be (127.0.107.195:39279)
I20260709 13:03:45.756670 12118 tablet_bootstrap.cc:654] T 8b0eaec7710c47e79cc78a1085de9b3f P 8dfed99448174185ba5ece679e9d90be: Neither blocks nor log segments found. Creating new log.
W20260709 13:03:45.758882 12104 tablet.cc:2406] T 03ae675fe38f4f2b96936940980c1ee9 P 8dfed99448174185ba5ece679e9d90be: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:03:45.761358 12119 tablet_bootstrap.cc:654] T 8b0eaec7710c47e79cc78a1085de9b3f P 367d36143adf465b950244c6baa620a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:45.768836 12004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda83ed4e6b84bf9985ad11c37b2bd59" candidate_uuid: "8dfed99448174185ba5ece679e9d90be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "367d36143adf465b950244c6baa620a5" is_pre_election: true
I20260709 13:03:45.769882 12140 raft_consensus.cc:493] T a846ec1843bc4dbca0df61be2992759d P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:45.770464 12140 raft_consensus.cc:515] T a846ec1843bc4dbca0df61be2992759d P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:45.772946 12140 leader_election.cc:290] T a846ec1843bc4dbca0df61be2992759d P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131), 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337)
I20260709 13:03:45.775516 12118 tablet_bootstrap.cc:492] T 8b0eaec7710c47e79cc78a1085de9b3f P 8dfed99448174185ba5ece679e9d90be: No bootstrap required, opened a new log
I20260709 13:03:45.776160 12118 ts_tablet_manager.cc:1403] T 8b0eaec7710c47e79cc78a1085de9b3f P 8dfed99448174185ba5ece679e9d90be: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.004s
I20260709 13:03:45.779273 12118 raft_consensus.cc:359] T 8b0eaec7710c47e79cc78a1085de9b3f P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } }
I20260709 13:03:45.780030 12118 raft_consensus.cc:385] T 8b0eaec7710c47e79cc78a1085de9b3f P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:45.780336 12118 raft_consensus.cc:740] T 8b0eaec7710c47e79cc78a1085de9b3f P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dfed99448174185ba5ece679e9d90be, State: Initialized, Role: FOLLOWER
I20260709 13:03:45.781303 12118 consensus_queue.cc:260] T 8b0eaec7710c47e79cc78a1085de9b3f P 8dfed99448174185ba5ece679e9d90be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } }
I20260709 13:03:45.786516 12118 ts_tablet_manager.cc:1434] T 8b0eaec7710c47e79cc78a1085de9b3f P 8dfed99448174185ba5ece679e9d90be: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:03:45.787698 12118 tablet_bootstrap.cc:492] T b8baeafde60b486094f5139efec7eca0 P 8dfed99448174185ba5ece679e9d90be: Bootstrap starting.
I20260709 13:03:45.791723 12004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a846ec1843bc4dbca0df61be2992759d" candidate_uuid: "bd1c07cda9da4436b69174af3a1ce92f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "367d36143adf465b950244c6baa620a5" is_pre_election: true
I20260709 13:03:45.792485 12004 raft_consensus.cc:2468] T a846ec1843bc4dbca0df61be2992759d P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd1c07cda9da4436b69174af3a1ce92f in term 0.
I20260709 13:03:45.794157 12118 tablet_bootstrap.cc:654] T b8baeafde60b486094f5139efec7eca0 P 8dfed99448174185ba5ece679e9d90be: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:45.795465 12004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a846ec1843bc4dbca0df61be2992759d" candidate_uuid: "8dfed99448174185ba5ece679e9d90be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "367d36143adf465b950244c6baa620a5" is_pre_election: true
I20260709 13:03:45.796150 12004 raft_consensus.cc:2468] T a846ec1843bc4dbca0df61be2992759d P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dfed99448174185ba5ece679e9d90be in term 0.
W20260709 13:03:45.797566 12042 leader_election.cc:343] T bda83ed4e6b84bf9985ad11c37b2bd59 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:45.798503 12042 leader_election.cc:304] T a846ec1843bc4dbca0df61be2992759d P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 367d36143adf465b950244c6baa620a5, 8dfed99448174185ba5ece679e9d90be; no voters: 
I20260709 13:03:45.799286 11893 leader_election.cc:304] T a846ec1843bc4dbca0df61be2992759d P bd1c07cda9da4436b69174af3a1ce92f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 367d36143adf465b950244c6baa620a5, bd1c07cda9da4436b69174af3a1ce92f; no voters: 
I20260709 13:03:45.800465 12123 raft_consensus.cc:2804] T a846ec1843bc4dbca0df61be2992759d P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:45.800884 12123 raft_consensus.cc:493] T a846ec1843bc4dbca0df61be2992759d P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:45.801232 12123 raft_consensus.cc:3060] T a846ec1843bc4dbca0df61be2992759d P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:45.799593 12132 raft_consensus.cc:493] T b8baeafde60b486094f5139efec7eca0 P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:45.802469 12132 raft_consensus.cc:515] T b8baeafde60b486094f5139efec7eca0 P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:45.805053 12132 leader_election.cc:290] T b8baeafde60b486094f5139efec7eca0 P 367d36143adf465b950244c6baa620a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131), 8dfed99448174185ba5ece679e9d90be (127.0.107.195:39279)
I20260709 13:03:45.809041 12123 raft_consensus.cc:515] T a846ec1843bc4dbca0df61be2992759d P bd1c07cda9da4436b69174af3a1ce92f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:45.811646 11929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda83ed4e6b84bf9985ad11c37b2bd59" candidate_uuid: "8dfed99448174185ba5ece679e9d90be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd1c07cda9da4436b69174af3a1ce92f" is_pre_election: true
I20260709 13:03:45.813253 11928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a846ec1843bc4dbca0df61be2992759d" candidate_uuid: "8dfed99448174185ba5ece679e9d90be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd1c07cda9da4436b69174af3a1ce92f" is_pre_election: true
I20260709 13:03:45.814162 11928 raft_consensus.cc:2393] T a846ec1843bc4dbca0df61be2992759d P bd1c07cda9da4436b69174af3a1ce92f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dfed99448174185ba5ece679e9d90be in current term 1: Already voted for candidate bd1c07cda9da4436b69174af3a1ce92f in this term.
W20260709 13:03:45.815477 12043 leader_election.cc:343] T bda83ed4e6b84bf9985ad11c37b2bd59 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:45.815932 12043 leader_election.cc:304] T bda83ed4e6b84bf9985ad11c37b2bd59 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dfed99448174185ba5ece679e9d90be; no voters: 367d36143adf465b950244c6baa620a5, bd1c07cda9da4436b69174af3a1ce92f
I20260709 13:03:45.817402 12140 raft_consensus.cc:2749] T bda83ed4e6b84bf9985ad11c37b2bd59 P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:45.818967 12004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a846ec1843bc4dbca0df61be2992759d" candidate_uuid: "bd1c07cda9da4436b69174af3a1ce92f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "367d36143adf465b950244c6baa620a5"
I20260709 13:03:45.819665 12004 raft_consensus.cc:3060] T a846ec1843bc4dbca0df61be2992759d P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:45.824270 12119 tablet_bootstrap.cc:492] T 8b0eaec7710c47e79cc78a1085de9b3f P 367d36143adf465b950244c6baa620a5: No bootstrap required, opened a new log
I20260709 13:03:45.824894 12119 ts_tablet_manager.cc:1403] T 8b0eaec7710c47e79cc78a1085de9b3f P 367d36143adf465b950244c6baa620a5: Time spent bootstrapping tablet: real 0.103s	user 0.007s	sys 0.004s
I20260709 13:03:45.827334 12123 leader_election.cc:290] T a846ec1843bc4dbca0df61be2992759d P bd1c07cda9da4436b69174af3a1ce92f [CANDIDATE]: Term 1 election: Requested vote from peers 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337), 8dfed99448174185ba5ece679e9d90be (127.0.107.195:39279)
I20260709 13:03:45.829363 12004 raft_consensus.cc:2468] T a846ec1843bc4dbca0df61be2992759d P 367d36143adf465b950244c6baa620a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd1c07cda9da4436b69174af3a1ce92f in term 1.
I20260709 13:03:45.830842 11893 leader_election.cc:304] T a846ec1843bc4dbca0df61be2992759d P bd1c07cda9da4436b69174af3a1ce92f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 367d36143adf465b950244c6baa620a5, bd1c07cda9da4436b69174af3a1ce92f; no voters: 
I20260709 13:03:45.831710 12140 raft_consensus.cc:2804] T a846ec1843bc4dbca0df61be2992759d P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:45.832176 12140 raft_consensus.cc:493] T a846ec1843bc4dbca0df61be2992759d P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:45.832506 12140 raft_consensus.cc:3060] T a846ec1843bc4dbca0df61be2992759d P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:45.836854 11928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a846ec1843bc4dbca0df61be2992759d" candidate_uuid: "367d36143adf465b950244c6baa620a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd1c07cda9da4436b69174af3a1ce92f" is_pre_election: true
I20260709 13:03:45.837764 11928 raft_consensus.cc:2393] T a846ec1843bc4dbca0df61be2992759d P bd1c07cda9da4436b69174af3a1ce92f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 367d36143adf465b950244c6baa620a5 in current term 1: Already voted for candidate bd1c07cda9da4436b69174af3a1ce92f in this term.
I20260709 13:03:45.838768 11929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8baeafde60b486094f5139efec7eca0" candidate_uuid: "367d36143adf465b950244c6baa620a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd1c07cda9da4436b69174af3a1ce92f" is_pre_election: true
W20260709 13:03:45.840737 11969 leader_election.cc:343] T b8baeafde60b486094f5139efec7eca0 P 367d36143adf465b950244c6baa620a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:45.840914 12078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a846ec1843bc4dbca0df61be2992759d" candidate_uuid: "367d36143adf465b950244c6baa620a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dfed99448174185ba5ece679e9d90be" is_pre_election: true
I20260709 13:03:45.842046 12077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8baeafde60b486094f5139efec7eca0" candidate_uuid: "367d36143adf465b950244c6baa620a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dfed99448174185ba5ece679e9d90be" is_pre_election: true
I20260709 13:03:45.846788 12140 raft_consensus.cc:515] T a846ec1843bc4dbca0df61be2992759d P 8dfed99448174185ba5ece679e9d90be [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
W20260709 13:03:45.847234 11968 leader_election.cc:343] T b8baeafde60b486094f5139efec7eca0 P 367d36143adf465b950244c6baa620a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dfed99448174185ba5ece679e9d90be (127.0.107.195:39279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:45.848055 12078 raft_consensus.cc:2393] T a846ec1843bc4dbca0df61be2992759d P 8dfed99448174185ba5ece679e9d90be [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 367d36143adf465b950244c6baa620a5 in current term 1: Already voted for candidate 8dfed99448174185ba5ece679e9d90be in this term.
I20260709 13:03:45.848569 11968 leader_election.cc:304] T b8baeafde60b486094f5139efec7eca0 P 367d36143adf465b950244c6baa620a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 367d36143adf465b950244c6baa620a5; no voters: 8dfed99448174185ba5ece679e9d90be, bd1c07cda9da4436b69174af3a1ce92f
I20260709 13:03:45.849900 12132 raft_consensus.cc:2749] T b8baeafde60b486094f5139efec7eca0 P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:45.851872 11968 leader_election.cc:304] T a846ec1843bc4dbca0df61be2992759d P 367d36143adf465b950244c6baa620a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 367d36143adf465b950244c6baa620a5; no voters: 8dfed99448174185ba5ece679e9d90be, bd1c07cda9da4436b69174af3a1ce92f
I20260709 13:03:45.853094 12123 raft_consensus.cc:2804] T a846ec1843bc4dbca0df61be2992759d P bd1c07cda9da4436b69174af3a1ce92f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:45.854156 12132 raft_consensus.cc:2749] T a846ec1843bc4dbca0df61be2992759d P 367d36143adf465b950244c6baa620a5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:45.856308 12140 leader_election.cc:290] T a846ec1843bc4dbca0df61be2992759d P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 1 election: Requested vote from peers bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131), 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337)
I20260709 13:03:45.856870 12120 tablet_bootstrap.cc:492] T bda83ed4e6b84bf9985ad11c37b2bd59 P bd1c07cda9da4436b69174af3a1ce92f: No bootstrap required, opened a new log
I20260709 13:03:45.856993 11929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a846ec1843bc4dbca0df61be2992759d" candidate_uuid: "8dfed99448174185ba5ece679e9d90be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd1c07cda9da4436b69174af3a1ce92f"
I20260709 13:03:45.857538 12120 ts_tablet_manager.cc:1403] T bda83ed4e6b84bf9985ad11c37b2bd59 P bd1c07cda9da4436b69174af3a1ce92f: Time spent bootstrapping tablet: real 0.138s	user 0.051s	sys 0.062s
I20260709 13:03:45.858923 12004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a846ec1843bc4dbca0df61be2992759d" candidate_uuid: "8dfed99448174185ba5ece679e9d90be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "367d36143adf465b950244c6baa620a5"
I20260709 13:03:45.859762 12004 raft_consensus.cc:2393] T a846ec1843bc4dbca0df61be2992759d P 367d36143adf465b950244c6baa620a5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dfed99448174185ba5ece679e9d90be in current term 1: Already voted for candidate bd1c07cda9da4436b69174af3a1ce92f in this term.
I20260709 13:03:45.861585 12120 raft_consensus.cc:359] T bda83ed4e6b84bf9985ad11c37b2bd59 P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:45.862214 12120 raft_consensus.cc:385] T bda83ed4e6b84bf9985ad11c37b2bd59 P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:45.862253 12118 tablet_bootstrap.cc:492] T b8baeafde60b486094f5139efec7eca0 P 8dfed99448174185ba5ece679e9d90be: No bootstrap required, opened a new log
I20260709 13:03:45.858577 12119 raft_consensus.cc:359] T 8b0eaec7710c47e79cc78a1085de9b3f P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } }
I20260709 13:03:45.862470 12120 raft_consensus.cc:740] T bda83ed4e6b84bf9985ad11c37b2bd59 P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd1c07cda9da4436b69174af3a1ce92f, State: Initialized, Role: FOLLOWER
I20260709 13:03:45.863009 12118 ts_tablet_manager.cc:1403] T b8baeafde60b486094f5139efec7eca0 P 8dfed99448174185ba5ece679e9d90be: Time spent bootstrapping tablet: real 0.076s	user 0.023s	sys 0.045s
I20260709 13:03:45.863605 12078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a846ec1843bc4dbca0df61be2992759d" candidate_uuid: "bd1c07cda9da4436b69174af3a1ce92f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dfed99448174185ba5ece679e9d90be" is_pre_election: true
I20260709 13:03:45.864157 12077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a846ec1843bc4dbca0df61be2992759d" candidate_uuid: "bd1c07cda9da4436b69174af3a1ce92f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dfed99448174185ba5ece679e9d90be"
I20260709 13:03:45.864650 12078 raft_consensus.cc:2393] T a846ec1843bc4dbca0df61be2992759d P 8dfed99448174185ba5ece679e9d90be [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd1c07cda9da4436b69174af3a1ce92f in current term 1: Already voted for candidate 8dfed99448174185ba5ece679e9d90be in this term.
I20260709 13:03:45.863022 12119 raft_consensus.cc:385] T 8b0eaec7710c47e79cc78a1085de9b3f P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:45.865319 12119 raft_consensus.cc:740] T 8b0eaec7710c47e79cc78a1085de9b3f P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 367d36143adf465b950244c6baa620a5, State: Initialized, Role: FOLLOWER
I20260709 13:03:45.863620 12120 consensus_queue.cc:260] T bda83ed4e6b84bf9985ad11c37b2bd59 P bd1c07cda9da4436b69174af3a1ce92f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:45.866205 12119 consensus_queue.cc:260] T 8b0eaec7710c47e79cc78a1085de9b3f P 367d36143adf465b950244c6baa620a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } }
I20260709 13:03:45.866770 12118 raft_consensus.cc:359] T b8baeafde60b486094f5139efec7eca0 P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:45.867530 12118 raft_consensus.cc:385] T b8baeafde60b486094f5139efec7eca0 P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:45.867828 12118 raft_consensus.cc:740] T b8baeafde60b486094f5139efec7eca0 P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dfed99448174185ba5ece679e9d90be, State: Initialized, Role: FOLLOWER
I20260709 13:03:45.868364 12120 ts_tablet_manager.cc:1434] T bda83ed4e6b84bf9985ad11c37b2bd59 P bd1c07cda9da4436b69174af3a1ce92f: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.003s
I20260709 13:03:45.868873 12119 ts_tablet_manager.cc:1434] T 8b0eaec7710c47e79cc78a1085de9b3f P 367d36143adf465b950244c6baa620a5: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.002s
I20260709 13:03:45.868724 12118 consensus_queue.cc:260] T b8baeafde60b486094f5139efec7eca0 P 8dfed99448174185ba5ece679e9d90be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:45.864539 12123 raft_consensus.cc:697] T a846ec1843bc4dbca0df61be2992759d P bd1c07cda9da4436b69174af3a1ce92f [term 1 LEADER]: Becoming Leader. State: Replica: bd1c07cda9da4436b69174af3a1ce92f, State: Running, Role: LEADER
I20260709 13:03:45.871094 12118 ts_tablet_manager.cc:1434] T b8baeafde60b486094f5139efec7eca0 P 8dfed99448174185ba5ece679e9d90be: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:03:45.869692 12120 tablet_bootstrap.cc:492] T 5078275d4ea64e67bf0a061eb3011157 P bd1c07cda9da4436b69174af3a1ce92f: Bootstrap starting.
I20260709 13:03:45.879846 12118 tablet_bootstrap.cc:492] T 5078275d4ea64e67bf0a061eb3011157 P 8dfed99448174185ba5ece679e9d90be: Bootstrap starting.
I20260709 13:03:45.885830 12120 tablet_bootstrap.cc:654] T 5078275d4ea64e67bf0a061eb3011157 P bd1c07cda9da4436b69174af3a1ce92f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:45.886401 12118 tablet_bootstrap.cc:654] T 5078275d4ea64e67bf0a061eb3011157 P 8dfed99448174185ba5ece679e9d90be: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:45.887295 12123 consensus_queue.cc:237] T a846ec1843bc4dbca0df61be2992759d P bd1c07cda9da4436b69174af3a1ce92f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:45.890769 12120 tablet_bootstrap.cc:492] T 5078275d4ea64e67bf0a061eb3011157 P bd1c07cda9da4436b69174af3a1ce92f: No bootstrap required, opened a new log
I20260709 13:03:45.891255 12120 ts_tablet_manager.cc:1403] T 5078275d4ea64e67bf0a061eb3011157 P bd1c07cda9da4436b69174af3a1ce92f: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.011s
I20260709 13:03:45.891685 12119 tablet_bootstrap.cc:492] T 03ae675fe38f4f2b96936940980c1ee9 P 367d36143adf465b950244c6baa620a5: Bootstrap starting.
I20260709 13:03:45.894533 12120 raft_consensus.cc:359] T 5078275d4ea64e67bf0a061eb3011157 P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:45.895733 12120 raft_consensus.cc:385] T 5078275d4ea64e67bf0a061eb3011157 P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:45.896107 12120 raft_consensus.cc:740] T 5078275d4ea64e67bf0a061eb3011157 P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd1c07cda9da4436b69174af3a1ce92f, State: Initialized, Role: FOLLOWER
I20260709 13:03:45.896976 12120 consensus_queue.cc:260] T 5078275d4ea64e67bf0a061eb3011157 P bd1c07cda9da4436b69174af3a1ce92f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:45.899227 12119 tablet_bootstrap.cc:654] T 03ae675fe38f4f2b96936940980c1ee9 P 367d36143adf465b950244c6baa620a5: Neither blocks nor log segments found. Creating new log.
W20260709 13:03:45.901589 11875 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:03:45.902930 12120 ts_tablet_manager.cc:1434] T 5078275d4ea64e67bf0a061eb3011157 P bd1c07cda9da4436b69174af3a1ce92f: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:03:45.904131 12120 tablet_bootstrap.cc:492] T 7f973c97455b4d918d353553cbe194a9 P bd1c07cda9da4436b69174af3a1ce92f: Bootstrap starting.
I20260709 13:03:45.904460 12118 tablet_bootstrap.cc:492] T 5078275d4ea64e67bf0a061eb3011157 P 8dfed99448174185ba5ece679e9d90be: No bootstrap required, opened a new log
I20260709 13:03:45.905022 12118 ts_tablet_manager.cc:1403] T 5078275d4ea64e67bf0a061eb3011157 P 8dfed99448174185ba5ece679e9d90be: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.008s
I20260709 13:03:45.904906 12043 leader_election.cc:304] T a846ec1843bc4dbca0df61be2992759d P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dfed99448174185ba5ece679e9d90be; no voters: 367d36143adf465b950244c6baa620a5, bd1c07cda9da4436b69174af3a1ce92f
I20260709 13:03:45.906351 12140 raft_consensus.cc:2749] T a846ec1843bc4dbca0df61be2992759d P 8dfed99448174185ba5ece679e9d90be [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:03:45.907498 11826 catalog_manager.cc:5697] T a846ec1843bc4dbca0df61be2992759d P bd1c07cda9da4436b69174af3a1ce92f reported cstate change: term changed from 0 to 1, leader changed from <none> to bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193). New cstate: current_term: 1 leader_uuid: "bd1c07cda9da4436b69174af3a1ce92f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:45.908387 12118 raft_consensus.cc:359] T 5078275d4ea64e67bf0a061eb3011157 P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:45.909216 12118 raft_consensus.cc:385] T 5078275d4ea64e67bf0a061eb3011157 P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:45.909392 12119 tablet_bootstrap.cc:492] T 03ae675fe38f4f2b96936940980c1ee9 P 367d36143adf465b950244c6baa620a5: No bootstrap required, opened a new log
I20260709 13:03:45.909557 12118 raft_consensus.cc:740] T 5078275d4ea64e67bf0a061eb3011157 P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dfed99448174185ba5ece679e9d90be, State: Initialized, Role: FOLLOWER
I20260709 13:03:45.910015 12119 ts_tablet_manager.cc:1403] T 03ae675fe38f4f2b96936940980c1ee9 P 367d36143adf465b950244c6baa620a5: Time spent bootstrapping tablet: real 0.040s	user 0.010s	sys 0.001s
I20260709 13:03:45.910430 12118 consensus_queue.cc:260] T 5078275d4ea64e67bf0a061eb3011157 P 8dfed99448174185ba5ece679e9d90be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:45.911164 12120 tablet_bootstrap.cc:654] T 7f973c97455b4d918d353553cbe194a9 P bd1c07cda9da4436b69174af3a1ce92f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:45.912865 12118 ts_tablet_manager.cc:1434] T 5078275d4ea64e67bf0a061eb3011157 P 8dfed99448174185ba5ece679e9d90be: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:03:45.914008 12118 tablet_bootstrap.cc:492] T 7f973c97455b4d918d353553cbe194a9 P 8dfed99448174185ba5ece679e9d90be: Bootstrap starting.
I20260709 13:03:45.916061 12119 raft_consensus.cc:359] T 03ae675fe38f4f2b96936940980c1ee9 P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:45.916842 12119 raft_consensus.cc:385] T 03ae675fe38f4f2b96936940980c1ee9 P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:45.917177 12119 raft_consensus.cc:740] T 03ae675fe38f4f2b96936940980c1ee9 P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 367d36143adf465b950244c6baa620a5, State: Initialized, Role: FOLLOWER
I20260709 13:03:45.918093 12119 consensus_queue.cc:260] T 03ae675fe38f4f2b96936940980c1ee9 P 367d36143adf465b950244c6baa620a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:45.919822 12119 ts_tablet_manager.cc:1434] T 03ae675fe38f4f2b96936940980c1ee9 P 367d36143adf465b950244c6baa620a5: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:03:45.920462 12118 tablet_bootstrap.cc:654] T 7f973c97455b4d918d353553cbe194a9 P 8dfed99448174185ba5ece679e9d90be: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:45.920984 12119 tablet_bootstrap.cc:492] T bda83ed4e6b84bf9985ad11c37b2bd59 P 367d36143adf465b950244c6baa620a5: Bootstrap starting.
I20260709 13:03:45.925541 12120 tablet_bootstrap.cc:492] T 7f973c97455b4d918d353553cbe194a9 P bd1c07cda9da4436b69174af3a1ce92f: No bootstrap required, opened a new log
I20260709 13:03:45.926211 12120 ts_tablet_manager.cc:1403] T 7f973c97455b4d918d353553cbe194a9 P bd1c07cda9da4436b69174af3a1ce92f: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.007s
I20260709 13:03:45.929800 12120 raft_consensus.cc:359] T 7f973c97455b4d918d353553cbe194a9 P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:45.930769 12120 raft_consensus.cc:385] T 7f973c97455b4d918d353553cbe194a9 P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:45.931160 12120 raft_consensus.cc:740] T 7f973c97455b4d918d353553cbe194a9 P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd1c07cda9da4436b69174af3a1ce92f, State: Initialized, Role: FOLLOWER
I20260709 13:03:45.932444 12118 tablet_bootstrap.cc:492] T 7f973c97455b4d918d353553cbe194a9 P 8dfed99448174185ba5ece679e9d90be: No bootstrap required, opened a new log
I20260709 13:03:45.932220 12120 consensus_queue.cc:260] T 7f973c97455b4d918d353553cbe194a9 P bd1c07cda9da4436b69174af3a1ce92f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:45.933056 12118 ts_tablet_manager.cc:1403] T 7f973c97455b4d918d353553cbe194a9 P 8dfed99448174185ba5ece679e9d90be: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.004s
I20260709 13:03:45.933419 12119 tablet_bootstrap.cc:654] T bda83ed4e6b84bf9985ad11c37b2bd59 P 367d36143adf465b950244c6baa620a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:45.935497 12120 ts_tablet_manager.cc:1434] T 7f973c97455b4d918d353553cbe194a9 P bd1c07cda9da4436b69174af3a1ce92f: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:03:45.936815 12120 tablet_bootstrap.cc:492] T 95bf609349e54fdd867e40d7fd578e52 P bd1c07cda9da4436b69174af3a1ce92f: Bootstrap starting.
I20260709 13:03:45.936425 12118 raft_consensus.cc:359] T 7f973c97455b4d918d353553cbe194a9 P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:45.937377 12118 raft_consensus.cc:385] T 7f973c97455b4d918d353553cbe194a9 P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:45.937742 12118 raft_consensus.cc:740] T 7f973c97455b4d918d353553cbe194a9 P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dfed99448174185ba5ece679e9d90be, State: Initialized, Role: FOLLOWER
I20260709 13:03:45.938634 12118 consensus_queue.cc:260] T 7f973c97455b4d918d353553cbe194a9 P 8dfed99448174185ba5ece679e9d90be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:45.943666 12118 ts_tablet_manager.cc:1434] T 7f973c97455b4d918d353553cbe194a9 P 8dfed99448174185ba5ece679e9d90be: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.004s
I20260709 13:03:45.944550 12120 tablet_bootstrap.cc:654] T 95bf609349e54fdd867e40d7fd578e52 P bd1c07cda9da4436b69174af3a1ce92f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:45.945005 12118 tablet_bootstrap.cc:492] T 196209061a514376bb68b340c922a883 P 8dfed99448174185ba5ece679e9d90be: Bootstrap starting.
I20260709 13:03:45.951586 12123 raft_consensus.cc:493] T 8b0eaec7710c47e79cc78a1085de9b3f P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:45.952561 12118 tablet_bootstrap.cc:654] T 196209061a514376bb68b340c922a883 P 8dfed99448174185ba5ece679e9d90be: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:45.952224 12123 raft_consensus.cc:515] T 8b0eaec7710c47e79cc78a1085de9b3f P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } }
I20260709 13:03:45.954483 12123 leader_election.cc:290] T 8b0eaec7710c47e79cc78a1085de9b3f P bd1c07cda9da4436b69174af3a1ce92f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dfed99448174185ba5ece679e9d90be (127.0.107.195:39279), 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337)
I20260709 13:03:45.956853 12120 tablet_bootstrap.cc:492] T 95bf609349e54fdd867e40d7fd578e52 P bd1c07cda9da4436b69174af3a1ce92f: No bootstrap required, opened a new log
I20260709 13:03:45.957170 12078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b0eaec7710c47e79cc78a1085de9b3f" candidate_uuid: "bd1c07cda9da4436b69174af3a1ce92f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dfed99448174185ba5ece679e9d90be" is_pre_election: true
I20260709 13:03:45.957463 12120 ts_tablet_manager.cc:1403] T 95bf609349e54fdd867e40d7fd578e52 P bd1c07cda9da4436b69174af3a1ce92f: Time spent bootstrapping tablet: real 0.021s	user 0.007s	sys 0.012s
I20260709 13:03:45.958089 12078 raft_consensus.cc:2468] T 8b0eaec7710c47e79cc78a1085de9b3f P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd1c07cda9da4436b69174af3a1ce92f in term 0.
I20260709 13:03:45.959303 12004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b0eaec7710c47e79cc78a1085de9b3f" candidate_uuid: "bd1c07cda9da4436b69174af3a1ce92f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "367d36143adf465b950244c6baa620a5" is_pre_election: true
I20260709 13:03:45.960088 12004 raft_consensus.cc:2468] T 8b0eaec7710c47e79cc78a1085de9b3f P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd1c07cda9da4436b69174af3a1ce92f in term 0.
I20260709 13:03:45.960814 12120 raft_consensus.cc:359] T 95bf609349e54fdd867e40d7fd578e52 P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:45.961601 12120 raft_consensus.cc:385] T 95bf609349e54fdd867e40d7fd578e52 P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:45.961953 12120 raft_consensus.cc:740] T 95bf609349e54fdd867e40d7fd578e52 P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd1c07cda9da4436b69174af3a1ce92f, State: Initialized, Role: FOLLOWER
I20260709 13:03:45.961896 11893 leader_election.cc:304] T 8b0eaec7710c47e79cc78a1085de9b3f P bd1c07cda9da4436b69174af3a1ce92f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dfed99448174185ba5ece679e9d90be, bd1c07cda9da4436b69174af3a1ce92f; no voters: 
I20260709 13:03:45.963146 12123 raft_consensus.cc:2804] T 8b0eaec7710c47e79cc78a1085de9b3f P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:45.963586 12123 raft_consensus.cc:493] T 8b0eaec7710c47e79cc78a1085de9b3f P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:45.964006 12123 raft_consensus.cc:3060] T 8b0eaec7710c47e79cc78a1085de9b3f P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:45.964340 12120 consensus_queue.cc:260] T 95bf609349e54fdd867e40d7fd578e52 P bd1c07cda9da4436b69174af3a1ce92f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:45.967126 12120 ts_tablet_manager.cc:1434] T 95bf609349e54fdd867e40d7fd578e52 P bd1c07cda9da4436b69174af3a1ce92f: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:03:45.968290 12120 tablet_bootstrap.cc:492] T b8baeafde60b486094f5139efec7eca0 P bd1c07cda9da4436b69174af3a1ce92f: Bootstrap starting.
I20260709 13:03:45.972627 12123 raft_consensus.cc:515] T 8b0eaec7710c47e79cc78a1085de9b3f P bd1c07cda9da4436b69174af3a1ce92f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } }
I20260709 13:03:45.974354 12120 tablet_bootstrap.cc:654] T b8baeafde60b486094f5139efec7eca0 P bd1c07cda9da4436b69174af3a1ce92f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:45.976583 12119 tablet_bootstrap.cc:492] T bda83ed4e6b84bf9985ad11c37b2bd59 P 367d36143adf465b950244c6baa620a5: No bootstrap required, opened a new log
I20260709 13:03:45.977295 12119 ts_tablet_manager.cc:1403] T bda83ed4e6b84bf9985ad11c37b2bd59 P 367d36143adf465b950244c6baa620a5: Time spent bootstrapping tablet: real 0.057s	user 0.023s	sys 0.002s
I20260709 13:03:45.981755 12123 leader_election.cc:290] T 8b0eaec7710c47e79cc78a1085de9b3f P bd1c07cda9da4436b69174af3a1ce92f [CANDIDATE]: Term 1 election: Requested vote from peers 8dfed99448174185ba5ece679e9d90be (127.0.107.195:39279), 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337)
I20260709 13:03:45.982946 12078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b0eaec7710c47e79cc78a1085de9b3f" candidate_uuid: "bd1c07cda9da4436b69174af3a1ce92f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dfed99448174185ba5ece679e9d90be"
I20260709 13:03:45.983752 12078 raft_consensus.cc:3060] T 8b0eaec7710c47e79cc78a1085de9b3f P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:45.987655 12120 tablet_bootstrap.cc:492] T b8baeafde60b486094f5139efec7eca0 P bd1c07cda9da4436b69174af3a1ce92f: No bootstrap required, opened a new log
I20260709 13:03:45.988343 12120 ts_tablet_manager.cc:1403] T b8baeafde60b486094f5139efec7eca0 P bd1c07cda9da4436b69174af3a1ce92f: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.001s
I20260709 13:03:45.989539 12004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b0eaec7710c47e79cc78a1085de9b3f" candidate_uuid: "bd1c07cda9da4436b69174af3a1ce92f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "367d36143adf465b950244c6baa620a5"
I20260709 13:03:45.990347 12004 raft_consensus.cc:3060] T 8b0eaec7710c47e79cc78a1085de9b3f P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:45.991525 12120 raft_consensus.cc:359] T b8baeafde60b486094f5139efec7eca0 P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:45.992519 12120 raft_consensus.cc:385] T b8baeafde60b486094f5139efec7eca0 P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:45.992859 12120 raft_consensus.cc:740] T b8baeafde60b486094f5139efec7eca0 P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd1c07cda9da4436b69174af3a1ce92f, State: Initialized, Role: FOLLOWER
I20260709 13:03:45.993700 12120 consensus_queue.cc:260] T b8baeafde60b486094f5139efec7eca0 P bd1c07cda9da4436b69174af3a1ce92f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:45.995847 12120 ts_tablet_manager.cc:1434] T b8baeafde60b486094f5139efec7eca0 P bd1c07cda9da4436b69174af3a1ce92f: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.002s
I20260709 13:03:46.000851 12119 raft_consensus.cc:359] T bda83ed4e6b84bf9985ad11c37b2bd59 P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:46.001845 12119 raft_consensus.cc:385] T bda83ed4e6b84bf9985ad11c37b2bd59 P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:46.001627 12004 raft_consensus.cc:2468] T 8b0eaec7710c47e79cc78a1085de9b3f P 367d36143adf465b950244c6baa620a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd1c07cda9da4436b69174af3a1ce92f in term 1.
I20260709 13:03:46.002293 12119 raft_consensus.cc:740] T bda83ed4e6b84bf9985ad11c37b2bd59 P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 367d36143adf465b950244c6baa620a5, State: Initialized, Role: FOLLOWER
I20260709 13:03:46.003266 12119 consensus_queue.cc:260] T bda83ed4e6b84bf9985ad11c37b2bd59 P 367d36143adf465b950244c6baa620a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:46.003424 11893 leader_election.cc:304] T 8b0eaec7710c47e79cc78a1085de9b3f P bd1c07cda9da4436b69174af3a1ce92f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 367d36143adf465b950244c6baa620a5, bd1c07cda9da4436b69174af3a1ce92f; no voters: 
I20260709 13:03:46.004732 12123 raft_consensus.cc:2804] T 8b0eaec7710c47e79cc78a1085de9b3f P bd1c07cda9da4436b69174af3a1ce92f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:46.005800 12119 ts_tablet_manager.cc:1434] T bda83ed4e6b84bf9985ad11c37b2bd59 P 367d36143adf465b950244c6baa620a5: Time spent starting tablet: real 0.028s	user 0.010s	sys 0.000s
I20260709 13:03:46.000838 12078 raft_consensus.cc:2468] T 8b0eaec7710c47e79cc78a1085de9b3f P 8dfed99448174185ba5ece679e9d90be [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd1c07cda9da4436b69174af3a1ce92f in term 1.
I20260709 13:03:46.007287 12119 tablet_bootstrap.cc:492] T 196209061a514376bb68b340c922a883 P 367d36143adf465b950244c6baa620a5: Bootstrap starting.
I20260709 13:03:46.005797 12123 raft_consensus.cc:697] T 8b0eaec7710c47e79cc78a1085de9b3f P bd1c07cda9da4436b69174af3a1ce92f [term 1 LEADER]: Becoming Leader. State: Replica: bd1c07cda9da4436b69174af3a1ce92f, State: Running, Role: LEADER
I20260709 13:03:46.009526 12123 consensus_queue.cc:237] T 8b0eaec7710c47e79cc78a1085de9b3f P bd1c07cda9da4436b69174af3a1ce92f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } }
I20260709 13:03:46.010896 12118 tablet_bootstrap.cc:492] T 196209061a514376bb68b340c922a883 P 8dfed99448174185ba5ece679e9d90be: No bootstrap required, opened a new log
I20260709 13:03:46.011461 12118 ts_tablet_manager.cc:1403] T 196209061a514376bb68b340c922a883 P 8dfed99448174185ba5ece679e9d90be: Time spent bootstrapping tablet: real 0.067s	user 0.020s	sys 0.045s
I20260709 13:03:46.014480 12118 raft_consensus.cc:359] T 196209061a514376bb68b340c922a883 P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:46.015275 12118 raft_consensus.cc:385] T 196209061a514376bb68b340c922a883 P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:46.015583 12118 raft_consensus.cc:740] T 196209061a514376bb68b340c922a883 P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dfed99448174185ba5ece679e9d90be, State: Initialized, Role: FOLLOWER
I20260709 13:03:46.016347 12118 consensus_queue.cc:260] T 196209061a514376bb68b340c922a883 P 8dfed99448174185ba5ece679e9d90be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:46.018023 12119 tablet_bootstrap.cc:654] T 196209061a514376bb68b340c922a883 P 367d36143adf465b950244c6baa620a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:46.018499 12118 ts_tablet_manager.cc:1434] T 196209061a514376bb68b340c922a883 P 8dfed99448174185ba5ece679e9d90be: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:03:46.019846 12118 tablet_bootstrap.cc:492] T 95bf609349e54fdd867e40d7fd578e52 P 8dfed99448174185ba5ece679e9d90be: Bootstrap starting.
I20260709 13:03:46.021246 12123 raft_consensus.cc:493] T 5078275d4ea64e67bf0a061eb3011157 P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:46.021782 12123 raft_consensus.cc:515] T 5078275d4ea64e67bf0a061eb3011157 P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:46.024179 12140 raft_consensus.cc:493] T b8baeafde60b486094f5139efec7eca0 P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:46.024744 12140 raft_consensus.cc:515] T b8baeafde60b486094f5139efec7eca0 P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:46.024866 11827 catalog_manager.cc:5697] T 8b0eaec7710c47e79cc78a1085de9b3f P bd1c07cda9da4436b69174af3a1ce92f reported cstate change: term changed from 0 to 1, leader changed from <none> to bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193). New cstate: current_term: 1 leader_uuid: "bd1c07cda9da4436b69174af3a1ce92f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:46.028142 11929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8baeafde60b486094f5139efec7eca0" candidate_uuid: "8dfed99448174185ba5ece679e9d90be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd1c07cda9da4436b69174af3a1ce92f" is_pre_election: true
I20260709 13:03:46.028471 12118 tablet_bootstrap.cc:654] T 95bf609349e54fdd867e40d7fd578e52 P 8dfed99448174185ba5ece679e9d90be: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:46.029117 12004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5078275d4ea64e67bf0a061eb3011157" candidate_uuid: "bd1c07cda9da4436b69174af3a1ce92f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "367d36143adf465b950244c6baa620a5" is_pre_election: true
W20260709 13:03:46.030912 11893 leader_election.cc:343] T 5078275d4ea64e67bf0a061eb3011157 P bd1c07cda9da4436b69174af3a1ce92f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:46.033529 12123 leader_election.cc:290] T 5078275d4ea64e67bf0a061eb3011157 P bd1c07cda9da4436b69174af3a1ce92f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337), 8dfed99448174185ba5ece679e9d90be (127.0.107.195:39279)
I20260709 13:03:46.035570 12078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5078275d4ea64e67bf0a061eb3011157" candidate_uuid: "bd1c07cda9da4436b69174af3a1ce92f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dfed99448174185ba5ece679e9d90be" is_pre_election: true
I20260709 13:03:46.036391 12078 raft_consensus.cc:2468] T 5078275d4ea64e67bf0a061eb3011157 P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd1c07cda9da4436b69174af3a1ce92f in term 0.
I20260709 13:03:46.037906 11893 leader_election.cc:304] T 5078275d4ea64e67bf0a061eb3011157 P bd1c07cda9da4436b69174af3a1ce92f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dfed99448174185ba5ece679e9d90be, bd1c07cda9da4436b69174af3a1ce92f; no voters: 367d36143adf465b950244c6baa620a5
I20260709 13:03:46.034370 12004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8baeafde60b486094f5139efec7eca0" candidate_uuid: "8dfed99448174185ba5ece679e9d90be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "367d36143adf465b950244c6baa620a5" is_pre_election: true
I20260709 13:03:46.039675 12004 raft_consensus.cc:2468] T b8baeafde60b486094f5139efec7eca0 P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dfed99448174185ba5ece679e9d90be in term 0.
I20260709 13:03:46.040714 11929 raft_consensus.cc:2468] T b8baeafde60b486094f5139efec7eca0 P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dfed99448174185ba5ece679e9d90be in term 0.
I20260709 13:03:46.041137 12042 leader_election.cc:304] T b8baeafde60b486094f5139efec7eca0 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 367d36143adf465b950244c6baa620a5, 8dfed99448174185ba5ece679e9d90be; no voters: 
I20260709 13:03:46.042148 12126 raft_consensus.cc:2804] T b8baeafde60b486094f5139efec7eca0 P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:46.042228 12140 leader_election.cc:290] T b8baeafde60b486094f5139efec7eca0 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131), 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337)
I20260709 13:03:46.042591 12126 raft_consensus.cc:493] T b8baeafde60b486094f5139efec7eca0 P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:46.044129 12126 raft_consensus.cc:3060] T b8baeafde60b486094f5139efec7eca0 P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:46.045434 12118 tablet_bootstrap.cc:492] T 95bf609349e54fdd867e40d7fd578e52 P 8dfed99448174185ba5ece679e9d90be: No bootstrap required, opened a new log
I20260709 13:03:46.046058 12118 ts_tablet_manager.cc:1403] T 95bf609349e54fdd867e40d7fd578e52 P 8dfed99448174185ba5ece679e9d90be: Time spent bootstrapping tablet: real 0.026s	user 0.018s	sys 0.000s
I20260709 13:03:46.043130 12123 raft_consensus.cc:2804] T 5078275d4ea64e67bf0a061eb3011157 P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:46.047674 12123 raft_consensus.cc:493] T 5078275d4ea64e67bf0a061eb3011157 P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:46.048108 12123 raft_consensus.cc:3060] T 5078275d4ea64e67bf0a061eb3011157 P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:46.049135 12118 raft_consensus.cc:359] T 95bf609349e54fdd867e40d7fd578e52 P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:46.050000 12118 raft_consensus.cc:385] T 95bf609349e54fdd867e40d7fd578e52 P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:46.050280 12118 raft_consensus.cc:740] T 95bf609349e54fdd867e40d7fd578e52 P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dfed99448174185ba5ece679e9d90be, State: Initialized, Role: FOLLOWER
I20260709 13:03:46.051048 12118 consensus_queue.cc:260] T 95bf609349e54fdd867e40d7fd578e52 P 8dfed99448174185ba5ece679e9d90be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:46.051870 12126 raft_consensus.cc:515] T b8baeafde60b486094f5139efec7eca0 P 8dfed99448174185ba5ece679e9d90be [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:46.053273 12118 ts_tablet_manager.cc:1434] T 95bf609349e54fdd867e40d7fd578e52 P 8dfed99448174185ba5ece679e9d90be: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:03:46.055260 11929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8baeafde60b486094f5139efec7eca0" candidate_uuid: "8dfed99448174185ba5ece679e9d90be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd1c07cda9da4436b69174af3a1ce92f"
I20260709 13:03:46.055284 12126 leader_election.cc:290] T b8baeafde60b486094f5139efec7eca0 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 1 election: Requested vote from peers bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131), 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337)
I20260709 13:03:46.055496 12004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8baeafde60b486094f5139efec7eca0" candidate_uuid: "8dfed99448174185ba5ece679e9d90be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "367d36143adf465b950244c6baa620a5"
I20260709 13:03:46.056082 11929 raft_consensus.cc:3060] T b8baeafde60b486094f5139efec7eca0 P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:46.056267 12004 raft_consensus.cc:3060] T b8baeafde60b486094f5139efec7eca0 P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:46.059173 12123 raft_consensus.cc:515] T 5078275d4ea64e67bf0a061eb3011157 P bd1c07cda9da4436b69174af3a1ce92f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:46.060468 12119 tablet_bootstrap.cc:492] T 196209061a514376bb68b340c922a883 P 367d36143adf465b950244c6baa620a5: No bootstrap required, opened a new log
I20260709 13:03:46.061026 12119 ts_tablet_manager.cc:1403] T 196209061a514376bb68b340c922a883 P 367d36143adf465b950244c6baa620a5: Time spent bootstrapping tablet: real 0.054s	user 0.011s	sys 0.029s
I20260709 13:03:46.061388 12123 leader_election.cc:290] T 5078275d4ea64e67bf0a061eb3011157 P bd1c07cda9da4436b69174af3a1ce92f [CANDIDATE]: Term 1 election: Requested vote from peers 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337), 8dfed99448174185ba5ece679e9d90be (127.0.107.195:39279)
I20260709 13:03:46.062282 12003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5078275d4ea64e67bf0a061eb3011157" candidate_uuid: "bd1c07cda9da4436b69174af3a1ce92f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "367d36143adf465b950244c6baa620a5"
I20260709 13:03:46.064108 11929 raft_consensus.cc:2468] T b8baeafde60b486094f5139efec7eca0 P bd1c07cda9da4436b69174af3a1ce92f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dfed99448174185ba5ece679e9d90be in term 1.
I20260709 13:03:46.064049 12119 raft_consensus.cc:359] T 196209061a514376bb68b340c922a883 P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:46.065016 12119 raft_consensus.cc:385] T 196209061a514376bb68b340c922a883 P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:46.065325 12119 raft_consensus.cc:740] T 196209061a514376bb68b340c922a883 P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 367d36143adf465b950244c6baa620a5, State: Initialized, Role: FOLLOWER
I20260709 13:03:46.065594 12004 raft_consensus.cc:2468] T b8baeafde60b486094f5139efec7eca0 P 367d36143adf465b950244c6baa620a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dfed99448174185ba5ece679e9d90be in term 1.
I20260709 13:03:46.063933 12078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5078275d4ea64e67bf0a061eb3011157" candidate_uuid: "bd1c07cda9da4436b69174af3a1ce92f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dfed99448174185ba5ece679e9d90be"
I20260709 13:03:46.066080 12043 leader_election.cc:304] T b8baeafde60b486094f5139efec7eca0 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dfed99448174185ba5ece679e9d90be, bd1c07cda9da4436b69174af3a1ce92f; no voters: 
W20260709 13:03:46.065304 11893 leader_election.cc:343] T 5078275d4ea64e67bf0a061eb3011157 P bd1c07cda9da4436b69174af3a1ce92f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:46.066294 12119 consensus_queue.cc:260] T 196209061a514376bb68b340c922a883 P 367d36143adf465b950244c6baa620a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:46.066305 12078 raft_consensus.cc:3060] T 5078275d4ea64e67bf0a061eb3011157 P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:46.067138 12126 raft_consensus.cc:2804] T b8baeafde60b486094f5139efec7eca0 P 8dfed99448174185ba5ece679e9d90be [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:46.067770 12126 raft_consensus.cc:697] T b8baeafde60b486094f5139efec7eca0 P 8dfed99448174185ba5ece679e9d90be [term 1 LEADER]: Becoming Leader. State: Replica: 8dfed99448174185ba5ece679e9d90be, State: Running, Role: LEADER
I20260709 13:03:46.068591 12126 consensus_queue.cc:237] T b8baeafde60b486094f5139efec7eca0 P 8dfed99448174185ba5ece679e9d90be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:46.070791 12119 ts_tablet_manager.cc:1434] T 196209061a514376bb68b340c922a883 P 367d36143adf465b950244c6baa620a5: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.002s
I20260709 13:03:46.071978 12119 tablet_bootstrap.cc:492] T 95bf609349e54fdd867e40d7fd578e52 P 367d36143adf465b950244c6baa620a5: Bootstrap starting.
I20260709 13:03:46.076737 12078 raft_consensus.cc:2468] T 5078275d4ea64e67bf0a061eb3011157 P 8dfed99448174185ba5ece679e9d90be [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd1c07cda9da4436b69174af3a1ce92f in term 1.
I20260709 13:03:46.078239 11893 leader_election.cc:304] T 5078275d4ea64e67bf0a061eb3011157 P bd1c07cda9da4436b69174af3a1ce92f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dfed99448174185ba5ece679e9d90be, bd1c07cda9da4436b69174af3a1ce92f; no voters: 367d36143adf465b950244c6baa620a5
I20260709 13:03:46.079056 12119 tablet_bootstrap.cc:654] T 95bf609349e54fdd867e40d7fd578e52 P 367d36143adf465b950244c6baa620a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:46.079566 12123 raft_consensus.cc:2804] T 5078275d4ea64e67bf0a061eb3011157 P bd1c07cda9da4436b69174af3a1ce92f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:46.080137 12123 raft_consensus.cc:697] T 5078275d4ea64e67bf0a061eb3011157 P bd1c07cda9da4436b69174af3a1ce92f [term 1 LEADER]: Becoming Leader. State: Replica: bd1c07cda9da4436b69174af3a1ce92f, State: Running, Role: LEADER
I20260709 13:03:46.081007 12123 consensus_queue.cc:237] T 5078275d4ea64e67bf0a061eb3011157 P bd1c07cda9da4436b69174af3a1ce92f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:46.083734 12146 raft_consensus.cc:493] T 95bf609349e54fdd867e40d7fd578e52 P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:46.084291 12146 raft_consensus.cc:515] T 95bf609349e54fdd867e40d7fd578e52 P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:46.086422 12146 leader_election.cc:290] T 95bf609349e54fdd867e40d7fd578e52 P bd1c07cda9da4436b69174af3a1ce92f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337), 8dfed99448174185ba5ece679e9d90be (127.0.107.195:39279)
I20260709 13:03:46.087543 12119 tablet_bootstrap.cc:492] T 95bf609349e54fdd867e40d7fd578e52 P 367d36143adf465b950244c6baa620a5: No bootstrap required, opened a new log
I20260709 13:03:46.088195 12119 ts_tablet_manager.cc:1403] T 95bf609349e54fdd867e40d7fd578e52 P 367d36143adf465b950244c6baa620a5: Time spent bootstrapping tablet: real 0.016s	user 0.008s	sys 0.007s
I20260709 13:03:46.088413 12004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95bf609349e54fdd867e40d7fd578e52" candidate_uuid: "bd1c07cda9da4436b69174af3a1ce92f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "367d36143adf465b950244c6baa620a5" is_pre_election: true
I20260709 13:03:46.090236 12140 raft_consensus.cc:493] T 196209061a514376bb68b340c922a883 P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:46.090819 12140 raft_consensus.cc:515] T 196209061a514376bb68b340c922a883 P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:46.091317 12146 raft_consensus.cc:493] T bda83ed4e6b84bf9985ad11c37b2bd59 P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:46.092154 12146 raft_consensus.cc:515] T bda83ed4e6b84bf9985ad11c37b2bd59 P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:46.093079 12140 leader_election.cc:290] T 196209061a514376bb68b340c922a883 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131), 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337)
I20260709 13:03:46.092806 12119 raft_consensus.cc:359] T 95bf609349e54fdd867e40d7fd578e52 P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:46.093580 12119 raft_consensus.cc:385] T 95bf609349e54fdd867e40d7fd578e52 P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:46.093873 12119 raft_consensus.cc:740] T 95bf609349e54fdd867e40d7fd578e52 P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 367d36143adf465b950244c6baa620a5, State: Initialized, Role: FOLLOWER
I20260709 13:03:46.094997 11929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "196209061a514376bb68b340c922a883" candidate_uuid: "8dfed99448174185ba5ece679e9d90be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd1c07cda9da4436b69174af3a1ce92f" is_pre_election: true
I20260709 13:03:46.095731 11929 raft_consensus.cc:2468] T 196209061a514376bb68b340c922a883 P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dfed99448174185ba5ece679e9d90be in term 0.
I20260709 13:03:46.096179 12003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "196209061a514376bb68b340c922a883" candidate_uuid: "8dfed99448174185ba5ece679e9d90be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "367d36143adf465b950244c6baa620a5" is_pre_election: true
I20260709 13:03:46.097164 12043 leader_election.cc:304] T 196209061a514376bb68b340c922a883 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dfed99448174185ba5ece679e9d90be, bd1c07cda9da4436b69174af3a1ce92f; no voters: 
I20260709 13:03:46.096968 12003 raft_consensus.cc:2468] T 196209061a514376bb68b340c922a883 P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dfed99448174185ba5ece679e9d90be in term 0.
I20260709 13:03:46.094645 12119 consensus_queue.cc:260] T 95bf609349e54fdd867e40d7fd578e52 P 367d36143adf465b950244c6baa620a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:46.098140 12140 raft_consensus.cc:2804] T 196209061a514376bb68b340c922a883 P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:46.098528 12140 raft_consensus.cc:493] T 196209061a514376bb68b340c922a883 P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:46.098930 12140 raft_consensus.cc:3060] T 196209061a514376bb68b340c922a883 P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:46.100030 12119 ts_tablet_manager.cc:1434] T 95bf609349e54fdd867e40d7fd578e52 P 367d36143adf465b950244c6baa620a5: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.004s
I20260709 13:03:46.101155 12119 tablet_bootstrap.cc:492] T 7f973c97455b4d918d353553cbe194a9 P 367d36143adf465b950244c6baa620a5: Bootstrap starting.
I20260709 13:03:46.103688 12003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda83ed4e6b84bf9985ad11c37b2bd59" candidate_uuid: "bd1c07cda9da4436b69174af3a1ce92f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "367d36143adf465b950244c6baa620a5" is_pre_election: true
I20260709 13:03:46.103888 12166 raft_consensus.cc:493] T 7f973c97455b4d918d353553cbe194a9 P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:46.104496 12003 raft_consensus.cc:2468] T bda83ed4e6b84bf9985ad11c37b2bd59 P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd1c07cda9da4436b69174af3a1ce92f in term 0.
I20260709 13:03:46.104825 12166 raft_consensus.cc:515] T 7f973c97455b4d918d353553cbe194a9 P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:46.094570 12146 leader_election.cc:290] T bda83ed4e6b84bf9985ad11c37b2bd59 P bd1c07cda9da4436b69174af3a1ce92f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337), 8dfed99448174185ba5ece679e9d90be (127.0.107.195:39279)
I20260709 13:03:46.106966 12146 raft_consensus.cc:493] T 03ae675fe38f4f2b96936940980c1ee9 P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:46.107160 12166 leader_election.cc:290] T 7f973c97455b4d918d353553cbe194a9 P bd1c07cda9da4436b69174af3a1ce92f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337), 8dfed99448174185ba5ece679e9d90be (127.0.107.195:39279)
I20260709 13:03:46.110687 12119 tablet_bootstrap.cc:654] T 7f973c97455b4d918d353553cbe194a9 P 367d36143adf465b950244c6baa620a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:46.114219 12146 raft_consensus.cc:515] T 03ae675fe38f4f2b96936940980c1ee9 P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:46.112087 12077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda83ed4e6b84bf9985ad11c37b2bd59" candidate_uuid: "bd1c07cda9da4436b69174af3a1ce92f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dfed99448174185ba5ece679e9d90be" is_pre_election: true
I20260709 13:03:46.114471 12076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f973c97455b4d918d353553cbe194a9" candidate_uuid: "bd1c07cda9da4436b69174af3a1ce92f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dfed99448174185ba5ece679e9d90be" is_pre_election: true
I20260709 13:03:46.115352 12077 raft_consensus.cc:2468] T bda83ed4e6b84bf9985ad11c37b2bd59 P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd1c07cda9da4436b69174af3a1ce92f in term 0.
I20260709 13:03:46.115909 12003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f973c97455b4d918d353553cbe194a9" candidate_uuid: "bd1c07cda9da4436b69174af3a1ce92f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "367d36143adf465b950244c6baa620a5" is_pre_election: true
I20260709 13:03:46.115427 12076 raft_consensus.cc:2468] T 7f973c97455b4d918d353553cbe194a9 P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd1c07cda9da4436b69174af3a1ce92f in term 0.
I20260709 13:03:46.110765 12004 raft_consensus.cc:2468] T 95bf609349e54fdd867e40d7fd578e52 P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd1c07cda9da4436b69174af3a1ce92f in term 0.
I20260709 13:03:46.118935 11893 leader_election.cc:304] T bda83ed4e6b84bf9985ad11c37b2bd59 P bd1c07cda9da4436b69174af3a1ce92f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 367d36143adf465b950244c6baa620a5, bd1c07cda9da4436b69174af3a1ce92f; no voters: 
I20260709 13:03:46.119907 12166 raft_consensus.cc:2804] T bda83ed4e6b84bf9985ad11c37b2bd59 P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:46.120272 12166 raft_consensus.cc:493] T bda83ed4e6b84bf9985ad11c37b2bd59 P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:46.120605 12166 raft_consensus.cc:3060] T bda83ed4e6b84bf9985ad11c37b2bd59 P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:46.120679 11893 leader_election.cc:304] T 7f973c97455b4d918d353553cbe194a9 P bd1c07cda9da4436b69174af3a1ce92f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dfed99448174185ba5ece679e9d90be, bd1c07cda9da4436b69174af3a1ce92f; no voters: 
I20260709 13:03:46.123409 12146 leader_election.cc:290] T 03ae675fe38f4f2b96936940980c1ee9 P bd1c07cda9da4436b69174af3a1ce92f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337), 8dfed99448174185ba5ece679e9d90be (127.0.107.195:39279)
I20260709 13:03:46.123963 12146 raft_consensus.cc:2804] T 7f973c97455b4d918d353553cbe194a9 P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:46.124330 12146 raft_consensus.cc:493] T 7f973c97455b4d918d353553cbe194a9 P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:46.124657 12146 raft_consensus.cc:3060] T 7f973c97455b4d918d353553cbe194a9 P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:46.107730 12140 raft_consensus.cc:515] T 196209061a514376bb68b340c922a883 P 8dfed99448174185ba5ece679e9d90be [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:46.127497 12078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95bf609349e54fdd867e40d7fd578e52" candidate_uuid: "bd1c07cda9da4436b69174af3a1ce92f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dfed99448174185ba5ece679e9d90be" is_pre_election: true
I20260709 13:03:46.128252 12078 raft_consensus.cc:2468] T 95bf609349e54fdd867e40d7fd578e52 P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd1c07cda9da4436b69174af3a1ce92f in term 0.
I20260709 13:03:46.133656 12166 raft_consensus.cc:515] T bda83ed4e6b84bf9985ad11c37b2bd59 P bd1c07cda9da4436b69174af3a1ce92f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:46.136068 11929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "196209061a514376bb68b340c922a883" candidate_uuid: "8dfed99448174185ba5ece679e9d90be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd1c07cda9da4436b69174af3a1ce92f"
I20260709 13:03:46.136835 11929 raft_consensus.cc:3060] T 196209061a514376bb68b340c922a883 P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:46.140106 12132 raft_consensus.cc:493] T 03ae675fe38f4f2b96936940980c1ee9 P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:46.140686 12132 raft_consensus.cc:515] T 03ae675fe38f4f2b96936940980c1ee9 P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:46.142903 12132 leader_election.cc:290] T 03ae675fe38f4f2b96936940980c1ee9 P 367d36143adf465b950244c6baa620a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131), 8dfed99448174185ba5ece679e9d90be (127.0.107.195:39279)
I20260709 13:03:46.143003 12140 leader_election.cc:290] T 196209061a514376bb68b340c922a883 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 1 election: Requested vote from peers bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131), 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337)
I20260709 13:03:46.145738 12003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "196209061a514376bb68b340c922a883" candidate_uuid: "8dfed99448174185ba5ece679e9d90be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "367d36143adf465b950244c6baa620a5"
I20260709 13:03:46.146411 12003 raft_consensus.cc:3060] T 196209061a514376bb68b340c922a883 P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:46.147305 11929 raft_consensus.cc:2468] T 196209061a514376bb68b340c922a883 P bd1c07cda9da4436b69174af3a1ce92f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dfed99448174185ba5ece679e9d90be in term 1.
I20260709 13:03:46.149458 11928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ae675fe38f4f2b96936940980c1ee9" candidate_uuid: "367d36143adf465b950244c6baa620a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd1c07cda9da4436b69174af3a1ce92f" is_pre_election: true
I20260709 13:03:46.149874 11893 leader_election.cc:304] T 95bf609349e54fdd867e40d7fd578e52 P bd1c07cda9da4436b69174af3a1ce92f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 367d36143adf465b950244c6baa620a5, bd1c07cda9da4436b69174af3a1ce92f; no voters: 
I20260709 13:03:46.150362 12076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ae675fe38f4f2b96936940980c1ee9" candidate_uuid: "367d36143adf465b950244c6baa620a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dfed99448174185ba5ece679e9d90be" is_pre_election: true
W20260709 13:03:46.150858 11893 leader_election.cc:343] T 7f973c97455b4d918d353553cbe194a9 P bd1c07cda9da4436b69174af3a1ce92f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:46.151048 12076 raft_consensus.cc:2468] T 03ae675fe38f4f2b96936940980c1ee9 P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 367d36143adf465b950244c6baa620a5 in term 0.
I20260709 13:03:46.152571 12043 leader_election.cc:304] T 196209061a514376bb68b340c922a883 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dfed99448174185ba5ece679e9d90be, bd1c07cda9da4436b69174af3a1ce92f; no voters: 
I20260709 13:03:46.154004 11928 raft_consensus.cc:2468] T 03ae675fe38f4f2b96936940980c1ee9 P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 367d36143adf465b950244c6baa620a5 in term 0.
I20260709 13:03:46.154850 12140 raft_consensus.cc:2804] T 196209061a514376bb68b340c922a883 P 8dfed99448174185ba5ece679e9d90be [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:46.155215 11968 leader_election.cc:304] T 03ae675fe38f4f2b96936940980c1ee9 P 367d36143adf465b950244c6baa620a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 367d36143adf465b950244c6baa620a5, 8dfed99448174185ba5ece679e9d90be; no voters: 
I20260709 13:03:46.161211 12132 raft_consensus.cc:2804] T 03ae675fe38f4f2b96936940980c1ee9 P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:46.161686 12132 raft_consensus.cc:493] T 03ae675fe38f4f2b96936940980c1ee9 P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:46.162041 12132 raft_consensus.cc:3060] T 03ae675fe38f4f2b96936940980c1ee9 P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:46.199091 12123 raft_consensus.cc:2804] T 95bf609349e54fdd867e40d7fd578e52 P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:46.199688 12123 raft_consensus.cc:493] T 95bf609349e54fdd867e40d7fd578e52 P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:46.200026 12123 raft_consensus.cc:3060] T 95bf609349e54fdd867e40d7fd578e52 P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:46.200289 12004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ae675fe38f4f2b96936940980c1ee9" candidate_uuid: "bd1c07cda9da4436b69174af3a1ce92f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "367d36143adf465b950244c6baa620a5" is_pre_election: true
W20260709 13:03:46.200574 11969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:46131, user_credentials={real_user=slave}} blocked reactor thread for 43866.2us
I20260709 13:03:46.149494 12078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ae675fe38f4f2b96936940980c1ee9" candidate_uuid: "bd1c07cda9da4436b69174af3a1ce92f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dfed99448174185ba5ece679e9d90be" is_pre_election: true
I20260709 13:03:46.203229 12140 raft_consensus.cc:697] T 196209061a514376bb68b340c922a883 P 8dfed99448174185ba5ece679e9d90be [term 1 LEADER]: Becoming Leader. State: Replica: 8dfed99448174185ba5ece679e9d90be, State: Running, Role: LEADER
I20260709 13:03:46.203426 12078 raft_consensus.cc:2468] T 03ae675fe38f4f2b96936940980c1ee9 P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd1c07cda9da4436b69174af3a1ce92f in term 0.
I20260709 13:03:46.212482 12166 leader_election.cc:290] T bda83ed4e6b84bf9985ad11c37b2bd59 P bd1c07cda9da4436b69174af3a1ce92f [CANDIDATE]: Term 1 election: Requested vote from peers 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337), 8dfed99448174185ba5ece679e9d90be (127.0.107.195:39279)
I20260709 13:03:46.206451 12132 raft_consensus.cc:515] T 03ae675fe38f4f2b96936940980c1ee9 P 367d36143adf465b950244c6baa620a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:46.211329 11827 catalog_manager.cc:5697] T 5078275d4ea64e67bf0a061eb3011157 P bd1c07cda9da4436b69174af3a1ce92f reported cstate change: term changed from 0 to 1, leader changed from <none> to bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193). New cstate: current_term: 1 leader_uuid: "bd1c07cda9da4436b69174af3a1ce92f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:46.207020 12003 raft_consensus.cc:2468] T 196209061a514376bb68b340c922a883 P 367d36143adf465b950244c6baa620a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dfed99448174185ba5ece679e9d90be in term 1.
I20260709 13:03:46.215808 11826 catalog_manager.cc:5697] T b8baeafde60b486094f5139efec7eca0 P 8dfed99448174185ba5ece679e9d90be reported cstate change: term changed from 0 to 1, leader changed from <none> to 8dfed99448174185ba5ece679e9d90be (127.0.107.195). New cstate: current_term: 1 leader_uuid: "8dfed99448174185ba5ece679e9d90be" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:46.227033 12004 raft_consensus.cc:2393] T 03ae675fe38f4f2b96936940980c1ee9 P 367d36143adf465b950244c6baa620a5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd1c07cda9da4436b69174af3a1ce92f in current term 1: Already voted for candidate 367d36143adf465b950244c6baa620a5 in this term.
I20260709 13:03:46.207144 12119 tablet_bootstrap.cc:492] T 7f973c97455b4d918d353553cbe194a9 P 367d36143adf465b950244c6baa620a5: No bootstrap required, opened a new log
I20260709 13:03:46.204236 12140 consensus_queue.cc:237] T 196209061a514376bb68b340c922a883 P 8dfed99448174185ba5ece679e9d90be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:46.228345 12119 ts_tablet_manager.cc:1403] T 7f973c97455b4d918d353553cbe194a9 P 367d36143adf465b950244c6baa620a5: Time spent bootstrapping tablet: real 0.127s	user 0.037s	sys 0.042s
I20260709 13:03:46.207528 12146 raft_consensus.cc:515] T 7f973c97455b4d918d353553cbe194a9 P bd1c07cda9da4436b69174af3a1ce92f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:46.230805 12146 leader_election.cc:290] T 7f973c97455b4d918d353553cbe194a9 P bd1c07cda9da4436b69174af3a1ce92f [CANDIDATE]: Term 1 election: Requested vote from peers 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337), 8dfed99448174185ba5ece679e9d90be (127.0.107.195:39279)
I20260709 13:03:46.231523 12119 raft_consensus.cc:359] T 7f973c97455b4d918d353553cbe194a9 P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:46.232318 12119 raft_consensus.cc:385] T 7f973c97455b4d918d353553cbe194a9 P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:46.232573 12119 raft_consensus.cc:740] T 7f973c97455b4d918d353553cbe194a9 P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 367d36143adf465b950244c6baa620a5, State: Initialized, Role: FOLLOWER
I20260709 13:03:46.233323 12119 consensus_queue.cc:260] T 7f973c97455b4d918d353553cbe194a9 P 367d36143adf465b950244c6baa620a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:46.234794 11928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ae675fe38f4f2b96936940980c1ee9" candidate_uuid: "367d36143adf465b950244c6baa620a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd1c07cda9da4436b69174af3a1ce92f"
I20260709 13:03:46.234966 12132 leader_election.cc:290] T 03ae675fe38f4f2b96936940980c1ee9 P 367d36143adf465b950244c6baa620a5 [CANDIDATE]: Term 1 election: Requested vote from peers bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131), 8dfed99448174185ba5ece679e9d90be (127.0.107.195:39279)
I20260709 13:03:46.235500 11928 raft_consensus.cc:3060] T 03ae675fe38f4f2b96936940980c1ee9 P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:46.204607 11893 leader_election.cc:304] T 03ae675fe38f4f2b96936940980c1ee9 P bd1c07cda9da4436b69174af3a1ce92f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dfed99448174185ba5ece679e9d90be, bd1c07cda9da4436b69174af3a1ce92f; no voters: 
I20260709 13:03:46.237600 12004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda83ed4e6b84bf9985ad11c37b2bd59" candidate_uuid: "bd1c07cda9da4436b69174af3a1ce92f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "367d36143adf465b950244c6baa620a5"
I20260709 13:03:46.238332 12004 raft_consensus.cc:3060] T bda83ed4e6b84bf9985ad11c37b2bd59 P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:46.239243 12078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ae675fe38f4f2b96936940980c1ee9" candidate_uuid: "367d36143adf465b950244c6baa620a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dfed99448174185ba5ece679e9d90be"
I20260709 13:03:46.239933 12078 raft_consensus.cc:3060] T 03ae675fe38f4f2b96936940980c1ee9 P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:46.241766 12123 raft_consensus.cc:515] T 95bf609349e54fdd867e40d7fd578e52 P bd1c07cda9da4436b69174af3a1ce92f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:46.244556 12076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda83ed4e6b84bf9985ad11c37b2bd59" candidate_uuid: "bd1c07cda9da4436b69174af3a1ce92f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dfed99448174185ba5ece679e9d90be"
I20260709 13:03:46.245278 12076 raft_consensus.cc:3060] T bda83ed4e6b84bf9985ad11c37b2bd59 P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:46.247602 12123 leader_election.cc:290] T 95bf609349e54fdd867e40d7fd578e52 P bd1c07cda9da4436b69174af3a1ce92f [CANDIDATE]: Term 1 election: Requested vote from peers 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337), 8dfed99448174185ba5ece679e9d90be (127.0.107.195:39279)
I20260709 13:03:46.248977 12002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95bf609349e54fdd867e40d7fd578e52" candidate_uuid: "bd1c07cda9da4436b69174af3a1ce92f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "367d36143adf465b950244c6baa620a5"
I20260709 13:03:46.249701 12002 raft_consensus.cc:3060] T 95bf609349e54fdd867e40d7fd578e52 P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:46.251081 12077 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f973c97455b4d918d353553cbe194a9" candidate_uuid: "bd1c07cda9da4436b69174af3a1ce92f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dfed99448174185ba5ece679e9d90be"
I20260709 13:03:46.251812 12077 raft_consensus.cc:3060] T 7f973c97455b4d918d353553cbe194a9 P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:46.255028 12003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f973c97455b4d918d353553cbe194a9" candidate_uuid: "bd1c07cda9da4436b69174af3a1ce92f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "367d36143adf465b950244c6baa620a5"
I20260709 13:03:46.255789 12003 raft_consensus.cc:3060] T 7f973c97455b4d918d353553cbe194a9 P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:46.256970 12075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95bf609349e54fdd867e40d7fd578e52" candidate_uuid: "bd1c07cda9da4436b69174af3a1ce92f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dfed99448174185ba5ece679e9d90be"
I20260709 13:03:46.257712 12075 raft_consensus.cc:3060] T 95bf609349e54fdd867e40d7fd578e52 P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:46.260736 12004 raft_consensus.cc:2468] T bda83ed4e6b84bf9985ad11c37b2bd59 P 367d36143adf465b950244c6baa620a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd1c07cda9da4436b69174af3a1ce92f in term 1.
I20260709 13:03:46.268756 11893 leader_election.cc:304] T bda83ed4e6b84bf9985ad11c37b2bd59 P bd1c07cda9da4436b69174af3a1ce92f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 367d36143adf465b950244c6baa620a5, bd1c07cda9da4436b69174af3a1ce92f; no voters: 
I20260709 13:03:46.269345 11928 raft_consensus.cc:2468] T 03ae675fe38f4f2b96936940980c1ee9 P bd1c07cda9da4436b69174af3a1ce92f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 367d36143adf465b950244c6baa620a5 in term 1.
I20260709 13:03:46.269958 12146 raft_consensus.cc:2764] T 03ae675fe38f4f2b96936940980c1ee9 P bd1c07cda9da4436b69174af3a1ce92f [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:03:46.269861 12123 raft_consensus.cc:2804] T bda83ed4e6b84bf9985ad11c37b2bd59 P bd1c07cda9da4436b69174af3a1ce92f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:46.270951 12123 raft_consensus.cc:697] T bda83ed4e6b84bf9985ad11c37b2bd59 P bd1c07cda9da4436b69174af3a1ce92f [term 1 LEADER]: Becoming Leader. State: Replica: bd1c07cda9da4436b69174af3a1ce92f, State: Running, Role: LEADER
I20260709 13:03:46.272214 12075 raft_consensus.cc:2468] T 95bf609349e54fdd867e40d7fd578e52 P 8dfed99448174185ba5ece679e9d90be [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd1c07cda9da4436b69174af3a1ce92f in term 1.
I20260709 13:03:46.271950 12123 consensus_queue.cc:237] T bda83ed4e6b84bf9985ad11c37b2bd59 P bd1c07cda9da4436b69174af3a1ce92f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:46.273455 11893 leader_election.cc:304] T 95bf609349e54fdd867e40d7fd578e52 P bd1c07cda9da4436b69174af3a1ce92f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dfed99448174185ba5ece679e9d90be, bd1c07cda9da4436b69174af3a1ce92f; no voters: 
I20260709 13:03:46.273473 11969 leader_election.cc:304] T 03ae675fe38f4f2b96936940980c1ee9 P 367d36143adf465b950244c6baa620a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 367d36143adf465b950244c6baa620a5, bd1c07cda9da4436b69174af3a1ce92f; no voters: 
I20260709 13:03:46.274516 12146 raft_consensus.cc:2804] T 95bf609349e54fdd867e40d7fd578e52 P bd1c07cda9da4436b69174af3a1ce92f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:46.275313 12146 raft_consensus.cc:697] T 95bf609349e54fdd867e40d7fd578e52 P bd1c07cda9da4436b69174af3a1ce92f [term 1 LEADER]: Becoming Leader. State: Replica: bd1c07cda9da4436b69174af3a1ce92f, State: Running, Role: LEADER
I20260709 13:03:46.276218 12146 consensus_queue.cc:237] T 95bf609349e54fdd867e40d7fd578e52 P bd1c07cda9da4436b69174af3a1ce92f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:46.277420 12076 raft_consensus.cc:2468] T bda83ed4e6b84bf9985ad11c37b2bd59 P 8dfed99448174185ba5ece679e9d90be [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd1c07cda9da4436b69174af3a1ce92f in term 1.
I20260709 13:03:46.278016 12132 raft_consensus.cc:2804] T 03ae675fe38f4f2b96936940980c1ee9 P 367d36143adf465b950244c6baa620a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:46.279383 12078 raft_consensus.cc:2468] T 03ae675fe38f4f2b96936940980c1ee9 P 8dfed99448174185ba5ece679e9d90be [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 367d36143adf465b950244c6baa620a5 in term 1.
I20260709 13:03:46.279714 12132 raft_consensus.cc:697] T 03ae675fe38f4f2b96936940980c1ee9 P 367d36143adf465b950244c6baa620a5 [term 1 LEADER]: Becoming Leader. State: Replica: 367d36143adf465b950244c6baa620a5, State: Running, Role: LEADER
I20260709 13:03:46.280593 12132 consensus_queue.cc:237] T 03ae675fe38f4f2b96936940980c1ee9 P 367d36143adf465b950244c6baa620a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:46.281040 12003 raft_consensus.cc:2468] T 7f973c97455b4d918d353553cbe194a9 P 367d36143adf465b950244c6baa620a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd1c07cda9da4436b69174af3a1ce92f in term 1.
I20260709 13:03:46.282747 12077 raft_consensus.cc:2468] T 7f973c97455b4d918d353553cbe194a9 P 8dfed99448174185ba5ece679e9d90be [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd1c07cda9da4436b69174af3a1ce92f in term 1.
I20260709 13:03:46.285025 12119 ts_tablet_manager.cc:1434] T 7f973c97455b4d918d353553cbe194a9 P 367d36143adf465b950244c6baa620a5: Time spent starting tablet: real 0.056s	user 0.005s	sys 0.001s
I20260709 13:03:46.285851 11893 leader_election.cc:304] T 7f973c97455b4d918d353553cbe194a9 P bd1c07cda9da4436b69174af3a1ce92f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dfed99448174185ba5ece679e9d90be, bd1c07cda9da4436b69174af3a1ce92f; no voters: 
I20260709 13:03:46.288193 12166 raft_consensus.cc:2804] T 7f973c97455b4d918d353553cbe194a9 P bd1c07cda9da4436b69174af3a1ce92f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:46.288549 12119 tablet_bootstrap.cc:492] T 5078275d4ea64e67bf0a061eb3011157 P 367d36143adf465b950244c6baa620a5: Bootstrap starting.
I20260709 13:03:46.288678 12166 raft_consensus.cc:697] T 7f973c97455b4d918d353553cbe194a9 P bd1c07cda9da4436b69174af3a1ce92f [term 1 LEADER]: Becoming Leader. State: Replica: bd1c07cda9da4436b69174af3a1ce92f, State: Running, Role: LEADER
I20260709 13:03:46.289644 12166 consensus_queue.cc:237] T 7f973c97455b4d918d353553cbe194a9 P bd1c07cda9da4436b69174af3a1ce92f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:46.294893 11827 catalog_manager.cc:5697] T bda83ed4e6b84bf9985ad11c37b2bd59 P bd1c07cda9da4436b69174af3a1ce92f reported cstate change: term changed from 0 to 1, leader changed from <none> to bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193). New cstate: current_term: 1 leader_uuid: "bd1c07cda9da4436b69174af3a1ce92f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:46.299207 11826 catalog_manager.cc:5697] T 196209061a514376bb68b340c922a883 P 8dfed99448174185ba5ece679e9d90be reported cstate change: term changed from 0 to 1, leader changed from <none> to 8dfed99448174185ba5ece679e9d90be (127.0.107.195). New cstate: current_term: 1 leader_uuid: "8dfed99448174185ba5ece679e9d90be" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:46.300413 12119 tablet_bootstrap.cc:654] T 5078275d4ea64e67bf0a061eb3011157 P 367d36143adf465b950244c6baa620a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:46.277413 12002 raft_consensus.cc:2468] T 95bf609349e54fdd867e40d7fd578e52 P 367d36143adf465b950244c6baa620a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd1c07cda9da4436b69174af3a1ce92f in term 1.
I20260709 13:03:46.311787 12119 tablet_bootstrap.cc:492] T 5078275d4ea64e67bf0a061eb3011157 P 367d36143adf465b950244c6baa620a5: No bootstrap required, opened a new log
I20260709 13:03:46.312307 12119 ts_tablet_manager.cc:1403] T 5078275d4ea64e67bf0a061eb3011157 P 367d36143adf465b950244c6baa620a5: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.005s
I20260709 13:03:46.315033 12119 raft_consensus.cc:359] T 5078275d4ea64e67bf0a061eb3011157 P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:46.315786 12119 raft_consensus.cc:385] T 5078275d4ea64e67bf0a061eb3011157 P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:46.316078 12119 raft_consensus.cc:740] T 5078275d4ea64e67bf0a061eb3011157 P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 367d36143adf465b950244c6baa620a5, State: Initialized, Role: FOLLOWER
I20260709 13:03:46.315954 11827 catalog_manager.cc:5697] T 03ae675fe38f4f2b96936940980c1ee9 P 367d36143adf465b950244c6baa620a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 367d36143adf465b950244c6baa620a5 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "367d36143adf465b950244c6baa620a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:46.316926 12119 consensus_queue.cc:260] T 5078275d4ea64e67bf0a061eb3011157 P 367d36143adf465b950244c6baa620a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:46.319223 12119 ts_tablet_manager.cc:1434] T 5078275d4ea64e67bf0a061eb3011157 P 367d36143adf465b950244c6baa620a5: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:03:46.328847 11826 catalog_manager.cc:5697] T 95bf609349e54fdd867e40d7fd578e52 P bd1c07cda9da4436b69174af3a1ce92f reported cstate change: term changed from 0 to 1, leader changed from <none> to bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193). New cstate: current_term: 1 leader_uuid: "bd1c07cda9da4436b69174af3a1ce92f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:46.330588 11826 catalog_manager.cc:5697] T 7f973c97455b4d918d353553cbe194a9 P bd1c07cda9da4436b69174af3a1ce92f reported cstate change: term changed from 0 to 1, leader changed from <none> to bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193). New cstate: current_term: 1 leader_uuid: "bd1c07cda9da4436b69174af3a1ce92f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:46.397354 12166 consensus_queue.cc:1048] T 8b0eaec7710c47e79cc78a1085de9b3f P bd1c07cda9da4436b69174af3a1ce92f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:46.412003 12146 consensus_queue.cc:1048] T 8b0eaec7710c47e79cc78a1085de9b3f P bd1c07cda9da4436b69174af3a1ce92f [LEADER]: Connected to new peer: Peer: permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:46.431936 12146 consensus_queue.cc:1048] T a846ec1843bc4dbca0df61be2992759d P bd1c07cda9da4436b69174af3a1ce92f [LEADER]: Connected to new peer: Peer: permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:46.442730 12166 consensus_queue.cc:1048] T a846ec1843bc4dbca0df61be2992759d P bd1c07cda9da4436b69174af3a1ce92f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:46.461846 12140 consensus_queue.cc:1048] T b8baeafde60b486094f5139efec7eca0 P 8dfed99448174185ba5ece679e9d90be [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:46.472893 12140 consensus_queue.cc:1048] T b8baeafde60b486094f5139efec7eca0 P 8dfed99448174185ba5ece679e9d90be [LEADER]: Connected to new peer: Peer: permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:46.507284 12167 consensus_queue.cc:1048] T 5078275d4ea64e67bf0a061eb3011157 P bd1c07cda9da4436b69174af3a1ce92f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:46.522226 12002 raft_consensus.cc:3060] T 5078275d4ea64e67bf0a061eb3011157 P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:46.532087 12167 consensus_queue.cc:1048] T 5078275d4ea64e67bf0a061eb3011157 P bd1c07cda9da4436b69174af3a1ce92f [LEADER]: Connected to new peer: Peer: permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:46.539242 12078 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "196209061a514376bb68b340c922a883"
dest_uuid: "8dfed99448174185ba5ece679e9d90be"
mode: GRACEFUL
new_leader_uuid: "bd1c07cda9da4436b69174af3a1ce92f"
 from {username='slave'} at 127.0.0.1:60132
I20260709 13:03:46.539966 12078 raft_consensus.cc:606] T 196209061a514376bb68b340c922a883 P 8dfed99448174185ba5ece679e9d90be [term 1 LEADER]: Received request to transfer leadership to TS bd1c07cda9da4436b69174af3a1ce92f
I20260709 13:03:46.545714 12078 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b8baeafde60b486094f5139efec7eca0"
dest_uuid: "8dfed99448174185ba5ece679e9d90be"
mode: GRACEFUL
new_leader_uuid: "bd1c07cda9da4436b69174af3a1ce92f"
 from {username='slave'} at 127.0.0.1:60132
I20260709 13:03:46.546299 12078 raft_consensus.cc:606] T b8baeafde60b486094f5139efec7eca0 P 8dfed99448174185ba5ece679e9d90be [term 1 LEADER]: Received request to transfer leadership to TS bd1c07cda9da4436b69174af3a1ce92f
I20260709 13:03:46.560642 11928 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bda83ed4e6b84bf9985ad11c37b2bd59"
dest_uuid: "bd1c07cda9da4436b69174af3a1ce92f"
mode: GRACEFUL
new_leader_uuid: "367d36143adf465b950244c6baa620a5"
 from {username='slave'} at 127.0.0.1:46230
I20260709 13:03:46.561194 11928 raft_consensus.cc:606] T bda83ed4e6b84bf9985ad11c37b2bd59 P bd1c07cda9da4436b69174af3a1ce92f [term 1 LEADER]: Received request to transfer leadership to TS 367d36143adf465b950244c6baa620a5
I20260709 13:03:46.570223 11928 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a846ec1843bc4dbca0df61be2992759d"
dest_uuid: "bd1c07cda9da4436b69174af3a1ce92f"
mode: GRACEFUL
new_leader_uuid: "367d36143adf465b950244c6baa620a5"
 from {username='slave'} at 127.0.0.1:46230
I20260709 13:03:46.570832 11928 raft_consensus.cc:606] T a846ec1843bc4dbca0df61be2992759d P bd1c07cda9da4436b69174af3a1ce92f [term 1 LEADER]: Received request to transfer leadership to TS 367d36143adf465b950244c6baa620a5
I20260709 13:03:46.576323 11928 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f973c97455b4d918d353553cbe194a9"
dest_uuid: "bd1c07cda9da4436b69174af3a1ce92f"
mode: GRACEFUL
new_leader_uuid: "367d36143adf465b950244c6baa620a5"
 from {username='slave'} at 127.0.0.1:46230
I20260709 13:03:46.576897 11928 raft_consensus.cc:606] T 7f973c97455b4d918d353553cbe194a9 P bd1c07cda9da4436b69174af3a1ce92f [term 1 LEADER]: Received request to transfer leadership to TS 367d36143adf465b950244c6baa620a5
I20260709 13:03:46.582173 11928 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5078275d4ea64e67bf0a061eb3011157"
dest_uuid: "bd1c07cda9da4436b69174af3a1ce92f"
mode: GRACEFUL
new_leader_uuid: "8dfed99448174185ba5ece679e9d90be"
 from {username='slave'} at 127.0.0.1:46230
I20260709 13:03:46.582746 11928 raft_consensus.cc:606] T 5078275d4ea64e67bf0a061eb3011157 P bd1c07cda9da4436b69174af3a1ce92f [term 1 LEADER]: Received request to transfer leadership to TS 8dfed99448174185ba5ece679e9d90be
I20260709 13:03:46.668247 12167 consensus_queue.cc:1048] T 95bf609349e54fdd867e40d7fd578e52 P bd1c07cda9da4436b69174af3a1ce92f [LEADER]: Connected to new peer: Peer: permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:46.679095 12167 consensus_queue.cc:1048] T 95bf609349e54fdd867e40d7fd578e52 P bd1c07cda9da4436b69174af3a1ce92f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:46.690614 12166 consensus_queue.cc:1048] T bda83ed4e6b84bf9985ad11c37b2bd59 P bd1c07cda9da4436b69174af3a1ce92f [LEADER]: Connected to new peer: Peer: permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:46.694365 12166 consensus_queue.cc:1048] T bda83ed4e6b84bf9985ad11c37b2bd59 P bd1c07cda9da4436b69174af3a1ce92f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:46.703330 12167 raft_consensus.cc:993] T bda83ed4e6b84bf9985ad11c37b2bd59 P bd1c07cda9da4436b69174af3a1ce92f: : Instructing follower 367d36143adf465b950244c6baa620a5 to start an election
I20260709 13:03:46.703913 12123 raft_consensus.cc:1081] T bda83ed4e6b84bf9985ad11c37b2bd59 P bd1c07cda9da4436b69174af3a1ce92f [term 1 LEADER]: Signalling peer 367d36143adf465b950244c6baa620a5 to start an election
I20260709 13:03:46.708858 12002 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bda83ed4e6b84bf9985ad11c37b2bd59"
dest_uuid: "367d36143adf465b950244c6baa620a5"
 from {username='slave'} at 127.0.0.1:52278
I20260709 13:03:46.709596 12002 raft_consensus.cc:493] T bda83ed4e6b84bf9985ad11c37b2bd59 P 367d36143adf465b950244c6baa620a5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:46.710073 12002 raft_consensus.cc:3060] T bda83ed4e6b84bf9985ad11c37b2bd59 P 367d36143adf465b950244c6baa620a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:46.718994 12002 raft_consensus.cc:515] T bda83ed4e6b84bf9985ad11c37b2bd59 P 367d36143adf465b950244c6baa620a5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:46.720631 12002 leader_election.cc:290] T bda83ed4e6b84bf9985ad11c37b2bd59 P 367d36143adf465b950244c6baa620a5 [CANDIDATE]: Term 2 election: Requested vote from peers bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131), 8dfed99448174185ba5ece679e9d90be (127.0.107.195:39279)
I20260709 13:03:46.721670 11928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda83ed4e6b84bf9985ad11c37b2bd59" candidate_uuid: "367d36143adf465b950244c6baa620a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bd1c07cda9da4436b69174af3a1ce92f"
I20260709 13:03:46.721773 12078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda83ed4e6b84bf9985ad11c37b2bd59" candidate_uuid: "367d36143adf465b950244c6baa620a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8dfed99448174185ba5ece679e9d90be"
I20260709 13:03:46.722468 11928 raft_consensus.cc:3055] T bda83ed4e6b84bf9985ad11c37b2bd59 P bd1c07cda9da4436b69174af3a1ce92f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:46.722555 12078 raft_consensus.cc:3060] T bda83ed4e6b84bf9985ad11c37b2bd59 P 8dfed99448174185ba5ece679e9d90be [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:46.722828 11928 raft_consensus.cc:740] T bda83ed4e6b84bf9985ad11c37b2bd59 P bd1c07cda9da4436b69174af3a1ce92f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bd1c07cda9da4436b69174af3a1ce92f, State: Running, Role: LEADER
I20260709 13:03:46.723647 11928 consensus_queue.cc:260] T bda83ed4e6b84bf9985ad11c37b2bd59 P bd1c07cda9da4436b69174af3a1ce92f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:46.724622 11928 raft_consensus.cc:3060] T bda83ed4e6b84bf9985ad11c37b2bd59 P bd1c07cda9da4436b69174af3a1ce92f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:46.728428 12078 raft_consensus.cc:2468] T bda83ed4e6b84bf9985ad11c37b2bd59 P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 367d36143adf465b950244c6baa620a5 in term 2.
I20260709 13:03:46.729517 11968 leader_election.cc:304] T bda83ed4e6b84bf9985ad11c37b2bd59 P 367d36143adf465b950244c6baa620a5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 367d36143adf465b950244c6baa620a5, 8dfed99448174185ba5ece679e9d90be; no voters: 
I20260709 13:03:46.730044 11928 raft_consensus.cc:2468] T bda83ed4e6b84bf9985ad11c37b2bd59 P bd1c07cda9da4436b69174af3a1ce92f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 367d36143adf465b950244c6baa620a5 in term 2.
I20260709 13:03:46.730212 12132 raft_consensus.cc:2804] T bda83ed4e6b84bf9985ad11c37b2bd59 P 367d36143adf465b950244c6baa620a5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:46.730792 12132 raft_consensus.cc:697] T bda83ed4e6b84bf9985ad11c37b2bd59 P 367d36143adf465b950244c6baa620a5 [term 2 LEADER]: Becoming Leader. State: Replica: 367d36143adf465b950244c6baa620a5, State: Running, Role: LEADER
I20260709 13:03:46.731586 12132 consensus_queue.cc:237] T bda83ed4e6b84bf9985ad11c37b2bd59 P 367d36143adf465b950244c6baa620a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:46.738389 11826 catalog_manager.cc:5697] T bda83ed4e6b84bf9985ad11c37b2bd59 P 367d36143adf465b950244c6baa620a5 reported cstate change: term changed from 1 to 2, leader changed from bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193) to 367d36143adf465b950244c6baa620a5 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "367d36143adf465b950244c6baa620a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:46.745747 12132 consensus_queue.cc:1048] T 03ae675fe38f4f2b96936940980c1ee9 P 367d36143adf465b950244c6baa620a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:46.747960 12140 consensus_queue.cc:1048] T 196209061a514376bb68b340c922a883 P 8dfed99448174185ba5ece679e9d90be [LEADER]: Connected to new peer: Peer: permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:46.753821 12167 consensus_queue.cc:1048] T 7f973c97455b4d918d353553cbe194a9 P bd1c07cda9da4436b69174af3a1ce92f [LEADER]: Connected to new peer: Peer: permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:46.758771 12132 consensus_queue.cc:1048] T 03ae675fe38f4f2b96936940980c1ee9 P 367d36143adf465b950244c6baa620a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:46.768932 12169 consensus_queue.cc:1048] T 196209061a514376bb68b340c922a883 P 8dfed99448174185ba5ece679e9d90be [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:46.774418 12167 raft_consensus.cc:993] T 7f973c97455b4d918d353553cbe194a9 P bd1c07cda9da4436b69174af3a1ce92f: : Instructing follower 367d36143adf465b950244c6baa620a5 to start an election
I20260709 13:03:46.775466 12167 raft_consensus.cc:1081] T 7f973c97455b4d918d353553cbe194a9 P bd1c07cda9da4436b69174af3a1ce92f [term 1 LEADER]: Signalling peer 367d36143adf465b950244c6baa620a5 to start an election
I20260709 13:03:46.779044 12002 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7f973c97455b4d918d353553cbe194a9"
dest_uuid: "367d36143adf465b950244c6baa620a5"
 from {username='slave'} at 127.0.0.1:52278
I20260709 13:03:46.779711 12002 raft_consensus.cc:493] T 7f973c97455b4d918d353553cbe194a9 P 367d36143adf465b950244c6baa620a5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:46.780133 12002 raft_consensus.cc:3060] T 7f973c97455b4d918d353553cbe194a9 P 367d36143adf465b950244c6baa620a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:46.782325 12167 consensus_queue.cc:1048] T 7f973c97455b4d918d353553cbe194a9 P bd1c07cda9da4436b69174af3a1ce92f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:46.790877 12002 raft_consensus.cc:515] T 7f973c97455b4d918d353553cbe194a9 P 367d36143adf465b950244c6baa620a5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:46.792239 12004 raft_consensus.cc:1240] T 7f973c97455b4d918d353553cbe194a9 P 367d36143adf465b950244c6baa620a5 [term 2 FOLLOWER]: Rejecting Update request from peer bd1c07cda9da4436b69174af3a1ce92f for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:46.795771 11929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f973c97455b4d918d353553cbe194a9" candidate_uuid: "367d36143adf465b950244c6baa620a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bd1c07cda9da4436b69174af3a1ce92f"
I20260709 13:03:46.796675 11929 raft_consensus.cc:3055] T 7f973c97455b4d918d353553cbe194a9 P bd1c07cda9da4436b69174af3a1ce92f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:46.797060 11929 raft_consensus.cc:740] T 7f973c97455b4d918d353553cbe194a9 P bd1c07cda9da4436b69174af3a1ce92f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bd1c07cda9da4436b69174af3a1ce92f, State: Running, Role: LEADER
I20260709 13:03:46.798039 11929 consensus_queue.cc:260] T 7f973c97455b4d918d353553cbe194a9 P bd1c07cda9da4436b69174af3a1ce92f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:46.799037 12167 consensus_queue.cc:1059] T 7f973c97455b4d918d353553cbe194a9 P bd1c07cda9da4436b69174af3a1ce92f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:46.799998 12002 leader_election.cc:290] T 7f973c97455b4d918d353553cbe194a9 P 367d36143adf465b950244c6baa620a5 [CANDIDATE]: Term 2 election: Requested vote from peers bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131), 8dfed99448174185ba5ece679e9d90be (127.0.107.195:39279)
I20260709 13:03:46.800092 12075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f973c97455b4d918d353553cbe194a9" candidate_uuid: "367d36143adf465b950244c6baa620a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8dfed99448174185ba5ece679e9d90be"
I20260709 13:03:46.804905 11929 raft_consensus.cc:3060] T 7f973c97455b4d918d353553cbe194a9 P bd1c07cda9da4436b69174af3a1ce92f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:46.808748 12126 raft_consensus.cc:993] T 196209061a514376bb68b340c922a883 P 8dfed99448174185ba5ece679e9d90be: : Instructing follower bd1c07cda9da4436b69174af3a1ce92f to start an election
I20260709 13:03:46.809326 12169 raft_consensus.cc:1081] T 196209061a514376bb68b340c922a883 P 8dfed99448174185ba5ece679e9d90be [term 1 LEADER]: Signalling peer bd1c07cda9da4436b69174af3a1ce92f to start an election
I20260709 13:03:46.811220 11928 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "196209061a514376bb68b340c922a883"
dest_uuid: "bd1c07cda9da4436b69174af3a1ce92f"
 from {username='slave'} at 127.0.0.1:46202
I20260709 13:03:46.811784 11928 raft_consensus.cc:493] T 196209061a514376bb68b340c922a883 P bd1c07cda9da4436b69174af3a1ce92f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:46.812175 11928 raft_consensus.cc:3060] T 196209061a514376bb68b340c922a883 P bd1c07cda9da4436b69174af3a1ce92f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:46.814814 11929 raft_consensus.cc:2468] T 7f973c97455b4d918d353553cbe194a9 P bd1c07cda9da4436b69174af3a1ce92f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 367d36143adf465b950244c6baa620a5 in term 2.
I20260709 13:03:46.816072 11969 leader_election.cc:304] T 7f973c97455b4d918d353553cbe194a9 P 367d36143adf465b950244c6baa620a5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 367d36143adf465b950244c6baa620a5, bd1c07cda9da4436b69174af3a1ce92f; no voters: 8dfed99448174185ba5ece679e9d90be
I20260709 13:03:46.816839 12132 raft_consensus.cc:2804] T 7f973c97455b4d918d353553cbe194a9 P 367d36143adf465b950244c6baa620a5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:46.817361 12132 raft_consensus.cc:697] T 7f973c97455b4d918d353553cbe194a9 P 367d36143adf465b950244c6baa620a5 [term 2 LEADER]: Becoming Leader. State: Replica: 367d36143adf465b950244c6baa620a5, State: Running, Role: LEADER
I20260709 13:03:46.818176 12132 consensus_queue.cc:237] T 7f973c97455b4d918d353553cbe194a9 P 367d36143adf465b950244c6baa620a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:46.820428 11928 raft_consensus.cc:515] T 196209061a514376bb68b340c922a883 P bd1c07cda9da4436b69174af3a1ce92f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:46.823376 11928 leader_election.cc:290] T 196209061a514376bb68b340c922a883 P bd1c07cda9da4436b69174af3a1ce92f [CANDIDATE]: Term 2 election: Requested vote from peers 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337), 8dfed99448174185ba5ece679e9d90be (127.0.107.195:39279)
I20260709 13:03:46.824530 12078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "196209061a514376bb68b340c922a883" candidate_uuid: "bd1c07cda9da4436b69174af3a1ce92f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8dfed99448174185ba5ece679e9d90be"
I20260709 13:03:46.824955 12002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "196209061a514376bb68b340c922a883" candidate_uuid: "bd1c07cda9da4436b69174af3a1ce92f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "367d36143adf465b950244c6baa620a5"
I20260709 13:03:46.825246 12078 raft_consensus.cc:3055] T 196209061a514376bb68b340c922a883 P 8dfed99448174185ba5ece679e9d90be [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:46.825651 12078 raft_consensus.cc:740] T 196209061a514376bb68b340c922a883 P 8dfed99448174185ba5ece679e9d90be [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8dfed99448174185ba5ece679e9d90be, State: Running, Role: LEADER
I20260709 13:03:46.825655 12002 raft_consensus.cc:3060] T 196209061a514376bb68b340c922a883 P 367d36143adf465b950244c6baa620a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:46.826858 12078 consensus_queue.cc:260] T 196209061a514376bb68b340c922a883 P 8dfed99448174185ba5ece679e9d90be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:46.827183 11824 catalog_manager.cc:5697] T 7f973c97455b4d918d353553cbe194a9 P 367d36143adf465b950244c6baa620a5 reported cstate change: term changed from 1 to 2, leader changed from bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193) to 367d36143adf465b950244c6baa620a5 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "367d36143adf465b950244c6baa620a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:46.828258 12078 raft_consensus.cc:3060] T 196209061a514376bb68b340c922a883 P 8dfed99448174185ba5ece679e9d90be [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:46.833531 12002 raft_consensus.cc:2468] T 196209061a514376bb68b340c922a883 P 367d36143adf465b950244c6baa620a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd1c07cda9da4436b69174af3a1ce92f in term 2.
I20260709 13:03:46.834812 11893 leader_election.cc:304] T 196209061a514376bb68b340c922a883 P bd1c07cda9da4436b69174af3a1ce92f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 367d36143adf465b950244c6baa620a5, bd1c07cda9da4436b69174af3a1ce92f; no voters: 
I20260709 13:03:46.835613 12146 raft_consensus.cc:2804] T 196209061a514376bb68b340c922a883 P bd1c07cda9da4436b69174af3a1ce92f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:46.835492 12078 raft_consensus.cc:2468] T 196209061a514376bb68b340c922a883 P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd1c07cda9da4436b69174af3a1ce92f in term 2.
I20260709 13:03:46.836230 12146 raft_consensus.cc:697] T 196209061a514376bb68b340c922a883 P bd1c07cda9da4436b69174af3a1ce92f [term 2 LEADER]: Becoming Leader. State: Replica: bd1c07cda9da4436b69174af3a1ce92f, State: Running, Role: LEADER
I20260709 13:03:46.837093 12146 consensus_queue.cc:237] T 196209061a514376bb68b340c922a883 P bd1c07cda9da4436b69174af3a1ce92f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:46.846525 11826 catalog_manager.cc:5697] T 196209061a514376bb68b340c922a883 P bd1c07cda9da4436b69174af3a1ce92f reported cstate change: term changed from 1 to 2, leader changed from 8dfed99448174185ba5ece679e9d90be (127.0.107.195) to bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193). New cstate: current_term: 2 leader_uuid: "bd1c07cda9da4436b69174af3a1ce92f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:46.942133 12123 raft_consensus.cc:993] T a846ec1843bc4dbca0df61be2992759d P bd1c07cda9da4436b69174af3a1ce92f: : Instructing follower 367d36143adf465b950244c6baa620a5 to start an election
I20260709 13:03:46.942574 12146 raft_consensus.cc:1081] T a846ec1843bc4dbca0df61be2992759d P bd1c07cda9da4436b69174af3a1ce92f [term 1 LEADER]: Signalling peer 367d36143adf465b950244c6baa620a5 to start an election
I20260709 13:03:46.944217 12002 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a846ec1843bc4dbca0df61be2992759d"
dest_uuid: "367d36143adf465b950244c6baa620a5"
 from {username='slave'} at 127.0.0.1:52278
I20260709 13:03:46.944706 12002 raft_consensus.cc:493] T a846ec1843bc4dbca0df61be2992759d P 367d36143adf465b950244c6baa620a5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:46.944959 12002 raft_consensus.cc:3060] T a846ec1843bc4dbca0df61be2992759d P 367d36143adf465b950244c6baa620a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:46.950598 12002 raft_consensus.cc:515] T a846ec1843bc4dbca0df61be2992759d P 367d36143adf465b950244c6baa620a5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:46.952731 12002 leader_election.cc:290] T a846ec1843bc4dbca0df61be2992759d P 367d36143adf465b950244c6baa620a5 [CANDIDATE]: Term 2 election: Requested vote from peers bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131), 8dfed99448174185ba5ece679e9d90be (127.0.107.195:39279)
I20260709 13:03:46.953753 12078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a846ec1843bc4dbca0df61be2992759d" candidate_uuid: "367d36143adf465b950244c6baa620a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8dfed99448174185ba5ece679e9d90be"
I20260709 13:03:46.953783 11928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a846ec1843bc4dbca0df61be2992759d" candidate_uuid: "367d36143adf465b950244c6baa620a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bd1c07cda9da4436b69174af3a1ce92f"
I20260709 13:03:46.954450 12078 raft_consensus.cc:3060] T a846ec1843bc4dbca0df61be2992759d P 8dfed99448174185ba5ece679e9d90be [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:46.954998 11928 raft_consensus.cc:3055] T a846ec1843bc4dbca0df61be2992759d P bd1c07cda9da4436b69174af3a1ce92f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:46.955312 11928 raft_consensus.cc:740] T a846ec1843bc4dbca0df61be2992759d P bd1c07cda9da4436b69174af3a1ce92f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bd1c07cda9da4436b69174af3a1ce92f, State: Running, Role: LEADER
I20260709 13:03:46.956077 11928 consensus_queue.cc:260] T a846ec1843bc4dbca0df61be2992759d P bd1c07cda9da4436b69174af3a1ce92f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:46.957180 11928 raft_consensus.cc:3060] T a846ec1843bc4dbca0df61be2992759d P bd1c07cda9da4436b69174af3a1ce92f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:46.960340 12078 raft_consensus.cc:2468] T a846ec1843bc4dbca0df61be2992759d P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 367d36143adf465b950244c6baa620a5 in term 2.
I20260709 13:03:46.961612 11968 leader_election.cc:304] T a846ec1843bc4dbca0df61be2992759d P 367d36143adf465b950244c6baa620a5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 367d36143adf465b950244c6baa620a5, 8dfed99448174185ba5ece679e9d90be; no voters: 
I20260709 13:03:46.962320 12132 raft_consensus.cc:2804] T a846ec1843bc4dbca0df61be2992759d P 367d36143adf465b950244c6baa620a5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:46.962610 11928 raft_consensus.cc:2468] T a846ec1843bc4dbca0df61be2992759d P bd1c07cda9da4436b69174af3a1ce92f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 367d36143adf465b950244c6baa620a5 in term 2.
I20260709 13:03:46.962771 12132 raft_consensus.cc:697] T a846ec1843bc4dbca0df61be2992759d P 367d36143adf465b950244c6baa620a5 [term 2 LEADER]: Becoming Leader. State: Replica: 367d36143adf465b950244c6baa620a5, State: Running, Role: LEADER
I20260709 13:03:46.963680 12132 consensus_queue.cc:237] T a846ec1843bc4dbca0df61be2992759d P 367d36143adf465b950244c6baa620a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:46.970077 11826 catalog_manager.cc:5697] T a846ec1843bc4dbca0df61be2992759d P 367d36143adf465b950244c6baa620a5 reported cstate change: term changed from 1 to 2, leader changed from bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193) to 367d36143adf465b950244c6baa620a5 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "367d36143adf465b950244c6baa620a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:46.994565 12123 raft_consensus.cc:993] T 5078275d4ea64e67bf0a061eb3011157 P bd1c07cda9da4436b69174af3a1ce92f: : Instructing follower 8dfed99448174185ba5ece679e9d90be to start an election
I20260709 13:03:46.995085 12146 raft_consensus.cc:1081] T 5078275d4ea64e67bf0a061eb3011157 P bd1c07cda9da4436b69174af3a1ce92f [term 1 LEADER]: Signalling peer 8dfed99448174185ba5ece679e9d90be to start an election
I20260709 13:03:46.996639 12078 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5078275d4ea64e67bf0a061eb3011157"
dest_uuid: "8dfed99448174185ba5ece679e9d90be"
 from {username='slave'} at 127.0.0.1:60124
I20260709 13:03:46.997157 12078 raft_consensus.cc:493] T 5078275d4ea64e67bf0a061eb3011157 P 8dfed99448174185ba5ece679e9d90be [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:46.997445 12078 raft_consensus.cc:3060] T 5078275d4ea64e67bf0a061eb3011157 P 8dfed99448174185ba5ece679e9d90be [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:47.003005 12078 raft_consensus.cc:515] T 5078275d4ea64e67bf0a061eb3011157 P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:47.004675 12078 leader_election.cc:290] T 5078275d4ea64e67bf0a061eb3011157 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 2 election: Requested vote from peers bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131), 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337)
I20260709 13:03:47.005657 11928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5078275d4ea64e67bf0a061eb3011157" candidate_uuid: "8dfed99448174185ba5ece679e9d90be" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bd1c07cda9da4436b69174af3a1ce92f"
I20260709 13:03:47.005802 12002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5078275d4ea64e67bf0a061eb3011157" candidate_uuid: "8dfed99448174185ba5ece679e9d90be" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "367d36143adf465b950244c6baa620a5"
I20260709 13:03:47.006326 11928 raft_consensus.cc:3055] T 5078275d4ea64e67bf0a061eb3011157 P bd1c07cda9da4436b69174af3a1ce92f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:47.006451 12002 raft_consensus.cc:3060] T 5078275d4ea64e67bf0a061eb3011157 P 367d36143adf465b950244c6baa620a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:47.006737 11928 raft_consensus.cc:740] T 5078275d4ea64e67bf0a061eb3011157 P bd1c07cda9da4436b69174af3a1ce92f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bd1c07cda9da4436b69174af3a1ce92f, State: Running, Role: LEADER
I20260709 13:03:47.007561 11928 consensus_queue.cc:260] T 5078275d4ea64e67bf0a061eb3011157 P bd1c07cda9da4436b69174af3a1ce92f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:47.008541 11928 raft_consensus.cc:3060] T 5078275d4ea64e67bf0a061eb3011157 P bd1c07cda9da4436b69174af3a1ce92f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:47.011817 12002 raft_consensus.cc:2468] T 5078275d4ea64e67bf0a061eb3011157 P 367d36143adf465b950244c6baa620a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dfed99448174185ba5ece679e9d90be in term 2.
I20260709 13:03:47.013017 12042 leader_election.cc:304] T 5078275d4ea64e67bf0a061eb3011157 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 367d36143adf465b950244c6baa620a5, 8dfed99448174185ba5ece679e9d90be; no voters: 
I20260709 13:03:47.013854 12169 raft_consensus.cc:2804] T 5078275d4ea64e67bf0a061eb3011157 P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:47.013923 11928 raft_consensus.cc:2468] T 5078275d4ea64e67bf0a061eb3011157 P bd1c07cda9da4436b69174af3a1ce92f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dfed99448174185ba5ece679e9d90be in term 2.
I20260709 13:03:47.014348 12169 raft_consensus.cc:697] T 5078275d4ea64e67bf0a061eb3011157 P 8dfed99448174185ba5ece679e9d90be [term 2 LEADER]: Becoming Leader. State: Replica: 8dfed99448174185ba5ece679e9d90be, State: Running, Role: LEADER
I20260709 13:03:47.015223 12169 consensus_queue.cc:237] T 5078275d4ea64e67bf0a061eb3011157 P 8dfed99448174185ba5ece679e9d90be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:47.021760 11824 catalog_manager.cc:5697] T 5078275d4ea64e67bf0a061eb3011157 P 8dfed99448174185ba5ece679e9d90be reported cstate change: term changed from 1 to 2, leader changed from bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193) to 8dfed99448174185ba5ece679e9d90be (127.0.107.195). New cstate: current_term: 2 leader_uuid: "8dfed99448174185ba5ece679e9d90be" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:47.042083 12126 raft_consensus.cc:993] T b8baeafde60b486094f5139efec7eca0 P 8dfed99448174185ba5ece679e9d90be: : Instructing follower bd1c07cda9da4436b69174af3a1ce92f to start an election
I20260709 13:03:47.042778 12169 raft_consensus.cc:1081] T b8baeafde60b486094f5139efec7eca0 P 8dfed99448174185ba5ece679e9d90be [term 1 LEADER]: Signalling peer bd1c07cda9da4436b69174af3a1ce92f to start an election
I20260709 13:03:47.044427 11928 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b8baeafde60b486094f5139efec7eca0"
dest_uuid: "bd1c07cda9da4436b69174af3a1ce92f"
 from {username='slave'} at 127.0.0.1:46202
I20260709 13:03:47.044917 11928 raft_consensus.cc:493] T b8baeafde60b486094f5139efec7eca0 P bd1c07cda9da4436b69174af3a1ce92f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:47.045193 11928 raft_consensus.cc:3060] T b8baeafde60b486094f5139efec7eca0 P bd1c07cda9da4436b69174af3a1ce92f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:47.050318 11928 raft_consensus.cc:515] T b8baeafde60b486094f5139efec7eca0 P bd1c07cda9da4436b69174af3a1ce92f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:47.052019 11928 leader_election.cc:290] T b8baeafde60b486094f5139efec7eca0 P bd1c07cda9da4436b69174af3a1ce92f [CANDIDATE]: Term 2 election: Requested vote from peers 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337), 8dfed99448174185ba5ece679e9d90be (127.0.107.195:39279)
I20260709 13:03:47.053013 12002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8baeafde60b486094f5139efec7eca0" candidate_uuid: "bd1c07cda9da4436b69174af3a1ce92f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "367d36143adf465b950244c6baa620a5"
I20260709 13:03:47.053293 12078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8baeafde60b486094f5139efec7eca0" candidate_uuid: "bd1c07cda9da4436b69174af3a1ce92f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8dfed99448174185ba5ece679e9d90be"
I20260709 13:03:47.053656 12002 raft_consensus.cc:3060] T b8baeafde60b486094f5139efec7eca0 P 367d36143adf465b950244c6baa620a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:47.053864 12078 raft_consensus.cc:3055] T b8baeafde60b486094f5139efec7eca0 P 8dfed99448174185ba5ece679e9d90be [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:47.054190 12078 raft_consensus.cc:740] T b8baeafde60b486094f5139efec7eca0 P 8dfed99448174185ba5ece679e9d90be [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8dfed99448174185ba5ece679e9d90be, State: Running, Role: LEADER
I20260709 13:03:47.054874 12078 consensus_queue.cc:260] T b8baeafde60b486094f5139efec7eca0 P 8dfed99448174185ba5ece679e9d90be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:47.055876 12078 raft_consensus.cc:3060] T b8baeafde60b486094f5139efec7eca0 P 8dfed99448174185ba5ece679e9d90be [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:47.058990 12002 raft_consensus.cc:2468] T b8baeafde60b486094f5139efec7eca0 P 367d36143adf465b950244c6baa620a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd1c07cda9da4436b69174af3a1ce92f in term 2.
I20260709 13:03:47.060281 11893 leader_election.cc:304] T b8baeafde60b486094f5139efec7eca0 P bd1c07cda9da4436b69174af3a1ce92f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 367d36143adf465b950244c6baa620a5, bd1c07cda9da4436b69174af3a1ce92f; no voters: 
I20260709 13:03:47.061043 12146 raft_consensus.cc:2804] T b8baeafde60b486094f5139efec7eca0 P bd1c07cda9da4436b69174af3a1ce92f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:47.061436 12146 raft_consensus.cc:697] T b8baeafde60b486094f5139efec7eca0 P bd1c07cda9da4436b69174af3a1ce92f [term 2 LEADER]: Becoming Leader. State: Replica: bd1c07cda9da4436b69174af3a1ce92f, State: Running, Role: LEADER
I20260709 13:03:47.061611 12078 raft_consensus.cc:2468] T b8baeafde60b486094f5139efec7eca0 P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd1c07cda9da4436b69174af3a1ce92f in term 2.
I20260709 13:03:47.062177 12146 consensus_queue.cc:237] T b8baeafde60b486094f5139efec7eca0 P bd1c07cda9da4436b69174af3a1ce92f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:47.069020 11824 catalog_manager.cc:5697] T b8baeafde60b486094f5139efec7eca0 P bd1c07cda9da4436b69174af3a1ce92f reported cstate change: term changed from 1 to 2, leader changed from 8dfed99448174185ba5ece679e9d90be (127.0.107.195) to bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193). New cstate: current_term: 2 leader_uuid: "bd1c07cda9da4436b69174af3a1ce92f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:47.206624 12078 raft_consensus.cc:1275] T bda83ed4e6b84bf9985ad11c37b2bd59 P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Refusing update from remote peer 367d36143adf465b950244c6baa620a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:47.208091 12132 consensus_queue.cc:1048] T bda83ed4e6b84bf9985ad11c37b2bd59 P 367d36143adf465b950244c6baa620a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:47.216398 11928 raft_consensus.cc:1275] T bda83ed4e6b84bf9985ad11c37b2bd59 P bd1c07cda9da4436b69174af3a1ce92f [term 2 FOLLOWER]: Refusing update from remote peer 367d36143adf465b950244c6baa620a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:47.217535 12078 raft_consensus.cc:3060] T 7f973c97455b4d918d353553cbe194a9 P 8dfed99448174185ba5ece679e9d90be [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:47.217902 12132 consensus_queue.cc:1048] T bda83ed4e6b84bf9985ad11c37b2bd59 P 367d36143adf465b950244c6baa620a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:47.225277 12078 raft_consensus.cc:1275] T 7f973c97455b4d918d353553cbe194a9 P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Refusing update from remote peer 367d36143adf465b950244c6baa620a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:47.226727 12132 consensus_queue.cc:1048] T 7f973c97455b4d918d353553cbe194a9 P 367d36143adf465b950244c6baa620a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:47.236042 11928 raft_consensus.cc:1275] T 7f973c97455b4d918d353553cbe194a9 P bd1c07cda9da4436b69174af3a1ce92f [term 2 FOLLOWER]: Refusing update from remote peer 367d36143adf465b950244c6baa620a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:47.237964 12201 consensus_queue.cc:1048] T 7f973c97455b4d918d353553cbe194a9 P 367d36143adf465b950244c6baa620a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:47.322566 12002 raft_consensus.cc:1275] T 196209061a514376bb68b340c922a883 P 367d36143adf465b950244c6baa620a5 [term 2 FOLLOWER]: Refusing update from remote peer bd1c07cda9da4436b69174af3a1ce92f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:47.323952 12146 consensus_queue.cc:1048] T 196209061a514376bb68b340c922a883 P bd1c07cda9da4436b69174af3a1ce92f [LEADER]: Connected to new peer: Peer: permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:47.331566 12078 raft_consensus.cc:1275] T 196209061a514376bb68b340c922a883 P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Refusing update from remote peer bd1c07cda9da4436b69174af3a1ce92f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:47.333091 12123 consensus_queue.cc:1048] T 196209061a514376bb68b340c922a883 P bd1c07cda9da4436b69174af3a1ce92f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:47.408984 12002 raft_consensus.cc:1275] T 5078275d4ea64e67bf0a061eb3011157 P 367d36143adf465b950244c6baa620a5 [term 2 FOLLOWER]: Refusing update from remote peer 8dfed99448174185ba5ece679e9d90be: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:47.410351 12169 consensus_queue.cc:1048] T 5078275d4ea64e67bf0a061eb3011157 P 8dfed99448174185ba5ece679e9d90be [LEADER]: Connected to new peer: Peer: permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:47.418246 11928 raft_consensus.cc:1275] T 5078275d4ea64e67bf0a061eb3011157 P bd1c07cda9da4436b69174af3a1ce92f [term 2 FOLLOWER]: Refusing update from remote peer 8dfed99448174185ba5ece679e9d90be: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:47.420409 12126 consensus_queue.cc:1048] T 5078275d4ea64e67bf0a061eb3011157 P 8dfed99448174185ba5ece679e9d90be [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:47.460770 12078 raft_consensus.cc:1275] T a846ec1843bc4dbca0df61be2992759d P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Refusing update from remote peer 367d36143adf465b950244c6baa620a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:47.462255 12201 consensus_queue.cc:1048] T a846ec1843bc4dbca0df61be2992759d P 367d36143adf465b950244c6baa620a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:47.473168 11928 raft_consensus.cc:1275] T a846ec1843bc4dbca0df61be2992759d P bd1c07cda9da4436b69174af3a1ce92f [term 2 FOLLOWER]: Refusing update from remote peer 367d36143adf465b950244c6baa620a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:47.474777 12132 consensus_queue.cc:1048] T a846ec1843bc4dbca0df61be2992759d P 367d36143adf465b950244c6baa620a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:47.613175 12078 raft_consensus.cc:1275] T b8baeafde60b486094f5139efec7eca0 P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Refusing update from remote peer bd1c07cda9da4436b69174af3a1ce92f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:47.614507 12123 consensus_queue.cc:1048] T b8baeafde60b486094f5139efec7eca0 P bd1c07cda9da4436b69174af3a1ce92f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:47.623780 12002 raft_consensus.cc:1275] T b8baeafde60b486094f5139efec7eca0 P 367d36143adf465b950244c6baa620a5 [term 2 FOLLOWER]: Refusing update from remote peer bd1c07cda9da4436b69174af3a1ce92f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:47.625375 12123 consensus_queue.cc:1048] T b8baeafde60b486094f5139efec7eca0 P bd1c07cda9da4436b69174af3a1ce92f [LEADER]: Connected to new peer: Peer: permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:49.614584 11824 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36676:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:03:49.616914 11824 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:03:49.665635 11916 tablet_service.cc:1511] Processing CreateTablet for tablet b71ba69388bf42a88deaf32615d3b1b6 (DEFAULT_TABLE table=soft_deleted_table [id=4c3bef42d55c4c8c87863995596e7175]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:03:49.666927 11916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b71ba69388bf42a88deaf32615d3b1b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.666872 11991 tablet_service.cc:1511] Processing CreateTablet for tablet b71ba69388bf42a88deaf32615d3b1b6 (DEFAULT_TABLE table=soft_deleted_table [id=4c3bef42d55c4c8c87863995596e7175]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:03:49.668226 11991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b71ba69388bf42a88deaf32615d3b1b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.668821 12067 tablet_service.cc:1511] Processing CreateTablet for tablet b71ba69388bf42a88deaf32615d3b1b6 (DEFAULT_TABLE table=soft_deleted_table [id=4c3bef42d55c4c8c87863995596e7175]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:03:49.670085 12067 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b71ba69388bf42a88deaf32615d3b1b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.671681 11915 tablet_service.cc:1511] Processing CreateTablet for tablet 93c0155ffb2b44fab1eed91e0025ef62 (DEFAULT_TABLE table=soft_deleted_table [id=4c3bef42d55c4c8c87863995596e7175]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:03:49.673056 11915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93c0155ffb2b44fab1eed91e0025ef62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.675654 11918 tablet_service.cc:1511] Processing CreateTablet for tablet 65544e18a6944de89c1560f44aaf32ec (DEFAULT_TABLE table=soft_deleted_table [id=4c3bef42d55c4c8c87863995596e7175]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:03:49.677057 11918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65544e18a6944de89c1560f44aaf32ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.677927 12066 tablet_service.cc:1511] Processing CreateTablet for tablet 93c0155ffb2b44fab1eed91e0025ef62 (DEFAULT_TABLE table=soft_deleted_table [id=4c3bef42d55c4c8c87863995596e7175]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:03:49.679268 12066 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93c0155ffb2b44fab1eed91e0025ef62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.679680 11986 tablet_service.cc:1511] Processing CreateTablet for tablet 93c0155ffb2b44fab1eed91e0025ef62 (DEFAULT_TABLE table=soft_deleted_table [id=4c3bef42d55c4c8c87863995596e7175]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:03:49.681002 11986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93c0155ffb2b44fab1eed91e0025ef62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.683724 12061 tablet_service.cc:1511] Processing CreateTablet for tablet 65544e18a6944de89c1560f44aaf32ec (DEFAULT_TABLE table=soft_deleted_table [id=4c3bef42d55c4c8c87863995596e7175]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:03:49.685173 12061 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65544e18a6944de89c1560f44aaf32ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.687697 11912 tablet_service.cc:1511] Processing CreateTablet for tablet 13ef79ebfe4f45b9bd9763de63a3e15a (DEFAULT_TABLE table=soft_deleted_table [id=4c3bef42d55c4c8c87863995596e7175]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:03:49.689077 11912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13ef79ebfe4f45b9bd9763de63a3e15a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.690779 11919 tablet_service.cc:1511] Processing CreateTablet for tablet 0fd34026fbe142c0898fd7ec29688648 (DEFAULT_TABLE table=soft_deleted_table [id=4c3bef42d55c4c8c87863995596e7175]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:03:49.692202 11919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fd34026fbe142c0898fd7ec29688648. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.695684 11917 tablet_service.cc:1511] Processing CreateTablet for tablet 0ac98551cc1c458e8e95be2e9f1ddeac (DEFAULT_TABLE table=soft_deleted_table [id=4c3bef42d55c4c8c87863995596e7175]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:03:49.696074 11913 tablet_service.cc:1511] Processing CreateTablet for tablet 175f2fe459f4455386cac7de26d34679 (DEFAULT_TABLE table=soft_deleted_table [id=4c3bef42d55c4c8c87863995596e7175]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:03:49.697077 11917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ac98551cc1c458e8e95be2e9f1ddeac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.697755 11913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 175f2fe459f4455386cac7de26d34679. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.701272 11987 tablet_service.cc:1511] Processing CreateTablet for tablet 65544e18a6944de89c1560f44aaf32ec (DEFAULT_TABLE table=soft_deleted_table [id=4c3bef42d55c4c8c87863995596e7175]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:03:49.684790 11911 tablet_service.cc:1511] Processing CreateTablet for tablet b5d801f325be415db1d2961ed3876b90 (DEFAULT_TABLE table=soft_deleted_table [id=4c3bef42d55c4c8c87863995596e7175]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:03:49.706202 11911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5d801f325be415db1d2961ed3876b90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.712039 11914 tablet_service.cc:1511] Processing CreateTablet for tablet d2a9a34c1be443a69f95f8f237dc4116 (DEFAULT_TABLE table=soft_deleted_table [id=4c3bef42d55c4c8c87863995596e7175]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:03:49.713429 11914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2a9a34c1be443a69f95f8f237dc4116. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.715847 12063 tablet_service.cc:1511] Processing CreateTablet for tablet 0fd34026fbe142c0898fd7ec29688648 (DEFAULT_TABLE table=soft_deleted_table [id=4c3bef42d55c4c8c87863995596e7175]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:03:49.716094 12064 tablet_service.cc:1511] Processing CreateTablet for tablet 175f2fe459f4455386cac7de26d34679 (DEFAULT_TABLE table=soft_deleted_table [id=4c3bef42d55c4c8c87863995596e7175]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:03:49.717280 12063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fd34026fbe142c0898fd7ec29688648. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.717074 12065 tablet_service.cc:1511] Processing CreateTablet for tablet b5d801f325be415db1d2961ed3876b90 (DEFAULT_TABLE table=soft_deleted_table [id=4c3bef42d55c4c8c87863995596e7175]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:03:49.717936 12064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 175f2fe459f4455386cac7de26d34679. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.719230 12068 tablet_service.cc:1511] Processing CreateTablet for tablet 0ac98551cc1c458e8e95be2e9f1ddeac (DEFAULT_TABLE table=soft_deleted_table [id=4c3bef42d55c4c8c87863995596e7175]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:03:49.720577 12068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ac98551cc1c458e8e95be2e9f1ddeac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.716094 12060 tablet_service.cc:1511] Processing CreateTablet for tablet 13ef79ebfe4f45b9bd9763de63a3e15a (DEFAULT_TABLE table=soft_deleted_table [id=4c3bef42d55c4c8c87863995596e7175]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:03:49.724037 12060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13ef79ebfe4f45b9bd9763de63a3e15a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.724448 12062 tablet_service.cc:1511] Processing CreateTablet for tablet d2a9a34c1be443a69f95f8f237dc4116 (DEFAULT_TABLE table=soft_deleted_table [id=4c3bef42d55c4c8c87863995596e7175]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:03:49.725749 12062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2a9a34c1be443a69f95f8f237dc4116. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.728209 11993 tablet_service.cc:1511] Processing CreateTablet for tablet 13ef79ebfe4f45b9bd9763de63a3e15a (DEFAULT_TABLE table=soft_deleted_table [id=4c3bef42d55c4c8c87863995596e7175]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:03:49.728506 11992 tablet_service.cc:1511] Processing CreateTablet for tablet b5d801f325be415db1d2961ed3876b90 (DEFAULT_TABLE table=soft_deleted_table [id=4c3bef42d55c4c8c87863995596e7175]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:03:49.729862 11990 tablet_service.cc:1511] Processing CreateTablet for tablet 0ac98551cc1c458e8e95be2e9f1ddeac (DEFAULT_TABLE table=soft_deleted_table [id=4c3bef42d55c4c8c87863995596e7175]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:03:49.730202 11989 tablet_service.cc:1511] Processing CreateTablet for tablet 0fd34026fbe142c0898fd7ec29688648 (DEFAULT_TABLE table=soft_deleted_table [id=4c3bef42d55c4c8c87863995596e7175]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:03:49.730911 11987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65544e18a6944de89c1560f44aaf32ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.732354 11990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ac98551cc1c458e8e95be2e9f1ddeac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.734901 12065 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5d801f325be415db1d2961ed3876b90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.735170 11989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fd34026fbe142c0898fd7ec29688648. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.737535 11992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5d801f325be415db1d2961ed3876b90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.744035 11988 tablet_service.cc:1511] Processing CreateTablet for tablet 175f2fe459f4455386cac7de26d34679 (DEFAULT_TABLE table=soft_deleted_table [id=4c3bef42d55c4c8c87863995596e7175]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:03:49.745500 11988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 175f2fe459f4455386cac7de26d34679. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.731696 11994 tablet_service.cc:1511] Processing CreateTablet for tablet d2a9a34c1be443a69f95f8f237dc4116 (DEFAULT_TABLE table=soft_deleted_table [id=4c3bef42d55c4c8c87863995596e7175]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:03:49.747856 11994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2a9a34c1be443a69f95f8f237dc4116. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.759586 12218 tablet_bootstrap.cc:492] T 175f2fe459f4455386cac7de26d34679 P bd1c07cda9da4436b69174af3a1ce92f: Bootstrap starting.
I20260709 13:03:49.760521 11993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13ef79ebfe4f45b9bd9763de63a3e15a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:49.883157 12218 tablet_bootstrap.cc:654] T 175f2fe459f4455386cac7de26d34679 P bd1c07cda9da4436b69174af3a1ce92f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:49.884423 12217 tablet_bootstrap.cc:492] T b71ba69388bf42a88deaf32615d3b1b6 P 367d36143adf465b950244c6baa620a5: Bootstrap starting.
I20260709 13:03:49.886474 12219 tablet_bootstrap.cc:492] T 0fd34026fbe142c0898fd7ec29688648 P 8dfed99448174185ba5ece679e9d90be: Bootstrap starting.
I20260709 13:03:49.892968 12217 tablet_bootstrap.cc:654] T b71ba69388bf42a88deaf32615d3b1b6 P 367d36143adf465b950244c6baa620a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:49.896636 12218 tablet_bootstrap.cc:492] T 175f2fe459f4455386cac7de26d34679 P bd1c07cda9da4436b69174af3a1ce92f: No bootstrap required, opened a new log
I20260709 13:03:49.897099 12218 ts_tablet_manager.cc:1403] T 175f2fe459f4455386cac7de26d34679 P bd1c07cda9da4436b69174af3a1ce92f: Time spent bootstrapping tablet: real 0.138s	user 0.005s	sys 0.006s
I20260709 13:03:49.898329 12219 tablet_bootstrap.cc:654] T 0fd34026fbe142c0898fd7ec29688648 P 8dfed99448174185ba5ece679e9d90be: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:49.899562 12218 raft_consensus.cc:359] T 175f2fe459f4455386cac7de26d34679 P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:49.900046 12217 tablet_bootstrap.cc:492] T b71ba69388bf42a88deaf32615d3b1b6 P 367d36143adf465b950244c6baa620a5: No bootstrap required, opened a new log
I20260709 13:03:49.900221 12218 raft_consensus.cc:385] T 175f2fe459f4455386cac7de26d34679 P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:49.900660 12218 raft_consensus.cc:740] T 175f2fe459f4455386cac7de26d34679 P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd1c07cda9da4436b69174af3a1ce92f, State: Initialized, Role: FOLLOWER
I20260709 13:03:49.900720 12217 ts_tablet_manager.cc:1403] T b71ba69388bf42a88deaf32615d3b1b6 P 367d36143adf465b950244c6baa620a5: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.000s
I20260709 13:03:49.901427 12218 consensus_queue.cc:260] T 175f2fe459f4455386cac7de26d34679 P bd1c07cda9da4436b69174af3a1ce92f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:49.903527 12218 ts_tablet_manager.cc:1434] T 175f2fe459f4455386cac7de26d34679 P bd1c07cda9da4436b69174af3a1ce92f: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.002s
I20260709 13:03:49.904320 12218 tablet_bootstrap.cc:492] T b5d801f325be415db1d2961ed3876b90 P bd1c07cda9da4436b69174af3a1ce92f: Bootstrap starting.
I20260709 13:03:49.903868 12217 raft_consensus.cc:359] T b71ba69388bf42a88deaf32615d3b1b6 P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:49.904693 12217 raft_consensus.cc:385] T b71ba69388bf42a88deaf32615d3b1b6 P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:49.904994 12217 raft_consensus.cc:740] T b71ba69388bf42a88deaf32615d3b1b6 P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 367d36143adf465b950244c6baa620a5, State: Initialized, Role: FOLLOWER
I20260709 13:03:49.905777 12217 consensus_queue.cc:260] T b71ba69388bf42a88deaf32615d3b1b6 P 367d36143adf465b950244c6baa620a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:49.907518 12219 tablet_bootstrap.cc:492] T 0fd34026fbe142c0898fd7ec29688648 P 8dfed99448174185ba5ece679e9d90be: No bootstrap required, opened a new log
I20260709 13:03:49.908239 12219 ts_tablet_manager.cc:1403] T 0fd34026fbe142c0898fd7ec29688648 P 8dfed99448174185ba5ece679e9d90be: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.000s
I20260709 13:03:49.914103 12219 raft_consensus.cc:359] T 0fd34026fbe142c0898fd7ec29688648 P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:49.915086 12219 raft_consensus.cc:385] T 0fd34026fbe142c0898fd7ec29688648 P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:49.915455 12219 raft_consensus.cc:740] T 0fd34026fbe142c0898fd7ec29688648 P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dfed99448174185ba5ece679e9d90be, State: Initialized, Role: FOLLOWER
I20260709 13:03:49.916450 12219 consensus_queue.cc:260] T 0fd34026fbe142c0898fd7ec29688648 P 8dfed99448174185ba5ece679e9d90be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:49.919350 12219 ts_tablet_manager.cc:1434] T 0fd34026fbe142c0898fd7ec29688648 P 8dfed99448174185ba5ece679e9d90be: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:03:49.920578 12218 tablet_bootstrap.cc:654] T b5d801f325be415db1d2961ed3876b90 P bd1c07cda9da4436b69174af3a1ce92f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:49.920674 12219 tablet_bootstrap.cc:492] T 0ac98551cc1c458e8e95be2e9f1ddeac P 8dfed99448174185ba5ece679e9d90be: Bootstrap starting.
I20260709 13:03:49.922773 12123 raft_consensus.cc:493] T 175f2fe459f4455386cac7de26d34679 P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:49.923388 12123 raft_consensus.cc:515] T 175f2fe459f4455386cac7de26d34679 P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:49.925563 12123 leader_election.cc:290] T 175f2fe459f4455386cac7de26d34679 P bd1c07cda9da4436b69174af3a1ce92f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337), 8dfed99448174185ba5ece679e9d90be (127.0.107.195:39279)
I20260709 13:03:49.928386 12078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "175f2fe459f4455386cac7de26d34679" candidate_uuid: "bd1c07cda9da4436b69174af3a1ce92f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dfed99448174185ba5ece679e9d90be" is_pre_election: true
W20260709 13:03:49.930131 11893 leader_election.cc:343] T 175f2fe459f4455386cac7de26d34679 P bd1c07cda9da4436b69174af3a1ce92f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dfed99448174185ba5ece679e9d90be (127.0.107.195:39279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:49.927878 12002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "175f2fe459f4455386cac7de26d34679" candidate_uuid: "bd1c07cda9da4436b69174af3a1ce92f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "367d36143adf465b950244c6baa620a5" is_pre_election: true
I20260709 13:03:49.927960 12217 ts_tablet_manager.cc:1434] T b71ba69388bf42a88deaf32615d3b1b6 P 367d36143adf465b950244c6baa620a5: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.017s
W20260709 13:03:49.932503 11893 leader_election.cc:343] T 175f2fe459f4455386cac7de26d34679 P bd1c07cda9da4436b69174af3a1ce92f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:49.932957 11893 leader_election.cc:304] T 175f2fe459f4455386cac7de26d34679 P bd1c07cda9da4436b69174af3a1ce92f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd1c07cda9da4436b69174af3a1ce92f; no voters: 367d36143adf465b950244c6baa620a5, 8dfed99448174185ba5ece679e9d90be
I20260709 13:03:49.934617 12217 tablet_bootstrap.cc:492] T 65544e18a6944de89c1560f44aaf32ec P 367d36143adf465b950244c6baa620a5: Bootstrap starting.
I20260709 13:03:49.935076 12123 raft_consensus.cc:2749] T 175f2fe459f4455386cac7de26d34679 P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:49.937345 12218 tablet_bootstrap.cc:492] T b5d801f325be415db1d2961ed3876b90 P bd1c07cda9da4436b69174af3a1ce92f: No bootstrap required, opened a new log
I20260709 13:03:49.937916 12218 ts_tablet_manager.cc:1403] T b5d801f325be415db1d2961ed3876b90 P bd1c07cda9da4436b69174af3a1ce92f: Time spent bootstrapping tablet: real 0.034s	user 0.013s	sys 0.006s
W20260709 13:03:49.938844 11875 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:03:49.942076 12218 raft_consensus.cc:359] T b5d801f325be415db1d2961ed3876b90 P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:49.942960 12218 raft_consensus.cc:385] T b5d801f325be415db1d2961ed3876b90 P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:49.943280 12218 raft_consensus.cc:740] T b5d801f325be415db1d2961ed3876b90 P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd1c07cda9da4436b69174af3a1ce92f, State: Initialized, Role: FOLLOWER
I20260709 13:03:49.944321 12219 tablet_bootstrap.cc:654] T 0ac98551cc1c458e8e95be2e9f1ddeac P 8dfed99448174185ba5ece679e9d90be: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:49.944044 12218 consensus_queue.cc:260] T b5d801f325be415db1d2961ed3876b90 P bd1c07cda9da4436b69174af3a1ce92f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:49.945303 12217 tablet_bootstrap.cc:654] T 65544e18a6944de89c1560f44aaf32ec P 367d36143adf465b950244c6baa620a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:49.946543 12218 ts_tablet_manager.cc:1434] T b5d801f325be415db1d2961ed3876b90 P bd1c07cda9da4436b69174af3a1ce92f: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:03:49.947633 12218 tablet_bootstrap.cc:492] T 0ac98551cc1c458e8e95be2e9f1ddeac P bd1c07cda9da4436b69174af3a1ce92f: Bootstrap starting.
I20260709 13:03:49.955538 12218 tablet_bootstrap.cc:654] T 0ac98551cc1c458e8e95be2e9f1ddeac P bd1c07cda9da4436b69174af3a1ce92f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:49.962055 12217 tablet_bootstrap.cc:492] T 65544e18a6944de89c1560f44aaf32ec P 367d36143adf465b950244c6baa620a5: No bootstrap required, opened a new log
I20260709 13:03:49.962610 12219 tablet_bootstrap.cc:492] T 0ac98551cc1c458e8e95be2e9f1ddeac P 8dfed99448174185ba5ece679e9d90be: No bootstrap required, opened a new log
I20260709 13:03:49.963238 12219 ts_tablet_manager.cc:1403] T 0ac98551cc1c458e8e95be2e9f1ddeac P 8dfed99448174185ba5ece679e9d90be: Time spent bootstrapping tablet: real 0.043s	user 0.025s	sys 0.000s
I20260709 13:03:49.965451 12218 tablet_bootstrap.cc:492] T 0ac98551cc1c458e8e95be2e9f1ddeac P bd1c07cda9da4436b69174af3a1ce92f: No bootstrap required, opened a new log
I20260709 13:03:49.965926 12218 ts_tablet_manager.cc:1403] T 0ac98551cc1c458e8e95be2e9f1ddeac P bd1c07cda9da4436b69174af3a1ce92f: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.004s
I20260709 13:03:49.965788 12219 raft_consensus.cc:359] T 0ac98551cc1c458e8e95be2e9f1ddeac P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:49.966449 12219 raft_consensus.cc:385] T 0ac98551cc1c458e8e95be2e9f1ddeac P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:49.966727 12219 raft_consensus.cc:740] T 0ac98551cc1c458e8e95be2e9f1ddeac P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dfed99448174185ba5ece679e9d90be, State: Initialized, Role: FOLLOWER
I20260709 13:03:49.962627 12217 ts_tablet_manager.cc:1403] T 65544e18a6944de89c1560f44aaf32ec P 367d36143adf465b950244c6baa620a5: Time spent bootstrapping tablet: real 0.028s	user 0.011s	sys 0.010s
I20260709 13:03:49.967453 12219 consensus_queue.cc:260] T 0ac98551cc1c458e8e95be2e9f1ddeac P 8dfed99448174185ba5ece679e9d90be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:49.968899 12218 raft_consensus.cc:359] T 0ac98551cc1c458e8e95be2e9f1ddeac P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:49.969497 12219 ts_tablet_manager.cc:1434] T 0ac98551cc1c458e8e95be2e9f1ddeac P 8dfed99448174185ba5ece679e9d90be: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:03:49.969671 12218 raft_consensus.cc:385] T 0ac98551cc1c458e8e95be2e9f1ddeac P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:49.970060 12218 raft_consensus.cc:740] T 0ac98551cc1c458e8e95be2e9f1ddeac P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd1c07cda9da4436b69174af3a1ce92f, State: Initialized, Role: FOLLOWER
I20260709 13:03:49.970589 12219 tablet_bootstrap.cc:492] T b71ba69388bf42a88deaf32615d3b1b6 P 8dfed99448174185ba5ece679e9d90be: Bootstrap starting.
I20260709 13:03:49.970192 12217 raft_consensus.cc:359] T 65544e18a6944de89c1560f44aaf32ec P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:49.971046 12217 raft_consensus.cc:385] T 65544e18a6944de89c1560f44aaf32ec P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:49.970863 12218 consensus_queue.cc:260] T 0ac98551cc1c458e8e95be2e9f1ddeac P bd1c07cda9da4436b69174af3a1ce92f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:49.971360 12217 raft_consensus.cc:740] T 65544e18a6944de89c1560f44aaf32ec P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 367d36143adf465b950244c6baa620a5, State: Initialized, Role: FOLLOWER
I20260709 13:03:49.972087 12217 consensus_queue.cc:260] T 65544e18a6944de89c1560f44aaf32ec P 367d36143adf465b950244c6baa620a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:49.973573 12218 ts_tablet_manager.cc:1434] T 0ac98551cc1c458e8e95be2e9f1ddeac P bd1c07cda9da4436b69174af3a1ce92f: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:03:49.974593 12218 tablet_bootstrap.cc:492] T 13ef79ebfe4f45b9bd9763de63a3e15a P bd1c07cda9da4436b69174af3a1ce92f: Bootstrap starting.
I20260709 13:03:49.976460 12217 ts_tablet_manager.cc:1434] T 65544e18a6944de89c1560f44aaf32ec P 367d36143adf465b950244c6baa620a5: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 13:03:49.977433 12219 tablet_bootstrap.cc:654] T b71ba69388bf42a88deaf32615d3b1b6 P 8dfed99448174185ba5ece679e9d90be: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:49.977540 12217 tablet_bootstrap.cc:492] T 0fd34026fbe142c0898fd7ec29688648 P 367d36143adf465b950244c6baa620a5: Bootstrap starting.
I20260709 13:03:49.980888 12218 tablet_bootstrap.cc:654] T 13ef79ebfe4f45b9bd9763de63a3e15a P bd1c07cda9da4436b69174af3a1ce92f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:49.985052 12217 tablet_bootstrap.cc:654] T 0fd34026fbe142c0898fd7ec29688648 P 367d36143adf465b950244c6baa620a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:49.989991 12219 tablet_bootstrap.cc:492] T b71ba69388bf42a88deaf32615d3b1b6 P 8dfed99448174185ba5ece679e9d90be: No bootstrap required, opened a new log
I20260709 13:03:49.990528 12219 ts_tablet_manager.cc:1403] T b71ba69388bf42a88deaf32615d3b1b6 P 8dfed99448174185ba5ece679e9d90be: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.004s
I20260709 13:03:49.993618 12219 raft_consensus.cc:359] T b71ba69388bf42a88deaf32615d3b1b6 P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:49.994369 12219 raft_consensus.cc:385] T b71ba69388bf42a88deaf32615d3b1b6 P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:49.994714 12219 raft_consensus.cc:740] T b71ba69388bf42a88deaf32615d3b1b6 P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dfed99448174185ba5ece679e9d90be, State: Initialized, Role: FOLLOWER
I20260709 13:03:49.995726 12217 tablet_bootstrap.cc:492] T 0fd34026fbe142c0898fd7ec29688648 P 367d36143adf465b950244c6baa620a5: No bootstrap required, opened a new log
I20260709 13:03:49.995502 12219 consensus_queue.cc:260] T b71ba69388bf42a88deaf32615d3b1b6 P 8dfed99448174185ba5ece679e9d90be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:49.996340 12217 ts_tablet_manager.cc:1403] T 0fd34026fbe142c0898fd7ec29688648 P 367d36143adf465b950244c6baa620a5: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.003s
I20260709 13:03:49.997917 12219 ts_tablet_manager.cc:1434] T b71ba69388bf42a88deaf32615d3b1b6 P 8dfed99448174185ba5ece679e9d90be: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:03:49.999912 12217 raft_consensus.cc:359] T 0fd34026fbe142c0898fd7ec29688648 P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:50.000696 12217 raft_consensus.cc:385] T 0fd34026fbe142c0898fd7ec29688648 P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:50.000923 12217 raft_consensus.cc:740] T 0fd34026fbe142c0898fd7ec29688648 P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 367d36143adf465b950244c6baa620a5, State: Initialized, Role: FOLLOWER
I20260709 13:03:50.001315 12218 tablet_bootstrap.cc:492] T 13ef79ebfe4f45b9bd9763de63a3e15a P bd1c07cda9da4436b69174af3a1ce92f: No bootstrap required, opened a new log
I20260709 13:03:50.001608 12217 consensus_queue.cc:260] T 0fd34026fbe142c0898fd7ec29688648 P 367d36143adf465b950244c6baa620a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:50.001894 12218 ts_tablet_manager.cc:1403] T 13ef79ebfe4f45b9bd9763de63a3e15a P bd1c07cda9da4436b69174af3a1ce92f: Time spent bootstrapping tablet: real 0.028s	user 0.007s	sys 0.003s
I20260709 13:03:50.002416 12219 tablet_bootstrap.cc:492] T b5d801f325be415db1d2961ed3876b90 P 8dfed99448174185ba5ece679e9d90be: Bootstrap starting.
I20260709 13:03:50.004611 12218 raft_consensus.cc:359] T 13ef79ebfe4f45b9bd9763de63a3e15a P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:50.005208 12218 raft_consensus.cc:385] T 13ef79ebfe4f45b9bd9763de63a3e15a P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:50.005467 12218 raft_consensus.cc:740] T 13ef79ebfe4f45b9bd9763de63a3e15a P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd1c07cda9da4436b69174af3a1ce92f, State: Initialized, Role: FOLLOWER
I20260709 13:03:50.006145 12218 consensus_queue.cc:260] T 13ef79ebfe4f45b9bd9763de63a3e15a P bd1c07cda9da4436b69174af3a1ce92f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:50.008428 12218 ts_tablet_manager.cc:1434] T 13ef79ebfe4f45b9bd9763de63a3e15a P bd1c07cda9da4436b69174af3a1ce92f: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:03:50.008730 12219 tablet_bootstrap.cc:654] T b5d801f325be415db1d2961ed3876b90 P 8dfed99448174185ba5ece679e9d90be: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:50.009486 12218 tablet_bootstrap.cc:492] T 93c0155ffb2b44fab1eed91e0025ef62 P bd1c07cda9da4436b69174af3a1ce92f: Bootstrap starting.
I20260709 13:03:50.016319 12217 ts_tablet_manager.cc:1434] T 0fd34026fbe142c0898fd7ec29688648 P 367d36143adf465b950244c6baa620a5: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:03:50.017438 12217 tablet_bootstrap.cc:492] T 0ac98551cc1c458e8e95be2e9f1ddeac P 367d36143adf465b950244c6baa620a5: Bootstrap starting.
I20260709 13:03:50.023574 12217 tablet_bootstrap.cc:654] T 0ac98551cc1c458e8e95be2e9f1ddeac P 367d36143adf465b950244c6baa620a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:50.023712 12219 tablet_bootstrap.cc:492] T b5d801f325be415db1d2961ed3876b90 P 8dfed99448174185ba5ece679e9d90be: No bootstrap required, opened a new log
I20260709 13:03:50.024348 12219 ts_tablet_manager.cc:1403] T b5d801f325be415db1d2961ed3876b90 P 8dfed99448174185ba5ece679e9d90be: Time spent bootstrapping tablet: real 0.026s	user 0.016s	sys 0.004s
I20260709 13:03:50.027347 12219 raft_consensus.cc:359] T b5d801f325be415db1d2961ed3876b90 P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:50.027709 12218 tablet_bootstrap.cc:654] T 93c0155ffb2b44fab1eed91e0025ef62 P bd1c07cda9da4436b69174af3a1ce92f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:50.027979 12219 raft_consensus.cc:385] T b5d801f325be415db1d2961ed3876b90 P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:50.028321 12219 raft_consensus.cc:740] T b5d801f325be415db1d2961ed3876b90 P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dfed99448174185ba5ece679e9d90be, State: Initialized, Role: FOLLOWER
I20260709 13:03:50.028957 12219 consensus_queue.cc:260] T b5d801f325be415db1d2961ed3876b90 P 8dfed99448174185ba5ece679e9d90be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:50.031340 12219 ts_tablet_manager.cc:1434] T b5d801f325be415db1d2961ed3876b90 P 8dfed99448174185ba5ece679e9d90be: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 13:03:50.032446 12219 tablet_bootstrap.cc:492] T 93c0155ffb2b44fab1eed91e0025ef62 P 8dfed99448174185ba5ece679e9d90be: Bootstrap starting.
I20260709 13:03:50.034382 12217 tablet_bootstrap.cc:492] T 0ac98551cc1c458e8e95be2e9f1ddeac P 367d36143adf465b950244c6baa620a5: No bootstrap required, opened a new log
I20260709 13:03:50.035035 12217 ts_tablet_manager.cc:1403] T 0ac98551cc1c458e8e95be2e9f1ddeac P 367d36143adf465b950244c6baa620a5: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.000s
I20260709 13:03:50.037235 12126 raft_consensus.cc:493] T b5d801f325be415db1d2961ed3876b90 P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.037815 12126 raft_consensus.cc:515] T b5d801f325be415db1d2961ed3876b90 P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:50.038376 12217 raft_consensus.cc:359] T 0ac98551cc1c458e8e95be2e9f1ddeac P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:50.039216 12217 raft_consensus.cc:385] T 0ac98551cc1c458e8e95be2e9f1ddeac P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:50.039566 12219 tablet_bootstrap.cc:654] T 93c0155ffb2b44fab1eed91e0025ef62 P 8dfed99448174185ba5ece679e9d90be: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:50.039515 12217 raft_consensus.cc:740] T 0ac98551cc1c458e8e95be2e9f1ddeac P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 367d36143adf465b950244c6baa620a5, State: Initialized, Role: FOLLOWER
I20260709 13:03:50.040072 12126 leader_election.cc:290] T b5d801f325be415db1d2961ed3876b90 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131), 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337)
I20260709 13:03:50.040455 12217 consensus_queue.cc:260] T 0ac98551cc1c458e8e95be2e9f1ddeac P 367d36143adf465b950244c6baa620a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:50.041822 12002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d801f325be415db1d2961ed3876b90" candidate_uuid: "8dfed99448174185ba5ece679e9d90be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "367d36143adf465b950244c6baa620a5" is_pre_election: true
I20260709 13:03:50.042307 11928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d801f325be415db1d2961ed3876b90" candidate_uuid: "8dfed99448174185ba5ece679e9d90be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd1c07cda9da4436b69174af3a1ce92f" is_pre_election: true
I20260709 13:03:50.042973 11928 raft_consensus.cc:2468] T b5d801f325be415db1d2961ed3876b90 P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dfed99448174185ba5ece679e9d90be in term 0.
I20260709 13:03:50.043074 12217 ts_tablet_manager.cc:1434] T 0ac98551cc1c458e8e95be2e9f1ddeac P 367d36143adf465b950244c6baa620a5: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
W20260709 13:03:50.043398 12042 leader_election.cc:343] T b5d801f325be415db1d2961ed3876b90 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:50.044718 12217 tablet_bootstrap.cc:492] T b5d801f325be415db1d2961ed3876b90 P 367d36143adf465b950244c6baa620a5: Bootstrap starting.
I20260709 13:03:50.046126 12043 leader_election.cc:304] T b5d801f325be415db1d2961ed3876b90 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dfed99448174185ba5ece679e9d90be, bd1c07cda9da4436b69174af3a1ce92f; no voters: 367d36143adf465b950244c6baa620a5
I20260709 13:03:50.046343 12218 tablet_bootstrap.cc:492] T 93c0155ffb2b44fab1eed91e0025ef62 P bd1c07cda9da4436b69174af3a1ce92f: No bootstrap required, opened a new log
I20260709 13:03:50.046998 12126 raft_consensus.cc:2804] T b5d801f325be415db1d2961ed3876b90 P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:50.047050 12218 ts_tablet_manager.cc:1403] T 93c0155ffb2b44fab1eed91e0025ef62 P bd1c07cda9da4436b69174af3a1ce92f: Time spent bootstrapping tablet: real 0.038s	user 0.008s	sys 0.010s
I20260709 13:03:50.047405 12126 raft_consensus.cc:493] T b5d801f325be415db1d2961ed3876b90 P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:50.047828 12126 raft_consensus.cc:3060] T b5d801f325be415db1d2961ed3876b90 P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:50.050386 12218 raft_consensus.cc:359] T 93c0155ffb2b44fab1eed91e0025ef62 P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:50.051035 12217 tablet_bootstrap.cc:654] T b5d801f325be415db1d2961ed3876b90 P 367d36143adf465b950244c6baa620a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:50.051179 12218 raft_consensus.cc:385] T 93c0155ffb2b44fab1eed91e0025ef62 P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:50.051555 12218 raft_consensus.cc:740] T 93c0155ffb2b44fab1eed91e0025ef62 P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd1c07cda9da4436b69174af3a1ce92f, State: Initialized, Role: FOLLOWER
I20260709 13:03:50.052323 12218 consensus_queue.cc:260] T 93c0155ffb2b44fab1eed91e0025ef62 P bd1c07cda9da4436b69174af3a1ce92f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:50.054874 12218 ts_tablet_manager.cc:1434] T 93c0155ffb2b44fab1eed91e0025ef62 P bd1c07cda9da4436b69174af3a1ce92f: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:03:50.056198 12218 tablet_bootstrap.cc:492] T b71ba69388bf42a88deaf32615d3b1b6 P bd1c07cda9da4436b69174af3a1ce92f: Bootstrap starting.
I20260709 13:03:50.057287 12219 tablet_bootstrap.cc:492] T 93c0155ffb2b44fab1eed91e0025ef62 P 8dfed99448174185ba5ece679e9d90be: No bootstrap required, opened a new log
I20260709 13:03:50.057858 12219 ts_tablet_manager.cc:1403] T 93c0155ffb2b44fab1eed91e0025ef62 P 8dfed99448174185ba5ece679e9d90be: Time spent bootstrapping tablet: real 0.026s	user 0.004s	sys 0.007s
I20260709 13:03:50.060954 12219 raft_consensus.cc:359] T 93c0155ffb2b44fab1eed91e0025ef62 P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:50.061671 12219 raft_consensus.cc:385] T 93c0155ffb2b44fab1eed91e0025ef62 P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:50.061954 12219 raft_consensus.cc:740] T 93c0155ffb2b44fab1eed91e0025ef62 P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dfed99448174185ba5ece679e9d90be, State: Initialized, Role: FOLLOWER
I20260709 13:03:50.062685 12219 consensus_queue.cc:260] T 93c0155ffb2b44fab1eed91e0025ef62 P 8dfed99448174185ba5ece679e9d90be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:50.063175 12218 tablet_bootstrap.cc:654] T b71ba69388bf42a88deaf32615d3b1b6 P bd1c07cda9da4436b69174af3a1ce92f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:50.055143 12126 raft_consensus.cc:515] T b5d801f325be415db1d2961ed3876b90 P 8dfed99448174185ba5ece679e9d90be [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:50.066951 12002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d801f325be415db1d2961ed3876b90" candidate_uuid: "8dfed99448174185ba5ece679e9d90be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "367d36143adf465b950244c6baa620a5"
W20260709 13:03:50.068456 12042 leader_election.cc:343] T b5d801f325be415db1d2961ed3876b90 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:50.068645 11928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d801f325be415db1d2961ed3876b90" candidate_uuid: "8dfed99448174185ba5ece679e9d90be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd1c07cda9da4436b69174af3a1ce92f"
I20260709 13:03:50.069074 12126 leader_election.cc:290] T b5d801f325be415db1d2961ed3876b90 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 1 election: Requested vote from peers bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131), 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337)
I20260709 13:03:50.071292 11928 raft_consensus.cc:3060] T b5d801f325be415db1d2961ed3876b90 P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:50.073810 12219 ts_tablet_manager.cc:1434] T 93c0155ffb2b44fab1eed91e0025ef62 P 8dfed99448174185ba5ece679e9d90be: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:03:50.086817 11928 raft_consensus.cc:2468] T b5d801f325be415db1d2961ed3876b90 P bd1c07cda9da4436b69174af3a1ce92f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dfed99448174185ba5ece679e9d90be in term 1.
I20260709 13:03:50.089035 12218 tablet_bootstrap.cc:492] T b71ba69388bf42a88deaf32615d3b1b6 P bd1c07cda9da4436b69174af3a1ce92f: No bootstrap required, opened a new log
I20260709 13:03:50.091166 12218 ts_tablet_manager.cc:1403] T b71ba69388bf42a88deaf32615d3b1b6 P bd1c07cda9da4436b69174af3a1ce92f: Time spent bootstrapping tablet: real 0.035s	user 0.014s	sys 0.016s
I20260709 13:03:50.091553 12043 leader_election.cc:304] T b5d801f325be415db1d2961ed3876b90 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dfed99448174185ba5ece679e9d90be, bd1c07cda9da4436b69174af3a1ce92f; no voters: 367d36143adf465b950244c6baa620a5
I20260709 13:03:50.092509 12126 raft_consensus.cc:2804] T b5d801f325be415db1d2961ed3876b90 P 8dfed99448174185ba5ece679e9d90be [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:50.092978 12126 raft_consensus.cc:697] T b5d801f325be415db1d2961ed3876b90 P 8dfed99448174185ba5ece679e9d90be [term 1 LEADER]: Becoming Leader. State: Replica: 8dfed99448174185ba5ece679e9d90be, State: Running, Role: LEADER
I20260709 13:03:50.093761 12126 consensus_queue.cc:237] T b5d801f325be415db1d2961ed3876b90 P 8dfed99448174185ba5ece679e9d90be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:50.094019 12218 raft_consensus.cc:359] T b71ba69388bf42a88deaf32615d3b1b6 P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:50.089543 12217 tablet_bootstrap.cc:492] T b5d801f325be415db1d2961ed3876b90 P 367d36143adf465b950244c6baa620a5: No bootstrap required, opened a new log
I20260709 13:03:50.094693 12218 raft_consensus.cc:385] T b71ba69388bf42a88deaf32615d3b1b6 P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:50.095048 12217 ts_tablet_manager.cc:1403] T b5d801f325be415db1d2961ed3876b90 P 367d36143adf465b950244c6baa620a5: Time spent bootstrapping tablet: real 0.051s	user 0.019s	sys 0.011s
I20260709 13:03:50.095016 12218 raft_consensus.cc:740] T b71ba69388bf42a88deaf32615d3b1b6 P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd1c07cda9da4436b69174af3a1ce92f, State: Initialized, Role: FOLLOWER
I20260709 13:03:50.095953 12218 consensus_queue.cc:260] T b71ba69388bf42a88deaf32615d3b1b6 P bd1c07cda9da4436b69174af3a1ce92f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:50.098372 12218 ts_tablet_manager.cc:1434] T b71ba69388bf42a88deaf32615d3b1b6 P bd1c07cda9da4436b69174af3a1ce92f: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:03:50.086920 12219 tablet_bootstrap.cc:492] T 13ef79ebfe4f45b9bd9763de63a3e15a P 8dfed99448174185ba5ece679e9d90be: Bootstrap starting.
I20260709 13:03:50.098201 12217 raft_consensus.cc:359] T b5d801f325be415db1d2961ed3876b90 P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:50.099025 12217 raft_consensus.cc:385] T b5d801f325be415db1d2961ed3876b90 P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:50.099311 12217 raft_consensus.cc:740] T b5d801f325be415db1d2961ed3876b90 P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 367d36143adf465b950244c6baa620a5, State: Initialized, Role: FOLLOWER
I20260709 13:03:50.100108 12217 consensus_queue.cc:260] T b5d801f325be415db1d2961ed3876b90 P 367d36143adf465b950244c6baa620a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:50.102803 12217 ts_tablet_manager.cc:1434] T b5d801f325be415db1d2961ed3876b90 P 367d36143adf465b950244c6baa620a5: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 13:03:50.103653 12123 raft_consensus.cc:493] T 13ef79ebfe4f45b9bd9763de63a3e15a P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.103816 12223 raft_consensus.cc:493] T b5d801f325be415db1d2961ed3876b90 P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.104204 12123 raft_consensus.cc:515] T 13ef79ebfe4f45b9bd9763de63a3e15a P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:50.104346 12223 raft_consensus.cc:515] T b5d801f325be415db1d2961ed3876b90 P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:50.105831 12218 tablet_bootstrap.cc:492] T 0fd34026fbe142c0898fd7ec29688648 P bd1c07cda9da4436b69174af3a1ce92f: Bootstrap starting.
I20260709 13:03:50.107129 12132 raft_consensus.cc:493] T 0ac98551cc1c458e8e95be2e9f1ddeac P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.104833 12219 tablet_bootstrap.cc:654] T 13ef79ebfe4f45b9bd9763de63a3e15a P 8dfed99448174185ba5ece679e9d90be: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:50.114470 12078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ef79ebfe4f45b9bd9763de63a3e15a" candidate_uuid: "bd1c07cda9da4436b69174af3a1ce92f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dfed99448174185ba5ece679e9d90be" is_pre_election: true
I20260709 13:03:50.116849 12078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d801f325be415db1d2961ed3876b90" candidate_uuid: "367d36143adf465b950244c6baa620a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dfed99448174185ba5ece679e9d90be" is_pre_election: true
I20260709 13:03:50.107409 12223 leader_election.cc:290] T b5d801f325be415db1d2961ed3876b90 P 367d36143adf465b950244c6baa620a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131), 8dfed99448174185ba5ece679e9d90be (127.0.107.195:39279)
I20260709 13:03:50.107918 12132 raft_consensus.cc:515] T 0ac98551cc1c458e8e95be2e9f1ddeac P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:50.106473 12123 leader_election.cc:290] T 13ef79ebfe4f45b9bd9763de63a3e15a P bd1c07cda9da4436b69174af3a1ce92f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337), 8dfed99448174185ba5ece679e9d90be (127.0.107.195:39279)
I20260709 13:03:50.119962 12002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ef79ebfe4f45b9bd9763de63a3e15a" candidate_uuid: "bd1c07cda9da4436b69174af3a1ce92f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "367d36143adf465b950244c6baa620a5" is_pre_election: true
W20260709 13:03:50.121615 11893 leader_election.cc:343] T 13ef79ebfe4f45b9bd9763de63a3e15a P bd1c07cda9da4436b69174af3a1ce92f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dfed99448174185ba5ece679e9d90be (127.0.107.195:39279): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:03:50.122778 11893 leader_election.cc:343] T 13ef79ebfe4f45b9bd9763de63a3e15a P bd1c07cda9da4436b69174af3a1ce92f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:50.112239 12217 tablet_bootstrap.cc:492] T d2a9a34c1be443a69f95f8f237dc4116 P 367d36143adf465b950244c6baa620a5: Bootstrap starting.
I20260709 13:03:50.128334 12132 leader_election.cc:290] T 0ac98551cc1c458e8e95be2e9f1ddeac P 367d36143adf465b950244c6baa620a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131), 8dfed99448174185ba5ece679e9d90be (127.0.107.195:39279)
I20260709 13:03:50.120347 11928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d801f325be415db1d2961ed3876b90" candidate_uuid: "367d36143adf465b950244c6baa620a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd1c07cda9da4436b69174af3a1ce92f" is_pre_election: true
I20260709 13:03:50.134977 11928 raft_consensus.cc:2393] T b5d801f325be415db1d2961ed3876b90 P bd1c07cda9da4436b69174af3a1ce92f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 367d36143adf465b950244c6baa620a5 in current term 1: Already voted for candidate 8dfed99448174185ba5ece679e9d90be in this term.
I20260709 13:03:50.129482 11893 leader_election.cc:304] T 13ef79ebfe4f45b9bd9763de63a3e15a P bd1c07cda9da4436b69174af3a1ce92f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd1c07cda9da4436b69174af3a1ce92f; no voters: 367d36143adf465b950244c6baa620a5, 8dfed99448174185ba5ece679e9d90be
I20260709 13:03:50.138712 12123 raft_consensus.cc:2749] T 13ef79ebfe4f45b9bd9763de63a3e15a P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:50.139991 11928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ac98551cc1c458e8e95be2e9f1ddeac" candidate_uuid: "367d36143adf465b950244c6baa620a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd1c07cda9da4436b69174af3a1ce92f" is_pre_election: true
I20260709 13:03:50.139592 11824 catalog_manager.cc:5697] T b5d801f325be415db1d2961ed3876b90 P 8dfed99448174185ba5ece679e9d90be reported cstate change: term changed from 0 to 1, leader changed from <none> to 8dfed99448174185ba5ece679e9d90be (127.0.107.195). New cstate: current_term: 1 leader_uuid: "8dfed99448174185ba5ece679e9d90be" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:50.141561 11969 leader_election.cc:304] T b5d801f325be415db1d2961ed3876b90 P 367d36143adf465b950244c6baa620a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 367d36143adf465b950244c6baa620a5; no voters: 8dfed99448174185ba5ece679e9d90be, bd1c07cda9da4436b69174af3a1ce92f
I20260709 13:03:50.143169 12223 raft_consensus.cc:3060] T b5d801f325be415db1d2961ed3876b90 P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:50.146996 12078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ac98551cc1c458e8e95be2e9f1ddeac" candidate_uuid: "367d36143adf465b950244c6baa620a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dfed99448174185ba5ece679e9d90be" is_pre_election: true
I20260709 13:03:50.147334 12217 tablet_bootstrap.cc:654] T d2a9a34c1be443a69f95f8f237dc4116 P 367d36143adf465b950244c6baa620a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:50.148284 12078 raft_consensus.cc:2468] T 0ac98551cc1c458e8e95be2e9f1ddeac P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 367d36143adf465b950244c6baa620a5 in term 0.
I20260709 13:03:50.149606 11968 leader_election.cc:304] T 0ac98551cc1c458e8e95be2e9f1ddeac P 367d36143adf465b950244c6baa620a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 367d36143adf465b950244c6baa620a5, 8dfed99448174185ba5ece679e9d90be; no voters: 
I20260709 13:03:50.150557 12132 raft_consensus.cc:2804] T 0ac98551cc1c458e8e95be2e9f1ddeac P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:50.150964 12132 raft_consensus.cc:493] T 0ac98551cc1c458e8e95be2e9f1ddeac P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:50.151304 12132 raft_consensus.cc:3060] T 0ac98551cc1c458e8e95be2e9f1ddeac P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:50.140724 11928 raft_consensus.cc:2468] T 0ac98551cc1c458e8e95be2e9f1ddeac P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 367d36143adf465b950244c6baa620a5 in term 0.
I20260709 13:03:50.153256 12218 tablet_bootstrap.cc:654] T 0fd34026fbe142c0898fd7ec29688648 P bd1c07cda9da4436b69174af3a1ce92f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:50.160120 12217 tablet_bootstrap.cc:492] T d2a9a34c1be443a69f95f8f237dc4116 P 367d36143adf465b950244c6baa620a5: No bootstrap required, opened a new log
I20260709 13:03:50.160718 12217 ts_tablet_manager.cc:1403] T d2a9a34c1be443a69f95f8f237dc4116 P 367d36143adf465b950244c6baa620a5: Time spent bootstrapping tablet: real 0.057s	user 0.011s	sys 0.000s
I20260709 13:03:50.161717 12132 raft_consensus.cc:515] T 0ac98551cc1c458e8e95be2e9f1ddeac P 367d36143adf465b950244c6baa620a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:50.163298 12218 tablet_bootstrap.cc:492] T 0fd34026fbe142c0898fd7ec29688648 P bd1c07cda9da4436b69174af3a1ce92f: No bootstrap required, opened a new log
I20260709 13:03:50.163858 12218 ts_tablet_manager.cc:1403] T 0fd34026fbe142c0898fd7ec29688648 P bd1c07cda9da4436b69174af3a1ce92f: Time spent bootstrapping tablet: real 0.058s	user 0.001s	sys 0.015s
I20260709 13:03:50.163879 12217 raft_consensus.cc:359] T d2a9a34c1be443a69f95f8f237dc4116 P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:50.164784 12217 raft_consensus.cc:385] T d2a9a34c1be443a69f95f8f237dc4116 P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:50.165091 12217 raft_consensus.cc:740] T d2a9a34c1be443a69f95f8f237dc4116 P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 367d36143adf465b950244c6baa620a5, State: Initialized, Role: FOLLOWER
I20260709 13:03:50.165943 12217 consensus_queue.cc:260] T d2a9a34c1be443a69f95f8f237dc4116 P 367d36143adf465b950244c6baa620a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:50.167104 12218 raft_consensus.cc:359] T 0fd34026fbe142c0898fd7ec29688648 P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:50.167876 12218 raft_consensus.cc:385] T 0fd34026fbe142c0898fd7ec29688648 P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:50.168386 12217 ts_tablet_manager.cc:1434] T d2a9a34c1be443a69f95f8f237dc4116 P 367d36143adf465b950244c6baa620a5: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 13:03:50.168427 12218 raft_consensus.cc:740] T 0fd34026fbe142c0898fd7ec29688648 P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd1c07cda9da4436b69174af3a1ce92f, State: Initialized, Role: FOLLOWER
I20260709 13:03:50.169818 12217 tablet_bootstrap.cc:492] T 175f2fe459f4455386cac7de26d34679 P 367d36143adf465b950244c6baa620a5: Bootstrap starting.
I20260709 13:03:50.169616 12218 consensus_queue.cc:260] T 0fd34026fbe142c0898fd7ec29688648 P bd1c07cda9da4436b69174af3a1ce92f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:50.172308 12218 ts_tablet_manager.cc:1434] T 0fd34026fbe142c0898fd7ec29688648 P bd1c07cda9da4436b69174af3a1ce92f: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:03:50.173381 12218 tablet_bootstrap.cc:492] T d2a9a34c1be443a69f95f8f237dc4116 P bd1c07cda9da4436b69174af3a1ce92f: Bootstrap starting.
I20260709 13:03:50.178014 12217 tablet_bootstrap.cc:654] T 175f2fe459f4455386cac7de26d34679 P 367d36143adf465b950244c6baa620a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:50.179461 12126 raft_consensus.cc:493] T b71ba69388bf42a88deaf32615d3b1b6 P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.186106 12126 raft_consensus.cc:515] T b71ba69388bf42a88deaf32615d3b1b6 P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:50.187093 12219 tablet_bootstrap.cc:492] T 13ef79ebfe4f45b9bd9763de63a3e15a P 8dfed99448174185ba5ece679e9d90be: No bootstrap required, opened a new log
I20260709 13:03:50.187103 11928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ac98551cc1c458e8e95be2e9f1ddeac" candidate_uuid: "367d36143adf465b950244c6baa620a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd1c07cda9da4436b69174af3a1ce92f"
I20260709 13:03:50.193356 11928 raft_consensus.cc:3060] T 0ac98551cc1c458e8e95be2e9f1ddeac P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:50.193434 12219 ts_tablet_manager.cc:1403] T 13ef79ebfe4f45b9bd9763de63a3e15a P 8dfed99448174185ba5ece679e9d90be: Time spent bootstrapping tablet: real 0.119s	user 0.023s	sys 0.029s
I20260709 13:03:50.194761 12002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b71ba69388bf42a88deaf32615d3b1b6" candidate_uuid: "8dfed99448174185ba5ece679e9d90be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "367d36143adf465b950244c6baa620a5" is_pre_election: true
I20260709 13:03:50.195348 12126 leader_election.cc:290] T b71ba69388bf42a88deaf32615d3b1b6 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131), 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337)
I20260709 13:03:50.195518 12002 raft_consensus.cc:2468] T b71ba69388bf42a88deaf32615d3b1b6 P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dfed99448174185ba5ece679e9d90be in term 0.
I20260709 13:03:50.189414 11929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b71ba69388bf42a88deaf32615d3b1b6" candidate_uuid: "8dfed99448174185ba5ece679e9d90be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd1c07cda9da4436b69174af3a1ce92f" is_pre_election: true
I20260709 13:03:50.196744 11929 raft_consensus.cc:2468] T b71ba69388bf42a88deaf32615d3b1b6 P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dfed99448174185ba5ece679e9d90be in term 0.
I20260709 13:03:50.196964 12042 leader_election.cc:304] T b71ba69388bf42a88deaf32615d3b1b6 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 367d36143adf465b950244c6baa620a5, 8dfed99448174185ba5ece679e9d90be; no voters: 
I20260709 13:03:50.197535 12219 raft_consensus.cc:359] T 13ef79ebfe4f45b9bd9763de63a3e15a P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:50.198139 12219 raft_consensus.cc:385] T 13ef79ebfe4f45b9bd9763de63a3e15a P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:50.198376 12219 raft_consensus.cc:740] T 13ef79ebfe4f45b9bd9763de63a3e15a P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dfed99448174185ba5ece679e9d90be, State: Initialized, Role: FOLLOWER
I20260709 13:03:50.167001 12223 raft_consensus.cc:2749] T b5d801f325be415db1d2961ed3876b90 P 367d36143adf465b950244c6baa620a5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:50.200793 12132 leader_election.cc:290] T 0ac98551cc1c458e8e95be2e9f1ddeac P 367d36143adf465b950244c6baa620a5 [CANDIDATE]: Term 1 election: Requested vote from peers bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131), 8dfed99448174185ba5ece679e9d90be (127.0.107.195:39279)
I20260709 13:03:50.202207 11928 raft_consensus.cc:2468] T 0ac98551cc1c458e8e95be2e9f1ddeac P bd1c07cda9da4436b69174af3a1ce92f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 367d36143adf465b950244c6baa620a5 in term 1.
I20260709 13:03:50.202435 12217 tablet_bootstrap.cc:492] T 175f2fe459f4455386cac7de26d34679 P 367d36143adf465b950244c6baa620a5: No bootstrap required, opened a new log
I20260709 13:03:50.203291 12217 ts_tablet_manager.cc:1403] T 175f2fe459f4455386cac7de26d34679 P 367d36143adf465b950244c6baa620a5: Time spent bootstrapping tablet: real 0.034s	user 0.012s	sys 0.014s
I20260709 13:03:50.203603 11969 leader_election.cc:304] T 0ac98551cc1c458e8e95be2e9f1ddeac P 367d36143adf465b950244c6baa620a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 367d36143adf465b950244c6baa620a5, bd1c07cda9da4436b69174af3a1ce92f; no voters: 
I20260709 13:03:50.204557 12132 raft_consensus.cc:2804] T 0ac98551cc1c458e8e95be2e9f1ddeac P 367d36143adf465b950244c6baa620a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:50.205099 12132 raft_consensus.cc:697] T 0ac98551cc1c458e8e95be2e9f1ddeac P 367d36143adf465b950244c6baa620a5 [term 1 LEADER]: Becoming Leader. State: Replica: 367d36143adf465b950244c6baa620a5, State: Running, Role: LEADER
I20260709 13:03:50.206694 12132 consensus_queue.cc:237] T 0ac98551cc1c458e8e95be2e9f1ddeac P 367d36143adf465b950244c6baa620a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:50.207376 12217 raft_consensus.cc:359] T 175f2fe459f4455386cac7de26d34679 P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:50.208139 12217 raft_consensus.cc:385] T 175f2fe459f4455386cac7de26d34679 P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:50.208036 12078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ac98551cc1c458e8e95be2e9f1ddeac" candidate_uuid: "367d36143adf465b950244c6baa620a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dfed99448174185ba5ece679e9d90be"
I20260709 13:03:50.208528 12217 raft_consensus.cc:740] T 175f2fe459f4455386cac7de26d34679 P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 367d36143adf465b950244c6baa620a5, State: Initialized, Role: FOLLOWER
I20260709 13:03:50.205061 12219 consensus_queue.cc:260] T 13ef79ebfe4f45b9bd9763de63a3e15a P 8dfed99448174185ba5ece679e9d90be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:50.209005 12078 raft_consensus.cc:3060] T 0ac98551cc1c458e8e95be2e9f1ddeac P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:50.209661 12237 raft_consensus.cc:2804] T b71ba69388bf42a88deaf32615d3b1b6 P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:50.209386 12217 consensus_queue.cc:260] T 175f2fe459f4455386cac7de26d34679 P 367d36143adf465b950244c6baa620a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:50.210067 12237 raft_consensus.cc:493] T b71ba69388bf42a88deaf32615d3b1b6 P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:50.210428 12237 raft_consensus.cc:3060] T b71ba69388bf42a88deaf32615d3b1b6 P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:50.211818 12217 ts_tablet_manager.cc:1434] T 175f2fe459f4455386cac7de26d34679 P 367d36143adf465b950244c6baa620a5: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:03:50.212934 12217 tablet_bootstrap.cc:492] T 93c0155ffb2b44fab1eed91e0025ef62 P 367d36143adf465b950244c6baa620a5: Bootstrap starting.
I20260709 13:03:50.215960 12078 raft_consensus.cc:2468] T 0ac98551cc1c458e8e95be2e9f1ddeac P 8dfed99448174185ba5ece679e9d90be [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 367d36143adf465b950244c6baa620a5 in term 1.
I20260709 13:03:50.219429 12217 tablet_bootstrap.cc:654] T 93c0155ffb2b44fab1eed91e0025ef62 P 367d36143adf465b950244c6baa620a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:50.221769 12219 ts_tablet_manager.cc:1434] T 13ef79ebfe4f45b9bd9763de63a3e15a P 8dfed99448174185ba5ece679e9d90be: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 13:03:50.222828 12223 raft_consensus.cc:493] T 65544e18a6944de89c1560f44aaf32ec P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.223474 12223 raft_consensus.cc:515] T 65544e18a6944de89c1560f44aaf32ec P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:50.218179 12237 raft_consensus.cc:515] T b71ba69388bf42a88deaf32615d3b1b6 P 8dfed99448174185ba5ece679e9d90be [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:50.195035 12218 tablet_bootstrap.cc:654] T d2a9a34c1be443a69f95f8f237dc4116 P bd1c07cda9da4436b69174af3a1ce92f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:50.229270 11928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65544e18a6944de89c1560f44aaf32ec" candidate_uuid: "367d36143adf465b950244c6baa620a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd1c07cda9da4436b69174af3a1ce92f" is_pre_election: true
I20260709 13:03:50.231256 12223 leader_election.cc:290] T 65544e18a6944de89c1560f44aaf32ec P 367d36143adf465b950244c6baa620a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131), 8dfed99448174185ba5ece679e9d90be (127.0.107.195:39279)
W20260709 13:03:50.233292 11969 leader_election.cc:343] T 65544e18a6944de89c1560f44aaf32ec P 367d36143adf465b950244c6baa620a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:50.233659 11929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b71ba69388bf42a88deaf32615d3b1b6" candidate_uuid: "8dfed99448174185ba5ece679e9d90be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd1c07cda9da4436b69174af3a1ce92f"
I20260709 13:03:50.234359 11929 raft_consensus.cc:3060] T b71ba69388bf42a88deaf32615d3b1b6 P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:50.237150 12219 tablet_bootstrap.cc:492] T 175f2fe459f4455386cac7de26d34679 P 8dfed99448174185ba5ece679e9d90be: Bootstrap starting.
I20260709 13:03:50.237984 12002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b71ba69388bf42a88deaf32615d3b1b6" candidate_uuid: "8dfed99448174185ba5ece679e9d90be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "367d36143adf465b950244c6baa620a5"
I20260709 13:03:50.239164 12002 raft_consensus.cc:3060] T b71ba69388bf42a88deaf32615d3b1b6 P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:50.242373 12217 tablet_bootstrap.cc:492] T 93c0155ffb2b44fab1eed91e0025ef62 P 367d36143adf465b950244c6baa620a5: No bootstrap required, opened a new log
I20260709 13:03:50.243036 12217 ts_tablet_manager.cc:1403] T 93c0155ffb2b44fab1eed91e0025ef62 P 367d36143adf465b950244c6baa620a5: Time spent bootstrapping tablet: real 0.030s	user 0.010s	sys 0.008s
I20260709 13:03:50.236732 12237 leader_election.cc:290] T b71ba69388bf42a88deaf32615d3b1b6 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 1 election: Requested vote from peers bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131), 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337)
I20260709 13:03:50.243875 12237 raft_consensus.cc:493] T 0fd34026fbe142c0898fd7ec29688648 P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.244305 12237 raft_consensus.cc:515] T 0fd34026fbe142c0898fd7ec29688648 P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:50.244364 11827 catalog_manager.cc:5697] T 0ac98551cc1c458e8e95be2e9f1ddeac P 367d36143adf465b950244c6baa620a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 367d36143adf465b950244c6baa620a5 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "367d36143adf465b950244c6baa620a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:50.246009 12219 tablet_bootstrap.cc:654] T 175f2fe459f4455386cac7de26d34679 P 8dfed99448174185ba5ece679e9d90be: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:50.245754 12217 raft_consensus.cc:359] T 93c0155ffb2b44fab1eed91e0025ef62 P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:50.246467 12217 raft_consensus.cc:385] T 93c0155ffb2b44fab1eed91e0025ef62 P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:50.246779 12217 raft_consensus.cc:740] T 93c0155ffb2b44fab1eed91e0025ef62 P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 367d36143adf465b950244c6baa620a5, State: Initialized, Role: FOLLOWER
I20260709 13:03:50.247833 12237 leader_election.cc:290] T 0fd34026fbe142c0898fd7ec29688648 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131), 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337)
I20260709 13:03:50.248092 12004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd34026fbe142c0898fd7ec29688648" candidate_uuid: "8dfed99448174185ba5ece679e9d90be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "367d36143adf465b950244c6baa620a5" is_pre_election: true
I20260709 13:03:50.248848 12004 raft_consensus.cc:2468] T 0fd34026fbe142c0898fd7ec29688648 P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dfed99448174185ba5ece679e9d90be in term 0.
I20260709 13:03:50.250320 12042 leader_election.cc:304] T 0fd34026fbe142c0898fd7ec29688648 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 367d36143adf465b950244c6baa620a5, 8dfed99448174185ba5ece679e9d90be; no voters: 
I20260709 13:03:50.251258 12002 raft_consensus.cc:2468] T b71ba69388bf42a88deaf32615d3b1b6 P 367d36143adf465b950244c6baa620a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dfed99448174185ba5ece679e9d90be in term 1.
I20260709 13:03:50.252592 12042 leader_election.cc:304] T b71ba69388bf42a88deaf32615d3b1b6 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 367d36143adf465b950244c6baa620a5, 8dfed99448174185ba5ece679e9d90be; no voters: 
I20260709 13:03:50.252956 11929 raft_consensus.cc:2468] T b71ba69388bf42a88deaf32615d3b1b6 P bd1c07cda9da4436b69174af3a1ce92f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dfed99448174185ba5ece679e9d90be in term 1.
I20260709 13:03:50.253829 12237 raft_consensus.cc:493] T 93c0155ffb2b44fab1eed91e0025ef62 P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.254513 12237 raft_consensus.cc:515] T 93c0155ffb2b44fab1eed91e0025ef62 P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:50.247459 12217 consensus_queue.cc:260] T 93c0155ffb2b44fab1eed91e0025ef62 P 367d36143adf465b950244c6baa620a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:50.257615 11929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0155ffb2b44fab1eed91e0025ef62" candidate_uuid: "8dfed99448174185ba5ece679e9d90be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd1c07cda9da4436b69174af3a1ce92f" is_pre_election: true
I20260709 13:03:50.257788 12237 leader_election.cc:290] T 93c0155ffb2b44fab1eed91e0025ef62 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131), 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337)
I20260709 13:03:50.256392 12217 ts_tablet_manager.cc:1434] T 93c0155ffb2b44fab1eed91e0025ef62 P 367d36143adf465b950244c6baa620a5: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:03:50.259303 12237 raft_consensus.cc:2804] T 0fd34026fbe142c0898fd7ec29688648 P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:50.259688 12237 raft_consensus.cc:493] T 0fd34026fbe142c0898fd7ec29688648 P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:50.258562 11929 raft_consensus.cc:2468] T 93c0155ffb2b44fab1eed91e0025ef62 P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dfed99448174185ba5ece679e9d90be in term 0.
I20260709 13:03:50.236605 12078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65544e18a6944de89c1560f44aaf32ec" candidate_uuid: "367d36143adf465b950244c6baa620a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dfed99448174185ba5ece679e9d90be" is_pre_election: true
I20260709 13:03:50.261463 12043 leader_election.cc:304] T 93c0155ffb2b44fab1eed91e0025ef62 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dfed99448174185ba5ece679e9d90be, bd1c07cda9da4436b69174af3a1ce92f; no voters: 
W20260709 13:03:50.262002 11968 leader_election.cc:343] T 65544e18a6944de89c1560f44aaf32ec P 367d36143adf465b950244c6baa620a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dfed99448174185ba5ece679e9d90be (127.0.107.195:39279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:50.262544 11968 leader_election.cc:304] T 65544e18a6944de89c1560f44aaf32ec P 367d36143adf465b950244c6baa620a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 367d36143adf465b950244c6baa620a5; no voters: 8dfed99448174185ba5ece679e9d90be, bd1c07cda9da4436b69174af3a1ce92f
I20260709 13:03:50.263361 12223 raft_consensus.cc:2749] T 65544e18a6944de89c1560f44aaf32ec P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:50.260068 12217 tablet_bootstrap.cc:492] T 13ef79ebfe4f45b9bd9763de63a3e15a P 367d36143adf465b950244c6baa620a5: Bootstrap starting.
I20260709 13:03:50.260017 12237 raft_consensus.cc:3060] T 0fd34026fbe142c0898fd7ec29688648 P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:50.251484 11928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd34026fbe142c0898fd7ec29688648" candidate_uuid: "8dfed99448174185ba5ece679e9d90be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd1c07cda9da4436b69174af3a1ce92f" is_pre_election: true
I20260709 13:03:50.265643 12219 tablet_bootstrap.cc:492] T 175f2fe459f4455386cac7de26d34679 P 8dfed99448174185ba5ece679e9d90be: No bootstrap required, opened a new log
I20260709 13:03:50.266197 11928 raft_consensus.cc:2468] T 0fd34026fbe142c0898fd7ec29688648 P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dfed99448174185ba5ece679e9d90be in term 0.
I20260709 13:03:50.266290 12219 ts_tablet_manager.cc:1403] T 175f2fe459f4455386cac7de26d34679 P 8dfed99448174185ba5ece679e9d90be: Time spent bootstrapping tablet: real 0.029s	user 0.013s	sys 0.011s
I20260709 13:03:50.270303 12217 tablet_bootstrap.cc:654] T 13ef79ebfe4f45b9bd9763de63a3e15a P 367d36143adf465b950244c6baa620a5: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:50.271005 12126 raft_consensus.cc:2804] T b71ba69388bf42a88deaf32615d3b1b6 P 8dfed99448174185ba5ece679e9d90be [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:50.271581 12126 raft_consensus.cc:697] T b71ba69388bf42a88deaf32615d3b1b6 P 8dfed99448174185ba5ece679e9d90be [term 1 LEADER]: Becoming Leader. State: Replica: 8dfed99448174185ba5ece679e9d90be, State: Running, Role: LEADER
I20260709 13:03:50.272413 12126 consensus_queue.cc:237] T b71ba69388bf42a88deaf32615d3b1b6 P 8dfed99448174185ba5ece679e9d90be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:50.273314 12247 raft_consensus.cc:2804] T 93c0155ffb2b44fab1eed91e0025ef62 P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:50.275871 12219 raft_consensus.cc:359] T 175f2fe459f4455386cac7de26d34679 P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:50.279683 12219 raft_consensus.cc:385] T 175f2fe459f4455386cac7de26d34679 P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:50.279520 12247 raft_consensus.cc:493] T 93c0155ffb2b44fab1eed91e0025ef62 P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:50.280054 12219 raft_consensus.cc:740] T 175f2fe459f4455386cac7de26d34679 P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dfed99448174185ba5ece679e9d90be, State: Initialized, Role: FOLLOWER
I20260709 13:03:50.281431 12002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0155ffb2b44fab1eed91e0025ef62" candidate_uuid: "8dfed99448174185ba5ece679e9d90be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "367d36143adf465b950244c6baa620a5" is_pre_election: true
I20260709 13:03:50.280843 12247 raft_consensus.cc:3060] T 93c0155ffb2b44fab1eed91e0025ef62 P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:50.282009 12217 tablet_bootstrap.cc:492] T 13ef79ebfe4f45b9bd9763de63a3e15a P 367d36143adf465b950244c6baa620a5: No bootstrap required, opened a new log
I20260709 13:03:50.283017 12217 ts_tablet_manager.cc:1403] T 13ef79ebfe4f45b9bd9763de63a3e15a P 367d36143adf465b950244c6baa620a5: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.008s
I20260709 13:03:50.285200 12218 tablet_bootstrap.cc:492] T d2a9a34c1be443a69f95f8f237dc4116 P bd1c07cda9da4436b69174af3a1ce92f: No bootstrap required, opened a new log
I20260709 13:03:50.284847 12237 raft_consensus.cc:515] T 0fd34026fbe142c0898fd7ec29688648 P 8dfed99448174185ba5ece679e9d90be [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:50.285737 12218 ts_tablet_manager.cc:1403] T d2a9a34c1be443a69f95f8f237dc4116 P bd1c07cda9da4436b69174af3a1ce92f: Time spent bootstrapping tablet: real 0.113s	user 0.012s	sys 0.000s
I20260709 13:03:50.281733 12219 consensus_queue.cc:260] T 175f2fe459f4455386cac7de26d34679 P 8dfed99448174185ba5ece679e9d90be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:50.282078 12002 raft_consensus.cc:2468] T 93c0155ffb2b44fab1eed91e0025ef62 P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dfed99448174185ba5ece679e9d90be in term 0.
I20260709 13:03:50.285863 12217 raft_consensus.cc:359] T 13ef79ebfe4f45b9bd9763de63a3e15a P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:50.289719 12217 raft_consensus.cc:385] T 13ef79ebfe4f45b9bd9763de63a3e15a P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:50.290017 12217 raft_consensus.cc:740] T 13ef79ebfe4f45b9bd9763de63a3e15a P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 367d36143adf465b950244c6baa620a5, State: Initialized, Role: FOLLOWER
I20260709 13:03:50.290449 12219 ts_tablet_manager.cc:1434] T 175f2fe459f4455386cac7de26d34679 P 8dfed99448174185ba5ece679e9d90be: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.002s
I20260709 13:03:50.290815 11928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd34026fbe142c0898fd7ec29688648" candidate_uuid: "8dfed99448174185ba5ece679e9d90be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd1c07cda9da4436b69174af3a1ce92f"
I20260709 13:03:50.291110 12002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd34026fbe142c0898fd7ec29688648" candidate_uuid: "8dfed99448174185ba5ece679e9d90be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "367d36143adf465b950244c6baa620a5"
I20260709 13:03:50.290788 12217 consensus_queue.cc:260] T 13ef79ebfe4f45b9bd9763de63a3e15a P 367d36143adf465b950244c6baa620a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:50.290028 12237 leader_election.cc:290] T 0fd34026fbe142c0898fd7ec29688648 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 1 election: Requested vote from peers bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131), 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337)
I20260709 13:03:50.291819 12002 raft_consensus.cc:3060] T 0fd34026fbe142c0898fd7ec29688648 P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:50.292490 12219 tablet_bootstrap.cc:492] T d2a9a34c1be443a69f95f8f237dc4116 P 8dfed99448174185ba5ece679e9d90be: Bootstrap starting.
I20260709 13:03:50.293350 12217 ts_tablet_manager.cc:1434] T 13ef79ebfe4f45b9bd9763de63a3e15a P 367d36143adf465b950244c6baa620a5: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:03:50.291628 11928 raft_consensus.cc:3060] T 0fd34026fbe142c0898fd7ec29688648 P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:50.298631 12002 raft_consensus.cc:2468] T 0fd34026fbe142c0898fd7ec29688648 P 367d36143adf465b950244c6baa620a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dfed99448174185ba5ece679e9d90be in term 1.
I20260709 13:03:50.299561 12219 tablet_bootstrap.cc:654] T d2a9a34c1be443a69f95f8f237dc4116 P 8dfed99448174185ba5ece679e9d90be: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:50.300978 12218 raft_consensus.cc:359] T d2a9a34c1be443a69f95f8f237dc4116 P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:50.301695 12218 raft_consensus.cc:385] T d2a9a34c1be443a69f95f8f237dc4116 P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:50.301944 12218 raft_consensus.cc:740] T d2a9a34c1be443a69f95f8f237dc4116 P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd1c07cda9da4436b69174af3a1ce92f, State: Initialized, Role: FOLLOWER
I20260709 13:03:50.302696 12218 consensus_queue.cc:260] T d2a9a34c1be443a69f95f8f237dc4116 P bd1c07cda9da4436b69174af3a1ce92f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:50.303982 12042 leader_election.cc:304] T 0fd34026fbe142c0898fd7ec29688648 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 367d36143adf465b950244c6baa620a5, 8dfed99448174185ba5ece679e9d90be; no voters: 
I20260709 13:03:50.304895 12237 raft_consensus.cc:2804] T 0fd34026fbe142c0898fd7ec29688648 P 8dfed99448174185ba5ece679e9d90be [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:50.305358 12237 raft_consensus.cc:697] T 0fd34026fbe142c0898fd7ec29688648 P 8dfed99448174185ba5ece679e9d90be [term 1 LEADER]: Becoming Leader. State: Replica: 8dfed99448174185ba5ece679e9d90be, State: Running, Role: LEADER
I20260709 13:03:50.312417 12247 raft_consensus.cc:515] T 93c0155ffb2b44fab1eed91e0025ef62 P 8dfed99448174185ba5ece679e9d90be [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:50.328016 12223 raft_consensus.cc:493] T 175f2fe459f4455386cac7de26d34679 P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.328667 12223 raft_consensus.cc:515] T 175f2fe459f4455386cac7de26d34679 P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:50.332232 12002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0155ffb2b44fab1eed91e0025ef62" candidate_uuid: "8dfed99448174185ba5ece679e9d90be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "367d36143adf465b950244c6baa620a5"
I20260709 13:03:50.357434 12219 tablet_bootstrap.cc:492] T d2a9a34c1be443a69f95f8f237dc4116 P 8dfed99448174185ba5ece679e9d90be: No bootstrap required, opened a new log
I20260709 13:03:50.358961 12219 ts_tablet_manager.cc:1403] T d2a9a34c1be443a69f95f8f237dc4116 P 8dfed99448174185ba5ece679e9d90be: Time spent bootstrapping tablet: real 0.068s	user 0.030s	sys 0.035s
I20260709 13:03:50.359076 11928 raft_consensus.cc:2468] T 0fd34026fbe142c0898fd7ec29688648 P bd1c07cda9da4436b69174af3a1ce92f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dfed99448174185ba5ece679e9d90be in term 1.
I20260709 13:03:50.332947 12247 leader_election.cc:290] T 93c0155ffb2b44fab1eed91e0025ef62 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 1 election: Requested vote from peers bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131), 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337)
I20260709 13:03:50.333034 12002 raft_consensus.cc:3060] T 93c0155ffb2b44fab1eed91e0025ef62 P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:50.362423 12223 leader_election.cc:290] T 175f2fe459f4455386cac7de26d34679 P 367d36143adf465b950244c6baa620a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131), 8dfed99448174185ba5ece679e9d90be (127.0.107.195:39279)
I20260709 13:03:50.363646 12219 raft_consensus.cc:359] T d2a9a34c1be443a69f95f8f237dc4116 P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:50.364399 12219 raft_consensus.cc:385] T d2a9a34c1be443a69f95f8f237dc4116 P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:50.364676 12219 raft_consensus.cc:740] T d2a9a34c1be443a69f95f8f237dc4116 P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dfed99448174185ba5ece679e9d90be, State: Initialized, Role: FOLLOWER
I20260709 13:03:50.365427 12078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "175f2fe459f4455386cac7de26d34679" candidate_uuid: "367d36143adf465b950244c6baa620a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dfed99448174185ba5ece679e9d90be" is_pre_election: true
I20260709 13:03:50.365346 12219 consensus_queue.cc:260] T d2a9a34c1be443a69f95f8f237dc4116 P 8dfed99448174185ba5ece679e9d90be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:50.365959 12126 raft_consensus.cc:493] T 175f2fe459f4455386cac7de26d34679 P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.368116 12218 ts_tablet_manager.cc:1434] T d2a9a34c1be443a69f95f8f237dc4116 P bd1c07cda9da4436b69174af3a1ce92f: Time spent starting tablet: real 0.082s	user 0.005s	sys 0.000s
I20260709 13:03:50.369097 12218 tablet_bootstrap.cc:492] T 65544e18a6944de89c1560f44aaf32ec P bd1c07cda9da4436b69174af3a1ce92f: Bootstrap starting.
I20260709 13:03:50.369575 12002 raft_consensus.cc:2468] T 93c0155ffb2b44fab1eed91e0025ef62 P 367d36143adf465b950244c6baa620a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dfed99448174185ba5ece679e9d90be in term 1.
I20260709 13:03:50.371040 12042 leader_election.cc:304] T 93c0155ffb2b44fab1eed91e0025ef62 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 367d36143adf465b950244c6baa620a5, 8dfed99448174185ba5ece679e9d90be; no voters: 
I20260709 13:03:50.371974 12247 raft_consensus.cc:2804] T 93c0155ffb2b44fab1eed91e0025ef62 P 8dfed99448174185ba5ece679e9d90be [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:50.372499 12247 raft_consensus.cc:697] T 93c0155ffb2b44fab1eed91e0025ef62 P 8dfed99448174185ba5ece679e9d90be [term 1 LEADER]: Becoming Leader. State: Replica: 8dfed99448174185ba5ece679e9d90be, State: Running, Role: LEADER
I20260709 13:03:50.366479 12126 raft_consensus.cc:515] T 175f2fe459f4455386cac7de26d34679 P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:50.374740 12078 raft_consensus.cc:2468] T 175f2fe459f4455386cac7de26d34679 P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 367d36143adf465b950244c6baa620a5 in term 0.
I20260709 13:03:50.362170 12237 consensus_queue.cc:237] T 0fd34026fbe142c0898fd7ec29688648 P 8dfed99448174185ba5ece679e9d90be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:50.376295 12247 consensus_queue.cc:237] T 93c0155ffb2b44fab1eed91e0025ef62 P 8dfed99448174185ba5ece679e9d90be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:50.377022 12219 ts_tablet_manager.cc:1434] T d2a9a34c1be443a69f95f8f237dc4116 P 8dfed99448174185ba5ece679e9d90be: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.008s
I20260709 13:03:50.377588 11968 leader_election.cc:304] T 175f2fe459f4455386cac7de26d34679 P 367d36143adf465b950244c6baa620a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 367d36143adf465b950244c6baa620a5, 8dfed99448174185ba5ece679e9d90be; no voters: 
I20260709 13:03:50.378250 12219 tablet_bootstrap.cc:492] T 65544e18a6944de89c1560f44aaf32ec P 8dfed99448174185ba5ece679e9d90be: Bootstrap starting.
I20260709 13:03:50.378551 12223 raft_consensus.cc:2804] T 175f2fe459f4455386cac7de26d34679 P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:50.379007 12223 raft_consensus.cc:493] T 175f2fe459f4455386cac7de26d34679 P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:50.379374 12223 raft_consensus.cc:3060] T 175f2fe459f4455386cac7de26d34679 P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:50.381556 11929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0155ffb2b44fab1eed91e0025ef62" candidate_uuid: "8dfed99448174185ba5ece679e9d90be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd1c07cda9da4436b69174af3a1ce92f"
I20260709 13:03:50.381870 11928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "175f2fe459f4455386cac7de26d34679" candidate_uuid: "367d36143adf465b950244c6baa620a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd1c07cda9da4436b69174af3a1ce92f" is_pre_election: true
I20260709 13:03:50.382221 11929 raft_consensus.cc:3060] T 93c0155ffb2b44fab1eed91e0025ef62 P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:50.382647 11928 raft_consensus.cc:2468] T 175f2fe459f4455386cac7de26d34679 P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 367d36143adf465b950244c6baa620a5 in term 0.
I20260709 13:03:50.386646 12219 tablet_bootstrap.cc:654] T 65544e18a6944de89c1560f44aaf32ec P 8dfed99448174185ba5ece679e9d90be: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:50.397691 12218 tablet_bootstrap.cc:654] T 65544e18a6944de89c1560f44aaf32ec P bd1c07cda9da4436b69174af3a1ce92f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:50.403779 12223 raft_consensus.cc:515] T 175f2fe459f4455386cac7de26d34679 P 367d36143adf465b950244c6baa620a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:50.406912 11928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "175f2fe459f4455386cac7de26d34679" candidate_uuid: "8dfed99448174185ba5ece679e9d90be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd1c07cda9da4436b69174af3a1ce92f" is_pre_election: true
I20260709 13:03:50.407361 12004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "175f2fe459f4455386cac7de26d34679" candidate_uuid: "8dfed99448174185ba5ece679e9d90be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "367d36143adf465b950244c6baa620a5" is_pre_election: true
I20260709 13:03:50.405750 12126 leader_election.cc:290] T 175f2fe459f4455386cac7de26d34679 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131), 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337)
I20260709 13:03:50.409787 12219 tablet_bootstrap.cc:492] T 65544e18a6944de89c1560f44aaf32ec P 8dfed99448174185ba5ece679e9d90be: No bootstrap required, opened a new log
I20260709 13:03:50.410158 12004 raft_consensus.cc:2393] T 175f2fe459f4455386cac7de26d34679 P 367d36143adf465b950244c6baa620a5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dfed99448174185ba5ece679e9d90be in current term 1: Already voted for candidate 367d36143adf465b950244c6baa620a5 in this term.
I20260709 13:03:50.408159 11929 raft_consensus.cc:2468] T 93c0155ffb2b44fab1eed91e0025ef62 P bd1c07cda9da4436b69174af3a1ce92f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dfed99448174185ba5ece679e9d90be in term 1.
I20260709 13:03:50.411067 12223 leader_election.cc:290] T 175f2fe459f4455386cac7de26d34679 P 367d36143adf465b950244c6baa620a5 [CANDIDATE]: Term 1 election: Requested vote from peers bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131), 8dfed99448174185ba5ece679e9d90be (127.0.107.195:39279)
I20260709 13:03:50.410318 12219 ts_tablet_manager.cc:1403] T 65544e18a6944de89c1560f44aaf32ec P 8dfed99448174185ba5ece679e9d90be: Time spent bootstrapping tablet: real 0.032s	user 0.013s	sys 0.007s
I20260709 13:03:50.412989 12078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "175f2fe459f4455386cac7de26d34679" candidate_uuid: "367d36143adf465b950244c6baa620a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dfed99448174185ba5ece679e9d90be"
I20260709 13:03:50.413573 12078 raft_consensus.cc:3060] T 175f2fe459f4455386cac7de26d34679 P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:50.415411 12219 raft_consensus.cc:359] T 65544e18a6944de89c1560f44aaf32ec P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:50.416246 12219 raft_consensus.cc:385] T 65544e18a6944de89c1560f44aaf32ec P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:50.416509 12219 raft_consensus.cc:740] T 65544e18a6944de89c1560f44aaf32ec P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dfed99448174185ba5ece679e9d90be, State: Initialized, Role: FOLLOWER
I20260709 13:03:50.409861 11928 raft_consensus.cc:2468] T 175f2fe459f4455386cac7de26d34679 P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dfed99448174185ba5ece679e9d90be in term 0.
I20260709 13:03:50.418351 11929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "175f2fe459f4455386cac7de26d34679" candidate_uuid: "367d36143adf465b950244c6baa620a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd1c07cda9da4436b69174af3a1ce92f"
I20260709 13:03:50.419574 12043 leader_election.cc:304] T 175f2fe459f4455386cac7de26d34679 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dfed99448174185ba5ece679e9d90be, bd1c07cda9da4436b69174af3a1ce92f; no voters: 367d36143adf465b950244c6baa620a5
I20260709 13:03:50.421273 11929 raft_consensus.cc:3060] T 175f2fe459f4455386cac7de26d34679 P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:50.422353 12078 raft_consensus.cc:2468] T 175f2fe459f4455386cac7de26d34679 P 8dfed99448174185ba5ece679e9d90be [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 367d36143adf465b950244c6baa620a5 in term 1.
I20260709 13:03:50.421386 12254 raft_consensus.cc:493] T d2a9a34c1be443a69f95f8f237dc4116 P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.423404 12254 raft_consensus.cc:515] T d2a9a34c1be443a69f95f8f237dc4116 P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:50.426935 11928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2a9a34c1be443a69f95f8f237dc4116" candidate_uuid: "8dfed99448174185ba5ece679e9d90be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd1c07cda9da4436b69174af3a1ce92f" is_pre_election: true
I20260709 13:03:50.427132 12004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2a9a34c1be443a69f95f8f237dc4116" candidate_uuid: "8dfed99448174185ba5ece679e9d90be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "367d36143adf465b950244c6baa620a5" is_pre_election: true
I20260709 13:03:50.427675 11928 raft_consensus.cc:2468] T d2a9a34c1be443a69f95f8f237dc4116 P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dfed99448174185ba5ece679e9d90be in term 0.
I20260709 13:03:50.428190 12004 raft_consensus.cc:2468] T d2a9a34c1be443a69f95f8f237dc4116 P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dfed99448174185ba5ece679e9d90be in term 0.
I20260709 13:03:50.429160 12043 leader_election.cc:304] T d2a9a34c1be443a69f95f8f237dc4116 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dfed99448174185ba5ece679e9d90be, bd1c07cda9da4436b69174af3a1ce92f; no voters: 
I20260709 13:03:50.430409 12250 raft_consensus.cc:2804] T d2a9a34c1be443a69f95f8f237dc4116 P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:50.430873 12250 raft_consensus.cc:493] T d2a9a34c1be443a69f95f8f237dc4116 P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:50.431174 12250 raft_consensus.cc:3060] T d2a9a34c1be443a69f95f8f237dc4116 P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:50.417224 12219 consensus_queue.cc:260] T 65544e18a6944de89c1560f44aaf32ec P 8dfed99448174185ba5ece679e9d90be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:50.429811 12254 leader_election.cc:290] T d2a9a34c1be443a69f95f8f237dc4116 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131), 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337)
I20260709 13:03:50.435322 11929 raft_consensus.cc:2468] T 175f2fe459f4455386cac7de26d34679 P bd1c07cda9da4436b69174af3a1ce92f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 367d36143adf465b950244c6baa620a5 in term 1.
I20260709 13:03:50.435988 12237 raft_consensus.cc:2764] T 175f2fe459f4455386cac7de26d34679 P 8dfed99448174185ba5ece679e9d90be [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:03:50.436522 11969 leader_election.cc:304] T 175f2fe459f4455386cac7de26d34679 P 367d36143adf465b950244c6baa620a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 367d36143adf465b950244c6baa620a5, bd1c07cda9da4436b69174af3a1ce92f; no voters: 
I20260709 13:03:50.437021 12218 tablet_bootstrap.cc:492] T 65544e18a6944de89c1560f44aaf32ec P bd1c07cda9da4436b69174af3a1ce92f: No bootstrap required, opened a new log
I20260709 13:03:50.437520 12218 ts_tablet_manager.cc:1403] T 65544e18a6944de89c1560f44aaf32ec P bd1c07cda9da4436b69174af3a1ce92f: Time spent bootstrapping tablet: real 0.069s	user 0.018s	sys 0.014s
I20260709 13:03:50.437575 12223 raft_consensus.cc:2804] T 175f2fe459f4455386cac7de26d34679 P 367d36143adf465b950244c6baa620a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:50.437994 12219 ts_tablet_manager.cc:1434] T 65544e18a6944de89c1560f44aaf32ec P 8dfed99448174185ba5ece679e9d90be: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.001s
I20260709 13:03:50.438138 12223 raft_consensus.cc:697] T 175f2fe459f4455386cac7de26d34679 P 367d36143adf465b950244c6baa620a5 [term 1 LEADER]: Becoming Leader. State: Replica: 367d36143adf465b950244c6baa620a5, State: Running, Role: LEADER
I20260709 13:03:50.439095 12223 consensus_queue.cc:237] T 175f2fe459f4455386cac7de26d34679 P 367d36143adf465b950244c6baa620a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:50.440107 12218 raft_consensus.cc:359] T 65544e18a6944de89c1560f44aaf32ec P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:50.440706 12218 raft_consensus.cc:385] T 65544e18a6944de89c1560f44aaf32ec P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:50.440899 12218 raft_consensus.cc:740] T 65544e18a6944de89c1560f44aaf32ec P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd1c07cda9da4436b69174af3a1ce92f, State: Initialized, Role: FOLLOWER
I20260709 13:03:50.441447 12218 consensus_queue.cc:260] T 65544e18a6944de89c1560f44aaf32ec P bd1c07cda9da4436b69174af3a1ce92f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:50.443048 12218 ts_tablet_manager.cc:1434] T 65544e18a6944de89c1560f44aaf32ec P bd1c07cda9da4436b69174af3a1ce92f: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:03:50.445310 12250 raft_consensus.cc:515] T d2a9a34c1be443a69f95f8f237dc4116 P 8dfed99448174185ba5ece679e9d90be [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:50.448877 12250 leader_election.cc:290] T d2a9a34c1be443a69f95f8f237dc4116 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 1 election: Requested vote from peers bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131), 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337)
I20260709 13:03:50.449692 11929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2a9a34c1be443a69f95f8f237dc4116" candidate_uuid: "8dfed99448174185ba5ece679e9d90be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd1c07cda9da4436b69174af3a1ce92f"
I20260709 13:03:50.449965 12004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2a9a34c1be443a69f95f8f237dc4116" candidate_uuid: "8dfed99448174185ba5ece679e9d90be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "367d36143adf465b950244c6baa620a5"
I20260709 13:03:50.450542 12004 raft_consensus.cc:3060] T d2a9a34c1be443a69f95f8f237dc4116 P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:50.450836 11929 raft_consensus.cc:3060] T d2a9a34c1be443a69f95f8f237dc4116 P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:50.456907 11827 catalog_manager.cc:5697] T b71ba69388bf42a88deaf32615d3b1b6 P 8dfed99448174185ba5ece679e9d90be reported cstate change: term changed from 0 to 1, leader changed from <none> to 8dfed99448174185ba5ece679e9d90be (127.0.107.195). New cstate: current_term: 1 leader_uuid: "8dfed99448174185ba5ece679e9d90be" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:50.458101 11929 raft_consensus.cc:2468] T d2a9a34c1be443a69f95f8f237dc4116 P bd1c07cda9da4436b69174af3a1ce92f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dfed99448174185ba5ece679e9d90be in term 1.
I20260709 13:03:50.458636 11827 catalog_manager.cc:5697] T 0fd34026fbe142c0898fd7ec29688648 P 8dfed99448174185ba5ece679e9d90be reported cstate change: term changed from 0 to 1, leader changed from <none> to 8dfed99448174185ba5ece679e9d90be (127.0.107.195). New cstate: current_term: 1 leader_uuid: "8dfed99448174185ba5ece679e9d90be" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:50.459513 12043 leader_election.cc:304] T d2a9a34c1be443a69f95f8f237dc4116 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dfed99448174185ba5ece679e9d90be, bd1c07cda9da4436b69174af3a1ce92f; no voters: 
I20260709 13:03:50.460507 12250 raft_consensus.cc:2804] T d2a9a34c1be443a69f95f8f237dc4116 P 8dfed99448174185ba5ece679e9d90be [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:50.461087 12250 raft_consensus.cc:697] T d2a9a34c1be443a69f95f8f237dc4116 P 8dfed99448174185ba5ece679e9d90be [term 1 LEADER]: Becoming Leader. State: Replica: 8dfed99448174185ba5ece679e9d90be, State: Running, Role: LEADER
I20260709 13:03:50.460899 11827 catalog_manager.cc:5697] T 93c0155ffb2b44fab1eed91e0025ef62 P 8dfed99448174185ba5ece679e9d90be reported cstate change: term changed from 0 to 1, leader changed from <none> to 8dfed99448174185ba5ece679e9d90be (127.0.107.195). New cstate: current_term: 1 leader_uuid: "8dfed99448174185ba5ece679e9d90be" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:50.462019 12250 consensus_queue.cc:237] T d2a9a34c1be443a69f95f8f237dc4116 P 8dfed99448174185ba5ece679e9d90be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:50.463510 12004 raft_consensus.cc:2468] T d2a9a34c1be443a69f95f8f237dc4116 P 367d36143adf465b950244c6baa620a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dfed99448174185ba5ece679e9d90be in term 1.
I20260709 13:03:50.472379 11826 catalog_manager.cc:5697] T 175f2fe459f4455386cac7de26d34679 P 367d36143adf465b950244c6baa620a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 367d36143adf465b950244c6baa620a5 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "367d36143adf465b950244c6baa620a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:50.478855 11827 catalog_manager.cc:5697] T d2a9a34c1be443a69f95f8f237dc4116 P 8dfed99448174185ba5ece679e9d90be reported cstate change: term changed from 0 to 1, leader changed from <none> to 8dfed99448174185ba5ece679e9d90be (127.0.107.195). New cstate: current_term: 1 leader_uuid: "8dfed99448174185ba5ece679e9d90be" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:50.511830 12250 consensus_queue.cc:1048] T b5d801f325be415db1d2961ed3876b90 P 8dfed99448174185ba5ece679e9d90be [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:50.513947 12223 raft_consensus.cc:493] T 13ef79ebfe4f45b9bd9763de63a3e15a P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.514894 12223 raft_consensus.cc:515] T 13ef79ebfe4f45b9bd9763de63a3e15a P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:50.518899 11928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ef79ebfe4f45b9bd9763de63a3e15a" candidate_uuid: "367d36143adf465b950244c6baa620a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd1c07cda9da4436b69174af3a1ce92f" is_pre_election: true
I20260709 13:03:50.519315 12078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ef79ebfe4f45b9bd9763de63a3e15a" candidate_uuid: "367d36143adf465b950244c6baa620a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dfed99448174185ba5ece679e9d90be" is_pre_election: true
I20260709 13:03:50.519529 11928 raft_consensus.cc:2468] T 13ef79ebfe4f45b9bd9763de63a3e15a P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 367d36143adf465b950244c6baa620a5 in term 0.
I20260709 13:03:50.525071 12078 raft_consensus.cc:2468] T 13ef79ebfe4f45b9bd9763de63a3e15a P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 367d36143adf465b950244c6baa620a5 in term 0.
I20260709 13:03:50.526087 11968 leader_election.cc:304] T 13ef79ebfe4f45b9bd9763de63a3e15a P 367d36143adf465b950244c6baa620a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 367d36143adf465b950244c6baa620a5, 8dfed99448174185ba5ece679e9d90be; no voters: 
I20260709 13:03:50.526420 12223 leader_election.cc:290] T 13ef79ebfe4f45b9bd9763de63a3e15a P 367d36143adf465b950244c6baa620a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131), 8dfed99448174185ba5ece679e9d90be (127.0.107.195:39279)
I20260709 13:03:50.527061 12132 raft_consensus.cc:2804] T 13ef79ebfe4f45b9bd9763de63a3e15a P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:50.527451 12132 raft_consensus.cc:493] T 13ef79ebfe4f45b9bd9763de63a3e15a P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:50.527783 12132 raft_consensus.cc:3060] T 13ef79ebfe4f45b9bd9763de63a3e15a P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:50.534422 12250 consensus_queue.cc:1048] T b5d801f325be415db1d2961ed3876b90 P 8dfed99448174185ba5ece679e9d90be [LEADER]: Connected to new peer: Peer: permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:50.535198 12132 raft_consensus.cc:515] T 13ef79ebfe4f45b9bd9763de63a3e15a P 367d36143adf465b950244c6baa620a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:50.537976 11929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ef79ebfe4f45b9bd9763de63a3e15a" candidate_uuid: "367d36143adf465b950244c6baa620a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd1c07cda9da4436b69174af3a1ce92f"
I20260709 13:03:50.538305 12132 leader_election.cc:290] T 13ef79ebfe4f45b9bd9763de63a3e15a P 367d36143adf465b950244c6baa620a5 [CANDIDATE]: Term 1 election: Requested vote from peers bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131), 8dfed99448174185ba5ece679e9d90be (127.0.107.195:39279)
I20260709 13:03:50.538180 12078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ef79ebfe4f45b9bd9763de63a3e15a" candidate_uuid: "367d36143adf465b950244c6baa620a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dfed99448174185ba5ece679e9d90be"
I20260709 13:03:50.538823 11929 raft_consensus.cc:3060] T 13ef79ebfe4f45b9bd9763de63a3e15a P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:50.539065 12078 raft_consensus.cc:3060] T 13ef79ebfe4f45b9bd9763de63a3e15a P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:50.545269 12078 raft_consensus.cc:2468] T 13ef79ebfe4f45b9bd9763de63a3e15a P 8dfed99448174185ba5ece679e9d90be [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 367d36143adf465b950244c6baa620a5 in term 1.
I20260709 13:03:50.546276 11968 leader_election.cc:304] T 13ef79ebfe4f45b9bd9763de63a3e15a P 367d36143adf465b950244c6baa620a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 367d36143adf465b950244c6baa620a5, 8dfed99448174185ba5ece679e9d90be; no voters: 
I20260709 13:03:50.547137 12132 raft_consensus.cc:2804] T 13ef79ebfe4f45b9bd9763de63a3e15a P 367d36143adf465b950244c6baa620a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:50.546335 11929 raft_consensus.cc:2468] T 13ef79ebfe4f45b9bd9763de63a3e15a P bd1c07cda9da4436b69174af3a1ce92f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 367d36143adf465b950244c6baa620a5 in term 1.
I20260709 13:03:50.547602 12132 raft_consensus.cc:697] T 13ef79ebfe4f45b9bd9763de63a3e15a P 367d36143adf465b950244c6baa620a5 [term 1 LEADER]: Becoming Leader. State: Replica: 367d36143adf465b950244c6baa620a5, State: Running, Role: LEADER
I20260709 13:03:50.548446 12132 consensus_queue.cc:237] T 13ef79ebfe4f45b9bd9763de63a3e15a P 367d36143adf465b950244c6baa620a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:50.558148 11826 catalog_manager.cc:5697] T 13ef79ebfe4f45b9bd9763de63a3e15a P 367d36143adf465b950244c6baa620a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 367d36143adf465b950244c6baa620a5 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "367d36143adf465b950244c6baa620a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:50.601594 12132 consensus_queue.cc:1048] T 0ac98551cc1c458e8e95be2e9f1ddeac P 367d36143adf465b950244c6baa620a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:50.612155 12268 consensus_queue.cc:1048] T 0ac98551cc1c458e8e95be2e9f1ddeac P 367d36143adf465b950244c6baa620a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:50.614166 12239 raft_consensus.cc:493] T 65544e18a6944de89c1560f44aaf32ec P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.614722 12239 raft_consensus.cc:515] T 65544e18a6944de89c1560f44aaf32ec P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:50.616915 12239 leader_election.cc:290] T 65544e18a6944de89c1560f44aaf32ec P bd1c07cda9da4436b69174af3a1ce92f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337), 8dfed99448174185ba5ece679e9d90be (127.0.107.195:39279)
I20260709 13:03:50.617877 12078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65544e18a6944de89c1560f44aaf32ec" candidate_uuid: "bd1c07cda9da4436b69174af3a1ce92f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dfed99448174185ba5ece679e9d90be" is_pre_election: true
I20260709 13:03:50.618435 12004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65544e18a6944de89c1560f44aaf32ec" candidate_uuid: "bd1c07cda9da4436b69174af3a1ce92f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "367d36143adf465b950244c6baa620a5" is_pre_election: true
I20260709 13:03:50.618600 12078 raft_consensus.cc:2468] T 65544e18a6944de89c1560f44aaf32ec P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd1c07cda9da4436b69174af3a1ce92f in term 0.
I20260709 13:03:50.619153 12004 raft_consensus.cc:2468] T 65544e18a6944de89c1560f44aaf32ec P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd1c07cda9da4436b69174af3a1ce92f in term 0.
I20260709 13:03:50.620311 11893 leader_election.cc:304] T 65544e18a6944de89c1560f44aaf32ec P bd1c07cda9da4436b69174af3a1ce92f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 367d36143adf465b950244c6baa620a5, bd1c07cda9da4436b69174af3a1ce92f; no voters: 
I20260709 13:03:50.621515 12123 raft_consensus.cc:2804] T 65544e18a6944de89c1560f44aaf32ec P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:50.621901 12123 raft_consensus.cc:493] T 65544e18a6944de89c1560f44aaf32ec P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:50.622210 12123 raft_consensus.cc:3060] T 65544e18a6944de89c1560f44aaf32ec P bd1c07cda9da4436b69174af3a1ce92f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:50.627523 12123 raft_consensus.cc:515] T 65544e18a6944de89c1560f44aaf32ec P bd1c07cda9da4436b69174af3a1ce92f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:50.629089 12123 leader_election.cc:290] T 65544e18a6944de89c1560f44aaf32ec P bd1c07cda9da4436b69174af3a1ce92f [CANDIDATE]: Term 1 election: Requested vote from peers 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337), 8dfed99448174185ba5ece679e9d90be (127.0.107.195:39279)
I20260709 13:03:50.629829 12004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65544e18a6944de89c1560f44aaf32ec" candidate_uuid: "bd1c07cda9da4436b69174af3a1ce92f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "367d36143adf465b950244c6baa620a5"
I20260709 13:03:50.630184 12078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65544e18a6944de89c1560f44aaf32ec" candidate_uuid: "bd1c07cda9da4436b69174af3a1ce92f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dfed99448174185ba5ece679e9d90be"
I20260709 13:03:50.630496 12004 raft_consensus.cc:3060] T 65544e18a6944de89c1560f44aaf32ec P 367d36143adf465b950244c6baa620a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:50.630810 12078 raft_consensus.cc:3060] T 65544e18a6944de89c1560f44aaf32ec P 8dfed99448174185ba5ece679e9d90be [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:50.637239 12078 raft_consensus.cc:2468] T 65544e18a6944de89c1560f44aaf32ec P 8dfed99448174185ba5ece679e9d90be [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd1c07cda9da4436b69174af3a1ce92f in term 1.
I20260709 13:03:50.637252 12004 raft_consensus.cc:2468] T 65544e18a6944de89c1560f44aaf32ec P 367d36143adf465b950244c6baa620a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd1c07cda9da4436b69174af3a1ce92f in term 1.
I20260709 13:03:50.638434 11893 leader_election.cc:304] T 65544e18a6944de89c1560f44aaf32ec P bd1c07cda9da4436b69174af3a1ce92f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dfed99448174185ba5ece679e9d90be, bd1c07cda9da4436b69174af3a1ce92f; no voters: 
I20260709 13:03:50.639150 12123 raft_consensus.cc:2804] T 65544e18a6944de89c1560f44aaf32ec P bd1c07cda9da4436b69174af3a1ce92f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:50.639606 12123 raft_consensus.cc:697] T 65544e18a6944de89c1560f44aaf32ec P bd1c07cda9da4436b69174af3a1ce92f [term 1 LEADER]: Becoming Leader. State: Replica: bd1c07cda9da4436b69174af3a1ce92f, State: Running, Role: LEADER
I20260709 13:03:50.640305 12123 consensus_queue.cc:237] T 65544e18a6944de89c1560f44aaf32ec P bd1c07cda9da4436b69174af3a1ce92f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:50.647584 11826 catalog_manager.cc:5697] T 65544e18a6944de89c1560f44aaf32ec P bd1c07cda9da4436b69174af3a1ce92f reported cstate change: term changed from 0 to 1, leader changed from <none> to bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193). New cstate: current_term: 1 leader_uuid: "bd1c07cda9da4436b69174af3a1ce92f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:50.664614 12078 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b71ba69388bf42a88deaf32615d3b1b6"
dest_uuid: "8dfed99448174185ba5ece679e9d90be"
mode: GRACEFUL
new_leader_uuid: "bd1c07cda9da4436b69174af3a1ce92f"
 from {username='slave'} at 127.0.0.1:60132
I20260709 13:03:50.665135 12078 raft_consensus.cc:606] T b71ba69388bf42a88deaf32615d3b1b6 P 8dfed99448174185ba5ece679e9d90be [term 1 LEADER]: Received request to transfer leadership to TS bd1c07cda9da4436b69174af3a1ce92f
I20260709 13:03:50.670372 12078 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "93c0155ffb2b44fab1eed91e0025ef62"
dest_uuid: "8dfed99448174185ba5ece679e9d90be"
mode: GRACEFUL
new_leader_uuid: "bd1c07cda9da4436b69174af3a1ce92f"
 from {username='slave'} at 127.0.0.1:60132
I20260709 13:03:50.670881 12078 raft_consensus.cc:606] T 93c0155ffb2b44fab1eed91e0025ef62 P 8dfed99448174185ba5ece679e9d90be [term 1 LEADER]: Received request to transfer leadership to TS bd1c07cda9da4436b69174af3a1ce92f
I20260709 13:03:50.687582 12004 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "13ef79ebfe4f45b9bd9763de63a3e15a"
dest_uuid: "367d36143adf465b950244c6baa620a5"
mode: GRACEFUL
new_leader_uuid: "bd1c07cda9da4436b69174af3a1ce92f"
 from {username='slave'} at 127.0.0.1:52282
I20260709 13:03:50.688130 12004 raft_consensus.cc:606] T 13ef79ebfe4f45b9bd9763de63a3e15a P 367d36143adf465b950244c6baa620a5 [term 1 LEADER]: Received request to transfer leadership to TS bd1c07cda9da4436b69174af3a1ce92f
I20260709 13:03:50.693182 12078 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b5d801f325be415db1d2961ed3876b90"
dest_uuid: "8dfed99448174185ba5ece679e9d90be"
mode: GRACEFUL
new_leader_uuid: "367d36143adf465b950244c6baa620a5"
 from {username='slave'} at 127.0.0.1:60132
I20260709 13:03:50.693681 12078 raft_consensus.cc:606] T b5d801f325be415db1d2961ed3876b90 P 8dfed99448174185ba5ece679e9d90be [term 1 LEADER]: Received request to transfer leadership to TS 367d36143adf465b950244c6baa620a5
I20260709 13:03:50.701915 12078 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0fd34026fbe142c0898fd7ec29688648"
dest_uuid: "8dfed99448174185ba5ece679e9d90be"
mode: GRACEFUL
new_leader_uuid: "367d36143adf465b950244c6baa620a5"
 from {username='slave'} at 127.0.0.1:60132
I20260709 13:03:50.702395 12078 raft_consensus.cc:606] T 0fd34026fbe142c0898fd7ec29688648 P 8dfed99448174185ba5ece679e9d90be [term 1 LEADER]: Received request to transfer leadership to TS 367d36143adf465b950244c6baa620a5
I20260709 13:03:50.775446 12250 consensus_queue.cc:1048] T 93c0155ffb2b44fab1eed91e0025ef62 P 8dfed99448174185ba5ece679e9d90be [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:50.776954 12250 consensus_queue.cc:1048] T 0fd34026fbe142c0898fd7ec29688648 P 8dfed99448174185ba5ece679e9d90be [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:50.782524 12254 raft_consensus.cc:993] T 93c0155ffb2b44fab1eed91e0025ef62 P 8dfed99448174185ba5ece679e9d90be: : Instructing follower bd1c07cda9da4436b69174af3a1ce92f to start an election
I20260709 13:03:50.783053 12237 raft_consensus.cc:1081] T 93c0155ffb2b44fab1eed91e0025ef62 P 8dfed99448174185ba5ece679e9d90be [term 1 LEADER]: Signalling peer bd1c07cda9da4436b69174af3a1ce92f to start an election
I20260709 13:03:50.786641 11927 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "93c0155ffb2b44fab1eed91e0025ef62"
dest_uuid: "bd1c07cda9da4436b69174af3a1ce92f"
 from {username='slave'} at 127.0.0.1:46202
I20260709 13:03:50.787261 11927 raft_consensus.cc:493] T 93c0155ffb2b44fab1eed91e0025ef62 P bd1c07cda9da4436b69174af3a1ce92f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:50.787631 11927 raft_consensus.cc:3060] T 93c0155ffb2b44fab1eed91e0025ef62 P bd1c07cda9da4436b69174af3a1ce92f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:50.795303 11927 raft_consensus.cc:515] T 93c0155ffb2b44fab1eed91e0025ef62 P bd1c07cda9da4436b69174af3a1ce92f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:50.796615 11929 raft_consensus.cc:1240] T 93c0155ffb2b44fab1eed91e0025ef62 P bd1c07cda9da4436b69174af3a1ce92f [term 2 FOLLOWER]: Rejecting Update request from peer 8dfed99448174185ba5ece679e9d90be for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:50.797449 11927 leader_election.cc:290] T 93c0155ffb2b44fab1eed91e0025ef62 P bd1c07cda9da4436b69174af3a1ce92f [CANDIDATE]: Term 2 election: Requested vote from peers 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337), 8dfed99448174185ba5ece679e9d90be (127.0.107.195:39279)
I20260709 13:03:50.798862 12078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0155ffb2b44fab1eed91e0025ef62" candidate_uuid: "bd1c07cda9da4436b69174af3a1ce92f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8dfed99448174185ba5ece679e9d90be"
I20260709 13:03:50.799217 12237 consensus_queue.cc:1048] T 0fd34026fbe142c0898fd7ec29688648 P 8dfed99448174185ba5ece679e9d90be [LEADER]: Connected to new peer: Peer: permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:50.798830 12247 consensus_queue.cc:1048] T 93c0155ffb2b44fab1eed91e0025ef62 P 8dfed99448174185ba5ece679e9d90be [LEADER]: Connected to new peer: Peer: permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:50.800447 12078 raft_consensus.cc:3055] T 93c0155ffb2b44fab1eed91e0025ef62 P 8dfed99448174185ba5ece679e9d90be [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:50.800890 12078 raft_consensus.cc:740] T 93c0155ffb2b44fab1eed91e0025ef62 P 8dfed99448174185ba5ece679e9d90be [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8dfed99448174185ba5ece679e9d90be, State: Running, Role: LEADER
I20260709 13:03:50.801107 12247 consensus_queue.cc:1059] T 93c0155ffb2b44fab1eed91e0025ef62 P 8dfed99448174185ba5ece679e9d90be [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:50.802860 12237 consensus_queue.cc:1048] T b71ba69388bf42a88deaf32615d3b1b6 P 8dfed99448174185ba5ece679e9d90be [LEADER]: Connected to new peer: Peer: permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:50.804500 12078 consensus_queue.cc:260] T 93c0155ffb2b44fab1eed91e0025ef62 P 8dfed99448174185ba5ece679e9d90be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:50.805752 12078 raft_consensus.cc:3060] T 93c0155ffb2b44fab1eed91e0025ef62 P 8dfed99448174185ba5ece679e9d90be [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:50.805552 12250 consensus_queue.cc:1048] T b71ba69388bf42a88deaf32615d3b1b6 P 8dfed99448174185ba5ece679e9d90be [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:50.813644 12078 raft_consensus.cc:2468] T 93c0155ffb2b44fab1eed91e0025ef62 P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd1c07cda9da4436b69174af3a1ce92f in term 2.
I20260709 13:03:50.799167 12004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c0155ffb2b44fab1eed91e0025ef62" candidate_uuid: "bd1c07cda9da4436b69174af3a1ce92f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "367d36143adf465b950244c6baa620a5"
W20260709 13:03:50.819098 12247 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:03:50.820868 12250 raft_consensus.cc:993] T b71ba69388bf42a88deaf32615d3b1b6 P 8dfed99448174185ba5ece679e9d90be: : Instructing follower bd1c07cda9da4436b69174af3a1ce92f to start an election
I20260709 13:03:50.821460 12237 raft_consensus.cc:1081] T b71ba69388bf42a88deaf32615d3b1b6 P 8dfed99448174185ba5ece679e9d90be [term 1 LEADER]: Signalling peer bd1c07cda9da4436b69174af3a1ce92f to start an election
I20260709 13:03:50.822016 11893 leader_election.cc:304] T 93c0155ffb2b44fab1eed91e0025ef62 P bd1c07cda9da4436b69174af3a1ce92f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dfed99448174185ba5ece679e9d90be, bd1c07cda9da4436b69174af3a1ce92f; no voters: 367d36143adf465b950244c6baa620a5
I20260709 13:03:50.822983 12123 raft_consensus.cc:2804] T 93c0155ffb2b44fab1eed91e0025ef62 P bd1c07cda9da4436b69174af3a1ce92f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:50.823374 11929 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b71ba69388bf42a88deaf32615d3b1b6"
dest_uuid: "bd1c07cda9da4436b69174af3a1ce92f"
 from {username='slave'} at 127.0.0.1:46202
I20260709 13:03:50.824298 11929 raft_consensus.cc:493] T b71ba69388bf42a88deaf32615d3b1b6 P bd1c07cda9da4436b69174af3a1ce92f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:50.824677 11929 raft_consensus.cc:3060] T b71ba69388bf42a88deaf32615d3b1b6 P bd1c07cda9da4436b69174af3a1ce92f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:50.823432 12123 raft_consensus.cc:697] T 93c0155ffb2b44fab1eed91e0025ef62 P bd1c07cda9da4436b69174af3a1ce92f [term 2 LEADER]: Becoming Leader. State: Replica: bd1c07cda9da4436b69174af3a1ce92f, State: Running, Role: LEADER
I20260709 13:03:50.831209 12123 consensus_queue.cc:237] T 93c0155ffb2b44fab1eed91e0025ef62 P bd1c07cda9da4436b69174af3a1ce92f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:50.836565 11929 raft_consensus.cc:515] T b71ba69388bf42a88deaf32615d3b1b6 P bd1c07cda9da4436b69174af3a1ce92f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:50.837563 11928 raft_consensus.cc:1240] T b71ba69388bf42a88deaf32615d3b1b6 P bd1c07cda9da4436b69174af3a1ce92f [term 2 FOLLOWER]: Rejecting Update request from peer 8dfed99448174185ba5ece679e9d90be for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:50.839664 12003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b71ba69388bf42a88deaf32615d3b1b6" candidate_uuid: "bd1c07cda9da4436b69174af3a1ce92f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "367d36143adf465b950244c6baa620a5"
I20260709 13:03:50.840435 12003 raft_consensus.cc:3060] T b71ba69388bf42a88deaf32615d3b1b6 P 367d36143adf465b950244c6baa620a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:50.840332 12254 consensus_queue.cc:1059] T b71ba69388bf42a88deaf32615d3b1b6 P 8dfed99448174185ba5ece679e9d90be [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:50.840378 11929 leader_election.cc:290] T b71ba69388bf42a88deaf32615d3b1b6 P bd1c07cda9da4436b69174af3a1ce92f [CANDIDATE]: Term 2 election: Requested vote from peers 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337), 8dfed99448174185ba5ece679e9d90be (127.0.107.195:39279)
I20260709 13:03:50.841233 12078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b71ba69388bf42a88deaf32615d3b1b6" candidate_uuid: "bd1c07cda9da4436b69174af3a1ce92f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8dfed99448174185ba5ece679e9d90be"
I20260709 13:03:50.841794 12254 raft_consensus.cc:3055] T b71ba69388bf42a88deaf32615d3b1b6 P 8dfed99448174185ba5ece679e9d90be [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:50.842489 12254 raft_consensus.cc:740] T b71ba69388bf42a88deaf32615d3b1b6 P 8dfed99448174185ba5ece679e9d90be [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8dfed99448174185ba5ece679e9d90be, State: Running, Role: LEADER
I20260709 13:03:50.843273 12254 consensus_queue.cc:260] T b71ba69388bf42a88deaf32615d3b1b6 P 8dfed99448174185ba5ece679e9d90be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:50.844594 12254 raft_consensus.cc:3060] T b71ba69388bf42a88deaf32615d3b1b6 P 8dfed99448174185ba5ece679e9d90be [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:50.850109 11827 catalog_manager.cc:5697] T 93c0155ffb2b44fab1eed91e0025ef62 P bd1c07cda9da4436b69174af3a1ce92f reported cstate change: term changed from 1 to 2, leader changed from 8dfed99448174185ba5ece679e9d90be (127.0.107.195) to bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193). New cstate: current_term: 2 leader_uuid: "bd1c07cda9da4436b69174af3a1ce92f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:50.851991 12247 raft_consensus.cc:993] T 0fd34026fbe142c0898fd7ec29688648 P 8dfed99448174185ba5ece679e9d90be: : Instructing follower 367d36143adf465b950244c6baa620a5 to start an election
I20260709 13:03:50.852556 12250 raft_consensus.cc:1081] T 0fd34026fbe142c0898fd7ec29688648 P 8dfed99448174185ba5ece679e9d90be [term 1 LEADER]: Signalling peer 367d36143adf465b950244c6baa620a5 to start an election
I20260709 13:03:50.856628 12002 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0fd34026fbe142c0898fd7ec29688648"
dest_uuid: "367d36143adf465b950244c6baa620a5"
 from {username='slave'} at 127.0.0.1:52274
I20260709 13:03:50.857990 12002 raft_consensus.cc:493] T 0fd34026fbe142c0898fd7ec29688648 P 367d36143adf465b950244c6baa620a5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:50.858367 12002 raft_consensus.cc:3060] T 0fd34026fbe142c0898fd7ec29688648 P 367d36143adf465b950244c6baa620a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:50.859362 12078 raft_consensus.cc:2468] T b71ba69388bf42a88deaf32615d3b1b6 P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd1c07cda9da4436b69174af3a1ce92f in term 2.
I20260709 13:03:50.860206 12003 raft_consensus.cc:2468] T b71ba69388bf42a88deaf32615d3b1b6 P 367d36143adf465b950244c6baa620a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd1c07cda9da4436b69174af3a1ce92f in term 2.
I20260709 13:03:50.860890 11893 leader_election.cc:304] T b71ba69388bf42a88deaf32615d3b1b6 P bd1c07cda9da4436b69174af3a1ce92f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dfed99448174185ba5ece679e9d90be, bd1c07cda9da4436b69174af3a1ce92f; no voters: 
I20260709 13:03:50.861613 12123 raft_consensus.cc:2804] T b71ba69388bf42a88deaf32615d3b1b6 P bd1c07cda9da4436b69174af3a1ce92f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:50.862031 12123 raft_consensus.cc:697] T b71ba69388bf42a88deaf32615d3b1b6 P bd1c07cda9da4436b69174af3a1ce92f [term 2 LEADER]: Becoming Leader. State: Replica: bd1c07cda9da4436b69174af3a1ce92f, State: Running, Role: LEADER
I20260709 13:03:50.862607 12123 consensus_queue.cc:237] T b71ba69388bf42a88deaf32615d3b1b6 P bd1c07cda9da4436b69174af3a1ce92f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:50.864400 12002 raft_consensus.cc:515] T 0fd34026fbe142c0898fd7ec29688648 P 367d36143adf465b950244c6baa620a5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:50.867178 12002 leader_election.cc:290] T 0fd34026fbe142c0898fd7ec29688648 P 367d36143adf465b950244c6baa620a5 [CANDIDATE]: Term 2 election: Requested vote from peers bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131), 8dfed99448174185ba5ece679e9d90be (127.0.107.195:39279)
I20260709 13:03:50.867440 12078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd34026fbe142c0898fd7ec29688648" candidate_uuid: "367d36143adf465b950244c6baa620a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8dfed99448174185ba5ece679e9d90be"
I20260709 13:03:50.868090 12078 raft_consensus.cc:3055] T 0fd34026fbe142c0898fd7ec29688648 P 8dfed99448174185ba5ece679e9d90be [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:50.868410 12078 raft_consensus.cc:740] T 0fd34026fbe142c0898fd7ec29688648 P 8dfed99448174185ba5ece679e9d90be [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8dfed99448174185ba5ece679e9d90be, State: Running, Role: LEADER
I20260709 13:03:50.869338 11929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd34026fbe142c0898fd7ec29688648" candidate_uuid: "367d36143adf465b950244c6baa620a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bd1c07cda9da4436b69174af3a1ce92f"
I20260709 13:03:50.869577 12078 consensus_queue.cc:260] T 0fd34026fbe142c0898fd7ec29688648 P 8dfed99448174185ba5ece679e9d90be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:50.870918 12078 raft_consensus.cc:3060] T 0fd34026fbe142c0898fd7ec29688648 P 8dfed99448174185ba5ece679e9d90be [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:50.870021 11929 raft_consensus.cc:3060] T 0fd34026fbe142c0898fd7ec29688648 P bd1c07cda9da4436b69174af3a1ce92f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:50.875059 11827 catalog_manager.cc:5697] T b71ba69388bf42a88deaf32615d3b1b6 P bd1c07cda9da4436b69174af3a1ce92f reported cstate change: term changed from 1 to 2, leader changed from 8dfed99448174185ba5ece679e9d90be (127.0.107.195) to bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193). New cstate: current_term: 2 leader_uuid: "bd1c07cda9da4436b69174af3a1ce92f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:50.878293 12078 raft_consensus.cc:2468] T 0fd34026fbe142c0898fd7ec29688648 P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 367d36143adf465b950244c6baa620a5 in term 2.
I20260709 13:03:50.879467 11968 leader_election.cc:304] T 0fd34026fbe142c0898fd7ec29688648 P 367d36143adf465b950244c6baa620a5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 367d36143adf465b950244c6baa620a5, 8dfed99448174185ba5ece679e9d90be; no voters: 
I20260709 13:03:50.880308 12268 raft_consensus.cc:2804] T 0fd34026fbe142c0898fd7ec29688648 P 367d36143adf465b950244c6baa620a5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:50.880807 12268 raft_consensus.cc:697] T 0fd34026fbe142c0898fd7ec29688648 P 367d36143adf465b950244c6baa620a5 [term 2 LEADER]: Becoming Leader. State: Replica: 367d36143adf465b950244c6baa620a5, State: Running, Role: LEADER
I20260709 13:03:50.880882 11929 raft_consensus.cc:2468] T 0fd34026fbe142c0898fd7ec29688648 P bd1c07cda9da4436b69174af3a1ce92f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 367d36143adf465b950244c6baa620a5 in term 2.
I20260709 13:03:50.881645 12268 consensus_queue.cc:237] T 0fd34026fbe142c0898fd7ec29688648 P 367d36143adf465b950244c6baa620a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:50.885813 12254 consensus_queue.cc:1048] T d2a9a34c1be443a69f95f8f237dc4116 P 8dfed99448174185ba5ece679e9d90be [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:50.891988 11827 catalog_manager.cc:5697] T 0fd34026fbe142c0898fd7ec29688648 P 367d36143adf465b950244c6baa620a5 reported cstate change: term changed from 1 to 2, leader changed from 8dfed99448174185ba5ece679e9d90be (127.0.107.195) to 367d36143adf465b950244c6baa620a5 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "367d36143adf465b950244c6baa620a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:50.898449 12237 consensus_queue.cc:1048] T d2a9a34c1be443a69f95f8f237dc4116 P 8dfed99448174185ba5ece679e9d90be [LEADER]: Connected to new peer: Peer: permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:50.913693 12268 consensus_queue.cc:1048] T 175f2fe459f4455386cac7de26d34679 P 367d36143adf465b950244c6baa620a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:50.925009 12242 consensus_queue.cc:1048] T 175f2fe459f4455386cac7de26d34679 P 367d36143adf465b950244c6baa620a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:51.012327 12132 consensus_queue.cc:1048] T 13ef79ebfe4f45b9bd9763de63a3e15a P 367d36143adf465b950244c6baa620a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:51.023007 12242 consensus_queue.cc:1048] T 13ef79ebfe4f45b9bd9763de63a3e15a P 367d36143adf465b950244c6baa620a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:51.031031 12223 raft_consensus.cc:993] T 13ef79ebfe4f45b9bd9763de63a3e15a P 367d36143adf465b950244c6baa620a5: : Instructing follower bd1c07cda9da4436b69174af3a1ce92f to start an election
I20260709 13:03:51.031525 12223 raft_consensus.cc:1081] T 13ef79ebfe4f45b9bd9763de63a3e15a P 367d36143adf465b950244c6baa620a5 [term 1 LEADER]: Signalling peer bd1c07cda9da4436b69174af3a1ce92f to start an election
I20260709 13:03:51.033243 11929 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "13ef79ebfe4f45b9bd9763de63a3e15a"
dest_uuid: "bd1c07cda9da4436b69174af3a1ce92f"
 from {username='slave'} at 127.0.0.1:46214
I20260709 13:03:51.033784 11929 raft_consensus.cc:493] T 13ef79ebfe4f45b9bd9763de63a3e15a P bd1c07cda9da4436b69174af3a1ce92f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:51.034080 11929 raft_consensus.cc:3060] T 13ef79ebfe4f45b9bd9763de63a3e15a P bd1c07cda9da4436b69174af3a1ce92f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:51.039855 12250 raft_consensus.cc:993] T b5d801f325be415db1d2961ed3876b90 P 8dfed99448174185ba5ece679e9d90be: : Instructing follower 367d36143adf465b950244c6baa620a5 to start an election
I20260709 13:03:51.040433 12250 raft_consensus.cc:1081] T b5d801f325be415db1d2961ed3876b90 P 8dfed99448174185ba5ece679e9d90be [term 1 LEADER]: Signalling peer 367d36143adf465b950244c6baa620a5 to start an election
I20260709 13:03:51.040693 11929 raft_consensus.cc:515] T 13ef79ebfe4f45b9bd9763de63a3e15a P bd1c07cda9da4436b69174af3a1ce92f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:51.042873 12002 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b5d801f325be415db1d2961ed3876b90"
dest_uuid: "367d36143adf465b950244c6baa620a5"
 from {username='slave'} at 127.0.0.1:52274
I20260709 13:03:51.043504 12002 raft_consensus.cc:493] T b5d801f325be415db1d2961ed3876b90 P 367d36143adf465b950244c6baa620a5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:51.043859 12002 raft_consensus.cc:3060] T b5d801f325be415db1d2961ed3876b90 P 367d36143adf465b950244c6baa620a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:51.043947 12003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ef79ebfe4f45b9bd9763de63a3e15a" candidate_uuid: "bd1c07cda9da4436b69174af3a1ce92f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "367d36143adf465b950244c6baa620a5"
I20260709 13:03:51.044633 12003 raft_consensus.cc:3055] T 13ef79ebfe4f45b9bd9763de63a3e15a P 367d36143adf465b950244c6baa620a5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:51.044955 12003 raft_consensus.cc:740] T 13ef79ebfe4f45b9bd9763de63a3e15a P 367d36143adf465b950244c6baa620a5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 367d36143adf465b950244c6baa620a5, State: Running, Role: LEADER
I20260709 13:03:51.045722 12003 consensus_queue.cc:260] T 13ef79ebfe4f45b9bd9763de63a3e15a P 367d36143adf465b950244c6baa620a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:51.046844 12003 raft_consensus.cc:3060] T 13ef79ebfe4f45b9bd9763de63a3e15a P 367d36143adf465b950244c6baa620a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:51.051280 12002 raft_consensus.cc:515] T b5d801f325be415db1d2961ed3876b90 P 367d36143adf465b950244c6baa620a5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:51.052816 12002 leader_election.cc:290] T b5d801f325be415db1d2961ed3876b90 P 367d36143adf465b950244c6baa620a5 [CANDIDATE]: Term 2 election: Requested vote from peers bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131), 8dfed99448174185ba5ece679e9d90be (127.0.107.195:39279)
I20260709 13:03:51.053829 11928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d801f325be415db1d2961ed3876b90" candidate_uuid: "367d36143adf465b950244c6baa620a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bd1c07cda9da4436b69174af3a1ce92f"
I20260709 13:03:51.054363 11929 leader_election.cc:290] T 13ef79ebfe4f45b9bd9763de63a3e15a P bd1c07cda9da4436b69174af3a1ce92f [CANDIDATE]: Term 2 election: Requested vote from peers 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337), 8dfed99448174185ba5ece679e9d90be (127.0.107.195:39279)
I20260709 13:03:51.054493 11928 raft_consensus.cc:3060] T b5d801f325be415db1d2961ed3876b90 P bd1c07cda9da4436b69174af3a1ce92f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:51.053831 12078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5d801f325be415db1d2961ed3876b90" candidate_uuid: "367d36143adf465b950244c6baa620a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8dfed99448174185ba5ece679e9d90be"
I20260709 13:03:51.054803 12075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ef79ebfe4f45b9bd9763de63a3e15a" candidate_uuid: "bd1c07cda9da4436b69174af3a1ce92f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8dfed99448174185ba5ece679e9d90be"
I20260709 13:03:51.055440 12078 raft_consensus.cc:3055] T b5d801f325be415db1d2961ed3876b90 P 8dfed99448174185ba5ece679e9d90be [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:51.055594 12075 raft_consensus.cc:3060] T 13ef79ebfe4f45b9bd9763de63a3e15a P 8dfed99448174185ba5ece679e9d90be [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:51.053006 12003 raft_consensus.cc:2468] T 13ef79ebfe4f45b9bd9763de63a3e15a P 367d36143adf465b950244c6baa620a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd1c07cda9da4436b69174af3a1ce92f in term 2.
I20260709 13:03:51.056937 12078 raft_consensus.cc:740] T b5d801f325be415db1d2961ed3876b90 P 8dfed99448174185ba5ece679e9d90be [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8dfed99448174185ba5ece679e9d90be, State: Running, Role: LEADER
I20260709 13:03:51.057165 11893 leader_election.cc:304] T 13ef79ebfe4f45b9bd9763de63a3e15a P bd1c07cda9da4436b69174af3a1ce92f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 367d36143adf465b950244c6baa620a5, bd1c07cda9da4436b69174af3a1ce92f; no voters: 
I20260709 13:03:51.057649 12078 consensus_queue.cc:260] T b5d801f325be415db1d2961ed3876b90 P 8dfed99448174185ba5ece679e9d90be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:51.058007 12123 raft_consensus.cc:2804] T 13ef79ebfe4f45b9bd9763de63a3e15a P bd1c07cda9da4436b69174af3a1ce92f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:51.058799 12078 raft_consensus.cc:3060] T b5d801f325be415db1d2961ed3876b90 P 8dfed99448174185ba5ece679e9d90be [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:51.058969 12123 raft_consensus.cc:697] T 13ef79ebfe4f45b9bd9763de63a3e15a P bd1c07cda9da4436b69174af3a1ce92f [term 2 LEADER]: Becoming Leader. State: Replica: bd1c07cda9da4436b69174af3a1ce92f, State: Running, Role: LEADER
I20260709 13:03:51.059796 12123 consensus_queue.cc:237] T 13ef79ebfe4f45b9bd9763de63a3e15a P bd1c07cda9da4436b69174af3a1ce92f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:51.062646 12075 raft_consensus.cc:2468] T 13ef79ebfe4f45b9bd9763de63a3e15a P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd1c07cda9da4436b69174af3a1ce92f in term 2.
I20260709 13:03:51.063362 12078 raft_consensus.cc:2468] T b5d801f325be415db1d2961ed3876b90 P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 367d36143adf465b950244c6baa620a5 in term 2.
I20260709 13:03:51.064383 11968 leader_election.cc:304] T b5d801f325be415db1d2961ed3876b90 P 367d36143adf465b950244c6baa620a5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 367d36143adf465b950244c6baa620a5, 8dfed99448174185ba5ece679e9d90be; no voters: 
I20260709 13:03:51.065169 12223 raft_consensus.cc:2804] T b5d801f325be415db1d2961ed3876b90 P 367d36143adf465b950244c6baa620a5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:51.065646 12223 raft_consensus.cc:697] T b5d801f325be415db1d2961ed3876b90 P 367d36143adf465b950244c6baa620a5 [term 2 LEADER]: Becoming Leader. State: Replica: 367d36143adf465b950244c6baa620a5, State: Running, Role: LEADER
I20260709 13:03:51.066423 12223 consensus_queue.cc:237] T b5d801f325be415db1d2961ed3876b90 P 367d36143adf465b950244c6baa620a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:51.068043 11928 raft_consensus.cc:2468] T b5d801f325be415db1d2961ed3876b90 P bd1c07cda9da4436b69174af3a1ce92f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 367d36143adf465b950244c6baa620a5 in term 2.
I20260709 13:03:51.069164 12123 consensus_queue.cc:1048] T 65544e18a6944de89c1560f44aaf32ec P bd1c07cda9da4436b69174af3a1ce92f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:51.074077 11827 catalog_manager.cc:5697] T 13ef79ebfe4f45b9bd9763de63a3e15a P bd1c07cda9da4436b69174af3a1ce92f reported cstate change: term changed from 1 to 2, leader changed from 367d36143adf465b950244c6baa620a5 (127.0.107.194) to bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193). New cstate: current_term: 2 leader_uuid: "bd1c07cda9da4436b69174af3a1ce92f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:51.076450 11826 catalog_manager.cc:5697] T b5d801f325be415db1d2961ed3876b90 P 367d36143adf465b950244c6baa620a5 reported cstate change: term changed from 1 to 2, leader changed from 8dfed99448174185ba5ece679e9d90be (127.0.107.195) to 367d36143adf465b950244c6baa620a5 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "367d36143adf465b950244c6baa620a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:51.083293 12123 consensus_queue.cc:1048] T 65544e18a6944de89c1560f44aaf32ec P bd1c07cda9da4436b69174af3a1ce92f [LEADER]: Connected to new peer: Peer: permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:51.248034 12003 raft_consensus.cc:3060] T 93c0155ffb2b44fab1eed91e0025ef62 P 367d36143adf465b950244c6baa620a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:51.253423 12003 raft_consensus.cc:1275] T 93c0155ffb2b44fab1eed91e0025ef62 P 367d36143adf465b950244c6baa620a5 [term 2 FOLLOWER]: Refusing update from remote peer bd1c07cda9da4436b69174af3a1ce92f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:51.254724 12123 consensus_queue.cc:1048] T 93c0155ffb2b44fab1eed91e0025ef62 P bd1c07cda9da4436b69174af3a1ce92f [LEADER]: Connected to new peer: Peer: permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:51.264163 11928 raft_consensus.cc:1275] T 0fd34026fbe142c0898fd7ec29688648 P bd1c07cda9da4436b69174af3a1ce92f [term 2 FOLLOWER]: Refusing update from remote peer 367d36143adf465b950244c6baa620a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:51.265139 12075 raft_consensus.cc:1275] T 93c0155ffb2b44fab1eed91e0025ef62 P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Refusing update from remote peer bd1c07cda9da4436b69174af3a1ce92f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:51.265870 12242 consensus_queue.cc:1048] T 0fd34026fbe142c0898fd7ec29688648 P 367d36143adf465b950244c6baa620a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:51.266626 12286 consensus_queue.cc:1048] T 93c0155ffb2b44fab1eed91e0025ef62 P bd1c07cda9da4436b69174af3a1ce92f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:51.275463 12078 raft_consensus.cc:1275] T 0fd34026fbe142c0898fd7ec29688648 P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Refusing update from remote peer 367d36143adf465b950244c6baa620a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:51.277253 12132 consensus_queue.cc:1048] T 0fd34026fbe142c0898fd7ec29688648 P 367d36143adf465b950244c6baa620a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:51.374217 12078 raft_consensus.cc:1275] T b71ba69388bf42a88deaf32615d3b1b6 P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Refusing update from remote peer bd1c07cda9da4436b69174af3a1ce92f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:51.375442 12286 consensus_queue.cc:1048] T b71ba69388bf42a88deaf32615d3b1b6 P bd1c07cda9da4436b69174af3a1ce92f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:51.385134 12003 raft_consensus.cc:1275] T b71ba69388bf42a88deaf32615d3b1b6 P 367d36143adf465b950244c6baa620a5 [term 2 FOLLOWER]: Refusing update from remote peer bd1c07cda9da4436b69174af3a1ce92f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:51.386751 12123 consensus_queue.cc:1048] T b71ba69388bf42a88deaf32615d3b1b6 P bd1c07cda9da4436b69174af3a1ce92f [LEADER]: Connected to new peer: Peer: permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:51.618325 12078 raft_consensus.cc:1275] T b5d801f325be415db1d2961ed3876b90 P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Refusing update from remote peer 367d36143adf465b950244c6baa620a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:51.619580 12223 consensus_queue.cc:1048] T b5d801f325be415db1d2961ed3876b90 P 367d36143adf465b950244c6baa620a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:51.629719 11928 raft_consensus.cc:1275] T b5d801f325be415db1d2961ed3876b90 P bd1c07cda9da4436b69174af3a1ce92f [term 2 FOLLOWER]: Refusing update from remote peer 367d36143adf465b950244c6baa620a5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:51.631340 12132 consensus_queue.cc:1048] T b5d801f325be415db1d2961ed3876b90 P 367d36143adf465b950244c6baa620a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:51.648969 12078 raft_consensus.cc:1275] T 13ef79ebfe4f45b9bd9763de63a3e15a P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Refusing update from remote peer bd1c07cda9da4436b69174af3a1ce92f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:51.650060 12239 consensus_queue.cc:1048] T 13ef79ebfe4f45b9bd9763de63a3e15a P bd1c07cda9da4436b69174af3a1ce92f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:51.657469 12003 raft_consensus.cc:1275] T 13ef79ebfe4f45b9bd9763de63a3e15a P 367d36143adf465b950244c6baa620a5 [term 2 FOLLOWER]: Refusing update from remote peer bd1c07cda9da4436b69174af3a1ce92f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:51.659365 12286 consensus_queue.cc:1048] T 13ef79ebfe4f45b9bd9763de63a3e15a P bd1c07cda9da4436b69174af3a1ce92f [LEADER]: Connected to new peer: Peer: permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:53.711287 11824 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:36676:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:03:53.738633 11824 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:36676:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:03:53.830782   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:03:53.981165 12320 log.cc:927] Time spent T 93c0155ffb2b44fab1eed91e0025ef62 P 367d36143adf465b950244c6baa620a5: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:03:53.919310 12326 tablet.cc:1724] T b71ba69388bf42a88deaf32615d3b1b6 P bd1c07cda9da4436b69174af3a1ce92f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:53.985425 12332 tablet.cc:1724] T 93c0155ffb2b44fab1eed91e0025ef62 P bd1c07cda9da4436b69174af3a1ce92f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:54.020265 12328 tablet.cc:1724] T b71ba69388bf42a88deaf32615d3b1b6 P 367d36143adf465b950244c6baa620a5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:54.079150 12337 tablet.cc:1724] T b71ba69388bf42a88deaf32615d3b1b6 P 8dfed99448174185ba5ece679e9d90be: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:54.072607 12336 tablet.cc:1724] T 93c0155ffb2b44fab1eed91e0025ef62 P 8dfed99448174185ba5ece679e9d90be: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:54.122766 12344 tablet.cc:1724] T b5d801f325be415db1d2961ed3876b90 P 367d36143adf465b950244c6baa620a5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:03:54.127166 11893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:39279, user_credentials={real_user=slave}} blocked reactor thread for 51722.4us
I20260709 13:03:54.163158 12332 tablet.cc:1724] T b5d801f325be415db1d2961ed3876b90 P bd1c07cda9da4436b69174af3a1ce92f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:54.132534 12343 tablet.cc:1724] T 93c0155ffb2b44fab1eed91e0025ef62 P 367d36143adf465b950244c6baa620a5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:54.178696 12347 tablet.cc:1724] T b5d801f325be415db1d2961ed3876b90 P 8dfed99448174185ba5ece679e9d90be: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:54.198179 12328 tablet.cc:1724] T 0fd34026fbe142c0898fd7ec29688648 P 367d36143adf465b950244c6baa620a5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:03:54.202746 12350 log.cc:927] Time spent T 0ac98551cc1c458e8e95be2e9f1ddeac P bd1c07cda9da4436b69174af3a1ce92f: Append to log took a long time: real 0.087s	user 0.002s	sys 0.000s
I20260709 13:03:54.166365 12345 tablet.cc:1724] T 65544e18a6944de89c1560f44aaf32ec P bd1c07cda9da4436b69174af3a1ce92f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:03:54.213502 12351 log.cc:927] Time spent T d2a9a34c1be443a69f95f8f237dc4116 P bd1c07cda9da4436b69174af3a1ce92f: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:03:54.223668 12345 tablet.cc:1724] T 175f2fe459f4455386cac7de26d34679 P bd1c07cda9da4436b69174af3a1ce92f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:54.227618 12353 tablet.cc:1724] T d2a9a34c1be443a69f95f8f237dc4116 P 8dfed99448174185ba5ece679e9d90be: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:54.237351 12356 tablet.cc:1724] T 175f2fe459f4455386cac7de26d34679 P 367d36143adf465b950244c6baa620a5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:03:54.263357 11969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:46131, user_credentials={real_user=slave}} blocked reactor thread for 68585.7us
I20260709 13:03:54.276830 12355 tablet.cc:1724] T 13ef79ebfe4f45b9bd9763de63a3e15a P bd1c07cda9da4436b69174af3a1ce92f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:54.271087 11925 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "95bf609349e54fdd867e40d7fd578e52"
dest_uuid: "bd1c07cda9da4436b69174af3a1ce92f"
mode: GRACEFUL
new_leader_uuid: "8dfed99448174185ba5ece679e9d90be"
 from {username='slave'} at 127.0.0.1:53474
I20260709 13:03:54.287901 11925 raft_consensus.cc:606] T 95bf609349e54fdd867e40d7fd578e52 P bd1c07cda9da4436b69174af3a1ce92f [term 1 LEADER]: Received request to transfer leadership to TS 8dfed99448174185ba5ece679e9d90be
I20260709 13:03:54.253059 12337 tablet.cc:1724] T 0fd34026fbe142c0898fd7ec29688648 P 8dfed99448174185ba5ece679e9d90be: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:54.307317 12345 tablet.cc:1724] T d2a9a34c1be443a69f95f8f237dc4116 P bd1c07cda9da4436b69174af3a1ce92f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:54.303512 12343 tablet.cc:1724] T 0ac98551cc1c458e8e95be2e9f1ddeac P 367d36143adf465b950244c6baa620a5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:54.311722 12328 tablet.cc:1724] T d2a9a34c1be443a69f95f8f237dc4116 P 367d36143adf465b950244c6baa620a5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:54.307370 12344 tablet.cc:1724] T 65544e18a6944de89c1560f44aaf32ec P 367d36143adf465b950244c6baa620a5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:03:54.326817 12352 log.cc:927] Time spent T 13ef79ebfe4f45b9bd9763de63a3e15a P 367d36143adf465b950244c6baa620a5: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:03:54.335732 12353 tablet.cc:1724] T 0ac98551cc1c458e8e95be2e9f1ddeac P 8dfed99448174185ba5ece679e9d90be: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:54.344458 12345 tablet.cc:1724] T 0ac98551cc1c458e8e95be2e9f1ddeac P bd1c07cda9da4436b69174af3a1ce92f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:54.347204 12336 tablet.cc:1724] T 13ef79ebfe4f45b9bd9763de63a3e15a P 8dfed99448174185ba5ece679e9d90be: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:54.334105 12337 tablet.cc:1724] T 65544e18a6944de89c1560f44aaf32ec P 8dfed99448174185ba5ece679e9d90be: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:54.356101 12328 tablet.cc:1724] T 13ef79ebfe4f45b9bd9763de63a3e15a P 367d36143adf465b950244c6baa620a5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:54.348445 12326 tablet.cc:1724] T 0fd34026fbe142c0898fd7ec29688648 P bd1c07cda9da4436b69174af3a1ce92f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:54.359630 12347 tablet.cc:1724] T 175f2fe459f4455386cac7de26d34679 P 8dfed99448174185ba5ece679e9d90be: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:54.391001 12002 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a846ec1843bc4dbca0df61be2992759d"
dest_uuid: "367d36143adf465b950244c6baa620a5"
mode: GRACEFUL
new_leader_uuid: "8dfed99448174185ba5ece679e9d90be"
 from {username='slave'} at 127.0.0.1:51676
I20260709 13:03:54.391662 12002 raft_consensus.cc:606] T a846ec1843bc4dbca0df61be2992759d P 367d36143adf465b950244c6baa620a5 [term 2 LEADER]: Received request to transfer leadership to TS 8dfed99448174185ba5ece679e9d90be
I20260709 13:03:54.393345   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:03:54.393968   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:54.396806 11823 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 952ff105c515428bad47a809ce3c645b: soft_deleted_table [id=4c3bef42d55c4c8c87863995596e7175] alter complete (version 1)
I20260709 13:03:54.670989 12362 raft_consensus.cc:993] T a846ec1843bc4dbca0df61be2992759d P 367d36143adf465b950244c6baa620a5: : Instructing follower 8dfed99448174185ba5ece679e9d90be to start an election
I20260709 13:03:54.671555 12340 raft_consensus.cc:1081] T a846ec1843bc4dbca0df61be2992759d P 367d36143adf465b950244c6baa620a5 [term 2 LEADER]: Signalling peer 8dfed99448174185ba5ece679e9d90be to start an election
I20260709 13:03:54.673219 12075 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a846ec1843bc4dbca0df61be2992759d"
dest_uuid: "8dfed99448174185ba5ece679e9d90be"
 from {username='slave'} at 127.0.0.1:60110
I20260709 13:03:54.673745 12075 raft_consensus.cc:493] T a846ec1843bc4dbca0df61be2992759d P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:54.674081 12075 raft_consensus.cc:3060] T a846ec1843bc4dbca0df61be2992759d P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:54.679831 12075 raft_consensus.cc:515] T a846ec1843bc4dbca0df61be2992759d P 8dfed99448174185ba5ece679e9d90be [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:54.681664 12075 leader_election.cc:290] T a846ec1843bc4dbca0df61be2992759d P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 3 election: Requested vote from peers bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131), 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337)
I20260709 13:03:54.682837 12002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a846ec1843bc4dbca0df61be2992759d" candidate_uuid: "8dfed99448174185ba5ece679e9d90be" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "367d36143adf465b950244c6baa620a5"
I20260709 13:03:54.682710 11926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a846ec1843bc4dbca0df61be2992759d" candidate_uuid: "8dfed99448174185ba5ece679e9d90be" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bd1c07cda9da4436b69174af3a1ce92f"
I20260709 13:03:54.683457 12002 raft_consensus.cc:3055] T a846ec1843bc4dbca0df61be2992759d P 367d36143adf465b950244c6baa620a5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:54.683626 11926 raft_consensus.cc:3060] T a846ec1843bc4dbca0df61be2992759d P bd1c07cda9da4436b69174af3a1ce92f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:54.683722 12002 raft_consensus.cc:740] T a846ec1843bc4dbca0df61be2992759d P 367d36143adf465b950244c6baa620a5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 367d36143adf465b950244c6baa620a5, State: Running, Role: LEADER
I20260709 13:03:54.684643 12002 consensus_queue.cc:260] T a846ec1843bc4dbca0df61be2992759d P 367d36143adf465b950244c6baa620a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:54.685612 12002 raft_consensus.cc:3060] T a846ec1843bc4dbca0df61be2992759d P 367d36143adf465b950244c6baa620a5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:54.690064 11926 raft_consensus.cc:2468] T a846ec1843bc4dbca0df61be2992759d P bd1c07cda9da4436b69174af3a1ce92f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dfed99448174185ba5ece679e9d90be in term 3.
I20260709 13:03:54.691576 12043 leader_election.cc:304] T a846ec1843bc4dbca0df61be2992759d P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dfed99448174185ba5ece679e9d90be, bd1c07cda9da4436b69174af3a1ce92f; no voters: 
I20260709 13:03:54.691655 12002 raft_consensus.cc:2468] T a846ec1843bc4dbca0df61be2992759d P 367d36143adf465b950244c6baa620a5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dfed99448174185ba5ece679e9d90be in term 3.
I20260709 13:03:54.692636 12237 raft_consensus.cc:2804] T a846ec1843bc4dbca0df61be2992759d P 8dfed99448174185ba5ece679e9d90be [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:54.693050 12237 raft_consensus.cc:697] T a846ec1843bc4dbca0df61be2992759d P 8dfed99448174185ba5ece679e9d90be [term 3 LEADER]: Becoming Leader. State: Replica: 8dfed99448174185ba5ece679e9d90be, State: Running, Role: LEADER
I20260709 13:03:54.693838 12237 consensus_queue.cc:237] T a846ec1843bc4dbca0df61be2992759d P 8dfed99448174185ba5ece679e9d90be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:54.703876 11823 catalog_manager.cc:5697] T a846ec1843bc4dbca0df61be2992759d P 8dfed99448174185ba5ece679e9d90be reported cstate change: term changed from 2 to 3, leader changed from 367d36143adf465b950244c6baa620a5 (127.0.107.194) to 8dfed99448174185ba5ece679e9d90be (127.0.107.195). New cstate: current_term: 3 leader_uuid: "8dfed99448174185ba5ece679e9d90be" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:54.711591 12293 raft_consensus.cc:993] T 95bf609349e54fdd867e40d7fd578e52 P bd1c07cda9da4436b69174af3a1ce92f: : Instructing follower 8dfed99448174185ba5ece679e9d90be to start an election
I20260709 13:03:54.712205 12348 raft_consensus.cc:1081] T 95bf609349e54fdd867e40d7fd578e52 P bd1c07cda9da4436b69174af3a1ce92f [term 1 LEADER]: Signalling peer 8dfed99448174185ba5ece679e9d90be to start an election
I20260709 13:03:54.713908 12071 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "95bf609349e54fdd867e40d7fd578e52"
dest_uuid: "8dfed99448174185ba5ece679e9d90be"
 from {username='slave'} at 127.0.0.1:60124
I20260709 13:03:54.714473 12071 raft_consensus.cc:493] T 95bf609349e54fdd867e40d7fd578e52 P 8dfed99448174185ba5ece679e9d90be [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:54.714828 12071 raft_consensus.cc:3060] T 95bf609349e54fdd867e40d7fd578e52 P 8dfed99448174185ba5ece679e9d90be [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:54.720476 12071 raft_consensus.cc:515] T 95bf609349e54fdd867e40d7fd578e52 P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:54.722277 12071 leader_election.cc:290] T 95bf609349e54fdd867e40d7fd578e52 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 2 election: Requested vote from peers bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131), 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337)
I20260709 13:03:54.723330 12002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95bf609349e54fdd867e40d7fd578e52" candidate_uuid: "8dfed99448174185ba5ece679e9d90be" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "367d36143adf465b950244c6baa620a5"
I20260709 13:03:54.723485 11926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95bf609349e54fdd867e40d7fd578e52" candidate_uuid: "8dfed99448174185ba5ece679e9d90be" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bd1c07cda9da4436b69174af3a1ce92f"
I20260709 13:03:54.724037 12002 raft_consensus.cc:3060] T 95bf609349e54fdd867e40d7fd578e52 P 367d36143adf465b950244c6baa620a5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:54.724218 11926 raft_consensus.cc:3055] T 95bf609349e54fdd867e40d7fd578e52 P bd1c07cda9da4436b69174af3a1ce92f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:54.724574 11926 raft_consensus.cc:740] T 95bf609349e54fdd867e40d7fd578e52 P bd1c07cda9da4436b69174af3a1ce92f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bd1c07cda9da4436b69174af3a1ce92f, State: Running, Role: LEADER
I20260709 13:03:54.725308 11926 consensus_queue.cc:260] T 95bf609349e54fdd867e40d7fd578e52 P bd1c07cda9da4436b69174af3a1ce92f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:54.726377 11926 raft_consensus.cc:3060] T 95bf609349e54fdd867e40d7fd578e52 P bd1c07cda9da4436b69174af3a1ce92f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:54.729043 12002 raft_consensus.cc:2468] T 95bf609349e54fdd867e40d7fd578e52 P 367d36143adf465b950244c6baa620a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dfed99448174185ba5ece679e9d90be in term 2.
I20260709 13:03:54.730324 12042 leader_election.cc:304] T 95bf609349e54fdd867e40d7fd578e52 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 367d36143adf465b950244c6baa620a5, 8dfed99448174185ba5ece679e9d90be; no voters: 
I20260709 13:03:54.731300 12237 raft_consensus.cc:2804] T 95bf609349e54fdd867e40d7fd578e52 P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:54.731709 12237 raft_consensus.cc:697] T 95bf609349e54fdd867e40d7fd578e52 P 8dfed99448174185ba5ece679e9d90be [term 2 LEADER]: Becoming Leader. State: Replica: 8dfed99448174185ba5ece679e9d90be, State: Running, Role: LEADER
I20260709 13:03:54.732481 12237 consensus_queue.cc:237] T 95bf609349e54fdd867e40d7fd578e52 P 8dfed99448174185ba5ece679e9d90be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:54.732877 11926 raft_consensus.cc:2468] T 95bf609349e54fdd867e40d7fd578e52 P bd1c07cda9da4436b69174af3a1ce92f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dfed99448174185ba5ece679e9d90be in term 2.
I20260709 13:03:54.740979 11823 catalog_manager.cc:5697] T 95bf609349e54fdd867e40d7fd578e52 P 8dfed99448174185ba5ece679e9d90be reported cstate change: term changed from 1 to 2, leader changed from bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193) to 8dfed99448174185ba5ece679e9d90be (127.0.107.195). New cstate: current_term: 2 leader_uuid: "8dfed99448174185ba5ece679e9d90be" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:55.152725 11926 raft_consensus.cc:1275] T 95bf609349e54fdd867e40d7fd578e52 P bd1c07cda9da4436b69174af3a1ce92f [term 2 FOLLOWER]: Refusing update from remote peer 8dfed99448174185ba5ece679e9d90be: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:55.154161 12237 consensus_queue.cc:1048] T 95bf609349e54fdd867e40d7fd578e52 P 8dfed99448174185ba5ece679e9d90be [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:55.168323 12002 raft_consensus.cc:1275] T 95bf609349e54fdd867e40d7fd578e52 P 367d36143adf465b950244c6baa620a5 [term 2 FOLLOWER]: Refusing update from remote peer 8dfed99448174185ba5ece679e9d90be: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:55.170002 12237 consensus_queue.cc:1048] T 95bf609349e54fdd867e40d7fd578e52 P 8dfed99448174185ba5ece679e9d90be [LEADER]: Connected to new peer: Peer: permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:55.181828 12004 raft_consensus.cc:1275] T a846ec1843bc4dbca0df61be2992759d P 367d36143adf465b950244c6baa620a5 [term 3 FOLLOWER]: Refusing update from remote peer 8dfed99448174185ba5ece679e9d90be: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:55.184128 12237 consensus_queue.cc:1048] T a846ec1843bc4dbca0df61be2992759d P 8dfed99448174185ba5ece679e9d90be [LEADER]: Connected to new peer: Peer: permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:55.196434 11926 raft_consensus.cc:1275] T a846ec1843bc4dbca0df61be2992759d P bd1c07cda9da4436b69174af3a1ce92f [term 3 FOLLOWER]: Refusing update from remote peer 8dfed99448174185ba5ece679e9d90be: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:55.198149 12361 consensus_queue.cc:1048] T a846ec1843bc4dbca0df61be2992759d P 8dfed99448174185ba5ece679e9d90be [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:55.455766   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
W20260709 13:03:55.640264 12043 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 11 similar messages]
I20260709 13:03:55.649232   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:55.651052   431 tablet_replica.cc:333] T 65544e18a6944de89c1560f44aaf32ec P bd1c07cda9da4436b69174af3a1ce92f: stopping tablet replica
I20260709 13:03:55.652182   431 raft_consensus.cc:2243] T 65544e18a6944de89c1560f44aaf32ec P bd1c07cda9da4436b69174af3a1ce92f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:55.653733   431 raft_consensus.cc:2272] T 65544e18a6944de89c1560f44aaf32ec P bd1c07cda9da4436b69174af3a1ce92f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.657804   431 tablet_replica.cc:333] T b71ba69388bf42a88deaf32615d3b1b6 P bd1c07cda9da4436b69174af3a1ce92f: stopping tablet replica
W20260709 13:03:55.660095 12043 consensus_peers.cc:597] T 5078275d4ea64e67bf0a061eb3011157 P 8dfed99448174185ba5ece679e9d90be -> Peer bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131): Couldn't send request to peer bd1c07cda9da4436b69174af3a1ce92f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:55.719727 12043 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:46131, user_credentials={real_user=slave}} blocked reactor thread for 59677.5us
W20260709 13:03:55.676564 11969 consensus_peers.cc:597] T 7f973c97455b4d918d353553cbe194a9 P 367d36143adf465b950244c6baa620a5 -> Peer bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131): Couldn't send request to peer bd1c07cda9da4436b69174af3a1ce92f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:55.677631   431 raft_consensus.cc:2243] T b71ba69388bf42a88deaf32615d3b1b6 P bd1c07cda9da4436b69174af3a1ce92f [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:03:55.720846 11969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:46131, user_credentials={real_user=slave}} blocked reactor thread for 44330.1us
I20260709 13:03:55.721659   431 raft_consensus.cc:2272] T b71ba69388bf42a88deaf32615d3b1b6 P bd1c07cda9da4436b69174af3a1ce92f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.725057   431 tablet_replica.cc:333] T 93c0155ffb2b44fab1eed91e0025ef62 P bd1c07cda9da4436b69174af3a1ce92f: stopping tablet replica
I20260709 13:03:55.726023   431 raft_consensus.cc:2243] T 93c0155ffb2b44fab1eed91e0025ef62 P bd1c07cda9da4436b69174af3a1ce92f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:55.727175   431 raft_consensus.cc:2272] T 93c0155ffb2b44fab1eed91e0025ef62 P bd1c07cda9da4436b69174af3a1ce92f [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:55.730458 11969 consensus_peers.cc:597] T 175f2fe459f4455386cac7de26d34679 P 367d36143adf465b950244c6baa620a5 -> Peer bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131): Couldn't send request to peer bd1c07cda9da4436b69174af3a1ce92f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:55.731460 12043 consensus_peers.cc:597] T a846ec1843bc4dbca0df61be2992759d P 8dfed99448174185ba5ece679e9d90be -> Peer bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131): Couldn't send request to peer bd1c07cda9da4436b69174af3a1ce92f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:55.732750 11969 consensus_peers.cc:597] T bda83ed4e6b84bf9985ad11c37b2bd59 P 367d36143adf465b950244c6baa620a5 -> Peer bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131): Couldn't send request to peer bd1c07cda9da4436b69174af3a1ce92f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:55.730424   431 tablet_replica.cc:333] T 13ef79ebfe4f45b9bd9763de63a3e15a P bd1c07cda9da4436b69174af3a1ce92f: stopping tablet replica
I20260709 13:03:55.734783   431 raft_consensus.cc:2243] T 13ef79ebfe4f45b9bd9763de63a3e15a P bd1c07cda9da4436b69174af3a1ce92f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:55.735805   431 raft_consensus.cc:2272] T 13ef79ebfe4f45b9bd9763de63a3e15a P bd1c07cda9da4436b69174af3a1ce92f [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:55.735981 11969 consensus_peers.cc:597] T 03ae675fe38f4f2b96936940980c1ee9 P 367d36143adf465b950244c6baa620a5 -> Peer bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131): Couldn't send request to peer bd1c07cda9da4436b69174af3a1ce92f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:55.738189   431 tablet_replica.cc:333] T 0fd34026fbe142c0898fd7ec29688648 P bd1c07cda9da4436b69174af3a1ce92f: stopping tablet replica
I20260709 13:03:55.738946   431 raft_consensus.cc:2243] T 0fd34026fbe142c0898fd7ec29688648 P bd1c07cda9da4436b69174af3a1ce92f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:55.739419   431 raft_consensus.cc:2272] T 0fd34026fbe142c0898fd7ec29688648 P bd1c07cda9da4436b69174af3a1ce92f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.741773   431 tablet_replica.cc:333] T 0ac98551cc1c458e8e95be2e9f1ddeac P bd1c07cda9da4436b69174af3a1ce92f: stopping tablet replica
I20260709 13:03:55.742440   431 raft_consensus.cc:2243] T 0ac98551cc1c458e8e95be2e9f1ddeac P bd1c07cda9da4436b69174af3a1ce92f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:55.742900   431 raft_consensus.cc:2272] T 0ac98551cc1c458e8e95be2e9f1ddeac P bd1c07cda9da4436b69174af3a1ce92f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.745164   431 tablet_replica.cc:333] T b8baeafde60b486094f5139efec7eca0 P bd1c07cda9da4436b69174af3a1ce92f: stopping tablet replica
I20260709 13:03:55.745877   431 raft_consensus.cc:2243] T b8baeafde60b486094f5139efec7eca0 P bd1c07cda9da4436b69174af3a1ce92f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:55.746769   431 raft_consensus.cc:2272] T b8baeafde60b486094f5139efec7eca0 P bd1c07cda9da4436b69174af3a1ce92f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.749468   431 tablet_replica.cc:333] T 175f2fe459f4455386cac7de26d34679 P bd1c07cda9da4436b69174af3a1ce92f: stopping tablet replica
I20260709 13:03:55.750032   431 raft_consensus.cc:2243] T 175f2fe459f4455386cac7de26d34679 P bd1c07cda9da4436b69174af3a1ce92f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:55.750499   431 raft_consensus.cc:2272] T 175f2fe459f4455386cac7de26d34679 P bd1c07cda9da4436b69174af3a1ce92f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.752588   431 tablet_replica.cc:333] T 95bf609349e54fdd867e40d7fd578e52 P bd1c07cda9da4436b69174af3a1ce92f: stopping tablet replica
I20260709 13:03:55.753136   431 raft_consensus.cc:2243] T 95bf609349e54fdd867e40d7fd578e52 P bd1c07cda9da4436b69174af3a1ce92f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:55.753528   431 raft_consensus.cc:2272] T 95bf609349e54fdd867e40d7fd578e52 P bd1c07cda9da4436b69174af3a1ce92f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.756049   431 tablet_replica.cc:333] T d2a9a34c1be443a69f95f8f237dc4116 P bd1c07cda9da4436b69174af3a1ce92f: stopping tablet replica
I20260709 13:03:55.756647   431 raft_consensus.cc:2243] T d2a9a34c1be443a69f95f8f237dc4116 P bd1c07cda9da4436b69174af3a1ce92f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:55.757081   431 raft_consensus.cc:2272] T d2a9a34c1be443a69f95f8f237dc4116 P bd1c07cda9da4436b69174af3a1ce92f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.759179   431 tablet_replica.cc:333] T 7f973c97455b4d918d353553cbe194a9 P bd1c07cda9da4436b69174af3a1ce92f: stopping tablet replica
I20260709 13:03:55.759927   431 raft_consensus.cc:2243] T 7f973c97455b4d918d353553cbe194a9 P bd1c07cda9da4436b69174af3a1ce92f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:55.760536   431 raft_consensus.cc:2272] T 7f973c97455b4d918d353553cbe194a9 P bd1c07cda9da4436b69174af3a1ce92f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.763682   431 tablet_replica.cc:333] T bda83ed4e6b84bf9985ad11c37b2bd59 P bd1c07cda9da4436b69174af3a1ce92f: stopping tablet replica
I20260709 13:03:55.764487   431 raft_consensus.cc:2243] T bda83ed4e6b84bf9985ad11c37b2bd59 P bd1c07cda9da4436b69174af3a1ce92f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:55.765125   431 raft_consensus.cc:2272] T bda83ed4e6b84bf9985ad11c37b2bd59 P bd1c07cda9da4436b69174af3a1ce92f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.767552   431 tablet_replica.cc:333] T b5d801f325be415db1d2961ed3876b90 P bd1c07cda9da4436b69174af3a1ce92f: stopping tablet replica
I20260709 13:03:55.768155   431 raft_consensus.cc:2243] T b5d801f325be415db1d2961ed3876b90 P bd1c07cda9da4436b69174af3a1ce92f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:55.768734   431 raft_consensus.cc:2272] T b5d801f325be415db1d2961ed3876b90 P bd1c07cda9da4436b69174af3a1ce92f [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:55.770248 12043 consensus_peers.cc:597] T 95bf609349e54fdd867e40d7fd578e52 P 8dfed99448174185ba5ece679e9d90be -> Peer bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131): Couldn't send request to peer bd1c07cda9da4436b69174af3a1ce92f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:55.771083   431 tablet_replica.cc:333] T a846ec1843bc4dbca0df61be2992759d P bd1c07cda9da4436b69174af3a1ce92f: stopping tablet replica
I20260709 13:03:55.771705   431 raft_consensus.cc:2243] T a846ec1843bc4dbca0df61be2992759d P bd1c07cda9da4436b69174af3a1ce92f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:55.772095   431 raft_consensus.cc:2272] T a846ec1843bc4dbca0df61be2992759d P bd1c07cda9da4436b69174af3a1ce92f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.774783   431 tablet_replica.cc:333] T 196209061a514376bb68b340c922a883 P bd1c07cda9da4436b69174af3a1ce92f: stopping tablet replica
I20260709 13:03:55.775308   431 raft_consensus.cc:2243] T 196209061a514376bb68b340c922a883 P bd1c07cda9da4436b69174af3a1ce92f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:55.776237   431 raft_consensus.cc:2272] T 196209061a514376bb68b340c922a883 P bd1c07cda9da4436b69174af3a1ce92f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.779101   431 tablet_replica.cc:333] T 8b0eaec7710c47e79cc78a1085de9b3f P bd1c07cda9da4436b69174af3a1ce92f: stopping tablet replica
I20260709 13:03:55.779680   431 raft_consensus.cc:2243] T 8b0eaec7710c47e79cc78a1085de9b3f P bd1c07cda9da4436b69174af3a1ce92f [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:03:55.779866 11969 consensus_peers.cc:597] T 0fd34026fbe142c0898fd7ec29688648 P 367d36143adf465b950244c6baa620a5 -> Peer bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131): Couldn't send request to peer bd1c07cda9da4436b69174af3a1ce92f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:55.780591   431 raft_consensus.cc:2272] T 8b0eaec7710c47e79cc78a1085de9b3f P bd1c07cda9da4436b69174af3a1ce92f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.783010   431 tablet_replica.cc:333] T 03ae675fe38f4f2b96936940980c1ee9 P bd1c07cda9da4436b69174af3a1ce92f: stopping tablet replica
I20260709 13:03:55.783551   431 raft_consensus.cc:2243] T 03ae675fe38f4f2b96936940980c1ee9 P bd1c07cda9da4436b69174af3a1ce92f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:55.783962   431 raft_consensus.cc:2272] T 03ae675fe38f4f2b96936940980c1ee9 P bd1c07cda9da4436b69174af3a1ce92f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.786103   431 tablet_replica.cc:333] T 5078275d4ea64e67bf0a061eb3011157 P bd1c07cda9da4436b69174af3a1ce92f: stopping tablet replica
I20260709 13:03:55.786710   431 raft_consensus.cc:2243] T 5078275d4ea64e67bf0a061eb3011157 P bd1c07cda9da4436b69174af3a1ce92f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:55.787305   431 raft_consensus.cc:2272] T 5078275d4ea64e67bf0a061eb3011157 P bd1c07cda9da4436b69174af3a1ce92f [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:55.816083 11895 connection.cc:466] server connection from 127.0.0.1:46202 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46202 (request call id 84) could send its response
W20260709 13:03:55.821168 12043 consensus_peers.cc:597] T d2a9a34c1be443a69f95f8f237dc4116 P 8dfed99448174185ba5ece679e9d90be -> Peer bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131): Couldn't send request to peer bd1c07cda9da4436b69174af3a1ce92f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:46131: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:55.824124   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
I20260709 13:03:55.858367   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
W20260709 13:03:55.876194 11969 consensus_peers.cc:597] T 0ac98551cc1c458e8e95be2e9f1ddeac P 367d36143adf465b950244c6baa620a5 -> Peer bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131): Couldn't send request to peer bd1c07cda9da4436b69174af3a1ce92f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:46131: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:55.887681   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:55.888500   431 tablet_replica.cc:333] T 13ef79ebfe4f45b9bd9763de63a3e15a P 367d36143adf465b950244c6baa620a5: stopping tablet replica
I20260709 13:03:55.889495   431 raft_consensus.cc:2243] T 13ef79ebfe4f45b9bd9763de63a3e15a P 367d36143adf465b950244c6baa620a5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:55.890180   431 raft_consensus.cc:2272] T 13ef79ebfe4f45b9bd9763de63a3e15a P 367d36143adf465b950244c6baa620a5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.892877   431 tablet_replica.cc:333] T 93c0155ffb2b44fab1eed91e0025ef62 P 367d36143adf465b950244c6baa620a5: stopping tablet replica
I20260709 13:03:55.893515   431 raft_consensus.cc:2243] T 93c0155ffb2b44fab1eed91e0025ef62 P 367d36143adf465b950244c6baa620a5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:55.893972   431 raft_consensus.cc:2272] T 93c0155ffb2b44fab1eed91e0025ef62 P 367d36143adf465b950244c6baa620a5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.896122   431 tablet_replica.cc:333] T b5d801f325be415db1d2961ed3876b90 P 367d36143adf465b950244c6baa620a5: stopping tablet replica
I20260709 13:03:55.896703   431 raft_consensus.cc:2243] T b5d801f325be415db1d2961ed3876b90 P 367d36143adf465b950244c6baa620a5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:55.897507   431 raft_consensus.cc:2272] T b5d801f325be415db1d2961ed3876b90 P 367d36143adf465b950244c6baa620a5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.899895   431 tablet_replica.cc:333] T 0ac98551cc1c458e8e95be2e9f1ddeac P 367d36143adf465b950244c6baa620a5: stopping tablet replica
I20260709 13:03:55.900486   431 raft_consensus.cc:2243] T 0ac98551cc1c458e8e95be2e9f1ddeac P 367d36143adf465b950244c6baa620a5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:55.901448   431 raft_consensus.cc:2272] T 0ac98551cc1c458e8e95be2e9f1ddeac P 367d36143adf465b950244c6baa620a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.903685   431 tablet_replica.cc:333] T 0fd34026fbe142c0898fd7ec29688648 P 367d36143adf465b950244c6baa620a5: stopping tablet replica
I20260709 13:03:55.904279   431 raft_consensus.cc:2243] T 0fd34026fbe142c0898fd7ec29688648 P 367d36143adf465b950244c6baa620a5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:55.905059   431 raft_consensus.cc:2272] T 0fd34026fbe142c0898fd7ec29688648 P 367d36143adf465b950244c6baa620a5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.907274   431 tablet_replica.cc:333] T d2a9a34c1be443a69f95f8f237dc4116 P 367d36143adf465b950244c6baa620a5: stopping tablet replica
I20260709 13:03:55.907882   431 raft_consensus.cc:2243] T d2a9a34c1be443a69f95f8f237dc4116 P 367d36143adf465b950244c6baa620a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:55.908329   431 raft_consensus.cc:2272] T d2a9a34c1be443a69f95f8f237dc4116 P 367d36143adf465b950244c6baa620a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.910305   431 tablet_replica.cc:333] T 7f973c97455b4d918d353553cbe194a9 P 367d36143adf465b950244c6baa620a5: stopping tablet replica
I20260709 13:03:55.910933   431 raft_consensus.cc:2243] T 7f973c97455b4d918d353553cbe194a9 P 367d36143adf465b950244c6baa620a5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:55.911751   431 raft_consensus.cc:2272] T 7f973c97455b4d918d353553cbe194a9 P 367d36143adf465b950244c6baa620a5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.913923   431 tablet_replica.cc:333] T 65544e18a6944de89c1560f44aaf32ec P 367d36143adf465b950244c6baa620a5: stopping tablet replica
I20260709 13:03:55.914441   431 raft_consensus.cc:2243] T 65544e18a6944de89c1560f44aaf32ec P 367d36143adf465b950244c6baa620a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:55.914897   431 raft_consensus.cc:2272] T 65544e18a6944de89c1560f44aaf32ec P 367d36143adf465b950244c6baa620a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.916857   431 tablet_replica.cc:333] T 175f2fe459f4455386cac7de26d34679 P 367d36143adf465b950244c6baa620a5: stopping tablet replica
I20260709 13:03:55.917388   431 raft_consensus.cc:2243] T 175f2fe459f4455386cac7de26d34679 P 367d36143adf465b950244c6baa620a5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:55.918112   431 raft_consensus.cc:2272] T 175f2fe459f4455386cac7de26d34679 P 367d36143adf465b950244c6baa620a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.920047   431 tablet_replica.cc:333] T 95bf609349e54fdd867e40d7fd578e52 P 367d36143adf465b950244c6baa620a5: stopping tablet replica
I20260709 13:03:55.920575   431 raft_consensus.cc:2243] T 95bf609349e54fdd867e40d7fd578e52 P 367d36143adf465b950244c6baa620a5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:55.920974   431 raft_consensus.cc:2272] T 95bf609349e54fdd867e40d7fd578e52 P 367d36143adf465b950244c6baa620a5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.923647   431 tablet_replica.cc:333] T a846ec1843bc4dbca0df61be2992759d P 367d36143adf465b950244c6baa620a5: stopping tablet replica
I20260709 13:03:55.924203   431 raft_consensus.cc:2243] T a846ec1843bc4dbca0df61be2992759d P 367d36143adf465b950244c6baa620a5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:55.924618   431 raft_consensus.cc:2272] T a846ec1843bc4dbca0df61be2992759d P 367d36143adf465b950244c6baa620a5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.927237   431 tablet_replica.cc:333] T 196209061a514376bb68b340c922a883 P 367d36143adf465b950244c6baa620a5: stopping tablet replica
I20260709 13:03:55.927780   431 raft_consensus.cc:2243] T 196209061a514376bb68b340c922a883 P 367d36143adf465b950244c6baa620a5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:55.928231   431 raft_consensus.cc:2272] T 196209061a514376bb68b340c922a883 P 367d36143adf465b950244c6baa620a5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.930282   431 tablet_replica.cc:333] T bda83ed4e6b84bf9985ad11c37b2bd59 P 367d36143adf465b950244c6baa620a5: stopping tablet replica
I20260709 13:03:55.930840   431 raft_consensus.cc:2243] T bda83ed4e6b84bf9985ad11c37b2bd59 P 367d36143adf465b950244c6baa620a5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:55.931602   431 raft_consensus.cc:2272] T bda83ed4e6b84bf9985ad11c37b2bd59 P 367d36143adf465b950244c6baa620a5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.933614   431 tablet_replica.cc:333] T 03ae675fe38f4f2b96936940980c1ee9 P 367d36143adf465b950244c6baa620a5: stopping tablet replica
I20260709 13:03:55.934088   431 raft_consensus.cc:2243] T 03ae675fe38f4f2b96936940980c1ee9 P 367d36143adf465b950244c6baa620a5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:55.934892   431 raft_consensus.cc:2272] T 03ae675fe38f4f2b96936940980c1ee9 P 367d36143adf465b950244c6baa620a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.936988   431 tablet_replica.cc:333] T 8b0eaec7710c47e79cc78a1085de9b3f P 367d36143adf465b950244c6baa620a5: stopping tablet replica
I20260709 13:03:55.937515   431 raft_consensus.cc:2243] T 8b0eaec7710c47e79cc78a1085de9b3f P 367d36143adf465b950244c6baa620a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:55.937911   431 raft_consensus.cc:2272] T 8b0eaec7710c47e79cc78a1085de9b3f P 367d36143adf465b950244c6baa620a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.940088   431 tablet_replica.cc:333] T 5078275d4ea64e67bf0a061eb3011157 P 367d36143adf465b950244c6baa620a5: stopping tablet replica
I20260709 13:03:55.940553   431 raft_consensus.cc:2243] T 5078275d4ea64e67bf0a061eb3011157 P 367d36143adf465b950244c6baa620a5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:55.940974   431 raft_consensus.cc:2272] T 5078275d4ea64e67bf0a061eb3011157 P 367d36143adf465b950244c6baa620a5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.942924   431 tablet_replica.cc:333] T b71ba69388bf42a88deaf32615d3b1b6 P 367d36143adf465b950244c6baa620a5: stopping tablet replica
I20260709 13:03:55.943410   431 raft_consensus.cc:2243] T b71ba69388bf42a88deaf32615d3b1b6 P 367d36143adf465b950244c6baa620a5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:55.943867   431 raft_consensus.cc:2272] T b71ba69388bf42a88deaf32615d3b1b6 P 367d36143adf465b950244c6baa620a5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.945816   431 tablet_replica.cc:333] T b8baeafde60b486094f5139efec7eca0 P 367d36143adf465b950244c6baa620a5: stopping tablet replica
I20260709 13:03:55.946306   431 raft_consensus.cc:2243] T b8baeafde60b486094f5139efec7eca0 P 367d36143adf465b950244c6baa620a5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:55.946791   431 raft_consensus.cc:2272] T b8baeafde60b486094f5139efec7eca0 P 367d36143adf465b950244c6baa620a5 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:56.192845 12042 consensus_peers.cc:597] T 5078275d4ea64e67bf0a061eb3011157 P 8dfed99448174185ba5ece679e9d90be -> Peer 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337): Couldn't send request to peer 367d36143adf465b950244c6baa620a5. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46337: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:56.201576 12042 consensus_peers.cc:597] T d2a9a34c1be443a69f95f8f237dc4116 P 8dfed99448174185ba5ece679e9d90be -> Peer 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337): Couldn't send request to peer 367d36143adf465b950244c6baa620a5. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46337: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:56.208197 12042 consensus_peers.cc:597] T 95bf609349e54fdd867e40d7fd578e52 P 8dfed99448174185ba5ece679e9d90be -> Peer 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337): Couldn't send request to peer 367d36143adf465b950244c6baa620a5. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46337: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:56.364812 12042 consensus_peers.cc:597] T a846ec1843bc4dbca0df61be2992759d P 8dfed99448174185ba5ece679e9d90be -> Peer 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337): Couldn't send request to peer 367d36143adf465b950244c6baa620a5. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46337: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:56.674041 12025 debug-util.cc:398] Leaking SignalData structure 0x7b080032f6a0 after lost signal to thread 434
W20260709 13:03:56.675215 12025 debug-util.cc:398] Leaking SignalData structure 0x7b08000aee40 after lost signal to thread 11861
W20260709 13:03:56.677320 12025 debug-util.cc:398] Leaking SignalData structure 0x7b0800230780 after lost signal to thread 12102
I20260709 13:03:56.716166 12361 raft_consensus.cc:493] T 65544e18a6944de89c1560f44aaf32ec P 8dfed99448174185ba5ece679e9d90be [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bd1c07cda9da4436b69174af3a1ce92f)
I20260709 13:03:56.716745 12361 raft_consensus.cc:515] T 65544e18a6944de89c1560f44aaf32ec P 8dfed99448174185ba5ece679e9d90be [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:56.718356 12361 leader_election.cc:290] T 65544e18a6944de89c1560f44aaf32ec P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131), 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337)
W20260709 13:03:56.722512 12043 leader_election.cc:336] T 65544e18a6944de89c1560f44aaf32ec P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131): Network error: Client connection negotiation failed: client connection to 127.0.107.193:46131: connect: Connection refused (error 111)
W20260709 13:03:56.723074 12042 leader_election.cc:336] T 65544e18a6944de89c1560f44aaf32ec P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46337: connect: Connection refused (error 111)
I20260709 13:03:56.723416 12042 leader_election.cc:304] T 65544e18a6944de89c1560f44aaf32ec P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dfed99448174185ba5ece679e9d90be; no voters: 367d36143adf465b950244c6baa620a5, bd1c07cda9da4436b69174af3a1ce92f
I20260709 13:03:56.723971 12361 raft_consensus.cc:2749] T 65544e18a6944de89c1560f44aaf32ec P 8dfed99448174185ba5ece679e9d90be [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:56.897360 12382 raft_consensus.cc:493] T b8baeafde60b486094f5139efec7eca0 P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bd1c07cda9da4436b69174af3a1ce92f)
I20260709 13:03:56.897876 12382 raft_consensus.cc:515] T b8baeafde60b486094f5139efec7eca0 P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:56.899832 12382 leader_election.cc:290] T b8baeafde60b486094f5139efec7eca0 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131), 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337)
W20260709 13:03:56.903744 12043 leader_election.cc:336] T b8baeafde60b486094f5139efec7eca0 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131): Network error: Client connection negotiation failed: client connection to 127.0.107.193:46131: connect: Connection refused (error 111)
W20260709 13:03:56.905498 12042 leader_election.cc:336] T b8baeafde60b486094f5139efec7eca0 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46337: connect: Connection refused (error 111)
I20260709 13:03:56.905826 12042 leader_election.cc:304] T b8baeafde60b486094f5139efec7eca0 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dfed99448174185ba5ece679e9d90be; no voters: 367d36143adf465b950244c6baa620a5, bd1c07cda9da4436b69174af3a1ce92f
I20260709 13:03:56.906400 12361 raft_consensus.cc:2749] T b8baeafde60b486094f5139efec7eca0 P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:56.913226 12361 raft_consensus.cc:493] T 175f2fe459f4455386cac7de26d34679 P 8dfed99448174185ba5ece679e9d90be [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 367d36143adf465b950244c6baa620a5)
I20260709 13:03:56.913673 12361 raft_consensus.cc:515] T 175f2fe459f4455386cac7de26d34679 P 8dfed99448174185ba5ece679e9d90be [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:56.915458 12361 leader_election.cc:290] T 175f2fe459f4455386cac7de26d34679 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131), 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337)
W20260709 13:03:56.919374 12043 leader_election.cc:336] T 175f2fe459f4455386cac7de26d34679 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131): Network error: Client connection negotiation failed: client connection to 127.0.107.193:46131: connect: Connection refused (error 111)
W20260709 13:03:56.919835 12042 leader_election.cc:336] T 175f2fe459f4455386cac7de26d34679 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46337: connect: Connection refused (error 111)
I20260709 13:03:56.920176 12042 leader_election.cc:304] T 175f2fe459f4455386cac7de26d34679 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dfed99448174185ba5ece679e9d90be; no voters: 367d36143adf465b950244c6baa620a5, bd1c07cda9da4436b69174af3a1ce92f
I20260709 13:03:56.920763 12361 raft_consensus.cc:2749] T 175f2fe459f4455386cac7de26d34679 P 8dfed99448174185ba5ece679e9d90be [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:56.957795 12361 raft_consensus.cc:493] T 03ae675fe38f4f2b96936940980c1ee9 P 8dfed99448174185ba5ece679e9d90be [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 367d36143adf465b950244c6baa620a5)
I20260709 13:03:56.958323 12361 raft_consensus.cc:515] T 03ae675fe38f4f2b96936940980c1ee9 P 8dfed99448174185ba5ece679e9d90be [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:56.960466 12361 leader_election.cc:290] T 03ae675fe38f4f2b96936940980c1ee9 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131), 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337)
W20260709 13:03:56.963940 12043 leader_election.cc:336] T 03ae675fe38f4f2b96936940980c1ee9 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131): Network error: Client connection negotiation failed: client connection to 127.0.107.193:46131: connect: Connection refused (error 111)
W20260709 13:03:56.965101 12042 leader_election.cc:336] T 03ae675fe38f4f2b96936940980c1ee9 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46337: connect: Connection refused (error 111)
I20260709 13:03:56.965421 12042 leader_election.cc:304] T 03ae675fe38f4f2b96936940980c1ee9 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dfed99448174185ba5ece679e9d90be; no voters: 367d36143adf465b950244c6baa620a5, bd1c07cda9da4436b69174af3a1ce92f
I20260709 13:03:56.965989 12361 raft_consensus.cc:2749] T 03ae675fe38f4f2b96936940980c1ee9 P 8dfed99448174185ba5ece679e9d90be [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:03:56.983824   431 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 12025)
I20260709 13:03:57.025588 12361 raft_consensus.cc:493] T 7f973c97455b4d918d353553cbe194a9 P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 367d36143adf465b950244c6baa620a5)
I20260709 13:03:57.026149 12361 raft_consensus.cc:515] T 7f973c97455b4d918d353553cbe194a9 P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:57.027876 12361 leader_election.cc:290] T 7f973c97455b4d918d353553cbe194a9 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131), 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337)
W20260709 13:03:57.031831 12042 leader_election.cc:336] T 7f973c97455b4d918d353553cbe194a9 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46337: connect: Connection refused (error 111)
W20260709 13:03:57.032387 12043 leader_election.cc:336] T 7f973c97455b4d918d353553cbe194a9 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131): Network error: Client connection negotiation failed: client connection to 127.0.107.193:46131: connect: Connection refused (error 111)
I20260709 13:03:57.032829 12043 leader_election.cc:304] T 7f973c97455b4d918d353553cbe194a9 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dfed99448174185ba5ece679e9d90be; no voters: 367d36143adf465b950244c6baa620a5, bd1c07cda9da4436b69174af3a1ce92f
I20260709 13:03:57.033517 12361 raft_consensus.cc:2749] T 7f973c97455b4d918d353553cbe194a9 P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:57.040792 12361 raft_consensus.cc:493] T 8b0eaec7710c47e79cc78a1085de9b3f P 8dfed99448174185ba5ece679e9d90be [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bd1c07cda9da4436b69174af3a1ce92f)
I20260709 13:03:57.041257 12361 raft_consensus.cc:515] T 8b0eaec7710c47e79cc78a1085de9b3f P 8dfed99448174185ba5ece679e9d90be [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } }
I20260709 13:03:57.043051 12361 leader_election.cc:290] T 8b0eaec7710c47e79cc78a1085de9b3f P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337), bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131)
W20260709 13:03:57.046689 12042 leader_election.cc:336] T 8b0eaec7710c47e79cc78a1085de9b3f P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46337: connect: Connection refused (error 111)
W20260709 13:03:57.047276 12043 leader_election.cc:336] T 8b0eaec7710c47e79cc78a1085de9b3f P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131): Network error: Client connection negotiation failed: client connection to 127.0.107.193:46131: connect: Connection refused (error 111)
I20260709 13:03:57.047583 12043 leader_election.cc:304] T 8b0eaec7710c47e79cc78a1085de9b3f P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dfed99448174185ba5ece679e9d90be; no voters: 367d36143adf465b950244c6baa620a5, bd1c07cda9da4436b69174af3a1ce92f
I20260709 13:03:57.048123 12361 raft_consensus.cc:2749] T 8b0eaec7710c47e79cc78a1085de9b3f P 8dfed99448174185ba5ece679e9d90be [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:57.139357 12361 raft_consensus.cc:493] T 0fd34026fbe142c0898fd7ec29688648 P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 367d36143adf465b950244c6baa620a5)
I20260709 13:03:57.139827 12361 raft_consensus.cc:515] T 0fd34026fbe142c0898fd7ec29688648 P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:57.141660 12361 leader_election.cc:290] T 0fd34026fbe142c0898fd7ec29688648 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131), 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337)
I20260709 13:03:57.144459 12361 raft_consensus.cc:493] T 13ef79ebfe4f45b9bd9763de63a3e15a P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bd1c07cda9da4436b69174af3a1ce92f)
I20260709 13:03:57.144984 12361 raft_consensus.cc:515] T 13ef79ebfe4f45b9bd9763de63a3e15a P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:57.147127 12361 leader_election.cc:290] T 13ef79ebfe4f45b9bd9763de63a3e15a P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131), 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337)
I20260709 13:03:57.147197 12382 raft_consensus.cc:493] T 196209061a514376bb68b340c922a883 P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bd1c07cda9da4436b69174af3a1ce92f)
W20260709 13:03:57.147879 12042 leader_election.cc:336] T 0fd34026fbe142c0898fd7ec29688648 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46337: connect: Connection refused (error 111)
I20260709 13:03:57.147742 12382 raft_consensus.cc:515] T 196209061a514376bb68b340c922a883 P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:57.149739 12382 leader_election.cc:290] T 196209061a514376bb68b340c922a883 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131), 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337)
I20260709 13:03:57.150902 12382 raft_consensus.cc:493] T b71ba69388bf42a88deaf32615d3b1b6 P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bd1c07cda9da4436b69174af3a1ce92f)
I20260709 13:03:57.151448 12382 raft_consensus.cc:515] T b71ba69388bf42a88deaf32615d3b1b6 P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
W20260709 13:03:57.153290 12043 leader_election.cc:336] T 0fd34026fbe142c0898fd7ec29688648 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131): Network error: Client connection negotiation failed: client connection to 127.0.107.193:46131: connect: Connection refused (error 111)
I20260709 13:03:57.153493 12382 leader_election.cc:290] T b71ba69388bf42a88deaf32615d3b1b6 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131), 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337)
I20260709 13:03:57.153784 12043 leader_election.cc:304] T 0fd34026fbe142c0898fd7ec29688648 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dfed99448174185ba5ece679e9d90be; no voters: 367d36143adf465b950244c6baa620a5, bd1c07cda9da4436b69174af3a1ce92f
I20260709 13:03:57.154608 12382 raft_consensus.cc:2749] T 0fd34026fbe142c0898fd7ec29688648 P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:03:57.156497 12042 leader_election.cc:336] T 13ef79ebfe4f45b9bd9763de63a3e15a P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46337: connect: Connection refused (error 111)
W20260709 13:03:57.156967 12042 leader_election.cc:336] T 196209061a514376bb68b340c922a883 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46337: connect: Connection refused (error 111)
W20260709 13:03:57.156962 12043 leader_election.cc:336] T 13ef79ebfe4f45b9bd9763de63a3e15a P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131): Network error: Client connection negotiation failed: client connection to 127.0.107.193:46131: connect: Connection refused (error 111)
I20260709 13:03:57.157510 12043 leader_election.cc:304] T 13ef79ebfe4f45b9bd9763de63a3e15a P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dfed99448174185ba5ece679e9d90be; no voters: 367d36143adf465b950244c6baa620a5, bd1c07cda9da4436b69174af3a1ce92f
I20260709 13:03:57.158233 12382 raft_consensus.cc:2749] T 13ef79ebfe4f45b9bd9763de63a3e15a P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:03:57.158385 12043 leader_election.cc:336] T 196209061a514376bb68b340c922a883 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131): Network error: Client connection negotiation failed: client connection to 127.0.107.193:46131: connect: Connection refused (error 111)
W20260709 13:03:57.159004 12042 leader_election.cc:336] T b71ba69388bf42a88deaf32615d3b1b6 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46337: connect: Connection refused (error 111)
I20260709 13:03:57.158946 12043 leader_election.cc:304] T 196209061a514376bb68b340c922a883 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dfed99448174185ba5ece679e9d90be; no voters: 367d36143adf465b950244c6baa620a5, bd1c07cda9da4436b69174af3a1ce92f
I20260709 13:03:57.159722 12382 raft_consensus.cc:2749] T 196209061a514376bb68b340c922a883 P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:03:57.161870 12043 leader_election.cc:336] T b71ba69388bf42a88deaf32615d3b1b6 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131): Network error: Client connection negotiation failed: client connection to 127.0.107.193:46131: connect: Connection refused (error 111)
I20260709 13:03:57.162213 12043 leader_election.cc:304] T b71ba69388bf42a88deaf32615d3b1b6 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dfed99448174185ba5ece679e9d90be; no voters: 367d36143adf465b950244c6baa620a5, bd1c07cda9da4436b69174af3a1ce92f
I20260709 13:03:57.162766 12382 raft_consensus.cc:2749] T b71ba69388bf42a88deaf32615d3b1b6 P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:57.205957 12382 raft_consensus.cc:493] T 93c0155ffb2b44fab1eed91e0025ef62 P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bd1c07cda9da4436b69174af3a1ce92f)
I20260709 13:03:57.206421 12382 raft_consensus.cc:515] T 93c0155ffb2b44fab1eed91e0025ef62 P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:57.208292 12382 leader_election.cc:290] T 93c0155ffb2b44fab1eed91e0025ef62 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131), 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337)
W20260709 13:03:57.212189 12043 leader_election.cc:336] T 93c0155ffb2b44fab1eed91e0025ef62 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131): Network error: Client connection negotiation failed: client connection to 127.0.107.193:46131: connect: Connection refused (error 111)
W20260709 13:03:57.212795 12042 leader_election.cc:336] T 93c0155ffb2b44fab1eed91e0025ef62 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46337: connect: Connection refused (error 111)
I20260709 13:03:57.213097 12042 leader_election.cc:304] T 93c0155ffb2b44fab1eed91e0025ef62 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dfed99448174185ba5ece679e9d90be; no voters: 367d36143adf465b950244c6baa620a5, bd1c07cda9da4436b69174af3a1ce92f
I20260709 13:03:57.213689 12382 raft_consensus.cc:2749] T 93c0155ffb2b44fab1eed91e0025ef62 P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:57.214581 12382 raft_consensus.cc:493] T b5d801f325be415db1d2961ed3876b90 P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 367d36143adf465b950244c6baa620a5)
I20260709 13:03:57.215008 12382 raft_consensus.cc:515] T b5d801f325be415db1d2961ed3876b90 P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:57.216801 12361 raft_consensus.cc:493] T 0ac98551cc1c458e8e95be2e9f1ddeac P 8dfed99448174185ba5ece679e9d90be [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 367d36143adf465b950244c6baa620a5)
I20260709 13:03:57.217371 12361 raft_consensus.cc:515] T 0ac98551cc1c458e8e95be2e9f1ddeac P 8dfed99448174185ba5ece679e9d90be [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:57.219658 12361 leader_election.cc:290] T 0ac98551cc1c458e8e95be2e9f1ddeac P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131), 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337)
I20260709 13:03:57.221819 12382 leader_election.cc:290] T b5d801f325be415db1d2961ed3876b90 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131), 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337)
W20260709 13:03:57.222220 12043 leader_election.cc:336] T b5d801f325be415db1d2961ed3876b90 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131): Network error: Client connection negotiation failed: client connection to 127.0.107.193:46131: connect: Connection refused (error 111)
W20260709 13:03:57.224841 12043 leader_election.cc:336] T 0ac98551cc1c458e8e95be2e9f1ddeac P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131): Network error: Client connection negotiation failed: client connection to 127.0.107.193:46131: connect: Connection refused (error 111)
W20260709 13:03:57.225261 12042 leader_election.cc:336] T b5d801f325be415db1d2961ed3876b90 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46337: connect: Connection refused (error 111)
I20260709 13:03:57.225615 12382 raft_consensus.cc:493] T bda83ed4e6b84bf9985ad11c37b2bd59 P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 367d36143adf465b950244c6baa620a5)
I20260709 13:03:57.225805 12042 leader_election.cc:304] T b5d801f325be415db1d2961ed3876b90 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dfed99448174185ba5ece679e9d90be; no voters: 367d36143adf465b950244c6baa620a5, bd1c07cda9da4436b69174af3a1ce92f
I20260709 13:03:57.226145 12382 raft_consensus.cc:515] T bda83ed4e6b84bf9985ad11c37b2bd59 P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:57.226558 12361 raft_consensus.cc:2749] T b5d801f325be415db1d2961ed3876b90 P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:03:57.226751 12042 leader_election.cc:336] T 0ac98551cc1c458e8e95be2e9f1ddeac P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46337: connect: Connection refused (error 111)
I20260709 13:03:57.228039 12042 leader_election.cc:304] T 0ac98551cc1c458e8e95be2e9f1ddeac P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dfed99448174185ba5ece679e9d90be; no voters: 367d36143adf465b950244c6baa620a5, bd1c07cda9da4436b69174af3a1ce92f
I20260709 13:03:57.228706 12361 raft_consensus.cc:2749] T 0ac98551cc1c458e8e95be2e9f1ddeac P 8dfed99448174185ba5ece679e9d90be [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:57.229342 12382 leader_election.cc:290] T bda83ed4e6b84bf9985ad11c37b2bd59 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131), 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337)
W20260709 13:03:57.233317 12042 leader_election.cc:336] T bda83ed4e6b84bf9985ad11c37b2bd59 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46337: connect: Connection refused (error 111)
W20260709 13:03:57.233826 12043 leader_election.cc:336] T bda83ed4e6b84bf9985ad11c37b2bd59 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131): Network error: Client connection negotiation failed: client connection to 127.0.107.193:46131: connect: Connection refused (error 111)
I20260709 13:03:57.234237 12043 leader_election.cc:304] T bda83ed4e6b84bf9985ad11c37b2bd59 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dfed99448174185ba5ece679e9d90be; no voters: 367d36143adf465b950244c6baa620a5, bd1c07cda9da4436b69174af3a1ce92f
I20260709 13:03:57.234922 12382 raft_consensus.cc:2749] T bda83ed4e6b84bf9985ad11c37b2bd59 P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:03:57.379900 11858 debug-util.cc:398] Leaking SignalData structure 0x7b08003fb880 after lost signal to thread 434
W20260709 13:03:57.381057 11858 debug-util.cc:398] Leaking SignalData structure 0x7b08002960a0 after lost signal to thread 11861
W20260709 13:03:57.382377 11858 debug-util.cc:398] Leaking SignalData structure 0x7b08001065e0 after lost signal to thread 12102
W20260709 13:03:57.984400   431 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 12025)
W20260709 13:03:58.138700 12043 consensus_peers.cc:597] T 5078275d4ea64e67bf0a061eb3011157 P 8dfed99448174185ba5ece679e9d90be -> Peer bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131): Couldn't send request to peer bd1c07cda9da4436b69174af3a1ce92f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:46131: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:58.280297 12043 consensus_peers.cc:597] T a846ec1843bc4dbca0df61be2992759d P 8dfed99448174185ba5ece679e9d90be -> Peer bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131): Couldn't send request to peer bd1c07cda9da4436b69174af3a1ce92f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:46131: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:58.395460 12043 consensus_peers.cc:597] T 95bf609349e54fdd867e40d7fd578e52 P 8dfed99448174185ba5ece679e9d90be -> Peer bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131): Couldn't send request to peer bd1c07cda9da4436b69174af3a1ce92f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:46131: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:58.532951 12043 consensus_peers.cc:597] T d2a9a34c1be443a69f95f8f237dc4116 P 8dfed99448174185ba5ece679e9d90be -> Peer bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131): Couldn't send request to peer bd1c07cda9da4436b69174af3a1ce92f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:46131: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:58.726305 12042 consensus_peers.cc:597] T a846ec1843bc4dbca0df61be2992759d P 8dfed99448174185ba5ece679e9d90be -> Peer 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337): Couldn't send request to peer 367d36143adf465b950244c6baa620a5. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46337: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:58.746804 12382 raft_consensus.cc:493] T 175f2fe459f4455386cac7de26d34679 P 8dfed99448174185ba5ece679e9d90be [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 367d36143adf465b950244c6baa620a5)
I20260709 13:03:58.747416 12382 raft_consensus.cc:515] T 175f2fe459f4455386cac7de26d34679 P 8dfed99448174185ba5ece679e9d90be [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
W20260709 13:03:58.749482 12042 consensus_peers.cc:597] T 5078275d4ea64e67bf0a061eb3011157 P 8dfed99448174185ba5ece679e9d90be -> Peer 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337): Couldn't send request to peer 367d36143adf465b950244c6baa620a5. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46337: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:58.749854 12382 leader_election.cc:290] T 175f2fe459f4455386cac7de26d34679 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131), 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337)
W20260709 13:03:58.755741 12042 leader_election.cc:336] T 175f2fe459f4455386cac7de26d34679 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46337: connect: Connection refused (error 111)
W20260709 13:03:58.760113 12043 leader_election.cc:336] T 175f2fe459f4455386cac7de26d34679 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131): Network error: Client connection negotiation failed: client connection to 127.0.107.193:46131: connect: Connection refused (error 111)
I20260709 13:03:58.760604 12043 leader_election.cc:304] T 175f2fe459f4455386cac7de26d34679 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dfed99448174185ba5ece679e9d90be; no voters: 367d36143adf465b950244c6baa620a5, bd1c07cda9da4436b69174af3a1ce92f
I20260709 13:03:58.761392 12382 raft_consensus.cc:2749] T 175f2fe459f4455386cac7de26d34679 P 8dfed99448174185ba5ece679e9d90be [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:03:58.767686 12042 consensus_peers.cc:597] T d2a9a34c1be443a69f95f8f237dc4116 P 8dfed99448174185ba5ece679e9d90be -> Peer 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337): Couldn't send request to peer 367d36143adf465b950244c6baa620a5. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46337: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:58.785750 12387 raft_consensus.cc:493] T 196209061a514376bb68b340c922a883 P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bd1c07cda9da4436b69174af3a1ce92f)
I20260709 13:03:58.786482 12387 raft_consensus.cc:515] T 196209061a514376bb68b340c922a883 P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:58.789017 12387 leader_election.cc:290] T 196209061a514376bb68b340c922a883 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131), 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337)
W20260709 13:03:58.793805 12042 leader_election.cc:336] T 196209061a514376bb68b340c922a883 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46337: connect: Connection refused (error 111)
W20260709 13:03:58.794423 12043 leader_election.cc:336] T 196209061a514376bb68b340c922a883 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131): Network error: Client connection negotiation failed: client connection to 127.0.107.193:46131: connect: Connection refused (error 111)
I20260709 13:03:58.794963 12043 leader_election.cc:304] T 196209061a514376bb68b340c922a883 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dfed99448174185ba5ece679e9d90be; no voters: 367d36143adf465b950244c6baa620a5, bd1c07cda9da4436b69174af3a1ce92f
I20260709 13:03:58.795713 12387 raft_consensus.cc:2749] T 196209061a514376bb68b340c922a883 P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:58.822595 12387 raft_consensus.cc:493] T 7f973c97455b4d918d353553cbe194a9 P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 367d36143adf465b950244c6baa620a5)
I20260709 13:03:58.823230 12387 raft_consensus.cc:515] T 7f973c97455b4d918d353553cbe194a9 P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:58.828065 12387 leader_election.cc:290] T 7f973c97455b4d918d353553cbe194a9 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131), 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337)
W20260709 13:03:58.830502 12042 leader_election.cc:336] T 7f973c97455b4d918d353553cbe194a9 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46337: connect: Connection refused (error 111)
W20260709 13:03:58.831005 12043 leader_election.cc:336] T 7f973c97455b4d918d353553cbe194a9 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131): Network error: Client connection negotiation failed: client connection to 127.0.107.193:46131: connect: Connection refused (error 111)
I20260709 13:03:58.831441 12043 leader_election.cc:304] T 7f973c97455b4d918d353553cbe194a9 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dfed99448174185ba5ece679e9d90be; no voters: 367d36143adf465b950244c6baa620a5, bd1c07cda9da4436b69174af3a1ce92f
I20260709 13:03:58.832213 12387 raft_consensus.cc:2749] T 7f973c97455b4d918d353553cbe194a9 P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:58.845357 12387 raft_consensus.cc:493] T b5d801f325be415db1d2961ed3876b90 P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 367d36143adf465b950244c6baa620a5)
I20260709 13:03:58.845937 12387 raft_consensus.cc:515] T b5d801f325be415db1d2961ed3876b90 P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:58.851377 12387 leader_election.cc:290] T b5d801f325be415db1d2961ed3876b90 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131), 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337)
W20260709 13:03:58.854558 12042 leader_election.cc:336] T b5d801f325be415db1d2961ed3876b90 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46337: connect: Connection refused (error 111)
W20260709 13:03:58.858906 12043 leader_election.cc:336] T b5d801f325be415db1d2961ed3876b90 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131): Network error: Client connection negotiation failed: client connection to 127.0.107.193:46131: connect: Connection refused (error 111)
I20260709 13:03:58.859419 12043 leader_election.cc:304] T b5d801f325be415db1d2961ed3876b90 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dfed99448174185ba5ece679e9d90be; no voters: 367d36143adf465b950244c6baa620a5, bd1c07cda9da4436b69174af3a1ce92f
I20260709 13:03:58.860191 12387 raft_consensus.cc:2749] T b5d801f325be415db1d2961ed3876b90 P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:58.875603 12387 raft_consensus.cc:493] T 65544e18a6944de89c1560f44aaf32ec P 8dfed99448174185ba5ece679e9d90be [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bd1c07cda9da4436b69174af3a1ce92f)
I20260709 13:03:58.876274 12387 raft_consensus.cc:515] T 65544e18a6944de89c1560f44aaf32ec P 8dfed99448174185ba5ece679e9d90be [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:58.878490 12387 leader_election.cc:290] T 65544e18a6944de89c1560f44aaf32ec P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131), 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337)
W20260709 13:03:58.883574 12042 leader_election.cc:336] T 65544e18a6944de89c1560f44aaf32ec P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46337: connect: Connection refused (error 111)
W20260709 13:03:58.884654 12043 leader_election.cc:336] T 65544e18a6944de89c1560f44aaf32ec P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131): Network error: Client connection negotiation failed: client connection to 127.0.107.193:46131: connect: Connection refused (error 111)
I20260709 13:03:58.885165 12043 leader_election.cc:304] T 65544e18a6944de89c1560f44aaf32ec P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dfed99448174185ba5ece679e9d90be; no voters: 367d36143adf465b950244c6baa620a5, bd1c07cda9da4436b69174af3a1ce92f
I20260709 13:03:58.886441 12387 raft_consensus.cc:2749] T 65544e18a6944de89c1560f44aaf32ec P 8dfed99448174185ba5ece679e9d90be [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:58.919174 12387 raft_consensus.cc:493] T 13ef79ebfe4f45b9bd9763de63a3e15a P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bd1c07cda9da4436b69174af3a1ce92f)
I20260709 13:03:58.919883 12387 raft_consensus.cc:515] T 13ef79ebfe4f45b9bd9763de63a3e15a P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:58.924810 12387 leader_election.cc:290] T 13ef79ebfe4f45b9bd9763de63a3e15a P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131), 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337)
W20260709 13:03:58.927407 12042 leader_election.cc:336] T 13ef79ebfe4f45b9bd9763de63a3e15a P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46337: connect: Connection refused (error 111)
W20260709 13:03:58.928071 12043 leader_election.cc:336] T 13ef79ebfe4f45b9bd9763de63a3e15a P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131): Network error: Client connection negotiation failed: client connection to 127.0.107.193:46131: connect: Connection refused (error 111)
I20260709 13:03:58.928566 12043 leader_election.cc:304] T 13ef79ebfe4f45b9bd9763de63a3e15a P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dfed99448174185ba5ece679e9d90be; no voters: 367d36143adf465b950244c6baa620a5, bd1c07cda9da4436b69174af3a1ce92f
I20260709 13:03:58.929731 12387 raft_consensus.cc:2749] T 13ef79ebfe4f45b9bd9763de63a3e15a P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:03:58.984977   431 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 12025)
W20260709 13:03:58.988040 12042 consensus_peers.cc:597] T 95bf609349e54fdd867e40d7fd578e52 P 8dfed99448174185ba5ece679e9d90be -> Peer 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337): Couldn't send request to peer 367d36143adf465b950244c6baa620a5. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46337: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:59.000104 12387 raft_consensus.cc:493] T 03ae675fe38f4f2b96936940980c1ee9 P 8dfed99448174185ba5ece679e9d90be [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 367d36143adf465b950244c6baa620a5)
I20260709 13:03:59.000854 12387 raft_consensus.cc:515] T 03ae675fe38f4f2b96936940980c1ee9 P 8dfed99448174185ba5ece679e9d90be [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:59.003266 12387 leader_election.cc:290] T 03ae675fe38f4f2b96936940980c1ee9 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131), 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337)
W20260709 13:03:59.008371 12042 leader_election.cc:336] T 03ae675fe38f4f2b96936940980c1ee9 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46337: connect: Connection refused (error 111)
W20260709 13:03:59.009040 12043 leader_election.cc:336] T 03ae675fe38f4f2b96936940980c1ee9 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131): Network error: Client connection negotiation failed: client connection to 127.0.107.193:46131: connect: Connection refused (error 111)
I20260709 13:03:59.009496 12043 leader_election.cc:304] T 03ae675fe38f4f2b96936940980c1ee9 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dfed99448174185ba5ece679e9d90be; no voters: 367d36143adf465b950244c6baa620a5, bd1c07cda9da4436b69174af3a1ce92f
I20260709 13:03:59.010644 12387 raft_consensus.cc:2749] T 03ae675fe38f4f2b96936940980c1ee9 P 8dfed99448174185ba5ece679e9d90be [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:59.016702 12387 raft_consensus.cc:493] T b8baeafde60b486094f5139efec7eca0 P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bd1c07cda9da4436b69174af3a1ce92f)
I20260709 13:03:59.017261 12387 raft_consensus.cc:515] T b8baeafde60b486094f5139efec7eca0 P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:59.019562 12387 leader_election.cc:290] T b8baeafde60b486094f5139efec7eca0 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131), 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337)
W20260709 13:03:59.024770 12042 leader_election.cc:336] T b8baeafde60b486094f5139efec7eca0 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46337: connect: Connection refused (error 111)
W20260709 13:03:59.025296 12043 leader_election.cc:336] T b8baeafde60b486094f5139efec7eca0 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131): Network error: Client connection negotiation failed: client connection to 127.0.107.193:46131: connect: Connection refused (error 111)
I20260709 13:03:59.025745 12043 leader_election.cc:304] T b8baeafde60b486094f5139efec7eca0 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dfed99448174185ba5ece679e9d90be; no voters: 367d36143adf465b950244c6baa620a5, bd1c07cda9da4436b69174af3a1ce92f
I20260709 13:03:59.026448 12387 raft_consensus.cc:2749] T b8baeafde60b486094f5139efec7eca0 P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:59.031965 12387 raft_consensus.cc:493] T bda83ed4e6b84bf9985ad11c37b2bd59 P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 367d36143adf465b950244c6baa620a5)
I20260709 13:03:59.032692 12387 raft_consensus.cc:515] T bda83ed4e6b84bf9985ad11c37b2bd59 P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:59.035096 12387 leader_election.cc:290] T bda83ed4e6b84bf9985ad11c37b2bd59 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131), 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337)
W20260709 13:03:59.039851 12043 leader_election.cc:336] T bda83ed4e6b84bf9985ad11c37b2bd59 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131): Network error: Client connection negotiation failed: client connection to 127.0.107.193:46131: connect: Connection refused (error 111)
W20260709 13:03:59.040360 12042 leader_election.cc:336] T bda83ed4e6b84bf9985ad11c37b2bd59 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46337: connect: Connection refused (error 111)
I20260709 13:03:59.040838 12042 leader_election.cc:304] T bda83ed4e6b84bf9985ad11c37b2bd59 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dfed99448174185ba5ece679e9d90be; no voters: 367d36143adf465b950244c6baa620a5, bd1c07cda9da4436b69174af3a1ce92f
I20260709 13:03:59.042183 12382 raft_consensus.cc:2749] T bda83ed4e6b84bf9985ad11c37b2bd59 P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:59.042868 12382 raft_consensus.cc:493] T 8b0eaec7710c47e79cc78a1085de9b3f P 8dfed99448174185ba5ece679e9d90be [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bd1c07cda9da4436b69174af3a1ce92f)
I20260709 13:03:59.043350 12382 raft_consensus.cc:515] T 8b0eaec7710c47e79cc78a1085de9b3f P 8dfed99448174185ba5ece679e9d90be [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } }
I20260709 13:03:59.045609 12382 leader_election.cc:290] T 8b0eaec7710c47e79cc78a1085de9b3f P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337), bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131)
W20260709 13:03:59.050253 12042 leader_election.cc:336] T 8b0eaec7710c47e79cc78a1085de9b3f P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46337: connect: Connection refused (error 111)
W20260709 13:03:59.050889 12043 leader_election.cc:336] T 8b0eaec7710c47e79cc78a1085de9b3f P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131): Network error: Client connection negotiation failed: client connection to 127.0.107.193:46131: connect: Connection refused (error 111)
I20260709 13:03:59.051362 12043 leader_election.cc:304] T 8b0eaec7710c47e79cc78a1085de9b3f P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dfed99448174185ba5ece679e9d90be; no voters: 367d36143adf465b950244c6baa620a5, bd1c07cda9da4436b69174af3a1ce92f
I20260709 13:03:59.052106 12382 raft_consensus.cc:2749] T 8b0eaec7710c47e79cc78a1085de9b3f P 8dfed99448174185ba5ece679e9d90be [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:59.211149 12382 raft_consensus.cc:493] T 93c0155ffb2b44fab1eed91e0025ef62 P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bd1c07cda9da4436b69174af3a1ce92f)
I20260709 13:03:59.211751 12382 raft_consensus.cc:515] T 93c0155ffb2b44fab1eed91e0025ef62 P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:59.214089 12382 leader_election.cc:290] T 93c0155ffb2b44fab1eed91e0025ef62 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131), 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337)
W20260709 13:03:59.219347 12043 leader_election.cc:336] T 93c0155ffb2b44fab1eed91e0025ef62 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131): Network error: Client connection negotiation failed: client connection to 127.0.107.193:46131: connect: Connection refused (error 111)
W20260709 13:03:59.220654 12042 leader_election.cc:336] T 93c0155ffb2b44fab1eed91e0025ef62 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46337: connect: Connection refused (error 111)
I20260709 13:03:59.221184 12042 leader_election.cc:304] T 93c0155ffb2b44fab1eed91e0025ef62 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dfed99448174185ba5ece679e9d90be; no voters: 367d36143adf465b950244c6baa620a5, bd1c07cda9da4436b69174af3a1ce92f
I20260709 13:03:59.221915 12382 raft_consensus.cc:2749] T 93c0155ffb2b44fab1eed91e0025ef62 P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:59.292438 12382 raft_consensus.cc:493] T 0ac98551cc1c458e8e95be2e9f1ddeac P 8dfed99448174185ba5ece679e9d90be [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 367d36143adf465b950244c6baa620a5)
I20260709 13:03:59.293047 12382 raft_consensus.cc:515] T 0ac98551cc1c458e8e95be2e9f1ddeac P 8dfed99448174185ba5ece679e9d90be [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:59.295460 12382 leader_election.cc:290] T 0ac98551cc1c458e8e95be2e9f1ddeac P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131), 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337)
W20260709 13:03:59.301841 12042 leader_election.cc:336] T 0ac98551cc1c458e8e95be2e9f1ddeac P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46337: connect: Connection refused (error 111)
W20260709 13:03:59.302362 12043 leader_election.cc:336] T 0ac98551cc1c458e8e95be2e9f1ddeac P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131): Network error: Client connection negotiation failed: client connection to 127.0.107.193:46131: connect: Connection refused (error 111)
I20260709 13:03:59.302862 12043 leader_election.cc:304] T 0ac98551cc1c458e8e95be2e9f1ddeac P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dfed99448174185ba5ece679e9d90be; no voters: 367d36143adf465b950244c6baa620a5, bd1c07cda9da4436b69174af3a1ce92f
I20260709 13:03:59.304029 12382 raft_consensus.cc:2749] T 0ac98551cc1c458e8e95be2e9f1ddeac P 8dfed99448174185ba5ece679e9d90be [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:59.391191 12382 raft_consensus.cc:493] T 0fd34026fbe142c0898fd7ec29688648 P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 367d36143adf465b950244c6baa620a5)
I20260709 13:03:59.391814 12382 raft_consensus.cc:515] T 0fd34026fbe142c0898fd7ec29688648 P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:59.394145 12382 leader_election.cc:290] T 0fd34026fbe142c0898fd7ec29688648 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131), 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337)
I20260709 13:03:59.396508 12382 raft_consensus.cc:493] T b71ba69388bf42a88deaf32615d3b1b6 P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bd1c07cda9da4436b69174af3a1ce92f)
I20260709 13:03:59.397101 12382 raft_consensus.cc:515] T b71ba69388bf42a88deaf32615d3b1b6 P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd1c07cda9da4436b69174af3a1ce92f" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46131 } } peers { permanent_uuid: "367d36143adf465b950244c6baa620a5" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46337 } } peers { permanent_uuid: "8dfed99448174185ba5ece679e9d90be" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39279 } }
I20260709 13:03:59.400429 12382 leader_election.cc:290] T b71ba69388bf42a88deaf32615d3b1b6 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131), 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337)
W20260709 13:03:59.400751 12043 leader_election.cc:336] T 0fd34026fbe142c0898fd7ec29688648 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131): Network error: Client connection negotiation failed: client connection to 127.0.107.193:46131: connect: Connection refused (error 111)
W20260709 13:03:59.405916 12043 leader_election.cc:336] T b71ba69388bf42a88deaf32615d3b1b6 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bd1c07cda9da4436b69174af3a1ce92f (127.0.107.193:46131): Network error: Client connection negotiation failed: client connection to 127.0.107.193:46131: connect: Connection refused (error 111)
W20260709 13:03:59.406961 12042 leader_election.cc:336] T 0fd34026fbe142c0898fd7ec29688648 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46337: connect: Connection refused (error 111)
I20260709 13:03:59.407495 12042 leader_election.cc:304] T 0fd34026fbe142c0898fd7ec29688648 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dfed99448174185ba5ece679e9d90be; no voters: 367d36143adf465b950244c6baa620a5, bd1c07cda9da4436b69174af3a1ce92f
I20260709 13:03:59.408228 12382 raft_consensus.cc:2749] T 0fd34026fbe142c0898fd7ec29688648 P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:03:59.411152 12042 leader_election.cc:336] T b71ba69388bf42a88deaf32615d3b1b6 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 367d36143adf465b950244c6baa620a5 (127.0.107.194:46337): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46337: connect: Connection refused (error 111)
I20260709 13:03:59.411581 12042 leader_election.cc:304] T b71ba69388bf42a88deaf32615d3b1b6 P 8dfed99448174185ba5ece679e9d90be [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dfed99448174185ba5ece679e9d90be; no voters: 367d36143adf465b950244c6baa620a5, bd1c07cda9da4436b69174af3a1ce92f
I20260709 13:03:59.412307 12382 raft_consensus.cc:2749] T b71ba69388bf42a88deaf32615d3b1b6 P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:59.854034   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
I20260709 13:03:59.905138   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
I20260709 13:03:59.943948   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:59.944749   431 tablet_replica.cc:333] T 65544e18a6944de89c1560f44aaf32ec P 8dfed99448174185ba5ece679e9d90be: stopping tablet replica
I20260709 13:03:59.945520   431 raft_consensus.cc:2243] T 65544e18a6944de89c1560f44aaf32ec P 8dfed99448174185ba5ece679e9d90be [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:59.946072   431 raft_consensus.cc:2272] T 65544e18a6944de89c1560f44aaf32ec P 8dfed99448174185ba5ece679e9d90be [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.948805   431 tablet_replica.cc:333] T 13ef79ebfe4f45b9bd9763de63a3e15a P 8dfed99448174185ba5ece679e9d90be: stopping tablet replica
I20260709 13:03:59.949558   431 raft_consensus.cc:2243] T 13ef79ebfe4f45b9bd9763de63a3e15a P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:59.950148   431 raft_consensus.cc:2272] T 13ef79ebfe4f45b9bd9763de63a3e15a P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.952455   431 tablet_replica.cc:333] T 93c0155ffb2b44fab1eed91e0025ef62 P 8dfed99448174185ba5ece679e9d90be: stopping tablet replica
I20260709 13:03:59.953039   431 raft_consensus.cc:2243] T 93c0155ffb2b44fab1eed91e0025ef62 P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:59.953526   431 raft_consensus.cc:2272] T 93c0155ffb2b44fab1eed91e0025ef62 P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.955708   431 tablet_replica.cc:333] T b5d801f325be415db1d2961ed3876b90 P 8dfed99448174185ba5ece679e9d90be: stopping tablet replica
I20260709 13:03:59.956247   431 raft_consensus.cc:2243] T b5d801f325be415db1d2961ed3876b90 P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:59.956708   431 raft_consensus.cc:2272] T b5d801f325be415db1d2961ed3876b90 P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.958822   431 tablet_replica.cc:333] T b71ba69388bf42a88deaf32615d3b1b6 P 8dfed99448174185ba5ece679e9d90be: stopping tablet replica
I20260709 13:03:59.959365   431 raft_consensus.cc:2243] T b71ba69388bf42a88deaf32615d3b1b6 P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:59.959859   431 raft_consensus.cc:2272] T b71ba69388bf42a88deaf32615d3b1b6 P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.961808   431 tablet_replica.cc:333] T 0ac98551cc1c458e8e95be2e9f1ddeac P 8dfed99448174185ba5ece679e9d90be: stopping tablet replica
I20260709 13:03:59.962369   431 raft_consensus.cc:2243] T 0ac98551cc1c458e8e95be2e9f1ddeac P 8dfed99448174185ba5ece679e9d90be [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:59.962903   431 raft_consensus.cc:2272] T 0ac98551cc1c458e8e95be2e9f1ddeac P 8dfed99448174185ba5ece679e9d90be [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.964901   431 tablet_replica.cc:333] T 0fd34026fbe142c0898fd7ec29688648 P 8dfed99448174185ba5ece679e9d90be: stopping tablet replica
I20260709 13:03:59.965422   431 raft_consensus.cc:2243] T 0fd34026fbe142c0898fd7ec29688648 P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:59.965865   431 raft_consensus.cc:2272] T 0fd34026fbe142c0898fd7ec29688648 P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.968048   431 tablet_replica.cc:333] T 175f2fe459f4455386cac7de26d34679 P 8dfed99448174185ba5ece679e9d90be: stopping tablet replica
I20260709 13:03:59.968600   431 raft_consensus.cc:2243] T 175f2fe459f4455386cac7de26d34679 P 8dfed99448174185ba5ece679e9d90be [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:59.969040   431 raft_consensus.cc:2272] T 175f2fe459f4455386cac7de26d34679 P 8dfed99448174185ba5ece679e9d90be [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.971086   431 tablet_replica.cc:333] T 95bf609349e54fdd867e40d7fd578e52 P 8dfed99448174185ba5ece679e9d90be: stopping tablet replica
I20260709 13:03:59.971619   431 raft_consensus.cc:2243] T 95bf609349e54fdd867e40d7fd578e52 P 8dfed99448174185ba5ece679e9d90be [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:59.972363   431 raft_consensus.cc:2272] T 95bf609349e54fdd867e40d7fd578e52 P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.974628   431 tablet_replica.cc:333] T a846ec1843bc4dbca0df61be2992759d P 8dfed99448174185ba5ece679e9d90be: stopping tablet replica
I20260709 13:03:59.975183   431 raft_consensus.cc:2243] T a846ec1843bc4dbca0df61be2992759d P 8dfed99448174185ba5ece679e9d90be [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:03:59.975937   431 raft_consensus.cc:2272] T a846ec1843bc4dbca0df61be2992759d P 8dfed99448174185ba5ece679e9d90be [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.978226   431 tablet_replica.cc:333] T 196209061a514376bb68b340c922a883 P 8dfed99448174185ba5ece679e9d90be: stopping tablet replica
I20260709 13:03:59.978847   431 raft_consensus.cc:2243] T 196209061a514376bb68b340c922a883 P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:59.979310   431 raft_consensus.cc:2272] T 196209061a514376bb68b340c922a883 P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.981598   431 tablet_replica.cc:333] T d2a9a34c1be443a69f95f8f237dc4116 P 8dfed99448174185ba5ece679e9d90be: stopping tablet replica
I20260709 13:03:59.982124   431 raft_consensus.cc:2243] T d2a9a34c1be443a69f95f8f237dc4116 P 8dfed99448174185ba5ece679e9d90be [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:59.982933   431 raft_consensus.cc:2272] T d2a9a34c1be443a69f95f8f237dc4116 P 8dfed99448174185ba5ece679e9d90be [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.985008   431 tablet_replica.cc:333] T 7f973c97455b4d918d353553cbe194a9 P 8dfed99448174185ba5ece679e9d90be: stopping tablet replica
I20260709 13:03:59.985530   431 raft_consensus.cc:2243] T 7f973c97455b4d918d353553cbe194a9 P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:59.985920   431 raft_consensus.cc:2272] T 7f973c97455b4d918d353553cbe194a9 P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.988217   431 tablet_replica.cc:333] T b8baeafde60b486094f5139efec7eca0 P 8dfed99448174185ba5ece679e9d90be: stopping tablet replica
I20260709 13:03:59.988750   431 raft_consensus.cc:2243] T b8baeafde60b486094f5139efec7eca0 P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:59.989221   431 raft_consensus.cc:2272] T b8baeafde60b486094f5139efec7eca0 P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.991597   431 tablet_replica.cc:333] T 8b0eaec7710c47e79cc78a1085de9b3f P 8dfed99448174185ba5ece679e9d90be: stopping tablet replica
I20260709 13:03:59.992087   431 raft_consensus.cc:2243] T 8b0eaec7710c47e79cc78a1085de9b3f P 8dfed99448174185ba5ece679e9d90be [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:59.992571   431 raft_consensus.cc:2272] T 8b0eaec7710c47e79cc78a1085de9b3f P 8dfed99448174185ba5ece679e9d90be [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.995108   431 tablet_replica.cc:333] T 03ae675fe38f4f2b96936940980c1ee9 P 8dfed99448174185ba5ece679e9d90be: stopping tablet replica
I20260709 13:03:59.995641   431 raft_consensus.cc:2243] T 03ae675fe38f4f2b96936940980c1ee9 P 8dfed99448174185ba5ece679e9d90be [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:59.996086   431 raft_consensus.cc:2272] T 03ae675fe38f4f2b96936940980c1ee9 P 8dfed99448174185ba5ece679e9d90be [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.998250   431 tablet_replica.cc:333] T bda83ed4e6b84bf9985ad11c37b2bd59 P 8dfed99448174185ba5ece679e9d90be: stopping tablet replica
I20260709 13:03:59.998764   431 raft_consensus.cc:2243] T bda83ed4e6b84bf9985ad11c37b2bd59 P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:59.999208   431 raft_consensus.cc:2272] T bda83ed4e6b84bf9985ad11c37b2bd59 P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:00.001389   431 tablet_replica.cc:333] T 5078275d4ea64e67bf0a061eb3011157 P 8dfed99448174185ba5ece679e9d90be: stopping tablet replica
I20260709 13:04:00.001855   431 raft_consensus.cc:2243] T 5078275d4ea64e67bf0a061eb3011157 P 8dfed99448174185ba5ece679e9d90be [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:00.002681   431 raft_consensus.cc:2272] T 5078275d4ea64e67bf0a061eb3011157 P 8dfed99448174185ba5ece679e9d90be [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:00.045154   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 13:04:00.083300   431 master.cc:562] Master@127.0.107.254:40505 shutting down...
I20260709 13:04:00.111353   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 952ff105c515428bad47a809ce3c645b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:00.112075   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 952ff105c515428bad47a809ce3c645b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:00.112479   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P 952ff105c515428bad47a809ce3c645b: stopping tablet replica
I20260709 13:04:00.460150   431 master.cc:584] Master@127.0.107.254:40505 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (15741 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (27986 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (348596 ms total)
[  PASSED  ] 8 tests.
I20260709 13:04:00.510787   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 548 messages since previous log ~530 seconds ago
I20260709 13:04:00.511027   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 555 messages since previous log ~530 seconds ago
I20260709 13:04:00.511229   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 555 messages since previous log ~530 seconds ago
I20260709 13:04:00.511431   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~38 seconds ago
I20260709 13:04:00.511626   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~38 seconds ago
I20260709 13:04:00.511809   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/consensus/raft_consensus.cc:670: suppressed but not reported on 3 messages since previous log ~227 seconds ago
I20260709 13:04:00.512084   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 128 messages since previous log ~4 seconds ago
I20260709 13:04:00.512364   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 53 messages since previous log ~14 seconds ago
